One-api one-api Some points for attention when configuring Xunfei Spark large model

Points to note when configuring Xunfei Xunhuo large model with one-api

  1. Xunfei Xinghuo large model does not have a non-stream model, when using AMA connection, first use other channel settings, then disable other channels, and enable Xunfei Xinghuo large model channel.
  2. Frequent timeout errors occur, and one-api/controller/relay-xunfei.gothe default timeout time in is 5 seconds, which is too short. Change HandshakeTimeout: 5 * time.Second,to HandshakeTimeout: 30 * time.Second,, and rebuild the container image.

end!

Guess you like

Origin blog.csdn.net/engchina/article/details/132401150