Replies: 1 comment
-
I found the reason. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I deployed an openai-like interface myself, and it was normal for the interface to use OpenAI().chat.completions.create requests.
When the stream was true, the result returned by the interface was as follows:
ChatCompletionChunk(id='803319e9-8427-4789-8d85-a8fe4291436f', choices=[Choice(delta=ChoiceDelta(content='hello', function_call=None, role=None, tool_calls=None), finish_reason=None, index=0, logprobs=None)], created=1717588547, model='Qwen1.5-72B-Chat-GPTQ-Int4', object='chat.completion.chunk', system_fingerprint=None, usage=None)
But when I used OpenAI-API-compatible in dify, the result was empty.
The logs of openai-like interface showed that the request sended by dify was received and returned normally.
How can I solve this problem in dify? Is the parameter returned by the openai-like interface incorrect?
Beta Was this translation helpful? Give feedback.
All reactions