We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The text was updated successfully, but these errors were encountered:
if somebody used us assuming we'd return a stream (generator object i believe) and we returned a dict, we'd break in code for them.
Sorry, something went wrong.
Does this need a separate model flag, e.g., supports_streaming = True, to distinguish?
supports_streaming = True
Not really - we already have a customstreamwrapper, we can just add this as default logic and send all model results there if stream=true
done
No branches or pull requests
The text was updated successfully, but these errors were encountered: