-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix: remove incremental done steps #2283
fix: remove incremental done steps #2283
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
a little complicated because this value is used in the LettaStreamingResponse return value which is a union of different types, so wasn't able to just directly use the constant everywhere. this has the implication that LettaStreamingResponse can no longer be used in isinstance checks since StreamDoneStatus is not a class
eb117a9
to
c1309cf
Compare
Example
|
Example
|
Only comment: both |
Patched:
|
Deprecated in favor of #2297 |
Re-implemented here: https://github.com/letta-ai/letta-cloud/pull/504 |
Please describe the purpose of this pull request.
don't stream done tokens in between multi step requests, only support the final done token
How to test
How can we test your PR during review? What commands should we run? What outcomes should we expect?
poetry run pytest -s -vv tests/test_client_legacy.py::test_streaming_send_message
Have you tested this PR?
Have you tested the latest commit on the PR? If so please provide outputs from your tests.
Related issues or PRs
Please link any related GitHub issues or PRs.
Is your PR over 500 lines of code?
If so, please break up your PR into multiple smaller PRs so that we can review them quickly, or provide justification for its length.
Additional context
Add any other context or screenshots about the PR here.