Skip to content
This repository has been archived by the owner on Dec 6, 2023. It is now read-only.

Streaming support for Petals services #127

Merged

Conversation

biswaroop1547
Copy link
Collaborator

Fixes #114

Copy link
Collaborator

@filopedraz filopedraz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Docker build failed, but not necessary now. We can merge. What do you think @casperdcl?

@biswaroop1547 biswaroop1547 merged commit 8363a8a into premAI-io:main Nov 3, 2023
5 of 6 checks passed
@biswaroop1547 biswaroop1547 deleted the feat/cht-petals-streaming branch November 3, 2023 08:30
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Enable streaming response for Petals services
3 participants