Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Async consumers support #188

Merged
merged 6 commits into from
Dec 4, 2024
Merged

Async consumers support #188

merged 6 commits into from
Dec 4, 2024

Conversation

NeonKirill
Copy link
Contributor

Added support for async consumers via Chatbots v2 API

- Dropped support for Python 3.7
- Updated requirements
@NeonKirill NeonKirill force-pushed the async_consumers_support branch from 58ce55c to dcd2450 Compare December 3, 2024 22:06
@NeonKirill NeonKirill requested a review from NeonDaniel December 3, 2024 22:23
Copy link
Member

@NeonDaniel NeonDaniel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Read through changes and tested by building/deploying ghcr.io/neongeckocom/neon-llm-vllm:alpha with this branch

Comment on lines +2 to +3
klat-connector==0.6.2a15
neon-mq-connector==0.7.2a5
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Consider leaving these as:

klat-connector~=0.6,>=0.6.2a15
neon-mq-connector~=0.7,>=0.7.2a5

so that they don't need to be updated for each release of these dependencies

@NeonKirill NeonKirill merged commit e1c3d21 into dev Dec 4, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants