-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add support for prompt adapters #21
Conversation
30e6edd
to
021112d
Compare
8e2519a
to
5e98135
Compare
You can now test this by setting https://github.com/opendatahub-io/vllm-tgis-adapter/blob/main/.github/workflows/tests.yaml#L33-L37 vllm_version:
# - "" # skip the pypi version as it will not work on CPU
- "git+https://github.com/vllm-project/vllm@v0.5.0.post1"
- "git+https://github.com/vllm-project/vllm@main"
- "git+https://github.com/opendatahub-io/vllm@main"
+ - "git+https://github.com/SwapnilDreams100/vllm@main" |
39298fa
to
1b32336
Compare
1b32336
to
0e13eac
Compare
@prashantgupta24 with the last push:
|
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #21 +/- ##
==========================================
+ Coverage 63.16% 63.58% +0.42%
==========================================
Files 18 18
Lines 1208 1211 +3
Branches 213 213
==========================================
+ Hits 763 770 +7
+ Misses 372 370 -2
+ Partials 73 71 -2 ☔ View full report in Codecov by Sentry. |
0e13eac
to
b232f9e
Compare
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Depends on upstream PR - vllm-project/vllm#4645