-
Notifications
You must be signed in to change notification settings - Fork 450
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] support qwen2 vl #1352
Comments
I eagerly look forward to the support for the qwen2-vl series models by sglang as soon as possible. Thanks! |
@ispobock's partner is currently working on it. |
I would like to know will sglang support qwen2 vl gptq-int4 release with more than one GPU? https://qwen.readthedocs.io/en/latest/quantization/gptq.html said vllm don't work and need padding and quantizated again. |
ref #1546 |
Checklist
Motivation
https://huggingface.co/collections/Qwen/qwen2-vl-66cee7455501d7126940800d
Related resources
No response
The text was updated successfully, but these errors were encountered: