You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm using CUDA 11.8, it's work with: transformers, unsloth and peft. Impossible to use it with awq/awq_ext.
When I try to execute pip install git+https://github.com/casper-hansen/AutoAWQ_kernels.git the install is never stop it.
building 'awq_ext' extension
creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/layernorm
creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/position_embedding
creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/quantization
creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/vllm
Emitting ninja build file /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
^C Building wheel for autoawq_kernels (setup.py) ... canceled
How to fix this?
Thank you!
The text was updated successfully, but these errors were encountered:
Hello
The module
awq_ext
can't be load:I'm using CUDA 11.8, it's work with:
transformers
,unsloth
andpeft
. Impossible to use it withawq
/awq_ext
.When I try to execute
pip install git+https://github.com/casper-hansen/AutoAWQ_kernels.git
the install is never stop it.How to fix this?
Thank you!
The text was updated successfully, but these errors were encountered: