Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

awq_ext is not defined #34

Open
Yarflam opened this issue Oct 13, 2024 · 1 comment
Open

awq_ext is not defined #34

Yarflam opened this issue Oct 13, 2024 · 1 comment

Comments

@Yarflam
Copy link

Yarflam commented Oct 13, 2024

Hello

The module awq_ext can't be load:

image

I'm using CUDA 11.8, it's work with: transformers, unsloth and peft. Impossible to use it with awq/awq_ext.

When I try to execute pip install git+https://github.com/casper-hansen/AutoAWQ_kernels.git the install is never stop it.

  building 'awq_ext' extension
  creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/layernorm
  creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/position_embedding
  creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/quantization
  creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/vllm
  Emitting ninja build file /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/build.ninja...
  Compiling objects...
  Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
^C  Building wheel for autoawq_kernels (setup.py) ... canceled

How to fix this?

Thank you!

@Yarflam
Copy link
Author

Yarflam commented Oct 13, 2024

Maybe, it's the same error in this issue: #21

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant