You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:1581:28: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:1656:16: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:1730:16: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:1835:16: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:1926:16: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:2003:16: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:2051:16: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:2108:16: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:2224:28: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:2225:16: error: use of undeclared identifier '__shfl_xor_sync'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:3771:33: error: use of undeclared identifier '__vcmpeq4'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:3772:33: error: use of undeclared identifier '__vcmpeq4'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:3773:28: error: use of undeclared identifier '__vsub4'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:3774:28: error: use of undeclared identifier '__vsub4'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:3782:33: error: use of undeclared identifier '__vcmpeq4'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:3783:33: error: use of undeclared identifier '__vcmpeq4'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:3784:28: error: use of undeclared identifier '__vsub4'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:3785:28: error: use of undeclared identifier '__vsub4'
/home/user/aphrodite-engine/kernels/quantization/gguf/gguf_kernel.hip:3808:28: error: use of undeclared identifier '__vsub4'
/home/user/aphrodite-engine/kernels/quantization/exl2/q_gemm_exl2.hip:120:9: error: no matching function for call to 'hipblasHgemm'
/home/user/aphrodite-engine/kernels/attention/../quantization/int8_kvcache/quant_utils_hip.cuh:210:12: error: no viable conversion from returned value of type 'const float' to function return type '__hip_bfloat16'
/home/user/aphrodite-engine/kernels/attention/attention_kernels.hip:235:23: error: no matching function for call to 'vec_conversion'
The text was updated successfully, but these errors were encountered:
I fixed some of them here, but I don't know if it actually works. It compiled after disabling gguf, squeezellm and gptq kernels, but then it fails while trying to run it.
Sorry I totally forgot about this issue. I have access to a navi GPU now so I will try and debug this. We will likely need to disable GGUF kernel compilation for non-nvidia GPUs. You can do this by moving the GGUF-related kernels in setup.py to the _is_cuda() block near the end.
Your current environment
How did you install Aphrodite?
It errors out
The text was updated successfully, but these errors were encountered: