Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CuDNN error #19

Closed
forslef opened this issue Nov 29, 2024 · 5 comments
Closed

CuDNN error #19

forslef opened this issue Nov 29, 2024 · 5 comments

Comments

@forslef
Copy link

forslef commented Nov 29, 2024

error looks like this: Could not locate cudnn_ops64_9.dll. Please make sure it is in your library path!
I downloaded CuDNN 8.7.0, checked the files and there is indeed no such file there.
I have cuda version 11.8.
Is it possible that one of the libraries has been updated and requires a different version of cuda and therefore a different version of cuDNN?
The LLM loads normally, but the error occurs only at the moment when the STT starts working, i.e. when I start speaking
I am inexperienced in such matters, so if I ask something stupid I apologize.

@kimjammer
Copy link
Owner

Hi there! It's not a dumb question, library problems are common in ml land. I think you have the right version of CUDA and CuDNN, so here is what I would try. In a separate environment, try installing KoljaB/RealtimeSTT and run one of their example programs to make sure its working. If that works, then try using the pipfreeze.txt to make sure we're using the same version of every library.

@forslef
Copy link
Author

forslef commented Dec 2, 2024

I created a separate environment where I installed RealTimeSTT, torch and torchaudio version 2.5.1 is installed by default, I ran simple_test.py and so everything works, but when I install version 2.5.1+cu118, the error appears, but asks for another file: ERROR:root:General error in transcription: Library cublas64_12.dll is not found or cannot be loaded
And with the version required by the project 2.2.2+cu118 the same error: Could not locate cudnn_ops64_9.dll. Please make sure it is in your library path!

I'm still pretty sure I have cuda 11.8 and cuDNN 8.7.0, and it seems to fit the requirements, so I have absolutely no idea what the cause could be. I also thought I might have specified something wrong in the environment variable, but that seems to be correct, but I'll attach a picture just in case.

Could it be because of old drivers for the videocard? I guess I haven't updated them in a long time, because nvidia servers are blocked in my region :(
SystemPropertiesAdvanced_bnXG9kwwQb

@Nenesh
Copy link

Nenesh commented Dec 3, 2024

The "Could not locate cudnn_ops64_9.dll" came from faster-whisper when using torch 2.2.2+cu118 . You need to downgrade ctranslate2 to 4.4.0 pip install ctranslate2==4.4.0
SYSTRAN/faster-whisper#1086

@jhj0517
Copy link

jhj0517 commented Dec 3, 2024

The realtimestt package depends on faster-whisper==1.0.3 which depends on ctranslate2==4.5.0.
It's recommended to use ctranslate2==4.5.0 with CUDA 12.4.

If you have to use CUDA 11.8, just downgrade to ctranslate2==4.4.0 as @Nenesh said.

@forslef
Copy link
Author

forslef commented Dec 3, 2024

Thank you all very much! After I did pip install ctranslate2==4.4.0, an error appeared because of faster-whisper,
I used the solution from here: jhj0517/Whisper-WebUI#102 (comment)
But faster-whisper of a different version installs tokenizer of a different version, so I had to reinstall it.
To summarize the procedure to solve this error:
pip install ctranslate2==4.4.0
pip install faster-whisper==0.10.1
pip install tokenizers==0.19.1

Thank you all!

@forslef forslef closed this as completed Dec 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants