You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I wanted to report this problem that I'm having when trying to load quantized models. Could someone give me a hand to see if I'm doing something wrong?
Describe the bug
Hello! First of all thank you for your work!
I wanted to report this problem that I'm having when trying to load quantized models. Could someone give me a hand to see if I'm doing something wrong?
To reproduce
Whisper.from_pretrained("ggml-model-whisper-small-q5_1.bin")
RuntimeError: src/whispercpp/context.cc#L69: c.wctx is not initialized
I also get the following log:
Expected behavior
The model should be loaded and it shouldn't crash
Environment
python: 3.10.12
OS: Ubuntu 22.04
The text was updated successfully, but these errors were encountered: