We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug For some GGUF models, the app crashes, even for very small one like the new DeepSeek-R1-Distill-Gwen-1.5b
To Reproduce Load GGUF.
Expected behavior Model loads
Environment (please complete the following information):
The text was updated successfully, but these errors were encountered:
Here is an example model that should work but crashes:
https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-7B-GGUF
Sorry, something went wrong.
same here, device Xiaomi 12s ultra, android 14
this PR #177 adds support for Depseek r1 models. The releases are being built as soon as they are our will let you know.
see this #178
Awesome, Asghar! I love that visually discinct rendering of the thought-process is already implemented.
Successfully merging a pull request may close this issue.
Describe the bug
For some GGUF models, the app crashes, even for very small one like the new DeepSeek-R1-Distill-Gwen-1.5b
To Reproduce
Load GGUF.
Expected behavior
Model loads
Environment (please complete the following information):
The text was updated successfully, but these errors were encountered: