Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: App crashes when loading some GGUF files from Huggingface #175

Closed
Duxon opened this issue Jan 22, 2025 · 5 comments · Fixed by #177
Closed

[Bug]: App crashes when loading some GGUF files from Huggingface #175

Duxon opened this issue Jan 22, 2025 · 5 comments · Fixed by #177
Labels
bug Something isn't working

Comments

@Duxon
Copy link

Duxon commented Jan 22, 2025

Describe the bug
For some GGUF models, the app crashes, even for very small one like the new DeepSeek-R1-Distill-Gwen-1.5b

To Reproduce
Load GGUF.

Expected behavior
Model loads

Environment (please complete the following information):

  • Device: Pixel 9 Pro
  • OS: Android 15
@Duxon Duxon added the bug Something isn't working label Jan 22, 2025
@Duxon
Copy link
Author

Duxon commented Jan 22, 2025

Here is an example model that should work but crashes:

https://huggingface.co/unsloth/DeepSeek-R1-Distill-Qwen-7B-GGUF

@moonheart
Copy link

same here, device Xiaomi 12s ultra, android 14

@a-ghorbani
Copy link
Owner

this PR #177 adds support for Depseek r1 models. The releases are being built as soon as they are our will let you know.

@a-ghorbani
Copy link
Owner

see this #178

@Duxon
Copy link
Author

Duxon commented Jan 23, 2025

Awesome, Asghar! I love that visually discinct rendering of the thought-process is already implemented.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants