Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to Index Model error mlx-community/Mamba-Codestral-7B-v0.1-8bit #33

Open
YorkieDev opened this issue Nov 8, 2024 · 1 comment
Assignees
Labels
bug Something isn't working fixed-in-next-release The next release of LM Studio fixes this issue

Comments

@YorkieDev
Copy link

YorkieDev commented Nov 8, 2024

LM Studio Version: 0.3.5(Build 4)
Sys Info: M3 Max 128gb, MacOS 14.3
Model link: https://huggingface.co/mlx-community/Mamba-Codestral-7B-v0.1-8bit

After downloading the Mamba-Codestral 7b I got a "Failed to Index Model" error "Unexpected token 'I', ...",
Infinity
"... is not valid JSON"

Steps to Repro:

  • Download Model from URL above
  • Head to your My Models tab
  • Observe error at top of My Models tab

Assuming either the model needs requanting, or the MLX engine needs an upgrade?

@neilmehta24 neilmehta24 self-assigned this Nov 8, 2024
@neilmehta24 neilmehta24 added bug Something isn't working to-investigate Needs looking into labels Nov 8, 2024
@neilmehta24
Copy link
Member

Thanks for reporting this. We need to update LM Studio's JSON parsing logic. This error will be fixed in the next version of LM Studio.

@neilmehta24 neilmehta24 added fixed-in-next-release The next release of LM Studio fixes this issue and removed to-investigate Needs looking into labels Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working fixed-in-next-release The next release of LM Studio fixes this issue
Projects
None yet
Development

No branches or pull requests

2 participants