Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for Phi-2 #381

Closed
nndnnv opened this issue Dec 21, 2023 · 3 comments
Closed

Support for Phi-2 #381

nndnnv opened this issue Dec 21, 2023 · 3 comments
Labels
enhancement New feature or request

Comments

@nndnnv
Copy link

nndnnv commented Dec 21, 2023 •
edited by martindevans
Loading

Tried running phi-2 model, got this error:
error loading model: unknown model architecture: 'phi2'

llama.cpp already added support for Phi-2 model, so I guess a new LLamaSharp version (with updated llama.cpp binary) should add support as well, correct?

ggml-org/llama.cpp#4490
@martindevans
Copy link
Member

Yep we'll need to update the binaries to get support for Phi2. Latest update was last week (#361) (not yet released). So we'll probably pickup Phi2 support in another month or so at the next update.

@martindevans martindevans added the enhancement New feature or request label Dec 21, 2023
@martindevans martindevans mentioned this issue Jan 12, 2024
Closed
@martindevans
Copy link
Member

Should be resolved in #479

@martindevans
Copy link
Member

0.10.0 just released, which includes Phi2 support.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@martindevans @nndnnv