Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create clear instructions for downloading and converting the models #644

Closed
edmundronald opened this issue Mar 31, 2023 · 2 comments
Closed
Labels
documentation Improvements or additions to documentation enhancement New feature or request

Comments

@edmundronald
Copy link

edmundronald commented Mar 31, 2023

Clear instructions are needed to allow new arrivals to download and convert the models, in spite of the multiple format versions (non quantised, quantised, various llama versions etc) .

I would suggest that each llama or alpaca etc print a version on startup, and that the conversions scripts have this in their name, and also that a program reading a file and figuring out what it is from a magic print the version read and the version expected even if it aborts.

Edmund

@gjmulder gjmulder added documentation Improvements or additions to documentation enhancement New feature or request labels Mar 31, 2023
@gjmulder
Copy link
Collaborator

There are extremely clear instructions on obtaining the LLaMA models at https://github.com/ggerganov/llama.cpp#obtaining-and-verifying-the-facebook-llama-original-model-and-stanford-alpaca-model-data

@sw
Copy link
Collaborator

sw commented May 3, 2023

Hello thumbs-down brigade!

Closing this as the README is quite clear in how to use llama.cpp. We don't distribute Facebook's model data, but there are alternatives. You may want to check out OpenLLaMA, though that doesn't quite seem to work with llama.cpp -> #1291

@sw sw closed this as not planned Won't fix, can't repro, duplicate, stale May 3, 2023
Deadsg pushed a commit to Deadsg/llama.cpp that referenced this issue Dec 19, 2023
Fix issue of missing words due to buffer overflow for Issue ggerganov#642
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants