Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added Faraday to readme #5354

Merged
merged 1 commit into from
Feb 7, 2024
Merged

Added Faraday to readme #5354

merged 1 commit into from
Feb 7, 2024

Conversation

biw
Copy link
Contributor

@biw biw commented Feb 6, 2024

I saw that there was an update to add a few more llamas.cpp based projects and Faraday was missing, so I added it 😄

@longregen
Copy link
Contributor

I believe propietary projects should not be hidden between the rest of free, open source projects. Particularly, it feels like LMStudio is extremely closed-source, I believe it should not be listed; respectfully, I think this kind of PR could be seen as some sort of link farming.

@pacmanincarnate
Copy link

I believe propietary projects should not be hidden between the rest of free, open source projects. Particularly, it feels like LMStudio is extremely closed-source, I believe it should not be listed; respectfully, I think this kind of PR could be seen as some sort of link farming.

They are two of a not huge number of interfaces for running llama.cpp. I'm not sure you can really call it link farming. It's not like this isn't a core part of both projects.

@ggerganov
Copy link
Owner

Adding proprietary projects using llama.cpp to that list is fine. But in this case, how do we know that it is using llama.cpp? For example, LMStudio clearly states it on their homepage

@JohannesGaessler
Copy link
Collaborator

They don't directly say it but they only support GGUF models and on their website they have this image to guide quantization decisions:

quants

In this image they explicitly reference llama.cpp for the perplexity calculation. The other table information is also copied verbatim from llama.cpp. So my expectation very much is that Faraday internally uses llama.cpp for the model evaluation.

However, I also believe that the onus is not on the llama.cpp developers to investigate whether or not some other project makes use of the project. Ultimately this is all just conjecture. If the Faraday devs want to be listed they should make it clear whether or not they use llama.cpp.

@biw
Copy link
Contributor Author

biw commented Feb 6, 2024

Adding proprietary projects using llama.cpp to that list is fine. But in this case, how do we know that it is using llama.cpp? For example, LMStudio clearly states it on their homepage

This is a great point @ggerganov. I didn't notice till now that we didn't mention llama.cpp, that wasn't by design! I have added a callback to llama.cpp on our homepage 😄:
Screenshot 2024-02-06 at 1 29 33 PM

@ggerganov ggerganov merged commit 9a697d8 into ggerganov:master Feb 7, 2024
@cztomsik
Copy link
Contributor

cztomsik commented Feb 7, 2024

In that case, maybe you can also merge this one? :)
#4362

jordankanter pushed a commit to jordankanter/llama.cpp that referenced this pull request Mar 13, 2024
hodlen pushed a commit to hodlen/llama.cpp that referenced this pull request Apr 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants