-
Notifications
You must be signed in to change notification settings - Fork 10.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Added Faraday to readme #5354
Added Faraday to readme #5354
Conversation
I believe propietary projects should not be hidden between the rest of free, open source projects. Particularly, it feels like LMStudio is extremely closed-source, I believe it should not be listed; respectfully, I think this kind of PR could be seen as some sort of link farming. |
They are two of a not huge number of interfaces for running llama.cpp. I'm not sure you can really call it link farming. It's not like this isn't a core part of both projects. |
Adding proprietary projects using |
They don't directly say it but they only support GGUF models and on their website they have this image to guide quantization decisions: In this image they explicitly reference llama.cpp for the perplexity calculation. The other table information is also copied verbatim from llama.cpp. So my expectation very much is that Faraday internally uses llama.cpp for the model evaluation. However, I also believe that the onus is not on the llama.cpp developers to investigate whether or not some other project makes use of the project. Ultimately this is all just conjecture. If the Faraday devs want to be listed they should make it clear whether or not they use llama.cpp. |
This is a great point @ggerganov. I didn't notice till now that we didn't mention llama.cpp, that wasn't by design! I have added a callback to llama.cpp on our homepage 😄: |
In that case, maybe you can also merge this one? :) |
I saw that there was an update to add a few more llamas.cpp based projects and Faraday was missing, so I added it 😄