Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the dotnet binding info. #1409

Merged
merged 1 commit into from
May 12, 2023

Conversation

AsakusaRinne
Copy link
Contributor

Hi, SciSharp STACK has made a C#/.NET Binding of llama.cpp, named LLamaSharp. May I kindly ask if it can be added to readme to let more dotnet users know it?

Currently it has provided the following features:

  1. Basic APIs, including getting the embeddings, tokenization and detokenization, loading and inferring the model, etc.
  2. Chat session, providing easy-to-use APIs to make a chat bot.
  3. Quantization, providing an API to quantize the model in C#.
  4. Integration of ASP.NET core, making it easy to deploy the chat service.
  5. One-click installation, without compiling llama.cpp or other manipulations.

SciSharp STACK developers will maintain it and follow up llama.cpp. I believe we can make this .NET Binding better with the great works of llama.cpp! :)

@ggerganov ggerganov merged commit 089b1c9 into ggerganov:master May 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants