A work in progress implementation of rust bindings to ggml (https://github.com/ggerganov/ggml) a c/c++ tensor library that has been used recently for portable inference of LLM on small devices. These bindings are adapated from a LLAMA implementation which used ggml under the hood (https://github.com/setzer22/llama-rs/tree/main/llama-rs)
-
Notifications
You must be signed in to change notification settings - Fork 2
michaelgiba/ggml-rs
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Work in progress rust bindings to ggml
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published