rust api wrapper for llm-inference chatllm.cpp
rust chatbot inference bindings api-wrapper llama quantization gemma mistral cpu-inference llm llms chatllm ggml llm-inference qwen
-
Updated
Nov 27, 2024 - Rust