Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.
-
Updated
Aug 18, 2025 - Rust
Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.
Fullstack chatbot built using Rust. Made using Candle, Leptos, Actix, Tokio and Tailwind. Uses quantized Mistral 7B Instruct v0.1 GGUF models.
Local photo management with semantic search and face recognition
AI Project using RPi 5 SBC, Hugging Face Candle, GStreamer Framework, Eclipse Zenoh and K3s.
Add a description, image, and links to the huggingface-candle topic page so that developers can more easily learn about it.
To associate your repository with the huggingface-candle topic, visit your repo's landing page and select "manage topics."