Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

A cloud-native vector database, storage for next generation AI applications

The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️

AI driven development in your terminal. Designed for large, real-world tasks.

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

eBPF Observability - Distributed Tracing and Profiling

Small self-contained pure-Go web server with Lua, Teal, Markdown, Ollama, HTTP/2, QUIC, Redis, SQLite and PostgreSQL support ++

Spising: ⚡️Open-source AI LangChain-like RAG (Retrieval-Augmented Generation) knowledge database with web UI and Enterprise SSO⚡️, supports OpenAI, Azure, LLaMA, Google Gemini, HuggingFace, Claude, Grok, etc., chat bot demo: https://demo.casibase.com, admin UI demo: https://demo-admin.casibase.com

Zep: Long-Term Memory for ‍AI Assistants.

Distributed ML Training and Fine-Tuning on Kubernetes

AIdea 是一款支持 GPT 以及国产大语言模型通义千问、文心一言等，支持 Stable Diffusion 文生图、图生图、 SDXL1.0、超分辨率、图片上色的全能型 APP。

llama.go is like llama.cpp in pure Golang!

Local CLI Copilot, powered by CodeLLaMa. 💻🦙

✨ Kubectl plugin to create manifests with LLMs

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

Nvidia GPU exporter for prometheus using nvidia-smi binary

A secure low code honeypot framework, leveraging AI for System Virtualization.

Rate limiting, caching, and request prioritization for modern workloads

🪿 LinGoose is a Go framework for building awesome AI/LLM applications.