ai-gateway

Here are 13 public repositories matching this topic...

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

gateway bedrock openai vertex-ai azure-openai llm langchain llmops anthropic openai-proxy litellm ai-gateway llm-gateway mcp-gateway

Updated Aug 6, 2025
Python

stacklok / codegate

Star

CodeGate: Security, Workspaces and Multiplexing for AI Agentic Frameworks

Updated Jun 5, 2025
Python

Kenza-AI / sagify

Star

LLMs and Machine Learning done easily

openai cohere sagemaker large-language-models llm generative-ai langchain llmops large-language-model anthropic langchain-python llm-inference open-source-llm ai-gateway

Updated Jul 30, 2025
Python

Portkey-AI / portkey-python-sdk

Star

Build reliable, secure, and production-ready AI apps easily.

mlops portkey llms llmops ai-gateway

Updated Jul 28, 2025
Python

trylonai / gateway

Star

The Open Source Firewall for LLMs. A self-hosted gateway to secure and control AI applications with powerful guardrails.

self-hosted ai-safety content-moderation pii-redaction prompt-injection llm-security ai-gateway llm-firewall llm-guardrails

Updated Jun 25, 2025
Python

BerriAI / litellm-pgvector

Star

vector-store litellm ai-gateway litellm-ai-gateway openai-vector-store vector-store-gateway

Updated Jul 18, 2025
Python

TU-Wien-dataLAB / aqueduct

Star

Aqueduct is a simple yet fully-featured AI gateway built on top of the LiteLLM Router SDK using Django.

api-gateway gateway openai llm openai-proxy llm-inference ai-gateway

Updated Aug 6, 2025
Python

Tanantor / langgate

Star

Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.