#Ai-gateway
Showing 48 of 48 repositories tagged #ai-gateway, ranked by stars
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
๐ฆ The API and AI Gateway
A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management. ๐ฅ
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
The Cloud-Native API Gateway and AI Gateway
An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
๐ Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.
๐ค AI Gateway | AI Native API Gateway
Plano is an AI-native proxy and data plane for agentic apps โ with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 ยตs overhead at 5k RPS.
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
A next-gen FOSS self-hosted unified zero trust secure access platform that can operate as a remote access VPN, a ZTNA platform, API/AI/MCP gateway, a PaaS, an ngrok-alternative and a homelab infrastructure.
Next Generation Agentic Proxy for AI Agents and MCP servers
GoClaw - GoClaw is OpenClaw rebuilt in Go โ with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.
Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready.
KrakenD Community Edition: High-performance, stateless, declarative, API Gateway written in Go.
Manages Unified Access to Generative AI Services built on Envoy Gateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing ยท Evals ยท Simulations ยท Datasets ยท Gateway ยท Guardrails. Self-hostable. Apache 2.0.
1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.
AI gateway written in Go. Lightweight unified OpenAI-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI & Ollama. LiteLLM alternative with observability, guardrails, streaming, costs and usage tracking.
Enterprise AI bastion host for secure AI API and MCP access, with unified proxying, RBAC, audit logs, rate limiting, and cost tracking across OpenAI, Anthropic, Gemini, and self-hosted LLMs.
Debug your AI agents
CodeGate: Security, Workspaces and Multiplexing for AI Agentic Frameworks
LLMs and Machine Learning done easily
้ขๅ OAใERPใCRMใๅทฅๅ็ญไผไธ็ณป็ปๅฟซ้ๆๅปบๆบ่ฝไฝ๏ผ่ฎฉ AI ๅจๆ้ใๅฎก่ฎกไธๆฒป็็บฆๆไธๅฎๅ จ่ฐ็จ็ๅฎไธๅก่ฝๅใBuild agents quickly for enterprise systems such as OA, ERP, CRM, and ticketing, enabling AI to safely call real business capabilities under permissions, audit, and governance controls.
Nuxt AI Chatbot Template made with Nuxt UI and Vercel AI SDK.
Build mods for Claude Code: Hook any request, modify any response, /model "with-your-custom-model", intelligent model routing using your logic or ours
digiRunner: Your API Gateway for Microservices
Self-hosted, OpenAI-compatible AI gateway for private RAG, natural-language data access, and tool-calling agents.
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
Privacy-first LLM proxy and AI gateway โ load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.
Supercharge your applications using Cloudflare Workers and Gemini within minutes (and for free, up to hundreds of requests per day) โ๏ธโจ
The open source, no-code MCP Server for AI-Native API Access
Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.
A high-performance AI Gateway written in Rust โ call 100+ LLM APIs using OpenAI format
Route inference across providers.
Production-ready full-stack blueprint for building multimodal GenAI apps with an Angular client and Node.js/Express AI Gateway.
Pure Front-End LLM API Testing Tool
Inference Hub for AI at Scale
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ๐ AI Gateway (LiteLLM) ๐ค LLM Serving (vLLM, SGLang, Ollama) ๐ Vector Databases, ๐ Embedding Models (TEI) ๐ Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
ไธๆกๅฝไปค๏ผๆๅพฎไฟกๅๆไปปไฝ AI Agent ็ๅ ฅๅฃ | Connect WeChat to any AI Agent with one command
An open source, Native AI Gateway and LLM proxy built in Rust
AI Firewall & LLM security toolkit - protect your AI applications from prompt injection, jailbreaks, PII leakage, and adversarial attacks
Local streaming reverse proxy between AI coding agents (Claude Code, Cursor, Codex) and model APIs (Anthropic, OpenAI, Gemini, MiniMax). Meters every token + USD cost, compacts bloated context to cut pay-per-token API spend, and runs shadow-eval to prove quality held. ccusage-style metering + live local dashboard.
kgateway.dev site and docs
Self-hosted, OpenAI-compatible AI gateway for organizations โ multi-provider (Azure/OpenAI/Anthropic/Gemini), revocable per-allocation credentials, usage & cost tracking, and an OpenAI Codexโready /v1/responses endpoint.