Model APIs · GitHub stars

1cheaper-inference / OmniRouteAn AI gateway offering a unified endpoint and automatic fallback across model providers.TypeScriptMIT · Permissive84,998

2BerriAI / litellmAuthor description: The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]PythonLicense not declared62,818

3QuantumNous / new-apiOpen-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.GoAGPL-3.0 · Share derivative source51,257

4musistudio / claude-code-routerOne local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay fully in control.TypeScriptMIT · Permissive38,018

5Portkey-AI / gatewayA blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.TypeScriptMIT · Permissive13,335

6TykTechnologies / tykOpen Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)GoLicense not declared10,876

7higress-group / higress🤖 AI Gateway | AI Native API GatewayGoApache-2.0 · Permissive9,723

8maximhq / bifrostOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200μs of overhead at 5k RPS.GoApache-2.0 · Permissive9,400

9coaidev / coaiAuthor description: 🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.TypeScriptApache-2.0 · Permissive9,343

10mnfst / llm-gatewayOpen Source LLM Gateway 🦚TypeScriptMIT · Permissive7,613

11tbphp / gpt-loadSelf-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage.GoMIT · Permissive7,200

12kgateway-dev / kgatewayThe Cloud-Native API Gateway and AI GatewayGoApache-2.0 · Permissive5,729

13looplj / axonhub⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.GoApache-2.0 · Permissive5,423

14AgnesAI-Labs / AgnesAI-ModelsOfficial Agnes AI gateway and model catalog for OpenAI-compatible text, image, video, and agent workflows.License not declared5,267

15NateBJones-Projects / OB1Open Brain — The infrastructure layer for your thinking. One database, one AI gateway, one chat channel — any AI plugs in. No middleware, no SaaS.TypeScriptLicense not declared4,752

16seakee / CPA-Manager-PlusA self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health.GoMIT · Permissive4,033

17xusenlinzy / api-for-open-llmA backend offering a unified OpenAI-style API for multiple language models.PythonApache-2.0 · Permissive2,459

18ENTERPILOT / GoModelAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.GoMIT · Permissive1,304

19api7 / aisixOpen-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.RustApache-2.0 · Permissive214