maximhq / bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200μs of overhead at 5k RPS.
- Repository stars
- 9,400All-time #5,841
- Fork
- 1,540
- Last push
- updated today
- Repository created
- since 2025
About
Summarised by AI from the README; the original prevails
Author description: Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200μs of overhead at 5k RPS.
Basic listing based on official public information; functionality has not been independently evaluated.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified