BerriAI / litellm
Author description: The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
- Repository stars
- 62,818All-time #357
- Fork
- 13,067
- Last push
- updated today
- Repository created
- since 2023
About
Summarised by AI from the README; the original prevails
Author description: Author description: The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Basic listing based on official public information; functionality has not been independently evaluated.
Check before adopting
- No license declared: commercial use and redistribution terms are unknown.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified