GitHub stars · StarDay

1BerriAI / litellmAuthor description: The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]PythonLicense not declared62,846

2GokuMohandas / Made-With-MLPractical material on building, deploying and iterating ML applications.Jupyter NotebookMIT · Permissive49,950

3langfuse / langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.TypeScriptLicense not declared37,105

4ComposioHQ / composioComposio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.TypeScriptMIT · Permissive30,950

5mlflow / mlflowThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.PythonApache-2.0 · Permissive28,706

6promptfoo / promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.TypeScriptMIT · Permissive26,914

7liguodongiot / llm-actionThis project aims to share the technical principles and practical experience related to large models (large model engineering, large model application implementation)HTMLApache-2.0 · Permissive25,258

8comet-ml / opikAuthor description: Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.PythonApache-2.0 · Permissive23,223

9dipakkr / awesome-ai-engineering🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.MIT · Permissive22,538

10jina-ai / serve☁️ Build multimodal AI applications with cloud-native stackPythonApache-2.0 · Permissive21,849

11TransformerOptimus / SuperAGI<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.PythonMIT · Permissive17,736

12vibrantlabsai / ragasSupercharge Your LLM Application Evaluations 🚀PythonApache-2.0 · Permissive16,254

13raga-ai-hub / RagaAI-CatalystPython SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph viewPythonApache-2.0 · Permissive16,188

14Portkey-AI / gatewayA blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.TypeScriptMIT · Permissive13,336

15bentoml / OpenLLMRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.PythonApache-2.0 · Permissive12,583

16Arize-ai / phoenixAI Observability & EvaluationPythonLicense not declared12,180

17Netflix / metaflowBuild, Manage and Deploy AI/ML SystemsPythonApache-2.0 · Permissive10,342

18MakazhanAlpamys / SoupFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.PythonApache-2.0 · Permissive10,249

190xPlaygrounds / rig⚙️🦀 Build modular and scalable LLM Applications in RustRustMIT · Permissive9,080

20bentoml / BentoMLThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!PythonApache-2.0 · Permissive8,935