Compare projects
Select 2–4 projects to compare on the same basis.
ModelTC / LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
kserve / kserve
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
Popularity
Repository stars4,3576,195Highest
Fork3841,779Highest
Maintenance
Last push2026-11-062026-11-04
Maintenance notesNot verifiedNot verified
Repository created2023-07-222019-03-27
License & use
LicenseApache-2.0 · PermissiveApache-2.0 · Permissive
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeData analysis · Model servingData analysis · Kubernetes operations · Model serving
TypeFrameworks & SDKsFrameworks & SDKs
SubcategoryData science & machine learningData science & machine learning
PlatformNot verifiedNot verified
First collected2026-11-032026-11-03
LanguagePythonGo
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Measured at 2026-11-06 UTC