All projects
8 repositories · updated 2026-11-06
Loading…
1tensorflow / servingA flexible, high-performance serving system for machine learning modelsC++Apache-2.0 · PermissiveInsufficient rank history6,365
2volcano-sh / volcanoA Cloud Native Batch System (Project under CNCF)GoApache-2.0 · PermissiveInsufficient rank history6,068
3skyzh / tiny-llmlearn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + QwenPythonApache-2.0 · PermissiveInsufficient rank history5,660
4SeldonIO / seldon-coreAn MLOps framework to package, deploy, monitor and manage thousands of production machine learning modelsGoLicense not declaredInsufficient rank history4,785
5ahkarami / Deep-Learning-in-ProductionIn this repository, I will share some useful notes and references about deploying deep learning-based models in production.License not declaredInsufficient rank history4,378
6Lightning-AI / LitServeA minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.PythonApache-2.0 · PermissiveInsufficient rank history3,987
7PaddlePaddle / FastDeployHigh-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddlePythonApache-2.0 · PermissiveInsufficient rank history3,724
8dingodb / dingoA multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ultra-low latency.JavaApache-2.0 · PermissiveInsufficient rank history1,705
