Compare projects
Select 2–4 projects to compare on the same basis.
PaddlePaddle / FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
Michael-A-Kuykendall / shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Popularity
Repository stars3,7246,011Highest
Fork758Highest587
Maintenance
Last push2026-09-242026-11-01
Maintenance notesNot verifiedNot verified
Repository created2022-06-272025-08-28
License & use
LicenseApache-2.0 · PermissiveApache-2.0 · Permissive
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeModel servingCommand-line tools · Data analysis · Model serving
TypeFrameworks & SDKsFrameworks & SDKs
SubcategoryGeneralData science & machine learning
PlatformNot verifiedNot verified
First collected2026-11-032026-11-03
LanguagePythonRust
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Measured at 2026-11-06 UTC