All projects
3 repositories · updated 2026-11-07
Loading…
1flashinfer-ai / flashinferFlashInfer: Kernel Library for LLM ServingCudaApache-2.0 · PermissiveInsufficient rank history6,866
2gpustack / gpustackA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.PythonApache-2.0 · PermissiveInsufficient rank history5,984
3llm-d / llm-dState of the art inference performance with modern accelerators on KubernetesPythonApache-2.0 · PermissiveInsufficient rank history5,160
