GitHub stars · StarDay

1sgl-project / sglangSGLang is a high-performance serving framework for large language models and multimodal models.PythonApache-2.0 · Permissive38,547

2FlashML-org / FreeTokenFreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.PythonApache-2.0 · Permissive16,775

3modelscope / ms-swiftUse PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).PythonApache-2.0 · Permissive16,057

4NVIDIA / TensorRT-LLMTensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.PythonLicense not declared15,031

5FareedKhan-dev / kimi-k3-in-cA 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.CApache-2.0 · Permissive11,009

6flashinfer-ai / flashinferFlashInfer: Kernel Library for LLM ServingCudaApache-2.0 · Permissive6,866

7czy0729 / Bangumi:electron: An unofficial https://bgm.tv ui first app client for Android and iOS, built with React Native. An ad-free, hobby-driven, not-for-profit, Douban-like follow-up record that specializes in ACG, bgm.tv third-party client. Redesigned for the mobile terminal, it has built-in a large number of enhanced functions that are difficult to achieve on the web terminal, and provides considerable customization options. Currently adapted for iOS / Android.TypeScriptMIT · Permissive6,218

8zai-org / GLM-4.5GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation ModelsPythonApache-2.0 · Permissive4,424