All projects
53 repositories · updated 2026-11-07
Loading…
1vllm-project / vllmAn inference and serving engine for language models.PythonApache-2.0 · PermissiveInsufficient rank history96,455
2ultralytics / yolov5Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.AGPL-3.0 · Share derivative sourceInsufficient rank history58,251
3ggml-org / whisper.cppPort of OpenAI's Whisper model in C/C++C++MIT · PermissiveInsufficient rank history54,977
4deepspeedai / DeepSpeedDeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.PythonApache-2.0 · PermissiveInsufficient rank history43,303
5hpcaitech / ColossalAIMaking large AI models cheaper, faster and more accessiblePythonApache-2.0 · PermissiveInsufficient rank history41,430
6sgl-project / sglangSGLang is a high-performance serving framework for large language models and multimodal models.PythonApache-2.0 · PermissiveInsufficient rank history38,536
7google-ai-edge / mediapipeCross-platform, customizable ML solutions for live and streaming media.C++Apache-2.0 · PermissiveInsufficient rank history37,584
8SYSTRAN / faster-whisperFaster Whisper transcription with CTranslate2PythonMIT · PermissiveInsufficient rank history26,530
9Tencent / ncnnncnn is a high-performance neural network inference framework optimized for the mobile platformC++License not declaredInsufficient rank history24,030
10stas00 / ml-engineeringMachine Learning Engineering Open BookPythonCC-BY-SA-4.0 · Share derivative sourceInsufficient rank history19,672
11FlashML-org / FreeTokenFreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.PythonApache-2.0 · PermissiveInsufficient rank history16,743
13gvergnaud / ts-pattern🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.TypeScriptMIT · PermissiveInsufficient rank history15,207
14NVIDIA / TensorRTNVIDIA® TensorRTTM is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.C++Apache-2.0 · PermissiveInsufficient rank history13,436
15LMCache / LMCacheAuthor description: LMCache: Supercharge Your LLM with the Fastest KV Cache LayerPythonApache-2.0 · PermissiveInsufficient rank history12,296
16triton-inference-server / serverThe Triton Inference Server provides an optimized cloud and edge inferencing solution.PythonBSD-3-Clause · PermissiveInsufficient rank history11,128
17openvinotoolkit / openvinoOpenVINOTM is an open source toolkit for optimizing and deploying AI inferenceC++Apache-2.0 · PermissiveInsufficient rank history11,119
18aws / amazon-sagemaker-examplesExample 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.Jupyter NotebookApache-2.0 · PermissiveInsufficient rank history11,002
19ultralytics / yolov3PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.PythonAGPL-3.0 · Share derivative sourceInsufficient rank history10,632
20RunanywhereAI / runanywhere-sdksAuthor description: Production ready toolkit to run AI locallyC++License not declaredInsufficient rank history10,332
