StarDayOpen source rankings
Back to rankings

Michael-A-Kuykendall / shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Repository stars
6,008All-time #9,836
Fork
587
Last push
updated 4 days ago
Repository created
since 2025
Frameworks & SDKsData science & machine learningRustApache-2.0 · Permissive
View source

About

Summarised by AI from the README; the original prevails

Author description: ⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Basic listing based on official public information; functionality has not been independently evaluated.

Platform
Not verified
Pricing
Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
Maintenance notes
Not verified
Model servingData analysisCommand-line tools# api-server# Developer tools# gguf# huggingface# huggingface-models# huggingface-transformers# llama# llamacpp# llm-inference# local-ai# machine-learning# ollama-api# openai-compatible# rust# rust-crate# transformers# webgpu

Star trend

Includes values estimated from GitHub history
5,9405,9746,00810-0710-1210-1710-2210-2711-0111-05

First collected 2026-11-03Measured at 2026-11-03 08:24 UTCSourceLicense source

Compiled from public project information; not independently tested. · Repository stars, not unique users or individual-skill installs · License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.