StarDayOpen source rankings
Back to rankings

SharpAI / SwiftLM

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

Repository stars
796All-time #46,396
Fork
56
Last push
updated 1 days ago
Repository created
since 2026
Apps & systemsGeneralSwiftMIT · Permissive
View source

About

Original · GitHub
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

Summarised by AI from the README; the original prevails

Author description: ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

Basic listing based on official public information; functionality has not been independently evaluated.

Pricing
Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.

Star trend

79679779711-06 · 79610-0810-1310-1810-2310-2811-0211-06

First collected 2026-11-06Measured at 2026-11-06 09:47 UTCSourceLicense source

Compiled from public project information; not independently tested. · Repository Stars, not unique users · License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.