jundot / omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
- Repository stars
- 23,405All-time #1,813
- Fork
- 2,101
- Last push
- updated 1 days ago
- Repository created
- since 2026
About
Summarised by AI from the README; the original prevails
Author description: LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Basic listing based on official public information; functionality has not been independently evaluated.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified