xorbitsai / inference
Author description: Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
- Repository stars
- 9,639All-time #5,661
- Fork
- 892
- Last push
- updated 3 days ago
- Repository created
- since 2023
About
Summarised by AI from the README; the original prevails
Author description: Author description: Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Basic listing based on official public information; functionality has not been independently evaluated.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified