google-ai-edge / LiteRT-LM
Author description: LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
- Repository stars
- 6,836All-time #8,442
- Fork
- 785
- Last push
- updated today
- Repository created
- since 2025
About
Summarised by AI from the README; the original prevails
Author description: Author description: LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Basic listing based on official public information; functionality has not been independently evaluated.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified