ztxz16 / fastllm
fastllm is a high-performance large model inference library with no backend dependencies, helping you to efficiently infer large models on most devices!
- Repository stars
- 5,130All-time #11,740
- Fork
- 505
- Last push
- updated 4 days ago
- Repository created
- since 2023
About
Summarised by AI from the README; the original prevails
Author description: fastllm is a high-performance large model inference library with no backend dependencies, helping you to efficiently infer large models on most devices!
Basic listing based on official public information; functionality has not been independently evaluated.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified