kvcache-ai / ktransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
- Repository stars
- 19,661All-time #2,302
- Fork
- 1,602
- Last push
- updated today
- Repository created
- since 2024
About
Summarised by AI from the README; the original prevails
Author description: A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Basic listing based on official public information; functionality has not been independently evaluated.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified