microsoft / vattention
Dynamic Memory Management for Serving LLMs without PagedAttention
- Repository stars
- 526All-time #59,927
- Fork
- 46
- Last push
- updated 2 months ago
- Repository created
- since 2024
About
Dynamic Memory Management for Serving LLMs without PagedAttentionSummarised by AI from the README; the original prevails
Author description: Dynamic Memory Management for Serving LLMs without PagedAttention
Basic listing based on official public information; functionality has not been independently evaluated.
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.