mit-han-lab / streaming-llm
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
- Repository stars
- 7,276All-time #7,877
- Fork
- 402
- Last push
- updated 2 years ago
- Repository created
- since 2023
About
Summarised by AI from the README; the original prevails
Author description: [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
Basic listing based on official public information; functionality has not been independently evaluated.
Check before adopting
- No pushes for over 6 months (last 2024-07-11); check whether it is maintained.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified
