tanishqkumar / ssd
A lightweight inference engine supporting speculative speculative decoding (SSD).
- Repository stars
- 1,019All-time #39,868
- Fork
- 79
- Last push
- updated 5 months ago
- Repository created
- since 2026
About
A lightweight inference engine supporting speculative speculative decoding (SSD).Summarised by AI from the README; the original prevails
Author description: A lightweight inference engine supporting speculative speculative decoding (SSD).
Basic listing based on official public information; functionality has not been independently evaluated.
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.