vllm-project / vllm
An inference and serving engine for language models.
- Repository stars
- 96,156All-time #154
- Fork
- 24,316
- Last push
- updated 3 days ago
- Repository created
- since 2023
About
Summarised by AI from the README; the original prevails
Basic information source: github.com/vllm-project/vllm. This entry summarizes basic project information and has not received an in-depth review.
Use cases：Serving language models to applications.
- Platform
- Not verified
- Pricing
- Pricing not verifiedVerify software, hosting, model and infrastructure costs against the current official documentation.