NVIDIA / TensorRT-Edge-LLM
High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI
- Repository stars
- 618All-time #54,173
- Fork
- 147
- Last push
- updated 2 days ago
- Repository created
- since 2025
About
High-performance, light-weight C++ LLM and VLM Inference Software for Physical AISummarised by AI from the README; the original prevails
Author description: High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI
Basic listing based on official public information; functionality has not been independently evaluated.
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.