Lightning-AI / lit-llama
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
- Repository stars
- 6,083All-time #9,693
- Fork
- 516
- Last push
- updated 1 years ago
- Repository created
- since 2023
About
Summarised by AI from the README; the original prevails
Author description: Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Basic listing based on official public information; functionality has not been independently evaluated.
Check before adopting
- No pushes for over 6 months (last 2025-07-01); check whether it is maintained.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified