Expand description
Llama model implementation with support for Llama 1/2/3 and GQA
Structsยง
- Llama
Config - Llama model configuration
- Llama
Model - Llama model implementation
- Rope
Scaling - RoPE scaling configuration (Llama 3)
Llama model implementation with support for Llama 1/2/3 and GQA