Expand description
Rotary Position Embedding (RoPE) implementation for tch-rs
Based on rotary-embedding-tchrs but updated for tch 0.20 compatibility. Original paper: https://arxiv.org/abs/2104.09864
Structsยง
- RoPE
- RoPE (Rotary Position Embedding) implementation optimized for tch-rs
- RoPE
Manager - RoPE cache manager for multiple model layers