Skip to main content

Module rope

Module rope 

Source
Expand description

Rotary Position Embedding (RoPE) implementation for tch-rs

Based on rotary-embedding-tchrs but updated for tch 0.20 compatibility. Original paper: https://arxiv.org/abs/2104.09864

Structsยง

RoPE
RoPE (Rotary Position Embedding) implementation optimized for tch-rs
RoPEManager
RoPE cache manager for multiple model layers