AIBullisharXiv – CS AI · 7h ago7/10
🧠
nD-RoPE: A Generalized RoPE for n-Dimensional Position Embedding
Researchers propose nD-RoPE, a generalized extension of Rotary Position Embedding (RoPE) for high-dimensional data that addresses limitations in existing Transformer position encoding methods. The innovation treats positions and frequencies as coupled n-dimensional vectors rather than independent rotations, enabling better cross-dimensional interactions and directional balance across images, videos, and point clouds.