MrRoPE: Mixed-radix Rotary Position Embedding

ICLROral2026

Authors
Qingyuan Tian, Wenhong Zhu, Xiaoran Liu, Xiaofeng Wang, Rui Wang
Affiliation
Shanghai Jiaotong University
Venue
ICLR 2026
Track
Oral

TL;DR

We present a unified theory MrRoPE linking major RoPE-extension methods to radix conversion. Based on this, we propose MrRoPE-Pro, a training-free context window extension method..

Opening excerpt from the authors’ abstract. source

Read the paper

Topics

theory

Related ICLR papers

← All ICLR 2026 Oral papers · Browse the whole archive