Preprint
Oct 2026
UpLoop: Upcycling Large Language Models with Gated Loop
Looped large language models trade parameter storage for recurrent computation, but most are trained from scratch. In practice, pretraining with looped depth is expensive, making post-training upcycling of a pretrained non-looped LLM an attractive alternative. We introduce \textbf{UpLoop}, a post-training recipe based...
Tie-Yuan Chen, Hua-Bin Liu, Ying-Tao Zhang et al.
· 0 citations