What Makes Recurrence Effective in Looped Language Models?
Looped language models (LoopLMs) increase computational depth through parameter sharing, offering a path to scale inference computation without adding parameters. However, it remains unclear when additional recurrence is beneficial and how architectural choices affect its effectiveness. Through controlled experiments,...
Xin-Lin Zhuang, Si-Yuan Wang, Imran Razzak et al.
· 0 citations