Preprint
Aug 2026
Dynamical phase selection controls compute scaling in looped transformers
A looped transformer performs inference by iterating a weight-tied map, making its computation a dynamical process whose cost is set by the resulting inference dynamics. Here we show that networks with identical architecture and objective, trained to identical accuracy, nevertheless realize distinct dynamical phases de...
Gunn Kim
· 0 citations