T. Konstantin Rusch

Looped Actor: Depth-Recurrent Reasoning Models for Reinforcement Learning

Looped reasoning models repeatedly apply a shared set of parameters, enabling more computation without increasing the model size. These models also support input-dependent computation by dynamically deciding when to stop looping. Motivated by the recent success of looped transformers in language modeling and reasoning,...