One Model to Loop Them All: Elastic Latent Recurrence for Language Models
This work presents Elastic Latent Recurrence (ELR), a recipe for training looped language models without a one-loop tax that makes a separate non-recurrent model the better choice whenever latency matters.