Patching Up Circuit Learning via Parameter Sharing
This work introduces a recursive parameter sharing construction (RePA) that fosters efficiency without assuming independence, and shows empirically that RePA can greatly reduce time and memory consumption while yielding competitive likelihoods.
Charles Bricout, Gennaro Gala, Viacheslav Borovitskiy et al.
· 0 citations