Training Trajectories Determine Circuit Removability in Annealable Soft-Prior Transformers
The results suggest that circuit removability in small discrete retrieval tasks depends on the training trajectory, not just the final architecture.
Zong-Lin Yang, Zi-Ming Zhao, Wei Tang et al.
· 1 citation