Are We Recovering Mechanisms? Objective-Level Recovery Gaps in Mechanistic Interpretability
It is shown that intervention-based faithfulness can prefer an equally sized circuit that reproduces the model's behavior less well, and restoring selected intact-model signals reverses 96 of 100 selected persistent misrankings, demonstrating that context distortion contributes to these failures.
Chu-Qin Geng, Li Zhang, Hao-Lin Ye et al.
· 0 citations