Rethinking Circuit Evaluation: Do Circuits Explain Model Errors?
Findings show circuits can preserve task success without adequately explaining model's failures, and support exact error reproduction as a necessary, but not sufficient, test of circuit-based explanations of model behaviour.