RESCUE: Repairing Language Model Errors to Sparse Circuits via Reinforcement Learning
This work introduces RESCUE (Reasoning-Error Sparse-Circuit Uncovering and Editing), a framework that localizes error-associated circuits and surgically repairs them for performance enhancement, and introduces a pruning technique and precisely fine-tunes error circuits to correct task failures, thereby translating erro...