Mechanistic Interpretability of Chain-of-Thought Reasoning via Sequential Activation Patching
This work introduces a sequential activation patching framework that traces CoT-conditioned attention-head activations across token positions and aggregates their effects using Part-of-Speech-guided analysis, and introduces Sequential Multi-Head Patching to evaluate the joint contribution of distributed head sets, toge...