Gabriele Dominici

Causal Chain of Thought: Mitigating Attention Leakage via Context Isolation

Chain-of-thought (CoT) prompting elicits step-by-step rationales that appear to explain model predictions, but there is no guarantee these steps causally drive the final answer. In standard autoregressive generation, dense attention allows each reasoning step to attend to the full context, enabling the model to derive...