Reasoning-Trace Collapse: Evaluating the Loss of Explicit Reasoning During Fine-Tuning
It is found that standard supervised fine-tuning can rapidly suppress valid reasoning traces, and that answer-only metrics can substantially obscure this failure: in several settings, performance conditional on valid reasoning remains high while the rate of valid reasoning falls sharply.