Jun 2026
Knowledge Distillation from Large Reasoning Models to Compact Student Models: A Case Study on the John O Bryan Mathematics Competition
It is demonstrated that CoT distillation improves compact student models and that response length is a critical factor in mathematical reasoning quality.
Gaurab Baral, Aaditya Khanal, Yangyang Tao et al.
· arXiv.org · 0 citations