Preprint
Jul 2026
Beyond the Best Teacher: Expanding and Compressing the Reasoning Solution Manifold
Strong students can be obtained not by selecting a single better teacher, but by deliberately constructing and compressing a complementary teacher union, in an expand-then-compress framework that couples teacher construction with multi-teacher policy distillation.
Songshuo Lu, Zhi Chen, Yaohua Tang
· 0 citations