Understanding the Synergy between SFT, RLVR, and OPD in LLM Post-Training
This work characterize OPD across nine student-teacher pairs spanning 2x to 53x parameter ratios and shows that OPD effectiveness depends on student-teacher compatibility rather than teacher scale alone, and suggests that each post-training stage should be chosen not only for the capability it adds, but for the learnin...