Preprint
Oct 2026
Self-Distillation for Supervised Fine-Tuning
Gold-Conditioned Distillation is proposed, a method that turns expert demonstrations into model-native supervision and improves new-task accuracy over SFT and generally reduces degradation on general benchmarks.
Wenxuan Zhu, Bang An, Shu-Ming Liu et al.
· 0 citations