Preprint
Jul 2026
Geometric Self-Distillation for Reasoning Generalization
GeoSD, a geometric self-distillation objective that treats this drift as movement in the student's predictive behavior and counters it in two complementary ways, preserves the in-distribution gains of self-distillation while improving average OOD accuracy.
Josip Jukic, Ivan Titov
· 0 citations