Tracing Subliminal Learning Through Pretraining
This work study both hard label distillation, where students train on numbers generated by a biased teacher, and on-policy soft label distillation, where students generate the data and the teacher's logits provide the learning signal, finding transfer persists in both settings across differences in weight initializatio...