Coupled Calibration and Learning: Mitigating Teacher Bias in LLM Distillation without Target-Domain Reward Feedback
Coupled Calibration and Learning (CCL) is proposed, an LLM distillation algorithm that couples teacher calibration with student updates through token-level branching, using reward feedback only on source questions.