Inductive Feedback for Mixed-Policy Distillation
This work treats verbal feedback as evidence for or against the hypothesis that a particular token comes next at a given prefix, and adopts a probabilistic confirmation framework which uniquely determines an ordering over the vocabulary based on the teacher's predictions before and after it receives feedback.