Trust Region Policy Distillation
This work presents Trust Region Policy Distillation (TOP-D), which transforms the notoriously unstable, high-variance On-Policy Distillation (OPD) into a stable training paradigm by dynamically constructing a proximal teacher and establishes a rigorous framework demonstrating that TOP-D inherently controls gradient var...