Recursive Offline Distillation via Entropy Gain Sampling and Answer Mixing
This work proposes a recursive offline distillation method combining two components: entropy-based sampling for selective distillation and answer mixing, and a comparative analysis of methods to generate and normalize distillation traces.
Andrey Goncharov, Daniil Vyazhev, С. С. Епанов et al.
· 0 citations