Simplifying and Improving On-Policy Distillation for Few-Step Diffusion
Few-step distillation reduces the sampling cost of diffusion and flow models, but existing approaches often require auxiliary score models or specialized architectures. We show that simple on-policy velocity regression already provides a strong foundation for 4-NFE generation. To represent teacher velocity variation wi...
Jia-Wei Zhang, Zi-Yu Wan, Nan-Ye Ma et al.
· 0 citations