Skip to content

Author

Ze-Yuan Liu

4 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Sep 2026

Data-Free On-Policy Distillation: How Far Can We Go Without External Data?

On-policy distillation (OPD) is increasingly applied to frontier foundation model post-training. Prior work in this area has largely focused on algorithmic advances, yet it remains unclear how much OPD depends on its training questions and, in particular, how far this dependence can be reduced. Across two representativ...

Gengsheng Li, Mao Zheng, Ming-Yang Song et al. · 0 citations
#machine learning Preprint Sep 2026

Distill What You Trust: Reliability-Aware Multi-Teacher On-Policy Distillation

TrustMOPD replaces example-level teacher selection with label-free, token-level supervision allocation and closes the overall-score gap between the initial student and oracle-routed teachers when trained on single- and multi-teacher on-policy distillation.

Jie Sun, Mao Zheng, Ming-Yang Song et al. · 6 citations
#artificial intelligence Preprint Sep 2026

Data-free On-policy Distillation

DF-OPD matches and even surpasses real data, and the questions it produces track the teacher's own post-training data on three key diagnostics of training dynamics, which other real datasets do not.

Gengsheng Li, Mao Zheng, Ming-Yang Song et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.