Skip to content

Author

Rui-Qi Liu

6 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Nov 2026

EvoOPD: Evolving Privileged Information Strategies for Black-Box On-Policy Distillation

Proprietary language models exhibit strong reasoning and coding capabilities, but their output distributions are inaccessible, making fine-grained distillation methods that rely on teacher logits difficult to apply directly to black-box models. We observe that rich textual feedback from a black-box teacher can be treat...

Xi-Mo Zhu, Rui-Qi Liu, Yi Han et al. · 0 citations
Preprint Sep 2026

Data-Free On-Policy Distillation: How Far Can We Go Without External Data?

On-policy distillation (OPD) is increasingly applied to frontier foundation model post-training. Prior work in this area has largely focused on algorithmic advances, yet it remains unclear how much OPD depends on its training questions and, in particular, how far this dependence can be reduced. Across two representativ...

Gengsheng Li, Mao Zheng, Ming-Yang Song et al. · 0 citations

On-Policy Distillation with Curriculum Turn-level Guidance for Multi-turn Agents

Guided On-Policy Distillation (Guided-OPD), a simple yet effective algorithm that mixes teacher- and student-generated turns within each rollout and schedules the teacher's intervention probability along a curriculum that decays to zero is proposed.

Gengsheng Li, Mao Zheng, Ming-Yang Song et al. · 24 citations · ⚡3
Preprint Aug 2026

ReOrder-OPD:Reliability-Aware Prompt Ordering for On-Policy Distillation

On-policy distillation (OPD) applies token-level teacher supervision to student-generated trajectories, but this supervision is not always reliable. Existing methods use local confidence or teacher-student agreement to weight, filter, or truncate the sampled trajectory. These signals do not directly determine whether t...

Ximo Zhu, Rui-Qi Liu, Rong Wang et al. · 4 citations
#machine learning Preprint Sep 2026

Nonparametric Variance-Penalized Actor-Critic: Statistical Inference for Risk-Sensitive Reinforcement Learning

This work proposes a nonparametric variance-penalized actor-critic (VPAC) framework that replaces the variance critic with statistically grounded online estimators based on bootstrapping and random scaling, techniques drawn from the statistical inference literature for stochastic approximation.

Saunak Kumar Panda, Tong Li, Yi-Sha Xiang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Data-free On-policy Distillation

DF-OPD matches and even surpasses real data, and the questions it produces track the teacher's own post-training data on three key diagnostics of training dynamics, which other real datasets do not.

Gengsheng Li, Mao Zheng, Ming-Yang Song et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.