This work introduces Asynchronous On-Policy Self-Distillation (AsyncOPSD), a framework that decouples rollout generation from learner updates to improve training throughput and introduces a distillation objective based on staleness-aware policy control and token-level entropy weighting.
Xi-Dong Wu, Qi Qi, Yu-Qiong Ji et al.· 0 citations
Human preferences change over time: an established preference may remain valid over time, become uncertain as context shifts, or be explicitly revised. Effective personalization requires conversational AI to adapt its response strategy to evolving preferences rather than relying on passive memory retrieval. We formaliz...
Priyanka Dey, Raja Das, Vikas Bahirwani et al.· 0 citations
An emerging hypothesis about reinforcement learning (RL) post-training of large language models (LLMs) is that it merely sharpens existing behaviors of a base model, improving single-shot accuracy at the cost of solution coverage. Although this trade-off has been observed in math and coding tasks, it need not extend to...
Changdae Oh, Qi Zeng, Qi Qi et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.