STEPS is proposed, a selective OPSD framework that controls the location, direction, and duration of distillation that improves mean accuracy over GRPO and support brief, targeted self-distillation as an efficient complement to reward-driven reasoning training.
Jia-Xuan Wang, Xuan-Xin Ouyang, Z. Chen et al.· 15 citations
RL has emerged as a powerful paradigm for enhancing the instruction following capabilities of LLMs. While existing training recipes achieve substantial gains, we find that they suffer from exploration bias towards easy instructions when the training data has multiple instructions in a prompt. This bias is caused by two...
Mian Zhang, Yueqin Yin, Kaiyu He et al.· 0 citations
CacheBridge is introduced, which co-designs architecture-indexed mapper support, attention-aligned calibration, and bounded mapper construction while retaining a closed-form affine interface for online deployment.
Xing-Yu Qu, Si-Yuan Lu, Z. Chen et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.