Reinforcement learning (RL) post-training with generative reward models (GenRM) has become a central recipe for improving large language models (LLMs), and it is also increasingly resource-intensive: policy rollout, GenRM-based reward evaluation, and policy training all compete for GPU resources. However, existing colo...
Yan-Feng Zhao, Hao-Yang Li, Sheng Lin et al.· 0 citations
This paper proposes DPP, which transforms PP granularity from a static design choice into a workload-adaptive optimization space over packed, split, and hybrid chunks and further introduces a new coupling between heterogeneous pipeline scheduling and gradient checkpointing.
Shiju Wang, Yujie Wang, Fang-Cheng Fu et al.· 0 citations
Block diffusion speculative decoding improves LLM inference efficiency by proposing a block of future tokens in parallel and verifying them with a single forward pass through the target model. However, existing methods retain only the accepted prefix and discard the rejected suffix, preventing the computation spent on...
Yao-Jie Zhang, Lin-Feng Zhang, Bin Cui et al.· 3 citations
Quadrant-weighted Sampling for Length-aware Policy Optimization (QLPO), a simple resampling-based variant of GRPO that introduces implicit length control without modifying the reward function, suggests that structured resampling provides an effective and robust approach to efficient reasoning.