Speculative decoding reduces large language model inference latency by drafting multiple tokens before target-model verification, but its effectiveness depends on both the proposal mechanism and draft depth. Fixed configurations cannot respond to changes in predictability, repetition, and acceptance during generation,...
Manvi Jha, Zach Zhang, Zhi-Chao Xu et al.· 0 citations
Privileged Self-Practice (PSP), which keeps the PI and moves it from the loss to the sampler and is the only method that consistently outperforms plain GRPO, improving task-goal completion on AppWorld and the resolved rate by up to 61% on SWE-bench Verified.
Xing-Yu Su, Abhishek Kumar, Qing Ping et al.· 0 citations
A novel simulation approach that combines categorical judgments with evaluator-specific auxiliary data--retrospective reasoning traces and interface telemetry--to enable LLM-based simulation of individual evaluators via in-context learning is proposed.
Zeyu He, Xuan Qi, Subramanian Chidambaram et al.· SIGDIAL Conferences· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.