The throughput gains of speculative decoding depend on the trade-off between acceptance length and execution latency. We ask when additional acceptance is worth the cost of obtaining it. We establish a comparison protocol spanning training, inference, and evaluation, remeasuring released checkpoints and retraining six...
Yong-Chao Long, Chun-Rui Zheng, Yuxuan Zhou et al.· 0 citations
This work presents a principled analysis of the distributions induced by lossy verification methods, and shows that many seemingly distinct approaches differ only superficially and can be unified into two categories: truncation-based verification and collaborative verification.
Tian-Yu Wang, Yuxuan Zhou, Heng Li et al.· arXiv.org· 0 citations
This work shows that a single BDDL specification, automatically constructed from open-world video evidence or curated tasks, can serve as a shared interface for data construction, plan verification, and reward design and introduces GroupAdapt, a difficulty-aware length schedule that uses the in-batch group pass rate as...
Xiangli Shi, Xiaomeng Zhu, Ye Tian et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.