Reasoning large language models (LLMs) benefit from test-time scaling, motivating adaptive policies that spend tokens when they help and stop early otherwise. Existing rules halt when a confidence or stability signal crosses a threshold, but such thresholds rarely transfer across models and datasets, and validation-cal...
Direct Diversity Optimization is presented, an offline post-training method that combines Divergence-Tree Collection with the Reference-Relative Target-Odds Objective (RTO) and achieves the strongest task success and successful strategy coverage among the compared post-training methods across BabyAI, BabaIsAI, and WebS...
Junwon Ko, Dong-Jae Lee, Minchan Kwon et al.· 0 citations
This paper proposes a novel training free token pruning framework grounded in the dual form perspective of attention, and derives a novel metric quantifying both a token's information magnitude and information duplication.
Dong-Jae Lee, S. Baek, Junmo Kim· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.