An early mistake in the generated reasoning can constrain all subsequent reasoning. Repeated-generation methods, like MCMC-based approaches, attempt to improve output quality by sampling multiple generations, but their effectiveness can be limited by randomly selecting where to regenerate. On MATH500 with Qwen2.5-Math-...
Yi-Cheng Ding, Meng-Yu Wang, Min Zhou et al.· 0 citations
Results show that selective anti-interference is an effective objective-level signal for robust context use and identifies locally sufficient tokens and sharply reduces prefix sensitivity on gate-selected suffix tokens.
Jin-Chang Zhu, Hao-Lan He, Yi-Cheng Ding et al.· 0 citations
SCIT, the Suffix Cache Interchange Test, is introduced, a causal protocol that constructs exact source-recipient counterfactuals, patches declared cache segments, and identifies which transformer object carries the counterfactual computation.
GapSight is proposed, a framework for learning visual re-reading: a VLM first takes a global glance, then selectively returns to a free-form region when the question calls for local evidence, and Mechanism analyses show that the router rescues concrete wrong answers, adapts its action rate by task, and forms a favorabl...
Jin-Chang Zhu, Rong Fu, Yi-Cheng Ding et al.· 1 citation
ExACT, a supervision-allocation objective that assigns extra weight to long effective-context targets by inverse frequency within the long tail, supports a supervision-centric thesis: long-context adaptation depends on how strongly training supervises long-context predictions.
Jinchang Zhu, Jindong Li, Chengyu Zou et al.· arXiv.org· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.