This project investigates scaling test-time compute through a Generative Verifier (GV) on the Countdown mathematical reasoning task using a computationally constrained 0.5B parameter regime, hypothesizing that the “verification gap” will widen at higher values of N due to the model’s limited semantic capacity.
This project explores the Countdown arithmetic reasoning task: given a set of numbers, produce an arithmetic expression that evaluates to a target value on the Qwen 2.5-0.5B base model and proposes two complementary extensions targeting these failure modes.
This work provides a scalable and effective framework for extending RLVR beyond the limitations of pattern-based verification to complex, noisy, real-world domains, and generalizes strongly to seven out-of-distribution benchmarks.
Yi Su, Dian Yu, Linfeng Song et al.· Annual Meeting of the Associ...· 1 citation
This project studies that failure mode in a controlled Countdown arithmetic setting and asks whether verifier-generated execution feedback can supply a minimally sufficient correction signal that later transfers into a no-feedback policy, confirming the proposal’s central concern.
This paper introduces C LUE (Clustering and Experience-based Verification) , a training-free, non-parametric verifier that improves selection and reranking in Large Language Model outputs and finds that correct and incorrect solutions exhibit measurable geometric differences in their hidden-state trajectories.
Zhenwen Liang, Ruosen Li, Yujun Zhou et al.· Annual Meeting of the Associ...· 0 citations
TrajVal, a lightweight probe-based estimator that approximates per-task learnability from a short probe run and two endpoint evaluations, is proposed and it is found that learnability is reproducible across independently sampled training contexts and predictive of downstream utility.
Ting Zhou, Zhenqing Ling, Daoyuan Chen et al.· 0 citations
This work establishes the first non-vacuous generalization bounds for parameter-efficient RLVR fine-tuning at the billion-parameter scale, and proposes the Progressive RLVR framework, which integrates RLVR with on-policy distillation, TinyLoRA, and model quantization.
