The results show that local credit correction provides an effective form of process supervision for outcome-driven RL, and improves performance under both critic-based and critic-free reinforcement learning methods.
Ai Jian, Hao-Ran Pan, Er-Yu Guo et al.· 0 citations
Reliable use of large language models requires responses to satisfy formatting requirements across changing instructions. Standard compliance scores do not distinguish preserving a model's observed format from correcting it, or reveal whether that correction holds across variants. We introduce ReFormBench, a benchmark...
Tian-Xiang Gao, Ya-Han Li, Chen-Lu Guo et al.· 0 citations
This work constructs a medical knowledge-poisoning benchmark covering retrieved evidence and reasoning chains, with seven attack families filtered by a three-judge "subtle-but-wrong"vote and paired clean exams that separate poisoning effects from question difficulty, and introduces Med-TrustRouter, a lightweight contro...
Do AI models designed for fast, structured decisions exhibit the cognitive and social biases observed in human judgment? We evaluate Jev, a model described as a System One decision-maker, using 41,500 responses across cognitive reflection tasks, five classical cognitive-bias paradigms, and a pricing experiment testing...
Ilaria Imperatrice, T. Kameneva, A. Greenberg et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Repeated event forecasting requires extracting predictive signals from noisy evidence and evaluating their value across successive decisions. We introduce JockeyBench, a benchmark and evaluation protocol that studies this problem through historical Japanese horse racing. The protocol combines time-gated evidence, price...
Zhong-Wei Xie, Xing-Su Li, Jing Yu et al.· 0 citations
On-policy distillation (OPD) transfers knowledge from a teacher model to a student along student-generated trajectories, typically by minimizing the reverse Kullback-Leibler (RKL) divergence. However, RKL can provide weak corrective signals for teacher-supported tokens to which the student assigns very low probability....
Tian-Tian Peng, Guan-Nan Lv, Hong-Yang Li et al.· 0 citations
Closing the loop of AI-driven science requires reliably translating natural-language protocols into executable laboratory workflows despite protocol defects and heterogeneous hardware. Existing approaches often couple scientific interpretation with device-specific code generation, making errors difficult to localize an...
Jingyuan Li, Dongzhan Zhou, Minting Pan et al.· 0 citations
In multi-modal 3D pre-training, aligning 3D shapes, their 2D image counterparts, and language descriptions has made tremendous progress. However, we find that supervision from rendered images is unreliable, the semantics encoded in synthetic views are distorted due to domain gap, self-occlusion, and rendering artifacts...
Chao-Yang Zhu, Zhe Liao, Jia-Yi Zhang et al.· 0 citations
Vision-language-action (VLA) models connect visual perception and language understanding with robot control, providing a foundation for instruction-conditioned manipulation. However, conventional pretrained VLA policies lack a mechanism for gradual adaptation through accumulated interaction experience during deployment...
Di-Yuan Shi, Yiqi Tang, Hong-Yin Zhang et al.· 0 citations
An agentic scientific workflow can run to completion and still release wrong results: a silent numerical error, a stale input, or a defect in a shared upstream step can contaminate several outputs while a sibling branch stays correct. We treat trust in such results as a release decision. A harness around the workflow's...
Ashish Acharya, Aman Al Amin, Hong Qin· 0 citations
Questions about an agent's history often require aggregating events, which retrieval alone does not resolve. We combine source-preserving evidence access with executable aggregation. Trajectory Memory (TM) retains the original trajectory and constructs a source-addressable reading view at question time. TallyMem augmen...
Ze-Rui Yang, Quan Xue, Chao-Rui Zhang et al.· 0 citations
Long-term memory remains a fundamental bottleneck for large language model (LLM) agents across sessions. Existing systems typically adopt a write-then-retrieve paradigm, storing context-dependent dialogue fragments and retrieving them via nearest-neighbor search in a continuous embedding space. This design yields unsta...
Xin Li, Liang Hu, Duo-Qian Miao et al.· 0 citations