Evaluation budgets in agentic retrieval-augmented generation span questions, search trajectories, and repeated answers. We measure allocation precision, reading efficiency, and cost boundaries using a retrieval-feedback comparison on HotpotQA and MuSiQue. At 34.14--34.39M model tokens, broader question coverage lowers...
The protocol measures predictive credit for research-agent benchmarks and scientific forecasting; natural-explanation credit remained unconfirmed at the tested donor resolutions.
Jing-Jie Ning, Xue-Qi Li, Yi-Bo Kong et al.· 0 citations
Scientific coding agents receive equations, boundary conditions, and output requirements in writing, then must assess the programs they revise. Rules to Tools (R2T) supplies prepared executable checks of public scientific requirements. Matched SciCode repair groups share written checks, starting programs, model, and bu...
Jing-Jie Ning, Guo-Jiang Zhao, Cheng-Xin Xu et al.· 0 citations
Joint reporting of priority responsiveness, presentation-dependent defaults, and task success and cost supports joint reporting of priority responsiveness, presentation-dependent defaults, and task success and cost.
ControlScope compares continuing generated code, editing the next tool call's data arguments, and replacing the unfinished workflow from the same public execution state to evaluate one-time and repeated reviews across filesystem tasks, ALFWorld, and AppWorld.
Jing-Jie Ning, Xue-Qi Li, Yi-Bo Kong et al.· 0 citations
WhatWorkedBench links acquisition, inference, program structure, and delivery through a delivered response surface of configuration scores, which evaluates this experimental understanding through a delivered response surface of configuration scores.
Jing-Jie Ning, Xue-Qi Li, Yi-Bo Kong et al.· 1 citation
The Discovery Certification Protocol (DCP) turns an outcome claim into an executable audit under a registered model, information boundary, and budget, and a deterministic verifier reproduces these local decisions from frozen records.
Jing-Jie Ning, Shan Zhong, Xiao-Chuan Li et al.· 1 citation
By validating decisions rather than only artifacts, this design turns adaptive search into reusable evidence wherever agents propose executable alternatives against a fixed evaluator.
The sandbox provides a search API that indexes large-scale public web corpora, namely ClueWeb22 and FineWeb, using a state-of-the-art dense retriever and approximate nearest neighbor search via DiskANN and achieves comparable latency to popular commercial APIs while ensuring stable document rankings across runs.
João Coelho, Jingjie Ning, Jingyuan He et al.· International Conference on...· 3 citations
The hidden phenomenon accuracy-blind answer churn is called and the Snapshot Compatibility Audit is introduced, which estimates excess answer churn by subtracting same-snapshot repeat disagreement from cross-snapshot disagreement.
Jing-Jie Ning, Xue-Qi Li· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
