Open-ended scientific discovery often requires repeatedly proposing and evaluating candidate solutions. LLM-based systems can support this process by generating and refining executable solutions from verifier feedback. Methods such as TTT-Discover use test-time training (TTT) to update the solution-generating LLM from...
Chong-He Jiang, Ao Qu, Si-Yuan Liu et al.· 0 citations
This work evaluates 25 model and agent systems under a controlled tool-using protocol, then uses controlled studies to locate failures in evidence access, tool selection, memory, reasoning, interaction, and scientific execution.
Zhiqing Cui, Xinxiang Yin, Yihong Tang et al.· 0 citations
Evaluated on diverse mathematical, algorithmic, and systems optimization tasks, CORAL sets new state-of-the-art results on 10 tasks, achieving 3-10 times higher improvement rates with far fewer evaluations than fixed evolutionary search baselines across tasks.
Ao Qu, Handi Zheng, Zi-Jian Zhou et al.· arXiv.org· 38 citations· ⚡7
The HUman-Grounded AGENT Benchmark is introduced, which rethinks human reasoning simulation along three dimensions: (i) from averaged to individualized reasoning, (ii) from behavioral mimicry to cognitive alignment, and (iii) from vignette-based to open-ended data.