It is shown that explicit idea-level allocation makes semantic coverage directly controllable, and that broader coverage becomes increasingly valuable when competitive research directions are sparse among many plausible alternatives.
Abstract
Frontier LLMs are increasingly used to automate scientific research through iterative search. We distinguish idea-driven search from solution-driven search and identify three core challenges: organizing evolving research ideas, selecting promising directions, and maintaining alignment between ideas and their implementations. To address these challenges, we introduce the Agentic Idea Manager (AIM), a fully autonomous framework for managing and exploring research directions in idea-driven automated research. Inspired by Bayesian optimization,
Aim
uses an Agentic Surrogate and an Agentic Acquisition mechanism to organize discovered ideas and guide their selection. A Solution Auditor maintains idea-solution integrity, while a Resource Planner adaptively allocates the remaining experimental budget across parallel search branches. Experiments on 10 AutoLab benchmark tasks show that
Aim
surpasses the strongest baseline by 1.6 percentage points on System Optimization tasks and 4.9 percentage points on long-horizon Model Development&CUDA tasks. Notably,
Aim
reaches the best baseline performance up to 3.1x faster in wall-clock time. We further provide a theoretical analysis of when searching over ideas becomes beneficial. Our analysis shows that explicit idea-level allocation makes semantic coverage directly controllable, and that broader coverage becomes increasingly valuable when competitive research directions are sparse among many plausible alternatives. Project Page: https://imhgchoi.github.io/agentic-idea-manager/
This work introduces PrimeScientist, which jointly determines research direction and resource investment across successive research attempts, and proposes an adaptive MCTS-based allocation policy that balances exploration and exploitation using experimental feedback and remaining resources.
EvoCast is introduced, a fully autonomous research-agent system for iterative forecasting architecture evolution that establishes and diagnoses a task-specific baseline, and develops task-specific architectures that outperform selected baselines, strong forecasting models, and agent baselines in three real-world foreca...
Kai-Peng Xu, Xiang Yan, Yan Wang et al.· 0 citations
This work introduces RobustSGPO, which specifies the requested edit, constructs and checks the patch, and continues search from either the incumbent or retained snapshots, and reduces source-task degradation after a shift, whereas random retention reaches a higher destination endpoint.
Zi-Bo Zhao, Ji-Jun Shi, Mo-Qing Zhou et al.· 1 citation
AlgoEvo is introduced, a unified agentic architecture that transforms automated algorithm discovery into an interactive, knowledge-accumulating process, demonstrating strong intra-task accumulation, cross-task transfer, and the ability to reproduce or exceed the strongest existing methods through flexible skill activat...
Jun-Hao Qiu, Qing-Long Hu, Ji Cheng et al.· arXiv.org· 2 citations
AgentIdeaBench is introduced, a multidisciplinary benchmark that evaluates scientific ideation under two matched settings, static observation and active exploration, and Scientific World Modeling is explored, a generation-time loop that refines a draft hypothesis through structured thought experiments.
Yunxiang Mo, Tianshi ZHENG, Yi-Sen Gao et al.· 1 citation
This work introduces SAIL, an open model with 35B total and 3B active parameters for literature research, scientific coding, and multi-step research workflows that achieves competitive performance across scientific research tasks with substantially fewer parameters than leading open-weight models.
Sai-Shuai Sun, Bryan Dai, Che Liu et al.· 0 citations