Autonomous R&D agents now write, run, and improve executable artifacts under automated evaluation-but largely as laboratory instruments: shown on curated benchmarks, with gains that are hard to trace to a cause and costs well above what sustained engineering practice absorbs. The limitation is structural. Most systems...
Jin Li, Ahmed Murtadha, Zhiying Wang et al.· 1 citation
This work introduces Mubric, a mutation testing-guided approach to rubric generation, which achieves the highest overall evaluation accuracy, outperforming the strongest baseline by 7.48 percentage points.
Jiayuxuan Yang, Jie M. Zhang, Yiling Lou et al.· 0 citations
Praxist is introduced, a lineage-centered generational system that converts reproducible artifacts and evaluator outcomes into a typed evidence graph of findings, lane-structured frontiers, and agendas, and Separating local artifact construction from cohort-level evidence synthesis lets later attempts inherit validated...
Jin Li, Ahmed Murtadha, Zhiying Wang et al.· 0 citations
This paper proposes SafeKeep, an inference-time safeguard that decouples safety judgment from tool execution: it assesses requests using flattened textual tool specifications while retaining the original schema-formatted specifications for execution.
