Autonomous R&D agents now write, run, and improve executable artifacts under automated evaluation-but largely as laboratory instruments: shown on curated benchmarks, with gains that are hard to trace to a cause and costs well above what sustained engineering practice absorbs. The limitation is structural. Most systems...
Jin Li, Ahmed Murtadha, Zhiying Wang et al.· 1 citation
VARM-Bench provides an auditable and reproducible benchmark for evaluating verifiable moderation rationales in Chinese abusive-speech moderation, and shows that strong label-level performance can conceal substantial errors in complete moderation records.
Mingyu Yuan, Sheng-Tao Wen, Ling-Bing Guo et al.· 0 citations
Praxist is introduced, a lineage-centered generational system that converts reproducible artifacts and evaluator outcomes into a typed evidence graph of findings, lane-structured frontiers, and agendas, and Separating local artifact construction from cohort-level evidence synthesis lets later attempts inherit validated...
Jin Li, Ahmed Murtadha, Zhiying Wang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
