Autonomous research seeks sustained model improvements through iterative experimentation and feedback. LLM agents show promise in automating machine learning and language-model post-training, but their ability to sustain multimodal improvement remains unclear. We introduce MMPostTrainBench, a benchmark spanning eight t...
Yu-Xin Liu, Yuxuan Wang, Zhen-Xin Lei et al.· 0 citations
It is found that several state-of-the-art deep-research agents on Deep Research Bench II satisfy fewer than 50% of the rubrics, revealing a substantial gap between current DRAs and human experts.
Ruizhe Li, Ming-Xuan Du, Benfeng Xu et al.· arXiv.org· 34 citations· ⚡3
This work introduces InMind, a 125-task, expert-verified benchmark spanning ten life domains, with 113 tasks grounded in citable public sources, and calls this failure mode the implicit-association blind spot, and introduces a minimal diagnostic probe that keeps memory visible before the query arrives recovers most of...
Ruizhe Li, Mingxuan Du, Benfeng Xu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.