MechHypoBench is introduced, the first benchmark for evaluating whether AI agents and AI scientists can generate mechanistic hypotheses from empirical data, and an evaluation framework is developed that assesses open-form mechanistic hypotheses through their consequences under withheld conditions.
Xia-Xun Xie, Qing-Qing Long, Meng Xiao et al.· 0 citations
Compared to contemporary or one-feature-one-agent RL-based approaches, HRLFS improves the downstream ML performance with iterative feature subspace exploration while accelerating total runtime by reducing the number of agents involved.
Wei-Liang Zhang, Xiao-Han Huang, Yi Du et al.· ACM Transactions on Knowledg...· 1 citation
SciHorizon-eLab is introduced, an agentic protocol-to-task compiler that formulates scientific embodied task construction as a compilation problem and constructs \BenchName, a ready-to-use benchmark comprising 300 certified tasks across diverse laboratory operations.
Mao-Kai Qin, Chuan Qin, Qi Zhang et al.· 0 citations
A significant gap exists between static QA and dynamic execution tasks, with top LLMs perform well on static QA but falter in real-world execution scenario; specialized agents outperform general models in real-world execution through environmental interaction and iterative refinement; and domain knowledge remains the p...
Yu-Fei Hou, Jiajia Wang, Ke Xiang et al.· Proceedings of the 32nd ACM...· 1 citation
This work proposes SciHorizon-DataEVA, a novel agentic system to scalable AI-readiness evaluation of heterogeneous scientific data, based on the Sci-TQA² principles, which organize AI-readiness into four complementary dimensions: Governance Trustworthiness, Data Quality, AI Compatibility, and Scientific Adaptability.
Dian-Yu Liu, Chuan Qin, Xi Chen et al.· Proceedings of the 32nd ACM...· 0 citations
The rapid advancement of high-throughput technologies has led to an explosion of biological data and a subsequent surge in bioinformatics analysis tools, thereby creating an urgent demand for automated bioinformatics workflows. Recently Large Language Models (LLMs) and LLM-based agents show great potential in this area...
Yufei Hou, Jiajia Wang, Ke Xiang et al.· Proceedings of the 32nd ACM...· 1 citation
Results indicate that SciDSK improves how agents locate and understand scientific datasets, providing a stronger foundation for actionable scientific data use.
Xiao-Han Huang, Qing-Qing Long, Xiaolei Du et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.