LLM agents' capabilities depend not only on their underlying models but also on their execution harnesses. Recursive self-improvement (RSI) offers a promising approach to automatically evolve these harnesses. However, deploying RSI in open-world settings still faces two critical challenges. First, open-world tasks are...
Ruiyao Xu, Yanfei Chen, Zhongying CuiZhu et al.· 0 citations
An intermediate architecture is explored, in which the cloud-written program defers bounded questions over user data to a small local model through an ordinary function call, which improves the success rate of a code-only agent in all six combinations of backbone model and test partition.
Boris Radovič, Marco Canini, Veljko Pejović· 0 citations
Explaining a vision--language model (VLM) prediction requires tracing training-example influence to the multimodal evidence that mediates it, yet existing attribution methods largely operate only at the sample level. Recent latent-mediated influence methods provide feature-level attribution in language models, but lack...
Laura Yao, Shi-Xing Yu, Jie Peng et al.· 0 citations
This work applies counterfactual interventions to explore if the value function of a Proximal Policy Optimization agent forms a world model of the Crafter environment, and learns concepts such as the rules governing when a diamond is collectible, water and food having an impact on health, heuristics regarding inventory...
Organisations that want language-model agents for security work face a choice between open-weight models, which they can run and audit themselves, and far more expensive closed frontier models. We study that choice on CTI-REALM (arXiv:2603.13517), a benchmark in which an agent turns a threat-intelligence report into a...
Sahil Garg, Ruhi Gottumukkala, Vishal Agarwal et al.· 0 citations
VETNET represents an ecosystem of live benchmark datasets and evaluation frameworks designed to accelerate AI-driven innovation in animal science and veterinary medicine through standardized, high-quality datasets and multi-institutional collaboration across academic and non-academic sectors. This framework addresses t...
Katherine J. Koebel, Renata Ivanek, Parminder Basran et al.· 0 citations
Long-horizon terminal benchmarks measure whether an agent can sustain progress through extended workflows with process rewards, not only whether its final state passes a binary check. We present Long-Horizon-Terminal-Bench 2.0 (LHTB 2.0), an extension of Long-Horizon-Terminal-Bench that preserves its 46 original tasks...
Zongxia Li, Zhongzhi Li, Yucheng Shi et al.· 0 citations
The method substantially improves upon previously reported FID scores for unguided generation and, notably, unconditional generation, where producing high-quality samples without guidance has been particularly challenging.
Donghoon Ahn, Run-Qian Wang, Alexei A. Efros et al.· 0 citations
The rapid advancement of Large Language Models (LLMs) has driven their deployment toward general-purpose harness environments, where LLM-based agents operate in sandbox workspaces and interact directly with file systems and shells. While numerous post-training pipelines exist for tool-use agents, their counterparts for...
Han-Si Yang, Lin-Ji Hao, Hong-Yan Hao et al.· 0 citations
Large language models have significantly lowered the barrier to writing code. Naturally, this has also led to the development of data science agents that promise automating the design and execution of data science from task formulation to model development. Existing evaluations of agentic data science (agentic DS) asse...
Xue Li, Hongqian Xia, Daniel Gomm et al.· 0 citations
Under the accelerated pace of AI development, any benchmark whose difficulty is calibrated with humans or current AI systems becomes circular, or saturates soon. How can we then evaluate machines that may become more capable than the current machines and the people who write the tests? One answer to the question hinges...
Proteomics is now generating unprecedented volumes of mass spectrometry data, driven by increasingly powerful instrumentation and large-scale studies. Yet our ability to translate these measurements into biological knowledge remains a major challenge. The limiting factor is no longer data generation, but our capacity t...
Wout Bittremieux· Zenodo (CERN European Organi...· 0 citations