Human supervisors rely on coding agents'reports to assess progress, verify repairs, and decide when to intervene. But a supervisor cannot investigate a failure they were never told occurred. Failed attempts, workarounds, and unresolved risks may disappear from routine reports, leaving supervisors unaware of issues that...
Guo-Yang Xu, Rui Zhang, Xiu-Yu Wu et al.· 0 citations
World models aim to learn compact representations of an environment from observations, enabling agents to predict future states and plan their behaviour. However, most existing approaches learn black-box representations, with limited ability to incorporate prior knowledge about the world. We introduce Concept-Grounded...
R. Andreoni, Massimiliano Ronzani, C. Ghidini et al.· 0 citations
Frontier language models excel at complex tasks yet may prioritize protection over larger physical consequences in simple, urgent decisions. GPT-5.6 Sol, for example, moves a girl playing in shallow water before retrieving a submerged camera. We call this Protection Mode and study it with ProtectionBench: 285 prompts,...
Yuanfan Li, Junyi Chen, Qi Zhou et al.· 0 citations
Mechanistic interpretability aims to decompose neural network computations into human-understandable features, yet progress is limited by the absence of ground-truth units to evaluate against. We address this with a Sparse Transformer (ST): a 5-layer language model trained on TinyStories whose wide, TopK-sparse MLP for...
Anton Korznikov, Alexey Dontsov, Elena Tutubalina· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
As GUI agents are increasingly deployed for mobile task automation, their reliability depends not only on final task outcomes, but also on whether they reach these outcomes through stable interaction trajectories. In automation workflows, unnecessary actions, detours, and execution errors can add noise to collected dat...
Ridong Zhang, Shu-Xian Liang, Chao-Qun Wan et al.· 0 citations
This work presents Euler, a human-centered mathematical research system built around a shared, structured representation of the research process that allows researchers to trace how results are developed and supplies agents with persistent, task-relevant knowledge for planning, collaboration, and verification across se...
Qiu-Yu Chen, Qi Wang, Liang Xu et al.· 0 citations
Long-horizon tasks expose a weakness of monolithic tool-use loops: one agent must decompose, execute, and verify a task within a single trajectory. We introduce LAGO, which treats specialized language agents as reusable temporally extended options. A meta-agent retrieves options from a persistent library or spawns new...
Yuran Wu, Mengkang Hu, Qionglin Qiu et al.· 0 citations
Frontier web agents using closed models have high inference and computational costs. Smaller open models can be an alternative, but to be performant, they require training supervision from a human or teacher model. Token-level teacher distillation is not an option for closed teachers as it needs access to the model's l...
This work presents AgenticRV, a runtime-verification architecture that separates these boundaries from the monitoring formalism, and supports reuse of monitoring methods at explicit control boundaries, subject to the stated observation and deployment assumptions.
Laboratory experiments involve more than following predefined protocols; they require adaptive decision-making as the experimental state changes. Existing scientific benchmarks rarely assess such evidence-based decisions in laboratory settings. Here we present LabOPBench, a multimodal benchmark of 756 expert-authored,...
Jingyuan Li, Yujie Liu, Yijie Dai et al.· 0 citations
Supermartingale certificates formally guarantee temporal properties of discrete and continuous-time stochastic dynamical systems. However, these guarantees rely on a mathematical model of the world, leaving a sim-to-real gap that can invalidate them for the deployed system. We formulate the runtime monitoring problem f...
Mirco Giacobbe, Thomas A. Henzinger, Konstantin Kueffner et al.· 0 citations
Large language models (LLMs) increasingly tackle complex real-world tasks in specialized domains. However, identifying and correctly applying domain-specific rules remains challenging when scenario information is distributed across multiple files. Existing rule-reasoning benchmarks typically represent scenarios using o...
Chen-Hao Yuan, Bo-Han Yu, Yin-Hao Xu et al.· 0 citations