Chain of Thought (CoT) monitoring is used by frontier labs to detect misbehaviour of AI systems. Yet, its reliability remains poorly understood. We attribute this to the lack of a successful organizing principle that leads to generalizable conclusions about monitoring reliability in different regimes. Recent work attri...
Lennart B\"urger, Piotr Komorowski, Moritz Weckbecker et al.· 0 citations
AI companions provide users with emotional support and ongoing companionship, but their sustained relational interactions also introduce distinct safety risks. Prior work largely targets general harms or specific companion platforms and risk categories, while relying on manually collected conversations, limiting scalab...
Xinyang Liao, Lingyu Li, Kaicheng Shen et al.· 0 citations
Deep research (DR) agents address open-ended information needs through multi-step reasoning, long-horizon web search, and evidence synthesis. However, existing benchmarks primarily focus on academic research or synthetic tasks, leaving DR agents'capabilities in real-world life and professional productivity settings ins...
Yi-Bo Wang, Sen-Jie Jin, Yansong NING et al.· 0 citations
Ambiguous or incomplete task specifications complicate both execution and clarification for language-model agents. Yet agents' responses to these information gaps remain poorly characterized across models and execution harnesses. We present AM-Bench, a benchmark built from 48 tasks adapted from Terminal-Bench 2.0 and H...
Kaiyu Huang, Yiting Li, Angyang Gu et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
AI has become increasingly helpful in scientific discovery, yet human expert review remains essential for those problems without reliable automated evaluation, posing a fundamental challenge as candidate generation scales beyond available review capacity. This paper studies verification under limited human effort, wher...
Fan Nie, Haotian Ye, Shurui Liu et al.· 0 citations
Autoresearch systems increasingly undertake entire research projects. In practice, scientific research requires systems to pursue multiple interdependent claims through a continuous, multi-stage workflow and revise experiments as evidence accumulates. Existing evaluations of autoresearch systems, however, typically sco...
Peng Jiang (Tsinghua University), Dongyang Li (Tsinghua University), Quanying Liu (Southern University of Science et al.· 0 citations
AReaL-RSI is presented, a framework for organizing a persistent research team of agents without updating backbone LLM weights and evaluating outcomes and whole-system resource expenditure in terms of evaluated outcomes and whole-system resource expenditure.
Wen-Hao Zhou, Jia-Jun Song, Hai-Tao Wang et al.· 0 citations
WorkRover is introduced, a framework for training long-horizon cowork agents through recursive environment evolution that enables construction agents to jointly build and validate semantically aligned work contexts, executable tasks, and evidence-grounded verifiers, adapting their actions to workspace state and executi...
Hang He, Lin-Ting Wang, Guan-Ming Liu et al.· 1 citation
Long-term memory has become a core component of large language model (LLM) agents. As agents accumulate personal information over long-term use, users increasingly ask them to delete sensitive or outdated facts. A memory system should honor such requests. It should remove exactly what was requested and keep the rest of...
Bo-Fan Xie, Chao-Kun Wang, Guan-Chen Ge et al.· 0 citations
In this paper, our goal is to represent text embeddings as sketches for three main reasons. First, to visualize text representation and to explore their potential their potential for AI explainability. Second, to investigate the potential benefits of the sketch-based representation for information retrieval. Third, to...
Test-time scaling has enabled LLMs to solve increasingly complex reasoning, discovery, and optimization tasks. However, existing approaches often gather observations while seeking evidence for current hypotheses, then generate new hypotheses conditioned on those hypotheses and their associated evidence. This couples ob...
Harshit Joshi, Priyank Shethia, Monica S. Lam· 0 citations
Do vision-language models use depth information to judge which object is closer, or rely on image-plane cues? We investigate this question through controlled depth--cue conflicts, representation analysis, and interventions. Among the many image-plane cues relevant to depth perception, we focus on apparent size and vert...