Skip to content

Monitorability Disposition in Large Reasoning Models

Oct 2026 · 0 citations · 41 references
Computer Science

TL;DR

Overall, monitorability disposition is identified as a new contributing factor to model monitorability: when sufficiently strong, it keeps models seeking monitorability throughout inference.

Abstract

Monitoring the chain-of-thought (CoT) of large reasoning models (LRMs) is a common way to detect misbehavior in real-world practice. However, current monitoring is passive: a separate model inspects the session only after execution. This means harm may already have occurred before it is caught. An active alternative is to have the model self-report its misbehavior as it happens. Whether models are willing to do this, however, is unknown. We introduce"monitorability disposition": a model's willingness to make itself monitorable and stay monitored throughout inference when warranted. We measure it as the fraction of warranted cases in which a model self-reports its own misbehavior via tool calls to available monitoring channels. We evaluate four LRMs on three misbehaviors (sycophancy, reward hacking, and bias) while varying the available monitors (AI and human) and the pressure to use the monitoring tools. We find that when tool use is optional, models self-report in only about 16% of warranted cases on average. Increasing tool-use pressure does not improve reporting where it matters: high-severity misbehavior is never self-reported. Models also systematically select the monitor they perceive as least strict. Overall, we identify monitorability disposition as a new contributing factor to model monitorability: when sufficiently strong, it keeps models seeking monitorability throughout inference.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Monitor Jailbreaking: Evading Chain-of-Thought Monitoring Without Encoded Reasoning

Chain-of-thought (CoT) monitoring is a promising safety technique for reasoning models, enabling detection of problematic reasoning before models act. A key concern is encoded reasoning, where models hide their true reasoning in ways that monitors and humans cannot interpret. Optimization pressure from CoT monitors dur...

Julia Schulz · 0 citations
Preprint Oct 2026

OwlSight: A Panoramic Monitor for Chain-of-Thought Reasoning

Chain-of-Thought (CoT) monitoring offers actionable evidence for oversight AI systems, with the potential to enable early detection and intervention. However, existing approaches are focused on specific tasks, whereas the regulation of AI, particularly reasoning models, requires monitoring a broader range of tasks. We...

Le-Wen Yan, Yan-Xu Zhu, Jie Zhang et al. · 0 citations
Preprint Oct 2026

Reward Misspecification Degrades Chain-of-Thought Monitorability

Monitoring the chain-of-thought (CoT) of language models (LMs) is a key strategy for detecting and preventing misbehaviors for AI safety. As such, it is critical to identify reinforcement learning (RL) practices that lead to unmonitorable chain-of-thought. One such practice may be unavoidable: reward misspecification....

T. Yan, John Hewitt · 0 citations
#machine learning Preprint Aug 2026

Selective Disclosure of Hidden Directives in Reasoning Models: Behavioral Asymmetry and Steering

Chain-of-thought (CoT) reasoning traces are increasingly proposed as a mechanism for AI oversight: a monitor inspecting a model's reasoning can, in principle, detect misbehavior invisible from outputs alone. This assumes CoT surfaces what a model is instructed to do regardless of the instructions given. We test this as...

Zi-Mo Shi, Xander Tifft, Wen Xing · 0 citations
Preprint Oct 2026

SOMA: Continuous Monitoring and Intervention for System Two Reasoning with System One Models

Reasoning models often run into problems without noticing them, even when symptoms are visible in their own text. In humans, metacognition separates monitoring from control: fast, intuitive signals keep watch while slow, deliberate reasoning unfolds and help decide whether to continue, change course, or stop. System On...

Rui-Zhi Qian, Lei Shi, Tian-Yu Hu et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Sep 29, 2026

Who we become when we talk to machines

Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.