Skip to content

Reasoning-Token Spikes Under Prompted Untruthful Responses in Large Language Models

Oct 2026 · 0 citations · 33 references
Computer Science

TL;DR

These findings show that explicitly prompted untruthful response policies can produce robust group-level differences in test-time reasoning-token use, and are a proof of concept that reasoning-token count can serve as a simple, content-independent black-box candidate signal for differentiating untruthful from truthful model behavior when raw reasoning traces are unavailable or unreliable.

Abstract

Monitoring the chain-of-thought of reasoning artificial intelligence (AI) models remains a key approach to detecting deception and other forms of misbehavior in such models. However, semantic chain-of-thought monitoring depends on reasoning traces being legible and sufficiently faithful to the underlying computations that produced the model's behavior, not to mention accessible. Moreover, there is increasing evidence that chain-of-thought outputs may soon become illegible or unfaithful, if they even remain accessible. Based on cognitive load theory, we investigate a lower-bandwidth signal--the number of reasoning tokens generated--which does not require access to the content of the reasoning trace. Three reasoning-capable large language models answered 210 multiple-choice questions--across analytic, descriptive, and normative reasoning types as well as moral and non-moral domains--under system prompts instructing them to respond truthfully, falsely, or without regard for truth. Across all three models, truth-directed responses elicited fewer reasoning tokens than both lie-directed and truth-indifferent responses. In addition, in one model, untruthful instructions increased the likelihood of reasoning at all. These findings show that explicitly prompted untruthful response policies can produce robust group-level differences in test-time reasoning-token use. While not yet establishing reasoning-token count as a detector of spontaneous deception or general misalignment, our results are a proof of concept that it can serve as a simple, content-independent black-box candidate signal for differentiating untruthful from truthful model behavior when raw reasoning traces are unavailable or unreliable. Future work should test instance-level detection rates, out-of-distribution generalization, learned deceptive policies, hidden objectives, and robustness under adversarial pressure.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

State of Thought Enables Endogenous Reasoning

State of Thought is proposed, a new reasoning paradigm that enables endogenous reasoning in LLMs, with the model's internal reasoning state governing how reasoning unfolds, and provides a generalizable and efficient alternative to existing test-time reasoning paradigms.

Z. Gong, Yi-Kun Hou, Zi-Hao Zeng et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Induction and Inquiry via Probabilistic Reasoning over Language and Code

The results suggest that one way humans continually grow their knowledge is by mentally representing many hypotheses spanning language-like and program-like representations, then revising those hypotheses to approximate Bayesian updates, while a bottom-up neural mechanism (an LLM) makes inference both tractable and lea...

Wasu Top Piriyakulkij, Samuel Acquaviva, Cassidy Langenfeld et al. · 0 citations
#machine learning Preprint Sep 2026

Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning

This work operationalizes the importance of a reasoning step as its advantage: the change in expected reward, e.g., producing the correct final answer, from including that step, estimated via Monte Carlo rollouts, and evaluates whether LLM judges can identify high-advantage steps and finds that sufficiently capable LLM...

Kevin Du, A. Hoyle, L. Ruis et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Reasoning Instructions Can Break Answer Decoding in Vision--Language Models

Chain-of-thought (CoT) instructions can distort multiple-choice VLM evaluation when a scorer appends a reasoning cue but reads answer-label logits before the model generates any rationale. We call this CoT-prefix scoring. On ScienceQA, Qwen2.5-VL-7B drops from 80.76% to 45.48%, and across five option-content permutatio...

Zeyan Li, Si-Yuan Qiu, Jian-Feng Xu · 0 citations
#natural language process... Preprint Sep 2026

When Confidence Rises Too Early: Detecting Shortcut Reasoning via Premature Answer Commitment

The Distributional Answer Commitment Score (DACS) is proposed, a distributional confidence estimator that measures the entropy of the model's probability distribution over answer commitment at each reasoning step to capture how concentrated the model's answer belief is without requiring ground-truth answers or task-spe...

Zhao-Han Zhang, Jun-Jie Liu, Chengzhengxu Li et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.