Skip to content
Open access

Characterizing the role of reasoning tokens in large language models as state over tokens

Oct 2026 · Nature Machine Intelligence · Vol 8, pp. 1515 - 1522 · 1 citation · 69 references

TL;DR

The State over Tokens (SoT) conceptual framework is introduced, which reframes reasoning tokens not as a linguistic narrative, but as an externalized computational state—the mechanism that persists the computation across the separate generation cycles.

Read PDF

Similar papers

#artificial intelligence Open access Oct 2026

Talking with language models

The artifactual stance is introduced, which describes human–AI interaction in terms of their design and affordances, rather than potential intentional attitudes, and reframes puzzles about AI reference, the persistence of supposed interlocutors, and responsibility for AI-generated text.

James Ravi Kirkpatrick, Alexandru Radulescu, R. Sterken · 0 citations
Open access

Reasoning in Language Models

The work done in this thesis indicates that LLMs do exhibit properties and behaviors one would expect of a system capable of reasoning, but always with caveats: models solve tasks requiring reasoning only some of the time, and the relations between concepts and propositions appear to be reflected in their internal repr...

Stefan F. Schouten · 5 citations

Chronologic: Measuring Language Models' Ability to Represent the Past

Language models are appealing tools for research on the past. But to trust the evidence a model provides, researchers need to know whether its responses fit the period represented. Validation is challenging, because this is not a task living people ordinarily perform, and because many questions have multiple correct an...

T. Underwood, Zi-Liang Qiu, Sarah Griebel et al. · 1 citation
#natural language process... Open access Oct 2026

Investigating the Role of Reasoning-Language Alignment in Monolingual Retrieval-Augmented Generation

Reasoning traces improve large language models (LLMs), but current models are trained to reason mostly in English. It has been shown that forcing a model to reason in another language degrades accuracy, even when the reasoning language matches the language of the prompt -- but only for a setting where the model reasons...

Oliver Hauck, Mario Sanz-Guerrero, Katharina von der Wense · 0 citations
#natural language process... Conference Open access Sep 2026

From Token Probabilities to Semantic Constraints: Towards Declarative Probabilistic Evaluation of Language Models

A declarative probabilistic framework for pre-training evaluation that makes the semantic structure of model behavior explicit and provides new formal tools for relating evaluation to learning, and links evaluation and learning through a shared semantics.

Kyle Richardson, C. Anderson, Pranav Balakrishnan et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.