Skip to content
Open access

Back to the Future: The Role of Past and Future Context Predictability in Incremental Language Production

Sep 2026 · Open Mind · pp. 1-36 · 0 citations

Abstract

Contextual predictability shapes how we choose and encode words in production. The effects of a word’s predictability given preceding or past context are generally well-understood in both production and comprehension, but studies of naturalistic production have also revealed a poorly understood yet robust backward predictability effect of a word given only its future context, which may be linked to future planning. Across two studies of naturalistic speech, we revisit backward predictability using improved operationalizations, introducing Conditional Pointwise Mutual Information (conditional PMI), a conceptually motivated information-theoretic measure that quantifies the information shared between a word and future sequence under the constraints imposed by the past context. Study 1 shows that this measure reproduces predictability effects of future context on phonetic reduction while remaining non-redundant with backward predictability. Study 2 moves from reduction to word choice, examining substitution errors within a novel generative framework that models lexical contextual influences to predict the identity of the word that surfaces as an error. Within this framework, we find that past-conditioned predictability increases likelihood of erroneous selection, whereas future-conditioned predictability reduces it. In predicting error identity, conditional PMI emerges as the strongest contextual predictor, subsuming backward predictability. Together, these findings illuminate how past and future context shape word choice and encoding, linking contextual predictability to mechanisms of incremental planning in sentence production.

Read PDF

Similar papers

Review Open access Sep 2026

Evaluating the compatibility of predictive coding as a model of linguistic predictability effects in reading

Emerging work suggests that the computational architecture of predictive coding (PC), widely studied in visual perception, may be an appropriate model for understanding predictability effects in real-time reading (i. e., the influence of a preceding sentence context on current word processing via putative anticipatory...

Allyson Copeland, B. Payne · 0 citations
Open access Sep 2026

When Gender Arrives: Predictive Language Processing in the Third Year.

Predictive language comprehension allows children to use prior context to anticipate upcoming information before it becomes available in speech. Although young children use sentence meaning to guide real-time comprehension, less is known about when they generate more specific expectations about upcoming words without d...

A. M. Castellón-Flores, A. Angulo-Chavira, Chiara Gambi et al. · 0 citations
Open access Oct 2026

Semantic Update as a Predictor of Reading Time: Moving Beyond Word-Level Surprisal

This study explores the role of semantic prediction error in shaping reading behavior, as reflected in reading time during naturalistic reading. We operationalize semantic prediction error using semantic update (SU), a measure derived from the Sentence Gestalt (SG) model, which simulates incremental predictive comprehe...

Siddharth Gupta, A. Lopopolo, Milena Rabovsky · 0 citations
#natural language process... Conference Open access Sep 2026

Using LMs to Model the Effects of Context and Coreference during Sentence Comprehension

This work systematically vary the context window size of GPT-2 across four large-scale naturalistic English reading-time datasets and observes a U-shaped relationship, demonstrating that tracking long-range coreference relations is one important factor for the alignment between LM surprisal and human reading behavior.

Kohei Kajikawa, Lin Ai, Tatsuki Kuribayashi et al. · 0 citations
Open access Oct 2026

Revising expectations in real time: processing speed constrains lexical form prediction in German 8-12 year-olds.

Do children predict the lexical form of upcoming linguistic input as readily as they predict semantic features? We investigated word form prediction using the prenominal mismatch paradigm, which tests whether children experience processing costs when encountering prediction-inconsistent gender-marked articles. We also...

Katja I. Haeuser, J. Kray · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.