Contextual predictability shapes how we choose and encode words in production. The effects of a word’s predictability given preceding or past context are generally well-understood in both production and comprehension, but studies of naturalistic production have also revealed a poorly understood yet robust backward predictability effect of a word given only its future context, which may be linked to future planning. Across two studies of naturalistic speech, we revisit backward predictability using improved operationalizations, introducing Conditional Pointwise Mutual Information (conditional PMI), a conceptually motivated information-theoretic measure that quantifies the information shared between a word and future sequence under the constraints imposed by the past context. Study 1 shows that this measure reproduces predictability effects of future context on phonetic reduction while remaining non-redundant with backward predictability. Study 2 moves from reduction to word choice, examining substitution errors within a novel generative framework that models lexical contextual influences to predict the identity of the word that surfaces as an error. Within this framework, we find that past-conditioned predictability increases likelihood of erroneous selection, whereas future-conditioned predictability reduces it. In predicting error identity, conditional PMI emerges as the strongest contextual predictor, subsuming backward predictability. Together, these findings illuminate how past and future context shape word choice and encoding, linking contextual predictability to mechanisms of incremental planning in sentence production.
Emerging work suggests that the computational architecture of predictive coding (PC), widely studied in visual perception, may be an appropriate model for understanding predictability effects in real-time reading (i. e., the influence of a preceding sentence context on current word processing via putative anticipatory...
Allyson Copeland, B. Payne· Frontiers in cognition· 0 citations
Predictive language comprehension allows children to use prior context to anticipate upcoming information before it becomes available in speech. Although young children use sentence meaning to guide real-time comprehension, less is known about when they generate more specific expectations about upcoming words without d...
A. M. Castellón-Flores, A. Angulo-Chavira, Chiara Gambi et al.· Journal of Experimental Chil...· 0 citations
This study explores the role of semantic prediction error in shaping reading behavior, as reflected in reading time during naturalistic reading. We operationalize semantic prediction error using semantic update (SU), a measure derived from the Sentence Gestalt (SG) model, which simulates incremental predictive comprehe...
Siddharth Gupta, A. Lopopolo, Milena Rabovsky· bioRxiv· 0 citations
This work systematically vary the context window size of GPT-2 across four large-scale naturalistic English reading-time datasets and observes a U-shaped relationship, demonstrating that tracking long-range coreference relations is one important factor for the alignment between LM surprisal and human reading behavior.
Kohei Kajikawa, Lin Ai, Tatsuki Kuribayashi et al.· Proceedings of the 2026 Conf...· 0 citations
Do children predict the lexical form of upcoming linguistic input as readily as they predict semantic features? We investigated word form prediction using the prenominal mismatch paradigm, which tests whether children experience processing costs when encountering prediction-inconsistent gender-marked articles. We also...
Katja I. Haeuser, J. Kray· Journal of Experimental Chil...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.