Large language models (LLMs) exhibit both knowledge of language, rendered by, for example, grammatical judgment ability, and abilities to perform tasks through language, such as math-word problem solving. Motivated by neurolinguistic studies of their neural dissociation in human brains, in this study, we investigate th...
This study first integrates PLMs into the modeling of naturalistic human reading and examines their use to estimate next-word predictability, which can also integrate orthographic and parafoveal information, demonstrating that next-word prediction difficulty has strong predictive power for gaze duration and word skippi...
Jun-Lin Li, Sara Alhajeri, Tatsuki Kuribayashi· Proceedings of the 2026 Conf...· 0 citations
Language models (LMs) often exhibit successful cross-lingual transfer through continued (pre)training, still their underlying process remains unclear. One possibility is that LMs can leverage the evidence toward language-universal principles, namely, hierarchical structure, from a source language (L1) to a new language...
Shin Yamaguchi, Masaya Taniguchi, Tatsuki Kuribayashi et al.· 0 citations
Some properties of languages, e.g., subject-object-verb (SOV) word order, are more prevalent than others among the thousands of attested natural languages (NLs). Such typological commonality is often attributed to learning biases. Computational simulations, recently with language models (LMs), have facilitated the expl...
This work systematically vary the context window size of GPT-2 across four large-scale naturalistic English reading-time datasets and observes a U-shaped relationship, demonstrating that tracking long-range coreference relations is one important factor for the alignment between LM surprisal and human reading behavior.
Kohei Kajikawa, Lin Ai, Tatsuki Kuribayashi et al.· Proceedings of the 2026 Conf...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.