Skip to content

Author

Tal Linzen

7 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Time

OP-Mix (On-Policy Mix), a data mixing algorithm that operates across pretraining, midtraining, and instruction tuning, is introduced, suggesting a different view of language model training: not a sequence of distinct phases, but a single continuous process of learning from data.

Michael Y Hu, Apurva Gandhi, Kyunghyun Cho et al. · 0 citations
Preprint Oct 2026

A failure of Imagination: VLMs fail to use visual representations for text, but self-distillation can help

Vision-language (VL) models are typically built by fine-tuning a language model to attend to visual features in service of a Visual Question-Answering objective. We ask whether this alignment changes how language models represent text---especially on tasks where visualization would help, like geometry questions posed i...

Shashwat Singh, He He, Tal Linzen · 0 citations
#natural language process... Preprint Sep 2026

Bayesian Fine-tuning Yields Language Models that are as Bayesian as their Beliefs Allow

Language models (LMs) are increasingly used for tasks that require reasoning about hidden variables from a few observations, for which Bayesian inference is the normatively correct solution. While supervised fine-tuning of an LM on the outputs of an optimal $\textit{Bayesian}$ model leads to near-Bayesian behavior, sta...

Polina Tsvilodub, Andreas Waldis, Lin-Lu Qiu et al. · 0 citations
#artificial intelligence Preprint Jun 2026

Does Anthropomorphic Language Impact Public Perceptions of AI?

The results indicate that any immediate effects on opinions of AI are modest, although they leave open the possibility that anthropomorphic language could have an effect in naturalistic settings, or over gradual, continued exposure.

Betty Li Hou, Sophie Hao, Sunoo Park et al. · 0 citations
#natural language process... Preprint Feb 2026

LLM surprisal is necessary but not sufficient to capture English garden-path effects: Evidence from joint latent modeling of reading paradigms

This work presents a latent-process multinomial processing tree (MPT) model of human reading and comprehension/judgment behavior in garden-path sentences that is fit to combined data from four different reading paradigms and test several models that assume an influence of surprisal within the MPT architecture.

Dario Paape, Tal Linzen, S. Vasishth · 1 citation

CogGym: Towards Large-Scale Comparative Evaluation of Human and Machine Cognition

CogGym is introduced, a scalable, unified framework grounded in cognitive science for systematically comparing model and human behavior on matched experimental trials, and intends for CogGym to provide a living evaluation framework that continually incorporates new cognitive science experiments to characterize where mo...

Lance Ying, Jin-Zhou Wu, Y. Wang et al. · 0 citations

Beyond the Rosetta Stone: Unification Forces in Generalization Dynamics

This work introduces a controlled setting to study the causes and training dynamics of cross-lingual knowledge transfer by training small Transformer models from scratch on synthetic multilingual datasets and suggests methods to encourage representational unification as part of training that would improve LLMs'cross-li...

C. Blum, Katja Filipova, Ann Yuan et al. · 5 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.