How much phonological knowledge do language models (LMs) possess about Chinese characters, and how is this knowledge represented and used? We introduce PinyinBench, a controlled benchmark covering homophones, phonological features (initials, finals, and tones), and polyphonic characters. We investigate 17 text-only and...
The results show that surprisal is predictive of Chinese reading times, and it is found that checkpoints whose surprisal remains closer to $n$-gram statistics are better predictors of reading in HKP and MECO, providing one possible explanation for the inverse scaling behavior.
Hon-Gao Zhu, Mu-Di Xu, Yikang Liu et al.· 0 citations
The first ChineseBabyLM Challenge, organized as part of NLPCC 2026, asked participants to train language models from scratch using no more than 102M Chinese words and provides a benchmark for advancing data-efficient and cognitively plausible approaches to Chinese language modeling.