Entity tracking emerges in sub-billion parameter language models and exceeds human performance in naturalistic narratives
This work evaluates entity tracking in both language models and humans using naturalistic narratives at multiple levels of complexity, finding that entity tracking degrades specifically with narrative complexity, not narrative length.