Carl Hartmann

Who is the Pronoun Pro? Comparing LLMs and Humans at Number-Disambiguation of'they'

This study evaluates whether large language models (LLMs) can reliably replace or complement human research assistants in linguistically complex annotation. In a controlled annotation task, 73 human annotators (local students and crowdworkers with and without a background in linguistics) and more than 40 LLM configurat...