An encoder-based efficient formulation that resolves multiple quotation attributions within a shared, large context window is proposed, and an analysis of models'representations suggests that joint scoring improves on challenging attribution examples by preserving long-range anaphora resolution signal, an information that was already present in pretrained encoders.
Abstract
Attributing quotations to their speakers in literary texts remains an open challenge. Standard methods, which independently predict a speaker mention for each quotation, are efficient but still limited in accuracy. In contrast, large language model (LLM) approaches achieve strong performance, but their computational cost limits their use in large-scale literary analysis. We propose an encoder-based efficient formulation that resolves multiple quotation attributions within a shared, large context window. Using our new formulation, \textit{joint scoring}, we report state-of-the-art (SOTA) performance on the Project Dialogism Novel Corpus (PDNC), comprising more than 35,000 manually annotated quotations from 22 English novels. Our best model reaches 94.5\% overall attribution accuracy while processing novels $20\times$ faster than comparable standard methods and more than $1000\times$ faster than LLM-based approaches on an A100 GPU. An analysis of models'representations suggests that joint scoring improves on challenging attribution examples by preserving long-range anaphora resolution signal, an information that we found already present in pretrained encoders. To facilitate adoption, we release ModernBookNLP, a modified fork of BookNLP that replaces its quotation attribution model with our best system available at https://github.com/gasmichel/ModernBookNLP_QA/.
This work aims to highlight that, although literary texts have received relatively little attention in sentence segmentation research, they offer a rich and promising intersection between Natural Language Processing, Italian linguistics, and the Digital Humanities.
Arianna Redaelli, Rachele Sprugnoli· Italian Journal of Computati...· 0 citations
Word Error Rate (WER), the most commonly used metric for Automatic Speech Recognition (ASR), treats every lexical deviation from the reference as equally costly, regardless of whether it changes meaning. This raises the question: does WER actually track how humans judge ASR transcript quality? We introduce HATS-en, an...
Hritika Sharma, Thibault Bañeras-Roux, Alessandra Pinto et al.· 0 citations
Near-synonymy in the Qur’an challenges translators because related lexical items can differ in intensity, scope, expressive force, and contextual function. This exploratory qualitative study compares selected English expressions by Arberry and Irving with excerpts reported as GPT-4 outputs. Eleven lexical items in ten...
Bilal M. J. Ibrahim Zakarneh, Yasser Alrefaee· International Journal of Lin...· 0 citations
A new dataset is introduced, the Annotated Narrative Interlocutor Text Archive, or ANITA, derived from 25 Project Gutenberg books to nearly double the size of the leading Speaker Attribution dataset.
The notable findings suggest that LLMs often make basic errors of grammar and semantics, and highlight the limitations of current LLMs as a reliable source of content generation and information retrieval for low-resource languages.
Farah Adeeba, A. Khan, Rajesh Bhatt et al.· 0 citations
Text-to-music generation models are trained on massive music collections, creating a growing need for data attribution methods that can quantify the contribution of individual training samples. However, existing attribution methods are difficult to rigorously evaluate due to the lack of reliable ground truth, making it...
Jia-Wei Yu, Jian Liu· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.