The Conversational Distribution Score (CDS) is introduced, which compares distributions of conversational behaviour using human conversations as a reference, and how many minutes and conversations are required before rankings stabilize is examined.
S. Satish, Erica Cooper, Patrícia Schmidtová et al.· arXiv.org· 0 citations
This work evaluates state-of-the-art LLMs as pointwise and pairwise judges of conversational success on CANDOR, finding pointwise scoring correlates moderately with human ratings, while pairwise comparison suffers from long transcripts and positional bias.
Maike Zufle, Patrícia Schmidtová, Vilém Zouhar et al.· arXiv.org· 1 citation
This position paper draws on AAC as a setting where speech AI failures are most visible and their stakes highest, alongside other underserved speakers - people who stutter, multilingual speakers, and non-binary and transgender users.
Maria Teleki, Kimi Wenzel, Anna Seo Gyeong Choi et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.