Addressing the scarcity of annotated data for Other-Initiated Repair (OIR), when recipients interrupt conversation progressivity to signal trouble, prompting speakers to provide repair, this work introduces OIR annotations for the NOXI corpus, achieving considerable reliability. We evaluate whether LLMs can reliably an...
Anh Ngo, Nicolas Rollet, C. Pelachaud et al.· International Conference on...· 1 citation
This workshop brings together researchers and practitioners from multimodal interaction, natural language processing, generative artificial intelligence, affective computing, human-computer interaction, and clinical practice to examine how generative and multimodal systems can support interactive, collaborative decisio...
Lisa Raithel, Stefan Hillmann, Roland Roller et al.· 0 citations
A novel multimodal model for OIR detection and classification is introduced, incorporating a set of visual features drawn from conversation analysis, which demonstrates that visual information consistently improves performance over text and audio baselines, and provides insights into cross-modal feature contributions a...
Ha Anh Ngo, Nicolas Rollet, C. Pelachaud et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.