Multimodal emotion preference learning uses pairwise comparisons to identify which open-ended emotion descriptions align more closely with human judgments. However, existing methods primarily focus on the final preference decision and provide little explicit supervision for localizing and correcting erroneous content....
Zi-Long Huang, K. Lee, Ze-Zhong Jin et al.· 0 citations
Speech large language models (speech LLMs) perform well on automatic speech recognition (ASR) when sufficient paired speech-text data is available, but their performance degrades in low-resource settings. A cascaded pipeline that performs speech-to-phoneme (S2P) conversion followed by phoneme-to-grapheme (P2G) conversi...
This work investigates the effectiveness of internal representations from encoder and decoder components of Speech LLMs for Parkinson's Disease detection across multilingual and cross-lingual settings and proposes a Squeeze-and-Excitation (SE)-based dynamic layer aggregation framework, which surpasses best-layer select...
Sarthak Giri, Z. Pang, Tatsuya Kawahara· arXiv.org· 0 citations
This work evaluates zero-shot phonetic classification on Chinese aspiration and Japanese moraic nasals and proposes a classification method based on continuous Articulatory Feature vectors extracted from each frame that outperforms discrete token-based methods, particularly for rare phones.
Experiments on the MER2026-EmoPrefer Challenge dataset and the error-augmented dataset demonstrate that EAPO improves emotion preference prediction and enhances the robustness of MLLM judges when evaluating fluent descriptions that conflict with the video's multimodal emotional evidence.
Zilong Huang, Junyi Peng, Junjie Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.