Multiparty Bench is introduced, the first benchmark specifically designed to objectively evaluate conversational speech systems as active participants within multi-party contexts and assesses agent behavior along two primary dimensions: turn-taking awareness and response appropriateness.
Yi-Jen Shih, Shih-Yun-Shan Kuan, Guan-Ting Lin et al.· 2 citations· ⚡1
AudioICL-Bench is introduced, a diagnostic benchmark whose per-episode rules are resampled so that no correct answer is recoverable from prior knowledge, and its nine tasks are organized along two axes that separate what must be learned from demonstrations from what must be perceived in the signal, enabling failures to...
Jia-Hung Chen, Yi-Cheng Lin, Kai-Wei Chang et al.· 0 citations
This paper introduces a syllable-level UASR framework based on masked language modeling, which avoids the need for G2P and the instability of GAN-based methods and generalizes effectively to low-resource languages that have remained particularly difficult for prior methods.
Liming Wang, Kai-Wei Chang, K. Kashino et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.