This work introduces TAC2, a foundation model that casts timestamped audio captioning as composable functions to construct granular, speaker-attributed acoustic timelines directly from in-the-wild audio, and extends it with expressive speech attributes to obtain TAC2-S, a unified model that yields strong spoken audio u...
Swapnil Bhosale, Prem Seetharaman, Ke Chen et al.· 0 citations
Generative TSE model PromptSep-Speaker is proposed, a generative TSE model based on latent diffusion that unifies four interchangeable cues: speaker temporal order, transcript, enrollment audio, and speaker caption that achieves state-of-the-art performance over TSE and universal source separation baselines, improving...
Yu-Tong Wen, Ke Chen, P. Seetharaman et al.· 0 citations
CrossEdit is presented, a unified omni-modal editing model for images, audio, and video that performs AV movie scene edits zero-shot through cross-modal transfer and proposes AV-FES, a metric that jointly scores instruction following and consistency.
William Chen, Prem Seetharaman, Ke Chen et al.· 0 citations
This work develops ParA-LLM, a framework of 22 paralinguistic characteristics that surpasses state-of-the-art Audio LLMs like GPT-4o-Audio by 7.5% on ParA-Bench and releases ParA-Bench, a benchmark of 6,000 multiple-choice questions across speaker-speech, acoustic, and mixed categories.
Nishit Anand, Jia-Qi Su, Ke Chen et al.· Interspeech· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.