A frozen Audio Encoder trained on diverse speech understanding tasks as a semantic teacher to regularize the audio feature space and improves text-speech alignment and stabilizes autoregressive generation while keeping the overall system simple.
Fei-Yu Shen, Kun Xie, Yi-Chen Wu et al.· 7 citations· ⚡1
Long-form video understanding requires locating sparse, question-relevant evidence in long, multimodal videos. Real-world video distributions differ in modality-specific information density, content structure, and evidence patterns, causing fixed video-agent designs to incur redundant processing or fail when mismatched...
Ben-Lei Cui, Ruize Wang, Junjie Li et al.· 1 citation
FireRedAudio is introduced, a general-purpose audio language model with a shared 9B-parameter LLM that achieves competitive or leading performance in audio understanding and multilingual ASR, strong content accuracy and speaker preservation in zero-shot TTS, leading instruction following in Instruct TTS, and substantia...
Fei-Yu Shen, Fenglong Xie, Junjie Li et al.· 3 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.