In this paper, we propose an alignment-path distillation framework for streaming automatic speech recognition (ASR) with large language models (LLMs). Interleaved streaming ASR-LLMs use forced alignments (FA) from alignment models, such as those trained with connectionist temporal classification (CTC), to construct spe...
Yan-Song Jia, Kai-Wei Huang, Junjie Chen et al.· 0 citations
A frozen Audio Encoder trained on diverse speech understanding tasks as a semantic teacher to regularize the audio feature space and improves text-speech alignment and stabilizes autoregressive generation while keeping the overall system simple.
Fei-Yu Shen, Kun Xie, Yi-Chen Wu et al.· 7 citations· ⚡1
FireRedAudio is introduced, a general-purpose audio language model with a shared 9B-parameter LLM that achieves competitive or leading performance in audio understanding and multilingual ASR, strong content accuracy and speaker preservation in zero-shot TTS, leading instruction following in Instruct TTS, and substantia...
Fei-Yu Shen, Fenglong Xie, Junjie Li et al.· 3 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.