We present M5-TTS, a compact text-to-speech system supporting multilingual and Chinese multidialect synthesis, zero-shot voice cloning, speaker-specific multilingual generation, and CPU streaming. Its 50M-parameter language model, excluding the speech codec, combines a temporal backbone with a local multi-token predict...
Wen-Hao Li, Jing-Bin Hu, Sheng-Ming Ling et al.· 0 citations
Continuous latent representations underlie recent diffusion-based lyrics-to-song and text-to-music systems, yet aligning lyric conditions with these latents remains difficult: existing systems resort to generator-side machinery such as sentence-level timestamps, auxiliary alignment objectives, or semi-autoregressive de...
Guo-Bin Ma, Yue-Peng Jiang, Da-Ke Guo et al.· 0 citations
MuSeC is proposed, a music semantic codec that factorizes semantic and acoustic content directly from mixed signals without source separation that preserves information required for high-fidelity reconstruction while producing more LM-friendly discrete units.
Hua-Kang Chen, Guo-Bin Ma, Yue-Peng Jiang et al.· 0 citations
SemBridge is proposed, a training-only semantic-token anchoring framework for continuous-latent autoregressive speech generation and demonstrates that explicit semantic-token supervision for autoregressive state learning is an effective and general direction for continuous speech generation.
Han-Ke Xie, Haopeng Lin, J. Qian et al.· 0 citations
MiDashengLM-Gen is an end-to-end framework that couples a pre-trained Large Language Model (LLM) with per-token conditional flow matching for autoregressive, variable-length mixed-audio scene generation and drastically improves speech intelligibility over existing unified models.
Xingwei Sun, Heinrich Dinkel, Gang Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.