Movie dubbing is the task of synthesizing speech from scripts conditioned on video scenes, requiring accurate lip sync, faithful timbre transfer, and proper modeling of character identity and emotion. However, existing methods face two major limitations: (1) high-quality multimodal dubbing datasets are limited in scale...
Jia-Xuan Liu, Yang Xiang, Han Zhao et al.· Proceedings of the Thirty-Fi...· 4 citations· ⚡1
This technical retrospective offers a different account of the CosyVoice lineage, from CosyVoice through CosyVoice 2 and CosyVoice 3 to Qwen-Audio-3.0-TTS, and formalizes this history through four interface dimensions---representation, ownership, availability, and gradient reach---and separate within-paper evidence fro...
Qian Chen, Xian-Gang Li, Xiang Lv et al.· 0 citations
Movie dubbing is the task of synthesizing speech from scripts conditioned on video scenes, requiring accurate lip sync, faithful timbre transfer, and proper modeling of character identity and emotion. However, existing methods face two major limitations: (1) high-quality multimodal dubbing datasets are limited in scale...
Jia-Xuan Liu, Yang Xiang, Han Zhao et al.· Proceedings of the Thirty-Fi...· 0 citations
Universal audio representations must preserve acoustic detail while making high-level concepts accessible across speech, music, environmental sound, and downstream models of different capacities. We study semantic refinement of an acoustically pretrained encoder by adding audio-description alignment to a foundation of...
Le-Jun Min, Jun-Yu Dai, Rui-Chen Zheng et al.· 0 citations
Qwen-Audio-3.0-Gen-Preview is presented, a unified non-autoregressive framework that uses a Diffusion Transformer and a shared variational autoencoder (VAE) to generate the complete mixed waveform and demonstrates the potential of unified generation for temporally structured audio without task-specific branches.
Jun-Yu Dai, Xiao-Yue Duan, Xin-Yu Fan et al.· 2 citations
FullDiT is introduced, a conditional DiT that fuses eight frame-aligned RVQ streams with independently encoded captions and lyrics and uses non-causal self-attention over the complete acoustic latent sequence and outperforms five commercial systems on 15 of 18 automatic metrics.
Yun-Jia Li, Meng-Li Wu, Jun-Yu Dai et al.· 0 citations
In this report, we present Qwen-Audio-3.0-TTS, a production-oriented speech synthesis system that jointly advances content consistency, speaker similarity, prosodic naturalness, audio quality, controllability, multilingual coverage, efficiency, and robustness. It combines a 12.5~Hz low-frame-rate speech tokenizer for r...
Bajian Xiang, Cheng Wen, Han Zhao et al.· 5 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
