Gander is presented, a native multimodal duplex interaction model that builds on MiniCPM-o 4.5 and is further adapted for realtime interaction with an asynchronous agent loop and is released together with its models, code, and data to facilitate further research and development in the community.
Orantqing, Shengpeng Ji, Jun-Long Tong et al.· 3 citations
Spatial audio editing modifies an existing soundfield according to a user's instruction while preserving the rest of the scene. Unlike conventional audio editing, it must reason jointly about audio events, spatial information, dynamic changes, and environmental information in first-order Ambisonic (FOA) waveforms. Exis...
Ke Lei, Chenyuhao Wen, Yu Zhang et al.· 0 citations
SwanTale is proposed, a multi-speaker expressive speech and audio generation model that supports both zero-shot and instruct tasks, and adopts reward-conditioned quality control and Engram conditioning along with Unified MoE for multi-task and multi-audio-modality modeling.
Yu Zhang, Ruiqi Li, Changhao Pan et al.· 3 citations
Spatial-Omni is a lightweight method that implements SO-Encoder to inject First-Order Ambisonics (FOA) spatial audio into existing Omni LLMs as an independent modality, without modifying their original audio encoders.
Vocalized audio synthesis, the task of generating audio in which intelligible speech is embedded within an environmental soundscape, underpins applications such as podcast production and video dubbing, and VoxAudio, a causal autoregressive flow matching model that addresses this problem from three complementary aspects...
Wenxiang Guo, Changhao Pan, Ziyue Jiang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.