Spatial audio editing modifies an existing soundfield according to a user's instruction while preserving the rest of the scene. Unlike conventional audio editing, it must reason jointly about audio events, spatial information, dynamic changes, and environmental information in first-order Ambisonic (FOA) waveforms. Exis...
Ke Lei, Chenyuhao Wen, Yu Zhang et al.· 0 citations
SwanTale is proposed, a multi-speaker expressive speech and audio generation model that supports both zero-shot and instruct tasks, and adopts reward-conditioned quality control and Engram conditioning along with Unified MoE for multi-task and multi-audio-modality modeling.
Yu Zhang, Ruiqi Li, Changhao Pan et al.· 3 citations
Spatial-Omni is a lightweight method that implements SO-Encoder to inject First-Order Ambisonics (FOA) spatial audio into existing Omni LLMs as an independent modality, without modifying their original audio encoders.