This work introduces a synthetic spoken-dialogue pipeline that provides earliest-actionable-point supervision, marking when the observed speech grounds a tool and its required arguments, and trains an omni-modal language model on this corpus, enabling causal, chunk-level decisions and partial-transcript generation for...
Yizhou Peng, Chen Chen, Donghang Wu et al.· 0 citations
Full-duplex speech models are moving voice interaction beyond conventional turn-taking, yet natural conversation is shaped not only by when an agent speaks, but also by how it behaves as a conversational character. We present CharDuplex, a character-driven full-duplex speech model that combines real-time spoken interac...
Donghang Wu, Yi-Si Liu, Chen Chen et al.· 0 citations
JELAR, a Joint-Embedding Predictive Architecture (JEPA)-based latent reasoning framework that conditions latent reasoning supervision on acoustic representations learned from raw waveforms, demonstrates the effectiveness of JEPA-conditioned latent reasoning as an alternative to explicit textual CoT supervision.
Donghang Wu, Haoyang Zhang, Yizhou Peng et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.