ReListen is a training-free method in which a frozen audio language model finds its own evidence before answering, and its memory stays constant even for recordings too long to hear whole on one GPU, therefore, a frozen audio language model can search hour-long recordings by itself, without a transcript or additional t...
Ming-Hao Hsu, Shu-Jie Liu, Yuxuan Hu et al.· 0 citations
Speech and audio language models connect continuous acoustic representations to decoders pretrained primarily on text data. Most such models use MLP or Q-Former interfaces to map acoustic features into the decoder's input space, requiring the decoder to learn how to interpret the resulting representations. We investiga...
Ming-Hao Hsu, Shu-Jie Liu, Yuxuan Hu et al.· 1 citation
Affine Fields for Interface Repair across Modalities (AFFIRM) is introduced, which first learns and freezes a base correction for speech hidden states, then adds query-specific corrections with zero mean over the operator-training queries.
Ming-Hao Hsu, Yu-Xiang Wang, Ying Shen et al.· 1 citation
Voice agents are converging on a collaboration pattern: a full-duplex interaction model stays on the live channel as the entry to the conversation, while search, reasoning, and coding are handled through asynchronous delegation. A duplex model supports continuous listening and speaking, but complex reasoning and tool u...
Ying Shen, Yu-Xiang Wang, Kun-Yu Feng et al.· 0 citations
AURAL is introduced, which models a distribution over multiple plausible reasoning continuations in latent space and jointly predicts chunks of future states to reduce sequential forward passes and reasoning latency and shows that harder questions elicit more latent reasoning steps.
Yu-Xiang Wang, Kun-Yu Feng, Yuan-Cheng Wang et al.· 4 citations
EvoAudio is proposed, a recursive self-improvement system for audio understanding that is the first to evolve the model, waveforms, questions, and difficulty in one closed loop.