Unified audio models capable of audio understanding, audio generation and, increasingly, audio editing are proliferating rapidly. However, each capability is evaluated in isolation on specialized benchmarks and a basic question remains unanswered: can these models understand the audio they generate/edit i.e. do they ex...
This work introduces SEABED, an audio-first question answering dataset designed to benchmark language and audio reasoning models on SEA speech, and evaluates not only answer accuracy, but also whether models'stated reasoning is grounded in the audio evidence.
Harshit Rajgarhia, Asif Shaik, R. Lokesh et al.· 0 citations
D DuplexWorld introduces six worlds where voice agents are especially useful: banking, insurance, travel, healthcare and logistics, and Pathfinding, and shows that even the best voice agents leave substantial room for improvement on all 3 axes.
RL-ADA (Reinforcement Learning with Adversarial Dialogue Agents), a co-evolutionary training framework that eliminates this bottleneck by replacing human labels with consequence-based reward signals derived directly from measurable interaction outcomes, is presented.