VAmoS Energy, a benchmark that combines challenges in 100 calls about utility billing and payment assistance, is introduced, showing why voice agents need evaluation across the whole call, including what they say, what they change, and how they handle competing speech.
Joshua Meyer, S. Shayegan, Ritiz Tambi et al.· 0 citations
VAmoS Bench, the Voice Agent Simulation Bench, measures complete voice-agent systems end to end in a stateful customer-support task and catches an agent that claims to have changed a card without updating the database as well as one that makes the right database change while disclosing protected information.
Joshua Meyer, S. Shayegan, Ritiz Tambi et al.· arXiv.org· 5 citations· ⚡2
The cluster loop yields the strongest held-out rubric on both evaluator tasks from a commercial search vertical, and is the only method robustly positive on both.
Jinyoung Kim, N. Corp, Sun Kim et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.