An episode-level protocol that scores whether, when, and what a delegate contributes around the participant's actual idea units is introduced, to evaluate online delegation.
Abstract
In online meeting delegation, LLM agents fail to recognize when to speak. With no structured way to track stances, coverage, and floor, they miss the moments where they should contribute. Prompt-only delegates stay silent on 51.4% of the absent participant's talking opportunities on the AMI corpus. We present CAPA (Collaborative Agent Predictive Architecture), an architecture for online meeting delegation. A Perceiver updates the meeting state from each observed turn. A Predictor forecasts how the conversation will continue. A Controller decides whether to speak and which proposition to surface. A Generator phrases the chosen contribution in the participant's style. Two judges score the forecast and the action against the next observed turn. A Recalibrator updates the meeting state from those verdicts for future decisions. To evaluate online delegation, we introduce an episode-level protocol that scores whether, when, and what a delegate contributes around the participant's actual idea units. The protocol's schema-constrained LLM judges align with human annotations at Cohen's kappa = 0.71. On 137 AMI meetings, CAPA reduces the silence rate from 51.4% to 2.5%, doubles credited recovery (26.1 -->52.2), and keeps hallucination at 0.6%. The failure mode shifts from omission to selection, with each residual near-miss attributable to a specific module of the architecture. Mechanism ablations identify the meeting state as the lever that closes the recognition gap, where raw-context scaling alone does not.
Hear2Act is introduced, a unified evaluation protocol for text and spoken assistants with 480 persona-grounded scenarios, hidden user concerns, and objectively verifiable outcomes that show that prosody matters when lexical evidence is insufficient, and that audio-capable LLMs can recover information from speech but do...
Xin-Yi Liu, H. Nayyeri, Dilek Hakkani-Tur et al.· 3 citations· ⚡1
Equal participation in co-located discussion is important for effective collaboration, yet people often hold back when they anticipate negative interpersonal or professional consequences, especially when raising a point requires voicing it themselves. We present SecondVoice, a mixed-reality system that enables people t...
Yue Shen, Rehema Abulikemu, Ryan P. McMahan et al.· 0 citations
This work argues for a restraint-first intervention policy: systems should intervene not merely because dialogue appears active, but when sustained engagement fails to convert into observable enactment, while withholding intervention once concrete enactment cues are present.
This work pauses a reflection-support agent when it would normally redirect the conversation, surface its observation, and asks users to interpret the pattern and decide how to proceed, and derives a taxonomy of nine interpretation categories and shows that similar reflective states can call for substantially different...
This work samples possible continuations of an ongoing turn and uses changes in semantic dispersion to identify TRPs within turns, providing empirical support for the view that evolving semantic constraints inform perceived turn-taking opportunities in unscripted interaction.
SAGE (State-Grounded Abstention-Aware Evaluation), which compiles a workflow specification and per-turn state diff into atomic, schema-grounded criteria and routes each through a cascade of symbolic and encoder/NLI verifiers that abstain rather than guess, aggregating criterion verdicts into a turn-level decision with...
Rayan Khoury, Shih-Yao Lin, P. Mishra· 0 citations