Targeted controls show that tool-invocation scores alone do not establish event grounding and that reminder coverage depends on response history and frequency, and motivate developing and evaluating streaming assistants for timely action, initiative under general user needs, and coverage of entire response sequences.
Yin-Song Yan, Ling Wang, Yuxuan Wang et al.· 0 citations
OmniVChat-Studio, a multi-agent data engine for synthesizing single- and multi-turn audio-visual dialogues and OmniVChat-RL, a reinforcement learning reward design that jointly targets reply correctness, efficiency, and style in OmniVChat.
Haolin He, Yun-Fei Chu, Qi Chen et al.· 0 citations
Omni Demand Understanding is established as a distinct multimodal contextual inference problem: given an interaction stream, a model must detect whether a user demand is present and infer intent from multimodal and conversational context, and ODU is evaluated along five dimensions, covering both single-turn and multi-t...
Qi Chen, Yun-Fei Chu, Haolin He et al.· 1 citation· ⚡1
We define OmniVChat (Omni Video Chat) as the task of native audio-visual dialogue between a user and an omni model. In OmniVChat, omni models directly and simultaneously receive audio and video from a user and return text. The user's query is embedded in the audio and video, without a separate text question, external c...
Haolin He, Yunfei Chu, Qi Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.