OmniVChat-Studio, a multi-agent data engine for synthesizing single- and multi-turn audio-visual dialogues and OmniVChat-RL, a reinforcement learning reward design that jointly targets reply correctness, efficiency, and style in OmniVChat.
Haolin He, Yun-Fei Chu, Qi Chen et al.· 0 citations
We define OmniVChat (Omni Video Chat) as the task of native audio-visual dialogue between a user and an omni model. In OmniVChat, omni models directly and simultaneously receive audio and video from a user and return text. The user's query is embedded in the audio and video, without a separate text question, external c...
Haolin He, Yunfei Chu, Qi Chen et al.· 0 citations
This work develops HarnessBandit, an online scheduler that selects one harness per optimizer step, and improves over mixed-batch multi-harness training on both benchmarks, while training diagnostics indicate that learnability and transferability provide distinct, evolving signals.
Hong-Liang Wei, Xiao-Bing Tu, Yinggui Wang et al.· 1 citation· ⚡1
BQ-LoRA is proposed, a low-rank adaptation framework that organizes trajectory updates through a local behavior quotient manifold and contains two modules, i.e., behavior quotient balancing (BQB) and decision preserving compression (DPC).
Peng-Yang Zhou, Xiao-Bing Tu, Zheng-Xi Liu et al.· 0 citations
TAC-Merge is proposed for tracing and coordinating cross-layer influence in multimodal model merging and demonstrated the effectiveness in consolidating complementary expert capabilities and supporting generalization to unseen tasks.
Peng-Yang Zhou, Xiao-Bing Tu, Zheng-Xi Liu et al.· 0 citations
Single-cell RNA sequencing now routinely produces detailed maps of cell types and states, but interpreting a finished project remains harder than it should be. Once the analysis is done, the results are usually handed over as static reports, figure panels and supplementary tables. A biologist who later wants to revisit...
Jin-Bo Zhang, Zheng-Xi Liu, Zhongqi Pu et al.· bioRxiv· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.