Multimodal models are expected to exploit synergistic information, that is, information available only when multiple modalities are observed together. In practice, however, a fusion module can fit the training objective by relying on a dominant modality or on information that modalities share, and the synergy between m...
Liang-Jian Wen, Qun Dai, Jiang Duan et al.· IEEE Transactions on Pattern...· 0 citations
Higher-order Representation and Information Learning (HRIL), which constructs an empirical cross-moment tensor over modality embeddings to represent multi-way interactions and employs Tucker decomposition to obtain a core tensor, complemented by a synergy-aware regularizer that prevents energy concentration and preserv...
Qun Dai, Liang-Jian Wen, Jiang Duan et al.· 0 citations
Large language model (LLM)-based multi-agent systems (MAS) have become a promising paradigm for complex information-seeking and reasoning tasks by enabling collaborative problem solving among specialized agents. However, existing MAS frameworks tightly couple task reasoning with coordination operations, including task...
Zi-Han Zhou, Xin-Zhe Hu, Han-Xu Yang et al.· 1 citation
This survey presents an information-theoretic perspective connecting Mutual Information, the Information Bottleneck, and Partial Information Decomposition as progressively refined views of multimodal information processing, and discusses how emerging multimodal foundation models instantiate these principles at scale.
Liang-Jian Wen, Lin Li, Jiang Duan et al.· 2 citations
Spectral Reverse Prompt (SRP), a prompting framework that rebalances the spectral contributions of frozen GNN encoders, achieves state-of-the-art performance with minimal additional parameters, highlighting that reweighting spectral components is a principled and effective strategy for parameter-efficient graph adaptat...
Han-Xu Yang, Yu-Huan Zhao, Xiao-Dong He et al.· arXiv.org· 0 citations
Graph prompt learning enables parameter-efficient adaptation of frozen Graph Neural Networks to downstream tasks through lightweight prompt parameters. As routing becomes increasingly node-adaptive, however, independently optimized local decisions can collectively concentrate assignment mass on a small subset of a fini...
Xiang-Yu Wang, Shuo Wang, Rui-Yi Fang et al.· 0 citations
SCGFM-ART, a structure-centric GFM framework that aligns arbitrary graphs onto a shared relational atlas via Amortized Relational Transport, achieves state-of-the-art transferability and establishes coordinate fidelity bounds, prove stability under predicted transport plans, and derive an amortized coverage bound that...