Sep 2026
Understanding Multimodal Learning From Modality Fusion and Alignment Perspectives.
This paper develops a dynamic strategy that jointly optimizes modality fusion and alignment, and develops a learning-based strategy using a bi-level optimization framework and theoretically proves the convergence of the learning algorithm to ensure its reliability.
Yang Yang, Feng-Qiang Wan, Qing-Jun Jiang et al.
· IEEE Transactions on Pattern... · 0 citations