Rebalancing Multimodal Learning via Adaptive Bidirectional Alignment
Multimodal learning often suffers from modality imbalance, leading to an optimization dilemma. A key reason is that different modalities exhibit asynchronous learning dynamics during joint training. A representative line of existing methods seeks to rebalance multimodal learning through cross-modal alignment. However,...