#machine learning
Jun 2026
When to Align, When to Predict: A Phase Diagram for Multimodal Learning
A data-driven procedure is presented to locate real-world datasets in this diagram using a small labeled subsample, identifying the preferred objective and prediction direction before any cross-modal training, and identifying when no objective in the CA/CP family can improve on the stronger modality alone.
Ilay Kamai, Hugues Van Assel, Aviv Regev et al.
· arXiv.org · 1 citation