Multimodal Concept Mapping
This work investigates how MLLMs learn novel concepts by introducing concepts in unimodal pre-training or multimodal fine-tuning, and evaluates the model’s ability to generalize between the two settings, and evaluates how deeply a model maps concepts across modalities.
S. Boppana, Tian Yun, Carina Curto et al.
· 0 citations