Alignment in Multimodal Large Language Models: A Survey
Multimodal large language models (MLLMs) can generate plausible responses without using the relevant evidence or meeting task constraints. We separate the Modality Gap in cross-modal correspondence and evidence use from the Intent Gap in behavior relative to specified constraints, goals, and human expectations. Six dim...