Large Multimodal Reasoning Models (LMRMs) have recently shown strong capabilities in complex visual understanding and multi-step inference. However, they remain highly vulnerable to multimodal hallucinations over extended reasoning trajectories. In this work, we study this failure as a state-dynamics problem: as reason...
Xiao-Ye Qu, Yan-Zhe Wu, Zhi-Hao Xie et al.· Proceedings of the 34th ACM...· 0 citations
This paper proposes a novel phase-aware adversarial attack framework that explicitly restricts adversarial perturbations to structure-relevant phase regions to suppress the MLLM' focus for effective and imperceptible attacks.
Dai-Zong Liu, Junhao Dong, Zhi-Yuan Ma et al.· IEEE transactions on multime...· 1 citation
A new perspective of information theory is introduced to investigate LVLMs’ transferable characteristics by exploring the relative dependence between outputs of the LVLM model and input adversarial samples and formulate the complicated calculation of information gain as an estimation problem and incorporate such inform...
Xiaowen Cai, Daizong Liu, Xiaoye Qu et al.· Neural Information Processin...· 8 citations
This paper proposes a novel LVLM attack method, called BadPhase with further backdoor designs, to implant adversarial phase as triggers into any image inputs via data poisoning so as to control the LVLMs’ predictions and finds that LVLMs are sensitive to the phase-aware image structure.
Dai-Zong Liu, Junhao Dong, Xiang Fang et al.· Proceedings of the Thirty-Fi...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.