JPPO is introduced, the first compound adversarial framework elevating the visible prompt to a first-class adversarial variable alongside image perturbations alongside image perturbations, motivating cost-aware robustness evaluation as a first-class security requirement for multimodal deployments.
Zhao-Xiong Ni, Ya-Tie Xiao, Chi-Man Pun et al.· 0 citations
This paper proposes a novel phase-aware adversarial attack framework that explicitly restricts adversarial perturbations to structure-relevant phase regions to suppress the MLLM' focus for effective and imperceptible attacks.
Dai-Zong Liu, Junhao Dong, Zhi-Yuan Ma et al.· IEEE transactions on multime...· 1 citation
A new perspective of information theory is introduced to investigate LVLMs’ transferable characteristics by exploring the relative dependence between outputs of the LVLM model and input adversarial samples and formulate the complicated calculation of information gain as an estimation problem and incorporate such inform...
Xiaowen Cai, Daizong Liu, Xiaoye Qu et al.· Neural Information Processin...· 8 citations
This paper proposes a novel LVLM attack method, called BadPhase with further backdoor designs, to implant adversarial phase as triggers into any image inputs via data poisoning so as to control the LVLMs’ predictions and finds that LVLMs are sensitive to the phase-aware image structure.
Dai-Zong Liu, Junhao Dong, Xiang Fang et al.· Proceedings of the Thirty-Fi...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.