Skip to content

Generalization Analysis for Adversarial Vision Transformers

· 0 citations · 47 references

TL;DR

This work establishes a high-probability generalization bound for ViTs in classification tasks under adversarial settings, and elucidates the roles of several factors in mitigating perturbation effects, norm regularization of weight matrices and depth-wise propagation constraints on layer-wise norms.

View source

Similar papers

Preprint Jul 2026

On Adversarial Vulnerability of Vision-Language Models through the Lens of Intermediate Spectral Subspaces

This work proposes a white-box spectral-subspace-guided attack (SSGRA) that aligns intermediate representations with the subspace spanned by the bottom right singular vectors, offering a spectral interpretation of adversarial vulnerability in VLMs, providing insights for improving their robustness.

Chethan Krishnamurthy Ramanaik, Tobias Callies, Michael Hecht et al. · 0 citations
Review Aug 2026

A Survey of Adversarial Efficiency Degradation for Vision Transformer by Exploiting Input-adaptive Optimization

Vision Transformers (ViTs) increasingly rely on input-adaptive inference, such as token pruning and early halting, to meet energy and latency budgets. This survey examines a recent class of adversarial efficiency degradation attacks that target these mechanisms to increase computation without necessarily degrading accuracy. We unify and compare two representative attacks, SlowFormer (a universal adversarial patch) and DeSparsify (per-image perturbations), across three popular token-pruning frameworks: A-ViT, ATS, and AdaViT. We standardize reporting using GFLOPs, accuracy loss, and an Attack Success (AS) metric that measures how much of the model's compute savings the attack takes away. Understanding these attacks is crucial for designing countermeasures that not only mitigate risk but also remain lightweight, since deployment often occurs in low-power settings such as mobile or embedded devices. To organize our analysis, we focus on three questions: how input-adaptive optimizations (e.g., token pruning and early halting) create attack surfaces for efficiency degradation; how such attacks operate in practice and which optimizations are most vulnerable; and which defenses exist today and whether they meaningfully restore efficiency under attack.

Anadi Goyal, Nandish Chattopadhyay, Anupam Chattopadhyay et al. · 0 citations
Open access Jul 2026

Comparative Analysis of Adversarial Robustness Across CNN, VGG19, and Vision Transformer Architectures Using Multiple Defense Strategies

The study concluded that adversarial resilience is largely determined by the interaction between model architecture and defense strategy, highlighting the need for architecture-specific defense selection when developing secure medical image classification systems.

Y. Heryadi, I. Sonata, Bambang Krismono Triwijoyo · 0 citations
Preprint Aug 2026

Multi-Task Consistency-based Detection of Adversarial Attacks

This work proposes an efficient and effective adversarial attack detection scheme leveraging the multi-task perception within a complex vision system, and develops a consistency score metric to measure the inconsistency between vision tasks.

Cong Chen, J. Monteuuis, Jonathan Petit · 0 citations
Aug 2026

FDT-PC: Enhancing Adversarial Transferability through Frequency Domain Transformation and Perceptual Constraints

FDT-PC (Frequency Domain Transformation with Perceptual Constraints), a novel method that enhances adversarial transferability across different model architectures, is proposed, which achieves superior black-box attack performance on both CNNs and Vision Transformers, outperforming existing state-of-the-art input transformation methods.

Bo Li, Li Tang, Xin Jin et al. · 0 citations