Skip to content
Preprint

Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detection

Jul 2026 · 0 citations · 58 references
Computer Science

TL;DR

A self-initiated investigation of purification-based adversarial detection, comparing three families of detection signals across six detectors that share a CLIP ViT-L/14 backbone finds that raw $|\Delta \text{logit}|$ under median-3 purification, applied through the EFFORT detector, separates adversarial inputs from clean inputs with AUROC 0.81-0.98.

Abstract

This paper describes the participation of team"Go To Germany"in the ImageCLEF 2026 Deepfake Detection and Generation Task. For the image generation task, we employ FLUX.1-dev with PuLID for identity-preserving face synthesis, combined with a multi-model PGD adversarial attack targeting 12 detectors simultaneously (DiffJPEG-in-loop, MI/DI/EoT, adaptive weighting, two-stage warm-start). Our approach achieved 90% evasion against organizer detectors and 57.6% against participant detectors, with a final generation score of 0.4170. For the image detection task, we combine two complementary detectors - SigLIP+DINOv2 for AI-generated images and GenD-DINOv3 for face manipulations - in a max-probability ensemble, achieving 99.4% accuracy on baseline deepfakes but suffering from high false-positive rates on real images, resulting in a final detection score of 0.6986. Beyond the official submission, we conducted a self-initiated investigation of purification-based adversarial detection, comparing three families of detection signals across six detectors that share a CLIP ViT-L/14 backbone. We find that raw $|\Delta \text{logit}|$ under median-3 purification, applied through the EFFORT detector, separates adversarial inputs from clean inputs with AUROC 0.81-0.98 across four adversarial source types - a finding that refutes the simple backbone-preservation hypothesis and exposes a sharp JPEG-quality cliff at Q70 where the signal collapses.

View source

Similar papers

Preprint Aug 2026

Adversarial Attacks on Deep OCR Systems

Deep-OCR (DeepSeek-OCR) advances document recognition by treating the visual modality as an optical compression medium, enabling long-context OCR at low token cost. However, its increased complexity may introduce new security vulnerabilities. In this paper, we present, to the best of our knowledge, the first pure black-box adversarial attack against a generative OCR vision-language model, where only the decoded string can be queried and no gradients, logits, or model internals are available. We recast the attack as a zeroth-order optimization problem driven by a bounded scalar loss defined directly on the string output via sequence similarity, and estimate the gradient with a random-direction finite-difference scheme whose query cost is independent of the image dimension. An Adam update with ell_infinity projection yields imperceptible perturbations for both untargeted and targeted objectives. Pilot experiments on Deep-OCR validate the string-only attack and evaluation pipeline and expose severe qualitative decoder failures, including repetition, truncation, and prompt leakage. They also show that controlled targeted rewriting remains substantially harder than untargeted degradation; we avoid claiming targeted success until the pre-registered evaluation is complete.

Wenbo Sun, Hong-Zong Li, Yanyun Wang et al. · 0 citations
2026

Patronus: Safeguarding Text-to-Image Models Against Adversarial Fine-Tuning

Text-to-image (T2I) models can be exploited to produce unsafe images. Existing safety measures, e.g., content moderation or model alignment, can be weakened by adversaries who attempt to restore unsafe generation through model fine-tuning. This paper presents Patronus, a defensive framework that improves T2I models’ resistance to the gradient-based adversarial fine-tuning attacks evaluated in this work. Specifically, we design a co-trained safety decoder that produces a deliberately corrupted output for a latent representation associated with unsafe content while preserving normal decoding for benign content. We also strengthen the decoder and U-Net with a non-fine-tunable learning mechanism. Across I2P, SneakyPrompt, and MMA-Diffusion, Patronus obtains attack success rates of 0.01–0.03 and true positive rates of 0.98–0.99. On benign prompts, it obtains FID 23.6, LPIPS 0.78, and a false positive rate of 0.01. The fine-tuning stress tests separately report the optimization losses of the defended decoder and U-Net under the evaluated attack settings.

Xinfeng Li, Sheng-Yuan Pang, Jialin Wu et al. · 0 citations
Preprint Jul 2026

Efficient LLM Adversarial Training via Low-Rank Defense and Circuit-Guided Surrogates

This work comprehensively investigates computation-efficient strategies to speed up latent adversarial training from two complementary perspectives, and reduces per-step adversarial-training FLOPs by 48.1% while requiring only 0.0118% trainable parameters.

Weiyi He, Yuping Lin, Jiliang Tang et al. · 0 citations
Preprint Aug 2026

Training-Free Reconstruction-Based AI-Generated Image Detectors Are Inherently Vulnerable to Adversarial Examples

The impressive visual quality and ubiquity of AI-generated images call for reliable and robust detection methods. Reconstruction-based detectors have emerged as a promising direction for transparent and training-free identification of synthetic images. However, due to their fundamentally different mode of operation (compared to standard, classifier-based methods), little is known about their adversarial robustness. In this work, we propose two novel attack methods targeted at detectors that leverage autoencoder reconstruction error. We find that by constructing imperceptible adversarial examples, the distance between original and reconstruction can be artificially increased, causing fake images to be wrongly classified as real. Our evaluation including images from three state-of-the-art generators and three detectors demonstrates that detection performance is significantly decreased, even if attacked images additionally undergo real-world degradations. Critically, our adversarial examples naturally transfer across detectors, as they all share the same principle, pointing towards an inherent vulnerability of reconstruction-based detectors.

R. Demchenko, Jonas Ricker, Asja Fischer · 0 citations
Preprint Jul 2026

VendorBench-100: A Unified Cross-Paradigm Benchmark for Deepfake Image Detection

VendorBench-100, a cross-paradigm benchmark that evaluates 36 representative models using a single adversarial 100-image corpus, a unified output schema, and a common evaluation framework, is introduced.

S. N. Deshmukh, Md. Rashidunnabi, Nelton Tiago Gemo et al. · 0 citations
Conference Jul 2026

Enhancing Adversarial Defense in Phishing Detection Using Deep Reinforcement Learning

Phishing classifiers trained on static data can underperform when slight adversarial modifications are made to URLs and HTML to evade both humans and traditional machine learning algorithms. During this research, a published XGBoost baseline from Aljofey et al. was reproduced and verified for reproducibility with multi-seed evaluation. The reproduced model attained a 94.76% accuracy, 92.19% F1, and 98.40% AUC with low seed variance on the clean data. To quantify adversarial vulnerability, homoglyph substitutions, zero-width character injections, and benign keyword padding were used. These adversarial modifications reduced phishing recall from 90.96% to 75.34%, a decrease of 15.62 percentage points (pp). To combat this, a DDQN preprocessor that learns to apply minimal, deterministic “repair” actions before the frozen XGBoost classifier was developed. On a mixed-label adversarial test, the DDQN+XGBoost improved F1 by +10.08 pp and accuracy by +9.65 pp versus the adversarial baseline, cuts FPR by -16.68 pp (60.35% relative), and maintains high recall (-3.12 pp trade-off). The defence requires no retraining of the base classifier, is interpretable at the action level, and adds modest inference overhead. These results demonstrate that learned preprocessing can restore deployable performance in the face of targeted adversarial attacks. This research shows that learned preprocessing can enhance adversarial defence for phishing detection at inference time, without changing the underlying classifier.

Derrick Asiedu Aboagye, Stones Dalitso Chindipha · 0 citations