Skip to content

TrustVLA: Mechanism-Guided Inference-Time Defense Against Vision-Language-Action Backdoors

Jul 2026 · arXiv.org · Vol abs/2607.12571 · 0 citations · 34 references
Computer Science

TL;DR

TrustVLA is introduced, a mechanism-guided inference-time defense that adapts the Dirichlet evidence framework from trusted classification to monitor per-token, per-layer epistemic uncertainty in VLA policies, providing a retraining-free, mechanism-guided defense for visual-triggered VLA backdoors.

Abstract

Vision-Language-Action (VLA) models are deployed through pipelines that end users cannot audit, and a poisoned VLA can behave normally on clean observations while a small visual trigger redirects a long-horizon robot policy before any failure becomes observable. Existing vision or language defenses rarely explain what a triggered VLA representation looks like or how to recover behavior without retraining. We study this gap through two independently proposed VLA attacks from groups with distinct injection strategies, BadVLA and INFUSE; the latter persists after downstream clean adaptation. Across the evaluated poisoned models, we identify a recurring internal mechanism: a \emph{compact causal footprint}, namely a small visual support that is attention-seeded, spatially compact, and \emph{causal} in a precise sense -- masking it returns a clean-calibrated evidence-evolution score to the normal operating region. This footprint motivates TrustVLA, a mechanism-guided inference-time defense that adapts the Dirichlet evidence framework from trusted classification to monitor per-token, per-layer epistemic uncertainty in VLA policies. With only a small clean calibration set, TrustVLA (i)~detects abnormal evidence evolution, (ii)~localizes the compact support by counterfactual mechanism-score drop, and (iii)~recovers the observation by localized inpainting. Across OpenVLA/LIBERO and $\pi_{0.5}$ transfer evaluations, TrustVLA reduces attack success while preserving clean-task performance, providing a retraining-free, mechanism-guided defense for visual-triggered VLA backdoors.

View source

Similar papers

Preprint Aug 2026

CertVLA: Certified Defense against Physical Visual Attacks for Vision-Language-Action Models

Vision-Language-Action (VLA) policies are vulnerable to localized physical perturbations, yet existing certified patch defenses target discrete labels and cannot directly certify continuous, temporally correlated actions. We introduce CertVLA, a certified defense for closed-loop VLA control under bounded patch and text...

Hui Lu, Zhi-Jie Peng, Yuqi Lin et al. · 0 citations
Preprint Aug 2026

Structure-Aware Robust Fine-Tuning: Defending Vision-Language-Action Robots Against Physical Attention Hijacking

Attention-Guided Semantic Disruption (AGSD), an Expectation-over-Transformation optimized printable patch that jointly concentrates action-to-vision attention on the patch and disrupts vision-language semantic alignment, yielding strong cross-task and cross-architecture transfer is proposed.

Jinquan Zhang, Dongfu Yin, Run Yang et al. · 0 citations
Preprint Aug 2026

What Guides the Agent? Adjudicating Unauthorized Behavior via Localizing Behavior-Guiding Instructions

This work proposes Attnlocate, a runtime framework for fine-grained localization of context spans that genuinely influence tool-calling decisions, i.e., behavior-guiding instructions, and designs a multi-head, multi-layer attention aggregation scheme to construct a token-level feature space tailored for object detectio...

Yi-Chao Gao, Yumo Zhang, Yunhao Yao et al. · 1 citation
Review Aug 2026

MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection

MonitorVLM-v2 is presented, a deployment-oriented framework that recasts VLM-based safety assessment as probabilistic inference over a finite regulatory decision space, compressing multimodal reasoning into single-step rule-ID predictions and reducing decoding from a variable-length sequence to a single token.

Jiang Wu, Sichao Wu, Yinsong Ma et al. · 0 citations
Preprint Aug 2026

VLAGuard: A Framework for Evaluating and Mitigating Physical Attention Hijacking in Vision-Language-Action Robots within Wireless Sensor Networks

Attention-Protective Fine-Tuning (APFT) is proposed, a defense that stabilizes spatiotemporal attention and enforces geometric consistency with zero inference overhead that reduces the OpenVLA failure rate and highlights that protecting attention pathways is important for improving the robustness of VLA-driven edge nod...

Dongfu Yin, Jinquan Zhang · 0 citations
#small language model Preprint Sep 2026

SafeLoop: Risk-Aware Rollback for Vision-Language-Action Manipulation

SafeLoop is introduced, a non-invasive external wrapper that adds hazard prediction and rollback-based recovery to a VLA model without changing its parameters, and achieves a stronger overall safety-success trade-off than alternative methods.

Zeyuan Lou, Tian-Ran Zhang, Xin-Quan Yue et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.