Position Matters: Feature Inversion Attacks in ViT Split Inference with Token Reduction and Shuffling
This work shows that, despite disrupting the spatial structure required by conventional reconstruction attacks, transmitted token embeddings retain substantial positional information, and introduces the Spatially Aligned Reconstruction Attack (SARA), a unified pipeline that predicts token positions, restores their spat...