Skip to content
Preprint

Attention-Scoped Guidance: Training-Free Spatial Control for Image Editing

Sep 2026 · 1 citation · 24 references
Computer Science

TL;DR

Attention-Scoped Guidance (ASG), a sampler wrapper that reads a soft support map from the instruction attention that the editor already computes, then weakens text guidance where support is low and strengthens image anchoring where support is high.

Abstract

Instruction-guided image editing should change what the instruction names and leave the rest of the image untouched. In dual classifier-free guidance (CFG), an editor combines two directions at every denoising step, one that pushes toward the instructed edit and one that pulls back toward the source image, using global weights. We introduce Attention-Scoped Guidance (ASG), a sampler wrapper that makes these weights spatial. It reads a soft support map from the instruction attention that the editor already computes, then weakens text guidance where support is low and strengthens image anchoring where support is high. The wrapper requires no training, no external mask, and no additional network evaluation. On the full MagicBrush and PIE-Bench++ splits, ASG improves preservation-oriented metrics, leading three of four MagicBrush metrics and PIE-Bench++ background PSNR. A dose-matched control that removes the spatial placement loses up to 0.73 CLIP on PIE-Bench++, confirming that the spatial allocation itself carries the gain.

View source

Similar papers

Sep 2026

DecFlowEdit: Self-Localized Flow-based Image Editing via Guidance Decoupling

DecFlowEdit is proposed, which decouples the optimal guidance scales for localization and for editing in flow-based generative models and first extracts an edit-relevant prior by temporally aggregating velocity differences evaluated without CFG, and then uses this prior to reweight the original updates under default CF...

Zhe-Yuan Zhan, Can Wang, Jia-Wei Chen et al. · 0 citations
Conference Open access Sep 2026

Semantically Aligned Gradient-Driven Context-Preserving Image Editing

IAB edited achieves state-of-the-art instruction adherence performance on RealEdit and EMU Edit benchmarks based on embedding-based metrics and shows that gradient-aligned VLM distillation holds up under real-world-like surveillance and occlusion conditions.

Chiranjeev Chiranjeev, Muskan Dosi, M. Vatsa et al. · 0 citations
Conference Aug 2026

MaskFlow: Attention-Guided Localized Editing for Rectified Flow Models

Text-guided image editing using rectified flow models such as Multimodal Diffusion Transformer (DiT) has demonstrated impressive generation quality. However, existing methods apply edits globally, inevitably modifying background regions unrelated to the intended semantic change. Our key observation is that the Text-to-...

Trong-Tai Dam Vu, Vinh-Tiep Nguyen · 0 citations
#artificial intelligence Preprint Oct 2026

Scalable Minimal-Change Learning for Controllable Image Editing

Image editing should change only the attributes specified by an instruction while preserving everything else, yet current methods often make unintended changes. We treat this minimal-change principle as an optimization objective for instruction-based editing. Latent L1 regularization is a poor proxy for output locality...

Shuo Chen, Feng-Ming Huang, Yu Yao et al. · 1 citation

Constrained Edit Fields for Training-Free Flow Editing

Constrained Edit Fields (CEF) achieves state-of-the-art Structure Distance, background LPIPS, and background MSE with both Stable Diffusion 3.5 Medium and FLUX, while retaining competitive instruction alignment.

Jing-Xuan Kang, Yin-Song Wang, Che Liu et al. · 1 citation
Preprint Sep 2026

Overpainting: Localized Context-aware Diffusion Image Editing

This work implements overpainting by adapting a pretrained image editing diffusion model using a combination of joint attention and low-rank adaption across input images with attention-dropout to balance the information flow between noise, source and mask images.

Sam Sartor, Iliyan Georgiev, Michael Fischer et al. · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.