SpotEdit: Selective Region Editing in Diffusion Transformers
By: Zhibin Qin , Zhenxiong Tan , Zeqing Wang and more
Potential Business Impact:
Edits only the changed parts of pictures.
Diffusion Transformer models have significantly advanced image editing by encoding conditional images and integrating them into transformer layers. However, most edits involve modifying only small regions, while current methods uniformly process and denoise all tokens at every timestep, causing redundant computation and potentially degrading unchanged areas. This raises a fundamental question: Is it truly necessary to regenerate every region during editing? To address this, we propose SpotEdit, a training-free diffusion editing framework that selectively updates only the modified regions. SpotEdit comprises two key components: SpotSelector identifies stable regions via perceptual similarity and skips their computation by reusing conditional image features; SpotFusion adaptively blends these features with edited tokens through a dynamic fusion mechanism, preserving contextual coherence and editing quality. By reducing unnecessary computation and maintaining high fidelity in unmodified areas, SpotEdit achieves efficient and precise image editing.
Similar Papers
Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers
CV and Pattern Recognition
Makes computers understand pictures better for tasks.
EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editing
CV and Pattern Recognition
Edits pictures without messing up other parts.
PartEdit: Fine-Grained Image Editing using Pre-Trained Diffusion Models
CV and Pattern Recognition
Changes parts of pictures using words.