Score: 0

HarmonPaint: Harmonized Training-Free Diffusion Inpainting

Published: July 22, 2025 | arXiv ID: 2507.16732v1

By: Ying Li , Xinzhe Li , Yong Du and more

Potential Business Impact:

Fixes pictures without needing to learn.

Business Areas:
Photo Editing Content and Publishing, Media and Entertainment

Existing inpainting methods often require extensive retraining or fine-tuning to integrate new content seamlessly, yet they struggle to maintain coherence in both structure and style between inpainted regions and the surrounding background. Motivated by these limitations, we introduce HarmonPaint, a training-free inpainting framework that seamlessly integrates with the attention mechanisms of diffusion models to achieve high-quality, harmonized image inpainting without any form of training. By leveraging masking strategies within self-attention, HarmonPaint ensures structural fidelity without model retraining or fine-tuning. Additionally, we exploit intrinsic diffusion model properties to transfer style information from unmasked to masked regions, achieving a harmonious integration of styles. Extensive experiments demonstrate the effectiveness of HarmonPaint across diverse scenes and styles, validating its versatility and performance.

Page Count
15 pages

Category
Computer Science:
CV and Pattern Recognition