FDS: Frequency-Aware Denoising Score for Text-Guided Latent Diffusion Image Editing
By: Yufan Ren , Zicong Jiang , Tong Zhang and more
Potential Business Impact:
Edits pictures precisely without messing them up.
Text-guided image editing using Text-to-Image (T2I) models often fails to yield satisfactory results, frequently introducing unintended modifications, such as the loss of local detail and color changes. In this paper, we analyze these failure cases and attribute them to the indiscriminate optimization across all frequency bands, even though only specific frequencies may require adjustment. To address this, we introduce a simple yet effective approach that enables the selective optimization of specific frequency bands within localized spatial regions for precise edits. Our method leverages wavelets to decompose images into different spatial resolutions across multiple frequency bands, enabling precise modifications at various levels of detail. To extend the applicability of our approach, we provide a comparative analysis of different frequency-domain techniques. Additionally, we extend our method to 3D texture editing by performing frequency decomposition on the triplane representation, enabling frequency-aware adjustments for 3D textures. Quantitative evaluations and user studies demonstrate the effectiveness of our method in producing high-quality and precise edits.
Similar Papers
Leveraging Diffusion Knowledge for Generative Image Compression with Fractal Frequency-Aware Band Learning
CV and Pattern Recognition
Makes pictures look real even when small.
A Hybrid Wavelet-Fourier Method for Next-Generation Conditional Diffusion Models
CV and Pattern Recognition
Makes computer pictures look more real.
LUSD: Localized Update Score Distillation for Text-Guided Image Editing
Graphics
Makes AI better at changing pictures without messing up.