Unleashing the Potential of the Semantic Latent Space in Diffusion Models for Image Dehazing
By: Zizheng Yang , Hu Yu , Bing Li and more
Potential Business Impact:
Clears foggy pictures faster using smart computer tricks.
Diffusion models have recently been investigated as powerful generative solvers for image dehazing, owing to their remarkable capability to model the data distribution. However, the massive computational burden imposed by the retraining of diffusion models, coupled with the extensive sampling steps during the inference, limit the broader application of diffusion models in image dehazing. To address these issues, we explore the properties of hazy images in the semantic latent space of frozen pre-trained diffusion models, and propose a Diffusion Latent Inspired network for Image Dehazing, dubbed DiffLI$^2$D. Specifically, we first reveal that the semantic latent space of pre-trained diffusion models can represent the content and haze characteristics of hazy images, as the diffusion time-step changes. Building upon this insight, we integrate the diffusion latent representations at different time-steps into a delicately designed dehazing network to provide instructions for image dehazing. Our DiffLI$^2$D avoids re-training diffusion models and iterative sampling process by effectively utilizing the informative representations derived from the pre-trained diffusion models, which also offers a novel perspective for introducing diffusion models to image dehazing. Extensive experiments on multiple datasets demonstrate that the proposed method achieves superior performance to existing image dehazing methods. Code is available at https://github.com/aaaasan111/difflid.
Similar Papers
Physics-Guided Image Dehazing Diffusion
CV and Pattern Recognition
Clears blurry pictures from photos automatically.
Boosting Generative Image Modeling via Joint Image-Feature Synthesis
CV and Pattern Recognition
Creates better pictures by understanding what they mean.
Learning Hazing to Dehazing: Towards Realistic Haze Generation for Real-World Image Dehazing
CV and Pattern Recognition
Clears foggy pictures faster and better.