Zero-shot Adaptation of Stable Diffusion via Plug-in Hierarchical Degradation Representation for Real-World Super-Resolution
By: Yi-Cheng Liao , Shyang-En Weng , Yu-Syuan Xu and more
Potential Business Impact:
Makes blurry pictures sharp and clear.
Real-World Image Super-Resolution (Real-ISR) aims to recover high-quality images from low-quality inputs degraded by unknown and complex real-world factors. Real-world scenarios involve diverse and coupled degradations, making it necessary to provide diffusion models with richer and more informative guidance. However, existing methods often assume known degradation severity and rely on CLIP text encoders that cannot capture numerical severity, limiting their generalization ability. To address this, we propose \textbf{HD-CLIP} (\textbf{H}ierarchical \textbf{D}egradation CLIP), which decomposes a low-quality image into a semantic embedding and an ordinal degradation embedding that captures ordered relationships and allows interpolation across unseen levels. Furthermore, we integrated it into diffusion models via classifier-free guidance (CFG) and proposed classifier-free projection guidance (CFPG). HD-CLIP leverages semantic cues to guide generative restoration while using degradation cues to suppress undesired hallucinations and artifacts. As a \textbf{plug-and-play module}, HD-CLIP can be seamlessly integrated into various super-resolution frameworks without training, significantly improving detail fidelity and perceptual realism across diverse real-world datasets.
Similar Papers
One-Step Diffusion-based Real-World Image Super-Resolution with Visual Perception Distillation
CV and Pattern Recognition
Makes blurry pictures clear in one step.
HDW-SR: High-Frequency Guided Diffusion Model based on Wavelet Decomposition for Image Super-Resolution
CV and Pattern Recognition
Makes blurry pictures sharp with new AI.
Mixture of Ranks with Degradation-Aware Routing for One-Step Real-World Image Super-Resolution
CV and Pattern Recognition
Makes blurry pictures sharp using smart computer parts.