From Image Denoisers to Regularizing Imaging Inverse Problems: An Overview
By: Hong Ye Tan, Subhadip Mukherjee, Junqi Tang
Potential Business Impact:
Makes blurry pictures clear using smart computer tricks.
Inverse problems lie at the heart of modern imaging science, with broad applications in areas such as medical imaging, remote sensing, and microscopy. Recent years have witnessed a paradigm shift in solving imaging inverse problems, where data-driven regularizers are used increasingly, leading to remarkably high-fidelity reconstruction. A particularly notable approach for data-driven regularization is to use learned image denoisers as implicit priors in iterative image reconstruction algorithms. This survey presents a comprehensive overview of this powerful and emerging class of algorithms, commonly referred to as plug-and-play (PnP) methods. We begin by providing a brief background on image denoising and inverse problems, followed by a short review of traditional regularization strategies. We then explore how proximal splitting algorithms, such as the alternating direction method of multipliers (ADMM) and proximal gradient descent (PGD), can naturally accommodate learned denoisers in place of proximal operators, and under what conditions such replacements preserve convergence. The role of Tweedie's formula in connecting optimal Gaussian denoisers and score estimation is discussed, which lays the foundation for regularization-by-denoising (RED) and more recent diffusion-based posterior sampling methods. We discuss theoretical advances regarding the convergence of PnP algorithms, both within the RED and proximal settings, emphasizing the structural assumptions that the denoiser must satisfy for convergence, such as non-expansiveness, Lipschitz continuity, and local homogeneity. We also address practical considerations in algorithm design, including choices of denoiser architecture and acceleration strategies.
Similar Papers
Analysis Plug-and-Play Methods for Imaging Inverse Problems
Image and Video Processing
Improves picture cleanup by cleaning picture edges.
Image Restoration via Primal Dual Hybrid Gradient and Flow Generative Model
CV and Pattern Recognition
Cleans up blurry or noisy pictures better.
Plug-and-play Diffusion Models for Image Compressive Sensing with Data Consistency Projection
CV and Pattern Recognition
Improves blurry pictures by combining math and AI.