Diffusion models for inverse problems
By: Hyungjin Chung, Jeongsol Kim, Jong Chul Ye
Potential Business Impact:
Makes blurry pictures clear using smart computer tricks.
Using diffusion priors to solve inverse problems in imaging have significantly matured over the years. In this chapter, we review the various different approaches that were proposed over the years. We categorize the approaches into the more classic explicit approximation approaches and others, which include variational inference, sequential monte carlo, and decoupled data consistency. We cover the extension to more challenging situations, including blind cases, high-dimensional data, and problems under data scarcity and distribution mismatch. More recent approaches that aim to leverage multimodal information through texts are covered. Through this chapter, we aim to (i) distill the common mathematical threads that connect these algorithms, (ii) systematically contrast their assumptions and performance trade-offs across representative inverse problems, and (iii) spotlight the open theoretical and practical challenges by clarifying the landscape of diffusion model based inverse problem solvers.
Similar Papers
Unifying and extending Diffusion Models through PDEs for solving Inverse Problems
Machine Learning (CS)
New math helps computers create realistic images.
Briding Diffusion Posterior Sampling and Monte Carlo methods: a survey
Machine Learning (CS)
Guides computers to solve hard problems using smart guessing.
The Principles of Diffusion Models
Machine Learning (CS)
Creates new pictures and sounds from noise.