Saving Foundation Flow-Matching Priors for Inverse Problems
By: Yuxiang Wan , Ryan Devera , Wenjie Zhang and more
Potential Business Impact:
Makes AI better at fixing blurry pictures.
Foundation flow-matching (FM) models promise a universal prior for solving inverse problems (IPs), yet today they trail behind domain-specific or even untrained priors. How can we unlock their potential? We introduce FMPlug, a plug-in framework that redefines how foundation FMs are used in IPs. FMPlug combines an instance-guided, time-dependent warm-start strategy with a sharp Gaussianity regularization, adding problem-specific guidance while preserving the Gaussian structures. This leads to a significant performance boost across image restoration and scientific IPs. Our results point to a path for making foundation FM models practical, reusable priors for IP solving.
Similar Papers
FMPlug: Plug-In Foundation Flow-Matching Priors for Inverse Problems
Image and Video Processing
Makes blurry pictures sharp and clear.
On the Inverse Flow Matching Problem in the One-Dimensional and Gaussian Cases
Machine Learning (CS)
Makes AI learn faster and better.
Physics-Constrained Fine-Tuning of Flow-Matching Models for Generation and Inverse Problems
Machine Learning (CS)
Teaches computers to predict science by learning rules.