FMPlug: Plug-In Foundation Flow-Matching Priors for Inverse Problems
By: Yuxiang Wan , Ryan Devera , Wenjie Zhang and more
Potential Business Impact:
Makes blurry pictures sharp and clear.
We present FMPlug, a novel plug-in framework that enhances foundation flow-matching (FM) priors for solving ill-posed inverse problems. Unlike traditional approaches that rely on domain-specific or untrained priors, FMPlug smartly leverages two simple but powerful insights: the similarity between observed and desired objects and the Gaussianity of generative flows. By introducing a time-adaptive warm-up strategy and sharp Gaussianity regularization, FMPlug unlocks the true potential of domain-agnostic foundation models. Our method beats state-of-the-art methods that use foundation FM priors by significant margins, on image super-resolution and Gaussian deblurring.
Similar Papers
Saving Foundation Flow-Matching Priors for Inverse Problems
Machine Learning (CS)
Makes AI better at fixing blurry pictures.
Image Restoration via Primal Dual Hybrid Gradient and Flow Generative Model
CV and Pattern Recognition
Cleans up blurry or noisy pictures better.
Latent Refinement via Flow Matching for Training-free Linear Inverse Problem Solving
CV and Pattern Recognition
Makes blurry pictures clear using smart math.