Image Interpolation with Score-based Riemannian Metrics of Diffusion Models
By: Shinnosuke Saito, Takashi Matsubara
Potential Business Impact:
Makes AI art smoother and more realistic.
Diffusion models excel in content generation by implicitly learning the data manifold, yet they lack a practical method to leverage this manifold - unlike other deep generative models equipped with latent spaces. This paper introduces a novel framework that treats the data space of pre-trained diffusion models as a Riemannian manifold, with a metric derived from the score function. Experiments with MNIST and Stable Diffusion show that this geometry-aware approach yields image interpolations that are more realistic, less noisy, and more faithful to prompts than existing methods, demonstrating its potential for improved content generation and editing.
Similar Papers
What's Inside Your Diffusion Model? A Score-Based Riemannian Metric to Explore the Data Manifold
Machine Learning (CS)
Makes AI create smoother, more realistic image changes.
Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models
CV and Pattern Recognition
Makes AI-generated pictures smoothly change.
MAD: Manifold Attracted Diffusion
Machine Learning (Stat)
Makes blurry pictures sharp and clear.