A Malliavin calculus approach to score functions in diffusion generative models
By: Ehsan Mirafzali , Frank Proske , Utkarsh Gupta and more
Potential Business Impact:
Makes AI create better, more realistic pictures.
Score-based diffusion generative models have recently emerged as a powerful tool for modelling complex data distributions. These models aim at learning the score function, which defines a map from a known probability distribution to the target data distribution via deterministic or stochastic differential equations (SDEs). The score function is typically estimated from data using a variety of approximation techniques, such as denoising or sliced score matching, Hyv\"arien's method, or Schr\"odinger bridges. In this paper, we derive an exact, closed-form, expression for the score function for a broad class of nonlinear diffusion generative models. Our approach combines modern stochastic analysis tools such as Malliavin derivatives and their adjoint operators (Skorokhod integrals or Malliavin Divergence) with a new Bismut-type formula. The resulting expression for the score function can be written entirely in terms of the first and second variation processes, with all Malliavin derivatives systematically eliminated, thereby enhancing its practical applicability. The theoretical framework presented in this work offers a principled foundation for advancing score estimation methods in generative modelling, enabling the design of new sampling algorithms for complex probability distributions. Our results can be extended to broader classes of stochastic differential equations, opening new directions for the development of score-based diffusion generative models.
Similar Papers
Malliavin Calculus for Score-based Diffusion Models
Machine Learning (CS)
Makes AI create realistic images and sounds.
A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fields
Probability
Makes AI create realistic images from any data.
Beyond Scores: Proximal Diffusion Models
Machine Learning (CS)
Makes AI create images much faster.