A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fields
By: Giacomo Greco
Potential Business Impact:
Makes AI create realistic images from any data.
We adopt a Gamma and Malliavin Calculi point of view in order to generalize Score-based diffusion Generative Models (SGMs) to an infinite-dimensional abstract Hilbertian setting. Particularly, we define the forward noising process using Dirichlet forms associated to the Cameron-Martin space of Gaussian measures and Wiener chaoses; whereas by relying on an abstract time-reversal formula, we show that the score function is a Malliavin derivative and it corresponds to a conditional expectation. This allows us to generalize SGMs to the infinite-dimensional setting. Moreover, we extend existing finite-dimensional entropic convergence bounds to this Hilbertian setting by highlighting the role played by the Cameron-Martin norm in the Fisher information of the data distribution. Lastly, we specify our discussion for spherical random fields, considering as source of noise a Whittle-Mat\'ern random spherical field.
Similar Papers
A Malliavin calculus approach to score functions in diffusion generative models
Machine Learning (Stat)
Makes AI create better, more realistic pictures.
Malliavin Calculus for Score-based Diffusion Models
Machine Learning (CS)
Makes AI create realistic images and sounds.
Generative modelling with jump-diffusions
Machine Learning (CS)
Makes AI create more realistic pictures and sounds.