Diffusion Models in Simulation-Based Inference: A Tutorial Review
By: Jonas Arruda , Niels Bracher , Ullrich Köthe and more
Diffusion models have recently emerged as powerful learners for simulation-based inference (SBI), enabling fast and accurate estimation of latent parameters from simulated and real data. Their score-based formulation offers a flexible way to learn conditional or joint distributions over parameters and observations, thereby providing a versatile solution to various modeling problems. In this tutorial review, we synthesize recent developments on diffusion models for SBI, covering design choices for training, inference, and evaluation. We highlight opportunities created by various concepts such as guidance, score composition, flow matching, consistency models, and joint modeling. Furthermore, we discuss how efficiency and statistical accuracy are affected by noise schedules, parameterizations, and samplers. Finally, we illustrate these concepts with case studies across parameter dimensionalities, simulation budgets, and model types, and outline open questions for future research.
Similar Papers
Simulation-Based Inference: A Practical Guide
Machine Learning (Stat)
Helps scientists find answers faster with computers.
The Principles of Diffusion Models
Machine Learning (CS)
Creates new pictures and sounds from noise.
Briding Diffusion Posterior Sampling and Monte Carlo methods: a survey
Machine Learning (CS)
Guides computers to solve hard problems using smart guessing.