Fast and Robust Simulation-Based Inference With Optimization Monte Carlo
By: Vasilis Gkolemis, Christos Diou, Michael Gutmann
Potential Business Impact:
Makes computer models run much faster and better.
Bayesian parameter inference for complex stochastic simulators is challenging due to intractable likelihood functions. Existing simulation-based inference methods often require large number of simulations and become costly to use in high-dimensional parameter spaces or in problems with partially uninformative outputs. We propose a new method for differentiable simulators that delivers accurate posterior inference with substantially reduced runtimes. Building on the Optimization Monte Carlo framework, our approach reformulates stochastic simulation as deterministic optimization problems. Gradient-based methods are then applied to efficiently navigate toward high-density posterior regions and avoid wasteful simulations in low-probability areas. A JAX-based implementation further enhances the performance through vectorization of key method components. Extensive experiments, including high-dimensional parameter spaces, uninformative outputs, multiple observations and multimodal posteriors show that our method consistently matches, and often exceeds, the accuracy of state-of-the-art approaches, while reducing the runtime by a substantial margin.
Similar Papers
Improving Generative Methods for Causal Evaluation via Simulation-Based Inference
Machine Learning (CS)
Creates better test data for computer learning.
Simulation-Based Inference: A Practical Guide
Machine Learning (Stat)
Helps scientists find answers faster with computers.
The Limits of Inference in Complex Systems: When Stochastic Models Become Indistinguishable
Statistical Mechanics
Helps scientists understand messy data better.