Worst-case generation via minimax optimization in Wasserstein space
By: Xiuyuan Cheng , Yao Xie , Linglingzhi Zhu and more
Worst-case generation plays a critical role in evaluating robustness and stress-testing systems under distribution shifts, in applications ranging from machine learning models to power grids and medical prediction systems. We develop a generative modeling framework for worst-case generation for a pre-specified risk, based on min-max optimization over continuous probability distributions, namely the Wasserstein space. Unlike traditional discrete distributionally robust optimization approaches, which often suffer from scalability issues, limited generalization, and costly worst-case inference, our framework exploits the Brenier theorem to characterize the least favorable (worst-case) distribution as the pushforward of a transport map from a continuous reference measure, enabling a continuous and expressive notion of risk-induced generation beyond classical discrete DRO formulations. Based on the min-max formulation, we propose a Gradient Descent Ascent (GDA)-type scheme that updates the decision model and the transport map in a single loop, establishing global convergence guarantees under mild regularity assumptions and possibly without convexity-concavity. We also propose to parameterize the transport map using a neural network that can be trained simultaneously with the GDA iterations by matching the transported training samples, thereby achieving a simulation-free approach. The efficiency of the proposed method as a risk-induced worst-case generator is validated by numerical experiments on synthetic and image data.
Similar Papers
Neural Local Wasserstein Regression
Machine Learning (Stat)
Teaches computers to understand complex data patterns.
Robust Optimization in Causal Models and G-Causal Normalizing Flows
Machine Learning (Stat)
Helps computers learn better from cause-and-effect.
Wasserstein Distributionally Robust Nonparametric Regression
Machine Learning (Stat)
Makes computer predictions better even with bad data.