Contextual Strongly Convex Simulation Optimization: Optimize then Predict with Inexact Solutions
By: Nifei Lin, Heng Luo, L. Jeff Hong
Potential Business Impact:
Helps computers make better choices faster.
In this work, we study contextual strongly convex simulation optimization and adopt an "optimize then predict" (OTP) approach for real-time decision making. In the offline stage, simulation optimization is conducted across a set of covariates to approximate the optimal-solution function; in the online stage, decisions are obtained by evaluating this approximation at the observed covariate. The central theoretical challenge is to understand how the inexactness of solutions generated by simulation-optimization algorithms affects the optimality gap, which is overlooked in existing studies. To address this, we develop a unified analysis framework that explicitly accounts for both solution bias and variance. Using Polyak-Ruppert averaging SGD as an illustrative simulation-optimization algorithm, we analyze the optimality gap of OTP under four representative smoothing techniques: $k$ nearest neighbor, kernel smoothing, linear regression, and kernel ridge regression. We establish convergence rates, derive the optimal allocation of the computational budget $Ξ$ between the number of design covariates and the per-covariate simulation effort, and demonstrate the convergence rate can approximately achieve $Ξ^{-1}$ under appropriate smoothing technique and sample-allocation rule. Finally, through a numerical study, we validate the theoretical findings and demonstrate the effectiveness and practical value of the proposed approach.
Similar Papers
Simulating classification models to evaluate Predict-Then-Optimize methods
Machine Learning (CS)
Tests how good computer guesses help solve tough problems.
Online Learning of Optimal Sequential Testing Policies
Machine Learning (CS)
Helps pick the best tests for people faster.
PAC-Bayes Meets Online Contextual Optimization
Optimization and Control
Helps computers make better choices when things change.