Convergence Rates of Time Discretization in Extended Mean Field Control
By: Christoph Reisinger , Wolfgang Stockinger , Maria Olympia Tsianni and more
Potential Business Impact:
Makes complex robot decisions faster and more accurate.
Piecewise constant control approximation provides a practical framework for designing numerical schemes of continuous-time control problems. We analyze the accuracy of such approximations for extended mean field control (MFC) problems, where the dynamics and costs depend on the joint distribution of states and controls. For linear-convex extended MFC problems, we show that the optimal control is $1/2$-H\"older continuous in time. Using this regularity, we prove that the optimal cost of the continuous-time problem can be approximated by piecewise constant controls with order $1/2$, while the optimal control itself can be approximated with order $1/4$. For general extended MFC problems, we further show that, under sufficient regularity of the value functions, the value functions converge with an improved first-order rate, matching the best-known rate for classical control problems without mean field interaction, and consistent with the numerical observations for MFC of Cucker-Smale models.
Similar Papers
Model-free policy gradient for discrete-time mean-field control
Optimization and Control
Teaches computers to make smart group decisions.
Accuracy of Discretely Sampled Stochastic Policies in Continuous-time Reinforcement Learning
Machine Learning (CS)
Makes robots learn better by trying random actions.
Continuous Policy and Value Iteration for Stochastic Control Problems and Its Convergence
Optimization and Control
Teaches computers to make best choices faster.