Automated Model Tuning for Multifidelity Uncertainty Propagation in Trajectory Simulation
By: James E. Warner , Geoffrey F. Bomarito , Gianluca Geraci and more
Potential Business Impact:
Makes computer simulations faster and more accurate.
Multifidelity uncertainty propagation combines the efficiency of low-fidelity models with the accuracy of a high-fidelity model to construct statistical estimators of quantities of interest. It is well known that the effectiveness of such methods depends crucially on the relative correlations and computational costs of the available computational models. However, the question of how to automatically tune low-fidelity models to maximize performance remains an open area of research. This work investigates automated model tuning, which optimizes model hyperparameters to minimize estimator variance within a target computational budget. Focusing on multifidelity trajectory simulation estimators, the cost-versus-precision tradeoff enabled by this approach is demonstrated in a practical, online setting where upfront tuning costs cannot be amortized. Using a real-world entry, descent, and landing example, it is shown that automated model tuning largely outperforms hand-tuned models even when the overall computational budget is relatively low. Furthermore, for scenarios where the computational budget is large, model tuning solutions can approach the best-case multifidelity estimator performance where optimal model hyperparameters are known a priori. Recommendations for applying model tuning in practice are provided and avenues for enabling adoption of such approaches for budget-constrained problems are highlighted.
Similar Papers
Optimally balancing exploration and exploitation to automate multi-fidelity statistical estimation
Computation
Makes computer models run faster and more accurately.
Efficient Learning of Vehicle Controller Parameters via Multi-Fidelity Bayesian Optimization: From Simulation to Experiment
Systems and Control
Makes car controls work better with less testing.
On Some Tunable Multi-fidelity Bayesian Optimization Frameworks
Machine Learning (CS)
Finds best designs using less expensive tests.