Learning Dynamics from Infrequent Output Measurements for Uncertainty-Aware Optimal Control
By: Robert Lefringhausen, Theodor Springer, Sandra Hirche
Potential Business Impact:
Controls machines even with bad, slow information.
Reliable optimal control is challenging when the dynamics of a nonlinear system are unknown and only infrequent, noisy output measurements are available. This work addresses this setting of limited sensing by formulating a Bayesian prior over the continuous-time dynamics and latent state trajectory in state-space form and updating it through a targeted marginal Metropolis-Hastings sampler equipped with a numerical ODE integrator. The resulting posterior samples are used to formulate a scenario-based optimal control problem that accounts for both model and measurement uncertainty and is solved using standard nonlinear programming methods. The approach is validated in a numerical case study on glucose regulation using a Type 1 diabetes model.
Similar Papers
Optimal Unpredictable Control for Linear Systems
Systems and Control
Makes computer systems harder to guess.
A Framework for Adaptive Stabilisation of Nonlinear Stochastic Systems
Systems and Control
Teaches robots to learn and control unpredictable machines.
Learning Constraints from Stochastic Partially-Observed Closed-Loop Demonstrations
Systems and Control
Teaches robots to follow hidden rules.