Streaming Generated Gaussian Process Experts for Online Learning and Control
By: Zewen Yang , Dongfa Zhang , Xiaobing Dai and more
Potential Business Impact:
Makes smart computer learning faster and use less memory.
Gaussian Processes (GPs), as a nonparametric learning method, offer flexible modeling capabilities and calibrated uncertainty quantification for function approximations. Additionally, GPs support online learning by efficiently incorporating new data with polynomial-time computation, making them well-suited for safety-critical dynamical systems that require rapid adaptation. However, the inference and online updates of exact GPs, when processing streaming data, incur cubic computation time and quadratic storage memory complexity, limiting their scalability to large datasets in real-time settings. In this paper, we propose a \underline{s}treaming \underline{k}ernel-induced progressivel\underline{y} generated expert framework of \underline{G}aussian \underline{p}rocesses (SkyGP) that addresses both computational and memory constraints by maintaining a bounded set of experts, while inheriting the learning performance guarantees from exact Gaussian processes. Furthermore, two SkyGP variants are introduced, each tailored to a specific objective, either maximizing prediction accuracy (SkyGP-Dense) or improving computational efficiency (SkyGP-Fast). The effectiveness of SkyGP is validated through extensive benchmarks and real-time control experiments demonstrating its superior performance compared to state-of-the-art approaches.
Similar Papers
Streaming Generated Gaussian Process Experts for Online Learning and Control
Machine Learning (CS)
Lets computers learn faster from new information.
Robust, Online, and Adaptive Decentralized Gaussian Processes
Machine Learning (Stat)
Makes computer models work better with messy data.
Conformalized Gaussian processes for online uncertainty quantification over graphs
Machine Learning (CS)
Helps computers guess better with new information.