Gaussian Process Regression -- Neural Network Hybrid with Optimized Redundant Coordinates
By: Sergei Manzhos, Manabu Ihara
Potential Business Impact:
Makes computer learning better and simpler.
Recently, a Gaussian Process Regression - neural network (GPRNN) hybrid machine learning method was proposed, which is based on additive-kernel GPR in redundant coordinates constructed by rules [J. Phys. Chem. A 127 (2023) 7823]. The method combined the expressive power of an NN with the robustness of linear regression, in particular, with respect to overfitting when the number of neurons is increased beyond optimal. We introduce opt-GPRNN, in which the redundant coordinates of GPRNN are optimized with a Monte Carlo algorithm and show that when combined with optimization of redundant coordinates, GPRNN attains the lowest test set error with much fewer terms / neurons and retains the advantage of avoiding overfitting when the number of neurons is increased beyond optimal value. The method, opt-GPRNN possesses an expressive power closer to that of a multilayer NN and could obviate the need for deep NNs in some applications. With optimized redundant coordinates, a dimensionality reduction regime is also possible. Examples of application to machine learning an interatomic potential and materials informatics are given.
Similar Papers
nuGPR: GPU-Accelerated Gaussian Process Regression with Iterative Algorithms and Low-Rank Approximations
Machine Learning (CS)
Makes smart predictions faster and use less memory.
Bayesian Bridge Gaussian Process Regression
Methodology
Finds important information in big data faster.
Efficient Level-Crossing Probability Calculation for Gaussian Process Modeled Data
Machine Learning (Stat)
Shows computer data uncertainties faster.