Accelerated decomposition of bistochastic kernel matrices by low rank approximation
By: Chris Vales, Dimitrios Giannakis
Potential Business Impact:
Finds hidden patterns in messy data faster.
We develop an accelerated algorithm for computing an approximate eigenvalue decomposition of bistochastic normalized kernel matrices. Our approach constructs a low rank approximation of the original kernel matrix by the pivoted partial Cholesky algorithm and uses it to compute an approximate decomposition of its bistochastic normalization without requiring the formation of the full kernel matrix. The cost of the proposed algorithm depends linearly on the size of the employed training dataset and quadratically on the rank of the low rank approximation, offering a significant cost reduction compared to the naive approach. We apply the proposed algorithm to the kernel based extraction of spatiotemporal patterns from chaotic dynamics, demonstrating its accuracy while also comparing it with an alternative algorithm consisting of subsampling and Nystroem extension.
Similar Papers
A general technique for approximating high-dimensional empirical kernel matrices
Machine Learning (Stat)
Makes computer predictions more accurate for complex data.
Low-rank approximation of analytic kernels
Numerical Analysis
Makes computer math faster for science.
Improved Central Limit Theorem and Bootstrap Approximations for Linear Stochastic Approximation
Machine Learning (Stat)
Makes computer learning more accurate and faster.