Near instance optimality of the Lanczos method for Stieltjes and related matrix functions
By: Marcel Schweitzer
Potential Business Impact:
Makes computer math problems solve much faster.
Polynomial Krylov subspace methods are among the most widely used methods for approximating $f(A)b$, the action of a matrix function on a vector, in particular when $A$ is large and sparse. When $A$ is Hermitian positive definite, the Lanczos method is the standard choice of Krylov method, and despite being very simplistic in nature, it often outperforms other, more sophisticated methods. In fact, one often observes that the error of the Lanczos method behaves almost exactly as the error of the best possible approximation from the Krylov space (which is in general not efficiently computable). However, theoretical guarantees for the deviation of the Lanczos error from the optimal error are mostly lacking so far (except for linear systems and a few other special cases). We prove a rigorous bound for this deviation when $f$ belongs to the important class of Stieltjes functions (which, e.g., includes inverse fractional powers as special cases) and a related class (which contains, e.g., the square root and the shifted logarithm), thus providing a \emph{near instance optimality} guarantee. While the constants in our bounds are likely not optimal, they greatly improve over the few results that are available in the literature and resemble the actual behavior much better.
Similar Papers
Filtered Rayleigh-Ritz is all you need
High Energy Physics - Lattice
Makes computer calculations for science more accurate.
A Lanczos-Based Algorithmic Approach for Spike Detection in Large Sample Covariance Matrices
Statistics Theory
Finds hidden patterns faster in big data.
A Krylov projection algorithm for large symmetric matrices with dense spectra
Numerical Analysis
Makes computer simulations of physics problems faster.