Chem-NMF: Multi-layer $α$-divergence Non-Negative Matrix Factorization for Cardiorespiratory Disease Clustering, with Improved Convergence Inspired by Chemical Catalysts and Rigorous Asymptotic Analysis
By: Yasaman Torabi, Shahram Shirani, James P. Reilly
Potential Business Impact:
Makes computer learning more accurate for pictures.
Non-Negative Matrix Factorization (NMF) is an unsupervised learning method offering low-rank representations across various domains such as audio processing, biomedical signal analysis, and image recognition. The incorporation of $\alpha$-divergence in NMF formulations enhances flexibility in optimization, yet extending these methods to multi-layer architectures presents challenges in ensuring convergence. To address this, we introduce a novel approach inspired by the Boltzmann probability of the energy barriers in chemical reactions to theoretically perform convergence analysis. We introduce a novel method, called Chem-NMF, with a bounding factor which stabilizes convergence. To our knowledge, this is the first study to apply a physical chemistry perspective to rigorously analyze the convergence behaviour of the NMF algorithm. We start from mathematically proven asymptotic convergence results and then show how they apply to real data. Experimental results demonstrate that the proposed algorithm improves clustering accuracy by 5.6% $\pm$ 2.7% on biomedical signals and 11.1% $\pm$ 7.2% on face images (mean $\pm$ std).
Similar Papers
Non-Negative Matrix Factorization Using Non-Von Neumann Computers
Quantum Physics
New computer helps solve hard math problems faster.
Dynamic Topic Analysis in Academic Journals using Convex Non-negative Matrix Factorization Method
Information Retrieval
Helps computers track how science ideas change.
Applying non-negative matrix factorization with covariates to label matrix for classification
Machine Learning (CS)
Helps computers guess what something is.