Leveraging Shared Factor Structures for Enhanced Matrix Completion with Nonconvex Penalty Regularization
By: Yuanhong A , Xinyan Fan , Bingyi Jing and more
Potential Business Impact:
Improves guessing missing data using hidden clues.
This article investigates the problem of noisy low-rank matrix completion with a shared factor structure, leveraging the auxiliary information from the missing indicator matrix to enhance prediction accuracy. Despite decades of development in matrix completion, the potential relationship between observed data and missing indicators has largely been overlooked. To address this gap, we propose a joint modeling framework for the observed data and missing indicators within the context of a generalized factor model and derive the asymptotic limit distribution of the estimators. Furthermore, to tackle the rank estimation problem for model specification, we employ matrix nonconvex penalty regularization and establish nonasymptotic probability guarantees for the Oracle property. The theoretical results are validated through extensive simulation studies and real-world data analysis, demonstrating the effectiveness of the proposed method.
Similar Papers
Statistical Inference for High-dimensional Matrix-variate Factor Models with Missing Observations
Methodology
Finds hidden patterns in messy data.
Computational Efficient and Minimax Optimal Nonignorable Matrix Completion
Machine Learning (Stat)
Fixes broken data even when missingness is tricky.
Leveraging Low-rank Factorizations of Conditional Correlation Matrices in Graph Learning
Machine Learning (CS)
Finds hidden connections in data faster.