A Proportional-Integral Controller-Incorporated SGD Algorithm for High Efficient Latent Factor Analysis
By: Jinli Li, Shiyu Long, Minglian Han
Potential Business Impact:
Learns faster from big data by remembering past lessons.
In industrial big data scenarios, high-dimensional sparse matrices (HDI) are widely used to characterize high-order interaction relationships among massive nodes. The stochastic gradient descent-based latent factor analysis (SGD-LFA) method can effectively extract deep feature information embedded in HDI matrices. However, existing SGD-LFA methods exhibit significant limitations: their parameter update process relies solely on the instantaneous gradient information of current samples, failing to incorporate accumulated experiential knowledge from historical iterations or account for intrinsic correlations between samples, resulting in slow convergence speed and suboptimal generalization performance. Thus, this paper proposes a PILF model by developing a PI-accelerated SGD algorithm by integrating correlated instances and refining learning errors through proportional-integral (PI) control mechanism that current and historical information; Comparative experiments demonstrate the superior representation capability of the PILF model on HDI matrices
Similar Papers
Water Quality Data Imputation via A Fast Latent Factorization of Tensors with PID-based Optimizer
Machine Learning (CS)
Fixes bad water data for better decisions.
Latent Tensor Factorization with Nonlinear PID Control for Missing Data Recovery in Non-Intrusive Load Monitoring
Machine Learning (CS)
Fixes smart meter data errors faster and better.
DRSLF: Double Regularized Second-Order Low-Rank Representation for Web Service QoS Prediction
Machine Learning (CS)
Makes cloud services pick the best options.