Model-Agnostic and Uncertainty-Aware Dimensionality Reduction in Supervised Learning
By: Yue Yu , Guanghui Wang , Liu Liu and more
Dimension reduction is a fundamental tool for analyzing high-dimensional data in supervised learning. Traditional methods for estimating intrinsic order often prioritize model-specific structural assumptions over predictive utility. This paper introduces predictive order determination (POD), a model-agnostic framework that determines the minimal predictively sufficient dimension by directly evaluating out-of-sample predictiveness. POD quantifies uncertainty via error bounds for over- and underestimation and achieves consistency under mild conditions. By unifying dimension reduction with predictive performance, POD applies flexibly across diverse reduction tasks and supervised learners. Simulations and real-data analyses show that POD delivers accurate, uncertainty-aware order estimates, making it a versatile component for prediction-centric pipelines.
Similar Papers
A general framework for adaptive nonparametric dimensionality reduction
Machine Learning (Stat)
Finds best way to show complex data simply.
Supervised Dynamic Dimension Reduction with Deep Neural Network
Machine Learning (Stat)
Predicts future events more accurately.
Supervised Dynamic Dimension Reduction with Deep Neural Network
Machine Learning (Stat)
Makes predictions more accurate by finding important patterns.