Multivariate Uncertainty Quantification with Tomographic Quantile Forests
By: Takuya Kanazawa
Quantifying predictive uncertainty is essential for safe and trustworthy real-world AI deployment. Yet, fully nonparametric estimation of conditional distributions remains challenging for multivariate targets. We propose Tomographic Quantile Forests (TQF), a nonparametric, uncertainty-aware, tree-based regression model for multivariate targets. TQF learns conditional quantiles of directional projections $\mathbf{n}^{\top}\mathbf{y}$ as functions of the input $\mathbf{x}$ and the unit direction $\mathbf{n}$. At inference, it aggregates quantiles across many directions and reconstructs the multivariate conditional distribution by minimizing the sliced Wasserstein distance via an efficient alternating scheme with convex subproblems. Unlike classical directional-quantile approaches that typically produce only convex quantile regions and require training separate models for different directions, TQF covers all directions with a single model without imposing convexity restrictions. We evaluate TQF on synthetic and real-world datasets, and release the source code on GitHub.
Similar Papers
Asymptotic Theory and Phase Transitions for Variable Importance in Quantile Regression Forests
Machine Learning (Stat)
Fixes computer predictions that guess wrong.
Generalized random forest for extreme quantile regression
Methodology
Predicts rare weather events more accurately.
Uncertainty Quantification for Deep Regression using Contextualised Normalizing Flows
Machine Learning (CS)
Shows how sure a computer is about its guesses.