On some practical challenges of conformal prediction
By: Liang Hong, Noura Raydan Nasreddine
Potential Business Impact:
Makes computer predictions more reliable and faster.
Conformal prediction is a model-free machine learning method for creating prediction regions with a guaranteed coverage probability level. However, a data scientist often faces three challenges in practice: (i) the determination of a conformal prediction region is only approximate, jeopardizing the finite-sample validity of prediction, (ii) the computation required could be prohibitively expensive, and (iii) the shape of a conformal prediction region is hard to control. This article offers new insights into the relationship among the monotonicity of the non-conformity measure, the monotonicity of the plausibility function, and the exact determination of a conformal prediction region. Based on these new insights, we propose a simple strategy to alleviate the three challenges simultaneously.
Similar Papers
Conformal Prediction and Trustworthy AI
Machine Learning (CS)
Makes AI trustworthy by showing what it knows.
Conformal prediction of future insurance claims in the regression problem
Machine Learning (Stat)
Makes insurance predictions more trustworthy and reliable.
Zono-Conformal Prediction: Zonotope-Based Uncertainty Quantification for Regression and Classification Tasks
Machine Learning (CS)
Makes computer predictions more trustworthy and accurate.