Symmetric Aggregation of Conformity Scores for Efficient Uncertainty Sets
By: Nabil Alami, Jad Zakharia, Souhaib Ben Taieb
Potential Business Impact:
Combines predictions to make them more accurate.
Access to multiple predictive models trained for the same task, whether in regression or classification, is increasingly common in many applications. Aggregating their predictive uncertainties to produce reliable and efficient uncertainty quantification is therefore a critical but still underexplored challenge, especially within the framework of conformal prediction (CP). While CP methods can generate individual prediction sets from each model, combining them into a single, more informative set remains a challenging problem. To address this, we propose SACP (Symmetric Aggregated Conformal Prediction), a novel method that aggregates nonconformity scores from multiple predictors. SACP transforms these scores into e-values and combines them using any symmetric aggregation function. This flexible design enables a robust, data-driven framework for selecting aggregation strategies that yield sharper prediction sets. We also provide theoretical insights that help justify the validity and performance of the SACP approach. Extensive experiments on diverse datasets show that SACP consistently improves efficiency and often outperforms state-of-the-art model aggregation baselines.
Similar Papers
Reliable Statistical Guarantees for Conformal Predictors with Small Datasets
Machine Learning (CS)
Makes AI predictions more trustworthy, even with little data.
Enhancing Conformal Prediction via Class Similarity
Machine Learning (CS)
Makes AI predictions more useful and accurate.
Distribution-informed Online Conformal Prediction
Machine Learning (Stat)
Makes computer guesses more accurate and reliable.