Score: 0

Bayesian Hierarchical Invariant Prediction

Published: May 16, 2025 | arXiv ID: 2505.11211v2

By: Francisco Madaleno , Pernille Julie Viuff Sand , Francisco C. Pereira and more

Potential Business Impact:

Finds what truly causes things, even with lots of data.

Business Areas:
Predictive Analytics Artificial Intelligence, Data and Analytics, Software

We propose Bayesian Hierarchical Invariant Prediction (BHIP) reframing Invariant Causal Prediction (ICP) through the lens of Hierarchical Bayes. We leverage the hierarchical structure to explicitly test invariance of causal mechanisms under heterogeneous data, resulting in improved computational scalability for a larger number of predictors compared to ICP. Moreover, given its Bayesian nature BHIP enables the use of prior information. In this paper, we test two sparsity inducing priors: horseshoe and spike-and-slab, both of which allow us a more reliable identification of causal features. We test BHIP in synthetic and real-world data showing its potential as an alternative inference method to ICP.

Country of Origin
🇩🇰 Denmark

Page Count
24 pages

Category
Computer Science:
Machine Learning (CS)