Bayes Factor Hypothesis Testing in Meta-Analyses: Practical Advantages and Methodological Considerations
By: Joris Mulder, Robbie C. M. van Aert
Potential Business Impact:
Helps scientists combine study results to find truth.
Bayesian hypothesis testing via Bayes factors offers a principled alternative to classical p-value methods in meta-analysis, particularly suited to its cumulative and sequential nature. Unlike p-values, Bayes factors allow for quantifying support both for and against the existence of an effect, facilitate ongoing evidence monitoring, and maintain coherent long-run behavior as additional studies are incorporated. Recent theoretical developments further show how Bayes factors can flexibly control Type I error rates through connections to e-value theory. Despite these advantages, their use remains limited in the meta-analytic literature. This paper provides a critical overview of their theoretical properties, methodological considerations, such as prior sensitivity, and practical advantages for evidence synthesis. Two illustrative applications are provided: one on statistical learning in individuals with language impairments, and another on seroma incidence following post-operative exercise in breast cancer patients. New tools supporting these methods are available in the open-source R package BFpack.
Similar Papers
Bayes Factor Hypothesis Testing in Meta-Analyses: Practical Advantages and Methodological Considerations
Methodology
Tests if a new idea is true, even with more info.
Bayes Factor Group Sequential Designs
Methodology
Helps scientists stop experiments early with confidence.
Meta-Analysis with JASP, Part II: Bayesian Approaches
Methodology
Helps scientists combine research results easily.