Bayes Factor Hypothesis Testing in Meta-Analyses: Practical Advantages and Methodological Considerations
By: Joris Mulder, Robbie C. M. van Aert
Potential Business Impact:
Tests if a new idea is true, even with more info.
Bayesian hypothesis testing via Bayes factors offers a principled alternative to classical p-value methods in meta-analysis, particularly suited to its cumulative and sequential nature. Unlike commonly reported p-values for standard null hypothesis significance testing, Bayes factors allow for quantifying support both for and against the existence of an effect, facilitate ongoing evidence monitoring, and maintain coherent long-run behavior as additional studies are incorporated. Recent theoretical developments further show how Bayes factors can flexibly control Type I error rates through connections to e-value theory. Despite these advantages, their use remains limited in the meta-analytic literature. This paper provides a critical overview of their theoretical properties, methodological considerations, such as prior sensitivity, and practical advantages for evidence synthesis. Two illustrative applications are provided: one on statistical learning in individuals with language impairments, and another on seroma incidence following post-operative exercise in breast cancer patients. New tools supporting these methods are available in the open-source R package BFpack.
Similar Papers
Bayes Factor Hypothesis Testing in Meta-Analyses: Practical Advantages and Methodological Considerations
Methodology
Helps scientists combine study results to find truth.
Bayes Factor Group Sequential Designs
Methodology
Helps scientists stop experiments early with confidence.
Bayesian Power and Sample Size Calculations for Bayes Factors in the Binomial Setting
Methodology
Finds the right number of people for studies.