Is Repeated Bayesian Interim Analysis Consequence-Free?
By: Suyu Liu , Beibei Guo , Laura Thompson and more
Potential Business Impact:
Makes sure medical tests give true results.
Interim analyses are commonly used in clinical trials to enable early stopping for efficacy, futility, or safety. While their impact on frequentist operating characteristics is well studied and broadly understood, the effect of repeated Bayesian interim analyses - when conducted without appropriate multiplicity adjustment - remains an area of active debate. In this article, we provide both theoretical justification and numerical evidence illustrating how such analyses affect key inferential properties, including bias, mean squared error, the coverage probability of posterior credible intervals, false discovery rate, familywise error rate, and power. Our findings demonstrate that Bayesian interim analyses can significantly alter a trial's operating characteristics, even when the prior used for Bayesian inference is correctly specified and aligned with the data-generating process. Extensive simulation studies, covering a variety of endpoints, trial designs (single-arm and two-arm randomized controlled trials), and scenarios with both correctly specified and misspecified priors, support theoretical insights. Collectively, these results underscore the necessity of appropriate adjustment, thoughtful prior specification, and comprehensive evaluation to ensure valid and reliable inference in Bayesian adaptive trial designs.
Similar Papers
Revisiting the apparent discrepancy between the frequentist and Bayesian interpretation of an adaptive design
Methodology
Bayesian trials can be tricked by early results.
Interim Analysis in Sequential Multiple Assignment Randomized Trials for Survival Outcomes
Methodology
Helps doctors stop medical trials early.
An information metric for comparing and assessing informative interim decisions in sequential clinical trials
Methodology
Fixes unfair trial results from early stops.