An adaptive procedure for detecting replicated signals with $k$-family-wise error rate control
By: Ninh Tran
Potential Business Impact:
Find more true science results, faster.
Partial conjunction (PC) hypothesis testing is widely used to assess the replicability of scientific findings across multiple comparable studies. In high-throughput meta-analyses, testing a large number of PC hypotheses with k-family-wise error rate (k-FWER) control often suffers from low statistical power due to the multiplicity burden. The state-of-the-art AdaFilter-Bon procedure by Wang et al. (2022, Ann. Stat., 50(4), 1890-1909) alleviates this problem by filtering out hypotheses unlikely to be false before applying a rejection rule. However, a side effect of filtering is that it renders the rejection rule more stringent than necessary, leading to conservative k-FWER control. In this paper, we mitigate this conservativeness - and thereby improve the power of AdaFilter-Bon - by incorporating a post-filter null proportion estimate into the procedure. The resulting method, AdaFilter-AdaBon, has proven asymptotic k-FWER control under weak dependence and demonstrates empirical finite-sample control with higher power than the original AdaFilter-Bon in simulations.
Similar Papers
Assessing Replicability Across Dependent Studies: A Framework for Testing Partial Conjunction Hypotheses with Application to GWAS
Methodology
Finds reliable science results even with shared data.
Family-wise error rate control in clinical trials with overlapping populations
Methodology
Fixes drug tests that wrongly say medicine works.
Optimal weighted tests for replication studies and the two-trials rule
Methodology
Makes sure science tests are more likely to be right.