Directional replicability: when can the factor of two be omitted
By: Vera Djordjilović, Tamar Sofer, Jonathan M. Dreyfuss
Potential Business Impact:
Finds if science results are real more easily.
Directional replicability addresses the question of whether an effect studied across $n$ independent studies is present with the same direction in at least $r$ of them, for $r \geq 2$. When the expected direction of the effect is not specified in advance, the state of the art recommends assessing replicability separately by combining one-sided $p$-values for both directions (left and right), and then doubling the smaller of the two resulting combined $p$-values to account for multiple testing. In this work, we show that this multiplicative correction is not always necessary, and give conditions under which it can be safely omitted.
Similar Papers
Replicability: Terminology, Measuring Success, and Strategy
Other Statistics
Makes science results more trustworthy and repeatable.
Optimal weighted tests for replication studies and the two-trials rule
Methodology
Makes sure science tests are more likely to be right.
Assessing Replicability Across Dependent Studies: A Framework for Testing Partial Conjunction Hypotheses with Application to GWAS
Methodology
Finds reliable science results even with shared data.