A sensitivity analysis for non-inferiority studies with non-randomised data
By: Daijiro Kabata, Takumi Imai
Potential Business Impact:
Measures how much hidden factors could change study results.
Background: Non-inferiority studies based on non-randomised data are increasingly used in clinical research but remain prone to unmeasured confounding. The classical E-value offers a simple way to quantify such bias but has been applied almost exclusively with respect to the statistical null. We reformulated the E-value framework to make explicit its applicability to predefined clinical margins, thereby extending its utility to non-inferiority analyses. Development: Using the bias-factor formulation by Ding and VanderWeele, we defined the non-inferiority E-value as the minimum strength of association that an unmeasured confounder would need with both treatment and outcome, on the risk-ratio scale, to move the 95% confidence-limit estimate to the prespecified non-inferiority margin. Application: This approach was applied to three observational studies and one single-arm trial with external controls to illustrate interpretation and range. The resulting non-inferiority E-values for the confidence limits varied from about one to three, depending on design and findings. In the single-arm trial, a large gap between the confidence-limit and point-estimate NIEs reflected small sample size and wide confidence intervals, highlighting that both should be reported for a balanced assessment of robustness. Conclusion: This study reformulates the E-value to focus on clinically meaningful margins rather than the statistical null, enabling its application to non-inferiority analyses. Although the non-inferiority E-value inherits the limitations of the original method and cannot address all bias sources, it offers a transparent framework for interpreting non-randomised evidence and for generating insights that inform the design of future, more definitive randomised controlled trials.
Similar Papers
Differentially Private E-Values
Methodology
Protects private data while still using it for analysis.
A General Framework for Designing and Evaluating Active-Controlled Trials with Non-Inferiority Objectives
Methodology
Tests new medicines better, even if old ones work.
Nonparametric Bounds for Evaluating the Clinical Utility of Treatment Rules
Methodology
Find best treatments even with missing info.