Identification and Semiparametric Estimation of Conditional Means from Aggregate Data
By: Cory McCartan, Shiro Kuriwaki
Potential Business Impact:
Figures out hidden group averages from overall averages.
We introduce a new method for estimating the mean of an outcome variable within groups when researchers only observe the average of the outcome and group indicators across a set of aggregation units, such as geographical areas. Existing methods for this problem, also known as ecological inference, implicitly make strong assumptions about the aggregation process. We first formalize weaker conditions for identification, which motivates estimators that can efficiently control for many covariates. We propose a debiased machine learning estimator that is based on nuisance functions restricted to a partially linear form. Our estimator also admits a semiparametric sensitivity analysis for violations of the key identifying assumption, as well as asymptotically valid confidence intervals for local, unit-level estimates under additional assumptions. Simulations and validation on real-world data where ground truth is available demonstrate the advantages of our approach over existing methods. Open-source software is available which implements the proposed methods.
Similar Papers
Bayesian Semi-supervised Inference via a Debiased Modeling Approach
Methodology
Improves computer learning with less labeled data.
Semiparametric model averaging for high-dimensional quantile regression with nonignorable nonresponse
Methodology
Fixes predictions when data is missing.
Identification and Estimation of Joint Potential Outcome Distributions from a Single Study
Methodology
Finds who treatment helps or harms.