Score: 0

Identification and Semiparametric Estimation of Conditional Means from Aggregate Data

Published: September 24, 2025 | arXiv ID: 2509.20194v1

By: Cory McCartan, Shiro Kuriwaki

Potential Business Impact:

Figures out hidden group averages from overall averages.

Business Areas:
Predictive Analytics Artificial Intelligence, Data and Analytics, Software

We introduce a new method for estimating the mean of an outcome variable within groups when researchers only observe the average of the outcome and group indicators across a set of aggregation units, such as geographical areas. Existing methods for this problem, also known as ecological inference, implicitly make strong assumptions about the aggregation process. We first formalize weaker conditions for identification, which motivates estimators that can efficiently control for many covariates. We propose a debiased machine learning estimator that is based on nuisance functions restricted to a partially linear form. Our estimator also admits a semiparametric sensitivity analysis for violations of the key identifying assumption, as well as asymptotically valid confidence intervals for local, unit-level estimates under additional assumptions. Simulations and validation on real-world data where ground truth is available demonstrate the advantages of our approach over existing methods. Open-source software is available which implements the proposed methods.

Country of Origin
🇺🇸 United States

Page Count
41 pages

Category
Statistics:
Methodology