Data Fusion for High-Resolution Estimation
By: Amy Guan , Marissa Reitsma , Roshni Sahoo and more
Potential Business Impact:
Makes health maps more accurate using different data.
High-resolution estimates of population health indicators are critical for precision public health. We propose a method for high-resolution estimation that fuses distinct data sources: an unbiased, low-resolution data source (e.g. aggregated administrative data) and a potentially biased, high-resolution data source (e.g. individual-level online survey responses). We assume that the potentially biased, high-resolution data source is generated from the population under a model of sampling bias where observables can have arbitrary impact on the probability of response but the difference in the log probabilities of response between units with the same observables is linear in the difference between sufficient statistics of their observables and outcomes. Our data fusion method learns a distribution that is closest (in the sense of KL divergence) to the online survey distribution and consistent with the aggregated administrative data and our model of sampling bias. This method outperforms baselines that rely on either data source alone on a testbed that includes repeated measurements of three indicators measured by both the (online) Household Pulse Survey and ground-truth data sources at two geographic resolutions over the same time period.
Similar Papers
A Simple and Robust Multi-Fidelity Data Fusion Method for Effective Modeling of Citizen-Science Air Pollution Data
Methodology
Improves air pollution maps using many sensors.
Small Area Estimation Methods for Multivariate Health and Demographic Outcomes using Complex Survey Data
Methodology
Improves health data for poor countries.
A systematic machine learning approach to measure and assess biases in mobile phone population data
Applications
Fixes phone data to show where everyone really is.