Nearest Neighbor Matching as Least Squares Density Ratio Estimation and Riesz Regression
By: Masahiro Kato
Potential Business Impact:
Makes computer learning fairer by fixing bias.
This study proves that Nearest Neighbor (NN) matching can be interpreted as an instance of Riesz regression for automatic debiased machine learning. Lin et al. (2023) shows that NN matching is an instance of density-ratio estimation with their new density-ratio estimator. Chernozhukov et al. (2024) develops Riesz regression for automatic debiased machine learning, which directly estimates the Riesz representer (or equivalently, the bias-correction term) by minimizing the mean squared error. In this study, we first prove that the density-ratio estimation method proposed in Lin et al. (2023) is essentially equivalent to Least-Squares Importance Fitting (LSIF) proposed in Kanamori et al. (2009) for direct density-ratio estimation. Furthermore, we derive Riesz regression using the LSIF framework. Based on these results, we derive NN matching from Riesz regression. This study is based on our work Kato (2025a) and Kato (2025b).
Similar Papers
Riesz Regression As Direct Density Ratio Estimation
Machine Learning (Stat)
Makes computer learning fairer and more accurate.
Learning density ratios in causal inference using Bregman-Riesz regression
Machine Learning (Stat)
Helps computers learn from different data sources.
A Unified Theory for Causal Inference: Direct Debiased Machine Learning via Bregman-Riesz Regression
Machine Learning (Stat)
Unifies methods to find what truly causes an effect.