Robust Estimation Under Heterogeneous Corruption Rates
By: Syomantak Chaudhuri, Jerry Li, Thomas A. Courtade
Potential Business Impact:
Filters bad data to make computer learning better.
We study the problem of robust estimation under heterogeneous corruption rates, where each sample may be independently corrupted with a known but non-identical probability. This setting arises naturally in distributed and federated learning, crowdsourcing, and sensor networks, yet existing robust estimators typically assume uniform or worst-case corruption, ignoring structural heterogeneity. For mean estimation for multivariate bounded distributions and univariate gaussian distributions, we give tight minimax rates for all heterogeneous corruption patterns. For multivariate gaussian mean estimation and linear regression, we establish the minimax rate for squared error up to a factor of $\sqrt{d}$, where $d$ is the dimension. Roughly, our findings suggest that samples beyond a certain corruption threshold may be discarded by the optimal estimators -- this threshold is determined by the empirical distribution of the corruption rates given.
Similar Papers
Robust Federated Personalised Mean Estimation for the Gaussian Mixture Model
Machine Learning (CS)
Protects smart devices from bad data attacks.
Confidence Intervals for Linear Models with Arbitrary Noise Contamination
Statistics Theory
Finds reliable answers even with bad data.
Linear Regression under Missing or Corrupted Coordinates
Data Structures and Algorithms
Protects math models from sneaky data changes.