Factorization by extremal privacy mechanisms: new insights into efficiency
By: Chiara Amorino, Arnaud Gloter
Potential Business Impact:
Protects your data while still letting computers learn.
We study the problem of efficiency under $\alpha$ local differential privacy ($\alpha$ LDP) in both discrete and continuous settings. Building on a factorization lemma, which shows that any privacy mechanism can be decomposed into an extremal mechanism followed by additional randomization, we reduce the Fisher information maximization problem to a search over extremal mechanisms. The representation of extremal mechanisms requires working in infinite dimensional spaces and invokes advanced tools from convex and functional analysis, such as Choquet's theorem. Our analysis establishes matching upper and lower bounds on the Fisher information in the high privacy regime ($\alpha \to 0$), and proves that the maximization problem always admits a solution for any $\alpha$. As a concrete application, we consider the problem of estimating the parameter of a uniform distribution on $[0, \theta]$ under $\alpha$ LDP. Guided by our theoretical findings, we design an extremal mechanism that yields a consistent and asymptotically efficient estimator in high privacy regime. Numerical experiments confirm our theoretical results.
Similar Papers
Dobrushin Coefficients of Private Mechanisms Beyond Local Differential Privacy
Information Theory
Makes private data sharing safer and more accurate.
Fundamental Limit of Discrete Distribution Estimation under Utility-Optimized Local Differential Privacy
Cryptography and Security
Keeps private info safe while learning from data.
High-Probability Bounds For Heterogeneous Local Differential Privacy
Machine Learning (Stat)
Protects your private info while still getting useful data.