The Sample Complexity of Distributed Simple Binary Hypothesis Testing under Information Constraints
By: Hadi Kazemi, Ankit Pensia, Varun Jog
Potential Business Impact:
Makes computers learn faster with less data.
This paper resolves two open problems from a recent paper, arXiv:2403.16981, concerning the sample complexity of distributed simple binary hypothesis testing under information constraints. The first open problem asks whether interaction reduces the sample complexity of distributed simple binary hypothesis testing. In this paper, we show that sequential interaction does not help. The second problem suggests tightening existing sample complexity bounds for communication-constrained simple binary hypothesis testing. We derive optimally tight bounds for this setting and resolve this problem. Our main technical contributions are: (i) a one-shot lower bound on the Bayes error in simple binary hypothesis testing that satisfies a crucial tensorisation property; (ii) a streamlined proof of the formula for the sample complexity of simple binary hypothesis testing without constraints, first established in arXiv:2403.16981; and (iii) a reverse data-processing inequality for Hellinger-$\lambda$ divergences, generalising the results from arXiv:1812.03031 and arXiv:2206.02765.
Similar Papers
Sequential Binary Hypothesis Testing with Competing Agents under Information Asymmetry
Systems and Control
Helps robots guess better when they trick each other.
Testing (Conditional) Mutual Information
Data Structures and Algorithms
Finds hidden connections between three things.
Sequential Adversarial Hypothesis Testing
Information Theory
Helps computers make better guesses with less information.