A Constructive Method to Minimize the Index of Coincidence under Marginal Constraints
By: Pierre Jean-Claude Robert Bertrand
We consider the problem of minimizing the index of coincidence of a joint distribution under fixed marginal constraints. This objective is motivated by several applications in information theory, where the index of coincidence naturally arises. A closed-form solution is known when the marginals satisfy a strong feasibility condition, but this condition is rarely met in practice. We first show that the measure of the set of marginals for which condition applies vanishes as the dimension grows. We then characterize the structure of the optimal coupling in the general case, proving that it exhibits a monotone staircase of zero entries. Based on this structure, we propose an explicit iterative construction and prove that it converges in finitely many steps to a minimizer. Main result of the paper is a complete constructive solution of index-of-coincidence minimization.
Similar Papers
An Information Geometric Approach to Fairness With Equalized Odds Constraint
Information Theory
Makes AI fair by hiding secret personal details.
An iterated $I$-projection procedure for solving the generalized minimum information checkerboard copula problem
Probability
Finds the simplest way to connect data.
Structural Properties of Entropic Vectors and Stability of the Ingleton Inequality
Information Theory
Makes information sharing more secure and reliable.