Structural Properties of Entropic Vectors and Stability of the Ingleton Inequality
By: Rostislav Matveev, Andrei Romashchenko
Potential Business Impact:
Makes information sharing more secure and reliable.
We study constrained versions of the Ingleton inequality in the entropic setting and quantify its stability under small violations of conditional independence. Although the classical Ingleton inequality fails for general entropy profiles, it is known to hold under certain exact independence constraints. We focus on the regime where selected conditional mutual information terms are small (but not zero), and the inequality continues to hold up to controlled error terms. A central technical tool is a structural lemma that materializes part of the mutual information between two random variables, implicitly capturing the effect of infinitely many non-Shannon--type inequalities. This leads to conceptually transparent proofs without explicitly invoking such infinite families. Some of our bounds recover, in a unified way, what can also be deduced from the infinite families of inequalities of Matúš (2007) and of Dougherty--Freiling--Zeger (2011), while others appear to be new.
Similar Papers
Inequalities Revisited
Information Theory
Finds new math rules by looking at old ones.
Entropic bounds for conditionally Gaussian vectors and applications to neural networks
Probability
Makes AI learn faster and more accurately.
Exploring the entropic region
Information Theory
Finds new ways to understand information.