Simplex-to-Euclidean Bijections for Categorical Flow Matching
By: Bernardo Williams , Victor M. Yeom-Song , Marcelo Hartmann and more
Potential Business Impact:
Helps computers understand and use data better.
We propose a method for learning and sampling from probability distributions supported on the simplex. Our approach maps the open simplex to Euclidean space via smooth bijections, leveraging the Aitchison geometry to define the mappings, and supports modeling categorical data by a Dirichlet interpolation that dequantizes discrete observations into continuous ones. This enables density modeling in Euclidean space through the bijection while still allowing exact recovery of the original discrete distribution. Compared to previous methods that operate on the simplex using Riemannian geometry or custom noise processes, our approach works in Euclidean space while respecting the Aitchison geometry, and achieves competitive performance on both synthetic and real-world data sets.
Similar Papers
Analytic Bijections for Smooth and Interpretable Normalizing Flows
Machine Learning (CS)
Makes computer models learn faster and better.
Generative Modeling with Continuous Flows: Sample Complexity of Flow Matching
Machine Learning (CS)
Makes AI create better pictures with less data.
An Eulerian Perspective on Straight-Line Sampling
Machine Learning (CS)
Makes computer art creation faster and simpler.