Control, Optimal Transport and Neural Differential Equations in Supervised Learning
By: Minh-Nhat Phung, Minh-Binh Tran
Potential Business Impact:
Teaches computers to move data smoothly and efficiently.
We study the fundamental computational problem of approximating optimal transport (OT) equations using neural differential equations (Neural ODEs). More specifically, we develop a novel framework for approximating unbalanced optimal transport (UOT) in the continuum using Neural ODEs. By generalizing a discrete UOT problem with Pearson divergence, we constructively design vector fields for Neural ODEs that converge to the true UOT dynamics, thereby advancing the mathematical foundations of computational transport and machine learning. To this end, we design a numerical scheme inspired by the Sinkhorn algorithm to solve the corresponding minimization problem and rigorously prove its convergence, providing explicit error estimates. From the obtained numerical solutions, we derive vector fields defining the transport dynamics and construct the corresponding transport equation. Finally, from the numerically obtained transport equation, we construct a neural differential equation whose flow converges to the true transport dynamics in an appropriate limiting regime.
Similar Papers
Optimal Transport for Machine Learners
Machine Learning (Stat)
Helps computers learn by comparing data.
Characterizing and computing solutions to regularized semi-discrete optimal transport via an ordinary differential equation
Numerical Analysis
Finds best way to move things, faster.
Scalable Approximate Algorithms for Optimal Transport Linear Models
Machine Learning (Stat)
Helps computers learn from data faster and better.