Data-driven Projection Generation for Efficiently Solving Heterogeneous Quadratic Programming Problems
By: Tomoharu Iwata, Futoshi Futami
Potential Business Impact:
Solves hard math problems much faster.
We propose a data-driven framework for efficiently solving quadratic programming (QP) problems by reducing the number of variables in high-dimensional QPs using instance-specific projection. A graph neural network-based model is designed to generate projections tailored to each QP instance, enabling us to produce high-quality solutions even for previously unseen problems. The model is trained on heterogeneous QPs to minimize the expected objective value evaluated on the projected solutions. This is formulated as a bilevel optimization problem; the inner optimization solves the QP under a given projection using a QP solver, while the outer optimization updates the model parameters. We develop an efficient algorithm to solve this bilevel optimization problem, which computes parameter gradients without backpropagating through the solver. We provide a theoretical analysis of the generalization ability of solving QPs with projection matrices generated by neural networks. Experimental results demonstrate that our method produces high-quality feasible solutions with reduced computation time, outperforming existing methods.
Similar Papers
Provably data-driven projection method for quadratic programming
Optimization and Control
Teaches computers to solve hard math problems faster.
BPQP: A Differentiable Convex Optimization Framework for Efficient End-to-End Learning
Machine Learning (CS)
Makes smart computers learn faster from data.
Warm-starting active-set solvers using graph neural networks
Machine Learning (CS)
Speeds up computer problem-solving for robots.