Unrolled Graph Neural Networks for Constrained Optimization
By: Samar Hadou, Alejandro Ribeiro
Potential Business Impact:
Teaches computers to solve hard problems better.
In this paper, we unroll the dynamics of the dual ascent (DA) algorithm in two coupled graph neural networks (GNNs) to solve constrained optimization problems. The two networks interact with each other at the layer level to find a saddle point of the Lagrangian. The primal GNN finds a stationary point for a given dual multiplier, while the dual network iteratively refines its estimates to reach an optimal solution. We force the primal and dual networks to mirror the dynamics of the DA algorithm by imposing descent and ascent constraints. We propose a joint training scheme that alternates between updating the primal and dual networks. Our numerical experiments demonstrate that our approach yields near-optimal near-feasible solutions and generalizes well to out-of-distribution (OOD) problems.
Similar Papers
Accelerated Decentralized Constraint-Coupled Optimization: A Dual$^2$ Approach
Optimization and Control
Helps many computers work together faster.
A Two-Timescale Primal-Dual Framework for Reinforcement Learning via Online Dual Variable Guidance
Optimization and Control
Teaches computers to learn from past experiences.
Global Convergence of Adjoint-Optimized Neural PDEs
Machine Learning (CS)
Teaches computers to solve hard science problems.