A first-order method for nonconvex-strongly-concave constrained minimax optimization
By: Zhaosong Lu, Sanyou Mei
Potential Business Impact:
Solves hard math problems much faster.
In this paper we study a nonconvex-strongly-concave constrained minimax problem. Specifically, we propose a first-order augmented Lagrangian method for solving it, whose subproblems are nonconvex-strongly-concave unconstrained minimax problems and suitably solved by a first-order method developed in this paper that leverages the strong concavity structure. Under suitable assumptions, the proposed method achieves an operation complexity of $O(\varepsilon^{-3.5}\log\varepsilon^{-1})$, measured in terms of its fundamental operations, for finding an $\varepsilon$-KKT solution of the constrained minimax problem, which improves the previous best-known operation complexity by a factor of $\varepsilon^{-0.5}$.
Similar Papers
A first-order method for nonconvex-strongly-concave constrained minimax optimization
Optimization and Control
Finds better answers to tricky math problems faster.
Solving bilevel optimization via sequential minimax optimization
Optimization and Control
Solves tricky math problems faster than before.
Solving Convex-Concave Problems with $\tilde{\mathcal{O}}(ε^{-4/7})$ Second-Order Oracle Complexity
Optimization and Control
Solves hard math problems faster using new computer tricks.