Momentum-based Distributed Resource Scheduling Optimization Subject to Sector-Bound Nonlinearity and Latency
By: Mohammadreza Doostmohammadian, Zulfiya R. Gabidullina, Hamid R. Rabiee
Potential Business Impact:
Helps devices share resources faster and more reliably.
This paper proposes an accelerated consensus-based distributed iterative algorithm for resource allocation and scheduling. The proposed gradient-tracking algorithm introduces an auxiliary variable to add momentum towards the optimal state. We prove that this solution is all-time feasible, implying that the coupling constraint always holds along the algorithm iterative procedure; therefore, the algorithm can be terminated at any time. This is in contrast to the ADMM-based solutions that meet constraint feasibility asymptotically. Further, we show that the proposed algorithm can handle possible link nonlinearity due to logarithmically-quantized data transmission (or any sign-preserving odd sector-bound nonlinear mapping). We prove convergence over uniformly-connected dynamic networks (i.e., a hybrid setup) that may occur in mobile and time-varying multi-agent networks. Further, the latency issue over the network is addressed by proposing delay-tolerant solutions. To our best knowledge, accelerated momentum-based convergence, nonlinear linking, all-time feasibility, uniform network connectivity, and handling (possible) time delays are not altogether addressed in the literature. These contributions make our solution practical in many real-world applications.
Similar Papers
Compressed Decentralized Momentum Stochastic Gradient Methods for Nonconvex Optimization
Machine Learning (CS)
Makes computers learn faster with less data.
Distributed Optimization with Gradient Tracking over Heterogeneous Delay-Prone Directed Networks
Systems and Control
Fixes computer networks with slow connections.
Delay-Tolerant Augmented-Consensus-based Distributed Directed Optimization
Systems and Control
Fixes slow computer networks for faster learning.