Zhou, Xu;
Ma, Zhongjing;
Zou, Suli;
Margellos, Kostas;
(2024)
Distributed Momentum Based Multi-Agent Optimization with Different Constraint Sets.
IEEE Transactions on Automatic Control
10.1109/tac.2024.3445575.
(In press).
Preview |
Text
Distributed_Momentum_Based_Multi-Agent_Optimization_with_Different_Constraint_Sets.pdf - Accepted Version Download (3MB) | Preview |
Abstract
This paper considers a class of consensus optimization problems over a time-varying communication network wherein each agent can only interact with its neighbours. The target is to minimize the summation of all local and possibly non-smooth objectives in the presence of different constraint sets per agent. To achieve this goal, we propose a novel distributed heavy-ball algorithm that combines the subgradient tracking technique with a momentum term related to history information. This algorithm promotes the distributed application of existing centralized accelerated momentum methods, especially for constrained non-smooth problems. Under certain assumptions and conditions on the step-size and momentum coefficient, the convergence and optimality of the proposed algorithm can be guaranteed through a rigorous theoretical analysis, and a convergence rate of O(lnk/k−−√) in objective value is also established. Simulations on an ℓ1 -regularized logistic-regression problem show that the proposed algorithm can achieve faster convergence than existing related distributed algorithms, while a case study involving a building energy management problem further demonstrates its efficacy.
Type: | Article |
---|---|
Title: | Distributed Momentum Based Multi-Agent Optimization with Different Constraint Sets |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1109/tac.2024.3445575 |
Publisher version: | http://dx.doi.org/10.1109/tac.2024.3445575 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. - For the purpose of Open Access, K. Margellos has applied a CC BY public copyright licence to any Author Accepted Manuscript (AAM) version arising from this submission. |
Keywords: | Distributed optimization, multi-agent networks, heavy-ball momentum, sub-gradient averaging consensus |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Chemical Engineering |
URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10197255 |
Archive Staff Only
![]() |
View Item |