Convergence Analysis of Split-Douglas-Rachford Algorithm and a Novel Preconditioned ADMM with an Improved Condition
Year: 2024
Author: Maoran Wang, Xingju Cai, Yongxin Chen
Numerical Mathematics: Theory, Methods and Applications, Vol. 17 (2024), Iss. 3 : pp. 658–696
Abstract
For the primal-dual monotone inclusion problem, the split-Douglas-Rachford (SDR) algorithm is a well-known first-order splitting method. Similar to other first-order algorithms, the efficiency of SDR is greatly influenced by its step parameters. Therefore, expanding the range of stepsizes may lead to improved numerical performance. In this paper, we prove that the stepsize range of SDR can be expanded based on a series of properties of the product Hilbert space. Moreover, we present a concise counterexample to illustrate that the newly proposed stepsize range cannot be further enhanced. Furthermore, to bridge the theoretical gap in the convergence rate of SDR, we analyze the descent of SDR’s fixed point residuals and provide the first proof of a sublinear convergence rate for the fixed point residuals. As an application, we utilize SDR to solve separable convex optimization problems with linear equality constraints and develop a novel preconditioned alternating direction method of multipliers (NP-ADMM). This method can handle scenarios where two linear operators are not identity operators. We propose strict convergence conditions and convergence rates for the preconditioned primal-dual split (P-PDS) method and NP-ADMM by demonstrating the relationship between SDR, P-PDS, and NP-ADMM. Finally, we conduct four numerical experiments to verify the computational efficiency of these algorithms and demonstrate that the performance of these algorithms has been significantly improved with the improved conditions.
You do not have full access to this article.
Already a Subscriber? Sign in as an individual or via your institution
Journal Article Details
Publisher Name: Global Science Press
Language: English
DOI: https://doi.org/10.4208/nmtma.OA-2023-0113
Numerical Mathematics: Theory, Methods and Applications, Vol. 17 (2024), Iss. 3 : pp. 658–696
Published online: 2024-01
AMS Subject Headings:
Copyright: COPYRIGHT: © Global Science Press
Pages: 39
Keywords: Primal-dual monotone inclusion problem split-Douglas-Rachford algorithm preconditioned ADMM improved convergence condition sublinear convergence rate.