Linearized Alternating Direction Method of Multipliers for Constrained Linear Least-Squares Problem

Linearized Alternating Direction Method of Multipliers for Constrained Linear Least-Squares Problem

Year:    2012

East Asian Journal on Applied Mathematics, Vol. 2 (2012), Iss. 4 : pp. 326–341

Abstract

The alternating direction method of multipliers (ADMM) is applied to a constrained linear least-squares problem, where the objective function is a sum of two least-squares terms and there are box constraints. The original problem is decomposed into two easier least-squares subproblems at each iteration, and to speed up the inner iteration we linearize the relevant subproblem whenever it has no known closed-form solution. We prove the convergence of the resulting algorithm, and apply it to solve some image deblurring problems. Its efficiency is demonstrated, in comparison with Newton-type methods.

You do not have full access to this article.

Already a Subscriber? Sign in as an individual or via your institution

Journal Article Details

Publisher Name:    Global Science Press

Language:    English

DOI:    https://doi.org/10.4208/eajam.270812.161112a

East Asian Journal on Applied Mathematics, Vol. 2 (2012), Iss. 4 : pp. 326–341

Published online:    2012-01

AMS Subject Headings:   

Copyright:    COPYRIGHT: © Global Science Press

Pages:    16

Keywords:    Linear least-squares problems alternating direction method of multipliers linearization image processing.

  1. TGV-based multiplicative noise removal approach: Models and algorithms

    Gao, Yiming | Yang, Xiaoping

    Journal of Inverse and Ill-posed Problems, Vol. 26 (2018), Iss. 6 P.703

    https://doi.org/10.1515/jiip-2016-0051 [Citations: 4]
  2. Autofocus algorithms with phase error correction for synthetic aperture radar imagery

    Yu, Guoyang | Liang, Junli | Fan, Wen | So, Hing Cheung | Zhou, Deyun

    Digital Signal Processing, Vol. 130 (2022), Iss. P.103692

    https://doi.org/10.1016/j.dsp.2022.103692 [Citations: 1]
  3. Structural Similarity-Based Nonlocal Variational Models for Image Restoration

    Wang, Wei | Li, Fang | Ng, Michael K.

    IEEE Transactions on Image Processing, Vol. 28 (2019), Iss. 9 P.4260

    https://doi.org/10.1109/TIP.2019.2906491 [Citations: 22]
  4. A 2-block semi-proximal ADMM for solving the H-weighted nearest correlation matrix problem

    Chang, Xiaokai | Liu, Sanyang

    Optimization, Vol. 66 (2017), Iss. 1 P.1

    https://doi.org/10.1080/02331934.2016.1246547 [Citations: 4]
  5. The Sensitivity Optimization Guided Imaging Method for Electrical Capacitance Tomography

    Zhao, Qing | Li, Jie | Liu, Shi | Liu, Guoqiang | Liu, Jing

    IEEE Transactions on Instrumentation and Measurement, Vol. 70 (2021), Iss. P.1

    https://doi.org/10.1109/TIM.2021.3106131 [Citations: 7]
  6. Convergence study of indefinite proximal ADMM with a relaxation factor

    Tao, Min

    Computational Optimization and Applications, Vol. 77 (2020), Iss. 1 P.91

    https://doi.org/10.1007/s10589-020-00206-x [Citations: 14]
  7. Linearized ADMM for Nonconvex Nonsmooth Optimization With Convergence Analysis

    Liu, Qinghua | Shen, Xinyue | Gu, Yuantao

    IEEE Access, Vol. 7 (2019), Iss. P.76131

    https://doi.org/10.1109/ACCESS.2019.2914461 [Citations: 73]
  8. A PAPR Reduction Method With EVM Constraints for OFDM Systems

    Wang, Yajun | Wang, Mengmeng | Xie, Zhibin

    IEEE Access, Vol. 7 (2019), Iss. P.171830

    https://doi.org/10.1109/ACCESS.2019.2956348 [Citations: 9]
  9. Convergence study on the proximal alternating direction method with larger step size

    Ma, Feng

    Numerical Algorithms, Vol. 85 (2020), Iss. 2 P.399

    https://doi.org/10.1007/s11075-019-00819-2 [Citations: 4]
  10. An inexact alternating direction method of multipliers for the solution of linear complementarity problems arising from free boundary problems

    Zhang, Jian-Jun | Zhang, Jian-Li | Ye, Wan-Zhou

    Numerical Algorithms, Vol. 78 (2018), Iss. 3 P.895

    https://doi.org/10.1007/s11075-017-0405-y [Citations: 6]
  11. An Implementable Splitting Algorithm for the $$\ell _1$$ ℓ 1 -norm Regularized Split Feasibility Problem

    He, Hongjin | Ling, Chen | Xu, Hong-Kun

    Journal of Scientific Computing, Vol. 67 (2016), Iss. 1 P.281

    https://doi.org/10.1007/s10915-015-0078-4 [Citations: 17]
  12. Decomposition Methods for Computing Directional Stationary Solutions of a Class of Nonsmooth Nonconvex Optimization Problems

    Pang, Jong-Shi | Tao, Min

    SIAM Journal on Optimization, Vol. 28 (2018), Iss. 2 P.1640

    https://doi.org/10.1137/17M1110249 [Citations: 15]
  13. Linearized block-wise alternating direction method of multipliers for multiple-block convex programming

    Wu, Zhongming | Cai, Xingju | Han, Deren

    Journal of Industrial & Management Optimization, Vol. 14 (2018), Iss. 3 P.833

    https://doi.org/10.3934/jimo.2017078 [Citations: 2]
  14. A new linearized split Bregman iterative algorithm for image reconstruction in sparse-view X-ray computed tomography

    Chen, Chong | Xu, Guoliang

    Computers & Mathematics with Applications, Vol. 71 (2016), Iss. 8 P.1537

    https://doi.org/10.1016/j.camwa.2016.01.003 [Citations: 15]
  15. Generalized Peaceman-Rachford splitting method for separable convex programming with applications to image processing

    Sun, Min | Liu, Jing

    Journal of Applied Mathematics and Computing, Vol. 51 (2016), Iss. 1-2 P.605

    https://doi.org/10.1007/s12190-015-0922-6 [Citations: 7]
  16. Sparse solution of nonnegative least squares problems with applications in the construction of probabilistic Boolean networks

    Wen, You‐Wei | Wang, Man | Cao, Zhiying | Cheng, Xiaoqing | Ching, Wai‐Ki | Vassiliadis, Vassilios S.

    Numerical Linear Algebra with Applications, Vol. 22 (2015), Iss. 5 P.883

    https://doi.org/10.1002/nla.2001 [Citations: 8]