Truncated $L_1$ Regularized Linear Regression: Theory and Algorithm

Truncated $L_1$ Regularized Linear Regression: Theory and Algorithm

Year:    2021

Author:    Mingwei Dai, Shuyang Dai, Junjun Huang, Lican Kang, Xiliang Lu

Communications in Computational Physics, Vol. 30 (2021), Iss. 1 : pp. 190–209

Abstract

Truncated $L_1$ regularization proposed by Fan in [5], is an approximation to the $L_0$ regularization in high-dimensional sparse models. In this work, we prove the non-asymptotic error bound for the global optimal solution to the truncated $L_1$ regularized linear regression problem and study the support recovery property. Moreover, a primal dual active set algorithm (PDAS) for variable estimation and selection is proposed. Coupled with continuation by a warm-start strategy leads to a primal dual active set with continuation algorithm (PDASC). Data-driven parameter selection rules such as cross validation, BIC or voting method can be applied to select a proper regularization parameter. The application of the proposed method is demonstrated by applying it to simulation data and a breast cancer gene expression data set (bcTCGA).

You do not have full access to this article.

Already a Subscriber? Sign in as an individual or via your institution

Journal Article Details

Publisher Name:    Global Science Press

Language:    English

DOI:    https://doi.org/10.4208/cicp.OA-2020-0250

Communications in Computational Physics, Vol. 30 (2021), Iss. 1 : pp. 190–209

Published online:    2021-01

AMS Subject Headings:    Global Science Press

Copyright:    COPYRIGHT: © Global Science Press

Pages:    20

Keywords:    High-dimensional linear regression sparsity truncated $L_1$ regularization primal dual active set algorithm.

Author Details

Mingwei Dai

Shuyang Dai

Junjun Huang

Lican Kang

Xiliang Lu

  1. Feature grouping and sparse principal component analysis with truncated regularization

    Jiang, Haiyan

    Qin, Shanshan

    Madrid Padilla, Oscar Hernan

    Stat, Vol. 12 (2023), Iss. 1

    https://doi.org/10.1002/sta4.538 [Citations: 0]