Concentration Inequalities for Statistical Inference

Concentration Inequalities for Statistical Inference

Year:    2021

Author:    Huiming Zhang, Songxi Chen

Communications in Mathematical Research , Vol. 37 (2021), Iss. 1 : pp. 1–85

Abstract

This paper gives a review of concentration inequalities which are widely employed in non-asymptotical analyses of mathematical statistics in a wide range of settings, from distribution-free to distribution-dependent, from sub-Gaussian to sub-exponential, sub-Gamma, and sub-Weibull random variables, and from the mean to the maximum concentration. This review provides results in these settings with some fresh new results. Given the increasing popularity of high-dimensional data and inference, results in the context of high-dimensional linear and Poisson regressions are also provided. We aim to illustrate the concentration inequalities with known constants and to improve existing bounds with sharper constants.

You do not have full access to this article.

Already a Subscriber? Sign in as an individual or via your institution

Journal Article Details

Publisher Name:    Global Science Press

Language:    English

DOI:    https://doi.org/10.4208/cmr.2020-0041

Communications in Mathematical Research , Vol. 37 (2021), Iss. 1 : pp. 1–85

Published online:    2021-01

AMS Subject Headings:    Global Science Press

Copyright:    COPYRIGHT: © Global Science Press

Pages:    85

Keywords:    Constants-specified inequalities sub-Weibull random variables heavy-tailed distributions high-dimensional estimation and testing finite-sample theory random matrices.

Author Details

Huiming Zhang

Songxi Chen

  1. Concentration inequalities of MLE and robust MLE

    Yang, Xiaowei | Liu, Xinqiao | Wei, Haoyu

    Communications in Statistics - Theory and Methods, Vol. 53 (2024), Iss. 19 P.6944

    https://doi.org/10.1080/03610926.2023.2253945 [Citations: 1]
  2. Asymptotic in a class of network models with an increasing sub-Gamma degree sequence

    Luo, Jing | Wei, Haoyu | Lei, Xiaoyu | Guo, Jiaxin

    Communications in Statistics - Theory and Methods, Vol. (2024), Iss. P.1

    https://doi.org/10.1080/03610926.2024.2370915 [Citations: 0]
  3. A novel method for computing the full-energy peak efficiency of coaxial high-purity germanium detectors for cylindrical sources

    D., GURAU | D. , STANGA | L. , DONE | O. , SIMA | G. , ILIE

    Romanian Reports in Physics, Vol. 76 (2024), Iss. 4 P.805

    https://doi.org/10.59277/RomRepPhys.2024.76.805 [Citations: 0]
  4. Asymptotics in the Thurstone model with an increasing items

    Yuyun, Wang | Jing, Luo | Zhimeng, Xu | Zhou, Lewei

    Communications in Statistics - Theory and Methods, Vol. 52 (2023), Iss. 22 P.8038

    https://doi.org/10.1080/03610926.2022.2056201 [Citations: 0]
  5. Concentration for multiplier empirical processes with dependent weights

    Zhang, Huiming | Huang, Hengzhen

    AIMS Mathematics, Vol. 8 (2023), Iss. 12 P.28738

    https://doi.org/10.3934/math.20231471 [Citations: 0]
  6. Adaptively aggregated forecast for exponential family panel model

    Yu, Dalei | Tang, Nian-Sheng | Shi, Yang

    International Journal of Forecasting, Vol. (2024), Iss.

    https://doi.org/10.1016/j.ijforecast.2024.06.005 [Citations: 0]
  7. Sharper Concentration Inequalities for Median-of-Mean Processes

    Teng, Guangqiang | Li, Yanpeng | Tian, Boping | Li, Jie

    Mathematics, Vol. 11 (2023), Iss. 17 P.3730

    https://doi.org/10.3390/math11173730 [Citations: 0]
  8. Asymptotics in the Thurstone model with an increasing items

    Yuyun, Wang | Jing, Luo | Zhimeng, Xu | Zhou, Lewei

    Communications in Statistics - Theory and Methods, Vol. 52 (2023), Iss. 22 P.8038

    https://doi.org/10.1080/03610926.2022.2056201 [Citations: 0]
  9. Asymptotic theory in network models with covariates and a growing number of node parameters

    Wang, Qiuping | Zhang, Yuan | Yan, Ting

    Annals of the Institute of Statistical Mathematics, Vol. 75 (2023), Iss. 2 P.369

    https://doi.org/10.1007/s10463-022-00848-0 [Citations: 0]
  10. Sharper Sub-Weibull Concentrations

    Zhang, Huiming | Wei, Haoyu

    Mathematics, Vol. 10 (2022), Iss. 13 P.2252

    https://doi.org/10.3390/math10132252 [Citations: 8]
  11. Non-asymptotic sub-Gaussian error bounds for hypothesis testing

    Li, Yanpeng | Tian, Boping

    Statistics & Probability Letters, Vol. 189 (2022), Iss. P.109586

    https://doi.org/10.1016/j.spl.2022.109586 [Citations: 0]
  12. On the sub-Gaussianity of the missing mass

    Li, Yanpeng | Tian, Boping

    Statistics & Probability Letters, Vol. 206 (2024), Iss. P.109991

    https://doi.org/10.1016/j.spl.2023.109991 [Citations: 0]
  13. Optimal Non-Asymptotic Bounds for the Sparse β Model

    Yang, Xiaowei | Pan, Lu | Cheng, Kun | Liu, Chao

    Mathematics, Vol. 11 (2023), Iss. 22 P.4685

    https://doi.org/10.3390/math11224685 [Citations: 0]
  14. Heterogeneous Overdispersed Count Data Regressions via Double-Penalized Estimations

    Li, Shaomin | Wei, Haoyu | Lei, Xiaoyu

    Mathematics, Vol. 10 (2022), Iss. 10 P.1700

    https://doi.org/10.3390/math10101700 [Citations: 3]
  15. Sparse Density Estimation with Measurement Errors

    Yang, Xiaowei | Zhang, Huiming | Wei, Haoyu | Zhang, Shouzheng

    Entropy, Vol. 24 (2021), Iss. 1 P.30

    https://doi.org/10.3390/e24010030 [Citations: 0]
  16. Oracle inequalities for weighted group Lasso in high-dimensional Poisson regression model

    Peng, Ling

    Communications in Statistics - Theory and Methods, Vol. 53 (2024), Iss. 19 P.6891

    https://doi.org/10.1080/03610926.2023.2253940 [Citations: 0]
  17. Non-Asymptotic Bounds of AIPW Estimators for Means with Missingness at Random

    Wang, Fei | Deng, Yuhao

    Mathematics, Vol. 11 (2023), Iss. 4 P.818

    https://doi.org/10.3390/math11040818 [Citations: 0]
  18. Weak finite determinacy of relative map-germs

    Shi, Changmei | Pei, Donghe

    Chinese Annals of Mathematics, Series B, Vol. 35 (2014), Iss. 6 P.991

    https://doi.org/10.1007/s11401-014-0859-3 [Citations: 0]
  19. Growing-dimensional partially functional linear models: non-asymptotic optimal prediction error

    Zhang, Huiming | Lei, Xiaoyu

    Physica Scripta, Vol. 98 (2023), Iss. 9 P.095216

    https://doi.org/10.1088/1402-4896/aceac0 [Citations: 5]
  20. Asymptotics in the Bradley-Terry model for networks with a differentially private degree sequence

    Ouyang, Yang | Jing, Luo | Qiuping, Wang | Zhimeng, Xu

    Communications in Statistics - Theory and Methods, Vol. (2024), Iss. P.1

    https://doi.org/10.1080/03610926.2024.2313063 [Citations: 0]
  21. Asymptotic normality and confidence region for Catoni's Z estimator

    Yao, Qiuran | Zhang, Huiming

    Stat, Vol. 11 (2022), Iss. 1

    https://doi.org/10.1002/sta4.495 [Citations: 2]