Year: 2021
Author: Hadrien Montanelli, Haizhao Yang, Qiang Du
Journal of Computational Mathematics, Vol. 39 (2021), Iss. 6 : pp. 801–815
Abstract
We prove a theorem concerning the approximation of generalized bandlimited multivariate functions by deep ReLU networks for which the curse of the dimensionality is overcome. Our theorem is based on a result by Maurey and on the ability of deep ReLU networks to approximate Chebyshev polynomials and analytic functions efficiently.
You do not have full access to this article.
Already a Subscriber? Sign in as an individual or via your institution
Journal Article Details
Publisher Name: Global Science Press
Language: English
DOI: https://doi.org/10.4208/jcm.2007-m2019-0239
Journal of Computational Mathematics, Vol. 39 (2021), Iss. 6 : pp. 801–815
Published online: 2021-01
AMS Subject Headings:
Copyright: COPYRIGHT: © Global Science Press
Pages: 15
Keywords: Machine learning Deep ReLU networks Curse of dimensionality Approximation theory Bandlimited functions Chebyshev polynomials.
Author Details
-
Solving PDEs on spheres with physics-informed convolutional neural networks
Lei, Guanhang | Lei, Zhen | Shi, Lei | Zeng, Chenyu | Zhou, Ding-XuanApplied and Computational Harmonic Analysis, Vol. 74 (2025), Iss. P.101714
https://doi.org/10.1016/j.acha.2024.101714 [Citations: 0] -
Evolution of biological cooperation: an algorithmic approach
Sudakow, Ivan | Reinitz, John | Vakulenko, Sergey A. | Grigoriev, DimaScientific Reports, Vol. 14 (2024), Iss. 1
https://doi.org/10.1038/s41598-024-52028-0 [Citations: 1] -
Near-optimal learning of Banach-valued, high-dimensional functions via deep neural networks
Adcock, Ben | Brugiapaglia, Simone | Dexter, Nick | Moraga, SebastianNeural Networks, Vol. 181 (2025), Iss. P.106761
https://doi.org/10.1016/j.neunet.2024.106761 [Citations: 0] -
Solving PDEs on unknown manifolds with machine learning
Liang, Senwei | Jiang, Shixiao W. | Harlim, John | Yang, HaizhaoApplied and Computational Harmonic Analysis, Vol. 71 (2024), Iss. P.101652
https://doi.org/10.1016/j.acha.2024.101652 [Citations: 0] -
Friedrichs Learning: Weak Solutions of Partial Differential Equations via Deep Learning
Chen, Fan | Huang, Jianguo | Wang, Chunmei | Yang, HaizhaoSIAM Journal on Scientific Computing, Vol. 45 (2023), Iss. 3 P.A1271
https://doi.org/10.1137/22M1488405 [Citations: 6] -
Stationary Density Estimation of Itô Diffusions Using Deep Learning
Gu, Yiqi | Harlim, John | Liang, Senwei | Yang, HaizhaoSIAM Journal on Numerical Analysis, Vol. 61 (2023), Iss. 1 P.45
https://doi.org/10.1137/21M1445363 [Citations: 2] -
Deep ReLU networks and high-order finite element methods II: Chebyšev emulation
Opschoor, Joost A.A. | Schwab, ChristophComputers & Mathematics with Applications, Vol. 169 (2024), Iss. P.142
https://doi.org/10.1016/j.camwa.2024.06.008 [Citations: 0] -
Neural network approximation and estimation of classifiers with classification boundary in a Barron class
Caragea, Andrei | Petersen, Philipp | Voigtlaender, FelixThe Annals of Applied Probability, Vol. 33 (2023), Iss. 4
https://doi.org/10.1214/22-AAP1884 [Citations: 2] -
The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimation
Du, Qiang | Gu, Yiqi | Yang, Haizhao | Zhou, ChaoSIAM Journal on Numerical Analysis, Vol. 60 (2022), Iss. 4 P.2014
https://doi.org/10.1137/21M140691X [Citations: 11] -
Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on Hölder Class
Jiao, Yuling | Lai, Yanming | Lu, Xiliang | Wang, Fengru | Yang, Jerry Zhijian | Yang, YuanyuanSIAM Journal on Mathematical Analysis, Vol. 55 (2023), Iss. 4 P.3635
https://doi.org/10.1137/21M144431X [Citations: 1] -
SelectNet: Self-paced learning for high-dimensional partial differential equations
Gu, Yiqi | Yang, Haizhao | Zhou, ChaoJournal of Computational Physics, Vol. 441 (2021), Iss. P.110444
https://doi.org/10.1016/j.jcp.2021.110444 [Citations: 30] -
Numerical Analysis Meets Machine Learning
Learning smooth functions in high dimensions
Adcock, Ben | Brugiapaglia, Simone | Dexter, Nick | Moraga, Sebastian2024
https://doi.org/10.1016/bs.hna.2024.05.001 [Citations: 1] -
Active learning based sampling for high-dimensional nonlinear partial differential equations
Gao, Wenhan | Wang, ChunmeiJournal of Computational Physics, Vol. 475 (2023), Iss. P.111848
https://doi.org/10.1016/j.jcp.2022.111848 [Citations: 12] -
Deep Structural Estimation: With an Application to Option Pricing
Chen, Hui | Didisheim, Antoine | Scheidegger, SimonSSRN Electronic Journal , Vol. (2021), Iss.
https://doi.org/10.2139/ssrn.3782722 [Citations: 3] -
Deep Gene Networks and Response to Stress
Vakulenko, Sergey | Grigoriev, DmitryMathematics, Vol. 9 (2021), Iss. 23 P.3028
https://doi.org/10.3390/math9233028 [Citations: 2] -
Exponential ReLU DNN Expression of Holomorphic Maps in High Dimension
Opschoor, J. A. A. | Schwab, Ch. | Zech, J.Constructive Approximation, Vol. 55 (2022), Iss. 1 P.537
https://doi.org/10.1007/s00365-021-09542-5 [Citations: 33] -
Approximation bounds for norm constrained neural networks with applications to regression and GANs
Jiao, Yuling | Wang, Yang | Yang, YunfeiApplied and Computational Harmonic Analysis, Vol. 65 (2023), Iss. P.249
https://doi.org/10.1016/j.acha.2023.03.004 [Citations: 3] -
Deep Neural Networks for Solving Large Linear Systems Arising from High-Dimensional Problems
Gu, Yiqi | Ng, Michael K.SIAM Journal on Scientific Computing, Vol. 45 (2023), Iss. 5 P.A2356
https://doi.org/10.1137/22M1488132 [Citations: 5] -
Optimal approximation rate of ReLU networks in terms of width and depth
Shen, Zuowei | Yang, Haizhao | Zhang, ShijunJournal de Mathématiques Pures et Appliquées, Vol. 157 (2022), Iss. P.101
https://doi.org/10.1016/j.matpur.2021.07.009 [Citations: 31]