Year: 2023
Author: Yuesheng Xu, Taishan Zeng
Numerical Mathematics: Theory, Methods and Applications, Vol. 16 (2023), Iss. 1 : pp. 58–78
Abstract
More competent learning models are demanded for data processing due to increasingly greater amounts of data available in applications. Data that we encounter often have certain embedded sparsity structures. That is, if they are represented in an appropriate basis, their energies can concentrate on a small number of basis functions. This paper is devoted to a numerical study of adaptive approximation of solutions of nonlinear partial differential equations whose solutions may have singularities, by deep neural networks (DNNs) with a sparse regularization with multiple parameters. Noting that DNNs have an intrinsic multi-scale structure which is favorable for adaptive representation of functions, by employing a penalty with multiple parameters, we develop DNNs with a multi-scale sparse regularization (SDNN) for effectively representing functions having certain singularities. We then apply the proposed SDNN to numerical solutions of the Burgers equation and the Schrödinger equation. Numerical examples confirm that solutions generated by the proposed SDNN are sparse and accurate.
You do not have full access to this article.
Already a Subscriber? Sign in as an individual or via your institution
Journal Article Details
Publisher Name: Global Science Press
Language: English
DOI: https://doi.org/10.4208/nmtma.OA-2022-0104
Numerical Mathematics: Theory, Methods and Applications, Vol. 16 (2023), Iss. 1 : pp. 58–78
Published online: 2023-01
AMS Subject Headings:
Copyright: COPYRIGHT: © Global Science Press
Pages: 21
Keywords: Sparse approximation deep learning nonlinear partial differential equations sparse regularization adaptive approximation.
Author Details
-
DEEP NEURAL NETWORK SOLUTIONS FOR OSCILLATORY FREDHOLM INTEGRAL EQUATIONS
Jiang, Jie | Xu, YueshengJournal of Integral Equations and Applications, Vol. 36 (2024), Iss. 1
https://doi.org/10.1216/jie.2024.36.23 [Citations: 0] -
A Survey on Regularized Sparse Optimization Models and Algorithms
程, 克林
Artificial Intelligence and Robotics Research, Vol. 12 (2023), Iss. 03 P.155
https://doi.org/10.12677/AIRR.2023.123018 [Citations: 0] -
Render unto Numerics: Orthogonal Polynomial Neural Operator for PDEs with Nonperiodic Boundary Conditions
Liu, Ziyuan | Wang, Haifeng | Zhang, Hong | Bao, Kaijun | Qian, Xu | Song, SongheSIAM Journal on Scientific Computing, Vol. 46 (2024), Iss. 4 P.C323
https://doi.org/10.1137/23M1556320 [Citations: 0]