A Multi-Scale DNN Algorithm for Nonlinear Elliptic Equations with Multiple Scales

A Multi-Scale DNN Algorithm for Nonlinear Elliptic Equations with Multiple Scales

Year:    2020

Author:    Xi-An Li, Zhi-Qin John Xu, Lei Zhang

Communications in Computational Physics, Vol. 28 (2020), Iss. 5 : pp. 1886–1906

Abstract

Algorithms based on deep neural networks (DNNs) have attracted increasing attention from the scientific computing community. DNN based algorithms are easy to implement, natural for nonlinear problems, and have shown great potential to overcome the curse of dimensionality. In this work, we utilize the multi-scale DNN-based algorithm (MscaleDNN) proposed by Liu, Cai and Xu (2020) to solve multi-scale elliptic problems with possible nonlinearity, for example, the p-Laplacian problem. We improve the MscaleDNN algorithm by a smooth and localized activation function. Several numerical examples of multi-scale elliptic problems with separable or non-separable scales in low-dimensional and high-dimensional Euclidean spaces are used to demonstrate the effectiveness and accuracy of the MscaleDNN numerical scheme.

You do not have full access to this article.

Already a Subscriber? Sign in as an individual or via your institution

Journal Article Details

Publisher Name:    Global Science Press

Language:    English

DOI:    https://doi.org/10.4208/cicp.OA-2020-0187

Communications in Computational Physics, Vol. 28 (2020), Iss. 5 : pp. 1886–1906

Published online:    2020-01

AMS Subject Headings:    Global Science Press

Copyright:    COPYRIGHT: © Global Science Press

Pages:    21

Keywords:    Multi-scale elliptic problem p-Laplacian equation deep neural network (DNN) variational formulation activation function.

Author Details

Xi-An Li

Zhi-Qin John Xu

Lei Zhang

  1. Physical informed neural networks with soft and hard boundary constraints for solving advection-diffusion equations using Fourier expansions

    Li, Xi'an | Deng, Jiaxin | Wu, Jinran | Zhang, Shaotong | Li, Weide | Wang, You-Gan

    Computers & Mathematics with Applications, Vol. 159 (2024), Iss. P.60

    https://doi.org/10.1016/j.camwa.2024.01.021 [Citations: 4]
  2. Three ways to solve partial differential equations with neural networks — A review

    Blechschmidt, Jan | Ernst, Oliver G.

    GAMM-Mitteilungen, Vol. 44 (2021), Iss. 2

    https://doi.org/10.1002/gamm.202100006 [Citations: 119]
  3. A Linear Frequency Principle Model to Understand the Absence of Overfitting in Neural Networks

    Zhang, Yaoyu | Luo, Tao | Ma, Zheng | Xu, Zhi-Qin John

    Chinese Physics Letters, Vol. 38 (2021), Iss. 3 P.038701

    https://doi.org/10.1088/0256-307X/38/3/038701 [Citations: 10]
  4. SN-MscaleDNN: A coupling approach for rapid shielding-scheme evaluation of micro gas-cooled reactor in the large design-parameter space

    Lei, Kaihui | Wu, Hongchun | Liu, Zhouyu | Cao, Yi | Liu, Guoming | Li, Xiaojing | He, Qingming | Cao, Liangzhi

    Annals of Nuclear Energy, Vol. 196 (2024), Iss. P.110241

    https://doi.org/10.1016/j.anucene.2023.110241 [Citations: 0]
  5. Overview Frequency Principle/Spectral Bias in Deep Learning

    Xu, Zhi-Qin John | Zhang, Yaoyu | Luo, Tao

    Communications on Applied Mathematics and Computation, Vol. (2024), Iss.

    https://doi.org/10.1007/s42967-024-00398-7 [Citations: 2]
  6. A block-coordinate approach of multi-level optimization with an application to physics-informed neural networks

    Gratton, Serge | Mercier, Valentin | Riccietti, Elisa | Toint, Philippe L.

    Computational Optimization and Applications, Vol. 89 (2024), Iss. 2 P.385

    https://doi.org/10.1007/s10589-024-00597-1 [Citations: 0]
  7. Modeling of the hysteretic behavior of nonlinear particle damping by Fourier neural network with transfer learning

    Ye, Xin | Ni, Yi-Qing | Ao, Wai Kei | Yuan, Lei

    Mechanical Systems and Signal Processing, Vol. 208 (2024), Iss. P.111006

    https://doi.org/10.1016/j.ymssp.2023.111006 [Citations: 3]
  8. A novel multi-scale loss function for classification problems in machine learning

    Berlyand, Leonid | Creese, Robert | Jabin, Pierre-Emmanuel

    Journal of Computational Physics, Vol. 498 (2024), Iss. P.112679

    https://doi.org/10.1016/j.jcp.2023.112679 [Citations: 2]
  9. Subspace Decomposition Based Dnn Algorithm for Elliptic-Type Multi-Scale Pdes

    Li, Xi-An | Xu, Zhi-Qin John | Zhang, Lei

    SSRN Electronic Journal, Vol. (2022), Iss.

    https://doi.org/10.2139/ssrn.4020731 [Citations: 3]
  10. A deep domain decomposition method based on Fourier features

    Li, Sen | Xia, Yingzhi | Liu, Yu | Liao, Qifeng

    Journal of Computational and Applied Mathematics, Vol. 423 (2023), Iss. P.114963

    https://doi.org/10.1016/j.cam.2022.114963 [Citations: 14]
  11. Subspace decomposition based DNN algorithm for elliptic type multi-scale PDEs

    Li, Xi-An | Xu, Zhi-Qin John | Zhang, Lei

    Journal of Computational Physics, Vol. 488 (2023), Iss. P.112242

    https://doi.org/10.1016/j.jcp.2023.112242 [Citations: 6]
  12. Adaptive multi-scale neural network with Resnet blocks for solving partial differential equations

    Chen, Miaomiao | Niu, Ruiping | Zheng, Wen

    Nonlinear Dynamics, Vol. 111 (2023), Iss. 7 P.6499

    https://doi.org/10.1007/s11071-022-08161-4 [Citations: 11]
  13. Prediction of safety parameters of pressurized water reactor based on feature fusion neural network

    Chen, Yinghao | Wang, Dongdong | Kai, Cao | Pan, Cuijie | Yu, Yayun | Hou, Muzhou

    Annals of Nuclear Energy, Vol. 166 (2022), Iss. P.108803

    https://doi.org/10.1016/j.anucene.2021.108803 [Citations: 9]
  14. Phase space approach to solving higher order differential equations with artificial neural networks

    Tori, Floriano | Ginis, Vincent

    Physical Review Research, Vol. 4 (2022), Iss. 4

    https://doi.org/10.1103/PhysRevResearch.4.043090 [Citations: 1]
  15. Solving a class of multi-scale elliptic PDEs by Fourier-based mixed physics informed neural networks

    Li, Xi'an | Wu, Jinran | Tai, Xin | Xu, Jianhua | Wang, You-Gan

    Journal of Computational Physics, Vol. 508 (2024), Iss. P.113012

    https://doi.org/10.1016/j.jcp.2024.113012 [Citations: 1]
  16. Solving multiscale elliptic problems by sparse radial basis function neural networks

    Wang, Zhiwen | Chen, Minxin | Chen, Jingrun

    Journal of Computational Physics, Vol. 492 (2023), Iss. P.112452

    https://doi.org/10.1016/j.jcp.2023.112452 [Citations: 8]
  17. Higher-order multi-scale deep Ritz method (HOMS-DRM) and its convergence analysis for solving thermal transfer problems of composite materials

    Linghu, Jiale | Dong, Hao | Nie, Yufeng | Cui, Junzhi

    Computational Mechanics, Vol. (2024), Iss.

    https://doi.org/10.1007/s00466-024-02491-3 [Citations: 1]
  18. Solving the one dimensional vertical suspended sediment mixing equation with arbitrary eddy diffusivity profiles using temporal normalized physics-informed neural networks

    Zhang, Shaotong | Deng, Jiaxin | Li, Xi'an | Zhao, Zixi | Wu, Jinran | Li, Weide | Wang, You-Gan | Jeng, Dong-Sheng

    Physics of Fluids, Vol. 36 (2024), Iss. 1

    https://doi.org/10.1063/5.0179223 [Citations: 1]