High Order Deep Neural Network for Solving High Frequency Partial Differential Equations

High Order Deep Neural Network for Solving High Frequency Partial Differential Equations

Year:    2022

Author:    Zhipeng Chang, Ke Li, Xiufen Zou, Xueshuang Xiang

Communications in Computational Physics, Vol. 31 (2022), Iss. 2 : pp. 370–397

Abstract

This paper proposes a high order deep neural network (HOrderDNN) for solving high frequency partial differential equations (PDEs), which incorporates the idea of "high order" from finite element methods (FEMs) into commonly-used deep neural networks (DNNs) to obtain greater approximation ability. The main idea of HOrderDNN is introducing a nonlinear transformation layer between the input layer and the first hidden layer to form a high order polynomial space with the degree not exceeding $p$, followed by a normal DNN. The order $p$ can be guided by the regularity of solutions of PDEs. The performance of HOrderDNN is evaluated on high frequency function fitting problems and high frequency Poisson and Helmholtz equations. The results demonstrate that: HOrderDNNs($p > 1$) can efficiently capture the high frequency information in target functions; and when compared to physics-informed neural network (PINN), HOrderDNNs($p > 1$) converge faster and achieve much smaller relative errors with same number of trainable parameters. In particular, when solving the high frequency Helmholtz equation in Section 3.5, the relative error of PINN stays around 1 with its depth and width increase, while the relative error can be reduced to around 0.02 as $p$ increases (see Table 5).

You do not have full access to this article.

Already a Subscriber? Sign in as an individual or via your institution

Journal Article Details

Publisher Name:    Global Science Press

Language:    English

DOI:    https://doi.org/10.4208/cicp.OA-2021-0092

Communications in Computational Physics, Vol. 31 (2022), Iss. 2 : pp. 370–397

Published online:    2022-01

AMS Subject Headings:    Global Science Press

Copyright:    COPYRIGHT: © Global Science Press

Pages:    28

Keywords:    Deep neural network high order methods high frequency PDEs.

Author Details

Zhipeng Chang

Ke Li

Xiufen Zou

Xueshuang Xiang

  1. Solving Electromagnetic Problems with PINN based on Scattering Equivalent Source Method

    Chang, Hongyuan | Fan, Jinsong | Wang, Ren | Wang, Bing-Zhong

    2024 IEEE International Symposium on Antennas and Propagation and INC/USNC‐URSI Radio Science Meeting (AP-S/INC-USNC-URSI), (2024), P.1025

    https://doi.org/10.1109/AP-S/INC-USNC-URSI52054.2024.10686927 [Citations: 0]
  2. Computing ground states of Bose-Einstein condensation by normalized deep neural network

    Bao, Weizhu | Chang, Zhipeng | Zhao, Xiaofei

    Journal of Computational Physics, Vol. 520 (2025), Iss. P.113486

    https://doi.org/10.1016/j.jcp.2024.113486 [Citations: 0]