An Adaptive Physics-Informed Neural Network with Two-Stage Learning Strategy to Solve Partial Differential Equations
Year: 2023
Author: Ruirui Ji, Shuyan Shi, Yuchao Han, Ding Liu, Ruirui Ji, Yuchao Han
Numerical Mathematics: Theory, Methods and Applications, Vol. 16 (2023), Iss. 2 : pp. 298–322
Abstract
Physics-Informed Neural Network (PINN) represents a new approach to solve Partial Differential Equations (PDEs). PINNs aim to solve PDEs by integrating governing equations and the initial/boundary conditions (I/BCs) into a loss function. However, the imbalance of the loss function caused by parameter settings usually makes it difficult for PINNs to converge, e.g. because they fall into local optima. In other words, the presence of balanced PDE loss, initial loss and boundary loss may be critical for the convergence. In addition, existing PINNs are not able to reveal the hidden errors caused by non-convergent boundaries and conduction errors caused by the PDE near the boundaries. Overall, these problems have made PINN-based methods of limited use on practical situations. In this paper, we propose a novel physics-informed neural network, i.e. an adaptive physics-informed neural network with a two-stage training process. Our algorithm adds spatio-temporal coefficient and PDE balance parameter to the loss function, and solve PDEs using a two-stage training process: pre-training and formal training. The pre-training step ensures the convergence of boundary loss, whereas the formal training process completes the solution of PDE by balancing various loss functions. In order to verify the performance of our method, we consider the imbalanced heat conduction and Helmholtz equations often appearing in practical situations. The Klein-Gordon equation, which is widely used to compare performance, reveals that our method is able to reduce the hidden errors. Experimental results confirm that our algorithm can effectively and accurately solve models with unbalanced loss function, hidden errors and conduction errors. The codes developed in this manuscript are publicy available at https://github.com/callmedrcom/ATPINN.
You do not have full access to this article.
Already a Subscriber? Sign in as an individual or via your institution
Journal Article Details
Publisher Name: Global Science Press
Language: English
DOI: https://doi.org/10.4208/nmtma.OA-2022-0063
Numerical Mathematics: Theory, Methods and Applications, Vol. 16 (2023), Iss. 2 : pp. 298–322
Published online: 2023-01
AMS Subject Headings:
Copyright: COPYRIGHT: © Global Science Press
Pages: 25
Keywords: Physics informed neural networks partial differential equations two-stage learning scientific computing.
Author Details
-
Physics-Informed Neural Network (PINN) for Solving Frictional Contact Temperature and Inversely Evaluating Relevant Input Parameters
Xia, Yichun | Meng, YonggangLubricants, Vol. 12 (2024), Iss. 2 P.62
https://doi.org/10.3390/lubricants12020062 [Citations: 1] -
A comprehensive review of advances in physics-informed neural networks and their applications in complex fluid dynamics
Zhao, Chi | Zhang, Feifei | Lou, Wenqiang | Wang, Xi | Yang, JianyongPhysics of Fluids, Vol. 36 (2024), Iss. 10
https://doi.org/10.1063/5.0226562 [Citations: 0]