Multi-Scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains
Year: 2020
Author: Ziqi Liu, Wei Cai, Zhi-Qin John Xu
Communications in Computational Physics, Vol. 28 (2020), Iss. 5 : pp. 1970–2001
Abstract
In this paper, we propose multi-scale deep neural networks (MscaleDNNs) using the idea of radial scaling in frequency domain and activation functions with compact support. The radial scaling converts the problem of approximation of high frequency contents of PDEs' solutions to a problem of learning about lower frequency functions, and the compact support activation functions facilitate the separation of frequency contents of the target function to be approximated by corresponding DNNs. As a result, the MscaleDNNs achieve fast uniform convergence over multiple scales. The proposed MscaleDNNs are shown to be superior to traditional fully connected DNNs and be an effective mesh-less numerical method for Poisson-Boltzmann equations with ample frequency contents over complex and singular domains.
You do not have full access to this article.
Already a Subscriber? Sign in as an individual or via your institution
Journal Article Details
Publisher Name: Global Science Press
Language: English
DOI: https://doi.org/10.4208/cicp.OA-2020-0179
Communications in Computational Physics, Vol. 28 (2020), Iss. 5 : pp. 1970–2001
Published online: 2020-01
AMS Subject Headings: Global Science Press
Copyright: COPYRIGHT: © Global Science Press
Pages: 32
Keywords: Deep neural network Poisson-Boltzmann equation multi-scale frequency principle.
Author Details
-
A shallow physics-informed neural network for solving partial differential equations on static and evolving surfaces
Hu, Wei-Fan | Shih, Yi-Jun | Lin, Te-Sheng | Lai, Ming-ChihComputer Methods in Applied Mechanics and Engineering, Vol. 418 (2024), Iss. P.116486
https://doi.org/10.1016/j.cma.2023.116486 [Citations: 1] -
A practical PINN framework for multi-scale problems with multi-magnitude loss terms
Wang, Yong | Yao, Yanzhong | Guo, Jiawei | Gao, ZhimingJournal of Computational Physics, Vol. 510 (2024), Iss. P.113112
https://doi.org/10.1016/j.jcp.2024.113112 [Citations: 2] -
Adaptive physics-informed neural operator for coarse-grained non-equilibrium flows
Zanardi, Ivan | Venturi, Simone | Panesi, MarcoScientific Reports, Vol. 13 (2023), Iss. 1
https://doi.org/10.1038/s41598-023-41039-y [Citations: 7] -
A Linear Frequency Principle Model to Understand the Absence of Overfitting in Neural Networks
Zhang, Yaoyu | Luo, Tao | Ma, Zheng | Xu, Zhi-Qin JohnChinese Physics Letters, Vol. 38 (2021), Iss. 3 P.038701
https://doi.org/10.1088/0256-307X/38/3/038701 [Citations: 10] -
A multiscale differential‐algebraic neural network‐based method for learning dynamical systems
Huang, Yin | Ding, JieyuInternational Journal of Mechanical System Dynamics, Vol. 4 (2024), Iss. 1 P.77
https://doi.org/10.1002/msd2.12102 [Citations: 1] -
Generative adversarial text-to-image generation with style image constraint
Wang, Zekang | Liu, Li | Zhang, Huaxiang | Liu, Dongmei | Song, YuMultimedia Systems, Vol. 29 (2023), Iss. 6 P.3291
https://doi.org/10.1007/s00530-023-01160-4 [Citations: 0] -
Solving the one dimensional vertical suspended sediment mixing equation with arbitrary eddy diffusivity profiles using temporal normalized physics-informed neural networks
Zhang, Shaotong | Deng, Jiaxin | Li, Xi'an | Zhao, Zixi | Wu, Jinran | Li, Weide | Wang, You-Gan | Jeng, Dong-ShengPhysics of Fluids, Vol. 36 (2024), Iss. 1
https://doi.org/10.1063/5.0179223 [Citations: 1] -
VW-PINNs: A volume weighting method for PDE residuals in physics-informed neural networks
Song, Jiahao | Cao, Wenbo | Liao, Fei | Zhang, WeiweiActa Mechanica Sinica, Vol. 41 (2025), Iss. 3
https://doi.org/10.1007/s10409-024-24140-x [Citations: 3] -
Friedrichs Learning: Weak Solutions of Partial Differential Equations via Deep Learning
Chen, Fan | Huang, Jianguo | Wang, Chunmei | Yang, HaizhaoSIAM Journal on Scientific Computing, Vol. 45 (2023), Iss. 3 P.A1271
https://doi.org/10.1137/22M1488405 [Citations: 6] -
DRVN (deep random vortex network): A new physics-informed machine learning method for simulating and inferring incompressible fluid flows
Zhang, Rui | Hu, Peiyan | Meng, Qi | Wang, Yue | Zhu, Rongchan | Chen, Bingguang | Ma, Zhi-Ming | Liu, Tie-YanPhysics of Fluids, Vol. 34 (2022), Iss. 10
https://doi.org/10.1063/5.0110342 [Citations: 4] -
Finite basis physics-informed neural networks (FBPINNs): a scalable domain decomposition approach for solving differential equations
Moseley, Ben | Markham, Andrew | Nissen-Meyer, TarjeAdvances in Computational Mathematics, Vol. 49 (2023), Iss. 4
https://doi.org/10.1007/s10444-023-10065-9 [Citations: 46] -
Higher-order multi-scale deep Ritz method (HOMS-DRM) and its convergence analysis for solving thermal transfer problems of composite materials
Linghu, Jiale | Dong, Hao | Nie, Yufeng | Cui, JunzhiComputational Mechanics, Vol. (2024), Iss.
https://doi.org/10.1007/s00466-024-02491-3 [Citations: 1] -
Multi-scale Heterogeneous Graph Attention Network for Prison Term Prediction
Feng, Duanyu | Hu, Bing | Zhang, Yifang | Tian, Wei | Wang, Hao2023 IEEE 3rd International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA), (2023), P.1395
https://doi.org/10.1109/ICIBA56860.2023.10164974 [Citations: 0] -
Real-time prediction of full-scale ship maneuvering motions at sea under random rudder actions based on BiLSTM-SAT hybrid method
Zhou, Xiao | Zou, Lu | He, Hong-Wei | Wu, Zi-Xin | Zou, Zao-JianOcean Engineering, Vol. 314 (2024), Iss. P.119664
https://doi.org/10.1016/j.oceaneng.2024.119664 [Citations: 0] -
A sixth-order method for large deflection bending analysis of complex plates with multiple holes
Feng, Yonggu | Zhou, Youhe | Wang, JizengActa Mechanica Sinica, Vol. 41 (2025), Iss. 6
https://doi.org/10.1007/s10409-024-24271-x [Citations: 0] -
Renormalized charge and dielectric effects in colloidal interactions: a numerical solution of the nonlinear Poisson–Boltzmann equation for unknown boundary conditions
Schlaich, Alexander | Tyagi, Sandeep | Kesselheim, Stefan | Sega, Marcello | Holm, ChristianThe European Physical Journal E, Vol. 46 (2023), Iss. 9
https://doi.org/10.1140/epje/s10189-023-00334-2 [Citations: 2] -
Solving multiscale elliptic problems by sparse radial basis function neural networks
Wang, Zhiwen | Chen, Minxin | Chen, JingrunJournal of Computational Physics, Vol. 492 (2023), Iss. P.112452
https://doi.org/10.1016/j.jcp.2023.112452 [Citations: 8] -
SN-MscaleDNN: A coupling approach for rapid shielding-scheme evaluation of micro gas-cooled reactor in the large design-parameter space
Lei, Kaihui | Wu, Hongchun | Liu, Zhouyu | Cao, Yi | Liu, Guoming | Li, Xiaojing | He, Qingming | Cao, LiangzhiAnnals of Nuclear Energy, Vol. 196 (2024), Iss. P.110241
https://doi.org/10.1016/j.anucene.2023.110241 [Citations: 0] -
Overview Frequency Principle/Spectral Bias in Deep Learning
Xu, Zhi-Qin John | Zhang, Yaoyu | Luo, TaoCommunications on Applied Mathematics and Computation, Vol. (2024), Iss.
https://doi.org/10.1007/s42967-024-00398-7 [Citations: 2] -
Unveiling the Phase Diagram and Reaction Paths of the Active Model B with the Deep Minimum Action Method
Zakine, Ruben | Simonnet, Eric | Vanden-Eijnden, EricPhysical Review Letters, Vol. 133 (2024), Iss. 3
https://doi.org/10.1103/PhysRevLett.133.038301 [Citations: 0] -
Zero coordinate shift: Whetted automatic differentiation for physics-informed operator learning
Leng, Kuangdai | Shankar, Mallikarjun | Thiyagalingam, JeyanJournal of Computational Physics, Vol. 505 (2024), Iss. P.112904
https://doi.org/10.1016/j.jcp.2024.112904 [Citations: 0] -
Learning high frequency data via the coupled frequency predictor-corrector triangular DNN
Zhang, Rui
Japan Journal of Industrial and Applied Mathematics, Vol. 40 (2023), Iss. 2 P.1259
https://doi.org/10.1007/s13160-023-00577-8 [Citations: 2] -
Bayesian Inversion with Neural Operator (BINO) for modeling subdiffusion: Forward and inverse problems
Yan, Xiong-Bin | Xu, Zhi-Qin John | Ma, ZhengJournal of Computational and Applied Mathematics, Vol. 454 (2025), Iss. P.116191
https://doi.org/10.1016/j.cam.2024.116191 [Citations: 0] -
Physics-informed neural network combined with characteristic-based split for solving forward and inverse problems involving Navier–Stokes equations
Hu, Shuang | Liu, Meiqin | Zhang, Senlin | Dong, Shanling | Zheng, RonghaoNeurocomputing, Vol. 573 (2024), Iss. P.127240
https://doi.org/10.1016/j.neucom.2024.127240 [Citations: 2] -
Learning based numerical methods for acoustic frequency-domain simulation with high frequency
Li, Tingyue | Chen, Yu | Miao, Yun | Ma, DingjiongEngineering Analysis with Boundary Elements, Vol. 163 (2024), Iss. P.200
https://doi.org/10.1016/j.enganabound.2024.03.009 [Citations: 1] -
Modeling of the hysteretic behavior of nonlinear particle damping by Fourier neural network with transfer learning
Ye, Xin | Ni, Yi-Qing | Ao, Wai Kei | Yuan, LeiMechanical Systems and Signal Processing, Vol. 208 (2024), Iss. P.111006
https://doi.org/10.1016/j.ymssp.2023.111006 [Citations: 3] -
On the spectral bias of coupled frequency predictor–corrector triangular DNN: The convergence analysis
Zhang, Rui
Japan Journal of Industrial and Applied Mathematics, Vol. 41 (2024), Iss. 1 P.545
https://doi.org/10.1007/s13160-023-00617-3 [Citations: 0] -
Stationary Density Estimation of Itô Diffusions Using Deep Learning
Gu, Yiqi | Harlim, John | Liang, Senwei | Yang, HaizhaoSIAM Journal on Numerical Analysis, Vol. 61 (2023), Iss. 1 P.45
https://doi.org/10.1137/21M1445363 [Citations: 2] -
A deep reinforcement learning-based active suspension control algorithm considering deterministic experience tracing for autonomous vehicle
Wang, Cheng | Cui, Xiaoxian | Zhao, Shijie | Zhou, Xinran | Song, Yaqi | Wang, Yang | Guo, KonghuiApplied Soft Computing, Vol. 153 (2024), Iss. P.111259
https://doi.org/10.1016/j.asoc.2024.111259 [Citations: 6] -
Computational Science – ICCS 2023
Hierarchical Learning to Solve PDEs Using Physics-Informed Neural Networks
Han, Jihun | Lee, Yoonsang2023
https://doi.org/10.1007/978-3-031-36024-4_42 [Citations: 1] -
Physics-informed neural network frameworks for crack simulation based on minimized peridynamic potential energy
Ning, Luyuan | Cai, Zhenwei | Dong, Han | Liu, Yingzheng | Wang, WeizheComputer Methods in Applied Mechanics and Engineering, Vol. 417 (2023), Iss. P.116430
https://doi.org/10.1016/j.cma.2023.116430 [Citations: 10] -
End-to-End Learning for 100G-PON Based on Noise Adaptation Network
Xu, Yongxin | Huang, Luyao | Jiang, Wenqing | Guan, Xiaokai | Hu, Weisheng | Yi, LilinJournal of Lightwave Technology, Vol. 42 (2024), Iss. 7 P.2328
https://doi.org/10.1109/JLT.2023.3341495 [Citations: 0] -
An immersed interface neural network for elliptic interface problems
Zhang, Xinru | He, QiaolinJournal of Computational and Applied Mathematics, Vol. 459 (2025), Iss. P.116372
https://doi.org/10.1016/j.cam.2024.116372 [Citations: 0] -
A deep domain decomposition method based on Fourier features
Li, Sen | Xia, Yingzhi | Liu, Yu | Liao, QifengJournal of Computational and Applied Mathematics, Vol. 423 (2023), Iss. P.114963
https://doi.org/10.1016/j.cam.2022.114963 [Citations: 13] -
Physical-inforced artificial intelligent model for prediction of water-hammar velocity
Hu, Xiaodong | Yi, Pukang | Luo, Yinghao | Zhou, Fujian | Wang, Tianyu | Chen, ChaoGeoenergy Science and Engineering, Vol. 230 (2023), Iss. P.212223
https://doi.org/10.1016/j.geoen.2023.212223 [Citations: 0] -
A Physics-Informed Neural Network Based on the Boltzmann Equation with Multiple-Relaxation-Time Collision Operators
Liu, Zhixiang | Zhang, Chenkai | Zhu, Wenhao | Huang, DongmeiAxioms, Vol. 13 (2024), Iss. 9 P.588
https://doi.org/10.3390/axioms13090588 [Citations: 0] -
Solving parametric elliptic interface problems via interfaced operator network
Wu, Sidi | Zhu, Aiqing | Tang, Yifa | Lu, BenzhuoJournal of Computational Physics, Vol. 514 (2024), Iss. P.113217
https://doi.org/10.1016/j.jcp.2024.113217 [Citations: 1] -
SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEs
Ramabathiran, Amuthan A. | Ramachandran, PrabhuJournal of Computational Physics, Vol. 445 (2021), Iss. P.110600
https://doi.org/10.1016/j.jcp.2021.110600 [Citations: 43] -
Randomized neural network with Petrov–Galerkin methods for solving linear and nonlinear partial differential equations
Shang, Yong | Wang, Fei | Sun, JingboCommunications in Nonlinear Science and Numerical Simulation, Vol. 127 (2023), Iss. P.107518
https://doi.org/10.1016/j.cnsns.2023.107518 [Citations: 9] -
FBSDE based neural network algorithms for high-dimensional quasilinear parabolic PDEs
Zhang, Wenzhong | Cai, WeiJournal of Computational Physics, Vol. 470 (2022), Iss. P.111557
https://doi.org/10.1016/j.jcp.2022.111557 [Citations: 1] -
On the Exact Computation of Linear Frequency Principle Dynamics and Its Generalization
Luo, Tao | Ma, Zheng | Xu, Zhi-Qin John | Zhang, YaoyuSIAM Journal on Mathematics of Data Science, Vol. 4 (2022), Iss. 4 P.1272
https://doi.org/10.1137/21M1444400 [Citations: 0] -
Phase space approach to solving higher order differential equations with artificial neural networks
Tori, Floriano | Ginis, VincentPhysical Review Research, Vol. 4 (2022), Iss. 4
https://doi.org/10.1103/PhysRevResearch.4.043090 [Citations: 1] -
A Multi-scale Deep Neural Network Technique for Surrogate Modeling of Microwave Components
Li, Zheng | Li, Xiao-Chun | Wu, Ze-Ming2024 Photonics & Electromagnetics Research Symposium (PIERS), (2024), P.1
https://doi.org/10.1109/PIERS62282.2024.10617970 [Citations: 0] -
Multiscale-integrated deep learning approaches for short-term load forecasting
Yang, Yang | Gao, Yuchao | Wang, Zijin | Li, Xi’an | Zhou, Hu | Wu, JinranInternational Journal of Machine Learning and Cybernetics, Vol. 15 (2024), Iss. 12 P.6061
https://doi.org/10.1007/s13042-024-02302-4 [Citations: 0] -
Three ways to solve partial differential equations with neural networks — A review
Blechschmidt, Jan | Ernst, Oliver G.GAMM-Mitteilungen, Vol. 44 (2021), Iss. 2
https://doi.org/10.1002/gamm.202100006 [Citations: 119] -
Physical informed neural networks with soft and hard boundary constraints for solving advection-diffusion equations using Fourier expansions
Li, Xi'an | Deng, Jiaxin | Wu, Jinran | Zhang, Shaotong | Li, Weide | Wang, You-GanComputers & Mathematics with Applications, Vol. 159 (2024), Iss. P.60
https://doi.org/10.1016/j.camwa.2024.01.021 [Citations: 4] -
Physics-informed neural network combined with characteristic-based split for solving Navier–Stokes equations
Hu, Shuang | Liu, Meiqin | Zhang, Senlin | Dong, Shanling | Zheng, RonghaoEngineering Applications of Artificial Intelligence, Vol. 128 (2024), Iss. P.107453
https://doi.org/10.1016/j.engappai.2023.107453 [Citations: 7] -
Prediction of safety parameters of pressurized water reactor based on feature fusion neural network
Chen, Yinghao | Wang, Dongdong | Kai, Cao | Pan, Cuijie | Yu, Yayun | Hou, MuzhouAnnals of Nuclear Energy, Vol. 166 (2022), Iss. P.108803
https://doi.org/10.1016/j.anucene.2021.108803 [Citations: 9] -
Proceedings of the 2nd International Conference on Mechanical System Dynamics
A Feature Fusion Method Based on DeepONet for Dynamic Equations
Huang, Yin | Ding, Jieyu2024
https://doi.org/10.1007/978-981-99-8048-2_41 [Citations: 0] -
Subspace decomposition based DNN algorithm for elliptic type multi-scale PDEs
Li, Xi-An | Xu, Zhi-Qin John | Zhang, LeiJournal of Computational Physics, Vol. 488 (2023), Iss. P.112242
https://doi.org/10.1016/j.jcp.2023.112242 [Citations: 6] -
Trans-Net: A transferable pretrained neural networks based on temporal domain decomposition for solving partial differential equations
Zhang, Dinglei | Li, Ying | Ying, ShihuiComputer Physics Communications, Vol. 299 (2024), Iss. P.109130
https://doi.org/10.1016/j.cpc.2024.109130 [Citations: 0] -
Annealed adaptive importance sampling method in PINNs for solving high dimensional partial differential equations
Zhang, Zhengqi | Li, Jing | Liu, BinJournal of Computational Physics, Vol. 521 (2025), Iss. P.113561
https://doi.org/10.1016/j.jcp.2024.113561 [Citations: 0] -
Fourier warm start for physics-informed neural networks
Jin, Ge | Wong, Jian Cheng | Gupta, Abhishek | Li, Shipeng | Ong, Yew-SoonEngineering Applications of Artificial Intelligence, Vol. 132 (2024), Iss. P.107887
https://doi.org/10.1016/j.engappai.2024.107887 [Citations: 3] -
Adaptive multi-scale neural network with Resnet blocks for solving partial differential equations
Chen, Miaomiao | Niu, Ruiping | Zheng, WenNonlinear Dynamics, Vol. 111 (2023), Iss. 7 P.6499
https://doi.org/10.1007/s11071-022-08161-4 [Citations: 11] -
Physics-informed machine learning
Karniadakis, George Em | Kevrekidis, Ioannis G. | Lu, Lu | Perdikaris, Paris | Wang, Sifan | Yang, LiuNature Reviews Physics, Vol. 3 (2021), Iss. 6 P.422
https://doi.org/10.1038/s42254-021-00314-5 [Citations: 2696] -
Single Reference Frequency Loss for Multifrequency Wavefield Representation Using Physics-Informed Neural Networks
Huang, Xinquan | Alkhalifah, TariqIEEE Geoscience and Remote Sensing Letters, Vol. 19 (2022), Iss. P.1
https://doi.org/10.1109/LGRS.2022.3176867 [Citations: 11] -
Subspace Decomposition Based Dnn Algorithm for Elliptic-Type Multi-Scale Pdes
Li, Xi-An | Xu, Zhi-Qin John | Zhang, LeiSSRN Electronic Journal, Vol. (2022), Iss.
https://doi.org/10.2139/ssrn.4020731 [Citations: 3] -
A multiscale adaptive framework based on convolutional neural network: Application to fluid catalytic cracking product yield prediction
Liu, Nan | Zhu, Chun-Meng | Zhang, Meng-Xuan | Lan, Xing-YingPetroleum Science, Vol. 21 (2024), Iss. 4 P.2849
https://doi.org/10.1016/j.petsci.2024.01.014 [Citations: 0] -
A block-coordinate approach of multi-level optimization with an application to physics-informed neural networks
Gratton, Serge | Mercier, Valentin | Riccietti, Elisa | Toint, Philippe L.Computational Optimization and Applications, Vol. 89 (2024), Iss. 2 P.385
https://doi.org/10.1007/s10589-024-00597-1 [Citations: 0] -
DeLISA: Deep learning based iteration scheme approximation for solving PDEs
Li, Ying | Zhou, Zuojia | Ying, ShihuiJournal of Computational Physics, Vol. 451 (2022), Iss. P.110884
https://doi.org/10.1016/j.jcp.2021.110884 [Citations: 18] -
Enhancing vehicle ride comfort through deep reinforcement learning with expert-guided soft-hard constraints and system characteristic considerations
Wang, Cheng | Cui, Xiaoxian | Zhao, Shijie | Zhou, Xinran | Song, Yaqi | Wang, Yang | Guo, KonghuiAdvanced Engineering Informatics, Vol. 59 (2024), Iss. P.102328
https://doi.org/10.1016/j.aei.2023.102328 [Citations: 7] -
Low-complexity end-to-end deep learning framework for 100G-PON
Xu, Yongxin | Guan, Xiaokai | Jiang, Wenqing | Wang, Xudong | Hu, Weisheng | Yi, LilinJournal of Optical Communications and Networking, Vol. 16 (2024), Iss. 11 P.1093
https://doi.org/10.1364/JOCN.532742 [Citations: 0] -
Multi-scale physics-informed neural networks for solving high Reynolds number boundary layer flows based on matched asymptotic expansions
Huang, Jianlin | Qiu, Rundi | Wang, Jingzhu | Wang, YiweiTheoretical and Applied Mechanics Letters, Vol. 14 (2024), Iss. 2 P.100496
https://doi.org/10.1016/j.taml.2024.100496 [Citations: 4] -
Neuron analysis through the swarming procedures for the singular two-point boundary value problems arising in the theory of thermal explosion
Sabir, Zulqurnain
The European Physical Journal Plus, Vol. 137 (2022), Iss. 5
https://doi.org/10.1140/epjp/s13360-022-02869-3 [Citations: 58] -
Parametric encoding with attention and convolution mitigate spectral bias of neural partial differential equation solvers
Shishehbor, Mehdi | Hosseinmardi, Shirin | Bostanabad, RaminStructural and Multidisciplinary Optimization, Vol. 67 (2024), Iss. 7
https://doi.org/10.1007/s00158-024-03834-7 [Citations: 1] -
Solving the Boltzmann Equation with a Neural Sparse Representation
Li, Zhengyi | Wang, Yanli | Liu, Hongsheng | Wang, Zidong | Dong, BinSIAM Journal on Scientific Computing, Vol. 46 (2024), Iss. 2 P.C186
https://doi.org/10.1137/23M1558227 [Citations: 1] -
Solving a class of multi-scale elliptic PDEs by Fourier-based mixed physics informed neural networks
Li, Xi'an | Wu, Jinran | Tai, Xin | Xu, Jianhua | Wang, You-GanJournal of Computational Physics, Vol. 508 (2024), Iss. P.113012
https://doi.org/10.1016/j.jcp.2024.113012 [Citations: 1] -
MPIPN: a multi physics-informed PointNet for solving parametric acoustic-structure systems
Wang, Chu | Wu, Jinhong | Wang, Yanzhi | Zha, Zhijian | Zhou, QiEngineering with Computers, Vol. (2024), Iss.
https://doi.org/10.1007/s00366-024-01998-w [Citations: 0] -
INN: Interfaced neural networks as an accessible meshless approach for solving interface PDE problems
Wu, Sidi | Lu, BenzhuoJournal of Computational Physics, Vol. 470 (2022), Iss. P.111588
https://doi.org/10.1016/j.jcp.2022.111588 [Citations: 14]