Boundedness and Convergence Analysis of a Pi-Sigma Neural Network Based on Online Gradient Method and Sparse Optimization
Year: 2024
Author: Qinwei Fan, Le Liu, Shuai Zhao, Zhiwen Zhang, Xiaofei Yang, Zhiwei Xing, Xingshi He
East Asian Journal on Applied Mathematics, Vol. 14 (2024), Iss. 4 : pp. 769–787
Abstract
High order neural networks have strong nonlinear mapping ability, but the network structure is more complex, which restricts the efficiency of the network, and the relevant theoretical analysis is still not perfect up to now. To solve these problems, an online gradient learning algorithm model of Pi-Sigma neural network with a smooth set lasso regular term is proposed. Since the original lasso regular term contains absolute values and is not differentiable at the origin, it causes experiment oscillations and poses a great challenge to the convergence analysis of the algorithm. We use grinding technology to overcome this deficiency. The main contribution of this paper lies in the adoption of online learning algorithm, which effectively improves the efficiency of the algorithm. At the same time, strict theoretical proofs are presented, including strong convergence and weak convergence. Finally, the effectiveness of the algorithm and the correctness of the theoretical results are verified by numerical experiments.
You do not have full access to this article.
Already a Subscriber? Sign in as an individual or via your institution
Journal Article Details
Publisher Name: Global Science Press
Language: English
DOI: https://doi.org/10.4208/eajam.2023-025.080823
East Asian Journal on Applied Mathematics, Vol. 14 (2024), Iss. 4 : pp. 769–787
Published online: 2024-01
AMS Subject Headings:
Copyright: COPYRIGHT: © Global Science Press
Pages: 19
Keywords: Online gradient method Pi-Sigma neural network regularizer convergence.
Author Details
-
Convergence Analysis of Regularized Elman Neural Networks Under Relaxed Conditions
Fan, Qinwei
Zhou, Li
Zurada, Jacek M.
Peng, Jigen
Li, Haiyang
Wang, Jian
Yang, Dakun
IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 55 (2025), Iss. 1 P.430
https://doi.org/10.1109/TSMC.2024.3486764 [Citations: 0]