Abstract
This paper investigated the global attractive set for quaternion-valued neural networks (QVNNs) with leakage delay, time-varying delay, and neutral items. Based on various basic conditions of activation function, the global attractive set and global exponential attractive set of QVNNs are given combined with novel analytical techniques and Lyapunov theory. The QVNNs are studied by a direct method, without any decomposition. The time delay can be non-differential, which makes the results more pragmatic. Restrictions on the activation function of the neutral item are relaxed. The neutral activation function can be bounded or unbounded, which makes the results more practical. Two simulation examples are given to verify the validity of the theory results.
Keywords: Global attractive set, Neutral type, Leakage delay
Subject terms: Applied mathematics, Computational science, Computer science
Introduction
With the development of artificial intelligence science, scholars concentrate on the study of artificial neural network,which has been widely used in control, medical diagnosis, and other fields1–5. In the existing literatures, neural networks are usually based on real-valued and complex-valued. However, they are limited in processing high-dimensional data. Quaternion was proposed by Hamilton in 1843, quaternion carry more information, containing real and imaginary parts. Nevertheless, its multiplication is not commutative. It is more difficult to study than real and complex numbers.
The literature6 shows that quaternion-valued neural networks (QVNNs) are more productive in solving multi-dimensional issues, and quaternion can better describe the spatial rotation state7,8. QVNNs are widely used in optimization, image processing, and life sciences9–12. It is important to study the characteristics and applications of QVNNs.
Decomposition methods are usually adopted to study QVNNs13,14. However, the computational complexity of the decomposition method is doubled or even quadrupled. To overcome this shortcoming, scholars established a more direct approach, without any decomposition15.
The time delay in the practical systems usually leads to instability, oscillation, or chaos. Considering that appropriate time delay can enhance stability, many scholars have concentrated on the dynamic behavior of time delay systems16–18. In the process of network transmission, signals between two network nodes may pass through multiple network segments with different transmission conditions, which can cause multiple time delays19,20. It is no longer appropriate to describe the induced effect with a single time delay component. Scholars focus on multiple time delays in neural networks21,22. Zhang et al.23discusses the QVNNs estimation problem with both distribution and leakage delay. However, these results are always based on real or complex numbers. According to available literature, there are few relevant research results in quaternions.
The performance of the neurons is connected with the past state, and also the derivative of the past state. A delay in the derivative is called a neutral delay24, the corresponding neural network is called a neutral-type neural network. In the literature, the function of the neutral term is usually set to be bounded25–28. But in real systems, the activation function is usually nonlinear or unbounded. It is a challenging problem to study such activation functions.
Exploring the dissipative and global attractive set of QVNN, which incorporates leakage delay, time-varying delay, and neutral delay, presents an unparalleled research frontier. This paper employs novel analytical techniques and Lyapunov theory to delve into this intricate issue, with the following main contributions:
-
I.
The QVNN offers a broader range of applications and innovative techniques compared to real-valued and complex-valued neural network. The approach to quaternions is holistic, eschewing any decomposition. Several novel Lyapunov-Krasovskii function are devised to ascertain the global attractive set and global exponential attractive set of QVNN, providing a comprehensive analysis.
-
II.
By incorporating the leakage delay term, the results are not only theoretically but also highly relevant and practical in real-world applications.
-
III.
This paper broadens the perspective on the activation function types of neutral items. By dispensing with traditional assumptions, the neutral activation function can to be either bounded or unbounded, thereby enhancing the applicability and practical value of the findings.
The subsequent sections of this paper are structured as follows: “Preliminaries” section presents preliminaries and model descriptions, “Main results” section delves into the detailed discussion and proofs of the global exponential dissipation and global dissipation of QVNN(1), “Discussion of results” section explores the global dissipation of QVNN(1) under varying activation function conditions, “Illustrative examples” section verifies the results through numerical simulations, and “Conclusions” section concludes the paper.
Preliminaries
Notations stands for the set of real numbers, stands for the set of positive real numbers, represents the set of quaternions, denotes the n-dimensional quaternion space. Quaternion u can be denoted as
i, j, k are imaginary parts, and satisfy the Hamilton rule
The conjugate of quaternion u is denoted as . The modulus of is specified as
The norm of vector is defined as
represents a class of continuous mapping set from to , where in . For ,
This paper investigates the QVNN model with neutral item29 and leakage delays17,
| 1 |
is the state of the th neuron. is the self-feedback coefficient, . , and are link weights. and are activation functions. is a positive real constant, and presents the leakage time delay. and are additive time-varying delay, is the neutral delay. They satisfy , . For convenience, the variables that satisfy the conditions are represented as , , , , and are real constants. is the external input.
Definition 1
30 If there exists , for and , , s.t.
then QVNN(1) is a globally dissipative system(GDS), and is the globally attractive set(GAS) of (1).
Definition 2
30 If there exists , for and , , s.t.
then the system (1) is a globally exponentially dissipative system (GEDS), and is the globally exponentially attractive set(GEAS) of (1).
Lemma 1
31 For , the following conclusions can be drawn:
Remark 1
For general case, . That is, quaternion multiplication generally does not satisfy the commutativity. The method that decomposes quaternion into real and complex numbers is more complicated, which increases the complexity of calculation, this paper tries to use some new methods for analysis.
Lemma 2
30 If , then , s.t.
Main results
This article considers the following two types of activation functions:
-
I.
-
II.
Theorem 1
For , there exists positive real constant , , such that the QVNN(1) is a GEDS. Let
then the set
is a GEAS of QVNN(1).
Proof
Construct the function
Let , then
and
For , the following conclusion can be drawn
which implies that, for , , then . If , there exist , for , , that is, the QVNN(1) is GDS, and is a GAS.
Due to
one can obtain
implies that
where . One derives
By Definition 2, the QVNN(1) is a GEDS, and is a GEAS of the QVNN(1).
Theorem 2
If , , there are positive constants and , such that the QVNN(1) is a GDS. Let
is a GAS of the QVNN(1).
Proof
Considering the following function with positive constants ,
By Lemma 2, one can obtain
Let ,then
When , the following inequality holds:
| 2 |
Accordingly, for , if , then . If , , for , then is a GAS of (1), the QVNN(1) is a GDS.
Discussion of results
In the previous section, we discussed and proved in detail the global exponential dissipation and global dissipation of QVNN(1) when the activation function satisfies different conditions. In fact, QVNN(1) can be similarly verified to be globally dissipative when the conditions of the activation function change to other conditions.
Corollary 1
If , , and , let
then the set
is a GAS of QVNN(1), and QVNN(1) is a GDS.
Proof
Construct the function
following Theorem 2, the conclusion can be drawn.
Corollary 2
If , , and there exist positive constants , , let
then the set
is a GAS of QVNNs(1), and QVNN(1) is a GDS.
Proof
Construct the function
following Theorem 2, the conclusion can be drawn.
Illustrative examples
Two simulation examples are given to test the validity of the theorems.
Example 1
Constructing the neural networks model:
| 3 |
Choosing , . Obviously, , , . According to Theorem 1, QVNN(2) is a GEDS,
is a GEAS of (2). Figures 1 and 2 show the simulation results of QVNN(2).
Figure 1.
Transient behavior trajectories of QVNN (2).
Figure 2.
Phase trajectories of QVNN (2).
Example 2
Considering the networks model:
| 4 |
Choosing . Obviously, , . Figures 3 and 4show the simulation results of QVNN(3). According to Theorem 2, the QVNN(3) is a GDS, and
is a GAS of (3).
Figure 3.
Transient behavior trajectories of QVNN (3).
Figure 4.
Phase trajectories of QVNN (3).
Remark 2
Via the theorems and simulation results, systems can reach stability under different initial value conditions, time-varying delay, external input, and exist a GAS.
Conclusions
This paper researched the GAS of the neutral type QVNNs with time-varying and leakage delay. The QVNNs are studied by direct methods, rather than decomposition into real or complex numbers. It makes the calculation more convenient. Traditional assumptions on neutral type activation function are removed, which makes the results more pragmatic. Four new classes of Lyapunov functions are constructed by extended inequalities and Lyapunov theory to find the GAS of QVNNs. Systems can reach stability under leakage delay and additive delay. The concrete GAS estimation is given by simulations.
The estimation of GAS and GEAS for QVNNs with different time delays will be further considered in the following work. This examination holds significant importance in understanding the dynamical behavior of QVNNs and how their stability properties are influenced by temporal factors. By thoroughly analyzing QVNNs with differing time delays, develop a comprehensive framework for estimating stability metrics, which can be utilized in designing more robust and efficient QVNNs for a wide range of applications. This work will not only enhance our theoretical understanding of QVNNs but also contribute to the practical implementation of these networks in real-world scenarios.
Author contributions
Xili Wu conceived the manuscript. All authors contributed to manuscript preparation, and revised the manuscript.
Funding
This study was supported by by the Science and Technology Project of Chongqing Education Commission (Nos.KJQN202301214, KJQN202101212, KJQN202101220, KJZD-M202001201, KJZD-M202301202), the Natural Science Foundation Project of Chongqing(Nos.cstc2021jcyj-msxmX0051,CSTB2022NSCQ-MSX0393).
Data availability
In this paper, numerical simulation is used to carry out the experiment, and all the data have been presented in the manuscript.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Zeng, S., Gou, J. & Deng, L. An antinoise sparse representation method for robust face recognition via joint l(1) and l(2) regularization. Expert Syst. Appl.82, 1–9 (2017). 10.1016/j.eswa.2017.04.001 [DOI] [Google Scholar]
- 2.Li, R., Gao, X. & Cao, J. Quasi-state estimation and quasi-synchronization control of quaternion-valued fractional-order fuzzy memristive neural networks: Vector ordering approach. Appl. Math. Comput.362, 0096–3003 (2019). [Google Scholar]
- 3.Wu, Z. Multiple asymptotic stability of fractional-order quaternion-valued neural networks with time-varying delays. Neurocomputing448, 301–312 (2021). 10.1016/j.neucom.2021.03.079 [DOI] [Google Scholar]
- 4.Shoaib, M. et al. Heat transfer impacts on Maxwell nanofluid flow over a vertical moving surface with MHD using stochastic numerical technique via artificial neural networks. Coatings11, 1483 (2021). 10.3390/coatings11121483 [DOI] [Google Scholar]
- 5.Akbar, A. et al. A design of neural networks to study MHD and heat transfer in two phase model of nano-fluid flow in the presence of thermal radiation. Waves Random Complex Media0, 1–24 (2022). [Google Scholar]
- 6.Buchholz, S. & Bihan, N. Optimal separation of polarized signals by quaternionic neural networks. In 2006 14th European Signal Processing Conference (2006).
- 7.Farouki, R. & Sakkalis, T. Equivalence of distinct characterizations for rational rotation-minimizing frames on quintic space curves. Comput. Aided Geom. Des.28(7), 436–445 (2011). 10.1016/j.cagd.2011.07.004 [DOI] [Google Scholar]
- 8.Zupan, E., Saje, M. & Zupan, D. Dynamics of spatial beams in quaternion description based on the newmark integration scheme. Comput. Mech.51(1), 47–64 (2013). 10.1007/s00466-012-0703-0 [DOI] [Google Scholar]
- 9.Trevor, B. Meta-heuristic optimization methods for quaternion-valued neural networks. Mathematics9(9), 2227–7390 (2021). [Google Scholar]
- 10.Isokawa, T., Kusakabe, T., Matsui, N. & Peper, F. Quaternion neural network and its application. In Lecture Notes in Computer Science Vol. 2774, 318–324 (2003).
- 11.Suhas, T., Sampath, K. & Jaya, R. Evaluation of pavement surface distress using image processing and artificial neural network. J. Test. Eval. Multidiscip. Forum Appl. Sci. Eng.51, 0090–3973 (2023). [Google Scholar]
- 12.Ell, T., Bihan, N. & Sangwine, S. Quaternion Fourier transforms for signal and image processing. In Quaternion Fourier Transforms for Signal and Image Processing, (2014). [DOI] [PubMed]
- 13.Huang, C. & Zhang, H. Periodicity of non-autonomous inertial neural networks involving proportional delays and non-reduced order method. Int. J. Biomath.12, 1793–5245 (2019). 10.1142/S1793524519500165 [DOI] [Google Scholar]
- 14.Duan, L., Fang, X. & Huang, C. Global exponential convergence in a delayed almost periodic Nicholson’s blowflies model with discontinuous harvesting. Math. Methods Appl. Sci.5, 1954–1965 (2017). [Google Scholar]
- 15.Yang, H. Exponential stability for stochastic jumping bam neural networks with time-varying and distributed delays. Nonlinear Anal. Hybrid Syst5, 52–77 (2011). 10.1016/j.nahs.2010.08.005 [DOI] [Google Scholar]
- 16.Chen, X., Li, Z., Song, Q., Hu, J. & Tan, Y. Robust stability analysis of quaternion-valued neural networks with time delays and parameter uncertainties. Neural Netw.91, 55–65 (2017). 10.1016/j.neunet.2017.04.006 [DOI] [PubMed] [Google Scholar]
- 17.Chen, X. & Song, Q. Global stability of complex-valued neural networks with both leakage time delay and discrete time delay on time scales. Neurocomputing121, 254–264 (2013). 10.1016/j.neucom.2013.04.040 [DOI] [Google Scholar]
- 18.Wang, L., Zeng, Z., Ge, M. & Hu, J. Global stabilization analysis of inertial memristive recurrent neural networks with discrete and distributed delays. Neural Netw.121, 65–74 (2018). 10.1016/j.neunet.2018.04.014 [DOI] [PubMed] [Google Scholar]
- 19.Liu, Y., Lee, S. & Lee, H. Robust delay-depent stability criteria for uncertain neural networks with two additive time-varying delay components. Neurocomputing151, 770–775 (2015). 10.1016/j.neucom.2014.10.023 [DOI] [Google Scholar]
- 20.Zhang, X. & Han, Q. A decentralized event-triggered dissipative control scheme for systems with multiple sensors to sample the system outputs. IEEE Trans. Cybern.46(12), 2745 (2016). 10.1109/TCYB.2015.2487420 [DOI] [PubMed] [Google Scholar]
- 21.Yu, Z., Gao, H. & Mou, S. Asymptotic stability analysis of neural networks with successive time delay components. Neurocomputing71, 2848–2856 (2008). 10.1016/j.neucom.2007.08.015 [DOI] [Google Scholar]
- 22.Wang, W. et al. Synchronization of memristive bam neural networks with leakage delay and additive time-varying delay components via sampled-data control. Chaos Solitons Fract.104, 84–97 (2017). 10.1016/j.chaos.2017.08.011 [DOI] [Google Scholar]
- 23.Zhang, X., Han, Q., Wang, Z. & Zhang, B. Neuronal state estimation for neural networks with two additive time-varying delay components. IEEE Trans. Cybern.47(10), 3184–3194 (2017). 10.1109/TCYB.2017.2690676 [DOI] [PubMed] [Google Scholar]
- 24.Yang, X., Cheng, Z., Li, X. & Ma, T. Exponential synchronization of coupled neutral-type neural networks with mixed delays via quantized output control. J. Franklin Inst.356(15), 8138–8153 (2019). 10.1016/j.jfranklin.2019.07.006 [DOI] [Google Scholar]
- 25.Qi, L., Zeng, Z. & Liao, X. Global exponential stability in Lagrange sense for neutral type recurrent neural networks. Neurocomputing74(4), 638–645 (2011). 10.1016/j.neucom.2010.10.001 [DOI] [Google Scholar]
- 26.Arik, S. An analysis of stability of neutral-type neural systems with constant time delays. J. Franklin Inst.351(11), 4949–4959 (2014). 10.1016/j.jfranklin.2014.08.013 [DOI] [Google Scholar]
- 27.Wang, B. & Jian, J. Global Lagrange stability for neutral-type Cohen-Grossberg bam neural networks with mixed time-varying delays. Math. Comput. Simul.116, 1–25 (2015). 10.1016/j.matcom.2015.04.005 [DOI] [Google Scholar]
- 28.Sriraman, R. & Samidurai, R. Global asymptotic stability analysis for neutral-type complex-valued neural networks with random time-varying delays. Int. J. Syst. Sci.50(9), 1–15 (2019). 10.1080/00207721.2019.1623340 [DOI] [Google Scholar]
- 29.Wu, X., Wang, L., Tu, Z. & Feng, Y. Global attractive set of neural networks with neutral item. Nonlinear Anal. Model. Control28, 181–193 (2023). [Google Scholar]
- 30.Tu, Z., Cao, J., Alsaedi, A. & Hayat, T. Global dissipativity analysis for delayed quaternion-valued neural networks. Neural Netw.89, 97–104 (2017). 10.1016/j.neunet.2017.01.006 [DOI] [PubMed] [Google Scholar]
- 31.Li, W. Quaternionan Matrices (National University of Defence Technology Press, 2002). [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
In this paper, numerical simulation is used to carry out the experiment, and all the data have been presented in the manuscript.




