Abstract
This paper discusses the synchronization of fractional order complex valued neural networks (FOCVNN) at the presence of time delay. Synchronization criterions are achieved through the employment of a linear feedback control and comparison theorem of fractional order linear systems with delay. Feasibility and effectiveness of the proposed system are validated through numerical simulations.
Keywords: synchronization, comparison theorem, time-delay, fractional order, complex valued neural networks
1. Introduction
Recently, complex valued neural networks (CVNN) have attracted more attention in many research fields, such as signal processing, quantum waves, speech synthesis, and so on [1,2,3,4,5]. Unlike real valued neural networks (RVNN), the state vectors, including weights of connections and activation functions of CVNN, derives from the complex valued field. CVNN can help solve some real-world problems that RVNN can never solve. For example, the Exclusive-OR (XOR) problem and the detection of symmetry problem can be solved with a single complex valued neuron with the orthogonal boundaries, whereas neither of them could be achieved by RVNN with such a simple network structure [6]. Generally speaking, the CVNN have more complicated properties and dynamical behaviors [7,8,9]. In fact, the activation functions in RVNN are employed to be bounded and smooth. However, based on Liouville’s theorem [10], a function that is bounded and analytic at the same time in the complex domain must be constant. Therefore, careful selection of the activation functions of CVNN is a challenging task [11]. Hence, considering the dynamical behaviors of CVNN is important and necessary. Existing results have concerned stability and synchronization [12,13,14].
Fractional calculus, which acts with derivatives and integrals of arbitrary order, was firstly proposed by Leibniz in 1695 [15]. Compared with an integer-order model, fractional order models can offer more accurate instrument for memory description and inherited properties of several processes. Some researchers introduced the fractional order derivatives into neural networks; the fractional order neural networks were designed for precisely modelling in real world [16,17,18,19].
It is worth pointing out that the interesting results of integer order CVNN can not be directly extended to fractional-order complex valued neural networks (FOCVNN). The stability and synchronization analysis of fractional order systems, including FOCVNN, are very difficult. Since calculating the fractional order derivatives of Lyapunov functions is complicated, the stability analysis methods for integer order systems such as Lyapunov functional method can not be easily generalized to fractional order systems. Taking these factors into consideration, many researchers have studied the dynamic behaviors of FOCVNN [20,21,22,23,24,25].
Due to finite switching speeds of amplifiers, it is quite difficult to avoid time delays in neural networks. This may induce oscillation and instability behaviors [26,27,28]. Some interesting results have been presented on the stability of FOCVNN with time delay. For instance, in [21], Gronwall inequality, Cauchy-Schiwartz inequality and inequality skills were utilized to consider stability of FOCVNN at the presence of time delay. Existence and uniform stability analysis of FOCVNN with time delays were studied in [22]. Stability analysis of fractional order complex valued neural networks and memristive neural networks with time delays were studied in [23,24]. To the best of our knowledge, only a few research works have considered the synchronization of FOCVNN with time delay. For example, in [25], synchronization of FOCVNN with time delay was achieved by employing linear delay feedback and a fractional order inequality.
Because the fractional order systems cannot have any exact non-constant periodic solution [29,30], we consider in this paper, from a numerical point of view, that a periodic solution is an extremely-near periodic trajectory. The main goal of this paper is to study the synchronization of FOCVNN with time delay by adopting a new strategy, and some interesting results are obtained. To ensure synchronization, sufficient conditions are established by constructing a Lyapunov function, employing a fractional order inequality and comparison theorem of fractional order linear systems when there is a time delay.
2. Preliminaries and Model Description
The literature gives some definitions of the fractional order derivatives, including the Riemann-Liouville definition and Caputo definition. The Caputo derivative only requires initial conditions given in terms of integer-order derivatives, thus it is more applicable in the real world. Therefore, this paper considers the Caputo derivative.
Definition 1
([31]). The Caputo derivative of fractional order α of a function is defined by:
where , , is the Gamma function, .
This paper proposes a class of FOCVNN at the presence of time delay as master system, which is expressed as:
| (1) |
or equivalently
| (2) |
where , n is the number of units in a neural networks, corresponds to the state of the j-th unit at time t, denotes , with is the self-regulating parameters of the neurons. represents the external input, and are the connective weights matrix in the presence and absence of delay, respectively. Functions and are the complex valued activation functions of the kth unit at time t and , respectively, is the transmission delay, denotes , .
The slave system is given:
| (3) |
or equivalently
| (4) |
where is the state vector of the system response, is a suitable controller.
In following, some assumptions and useful lemmas are presented to proof the main results.
Assumption 1.
Let , and are analytic and can be expressed, while separating the real and imaginary parts, as
where , , , .
Assumption 2.
The functions satisfy the following conditions: there exist positive constants such that
for all .
Note that Assumption 2 is very important. Compare with the Lipschitz condition , Assumption 2 is the general Lipschitz condition. In CVNN, the activation functions cannot be bounded and analytic, careful selection of the activation functions of CVNN is a challenge task. Therefore, under Assumption 2, the results in this paper have been obtained.
Lemma 1
([32]). Suppose is a continuous and differentiable vector-value function. Then, for any time instant , we get
(5) where .
Lemma 2
([33]). Suppose is a continuous differentiable and nonnegative function, which satisfies
(6) where . If for all , then .
3. Main Results
This section derives the synchronization conditions of FOCVNN with time delay by designing a suitable controller.
Assuming that is the synchronization error, then the system’s error can be computed as
| (7) |
The vector form as follows:
| (8) |
In the following, the notations are used:
| (9) |
| (10) |
Select the control input function as the following form:
| (11) |
where each with denote the control gain.
Then the system’s error can be given as
| (12) |
| (13) |
where are the real parts of matrix , respectively, are the imaginary parts of matrix , respectively.
The error system (12) and (13) can also be rewritten as
| (14) |
| (15) |
Note
Theorem 1.
Suppose Assumptions 1 and 2 hold, the control gains satisfy , then the master system (1) and the slave system (3) are globally asymptotically synchronized, where
Proof.
See the Appendix A.
If the parameters, states and activation functions in systems (1) and (3) are all selected from real valued field, based on Theorem 1, we get , Thus, one can obtain the following corollary. ☐
Corollary 1.
Suppose Assumptions 1 and 2 hold, the control gains η satisfy , then the master system (1) and the slave system (3) are globally asymptotically synchronized.
Remark 1.
Compared with [21], in this paper, the comparison theorem of linear fractional order systems with delay is adopted to achieve the synchronization of FOCVNN with time delay, and the results are presented. The method is new and effective at designing the synchronization of complex valued neural networks.
Remark 2.
Lemmas 1 and 2 play important and useful roles for studying synchronization of FOCVNN. The proposed method can be extended to consider the synchronization of fractional order complex valued memristive neural networks at the existence of delays, including fractional order chaotic and hyperchaotic systems.
4. Numerical Simulations
The following fractional order complex valued delayed neural networks is considered as the master system:
| (16) |
where and .
, and for
The slave system is given as:
| (17) |
where , is the control function to be designed later.
The initial values are selected for The curves of and are shown without controller in Figure 1 and Figure 2. Figure 3, Figure 4, Figure 5 and Figure 6 depict the time evolution of the real and imaginary parts of and with control gains The simulation results show that the master system cannot synchronize the slave system without a controller.
Figure 1.
Curves of in 3-dimensional space without control.
Figure 2.
Curves of in 2-dimensional space without control.
Figure 3.
The trajectories of without control.
Figure 4.
The trajectories of without control.
Figure 5.
The trajectories of without control.
Figure 6.
The trajectories of without control.
If we select the control gain , by simple computing, the condition of Theorem 1 is satisfied. The initial values are selected for The curves of and are shown with controller in Figure 7 and Figure 8. The synchronization errors of real and imaginary parts of , are shown in Figure 9, Figure 10, Figure 11 and Figure 12, the synchronization trajectories of real and imaginary parts of , are shown in Figure 13, Figure 14, Figure 15 and Figure 16, which indicates that the slave system (17) achieved synchronization with the master system (16).
Figure 7.
Curves of in 3-dimensional space with controller.
Figure 8.
Curves of in 2-dimensional space with controller.
Figure 9.
The synchronization trajectories of with controller.
Figure 10.
The synchronization trajectories of with controller.
Figure 11.
The synchronization trajectories of with controller.
Figure 12.
The synchronization trajectories of with controller.
Figure 13.
The synchronization error state.
Figure 14.
The synchronization error state.
Figure 15.
The synchronization error state.
Figure 16.
The synchronization error state.
5. Conclusions
Compared with real valued neural networks, FOCVNN has more complicated properties and dynamical behaviors. In this paper, the synchronization of FOCVNN with time delay is considered. An error feedback controller is designed by using the comparison theorem of linear fractional order systems with delay and a fractional inequality. An example is proposed to demonstrate the correctness and effectiveness of the obtained results. The method is not only easy to apply for achieving the synchronization of FOCVNN with delay, but also has improved the previous results. The results obtained are still suitable for synchronization of a fractional order real valued neural network with delay. The stability and synchronization of FOCVNN still remain open topics which need to be pursued in the future.
Acknowledgments
The authors thanks the referees and the editor for their valuable comments. This work was supported by the National Natural Science Foundation of China (No. 61573096), the Natural Science Foundation of Anhui Province (No. 1608085MA14) and the Natural Science Foundation of the Higher Education Institutions of Anhui Province (No. KJ2015A152).
Abbreviations
The following abbreviations are used in this manuscript:
| CVNN | complex valued neural networks |
| RVNN | real valued neural networks |
| FOCVNN | fractional-order complex-valued neural networks |
Appendix A
Proof of Theorem 1:
Construct an auxiliary function:
| (A1) |
Using Lemma 1, then
Then, one gets
| (A2) |
According to Lemma 2, when the system (1) synchronizes the system (3).
Author Contributions
In this paper, Weiwei Zhang is in charge of the fractional calculus theory and paper writing. Jinde Cao is in charge of the synchronization controller design. Dingyuan Chen mainly contribute in the stability analysis, and Fuad E. Alsaadi is in charge of the discussion and the simulation. All authors have read and approved the final manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Aizenberg I., Aizenberg N.N., Vandewalle J.P.L. Multi-Valued and Universal Binary Neurons: Theory, Learning and Applications. Springer; New York, NY, USA: 2000. pp. 88–106. [Google Scholar]
- 2.Aizenberg I. Complex-Valued Neural Networks with Multi-Valued Neurons. Springer; New York, NY, USA: 2011. pp. 39–62. [Google Scholar]
- 3.Hirose A. Complex-Valued Neural Networks. Springer; Berlin/Heidelberg, Germany: 2012. pp. 53–71. [Google Scholar]
- 4.Tanaka G., Aihara K. Complex-valued multistate associative memory with nonlinear multilevel functions for gray-level image reconstruction. IEEE Trans. Neural Netw. 2009;2011:1463–1473. doi: 10.1109/TNN.2009.2025500. [DOI] [PubMed] [Google Scholar]
- 5.Hirose A. Complex-Valued Neural Networks: Advances and Applications. Wiley Georg Olms Verlagsbuch-Handlung; Hoboken, NJ, USA: 2013. pp. 32–58. [Google Scholar]
- 6.Hirose A. Dynamics of fully complex-valued neural networks. Electron. Lett. 1992;28:1492–1494. doi: 10.1049/el:19920948. [DOI] [Google Scholar]
- 7.Mathews J.H., Howell R.W. Complex Analysis for Mathematics and Engineering. Jones and Bartlett Learning; Burlington, NJ, USA: 2012. pp. 63–98. [Google Scholar]
- 8.Hu J., Wang J. Global stability of complex-valued recurrent neural networks with time-delays. IEEE Trans. Neural Netw. Learn. Syst. 2012;23:853–865. doi: 10.1109/TNNLS.2012.2195028. [DOI] [PubMed] [Google Scholar]
- 9.Xu X.H., Zhang J.Y., Shi J.Z. Exponential stability of complex-valued neural networks with mixed delays. Neurocomputing. 2014;128:483–490. doi: 10.1016/j.neucom.2013.08.014. [DOI] [Google Scholar]
- 10.Song Q.K., Zhao Z.J., Liu Y.R. Impulsive effects on stability of discrete-time complex-valued neural networks with both discrete and distributed time-varying delays. Neurocomputing. 2015;168:1044–1050. doi: 10.1016/j.neucom.2015.05.020. [DOI] [Google Scholar]
- 11.Gong W.Q., Liang J.L., Zhang C.J. Multistability of complex-valued neural networks with distributed delays. Neural Comput. Appl. 2017;28:1–14. doi: 10.1007/s00521-016-2305-9. [DOI] [Google Scholar]
- 12.Zhou B., Song Q.K. Boundedness and complete stability of complex-valued neural networks with time delay. IEEE Trans. Neural Netw. Learn. Syst. 2013;24:1227–1238. doi: 10.1109/TNNLS.2013.2247626. [DOI] [PubMed] [Google Scholar]
- 13.Wu E.L., Yang X.S. Adaptive synchronization of coupled nonidentical chaotic systems with complex variables and stochastic perturbations. Nonlinear Dyn. 2016;84:261–269. doi: 10.1007/s11071-015-2433-2. [DOI] [Google Scholar]
- 14.Velmurugan G., Rakkiyappan R., Cao J.D. Further analysis of global μ-stability of complex-valued neural networks with unbounded time-varying delays. Neural Netw. 2015;67:14–27. doi: 10.1016/j.neunet.2015.03.007. [DOI] [PubMed] [Google Scholar]
- 15.Leibniz G.W. Mathematische Schiften. Georg Olms Verlagsbuch-Handlung; Hildesheim, Germany: 1962. pp. 36–63. [Google Scholar]
- 16.Zhang W.W., Cao J.D., Alsaedi A., Alsaadi F.E. New Methods of Finite-Time Synchronization for a Class of Fractional-Order Delayed Neural Networks. Math. Probl. Eng. 2017 doi: 10.1155/2017/1804383. [DOI] [Google Scholar]
- 17.Zhang H., Ye R.Y., Cao J.D., Alsaedie A. Existence and globally asymptotic stability of equilibrium solution for fractional-order hybrid BAM neural networks with distributed delays and impulses. Complexity. 2017 doi: 10.1155/2017/6875874. [DOI] [Google Scholar]
- 18.Zhang W.W., Wu R.C., Cao J.D., Alsaedi A., Hayat T. Synchronization of a class of fractional-order neural networks with multiple time delays by comparison principles. Nonlinear Anal. Model. Control. 2017;22:636–645. [Google Scholar]
- 19.Zhang H., Ye R.Y., Cao J.D., Alsaedie A. Lyapunov functional approach to stability analysis of Riemann-Liouville fractional neural networks with time-varying delays. Asian J. Control. 2017 doi: 10.1002/asjc.1675. [DOI] [Google Scholar]
- 20.Rakkiyappan R., Velmurugan G., Cao J.D. Finite-time stability analysis of fractional-order complex-valued memristor-based neural networks with time delays. Nonlinear Dyn. 2014;78:2823–2836. doi: 10.1007/s11071-014-1628-2. [DOI] [Google Scholar]
- 21.Ding X.S., Cao J.D., Zhao X., Alsaadi F.E. Finite-time Stability of Fractional-order Complex-valued Neural Networks with Time Delays. Neural Process Lett. 2017;46:561–580. doi: 10.1007/s11063-017-9604-8. [DOI] [Google Scholar]
- 22.Rakkiyappan R., Cao J.D., Velmurugan G. Existence and uniform stability analysis of fractional-order complex-valued neural networks with time delays. IEEE Trans. Neural Netw. Learn. Syst. 2015;26:84–97. doi: 10.1109/TNNLS.2014.2311099. [DOI] [PubMed] [Google Scholar]
- 23.Rakkiyappana R., Velmurugana G., Cao J.D. Stability analysis of fractional-order complex-valued neural networks with time delays. Chaos Solitons Fractals. 2015;78:297–316. doi: 10.1016/j.chaos.2015.08.003. [DOI] [Google Scholar]
- 24.Wei H.Z., Li R.X., Chen C.R., Tu Z.W. Stability Analysis of Fractional Order Complex-Valued Memristive Neural Networks with Time Delays. Neural Process Lett. 2016;45:379–399. doi: 10.1007/s11063-016-9531-0. [DOI] [Google Scholar]
- 25.Bao H.B., Park J.H., Cao J.D. Synchronization of fractional-order complex-valued neural networks with time delay. Neural Netw. 2016;81:16–28. doi: 10.1016/j.neunet.2016.05.003. [DOI] [PubMed] [Google Scholar]
- 26.Li X., Wu J. Stability of nonlinear differential systems with state-dependent delayed impulses. Automatica. 2016;64:63–69. doi: 10.1016/j.automatica.2015.10.002. [DOI] [PubMed] [Google Scholar]
- 27.Li X., Song S. Stabilization of Delay Systems: Delay-dependent Impulsive Control. IEEE Trans. Autom. Control. 2017;62:406–411. [Google Scholar]
- 28.Li X., Cao J.D. An impulsive delay inequality involving unbounded time-varying delay and applications. IEEE Trans. Autom. Control. 2017;62:3618–3625. doi: 10.1109/TAC.2017.2669580. [DOI] [Google Scholar]
- 29.Tavazoei M.S., Haeri M. A proof for non existence of periodic solutions in time invariant fractional order systems. Automatica. 2009;45:1886–1890. doi: 10.1016/j.automatica.2009.04.001. [DOI] [Google Scholar]
- 30.Shen J., Lam J. Non-existence of finite-time stable equilibria in fractional-order nonlinear systems. Automatica. 2014;50:547–551. [Google Scholar]
- 31.Hilfer R. Applications of Fractional Calculus in Physics. World Scientic York; Singapore: 2000. pp. 45–74. [Google Scholar]
- 32.Aguila-Camacho N., Duarte-Mermoud M.A., Gallegos J.A. Lyapunov functions for fractional order systems. Commun. Nonlinear Sci. Numer. Simul. 2014;19:2951–2957. doi: 10.1016/j.cnsns.2014.01.022. [DOI] [Google Scholar]
- 33.Liang S., Wu R.C., Chen L.P. Adaptive pinning synchronization in fractional-order uncertain complex dynamical networks with delay. Physica A. 2016;444:49–62. doi: 10.1016/j.physa.2015.10.011. [DOI] [Google Scholar]
















