Skip to main content
Cognitive Neurodynamics logoLink to Cognitive Neurodynamics
. 2020 Mar 6;14(3):359–374. doi: 10.1007/s11571-020-09575-9

Multiple bifurcations and coexistence in an inertial two-neuron system with multiple delays

Zigen Song 1, Bin Zhen 2,, Dongpo Hu 3
PMCID: PMC7203331  PMID: 32399077

Abstract

In this paper, we construct an inertial two-neuron system with multiple delays, which is described by three first-order delayed differential equations. The neural system presents dynamical coexistence with equilibria, periodic orbits, and even quasi-periodic behavior by employing multiple types of bifurcations. To this end, the pitchfork bifurcation of trivial equilibrium is analyzed firstly by using center manifold reduction and normal form method. The system presents different sequences of supercritical and subcritical pitchfork bifurcations. Further, the nontrivial equilibrium bifurcated from trivial equilibrium presents a secondary pitchfork bifurcation. The system exhibits stable coexistence of multiple equilibria. Using the pitchfork bifurcation curves, we divide the parameter plane into different regions, corresponding to different number of equilibria. To obtain the effect of time delays on system dynamical behaviors, we analyze equilibrium stability employing characteristic equation of the system. By the Hopf bifurcation, the system illustrates a periodic orbit near the trivial equilibrium. We give the stability regions in the delayed plane to illustrate stability switching. The neural system is illustrated to have Hopf–Hopf bifurcation points. The coexistence with two periodic orbits is presented near these bifurcation points. Finally, we present some mixed dynamical coexistence. The system has a stable coexistence with periodic orbit and equilibrium near the pitchfork–Hopf bifurcation point. Moreover, multiple frequencies of the system induce the presentation of quasi-periodic behavior. The system presents stable coexistence with two periodic orbits and one quasi-periodic behavior.

Keywords: Neural system, Inertial term, Time delay, Coexistence, Multiple bifurcations, Quasi-periodic behavior

Introduction

In recent decades, dynamical behaviors such as stability and bifurcation of neural networks have received much more attention since Hopfield (1984) proposed a simplified neural model. Most of mathematical models of neurons are presented by first-order differential equation such as Hopfield neural system, Cohen–Grossberg neural system (Ozcan 2019), and cellular neural system (Mani et al. 2019), which have been applied in many research fields such as associative memory, secure communication, and signal processing. In fact, artificial neural networks are usually constructed by simulating biological neural systems, for example Hodgkin–Huxley model (Wang et al. 2018; Wu et al. 2013), Chay model (Jia et al. 2017; Zhu et al. 2019) and Hindmarsh–Rose model (Hu and Cao 2016; Mondal et al. 2019). The mathematical model of neural node is very important to dynamical behavior of whole network system (Ma et al. 2019; Qu and Wang 2017). To further approximate biological neuron, some researchers introduced inductance term into artificial neural model (Badcock and Westervelt 1987). In reality, the membrane activity of a hair cell can be represented by the equivalent circuit having an inductance (Angelaki and Correia 1991). The squid axon was described as containing a phenomenological inductance (Mauro et al. 1970). The neuron system was modeled by a circuit system containing inertial term. The output of a neuron with inertial term is connected to its input via an RLC (resistance–inductance–capacitance) circuit. Further, the aim of the presented paper is to show how the dynamical behavior might be affected when an inertial term is added to the standard Hopfield equation.

Moreover, time delay is very important in real neural systems because of their finite switching speed. Some delayed inertial neural systems were presented to analyze their dynamical behaviors (Gu and Zhao 2015). For example, the delayed inertial one-neural system (Liu et al. 2009; He et al. 2012) was considered to study its stability, bifurcation, and even chaotic behavior (Li et al. 2004). For the delayed inertial two-neuron system, (Liu et al. 2009) focused on the equilibrium stability and Hopf bifurcation. Dong et al. (2012) illustrated a two-equilibrium coexistence, periodic orbit, and even quasi-periodic behavior by analyzing the Hopf–pitchfork bifurcation. Song and Xu (2014) presented a delayed inertial system with two neurons to analyze its stability switching and Bogdanov–Takens bifurcation. Further, Ge and Xu (2018) constructed a delayed inertial system with four neurons to study the fold-Hopf bifurcation (Ge and Xu 2015) and Hopf–Hopf bifurcation (Ge and Xu 2013). Recently, multistability coexistence was illustrated in a delayed inertial two-neuron system (Song et al. 2016). The neural system presented some stable coexistences with multi-type activity patterns such as two equilibria, multiple periodic orbits, and even quasi-periodic spiking by different bifurcation routes (Song et al. 2015a, b). Further, when the neural activation function was chosen as the Crespi function, the delayed inertial two-neuron system exhibited three chaotic attractors through the period-doubling and quasi-periodic bifurcations (Yao et al. 2019).

However, most works focused on analyzing the dynamics of the delayed inertial neural system described by two-, four-, and even eight-order differential equations. In fact, Wheeler and Schieve (1997) constructed a two-neuron system by adding inertial term into one of neurons. The neural system was presented by three first-order differential equations. Zhao et al. (2012) introduced time delay into the inertial two-neuron system and discussed in detail the equilibrium stability and Hopf bifurcation. Following the mentioned references, in this paper, we introduce self- and cross-interaction delays into the inertial two-neuron system. The mathematical model is presented by three first-order delayed differential equations. We focus on analyzing the stable coexistence with multiple equilibria, periodic orbits, and even quasi-periodic behavior. In fact, multiple coexistence is one of the most important dynamical behaviors in biological and artificial neural networks (Song et al. 2015a, b). It should be noticed that the similar two-neuron system without inertial term has been proposed in Song et al. (2019). The system has the same number of equilibrium points, but the different static bifurcation sequences. Further, in this paper, we will find that the inertial term induces a mixed dynamics coexistence including the coexistence of one periodic orbit and two equilibria, the coexistence of two periodic orbits and one quasi-periodic behavior. On the other hand, two inertial terms are introduced in two-neuron coupling system. The system just exhibits the coexistence of two equilibria and one periodic orbit by the pitchfork–Hopf bifurcation (Song et al. 2016).

The delayed inertial two-neuron system considered in the paper is described by the following equation:

x˙1(t)=x2(t),x˙2(t)=-kx2(t)-x1(t)+c1f(x1(t-τ1))+c2f(y1(t-τ2)),y˙1(t)=-y1(t)+c1f(y1(t-τ1))+c2f(x1(t-τ2)), 1

where x1(t) and y1(t) denote neural activities at time t, x2(t) is derivative of x1(t), k>0 is a damping factor, τ1, τ2>0 describe time delays of self- and cross-interaction, c1 and c2 are coupled weighs for inhibition (ci<0) and excitation (ci>0), the activation function is f(x)=tanh(x).

This paper is organized as follows. In Sect. 2, multiple pitchfork bifurcations of trivial and nontrivial equilibria are analyzed. Employing center manifold reduction and normal form method, we find that the neural system (1) illustrates multiple bifurcation sequences with supercritical and subcritical pitchfork bifurcations. Using these pitchfork bifurcation curves, we give the detail parameter regions with the different number of system’s equilibrium. In Sect. 3, we analyze time delays on equilibrium’s stability. With time delay increase, the neural system can repeatedly switches its stability by the forward and reverse Hopf bifurcation, which is called the stability switching. In Sect. 4, we give stability regions. The Hopf–Hopf bifurcation points are illustrated by the Hopf bifurcation curves. The neural system presents two-coexisting periodic orbits. In Sect. 5, through theoretical analysis and numerical simulation, we present some mixed dynamics coexistence, such as the coexistence of one periodic orbit and two equilibria, the coexistence of two periodic orbits and one quasi-periodic behavior. Conclusion is provided in Sect. 6.

Multi-pitchfork bifurcations of trivial/nontrivial equilibria

Bifurcation is one of the most important dynamics in the behavior analysis of neural network system (Guan et al. 2019; Wang and Zhu 2016; Zhang et al. 2019). The pitchfork bifurcation can lead neural system to have a new pair of stable equilibria, which can be used as the static retrievable memory. Nakajima and Ikegami (2010) proposed a dynamical model to interpret the crossed-hand deficit of temporal order judgment (TOJ) from the pitchfork bifurcation analysis. Further, the coexistence of two stable equilibria provides a great flexibility in system function. Multiple coexistence of resting state is important for applications in content-addressable memory, pattern recognition and automatic control (Huang and Cao 2010; Nie et al. 2013).

In this section, to get the number of equilibria in system (1), we will analyze the static bifurcations using center manifold reduction and normal form method. However, the center manifold reduction of the delayed dynamical system is too complicated to be understand. Further, time delay cannot affect the number of equilibria. So, in the following section, we just analyze static bifurcations of the delay-free system. The stability of the equilibrium will be proposed in the next section by the Hopf bifurcation. The results show that the neural system has different bifurcation sequences of supercritical and subcritical pitchfork bifurcations. Further, the nontrivial equilibrium bifurcated from the trivial equilibrium presents a secondary pitchfork bifurcation. The system illustrates a coexistence with multiple equilibria. The delay-free neural system is

x˙1=x2,x˙2=-kx2-x1+c1f(x1)+c2f(y1),y˙1=-y1+c1f(y1)+c2f(x1). 2

Obviously, (0, 0, 0) is the trivial equilibrium of system (2). The characteristic equation of the linearized system at (0, 0, 0) is

λ3+(1+k-c1)λ2+(1+k)(1-c1)λ+(c1-1)2-c22=0. 3

System (2) presents a static bifurcation if the eigenvalue passes through the imaginary axis along real axis. Therefore, letting λ=0 in (3), we have

(c1-1)2-c22=0. 4

Equation (4) is called as the bifurcation set, where c1 and c2 can be regarded as bifurcation parameters. In the following, we analyze the bifurcation types (supercritical or subcritical) to show the system’s equilibrium by center manifold reduction and normal form method. To this end, firstly, regard c2 as the bifurcation parameter for the fixed parameter c1. The corresponding bifurcation points are c2=c1-1 and c2=1-c1. Let c2=c2+ε in system (2), where ε is the unfolding parameter, one has

Theorem 1

Neural system (2) presents a subcritical pitchfork bifurcation at the bifurcation pointc2=c1-1and a supercritical pitchfork bifurcation atc2=1-c1. The corresponding normal form systems are

z˙1=-21+kεz1-23(1+k)z13+,ε˙=0, 5

forc2=c1-1and

z˙1=21+kεz1-23(1+k)z13+,ε˙=0, 6

forc2=1-c1, respectively.

Proof

Let c2=c2=c1-1 in (3). The characteristic equation is simplified to

λ(λ2+(1+k-c1)λ+(1+k)(1-c1))=0. 7

The eigenvalues are

λ1=0,λ2,3=-c1-k-1±Δ2, 8

where Δ=c12+2(c1+k-3)(1+k). The corresponding eigenvector is

v1=-101,v2=c1-1c1-1+kλ2+λ22(c1-1)λ2c1-1+kλ2+λ221,v3=c1-1c1-1+kλ3+λ32(c1-1)λ3c1-1+kλ3+λ321. 9

Submitting c2=c2+ε into (2) and applying Taylor expansion, one has the following system

x˙1=x2,x˙2=(c1-1)x1-kx2+(c1-1+ε)y1-c13x13-c1-1+ε3y13+,y˙1=(c1-1+ε)x1+(c1-1)y1-c1-1+ε3x13-c13y13+,ε˙=0. 10

Let

x1x2y1=Tz1z2z3,

where

T=-1c1-1c1-1+kλ2+λ22c1-1c1-1+kλ3+λ320(c1-1)λ2c1-1+kλ2+λ22(c1-1)λ3c1-1+kλ3+λ32111.

System (10) is transformed into the following standard form, which is

z˙1=0z1+f1,z˙2=λ2z2+f2,z˙3=λ3z3+f3,ε˙=0, 11

where

f1=m1εz1+m2εz2+m3εz3+m13z13+m2z12z2+m3z12z3+m4z1z22+m5z1z2z3+m6z1z32+m7z23+m8z22z3+m9z2z32+m10z33+,f2=n1εz1+n2εz2+n3εz3+n13z13+n4z12z2+n5z12z3+n6z1z22+n7z1z2z3+n8z1z32+n9z23+n10z22z3+n11z2z32+n12z33+,f3=q1εz1+q2εz2+q3εz3+q13z13+q4z12z2+q5z12z3+q6z1z22+q7z1z2z3+q8z1z32+q9z23+q10z22z3+q11z2z32+q12z33+,

and

m1=-21+k,m2=3-3c1-k-Δ2(c1-1)(1+k),m3=3-3c1-k+Δ2(c1-1)(1+k),m4=-2(1-2k+(c1+k)2)+2(c1-1+k)Δ(1+k)(c1-1+k-Δ)2,m5=2(2-c1)(c1-1)(1+k),m6=-2(1-2k+(c1+k)(c1+k+δ))-δ(1+k)(c1-1+k+Δ).

The expressions of other coefficients (i.e., mi,i=7,,10 and nj,qj,j=1,,12) are too complicated to be presented. Assume the center manifold of system (11) as

Wc(0)=(z1,z2,z3,ε)R4|z2=h2(z1,ε),z3=h3(z1,ε),|z1|<δ1,|ε|<δ2,hi(0,0)=0,Dhi(0,0)=0,i=2,3,

where

z2=h2(z1,ε)=r1z12+r2z1ε+r3ε2+,z3=h3(z1,ε)=s1z12+s2z1ε+s3ε2+, 12

and δ1 and δ2 are small. We let

DH(0·z1+f1)-BH-L=0, 13

where D is the differential operator, and

B=λ200λ3,H=h2h3,L=f2f3.

Substituting (12) into (13), we have the coefficients of (12). Then neural system (2) can be transformed into (5), which is the normal form of the pitchfork bifurcation at c2=c1-1. By the same computation process, the normal form system for c2=1-c1 is shown as (6). This completes the proof.

On the other hand, if c1 is regarded as the bifurcation parameter for the fixed c2 , we obtain the bifurcation points c1=1-c2 and c1=1+c2, respectively. Similarly, let c1=c1+ε, where ε is the unfolding parameter, we have

Theorem 2

Neural system (2) presents two supercritical pitchfork bifurcations at the bifurcation pointsc1=1-c2andc1=1+c2, respectively. The corresponding normal form systems are all

z˙1=21+kεz1-23(1+k)z13+,ε˙=0. 14

It follows that system (2) presents the different types of pitchfork bifurcations. Regarding c2 as the bifurcation parameter, we obtain the supercritical and subcritical pitchfork bifurcations in system (2) . For example, choosing k=1, one has the pitchfork bifurcation points c2=c1-1=6 and c2=1-c1=6 for c1=-5. By theorem 1, the pitchfork bifurcation is subcritical for c2=-6 and supercritical for c2=6. The bifurcation diagrams are shown in Fig. 1. It implies that neural system (2.1) firstly presents the subcritical, and then supercritical pitchfork bifurcations, as shown in Figs. 1a, b. However, if we choose c1=5, the subcritical pitchfork bifurcation point is c2=c1-1=4 and the supercritical pitchfork bifurcation is c2=1-c1=4 . That is, neural system (2) firstly presents the supercritical, and then the subcritical pitchfork bifurcation, as shown in Figs.1c, d.

Fig. 1.

Fig. 1

The bifurcation diagrams with c2 variation show the subcritical and supercritical pitchfork bifurcations for a, bc1=-5 and c, dc1=5 in system (2)

On the other hand, if c1 is regarded as the bifurcation parameter for the fixed parameter c2=5, one has the pitchfork bifurcation points c1=1-c2=-4 and c1=1+c2=6. Further, it follows from theorem 2 that these bifurcation are all supercritical. The bifurcation diagrams are exhibited in Fig. 2a, b. The neural system (2) has the first supercritical pitchfork bifurcation at c1=-4. The single trivial equilibrium (0, 0, 0) bifurcates into three equilibria. Increasing c1 to pass through c1=6, system (2) exhibits the second supercritical pitchfork bifurcation, as shown in Fig. 2b. The trivial equilibrium generates another two equilibria. Neural system (2) illustrates a bifurcation sequence with two supercritical pitchfork bifurcations.

Fig. 2.

Fig. 2

The bifurcation diagrams with c1 variation show the supercritical pitchfork bifurcation ac1=1-c2=-4 and bc1=1+c2=6 with c2=5 in system (2)

Now, we will show a new pitchfork bifurcation of the nontrivial equilibria. In fact, neural system (2) presents the nontrivial equilibrium (x10,0,y10) satisfied with the dynamic nullclines x10=c1f(x10)+c2f(y10) and y10=c1f(y10)+c2f(x10). By u1=x1-x10, u2=x2, u3=y1-y10, one has the linearizing system

u˙1=u2,u˙2=-ku2-u1+c1P1u1+c2P2u3,u˙3=-u3+c1P2u3+c2P1u1, 15

where P1=1-tanh2(x10), P2=1-tanh2(y10) The characteristic equation is

λ3+(1+k-c1P2)λ2+(1+k-c1P1-c1kP2)λ+(c1P1-1)(c1P2-1)-c22P1P2=0. 16

Neural system (2) presents a pitchfork bifurcation at (x10,0,y10) when the following condition is valid, which is

Q(c1)=(c1P1-1)(c1P2-1)-c22P1P2=0, 17

where P1 and P2 are the function of x10 and y10. The pitchfork bifurcation point cannot be obtained by theoretical expression since (17) is a transcendental equation. So, we just give some numerical results for the given parameters in system (2). As the above section, we regard c1 as the bifurcation parameter for the fixed c2 with k=1. The neural system (2) presents two bifurcations when the bifurcation parameter c1 passes through the second supercritical pitchfork bifurcation, i.e., c1>c1=6. It follows from Fig. 3a that Q(c1)=0 has three roots, i.e., c1=-4, 6 and 6.99917. In fact, the critical values c1=-4,6 are the pitchfork bifurcation points corresponded to the equilibrium (0, 0, 0). The third root c1=6.99917 corresponds to the bifurcation of the nontrivial equilibrium. The bifurcation diagram with c1 varying is illustrated in Fig. 3b. The nontrivial equilibria bifurcated from the second pitchfork bifurcation present simultaneously two supercritical pitchfork bifurcations.

Fig. 3.

Fig. 3

a The function Q(c1)=0, b bifurcation diagram shows the pitchfork bifurcations of the trivial/nontrivial equilibria with a12=1, a21=0.6

Lastly, we illustrate the pitchfork bifurcation curves to show the dynamical classification of equilibrium’s number in (c1,c2)-plane. The figure is shown in Fig. 4. In region D1, system (2) just illustrates a stable equilibrium (0, 0, 0). When the parameters enter into region D2 or D3, system (2) exhibits three equilibria through the pitchfork bifurcation. Further, neural system (2) obtains a new pair of nontrivial equilibrium when the parameters enter into region D4 or D5, which is divided by the second pitchfork bifurcation curve. In region D6, system (2) possesses nine equilibria through adding two pairs of new nontrivial equilibria, which is a new pitchfork bifurcation of the nontrivial equilibrium.

Fig. 4.

Fig. 4

The classification of the number of system’s equilibrium in the (c1,c2)-plane by multiple pitchfork bifurcation curves of system (2) with k=1, where the nullcline curves x10=c1f(x10)+c2f(y10) and y10=c1f(y10)+c2f(x10) show the number of equilibria

Hopf bifurcation and periodic orbit

In what follows, we analyze the effect of time delays on the equilibrium’s stability. The neural system exhibits a periodic orbit by the Hopf bifurcation of trivial equilibrium. The linearized system near the trivial equilibrium is

x˙1(t)=x2(t),x˙2(t)=-kx2(t)-x1(t)+c1x1(t-τ1)+c2y1(t-τ2),y˙1(t)=-y1(t)+c1y1(t-τ1)+c2x1(t-τ2), 18

The corresponding characteristic equation is

c1e-λτ1-12-c22e-2λτ2+(1+k)(1-c1e-λτ1)λ+(1+k-c1e-λτ1)λ2+λ3=0. 19

The equilibrium is stable if all eigenvalues have negative real parts. So, we firstly present the basic condition for τ1=0 and τ2=0 in (19), where the trivial equilibrium is stable. The characteristic equation is simplified to

(c1-1)2-c22+(1+k)(1-c1)λ+(1+k-c1)λ2+λ3=0. 20

Applying the Routh-Hurwitz criterion, we have necessary and sufficient conditions of the stable trivial equilibrium, which is

1+k-c1>0or(1+k)(1-c1)>0,(c1-1)2-c22>0,c22+(1-c1)(k+2-c1)k>0. 21

By k>0 in system (1), the basic condition is simplified into

1-c1>0and(c1-1)2>c22. 22

Time delays τ1 and τ2 can induce the trivial equilibrium to instability. To analyze its stability and obtain the stability region, we regard τ2 as a bifurcation parameter for the fixed τ1. Assuming (19) has a pure imaginary root λ=iω,ω>0, one has

1-2c1e-iωτ1+c12e-2iωτ1-c22e-2iωτ2+i1+k-c1e-iωτ1ω-1+k-c1e-iωτ1ω2-iω3=0, 23

Separating real and imaginary parts, we have

1-ω2-kω2+(c1ω2-2c1)cosωτ1+c12cos2ωτ1-(c1ω+kc1ω)sinωτ1-c22cos2ωτ2=0,ω+kω-ω3-(c1ω+kc1ω)cosωτ1-c12sin2ωτ1+(2c1-c1ω2)sinωτ1+c22sin2ωτ2=0. 24

Eliminating τ2 from (24) produces

cos2ωτ2=1-(1+k)ω2+c1-2+ω2cosωτ1+c1cos2ωτ1-(1+k)ωsinωτ1c22,sin2ωτ2=ω3-(1+k)ω+(1+k)c1ωcosωτ1+c1ω2-2+2c1cosωτ1sinωτ1c22. 25

Using cos22ωτ2+sin22ωτ2=1, one has

L(ω)=1-(1+k)ω2+c1-2+ω2cosωτ1+c1cos2ωτ1-(1+k)ωsinωτ12+ω3-(1+k)ω+(1+k)c1ωcosωτ1+c1ω2-2+2c1cosωτ1sinωτ12c24=0, 26

Supposing (26) exhibits some positive roots ωi,i=1,2,, one obtains some critical values of stability region, which is

τ2i,j=φi+2jπωi,i=1,2,;j=0,1,2,, 27

where φi[0,2π). Define

τ20=min{τ2i,0:i=1,2,}. 28

Differentiating λ with τ2 in (19), one checks the transversality condition, i.e., the eigenvalue passes through the imaginary axis with non-zero velocity

λ(τ2)=-2c22λe2λτ2(1+k+2kλ+2λ+3λ2)-2c12e2λ(τ2-τ1)τ1+2c22τ2+c1eλ(2τ2-τ1)((2+λ(1+k+λ))τ1-1-k-2λ). 29

Therefore, employing the Hopf bifurcation theory, one has

Theorem 3

With the basic conditions1-c1>0and(c1-1)2>c22, the equilibrium (0, 0, 0) is asymptotically stable for arbitraryτ2when (26) has no positive root. Further, when (26) has at least two positive and simple rootsωi,i=1,2,, there exist a finite number of delay intervals, in which the equilibrium (0, 0, 0) is asymptotically stable. That is to say, the neural system presents stability switching with delay increase.

For example, we choose k=1,c1=-2,c2=-1. System (1) just has the equilibrium (0, 0, 0). When time delay τ1=0.3, the equation L(ω)=0 has no positive root. The equilibrium (0, 0, 0) is locally asymptotically stable for arbitrary τ2. Time delay τ2 cannot induce the equilibrium to instability. The time histories are exhibited with small delay τ2=1 (Fig. 5a) and large delay τ2=10 (Fig. 5b). The system trajectories evolve and enter into the equilibrium (0, 0, 0). Further, if time delay τ1 increases to 0.5, it follows from (26) that L(ω)=0 has two different roots, i.e., ω1=1.454 and ω2=1.6541. Submitting ω1 and ω2 into (27), one has two series of values of time delay, that is τ21,j=2.0346,4.1954,6.3562, and τ22,j=1.0607,2.9599,4.859,. The equilibrium (0, 0, 0) presents the stability switching with delay increase. In fact, when τ2(0,1.0607), system (1) has a stable trivial equilibrium (0, 0, 0). Time history is shown in Fig. 6a for τ2=0.5 . The trajectory evolves into the equilibrium (0, 0, 0). When delay passes through the critical value τ22,0=1.0607 , the equilibrium (0, 0, 0) loses its stability by Hopf bifurcation with frequency ω2. It follows form Fig. 6b that the system presents a stable periodic orbit. Due to the existence of two roots, i.e., ω1 and ω2, the stable periodic orbit will disappear by the reverse Hopf bifurcation with frequency ω1. The trivial equilibrium (0, 0, 0) regains its stability. Time history is shown in Fig. 6c for τ2=2.5. Furthermore, the stable trivial equilibrium will lose its stability if the delay passes through τ22,1=2.9599. The system re-exhibits a stable periodic orbit, as shown in Fig. 6d. In such way, system (1) multi-switches its stability with delay increase, which is called as the stability switching. The corresponding eigenvalues are shown in Fig. 7a for τ1=0.3 and Fig. 7b for τ1=0.5.

Fig. 5.

Fig. 5

Time histories in system (1) for aτ2=1 and (b) τ2=10 with k=1,c1=-2,c2=-1 and τ1=0.3

Fig. 6.

Fig. 6

Time histories with aτ2=0.5, bτ2=1.5, cτ2=2.5, and dτ2=3.5 show the stability switching for k=1,c1=-2,c2=-1 and τ1=0.5

Fig. 7.

Fig. 7

The real parts of system eigenvalues with τ2 increase: aτ1=0.3 and bτ1=0.5. The other parameters are k=1,c1=-2,c2=-1

Hopf–Hopf bifurcation and periodic coexistence

We have analyzed the effect of time delays on stability of trivial equilibrium. It follows that the equilibrium (0, 0, 0) of the system repeatedly loses and retrieves its stability with delay increase. In this section, we will show the Hopf bifurcation curves and give some Hopf–Hopf bifurcation points. Further, some special dynamical behaviors, such as two-coexisting periodic orbits are exhibited near the Hopf–Hopf bifurcation points.

In fact, for each τ1, by (27), one obtains the Hopf bifurcation curves, i.e., τ21,j, τ22,j(j=0,1,2,) in the (τ1,τ2)-plane, as shown in Fig. 8 with k=1,c1=-2,c2=-1. The plane is divided into some regions by the equilibrium’s stability criterion. It should be noticed that the Hopf bifurcation curves have some intersection points H-H in Fig. 8. The corresponding coordinates are (τ1,τ2)=(0.7074,4.9759),(0.5774,6.7731) and (0.5191, 8.653) for the first few points. In fact, two pairs of eigenvalues with maximum real part have pure imaginary, which is called as the Hopf–Hopf bifurcations. By the Hopf–Hopf bifurcation theory, we obtain that system (1) illustrates the stable coexistence with two periodic orbits due to the frequencies ω1 and ω2. Using the Matlab package tool DDE-BIFTOOL, we can further give the parameter regions of stable coexistence, as shown in Fig. 8. The enlargement is shown in Fig.9, where T denotes the appearance and disappearance of the two-coexisting periodic orbits.

Fig. 8.

Fig. 8

Hopf bifurcation curves τ21,j, τ22,j(j=0,1,2,) presented in (τ1,τ2)-plane illustrate the Hopf–Hopf bifurcation points (H-H) for k=1,c1=-2,c2=-1

Fig. 9.

Fig. 9

The parameter regions of the two-coexisting periodic orbits near the first two Hopf–Hopf bifurcation points, where T denotes the appearance and disappearance curves of the regions

In what follows, we will give some numerical simulations to illustrate the corresponding dynamical behaviors. It follows from Fig. 10 that the equilibrium (0, 0, 0) shown in Fig. 10a evolves into a periodic orbit shown in Fig. 10b, c through Hopf bifurcation with frequency ω2 . On the other hand, the system present a long and narrow periodic orbit (as shown in Fig. 10e, f) by the Hopf bifurcation with frequency ω1. Furthermore, the periodic orbits generated from the different Hopf bifurcation will be encountered in a small region of time delay. The system exhibits the stable coexistence with two periodic orbits, as shown in Fig. 10d for (τ1,τ2)=(0.8,5.29) with initial conditions (1, 0, 1) and (-1,0,1). Similarly, system (1) presents the two-periodic coexistence for other Hopf–Hopf bifurcation points, as shown in Fig. 11 for (τ1,τ2)=(0.8,7.79) and (0.8, 10.3) with initial conditions (1, 0, 1) and (-1,0,1). It follows from Fig. 11 that two coexisting periodic orbits repeatedly change their shapes from oval to long and narrow with delay increase.

Fig. 10.

Fig. 10

Phase portraits near (τ1,τ2)=(0.7074,4.9759) show the system dynamical behaviors for the fixed delays a (0.6, 4.8), b (0.6, 5.2), c (0.8, 5.4), d (0.8, 5.29), e (0.8, 4.6), and f (0.6, 4.4) with k=1,c1=-2,c2=-1

Fig. 11.

Fig. 11

Phase portraits near the second and third Hopf–Hopf bifurcation points show two-coexisting periodic orbits for the fixed delays a (0.8, 7.79) and b (0.8, 10.3) with k=1,c1=-2,c2=-1

The mixed dynamical coexistence

In above section, we present the stable coexistence of two periodic orbits near the Hopf–Hopf bifurcation points. In fact, the typical dynamical behaviors of system include equilibrium, periodic orbit, and even quasi-periodic behavior. So, in what follows, we will illustrate some mixed dynamical coexistence, such as the coexistence of two equilibria and one periodic orbit, the coexistence of two periodic orbits and one quasi-periodic behavior.

For this purpose, firstly, we choose c2 and τ2 as the variable parameters to obtain the pitchfork–Hopf bifurcation for k=1,c1=-1, and τ1=1. It follows from theorem 1 that the pitchfork bifurcations are c2=c1-1=-2 and c2=1-c1=2. The Hopf bifurcation curve represented by c2 and τ2 can be obtained by (27), as shown in Fig. 12a for c2=2. There exists an intersection point coordinated as (c2,τ2)=(2,0.5525) for the pitchfork and Hopf bifurcation curves. Similar dynamical behaviors can be exhibited for c2=-2. The eigenvalues are illustrated in Fig. 12b with c2 increase. It follows that ω2 evolves to zero and ω1 maintains a positive when c2 increases and passes through the pitchfork bifurcation point c2=2. The result shows that the intersection is a pitchfork–Hopf bifurcation point. In the following, we will choose some fixed parameters (c2,τ2) to illustrate the mixed dynamical coexistence with two equilibria and one periodic orbit by time histories. The detail parameter values are shown in Fig. 12a.

Fig. 12.

Fig. 12

a Hopf and pitchfork bifurcation curves show the pitchfork–Hopf bifurcation point, b evolution of frequencies ω1 and ω2 with c2 increase for the system parameter values k=1,c1=-1,τ1=1

It follows from Fig. 13a that time history for (c2,τ2)=(1.8,0.2) is converged into the trivial equilibrium. Fixed c2=1.8 and increased τ2=1.0, time delay crosses through the Hopf bifurcation curve. The system obtains a periodic orbit near the trivial equilibrium, as shown in Fig. 13b. Further, when c2 passes through the pitchfork bifurcation curve, the neural system gets two stable nontrivial equilibria bifurcated from the trivial equilibrium. The time history is illustrated in Fig. 13d for (c2,τ2)=(2.2,0.2). The trajectories for initial conditions (1, 0, 1) and (-1,0,-1) evolve into the different nontrivial equilibria. Further, choosing c2=2.2 and varying τ2=0.7, we present a stable coexistence with one periodic orbit and two equilibria, as shown in Fig. 13c for initial condition (1, 0, 1), (-1,0,-1) and (1,0,-1). The phase portraits in x1-x2 and x1-y1 are illustrated in Fig. 14 for a clear presentation.

Fig. 13.

Fig. 13

Time histories for the fixed (c2,τ2)a (1.8, 0.2), b (1.8, 1.0), c (2.2, 0.7), d (2.2, 0.2) show the dynamical behavior near the pitchfork–Hopf bifurcation point with k=1,c1=-1 and τ1=1

Fig. 14.

Fig. 14

Phase portraits show the mixed dynamical coexistence in the different plane ax1-y1 and bx1-x2 for (c2,τ2)=(2.2,0.7) with k=1,c1=-1 and τ1=1

At the end of this paper, we present a more complex coexistence with some mixed dynamical behaviors including two periodic orbits and one quasi-periodic behavior. The system is chosen as k=1,c1=-2,c2=-1 and τ1=10. The phase portraits are shown in Fig. 15. Firstly, system (1) just exhibits a long and narrow periodic orbit for τ2=1 shown in Fig. 15a. With delay increasing to τ2=2, there is a new oval periodic orbit shown in Fig. 15b. The neural system exhibits a stable coexistence with two periodic orbits, where initial conditions are chosen as (1, 0, 1) and (-1,0,1), respectively. Due to multiple frequencies, the long and narrow periodic orbit loses its stability and enters into a quasi-periodic behavior. The phase portrait is illustrated in Fig. 15c for delay τ2=3. Neural system (1) presents a mixed dynamical coexistence with one periodic orbit and one quasi-periodic behavior, where initial conditions are fixed as (1, 0, 1) and (-1,0,1).

Fig. 15.

Fig. 15

Phase portraits show the complex coexistence for aτ2=1, bτ2=2, cτ2=3, dτ2=3.89, eτ2=4.5, and fτ2=6 with k=1,c1=-1,c2=-2, and τ1=10

Further, when delay is chosen as τ2=3.89, system (1) presents a more complex coexistence with two periodic orbits and one quasi-periodic behavior, as shown in Fig. 15d for initial conditions (1, 0, 1), (-1,0,1) and (2, 0, 2), respectively. The oval periodic orbit loses its stability and the system presents the mixed dynamical coexistence with a long and narrow periodic orbit and quasi-periodic behavior, as shown in Fig. 15e for τ2=4.5, where initial conditions are chosen as (1, 0, 1) and (-1,0,1). Lastly, the quasi-periodic behavior evolves into a periodic orbit for τ2=6. The neural system retrieves two-coexisting with a long and narrow periodic orbit and an oval periodic orbit. The phase portraits are illustrated in Fig. 15f for initial conditions (1, 0, 1) and (-1,0,1). It follows that the oval periodic orbit shown in Fig. 15f is just evolved from the long and narrow periodic orbit presented in Fig. 15b. To obtain a detail evolution of the dynamical behaviors, we illustrate the bifurcation diagram employing Poincáre sections x˙2=0, as shown in Fig. 16. The system presents the mixed dynamical coexistence with two periodic orbits and one quasi-periodic behavior in a long parameter region of delay τ2, where Fig. 16b is a Poincáre map for τ2=4 shown a quasi-periodic behavior.

Fig. 16.

Fig. 16

The bifurcation diagram obtained by Poincáre sections x˙2=0 shows the complex coexistence for the fixed parameters k=1,c1=-1,c2=-2, and τ1=10, where (b) is a Poincáre map for τ2=4 denoted quasi-periodic behavior

Conclusion

Stable coexistence with different kinds of attractors is one of the most important dynamical properties in both biological and artificial neural systems. In this paper, we introduced self- and cross-interaction delays into an inertial two-neuron system presented by three first-order delayed differential equations. The system illustrated some coexistence patterns with equilibria, periodic orbits, and even quasi-periodic behavior. We firstly illustrated the coexistence with multiple equilibria through the pitchfork bifurcation sequences of the trivial/nontrivial equilibrium. By center manifold reduction and normal form method, we found the different bifurcation sequences of the supercritical and subcritical pitchfork bifurcations. The nontrivial equilibrium bifurcated from the trivial equilibrium presents the secondary pitchfork bifurcation. The system exhibits a stable coexistence with multiple equilibria. Using all pitchfork bifurcation curves, we obtained the detail regions, where the neural system has the different number of equilibrium.

We further analyzed the stability of the equilibrium (0, 0, 0) and found a periodic orbit. By the Hopf bifurcation curves, we presented the stability regions and exhibited the stability switching. The neural system lost and regained its stability through the forward and reverse Hopf bifurcation with time delay increase. Because of the multiple frequencies, the neural system illustrated a stable coexistence with two periodic orbits in the region of the Hopf–Hopf bifurcation points. Moreover, we illustrated the mixed dynamical coexistence with one periodic orbit and two equilibria in the region of the pitchfork–Hopf bifurcation point. Further, the neural system exhibited a stable coexistence including two periodic orbits and one quasi-periodic behavior.

Acknowledgements

This research is supported by the National Natural Science Foundation of China under Grant Nos. 11672177, 11672185, NSF of Shandong Province under Grant No. ZR2018BF018 and China Postdoctoral Science Foundation under Grant No. 2019M652349.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Zigen Song, Email: zigensong@163.com.

Bin Zhen, Email: zhenbin80@163.com.

Dongpo Hu, Email: hudongpo2006@126.com.

References

  1. Angelaki DE, Correia MJ. Models of membrane resonance in pigeon semicircular canal type II hair cells. Biol Cybern. 1991;65:1–10. doi: 10.1007/BF00197284. [DOI] [PubMed] [Google Scholar]
  2. Badcock KL, Westervelt RM. Dynamics of simple electronic neural networks. Phys D. 1987;28:305–316. doi: 10.1016/0167-2789(87)90021-2. [DOI] [Google Scholar]
  3. Dong T, Liao XF, Huang TW, Li HQ. Hopf–pitchfork bifurcation in an inertial two-neuron system with time delay. Neurocomputing. 2012;97:223–232. doi: 10.1016/j.neucom.2012.06.008. [DOI] [Google Scholar]
  4. Ge JH, Xu J. Stability switches and fold-Hopf bifurcations in an inertial four-neuron network model with coupling delay. Neurocomputing. 2013;110:70–79. doi: 10.1016/j.neucom.2012.08.048. [DOI] [Google Scholar]
  5. Ge JH, Xu J. Double Hopf bifurcation in a four-neuron delayed system with inertial terms. Nonlinear Dyn. 2015;82:1969–1978. doi: 10.1007/s11071-015-2291-y. [DOI] [Google Scholar]
  6. Ge JH, Xu J. Stability and Hopf bifurcation on four-neuron neural networks with inertia and multiple delays. Neurocomputing. 2018;287:34–44. doi: 10.1016/j.neucom.2018.01.081. [DOI] [Google Scholar]
  7. Gu H, Zhao Z. Dynamics of time delay-induced multiple synchronous behaviors in inhibitory coupled neurons. PLoS One. 2015;10:e0138593. doi: 10.1371/journal.pone.0138593. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Guan L, Jia B, Gu H. A novel threshold across which the negative stimulation evokes action potential near a saddle-node bifurcation in a neuronal model with I-h current. Int J Bifurc Chaos. 2019;29:1950198. doi: 10.1142/S0218127419501980. [DOI] [Google Scholar]
  9. He X, Li C, Shu Y. Bogdanov–Takens bifurcation in a single inertial neuron model with delay. Neurocomputing. 2012;89:193–201. doi: 10.1016/j.neucom.2012.02.019. [DOI] [Google Scholar]
  10. Hopfield JJ. Neurons with graded response have collective computational properties like those of two-state neurons. Proc Natl Acad USA. 1984;81:3088–3092. doi: 10.1073/pnas.81.10.3088. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Hu DP, Cao HJ. Stability and Hopf bifurcation analysis in Hindmarsh–Rose neuron model with multiple time delays. Int J Bifurc Chaos. 2016;26:1650187. doi: 10.1142/S021812741650187X. [DOI] [Google Scholar]
  12. Huang G, Cao J. Delay-dependent multistability in recurrent neural networks. Neural Netw. 2010;23:201–209. doi: 10.1016/j.neunet.2009.10.004. [DOI] [PubMed] [Google Scholar]
  13. Jia B, Gu HG, Xue L. A basic bifurcation structure from bursting to spiking of injured nerve fibers in a two-dimensional parameter space. Cogn Neurodyn. 2017;11:189–200. doi: 10.1007/s11571-017-9422-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Li CG, Chen GR, Liao XF, Yu JB. Hopf bifurcation and chaos in a single inertial neuron model with time delays. Eur Phys J B. 2004;41:337–343. doi: 10.1140/epjb/e2004-00327-2. [DOI] [Google Scholar]
  15. Liu Q, Liao XF, Guo ST, Wu Y. Stability of bifurcating periodic solutions for a single delayed inertial neuron model under periodic excitation. Nonlinear Anal Real World Appl. 2009;10:2384–2395. doi: 10.1016/j.nonrwa.2008.04.025. [DOI] [Google Scholar]
  16. Liu Q, Liao XF, Liu Y, Zhou S, Guo S. Dynamics of an inertial two-neuron system with time delay. Nonlinear Dyn. 2009;58:573–609. doi: 10.1007/s11071-009-9503-2. [DOI] [Google Scholar]
  17. Ma J, Yang ZQ, Yang LJ, Tang J. A physical view of computational neurodynamics. J Zhejiang Univ Sci A (Appl Phys Eng) 2019;20:639–659. doi: 10.1631/jzus.A1900273. [DOI] [Google Scholar]
  18. Mani P, Rajan R, Shanmugam L, Joo YH. Adaptive control for fractional order induced chaotic fuzzy cellular neural networks and its application to image encryption. Inform Sci. 2019;491:74–89. doi: 10.1016/j.ins.2019.04.007. [DOI] [Google Scholar]
  19. Mauro A, Conti F, Dodge F, Schor R. Subthreshold behavior and phenomenological impedance of the squid giant axon. J Gen Physiol. 1970;55:497–523. doi: 10.1085/jgp.55.4.497. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Mondal A, Upadhyay RK, Ma J, Yadav BK, Sharma SK, Mondal A. Bifurcation analysis and diverse firing activities of a modified excitable neuron model. Cogn Neurodyn. 2019;13:393–407. doi: 10.1007/s11571-019-09526-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Nakajima K, Ikegami T. Dynamical systems interpretation of reversal of subjective temporal order due to arm crossing. Adapt Behav. 2010;18:189–210. doi: 10.1177/1059712310375470. [DOI] [Google Scholar]
  22. Nie X, Cao J, Fei S. Multistability and instability of delayed competitive neural networks with nondecreasing piecewise linear activation functions. Neurocomputing. 2013;119:281–291. doi: 10.1016/j.neucom.2013.03.030. [DOI] [Google Scholar]
  23. Ozcan N. Stability analysis of Cohen–Grossberg neural networks of neutral-type: multiple delays case. Neural Netw. 2019;113:20–27. doi: 10.1016/j.neunet.2019.01.017. [DOI] [PubMed] [Google Scholar]
  24. Qu J, Wang RB. Collective behavior of large-scale neural networks with GPU acceleration. Cogn Neurodyn. 2017;11:553–563. doi: 10.1007/s11571-017-9446-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Song ZG, Xu J. Stability switches and Bogdanov–Takens bifurcation in an inertial two-neurons coupling system with multiple delays. Sci China Technol Sci. 2014;57:893–904. doi: 10.1007/s11431-014-5536-y. [DOI] [Google Scholar]
  26. Song ZG, Xu J, Zhen B. Multitype activity coexistence in an inertial two-neuron system with multiple delays. Int J Bifurc Chaos. 2015;25:1530040. doi: 10.1142/S0218127415300402. [DOI] [Google Scholar]
  27. Song ZG, Yang K, Xu J, Wei YC. Multiple pitchfork bifurcations and multiperiodicity coexistences in a delay-coupled neural oscillator system with inhibitory-to-inhibitory connection. Commun Nonlinear Sci Numer Simul. 2015;29:327–345. doi: 10.1016/j.cnsns.2015.05.013. [DOI] [Google Scholar]
  28. Song ZG, Wang CH, Zhen B. Codimension-two bifurcation and multistability coexistence in an inertial two-neuron system with multiple delays. Nonlinear Dyn. 2016;85:2099–2113. doi: 10.1007/s11071-016-2816-z. [DOI] [Google Scholar]
  29. Song ZG, Qian WG, Zhen B, Kong XH. Multiple bifurcations and periodic coexistence in a delayed Hopfield two-neural system with a monotonic activation function. Adv Differ Equ. 2019;167:1–18. [Google Scholar]
  30. Wang R, Zhu Y. Can the activities of the large-scale cortical network be expressed by neural energy? A brief review. Cogn Neurodyn. 2016;10:1–5. doi: 10.1007/s11571-015-9354-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Wang RB, Wang ZY, Zhu ZY. The essence of neuronal activity from the consistency of two different neuron models. Nonlinear Dyn. 2018;92:973–982. doi: 10.1007/s11071-018-4103-7. [DOI] [Google Scholar]
  32. Wheeler DW, Schieve WC. Stability and chaos in an inertial two-neuron system. Phys D. 1997;105:267–284. doi: 10.1016/S0167-2789(97)00008-0. [DOI] [Google Scholar]
  33. Wu Y, Li J, Liu S, Pang J, Du M, Lin P. Noise-induced spatiotemporal patterns in Hodgkin–Huxley neuronal network. Cogn Neurodyn. 2013;7:431–440. doi: 10.1007/s11571-013-9245-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Yao S, Ding L, Song Z, Xu J. Two bifurcation routes to multiple chaotic coexistence in an inertial two-neural system with time delay. Nonlinear Dyn. 2019;95:1549–1563. doi: 10.1007/s11071-018-4643-x. [DOI] [Google Scholar]
  35. Zhang X, Gu H, Wu F. Memristor reduces conduction failure of action potentials along axon with Hopf bifurcation. Eur Phys J Spec Top. 2019;228:2053–2063. doi: 10.1140/epjst/e2019-900004-2. [DOI] [Google Scholar]
  36. Zhao HY, Yu XH, Wang L. Bifurcation and control in an inertial two-neuron system with time delays. Int J Bifurc Chaos. 2012;22:1250036. doi: 10.1142/S0218127412500368. [DOI] [Google Scholar]
  37. Zhu FY, Wang RB, Pan XC, Zhu ZY. Energy expenditure computation of a single bursting neuron. Cogn Neurodyn. 2019;13:75–87. doi: 10.1007/s11571-018-9503-3. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Cognitive Neurodynamics are provided here courtesy of Springer Science+Business Media B.V.

RESOURCES