Abstract
The onset of synchronization in networks of networks is investigated. Specifically, we consider networks of interacting phase oscillators in which the set of oscillators is composed of several distinct populations. The oscillators in a given population are heterogeneous in that their natural frequencies are drawn from a given distribution, and each population has its own such distribution. The coupling among the oscillators is global, however, we permit the coupling strengths between the members of different populations to be separately specified. We determine the critical condition for the onset of coherent collective behavior, and develop the illustrative case in which the oscillator frequencies are drawn from a set of (possibly different) Cauchy-Lorentz distributions. One motivation is drawn from neurobiology, in which the collective dynamics of several interacting populations of oscillators (such as excitatory and inhibitory neurons and glia) are of interest.
In recent years, there has been considerable interest in networks of interacting systems. Researchers have found that an appropriate description of such systems involves an understanding of both the dynamics of the individual oscillators and the connection topology of the network. Investigators studying the latter have found that many complex networks have a modular structure involving motifs [1], communities [2, 3], layers [4], or clusters [5]. For example, recent work has shown that as many kinds of networks (including isotropic homogeneous networks and a class of scale-free networks) transition to full synchronization, they pass through epochs in which well-defined synchronized communities appear and interact with one another [3]. Knowledge of this structure, and the dynamical behavior it supports, informs our understanding of biological [6], social [7], and technological networks [8].
Here we consider the onset of coherent collective behavior in similarly structured systems for which the dynamics of the individual oscillators is simple. In seminal work, Kuramoto analyzed a mathematical model that illuminates the mechanisms by which synchronization arises in a large set of globally-coupled phase oscillators [9]. An important feature of Kuramoto’s model is that the oscillators are heterogeneous in their frequencies. And, although these mathematical results assume global coupling, they have been fruitfully applied to further our understanding of systems of fireflies, arrays of Josephson junctions, electrochemical oscillators, and many other cases [10].
In this work, we study systems of several interacting Kuramoto systems, i.e., networks of interacting populations of phase oscillators. Our motivation is drawn not only from the applications listed above (e.g., an amusing application might be interacting populations of fireflies, where each population inhabits a separate tree), but also from other biological systems. Rhythms arising from coupled cell populations are seen in many of the body’s organs (including the heart, the pancreas, and the kidneys, to name but a few), all of which interact. For example, the circadian rhythm influences many of these systems. We draw additional motivation from consideration of how neuronal tissue is organized. Although we do not consider neuronal systems specifically in this paper, we note that heterogeneous ensembles of neurons often exhibit a “network-of-networks” topology. At the cellular level, populations of particular kinds of neurons (e.g., excitatory neurons) interact not only among themselves, but also with populations of other distinct neuronal types (e.g., inhibitory neurons). At a higher level of organization, various anatomical regions of the brain interact with one another as well [6].
Although our network is simple, it is novel in that we include heterogeneity at several levels. Each population consists of a collection of phase oscillators whose natural frequencies are drawn at random from a given distribution. To allow for heterogenity at the population level, we let each population have its own such frequency distribution. In addition, our system is heterogeneous at the coupling level as well: we consider global coupling such that the coupling strengths between the members of different populations can be separately specified.
The assumpion of global (but population-weighted) coupling permits an analytic determination of the critical condition for the onset of coherent collective behavior, as we will show. While this assumption may not strictly apply in some applications, our results provide insight into the behavior of networks of similar topology even if the connectivity is less than global.
We begin by specifying our model and deriving our main results. We then discuss several illustrative examples.
Consider first a two-species Kuramoto model. We label the separate species θ and φ and assume that there are Nθ and Nφ such oscillators in each population, respectively. Thus, the system equations are
Here, η is an overall coupling strength, the α’s provide additional heterogeneity in the coupling functions, and the matrix
(1) |
defines the connectivity among the populations [11].
For arbitrarily many different species, let σ range over the various population symbols θ, φ, … with the understanding that depending on the context, σ may represent either a label (when subscripted) or a variable. Thus, we have
The ωσi are the constant natural frequencies of the oscillators when uncoupled, and are distributed according to a set of time-independent distribution functions Gσ(ωσ) [12].
We define the usual Kuramoto order parameter for each population, i.e.,
Here, rσ describes the degree of synchronization in each population, and ranges from 0 to 1. Using this, the above equations can be expressed
Assuming that the Nσ are very large, we solve for the onset of coherent collective behavior by using a distribution function approach. Thus, instead of discrete indicies, we imagine continua of oscillators described by distribution functions Fσ(σ, ωσ, t) such that Fσ(σ, ωσ, t)dσdωσ is the fraction of σ-oscillators whose phases and natural frequencies lie in the infinitesimal volume element dσdωσ at time t. Note that in the Nσ → ∞ limit,
and the order parameters are given by
(2) |
In this context, the distribution functions satisfy the equations of continuity, i.e.,
and if we write Fσ(σ, ωσ, t) = fσ(σ, ωσ, t)Gσ(ωσ), we have
(3) |
The incoherent state has σ distributed uniformly over [0, 2π], so that fσ = 1/2π and rσ = 0. These satisfy Eq. (3) trivially. We test the stability of this solution by perturbing it. Note that a perturbation to fσ leads to a perturbation of rσ, and we expect these perturbations to either grow or shrink exponentially in time, depending on the overall coupling strength η. The marginally stable case occurs at a critical value η* at which coherent collective behavior emerges.
Thus, we write fσ = 1/2π + (δfσ)est and rσ = (δrσ)est, where (δfσ) and (δrσ) are small. Inserting the first of these into the continuity equation (Eq. (3)), and keeping only first-order terms, we obtain
The solution to this equation is
(4) |
Consistency demands that the perturbations (δfσ) and (δrσ) be related to each other via the order parameter equation, Eq. (2). This yields our main result, as follows. Eq. (2) becomes
The integral involving 1/2π is zero. Inserting the solution for (δfσ) from Eq. (4), one obtains [13]
Define the bracketed expression to be gσ(s), and define zσ = (δrσ)eiψσ. Then, we have
Now define the complex quantity k̄σσ′ = ηkσσ′e−iασσ′. Using the Kronecker delta δσσ′, the above equation can be written
In matrix notation for the case of two populations labeled θ and φ, this is
(5) |
This equation has a non-trivial solution if the determinant of the matrix is zero. This condition determines the growth rate s in terms of η, k̄σσ′, and the parameters of the distributions Gσ(ωσ) (via gσ(s)).
To illustrate the resulting behavior, we note that gσ(s) can be evaluated in closed form for a Cauchy-Lorentz distribution
(6) |
where Ωσ, the mean frequency of population σ, and the half-width-at-half-maximum Δσ are both real, and Δσ is positive. One obtains
Using this, the determinant condition for the two-population case reduces to
For simplicity, we set the phase angles ασσ′ to zero for the remainder of this paper [14]. In this case, the matrix elements k̄σσ′ are purely real, so that k̄σσ′ = ηkσσ′. The determinant condition then becomes
(7) |
Notice that if η = 0, then s = −Δσ − iΩσ, indicating that the incoherent state is stable for zero coupling (since −Δσ is negative). We imagine increasing (or decreasing) η until s crosses the imaginary axis at a critical value η*. At this point, the incoherent state loses stability and coherent collective behavior emerges in the ensemble. Thus, the critical value η* can be determined from the determinant condition by setting s = iυ, where υ is real (so that the perturbations are marginally stable), and equating the real and imaginary parts of the left side of Eq. (7) to zero. This results in two equations which can be solved simultaneously for the two (real) unknowns η and υ.
For our first example, we choose two identical populations; we set Δθ = Δφ = Δ and Ωθ = Ωφ = Ω. (A more generic example will follow.) Denoting D = det(K) and T = tr(K), we separate the real and imaginary parts of Eq. (7) to obtain
(8) |
One solution to these equations is
which is valid for T2 ≥ 4D, since η is assumed to be real. Notice that the appropriate solution as D → 0 (using the negative sign for T > 0 and the positive sign for T < 0) is
as can be verified by setting D = 0 in Eq. (8) directly. Another solution is
Finally, setting T = 0 in Eq. (8) yields υ* = −Ω and for D < 0, and no solution for D ≥ 0. These results are summarized in Table I.
TABLE I.
Case | Condition | υ* | η * |
---|---|---|---|
1 | T2 > 4D | −Ω | |
2 | T2 ≤ 4D | |
|
3 | D = 0 | −Ω | |
4 | T = 0, D < 0 | −Ω | |
5 | T = 0, D ≥ 0 | no solution | no solution |
Thus, the critical values η* are determined by T, D, and Δ. To illustrate this result, we begin by discussing a particular example. Consider the matrix
which has trace T = 1 and determinant D = 1. This corresponds to case two in Table I, from which we find that η* = 4Δ/T. Fig. 1 shows the results of a numerical simulation of two populations of 10, 000 oscillators each, using Δ = 1. The order parameters rσ versus η are shown, and we can see that the oscillator populations are incoherent for η values below the predicted critical value η* = 4, and that they grow increasingly synchronized as η is increased beyond η*.
Next, we examined eight different connectivity matricies K that were chosen to sample the various regions in T − D space. Table (II) shows these matricies and the corresponding value(s) of η*. These predictions were tested by numerically calculating the order parameters rσ for a range of coupling values η [15]. Results are shown in Fig. 2. The various cases are located by letter in the D − T plane according to the trace and determinant of the matricies, and the corresponding inset shows the numerically-calculated order parameters plotted versus η, with the predicted critical coupling indicated by a vertical line at η = η*. For example, the inset to case A (with (T, D) = (1, 1)) corresponds to Fig. 1, which was discussed above. It can be seen that for all cases, the onset of synchronization occurs as predicted.
Note that more than one prediction for η* may be specified by our analysis (see Table I). The solutions closest to η = 0 are the relevant ones, because we expect the incoherent state to lose stability once the first η* solution is encountered. There are two possible cases depending on the sign of D. First, if the two solutions have the same sign, then there is only one critical value η* (which may be positive or negative depending on the sign of the trace) for the onset of synchronization. This occurs for D > 0 and T ≠ 0, as can be seen in Fig. 2. (Interestingly, for D > 0 and T = 0, synchronization does not occur for any η.) The other case occurs for D < 0, for which the two η* solutions have opposite signs. In this case, there are two critical values η* for the onset of synchronization – one on either side of η= 0. This can also be observed in Fig. 2.
In the more general case in which the various populations have different natural frequency distributions, it is not typically possible to describe the onset of synchronization in terms of the determinant and trace of the coupling matrix K = kσσ′ alone. We now consider this situation, but retain the Cauchy-Lorentz form of the natural frequency distributions for convenience. We manipulate Eq. (7) as follows. Let s = iυ (i.e., purely imaginary, to consider the marginally stable case) and define a = Δθ + i(υ + Ωθ) and b = Δφ + i(υ + Ωφ). We obtain
(9) |
There are two unknowns in this equation: η and υ. Eq. (9) is a quadratic equation in η with complex coefficients, and we can easily obtain two complex solutions η(1,2) as functions of υ. Since the critical values must be real, we solve for the roots of Im(η(1,2)), and evaluate Re(η(1,2)) at these roots. This yields the possible critical values . Typically, these steps must be performed symbolically and/or numerically; we used MATLAB® [16]. As before, the values of that are closest to zero (on either side) are the relevant values.
To illustrate, we choose two populations with Cauchy-Lorentz natural frequency distributions (Eq. (6)) with parameters Δθ = 1, Ωθ = 2, Δφ = 0.5, and Ωφ = 4. We consider the same K matricies as before, i.e., those listed in the second column of Table II. Case E is straightforward; the analysis is illustrated in Fig. (3) and the numerical verification is in Fig. (4). Note that since Eq. (9) has complex coefficients, obtaining η typically involves taking the square root of a complex number. Therefore, one must be mindful of branch cuts when obtaining symbolic and/or numerical solutions. This is important in the analysis for case A, shown in Figs. (5) and (6). Finally, case H, which exhibits no synchronization for identical populations for any value of η, does show synchronization in the present case. The analysis is shown in Figs. (7–8).
TABLE II.
Case | Matrix | T | D | η* |
---|---|---|---|---|
A | |
1 | 1 | 4 |
B | |
−1 | 1 | −4 |
C | |
2 | 0.5 | |
D | |
−2 | 0.5 | |
E | |
1 | −1 | |
F | |
−1 | −1 | |
G | |
0 | −1 | ±2 |
H | |
0 | 1 | None |
We close by giving an example with three different populations. We choose the same Cauchy-Lorentz distributions as above, and add a third with Δρ = 1/3 and Ωρ = 1. We use the following K matrix:
The procedure for deriving η* proceeds as above, except that Eq. (7) is replaced by a third-degree polynomial in η. Fig. (9) shows the imaginary and real parts of the three η solutions. (Note that the branch cuts are more complicated.) The predicted onset of synchronization was verified, as shown in Fig. (10).
Acknowledgments
In conclusion, we have described how to determine the onset of coherent collective behavior in systems of interacting Kuramoto systems, i.e., systems of interacting populations of phase oscillators with both node and coupling heterogeneity. EB was supported by NIH grant R01-MH79502; EO was supported by ONR (Physics) and by NSF grant PHY045624.
References
- 1.Milo R, et al. Science. 2002;298:824–827. doi: 10.1126/science.298.5594.824. [DOI] [PubMed] [Google Scholar]
- 2.Newman MEJ, Girvan M. Phys Rev. 2004;E 69:026113. doi: 10.1103/PhysRevE.69.026113. [DOI] [PubMed] [Google Scholar]
- 3.Arenas A, Díaz-Guilera A, Pérez-Vicente CJ. Phys Rev Lett. 2006;96:114102. doi: 10.1103/PhysRevLett.96.114102. [DOI] [PubMed] [Google Scholar]; Arenas A, Díaz-Guilera A, Pérez-Vicente CJ. Physica D. 2006;224:27–34. [Google Scholar]
- 4.Kurant M, Thiran P. Phys Rev Lett. 2006;96:138701. doi: 10.1103/PhysRevLett.96.138701. [DOI] [PubMed] [Google Scholar]
- 5.Wang X, Huang L, Lai Y-C, Lai CH. Phys Rev. 2007;E 76:056113. doi: 10.1103/PhysRevE.76.056113. [DOI] [PubMed] [Google Scholar]
- 6.Zhou C, Zemanová L, Zamora G, Hilgetag CC, Kurths J. Phys Rev Lett. 2006;97:238103. doi: 10.1103/PhysRevLett.97.238103. [DOI] [PubMed] [Google Scholar]
- 7.Girvan M, Newman MEJ. Proc Natl Acad Sci. 2002;99:7821–7826. doi: 10.1073/pnas.122653799. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Milo R, et al. Science. 2004;303:1538–1542. doi: 10.1126/science.1089167. [DOI] [PubMed] [Google Scholar]
- 9.Kuramoto Y. International Symposium on Mathematical Problems in Theoretical Physics. In: Araki H, editor. Lecture Notes in Physics. Vol. 39. Springer; Berlin: 1975. [Google Scholar]; Chemical Oscillators, Waves and Turbulence. Springer; Berlin: 1984. [Google Scholar]
- 10.Winfree AT. The Geometry of Biological Time. Springer; New York: 1980. [Google Scholar]; Strogatz SH. Physica D. 2000;143:1. [Google Scholar]; Acebrón JA, et al. Rev Mod Phys. 77:137–185. [Google Scholar]; Wiesenfeld K, Swift JW. Phys Rev. 1995;E 51:1020–1025. doi: 10.1103/physreve.51.1020. [DOI] [PubMed] [Google Scholar]; Kiss IZ, Zhai Y, Hudson JL. Science. 2005;296:1676. doi: 10.1126/science.1070757. [DOI] [PubMed] [Google Scholar]
- 11.A similar system of two asymmetrically interacting populations with a particular form of coupling matrix K was considered in Montbrio E, Kurths J, Blasius B. Phys Rev. 2004;E 70:056125. doi: 10.1103/PhysRevE.70.056125. The formulation in the current paper is more general in two important aspects: K is arbitrary, and we allow for any number of interacting populations
- 12.Our system is similar to that studied in Restrepo JG, Ott E, Restrepo JG. Chaos. 2005;16:015107. However, our formulation permits different natural frequency distributions for each population
- 13.The bracketed expression is valid for Re(s) > 0 and may be analytically continued into the region where Re(s) ≤ 0. See Ott E, So P, Barreto E, Antonsen T. Physica D. 2002;173:226–258.Ott E. Chaos in Dynamical Systems. 2. Cambridge University Press; 2002. p. 240.
- 14.Many interesting states require ασσ′ ≠ = 0, such as the chimera state observed in Abrams DM, Strogatz SH. Int J Bif Chaos. 2006;16(1):21–37.
- 15.Simulations used fourth-order Runge-Kutta with a timestep of 0.01 seconds, N = 10, 000 or 50, 000, and parameters as noted. The system was initialized in the incoherent state and an initial transient was discarded. The order parameters were then averaged over the subsequent 10 seconds. Because the standard deviations over this interval were small, no error bars were plotted.
- 16.MATLAB®, The MathWorks, Inc., Natick, MA (http://www.mathworks.com/).