Abstract
There has been much interest in understanding collective dynamics in networks of brain regions due to their role in behavior and cognitive function. Here we show that a simple, homogeneous system of densely connected oscillators, representing the aggregate activity of local brain regions, can exhibit a rich variety of dynamical patterns emerging via spontaneous breaking of permutation or translational symmetries. Upon removing just a few connections, we observe a striking departure from the mean-field limit in terms of the collective dynamics, which implies that the sparsity of these networks may have very important consequences. Our results suggest that the origins of some of the complicated activity patterns seen in the brain may be understood even with simple connection topologies.
Collective dynamics of coupled oscillators, in particular, synchronization1, is integral to many natural phenomena2 and is especially important for several biological processes3,4,5, such as brain function6,7,8,9,10. While very large-scale synchronization of neuronal activity is considered pathological, as in epilepsy11, the brain is capable of exhibiting a variety of complex spatiotemporal excitation patterns that may play a crucial role in information processing12. Understanding the dynamics of these patterns at the scale of the entire brain (imaged using techniques such as fMRI) is of fundamental importance13. As detailed simulation of each individual neuron in the brain is computationally expensive,14,15 when studying the dynamics of the entire system it is useful to focus on the network of interactions between brain regions. It has also been explicitly shown that the collective response of a large number of connected excitatory and inhibitory neurons, which constitute such regions, can be much simpler than the dynamics of individual neurons16. Indeed, each region can be described using phenomenological models in terms of a few aggregate variables17.
Using anatomical and physiological data collected over several decades, the networks of brain regions for different animals have been reconstructed18,19,20, where the individual nodes correspond to large assemblies (103–106) of neurons21,22. The connectivity C (i.e., fraction of realized links) of these networks (C ~ 10−1) is significantly higher than that among neurons (C ~ 10−6)23,24. A schematic representation of a network of the Macaque brain regions (adapted from a recent study20; see Methods for more details) is shown in Fig. 1(a). The collective activity of such networks can result in complicated nodal dynamics, including temporal oscillations at several scales that are known to be functionally relevant10,25,26. Each of these nodes can be described using neural field models of localized neuronal population activity, which can have varying mathematical complexity and biological realism27,28,29. Here, we use the well-known and pioneering model proposed by Wilson and Cowan (WC)30,31 to describe the activity of each brain region.
The complex collective dynamics obtained using this model for the Macaque network, shown in Fig. 1(b), are reminiscent of experimentally recorded activity of brain regions10. The range of behaviors observed in this system at different connection strengths [Fig. 1(c,d)], can arise from an interplay of several factors, which makes their analysis difficult. A possible approach to understand the genesis of these patterns is to focus on the dynamics of nodes interacting in the simplified setting of a homogeneous, globally coupled system, which is an idealization of the densely connected network.
In this article we show that this simple system exhibits an unexpectedly rich variety of complex phenomena, despite lacking the detailed topological features of brain networks [e.g., Fig. 1(a)], such as heterogeneity in degree (number of connections per node) and modular organization. In particular, we show the existence of novel collective states, including those characterized by oscillator clusters, where each cluster is distinguished by its amplitude or frequency. The occurrence of such clusters is surprising as each node is identical in terms of both intrinsic dynamics and connectivity, indicating that the homogeneous system of oscillators undergoes spontaneous symmetry breaking. In addition we observe patterns where the time-series for all oscillators are identical except for a non-zero phase difference between groups of exactly synchronized elements that we refer to as “phase clusters”. On removing a few links from the network while preserving the structural symmetry of connections we observe even more striking situations such as the appearance of many (>2) clusters having different amplitudes. Moreover, oscillator death (i.e., termination of oscillations upon coupling), which is seen over a substantial region of parameter space in the fully connected system, occurs in a drastically reduced region for such marginally sparse networks. As the behavior of a large, densely connected system is effectively identical to that of the corresponding mean-field model, it is remarkable that the dynamical properties of the system considered here are radically altered in response to extremely minor deviations from the fully connected situation.
Results
We first examine the collective dynamics of a pair of coupled oscillators (N = 2) as a function of the interaction strength w between them. Figure 2(a,b) show that while exact synchronization (ES) of oscillator dynamics occurs at weak coupling (), a state of anti-phase synchronization (APS) is observed at higher values of w (). For intermediate w, the co-existence of the dominant frequencies corresponding to ES and APS states [Fig. 2(c)] indicates that the quasi-periodic (QP) behavior observed in this regime can be interpreted as arising through competition between the mechanisms responsible for the above two states. At w ~ 11, the system undergoes spontaneous symmetry-breaking, eventually giving rise to inhomogeneous in-phase synchronization (IIS), characterized by different phase space projections and distinct amplitudes for the time-series of each oscillator [Fig. 2(a,b), last panel]. The nature of the transition from APS to IIS is made explicit in Fig. 2(d) [top panel], where the excitatory components (u1,2) of the fixed points of the system, obtained using numerical root finding, are shown over a range of w. At w ≈ 10.943, a pair of heterogeneous unstable solutions related by permutation symmetry, corresponding to an inhomogeneous steady-state (ISS), emerge from a homogeneous unstable solution, beyond which all three solutions coexist. Thus, spontaneous symmetry breaking appears to arise in the system through a subcritical pitchfork bifurcation, with the number of positive eigenvalues corresponding to the homogeneous solution decreasing by unity (not shown). The ISS is stable over a very small range, , as seen from their corresponding eigenvalues in Fig. 2(d) [lower panel]. Note that stability is lost on either end of this interval through supercritical Hopf bifurcations (see Supplemental Material). For , both oscillators converge to the inactive state ui = vi = 0 ∀i, corresponding to amplitude death (AD, not shown).
Increasing the number of oscillators, we observe that while the patterns seen for a pair of coupled oscillators, namely ES, QP, ISS, IIS, APS and AD persist (first four shown in Fig. 3(a,b) for N = 20) qualitatively different states also emerge as shown in the phase diagram in Fig. 3(c). As mentioned earlier, a new class of patterns characterized by the existence of phase clusters appears. The most robust of these, referred to as gradient synchronization (GS), has ncl ~ N clusters with distinct phases. Note that APS, which for N > 2 has a very small basin of attraction, is a phase cluster state for which ncl = 2. Another new pattern comprises two oscillator clusters, each characterized by a unique frequency [Fig. 3(d)]. This constitutes a dramatic instance of spontaneous breaking of permutation symmetry, as the oscillators are intrinsically indistinguishable for this completely homogeneous system. Thus, the appearance of multiple frequencies in a dynamical network need not imply heterogeneity in connectivity or node properties. A third new pattern is a homogeneous steady state referred to as oscillator death (OD), in which the individual nodes have the same time-invariant, non-zero activity. This dynamical state appears over a large region in (w,N)-space as seen in the phase diagram, Fig. 3(c). To identify and segregate the regimes in this diagram, we use several order parameters (see Methods for details, and the table in the Supplemental Material for a summary). A system with a small number of oscillators can show multistability, i.e., different initial conditions may converge to distinct dynamical regimes for identical parameter values, close to the boundary between two regimes. Thus, we identify the regime to which a point in the (w, N)-space belongs as the one to which a majority (>50%) of the initial conditions converge. However, as N increases the regions showing such multistability shrinks, as shown by the finite-size scaling of the ES-QP boundary [Fig. 3(e)] that decreases as .
As a first step towards extending the results seen for the globally coupled system to brain networks of the type shown in Fig. 1(a), we have investigated the consequences of gradually decreasing the connection density (see Methods for details). In addition to preserving degree homogeneity, our method ensures that every node has the same neighborhood structure [Fig. 4(a)]. As we deviate from the global coupling limit, we observe patterns similar to those shown in Fig. 3(a–d), although the precise form of the attractors may differ and it is now the translational symmetry that is being spontaneously broken. For example, as seen in Fig. 4(b), a reduction of just 2 links per node causes the trajectory in the IIS state to split into many more (~N) projections than seen for the fully connected case (~2). Also, while the phase diagram of the system remains qualitatively unchanged when the degree is decreased from kmax = N − 1, there is a dramatic quantitative reduction in the area corresponding to OD [Fig. 4(c)] even with the reduction of one link per node. This is surprising, as one would expect that a marginal deviation from the global coupling limit in large systems will not result in a perceptible change from the mean-field behavior.
As it is well-known that the incorporation of time delays can qualitatively change the observed patterns in dynamical systems32 (including neural oscillators33,34), and can impact their stability35, we have also simulated a system of globally coupled oscillators incorporating a delay in each of the links (see Methods for more details). We observe that while the precise nature of the synchronization pattern changes on the introduction of delay, the patterns observed fall under the same qualitative categories as those described above (see Supplemental Material). Intriguingly, it would appear that a small amount of delay tends to suppress the complexity of collective dynamics by enhancing the likelihood of exact synchronization being observed, even at strong coupling strengths. However, complicated patterns re-emerge as the delays get longer.
Discussion
An important implication of this study follows from our demonstration that systems with simple connection topology are capable of exhibiting very rich dynamical behavior. In particular, many of the patterns seen in our simulations of the network of Macaque brain regions (Fig. 1) resemble those observed using much simpler connectivity schemes (Fig. 3). Hence, patterns seen in complex systems that are often attributed to their non-trivial connection structure, may in fact be independent of the details of the network architecture.
Our result that weakening connections between nodes of a network can increase coherence in collective activity (viz., observation of ES at low w) suggests an intriguing relation between two recent experimental findings: (i) anaesthetic-induced loss of consciousness occurs through the progressive disruption of communication between brain areas36 and (ii) functional connectivity networks reconstructed from EEG data become increasingly dense with the development of fatigue in sleep-deprived subjects37,38. The latter study finds that the onset of sleep is accompanied by an increase in the degree of synchronization between brain areas, while the former result implies that the interaction strengths between these areas will concurrently get weaker. Although it may appear counter-intuitive that decreased coupling strength would result in increased synchronization, our findings illustrate that these results are not incompatible.
With the availability of high-resolution data and increased computational power, it is now possible to model brain networks incorporating a higher level of realistic detail14. Nevertheless even simple phenomenological models on coarse-grained brain-region networks may provide insights into mesoscale phenomena, such as those observed in fMRI and EEG experiments. Our findings provide a baseline for future investigations of the specific role of the detailed aspects (such as degree heterogeneity or modular architecture) of brain networks on their collective dynamics. Indeed, a preliminary study into the role of node heterogeneity (in terms of the application of external stimulus) indicates that a rich variety of novel effects, such as coupling-induced oscillations, can be observed. To conclude, we have shown that the collective dynamics of a homogeneous system of oscillators, motivated by mesoscopic descriptions of brain activity, exhibits spontaneous symmetry breaking that gives rise to several novel patterns. Despite preserving the structural symmetry of connections, a marginal increase in the network sparsity, corresponding to an extremely small deviation from the mean-field, unexpectedly changes the robustness of certain patterns. Our results suggest that some of the complicated activity patterns seen in the brain can be explained even with simple connection topologies.
Methods
Nodal dynamics
The model we consider comprises a network of N oscillators, each described by the WC model whose dynamics results from interactions between an excitatory and an inhibitory neuronal subpopulation. The average activity of each node i (ui, vi) evolves as:
where and represent the total input to the two subpopulations respectively. The time constants and external stimuli for the subpopulations are indicated by τu,v and respectively, while cμν (μ, ν = u, v) corresponds to the strength of interactions within and between the subpopulations of a node. The interaction strengths are represented by the weight matrices and the summation Σ′ is over all network neighbors (for a globally coupled system, ). The function has a sigmoidal dependence on z, with κμ = 1 − [1 + exp(aμθμ)]−1. The parameter values have been chosen such that each isolated node (Wμν = 0) is in the oscillatory regime, viz., au = 1.3, θu = 4, av = 2, θv = 3.7, cuu = 16, cuv = 12, cvu = 15, cvv = 3, ru = 1, rv = 1, τu = 8, τv = 8, and . For the homogeneous systems considered here the links all have same strength, i.e., (μ, ν = u, v) and i(≠ j) = 1, …, N; , where k is the degree of a node. In order to investigate the effect of incorporating a delay d in the coupling term, we modify the summation term in and to , where and are the activation and inhibition variables of node j at a time instant t − d prior to the current time t.
The dynamical system (Eq. 1) is numerically solved using an adaptive-step Runge-Kutta integration scheme for different system sizes (N) and coupling strengths (w). Linear stability analysis is used to determine the stability of some of the patterns and identify the associated bifurcations. The behavior of the system for each set (w, N) is analyzed over many (~100) randomly chosen initial conditions. We have explicitly verified that our results are robust with respect to small variations in the parameters.
Network topology
We use the model outlined above to describe the excitatory-inhibitory dynamics at each node of a network. The resulting synchronization patterns are investigated for three distinct network topologies: (i) Globally coupled networks of N nodes, in which each node is (bi-directionally) connected to every other node in the network, excluding itself. (ii) Sparse, symmetric networks, characterized by nodes with identical connection topologies. Sparsity is systematically introduced through a degree reduction that preserves as many of the existing symmetries as possible. To do this, we arrange the nodes on a circle and sequentially remove connections between nodes placed furthest apart. (iii) A realistic network comprising 266 nodes describing the anatomical connectivity between different regions of the Macaque brain. The network we have used here is a reduced version of that presented in a recent study20 in that only those brain regions that cannot be further hierarchically subdivided have been considered. This is to avoid redundancies that arise from the fact that several of the nodes in the network of ref. 20 are actually anatomical subdivisions of other nodes. Hence, by only considering nodes at the lowest hierarchical level, we avoid the possibility that the network contains multiple links that describe the same anatomical connection. We have identified the community organization of this network using a partitioning algorithm39 that segregates it into five modules (comprising 71, 60, 54, 42 and 39 nodes, respectively).
Order parameters
The different synchronization patterns are classified through the use of order parameters as follows. The mean of the oscillation amplitude, measured as the variance (σ2) with respect to time of one of the WC variables, v, averaged over all the nodes , is zero for all the non-oscillating states AD, OD and ISS. These are further distinguished by using the mean and variance with respect to all nodes of the time-averaged v, i.e., 〈〈vi〉t〉i (= 0 for AD) and (= 0 for OD and AD). Note that the order parameter captures aspects of symmetry-breaking, as non-zero values indicate that different oscillators exhibit qualitatively distinct dynamics despite being identical. To distinguish between the oscillating patterns, we consider the mean coherence, measured as , and the total space occupied by all the trajectory projections Δ, as measured by the number of non-zero bins of their histogram in (u, v)-space. ES is characterized by and IIS by . The remaining patterns, GS and QP, are distinguished by Δ being considerably larger for QP. Note that 〈〉t and 〈〉i represent averaging over time and all nodes, respectively. In practice, different regimes are characterized by thresholds whose specific values do not affect the qualitative nature of the results.
Additional Information
How to cite this article: Singh, R. et al. Complex patterns arise through spontaneous symmetry breaking in dense homogeneous networks of neural oscillators. Sci. Rep. 6, 22074; doi: 10.1038/srep22074 (2016).
Supplementary Material
Acknowledgments
We thank Raghavendra Singh, Purusattam Ray, Gautam Menon, Varsha Sreenivasan, V. Sasidevan and K. A. Chandrashekar for helpful discussions. We thank IMSc for providing access to the “Annapurna” supercomputer. This research was supported in part by the IMSc Complex Systems Project.
Footnotes
Author Contributions R.S., S.N.M. and S.S. conceived and designed the experiment(s), R.S. and S.N.M. performed the experiments, R.S., S.N.M. and S.S. analysed the data, R.S., S.N.M. and S.S. wrote the paper. All authors reviewed the manuscript.
References
- Pikovsky A., Rosenblum M. & Kurths J. Synchronization (Cambridge University Press, Cambridge, England, 2003). [Google Scholar]
- Acebrón J. A. et al. The Kuramoto model: A simple paradigm for synchronization phenomena. Rev. Mod. Phys. 77, 137 (2005). [Google Scholar]
- Glass L. Synchronization and rhythmic processes in physiology. Nature 410, 277 (2001). [DOI] [PubMed] [Google Scholar]
- Gillette M. U. & Sejnowski T. J. Biological clocks coordinately keep life on time. Science 309, 1196 (2005). [DOI] [PubMed] [Google Scholar]
- Singh R. et al. Self-organized transition to coherent activity in disordered media. Phys. Rev. Lett. 108, 068102 (2012). [DOI] [PubMed] [Google Scholar]
- Engel A. K., Fries P. & Singer W. Dynamic predictions: Oscillations and synchrony in top–down processing. Nature Rev. Neurosci. 2, 704 (2001). [DOI] [PubMed] [Google Scholar]
- Rabinovich M. I., Varona P., Selverston A. I. & Abarbanel H. D. I. Dynamical principles in neuroscience. Rev. Mod. Phys. 78, 1213 (2006). [Google Scholar]
- Olmi S., Politi A. & Torcini A. Collective chaos in pulse-coupled neural networks. Europhys. Lett. 92, 60007 (2010). [Google Scholar]
- Steyn-Ross M. L., Steyn-Ross D. A. & Sleigh J. W. Interacting Turing-Hopf instabilities drive symmetry-breaking transitions in a mean-field model of the cortex: A mechanism for the slow oscillation. Phys. Rev. X 3, 021005 (2013). [Google Scholar]
- Buzsáki G. & Draguhn A. Neuronal oscillations in cortical networks. Science 304, 1926 (2004). [DOI] [PubMed] [Google Scholar]
- Kandel E. R., Schwartz J. H. & Jessell T. M. Principles of Neural Science (McGraw-Hill, New York, 4th edition, 2000). [Google Scholar]
- Singer W. Synchronization of cortical activity and its putative role in information processing and learning. Ann. Rev. Physiol. 55, 349 (1993). [DOI] [PubMed] [Google Scholar]
- Bressler S. L. & Menon V. Large-scale brain networks in cognition: emerging methods and principles. Trends Cogn. Sci. 14, 277 (2010). [DOI] [PubMed] [Google Scholar]
- Markram H. The blue brain project. Nature Rev. Neurosci. 7, 153 (2006). [DOI] [PubMed] [Google Scholar]
- Zhou C., Zemanová L., Zamora G., Hilgetag C. C. & Kurths J. Hierarchical organization unveiled by functional connectivity in complex brain networks. Phys. Rev. Lett. 97, 238103 (2006). [DOI] [PubMed] [Google Scholar]
- van Vreeswijk C. & Sompolinsky H. Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274, 1724 (1996). [DOI] [PubMed] [Google Scholar]
- Deco G., Jirsa V. K., Robinson P. A., Breakspear M. & Friston K. The dynamic brain: from spiking neurons to neural masses and cortical fields. PLoS Comput. Biol. 4, e1000092 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Scannell J. W., Blakemore C. & Young M. P. Analysis of connectivity in the cat cerebral cortex. J. Neurosci. 15, 1463 (1995). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hagmann P. et al. Mapping the structural core of human cerebral cortex. PLoS Biol. 6, e159 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Modha D. S. & Singh R. Network architecture of the long-distance pathways in the macaque brain. Proc. Natl. Acad. Sci. USA 107, 13485 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Palm G. Cell assemblies, coherence, and corticohippocampal interplay. Hippocampus 3, 219 (1993). [PubMed] [Google Scholar]
- Johansson C. & Lansner A. Towards cortex sized artificial neural systems. Neural Networks 20, 48 (2007). [DOI] [PubMed] [Google Scholar]
- Shepherd G. M. (Ed.), The Synaptic Organization of the Brain (Oxford University Press, New York, 4th edition, 2003). [Google Scholar]
- Morris R. Theories of Hippocampal Function in The Hippocampus Book (Eds. Andersen P. et al.) (Oxford University Press, Oxford, 2007). [Google Scholar]
- Schnitzler A. & Gross J. Normal and pathological oscillatory communication in the brain. Nature Rev. Neurosci. 6, 285 (2005). [DOI] [PubMed] [Google Scholar]
- Uhlhaas P. J. & Singer W. Abnormal neural oscillations and synchrony in schizophrenia. Nature Rev. Neurosci. 11, 100 (2010). [DOI] [PubMed] [Google Scholar]
- Jansen B. H. & Rit V. G. Electroencephalogram and visual evoked potential generation in a mathematical model of coupled cortical columns. Biol. Cybern. 73, 357 (1995). [DOI] [PubMed] [Google Scholar]
- Honey C. J., Kotter R., Breakspear M. & Sporns O. Network structure of cerebral cortex shapes functional connectivity on multiple time scales. Proc. Natl. Acad. Sci. USA 104, 10240 (2007). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marten F., Rodrigues S., Benjamin O., Richardson M. P. & Terry J. R. Onset of polyspike complexes in a mean-field model of human electroencephalography and its application to absence epilepsy. Phil. Trans. R. Soc. A 367, 1145 (2009). [DOI] [PubMed] [Google Scholar]
- Wilson H. R. & Cowan J. D. Excitatory and inhibitory interactions in localized populations of model neurons. Biophys. J. 12, 1 (1972). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Destexhe A. & Sejnowski T. J. The Wilson–Cowan model, 36 years later. Biol. Cybern. 101, 1 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stephen Yeung M. K. & Strogatz S. H. Time delay in the Kuramoto model of coupled oscillators. Phys. Rev. Lett. 82, 648 (1999). [Google Scholar]
- Roxin A., Brunel N. & Hansel D. Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. Phys. Rev. Lett. 94, 238103 (2005). [DOI] [PubMed] [Google Scholar]
- Deco G., Jirsa V., McIntosh A. R., Sporns O. & Kötter R. Key role of coupling, delay, and noise in resting brain fluctuations. Proc. Natl. Acad. Sci. USA 106, 10302 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dhamala M., Jirsa V. K. & Ding M. Enhancement of neural synchrony by time delay. Phys. Rev. Lett. 92, 074104 (2004). [DOI] [PubMed] [Google Scholar]
- Lewis L. D. et al. Rapid fragmentation of neuronal networks at the onset of propofol-induced unconsciousness. Proc. Natl. Acad. Sci. USA 109, E3377 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kar S., Routray A. & Nayak B. P. Functional network changes associated with sleep deprivation and fatigue during simulated driving: validation using blood biomarkers. Clin. Neurophysiol. 122, 966 (2011). [DOI] [PubMed] [Google Scholar]
- Chu C. J. et al. Emergence of stable functional networks in long-term human electroencephalography. J. Neurosci. 32, 2703 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leicht E. A. & Newman M. E. J. Community Structure in Directed Networks. Phys. Rev. Lett. 100, 118703 (2008). [DOI] [PubMed] [Google Scholar]
- Bastian M., Heymann S. & Jacomy M., Gephi: an open source software for exploring and manipulating networks. Int. AAAI Conf. Weblogs & Social Media, Vol. 2. (AAAI Press, Menlo Park, CA, 2009).
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.