Significance
Short-term synaptic plasticity contributes to the balance and regulation of brain networks from milliseconds to several minutes. In this paper we report the existence of a route to chaos in the Tsodyks and Markram model of short-term synaptic plasticity. The chaotic region corresponds to what in mathematics is called Shilnikov chaos, an unstable manifold that strongly modifies the shape of trajectories and induces highly irregular transient dynamics, even in the absence of noise. The interplay between the Shilnikov chaos and stochastic effects may give rise to some of the complex dynamics observed in neural systems such as transitions between up and down states.
Keywords: brain oscillations, chaotic dynamics, Shilnikov homoclinic orbit, cerebral cortex
Abstract
Short-term synaptic plasticity strongly affects the neural dynamics of cortical networks. The Tsodyks and Markram (TM) model for short-term synaptic plasticity accurately accounts for a wide range of physiological responses at different types of cortical synapses. Here, we report a route to chaotic behavior via a Shilnikov homoclinic bifurcation that dynamically organizes some of the responses in the TM model. In particular, the presence of such a homoclinic bifurcation strongly affects the shape of the trajectories in the phase space and induces highly irregular transient dynamics; indeed, in the vicinity of the Shilnikov homoclinic bifurcation, the number of population spikes and their precise timing are unpredictable and highly sensitive to the initial conditions. Such an irregular deterministic dynamics has its counterpart in stochastic/network versions of the TM model: The existence of the Shilnikov homoclinic bifurcation generates complex and irregular spiking patterns and—acting as a sort of springboard—facilitates transitions between the down-state and unstable periodic orbits. The interplay between the (deterministic) homoclinic bifurcation and stochastic effects may give rise to some of the complex dynamics observed in neural systems.
Short-term synaptic plasticity (STSP) is a temporal increase or decrease of synaptic strength in response to use, modulating the efficacy of synaptic transmission on timescales from a few milliseconds to several minutes (1–3). Short-term variations of the synaptic efficacy directly affect the timing and integration of presynaptic inputs to postsynaptic neurons, thereby affecting network-level dynamics and influencing brain function. Synaptic depression, an activity-regulatory mechanism that performs gain control (4), reduces cortical responses to strong stimuli (5). Recurrent cortical circuits in the presence of synaptic depression work as nonlinear adaptive filters in the visual system, with long response latencies for low-contrast stimuli and short latencies for high-contrast stimuli (6). Synaptic depression affects the responses of individual neurons and also the correlations of neural populations and the population accuracy for coding signals (7). Finally, working memory can be implemented through STSP using the dynamics of synaptic facilitation (8). Given this broad spectrum of disparate functions, it is not surprising that different cortical synapses in different cortical areas exhibit vastly different STSP dynamics (9).
The Tsodyks and Markram (TM) model describes the dynamics of STSP under general conditions in an elegant and parsimonious way (1, 2). Indeed, the TM model includes several parameters that can be identified with biophysical variables (such as the time constant for refilling the readily releasable pool of vesicles) that can be regulated and account remarkably well for the highly heterogeneous dynamics in areas such as the visual and prefrontal cortices (see table 1 in ref. 10). Moreover, the TM model can explain as well the transitions between up and down cortical states (11–13).
Here, we report the existence of highly irregular and chaotic-like dynamics in the TM model. Chaotic dynamics has been already suggested as a possible mechanism to explain the irregular dynamics observed in cortical activity (14), as reflected, for example, in trial-to-trial variability of neuron responses observed after multiple repetitions of the same stimulus (15, 16), and the erratic and complex transients occurring in local field potentials (17). We identified a form of chaos in the TM model, called Shilnikov chaos, which induces highly irregular transient dynamics and large sensitivity to initial conditions, even for the case of the Shilnikov chaos having an associated attractor that is unstable, rather than a stable one (18–21). The existence of Shilnikov chaos cannot, in principle, account for all of the observed complexity of cortical dynamics, but it may account for some irregularity in the overall network activity and, in particular, for facilitating transitions between large-scale brain states.
Model
We consider the continuous time TM model (8) as sketched in Fig. 1; the corresponding differential equations are detailed in Materials and Methods. The model describes the deterministic behavior of a population of identical excitatory neurons (in blue in Fig. 1A) described by three state variables: the average excitatory network activity at any given time,
(in hertz) and two other variables,
and
, that model synaptic depression and facilitation, respectively. Each neuron receives global inhibition (in red in Fig. 1A) represented by the constant
.
Fig. 1.
Model of the STSP dynamics. (A) Cartoon of a neural network; a pool of identical excitatory pyramidal neurons (blue) are recurrently connected and receive global inhibition from a pool of identical interneurons (red).
is the average rate in hertz for the excitatory pool and
the average rate in hertz for inhibitory neurons (fixed parameter). Excitatory connections are described by the TM model for STSP. (B) Sketch of TM dynamics. At the presynaptic site (large gray oval) resources are represented by small circles and could be in two possible states: available to be released [green,
] and nonavailable [orange,
]. The transition rates between these states are given by
and
. The variable
(in pink) models variations in release probability, affecting neurotransmitters that have a high probability of releasing
and to those with a low release probability [
, in yellow]. The transition rates between the two states are given by
and
, with U the baseline decay for
. (C) Equilibrium solution for the average activity in the excitatory population. The total input arriving to the postsynaptic neuron (small gray oval), given by
with J a synaptic-strength parameter, is rectified and amplified through the gain function g.
In the TM model, presynaptic resources are finite and each one is represented by two possible states: available to be released, inducing presynaptic activation (green circles in Fig. 1B), and nonavailable for release (orange circles in Fig. 1B). The overall fraction of available neurotransmitters is
, whereas
is the fraction of nonavailable ones. Network activity,
, consumes resources; the consumption rate from state
to
is given by
(discussed below), which leads to short-term synaptic depression. The transition from nonavailable to available states (i.e., refilling dynamics) is occurring at a rate
, where
represents the spontaneous recovery time from the depressed state.
The facilitation variable
encodes variations in the release probability of available neurotransmitters, owing mainly to the influx of calcium ions into the presynaptic terminal. Thus, neurotransmitters are represented by two additional states: a fraction
(yellow in Fig. 1B) with a low probability to be released (the low-p releasable state) and a complementary fraction
in the high-p releasable state (pink in Fig. 1B). The transition rate from low-p to high-p releasable state is given by
, with U representing the baseline level of
, whereas the reverse transition occurs spontaneously at a rate
, where
is the time constant modeling facilitation.
The total input arriving at the postsynaptic terminal is given by
(where J is the strength of recurrent connections in the neuronal excitatory population), which is then rectified and amplified via the gain function
(ref. 8 and Materials and Methods). Parameter values and time constants are summarized in Table S1.
Results
Bifurcation Diagram of the TM Model.
The TM model is known to exhibit a wide range of dynamical regimes, such as bistable electrical activity, mimicking cortical up and down states, and oscillatory up states (see figure S1 in ref. 8). Here, we further explored the TM phase space using a numerical software tool, XPPAUT (22), for bifurcation analysis. This software enabled us to systematically track the model’s trajectories and stability of equilibrium points and limit cycles while continuously varying system parameters. In addition, XPPAUT allowed us to reconstruct the full bifurcation diagram summarizing all possible states. We identified stable attractor solutions as well as unstable solutions beyond the reach of standard brute-force search. The resulting bifurcation diagram, shown in Fig. 2, illustrates all possible transitions from steady-state activity to oscillatory and complex oscillations under continuous variations of the external inhibition parameter
. Solid lines correspond to stable solutions and dashed lines to unstable ones. There are three classes of network stable states, which had already been described (8): A down-state fixed point (blue), an up-state fixed point (black), and a periodic up state (a limit cycle whose maximum and minimum amplitudes are the lines marked in red and green, respectively). Further continuing, these states become unstable and we subsequently have detected a Shilnikov homoclinic bifurcation point (orange), which had not previously been identified. Although the trajectories associated with the Shilnikov homoclinic bifurcation are unstable, its presence organizes the observable network states, as we will show below.
Fig. 2.
Bifurcation diagram of the STSP dynamics. Numerical continuation of E when varying parameter
for
. Changes in solutions stability occurred at bifurcation points: saddle node at (SN)
and
, subcritical Hopf (H) at
, and saddle node of a periodic solution (SNP) at
and
. Chaos emerged near the homoclinic bifurcation (HO) at
. Different classes of states (fixed points) describing the network dynamics are depicted with different colors: down-state fixed point (blue), up-state fixed point (black), up-periodic state (red for the maximum oscillation amplitude and green for the minimum), and up-chaotic state (orange). Solid lines refer to stable solutions and dashed lines to unstable solutions. Notice that there is coexistence between different network states, so that for a fixed external stimulus either a small parameter variation or simply noise can produce transitions between the different network states that coexist along the same vertical line in the bifurcation diagram. The SN, H, and SNP bifurcations were reported in ref. 8, but the Shilnikov homoclinic bifurcation HO, which indicates chaos, is new here. Note that there is another subcritical Hopf (H) at
, creating a branch of unstable limit cycles that terminate at a homoclinic bifurcation (HO) at
. This HO bifurcation does not produces Shilnikov chaos, so it has no impact on the overall dynamics.
States and Transitions in the TM Model.
For very large inhibition currents,
, the only stable state is the down state. In contrast, for relatively small inhibitory inputs, the system settles to a fixed point with nonvanishing constant activity, called an up state; by progressively increasing
a saddle-node of a periodic bifurcation leads to a stable oscillatory up state, which coexists with the up state and eventually loses its stability, giving rise to a branch of unstable periodic states. This solution branch terminates at a Shilnikov homoclinic bifurcation (Fig. 2 gives a full description of the different bifurcations).
Note that there is another subcritical Hopf bifurcation at
; the branch of unstable limit cycles emanating from that Hopf bifurcation terminates at a homoclinic bifurcation at
, which is not of Shilnikov type. This branch has no impact on the dynamics of the system.
Properties of the Shilnikov Homoclinic Bifurcation.
The existence of a Shilnikov homoclinic bifurcation in STSP dynamics unveils hidden complexity in the TM model. Indeed, as illustrated in Fig. 3A, the period T of the oscillations of the unstable branch of solutions grows without bound as the homoclinic bifurcation is approached, becoming infinitely large right at the bifurcation point; this infinitely large period can be a first indication of chaotic-like dynamics (23).
Fig. 3.
Divergence of the oscillation period as a route to chaos in the STSP dynamics. (A) Accumulation of branches of periodic solutions close to a Shilnikov homoclinic (HO) bifurcation. The branch undergoes an infinite number of saddle-node bifurcations (folds); however, these accumulate to a fixed value of
corresponding to the Shilnikov homoclinic bifurcation. (Inset) A zoom-in of the gray area. (B) Time series of the population activity E and synaptic parameters x and u along the branch. Time is measured in units of the period T. Far from the homoclinic bifurcation (yellow 1 in A) the network activity exhibits a smooth wave with time. Closer to the homoclinic bifurcation, the wave is briefer (green 2). At the homoclinic bifurcation (purple 3), the wave becomes a spike. (C) Last periodic orbit
along the branch illustrated in A, viewed in 3D phase space
. The orbit
has a large period and is a numerical approximation of the homoclinic orbit (formally with infinite period). The orbit
in the plane
is approximately stable and spirals toward an equilibrium of saddle type in which both stable and unstable directions coexist. The orbit then shoots out in the unstable direction, which approaches the E direction before spiraling back to the saddle equilibria. Simulations are performed for
; similar behavior was observed for a wide range of parameter values (Fig. S1).
As shown in Fig. 3B the time series (plotted as a function of
), along the previously identified wiggly branch, changes its time profile as the homoclinic bifurcation is approached. Far from the homoclinic bifurcation (yellow circle 1 in Fig. 3A), the solutions are harmonic oscillations, but as the period of oscillation increases (green circle 2) the solutions exhibit a spiking behavior followed by a slow oscillatory relaxation to a nominal value; this slow return to a quasi-rest state lasts longer and longer as the homoclinic bifurcation is approached. Eventually, at the homoclinic bifurcation the network activity occurs in the form of infinitely separated spikes (purple circle 3), and the period of oscillations increases without bound as the homoclinic orbit is approached (further details in Materials and Methods).
An approximate (computationally tractable) solution of a homoclinic orbit is shown in Fig. 3C; observe that the orbit is stable in the
-plane and spirals toward a saddle equilibrium fixed point where the stable and unstable manifolds intersect; the orbit then shoots out in the unstable direction, with E increasing in a “spike-like” way, before spiraling back to the saddle-equilibria. In the neighborhood of the homoclinic bifurcation trajectories are similar to this orbit, but eventually after some number of cycles around the attractor, they flow away along the unstable direction. Thus,
exhibits transient population spikes, the number of spikes, their amplitude, and their exact locations being extremely sensitive to initial conditions. This is illustrated in Fig. 4, where different traces of activity corresponding to slightly different initial conditions are shown. The irregular spike-like bursting has an oscillatory character as the system eventually settles to the stable down state. These orbits corresponds to solutions very close to the homoclinic orbit, which repeat themselves with relatively small variance; despite this regularity, the return periods of these orbits widely fluctuate with weak correlation between successive returns (24); these are typical features of homoclinic chaos. In conclusion, the existence of a homoclinic bifurcation profoundly affects the transient dynamics in a broad neighborhood around it, leading to irregular dynamics that directly affects the transient responses of the TM model.
Fig. 4.
Effects of the Shilnikov chaos in the transient dynamics. Shilnikov chaos differs from other routes to chaos: Although the time series for the TM model near the homoclinic orbit looks regular, the intervals between spikes vary from spike to spike.
is superimposed for trajectories from similar initial conditions
(15 different traces in different colors), illustrating the large sensibility to small variations; the trajectories vary in the number of spikes from four to nine before settling down to the stable equilibrium (note also the variable amplitudes of the peaks and the lack of temporal coherence).
A mathematical test for whether the dynamics around the attractor is actually chaotic is to evaluate the so-called saddle quantity, σ; a theorem by Shilnikov (25, 26) states that the dynamics is complex/chaotic for
and simple for negative values (Materials and Methods). As shown in Fig. S1, the saddle quantity measured numerically for the TM model is strictly positive and quite large, confirming the presence of Shilnikov chaos.
Robustness of the Shilnikov Homoclinic Bifurcation.
To examine whether chaos exists under different conditions we varied previously fixed variables, such as J, keeping the others fixed. In the 2D parameter space
we found a line of homoclinic bifurcations. Similar lines of homoclinic bifurcations were found by varying other pairs of parameters, such as
,
,
,
, and
, all of which had large, positive values of the saddle quantity (Fig. S1). In addition, we also studied the effects of synaptic delays on the dynamics of short-term synaptic plasticity (Fig. S2), confirming the robust existence of Shilnikov chaotic dynamics in the TM model.
Influence of Noise on the Network Dynamics Near the Shilnikov Homoclinic Bifurcation.
Physiological systems have noise that precludes strict determinism. To study the interplay between stochasticity and the deterministic chaotic dynamics, we have studied a network model proposed in ref. 27 (Fig. 5); the model is such that, in the limit of an infinite number of neurons
, it is exactly described by the TM deterministic equations (further details are given in (SI Text, section 2). In contrast, for a finite number of neurons, N, the network is a noisy version of the TM model with the noise amplitude scaling as
. Thus, the standard TM model is the mean field description of the noisy network and the level of noise in the system can be controlled by varying the number of neurons.
Fig. 5.

Effects of the Shilnikov chaos in the network dynamics. Simulation of the network activity
based on the model introduced in ref. 27, which in its infinite network size limit is described by the TM deterministic equations. We considered a network with
neurons and parameter values
and
, very close to the homoclinic orbit of the deterministic equations. The initial condition was close to the stationary point on the homoclinic orbit. The standard TM model with these parameters does not have a stable periodic state. (Upper) Transitions to noisy transient periodic up states. Some isolated spikes, indicated with an arrow, correspond to the unstable periodic up states near the homoclinic points. (Lower) Insets of areas labeled A, B, and C in the upper figure. Observe the high irregularity and complexity of the curves.
We have performed computer simulations of the stochastic network using parameter values close to the homoclinic orbit
, for which the up-periodic state is at the edge of undergoing a stability change at a deterministic level (Fig. 2). Simulations show that depending on the noise level the network switches between the down state and what seems to be a noisy version of the periodic state (Fig. 5). For intermediate noise intensities (i.e.,
), we observed spikes corresponding to the unstable periodic orbits close to the homoclinic point (Fig. 5). As in the deterministic model, these unstable spikes decayed back to the down state and, consequently, were temporally isolated. However, eventually the system jumps to the periodic up state by using the nearby unstable periodic solutions close to the homoclinic orbit as a kind of springboard. Indeed, it did not require much noise to put the system close to the stationary point on the homoclinic orbit, from which the network could jump to nearby unstable periodic orbits. The resulting highly irregular dynamics results from the interplay between deterministic complex dynamics and stochasticity. Further away from the homoclinic bifurcation (i.e., for smaller values of
), there is no homoclinic orbit between the down- and the up-periodic state and much more noise is required to observe jumps between these two regimes.
Discussion
Consequences of the Shilnikov Homoclinic Bifurcation.
We have identified the existence of Shilnikov homoclinic chaos in the simple and parsimonious TM model for the STSP dynamics. Shilnikov proved that if the saddle quantity is positive, infinitely many saddle limit cycles coexist at the bifurcation point: Each of these saddle limit cycles had stable and unstable manifolds, which results in high sensitivity to initial conditions and irregular transient dynamics. In the TM model the saddle quantity is generically positive in all cases: The behavior around the homoclinic bifurcation point is chaotic in the sense of Shilnikov, yielding unpredictable transient patterns with arbitrarily many spikes before settling down to the stable (down-state) equilibrium (Fig. 4).
The striking point to be stressed here is that the presence of a homoclinic bifurcation shapes and organizes the flow of trajectories in a relatively large region around it. We have shown that the Shilnikov bifurcation induces different complex transient responses depending on initial conditions before the system converges to one of the stable attractors. Could this transient dynamics caused by the Shilnikov homoclinic bifurcation mediate or explain certain irregular transients observed in large-scale brain dynamics, such as the erratic and complex transients observed in local field potentials in brain electrophysiology under certain conditions (e.g., ref. 17)? In this context, it is noteworthy that sequences of homoclinic-heteroclinic orbits have been recently proposed to be at the basis of central pattern generators and possibly other high-cognition functions such as memory or motor control in analog, continuous-time, neuronal networks (28); the present study reveals that even isolated homoclinic orbits with strong unstable directions do greatly affect the overall transient dynamics of STSP (and in general the observable network states)—especially when some degree of stochasticity is introduced—and promote transitions between different states, thus fostering complex behavior.
Simulations of the TM Model on a Network.
Numerical simulations of a network version of the TM model for STSP support the idea that the chaotic manifold can act as a springboard from the down state to the periodic state. The nearby unstable periodic orbits are involved in this switching behavior because they shape the dynamics in an extended region of the phase space. Thus, the network can take advantage of these orbits, through noise, to sample extended regions of the phase space that might not be easily accessible in the deterministic model. This suggests an interesting use of the chaotic manifold as a means to switch between states that are otherwise too far from each other to allow a direct transition through noise.
Complex Inputs and Balanced States.
We have considered here the effects that constant inhibitory inputs have in the STSP dynamics. However, effects of periodic inputs and other forms of inhibition can be investigated (29). In this case, the usual up state is expected to become oscillatory, and the oscillatory up state to become more complex, with a structure that is likely to depend on the interplay between the intrinsic self-generated oscillations and external ones. It could also potentially lead to much more complex dynamics, such as mixed-mode oscillations and bursting (see ref. 30), by introducing a slow feedback dynamics for the inhibition variable
.
It is generally thought that irregular dynamics occurs when the underlying system is in a state in which excitation and inhibition are balanced (31, 32). We have computed the balance ratio in the STSP dynamics, defined as
divided by
per time unit along the different trajectories, and verified that all of the active states including fixed points, limit cycles, and chaotic states are generally balanced (i.e., balance ratio of order 1). This is in agreement with ref. 33, which reported that although the excitation–inhibition balance is required for the irregular dynamics, chaotic dynamics is not a necessary ingredient.
Effects of Noise on Chaotic Dynamics.
Noise—including unreliable synaptic connections, synaptic heterogeneity, irregularity of external inputs, background net activity, network size effects, heterogeneous sparse connectivity, and so on—is ubiquitous in cortical networks and has a profound impact on their dynamics (for a review see ref. 34). Many interesting effects can be found by introducing noise explicitly into the deterministic TM equations or by simulating the TM dynamics upon a (finite) random network (discussed below). For instance, transitions from a down-state fixed point to an up-state fixed point occurred in the presence of stochasticity (11); transitions from either down- or up-state fixed points to periodic up states (two distinct possibilities) were conjectured to exist in ref. 8 and experimentally observed in ref. 35. Also, owing to the presence of noise, up states (but not down states) can exhibit quasi-oscillations, in which the network activity fluctuates in an irregular way—with a nontrivial power spectrum—around its average value (13, 36). The underlying mechanism responsible for such quasi-oscillations is that the corresponding eigenvalues of the underlying up-state fixed point are complex, and hence the transient decay toward it occurs in the form of damped oscillations. Noise eventually kicks the system away from the deterministic fixed point, increasing the amplitude of the damped oscillations, and the system reaches a balanced state in which deterministic relaxation and noise excitation equilibrate, giving rise to a nontrivial spectrum of fluctuations (13, 36). In a similar spirit, we expect that adding noise to the STSP dynamics might lead to highly complex dynamics, especially in the neighborhood of the homoclinic orbit. First, deterministic chaos produces irregular transient spiking behavior (converging to the resting down state as described above). Second, noise kicks the system away from the down state, leading to a complex interplay of chaotic dynamics and stochasticity.
Self-Organization to the Edge of Chaos.
Recent in vitro experiments revealed that spontaneous up–down transitions occurred predominantly near the limit of stability of the oscillatory phase (37), suggesting that there is some kind of biological self-organizing mechanism tuning cortical networks to the “edge of chaos,” a borderline between the active and quiescent phases in parameter space (38–43). This corresponds to the region near the Shilnikov homoclinic bifurcation the TM model unveiled. A feedback loop between excitation and inhibition could be a good candidate to provide for such a mechanism. Future research should explore these issues in the context of more complex network models.
To summarize, we have found the existence of Shilnikov chaos in the parsimonious TM model for short-term synaptic plasticity. Shilnikov chaos may have a profound impact in transient dynamics of large-scale network dynamics, which could be relevant for neural computation. We have shown that the presence of Shilnikov chaos constitutes a possible neural mechanism for transitory variability even in the noiseless neural dynamics and in a stochastic system may serve to facilitate transitions between different stable states.
Materials and Methods
Standard TM Model.
We consider the continuous-time version of the TM model (8), as defined by the following set of equations (dot stands for time derivatives):
![]() |
Bifurcation Diagram and Numerical Continuation and XPPAUT.
A bifurcation diagram is simply a plot summarizing all possible dynamical states in the parameter space, marking all possible fixed-point steady states, limit cycles, chaotic attractors, and so on, as well as the unstable and saddle points separating their respective domains of attractions. For clarity of visualization, we plotted a one-dimensional projection of the full state space as a function of one parameter: In the case of periodic oscillations only the maximum and the minimum amplitude values are plotted versus the parameter of interest, and the chaotic attractor is represented by a single point.
XPPAUT is a software package that uses continuation techniques to numerically analyze sets of differential equations in an efficient manner (22). By using numerical continuation we tracked the unstable solutions, which cannot be done by with brute-force bifurcation diagrams, in which only stable solutions can be depicted. The code is available at www.math.pitt.edu/∼bard/xpp/xpp.html.
Shilnikov Homoclinic Orbit and Saddle Quantity.
A homoclinic orbit is a trajectory of a dynamical system that joins the stable
and unstable
manifolds of a saddle-type invariant set with an infinite period. The stable manifold is defined as the set of all trajectories (solutions) that tend to the invariant set in forward time; the unstable manifold is defined as the set of all trajectories that tend to the invariant set in backward time. In this particular case, the invariant dynamical object is a fixed point (here, a saddle-focus equilibrium). The oscillations tend to approximately focus with spiral dynamics; however, the focus possesses only one unstable direction, which has the effect of driving the solution away from this plane before returning again to the oscillatory region (Fig. 3C). Thus, in this particular system
is one-dimensional, because the equilibrium has one real eigenvalue,
, and
is 2D because of the spiral dynamics, dictated by a pair of complex conjugated eigenvalues
(SI Text, section 1 gives the calculation of the eigenvalues). In this way, two eigenvalues
control the stable direction and a third eigenvalue
controls the unstable direction.
According to Shilnikov theorem (26), the nature of the overall dynamics of the system near this bifurcation depends on the saddle quantity σ, defined by
, where
is the real part of the eigenvalues. In the present case, σ can have values that are strictly positive (approximately 15 in Fig. 2, and other positive values in Fig. S1). Consequently, Shilnikov’s theorem implies the existence of countably many saddle cycles nearby, which is evidence for chaos. Because there are many saddle-limit cycles dictated by the Shilnikov orbit, an orbit from an initial condition in this region will iterate along these many cycles, thus generating periodic obits with an unpredictable number of spikes, N, at irregular intervals.
The classic Shilnikov theorem implies that the unstable direction is associated with the real eigenvalue and that the stable one is associated with the complex conjugate eigenvalues. In case of having directions opposite to the classic case (i.e., stable for the real eigenvalue and unstable for the complex conjugate eigenvalues), the positivity of the saddle quantity does not imply chaos. In any case, the absolute value of the real eigenvalue has to be bigger than the absolute value of the real part of the complex conjugate eigenvalues, which is equivalent to the positivity of the saddle quantity in the classic Shilnikov scenario (i.e., the one we report here), and to its negativity in the scenario with opposite directions.
Two-Parameter Continuation for Computation of the Chaotic Region.
To estimate the volume in parameter space containing chaotic dynamics, we used a numerical strategy based on an extended boundary-value problem, pseudo-arc-length continuation (22). We computed a two-parameter family of approximate Shilnikov homoclinic orbits (similar to that shown in Fig. 3C) together with its associated saddle-focus equilibrium. More specifically, we use the module HOMCONT, part of the software package AUTO (44), which performs these types of computations, which were not possible with XPPAUT. In this way, we were able to compute the saddle quantity σ associated with the saddle-focus equilibrium for every couple of parameter values along the computed family. For a saddle-focus equilibrium of a 3D vector field, this quantity is defined as the sum of its real eigenvalue and the real part of its complex conjugated eigenvalues. A major theoretical result states that if σ is strictly positive, then the chaotic dynamics extends to a neighborhood around the parameter value of the Shilnikov homoclinic bifurcation (25).
Supplementary Material
Acknowledgments
J.M.C. is supported by Ikerbasque, the Basque Foundation for Science. This work was supported by Junta de Andalucia Grant P09-FQM-4682 (to J.M.C. and M.A.M.), the Howard Hughes Medical Institute, and Office of Naval Research Grant N000141210299 (to R.V. and T.J.S.).
Footnotes
The authors declare no conflict of interest.
This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1316071110/-/DCSupplemental.
References
- 1.Tsodyks MV, Markram H. The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. Proc Natl Acad Sci USA. 1997;94(2):719–723. doi: 10.1073/pnas.94.2.719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Markram H, Tsodyks M. Redistribution of synaptic efficacy between neocortical pyramidal neurons. Nature. 1996;382(6594):807–810. doi: 10.1038/382807a0. [DOI] [PubMed] [Google Scholar]
- 3.Thomson AM, Deuchars J. Temporal and spatial properties of local circuits in neocortex. Trends Neurosci. 1994;17(3):119–126. doi: 10.1016/0166-2236(94)90121-x. [DOI] [PubMed] [Google Scholar]
- 4.Abbott LF, Varela JA, Sen K, Nelson SB. Synaptic depression and cortical gain control. Science. 1997;275(5297):220–224. doi: 10.1126/science.275.5297.221. [DOI] [PubMed] [Google Scholar]
- 5.Chance FS, Nelson SB, Abbott LF. Synaptic depression and the temporal response characteristics of V1 cells. J Neurosci. 1998;18(12):4785–4799. doi: 10.1523/JNEUROSCI.18-12-04785.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.van Rossum MCW, van der Meer MA, Xiao D, Oram MW. Adaptive integration in the visual cortex by depressing recurrent cortical circuits. Neural Comput. 2008;20(7):1847–1872. doi: 10.1162/neco.2008.06-07-546. [DOI] [PubMed] [Google Scholar]
- 7.Cortes JM, et al. The effect of neural adaptation on population coding accuracy. J Comput Neurosci. 2012;32(3):387–402. doi: 10.1007/s10827-011-0358-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Mongillo G, Barak O, Tsodyks M. Synaptic theory of working memory. Science. 2008;319(5869):1543–1546. doi: 10.1126/science.1150769. [DOI] [PubMed] [Google Scholar]
- 9.Zucker RS, Regehr WG. Short-term synaptic plasticity. Annu Rev Physiol. 2002;64:355–405. doi: 10.1146/annurev.physiol.64.092501.114547. [DOI] [PubMed] [Google Scholar]
- 10.Wang Y, et al. Heterogeneity in the pyramidal network of the medial prefrontal cortex. Nat Neurosci. 2006;9(4):534–542. doi: 10.1038/nn1670. [DOI] [PubMed] [Google Scholar]
- 11.Holcman D, Tsodyks M. The emergence of up and down states in cortical networks. PLOS Comput Biol. 2006;2(3):e23. doi: 10.1371/journal.pcbi.0020023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Barak O, Tsodyks M. Persistent activity in neural networks with dynamic synapses. PLOS Comput Biol. 2007;3(2):e35. doi: 10.1371/journal.pcbi.0030035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Hidalgo J, Seoane LF, Cortés JM, Muñoz MA. Stochastic amplification of fluctuations in cortical up-states. PLoS ONE. 2012;7(8):e40710. doi: 10.1371/journal.pone.0040710. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.van Vreeswijk C, Sompolinsky H. Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science. 1996;274(5293):1724–1726. doi: 10.1126/science.274.5293.1724. [DOI] [PubMed] [Google Scholar]
- 15.Vogels R, Spileers W, Orban GA. The response variability of striate cortical neurons in the behaving monkey. Exp Brain Res. 1989;77(2):432–436. doi: 10.1007/BF00275002. [DOI] [PubMed] [Google Scholar]
- 16.Arieli A, Sterkin A, Grinvald A, Aertsen A. Dynamics of ongoing activity: explanation of the large variability in evoked cortical responses. Science. 1996;273(5283):1868–1871. doi: 10.1126/science.273.5283.1868. [DOI] [PubMed] [Google Scholar]
- 17.Freeman W. Mass Action in the Nervous System. New York: Academic; 1975. [Google Scholar]
- 18.Shilnikov L, Shilnikov A. Shilnikov bifurcation. Scholarpedia. 2007;2:1891. [Google Scholar]
- 19.Sammon M, Romaniuk JR, Bruce EN. Bifurcations of the respiratory pattern produced with phasic vagal stimulation in the rat. J Appl Physiol. 1993;75(2):912–926. doi: 10.1152/jappl.1993.75.2.912. [DOI] [PubMed] [Google Scholar]
- 20.Kelso JA, Fuchs A. Self-organizing dynamics of the human brain: Critical instabilities and Sil’nikov chaos. Chaos. 1995;5(1):64–69. doi: 10.1063/1.166087. [DOI] [PubMed] [Google Scholar]
- 21.van Veen L, Liley DT. Chaos via Shilnikov’s saddle-node bifurcation in a theory of the electroencephalogram. Phys Rev Lett. 2006;97(20):208101. doi: 10.1103/PhysRevLett.97.208101. [DOI] [PubMed] [Google Scholar]
- 22.Ermentrout B. Simulating, Analyzing, and Animating Dynamical Systems: A Guide to XPPAUT for Researchers and Students. Vol 14. Philadelphia: Society Industrial Applied Mathematics; 2002. [Google Scholar]
- 23.Weiss CO, Abraham NB, Hübner U. Homoclinic and heteroclinic chaos in a single-mode laser. Phys Rev Lett. 1988;61(14):1587–1590. doi: 10.1103/PhysRevLett.61.1587. [DOI] [PubMed] [Google Scholar]
- 24.Allaria E, Arecchi FT, Di Garbo A, Meucci R. Synchronization of homoclinic chaos. Phys Rev Lett. 2001;86(5):791–794. doi: 10.1103/PhysRevLett.86.791. [DOI] [PubMed] [Google Scholar]
- 25.Shilnikov L. A case of the existence of a denumerable set of periodic motions. Soviet Math Dokl. 1965;6:163–166. [Google Scholar]
- 26. Kuznetsov A (1998) Elements of Applied Bifurcation Theory, Applied Mathematical Sciences (Springer, New York), Vol 112.
- 27.Bressloff PC. Metastable states and quasicycles in a stochastic Wilson-Cowan model of neuronal population dynamics. Phys Rev E Stat Nonlin Soft Matter Phys. 2010;82(5 Pt 1):051903. doi: 10.1103/PhysRevE.82.051903. [DOI] [PubMed] [Google Scholar]
- 28.Rabinovich M, Varona P, Selverston A, Abarbanel H. Dynamical principles in neuroscience. Rev Mod Phys. 2006;78:1213. [Google Scholar]
- 29.Parga N, Abbott LF. Network model of spontaneous activity exhibiting synchronous transitions between up and down states. Front Neurosci. 2007;1(1):57–66. doi: 10.3389/neuro.01.1.1.004.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Desroches M, et al. Mixed-mode oscillations with multiple time scales. SIAM Rev. 2012;54:211–288. [Google Scholar]
- 31.Shu Y, Hasenstaub A, McCormick DA. Turning on and off recurrent balanced cortical activity. Nature. 2003;423(6937):288–293. doi: 10.1038/nature01616. [DOI] [PubMed] [Google Scholar]
- 32.Haider B, Duque A, Hasenstaub AR, McCormick DA. Neocortical network activity in vivo is generated through a dynamic balance of excitation and inhibition. J Neurosci. 2006;26(17):4535–4545. doi: 10.1523/JNEUROSCI.5297-05.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Jahnke S, Memmesheimer RM, Timme M. How chaotic is the balanced state? Front Comput Neurosci. 2009;3:13. doi: 10.3389/neuro.10.013.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Vogels TP, Rajan K, Abbott LF. Neural network dynamics. Annu Rev Neurosci. 2005;28:357–376. doi: 10.1146/annurev.neuro.28.061604.135637. [DOI] [PubMed] [Google Scholar]
- 35.Compte A, et al. Spontaneous high-frequency (10-80 Hz) oscillations during up states in the cerebral cortex in vitro. J Neurosci. 2008;28(51):13828–13844. doi: 10.1523/JNEUROSCI.2684-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Wallace E, Benayoun M, van Drongelen W, Cowan JD. Emergent oscillations in networks of stochastic spiking neurons. PLoS ONE. 2011;6(5):e14804. doi: 10.1371/journal.pone.0014804. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Mattia M, Sanchez-Vives MV. Exploring the spectrum of dynamical regimes and timescales in spontaneous cortical activity. Cogn Neurodyn. 2012;6(3):239–250. doi: 10.1007/s11571-011-9179-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Bertschinger N, Natschläger T. Real-time computation at the edge of chaos in recurrent neural networks. Neural Comput. 2004;16(7):1413–1436. doi: 10.1162/089976604323057443. [DOI] [PubMed] [Google Scholar]
- 39.Beggs JM, Plenz D. Neuronal avalanches in neocortical circuits. J Neurosci. 2003;23(35):11167–11177. doi: 10.1523/JNEUROSCI.23-35-11167.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Beggs J. The criticality hypothesis: How local cortical networks might optimize information processing. Philos Transact A Math Phys Eng Sci. 2008;366:329–343. doi: 10.1098/rsta.2007.2092. [DOI] [PubMed] [Google Scholar]
- 41.Kitzbichler MG, Smith ML, Christensen SR, Bullmore E. Broadband criticality of human brain network synchronization. PLOS Comput Biol. 2009;5(3):e1000314. doi: 10.1371/journal.pcbi.1000314. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Chialvo DR. Emergent complex neural dynamics. Nat Phys. 2010;6:744750. [Google Scholar]
- 43.Toyoizumi T, Abbott LF. Beyond the edge of chaos: Amplification and temporal integration by recurrent networks in the chaotic regime. Phys Rev E Stat Nonlin Soft Matter Phys. 2011;84(5 Pt 1):051908. doi: 10.1103/PhysRevE.84.051908. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Doedel E, et al. (2007) Auto-07p: Continuation and bifurcation software for ordinary differential equations (2007). Available at http://indy.cs.concordia.ca/auto.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.





