Abstract
This article uncovers a remarkable behavior in two biochemical systems that commonly appear as components of signal transduction pathways in systems biology. These systems have globally attracting steady states when unforced, so they might have been considered uninteresting from a dynamical standpoint. However, when subject to a periodic excitation, strange attractors arise via a period-doubling cascade. Quantitative analyses of the corresponding discrete chaotic trajectories are conducted numerically by computing largest Lyapunov exponents, power spectra, and autocorrelation functions. To gain insight into the geometry of the strange attractors, the phase portraits of the corresponding iterated maps are interpreted as scatter plots for which marginal distributions are additionally evaluated. The lack of entrainment to external oscillations, in even the simplest biochemical networks, represents a level of additional complexity in molecular biology, which has previously been insufficiently recognized but is plausibly biologically important.
Introduction
Many unforced biochemical systems, such as pairs of mutually repressing genes, or phosphorylation/dephosphorylation cycles, can exhibit biologically important properties such as multistability and oscillations (1, 2, 3, 4, 5, 6, 7, 8). The experimental observation of these behaviors helps one to distinguish among alternative models, and indicates the necessity of positive or negative feedback loops (9). Biological observables exhibited in response to time-dependent forcing signals (i.e., dynamic phenotypes) can provide further insight into the structure of biological systems. Recent examples include scale invariance or “fold-change detection” (10, 11, 12), nonmonotonic behavior under monotonic inputs (13), refractory period stabilization (14), and nonentrained solutions or “period skipping” when stimuli are periodic (14).
The goal of Rahi et al. (14) was to find tools that allow one to distinguish between different perfect adaptation topologies. It is known that adaptation requires the existence of incoherent feedforward or negative feedback subnetworks. Either of these works, giving asymptotically the same behavior under constant stimulation. On the other hand, responses to nonconstant inputs allow a finer model discrimination. Indeed, it is shown theoretically in (14) that both feedforward loops and positive feedback loops can never destroy entrainment, leaving negative feedback as the only explanation for lack thereof. Rahi et al. (14) found experimentally, in a Caenorhabditis elegans odor-sensing neuron, responses whose periods are roughly multiples of the period T of an excitation signal, thus theoretically implying the presence of negative feedback loops, and went on to propose a circuit architecture that is capable of displaying the observed dynamic phenotype. These findings suggest the following theoretical question: what complicated dynamics can arise in the simplest biochemical systems, more generally, in response to a periodic input? Here we answer that question by showing that a negative feedback system motivated by (14), and also the “nonlinear integral feedback” circuit proposed in (10) for scale-invariance, can both exhibit a rich bifurcation structure and chaotic behavior in response to pulse-train excitations.
There is an extensive and deep literature that deals with the analysis of responses of nonlinear systems, and particularly oscillators, to periodic signals. Under the influence of external periodic environmental forcing, nonlinear systems can exhibit bifurcations leading to subharmonic responses and chaos. Such behaviors have been studied theoretically and experimentally, in squid axons (15), cellular circadian oscillations subjected to periodic forcing by a light-dark cycle (16), forced pendulums and other classical physical oscillators described by the van der Pol and the Duffing equations (17, 18, 19, 20, 21, 22, 23), and biochemical oscillators such as the “Brusselator” (24, 25). Our contribution is to show that similar behaviors can be found already in two of the simplest nonlinear systems, which appear in the current systems biology literature. Furthermore, and perhaps equally remarkable, our two systems are not rhythmic in the absence of periodic stimulation; quite the contrary, they have unique and globally asymptotically stable steady states when the input is constant. This complexity in ubiquitous systems that constitute components of typical signal sensing and transduction networks suggests a previously unrecognized hidden level of complexity in molecular biology, which is of significance for biological function (14).
Materials and Methods
We first discuss the models to be considered, the type of periodic input, and the notion of chaos.
The two models
Our first example, motivated by (14), where similar models appear, is a negative feedback system that consists of two species X and Y such that X enhances the production of Y and Y inhibits the production of X. The concentrations of X and Y at time t are denoted respectively by x = x(t) and y = y(t). The interaction terms are modeled by Michaelis-Menten kinetics, and both X and Y are subject to zeroth-order decay through a mechanism such as protease-mediated degradation. An external input U, with magnitude u = u(t) in appropriate units, triggers production of X. The equations are as follows:
| (1a) |
| (1b) |
where we omit the argument t in x and in y, but leave it in the input to emphasize its time-dependence. All constants are assumed to be positive. A diagram of this model is in Fig. 1, a and c, with a general periodic input or a pulsed input, respectively.
Figure 1.
Simple biocircuits with an arbitrary periodic input and a negative feedback output. (a and c) Negative feedback system. (b and d) Fold-change detection system. (a and b) Arbitrary periodic input. (c and d) Pulse train input.
To emphasize that the bifurcation behaviors are not an artifact of artificially chosen parameter values, we will also consider the special case of model 1 in which all parameter values are unity (σx = σy = θx = θy = μx = μx = Mx = My = 1). We call this the “unity” model.
Our second example originates in (10) (see (26) for more theoretical analysis). It is an integral feedback system consisting of a regulator species X and an output species Y, with equations (using again x, y, and u for concentrations and inputs) as follows:
| (2a) |
| (2b) |
In model 2, a = Y0 = c = d = 1.0. Thus, model 2 is also a unity model. We use a small (nonzero) parameter Kx, 0 < Kx ≪ 1, for the sake of computational feasibility only to avoid division by zero or very small numbers. For a Michaelis-Menten constant Kx, 0 < Kx ≪ 1, this system is perfectly adapting to constant inputs and has the scale invariance or fold-change detection property, as discussed in (10). A diagram of this model is in Fig. 1, b and d, with a general periodic input or a pulsed input, respectively.
Both examples have the property that when u(t) is a constant there cannot be any periodic orbits and, furthermore, all solutions converge to a globally asymptotically stable steady state (with one minor exception for model 1, explained in the Supporting Material, which arises when some solutions become unbounded). For the system defined by model 2, this fact was proved in (26). For the system described by model 1, this is discussed in the Supporting Material.
Inputs
For simplicity, and to connect with the experiments in (14), we will consider T-periodic input functions u(t) (i.e., u(t) ≡ u(t + T)), which consist of pulse trains of period T:
| (3) |
In Eq. 3, t1 = (T – Δ)/2, t2 = (T + Δ)/2, where T and Δ are the period and support of the input function u(t), respectively. For the sake of (computational) simplicity, the support interval, [t1,t2], is centered at the midpoint of the interval [0,T]. We will analyze the effects of different choices of the amplitude parameter m or period T.
Chaos
There are many definitions of chaos, the choice of which depends on the aspect of chaos to be emphasized (22, 27, 28, 29, 30, 31, 32).
The definition of chaos appropriate for our work is based on periodic orbits and corresponds to the transition to chaos though period-doubling cascades (33, 34, 35). Following (35), we say that the given dynamic system has a periodic-orbit chaos or a periodic orbit strange attractor, if it has infinitely many regular periodic saddles.
Specifically, in the context of this work we reduce the bifurcation analysis of our models to the bifurcation analysis of the corresponding period-T maps Φ of the plane, Φ: 2 → 2. In this case, periodic solutions of the models, of period kT, are in one-to-one correspondence with the respective fixed points of Φk, k – 1,…. We call a k-periodic orbit {z0, …, zk−1} of the map Φ a regular saddle periodic orbit or a regular periodic saddle, zn+1 = Φ(zn), n = 0, …, k – 1, with zk = Φ(z0) if the Jacobian matrix ∂Φk(z0)/∂z has two eigenvalues |μ1| < 1 and |μ2| > 1.
It is instructive to compare our biocircuit models with the Duffing’s equation, the second-order ordinary differential equation (ODE) with a cubic nonlinearity describing a driven damped anharmonic oscillator, x″ + kx′ + x3 = Bcosωt. Here, the parameter k controls the damping, and the parameter B controls the amplitude of an external periodically varying driving force (17, 22). Chaotic solutions of the Duffing’s equation were discovered as early as 1962–63 (20, 21, 23) and have been the subject of extensive research (18, 34, 36). Detailed reviews of the Duffing equation’s fundamental properties can be found in (22, 32). In the examples studied below, a strange attractor emerges via a cascade of period-doubling bifurcations (35), the transition to chaos also observed in the Duffing’s equation (34).
As already explained, when our biocircuits are subject to constant inputs, they admit a globally asymptotically stable state. However, when the external periodic force is allowed to act during a short period of time, very small relative to the period T, chaotic behavior emerges (Fig. 2). This phenomenon is discussed in detail throughout the rest of the article.
Figure 2.
Bifurcation diagrams with respect to the external period T. Here, (a) and (b) correspond to model 1; (c) and (d) correspond to unity model 1; and (e) and (f) correspond to model 2.
We conclude this section with a few qualitative motivating remarks. Specifically, although we focus on very simple and concrete examples of mathematical models manifesting complex chaotic dynamics, the models are analyzed in the constructive style of the modern theory of dynamical systems. Despite the fact that this mathematical theory is still complex, it has evolved to a point where it can be used to predict or, at least to motivate, both the existence and structure of complex dynamics in a systematic manner. We illustrate this next through two theoretical approaches.
First of all, by appending a third equation, dθ/dt = ω with ω = 2π/T, to the above-formulated 2D models, followed by an appropriate Fourier series approximation of the discontinuous 2π-periodic input function v(θ) = u(θ.2π) to fulfill formal smoothness conditions, the extended approximated models can be viewed as a forced relaxation oscillator in the style of (30). Intuitively, as the steady state of our simple models depends on the input-level, if these input-levels oscillate, then the overall system’s response is periodic and what we have is a relaxation oscillator. The theory developed by Guckenheimer et al. (30) predicts that this class of forced relaxation oscillators can have a positive measure set of parameter values for which trajectories with positive Lyapunov exponents exist.
Second, the approach developed by Sander and Yorke (35) provides insight into the origin of the chaotic dynamics studied below via period-doubling cascades.
Shift maps by period T
The piecewise definition given in Eq. 3 of the input u(t) makes it inconvenient to numerically study bifurcations of limit cycles with respect to model parameters. It is more convenient to study the corresponding 2D-iterated maps, or shift maps by period T,
| (4) |
where Φ(zn,α) is the shift map by period T along the trajectories of the nonautonomous ODE given by (1a), (1b) or (2a), (2b), respectively (recall that T is the (minimal) period of the external input u(t)). More precisely, we define Φ(z,α) = φT(z,α), where φt(z,α) is the solution of the given ODE, that is, φt(z,α) = (x(t,α), y(t,α)), with the initial condition z = (x,y) at t = 0. Equation 4 gives the value of zn+1 as a function of zn (n = 0,1,2,…), and α is the vector of model parameters. Note that a fixed point in Eq. 4 corresponds to the appropriate periodic solution of the ODE model considered.
Theoretical homotopy continuation (35) and numerical bifurcation approaches (37, 38), as implemented for instance in the powerful numerical bifurcation tool MatcontM (38), can then be applied to study numerically bifurcations of fixed and periodic points of the iterated map Φ(z,α) defined in Eq. 4. A technical requirement for these methods is that the map Φ(z,α) should be smooth with respect to state variable z and parameter α. This requirement is easy to verify; see the Supporting Material.
Results and Discussion
Off-on-off chaos
Numerical analysis of the discrete trajectories in Eq. 4 corresponding to the models described in the Supporting Material immediately reveals chaotic dynamics in a wide range of model parameters.
Specifically, Fig. 2 demonstrates examples of bifurcation diagrams, when the values of the external period T are allowed to vary: 1) Fig. 2, a and b, corresponds to a strange attractor of the map in Eq. 4 for model 1 used with the fixed parameter values σx = σy = 104, θx = 10, θy = 1, μx = 100, μy = 10, Mx = My = 1, m = 1.75, and Δ = 10−4; 2) Fig. 2, c and d, corresponds to the map in Eq. 4 for the unity model 1 (with all parameters = 1) used with m = 2.0 × 104 and Δ = 10−2; and 3) Fig. 2, e and f, corresponds to a strange attractor of the map in Eq. 4 for model 2 used with m = 10−5, and Δ = 0.2.
We observe from Fig. 2 that for large values of the external period T (that is, low frequencies, ω → 0), the dynamics in all the three models is asymptotically localized to a small vicinity of the unique globally stable steady state, corresponding to oscillations with a very small amplitude. Indeed, large periods of external forcing allow the dynamics systems to relax to their globally stable steady states.
However, as soon as the period T of the external input decreases, small amplitude oscillations develop into large-amplitude oscillations, followed by the transition to chaos via a period-doubling cascade. Remarkably, and counterintuitively, whereas the period T of the external input decreases, the period of periodic processes described by each periodically forced model increases before each model becomes fully chaotic.
If the external period T is further decreased, the chaotic dynamics is eliminated and is replaced again by regular periodic oscillations with period T. This backward transition, chaos → periodic oscillations, can be explained by the Krylov-Bogoliubov-Mitropolsky asymptotic theory (39, 40). The theory predicts that asymptotically in the limit ω → ∞, the system dynamics becomes periodic with vanishing amplitude of oscillations. In this case, the high-frequency small-amplitude periodic dynamics can be approximated by a steady state in the corresponding autonomous (averaged) system (41).
The strange attractors shown in Fig. 2 are called “off-on-off” attractors (35), because the chaotic dynamics disappears for small and large values of the bifurcation parameter, period T in this case, and exists only for intermediate values of the parameter. Examples of chaotic time-resolved solutions for the strange attractors (Fig. 2) with positive largest Lyapunov exponents (λmax > 0) (42), are shown in Fig. S3.1.
To gain additional insight into the geometry of the strange attractors corresponding to the bifurcations trees (Fig. 2) and their complex time-resolved realizations (Fig. S3.1), we then plotted their respective phase portraits for appropriate iterated maps from Eq. 4 as discussed earlier. In the case of discrete trajectories generated by the map in Eq. 4, it is convenient to interpret the phase portraits as scatter plots for which marginal distributions can be computed (see the Supporting Material). We observe from Figs. S4.1 and S4.3 that for model 1 with the parameters shown, and also for model 2, the discrete trajectories are localized along the axis y, respectively. However, in the special case of the unity model, the discrete trajectories stochastically jump between and stochastically move along several attractor loci (Fig. S4.1).
When instead of the external period T, the strength, m, or support, Δ, of the external input, are taken as bifurcation parameters, similar results can be obtained (Figs. 5 and 6 and S5.1, respectively).
Figure 5.
(a and b) Multiple cascades in the unity model with respect to input strength m at T = 100.
Figure 6.
(a and b) Unbounded chaos cascade in model 2 with respect to input strength m at T = 5.
Power spectra and autocorrelation functions
In the theory of chaotic dynamic systems and discrete iterated maps (43), the power spectrum is computed and used to distinguish periodic, quasiperiodic, and chaotic motions described by dynamical systems arising in a broad range of fields (31). The power spectrum plotted for periodic or quasiperiodic trajectories has discrete peaks at the harmonic and subharmonics, whereas chaotic trajectories have a broadband component in their power spectrum. To illustrate that phenomenon for chaotic discrete trajectories of the iterated maps given in Eq. 4, we compute the power spectra and autocorrelation functions for the discrete trajectories corresponding to those values of parameters for which the plots in Fig. 2 (and Fig. S3.1) are obtained. To compute the power spectra and autocorrelation function (ACF), we use fast Fourier transform and ACF functions available from MATLAB (The MathWorks, Natick, MA) with N0 = 105, the number of points used to compute both the power spectra and ACFs (Fig. 3).
Figure 3.
Power spectra and autocorrelation functions. Power spectra and ACFs are generated from the discrete chaotic trajectories of the corresponding iterated maps. Here, (a) and (b) correspond to the map in Eq. 4 for model 1 with period T = 1; (c) and (d) correspond to the map in Eq. 4 for the unity model with period T = 40; and (e) and (f) correspond to the map in Eq. 4 for model 2 with period T = 5.
Recall that the ACF ρ(L) is defined and computed as follows (44):
| (5) |
Here, N0 is a sufficiently large integer, the integer argument L is called a lag (31, 44), and yn is, for example, the y component of the iterated phase point zn, zn = (xn,yn), zn = Φ(zn−1), n = 1,2,… (see the Supporting Material).
We also recall briefly that chaotic dynamics implies mixing and, therefore, a positive Kolmogorov entropy (31). As a result of the mixing effect, ρ(L) decreases to zero exponentially at a rate determined by the Kolmogorov entropy (45).
We observe from Fig. 3 that the ACF in the case of model 1 converges to zero slowly, rapidly oscillating between positive and negative values, Fig. 3, a and b, whereas the ACF in both case of the unity model, Fig. 3, c and d, and model 2, Fig. 3, e and f, vanishes rapidly. This observation could be interpreted as saying that model 1 has a larger capacity for memory than the other two models in terms of its remembrance of the past.
Myrberg-Feigenbaum cascades
We continue our discussion of the bifurcation diagrams (Fig. 2) by analyzing the corresponding period-doubling cascades as discussed informally below. A rigorous definition of period-doubling cascades can be found in (33, 35).
To begin with, we note that Pekka Myrberg, a Finnish mathematician, was the first who discovered period-doubling cascades for periodic orbits with periods p × 2q, q = 1,2,3, …, for a variety of p values in a series of articles published in 1958–1963 (46, 47), reviewed in (35). In the late 1970s, Mitchell J. Feigenbaum discovered a remarkable universality for the period-doubling bifurcation cascades in 1D iterated maps (33). Specifically, Feigenbaum discovered that if dk is defined by dk = pk+1 – pk, where pk is the given map’s bifurcation parameter value corresponding to the k-th period doubling bifurcation with the period transition 2k → 2k+1, then
| (6) |
The number δ, known as the “Feigenbaum constant”, is as fundamental a quantity as the numbers π and e, in that it appears throughout the realms of science. The constant δ can be found not only in iterative maps but also in certain differential equations, for example, in the Duffing equation, as empirically shown in (34). We next check if the corresponding bifurcation values of the parameters T and m also satisfy the universality law (6).
To carry out the corresponding computations systematically, we employed the command-line version of MatcontM (38). Specifically, we used MatcontM to compute the Feigenbaum (bifurcation) tree (Fig. 4), leading to the rapid accumulation of regular saddle periodic points which eventually form an infinite countable set around the parameter value T∗ (Fig. 4 a), or m∗ (Fig. 4 b), correspondingly.
Figure 4.
(a and b) A Feigenbaum period-doubling tree. Because of the very fast accumulation of the bifurcation values of the corresponding parameters, Tk and mk (k = 1, 2,…), around their respective limits (Table 1), only the very well-visible onsets of the bifurcation trees are shown.
Here, T∗ (or m∗) corresponds to the Feigenbaum constant in the limit, Tk → T∗ (or mk → m∗) and δk → δ, as k → ∞ (Table 1).
Table 1.
Numerical Approximation of the Feigenbaum Constant δ
| k | Tk | δk | mk | δk |
|---|---|---|---|---|
| 1 | 3.46269 | 0.63353 | ||
| 2 | 1.79848 | 1.10720 | ||
| 3 | 1.67155 | 13.11112 | 1.23735 | 3.63917 |
| 4 | 1.66440 | 17.74194 | 1.27174 | 3.78548 |
| 5 | 1.66345 | 7.52016 | 1.27984 | 4.24533 |
| 6 | 1.66326 | 5.13666 | 1.28161 | 4.55884 |
| 7 | 1.66322 | 4.72916 | 1.28200 | 4.64452 |
We find from Table 1 that whereas the sequence {Tk} converges slowly, the sequence {mk} converges rapidly to its limit and its rate of convergence approximates the Feigenbaum constant very well.
Multiple cascades
We next proceed with the discussion of the bifurcation diagrams shown in Fig. 2, c and d. Specifically, we discuss the intervals in the values of the parameter T with chaotic and regular dynamics interchange, as can be observed from Fig. 2, c and d. A similar phenomenon holds for the bifurcations with respect to the parameter m characterizing the input strength (Fig. 5).
The behavior of the unity model turned out to be so complex that it was impossible to employ MatcontM to carry out a detailed numerical bifurcation analysis similarly to that completed for model 1, and discussed in the Supporting Material. Despite the complexity of the observed dynamics (Figs. 2, c and d, and 5), we emphasize here that this model is exactly the type of very complex dynamical system for which the theory developed in (35) can be applied to attain insight into the origin of the model’s chaotic behavior. Due to the theory (35) and our numerical evidence, we have a strong belief that multiple period-doubling cascades contribute to the formation of the corresponding strange attractors in these cases. Such multiple cascades lead to the formation of an infinite countable set of saddle periodic points that give rise to the emergence of chaos (35).
Unbounded chaos
We complete our discussion of chaos emerging in these simple periodically forced models with the case in which model 2 has a strange attractor that appears to exist for unbounded values of the bifurcation parameter m as verified in our intensive numerical computations (Fig. 6).
We observe from Fig. 6 that although the magnitude of chaotic changes in the y variable stays bounded as in Fig. 6 b, the magnitude of chaotic changes in the x variable grows monotonically as the values of the bifurcation parameter m increase as in Fig. 6 a. The complex dynamics within such strange attractors is called “unbounded chaos” (35). Moreover, the theory predicts the existence of a cascade leading to the formation of strange attractors with unbounded chaos (35).
Effect of noise
We now briefly explore the effect of additive noise by studying the Itô stochastic differential equation (SDE):
| (7a) |
| (7b) |
In the SDE given in Eqs. 7a and 7b, the parameters ε12 and ε22 describe the variance rates for the changes in the net rates of the random variables X and Y, respectively. Recall that the stochastic differentials dWX and dWY describe the standard Winner process (the standard Brownian motion) (48, 49). We write the SDE using a full differential form because WX and WY are nowhere differentiable with probability one (48, 50), and we solve the SDE numerically using the Milstein scheme (50, 51) implemented in the MATLAB SDE Toolbox (52).
The results of numerical simulation of the SDE for different noise levels are shown in Fig. 7 for the set of parameter values corresponding to model 1, and in Fig. 8 for the set of parameter values corresponding to the unity model. In each case, five traces or, equivalently, five stochastic trajectories starting from the same initial conditions are computed and used to plot the corresponding stochastic bifurcation diagrams.
Figure 7.
Bifurcation diagrams with respect to the external period T in the presence of noise (unity model 1). Here, (a–c) correspond, respectively, to the noise levels ε2 = 0.01, ε2 = 0.1, and ε2 = 1.0 taken from Eqs. 7a and 7b. In all cases, ε1 = 10−6. The deterministic parameter values are as used in Fig. 2, a and b.
Figure 8.
Bifurcation diagrams with respect to the external period T in the presence of noise (unity model 1). Here, (a) and (b) correspond to the noise level ε2 = 0.01 taken from Eqs. 7a and 7b; and (c) and (d) correspond to the noise level ε2 = 0.1 taken from Eqs. 7a and 7b. In all cases, ε1 = 10−6. The deterministic parameter values are as used in Fig. 2, c and d.
We observe that for the smallest variance (the noise level ε2 = 0.01 in Figs. 7 a and 8, a and b), the stochastic bifurcation diagrams are similar to the corresponding fully deterministic bifurcation diagrams shown in Fig. 2. For the medium-valued variance (the noise level ε2 = 0.1 in Fig. 7 b), the structure of deterministic bifurcation diagrams is preserved, although large numerical clouds become clearly visible. For the larger values of the variance (the noise level ε2 = 1.0 in Fig. 7 c, and ε2 = 0.1 in Fig. 8, c and d), the structure of the corresponding deterministic bifurcation diagrams is destroyed. If the values of the variances are further increased, the deterministic strange attractors disappear at the cost of stability loss.
Conclusions
We showed that simple biochemical systems commonly seen in models of sensing and signal transduction pathways are able to exhibit a rich bifurcation structure into subharmonic oscillations, and even chaotic behavior, in response to periodic excitations.
The appearance of subharmonic responses is by no means an automatic property of cellular biochemical systems, however. For example, models of processes involved in gene transcription (53) and mRNA translation (54) can be shown to display the opposite behavior, namely entrainment, which means that all solutions have the same frequency as the forcing periodic signal. More generally, the synchronization of oscillators to external signals whose magnitude is large enough to enter the “Arnold tongue” insures that solutions will have the same frequency as the input (55). As pointed out in a recent article (56), entrained responses of biological systems play a key regulatory role in organisms (57, 58, 59).
Although the behavior that we uncovered theoretically is consistent with the nonentrained responses seen experimentally in (14), it is virtually impossible to mathematically prove that an experimentally observed behavior is chaotic, or even perfectly subharmonic, especially in molecular biology, where noisy and relatively low precision measurements are the rule. Nonetheless, this work can serve as an indication that a lack of entrainment, complicated bifurcation structure, and chaotic behavior even in some of the simplest biochemical models, need not necessarily appeal to randomness or complex hidden regulatory pathways.
Author Contributions
E.D.S. and S.J.R. conceived the work. E.V.N. and E.D.S. designed research. E.V.N. performed research and analyzed data. S.J.R. contributed data. E.V.N. and E.D.S. wrote the manuscript.
Acknowledgments
This research was supported in part by grant Air Force Office of Scientific Research FA9550-14-1-0060 and grant Office of Naval Research N00014-13-1-0074.
Editor: Fazoil Ataullakhanov.
Footnotes
Supporting Materials and Methods and eight figures are available at http://www.biophysj.org/biophysj/supplemental/S0006-3495(18)30071-7.
Supporting Material
References
- 1.Ferrell J.E., Jr. Self-perpetuating states in signal transduction: positive feedback, double-negative feedback and bistability. Curr. Opin. Cell Biol. 2002;14:140–148. doi: 10.1016/s0955-0674(02)00314-9. [DOI] [PubMed] [Google Scholar]
- 2.Tyson J.J., Chen K.C., Novak B. Sniffers, buzzers, toggles and blinkers: dynamics of regulatory and signaling pathways in the cell. Curr. Opin. Cell Biol. 2003;15:221–231. doi: 10.1016/s0955-0674(03)00017-6. [DOI] [PubMed] [Google Scholar]
- 3.Pomerening J.R., Sontag E.D., Ferrell J.E., Jr. Building a cell cycle oscillator: hysteresis and bistability in the activation of Cdc2. Nat. Cell Biol. 2003;5:346–351. doi: 10.1038/ncb954. [DOI] [PubMed] [Google Scholar]
- 4.Markevich N.I., Hoek J.B., Kholodenko B.N. Signaling switches and bistability arising from multisite phosphorylation in protein kinase cascades. J. Cell Biol. 2004;164:353–359. doi: 10.1083/jcb.200308060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Craciun G., Tang Y., Feinberg M. Understanding bistability in complex enzyme-driven reaction networks. Proc. Natl. Acad. Sci. USA. 2006;103:8697–8702. doi: 10.1073/pnas.0602767103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Thomson M., Gunawardena J. Unlimited multistability in multisite phosphorylation systems. Nature. 2009;460:274–277. doi: 10.1038/nature08102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Wang L., Sontag E.D. On the number of steady states in a multiple futile cycle. J. Math. Biol. 2008;57:29–52. doi: 10.1007/s00285-007-0145-z. [DOI] [PubMed] [Google Scholar]
- 8.Siegal-Gaskins D., Grotewold E., Smith G.D. The capacity for multistability in small gene regulatory networks. BMC Syst. Biol. 2009;3:96. doi: 10.1186/1752-0509-3-96. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Thomas R. Springer; Berlin, Germany: 1981. On the Relation Between the Logical Structure of Systems and Their Ability to Generate Multiple Steady States or Sustained Oscillations; pp. 180–193. [Google Scholar]
- 10.Shoval O., Goentoro L., Alon U. Fold-change detection and scalar symmetry of sensory input fields. Proc. Natl. Acad. Sci. USA. 2010;107:15995–16000. doi: 10.1073/pnas.1002352107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lazova M.D., Ahmed T., Shimizu T.S. Response rescaling in bacterial chemotaxis. Proc. Natl. Acad. Sci. USA. 2011;108:13870–13875. doi: 10.1073/pnas.1108608108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Hamadeh A., Ingalls B., Sontag E. Transient dynamic phenotypes as criteria for model discrimination: fold-change detection in Rhodobacter sphaeroides chemotaxis. J. R. Soc. Interface. 2013;10:20120935. doi: 10.1098/rsif.2012.0935. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ascensao J.A., Datta P., Igoshin O.A. Non-monotonic response to monotonic stimulus: regulation of glyoxylate shunt gene-expression dynamics in Mycobacterium tuberculosis. PLoS Comput. Biol. 2016;12:e1004741. doi: 10.1371/journal.pcbi.1004741. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Rahi S.J., Larsch J., Cross F.R. Oscillatory stimuli differentiate adapting circuit topologies. Nat. Methods. 2017;14:1010–1016. doi: 10.1038/nmeth.4408. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Matsumoto G., Aihara K., Nagumo J. -i. Chaos and phase locking in normal squid axons. Phys. Lett. A. 1987;123:162–166. [Google Scholar]
- 16.Goldbeter A., Gonze D., Dupont G. From simple to complex oscillatory behavior in metabolic and genetic control networks. Chaos. 2001;11:247–260. doi: 10.1063/1.1345727. [DOI] [PubMed] [Google Scholar]
- 17.Duffing G. Vieweg & Sohn; Berlin, Germany: 1918. Erzwungene Schwingungen bei Veränderlicher Eigenfrequenz und ihre Technische Bedeutung. [Google Scholar]
- 18.Wiggins S. Chaos in the quasiperiodically forced duffing oscillator. Phys. Lett. A. 1987;124:138–142. [Google Scholar]
- 19.Rajasekar S., Lakshmanan M. Period doubling route to chaos for a BVP oscillator with periodic external force. J. Theor. Biol. 1988;133:473–477. [Google Scholar]
- 20.Ueda Y., Abraham R.H., Stewart H.B. Aerial Press; New Orleans, LA: 2001. The Road to Chaos. [Google Scholar]
- 21.Abraham R.H., Ueda Y. Vol. 39. World Scientific; Singapore: 2001. The Chaos Avant-Garde: Memories of the Early Days of Chaos Theory. [Google Scholar]
- 22.Guckenheimer J., Holmes P.J. Vol. 42. Springer Science & Business Media; Berlin, Germany: 2013. Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields. [Google Scholar]
- 23.Holmes P. Ninety plus thirty years of nonlinear dynamics: less is more and more is different. Int. J. Bifurcat. Chaos. 2005;15:2703–2716. [Google Scholar]
- 24.Tomita K., Kai T. Stroboscopic phase portrait and strange attractors. Phys. Lett. A. 1978;66:91–93. [Google Scholar]
- 25.Itō A. Perturbation theory of self-oscillating system with a periodic perturbation. Prog. Theor. Phys. 1979;61:45. [Google Scholar]
- 26.Shoval O., Alon U., Sontag E.D. Symmetry invariance for adapting biological systems. SIAM J. Appl. Dyn. Syst. 2011;10:857–886. [Google Scholar]
- 27.Afraimovich V.S., Arnold V.I., Shilnikov L.P. Springer; Heidelberg, Germany.: 1989. Dynamical Systems V. Encyclopedia of Mathematical Sciences. [Google Scholar]
- 28.Kuznetsov Y.A., Muratori S., Rinaldi S. Bifurcations and chaos in a periodic predator-prey model. Int. J. Bifurcat. Chaos. 1992;2:117–128. [Google Scholar]
- 29.Shilnikov L.P., Shilnikov A.L., Chua L.O. World Scientific; Singapore: 1998. Methods of Qualitative Theory in Nonlinear Dynamics. [Google Scholar]
- 30.Guckenheimer J., Wechselberger M., Young L.-S. Chaotic attractors of relaxation oscillators. Nonlinearity. 2006;19:701. [Google Scholar]
- 31.Anishchenko V.S., Astakhov V., Schimansky-Geier L. Springer Science & Business Media; Berlin, Germany: 2007. Nonlinear Dynamics of Chaotic and Stochastic Systems: Tutorial and Modern Developments. [Google Scholar]
- 32.Wiggins S. Vol. 73. Springer Science & Business Media; Berlin, Germany: 2013. Global Bifurcations and Chaos: Analytical Methods. [Google Scholar]
- 33.Feigenbaum M.J. The universal metric properties of nonlinear transformations. J. Stat. Phys. 1979;21:669–706. [Google Scholar]
- 34.Feigenbaum M.J. Universal behavior in nonlinear systems. Physica D. 1983;7:16–39. [Google Scholar]
- 35.Sander E., Yorke J.A. A period-doubling cascade precedes chaos for planar maps. Chaos. 2013;23:033113. doi: 10.1063/1.4813600. [DOI] [PubMed] [Google Scholar]
- 36.Holmes P. A nonlinear oscillator with a strange attractor. Phil. Trans. R. Soc. Lond. A. 1979;292:419–448. [Google Scholar]
- 37.Khibnik A.I., Kuznetsov Y.A., Nikolaev E.V. Continuation techniques and interactive software for bifurcation analysis of ODEs and iterated maps. Physica D. 1993;62:360–371. [Google Scholar]
- 38.Neirynck N., Al-Hdaibat B., Meijer H.G.E. Using MatContM in the study of a nonlinear map in economics. J. Phys. Conf. Ser. 2016;692:012013. [Google Scholar]
- 39.Bogoliubov N.N., Mitropolsky Y.A. Hindustan Publishing Corporation; Delhi, India: 1961. Asymptotic Methods in the Theory of Non-Linear Oscillations. [Google Scholar]
- 40.Bogoliubov N.N., Mitropolsky Y.A., Gillis J. Asymptotic methods in the theory of non-linear oscillations. Phys. Today. 1963;16:61. [Google Scholar]
- 41.Nikolaev E.V., Atlas J.C., Shuler M.L. Sensitivity and control analysis of periodically forced reaction networks using the Green’s function method. J. Theor. Biol. 2007;247:442–461. doi: 10.1016/j.jtbi.2007.02.013. [DOI] [PubMed] [Google Scholar]
- 42.Wolf A., Swift J.B., Vastano J.A. Determining Lyapunov exponents from a time series. Physica D. 1985;16:285–317. [Google Scholar]
- 43.Melbourne I., Gottwald G.A. Power spectra for deterministic chaotic dynamical systems. Nonlinearity. 2007;21:179. [Google Scholar]
- 44.Dunn P.F. CRC Press; Boca Raton, FL: 2014. Measurement and Data Analysis for Engineering and Science. [Google Scholar]
- 45.Marchesoni F. Nucleation of kinks in 1+1 dimensions. Phys. Rev. Lett. 1994;73:2394–2397. doi: 10.1103/PhysRevLett.73.2394. [DOI] [PubMed] [Google Scholar]
- 46.Myrberg P.J. Sur l’itération des polynomes réels quadratiques. J. Math. Pures Appl. 1962;41:339–351. [Google Scholar]
- 47.Myrberg P.J. Iteration der reellen polynome zweiten grades III. Ann. Acad. Sci. Fenn. [Biol.] 1963;336:1. [Google Scholar]
- 48.Higham D.J. An algorithmic introduction to numerical simulation of stochastic differential equations. SIAM Rev. 2001;43:525–546. [Google Scholar]
- 49.Allen L.J.S. CRC Press; Boca Raton, FL: 2010. An Introduction to Stochastic Processes with Applications to Biology. [Google Scholar]
- 50.Evans L.C. Vol. 82. American Mathematical Society; Providence, RI: 2012. An Introduction to Stochastic Differential Equations. [Google Scholar]
- 51.Higham D.J. Modeling and simulating chemical reactions. SIAM Rev. 2008;50:347–368. [Google Scholar]
- 52.Picchini, U. 2007. SDE toolbox: simulation and estimation of stochastic differential equations with MATLAB. http://www.maths.lth.se/matstat/staff/umberto.
- 53.Russo G., di Bernardo M., Sontag E.D. Global entrainment of transcriptional systems to periodic inputs. PLoS Comput. Biol. 2010;6:e1000739. doi: 10.1371/journal.pcbi.1000739. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Margaliot M., Sontag E.D., Tuller T. Entrainment to periodic initiation and transition rates in a computational model for gene translation. PLoS One. 2014;9:e96039. doi: 10.1371/journal.pone.0096039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Pikovsky A., Rosenblum M., Kurths J. Cambridge University Press; Cambridge, United Kingdom: 2001. Synchronization: A Universal Concept in Nonlinear Sciences. [Google Scholar]
- 56.Gupta A., Hepp B., Khammash M. Noise induces the population-level entrainment of incoherent, uncoupled intracellular oscillators. Cell Syst. 2016;3:521–531.e13. doi: 10.1016/j.cels.2016.10.006. [DOI] [PubMed] [Google Scholar]
- 57.Han Q., Bagheri N., Love J.C. Polyfunctional responses by human T cells result from sequential release of cytokines. Proc. Natl. Acad. Sci. USA. 2012;109:1607–1612. doi: 10.1073/pnas.1117194109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Kalsbeek A., la Fleur S., Fliers E. Circadian control of glucose metabolism. Mol. Metab. 2014;3:372–383. doi: 10.1016/j.molmet.2014.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Lin Y., Sohn C.H., Elowitz M.B. Combinatorial gene regulation by modulation of relative pulse timing. Nature. 2015;527:54–58. doi: 10.1038/nature15710. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.








