Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2012 Jul 16;7(7):e40085. doi: 10.1371/journal.pone.0040085

Interplay between Path and Speed in Decision Making by High-Dimensional Stochastic Gene Regulatory Networks

Nuno R Nené 1,*, Alexey Zaikin 2
Editor: Jürgen Kurths3
PMCID: PMC3398018  PMID: 22815725

Abstract

Induction of a specific transcriptional program by external signaling inputs is a crucial aspect of intracellular network functioning. The theoretical concept of coexisting attractors representing particular genetic programs is reasonably adapted to experimental observations of “genome-wide” expression profiles or phenotypes. Attractors can be associated either with developmental outcomes such as differentiation into specific types of cells, or maintenance of cell functioning such as proliferation or apoptosis. Here we review a mechanism known as speed-dependent cellular decision making (SdCDM) in a small epigenetic switch and generalize the concept to high-dimensional space. We demonstrate that high-dimensional network clustering capacity is dependent on the level of intrinsic noise and the speed at which external signals operate on the transcriptional landscape.

Introduction

The conceptual framework of attractors in phase space representing particular transcriptional programs has been demonstrated in experimental observations of “genome-wide” expression profiles, e.g. in neutrophil differentiation [1], [2]. An attractor or dynamical regime is a stable solution to the set of mathematical equations that describe a dynamical system: that is, it represents the state of equilibrium to which a system will tend to move. Dynamical systems often have more than one solution, or attractor. In gene regulatory systems these can be either developmental outcomes such as specific types of differentiated cells, or maintenance of cell functioning such as proliferation or apoptosis. Each attractor, in normal circumstances, represents the adequate response to the combination of external signals and corresponds to a particular mRNA and protein concentration pattern [1][3]. Cell fate commitment has been correlated with both external signal duration and amplitude [4]. Additionally, the speed at which external signals induce changes on transcriptional landscapes has also recently been explored as an important mechanism for cell fate decision [5]. In fact, one of the mechanisms reported here explores this in connection with Speed-dependent Cellular Decision Making (SdCDM) observed in low order circuit models [5], but in a high-dimensional circuit. In Fig. 1 the main aspects of this mechanism are reviewed for the low order circuit explored in [5]. The combination of external signals Inline graphic (see Fig. 1A and B) in the low order circuit takes the system from a state where the cell has only one possible end state (point Inline graphic), to a situation of bistability (Inline graphic), and finally to a point (Inline graphic) (see Fig. 1D) where the system ends up in one of two possible states. This constitutes the result of cellular decision making. Depending on the maximum of the time-dependent asymmetry between external signals (see Fig. 1C), the system will enter the bistability region at a different point of the Inline graphic border (see Fig. 1D). Because the external signals end in the same values, one only has a transient asymmetry which biases the cellular decision making towards one of the available states in region Inline graphic. Therefore, the interval the system is exposed to that asymmetry influences the outcome of the decision. In the case of the simulations represented in Fig. 1, because Inline graphic had always a smaller rising time (Inline graphic) than Inline graphic (Inline graphic), the final state selected with the highest probability was Inline graphic (H corresponds to high concentration values and L to low concentration values). The values of all parameters associated with transcription or translation processes were assumed to be symmetric in the circuit of Fig. 1A, in order to focus on the bias provided by external signals [5]. If the two signals Inline graphic and Inline graphic were identical and evolved in time at equal rates, the cell would undergo a transition to bistability through the straight line segment Inline graphic. Along this segment there is complete symmetry, and consequently the cell would choose its fate stochastically between the two equally possible steady states. An interesting mechanism that was found in [5], the SdCDM effect (Fig. 1D), is associated with the fact that the combination of external signals is most efficient in selecting the attractor Inline graphic in the face of fluctuations when the rising times Inline graphic are larger (for a constant maximum asymmetry Inline graphic respecting Eq. (1), where Inline graphic stands for the maximum amplitude allowed for each external signal). This is a consequence of larger Inline graphic’s corresponding to smaller sweeping speeds through the critical region.

Figure 1. Paradigmatic integrated low order signaling–transcriptional circuit switch and speed-dependent cellular decision making.

Figure 1

(A) Schematic representation: Nodes represent proteins, regulated by protein kinases with concentrations Inline graphic and Inline graphic, where Inline graphic and Inline graphic stand for transcription factors that can be phosporylated to generate Inline graphic and Inline graphic. Black lines represent transcriptional interactions, while grey lines stand for protein-protein interactions. (B) Time evolution of the input signals Inline graphic (black) and Inline graphic (grey), with Inline graphic. In [5] Inline graphic was considered to have a rising time Inline graphic smaller than Inline graphic. (C) Amplitude of the transient asymmetry between signals Inline graphic. Here the maximal asymmetry is given by Eq. (1). (D) Phase diagram for Inline graphic in the space (Inline graphic). Thin lines represent borders between different regimes: Inline graphic stands for monostability, with Inline graphic having a low or a high value, respectively. Inline graphic denotes bistability between two states at which Inline graphic and Inline graphic have opposite concentrations, (high, low) or (low, high). Inline graphic, Inline graphic and Inline graphic correspond to the initial (Inline graphic), intermediary (Inline graphic), and final (Inline graphic) points of the signaling (see Fig. 1B and C). (E) Dependence of the fraction Inline graphic of cells that end up in the Inline graphic, on the speed of the transition (measured by Inline graphic) for different values of the maximum asymmetry A (see Fig. 1C). Noise intensity equals 0.01 for Fig. 1E, Inline graphic and there is no time scale difference between phosphorylation and transcription reactions. For further details see [5].

graphic file with name pone.0040085.e050.jpg (1)

As in canonical models of nonequilibrium statistical physics [6] or dynamic bifurcations [7], the probability that during the sweeping process the system forced by noise jumps across the potential barrier located at the basin of attraction boundary separating the desired end state Inline graphic from Inline graphic, is reduced when the system goes slowly through its critical region.

In the present work, we extend the findings reviewed above, and fully explored in [5], to a high-dimensional genetic switch (see Fig. 2) in the presence of fluctuations (see also Methods). High-dimensional switches have been used before to model generalized, switch-like competitive basic Helix-Loop-Helix heterodimerization networks in the context of differentiation [8][10]. A set of rules for the clustering capacity of this type of network was devised as a function of competition between synthesis, degradation and complex formation rates of different elements. In our work we will focus on a specific type of network parameters that induce multistability but in a different class of models (see Methods) from those previously explored in [8][10].

Figure 2. Representation of the high-dimensional genetic decision switch with external stimulation.

Figure 2

Nodes 6 to 15 represent proteins, transcription factors. Signals Inline graphic represent protein kinases. Only nodes 6 to 10 need to be activated (phosphorylated) to act on any promoter region of the rest of the transcription factors in the network. Each transcription factor reinforces its own expression (black arrows) and represses (red links) all other nodes. Phosphorylation reactions are represented by grey arrows. See also figure legend on right hand side.

The high-order transcriptional circuit chosen will be stimulated by a set of external signals Inline graphic (see Fig. 2) driving gene expression, a common assumption in gene regulatory network models [2], [4], [5]. For simplicity, each external signal combination Inline graphic will only differ on their rising times Inline graphic (see for illustration purposes the example presented in Fig. 1B for the low order circuit). As with the bistable switch previously studied [5], the differences in rising times impose time-dependent asymmetries which are processed by the network. Unlike the low order decision genetic switch, here we additionally consider an extra layer of nodes Inline graphic that should respond to the activity of the “genomic gateway” set of nodes Inline graphic (see Fig. 2). We chose to work with five inputs because it stands as the number of nodes most often associated in the literature with competing attractor selection by signals [11]. Usually, the external signals studied are: Akt, whose activity has been correlated with apoptosis; Erk, which is linked with proliferation; Rac, which regulates the cytoskeletal activity; Sapk and p38, which are cellular stress related nodes [11]. For simplicity purposes and in order to generalize the structure of the genetic switch studied before [5], we limited the number of nodes to five in both layers of transcription factors represented in Fig. 2. An important feature of our model is the fact that only half of the transcription factors (from Inline graphic to Inline graphic, see Fig. 2) need to go through an activation reaction before being able to act on a downstream promoter region. This models generically the action of signaling molecules on Immediate Early Gene products (IEGs) such as c-jun, c-fos and c-myc [12]. The rest of the transcription factors (from Inline graphic to Inline graphic, see Fig. 2) operate even if no signal is present. They stand for Delayed Early Gene products (DEGs), the second wave of transcription initiated by the signal [12]. Although this scenario is a condensed approach to modeling the interface between the signaling module and the transcriptional machinery, it serves our objective: observe and generalize the effects of parameter sweeping speed and transient external asymmetries on high-dimensional attractor selection in phase space, here equated with the space of concentrations of each of the transcription factors.

The combinations of external signals are expected to be associated with particular transcriptional programs [1], [12], [13]. The progression from an initial state or phenotype to the outcome of cell fate decision is performed by a sequence of steps or path in phase space [1], [2], [14]. This path is determined to an extent by Inline graphic (see Fig. 2), in the case of our model. Due to the fact that gene expression is affected by fluctuations [15], the path forced by the external inputs may suffer substantial alterations which may affect cellular decision making. Therefore, not only external signal amplitudes and duration [4], [16], [17] but also their shapes determined by rising and decay times may become relevant.

Results and Discussion

High-dimensional Regulatory Network Exhibits Multistability

An extensive study of all sets of parameters (see Methods and Table 1) and Inline graphic connectivity matrices (with Inline graphic and Inline graphic) was performed for the high-dimensional genetic switch. We selected the network that exhibited the highest number of attractors in phase space in order to generate, potentially, maximum discrimination between combinations of inputs. The resultant connectivity between the set of signaling inputs Inline graphic and the set of transcription factors activated by phosphorylation (see Fig. 2) was the following (see Eq. (2)):

graphic file with name pone.0040085.e068.jpg
graphic file with name pone.0040085.e069.jpg (2)

Table 1. Parameters in the high-dimensional decision genetic switch with external stimulation model.

Parameter Interpretation Value
Inline graphic External signal Inline graphic Inline graphic, Inline graphic and Inline graphic, Inline graphic
Inline graphic Maximum amplitude of any Inline graphic Inline graphic
Inline graphic Rising times of Inline graphic
Inline graphic Maximum asymmetry between Inline graphic and Inline graphic Inline graphic
Inline graphic Basal transcription rate multiplied by translation rate divided by Inline graphic and protein degradation rates Inline graphic
Inline graphic Ratio between binding and unbinding affinities of dimers to promoter regions for self-activation, respectively Inline graphic
Inline graphic Ratio between binding and unbinding affinities of dimers to promoter regions for cross-inhibition, respectively Inline graphic
Inline graphic Ratio between rate of expression of the respective gene when homodimers are bound and basal transcription Inline graphic
Inline graphic Combined dimensionless time scale for transcription and translation of proteins Inline graphic and Inline graphic
Inline graphic Dimensionless time scale for phosphorylation processes Inline graphic
Inline graphic Allowed order of dimers, homo and hetero, in the high-dimensional genetic switch model Inline graphic
Inline graphic Intensity of Gaussian noise Inline graphic with zero mean and Inline graphic Inline graphic, Inline graphic and Inline graphic

Parameters used in Eqs. (6) to (10) and their respective interpretation and values. See also [39].

Each link between Inline graphic’s and Inline graphic’s (see Eq. (2)), with Inline graphic and Inline graphic, is stimulatory. As in the study performed on the low order genetic switch with external stimulation [5] (see also Fig. 1), we will focus on the bias produced by the set of external signals Inline graphic stimulating the high-dimensional genetic switch. Therefore, any parameters representing activation or transcription and translation of proteins will be assumed to be equal for each transcription factor node in Fig. 2 (see also Methods and Table 1).

The existence of multistability can be verified, for example, in bifurcation diagrams generated by assuming Inline graphic (see Fig. 3A). For each value of critical parameter Inline graphic the attractors emerging from initiating the system at 100 random initial conditions were recorded and plotted (see also Methods for the equations behind the computations performed). One can clearly verify the existence of multiple attractors for all network nodes. For the set of nodes activated by the external signals Inline graphic, i.e. Inline graphic (see Fig. 2), only when the signal amplitude crosses a certain threshold, Inline graphic for Inline graphic and Inline graphic for Inline graphic, do multiple attractors above zero become clear. Actually, even before the amplitude reaches this point there’s a very fine set of states very close to zero (see Fig. 3B). For the remaining set of transcription factor nodes that do not directly interact with any Inline graphic, i.e. Inline graphic (see Fig. 2), the existence of multiple high concentration stable states is clear even for low values of parameter Inline graphic. Additionally, there is also a very fine set of attractors very close to zero for nodes Inline graphic (see Fig. 3B). As the control parameter Inline graphic is raised the nodes from Inline graphic to Inline graphic tend to show higher and higher stable state concentrations. Nevertheless, a set of low concentration steady states is still observed for all values of Inline graphic and for all nodes with the exception of Inline graphic. Regarding the nodes from Inline graphic to Inline graphic, higher levels of Inline graphic reduce the stable state concentration levels (Fig. 3A). The finer structure of stable states close to zero is also maintained for this set of transcription factors (Fig. 3B).

Figure 3. Bifurcation diagram for each of the transcription factors for Inline graphic.

Figure 3

(A) Complete bifurcation diagram. Inset: detail of branches near Inline graphic. (B) Amplification of states represented in (A) close to zero. Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic, for Inline graphic (see Methods). Inline graphic is the horizontal axis for all the figures, from Inline graphic to Inline graphic. Inline graphic, i.e. the concentration of each transcription factor is represented here by Inline graphic and associated with Inline graphic in Eqs. (7) and (8) with Inline graphic (see Methods). In the construction of the bifurcation diagrams 100 initial conditions were randomly selected for each Inline graphic and the long term trajectories recorded and plotted.

The bifurcation diagrams in Fig. 3 show that for the chosen set of parameters the system seems to go through a subcritical type of bifurcation, due to the disconnection between emerging branches. Indeed, this class of models and set of parameters has shown to induce in 2 dimensional genetic switches a transition between a region of 1 stable state with low concentration values, and another with three stable states with high concentration values [4]. Although the model in [4] was slightly different (only homodimers were allowed), if a similar process is present in our circuit then the disconnection is indeed caused by a subcritical type of bifurcation. On the other hand, the type of bifurcation present may be supercritical and further sampling of the state space is necessary to dismiss other options. Although the mechanism of SdCDM has been explored in supercritical systems and relies on both the intrinsic dynamics of the system and the dynamics of the external driving signal near the bifurcation point [5], [6], subcritical systems may also reveal speed-dependent effects when control parameters are made time-dependent [18].

For the time-dependent external signals studied ahead, the asymmetries Inline graphic (with Inline graphic) between each of the inputs influence the available attractors in the system at each time step, as was the case of the small genetic switch studied in [5] and summarized in Fig. 1. Further ahead we will focus on three specific input combinations. Their bifurcation diagrams show relatively small differences (compare Figs. S1, S2 and S3). Yet, as will be seen in following sections, this is sufficient to induce differences in long-term distributions over stable states when fluctuations are considered.

Clustering of Input Signal Combinations

In order to understand if differences in time-dependent input signal profiles force the system to converge to different attractors, we tested the response of the high-dimensional decision switch to a batch of 100 combinations of inputs, Inline graphic, generated by randomly selecting Inline graphic’s (see Fig. 1B for illustration purposes) for each input Inline graphic. The maximum amplitude Inline graphic allowed for each signal Inline graphic was 2. This value arose from the initial investigations that led to the choice of a set parameter values (see Table 1) and Inline graphic connectivity matrices, with Inline graphic and Inline graphic (see Eq. (2)), that generated the highest number of attractors. For each combination Inline graphic the system was randomly initiated at 100 initial conditions, with Inline graphic, for Inline graphic (see Methods and Table 1). Subsequently, the asymptotic stable states were recorded for each of the combinations Inline graphic and each of the initial conditions long after the largest Inline graphic had been reached. For all input combinations the set of initial conditions was exactly the same.

In order to quantify the differences in the number of trajectories converging to each stable state forced by each combination Inline graphic, the average Euclidean distance (AED, see Eq. (3)) between the set of concentrations Inline graphic, in the limit of large times, was compared for all possible pairs Inline graphic and averaged over the number of initial conditions tested (Inline graphic in Eq. (3)). Further investigations will be performed in subsequent studies by applying other distance metrics in high-dimensional phase space, e.g. the ISOMAP [2], [19] or extensions thereof [20]. Here we must stress that the bifurcation diagrams shown in Figs. 3, S1, S2 and S3 represent only the available stable states at each amplitude of the external signals. When time-dependent signals are considered the configuration of the phase space changes with time. Despite the fact that the available stable states for each amplitude, at each time instant, are the same as those determined in the respective bifurcation diagrams, the dynamics arising from changing the phase space in time will not be the same as that arising from holding the signal amplitudes at a certain level and letting the system converge to its asymptotic state. Further analysis is necessary to quantify exactly the differences in the dynamics stemming from both situations. Here, we will focus only on the end state of the sweeping process. We will assert if possible differences in the dynamics arising from a phase space changing with time result in significant changes in the selectivity of attractors.

graphic file with name pone.0040085.e168.jpg (3)

In Fig. 4A and B, the results obtained from the application of Eq. (3) can be visualized for two time scale ratios Inline graphic (see Methods and Table 1). Because the matrices presented are symmetric we need only to observe values below the diagonal. In both matrices one can verify that certain pairs Inline graphic force the system to converge to different attractors even if the initial conditions and the initial and final amplitudes for each Inline graphic are the same (red pixels, higher Inline graphic distance). Others, for the same initial conditions, select exactly the same attractors, on average (blue pixels, lower Inline graphic). This indicates that certain combinations Inline graphic of signals Inline graphic are clustered together due to the incapacity of the network to memorize the transient asymmetries Inline graphic (with Inline graphic) intrinsic to each of them. In order to verify if the pairs Inline graphic inducing the same attractors were doing it because their differences were very reduced, we calculated the distances between the input vectors Inline graphic corresponding to each pair of input combinations (see Fig. 4 C), by applying a correlation based metric. By visual inspection (see for example Fig. 4A and C) we can conclude that no clear correlation exists between the distance between input vectors Inline graphic and the average euclidean distances (AED, see Eq. (3)). Indeed, the correlation between the vectors obtained by concatenation of the lines of each of the matrices represented in Fig. 4A and C, and Fig. 4B and C, is 0.1283 and 0.1588, respectively.

Figure 4. Pair-wise average distance between asymptotically stable states induced by input combinations.

Figure 4

(A) Results for time scale ratio Inline graphic calculated through Eq. (3) and (B) Inline graphic. (C) Distance between pairs of vectors Inline graphic, calculated through the distance metric Inline graphic, with Inline graphic being the Pearson coefficient of correlation between the actual vectors Inline graphic and Inline graphic. Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression)(see Methods), for Inline graphic.

Observing Fig. 4B we see that overall the AED distance (Eq. (3)) for each pair of input combinations is decreased if the time scale ratio (Inline graphic) (see Methods) of transcription over phosphorylation processes is raised. This effect had been seen already in the low-order decision genetic switch [5], although in the presence of fluctuations. In real biological systems the time scale differences between phosphorylation and transcription reactions can be substantial [21]. If genetic circuits are not sensitive to slight differences between driving external signals when time scale separation is significant, then integration of signals is only successful when very pronounced external asymmetries occur. Ultimately, only considerable differences in amplitude held for an interval compared to the characteristic relaxation time scale of the system will be discriminated efficiently.

Path-dependent Effects on Attractor Selectivity in the Presence of Multiplicative Noise

In order to prove the existence of path-dependent effects in attractor selectivity in the presence of fluctuations, first we analyzed the inter-trajectory distance for every pair (Inline graphic generating the same end attractors when Inline graphic (see Fig. 4A, dark blue pixels) and noise intensity is zero. For this calculation we used the correlation based distance metric Inline graphic represented in Eq. (4), where Inline graphic stands for correlation between trajectories induced by vectors Inline graphic and Inline graphic. Throughout our work selectivity represents the fraction of trajectories in a stochastic simulation that converge to a specific attractor.

graphic file with name pone.0040085.e201.jpg (4)

The pair Inline graphic with input combinations inducing the same end attractors that had, at a particular instant, the highest maximum for the inter-trajectory distance Inline graphic (Eq. (4)) amongst all the pairs was Inline graphic (see Fig. 5B). On the other hand, the pair exhibiting the smallest maximum was Inline graphic (see Fig. 5B). The time-dependent profiles for Inline graphic, Inline graphic and Inline graphic can be visualized in Fig. 5A. A typical trajectory in time can also be observed in Fig. 5C. The trajectory presented corresponds to the evolution of the system by applying Inline graphic. Yet, it represents the typical dynamics observed for any input combination Inline graphic, the only difference being the allocation of nodes per stable state. Regarding the switching dynamics, usually the trajectories converge very rapidly to high or low concentration values (Fig. 5D). Subsequently, for nodes migrating to low concentration values there is a further reorganization of states (Fig. 5E). In the vicinity of the instant when all Inline graphic’s have reached their maximum amplitude there’s further reorganization of states with certain nodes reaching intermediate concentration values (see Fig. 5C and E). Although for the example shown in Fig. 5C it is not clear the existence of multiple attractors at high concentration values, these do exist as can be visualized in the bifurcation diagrams of Figs. 3, S1, S2 and S3.

Figure 5. Inter-trajectory distance, profile of specific input combinations and typical switching dynamics.

Figure 5

(A) Time-dependent profile for each input Inline graphic for 3 input combinations: Inline graphic, Inline graphic, Inline graphic. (B) Inter-trajectory distance for pairs Inline graphic inducing the same attractors (see Fig. 4A). Pairs exhibiting the highest value for Inline graphic (Eq. (4)) and the lowest value for Inline graphic. Inset: zoom of Inline graphic curve for Inline graphic. (C) Typical evolution of concentrations for all the nodes Inline graphic, Inline graphic. This particular trajectory was generated by applying Inline graphic and noise intensity Inline graphic (see Methods). (D) Amplification of (C) for early times t. (E) Amplification of (C) for concentrations Inline graphic close to zero. Inline graphic, i.e. the concentration of each transcription factor is represented here by Inline graphic and associated with Inline graphic in Eqs. (7) and (8) with Inline graphic (see Methods). Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic (see Methods), for Inline graphic.

The probability of each attractor when all Inline graphic are held at an amplitude of 0 and Inline graphic can be seen in Fig. 6. One should remember that each of the selected combinations Inline graphic has exactly the same initial and final signal amplitudes. Therefore the phase space looks exactly the same. If any differences arise due to path-dependent effects forced by the time-dependent asymmetries Inline graphic, then the frequencies observed for each attractor when the selected input combinations are applied will be different (discussed ahead). Fig. 6 was obtained by collecting the stable-state values for the concentration of each Inline graphic (see Fig. 2) starting at 100 initials conditions, and in the absence of noise.

Figure 6. Initial and final attractor frequency in the absence of fluctuations.

Figure 6

(A) Attractors available for Inline graphic, with Inline graphic, and respective frequency. (B) Attractors available for Inline graphic, with Inline graphic. The frequency of the attractors shown here will change when each of the selected input combinations is applied in the presence of fluctuations. This stems from path-dependent effects on attractor selection (discussed in main text). Inline graphic, i.e. the concentration of each transcription factor is represented here by Inline graphic and associated with Inline graphic in Eqs. (7) and (8) with Inline graphic (see Methods). Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic, Inline graphic (see Methods), for Inline graphic.

One can observe that, when every Inline graphic is equal to Inline graphic, the nodes Inline graphic (Fig. 6B) show propensity to converge to attractors with intermediate and high concentrations. Regarding this set of nodes it is possible to verify that there is also some probability of reaching attractors close to zero. These low concentration attractors are very close to each other (see Fig. 3B). One should add that regarding node Inline graphic the presence of attractors states close to zero at high external signal amplitudes is inconsistent with what we observed for the bifurcation diagram in Fig. 3. For node Inline graphic the opposite of what is verified for Inline graphic occurs. We must then conclude that this discrepancy arises from initial condition sampling issues. For nodes corresponding to the DEG layer, i.e. Inline graphic (see Fig. 2), higher selectivity frequencies for most of the nodes are registered for attractors with higher concentrations. However, there is still a high number of trajectories with asymptotic states near zero (Fig. 6B).

The three input combinations Inline graphic, Inline graphic and Inline graphic were once again applied to the circuit but in the presence of fluctuations. Overall, the data from 5000 trajectories for each selected input combination was collected, including random starting points in phase space. Several observable changes in the attractors selected were noticed. For the IEG layer of transcription factors, i.e. Inline graphic (see Fig. 2), there was a considerable transfer of probability mass to states located near zero (figure not shown). These were not identified as being very probable in the deterministic scenario (see Fig. 6B). The addition of noise forces the system to jump across potential barriers, located at the basin of attraction boundaries, to stronger attractors which, in this case, are closer to zero. As was seen in the one dimensional canonical model [22], according to Kramer’s classical theory [23] the transition time for a system in one dimension to jump across the potential barrier decreases with noise intensity. There are several aspects of the attractor selection process that might be occurring here. First, let us recall the probability distribution shown in Fig. 6. These results are dependent only on differences in attractor basins and number of initial conditions tested. The basin of attraction in dynamical system theory is taken as the percentage of points converging to a specific attractor [24]. Sampling 100 initial points randomly may not have probed completely the phase space. Higher sampling could have revealed finer aspects of attractor basins. A second aspect of the selection process arises as a function of the fact that different externals signals are exerting different changes on the attractor landscape. If the probability mass transfer to attractors located near zero was only a consequence of the combination of input signals, then the differences observed in the presence of noise should have been more pronounced. The only clear differences recorded had very low probabilities (figure not shown). We can conclude from these observations that, although the asymmetries induced by each combination Inline graphic play a significant part in the high frequencies found for low concentration values for the set of nodes Inline graphic to Inline graphic, this occurrence is also intrinsically related to the concept of attractor strength. This concept is defined as the minimum size of a perturbation (in our case noise) that results in a very low probability of return [24]. Regarding the frequency of the attractors found for the DEG layer of transcription factor nodes, i.e. Inline graphic, the distribution does not differ considerably in terms of location from that generated in the deterministic scenario. The differences between applying each pair of combinations, Inline graphic or Inline graphic, occur mostly in the same set of attractors at high concentration values. Actually, applying one or another input combination shifts the probability maximum to an attractor in the vicinity. We conclude that regarding the DEG layer the differences arising from the application of each of the selected input combinations induces smaller changes in the final distribution of trajectories across attractors.

We further evaluated the distance between distributions for several noise intensities (see Fig. 7) to understand if, as in the small integrated signaling-gene regulatory decision switch [5], noise increases symmetry between the distribution across attractors or if its effect is not as strong as previously observed and it only causes new attractors to be populated in conjunction with the changes exerted by each Inline graphic. The distance metric Inline graphic used for the following investigations is a correlation based metric, where Inline graphic stands for the correlation between the distributions across attractors, induced by Inline graphic and Inline graphic, in the limit of large times. For the pair Inline graphic, the most noticeable fact when we raised noise intensity from 0.01 to 0.05, is the relative proximity of the distributions for the DEG node layer (Fig. 7A). The 5 fold increment seems to force the system to jump to the strongest attractors. Effectively, comparing by visual inspection the distribution obtained with noise intensity 0.01 and 0.05 (figures not shown), we verified that for noise Inline graphic essentially the maximum frequencies for Inline graphic and Inline graphic occurred at the same attractors. For the IEG layer of nodes the same observation stands although it was not as evident (Fig. 7A). Raising further the noise intensity increased the distance between final distributions, which was to be expected due to the increased capacity to cross potential barriers and, as a result, populate different attractors. For the pair of input combinations Inline graphic that, as was determined before (Fig. 5), had a very small difference between the trajectories in phase space, the tendency observed for the distance calculated between distributions when noise intensity is increased from 0.01 to 0.5 was similar to that of the pair Inline graphic. Also, for these noise intensities Inline graphic is higher than Inline graphic, which is consistent with the fact that Inline graphic (Fig. 5B). Nevertheless, for noise amplitude equal to 0.05 the tendency observed for Inline graphic was not maintained. At this noise intensity, instead of an optimal attractor selection that approximates the distributions, the opposite effect is present. The numerical results reported above indicate that there is an optimal intensity of noise that increases the convergence of trajectories to the same attractors, when the differences between trajectories induced by each Inline graphic is larger. When the differences in phase space trajectory are small the noise optimality effect observed before reverses its role and increases inter-distribution distance.

Figure 7. Distance between final distributions generated by different pairs of input combinations Inline graphic in the presence of fluctuations.

Figure 7

(A) Pair Inline graphic. (B) Pair Inline graphic. Inline graphic is a correlation based metric, where Inline graphic stands for the correlation between the distributions across attractors, induced by Inline graphic and Inline graphic, in the limit of large times. Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic (see Methods), for Inline graphic. Inline graphic stands for noise intensity (see Methods).

The Importance of Sweeping Speed for High-dimensional Attractor Selection in the Presence of Fluctuations

To test SdCDM [5] in the high-dimensional switch we extended the simulation experiments for noise intensity Inline graphic. We chose to perform the extra simulations with the maximum noise intensity to understand if the sweeping speed could override the strong effects of noise. The original selected combinations, Inline graphic, Inline graphic, Inline graphic, were changed in a way that the maximum asymmetry between each of the inputs Inline graphic was maintained but the sweeping speed was decreased. The following steps were taken:

1. For input Inline graphic of the original combination calculate the maximum asymmetry reached between Inline graphic (Inline graphic) and Inline graphic recurring to Eq. (5);

2. Increase Inline graphic by n numerical integration time-steps and calculate the necessary Inline graphic (Eq. (5)) for each of the inputs that maintains the maximum asymmetries Inline graphic between each of the signals Inline graphic and Inline graphic.

graphic file with name pone.0040085.e320.jpg (5)

This strategy secures that the signals induce similar changes in the transcriptional landscape as the original combinations, but at a smaller speed. The distance between the final distributions was calculated again by applying a correlation based distance metric to three extra cases: same input combinations but 100, 300 and 500 numerical integration time-steps slower. The results are shown in Fig. 8. In light of the results obtained for the small genetic decision switch [5] (see also Fig. 1) we expected that the differences between final distributions across attractors induced by each pair Inline graphic would be increased if the speed with which the signals Inline graphic are changed is reduced. Figure 8 shows that, overall, the path-dependent effects registered before for the pair of input combinations Inline graphic are less clear if we perform the sweeping process at lower rates. Comparing with the original results (black bars, Fig. 8A), we can verify that by decreasing the sweeping speed through the bifurcation region (by imposing for example Inline graphic’s 500 time-steps slower) seems to have, for most of the transcription factors, an effect which brings the distributions induced by Inline graphic and Inline graphic closer together. For the other sweeping speed experiments (Fig. 8 A, 100 and 300 steps slower) there seems to be a tendency for the pair Inline graphic to induce closer and closer final distributions as we decrease the sweeping speed. Yet, this occurs in a non-monotonous fashion. This observation contrasts with the findings of speed-dependent decision making in the bistable decision genetic switch (see Fig. 1) where slower sweeping rates increased the sensitivity to external asymmetries. The differences in the final distributions arising from the respective paths in phase space should have been more pronounced. On the other hand, we do observe reasonably clear speed-dependent effects for the high-dimensional switch, although with a different outcome from that of [5]. Further simulation studies, for Inline graphic and Inline graphic, are necessary to clarify the synergistic effects of sweeping speed and noise intensity in high-dimensional phase space with irregular attractor landscapes. Regarding the other input combination pair, Inline graphic (see Fig. 8B), a considerable reduction in sweeping speed (500 time-steps slower) induces exactly the opposite effect observed for Inline graphic. This tendency to observe opposite effects in the input combination pairs used throughout this work is quite intriguing and should be investigated with the complete set of pairs Inline graphic with same end attractors (see Fig. 4). Overall, we observe that slower sweeping speeds induce a higher sensitivity of the high-dimensional circuit to external signals when the differences between the respective paths in high-dimensional phase space, induced by each pair Inline graphic, are smaller.

Figure 8. Inter-distribution distance dependence on sweeping speed.

Figure 8

(A) Inter-distribution distance between the attractors induced by combination Inline graphic and Inline graphic. (B) Inter-distribution distance between the attractors induced by combination Inline graphic and Inline graphic. Inline graphic is a correlation based metric, where Inline graphic stands for the correlation between the distributions across attractors, induced by Inline graphic and Inline graphic, in the limit of large times. Parameters: M = 2, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic (see Methods), for i, j = 6,…,15. Inline graphic stands for noise intensity (see Methods). On each figure each color corresponds to different sweeping speeds obtained by increasing Inline graphic by 100, 300, or 500 numerical integration time-steps.

The generalization of the parameter sweeping mechanism to high-dimensional space demonstrated that it is dependent on phase space structure and the efficiency of noise to induce transitions across potential barriers. Moreover, the capacity of high-dimensional genetic circuits to integrate a combination of complex signals is closely linked to the initial condition chosen. It was also clearly shown that input combinations that generate the same attractors in a deterministic system have significant differences in the final distributions when noise is taken into account. Hence, path-dependent effects exerted by different complex signals and noise are relevant for attractor selectivity and cell fate decision in high-dimensional systems. We have also shown that the speed of signaling in genetic switches changes significantly the result of cellular decision, an effect that we had termed speed-dependent cellular decision making (SdCDM) [5], and that it is also relevant in high order circuits. In contrast to other aspects of nonequilibrium physics [25][27], dynamic bifurcations have only recently been systematically studied in systems biology [5], [28][30], despite involving fundamental aspects of cell fate decision. It is of special interest in this context because all genetic switches are asymmetric and stochastic and, hence, can be expected to demonstrate both path and speed-dependent effects in the process of phenotype selection. Additionally, certain cell differentiation processes have been demonstrated to be driven by slow build-up of decision-driving signals [31] and experiments have revealed that temporal competition can determine cell fate choice in multipotent differentiation [32], thus indicating a predominant role of time-dependent effects.

Regarding the response of the DEG layer of nodes, Inline graphic, to IEG products, Inline graphic, or even external signals Inline graphic (see Fig. 2), recent studies have shown that the function of regulators in the immediate early response “may be used to put the cell into a transient receptive state…by moving the system out of its attractor basin” [33]. In our model this stage arises from the dynamics of the nodes activated by signals. Although further studies are necessary to understand the mutual information between immediate early dynamics and the delayed responses, we should add that the immediate early response not only puts the system in a receptive transient state, but also induces time-dependent changes on the transcriptional landscape in order to generate the correct, or most probable, decision outcome.

Further studies are necessary to understand speed-dependent attractor selection in systems which consider additional inter-cellular connections and thus show coexistence of different dynamical regimes [34], [35]. This endeavor will constitute an interesting extension and contribute to the clarification of real selectivity mechanisms present in cells that execute competing differentiation, proliferation and apoptosis programs. Additionally, SdCDM in spatiotemporal pattern formation could also play a crucial part in the self-organized, stochastic, gradual patterning behavior observed for instance in paradigmatic inter-cellular phenomena arising in development [36]. One can hypothesize that evolution has selected for embryonic development with the optimal cellular differentiation speed. The conditions leading to deviations from this optimal route, the onset of pathologies and their possible treatment, constitute still an important open question. Speed-dependent decision making effects in biological systems contributes to the area of critical transitions in open systems [37], so crucial for the understanding of selectivity mechanisms in a wide range of subjects [38].

Methods

The dynamics of the protein concentrations involved in our circuit (see Fig. 2) is described by a phenomenological model following [39] and assumed to be dimensionless. The variables Inline graphic or Inline graphic (see Eqs. (6) to (10)) represent the concentration of transcription factors, i.e. Inline graphic, in their inactive and active forms, respectively. For each Inline graphic connection, associated with a protein-gene interaction or regulatory process (see Fig. 2), we resorted to a generic representation shown in Eq. (7) and (8). All regulatory interactions to any gene are replaced with an average or effective interaction, taking into account the repression, activation and multimerization mechanisms inherent to epigenetic regulation. This formalism stands as a generalization of [5] but takes into account all possible reactions between input nodes and allows for both hetero and homodimers (see Eqs. (9) and (10)).

graphic file with name pone.0040085.e356.jpg (6)
graphic file with name pone.0040085.e357.jpg
graphic file with name pone.0040085.e358.jpg (7)
graphic file with name pone.0040085.e359.jpg (8)

In this model, Eq. (6) represents activation of transcription factors by phosphorylation-dephosphorylation [12], where the latter is assumed to occur with a constant rate (corresponding to a constant phosphatase concentration, a common assumption in pathway modeling [40]). Phosphorylation is considered to depend on the external signals: Inline graphic, where the sum is done according to the network connectivity set in Eq. (2). In Eqs. (7) the transcriptional input of Inline graphic contains the stimulatory action of its phosphorylated form Inline graphic and the inhibitory effect of Inline graphic, with Inline graphic, and Inline graphic, with Inline graphic (see Eq. (9)):

graphic file with name pone.0040085.e367.jpg (9)

In Eq. (8) the function Inline graphic has a similar formula to Eq. (9), although one has to adapt the term to the fact that the transcription factors from Inline graphic to Inline graphic do not need to be phosphorylated to operate on their promoter regions or on other nodes’ (see Eq. (10)):

graphic file with name pone.0040085.e371.jpg (10)

The parameters Inline graphic represent the ratio between the maximally activated expression rate and basal transcription, while Inline graphic and Inline graphic denote activation and repression thresholds. The parameters Inline graphic are a measure of the promoter strength multiplied by translational efficiency [39] (see also Table 1). Equation (9) is a simplification of the original input contemplating the action of multimers up to order M [39] where Inline graphic stands for

graphic file with name pone.0040085.e377.jpg

For Eq. (10) similar observations stand and Inline graphic has a formula consistent with Eqs. (8) and (10).

We chose to use the class of models described above due to its compact way of dealing with the complex set of reactions inherent to the transcription initiation process. The larger the multimer order, the larger the cooperativity between input species. Depending on the order M of multimers allowed to be formed, several regimes can be generated by combining both negative and positive links between transcription factors: multiple clustering attractors Inline graphic, oscillations Inline graphic and chaotic regimes Inline graphic [39]. In the case of the high-dimensional switch chosen for our work, Inline graphic, and only a high density of multiple stable states are observed (see Figs. 3, S1, S2 and S3).

Eqs. (6) to (10) were derived by assuming that transcription factor binding and unbinding, on the one hand, and Inline graphic dynamics, on the other, are fast when compared to protein dynamics [4], [21], [39]. Although there is also a substantial difference between the time scales of translation and phosphorylation events [21], the profile of activation of each transcription factor or of signals Inline graphic has been demonstrated to be fundamental to understand cell fate decision [16], [17], [41]. Therefore, we maintained the activation Eqs. (6). Moreover, this option allows us to extend in further studies the impact on cell fate decision, here equated with attractor selection, of partial inhibition of phosphorylation processes exerted by specific classes of drugs [42].

Our model assumes that the circuit operates in a constant-volume cell, but takes into account stochastic fluctuations in gene expression [15], through the terms Inline graphic (see Eqs. (7) and (8)) [43]. To that end, Inline graphic represents a Gaussian noise with zero mean and correlation Inline graphic, and models the contribution of intrinsic random fluctuations inherent to transcription and translation processes [44] (see Eqs. (7) and (8)). This multiplicative noise term is interpreted in the Ito sense, which is the correct stochastic interpretation for a noise term arising from stochastic protein-gene interaction events [23], [43]. Here we will not consider extrinsic sources of noise such as fluctuations in kinase or phosphatase numbers (see [5]).

Numerical Methods

All simulation results were performed by numerically integrating the stochastic differential equations using the Heun method [45] with a scaled time-step of Inline graphic. In order to determine each of the quantities represented in the figures shown throughout this work, the set of simulations was performed until an instant far beyond the maximum of each of the rising times for each of the signals Inline graphic in order to secure that the system had converged.

Supporting Information

Figure S1

Bifurcation diagram obtained by setting the parameters Inline graphic following the combination of amplitudes inherent to Inline graphic. (A) Complete bifurcation diagram. Inset: detail of branches near Inline graphic. (B) Amplification of lower part of the bifurcation diagram represented in (A). Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic (see Methods) for Inline graphic. The available attractors at specific times can be visualized. The input combination changes the attractor landscape with respect to the original bifurcation diagram with Inline graphic (see Fig. 3) and the other input sequences Inline graphic and Inline graphic. t is the horizontal axis variable for all the figures, from Inline graphic to Inline graphic. Inline graphic, i.e. the concentration of each transcription factor is represented here by Inline graphic and associated with Inline graphic in Eqs. (7) and (8) with Inline graphic (see Methods). For each time instant t 100 initial conditions were sampled and the respective end attractors recorded and plotted.

(TIFF)

Figure S2

Bifurcation diagram obtained by setting the parameters Inline graphic following the combination of amplitudes inherent to Inline graphic. (A) Complete bifurcation diagram. Inset: detail of branches near Inline graphic. (B) Amplification of lower part of the bifurcation diagram represented in (A). Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic (see Methods) for Inline graphic. The available attractors at specific times can be visualized. The input combination changes the attractor landscape with respect to the original bifurcation diagram with Inline graphic (see Fig. 3) and the other input sequences Inline graphic and Inline graphic. t is the horizontal axis variable for all the figures, from Inline graphic to Inline graphic. Inline graphic, i.e. the concentration of each transcription factor is represented here by Inline graphic and associated with Inline graphic in Eqs. (7) and (8) with Inline graphic (see Methods). For each time instant t 100 initial conditions were sampled and the respective end attractors recorded and plotted.

(TIFF)

Figure S3

Bifurcation diagram obtained by setting the parameters Inline graphic following the combination of amplitudes inherent to Inline graphic. (A) Complete bifurcation diagram. Inset: detail of branches near Inline graphic. (B) Amplification of lower part of the bifurcation diagram represented in (A). Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic (see Methods) for Inline graphic. The available attractors at specific times can be visualized. The input combination changes the attractor landscape with respect to the original bifurcation diagram with Inline graphic (see Fig. 3) and the other input sequences Inline graphic and Inline graphic. t is the horizontal axis variable for all the figures, from Inline graphic to Inline graphic. Inline graphic, i.e. the concentration of each transcription factor is represented here by Inline graphic and associated with Inline graphic in Eqs. (7) and (8) with Inline graphic (see Methods). For each time instant t 100 initial conditions were sampled and the respective end attractors recorded and plotted.

(TIFF)

Footnotes

Competing Interests: The authors have declared that no competing interests exist.

Funding: NRN acknowledges financial support from the Engineering and Physical Sciences Research Council at CoMPLEX, University College London. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Huang S, Eichler G, Bar-Yam Y, Ingber DE. Cell fates as high-dimensional attractor states of a complex gene regulatory network. Phys Rev Lett. 2005;94:128701. doi: 10.1103/PhysRevLett.94.128701. [DOI] [PubMed] [Google Scholar]
  • 2.Huang S, Guo Y, May G, Enver T. Bifurcation dynamics in lineage-commitment in bipotent progenitor cells. Dev Biol. 2007;305(2):695–713. doi: 10.1016/j.ydbio.2007.02.036. [DOI] [PubMed] [Google Scholar]
  • 3.Chang HH, Hemberg M, Barahona M, Ingber DE, Huang S. Transcriptome-wide noise controls lineage choice in mammalian progenitor cells. Nature. 2008;453:544–547. doi: 10.1038/nature06965. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Guantes R, Poyatos J. Multistable decision switches for flexible control of epigenetic differentiation. PLoS Comp Biol. 2008;4(11):e1000235. doi: 10.1371/journal.pcbi.1000235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Nene NR, Garcia-Ojalvo J, Zaikin A. Speed-Dependent Cellular Decision Making in Nonequilibrium Genetic Circuits. PLoS ONE. 2012;7(3):e32779. doi: 10.1371/journal.pone.0032779. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Kondepudi DK, Moss F, McClintock P. Observation of symmetry breaking, state selection and sensitivity in a noisy electronic system. Physica D. 1986;21:296. [Google Scholar]
  • 7.Berglund N, Gentz B. Noise-Induced Phenomena in Slow-Fast Dynamical Systems: A Sample-Paths Approach: Springer-Verlag, London. 2006. 276p
  • 8.Cinquin O, Demongeot J. Positive and negative feedback: striking a balance between necessary antagonists. J Theor Biol. 2002;216(2):229–241. doi: 10.1006/jtbi.2002.2544. [DOI] [PubMed] [Google Scholar]
  • 9.Cinquin O, Demongeot J. High-dimensional switches and the modeling of cellular differentiation. J Theor Biol. 2005;233(3):391–411. doi: 10.1016/j.jtbi.2004.10.027. [DOI] [PubMed] [Google Scholar]
  • 10.Cinquin O, Page KM. Generalized, switch-like competitive heterodimerization networks. Bull Math Biol. 2007;69(2):483–494. doi: 10.1007/s11538-006-9114-8. [DOI] [PubMed] [Google Scholar]
  • 11.Helikar T, Konvalina J, Heidel J, Rogers JA. Emergent decision-making in biological signal transduction networks. Proc Natl Acad Sci USA. 2008;105(6):1913–1918. doi: 10.1073/pnas.0705088105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Brivanlou A, Darnell J. Signal Transduction and the Control of Gene Expression. Science. 2000;295(5556):813–818. doi: 10.1126/science.1066355. [DOI] [PubMed] [Google Scholar]
  • 13.Gaudet S, Janes KA, Albeck JG, Pace EA, Lauffenburger DA, et al. A compendium of signals and responses triggered by prodeath and prosurvival cytokines. Mol Cell Proteomics. 2005;4(10):1569–1590. doi: 10.1074/mcp.M500158-MCP200. [DOI] [PubMed] [Google Scholar]
  • 14.Enver T, Pera M, Peterson C, Andrews PW. Stem cell states, fates, and the rules of attraction. Cell Stem Cell. 2009;4(5):393. doi: 10.1016/j.stem.2009.04.011. [DOI] [PubMed] [Google Scholar]
  • 15.Elowitz M, Levine A, Siggia E, Swain P. Stochastic gene expression in a single cell. Science. 2002;297:1183. doi: 10.1126/science.1070919. [DOI] [PubMed] [Google Scholar]
  • 16.Marshall CJ. Specificity of receptor tyrosine kinase signaling: transient versus sustained extracellular signal-regulated kinase activation. Cell. 1995;80(2):179–185. doi: 10.1016/0092-8674(95)90401-8. [DOI] [PubMed] [Google Scholar]
  • 17.Murphy LO, Smith S, Chen RH, Fingar DC, Blenis J. Molecular interpretation of ERK signal duration by immediate early gene products. Nat Cell Biol. 2002;4(8):556–564. doi: 10.1038/ncb822. [DOI] [PubMed] [Google Scholar]
  • 18.Nicolis G, Nicolis C. Kinetics of phase transitions in the presence of an intermediate metastable state: a generic model. Physics A. 2005;351(1):22–39. [Google Scholar]
  • 19.Tenenbaum JB, de Silva V, Langford JC. A global geometric framework for nonlinear dimensionality reduction. Science. 2000;290(5500):2319–2323. doi: 10.1126/science.290.5500.2319. [DOI] [PubMed] [Google Scholar]
  • 20.Vangelov B, Barahona M. A computational framework for reconstruction of epigenetic landscapes from gene expression data. Experimental Hematology 39(8), Supplement 1, S89. 2011.
  • 21.Alon U. An Introduction to Systems Biology-design principles of biological circuits: Taylor & Francis Group. 2007;LLC:320p. [Google Scholar]
  • 22.Nicolis C, Nicolis G. Passage through a barrier with a slowly increasing control parameter. Phys Rev E. 2000;62(1):197–203. doi: 10.1103/physreve.62.197. [DOI] [PubMed] [Google Scholar]
  • 23.Van Kampen N. Stochastic Processes in Physics and Chemistry: North-Holland, Amsterdam. 1992. 480p
  • 24.Kaneko K. On the strength of attractors in a high-dimensional system: Milnor attractor network, robust global attraction, and noise-induced selection. Physica D. 1998;124:322–344. [Google Scholar]
  • 25.Berg J. Out-of-Equilibrium Dynamics of Gene Expression and the Jarzynski Equality. Phys Rev Lett. 2008;100:188101. doi: 10.1103/PhysRevLett.100.188101. [DOI] [PubMed] [Google Scholar]
  • 26.Ge H, Qian H. Thermodynamic Limit of a Nonequilibrium Steady State: Maxwell-Type Construction for a Bistable Biochemical System. Phys Rev Lett. 2009;103:148103. doi: 10.1103/PhysRevLett.103.148103. [DOI] [PubMed] [Google Scholar]
  • 27.Kobayashi TJ. Connection between Noise-Induced Symmetry Breaking and an Information-Decoding Function for Intracellular Networks. Phys Rev Lett. 2011;106:228101. doi: 10.1103/PhysRevLett.106.228101. [DOI] [PubMed] [Google Scholar]
  • 28.Wang J, Wang E. Potential landscape and flux framework of nonequilibrium networks: Robustness, dissipation, and coherence of biochemical oscillations. Proc Nat Acad Sci USA. 2008;105(34):12271–12276. doi: 10.1073/pnas.0800579105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Wang J, Xu L, Wang E, Huang S. The potential landscape of genetic circuits imposes the arrow of time in stem cell differentiation. Biophys J. 2010;99(1):23–39. doi: 10.1016/j.bpj.2010.03.058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Wang J, Zhang K, Wang E. Quantifying the Waddington landscape and biological paths for development and differentiation. Proc Nat Acad Sci USA. 2010;108(20):8257–8262. doi: 10.1073/pnas.1017017108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Sen S, Garcia-Ojalvo J, Elowitz MB. Dynamical Consequences of Bandpass Feedback Loops in a Bacterial Phosphorelay. PLoS ONE. 2011;6(9):e25102. doi: 10.1371/journal.pone.0025102. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Kuchina A, Espinar L, Cagatay T, Balbin AO, Zhang F, et al. Temporal competition between differentiation programs determines cell fate choice. Mol Syst Biol. 2011;7(557):557. doi: 10.1038/msb.2011.88. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Suzuki H, Forrest ARR, van Nimwegen E, Daub CO, Balwierz PJ, et al. The transcriptional network that controls growth arrest and differentiation in a human myeloid leukemia cell line. Nat Genetics. 2009;41:553–562. doi: 10.1038/ng.375. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Ullner E, Zaikin A, Volkov EI, Garcia-Ojalvo J. Multistability and clustering in a population of synthetic genetic oscillators via phase-repulsive cell-to-cell communication. Phys Rev Lett. 2007;99:148103. doi: 10.1103/PhysRevLett.99.148103. [DOI] [PubMed] [Google Scholar]
  • 35.Koseska A, Zaikin A, Kurths J, Garcia-Ojalvo J. Timing Cellular Decision Making Under Noise via Cell–Cell Communication. PLoS ONE. 2009;4(3):e4872. doi: 10.1371/journal.pone.0004872. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Cohen M, Georgiou M, Stevenson N, Miodownik M, Baum B. Dynamic Filopodia Transmit Intermittent Delta-Notch Signaling to Drive Pattern Refinement during Lateral Inhibition. Dev Cell. 2010;19(1):78. doi: 10.1016/j.devcel.2010.06.006. [DOI] [PubMed] [Google Scholar]
  • 37.Kuehn C. A mathematical framework for critical transitions: Bifurcations, fast–slow systems and stochastic dynamics. Physica D: Nonlinear Phenomena. 2011;240(12):1020–1035. [Google Scholar]
  • 38.Ashwin P, Wieczorek S, Vitolo R, Cox P. Tipping points in open systems: bifurcation, noise-induced and rate-dependent examples in the climate system. Phil. Trans. Roy. Soc. A. 2012;370(1962):1166–1184. doi: 10.1098/rsta.2011.0306. [DOI] [PubMed] [Google Scholar]
  • 39.Andrecut M, Kauffman S. Mean-field model of genetic regulatory networks. New J Phys. 2006;8:148. [Google Scholar]
  • 40.Chen W, Schoeberl B, Jasper P, Niepel M, Nielsen U, et al. Input-output behavior of ErbB signaling pathways as revealed by a mass action model trained against dynamic data. Mol Sys Biol. 2009;5:239. doi: 10.1038/msb.2008.74. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Werner SL, Barken D, Hoffmann A. Stimulus Specificity of Gene Expression Programs Determined by Temporal Control of IKK Activity. Science. 2005;309(5742):1857–1861. doi: 10.1126/science.1113319. [DOI] [PubMed] [Google Scholar]
  • 42.Zhang J, Yang PL, Gray NS. Targeting cancer with small molecule kinase inhibitors. Nat Rev Cancer. 2009;9(1):28–39. doi: 10.1038/nrc2559. [DOI] [PubMed] [Google Scholar]
  • 43.Garca-Ojalvo J, Sancho JM. Noise in Spatially Extended Systems: Springer, New York. 1999. 321p. [DOI] [PubMed]
  • 44.Swain P, Elowitz M, Siggia E. Intrinsic and extrinsic contributions to stochasticity in gene expression. Proc Natl Acad Sci USA. 2002;99(20):12795–12800. doi: 10.1073/pnas.162041399. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Kloeden PE, Platen E. Numerical solution of stochastic differential equations: Springer-Verlag, Berlin Heidelberg. 1999. 636p

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Figure S1

Bifurcation diagram obtained by setting the parameters Inline graphic following the combination of amplitudes inherent to Inline graphic. (A) Complete bifurcation diagram. Inset: detail of branches near Inline graphic. (B) Amplification of lower part of the bifurcation diagram represented in (A). Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic (see Methods) for Inline graphic. The available attractors at specific times can be visualized. The input combination changes the attractor landscape with respect to the original bifurcation diagram with Inline graphic (see Fig. 3) and the other input sequences Inline graphic and Inline graphic. t is the horizontal axis variable for all the figures, from Inline graphic to Inline graphic. Inline graphic, i.e. the concentration of each transcription factor is represented here by Inline graphic and associated with Inline graphic in Eqs. (7) and (8) with Inline graphic (see Methods). For each time instant t 100 initial conditions were sampled and the respective end attractors recorded and plotted.

(TIFF)

Figure S2

Bifurcation diagram obtained by setting the parameters Inline graphic following the combination of amplitudes inherent to Inline graphic. (A) Complete bifurcation diagram. Inset: detail of branches near Inline graphic. (B) Amplification of lower part of the bifurcation diagram represented in (A). Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic (see Methods) for Inline graphic. The available attractors at specific times can be visualized. The input combination changes the attractor landscape with respect to the original bifurcation diagram with Inline graphic (see Fig. 3) and the other input sequences Inline graphic and Inline graphic. t is the horizontal axis variable for all the figures, from Inline graphic to Inline graphic. Inline graphic, i.e. the concentration of each transcription factor is represented here by Inline graphic and associated with Inline graphic in Eqs. (7) and (8) with Inline graphic (see Methods). For each time instant t 100 initial conditions were sampled and the respective end attractors recorded and plotted.

(TIFF)

Figure S3

Bifurcation diagram obtained by setting the parameters Inline graphic following the combination of amplitudes inherent to Inline graphic. (A) Complete bifurcation diagram. Inset: detail of branches near Inline graphic. (B) Amplification of lower part of the bifurcation diagram represented in (A). Parameters: Inline graphic, Inline graphic, Inline graphic, Inline graphic (self-activation) and Inline graphic (cross-repression), Inline graphic (see Methods) for Inline graphic. The available attractors at specific times can be visualized. The input combination changes the attractor landscape with respect to the original bifurcation diagram with Inline graphic (see Fig. 3) and the other input sequences Inline graphic and Inline graphic. t is the horizontal axis variable for all the figures, from Inline graphic to Inline graphic. Inline graphic, i.e. the concentration of each transcription factor is represented here by Inline graphic and associated with Inline graphic in Eqs. (7) and (8) with Inline graphic (see Methods). For each time instant t 100 initial conditions were sampled and the respective end attractors recorded and plotted.

(TIFF)


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES