Skip to main content
PLOS Computational Biology logoLink to PLOS Computational Biology
. 2010 Apr 29;6(4):e1000764. doi: 10.1371/journal.pcbi.1000764

A Critical Quantity for Noise Attenuation in Feedback Systems

Liming Wang 1, Jack Xin 1, Qing Nie 1,*
Editor: Christopher V Rao2
PMCID: PMC2861702  PMID: 20442870

Abstract

Feedback modules, which appear ubiquitously in biological regulations, are often subject to disturbances from the input, leading to fluctuations in the output. Thus, the question becomes how a feedback system can produce a faithful response with a noisy input. We employed multiple time scale analysis, Fluctuation Dissipation Theorem, linear stability, and numerical simulations to investigate a module with one positive feedback loop driven by an external stimulus, and we obtained a critical quantity in noise attenuation, termed as “signed activation time”. We then studied the signed activation time for a system of two positive feedback loops, a system of one positive feedback loop and one negative feedback loop, and six other existing biological models consisting of multiple components along with positive and negative feedback loops. An inverse relationship is found between the noise amplification rate and the signed activation time, defined as the difference between the deactivation and activation time scales of the noise-free system, normalized by the frequency of noises presented in the input. Thus, the combination of fast activation and slow deactivation provides the best noise attenuation, and it can be attained in a single positive feedback loop system. An additional positive feedback loop often leads to a marked decrease in activation time, decrease or slight increase of deactivation time and allows larger kinetic rate variations for slow deactivation and fast activation. On the other hand, a negative feedback loop may increase the activation and deactivation times. The negative relationship between the noise amplification rate and the signed activation time also holds for the six other biological models with multiple components and feedback loops. This principle may be applicable to other feedback systems.

Author Summary

Many biological systems use feedback loops to regulate dynamic interactions among different genes and proteins. Here, we ask how interlinked feedback loops control the timing of signal transductions and responses and, consequently, attenuate noise. Drawing on simple modeling along with both analytical insights and computational assessments, we have identified a key quantity, termed as the “signed activation time”, that dictates a system's ability of attenuating noise. This quantity combining the speed of deactivation and activation in signal responses, relative to the input noise frequency, is determined by the property of feedback systems when noises are absent. In general, such quantity could be measured experimentally through the output response time of a signaling system driven by pulse stimulus. This principle for noise attenuation in feedback loops may also be applicable to other biological systems involving more complex regulations.

Introduction

It has been identified that feedback loops play important roles in a variety of biological processes, such as calcium signaling [1], [2], p53 regulation [3], galactose regulation [4], cell cycle [5][8], and budding yeast polarization [9][13]. Although the detailed regulation of feedback loops may vary in different systems, the overall functions of feedback loop modules may be similar. For example, positive feedback loops are mainly used for promoting bi-stable switches and amplifying signals. One example is the cell cycle system [5][8] in which the mitotic regulator CDK1 activates Cdc25, which in turn activates CDK1, forming a positive feedback loop. Conversely, Wee1 and CDK1 inactivate each other, forming a double-negative feedback loop, equivalent to a positive feedback loop. The overall positive feedback regulation gives rise to a bi-stable switch that toggles between the inter-phase state and the mitotic-phase state. Another example is the system of yeast mating [9][15], in which multi-stage positive feedback loops enable the localization of signaling molecules at the plasma membrane by amplifying signals to initiate cell polarization and mating.

While most studies of feedback loops have been concerned with their roles in signal amplification, switch (or switch-like) responses [16][20], and oscillations [21] (See [22], [23] for the latest review.), recently, another important aspect of feedback loops has drawn more and more attention: modulating (accelerating or delaying) timing of signal responses [22], [24], [25]. Intuitively, positive feedback could amplify signals inducing an expeditious activation, or delay an activation by setting a higher threshold such that the system is activated only when the response accumulates beyond that threshold [22], [25]. Because characteristics of noises (e.g., the temporal frequency of a noise) in a biological process are closely related to timing of a signaling system, feedbacks clearly play a critical role in noise attenuation [26][29].

Thus, one of the central questions on noise analysis is how the architecture of a feedback circuit affects its noise property. Some studies suggested that positive feedbacks tended to amplify noise and negative feedbacks typically attenuated noise [30][32]; on the other hand, some other studies demonstrated that the positive feedbacks could attenuate noises and there were no strong correlations between the sign of feedbacks (negative or positive) and the noise attenuation properties [28], [33].

In their novel work [34], Brandman et al. linked the effect of positive feedback loops on noise attenuation to the time scales of the feedback loops. They studied a canonical feedback module consisting of three components, i.e., an output Inline graphic and two positive feedback loops, Inline graphic and Inline graphic. The output Inline graphic is turned on by the two positive feedback loops and Inline graphic, which are stimulated by an external (or upstream) stimulus and are also facilitated by Inline graphic (Figure 1A). The output Inline graphic becomes active (or stays inactive) as the pulse stimulus is high (or low). Through numerical simulations, Brandman et al. [34] showed that, if one of the positive feedback loops (e.g., loop Inline graphic) was slow and the other one was fast (termed as dual-time loops), the system could lead to distinct active output Inline graphic even in the presence of noise in the stimulus (at the high state).

Figure 1. Schematic diagrams of single-positive-loop, positive-positive-loop, and positive-negative-loop modules.

Figure 1

(A) The positive feedback modules. In this plot, there are three components: loop Inline graphic, loop Inline graphic, and output Inline graphic. Inline graphic, Inline graphic, and Inline graphic denote the active forms, whereas Inline graphic, Inline graphic, and Inline graphic stand for the corresponding inactive forms, respectively. The red dashed box represents the single-positive-loop module consisting of Inline graphic and Inline graphic only. In the Inline graphic component, signals come in to active Inline graphic with the help of Inline graphic at the rate of Inline graphic. All other activation processes of Inline graphic are lumped into one term, the basal activation rate Inline graphic. The conversion from Inline graphic to Inline graphic has the rate Inline graphic. In the Inline graphic component, Inline graphic is activated by Inline graphic at the rate of Inline graphic, and the deactivation of Inline graphic is at the rate of Inline graphic. The basal activation rate of Inline graphic is Inline graphic. Similar notations are used in the Inline graphic component. (B) The positive-negative-loop module. The positive feedback from Inline graphic to Inline graphic is replaced by negative feedback (red arrow).

Following this work, Zhang et al. [35] studied dual-time loops in producing a bi-stable response with a constant input (unlike a pulse input in [34]). They concluded that dual-time loops were the most robust design among all combinations in producing bi-stable output for a slightly different system in which the stimulus could activate Inline graphic or Inline graphic without the participation of Inline graphic. Kim et al. [36] considered systems coupled with negative and positive feedback loops. By assuming all the positive feedback loops have the same time scale but different time delays, they obtained a system that was capable of performing fast activation, fast deactivation, and noise attenuation.

What remains unclear are the sufficient and necessary conditions for a feedback system to achieve noise attenuation. Are two, or at least two, positive feedback loops (as used in [34][36]) required for controlling noise amplification in the input? Is a fast loop necessary for a positive feedback loop system to achieve noise attenuation? Are there any intrinsic quantities that connect the dynamic property of a system in absence of noises with the system's capability of noise suppression? If such quantities exist, how do positive feedbacks or negative feedbacks affect them?

In this work, we find that the capability of noise suppression in a system strongly depends on a quantity that measures the difference between the deactivation and activation times relative to the input noise frequency. Specifically, this quantity, termed as the “signed activation time”, has an inverse relationship with the noise amplification rate, with larger signed activation time leading to better noise attenuation. In addition, the signed activation time , representing one of the essential temporal characteristics of the system in absence of noises, may be controlled by either negative or positive feedbacks. We explore the properties of the quantity through both analytic approach (including linear stability analysis, multiple time scale analysis, and Fluctuation Dissipation Theorem) and numerical simulations. We first consider the same modules as in [34], and find that, for example, an additional positive feedback loop could drastically increase the signed activation time by speeding up the activation time while still keeping the deactivation time slow, as consistent with the previous observation [34] that dual-time-loop systems suppress noises better than single-loop systems. We next add a negative feedback loop to the positive-feedback-only system and show that a negative feedback loop usually slows down both activation and deactivation processes, leading to better or worse noise attenuation depending on which process (between activation and deactivation) is more significantly affected. Finally, we study the signed activation time and its relations to the noise amplification rate in different systems involving various feedbacks (e.g., positive, negative, and feedforward), including a yeast cell polarization model [14], [37], a polymyxin B resistance model in enteric bacteria [38], and four connector-mediated models [39]. All simulations confirm that the capability of noise attenuation in those systems improves as the signed activation time increases.

Results

The Difference between Deactivation and Activation Time Scales Dictates Noise Attenuation Ability

A simple model with one positive feedback loop may have two components with one upstream stimulus (inside the red dashed box in Figure 1A). In this system, the output Inline graphic is activated by Inline graphic, and Inline graphic is triggered by a stimulus Inline graphic and regulated by Inline graphic. The stimulus Inline graphic drives the output of the system with a high (or low) stimulus that corresponds to an active (or inactive) state of Inline graphic. Many biological circuits have positive feedback regulations of this nature [1], [2], [19], [40]. For example, Inline graphic is a kinase to phosphorylate Inline graphic to Inline graphic, and once Inline graphic is activated, it catalyzes a conversion from an inactive form Inline graphic to an active form Inline graphic [5]. Neglecting the mechanistic details, while keeping the essential interactions, we model the dynamics of the above module by the following system of ordinary differential equations (Text S1):

graphic file with name pcbi.1000764.e057.jpg (1)

where Inline graphic and Inline graphic represent normalized concentrations of Inline graphic and Inline graphic, respectively. The normalized stimulus Inline graphic, as a function of time, Inline graphic, usually varies (continuously) between two states, i.e., an inactive state in which Inline graphic (or the “off” state) and an active state in which Inline graphic (or the “on” state). The parameters Inline graphic, Inline graphic, Inline graphic, and Inline graphic are kinetic constants, and Inline graphic indicates the time scale for loop Inline graphic.

Once the output of the system reaches the “on” state driven by the stimulus, how does system (1) respond to temporal noises in the input signal Inline graphic? What are the strategies for effectively maintaining the system in the “on” state even with noises presented by the stimulus? We find that the time scales, denoted by Inline graphic and Inline graphic (Figure 2), for the system to switch from the “on” state to the “off” state and from “off” to “on” respectively in the absence of noises in the signal, play a critical role. Specifically, when Inline graphic is significantly larger than the time scale of the noise, i.e., Inline graphic, where Inline graphic is the frequency of the noise, the output Inline graphic of the system remains in the “on” state (Figures 3A–3B).

Figure 2. Schematic illustration of the activation (left) and deactivation (right) time scales.

Figure 2

Figure 3. Noise attenuation and time scales in single-positive-loop systems.

Figure 3

(A) A noisy signal with frequency Inline graphic and Inline graphic (defined in Methods). (B) A typical output response to the signal in (A). (C) Inline graphic versus Inline graphic. Kinetic parameters Inline graphic (black), Inline graphic (red), Inline graphic (green), and Inline graphic (blue) are varied individually to tune Inline graphic and Inline graphic while Inline graphic is fixed. The Inline graphic curve (black): Inline graphic, Inline graphic; the Inline graphic curve (red): Inline graphic, Inline graphic; the Inline graphic curve (green): Inline graphic, Inline graphic; the Inline graphic curve (blue): Inline graphic, Inline graphic. (D) Four sets of kinetic parameters are chosen, and each set corresponds to one curve. On each curve, Inline graphic is varied, and the kinetic parameters are fixed. Each point represents an average of Inline graphic based on Inline graphic simulations with different noisy signals but fixed Inline graphic. Set Inline graphic (blue): Inline graphic, Inline graphic, Inline graphic. Set Inline graphic (black): Inline graphic, Inline graphic, Inline graphic. Set Inline graphic (red): Inline graphic, Inline graphic, Inline graphic. Set Inline graphic (green): Inline graphic, Inline graphic, Inline graphic. In set Inline graphic, Inline graphic takes Inline graphic, Inline graphic. For the rest, Inline graphic, Inline graphic. (E) Inline graphic (bottom) and Inline graphic (top) versus Inline graphic. Parameters are the same as the corresponding color set in (D). Inline graphic, Inline graphic. (F) Inline graphic (bottom) and Inline graphic (top) versus Inline graphic. Inline graphic (set 1, blue), Inline graphic (set 2, red). In each plot, Inline graphic, Inline graphic. In all simulations, Inline graphic, Inline graphic, Inline graphic, unless otherwise specified.

Intuitively, when the system in the stable “on” state receives a noisy signal with an instantaneous value possibly near Inline graphic, it needs time Inline graphic to react and detour to the “off” state. In the case of Inline graphic, before the system settles down to the “off” state, a noisy signal with an instantaneous value near Inline graphic shows up, forcing the system to synchronize with the new value of the input signal. If Inline graphic, the output recovers fast from the drift towards the inactive state, and is more likely to maintain around the “on” state. The above intuition suggests that the noise attenuation at the “on” state depends positively on Inline graphic and negatively on Inline graphic. Thus, the quantity Inline graphic, i.e., the signed activation time , could be a good indicator of a system's ability of attenuating noise.

To investigate how noise level in the solution depends on the signed activation time , we study the noise amplification rate, defined as the relative ratio of the coefficients of variation of the output (Inline graphic) and the noise (Inline graphic) [28]:

graphic file with name pcbi.1000764.e153.jpg

First, we perform numerical simulations on system (1) (Methods) to study the relationship between Inline graphic and Inline graphic by varying the activation and deactivation time scales while fixing Inline graphic. This is achieved by changing the kinetic parameteres Inline graphic, and Inline graphic individually in the system, and Inline graphic is found decreasing in Inline graphic (Figure 3C). Next, we hold Inline graphic constant, corresponding to no changes in all parameters, and vary the noise frequency Inline graphic. The trend of Inline graphic remains the same (Figure 3D). We also consider the dependence of Inline graphic on Inline graphic and Inline graphic individually (Figure S1). In the single loop case, it turns out that Inline graphic is always decreasing in Inline graphic (Figures S1A–S1C), but it might be increasing in Inline graphic (Figure S1D). Similar results are also obtained for positive-positive-loop systems (Figure S2). Both suggest that neither deactivation nor activation alone can fully characterize the noise amplification rate, and the noise amplification rate is more likely determined by the difference between the deactivation and activation time scales. Next, we further explore this system through the following two analytical approaches.

Two-time-scale analysis

To understand why the relative ratio of the time scale of noise in the input and the system's intrinsic time scales when noise is absent is important to noise attenuation, we carry out a two-time-scale asymptotic expansion of the solutions [41]. The solutions are first written in terms of two time scales, Inline graphic and Inline graphic, where Inline graphic,

graphic file with name pcbi.1000764.e173.jpg (2)

When Inline graphic is small, the two time scales are well separated. The independent variables Inline graphic and Inline graphic correspond to the fast and slow time scales, respectively. This two-time-scale asymptotic expansion allows us to see a clear dependence of solutions on different time scales. For fast varying input, the input Inline graphic can be written as the sum of a constant signal Inline graphic and a fast altering term Inline graphic, i.e., Inline graphic. The solution of (1) is (Text S1, Section 4)

graphic file with name pcbi.1000764.e181.jpg (3)

Here, Inline graphic and Inline graphic are the initial conditions of Inline graphic and Inline graphic, respectively; Inline graphic is the solution of

graphic file with name pcbi.1000764.e187.jpg (4)

The zero-order solution, Inline graphic, approximates the full solution when Inline graphic is small (Figures S3A–S3C), and we thus focus on the noise effect on the zero-order solution. Notice that the noise term Inline graphic does not show up in equation (4), so the zero-order approximations with and without noise are the same, suggesting that fast varying noises are filtered out through the system (Figures S3D–S3E).

If the input consists of both fast and slow noises (Figures S3G–S3H), for example, when the input is decoupled to a sum of fast and slow noise terms, i.e., Inline graphic, then only the slow part appears in the equation of Inline graphic (Text S1, Section 4),

graphic file with name pcbi.1000764.e193.jpg

In this case, the noise term Inline graphic could significantly affect the output (Figures S3F, S3I–S3J). In summary, the single-positive-loop system could function as a low-pass filter [42][45], and thus the time scale of the input noise relative to the time scales of the internal system is important to noise attenuation.

Fluctuation Dissipation Theorem (FDT) approach

To see the inverse relation between the noise amplification rate and the signed activation time , we employ the FDT approach [27], [28], [46], [47]. Under the linear approximation assumption in FDT, the noise amplification rate can be computed analytically (Text S1, Section 5), and when Inline graphic and Inline graphic, we obtain

graphic file with name pcbi.1000764.e197.jpg (5)

where Inline graphic is the association constant, indicating the strength of the activation from Inline graphic to Inline graphic.

Based on equation (5), one can infer a qualitative relation between the noise amplification rate and the kinetic parameters. For Inline graphic, since Inline graphic (Text S1, Section 1, the conditions for a “switch-like” response), as Inline graphic increases, the noise amplification rate Inline graphic decreases. The parameter Inline graphic, measuring the activation from Inline graphic to Inline graphic, negatively affects the noise amplification rate, and the time scale of the Inline graphic-loop, Inline graphic, positively affects Inline graphic.

On the contrary, Inline graphic depends negatively on Inline graphic and positively on Inline graphic and Inline graphic (details later). Thus, a negative relation between Inline graphic and Inline graphic is expected (as confirmed by simulations in Figures 3C–3D). In addition, Inline graphic and Inline graphic appearing together in (5) suggests a close dependence of the noise attenuation capability on the noise frequency in the input and the intrinsic time scales of the system in the absence of noise.

How to Control Deactivation and Activation Time Scales

In the previous section, we have demonstrated that the noise amplification rate depends negatively on the signed activation time. Thus, if a system is persistent to noise at the “on” state, it should have a large signed activation time . In this section, by studying the dynamics of the noise-free system, we show that a small Inline graphic is necessary for a slow deactivation, but not sufficient. With a fixed small Inline graphic, larger Inline graphic or Inline graphic could lead to slower deactivation and faster activation.

Deactivation

When the input signal switches from Inline graphic to Inline graphic, the system responds through deactivation from the stabilized active state to the inactive state. The dynamics of Inline graphic around the inactive state can be approximated by (Text S1, Section 1)

graphic file with name pcbi.1000764.e226.jpg (6)

Here, Inline graphic and Inline graphic denote the steady state values of Inline graphic and Inline graphic at Inline graphic, respectively; Inline graphic, where Inline graphic and Inline graphic are the initial conditions of Inline graphic and Inline graphic, respectively. Equation (6) clearly indicates that the dynamics of Inline graphic is not only determined by parameters in the Inline graphic-equation but also affected by the time scale of the Inline graphic-equation, Inline graphic. Without the positive feedback loop (Inline graphic-equation), Inline graphic can be solved in a closed form:

graphic file with name pcbi.1000764.e243.jpg (7)

Comparing (7) with (6), it is clear that, to achieve a slower deactivation when Inline graphic is present, Inline graphic need to be much smaller than Inline graphic. Conversely, if Inline graphic is on the same or higher order of Inline graphic, the output Inline graphic responds in a time scale of Inline graphic without slow deactivation.

In addition to a small Inline graphic, the more significantly the second term in (6) contributes to the dynamics of Inline graphic, the slower Inline graphic converges to Inline graphic, and thus, the larger Inline graphic becomes. The contribution of Inline graphic to the deactivation time scale is characterized by (Text S1, Section 1)

graphic file with name pcbi.1000764.e257.jpg (8)

As a result, a large Inline graphic or Inline graphic leads to a slow deactivation. This is also demonstrated by direct simulations (Figures 3E–3F, top).

In addition to the linear stability analysis around either the active state or the inactive state, under the assumption of Inline graphic, our previous two-time-scale asymptotic expansion provides a uniformly approximated solution of (1) [41]. The leading order of Inline graphic yields a solution that is in a similar form of (6) (Text S1, Section 4):

graphic file with name pcbi.1000764.e262.jpg (9)

Activation

Besides the deactivation time scale, the slow positive loop Inline graphic also affects the activation time scale. During the activation process (Text S1, Section 1),

graphic file with name pcbi.1000764.e264.jpg (10)

where Inline graphic and Inline graphic are two constants depending on the initial conditions; Inline graphic and Inline graphic denote the steady state of Inline graphic and Inline graphic at Inline graphic, respectively. Different from the deactivation process, loop Inline graphic affects the dynamics of Inline graphic through the term

graphic file with name pcbi.1000764.e274.jpg (11)

instead of Inline graphic. The extra factor Inline graphic in the exponent of (11) can lead to faster activation. Numerical simulations of system (1) with different values of Inline graphic confirm this (Figure 3E, bottom). Another way to accelerate the activation process is to minimize the contribution of the exponential function in (11) to the dynamics of Inline graphic, characterized by (Text S1, Section 1)

graphic file with name pcbi.1000764.e279.jpg (12)

Based on (12), increasing Inline graphic or Inline graphic decreases the contribution from Inline graphic, and thus leads to faster activation (Figures 3E–3F, bottom). In the extreme case of Inline graphic, there is no feedback from the output Inline graphic to the Inline graphic system, and Inline graphic evolves on its own time scale of Inline graphic. Thus, the output Inline graphic driven by Inline graphic is also on the slow time scale of Inline graphic.

In summary, a slow positive feedback loop is necessary for slow deactivation, and a slow positive feedback can lead to fast activation. It is worth pointing out that the above analysis of achieving rapid activation and slow deactivation is based on a system with one positive feedback loop. In a previous study [34], the response of rapid activation and slow deactivation was achieved through two positive feedback loops with two drastically different time scales. This raises the question of why biological processes often utilize multiple loops rather than a single positive feedback loop when one positive feedback loop seems sufficient for the basic objective.

Roles of an Additional Positive Feedback Loop: Faster Activation and Robustness

In many biological processes, such as cell cycle [5], [6], often two positive feedback loops Inline graphic and Inline graphic activate the output Inline graphic simultaneously (Figure 1A). Similar to system (1), the corresponding equations take the form:

graphic file with name pcbi.1000764.e294.jpg (13)

Through direct numerical simulations, we find that the noise amplification rate decreases in the signed activation time (Figures 4A–4B), following the same principle as in the single-positive-loop system (1). The activation time scale decreases in Inline graphic and Inline graphic, while the deactivation time scale increases in Inline graphic and Inline graphic (Figures 4C–4D, Table 1). We also find that an additional feedback loop can lead to a faster activation (red and black versus blue in Figures 4C–4D, bottom) and a slower (or similar) deactivation (red and black versus blue in Figures 4C–4D, top), compared to a single-positive-loop system, and a positive-positive-loop system can achieve similar activation and deactivation rates with larger ranges of kinetic parameters than a single-positive-loop system (Table 2). Consequently, noise attenuation can be better achieved in the positive-positive-loop system (Figures 4E–4F). Below are details of the mathematical analysis for the roles of the additional positive feedback.

Figure 4. Noise attenuation and time scales in positive-positive-loop systems.

Figure 4

(A–B) The same plots as in Figures 3C–3D but with the additional positive feedback loop Inline graphic, where Inline graphic. (C–D) The change of Inline graphic (bottom) and Inline graphic (top) with respect to Inline graphic (C) and Inline graphic (D) in single-positive-loop (blue), fast-slow-loop (Inline graphic, black), and slow-slow-loop (Inline graphic, red) systems. Inline graphic and Inline graphic are varied the same way as in Figure 3E and Figure 3F, respectively. (E–F) The ratio of Inline graphic in positive-positive-loop systems to Inline graphic in the corresponding single-positive-loop systems with respect to Inline graphic (E) and Inline graphic (F). Inline graphic (blue), Inline graphic (black), and Inline graphic (red). All simulations use the same parameters and inputs as their counterparts in Figure 3 with the additional parameter Inline graphic, unless otherwise specified.

Table 1. Qualitative relationship between response time scales and parameters Inline graphic, Inline graphic, Inline graphic, and Inline graphic in single-positive-loop (S-P), positive-positive-loop (P-P), positive-negative-loop (P-N) systems.

Deactivation Activation
S-P P-P P-N S-P P-P P-N
Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
Inline graphic NA Inline graphic Inline graphic NA Inline graphic Inline graphic

The up arrow Inline graphic and down arrow Inline graphic denote increasing and decreasing, respectively. Variables Inline graphic, and Inline graphic are positive.

Table 2. Changes of the activation and deactivation time scales with respect to parameter variations in single-positive-loop (S-P), fast-slow-loop (F-S), and slow-slow-loop (S-S) systems.

Parameter Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
changes S-P F-S S-S S-P F-S S-S
Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic

For example, when the parameter Inline graphic varies between Inline graphic and Inline graphic, the activation time scale in the S-P system varies between Inline graphic and Inline graphic; the activation time scale in the F-S system (Inline graphic) varies between Inline graphic and Inline graphic; the activation time scale in the S-S system (Inline graphic) varies between Inline graphic and Inline graphic.

Activation

During activation, the dynamics of Inline graphic can be approximated by (Text S1, Section 2)

graphic file with name pcbi.1000764.e390.jpg (14)

where Inline graphic, Inline graphic, and Inline graphic denote the eigenvalues of the Jacobian matrix of system (13) at the active state; Inline graphic, Inline graphic, and Inline graphic are the first coordinates of the corresponding eigenvectors, respectively; Inline graphic, Inline graphic, and Inline graphic are constants depending on initial conditions. Similar to the single-positive-loop case, in order to achieve slow deactivation, either Inline graphic or Inline graphic must be much smaller than Inline graphic. Without loss of generality, we assume that Inline graphic and Inline graphic because of the symmetry between the two loops. Thus, analytically, we consider the following two cases to illustrate the effect of the additional feedback loop.

  • Inline graphic, corresponding to a slow-slow-loop system. Loop Inline graphic and loop Inline graphic both affect the dynamics of Inline graphic through the term Inline graphic, and their contributions are measured by (Text S1, Section 2)
    graphic file with name pcbi.1000764.e410.jpg (15)
    which is smaller than (12), the corresponding contribution of loop Inline graphic to the single-positive-loop system. If Inline graphic is large compared to one, even though the additional loop is on the slow time scale, the activation time scale can drop to one quarter of that in the single-positive-loop system, which is also suggested by direct simulations (Figures 4C–4D, lower red dots).
  • Inline graphic, corresponding to a fast-slow-loop system. In this case, the term Inline graphic decays much faster than Inline graphic. As a result, the slow dynamics of Inline graphic mostly comes from loop Inline graphic through the term Inline graphic. The contribution from Inline graphic is characterized by (Text S1, Section 2)
    graphic file with name pcbi.1000764.e420.jpg (16)
    which is also smaller than (12). Notice that, if Inline graphic is large compared to one, (16) can be as small as one eighth of (12). Direct numerical simulations also show that a fast-slow-loop system has much smaller Inline graphic than the corresponding single-positive-loop system (Figures 4C–4D, lower black versus blue).

In summary, both cases suggest that an additional positive feedback loop accelerates the activation process, and the activation time scale decreases in Inline graphic and Inline graphic (Figures 4C–4D, bottom), similar to the single-positive-loop system.

Deactivation

During deactivation, the dynamics of Inline graphic is approximated by (Text S1, Section 2)

graphic file with name pcbi.1000764.e426.jpg (17)

where Inline graphic, Inline graphic, and Inline graphic are constants depending on initial conditions of the system; Inline graphic, Inline graphic, and Inline graphic are the eigenvalues of the Jacobian matrix of system (13) at the inactive state. Let us consider the same two cases studied in the activation process.

  • Inline graphic, corresponding to a slow-slow-loop system. The contributions of loop Inline graphic and loop Inline graphic to the dynamics of Inline graphic are measured by (Text S1, Section 2)
    graphic file with name pcbi.1000764.e437.jpg (18)
    which is larger than (8), the corresponding contribution of loop Inline graphic to a single loop system. So, the additional slow positive feedback loop sustains the deactivation process, as is also shown in direct simulations (Figures 4C–4D, upper red dots).
  • Inline graphic, corresponding to a fast-slow-loop system. In this case, the contribution of the term Inline graphic to the dynamics of Inline graphic is (Text S1, Section 2)
    graphic file with name pcbi.1000764.e442.jpg (19)
    smaller than (8). In other words, the deactivation time scale in a positive-positive-loop system can be faster than that in a single-positive-loop system. However, the relative difference of the deactivation time scales between the two systems is small (Figures 4C–4D, upper black and blue dots), because the ratio of (19) to (8) is Inline graphic

The above analysis suggests that the additional loop Inline graphic increases the deactivation time in a slow-slow-loop system and slightly decreases the deactivation time in a fast-slow-loop system. Equations (18) and (19) also suggest the positive dependence of the deactivation time scale on Inline graphic and Inline graphic, as confirmed by direct simulations (Figures 4C–4D, top).

Moreover, as seen in Table 2, the activation time scale, Inline graphic, is under tighter control in a positive-positive-loop system than a single-positive-loop system when the kinetic parameters are varied. In other words, a change of the kinetic parameters in a positive-positive-loop system leads to less change in the activation time scale than in a single-positive-loop system (Table 2); therefore, the activation time scale in a positive-positive-loop system is more robust to fluctuations in kinetic parameters (independent of fluctuations in the input).

Even though the additional loop can lead to a slightly larger deactivation time under certain conditions (e.g., Inline graphic), the relative change is usually small, especially in comparison to the relative decrease of the activation time (Table 2). As a result, Inline graphic increases, and thus the noise amplification rate becomes smaller in the positive-positive-loop system than in the corresponding single-positive-loop system (Figures 4E–4F, blue dots). Of course, when the additional loop Inline graphic is slow (e.g., Inline graphic), the deactivation time scale increases, and the activation time scale decreases, resulting in better noise attenuation than the single-positive-loop system (Figures 4E–4F, red dots).

Roles of an Additional Negative Feedback Loop: Slower Deactivation

In this section, we study how an additional negative feedback loop affects noise attenuation in a system. One of the simplest ways to introduce negative feedback to the single-positive-loop system (1) is to let Inline graphic deactivate Inline graphic (Figure 1B) [21]. In this case, the model becomes

graphic file with name pcbi.1000764.e454.jpg (20)

Our analytical results show that the additional negative feedback loop leads to slower deactivation and slower (or slightly faster) activation compared to its single-positive-loop counterpart (red and black versus blue in Figures 5C–5D). Moreover, the deactivation time scale increases in Inline graphic and Inline graphic, and the activation time scale decreases in Inline graphic and (Figures 5C–5D, Table 1), similar to the single-positive-loop (Figures 3E–3F) and positive-positive-loop systems (Figures 4C–4D). Numerical simulations reinforce these findings and demonstrate that the noise amplification rate of negative-positive-loop systems decreases in the signed activation time , following the same principle as their single-positive-loop counterparts (Figures 5A–5B).

Figure 5. Noise attenuation and time scales in positive-negative-loop systems.

Figure 5

(A) Kinetic parameters Inline graphic (black), Inline graphic (orange), Inline graphic (red), Inline graphic (green), Inline graphic (purple), Inline graphic (cyan), and Inline graphic (blue) are varied individually to tune Inline graphic and Inline graphic while Inline graphic is fixed. In each parameter variation, Inline graphic samples are simulated. (B) The dependence of Inline graphic on Inline graphic when Inline graphic is varied and the kinetic parameters are fixed. We use the same four sets of parameters as in Figure 3D with the additional parameters Inline graphic. (C–D) The change of Inline graphic (bottom) and Inline graphic (top) with respect to Inline graphic (C) and Inline graphic (D) in single-positive-loop (blue), positive-negative-loop (Inline graphic, black), and positive-negative-loop (Inline graphic, red) systems. Inline graphic and Inline graphic are varied the same way as in Figure 3E and Figure 3F, respectively.

Below, we provide detailed analysis to show how the deactivation and activation time scales depend on various kinetic parameters, compared to the single-positive-loop case. In our analytical studies, we assume Inline graphic for simplicity. However, Inline graphic and Inline graphic are varied independently in numerical simulations.

Deactivation

During deactivation, the dynamics of Inline graphic is approximated by (Text S1, Section 3)

graphic file with name pcbi.1000764.e485.jpg (21)

where Inline graphic, Inline graphic, and Inline graphic are constants depending on initial conditions of the system; Inline graphic, Inline graphic, and Inline graphic are the eigenvalues of the Jacobian matrix of system (20) at the inactive state. We focus on the following two cases.

  • Inline graphic: fast negative loop and slow positive loop. In this case, the contribution of Inline graphic to the dynamics of Inline graphic is measured by (Text S1, Section 3)
    graphic file with name pcbi.1000764.e495.jpg (22)
    Here, Inline graphic, the same as in the single-positive-loop case; Inline graphic is defined as Inline graphic. A straightforward calculation shows that (22) is always larger than (8), the corresponding contribution of Inline graphic to the single-positive-loop system (Text S1, Section 3). Note that the more the Inline graphic term contributes to the dynamics, the slower Inline graphic gets deactivated. As a result, the deactivation in the fast-negative-slow-positive-loop system is slower than that in the single-positive-loop system. In addition, (22) increases in Inline graphic and Inline graphic, and thus the deactivation time scale increases in Inline graphic and Inline graphic.
  • Inline graphic: slow negative loop and slow positive loop. The contribution from the slow term Inline graphic is measured by (22) minus a small term on the order of Inline graphic and Inline graphic (Text S1, Section 3), and is still larger than (8).

To summarize, in both cases the additional negative feedback loop leads to slower deactivation, and the deactivation time scale increases in Inline graphic and Inline graphic (Figures 5C–5D, top).

Activation

We again analyze the two cases of fast negative loop and slow negative loop.

  • Inline graphic: fast negative loop and slow positive loop. The slow dynamics of Inline graphic is characterized by (Text S1, Section 3)
    graphic file with name pcbi.1000764.e514.jpg (23)
    which is bigger than (12), the corresponding contribution to the single-positive-loop system. In addition, (23) is decreasing in Inline graphic and Inline graphic.
  • Inline graphic: slow negative loop and slow positive loop. The contribution to the slow dynamics of Inline graphic is measured by (Text S1, Section 3)
    graphic file with name pcbi.1000764.e519.jpg (24)
    which is smaller than (12). The function (24) decreases in Inline graphic and Inline graphic.

Together, compared to the single-positive-loop system, the activation is slower when the negative feedback acts on a fast time scale (Inline graphic), but faster when the the negative feedback is on a slow time scale (Inline graphic). Numerical simulations confirm these findings (Figures 5C–5D), and show that in the slow negative loop case, the activation is about the same as the single-positive-loop case, albeit slightly faster (Figures 5C–5D, lower red versus blue). Moreover, the activation time scale decreases in Inline graphic and Inline graphic (Figures 5C–5D, lower).

Since the additional negative feedback loop in general leads to slower deactivation and slower activation, the net effect to the signed activation time is not straightforward. Numerical simulations suggest that the noise amplification rate could either increase or decrease depending on Inline graphic, the time scale of the negative feedback loop (Figure S4).

Noise Attenuation in a Yeast Cell Polarization System

Unlike the simple models in the previous section, a yeast cell polarization signaling pathway model that we study next (Figure 6A) consists of more than three components and multiple feedback regulations [37], [48]. Polarization in yeast cells (a or Inline graphic cells) is activated by pheromone gradients [48]. The pheromone (L) binds to the receptor (R) and becomes activated (RL). The activated receptor facilitates the conversion of the heterotrimeric G-protein (G) into an activated Inline graphic-subunit (GInline graphic) and a free GInline graphic dimmer [49]. GInline graphic is then deactivated to an inactive Inline graphic-subunit (Gd), which in turn binds to GInline graphic and forms the heterotrimeric G-protein. The free GInline graphic recruits cytoplasmic Cdc24 to the membrane, forming the membrane-bounded Cdc24 (Cdc24m), an activator of Cdc42. Accumulation of the activated Cdc42 (Cdc42a) at the projection site is a key feature of polarization, and thus is regarded as the output of the proposed system. The activated Cdc42 participates in other polarization processes, forming positive or negative feedback loops. For example, the activated Cdc42 sequesters the scaffold protein Bem1 to the membrane, which then recruits Cdc24 to the membrane [50]. This forms a positive feedback loop. Other functions of Cdc42 include the activation of Cla4 (Cla4a), an inhibitor of Cdc24, resulting in a negative feedback loop [51].

Figure 6. Noise attenuation in a yeast cell polarization model.

Figure 6

(A) Schematic diagram of the yeast cell polarization signal transduction pathway. (B) The active state (upper black) and the inactive state (lower red). The upper black curve is the output (concentration of Cdc42a) response to the constant high pheromone concentration of [L]Inline graphicnM, and the lower red curve is the output response to the low pheromone concentration of [L]Inline graphicnM. (C) A noisy input signal with low amplitude. (D) The output response to (C). (E) A noisy input signal with large amplitude. (F) The output response to (E). (G) The noise amplification rate versus the signed activation time. Ten parameters are varied systematically in Inline graphic-fold ranges based on their original values given in (D). Each variation corresponds to one curve on the plot. The ten parameters are Inline graphic (red), Inline graphic (black), Inline graphic (pink), Inline graphic (magenta), Inline graphic (yellow), Inline graphic (orange), Inline graphic (cyan), Inline graphic (green), Inline graphic (blue), Inline graphic (brown). The leftmost point of the Inline graphic curve is not shown in this picture, as it changes the scale of the picture. Please see Figure S7 for the full plot. Parameter values are mostly taken from [37], except Inline graphic and Inline graphic, because of the loss of the spatial effect. The initial conditions are Inline graphic, Inline graphic, where Inline graphic.

Following the model proposed in [37] but ignoring the spatial effect, we have the following system of equations:

graphic file with name pcbi.1000764.e554.jpg (25)

Here, Inline graphic denotes the concentration of the corresponding protein; [L] is the input signal, and [Cdc42a] is the output; the concentrations of GInline graphic, Gd, the inactive form of Cdc42, the cytoplasmic Cdc24, and the cytoplasmic Bem1 are derived through conservation relations:

graphic file with name pcbi.1000764.e557.jpg
graphic file with name pcbi.1000764.e558.jpg

Here, Inline graphic is the volume of the cell; Inline graphic is the surface area of the cell; Inline graphic, and Inline graphic are the total numbers of molecules per cell of the corresponding proteins. The two Hill functions Inline graphic and Inline graphic are defined as

graphic file with name pcbi.1000764.e565.jpg
graphic file with name pcbi.1000764.e566.jpg

These two functions represent two different ways of bringing Cdc24 to the membrane. One is by the free GInline graphic (function Inline graphic), and the other is through Bem1. The Bem1 recruitment is known to be facilitated by GInline graphic's binding to Ste20 [52], and the influence from GInline graphic is modeled by the function Inline graphic. Kinetic parameters take the same values as in [37], and see also the caption of Figure 6.

Starting from zero Cdc42a, giving high ([L]Inline graphicnM) or low ([L]Inline graphicnM) constant inputs, the output reaches active and inactive states, respectively, which are clearly distinguished (Figure 6B). Inputs with small amplitude (Figure 6C) can be detected by the system (Figure 6D). On the other hand, the output is robust to noise when it is around the active state (Figures 6E–6F). To study how the noise amplification rate depends on the relative time scales, we vary ten parameters systematically in their Inline graphic-fold ranges. All of them show the same decreasing trend of the noise amplification rate as a function of the signed activation time (Figure 6G). This suggests that the negative relation between the noise amplification rate and the signed activation time , derived from the simple models, could also apply to models of complex interactions and combinations of positive and negative feedback loops. Such negative relationship may be a generic principle on noise suppression for input-output systems with feedback loops.

Applications to Other Systems

A polymyxin B resistance model in enteric bacteria

To further explore the generality of the proposed criterion, we consider a recently discovered genetic regulatory network of the connector-mediated polymyxin B resistance induced by Inline graphic in enteric bacteria [38]. At low Inline graphic, the protein PhoP is phosphorylated and activates the promoter of the connector protein PmrD. PmrD then proceeds to activate the transcription factor of pbgP, which eventually results in the resistance to polymyxin B. In addition to the indirect regulation, PhoP also promotes pbgP expression directly by binding to the pbgP promoter [38]. The feedforward connector loop (FCL) model proposed in [38] contains five variables and Inline graphic parameters with the input being the concentration of the phosphorylated PhoP and the output being the pbgP mRNA level (Figure 7A).

Figure 7. Noise attenuation in a polymyxin B resistance model.

Figure 7

(A) Schematic diagram of the polymyxin B resistance network. (B) A typical input with noise. (C) The output response to the input in (B). (D) The noise amplification rate versus the signed activation time . Ten parameters are varied in Inline graphic-fold ranges based on their original values given in Table S1. The ten parameters are Inline graphic (red), Inline graphic (black), Inline graphic (pink), Inline graphic (magenta), Inline graphic (yellow), Inline graphic (orange), Inline graphic (cyan), Inline graphic (green), Inline graphic (blue), Inline graphic (brown). The equations of the system are given in Section 7 of Text S1.

Interestingly, the FCL model robustly exhibits fast activation and slow deactivation as shown in [38], which would lead to a strong noise attenuation capability based on our proposed criterion. Indeed, when noise is introduced to the input (Figure 7B), our simulation shows the output, pbgP mRNA, maintains at a high level (Figure 7C). The noise amplification rate is found to decrease as the signed activation time increases (Figure 7D) when ten out of thirteen parameters in the model are varied within their Inline graphic-fold ranges. (Please see Section 7 of Text S1 for the equations and Table S1 for the parameter values.)

Four connector-mediated models

Following the work [38], Mitrophanov and Groisman proposed four different regulatory mechanisms of a connector-mediated circuit [39]. The four generic models, mainly consisting of three components, the connector, the sensor, and the regulator, differ in functions of the connector protein. In the regulator-protecting (RP) model, the connector protein binds to the phosphorylated regulator and protects it from dephosphorylation by the sensor protein, whereas in the regulator-activating (RA) model, the connector binds to the unphosphorylated regulator and promotes its phosphorylation. The connector in the phosphatase-inhibiting (PI) model binds to the sensor to inhibit its phosphatase activity, instead of promoting the kinase activity as in the kinase-stimulating (KS) model. The same input used for the four models is the synthesis rate of the connector protein, and their output is the concentration of the phosphorylated regulator protein [39].

We first study the KS model (Figure 8A) to test the relation between the noise amplification rate and the signed activation time. The KS model used in [39] contains six variables and Inline graphic parameters. Based on the same parameter set used in [39], we vary eight parameters within their Inline graphic-fold ranges individually. The simulations consistently indicate the inverse relationship between the noise amplification rate and the signed activation time (Figure 8B), similar to our results for other systems.

Figure 8. Noise attenuation in the kinase-stimulating (KS) model.

Figure 8

(A) Schematic diagram of the KS network. Here, Inline graphic, and Inline graphic represent the sensor protein in the kinase form, the sensor protein in the phosphatase form, the connector protein, the response regulator, the phosphorylated response regulator, and the connector-sensor(kinase) complex, respectively. (B) The noise amplification rate versus the signed activation time . Eight parameters are varied in Inline graphic-fold ranges around their original values given in [39]. The eight parameters are Inline graphic (red), Inline graphic (black), Inline graphic (pink), Inline graphic (magenta), Inline graphic (yellow), Inline graphic (orange), Inline graphic (cyan), and Inline graphic (green).

Next, we study the four models and compare their noise amplification rates and signed activation time s for the same nominal parameter set used in [39]. Although the deactivation and activation dynamics of the four models are quite different [39] (Figures S8A–S8B), we notice that the same relationship between the amplification rate and signed activation time seems to hold across the four different models, i.e. a model with smaller signed activation time has higher noise amplification rate than another system with larger signed activation time (Table 3, Figures S8C–S8F).

Table 3. Time scales and noise amplification rates in four connector-mediated models.
RP RA KS PI
Activation time (Inline graphic) Inline graphic Inline graphic Inline graphic Inline graphic
Deactivation time (Inline graphic) Inline graphic Inline graphic Inline graphic Inline graphic
Signed activation time Inline graphic Inline graphic Inline graphic Inline graphic
Noise amplification rate Inline graphic Inline graphic Inline graphic Inline graphic

RP, RA, PI, and KS stands for the regulator-protecting model, the regulator-activating model, the phosphatase-inhibiting model, and the kinase-stimulating model, respectively. The same noise input (Figure S8G) is used for all four models. The equations and parameters are taken from [39].

Discussion

Our theoretical and numerical studies have demonstrated that it is not the sign of the feedback that determines the degree of noise attenuation. In searching for a general framework for a relation between feedback and noise attenuation, we have identified a critical quantity, termed as the “signed activation time”. Its relation with the system's ability of noise attenuation has been explored, and we have revealed that the noise amplification rate decreases in the signed activation time. These results are concluded through employing multiple time scale analysis, Fluctuation Dissipation Theorem, and linear stability analysis, combined with numerical simulations, in three feedback modules (Figure 1): single-positive-loop, positive-positive-loop, and positive-negative-loop systems. To test the generality of the conclusion, we have explored models (Figure 1A) with saturation effect, i.e., modeling feedback loops by Hill functions (Text S1, Section 6, Figures S5, S6), a yeast cell polarization model consisting of multiple intermediate components (Figure 6), a polymyxin B resistance model in enteric bacteria (Figure 7), and four connector mediated models (Table 3, Figure 8). In all cases, the noise amplification rate has been confirmed to be a decreasing function in the signed activation time.

To analyze the roles of multiple positive and negative feedback loops in our toy models, we have found that: 1) an additional positive feedback loop could drastically reduce the activation time scale, improving performance in noise attenuation; 2) the time scales in positive-positive-loop feedback systems are more robust to rate constant variations (e.g. due to variability of organisms or variation of environments); and 3) adding a negative feedback loop usually sustains both deactivation and activation processes, and thus its overall effect on the signed activation time could be either negative or positive.

To obtain slow deactivation and fast activation, we have identified two key parameters, Inline graphic, the association constant of Inline graphic to Inline graphic, and Inline graphic, the association constant of Inline graphic to Inline graphic (Figure 1A), that tightly control the deactivation and the activation time scales (Tables 1 and 2). Interestingly, under appropriate conditions, even the simplest single positive feedback loop system could display slow deactivation and fast activation, which were not observed in previous works [34][36].

The idea of connecting noise attenuation with the time scales of signal responses was mentioned in other works, for example, [53], in which only the activation time scale was considered. However, we have shown that in our models neither the deactivation time scale nor activation time scale alone predict correctly the trend of the noise amplification rate (comparing Figure 3C to Figures S1C–S1D, for example) and the noise amplification rate is an interplay between the two time scales. Our proposed quantity, the signed activation time , provides a more consistent relation linking to the noise attenuation rate.

Direct approaches for analyzing noise may be applied to feedback systems, such as the energy landscape method [4], [35], [54][56] and the methods used for noise attenuation or amplification in signaling cascades [28], [57][60] and covalent modification cycles [53]. To characterize signaling time scales, we have studied the magnitude of eigenvalues and their corresponding eigenvectors of the Jacobian matrices at each distinct state of the signal. Questions concerning how the magnitude of signal output and signal duration depend on properties of pathway components (e.g., the effect of cascades) were explored from a system control point of view in other works [61][63].

Our study features a novel approach using multiple time scale asymptotic expansion [41]. Different from the one-time-scale expansion, this approach provides an explicit relation between the solutions and the two separated time scales, suggesting that the single-positive-loop system can function as a low-pass filter and explaining why the relative size of noise time scale and a system's intrinsic time scales is important to noise attenuation. This approach may be applied to other biological systems with time scale separations.

Our findings suggest that the negative relationship between the noise amplification rate and the signed activation time could be a general principle for many biological systems regardless of specific regulations or feedback loops. Notice that the deactivation and activation time scales are widely defined and could be measured without detailed knowledge of a system's internal structure. Thus, the underline system could be treated as a black box and its ability of noise attenuation could be estimated based on the signed activation time . In general, if a system prefers to better attenuate noise at the “on” state, the system should have a large signed activation time .

We would like to point out that the studies done here mainly focus on time scale changes within a fixed system, although comparisons across different systems are likely to be consistent with our result (e.g. the four connector-mediated models). However, we might not expect two drastically different systems with equal signed activation time to exhibit the same noise amplification rate, which is likely to depend on other factors in the system as well. We hope that the present work can shed some light on general principles of noise attenuation, in particular, their connections with timing of a system in the absence of noises.

Methods

Simulations

All simulations are performed using Mathematica 6.0.0. To compute the noise amplification rate Inline graphic, we use

graphic file with name pcbi.1000764.e628.jpg

to approximate Inline graphic, where

graphic file with name pcbi.1000764.e630.jpg

We use

graphic file with name pcbi.1000764.e631.jpg

to approximate Inline graphic, where

graphic file with name pcbi.1000764.e633.jpg

The noise is generated by dividing the time interval into sub-intervals of length Inline graphic, and on each sub-interval the signal takes a random number from a uniform distribution in Inline graphic. See Figure 3A for a typical noisy signal.

Linear analysis, two-time-scale asymptotical expansion, FDT approach

See Text S1.

Supporting Information

Text S1

Linear analysis, two-time-scale asymptotical expansion, FDT approach, and equations of the polymyxin B resistance model.

(0.18 MB PDF)

Figure S1

Noise amplification rate in single-positive-loop systems with respect to t1→0 and t0→1, respectively.

(0.08 MB PDF)

Figure S2

Noise amplification rate in positive-positive-loop systems with respect to t1→0 and t0→1, respectively.

(0.07 MB PDF)

Figure S3

Two-time-scale decomposition of the single-positive-loop system (1) in the main text.

(0.23 MB PDF)

Figure S4

The ratio of noise amplification rates in positive-negative-loop systems to single-positive-loop systems.

(0.03 MB PDF)

Figure S5

Simulations of the Hill function model (46) in Text S1.

(0.10 MB PDF)

Figure S6

Simulations of the Hill function model (47) in Text S1.

(0.07 MB PDF)

Figure S7

The full plot of Figure 6G.

(0.03 MB PDF)

Figure S8

Simulations of the four connector-mediated models. The activation (A) and deactivation (B) dynamics of the regulator-protecting (RP) model (blue), the regulator-activating (RA) model (green), the phosphatase-inhibiting (PI) model (black), and the kinase-stimulating (KS) model (red). (C–F) The output of the RP model (C), the RA model (D), the PI model (E), and the KS model (F). In (C–F), we use the same input (G).

(0.09 MB PDF)

Table S1

Parameters used in the simulation of the polymyxin B resistance model. The values of kp and k−p correspond to kpmax = 1, k−pmax = 2, and f = 0.05 in [38], a case of mild activation from the second input.

(0.05 MB PDF)

Acknowledgments

We thank the anonymous reviewers for their helpful suggestions and references. We also thank Tau-Mu Yi, Travis Moore and Ching-Shan Chou for their valuable discussions on yeast cell polarization models.

Footnotes

The authors have declared that no competing interests exist.

This work was supported by NIH grants R01GM75309, R01GM67247, and P50GM76516. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Berridge MJ. The versatility and complexity of calcium signalling. Complexity in biological information processing. 2001;239:52–67. [PubMed] [Google Scholar]
  • 2.Lewis RS. Calcium signaling mechanisms in T lymphocytes. Annu Rev Immunol. 2001;19:497–521. doi: 10.1146/annurev.immunol.19.1.497. [DOI] [PubMed] [Google Scholar]
  • 3.Harris SL, Levine AJ. The p53 pathway: positive and negative feedback loops. Oncogene. 2005;24:2899–2908. doi: 10.1038/sj.onc.1208615. [DOI] [PubMed] [Google Scholar]
  • 4.Acar M, Becskei A, van Oudenaarden A. Enhancement of cellular memory by reducing stochastic transitions. Nature. 2005;435:228–232. doi: 10.1038/nature03524. [DOI] [PubMed] [Google Scholar]
  • 5.Hoffmann I, Clarke PR, Marcote MJ, Karsenti E, Draetta G. Phosphorylation and activation of human cdc25-C by cdc2-cyclin B and its involvement in the self-amplification of MPF at mitosis. EMBO Journal. 1993;12:53–63. doi: 10.1002/j.1460-2075.1993.tb05631.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Morgan DO. The Cell Cycle: Principles of Control. New Science Press; 2007. [Google Scholar]
  • 7.Novak B, Tyson JJ. Modeling the cell division cycle: M-phase trigger, oscillations, and size control. J Theor Biol. 1993;165:101–134. [Google Scholar]
  • 8.Solomon MJ, Glotzer M, Lee TH, Philippe M, Kirschner MW. Cyclin activation of p34cdc2. Cell. 1990;63:1013–1024. doi: 10.1016/0092-8674(90)90504-8. [DOI] [PubMed] [Google Scholar]
  • 9.Altschuler SJ, Angenent SB, Wang Y, Wu LF. On the spontaneous emergence of cell polarity. Nature. 2008;454:886–890. doi: 10.1038/nature07119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Butty AC, Perrinjaquet N, Petit A, Jaquenoud M, Segall JE, et al. A positive feedback loop stabilizes the guanine-nucleotide exchange factor Cdc24 at sites of polarization. The EMBO Journal. 2002;21:1565–1576. doi: 10.1093/emboj/21.7.1565. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Drubin DG, Nelson WJ. Origins of cell polarity. Cell. 1996;84:335–344. doi: 10.1016/s0092-8674(00)81278-7. [DOI] [PubMed] [Google Scholar]
  • 12.Wedlich-Soldner R, Altschuler S, Wu L, Li R. Spontaneous cell polarization through actomyosin-based delivery of the Cdc42 GTPase. Science. 2003;299:1231–1235. doi: 10.1126/science.1080944. [DOI] [PubMed] [Google Scholar]
  • 13.Wedlich-Soldner R, Wai SC, Schmidt T, Li R. Robust cell polarity is a dynamic state established by coupling transport and GTPase signaling. J Cell Biol. 2004;166:889–900. doi: 10.1083/jcb.200405061. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Chou CS, Nie Q, Yi T. Modeling robustness tradeoffs in yeast cell polarization induced by spatial gradients. PLoS ONE. 2008;3:e3103. doi: 10.1371/journal.pone.0003103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Moore T, Chou CS, Nie Q, Jeon N, Yi TM. Robust spatial sensing of mating pheromone gradients by yeast cells. PLoS ONE. 2008;3:e3865. doi: 10.1371/journal.pone.0003865. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Angeli D, Ferrell JE, Sontag ED. Detection of multistability, bifurcations, and hysteresis in a large class of biological positive-feedback systems. Proc Natl Acad Sci USA. 2004;101:1822–1827. doi: 10.1073/pnas.0308265100. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Ferrell JE. Feedback regulation of opposing enzymes generates robust, all-or-none bistable responses. Current Biology. 2008;18:244–245. doi: 10.1016/j.cub.2008.02.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Ferrell JE, Xiong W. Bistability in cell signaling: How to make continuous processes discontinuous, and reversible processes irreversible. Chaos. 2001;11:221–236. doi: 10.1063/1.1349894. [DOI] [PubMed] [Google Scholar]
  • 19.Huang CY, Ferrell JE. Ultrasensitivity in the mitogen-activated protein kinase cascade. Proc Natl Acad Sci USA. 1996;93:10078–10083. doi: 10.1073/pnas.93.19.10078. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Ingolia NT, Murray AW. Positive-feedback loops as a flexible biological module. Current biology. 2007;17:668–677. doi: 10.1016/j.cub.2007.03.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Tsai TY, Choi YS, Ma W, Pomerening JR, Tang C, et al. Robust, tunable biological oscillations from interlinked positive and negative feedback loops. Science. 2008;321:126–129. doi: 10.1126/science.1156951. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Brandman O, Meyer T. Feedback loops shape cellular signals in space and time. Science. 2008;322:390–395. doi: 10.1126/science.1160617. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Mitrophanov AY, Groisman EA. Positive feedback in cellular control systems. Bioessays. 2008;30:542–555. doi: 10.1002/bies.20769. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Boulware M, Marchant J. Timing in cellular Ca2+ signaling. Current Biology. 2008;18:R769–R776. doi: 10.1016/j.cub.2008.07.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Freeman M. Feedback control of intercellular signalling in development. Nature. 2000;408:313–319. doi: 10.1038/35042500. [DOI] [PubMed] [Google Scholar]
  • 26.Rao CV, Wolf DM, Arkin AP. Control, exploitation and tolerance of intracellular noise. Nature. 2002;420:231–237. doi: 10.1038/nature01258. [DOI] [PubMed] [Google Scholar]
  • 27.Paulsson J. Summing up the noise in gene networks. Nature. 2004;427:415–418. doi: 10.1038/nature02257. [DOI] [PubMed] [Google Scholar]
  • 28.Hornung G, Barkai N. Noise propagation and signaling sensitivity in biological networks: a role for positive feedback. PLoS Comput Biol. 2008;4:e8. doi: 10.1371/journal.pcbi.0040008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Raj A, van Oudenaarden A. Nature, nurture, or chance: Stochastic gene expression and its consequences. Cell. 2008;135 doi: 10.1016/j.cell.2008.09.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Alon U. Network motifs: theory and experimental approaches. Nature Reviews Genetics. 2007;8:450–461. doi: 10.1038/nrg2102. [DOI] [PubMed] [Google Scholar]
  • 31.Becskei A, Serrano L. Engineering stability in gene networks by autoregulation. Nature. 2000;405:590–593. doi: 10.1038/35014651. [DOI] [PubMed] [Google Scholar]
  • 32.Austin D, Allen M, McCollum J, Dar R, Wilgus J, et al. Gene network shaping of inherent noise spectra. Nature. 2006;439:608–611. doi: 10.1038/nature04194. [DOI] [PubMed] [Google Scholar]
  • 33.Hooshangi S, Weiss R. The effect of negative feedback on noise propagation in transcriptional gene networks. Chaos. 2006;16:026108. doi: 10.1063/1.2208927. [DOI] [PubMed] [Google Scholar]
  • 34.Brandman O, Ferrell JE, Li R, Meyer T. Interlinked fast and slow positive feedback loops drive reliable cell decisions. Science. 2005;310:496–498. doi: 10.1126/science.1113834. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Zhang XP, Cheng Z, Liu F, Wang W. Linking fast and slow positive feedback loops creates an optimal bistable switch in cell signaling. Physical Review E. 2007;76:031924. doi: 10.1103/PhysRevE.76.031924. [DOI] [PubMed] [Google Scholar]
  • 36.Kim D, Kwon YK, Cho KH. Coupled positive and negative feedback circuits form an essential building block of cellular signaling pathways. Bioessays. 2007;29:85–90. doi: 10.1002/bies.20511. [DOI] [PubMed] [Google Scholar]
  • 37.Chou CS, Nie Q, Yi TM. Modeling robustness tradeoffs in yeast cell polarization induced by spatial gradients. PLoS ONE. 2008;3:e3103. doi: 10.1371/journal.pone.0003103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Mitrophanov A, Jewett M, Hadley T, Groisman E. Evolution and dynamics of regulatory architectures controlling polymyxin B resistance in enteric bacteria. PLoS Genetics. 2008;4 doi: 10.1371/journal.pgen.1000233. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Mitrophanov A, Groisman E. Response acceleration in post-translationally regulated genetic circuits. Journal of Molecular Biologyolecular biology. 2009 doi: 10.1016/j.jmb.2009.11.043. doi: 10.1016/j.jmb.2009.11.043. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Chang L, Karin M. Mammalian MAP kinase signaling cascades. Nature. 2001;410:37–40. doi: 10.1038/35065000. [DOI] [PubMed] [Google Scholar]
  • 41.Kevorkian J, Cole JD. Perturbation Methods in Applied Mathematics, volume 34 of Applied Mathematical Sciences. Berlin and New York: Springer-Verlag; 1981. [Google Scholar]
  • 42.Plack CJ. The sense of hearing. Lawrence Erlbaum 2005 [Google Scholar]
  • 43.Shiro U, Itzhak A. Digital low-pass differentiation for biological signal processing. IEEE Trans Biomed Engr. 1982;BME-29:686–693. doi: 10.1109/TBME.1982.324861. [DOI] [PubMed] [Google Scholar]
  • 44.Müller J, Kuttler C, Hense BA. Sensitivity of the quorum sensing system is achieved by low pass filtering. Biosystems. 2008;92:76–81. doi: 10.1016/j.biosystems.2007.12.004. [DOI] [PubMed] [Google Scholar]
  • 45.Garca-Niebla J, Serra-Autonell G. Effects of inadequate low-pass filter application. J Electrocardiol. 2009 doi: 10.1016/j.jelectrocard.2009.03.002. doi: 10.1016/j.jelectrocard.2009.03.002. [DOI] [PubMed] [Google Scholar]
  • 46.Gardiner CW. Handbook of Stochastic Methods. Springer, third edition; 2004. [Google Scholar]
  • 47.Paulsson J. Models of stochastic gene expression. Phys Life Rev. 2005;2:157–75. [Google Scholar]
  • 48.Sprague GF, Thorner JW. The Molecular and Cellular Biology of the Yeast Saccharomyces cerevisiae: Gene Expression. Cold Spring Harbor: Cold Spring Harbor Laboratory Press; 1992. [Google Scholar]
  • 49.Dohlman HG, Thorner JW. Regulation of G protein-initiated signal transduction in yeast: paradigms and principles. Annu Rev Biochem. 2001;70:703–54. doi: 10.1146/annurev.biochem.70.1.703. [DOI] [PubMed] [Google Scholar]
  • 50.Butty AC, Perrinjaquet N, Petit A, Jaquenoud M, Segall JE, et al. A positive feedback loop stabilizes the guanine-nucleotide exchange factor Cdc24 at sites of polarization. Embo J. 2002;21:1565–1576. doi: 10.1093/emboj/21.7.1565. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Gulli MP, Jaquenoud M, Shimada Y, Niederhauser G, Wiget P, et al. Phosphorylation of the Cdc42 exchange factor Cdc24 by the PAK-like kinase Cla4 may regulate polarized growth in yeast. Mol Cell. 2000;6:1155–1167. doi: 10.1016/s1097-2765(00)00113-1. [DOI] [PubMed] [Google Scholar]
  • 52.Leeuw T, Fourest-Lieuvin A, Wu C, Chenevert J, Clark K, et al. Pheromone response in yeast: Association of Bem1p with proteins of the MAP kinase cascade and actin. Science. 1995;270:1210–1213. doi: 10.1126/science.270.5239.1210. [DOI] [PubMed] [Google Scholar]
  • 53.Gomez-Uribe C, Verghese GC, Mirny LA. Operating regimes of signaling cycles: Statics, dynamics, and noise filtering. PLoS Comput Biol. 2007;3:e246. doi: 10.1371/journal.pcbi.0030246. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Frauenfelder H, Sligar SG, Wolynes PG. The energy landscapes and motions of proteins. Science. 1991;254:1598–1603. doi: 10.1126/science.1749933. [DOI] [PubMed] [Google Scholar]
  • 55.Hasty J, Pradines J, Dolnik M, Collins JJ. Noise-based switches and amplifiers for gene expression. Proc Natl Acad Sci. 2000;97:2075–2080. doi: 10.1073/pnas.040411297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Kim K, Wang J. Potential energy landscape and robustness of a gene regulatory network: toggle switch. PLoS Comput Biol. 2007;3:e60. doi: 10.1371/journal.pcbi.0030060. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Thattai M, van Oudenaarden A. Attenuation of noise in ultrasensitive signaling cascades. Biophys J. 2002;82:2943–2950. doi: 10.1016/S0006-3495(02)75635-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Lan Y, Papoian GA. The interplay between discrete noise and nonlinear chemical kinetics in a signal amplification cascade. J Chem Phys. 2006;125:154901. doi: 10.1063/1.2358342. [DOI] [PubMed] [Google Scholar]
  • 59.Shibata T, Fujimoto K. Noisy signal amplification in ultrasensitive signal transduction. Proc Natl Acad Sci U S A. 2005;102:331–336. doi: 10.1073/pnas.0403350102. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Tanase-Nicola S, Warren PB, ten Wolde PR. Signal detection, modularity, and the correlation between extrinsic and intrinsic noise in biochemical networks. Physical review letters. 2006;97 doi: 10.1103/PhysRevLett.97.068102. [DOI] [PubMed] [Google Scholar]
  • 61.Heinrich R, Neel BG, Rapoport TA. Mathematical models of protein kinase signal transduction. Mol Cell. 2002;9:957–970. doi: 10.1016/s1097-2765(02)00528-2. [DOI] [PubMed] [Google Scholar]
  • 62.Chaves M, Dinerstein RJ, Sontag ED. Optimal length and signal amplification in weakly activated signal transduction cascades. J Physical Chemistry. 2004;108:15311–15320. [Google Scholar]
  • 63.Chaves M, Sontag ED. Exact computation of amplification for a class of nonlinear systems arising from cellular signaling pathways. Automatica. 2006;42:1987–1992. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Text S1

Linear analysis, two-time-scale asymptotical expansion, FDT approach, and equations of the polymyxin B resistance model.

(0.18 MB PDF)

Figure S1

Noise amplification rate in single-positive-loop systems with respect to t1→0 and t0→1, respectively.

(0.08 MB PDF)

Figure S2

Noise amplification rate in positive-positive-loop systems with respect to t1→0 and t0→1, respectively.

(0.07 MB PDF)

Figure S3

Two-time-scale decomposition of the single-positive-loop system (1) in the main text.

(0.23 MB PDF)

Figure S4

The ratio of noise amplification rates in positive-negative-loop systems to single-positive-loop systems.

(0.03 MB PDF)

Figure S5

Simulations of the Hill function model (46) in Text S1.

(0.10 MB PDF)

Figure S6

Simulations of the Hill function model (47) in Text S1.

(0.07 MB PDF)

Figure S7

The full plot of Figure 6G.

(0.03 MB PDF)

Figure S8

Simulations of the four connector-mediated models. The activation (A) and deactivation (B) dynamics of the regulator-protecting (RP) model (blue), the regulator-activating (RA) model (green), the phosphatase-inhibiting (PI) model (black), and the kinase-stimulating (KS) model (red). (C–F) The output of the RP model (C), the RA model (D), the PI model (E), and the KS model (F). In (C–F), we use the same input (G).

(0.09 MB PDF)

Table S1

Parameters used in the simulation of the polymyxin B resistance model. The values of kp and k−p correspond to kpmax = 1, k−pmax = 2, and f = 0.05 in [38], a case of mild activation from the second input.

(0.05 MB PDF)


Articles from PLoS Computational Biology are provided here courtesy of PLOS

RESOURCES