Abstract
Autoregulatory feedback loops, where the protein expressed from a gene inhibits or activates its own expression are common gene network motifs within cells. In these networks, stochastic fluctuations in protein levels are attributed to two factors: intrinsic noise (i.e., the randomness associated with mRNA/protein expression and degradation) and extrinsic noise (i.e., the noise caused by fluctuations in cellular components such as enzyme levels and gene-copy numbers). We present results that predict the level of both intrinsic and extrinsic noise in protein numbers as a function of quantities that can be experimentally determined and/or manipulated, such as the response time of the protein and the level of feedback strength. In particular, we show that for a fixed average number of protein molecules, decreasing response times leads to attenuation of both protein intrinsic and extrinsic noise, with the extrinsic noise being more sensitive to changes in the response time. We further show that for autoregulatory networks with negative feedback, the protein noise levels can be minimal at an optimal level of feedback strength. For such cases, we provide an analytical expression for the highest level of noise suppression and the amount of feedback that achieves this minimal noise. These theoretical results are shown to be consistent and explain recent experimental observations. Finally, we illustrate how measuring changes in the protein noise levels as the feedback strength is manipulated can be used to determine the level of extrinsic noise in these gene networks.
Introduction
Gene expression and regulation is inherently a noisy process. The origins of this stochasticity lie in the probabilistic nature of transcription and translation and low copy numbers of RNAs and proteins within cells, which can lead to large statistical fluctuations in molecule numbers. Recent work (1–6) has provided considerable experimental evidence for these stochastic fluctuations and may explain the large amounts of cell-to-cell variation observed in genetically identical cells exposed to the same environmental conditions (7,8). Various gene network motifs within cells decrease these stochastic fluctuations. A common such motif is an autoregulatory gene network where the protein expressed from the gene inhibits its own transcription (9,10). Both theoretical and experimental studies have shown that negative feedback in these autoregulatory gene networks reduces stochastic fluctuations in the protein population (11–19), whereas positive feedback has the opposite effect (20,21).
Autoregulatory gene networks are characterized by their transcriptional response g(x), which determines the transcription rate of the gene as a nonlinear function g of the protein molecular count x within the cell. Monotonic decreasing and increasing functions g(x) denote negative and positive feedback, respectively. The noise in the protein population is quantified by its coefficient of variation defined as the ratio of the standard deviation to the average number of protein molecules. Previous work has shown that this protein noise level is determined by a combination of two components (22,23). The first is the intrinsic noise, which represents the stochastic fluctuations in the protein population arising due to random mRNA and protein formation/degradation events. The second component is the extrinsic noise, which corresponds to fluctuations in the protein numbers arising due to an exogenous noise source driving the autoregulatory gene network, e.g., fluctuations in gene copy numbers, enzyme levels, and/or environmental stimuli.
Using a gene expression model where each expression event produces a burst of random numbers of protein molecules, we decompose the total noise in the protein population into its extrinsic and intrinsic components. In particular, both these components of noise are expressed in terms of the response time defined as follows: assuming x∗ to be the steady-state average protein count, the response time Tr is the time taken for any initial perturbation about x∗ to decay by 50% of its initial value. The response time is intrinsically connected to the stability of the equilibrium x∗ with more stable equilibriums having smaller values of Tr. We show that for a fixed average number of protein molecules, decreasing response times leads to attenuation of both protein intrinsic and extrinsic noise, with the extrinsic noise being more sensitive to changes in the response time.
We next quantify noise in autoregulatory gene networks that involve a common negative feedback with transcriptional response given by
(1) |
where M ≥ 1 denotes the Hill coefficient, g0 corresponds to the maximum transcription rate, and the constant a characterizes the negative feedback strength. We perform a systematic analysis of how the protein noise level changes as the feedback strength is increased, keeping all the other kinetic parameters of the gene network fixed. In this procedure of varying the feedback strength a, the steady-state average protein level monotonically decreases with increasing a. We show that in this case, the total noise in the protein population is minimal at some optimal level of feedback strength, and decreasing or increasing feedback strength away from this optima always causes an increase in the noise level. We quantify both the optimal level of feedback strength and the limit of noise suppression, which is defined as the ratio of the minimum possible noise in the protein population to the protein noise level when there is no feedback. We show that this limit of noise suppression can be used to estimate the noise in the exogenous signal that is the source of protein extrinsic noise. These theoretical results are validated using experimental data from Dublanche et al. (24) for a synthetic autoregulatory gene network.
Finally, we investigate how the protein noise level changes as the feedback strength is increased, keeping the steady-state average protein level x∗ fixed. Here increasing feedback strength is also accompanied by a change in one of the gene network parameters (for example, the maximum transcription rate g0) such that x∗ does not change. We show that depending on which gene network parameter is varied with the feedback strength, the protein noise level can either monotonically decrease with increasing feedback strength or can be minimal at an optimal level of feedback strength.
Unregulated Gene Expression
We consider a simple model of gene expression where a gene expresses a protein X in bursts that occur at a rate Kx. Each expression event leads to a burst of Nx molecules of the protein X. Recent work suggests that the burst of proteins from each mRNA transcript follows a geometric distribution (25–27). Thus, instead of assuming Nx to be a constant, we assume it to be a random variable with mean Nx and variance V2x. We also assume that the protein decays at a constant rate dx. Our model omits the mRNA dynamics. This is a valid approximation as long as the protein's half-life is much longer than the mRNA's half-life (26,28). Shahrezaei and Swain (26) does a survey of ∼2000 genes in budding yeast and shows that most genes do indeed satisfy this condition. Ignoring the mRNA dynamics leads to relatively simple expressions for the protein noise level, which help develop a qualitative understanding of how noise level changes in response to alterations of the gene network parameters.
In a stochastic formulation, gene expression and protein degradation are treated as probabilistic events with probabilities of occurring in an infinitesimal time interval (t, t + dt] given by
(2a) |
(2b) |
respectively, where x(t) denotes the number of molecules of protein X at time t.
A convenient way to model the time evolution of the number of molecules x is through a stochastic hybrid system (SHS) characterized by trivial continuous dynamics
(3) |
and two reset maps
(4) |
with corresponding transition intensities given by
(5) |
(29). To gauge the noise level in the protein population, we determine the time evolution of the first- and second-order moments of x, i.e., the expected values E[x] and E[x2]. The moment dynamics can be obtained using the Dynkin's formula for the above SHS, according to which, for every differentiable function ψ(x), we have that
(6) |
(30,31). Taking ψ(x) = x and ψ(x) = x2 in Eq. 6, we obtain the following moment dynamics:
(7a) |
(7b) |
As t → ∞, the first- and second-order moments converge to constant steady-state values given by
(8a) |
(8b) |
We quantify the noise in x(t) by its coefficient of variation defined as the ratio of the standard deviation in protein numbers to the average number of protein molecules. Using the above steady-state values, we obtain
(9) |
This quantity quantifies the noise in the protein X solely due to random gene expression and protein degradation, and is referred to as the intrinsic noise in the protein population when there is no regulation. Table 1 provides a summary of the notations used for the different forms of noise in the protein population. Note that the noise in the protein increases with the variance V2x in the number of protein molecules produced in each transcription event. A special case of Eq. 9 is obtained for Nx = 1 and Vx = 0, for which x(t) has a Poisson distribution and CVint–nr2 = 1/x∗. In the next section, we examine what happens to this intrinsic noise when the gene expression rate is not a constant but a function of the number of protein molecules.
Table 1.
CVtot | Total noise in protein numbers. |
CVext | Extrinsic noise in protein numbers. |
CVint | Intrinsic noise in protein numbers. |
CVz | Noise in the exogenous signal driving the gene network. |
CVtot–nr | Total noise in protein numbers when there is no feedback. |
CVext–nr | Extrinsic noise in protein numbers when there is no feedback. |
CVint–nr | Intrinsic noise in protein numbers when there is no feedback. |
CVtot–min | Minimum possible total noise in protein numbers with optimal negative feedback. |
CVext–min | Minimum possible extrinsic noise in protein numbers with optimal negative feedback. |
CVint–min | Minimum possible intrinsic noise in protein numbers with optimal negative feedback. |
amin | Feedback strength where the total noise in the protein is minimum. |
x∗ | Steady-state mean protein level. |
Tr | Protein response time. |
Tnr | Protein's half-life. |
Tz | Response time of the exogenous signal. |
Autoregulatory Gene Expression
Often the expressed protein binds to the promoter region of its own gene. In doing so, it either recruits the enzyme RNA polymerase to the promoter (which leads to an increase in gene expression) or blocks RNA polymerase from binding to the promoter (which causes a decrease in gene expression). Such gene expression is referred to as an autoregulatory gene network. Recent work has reported that >40% of Escherichia coli transcription factors regulate their own expression through these mechanisms (32).
We model this network by assuming that the rate of gene expression is no longer a constant and is instead a function g(x) of the number of protein molecules x. We refer to the function g(x) as the transcriptional response of the network. This transcriptional response can be formally derived assuming that the rate of binding and dissociation between the protein and its promoter is much faster than the dynamics of protein production and degradation (9), or it can be determined directly from experiments. Monotonic decreasing and increasing functions g(x) denote negative and positive feedback, respectively.
When an autoregulation mechanism is present, the probabilities of gene expression and protein degradation events occurring in an infinitesimal time interval (t, t + dt] are given by
(10a) |
(10b) |
To write the moment dynamics of x we approximate g(x) by a linear transcriptional response,
(11) |
where x∗ is the steady-state average protein count. This approximation is valid as long as the stochastic fluctuations in the protein do not leave the region in which g(x) is approximately linear.
As in the section on Unregulated Gene Expression, we model the time evolution of x through an SHS, but now the transition intensities are given by λ1(x) = g(x∗) + g′(x∗)(x – x∗) and λ2(x) = dxx. Using the Dynkin's formula for this modified SHS, we obtain the following dynamics for the mean E[x],
(12) |
and the steady-state value x∗ for the mean population E[x] must satisfy
(13) |
Assuming that this steady state is stable, we have a negative eigenvalue
(14) |
for the linear system given by Eq. 12. This eigenvalue λ can be expressed in terms of the response time Tr of the protein. The response time is defined as the time taken for any perturbation around x∗ to decay by 50% of its initial value, and is given by
(15) |
The above equation shows that for a fixed mean protein count x∗, average burst size Nx, and protein degradation rate dx, making the slope g′(x∗) more negative decreases the response time Tr.
We now compute the coefficient of variation of x(t) by writing the moment dynamics for the second-order moment E[x2]. Using Eq. 6, with ψ(x) = x2 we obtain the following time derivative for E[x2]:
(16) |
Performing a steady-state analysis of the above equations and using Eq. 13, we obtain the following steady-state coefficient of variation,
(17) |
where I can be interpreted as the y intercept of the tangent to the transcriptional response g(x) at x = x∗ (see Fig. 1). Using Eqs. 13, 15, and 17, we can also relate the intrinsic noise to the response time Tr of the protein as
(18) |
where Tnr = ln(2)/dx is the protein's half-life. The formula in Eq. 18 shows that the intrinsic noise level in autoregulatory gene networks is determined by three factors: the average number of protein molecules x∗; the response time of the protein Tr; and the gene expression burst-characteristics, i.e., Nx and V2x. From Eqs. 15 and 18, we also conclude that for a fixed x∗, Nx, V2x, and dx, making the slope g′(x∗) more negative causes a decrease in the response time and leads to attenuation of intrinsic noise in the protein population. For example, for a fixed x∗ a fivefold decrease in response time (i.e., Tr = Tnr/5) will reduce the intrinsic noise levels in the protein population by a factor of .
An important feature of Eq. 18 is that it relates the noise in the protein to parameters that can be experimentally determined. In particular, the average burst size Nx = Lx/dr, where Lx is the translation rate of the mRNA and dr is the mRNA degradation rate. As mentioned before, protein half-lives are typically much longer than mRNA half-lives. In this case, Nx follows a geometric distribution and V2x = N2x + Nx (26,27). Finally, the response times can be measured by tracking the time evolution of fluorescently tagged protein molecules (32).
Extrinsic and Intrinsic Contributions to Noise
We now consider extrinsic noise in the protein population arising due to an exogenous noise source driving the autoregulatory gene network. Toward that end, we consider a transcriptional response g(x, z) that depends on a noisy exogenous signal z. The transcriptional response g(x, z) may take different forms. For example, if the gene is encoded on a low-copy plasmid, then fluctuations in the number of copies of the plasmid are known to be a major source of extrinsic noise (24). In this case, the transcriptional response takes the form zg(x), where z represents the number of copies of the plasmid. Alternatively, z could represent the number of molecules of the RNA polymerase, in which case, the transcriptional response (assuming a feedback with a Hill coefficient equal to one) would be
(19) |
where k0, k1, and k2 are positive constants (14).
We model the stochastic fluctuations in z by a birth-death process. In particular, the probabilities of formation and degradation of z in the infinitesimal time interval (t, t + dt] are given by
(20a) |
(20b) |
where Kz and dz represent the production and degradation rate of z, respectively, and Nz is a random variable with mean Nz and variance V2z. In the sequel we refer to Tz = ln(2)/dz as the response time of the exogenous signal. Following steps such as those outlined in Unregulated Gene Expression, we can conclude from Eqs. 8 and 9 that the steady-state average level and the coefficient of variation of z are given by
(21) |
and
(22) |
respectively. The quantity CVz represents the amount of noise that enters the autoregulatory gene network through the exogenous signal z. Assuming that stochastic fluctuations around the means are sufficiently small, we linearize the transcriptional response with respect to both x and z. This gives us the transcriptional response
(23) |
where x∗ and z∗ are steady-state means of x and z, respectively. In the sequel, g(x) refers to g(x, z∗), the transcriptional response when there is no noise in the exogenous signal. Details are presented in Appendix A (see Supporting Material) where we show that for this linearized transcriptional response, x∗ is the solution to Eq. 13 and the total protein noise CVtot is given by
(24) |
where CVint is the previously computed intrinsic noise and
(25) |
represents the extrinsic noise in the protein population. Note that signals z with small response times Tz result in smaller values of CVext because rapid fluctuations in the exogenous signal are averaged out by the dynamics of the gene network. Typically, only those exogenous signals that have response times much larger than the protein's response time contribute significantly to the extrinsic component of protein noise.
Equation 25 shows that the extrinsic component of noise CVext is related to the protein response time Tr, which in turn is determined by the slope of the transcriptional response g(x) at x = x∗ (see Eq. 15). This is in contrast to the intrinsic noise CVint, which is determined by the y intercept of the tangent to the transcriptional response g(x) at x = x∗ (see Eq. 17).
We recall that for a fixed mean protein count x∗, average burst size Nx, and protein degradation rate dx, making the slope g′(x∗) more negative decreases the response time Tr. Equation 25 predicts that like intrinsic noise, here decreasing response time also reduces the extrinsic component of noise CVext. We now contrast how rapidly intrinsic and extrinsic noise attenuate as the response time decreases. We first express CVext as a function of the extrinsic noise level CVext–nr that would be observed in the absence of feedback,
(26) |
where
(27) |
Note from the previous section that a fivefold decrease in the response time (i.e., Tr = Tnr/5) reduced protein intrinsic noise levels by a factor of 2.2 (assuming that x∗ is kept fixed). From Eq. 26, we conclude that this fivefold decrease in the response time corresponds to a reduction of CVext by a factor of 3.9 compared to CVext–nr when Tz ≈ Tnr, or a reduction by a factor of 5 when Tz >> Tnr. This illustrates an important point: in these autoregulatory gene networks, negative feedback is much more effective in reducing the extrinsic component of protein noise than its intrinsic component.
Autoregulatory Gene Networks with Negative Feedback
We next consider autoregulatory gene networks where transcriptional response is given by the Hill equation
(28) |
where M ≥ 1 denotes the Hill coefficient and g0 is the maximal transcription rate (9,33). The constant a is the feedback strength that depends on the binding affinity of the protein to the promoter, with lower binding affinities corresponding to smaller values of a. Note that a = 0 corresponds to no negative feedback in gene expression. This is because when a = 0, the transcription rate is simply g(x)|a=0 = g0, which is independent of the protein count. For this transcriptional response, we conclude from Eq. 13 that the steady-state average protein count x∗ is the unique solution to
(29) |
and monotonically decreases as we increase the feedback strength a.
Our goal is to understand how the noise in the protein numbers change as the negative feedback strength varies. In particular, we vary the feedback strength in two different ways. Firstly, we vary a by keeping the gene network kinetics (i.e., the constants g0, Nx, and dx) fixed. As mentioned above, here the protein count x∗ decreases with increasing feedback strength a. Alternatively, we vary a by keeping x∗ fixed. In this later procedure, any increase in a is also accompanied by a change in g0, Nx, or dx. As we show below, in both these methods of varying the feedback strength, noise in protein numbers can be minimal at an optimal level of feedback strength.
Changing Feedback Strength by Keeping the Kinetics Fixed
We investigate how the different components of the noise and the total noise in the protein numbers change as the feedback strength is varied, keeping the constants g0, Nx, and dx fixed.
Suppression of intrinsic noise in the protein
We first investigate the intrinsic component of noise given by Eq. 18 for this specific transcriptional response. Substituting Eq. 28 in Eq. 18, and using Eq. 29, we conclude that the intrinsic noise CVint in the protein is given by
(30) |
where
(31) |
is the intrinsic noise in the protein when there is no feedback (i.e., a = 0). Using Eqs. 15 and 28, we have that the response time Tr is given by
(32) |
and it monotonically decreases as we increase the feedback strength a (keeping g0, Nx, and dx fixed) with the asymptote
(33) |
Substituting Eq. 32 in Eq. 30, we get
(34) |
Straightforward calculus shows that the above intrinsic noise is smallest when the feedback strength is equal to
(35) |
and the corresponding minimum intrinsic noise CVint–min is given by
(36) |
When M = 1, then aint–min = 0 and CVint–min = CVint–nr, i.e., the intrinsic noise level is minimum when there is no feedback. In this particular case, increasing a causes CVint to monotonically increase (see Fig. 2). This happens because as we increase a from zero, both Tr and x∗ decrease in Eq. 18. However, as x∗ decreases at a faster rate than Tr, their ratio Tr/x∗ increases, and hence, the intrinsic noise increases as we increase the feedback strength a. When M > 1, the intrinsic noise first decreases when we increase a from zero and achieves a minimum at some optimal value a = aint–min > 0. Increasing a beyond aint–min causes an increase in the intrinsic noise level (see Fig. 2). Note from Fig. 2 that, for large levels of feedback strength, the intrinsic component of protein noise always increases with increasing feedback strength, irrespective of the value of the Hill coefficient.
From Eq. 36, the quantity
(37) |
represents the highest suppression of intrinsic noise in the protein from CVint–nr that can be achieved with the transcriptional response given by Eq. 28. This limit of noise suppression is completely determined by the Hill coefficient M, with larger values of M causing more reduction in the protein intrinsic noise. This is consistent with results in the literature, which show that a large Hill coefficient is more effective in reducing stochastic fluctuations in the protein (12,17,33). For example, when M = 2, there can be, at most, a reduction in intrinsic noise from CVint–nr, whereas for M = 4, we can have a 20% reduction.
In summary, depending on the Hill coefficient, the protein intrinsic noise levels can either monotonically increase or exhibit a U-shaped curve as the feedback strength is increased. Moreover, large Hill coefficients are much more effective in reducing noise.
Suppression of extrinsic noise in the protein
We now investigate the extrinsic component of protein noise CVext. As the response time Tr is a monotonically decreasing function of the feedback strength (see Eq. 32), we conclude from Eq. 25 that the extrinsic noise in protein numbers decreases with increasing feedback strength. Using Eqs. 26 and 33, the minimum level of extrinsic noise is given by
(38) |
and is achieved in the limit a → ∞.
Equation 38 represents the limit of extrinsic noise suppression. If the response time of the exogenous signal is much slower than the protein half-life (i.e., Tz >> Tnr), then this limit reduces to
(39) |
As we increase M, these limits decrease at a much faster rate than the limit of intrinsic noise suppression (compare with right-hand side of Eq. 37). For example, when Tz ≈ Tnr and M = 2, we have a maximum reduction in extrinsic noise of ≈42%, whereas for M = 4 we have a reduction of 74%. These reductions are much larger than the maximum reductions of 5.7% and 20% in the protein intrinsic noise level for the same values of M (see previous section). This reinforces the earlier point that negative feedback is much more efficient in reducing the extrinsic component of the noise than its intrinsic component.
Suppression of total noise in the protein
Finally, we investigate how the total noise in the protein population varies with the feedback strength. As derived in Extrinsic and Intrinsic Contributions to Noise, the total protein noise level is given by
(40) |
By which, using Eq. 25, Eqs. 32 and 34 can be written as
(41a) |
(41b) |
Now, for all M ≥ 1 and CVz > 0, we have that
(42) |
which means that in the presence of extrinsic noise, the total protein noise level will always decrease as we increase the feedback strength from a = 0, irrespective of the value of the Hill coefficient, but eventually will start to increase for sufficiently large values of a past an optimal feedback strength amin. In summary, in the presence of extrinsic noise, the total noise in the protein is always minimized at some optimal feedback strength and decreasing or increasing feedback strength away from this optima will always causes an increase in the noise level. This point is shown in Fig. 3, which plots CVtot/CVtot–nr as a function of a when the Hill coefficient is one, where
(43) |
represents the protein noise level when there is no feedback. We can see that in the absence of extrinsic noise (CVz = 0), CVtot/CVtot–nr monotonically increases as the feedback strength is increased. However, in the presence of extrinsic noise, it follows a U-shaped profile and is minimized at some a = amin > 0.
As shown in Fig. 4, when the Hill coefficient is larger than one (M > 1), then even in the absence of any extrinsic noise (CVz = 0), the protein noise level will show a U-shaped profile as the feedback strength is altered. In particular, for CVz = 0, we conclude from Eq. 37 that the minimum value of CVtot/CVtot–nr, i.e., the limit of noise suppression, is given by
(44) |
and is attained when the feedback strength is equal to
(45) |
As shown in Fig. 3 (for M = 1) and Fig. 4 (for M = 2), when we now increase CVz away from zero, this limit of noise suppression decreases and is much lower than what is predicted by Eq. 44. On the other hand, the optimal feedback strength amin, at which the protein noise is minimum, increases and is much higher than Eq. 45. As we further increase the noise CVz in the exogenous signal, CVtot–min/CVtot–nr approaches Eq. 38, which corresponds to the scenario where extrinsic noise dominates the total noise in protein numbers.
In Appendix B (see Supporting Material), we provide formulas that predict both the minimum level of noise CVtot–min and the optimal feedback strength when both intrinsic and extrinsic noise are present but neither dominates the total noise in the protein population. As we will illustrate later, an important application of these formulas is that one can estimate the noise in the exogenous signal from the experimentally obtained value of CVtot–min without directly measuring the exogenous signal.
Experimental verification
We now validate our theoretical results with recent experimental measurements of protein noise levels that were obtained as the feedback strength was changed via experimental manipulation. In Dublanche et al. (24), a synthetic autoregulatory gene network is constructed where the protein inhibits its own transcription. The feedback strength is altered by adding a compound aTc that binds to the protein and the resulting complex has a significantly smaller binding affinity to the promoter. As the feedback strength is directly related to the binding affinity of the protein to its promoter, increasing the concentration of aTc corresponds to decreasing the feedback strength a. The gene is encoded on a low-copy plasmid with high variability in plasmid population contributing to large levels of extrinsic noise in the protein population. Based on our theoretical analysis, the protein noise level should show a U-shaped profile as the feedback strength is changed. In particular, at low values of a (i.e., high levels of aTc), increasing a (i.e., deceasing aTc) should lead to a decrease in protein noise levels. However, at high values of a (i.e., low levels of aTc), increasing a (i.e., deceasing aTc) should increase the protein noise levels. Such a U-shaped profile is indeed what is experimentally observed and the protein noise level is minimized at an optimal level of feedback strength (see bottom-left plot of Fig. 4 in (24)).
In Dublanche et al. (24), the results from detailed stochastic simulations of the autoregulatory gene network are also reported. The authors observe in simulation that both in the absence of any extrinsic noise or when the extrinsic noise from only the enzyme RNA polymerase is included, instead of seeing a U-shaped profile, the protein noise level monotonically increased as the feedback strength is increased (i.e., aTc concentration is decreased). Our theoretical results fully explain this phenomenon: Since in this synthetic gene network the Hill coefficient is one (M = 1), our analysis in Changing Feedback Strength by Keeping the Kinetics Fixed shows that the intrinsic noise level will always increase when the feedback strength is increased. As the extrinsic noise associated with fluctuations in RNA polymerase numbers is very small (we calculate CVRNA polymerase ≈ 0.02 using Eq. 22 and the reaction rates provided in Table I of (24)), in both the above cases the protein noise is dominated by the intrinsic noise, which always increases with the feedback strength, and hence, no U-shaped profile should be observed.
As mentioned earlier, our results also allow us to predict the level of noise in the exogenous signal that drives the synthetic autoregulated gene network. Hypothesizing that the source of extrinsic noise is the plasmid population, and using the experimentally obtained minimal protein noise level of ∼0.4, we estimate in Appendix C (see Supporting Material) that
(46) |
Independent measurements of plasmid noise (using Eq. 22 and the reaction rates provided in Table I of (24)) show that CVplasmid is equal to 0.51, which is just slightly smaller than given by Eq. 46. This indicates that variability in plasmid numbers is indeed the major source of extrinsic noise in the protein population. The fact that the estimate in Eq. 46 is larger than the actual plasmid noise suggests that variability in other cellular components or fluctuations in number of aTc molecules also make (minor) contributions to the extrinsic noise.
In summary, the experimental results of Dublanche et al. (24) provide an experimental verification of our theoretical predictions. They also indicate that measuring changes in the protein noise level as a function of the feedback strength could be useful in determining the level of noise in the exogenous signal.
Changing Feedback Strength by Keeping the Protein Level Fixed
We finally investigate how the protein noise levels change as the feedback strength is varied, keeping the steady-state average protein level x∗ fixed. As can be seen from Eq. 29, x∗ can be held at a fixed level if increasing feedback strength a is also accompanied by: 1), an increase in the maximum transcription rate g0; 2), a decrease in the protein degradation rate dx; and 3), an increase in the average protein burst size Nx. Recall that the average burst size Nx = Lx/dr, where Lx is the translation rate of the mRNA and dr is the mRNA degradation rate. Thus, increasing both mRNA translational rate and/or decreasing mRNA degradation rate will result in an increase in Nx. In Appendix D (see Supporting Material), we derive formulas for the total noise in the protein level for each of these three different ways of changing the feedback strength but keeping the average protein level fixed.
We show that if the feedback strength is varied along with either the maximum transcription rate g0 or the protein degradation rate dx, then noise in protein numbers always decreases with increasing feedback strength. On the other hand, if feedback strength is varied by changing the mRNA translation or degradation rate (i.e., the average protein burst size), then there exists an optimal levels of feedback strength where protein noise level is minimum. The above points are illustrated in Fig. 5, where, for a given fixed x∗, we observe a U-shaped noise profile when feedback strength is varied along with the average protein burst size. However, this U-shaped profile vanishes if feedback strength is varied along with the maximum transcription rate g0 or protein degradation rate dx.
Discussion
Autoregulatory gene networks where the protein inhibits/activates its own transcription are common motifs occurring within living cell. These networks are characterized by their transcriptional response g(x), which provides information on how the transcription rate of the gene varies as a function of the number of protein molecules x present in the cell.
Noise and the shape of the transcriptional response
We developed a full understanding of how the protein noise levels are related to the functional form of the transcriptional response. Using a linear approximation for g(x), we showed that the extrinsic noise levels are determined by the slope g′(x∗) of the transcriptional response at x∗, with more negative values of the slope (i.e., more stable equilibriums x∗) leading to smaller levels of extrinsic noise. On the other hand, the intrinsic noise levels are determined by I = g(x∗) – x∗g′(x∗), which is the y intercept of the tangent to the transcriptional response at x = x∗ (as shown in Fig. 1), and larger values of I lead to smaller levels of intrinsic noise. Consequently, given two gene networks with same protein degradation rate, gene expression characteristics (i.e., Nx and V2x) but different hypothetical transcriptional responses g1(x) = 1 and g2(x) = 1 − x/2, the response g2(x) will give lower levels of extrinsic noise. However, since both transcriptional responses have the same intercept I equal to one, they both yield the same level of intrinsic noise in the protein population.
Analytical formulas that relate the noise levels to the response time of the protein show key differences between extrinsic and intrinsic noise. For a fixed mean protein level, burst size, and protein degradation rate, as one decreases the protein response time Tr through feedback (by decreasing the slope g′(x∗)), the levels of extrinsic noise decrease much more than those of intrinsic noise. This leads to an important conclusion that negative feedback is much more effective in reducing the extrinsic component of protein noise than its intrinsic component, which is consistent with other theoretical and experimental studies (23,34–36). At a qualitative level, this arises because intrinsic noise is equivalent to white noise driving gene expression (16,37). On the other hand, the exogenous noisy signal z that comes from Eq. 20 is colored noise in the sense that it has noise shifted to lower frequencies, and hence, can be more easily attenuated with feedback than white noise.
Changing feedback strength with fixed kinetics
We investigated how protein noise levels change as we vary the feedback strength keeping the kinetics of the gene network fixed. This was done for a biologically meaningful class of autoregulatory gene networks with negative feedback and characterized by the transcriptional response
(47) |
Our main result shows that in this procedure of varying the feedback strength, the total noise level in the protein population is minimized at an optimal level of feedback strength. This is in contrast to the Fano factor, defined as the ratio of the variance to the average number of protein molecules. As illustrated in Appendix E (see Supporting Material), in this case the Fano factor always decreases with increasing feedback strength, irrespective of whether noise in protein numbers is intrinsic or extrinsic.
Recall from Autoregulatory Gene Networks with Negative Feedback that increasing the feedback strength causes a decrease in the average number of protein molecules, which results in an increase in the intrinsic noise level. On the other hand, increasing the feedback strength causes the protein response time to decrease, which attenuates both the intrinsic and extrinsic noise. The net result of these two opposing effects is a U-shaped profile, where increasing feedback strength first causes the noise level to decrease and then increase. This U-shaped profile was shown to be in good agreement with experimental data for a synthetic autoregulatory gene network. We also identified a scenario where noise is minimum when there is no feedback and any amount of negative feedback will always increase the noise: the case where intrinsic noise dominates the total noise in the protein population and the Hill coefficient is close to one. This explained the observation that when the source of the extrinsic noise was removed, the U-shaped profile vanished, and instead, the noise level monotonically increased with the feedback strength. However, for synthetic gene networks characterized by a large Hill coefficient, our theory predicts that, even in the absence of extrinsic noise, a U-shaped profile should be observed. This remains to be experimentally verified.
Limit of noise suppression
We characterized the smallest level of noise when feedback strength is varied keeping the gene network kinetics fixed. This was done through the limit of noise suppression, which is defined to be the ratio of the minimum possible noise with feedback to the protein noise level when there is no feedback (i.e., a = 0), and corresponds to the depth of the U-shape profile in Figs. 3 and 4. This limit is given by
(48) |
when the intrinsic noise dominates the total noise in the protein (see Eq. 37). However, as the amount of extrinsic noise increases, this limit decreases and asymptotically approaches a value of
(49) |
which corresponds to the situation where extrinsic noise completely dominates the total noise in the protein (see Eq. 38).
The above results can be used to quantify the level of extrinsic noise in the protein population. This is useful for synthetic and natural autoregulatory gene networks where the feedback strength can be manipulated. As illustrated, noise in the exogenous signal can then be estimated from the minimum possible protein noise. Matching these estimates with independent measurements of noise in the exogenous signal can be used to confirm that a particular noise source is the major contributor of extrinsic noise to the protein population.
Relaxing the assumptions of the model
Our analysis made two important assumptions about the autoregulatory gene network model. Firstly, we omitted the mRNA dynamics. This is a valid approximation for any gene network, with or without transcriptional feedback, as long as the protein's half-life time is much longer than the mRNA's half-life (26,28,38). Secondly, we assumed that the minimum level of transcription rate for the transcriptional response g(x) (also called the basal level of transcription rate and achieved when x → ∞) is zero. The PhD thesis (38) relaxes both these assumptions and shows that our above results hold even when the mRNA dynamics is slower than the protein dynamics and the basal rate of transcription is nonzero. The only difference is that the limit of noise suppression is now slightly larger than predicted by Eqs. 48 and 49.
Changing feedback strength with fixed mean protein level
We also investigated how the protein noise levels change as the feedback strength is varied, keeping the steady-state mean protein level fixed. We showed that in this comparison the shape of protein noise profile depends on which particular gene network parameter is varied with the feedback strength. In particular, if the feedback strength is varied along with the maximum transcription rate or the protein degradation rate, then there is no optimality, and protein noise level always decreases with increasing feedback strength.
If the feedback strength is varied with the mean protein burst size Nx (i.e., mRNA translation or degradation rate), then we get a U-shaped protein noise profile. Such a noise profile arises because for a fixed x∗, a large feedback strength a corresponds to having a high mean burst size Nx ≈ aMx∗Mdx/g0 (see Eq. 29), and hence, high levels of intrinsic noise in the protein population (see Eq. 18). Thus, in this case, small levels of a yield high noise levels because there is no negative feedback in the system, while large levels of a also yield high noise levels because of very bursty gene expression. This results in a U-shaped profile in which total noise in protein numbers is minimum at an optimal level of feedback strength.
In summary, we have developed results relating the noise levels to the feedback strength in autoregulatory gene networks. We have shown that depending on how the feedback strength is increased in these networks, the protein noise levels can monotonically increase, decrease, or be minimal at an optimal level of feedback strength. These results were not only consistent but also helped explain experimental observation from a synthetic autoregulatory gene network. Finally, we illustrated how measuring changes in protein noise level as the feedback strength is altered can be a useful tool to determine the level of extrinsic noise in autoregulatory gene networks.
Acknowledgments
We thank Mustafa Khammash for many discussions of the work reported in this article. We also thank three anonymous reviewers for their useful comments on an earlier draft of the article.
This material is based upon work supported by the Institute for Collaborative Biotechnologies through grant No. DAAD19-03-D-0004 from the U.S. Army Research Office and by the National Science Foundation under grant No. EECS-0725485.
Supporting Material
References
- 1.Walters M.C., Fiering S., Eidemiller J., Magis W., Groudine M. Enhancers increase the probability but not the level of gene expression. Proc. Natl. Acad. Sci. USA. 1995;92:7125–7129. doi: 10.1073/pnas.92.15.7125. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Arkin A., Ross J., McAdams H.H. Stochastic kinetic analysis of developmental pathway bifurcation in phage λ-infected Escherichia coli cells. Genetics. 1998;149:1633–1648. doi: 10.1093/genetics/149.4.1633. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Blake W.J., Kaern M., Cantor C.R., Collins J.J. Noise in eukaryotic gene expression. Nature. 2003;422:633–637. doi: 10.1038/nature01546. [DOI] [PubMed] [Google Scholar]
- 4.Elowitz M.B., Levine A.J., Siggia E.D., Swain P.S. Stochastic gene expression in a single cell. Science. 2002;297:1183–1186. doi: 10.1126/science.1070919. [DOI] [PubMed] [Google Scholar]
- 5.Bar-Even A., Paulsson J., Maheshri N., Carmi M., O'Shea E. Noise in protein expression scales with natural protein abundance. Nat. Genet. 2006;38:636–643. doi: 10.1038/ng1807. [DOI] [PubMed] [Google Scholar]
- 6.Newman J.R.S., Ghaemmaghami S., Ihmels J., Breslow D.K., Noble M. Single-cell proteomic analysis of S. cerevisiae reveals the architecture of biological noise. Nat. Genet. 2006;441:840–846. doi: 10.1038/nature04785. [DOI] [PubMed] [Google Scholar]
- 7.Spudich J.L., Koshland D.E. Non-genetic individuality: chance in the single cell. Nature. 1976;262:467–471. doi: 10.1038/262467a0. [DOI] [PubMed] [Google Scholar]
- 8.McAdams H.H., Arkin A.P. Stochastic mechanisms in gene expression. Proc. Natl. Acad. Sci. USA. 1997;94:814–819. doi: 10.1073/pnas.94.3.814. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Alon U. Network motifs: theory and experimental approaches. Nat. Rev. Genet. 2007;8:450–461. doi: 10.1038/nrg2102. [DOI] [PubMed] [Google Scholar]
- 10.Wall M.E., Hlavacek W.S., Savageau M.A. Design principles for regulator gene expression in a repressible gene circuit. J. Mol. Biol. 2003;332:861–876. doi: 10.1016/s0022-2836(03)00948-3. [DOI] [PubMed] [Google Scholar]
- 11.Savageau M.A. Comparison of classical and autogenous systems of regulation in inducible operons. Nature. 1974;252:546–549. doi: 10.1038/252546a0. [DOI] [PubMed] [Google Scholar]
- 12.Orrell D., Bolouri H. Control of internal and external noise in genetic regulatory networks. J. Theor. Biol. 2004;230:301–312. doi: 10.1016/j.jtbi.2004.05.013. [DOI] [PubMed] [Google Scholar]
- 13.Tao Y., Zheng X., Sun Y. Effect of feedback regulation on stochastic gene expression. J. Theor. Biol. 2007;247:827–836. doi: 10.1016/j.jtbi.2007.03.024. [DOI] [PubMed] [Google Scholar]
- 14.Becskei A., Serrano L. Engineering stability in gene networks by autoregulation. Nature. 2000;405:590–593. doi: 10.1038/35014651. [DOI] [PubMed] [Google Scholar]
- 15.Tomioka R., Kimura H., Kobayashi T.J., Aihara K. Multivariate analysis of noise in genetic regulatory networks. J. Theor. Biol. 2004;229:501–521. doi: 10.1016/j.jtbi.2004.04.034. [DOI] [PubMed] [Google Scholar]
- 16.Simpson M.L., Cox C.D., Sayler G.S. Frequency domain analysis of noise in autoregulated gene circuits. Proc. Natl. Acad. Sci. USA. 2003;100:4551–4556. doi: 10.1073/pnas.0736140100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Singh, A., and J.P. Hespanha. 2006. Stochastic analysis of gene regulatory networks using moment closure. In Proc.. of the 2007 American Control Conference, New York, NY.
- 18.Swain P.S. Efficient attenuation of stochasticity in gene expression through post-transcriptional control. J. Mol. Biol. 2004;344:956–976. doi: 10.1016/j.jmb.2004.09.073. [DOI] [PubMed] [Google Scholar]
- 19.Singh, A., and J.P. Hespanha. 2009. Reducing noise through translational control in an auto-regulatory gene network. In Proc.. of the 2009 American Control Conference, St. Louis, MO.
- 20.Hasty J., Pradines J., Dolnik M., Collins J.J. Noise-based switches and amplifiers for gene expression. Proc. Natl. Acad. Sci. USA. 2000;97:2075–2080. doi: 10.1073/pnas.040411297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Brandman O., Ferrell J.E., Li R., Meyer T. Interlinked fast and slow positive feedback loops drive reliable cell decisions. Science. 2005;310:496–498. doi: 10.1126/science.1113834. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Swain P.S., Elowitz M.B., Siggia E.D. Intrinsic and extrinsic contributions to stochasticity in gene expression. Proc. Natl. Acad. Sci. USA. 2002;99:12795–12800. doi: 10.1073/pnas.162041399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Paulsson J. Summing up the noise in gene networks. Nature. 2004;427:415–418. doi: 10.1038/nature02257. [DOI] [PubMed] [Google Scholar]
- 24.Dublanche Y., Michalodimitrakis K., Kummerer N., Foglierini M., Serrano L. Noise in transcription negative feedback loops: simulation and experimental analysis. Mol. Sys. Biol. 2006;2:41. doi: 10.1038/msb4100081. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Longo D., Hasty J. Imaging gene expression: tiny signals make a big noise. Nat. Chem. Biol. 2006;2:181–182. doi: 10.1038/nchembio0406-181. [DOI] [PubMed] [Google Scholar]
- 26.Shahrezaei V., Swain P.S. Analytical distributions for stochastic gene expression. Proc. Natl. Acad. Sci. USA. 2008;105:17256–17261. doi: 10.1073/pnas.0803850105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Friedman N., Cai L., Xie X.S. Linking stochastic dynamics to population distribution: an analytical framework of gene expression. Phys. Rev. Lett. 2006;97:168302. doi: 10.1103/PhysRevLett.97.168302. [DOI] [PubMed] [Google Scholar]
- 28.Paulsson J. Model of stochastic gene expression. Phys. Life Rev. 2005;2:157–175. [Google Scholar]
- 29.Hespanha J.P., Singh A. Stochastic models for chemically reacting systems using polynomial stochastic hybrid systems. Int. J. Robust Nonlin. Control. 2005;15:669–689. [Google Scholar]
- 30.Davis M.H.A. Chapman and Hall; London: 1993. Markov Models and Optimization. [Google Scholar]
- 31.Hespanha J.P. Stochastic hybrid systems: applications to communication networks. In: Alur R., Pappas G.J., editors. Hybrid Systems: Computation and Control. No. 2993, Lecture Notes in Computer Science. Springer-Verlag; Berlin, Germany: 2004. [Google Scholar]
- 32.Rosenfeld N., Elowitz M.B., Alon U. Negative autoregulation speeds the response times of transcription networks. J. Mol. Biol. 2002;323:785–793. doi: 10.1016/s0022-2836(02)00994-4. [DOI] [PubMed] [Google Scholar]
- 33.Thattai M., van Oudenaarden A. Intrinsic noise in gene regulatory networks. Proc. Natl. Acad. Sci. USA. 2001;98:8614–8619. doi: 10.1073/pnas.151588598. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Hooshangi S., Weiss R. The effect of negative feedback on noise propagation in transcriptional gene networks. Chaos. 2006;16:026108. doi: 10.1063/1.2208927. [DOI] [PubMed] [Google Scholar]
- 35.Shahrezaei V., Olivier J.F., Swain P.S. Colored extrinsic fluctuations and stochastic gene expression. Mol. Sys. Biol. 2008;4:196. doi: 10.1038/msb.2008.31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Stekel D.J., Jenkins D.J. Strong negative self-regulation of prokaryotic transcription factors increases the intrinsic noise of protein expression. BMC Sys. Biol. 2008;2:6. doi: 10.1186/1752-0509-2-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Ozbudak E.M., Thattai M., Kurtser I., Grossman A.D., van Oudenaarden A. Regulation of noise in the expression of a single gene. Nat. Genet. 2002;31:69–73. doi: 10.1038/ng869. [DOI] [PubMed] [Google Scholar]
- 38.Singh, A. 2009. Stochastic modeling of chemical reactions and gene regulatory networks. PhD thesis. University of California, Santa Barbara, CA.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.