Significance
The relationship between form and function is ubiquitous in biology. Using a method (maximum entropy) from statistical physics, we investigated how function regulates form in the context of Escherichia coli chemotaxis. We found that the nearly perfect and robust chemotaxis behavior (function) does not fully determine the cell-to-cell variations of chemotaxis protein abundances (form) in E. coli. We show that additional constraints imposed by the protein synthesis machinery and nonchemotactic cell functions in conjunction with the constraints imposed by the chemotaxis program are required to determine the observed variations of protein abundances. This demonstrates that properties of a modular component (e.g., the chemotaxis signaling module) in a biological network also depend on the system of which the module is a part.
Keywords: maximum caliber, cell signaling, correlated protein expressions, statistical physics
Abstract
Cell-to-cell variations in protein abundance in clonal cell populations are ubiquitous in living systems. Because protein composition determines responses in individual cells, it stands to reason that the variations themselves are subject to selective pressures. However, the functional role of these cell-to-cell differences is not well understood. One way to tackle questions regarding relationships between form and function is to perturb the form (e.g., change the protein abundances) and observe the resulting changes in some function. Here, we take on the form–function relationship from the inverse perspective, asking instead what specific constraints on cell-to-cell variations in protein abundance are imposed by a given functional phenotype. We develop a maximum entropy-based approach to posing questions of this type and illustrate the method by application to the well-characterized chemotactic response in Escherichia coli. We find that full determination of observed cell-to-cell variations in protein abundances is not inherent in chemotaxis itself but, in fact, appears to be jointly imposed by the chemotaxis program in conjunction with other factors (e.g., the protein synthesis machinery and/or additional nonchemotactic cell functions, such as cell metabolism). These results illustrate the power of maximum entropy as a tool for the investigation of relationships between biological form and function.
Cell-to-cell variations in protein abundances or copy numbers are commonly found in genetically identical cells (1, 2). Because protein abundances directly regulate cell responses through signaling networks, a logical form–function relationship would imply that in the context of an adaptive behavior of a cell population (function), these variations among individual cells (form) should themselves be under selection pressures. However, functional implications of cell-to-cell variations of protein abundances are generally not understood well (3).
The relationship between form and function is an abiding theme of biological research (4, 5). The most common way to probe this relationship is through manipulation of form [e.g., perturbing parameters of the system and observing the effects on function (this can be done in vivo, in vitro, or in silico)]. Experiments of this type in recent years have indeed demonstrated functional consequences of cell-to-cell variation in protein abundances; that is, differences in protein abundances can produce distinct lineage commitments in hematopoietic stem cells (6), and covariation in protein abundances has been shown to increase the efficiency of chemotactic responses in Escherichia coli (E. coli) (7, 8). This type of experiment can be illuminating, but it can also be incomplete because the range of perturbations considered is subject to practical limitations as well as the limits of our imaginations regarding what other possibilities exist.
Here, we turn this procedure around and instead ask the question: If we start from an evolutionarily favored function, what general features of form must then exist? In other words, rather than asking what is the impact on function of some selected features of form, we ask what constraints are imposed on form by selective factors operating at the level of function. In the context of cell-to-cell variations of protein abundances, this question becomes the following: How does the ability of individual cells to respond to changes in the local environment shape the nature of variations of protein abundances in a cell population? Addressing this question is important to acquire a better understanding regarding the functional role of the cellular heterogeneity.
We develop a general methodology for asking such questions, based on maximum entropy (MaxEnt) (9, 10). To illustrate, we apply the method to one particular feature of form, cell-to-cell variation in protein abundances or copy numbers in genetically identical cells, in the context of a very well-characterized and highly robust system: chemotaxis in E. coli (11, 12). Using experimental data from cell population-based assays as well as single cell experiments available in the published literature (7, 8, 13–16), we use MaxEnt to ask two distinct but related questions. First, we investigate whether the observed chemotactic responses are sufficient to explain the variations in protein abundances. We find that the answer to this question is “no,” and we hypothesize that additional constraints on the relationships among protein abundances are required, above and beyond the constraints inherent in the chemotactic response itself. The second question we ask relates to the nature of these additional constraints. We show that when constraints jointly imposed by the chemotaxis program itself and by cell functions and processes not directly related to chemotaxis (e.g., processes involved in protein synthesis) determine mean values and pair correlations of the chemotaxis protein abundances in individual cells, the cell population remarkably reproduces the measured chemotactic responses. These results demonstrate the role of nonchemotactic functions in shaping the form of the chemotaxis signaling network module in E. coli, which is widely believed to be relatively isolated (17). This adds another important example of an emerging theme in biology, namely, that properties of a modular component in a biological network depend on the system of which the module is a part (18). In addition to shedding additional light on E. coli chemotaxis, these results illustrate the power of the MaxEnt methodology as a general tool for the investigation of relationships between biological form and function.
Results
E. coli Chemotaxis and the MaxEnt Method.
Single E. coli cells sense the presence of attractants such as amino acids in the medium and swim toward the nutrient source. Upon reaching the region of higher nutrient concentrations, the cells return to their prestimulus state of random movements, displaying a nearly perfect adaptive behavior. In individual E. coli cells, membrane-bound chemoreceptor Tar binds to attractant molecules and initiates a series of biochemical signaling reactions (Fig. 1A) leading to a transient dephosphorylation of the phosphorylated form of a key cytosolic protein CheY or CheY-P. CheY-P controls the direction of rotation (clockwise or anti-clockwise); a decrease in CheY-P abundance favors anti-clockwise rotations and propels the single cell toward the attractants (Fig. 1B). The CheY-P abundance slowly increases back to its prestimulus level as the copy number of methylated Tar receptors, which lead to phosphorylation of CheY at an increased rate, is gradually elevated due to a decrease in the demethylation rate in the presence of attractants (Fig. 1A). Throughout the signaling, the methylation/demethylation processes are executed by the enzymes CheR/CheB and the phosphorylation/dephosphorylation processes are carried out by the enzymes CheA-P/CheZ. Because CheY-P abundances in single cells regulate flagellar rotations, the chemotactic response in single E. coli cells can be characterized by variables describing the time scale and the adaptive behavior of the CheY-P kinetics (Fig. 1B); specifically, (i) adaptation time, τα, defined as the time the CheY-P abundance (denoted by [CheY-P]) in an E. coli cell (indexed by α) takes to rise up to half of its prestimulus value from the time when attractants were added; (ii) precision of adaptation, sα, calculated as the absolute value of the relative difference in the steady-state abundance of CheY-P in a single E. coli cell at the prestimulation ([CheY-P]prestim) and poststimulation ([CheY-P]poststim) conditions (i.e., sα = |([CheY-P]poststim − [CheY-P]prestim)|/[CheY-P]prestim); and (iii) the variation of the prestimulus steady-state abundance of CheY-P (or pα) in an E. coli cell relative to its value at the optimal condition as a relevant variable for characterizing chemotactic responses for the reasons below. Previous experiments and mathematical models pioneered by Barkai and Leibler (19) (henceforth referred to as the BL model) (SI Appendix, Fig. S1 and Tables S1 and S2) demonstrated the robustness of the perfect adaptive nature of the chemotactic response to variations of protein abundances and kinetic rates. However, single cell experiments of the E. coli flagellar motor response showed that the motor can work properly within a 30% variation from the optimal steady-state concentration of CheY-P at about 3 μM (13). The BL model produces substantial changes to steady-state CheY-P abundances against large variations of protein abundances, and thus is unable to explain the robustness of the motor function for such large perturbations. Sourjik and colleagues (7) modified the BL model (the modified BL model; henceforth referred to as the MBL model) to account for the proper functioning of the flagellar motor. A key extension of the MBL model over the BL model was the inclusion of a CheZ-dependent deactivation of CheY-P dephosphorylation (Fig. 1A).
We develop a MaxEnt-based method to quantify the minimally structured cell-to-cell variations in total protein abundances required to reproduce the observed chemotactic responses in single cell- and cell population-based experiments. We considered cell-to-cell variations of total abundances of chemotaxis proteins (20, 21), as well as intrinsic fluctuations in copy numbers of signaling proteins within individual E. coli cells that arise due to the stochastic nature of biochemical chemotaxis signaling reactions (20–22). Upon addition of attractants in the medium at time t = t0 in an individual cell containing total protein abundances, given by (q = 1… NT, representing the chemotaxis proteins Tar, CheA, CheB, CheR, CheZ, and CheY), the copy numbers of signaling molecules change with time due to the signaling reactions. We define a stochastic trajectory, Γ, representing changes in the abundances of signaling proteins with time in an individual cell by a set ({nj}, tn ;{nj}, tn−1 ; {nj}, tn−2 ; ….; {nj}, t1 ; {nj}, t0 ; ) where copy numbers of different proteins, {nj} [j = 1…NP; NP = total number (#) of distinct signaling proteins] change at the times {t0, t0 + Δ, t0 + 2Δ, \x{2026}, t0 + nΔ}. Δ is taken to be smaller than or of the same order of the smallest reaction time scale (Fig. 2). NP ≥ NT, because a protein species can be modified during signaling (e.g., CheY-P is generated from the protein CheY during signaling). We use the MaxEnt technique to estimate the probability distribution of these trajectories (PΓ), specifically by maximizing Shannon’s entropy (S):
in the presence of constraints imposed by experimental measurements pertaining to chemotactic responses or chemotaxis protein abundances. Eq. 1 is also known as the path entropy, and the constrained maximum is also referred to as the maximum caliber (10). We carried out maximization of S in the presence of two types of constraints that capture relevant information (23) regarding E. coli chemotactic responses and the nature of the cell-to-cell variations of total protein abundances:
i) Constraints characterizing chemotactic responses. Because the essential features of chemotactic responses in a single cell (indexed by α) are described by the variables τα, sα, and pα, we used average values and variances of these variables over a cell population as constraints.
ii) Constraints describing the shape of cell-to-cell variations of total protein abundances. We used the average values, as well as the variances and covariances of the protein abundances, as constraints.
Because PΓ represents the joint distribution P({nj}, tn ;{nj}, tn−1 ; {nj}, tn−2 ; ….; {nj}, t1 ; {nj}, t0 ; ), any change in the shape of cell-to-cell variations of total protein abundances or will produce changes in PΓ. We sought to estimate the maximally varying, or the least structured, distribution consistent with constraints imposed by the available experimental data as described in i or ii (an explicit derivation of the underlying equations is provided in Materials and Methods). Therefore, represents a probability distribution that is sufficient to characterize what is known about the underlying system (the constraints), without the imposition of any additional assumptions not directly justified by the available empirical data (9, 10). The constraints in i estimate the minimal structure imposed by the chemotactic responses themselves on the distribution of total protein abundances in E. coli cells, whereas the constraints in ii probe the minimal structure in cell-to-cell variations of total protein abundances that is able to reproduce the measured chemotactic responses while remaining consistent with the observed protein abundances. If the distribution of the protein abundances is entirely shaped by the chemotactic responses, the estimated will be the same using the constraints in i and the constraints in ii. Our results show, however, that this is not the case. We describe our results in the next sections.
Chemotaxis Itself Is Not Sufficient to Explain Observed Protein Abundance Distributions.
We maximized the entropy (Eq. 1) to evaluate (details are provided in Materials and Methods) the least structured cell-to-cell variations in protein abundances required to produce experimentally observed chemotactic responses and then compared the inferred distribution with the available data pertaining to cell-to-cell variations of E. coli proteins from experimental observations. Specifically, we compared the mean values, variances, and covariances of the least structured distribution with the available measurements. Because all six chemotactic proteins (Tar, CheA, CheR, CheB, CheZ, and CheY) regulate the variables τα, sα, and pα in single cells, constraining averages and variances of these variables, in principle, could constrain variations of total protein abundances of the chemotactic proteins. When average values of {τα} (or ), {sα} (or ), and {pα} (or ) were constrained individually, the corresponding least structured distribution of protein abundances produced small correlations, both positive and negative, between the protein abundances (SI Appendix, Fig. S2). This was in stark contrast to the experimental observation that shows strong positive correlations (≈1) between the proteins CheY and CheZ or CheA and CheY (7, 8) or between CheY and CheB as observed in in vitro experiments using cloned gene pairs (8). The average values of the protein abundances in the inferred distribution showed much larger values compared with their experimental counterparts (SI Appendix, Table S3). When , , and were constrained at the same time, the qualitative features of the least structured distribution of protein abundances did not change (SI Appendix, Fig. S2). Including the variances of the variables, , , and in the set of constraints in different combinations increased the magnitude of the correlations between the protein abundances; however, the correlations contained both positive and negative values, and the average values of the protein abundances were still larger compared with their experimental counterparts (SI Appendix, Figs. S2 and S3 and Table S3).
We describe results from a particular case in which the variables , , , , and were constrained as detailed below to discuss specific agreements and disagreements of the variations of protein abundances with experimental observations and their biological implications. The above constraints produced correlated variations in the protein abundances (Fig. 2 and SI Appendix, Fig. S4); however, the magnitude of the correlations was smaller compared with that observed in experiments. Positive correlations were obtained between abundances of multiple protein pairs (Fig. 2 and SI Appendix, Table S4), including the protein pairs (e.g., CheY-CheZ, CheY-CheB, CheY-CheR, CheR-CheZ, Tar-CheR, Tar-CheB, Tar-CheZ) that are encoded by genes (cheY, cheZ, cheB, mcp, and cheR) residing in the meche operon (7, 8) and the protein pairs (e.g., CheA-CheB, CheA-CheZ) that are encoded by genes residing in two different operons, meche and mocha (contains cheA) (7, 8). When E. coli chemotaxis proteins are encoded by genes in the same operon, they are translated by the same polycistronic mRNA (24); thus, abundances of those proteins are likely to be positively correlated. Therefore, the observed positive correlations for the MBL model between the protein abundances encoded by the meche operon are qualitatively consistent with the notion of coregulated gene expressions for the genes in the same operon. The positive correlation between CheY and CheZ is in direct qualitative agreement with single cell experiments measuring CheY and CheZ simultaneously (7, 8). Positive MaxEnt correlations between other pairs of protein abundances have not been directly measured in single cell experiments. However, the predicted positive correlations between the abundances of CheY-CheB and CheY-CheZ are consistent with in vitro experiments assaying correlations in protein expression using cloned gene pairs (8) (Fig. 2 and SI Appendix, Table S4). Most of the protein pairs producing positive correlations (SI Appendix, Table S4) in the inferred distribution also showed strong pairwise co-occurrence of the encoding genes in 527 bacterial genomes containing at least one chemotaxis gene (8), supporting the concept that the chemotactic functions partially produce the observed correlated variations between these protein pairs qualitatively.
However, the MaxEnt model also produced negative correlations between protein abundances (Fig. 2) for protein pairs (CheB-CheZ, CheR-CheB, and Tar-CheY) encoded by the meche operon and protein pairs (Tar-CheA, CheA-CheY, and CheA-CheR) encoded by the mocha and meche operons. This disagrees with experiments (7), which have demonstrated a positive correlation between abundances of CheA and CheY, and between CheR and CheB, and it also disagrees with in vitro protein expression measurements for cloned gene pairs (8). In addition, the negative correlations between CheB-CheZ, CheR-CheB, and Tar-CheY would seem to contradict the idea that genes in the same operon are likely to produce positive correlations between corresponding protein expressions.
Furthermore, by comparison with data from single cell experiments, the univariate MaxEnt distributions of protein abundances showed larger means and variances and higher order moments for the abundances of CheY, CheZ, and CheA (Fig. 3 A and B and SI Appendix, Figs. S5 and S6). Similarly, the second and higher order moments calculated from the predicted joint distributions of CheY and CheZ (Fig. 3C) or CheA and CheZ abundances showed a similar increased spread of protein abundances in single cells compared with the experiments. In addition, the mean abundances for the other proteins in the inferred distribution were consistently larger than for their measured counterparts. Constraining all six variables, , , , , , and , did not produce any qualitative change in the results (SI Appendix, Fig. S2 and Table S3). This shows that regardless of the combination of the constraints, involving the variables describing the chemotactic responses consistently produces a broader distribution with larger mean values and positive and negative covariances and including additional constraints does not lead to a qualitatively better agreement between the inferred distribution and the experiments. This tells us that the distribution of protein abundances in E. coli is subject to additional constraints not yet incorporated into the MaxEnt calculation.
Because the chemotactic program itself does not sufficiently constrain the protein abundance distribution, we hypothesize the importance of additional constraints arising from physical and biochemical processes that control synthesis and other nonchemotactic functions of these different proteins in a cell. Taking a clue from the result that a multivariate normal distribution can be used to approximate to a reasonable extent the inferred distribution in protein abundances (Fig. 3D), we hypothesized that the efficient chemotactic program in individual E. coli cells, along with processes not directly related to the chemotaxis, regulates the mean values and the pair correlations in the chemotaxis protein abundances. We turn to these in the next section.
Mean Values and Pairwise Correlations in Protein Abundances Regulate Chemotactic Responses in E. coli.
Here, we again use the MBL model, but we do not impose constraints on the chemotactic parameters. Instead, we introduce constraints directly on the protein abundances and compare the resulting MaxEnt model with the observed chemotactic response.
We first considered the MaxEnt distribution subject only to constraints on the means of the protein abundances taken from cell population measurements. The model showed exponentially distributed protein abundances with vanishing covariations (details are provided in SI Appendix). This distribution generated chemotactic responses with values for s, p, and τ (in individual cells) that were substantially different from those observed in experiments for WT E. coli (SI Appendix, Fig. S7 and Table S5). We then further constrained the variances and covariances between different protein abundances. Magnitudes of variances and covariances for most of the chemotaxis protein pairs, except CheY-CheA and CheY-CheZ (7), were not directly available from the published experiments. However, as suggested by Kollman et al. (7), a log-normal distribution for all proteins similar to that of CheY and CheZ reproduced the observed average values of s, p, and τ, as well as their distribution, reasonably well (SI Appendix, Fig. S7). Thus, we used covariances calculated from the log-normal distribution for those protein abundances that have not been directly measured in single cell experiments.
With these additional constraints in place, the MaxEnt distribution was a multivariate normal for the protein abundances, and the resulting chemotactic response produced distributions of s, p, and τ that showed excellent agreement with experiments (Fig. 4 A–C and SI Appendix, Fig. S8). We tested this conclusion further by leaving covariances between different pairs of protein unconstrained. Our results show that as long as covariances that minimally connect all the protein abundances are constrained, the generated chemotactic response is in reasonable agreement with the experiments (SI Appendix, Figs. S7, S9, and S10). This represents the minimal set of constraints in protein abundances required to produce the observed chemotactic response (details are provided in SI Appendix). This supports the hypothesis that a combination of constraints imposed by an efficient chemotactic response and other factors (e.g., the protein synthesis machinery and/or the nonchemotactic functions of the chemotaxis proteins) determines the mean values, variances, and covariances that minimally connect all the chemotaxis protein abundances in the WT E. coli.
Discussion
Examples of form constraining function are ubiquitous in living systems (5). Here, we addressed the inverse question of “how function constrains form” in the context of E. coli chemotaxis. Specifically, using a MaxEnt-based approach, we studied the minimal restriction imposed on cell-to-cell variations of protein abundances by the measured chemotactic response in individual E. coli cells. We found that the observed chemotactic response imposed both positive and negative correlations between protein abundances (Fig. 2 and SI Appendix, Table S4). The positive correlations suggest that the requirement to execute an efficient chemotaxis program, crucial for increased growth or fitness of an E. coli population, leads to selection of processes that can coregulate protein expressions in E. coli. Formation of operons could provide a potential mechanism to generate positively correlated protein expressions (24) because genes in an operon transcribed by the same mRNA are likely to produce coregulated gene expressions. E. coli chemotaxis proteins are encoded by genes residing in two operons, meche and mocha (7, 8). Therefore, the positive correlations of protein abundances in the MBL model in the pairs CheY-CheZ, CheY-CheB, CheY-CheR, CheR-CheZ, Tar-CheR, Tar-CheB, and Tar-CheZ indicate that the requirement of efficient chemotaxis helped in formation of the mocha operon. Also, proteins encoded by genes in different operons can become correlated during translation (8, 25, 26). Therefore, the positive correlations between CheA-CheB or CheA-CheZ could assist in evolutionary selection of such processes.
An intriguing aspect of our results is the imposition of negative correlations in protein abundances by the observed chemotactic behavior. Functional implications of the negative correlations in the chemotaxis signaling kinetics are evident in most of the cases (SI Appendix, Table S4) (e.g., the negative correlation between CheA and CheY abundances; because CheA activates CheY, an increase in the abundance of CheA accompanied by a decrease in the abundance of CheY keeps the abundance of CheY-P unchanged, and thus increases robustness). Surprisingly, this result contradicted the results of single cell experiments, which showed a positive correlation between the protein abundances (7). Furthermore, the same minimally structured distribution produced much larger mean values and higher order moments compared with the experiments (Fig. 3). This led us to hypothesize that mean values and the pair correlations in protein abundances whose primary function is to execute chemotactic signaling in E. coli are largely determined by constraints imposed by both an efficient chemotaxis program and functions directly unrelated to chemotaxis (Fig. 5). Limitations such as a finite pool of RNA polymerases and ribosomes in individual cells (27, 28) or energetic costs for protein synthesis (29) imposed by the protein synthesis machinery could restrict protein expression. These restrictions are manifested in a reduction in cell growth rate when abundances of nonfunctional proteins are increased in bacterial cells (27, 30). A tight regulation of protein abundances is also demonstrated in the results showing that the steady-state protein abundances are remarkably conserved across species (31). Moreover, a chemotaxis protein could be involved in nonchemotactic function as well as cell metabolism [e.g., CheY is linked with the metabolic state of the cell (32)].
We found that the mean values and the pair correlation functions between protein abundances that minimally connect all the protein abundances are required to be constrained to be able to produce the measured chemotactic responses in individual E. coli cells (SI Appendix, Figs. S7, S9, and S10). In this case, all the pair correlations needed to be constrained to large positive values. Therefore, these nonchemotactic functions lead to selection of a distribution of protein abundances that links all the chemotactic proteins simultaneously with strong positive correlations. This is chosen over the distribution containing weaker pair correlations with positive and negative values as preferred by the chemotactic responses alone. This result, in addition to emphasizing the role of nonchemotactic functions in shaping protein abundances involved in a relatively insulated chemotaxis signaling module, lends support to an emerging theme in biology that properties of a biological module can be influenced by the system in which the module is embedded (14).
Recent work by Salman et al. (33) showed that protein abundances in E. coli and yeast that are involved in metabolism can be scaled to a “universal” non-Gaussian scaling function when protein abundances are scaled with the mean values and the variances. This result urges us to speculate if the scaling of distributions of protein concentrations to a universal scaling function reflects the adequacy of the mean values and the pairwise correlations to produce the essential variations in the phenotype primarily regulated by those proteins in individual cells. It will be worthwhile to investigate the generality of these results for other phenotypes in other cell types. The proposed MaxEnt method is general and can be used to probe such function–form relationships in other living systems.
Materials and Methods
Calculation of MaxEnt (Maximum Caliber) Solutions.
We seek to determine the least structured distribution of total protein abundances, or , that maximizes S in Eq. 1 in the presence of constraints imposed by the chemotactic response in E. coli. PΓ is related to by the relation
where, is the conditional probability of occurrence of the trajectory, ΓC, represented by the set, ({nj}, tn ; {nj}, tn−1 ; …. ; {nj}, t1; {nj}, t0) for a specific choice of total protein abundances, . When a variable, fΓ, describes a chemotactic response (e.g., τ) that depends on the stochastic trajectory Γ produced in a single E. coli cell indexed by α, the cell population-averaged value of fΓ is given by:
where denotes the average value of f measured in experiments. We show the result that maximizes S in Eq. 1 for the constraint in Eq. 3 for simplicity. The result, including additional constraints, is shown in SI Appendix.
Because PΓ depends on via Eq. 2, it is possible to choose different shapes of that will satisfy the constraint imposed by Eq. 3. We seek to estimate the maximally varying or the least structured distribution , where the minimal structure in the distribution arises solely due to the constraints imposed. For the constraint in Eq. 3, the that maximizes S (Eq. 1) is given by (a detailed derivation and discussion are provided in SI Appendix):
where . The sum over ΓC essentially denotes averages over variations of stochastic trajectories due to intrinsic noise fluctuations. The conditional probability PC can be calculated by solving the master equation (22) describing the biochemical reactions in the signaling model. QC is then calculated from PC. The Lagrange multiplier λ is calculated by substituting the estimated in the constraint equation (Eq. 3) and then solving the resulting nonlinear equation. We could also extend this method to a more general scenario, where the underlying intrinsic fluctuations are not quantifiable due to uncharacterized interactions in the signaling network. In such cases, PC can be inferred by imposing further constraints on lnQC, provided data from repeated experiments on the same sample (or individual cell) (34) are available. Additional details are provided in SI Appendix (section IIIA) and refs. 35–37.
When the mean values and the higher order moments of the total protein abundances are constrained instead of the chemotactic responses, the minimally structured distribution is calculated by maximizing the entropy:
instead of Eq. 1 because the structure of is independent of the chemotactic response in this case. The estimation of for this case is detailed in SI Appendix.
In our simulations, we evaluate the distribution in Eq. 4 in the following way. First, we generate a priori distribution by drawing total protein abundances from a uniform distribution U(0, UH), where UH is chosen to be roughly 10-fold larger than the experimentally measured mean abundance of the corresponding chemotactic protein (14). Then, the signaling kinetics in each individual cell are simulated by solving the deterministic biochemical reactions for the MBL model in the prestimulus condition (zero attractant concentration) using the rule-based software package BIONETGEN (www.bionetgen.org) (38). Once the kinetics reach the steady state, attractants are added in the medium and the stochastic kinetics of the signaling reactions are simulated using BIONETGEN for a long time when the kinetics reach a steady state. In the sample size (∼70,000 single cells) we considered, each E. coli cell produces a unique chemotactic response composed of a stochastic trajectory Γ describing the time evolution of abundances of signaling proteins; therefore, we identified each trajectory by the single cell that generated it (Fig. 1). The summation over ΓC in Eq. 4 is performed using this unique association of any trajectory with a single cell. Further details regarding the numerical scheme for constructing in Eq. 4 are provided in SI Appendix (section III and Figs. S11–S13). We carry out simulations for the BL and fine-tuned (39) models following the same scheme.
Data from E. coli Experiments.
The distribution of τ was obtained from Min et al. (15) by digitizing Fig. 3C in that paper using an online Web plot digitizer (http://arohatgi.info/WebPlotDigitizer/). The values of and are calculated from the distribution thus obtained. The value of for WT RP437 strain was obtained from the work of Alon et al. (16). The average values of the chemotactic protein abundances were taken from Li and Hazelbauer (14). The single cell distributions of CheY, CheZ, CheY-CheZ, and CheA-CheY for the WT RP437 strain were extracted from the work of Kollman et al. (7) using the same graph digitizer.
Supplementary Material
Acknowledgments
J.D. thanks C. Jayaprakash and Ashok Prasad for discussions. We thank the two anonymous reviewers for making constructive suggestions. This work was supported by funding from the Research Institute at Nationwide Children’s Hospital and National Institutes of Health (NIH) Grant AI090115 (to J.D.) and NIH Grant MH086117 (to V.J.V.). This work was also partially supported by a grant from the Ohio Supercomputer Center (OSC) (to J.D.).
Footnotes
The authors declare no conflict of interest.
This article is a PNAS Direct Submission.
This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1311069110/-/DCSupplemental.
References
- 1.Kaern M, Elston TC, Blake WJ, Collins JJ. Stochasticity in gene expression: From theories to phenotypes. Nat Rev Genet. 2005;6(6):451–464. doi: 10.1038/nrg1615. [DOI] [PubMed] [Google Scholar]
- 2.Avery SV. Microbial cell individuality and the underlying sources of heterogeneity. Nat Rev Microbiol. 2006;4(8):577–587. doi: 10.1038/nrmicro1460. [DOI] [PubMed] [Google Scholar]
- 3.Altschuler SJ, Wu LF. Cellular heterogeneity: Do differences make a difference? Cell. 2010;141(4):559–563. doi: 10.1016/j.cell.2010.04.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Laubichler MD, Maienschein J. Form and Function in Developmental Evolution. Cambridge, UK: Cambridge Univ Press; 2009. [Google Scholar]
- 5.Thompson DAW. On Growth and Form. 2nd Ed. Cambridge, UK: Cambridge Univ Press; 1968. [Google Scholar]
- 6.Chang HH, Hemberg M, Barahona M, Ingber DE, Huang S. Transcriptome-wide noise controls lineage choice in mammalian progenitor cells. Nature. 2008;453(7194):544–547. doi: 10.1038/nature06965. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Kollmann M, Løvdok L, Bartholomé K, Timmer J, Sourjik V. Design principles of a bacterial signalling network. Nature. 2005;438(7067):504–507. doi: 10.1038/nature04228. [DOI] [PubMed] [Google Scholar]
- 8.Løvdok L, et al. Role of translational coupling in robustness of bacterial chemotaxis pathway. PLoS Biol. 2009;7(8):e1000171. doi: 10.1371/journal.pbio.1000171. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Jaynes ET. Information theory and statistical mechanics. Phys Rev. 1957;106(4):620–630. [Google Scholar]
- 10.Presse S, Ghosh K, Lee J, Dill KA. Principles of maximum entropy and maximum caliber in statistical physics. Rev Mod Phys. 2013;85(3):1115–1141. [Google Scholar]
- 11.Alon U. An Introduction to Systems Biology: Design Principles of Biological Circuits. Boca Raton, FL: Chapman & Hall/CRC; 2007. [Google Scholar]
- 12.Wadhams GH, Armitage JP. Making sense of it all: Bacterial chemotaxis. Nat Rev Mol Cell Biol. 2004;5(12):1024–1037. doi: 10.1038/nrm1524. [DOI] [PubMed] [Google Scholar]
- 13.Cluzel P, Surette M, Leibler S. An ultrasensitive bacterial motor revealed by monitoring signaling proteins in single cells. Science. 2000;287(5458):1652–1655. doi: 10.1126/science.287.5458.1652. [DOI] [PubMed] [Google Scholar]
- 14.Li M, Hazelbauer GL. Cellular stoichiometry of the components of the chemotaxis signaling complex. J Bacteriol. 2004;186(12):3687–3694. doi: 10.1128/JB.186.12.3687-3694.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Min TL, Mears PJ, Golding I, Chemla YR. Chemotactic adaptation kinetics of individual Escherichia coli cells. Proc Natl Acad Sci USA. 2012;109(25):9869–9874. doi: 10.1073/pnas.1120218109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Alon U, Surette MG, Barkai N, Leibler S. Robustness in bacterial chemotaxis. Nature. 1999;397(6715):168–171. doi: 10.1038/16483. [DOI] [PubMed] [Google Scholar]
- 17.Hartwell LH, Hopfield JJ, Leibler S, Murray AW. From molecular to modular cell biology. Nature. 1999;402(6761) Suppl:C47–C52. doi: 10.1038/35011540. [DOI] [PubMed] [Google Scholar]
- 18.Gunawardena J. Biology is more theoretical than physics. Mol Biol Cell. 2013;24(12):1827–1829. doi: 10.1091/mbc.E12-03-0227. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Barkai N, Leibler S. Robustness in simple biochemical networks. Nature. 1997;387(6636):913–917. doi: 10.1038/43199. [DOI] [PubMed] [Google Scholar]
- 20.Swain PS, Elowitz MB, Siggia ED. Intrinsic and extrinsic contributions to stochasticity in gene expression. Proc Natl Acad Sci USA. 2002;99(20):12795–12800. doi: 10.1073/pnas.162041399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Bialek WS. Biophysics: Searching for Principles. Princeton: Princeton Univ Press; 2012. [Google Scholar]
- 22.Kampen NGv . Stochastic Processes in Physics and Chemistry. 3rd Ed. Amsterdam: North-Holland; 1992. [Google Scholar]
- 23. Caticha A (2012) Entropic inference: Some pitfalls and paradoxes we can avoid. arXiv:1212.6967v1.
- 24.Jacob F, Monod J. On regulation of gene activity. Cold Spring Harb Symp Quant Biol. 1961;26:193–211. doi: 10.1101/sqb.1961.026.01.048. [DOI] [PubMed] [Google Scholar]
- 25.Levin-Karp A, et al. Quantifying Translational Coupling in E. coli Synthetic Operons Using RBS Modulation and Fluorescent Reporters. ACS Synth Biol. 2013;2(6):327–336. doi: 10.1021/sb400002n. [DOI] [PubMed] [Google Scholar]
- 26.Schümperli D, McKenney K, Sobieski DA, Rosenberg M. Translational coupling at an intercistronic boundary of the Escherichia coli galactose operon. Cell. 1982;30(3):865–871. doi: 10.1016/0092-8674(82)90291-4. [DOI] [PubMed] [Google Scholar]
- 27.Dong H, Nilsson L, Kurland CG. Gratuitous overexpression of genes in Escherichia coli leads to growth inhibition and ribosome destruction. J Bacteriol. 1995;177(6):1497–1504. doi: 10.1128/jb.177.6.1497-1504.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Vind J, Sørensen MA, Rasmussen MD, Pedersen S. Synthesis of proteins in Escherichia coli is limited by the concentration of free ribosomes. Expression from reporter genes does not always reflect functional mRNA levels. J Mol Biol. 1993;231(3):678–688. doi: 10.1006/jmbi.1993.1319. [DOI] [PubMed] [Google Scholar]
- 29.Berkhout J, et al. How biochemical constraints of cellular growth shape evolutionary adaptations in metabolism. Genetics. 2013;194(2):505–512. doi: 10.1534/genetics.113.150631. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Dekel E, Alon U. Optimality and evolutionary tuning of the expression level of a protein. Nature. 2005;436(7050):588–592. doi: 10.1038/nature03842. [DOI] [PubMed] [Google Scholar]
- 31.Vogel C, Marcotte EM. Insights into the regulation of protein abundance from proteomic and transcriptomic analyses. Nat Rev Genet. 2012;13(4):227–232. doi: 10.1038/nrg3185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Barak R, Eisenbach M. Co-regulation of acetylation and phosphorylation of CheY, a response regulator in chemotaxis of Escherichia coli. J Mol Biol. 2004;342(2):375–381. doi: 10.1016/j.jmb.2004.07.021. [DOI] [PubMed] [Google Scholar]
- 33.Salman H, et al. Universal protein fluctuations in populations of microorganisms. Phys Rev Lett. 2012;108(23):238105. doi: 10.1103/PhysRevLett.108.238105. [DOI] [PubMed] [Google Scholar]
- 34.Elowitz MB, Levine AJ, Siggia ED, Swain PS. Stochastic gene expression in a single cell. Science. 2002;297(5584):1183–1186. doi: 10.1126/science.1070919. [DOI] [PubMed] [Google Scholar]
- 35.Crooks GE. Beyond Boltzmann-Gibbs statistics: Maximum entropy hyperensembles out of equilibrium. Phys Rev E Stat Nonlin Soft Matter Phys. 2007;75(4 Pt 1):041119. doi: 10.1103/PhysRevE.75.041119. [DOI] [PubMed] [Google Scholar]
- 36.Dixit PD. Quantifying extrinsic noise in gene expression using the maximum entropy framework. Biophys J. 2013;104(12):2743–2750. doi: 10.1016/j.bpj.2013.05.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Caticha A, Preuss R. Maximum entropy and Bayesian data analysis: Entropic prior distributions. Phys Rev E Stat Nonlin Soft Matter Phys. 2004;70(4 Pt 2):046127. doi: 10.1103/PhysRevE.70.046127. [DOI] [PubMed] [Google Scholar]
- 38.Hlavacek WS, et al. Rules for modeling signal-transduction systems. Sci STKE. 2006;2006(344):re6. doi: 10.1126/stke.3442006re6. [DOI] [PubMed] [Google Scholar]
- 39.Hauri DC, Ross J. A model of excitation and adaptation in bacterial chemotaxis. Biophys J. 1995;68(2):708–722. doi: 10.1016/S0006-3495(95)80232-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.