Abstract
Over the past decade a massive amount of research has been dedicated to generating omics data to gain insight into a variety of biological phenomena, including cancer, obesity, biofuel production, and infection. Although most of these omics data are available publicly, there is a growing concern that much of these data sit in databases without being used or fully analyzed. Statistical inference methods have been widely applied to gain insight into which genes may influence the activities of others in a given omics data set, however, they do not provide information on the underlying mechanisms or whether the interactions are direct or distal. Biochemically, genetically, and genomically consistent knowledgebases are increasingly being used to extract deeper biological knowledge and understanding from these data sets than possible by inferential methods. This improvement is largely due to knowledgebases providing a validated biological context for interpreting the data.
Keywords: Simulation and data analysis, Metabolic and regulatory networks, Transcriptomics, Tissue-specific Networks
INTRODUCTION
Omics technologies have transformed molecular biology into a data-rich discipline by enabling scientists to simultaneously measure large numbers of molecular components (e.g., proteins, metabolites, and nucleic acids) that operate simultaneously through a network of interactions to generate cellular functions and phenotypic states1. However, extraction of ‘knowledge’ from this ocean of omics has proven to be nontrivial2. Analysis efforts are lagging for several reasons, including incompleteness of data3, variability between experimental platforms4, and multiple hypotheses testing with few replicates5.
Two major network approaches have emerged to extract biological insight from omics data: inference-based and knowledge-based. Both approaches use an interconnected network of biological molecules to interpret omics data; however, there are crucial differences in how the networks are constructed, and therefore in the biological questions that they can answer. Inference-based approaches employ statistical methodologies to construct network models from correlation or recurring patterns in omics data (see refs6,7 for reviews). Reconstruction-based approaches are essentially 2-D genome annotation efforts8 that construct networks from biochemical and genetic data (reviewed in9,10). Like KEGG11 and EcoCyc12, network reconstructions are knowledgebases of organized biochemical and genetic data. However, network reconstructions are also amenable to ready transformation into mathematical models to faciliate hypotheses generation and testing. In this perspective, our focus is on network reconstructions.
Network reconstruction employs established biochemical, genetic, and genomic data9,13 to assemble a knowledgebase of an organism’s molecular components and their interactions. Although knowledgebases may be used for regulatory14 or signaling10 networks, they have enjoyed the greatest success with metabolic networks13. This success is due to the availability of decades of legacy biochemical research in the area of metabolism and to difficulties in modeling signaling and regulation at the genome-scale10. Metabolic network reconstructions have been employed for a range of analyses of omics data, including applications in data visualization15, network medicine16, deducing regulatory rules17–19, constructing tissue-specific models20–23, and multi-cellular modeling24–26. More recently, we’ve developed a method for genome-scale modeling metabolism and macromolecular expression that supports direct analysis of a variety of omics data27.
In this work, we focus on progress in integrated analysis of omics data with functional genome-scale models of metabolism. A functional network model of metabolism is a mathematical model that is capable of simulating cellular and molecular phenotypes (Fig. 1). Two common approaches for integrating omics data with metabolic network reconstructions are: comparison of model simulations with omics data and using omics data to constrain the model and create condition- or tissue-specific models. Over the past five years, there have been significant advances in computational methods development. Now, we are at the point where we expect to see increasing applications of these methods in biological research23,28. One of the most exciting developments, is Frezza et al.’s23 application of an integrated method to identify how a cancer cell line proliferates without a functional tricarboxylic acid (TCA) cycle (highlighted below).
The major goals of this perspective are to highlight how genome-scale models derived from knowledgebases may be used to extract additional biological understanding from omics data sets and inspire novel applications of this technology to interpretation of complex data sets. The first part covers integration of models with yeast phenomics data; and, the second part describes methods that have been developed to use omics data to guide creation of condition-specific models.
COMPARING PHENOMICS WITH PREDICTIONS
The most direct way to analyze omics data with genome scale models of metabolism to compare omics measurements with model topology or predictions. It is possible to compare a variety of omics data with metabolic network model simulations because the models relate genes to enzymatic activities to global phenotypes (Fig. 2a). Overlaying omics data on a functional model organizes the data in terms of underlying biochemistry (Fig. 2b). Comparing omics data with model simulations can also identify points of discord between the model and reality (Fig. 2c). Discrepancies between measurements and simulations are then used to refine our understanding of a biological process or to develop hypotheses29.
There is growing interest in using the models to predict biosynthetic and synthetic lethalities as well as identify other genetic interactions. Genome-scale models have been used widely to predict gene essentiality and more, recently, synthetic lethalities30. Lethal interactions could serve to identify gene products as novel strategies for next generation antibiotics31. Analysis of model predictions with high-throughput phenomic assays, such as a yeast synthetic genetic array32 (SGA), should allow us to identify possible biochemical mechanisms underlying synthetic lethal interactions and assess the accuracy of models and methods (Fig. 2c). The comparison of SGA results with model predictions, could be used to assess specific mechanistic hypotheses33, as described below. Integrated analysis of SGA results and simulations may eventually be able to delineate a set of likely biochemical pathways responsible for observed genetic interactions.
Snitkin et al.33 asked whether combining simulations with yeast phenomics data could be used to assess two alternative pathways for raffinose consumption. In the first pathway, YBR184W ‘cleaves’ raffinose at the α-galactosidic bond resulting in galactose and sucrose that SUC2 ‘digests’ into glucose and fructose both of which are subsequently used in glycolysis. Whereas in the second pathway, there is no α-galactosidase for raffinose and SUC2 ‘digests’ raffinose into fructose and melobiose; fructose is consumed by glycolysis while melobiose must be secreted because the strain of S. cerevisiae in question is unable to metabolize melobiose.
To determine if the model could provide support for either mechanism, they simulated gene essentiality in raffinose for the wild-type (WT) model and a mutant model in which YBR184W’s α-galactosidase activity was removed. Then they compared these predictions with their raffinose phenomics measurements. Interestingly, removal of the α-galactosidase activity from the model lead to the correction of 6 errors versus the WT model, thus supporting the hypothesis that YBR184W encodes an α-galactosidase activity. While an assay for α-galactosidase activity may be considered an even stronger method to test the two pathways, it may not always be possible to perform an enzyme assay. Also, this integrated approach with the model and phenomics data could be used to prioritize a large number of alternative hypotheses for biochemical validation or provide supporting evidence when a decisive assay is not available.
High-throughput genetic interaction assays can rapidly and quantitatively assess whether a mutation of a pair of genes results in a positive or negative effect compared that expected from the individual mutants. Unfortunately, these high throughput assays do not provide hypotheses for how the interactions occur. As the genetic interactions appear to occur mostly between pathways34, the biochemical connections underlying the interaction are not likely to be obvious.
Szappanos et al.35 used an SGA to measure the interactions of 613 metabolic genes to explore the utility of metabolic network models in investigating genetic interactions. When they analyzed the genetic interactions in the context of the model, they found that most genetic interactions occur between genes that are not within the same pathway (as previously noted34) and are not flux coupled. Unfortunately, when comparing simulated genetic interactions to their measurements they found that simulations only identified 2.8% and 12.9% of negative and positive interactions, respectively. Possible reasons for these discrepancies include, errors in the model, errors in the assay33, inappropriate model assumptions, lack of regulation in model. Modeling transcriptional regulation at the genome-scale has proven difficult and methods using omics data as surrogates for regulatory modeling are discussed in the next section.
OMICS AS SURROGATES FOR MODELING REGULATION
Metabolic network reconstructions aim to be comprehensive repositories of biochemical data for an organism. Thus, models derived from these knowledgebases will include all possible reactions catalyzed by an organism’s gene products regardless of whether they are active in a given environment. The all-inclusive nature of these knowledgebases is partially responsible for false negatives observed in gene essentiality or genetic interaction simulations35. Biological networks have evolved a degree of robustness against perturbations that result cascading failures36 – this robustness is due, in part, to the presence of alternative compensatory pathways. However, an alternative pathway that is present in the global knowledgebase may not be accessible to the organism in the given growth medium, thus mutation of the principle pathway will result in a phenotype in vivo but not in silico. For example, if the oxygen-stable form of fumarase is mutated in an aerobic medium then the model is likely to propose the oxygen-labile form as an equivalent alternative, whereas, in reality there will be a phenotypic effect37.
The regulatory apparatuses of successful organisms have evolved to express the network components that are suited to their current environment. If we knew the complete regulatory structure of an organism and how it worked then we could plausibly compute which cellular components may be expressed in a given condition; unfortunately, this isn’t known even for the arguably best-studied bacterium38. Due to stochastic effects arising from low copy numbers of regulators and enzymes39,40, and intracellular heterogeneity, integrated models of metabolism and regulation will still be an approximation of individual cells and populations. Including probabilistic effects in genome-scale models of organisms will likely improve their predictive capabilities; however, there are significant computational hurdles that must be overcome, as illustrated by Karr et al.’s recent attempt to construct a whole-cell model41.
In the absence of experimentally elucidated regulatory rules, we can still use omics surveys in conjunction with functional models to serve as surrogates for a regulatory model, and create condition- and tissue-specific models20,21,24–26,42–45 (Fig. 3a). There are two general classes of semi-automated methods for generating condition-specific models from omics data: switch-based and valve-based (Fig. 3b). The former, loosely uses omics data to indicate the ‘presence’ of gene products in a given condition43,44,46; whereas, the latter uses omics data as relative constraints on enzyme activities45,47,48. Because these approaches employ different fundamental assumptions, it is possible that they will be successful in different arenas. As these methods are used and improved in prospective research their utility and limits will become clear. In the remainder of this work, we provide an overview of a few key methods and describe results from recent studies using these methods.
Switch Approaches
In an early attempt to integrate omics data with genome-scale models of metabolism, Akesson et al.42 deactivated enzymes if the associated gene products were not detected in transcriptome profiles. This method’s major deficiency is the assumption that items that weren’t detected are not false negatives; i.e., it equates undetected with unexpressed. Because omics technologies often suffer from a lack of sensitivity5, this assumption may lead to enzymes being incorrectly disabled and result in a model that cannot simulate expected phenotypes. Along this line Akesson et al. choose to re-enable specific genes that weren’t detected because they believed the measurements were false negatives. While re-enabling genes in an ad hoc fashion may be appropriate, it can be difficult to determine which genes are false negatives in an omics data set. To reduce the burden of investigating all absent calls as false negatives, we43 and Shlomi and collaborators21,44 devised semi-automated methods to determine which absent calls might be false negatives.
In Becker et al.43 we used expression data to determine which reactions were active, similar to Akesson et al., however, we also included a criterion for re-enabling reactions if the model fails to simulate the global phenotype (Fig. 3c). Our method preferentially re-enables lowly expressed genes associated with low flux enzyme activities. We’ve used this approach to aid in constructing a variety of models24,49–52.
Shlomi et al.44 developed a method that attempts to assemble a submodel that is maximally consistent with gene expression and that does not contain any dead-end metabolites (Fig. 3d). Consistent means that the constrained model will be able to produce all metabolites and attempts to include the maximum number of enzymatic activities associated with highly expressed gene products while minimizing the number of activities associated with weakly expressed gene products. Unfortunately, this method did not perform well in an independent study20: when Gille et al.20 created a draft model with this method44 they couldn’t simulate 41% of the hepatocytes metabolic functions and noted a need for human curation of the model. Opportunely, an improved version21 of the method which attempts to leverage human insight accompanied Gille et al. This approach was subsequently applied in a theoretical study designed to identify drug targets in cancers22 and an applied study described below.
Valve Approaches
Colijn et al.45 developed a method that used expression levels for a gene product as linear adjustments to the allowable flux for associated activities. Using this method to analyze publicly available transcriptome profiles collected after exposing M. tuberculosis to various inhibitors of metabolism53, they correctly identified 7 of 8 known inhibitors for production of the virulence factor mycolic acid and a number of candidate inhibitors that represent potential therapeutics. Sorokina et al.54 applied this approach to a small scale 43-gene model of starch metabolism for the alga Ostreoccus tauri, and simulated diurnal starch and maltose production. Their simulations indicated that β-amylase and AGPase affect the ‘light’ portion of the cycle, whereas GWD, ISA1, ISA3, and α-amylase influence the dark cycle. Future biochemical validation of these predictions would be a testimony to these approaches.
More recently, Chandrasekaran and Price47 developed a method that attempts to integrate knowledge of transcriptional regulatory interactions with omics data and metabolic models. In this method, a large compendium of transcriptome data is used to calculate the probability of interaction (Pint) between a transcription factor (TF) and its target genes. Where, Pint is defined as the number of transcriptomes in which a target gene and the TF in question are both expressed divided by the number of transcriptomes in which the target gene is expressed. Then, based on knowledge about the activity of the TF in a given environment, the Pint is used to constrain the maximal flux for the target gene. However, this method has not been applied independently to the extent of our knowledge.
Testing model-derived mechanisms
To date, the overwhelming majority of research in this area has been theoretical and interpretive with predictions only being validated on preexisting data. Recent work by Frezza et al.23 may portend a shift from theory to practice in the coming years. Frezza et al. were interested in identifying the mechanism through which fumarate hydratase (FH) deficient cells are able to survive. FH mutations are associated with hereditary leiomyomatosis renal cell carcinoma (HLRCC)55. FH is an enzyme of the TCA cycle and inactivating mutations in FH result in a dysfunctional TCA cycle. To determine how Fh1-deficient cells could survive without a functional TCA cycle, Frezza et al. generated immortalized Fh1−/− murine kidney cells. After creating a tissue-specific model from transcriptome data and a generic model of cancer metabolism22, they used the model to identify which reactions were synthetic lethal pairs for FH. Their simulations identified 24 reactions, 18 of which were in a linear pathway of haem biosynthesis and degradation. To determine if the model’s predictions held water, they targeted haem oxygenase 1 (Hmox1) which is an essential component of the haem pathway. When Hmox1 was silenced by short-hairpin RNAs or it’s activity inhibited with zinc protoporphryin (ZnPP), Fh1−/− cells showed decreased growth whereas wild-type cells were unaffected. These results indicate that targeting Hmox1 may inhibit HLRCC survival, which is precisely what they observed when they treated the HLRCC cell line UOK26256 with ZnPP. This example shows how integration of omics data with network models provides mechanistic insight into the underlying biology.
PERSPECTIVE
Our understanding of the functions of a gene product may be severely limited without accounting for the context provided by the organism’s genome in addition to the external environment57. In other words, we may make progress in delineating certain prominent features of a gene product, however, we may miss key features when we solely employ a reduced scope. Network reconstructions contain a biochemical description of the internal environment of an organism, thus provide a biologically-grounded context for interpreting omics data. Complementarily, omics data may be used to refine network reconstructions and ask increasingly detailed questions about the systems biochemistry of disease. It may even be possible to use single-cell omics data58,59 derived from multiple cells in a tissue, or a microbial culture, to investigate disease progression and community interactions.
Since models are still being expanded, do not account for probabilistic factors39,40, and our knowledge of biology and biochemistry is incomplete, it is premature to expect 100% consistency between a network model and omics data. For the most detailed E. coli model60, only about 30% of the gene products are included in the model and over 1/3 of E. coli’s gene products are not functionally annotated. Regardless of our lack of comprehensive biochemical annotation for an organism, it is still possible to use omics data to aid in hypothesis generation. This was the approach taken by Frezza et al.23 when they uncovered the mechanism for HLRCC survival which could be targeted in future chemotherapy.
Given that mechanistic biological knowledge may be extracted from omics data sets with reconstructed networks and the large investment that has been made in omics data sets, it is likely that we are just seeing the beginning of this approach to omics data analysis. Because these network models contain points for integration with genomics, transcriptomics, proteomic, metabolomic, and phenomic data (Fig. 2a) we anticipate that these networks will soon be used to extract biological insight from sample-matched multi-omics data sets. This approach combines the wealth of omics data with biochemical knowledge that we have on molecular components and their function and puts it in the context of all the other components used by the cell at the same time. Thus moving us beyond molecular biology to systems biology. In a larger context, this process builds genotype-phenotype relationships61 and serves to link molecular and cellular physiology. As this relationship is foundational to biology, we anticipate vigorous activity and steady progress with this approach in the coming years.
Specifically, we expect that future research will leverage the added biological detail captured in models generated using our method for model metabolism and macromolecular expression27 or the whole-cell modeling method of Karr et al.41 to analyze omics data because of opportunities for direct integration of various omics data types. Additionally, as computational resources improve in coming years it is likely that we will see advances in modeling approaches, such as Karr et al., that integrate probabilistic and constraints-based approaches at the genome scale.
Acknowledgments
This work was supported by the US National Institute of Allergy and Infectious Diseases and the US Department of Health and Human Services through interagency agreement Y1-AI-8401-01. D.R.H. is supported in part by a Seed Award from the San Diego Center for Systems Biology funded by NIH/NIGMS (GM085764).
References
- 1.Zhang W, Li F, Nie L. Microbiology. 2010;156:287–301. doi: 10.1099/mic.0.034793-0. [DOI] [PubMed] [Google Scholar]
- 2.Palsson B, Zengler K. Nat Chem Biol. 2010;6:787–789. doi: 10.1038/nchembio.462. [DOI] [PubMed] [Google Scholar]
- 3.Christian N, May P, Kempa S, Handorf T, Ebenhoh O. Mol Biosyst. 2009;5:1889–1903. doi: 10.1039/B915913b. [DOI] [PubMed] [Google Scholar]
- 4.Shi L, et al. Nat Biotechnol. 2006;24:1151–1161. doi: 10.1038/nbt1239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Clarke R, et al. Nat Rev Cancer. 2008;8:37–49. doi: 10.1038/nrc2294. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Bonneau R. Nat Chem Biol. 2008;4:658–664. doi: 10.1038/nchembio.122. [DOI] [PubMed] [Google Scholar]
- 7.De Smet R, Marchal K. Nat Rev Microbiol. 2010;8:717–729. doi: 10.1038/nrmicro2419. [DOI] [PubMed] [Google Scholar]
- 8.Palsson B. Nat Biotechnol. 2004;22:1218–1219. doi: 10.1038/nbt1004-1218. [DOI] [PubMed] [Google Scholar]
- 9.Reed JL, Famili I, Thiele I, Palsson BO. Nat Rev Genet. 2006;7:130–141. doi: 10.1038/nrg1769. [DOI] [PubMed] [Google Scholar]
- 10.Hyduke DR, Palsson BO. Nat Rev Genet. 2010;11:297–307. doi: 10.1038/nrg2750. [DOI] [PubMed] [Google Scholar]
- 11.Kanehisa M, Goto S. Nucleic Acids Res. 2000;28:27–30. doi: 10.1093/nar/28.1.27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Keseler IM, et al. Nucleic Acids Res. 2011;39:D583–90. doi: 10.1093/nar/gkq1143. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Feist AM, Palsson BO. Nat Biotechnol. 2008;26:659–667. doi: 10.1038/nbt1401. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Covert MW, Knight EM, Reed JL, Herrgard MJ, Palsson BO. Nature. 2004;429:92–96. doi: 10.1038/nature02456. [DOI] [PubMed] [Google Scholar]
- 15.Duarte NC, et al. Proc Natl Acad Sci U S A. 2007;104:1777–1782. doi: 10.1073/pnas.0610772104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Barabasi AL, Gulbahce N, Loscalzo J. Nat Rev Genet. 2011;12:56–68. doi: 10.1038/nrg2918. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Kharchenko P, Church GM, Vitkup D. Mol Syst Biol. 2005;1:2005.0016. doi: 10.1038/msb4100023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Patil KR, Nielsen J. Proc Natl Acad Sci U S A. 2005;102:2685–2689. doi: 10.1073/pnas.0406811102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Kummel A, Panke S, Heinemann M. Mol Syst Biol. 2006;2:2006.0034. doi: 10.1038/msb4100074. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Gille C, et al. Mol Syst Biol. 2010;6:411. doi: 10.1038/msb.2010.62. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Jerby L, Shlomi T, Ruppin E. Mol Syst Biol. 2010;6:401. doi: 10.1038/msb.2010.56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Folger O, et al. Mol Syst Biol. 2011;7:501. doi: 10.1038/msb.2011.35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Frezza C, et al. Nature. 2011;477:225–228. doi: 10.1038/nature10363. [DOI] [PubMed] [Google Scholar]
- 24.Bordbar A, Lewis NE, Schellenberger J, Palsson BO, Jamshidi N. Mol Syst Biol. 2010;6:422. doi: 10.1038/msb.2010.68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Lewis NE, et al. Nat Biotechnol. 2010;28:1279–1285. doi: 10.1038/nbt.1711. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Huthmacher C, Hoppe A, Bulik S, Holzhutter HG. BMC Syst Biol. 2010;4:120. doi: 10.1186/1752-0509-4-120. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Lerman JA, et al. Nat Commun. 2012;3:929. doi: 10.1038/ncomms1928. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Lobel L, Sigal N, Borovok I, Ruppin E, Herskovits AA. PLoS Genet. 2012;8:e1002887. doi: 10.1371/journal.pgen.1002887. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Reed JL, et al. Proc Natl Acad Sci U S A. 2006;103:17480–17484. doi: 10.1073/pnas.0603364103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Oberhardt MA, Palsson BO, Papin JA. Mol Syst Biol. 2009;5:320. doi: 10.1038/msb.2009.77. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Thiele I, et al. BMC Syst Biol. 2011;5:8. doi: 10.1186/1752-0509-5-155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Tong AH, et al. Science. 2001;294:2364–2368. doi: 10.1126/science.1065810. [DOI] [PubMed] [Google Scholar]
- 33.Snitkin ES, et al. Genome Biol. 2008;9:R140. doi: 10.1186/gb-2008-9-9-r140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Kelley R, Ideker T. Nat Biotechnol. 2005;23:561–566. doi: 10.1038/nbt1096. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Szappanos B, et al. Nat Genet. 2011;43:656–662. doi: 10.1038/ng.846. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Smart AG, Amaral LA, Ottino JM. Proc Natl Acad Sci U S A. 2008;105:13223–13228. doi: 10.1073/pnas.0803571105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Park SJ, Gunsalus RP. J Bacteriol. 1995;177:6255–6262. doi: 10.1128/jb.177.21.6255-6262.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Cho BK, et al. Nat Biotechnol. 2009;27:1043–1049. doi: 10.1038/nbt.1582. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Paulsson J, Berg OG, Ehrenberg M. Proc Natl Acad Sci U S A. 2000;97:7148–7153. doi: 10.1073/pnas.110057697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Stewart-Ornstein J, Weissman JS, El-Samad H. Mol Cell. 2012;45:483–493. doi: 10.1016/j.molcel.2011.11.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Karr JR, et al. Cell. 2012;150:389–401. doi: 10.1016/j.cell.2012.05.044. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Akesson M, Forster J, Nielsen J. Metab Eng. 2004;6:285–293. doi: 10.1016/j.ymben.2003.12.002. [DOI] [PubMed] [Google Scholar]
- 43.Becker SA, Palsson BO. PLoS Comput Biol. 2008;4:e1000082. doi: 10.1371/journal.pcbi.1000082. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Shlomi T, Cabili MN, Herrgard MJ, Palsson BO, Ruppin E. Nat Biotechnol. 2008;26:1003–1010. doi: 10.1038/nbt.1487. [DOI] [PubMed] [Google Scholar]
- 45.Colijn C, et al. PLoS Comput Biol. 2009;5:e1000489. doi: 10.1371/journal.pcbi.1000489. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Jensen PA, Papin JA. Bioinformatics. 2011;27:541–547. doi: 10.1093/bioinformatics/btq702. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Chandrasekaran S, Price ND. Proc Natl Acad Sci U S A. 2010;107:17845–17850. doi: 10.1073/pnas.1005139107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.van Berlo RJ, et al. IEEE/ACM Trans Comput Biol Bioinform. 2011;8:206–216. doi: 10.1109/TCBB.2009.55. [DOI] [PubMed] [Google Scholar]
- 49.Chang RL, Xie L, Xie L, Bourne PE, Palsson BO. PLoS Comput Biol. 2010;6:e1000938. doi: 10.1371/journal.pcbi.1000938. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Bordbar A, et al. BMC Syst Biol. 2011;5:180. doi: 10.1186/1752-0509-5-180. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Ahn SY, et al. J Biol Chem. 2011;286:31522–31531. doi: 10.1074/jbc.M111.272534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Bordbar A, et al. Mol Syst Biol. 2012;8:558. doi: 10.1038/msb.2012.21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Boshoff HI, et al. J Biol Chem. 2004;279:40174–40184. doi: 10.1074/jbc.M406796200. [DOI] [PubMed] [Google Scholar]
- 54.Sorokina O, et al. BMC Syst Biol. 2011;5:36. doi: 10.1186/1752-0509-5-36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Tomlinson IP, et al. Nat Genet. 2002;30:406–410. doi: 10.1038/ng849. [DOI] [PubMed] [Google Scholar]
- 56.Yang Y, et al. Cancer Genet Cytogenet. 2010;196:45–55. doi: 10.1016/j.cancergencyto.2009.08.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Kauffman SA. Reinventing the sacred: a new view of science, reason and religion. Basic Books; New York: 2008. [Google Scholar]
- 58.Tang F, et al. Nat Methods. 2009;6:377–382. doi: 10.1038/nmeth.1315. [DOI] [PubMed] [Google Scholar]
- 59.Kang Y, et al. Genome Res. 2011;21:925–935. doi: 10.1101/gr.116103.110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Orth JD, et al. Mol Syst Biol. 2011;7:535. doi: 10.1038/msb.2011.65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Palsson B. FEBS Lett. 2009;583:3900–3904. doi: 10.1016/j.febslet.2009.09.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Otero JM, Nielsen J. Biotechnol Bioeng. 2010;105:439–460. doi: 10.1002/bit.22592. [DOI] [PubMed] [Google Scholar]