Abstract
Putting new findings into the context of available literature knowledge is one approach to deal with the surge of high-throughput data results. Furthermore, prior knowledge can increase the performance and stability of bioinformatic algorithms, for example, methods for network reconstruction. In this review, we examine software packages for the statistical computing framework R, which enable the integration of pathway data for further bioinformatic analyses. Different approaches to integrate and visualize pathway data are identified and packages are stratified concerning their features according to a number of different aspects: data import strategies, the extent of available data, dependencies on external tools, integration with further analysis steps and visualization options are considered. A total of 12 packages integrating pathway data are reviewed in this manuscript. These are supplemented by five R-specific packages for visualization and six connector packages, which provide access to external tools.
Keywords: Pathway data, data integration, R-project, bioconductor, BioPAX, rBiopaxParser, Cytoscape
1. Introduction
Easier access and decreased costs have lowered the entrance barrier for performing high-throughput experiments. However, analysis and interpretation of this data poses a challenge for biologists and bioinformaticians alike. This surge in generation of new data, both in vitro and in vivo, will naturally entail a surge in newly generated results as well. Such results can be used in the discovery of new drug targets, protein-protein interactions or regulatory effects. In either case, putting new findings into context of already existing knowledge is essential. An important aspect to evaluate results of high-throughput experiments is access to pathway data within the scope of programming environments. There are several methods incorporating pathway data into these analyses either in a form of the gene sets [1,2] or as regulatory graphs [3,4,5]. Furthermore, access to pathway data enables researchers to programmatically verify their results, for example by putting new results into context of available literature knowledge and thus testing for overlaps of findings with prior knowledge [6]. Additionally, the integration of pathway knowledge is also increasingly important for methods and approaches in bioinformatics. Many bioinformatic algorithms can increase their power and robustness, if prior knowledge is directly integrated during the analysis [7,8,9].
This manuscript aims to give an overview of software packages for the R Project for Statistical Computing that integrate pathway data for bioinformatic analysis within R. This manuscript focuses on provided pathway data, the extent of this data, and the integration of the R package with further analysis steps, as well as procedures for data visualization.
1.1. Modeling Pathway Knowledge
In general, pathways can be divided into the groups of metabolic pathways, signaling pathways, gene regulatory networks and protein–protein interaction networks, however, mixtures and overlaps exist. Metabolic pathways represent chains of chemical reactions of small molecules, so called metabolites, which are catalyzed by specific proteins, called enzymes. Signaling pathways represent the communication within and between cells. Gene expression is the process of generating the functional cell product of the DNA sequence of a gene. Gene regulatory networks model the indirect regulation and interaction of genes. Further, protein–protein interaction (PPI) databases store computationally inferred or experimentally validated protein–protein interactions, which can be assembled to PPI networks. Certain design decisions have to be made to model any of the pathway types, mainly coming down to a trade-off between richness of detail and generalization. Several ways to encode pathway knowledge have been developed to represent the various pathway types. Apart from proprietary XML or database models developed by pathway providers, a number of standards have received broader attention. The KEGG Markup Language (KGML), developed for and used by the Kyoto Encyclopedia of Genes and Genomes (KEGG) database, is an example for a proprietary data model of a database provider to encode metabolic and signaling pathways [10]. However, generic and well-documented formats, which aim at easing knowledge exchange, have been proposed in recent years. The Systems Biology Markup Language (SBML) [11] is designed to represent quantitative pathway models, as well as metabolic and regulatory pathways. Its main focus is on encoding quantifiable models to be used in systems biology modeling. The ontology for Biological Pathway Exchange (BioPAX) [12,13] models pathway knowledge and aims at promoting knowledge exchange between researchers. The latest release BioPAX Level 3 is able to represent metabolic, signaling as well as regulatory pathways. The Human Proteome Organization (HUPO) published the Proteomics Standards Initiatives Molecular Interaction (PSI MI) format, which initially only encoded protein–protein interaction data [14]. However, the format has been extended and can model various chemical entities and molecular interactions and features a querying syntax [15,16].
1.2. Pathway Databases
A plethora of pathway databases are freely available on the web. Pathguide [17], an online resource listing pathway database, currently contains links to over 300 different databases. One of the most notable databases, featuring metabolic and signaling pathways, is the Kyoto Encyclopedia of Genes and Genomes (KEGG) [10]. However, access to the bulk FTP download of data was restricted in 2011 and is currently only available via a subscription fee (http://www.kegg.jp/kegg/docs/plea.html). On the other hand, pathway sketches and data can still be retrieved free of charge via the KEGG website and web services. Reactome [18] is an open-source pathway database, manually curated and peer-reviewed, which is available in many different data formats, for example SBML, BioPAX and as MySQL-dump. The Pathway Interaction Database (PID) [19] is a collaborative project of the National Cancer Institute (NCI) and the Nature Publishing Group launched in 2006. As of 22 September, 2012 the NCI has taken over the project and will perform future updates. PID is available encoded in proprietary XML and in BioPAX Level 2 and Level 3. WikiPathways [20] on the other hand, is a community approach to pathway curation, available in BioPAX and proprietary formats. For a detailed review see Bauer-Mehren and colleagues [21], who evaluated popular databases concerning their extent and overlaps for specific pathways, including KEGG, Reactome, WikiPathways and PID. The European Bioinformatics Institute (EBI) hosts a registry (http://www.ebi.ac.uk/Tools/webservices/psicquic/registry/registry?action=STATUS) currently listing 28 web services available for querying databases for PSI MI-compatible data using the PSICQUIC querying language [16].
1.3. Tools for Pathway Curation and Analysis
During the last decade, a number of tools have been developed to create, edit and analyze pathways. Most notable among these are CellDesigner, PathVisio and Cytoscape. CellDesigner is heavily influenced by the Systems Biology Graphical Notation (SBGN) [22] and focuses on pathway diagram creation. PathVisio [23] and Cytoscape [24] are Java-based open-source tools to curate and analyze pathways. Both can be extended by a number of plugins to support more data formats or integrate new pathway analyses. Furthermore, both PathVisio and Cytoscape feature functionality to execute remote procedure calls and exchange and visualize data via external programs. The corresponding R package RCytoscape [25] is part of this review for its data loading and visualization functionality. Comparable PathVisio code can be found in an online tutorial (http://projects.bigcat.unimaas.nl/pathvisiorpc/tutorial). Arguably, Cytoscape is currently the most popular tool for pathway editing, featuring over 150 plugins in the Cytoscape App store [26]. An extensive review of standalone tools for pathway curation has been compiled by Sunderman and Hallett [27].
1.4. R Framework for Statistical Computing
The R Framework for Statistical Computing [28] has been well established in the field of bioinformatics and features a variety of tools to perform pathway analysis [8,9], methods for network reconstruction [29,30], as well as libraries for visualizing graphs and biological networks [31]. The main resources for R packages are the online repositories Comprehensive R Archive Network (CRAN) [32], Bioconductor [33] and the Omega Project for Statistical Computing [34], which currently contain 4705, 671 and 98 packages respectively. Categorized lists of packages for certain tasks, as well as search functionality allow the user to browse these repositories easily. However, it is hard to judge which package is the right one for a given task just by the package name and short description.
2. Methods Section
Within this review R packages are evaluated according to five different aspects: The first aspect determines the source of integrated data; renowned metabolic or signaling pathway databases like KEGG or Reactome are more often integrated and available via several packages. Within the second aspect, the internal data model and its extent are described; this can range from supplying only gene sets of pathways, to undirected graphs and directed graphs with fully annotated edges. The next criterion will assert the dependence or interaction of the R package with external tools for tasks such as visualization or data import; for example Cytoscape [24] or the Graphviz [35] libraries. The fourth aspect describes whether further methods for analyses, e.g., pathway analyses or methods for network reconstruction are already included or can be easily integrated by supplying readily transformed pathway data as input. Finally, visualization strategies will be described, ranging from no extra functionality to complex and colorful plots by using internal R functionality, external tools such as Cytoscape, or other graphical user interfaces.
2.1. Overview of Available Packages
The two most notable online repositories for R packages, CRAN [32] and Bioconductor [33], have been screened for packages which integrate pathway data. Various approaches to integrate, process and visualize pathway data have been realized by the package authors. A total of 12 packages integrating pathway data have been identified and are described here. These are supplemented by 5 R-specific packages for visualization, for example Rgraphviz, and 6 connector packages, for example XML and RJava, which provide access to external tools. Table 1 offers a list of reviewed packages along with their main features and properties.
Table 1.
Package Name | Data Source | Data Import | Dependencies | Further Analyses | Visualization |
---|---|---|---|---|---|
rBiopaxParser | generic BioPAX parser; all BioPAX databases | gene sets, directed graphs, full annotation | XML, biomaRt | Rgraphviz | |
graphite | includes KEGG, BioCarta, PID, Reactome, SPIKE | gene sets, directed graphs, mapping and converting IDs | AnnotationDbi | Pathway analyses: clipper, SPIA | Cytoscape |
NCIgraph | load PID data via Cytoscape | graph objects with directed edges | Java, Cytoscape | Rgraphviz | |
pathview | load data via KEGGgraph | gene sets with graph layout annotation | KEGGgraph | Pathway analyses: gage | Rgraphviz + native KEGG |
KEGGgraph | generic KGML parser, KEGG | graph objects with directed edges | XML, biomaRt | Rgraphviz | |
RedeR | igraph objects | Java | Java GUI | ||
SBMLR | generic SBML parser, limited functionality | list of SBML class instances | XML | deSolve | - |
rsbml | generic SBML parser | graph objects | libSBML | SBML ODE Solver Library (SOSLib) | Rgraphviz |
RCytoscape | load data via Cytoscape, R | graphNEL objects | Java, Cytoscape | Cytoscape | |
Gaggle | load data via Gaggle server | graph objects with directed edges | Gaggle | - | |
CePa | includes KEGG, BioCarta, PID, Reactome | igraph objects | igraph | Pathway analyses.GSEA, ORA | igraph |
PSICQUIC | PSI MI-QL compliant databases | list of interactions | RCurl |
In order to generate an overview of popular tools promoting the use of pathway data in R, the dependencies of and between these packages have been depicted in a dependency network in Figure 1, see Section 2.4. “Dependency on external tools”.
2.2. Source of Integrated Pathway Data
The common sources of data for all reviewed R packages are online pathway databases, which allow users to download an export of their curated pathway data or access via a web service. All reviewed packages pursue one of three approaches to integrate pathway data into R: The first approach is that pathway data is retrieved via external tools, i.e., Gaggle [36] or Cytoscape [24], which allow the user to access data types compatible with these tools. For example the package NCIgraph, tailored around the Pathway Interaction Database (PID) [19] of the National Cancer Institute (NCI), bases on RCytoscape to load pathways via Cytoscape to import arbitrary BioPAX data. The RCytoscape package [25] is able to retrieve networks within a Cytoscape window as R graph objects using generic remote procedure calls via the XMLRPC package. Furthermore, R graph objects can be loaded and visualized via Cytoscape. Another example is the R package gaggle, which is able to link to a Gaggle host and receive networks from other applications using the Gaggle framework for data exchange.
The second approach is that pathway data is retrieved, parsed and curated in a more or less automatic manner by the package maintainers and subsequently distributed directly via the package or as separate download. This approach is applied by the graphite package [37], which includes the pathway data of KEGG [10], BioCarta [38], PID [19], Reactome [18] and SPIKE [39]. The same approach is applied by the CePa package [40], which includes KEGG, BioCarta, PID and Reactome. Package pathRender reads interaction lists from the cMAP data package and builds graphs from these interactions.
Finally, the third approach is the ability of packages to parse data encoded in generic pathway formats and model these in an internal R representation. Naturally, this enables users to parse arbitrary pathway databases. The KEGGgraph package parses KGML encoded data and supplies it as R objects package [41]. The Pathview package [42] loads KGML encoded files using the KEGGgraph package and also features a download function, which is able to automatically retrieve KEGG pathways via the web. The SBMLR package [43] parses SBML up to Level 2 using the R XML package. The package rsbml uses the system library libSBML [44] to parse, validate and convert SBML data to R graphs, objects and currently supports SBML up to Level 3. The package PSICQUIC [45] retrieves interactions and annotations in the PSI MI format via web services offering PSI MI query capabilities and returns these as lists of interactions within R. Finally, the rBiopaxParser parses arbitrary BioPAX Level 2 and Level 3 databases using the XML package and represents them in R [46].
2.3. Internal Data Model
Another criterion for pathway data integration is the extent of data that is made available by individual packages. The simplest representation of a pathway in R is a gene set. Further, undirected or directed graphs can be used to represent a specific pathway. In order to integrate the pathway data into further analyses, the user has to ensure that the appropriate information about nodes, edges and edge direction is available. Depending on the package, pathway graphs might be available in a mechanistic fashion, including all biological processes, e.g., complex assembly, cellular transport, transcription or phosphorylation, or pathways might be transformed into a regulatory graph, only containing inhibiting or activating interactions. Furthermore, the data provided by the databases might be enriched by additional annotation data for genes or references to published evidence.
The pathview and KEGGgraph packages supply for every pathway a KEGGPathway object, which includes pathway information like title and organism, and a directed R graph object, which maintains the pathway topology and all essential attributes. Both metabolic and regulatory graph views can be extracted from the KEGGPathway object. Furthermore, pathway nodes in KGML can represent families of proteins, which the packages are able to expand and map to the corresponding set of single proteins. Cytoscape is a Java-based software platform for visualizing and analyzing networks and graphs, which can be extended by a large number of available plugins. RCytoscape retrieves networks from Cytoscape and represents them as R graph objects. The R object has directed or undirected edges and is annotated depending on the network within Cytoscape. The Gaggle framework consists of plugins for different software tools and enables dynamic data exchange via a host service, which connects the independent tools. Package gaggle can receive network data from other Gaggle applications and import these as graph objects. NCIgraph bases on the data retrieved via RCytoscape and offers further functionality to merge pathway nodes of PID data, which depends on a specific annotation by the NCI. Despite the similar naming, the packages providing SBML data, rsbml and SBMLR, use different approaches for their internal data model. SBMLR parses the pathway data into an internal model comprised of a set of lists. These are specifically tailored to represent reactants, products and the reaction rates for model simulations in systems biology. On the other hand, rsbml uses libSBML to parse an SBML model either as an R graph object or as a Document Object Model (DOM). Using convenience functions the annotation data within the DOM object can be queried and modified, the graph object can be extracted and used for further analyses. The graphite package offers its parsed data as pathway objects, which are imported from KGML- and BioPAX-encoded data and converted to R objects. These objects store information about the nodes and directed and undirected edges, as well as the data source, pathway name and species. The pathway objects can be converted into R graph objects. Similarly, the CePa package supplies pre-parsed interaction lists of its integrated databases and can generate directed igraph pathway graphs. The PSICQUIC package enables the users to retrieve PSI MI-compatible lists of molecular interactions from databases offering PSICQUIC web services. Afterwards these can be used to assemble networks or graphs from the retrieved interactions and annotations. The package rBiopaxParser parses arbitrary BioPAX-encoded data and provides biopax objects within R. These objects include all information of the original data within one data frame, similar to the triplets of the Resource Description Framework (RDF) model. The BioPAX data can be accessed and edited using convenience functions and pathways can be converted into R graph objects.
2.4. Dependency on External Tools
A number of packages for pathway integration rely on external tools, either for accessing, parsing and importing data or for mapping between various identifiers. Many packages depend on external tools for visualization purposes as well; however, these are described in Section 2.6. “Visualization of Pathway Data”. Figure 1 illustrates the dependencies of and between the data sources, reviewed packages, as well as the external tools.
Not all dependencies must be fulfilled to run the packages out of the box, however functionality might be crippled. In order to use the download functionality of the rBiopaxParser package and the querying capabilities of PSICQUIC, the curl tool must be installed. The gaggle package for data exchange relies on Java and the rJava package for communication with other Gaggle applications. The R packages rBiopaxParser, KEGGgraph and SBMLR rely on the XML package and the libxml system library for parsing, similarly rsbml depends on libSBML. For data import the packages NCIgraph and RCytoscape depend on a running Cytoscape session to load networks. In order to enrich available annotation and map identifiers the packages graphite and pathview depend on the AnnotationDbi package, while KEGGgraph, PSICQUIC and rBiopaxParser depend on the biomaRt package and web service.
2.5. Integration with Further Analysis Steps
Pathway analyses in its classical approach, the gene set enrichment analysis, allow bioinformaticians to test if a pathway is significantly regulated between groups of samples. Many different algorithms are available in R to perform gene set enrichment analyses, for example via package HTSanalyzeR [47] and CAMERA in the limma package [48,49]. More advanced pathway analysis tools are able to take pathway topology into account, e.g., SPIA [3], clipper [4], GGEA [50] and many other available as R packages from Bioconductor [5,51,52,53]. Furthermore, methods for network reconstruction aim at reconstructing networks by analyzing gene co-expression or intervention data [54]. Different approaches have been published and were implemented as R packages. Several of these can be enhanced in their performance by integrating graphs as prior knowledge, for example NEM [7], DDEPN [30], birta [55] and BoolNet [56]. On the other hand, packages offering access to SBML-encoded data, which is focused on describing quantitative models and enable direct integration with solvers for ordinary differential equations (ODEs) [57,58].
Almost all reviewed packages enable the user to access pathways within R as graph objects. If nodes in these graphs represent genes, a list of nodes can be used to perform gene set enrichment analyses. For more advanced algorithms the input has often to be reformatted to match the requirements of the specific implementation. Graphs might have to be either directed or undirected, edge weights must stay within certain limits and different edge types might or might not exist. In order to enhance the bioinformatic workflow several reviewed packages offer a kind of wrapper for further analyses. Graphs are automatically transformed into the right format and the analyses can be directly called from within the package. The packages rsbml and SBMLR include wrappers for solving ODEs using the SBML ODE Solver Library SOSlib [57] and the R package deSolve [58] respectively. The graphite package enables users to run several pathway analyses tools which take pathway topology into account for their testing procedures, for example clipper [4], SPIA [3] and DEGraph [59]. The CePa package integrates standard gene set enrichment and custom over-representation analyses published by Gu and colleagues [40].
2.6. Visualization of Pathway Data
There are several packages available which focus primarily on the visualization of R graph data. Package pathRender provides plotting capabilities with preset parameters to quickly retrieve visualization of graphs. RedeR [60] is a powerful tool, which implements plotting and remote interaction of graph objects of package igraph with a Java-based graphical user interface similar to Cytoscape, especially focused on visualizing extremely large networks. CePa provides preset plotting parameters for its supplied igraph objects. The packages NCIgraph, KEGGgraph, pathview and rBiopaxParser enable the user to plot pathways via Rgraphviz. Package pathview additionally provides a function to export native KEGG representations as PNG image files. The graphite package, which uses RCytoscape for visualization, as well as RCytoscape itself, visualize graphs via an active Cytoscape session. RCytoscape offers a multitude of well-documented parameters and functions to visualize, layout and modify R graph objects using Cytoscape.
Furthermore, the user is free to extend and improve visualization, since all methods for visualization—Cytoscape, RedeR, Graphviz as well as common R plotting—allow for individual modifications of parameters, e.g., color, size of nodes, width of edges.
3. Summary
Bioinformatics and systems biology are still rapidly evolving fields, and along with these many new and exciting software tools are becoming available. This speed as well as the interdisciplinary work makes it difficult for biologists and bioinformaticians alike to keep up with new developments. A positive aspect is the maturing of data sources for pathway knowledge: All mentioned database providers either offer exports abiding to the standards of SBML [11] or BioPAX [12], or even use the standards internally.
However, the internal data model of the reviewed packages is usually a combined use of the R graph class and additional, package-specific, tables or lists for further annotation data, for example for identifier mapping or edge and node types. None of the dependencies on external tools really restrict the use of the reviewed packages. The standalone versions of Cytoscape, RedeR and Gaggle are available via Java on all platforms and the Graphviz library has been integrated into the Rgraphviz package since version 2.1. This enables many differently flavored visualization options from within R.
Assessing pathway analyses or network reconstructions probably pose the biggest challenge for users, due to the package-specific data modeling of pathways within R. This is partly due to the fact that the packages for further analyses have varying requirements on graphs or prior knowledge, for example, that graphs must be supplied as undirected graphs or directed acyclic graphs. However, these problems might be tackled in the future by providing standardized pathway classes, for example via Bioconductor, which can automate these transformations.
Concerning the visualization, it is not surprising that packages which mostly act as an interface and connect R and external tools such as RCytoscape and RedeR are mainly focused on providing general capabilities for data exchange and visualization to their users. On the other hand, packages which focus on providing pathway information, for example graphite, CePa, rBiopaxParser or KEGGgraph, provide plotting capabilities with many preset parameters and thus offer pre-formatted pathway visualization. This enables users to work with these packages and the provided pathway data out of the box.
All of the reviewed R packages have a clear focus and provide unique capabilities. However, the different aspects within this review should enable users to narrow down their choice of packages for pathway data within R, according to the desired data sources, pathway analyses options and possibilities for visualization.
4. Conclusions
Although, this review is focused on pathway data within R, users may also choose to fully rely on other tools. The Cytoscape platform has a large community of users and numerous plugins in its new app store [26]. These enable users to import and curate pathway data, conduct analyses and offer many visualization possibilities. On the other hand, web tools such as DAVID [61] or Graphite Web [62] aim at providing a maximum of convenience by offering simple access to basic and advanced high-throughput analyses, as well as visualization via the web browser.
Programming in R leaves many options for interactions with different systems and services and near endless possibilities to perform and combine analyses and tools. However, compared to all-in-one tools like DAVID, these possibilities come at a price: Even with the emerging generic standards for data encoding like BioPAX, SBML or PSI MI, the availability of interfacing or libraries for various programming languages can be a limiting factor. Fortunately, new interfaces [16] and libraries [46] will appear over time and gaps between data formats will become smaller [15,63]. Strömbäck and Lambrix [64] compared different encodings of pathway knowledge, evaluating the features and capabilities of SBML, PSI MI and BioPAX. Cary and colleagues reviewed available pathway information and different data formats for encoding pathway knowledge [13]. Furthermore, a number of extensions and approaches to convert between formats have been published [65,66,67,68,69]. Unfortunately, lossless knowledge conversion between standards and reproducibility of pathway curation/reconstruction efforts remains hard to achieve.
Author Contributions
F.K. and M.B. compiled the figures and tables. F.K., M.B. and T.B. wrote the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
References and Notes
- 1.Beißbarth T., Speed T.P. GOstat: Find statistically overrepresented Gene Ontologies within a group of genes. Bioinformatics. 2004;20:1464–1465. doi: 10.1093/bioinformatics/bth088. [DOI] [PubMed] [Google Scholar]
- 2.Subramanian A., Tamayo P., Mootha V.K., Mukherjee S., Ebert B.L., Gillette M.A., Paulovich A., Pomeroy S.L., Golub T.R., Lander E.S., Mesirov J.P. Gene set enrichment analysis: A knowledge-based approach for interpreting genome-wide expression profiles. Proc. Natl. Acad. Sci. USA. 2005;102:15545–15550. doi: 10.1073/pnas.0506580102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Tarca A.L., Draghici S., Khatri P., Hassan S.S., Mittal P., Kim J., Kim C.J., Kusanovic J.P., Romero R. A novel signaling pathway impact analysis. Bioinformatics. 2009;25:75–82. doi: 10.1093/bioinformatics/btn577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Martini P., Sales G., Massa M.S., Chiogna M., Romualdi C. Along signal paths: an empirical gene set approach exploiting pathway topology. Nucleic Acids Res. 2012;41:19. doi: 10.1093/nar/gks866. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Dutta B., Wallqvist A., Reifman J. PathNet: A tool for pathway analysis using topological information. Source Code Biol. Med. 2012;7:10. doi: 10.1186/1751-0473-7-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Beissbarth T. Interpreting Experimental Results Using Gene Ontologies. In: Kimmel A., Oliver B., editors. Methods in Enzymology. Volume 411. Academic Press; Salt Lake City, UT, USA: 2006. pp. 340–352. [DOI] [PubMed] [Google Scholar]
- 7.Fröhlich H., Beißbarth T., Tresch A., Kostka D., Jacob J., Spang R., Markowetz F. Analyzing gene perturbation screens with nested effects models in R and bioconductor. Bioinformatics. 2008;24:2549–2550. doi: 10.1093/bioinformatics/btn446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Gade S., Porzelius C., Fälth M., Brase J.C., Wuttig D., Kuner R., Binder H., Sültmann H., Beißbarth T. Graph based fusion of miRNA and mRNA expression data improves clinical outcome prediction in prostate cancer. BMC Bioinformatics. 2011;12:488. doi: 10.1186/1471-2105-12-488. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Johannes M., Brase J.C., Fröhlich H., Gade S., Gehrmann M., Fälth M., Sültmann H., Beißbarth T. Integration of pathway knowledge into a reweighted recursive feature elimination approach for risk stratification of cancer patients. Bioinformatics. 2010;26:2136–2144. doi: 10.1093/bioinformatics/btq345. [DOI] [PubMed] [Google Scholar]
- 10.Kanehisa M., Goto S., Kawashima S., Okuno Y., Hattori M. The KEGG resource for deciphering the genome. Nucleic Acids Res. 2004;32:D277–D280. doi: 10.1093/nar/gkh063. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Hucka M., Finney A., Sauro H.M., Bolouri H., Doyle J.C., Kitano H., Arkin A.P., Bornstein B.J., Bray D., Cornish-Bowden A., Cuellar A.A., Dronov S., Gilles E.D., Ginkel M., Gor V., Goryanin I.I., Hedley W.J., Hodgman T.C., Hofmeyr J.-H., Hunter P.J., Juty N.S., Kasberger J.L., Kremling A., Kummer U., Novère N.L., Loew L.M., Lucio D., Mendes P., Minch E., Mjolsness E.D., Nakayama Y., Nelson M.R., Nielsen P.F., Sakurada T., Schaff J.C., Shapiro B.E., Shimizu T.S., Spence H.D., Stelling J., Takahashi K., Tomita M., Wagner J., Wang J. The systems biology markup language (SBML): A medium for representation and exchange of biochemical network models. Bioinformatics. 2003;19:524–531. doi: 10.1093/bioinformatics/btg015. [DOI] [PubMed] [Google Scholar]
- 12.Demir E., Cary M.P., Paley S., Fukuda K., Lemer C., Vastrik I., Wu G., D’Eustachio P., Schaefer C., Luciano J., Schacherer F., Martinez-Flores I., Hu Z., Jimenez-Jacinto V., Joshi-Tope G., Kandasamy K., Lopez-Fuentes A.C., Mi H., Pichler E., Rodchenkov I., Splendiani A., Tkachev S., Zucker J., Gopinath G., Rajasimha H., Ramakrishnan R., Shah I., Syed M., Anwar N., Babur Ö., Blinov M., Brauner E., Corwin D., Donaldson S., Gibbons F., Goldberg R., Hornbeck P., Luna A., Murray-Rust P., Neumann E., Ruebenacker O., Samwald M., Van Iersel M., Wimalaratne S., Allen K., Braun B., Whirl-Carrillo M., Cheung K.-H., Dahlquist K., Finney A., Gillespie M., Glass E., Gong L., Haw R., Honig M., Hubaut O., Kane D., Krupa S., Kutmon M., Leonard J., Marks D., Merberg D., Petri V., Pico A., Ravenscroft D., Ren L., Shah N., Sunshine M., Tang R., Whaley R., Letovksy S., Buetow K.H., Rzhetsky A., Schachter V., Sobral B.S., Dogrusoz U., McWeeney S., Aladjem M., Birney E., Collado-Vides J., Goto S., Hucka M., Novère N.L., Maltsev N., Pandey A., Thomas P., Wingender E., Karp P.D., Sander C., Bader G.D. The BioPAX community standard for pathway data sharing. Nat. Biotechnol. 2010;28:935–942. doi: 10.1038/nbt.1666. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Cary M.P., Bader G.D., Sander C. Pathway information for systems biology. FEBS Lett. 2005;579:1815–1820. doi: 10.1016/j.febslet.2005.02.005. [DOI] [PubMed] [Google Scholar]
- 14.Hermjakob H., Montecchi-Palazzi L., Bader G., Wojcik J., Salwinski L., Ceol A., Moore S., Orchard S., Sarkans U., von Mering C., Roechert B., Poux S., Jung E., Mersch H., Kersey P., Lappe M., Li Y., Zeng R., Rana D., Nikolski M., Husi H., Brun C., Shanker K., Grant S.G. N., Sander C., Bork P., Zhu W., Pandey A., Brazma A., Jacq B., Vidal M., Sherman D., Legrain P., Cesareni G., Xenarios I., Eisenberg D., Steipe B., Hogue C., Apweiler R. The HUPO PSI’s Molecular Interaction format?a community standard for the representation of protein interaction data. Nat. Biotechnol. 2004;22:177–183. doi: 10.1038/nbt926. [DOI] [PubMed] [Google Scholar]
- 15.Kerrien S., Orchard S., Montecchi-Palazzi L., Aranda B., Quinn A.F., Vinod N., Bader G.D., Xenarios I., Wojcik J., Sherman D., Tyers M., Salama J.J., Moore S., Ceol A., Chatr-aryamontri A., Oesterheld M., Stümpflen V., Salwinski L., Nerothin J., Cerami E., Cusick M.E., Vidal M., Gilson M., Armstrong J., Woollard P., Hogue C., Eisenberg D., Cesareni G., Apweiler R., Hermjakob H. Broadening the horizon—Level 2.5 of the HUPO-PSI format for molecular interactions. BMC Biol. 2007;5:44. doi: 10.1186/1741-7007-5-44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Aranda B., Blankenburg H., Kerrien S., Brinkman F.S. L., Ceol A., Chautard E., Dana J.M., De Las Rivas J., Dumousseau M., Galeota E., Gaulton A., Goll J., Hancock R.E. W., Isserlin R., Jimenez R.C., Kerssemakers J., Khadake J., Lynn D.J., Michaut M., O’Kelly G., Ono K., Orchard S., Prieto C., Razick S., Rigina O., Salwinski L., Simonovic M., Velankar S., Winter A., Wu G., Bader G.D., Cesareni G., Donaldson I.M., Eisenberg D., Kleywegt G.J., Overington J., Ricard-Blum S., Tyers M., Albrecht M., Hermjakob H. PSICQUIC and PSISCORE: Accessing and scoring molecular interactions. Nat. Methods. 2011;8:528–529. doi: 10.1038/nmeth.1637. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Bader G.D., Cary M.P., Sander C. Pathguide: a Pathway Resource List. Nucleic Acids Res. 2006;34:D504–D506. doi: 10.1093/nar/gkj126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Croft D., O?Kelly G., Wu G., Haw R., Gillespie M., Matthews L., Caudy M., Garapati P., Gopinath G., Jassal B., Jupe S., Kalatskaya I., Mahajan S., May B., Ndegwa N., Schmidt E., Shamovsky V., Yung C., Birney E., Hermjakob H., D'Eustachio P., Stein L. Reactome: A database of reactions, pathways and biological processes. Nucleic Acids Res. 2011;39:D691–D697. doi: 10.1093/nar/gkq1018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Schaefer C.F., Anthony K., Krupa S., Buchoff J., Day M., Hannay T., Buetow K.H. PID: The Pathway Interaction Database. Nucleic Acids Res. 2009;37:D674–D679. doi: 10.1093/nar/gkn653. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Kelder T., van Iersel M.P., Hanspers K., Kutmon M., Conklin B.R., Evelo C.T., Pico A.R. WikiPathways: building research communities on biological pathways. Nucleic Acids Res. 2011;40:D1301–D1307. doi: 10.1093/nar/gkr1074. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Bauer-Mehren A., Furlong L.I., Sanz F. Pathway databases and tools for their exploitation: Benefits, current limitations and challenges. Mol. Syst. Biol. 2009;5:290. doi: 10.1038/msb.2009.47. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Funahashi A., Morohashi M., Kitano H., Tanimura N. CellDesigner: A process diagram editor for gene-regulatory and biochemical networks. BIOSILICO. 2003;1:159–162. doi: 10.1016/S1478-5382(03)02370-9. [DOI] [Google Scholar]
- 23.Iersel M.P. van, Kelder T., Pico A.R., Hanspers K., Coort S., Conklin B.R., Evelo C. Presenting and exploring biological pathways with PathVisio. BMC Bioinformatics. 2008;9:399. doi: 10.1186/1471-2105-9-399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Shannon P., Markiel A., Ozier O., Baliga N.S., Wang J.T., Ramage D., Amin N., Schwikowski B., Ideker T. Cytoscape: A Software Environment for Integrated Models of Biomolecular Interaction Networks. Genome Res. 2003;13:2498–2504. doi: 10.1101/gr.1239303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Shannon P.T., Grimes M., Kutlu B., Bot J.J., Galas D.J. RCytoscape: Tools for exploratory network analysis. BMC Bioinformatics. 2013;14:217. doi: 10.1186/1471-2105-14-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Lotia S., Montojo J., Dong Y., Bader G.D., Pico A.R. Cytoscape app store. Bioinforma. Oxf. Engl. 2013;29:1350–1351. doi: 10.1093/bioinformatics/btt138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Suderman M., Hallett M. Tools for visually exploring biological networks. Bioinformatics. 2007;23:2651–2659. doi: 10.1093/bioinformatics/btm401. [DOI] [PubMed] [Google Scholar]
- 28.R Core Team . R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing; Vienna, Austria: 2013. [Google Scholar]
- 29.Fröhlich H., Fellmann M., Sültmann H., Poustka A., Beissbarth T. Estimating large-scale signaling networks through nested effect models with intervention effects from microarray data. Bioinformatics. 2008;24:2650–2656. doi: 10.1093/bioinformatics/btm634. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Bender C., Henjes F., Fröhlich H., Wiemann S., Korf U., Beißbarth T. Dynamic deterministic effects propagation networks: learning signalling pathways from longitudinal protein array data. Bioinformatics. 2010;26:i596–i602. doi: 10.1093/bioinformatics/btq385. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Carey V.J., Gentry J., Whalen E., Gentleman R. Network structures and algorithms in Bioconductor. Bioinformatics. 2005;21:135–136. doi: 10.1093/bioinformatics/bth458. [DOI] [PubMed] [Google Scholar]
- 32.Hornik K. The Comprehensive R Archive Network. Wiley Interdiscip. Rev. Comput. Stat. 2012;4:394–398. doi: 10.1002/wics.1212. [DOI] [Google Scholar]
- 33.Gentleman R.C., Carey V.J., Bates D.M., Bolstad B., Dettling M., Dudoit S., Ellis B., Gautier L., Ge Y., Gentry J., Hornik K., Hothorn T., Huber W., Iacus S., Irizarry R., Leisch F., Li C., Maechler M., Rossini A.J., Sawitzki G., Smith C., Smyth G., Tierney L., Yang J.Y., Zhang J. Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 2004;5:R80. doi: 10.1186/gb-2004-5-10-r80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Lang D.T. The Omegahat Environment: New Possibilities for Statistical Computing. J. Comput. Graph. Stat. 2000;9:423–451. [Google Scholar]
- 35.Ellson J., Gansner E., Koutsofios L., North S.C., Woodhull G. Graphviz—Open Source Graph Drawing Tools. In: Mutzel P., Jünger M., Leipert S., editors. Graph Drawing. Springer; Berlin /Heidelberg, Germany: 2002. pp. 483–484. [Google Scholar]
- 36.Shannon P.T., Reiss D.J., Bonneau R., Baliga N.S. The Gaggle: An open-source software system for integrating bioinformatics software and data sources. BMC Bioinformatics. 2006;7:176. doi: 10.1186/1471-2105-7-176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Sales G., Calura E., Cavalieri D., Romualdi C. graphite - a Bioconductor package to convert pathway topology to gene network. BMC Bioinformatics. 2012;7:176. doi: 10.1186/1471-2105-13-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Nishimura D. BioCarta. Biotech Softw. Internet Rep. 2001;2:117–120. doi: 10.1089/152791601750294344. [DOI] [Google Scholar]
- 39.Paz A., Brownstein Z., Ber Y., Bialik S., David E., Sagir D., Ulitsky I., Elkon R., Kimchi A., Avraham K.B., Shiloh Y., Shamir R. SPIKE: A database of highly curated human signaling pathways. Nucleic Acids Res. 2011;39:D793–D799. doi: 10.1093/nar/gkq1167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Gu Z., Wang J. CePa: An R package for finding significant pathways weighted by multiple network centralities. Bioinformatics. 2013;29:658–660. doi: 10.1093/bioinformatics/btt008. [DOI] [PubMed] [Google Scholar]
- 41.Zhang J.D., Wiemann S. KEGGgraph: A graph approach to KEGG PATHWAY in R and bioconductor. Bioinformatics. 2009;25:1470–1471. doi: 10.1093/bioinformatics/btp167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Luo W., Brouwer C. Pathview: An R/Bioconductor package for pathway-based data integration and visualization. Bioinformatics. 2013;29:1830–1831. doi: 10.1093/bioinformatics/btt285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Radivoyevitch T. A two-way interface between limited Systems Biology Markup Language and R. BMC Bioinformatics. 2004;5:190. doi: 10.1186/1471-2105-5-190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Bornstein B.J., Keating S.M., Jouraku A., Hucka M. LibSBML: An API Library for SBML. Bioinformatics. 2008;24:880–881. doi: 10.1093/bioinformatics/btn051. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.del-Toro N., Dumousseau M., Orchard S., Jimenez R.C., Galeota E., Launay G., Goll J., Breuer K., Ono K., Salwinski L., Hermjakob H. A new reference implementation of the PSICQUIC web service. Nucleic Acids Res. 2013;41:W601–W606. doi: 10.1093/nar/gkt392. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Kramer F., Bayerlová M., Klemm F., Bleckmann A., Beißbarth T. rBiopaxParser—An R package to parse, modify and visualize BioPAX data. Bioinformatics. 2013;29:520–522. doi: 10.1093/bioinformatics/bts710. [DOI] [PubMed] [Google Scholar]
- 47.Wang X., Terfve C., Rose J.C., Markowetz F. HTSanalyzeR: An R/Bioconductor package for integrated network analysis of high-throughput screens. Bioinformatics. 2011;27:879–880. doi: 10.1093/bioinformatics/btr028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Smyth G.K. Bioinformatics and Computational Biology Solutions Using R and Bioconductor. Springer; Amsterdam, Netherlands: 2005. Limma: Linear models for microarray data; pp. 397–420. [Google Scholar]
- 49.Wu D., Smyth G.K. Camera: A competitive gene set test accounting for inter-gene correlation. Nucleic Acids Res. 2012;40:e133–e133. doi: 10.1093/nar/gks461. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Geistlinger L., Csaba G., Küffner R., Mulder N., Zimmer R. From sets to graphs: towards a realistic enrichment analysis of transcriptomic systems. Bioinformatics. 2011;27:i366–i373. doi: 10.1093/bioinformatics/btr228. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Chiromatzo A.O., Oliveira T.Y.K., Pereira G., Costa A.Y., Montesco C.A.E., Gras D.E., Yosetake F., Vilar J.B., Cervato M., Prado P.R.R., Cardenas R.G.C.C.L., Cerri R., Borges R.L., Lemos R.N., Alvarenga S.M., Perallis V.R.C., Pinheiro D.G., Silva I.T., Brandão R.M., Cunha M.A.V., Giuliatti S., Silva W.A. miRNApath: A database of miRNAs, target genes and metabolic pathways. Genet. Mol. Res. GMR. 2007;6:859–865. [PubMed] [Google Scholar]
- 52.Tian L., Greenberg S.A., Kong S.W., Altschuler J., Kohane I.S., Park P.J. Discovering statistically significant pathways in expression profiling studies. Proc. Natl. Acad. Sci. USA. 2005;102:13544–13549. doi: 10.1073/pnas.0506577102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.ReactomePA. [(accessed on 28 November 2013)]. Available online: http://www.bioconductor.org/packages/2.13/bioc/html/ReactomePA.html.
- 54.Baumbach J., Tauch A., Rahmann S. Towards the integrated analysis, visualization and reconstruction of microbial gene regulatory networks. Brief. Bioinform. 2009;10:75–83. doi: 10.1093/bib/bbn055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Zacher B., Abnaof K., Gade S., Younesi E., Tresch A., Fröhlich H. Joint Bayesian inference of condition-specific miRNA and transcription factor activities from combined gene and microRNA expression data. Bioinformatics. 2012;28:1714–1720. doi: 10.1093/bioinformatics/bts257. [DOI] [PubMed] [Google Scholar]
- 56.Müssel C., Hopfensitz M., Kestler H.A. BoolNet—An R package for generation, reconstruction and analysis of Boolean networks. Bioinformatics. 2010;26:1378–1380. doi: 10.1093/bioinformatics/btq124. [DOI] [PubMed] [Google Scholar]
- 57.Machné R., Finney A., Müller S., Lu J., Widder S., Flamm C. The SBML ODE Solver Library: A native API for symbolic and fast numerical analysis of reaction networks. Bioinformatics. 2006;22:1406–1407. doi: 10.1093/bioinformatics/btl086. [DOI] [PubMed] [Google Scholar]
- 58.Soetaert K., Petzoldt T., Setzer R.W. Solving differential equations in R: Package deSolve. J. Stat. Softw. 2010;33:1–25. [Google Scholar]
- 59.Jacob L., Neuvial P., Dudoit S. More power via graph-structured tests for differential expression of gene networks. Ann. Appl. Stat. 2012;6:561–600. doi: 10.1214/11-AOAS528. [DOI] [Google Scholar]
- 60.Castro M.A., Wang X., Fletcher M.N., Meyer K.B., Markowetz F. RedeR: R/Bioconductor package for representing modular structures, nested networks and multiple levels of hierarchical associations. Genome Biol. 2012;13:R29. doi: 10.1186/gb-2012-13-4-r29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Huang D.W., Sherman B.T., Tan Q., Kir J., Liu D., Bryant D., Guo Y., Stephens R., Baseler M.W., Lane H.C., Lempicki R.A. DAVID Bioinformatics Resources: Expanded annotation database and novel algorithms to better extract biology from large gene lists. Nucleic Acids Res. 2007;35:W169–W175. doi: 10.1093/nar/gkm415. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Sales G., Calura E., Martini P., Romualdi C. Graphite Web: Web tool for gene set analysis exploiting pathway topology. Nucleic Acids Res. 2013;41:W89–W97. doi: 10.1093/nar/gkt386. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Wrzodek C., Büchel F., Ruff M., Dräger A., Zell A. Precise generation of systems biology models from KEGG pathways. BMC Syst. Biol. 2013;7:15. doi: 10.1186/1752-0509-7-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Strömbäck L., Lambrix P. Representations of molecular pathways: an evaluation of SBML, PSI MI and BioPAX. Bioinformatics. 2005;21:4401–4407. doi: 10.1093/bioinformatics/bti718. [DOI] [PubMed] [Google Scholar]
- 65.Büchel F., Wrzodek C., Mittag F., Dräger A., Eichner J., Rodriguez N., Novère N.L., Zell A. Qualitative translation of relations from BioPAX to SBML qual. Bioinformatics. 2012;28:2648–2653. doi: 10.1093/bioinformatics/bts508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Keating S.M., Le Novère N. Supporting SBML as a model exchange format in software applications. Methods Mol. Biol. 2013;1021:201–225. doi: 10.1007/978-1-62703-450-0_11. [DOI] [PubMed] [Google Scholar]
- 67.Ruebenacker O., Moraru I.I., Schaff J.C., Blinov M.L. Integrating BioPAX pathway knowledge with SBML models. IET Syst. Biol. 2009;3:317–328. doi: 10.1049/iet-syb.2009.0007. [DOI] [PubMed] [Google Scholar]
- 68.Vlaic S., Hoffmann B., Kupfer P., Weber M., Dräger A. GRN2SBML: Automated encoding and annotation of inferred gene regulatory networks complying with SBML. Bioinforma. Oxf. Engl. 2013;29:2216–2217. doi: 10.1093/bioinformatics/btt370. [DOI] [PubMed] [Google Scholar]
- 69.Webb R.L., Ma’ayan A. Sig2BioPAX: Java tool for converting flat files to BioPAX Level 3 format. Source Code Biol. Med. 2011;6:5. doi: 10.1186/1751-0473-6-5. [DOI] [PMC free article] [PubMed] [Google Scholar]