Skip to main content
F1000Research logoLink to F1000Research
. 2019 Mar 29;8:42. Originally published 2019 Jan 10. [Version 2] doi: 10.12688/f1000research.17548.2

Expanding the Orthologous Matrix (OMA) programmatic interfaces: REST API and the OmaDB packages for R and Python

Klara Kaleb 1, Alex Warwick Vesztrocy 1,2, Adrian Altenhoff 2,3, Christophe Dessimoz 1,2,4,5,6,a
PMCID: PMC6464060  PMID: 31001419

Version Changes

Revised. Amendments from Version 1

Version 2 of our manuscript addresses the points from the peer-reviewers, whom we thank for their constructive feedback. We clarified the installation procedure for the package, which is currently in the development version of Bioconductor, due to be released in Spring 2019. Furthermore, we corrected typos, improved the documentation, and clarified potential differences in the output of the code examples that can arise due to updates of the OMA database.

Abstract

The Orthologous Matrix (OMA) is a well-established resource to identify orthologs among many genomes. Here, we present two recent additions to its programmatic interface, namely a REST API, and user-friendly R and Python packages called OmaDB. These should further facilitate the incorporation of OMA data into computational scripts and pipelines. The REST API can be freely accessed at https://omabrowser.org/api. The R OmaDB package is available as part of Bioconductor at http://bioconductor.org/packages/OmaDB/, and the omadb Python package is available from the Python Package Index (PyPI) at https://pypi.org/project/omadb/.

Keywords: orthologs, paralogs, hierarchical orthologous groups, comparative genomics, orthologous matrix, oma, API, R, python, REST, bioconductor

Introduction

Orthologs are pairs of protein coding genes that have common ancestry and have diverged due to speciation events 1. The detection of orthologs is of fundamental importance in many fields in biology, such as comparative genomics, as it allows us to propagate existing biological knowledge to ever growing newly sequenced data 2, 3.

The Orthologous Matrix (OMA) is a method and resource for the inference of orthologs among complete genomes 4. The OMA database ( https://omabrowser.org) features broad scope and size with currently over 2,100 species from all three domains of life.

The OMA browser has supported multiple ways of exporting the underlying data from its beginning. Users can download data either via bulk archives or interactively through the browser—using where possible standard file formats, such as FASTA, OrthoXML 5, or PhyloXML 6. For programmatic access, early OMA database releases offered an Application Programming Interface (API) in the form of the Simple Object Access Protocol (SOAP). However, the complexity and limited adoption of SOAP has prompted us to recently switch to the simpler, faster, and more widely used Representational State Transfer (REST) protocol for the OMA API 4. Here, we provide a description of this new OMA REST API.

Furthermore, the R environment is widely used in bioinformatics due to its flexibility as a high-level scripting language, statistical capabilities, and numerous bioinformatics libraries. In particular, the Bioconductor open source framework contains over 2,000 packages to facilitate either access to or manipulation of biological data 7. This motivated us to develop the OmaDB Bioconductor package which provides a more idiomatic and user-friendly access to OMA data in R implemented on top of the REST API.

Finally, to also enable Python users to easily interact with the database, we have developed a similar package in that language, compliant with the conventions and with support of typical complementary Python packages as outlined below.

Methods

We start by describing the OMA REST API, before moving on to detail the OmaDB Bioconductor package, and finally outline the omadb Python package.

OMA REST API

The REST framework is an API architectural style that is based on URLs and HTTP protocol methods. It was designed to be stateless and thus is context independent. That is, it does not save data internally between the HTTP requests which minimises server-side application state, thus easing parallelism. The combination of the HTTP and JSON data formats makes it particularly suitable for web applications and easily supported by most programming languages.

Since the backend of the OMA browser is almost fully based on Python and its frontend is supported by the Django web framework 8, we have opted to use the Django Rest Framework (DRF) to implement a REST API in our latest release 4. Most API calls require querying the OMA database, stored in HDF5 9, using a custom Python library (“pyoma”). The query results are serialised in the format requested by the user — typically JSON.

Most data available through the OMA browser is now also accessible via the API, with the exception of the local synteny data. This includes individual genes and their attributes such as protein or cDNA sequences, cross-references, pairwise orthologs, hierarchical orthologous groups 10, as well as species trees and the corresponding taxonomy. The API documentation as well as the interactive interface can be found at https://omabrowser.org/api/docs ( Figure 1).

Figure 1. Showcase of the OMA REST API documentation page, with an example of the interactive query and response.

Figure 1.

OmaDB Bioconductor package

To facilitate simplified access to the API and downstream analyses in the R environment, we have also developed an API wrapper package in R, now available in Bioconductor 7 ( http://bioconductor.org/packages/OmaDB/). This allowed for abstraction of the server interface, eliminating the need to know structure of the database or the URL endpoints to access the required data.

The package consists of a collection of functions that import OMA data into R objects, the type of which depends on the query supplied. Due to the volume of the data available, some selected object attributes are at first given as URL endpoints. However, these are automatically loaded upon accession. OmaDB also facilitates further downstream analyses with other Bioconductor packages, such as GO enrichment analysis with topGO 11, sequence analysis with BioStrings 12, phylogenetic analyses using ggtree 13 or gene locus analyses with the help of GenomicRanges 14.

The open source code is hosted at https://github.com/DessimozLab/OmaDB/. In the results section we showcase usage of the latest version of the package (v2.0), which requires R version >= 3.6 and Bioconductor version >= 3.9. Note that as of the time of publication, this is in the Bioconductor development version. For details, see the Software Availability section.

Package Installation

if (!requireNamespace("BiocManager"))
install.packages("BiocManager")
BiocManager::install("OmaDB")
# Load the package
library(OmaDB)

omadb Python package

For Python users, we provide an analogous package named omadb. Results are supplied to users as a hybrid attribute-dictionary object. As such, both attribute and key-based access is possible. Where the URL of a further API call is listed in a response, this has been designed to be automatically requested for the user.

For data that can be represented as a table, the pandas package 15 is supported. HOGs can be analysed or displayed using the pyham library 16. Trees are retrievable as DendroPy 17 or ETE3 18 Tree objects. Gene Ontology enrichment analyses are possible through the use of the goatools package 19.

The open source code is hosted at https://github.com/DessimozLab/pyomadb/. The package requires Python >=3.6, as well as a stable internet connection. It is also available to download from PyPI, installable using pip.

Package Installation

# Install in shell, using pip
$ pip install omadb

# In Python, load the package
>>>fromomadb import Client
# Initialise the client
>>> c = Client()

Results

We provide six illustrative examples in R. The first shows a direct call to the REST API, while the other five showcase the OmaDB R package (version 2.0). These examples are also available as a Jupyter notebook 20 as part of the OmaDB R code repository. We have also provided analogous examples in Python, also in the form of a Jupyter notebook, included in its code repository—with the exception of Example 6, which uses a package only available in R.

Note that the results of the queries using the API and the packages may change as we continue to update the OMA database. The OMA database release of June 2018 was used to generate the examples below.

Example 1 - Simply accessing the API, in R, via URLs

One way to access the API is to directly send a request using httr 21 in R. This approach requires the user to know the URL of the API endpoint, as well as the URL of the API function of interest. Some additional processing steps of the resultant response is usually needed. A simple example to retrieve information on the P53_RAT protein is provided below.

Here we first formulate our URL of interest and use it to send a GET request to the API. This gives us the response JSON object, which can then be parsed into an R list.

library(httr)

url <-"https://omabrowser.org/api/protein/P53_RAT/"
response <- GET(url)

response_content_list <- httr::content(response, as ="parsed")

Example 2 - Using a sequence to find its gene family (Hierarchical Orthologous Group) and function via gene ontologies

Below is a simple workflow using the OmaDB package to annotate a given protein sequence, using the mapSequence() function.

library(OmaDB)

sequence <-'MKLVFLVLLFLGALGLCLAGRRRSVQWCAVSQPEATKCFQWQRNMRKVRGPPVSCIKRD
SPIQCIQAIAENRADAVTLDGGFIYEAGLAPYKLRPVAAEVYGTERQPRTHYYAVAVVKKGGSFQLNELQGL
KSCHTGLRRTAGWNVPIGTLRPFLNWTGPPEPIEAAVARFFSASCVPGADKGQFPNLCRLCAGTGENKCAFS
SQEPYFSYSGAFKCLRDGAGDVAFIRESTVFEDLSDEAERDEYELLCPDNTRKPVDKFKDCHLARVPSHAVV
ARSVNGKEDAIWNLLRQAQEKFGKDKSPKFQLFGSPSGQKDLLFKDSAIGFSRVPPRIDSGLYLGSGYFTAI
QNLRKSEEEVAARRARVVWCAVGEQELRKCNQWSGLSEGSVTCSSASTTEDCIALVLKGEADAMSLDGGYVY
TAGKCGLVPVLAENYKSQQSSDPDPNCVDRPVEGYLAVAVVRRSDTSLTWNSVKGKKSCHTAVDRTAGWNIP
MGLLFNQTGSCKFDEYFSQSCAPGSDPRSNLCALCIGDEQGENKCVPNSNERYYGYTGAFRCLAENAGDVAF
VKDVTVLQNTDGNNNEAWAKDLKLADFALLCLDGKRKPVTEARSCHLAMAPNHAVVSRMDKVERLKQVLLHQ
QAKFGRNGSDCPDKFCLFQSETKNLLFNDNTECLARLHGKTTYEKYLGPQYVAGITNLKKCSTSPLLEACEF
LRK'

seq_annotation <- mapSequence(sequence)
length(seq_annotation$targets)# 1

The identified targets can be found in the seq_annotation$targets. As the length of this object attribute is 1, in this example the sequence mapping identified a single target sequence. From this object further information can be obtained as follows:

seq_annotation$targets[[1]]$canonicalid# 'TRFL_HUMAN'

Thus, our sequence is human lactotransferrin (also known as lactoferrin). Lactotransferrin is one of four subfamilies of transferrins in mammals 22.

To investigate the evolutionary history of genes more precisely, we turn to Hierarchical Orthologous Groups (HOGs)—sets of genes which have descended from a single common ancestral gene within a taxonomic range of interest 10. For an introduction to HOGs, we refer the interested reader to the following short video: https://youtu.be/5p5x5gxzhZA.

By knowing the ID of the HOG to which our sequence belongs, we can obtain a list of all the HOG members (i.e. all genes in the HOG), as follows:

hog_id <- seq_annotation$targets[[1]]$oma_hog_id# 'HOG:0413862.1a.1b'
hog <- getHOG(id = hog_id, members = TRUE, level ='Mammalia')
hog$members

Note that it is also possible to access information on a HOG using the getHOG() function. A HOG can be identified by its ID or the ID of one of its member proteins. Therefore the below will produce the same output.

hog <- getHOG(id ='TRFL_HUMAN', members = TRUE, level ='Mammalia')

We can easily retrieve the Gene Ontology (GO) terms 23 that are associated to each of the members using OmaDB.

go_annotations <- getProtein(hog$members$omaid,attribute ='gene_ontology')

The resultant list of GO terms per gene is in the “geneID2GO” format by default, which is used by the topGO 11 package.

To compare the function of lactotransferrins with their paralogous counterparts, we can retrieve a background set consisting of all members of the transferring HOG defined at the root of the eukaryotes

bgHOG <- getHOG(id ='TRFL_HUMAN', members = TRUE, level ='Eukaryota')
bgAnnnot <- getProtein(bgHOG$members$omaid, attribute ='gene_ontology')

We can now construct a topGO object using the getTopGO function as seen below. Note that the background set of terms is set by getTopGO to all terms appearing in the list of annotations. This may not be appropriate in all cases—the choice of background set requires careful consideration 24.

bgAnnnotFormatted = formatTopGO(bgAnnnot, format ='geneID2GO')

library(topGO)
myGO <- getTopGO(annotations = bgAnnnotFormatted, format ='geneID2GO',foregroundGenes = hog$members$entry_nr, ontology ='BP')

myRes <- runTest(myGO, algorithm ='classic', statistic ='fisher')
print(GenTable(myGO, myRes))

As the output in Table 1 indicates, several enriched terms in the mammalian lactotransferrin are related to bone formation, consistent with previous reports in the literature (e.g. 25). So is the role of lactotransferrin in antimicrobial activity (e.g. 26).

Table 1. Gene Ontology enrichment of Biological Process terms associated with mammalian lactotransferrins compared to all eukaryotic transferrins, as obtained from example 2.

GO.ID Term P-value
GO:0001501 skeletal system development <1e-30
GO:0001503 ossification <1e-30
GO:0001649 osteoblast differentiation <1e-30
GO:0001816 cytokine production <1e-30
GO:0001817 regulation of cytokine production <1e-30
GO:0001818 negative regulation of cytokine production <1e-30
GO:0002237 response to molecule of bacterial origin <1e-30
GO:0002682 regulation of immune system process <1e-30
GO:0002683 negative regulation of immune system process <1e-30
GO:0002761 regulation of myeloid leukocyte differentiation <1e-30

Example 3 - Taxonomic tree visualisation

The taxonomic data obtained using the OmaDB package can easily be plugged into ggtree 13 for phylogenetic tree visualisation. First, the tree is obtained using the getTaxonomy() function. In this example, the tree is rooted at the Hominoidea taxonomic level. The default format of the object returned is newick.

tax <- getTaxonomy(root ='Hominoidea')

The resultant object can directly be used to build a phylogenetic tree using the ggtree package as below:

library(ggtree)
tree <- getTree(tax$newick)

mytree <- ggtree(tree)

The tree can be further annotated using species silhouettes from PhyloPic ( http://phylopic.org/). This functionality is already enabled within the ggtree package and just requires obtaining the relevant image codes. The workflow to produce Figure 2 is below.

library(rphylopic)

labels <- tree$tip.label

labelsFormatted <- sapply(labels, FUN = function(x)
           gsub("_"," ", x, fixed = TRUE))

ids <- sapply(labelsFormatted, FUN = function(x)         
           name_search(x)$canonicalName[1,1])

images <- sapply( as.character(ids), FUN = function(x)  
           tryCatch(name_images(x)$same[[1]]$uid, error = 
           function(w) name_images(x)$supertaxa[[1]]$uid) )

d <- data.frame(label = labels, images = as.character(images))

library(dplyr)
library(ggimage)
mytree %<+% d + geom_tiplab(aes(image = images), geom ='phylopic', 
    offset = 2.3, color ='steelblue') + geom_tiplab(offset = 0.3)    
    + ggplot2::xlim(0, 7)

Figure 2. Species taxonomy tree obtained using example 3.

Figure 2.

Example 4 - Visualising the distribution of PAM distances in the taxonomic space

To obtain all orthologous pairs between two genomes, we can use the getGenomePairs() function. To limit server load, the resultant response is paginated and by default only returns the first page, capped at 100 entries. This is easily adjustable by setting the ‘per_page’ parameter to either the number of orthologs required or simply to ‘all’.

In this example, we compare the distribution of PAM distances (Point accepted mutations; 27) between orthologs of two species-pairs, namely human-dog and human-mouse. First, we request the required data:

mouse_id = getGenome(id='Mus musculus')$taxon_id
human_id = getGenome(id='Homo sapiens')$taxon_id
dog_id = getGenome(id='Canis lupus familiaris')$taxon_id

human_mouse <- getGenomePairs(genome_id1 = human_id, 
    genome_id2 = mouse_id, rel_type ='1:1')

human_dog <- getGenomePairs(genome_id1 = human_id, 
    genome_id2 = dog_id, rel_type ='1:1')

We can then bind the two resultant data frames and plot the results ( Figure 3), as so:

human_mouse$Species <-'Mus musculus'
human_dog$Species <-'Canis lupus familiaris'

all_pairs <- rbind(human_mouse, human_dog)
all_pairs$Species <- as.factor(all_pairs$Species)

library(ggplot2)

g <- ggplot(all_pairs, aes(x =distance, fill = Species)) +
    geom_density(alpha = 0.5) + 
    xlab('evolutionary distance [PAM]') +
    theme(legend.position ='bottom', panel.grid.major = 
    element_blank(), panel.grid.minor = element_blank(),
    panel.background = element_blank(), axis.line = element_line(colour 
    ='black'))
print(g)

Figure 3. Distribution of evolutionary distances (in PAM units; 27) human-dog (red) and human-mouse (blue) pairs, obtained using example 4.

Figure 3.

The two-sample Kolmogorov-Smirnov test can be performed on the two distributions, using the command:

ks.test(human_dog$distance, human_mouse$distance)

This returns p-value < 2.2e-16. The median distance between dog and human is shorter than that of mouse and human (8.8 vs. 11.8). This is consistent with previous observations that the rodent has a longer branch than humans and carnivores, in part due to their shorter generation time 28.

Example 5 - Annotating protein sequences not present in OMA

Although the OMA database currently analyses over 2,100 genomes, many more have been sequenced, and the gap keeps on widening. It is nevertheless possible to use OMA to infer the function of custom protein sequences through a fast approximate search against all sequences in OMA 4.

# Our mystery sequence is cystic fibrosis transmembrane conductance
# regulator in the Emperor penguin (UniProt ID: A0A087RGQ1_APTFO)
mysterySeq <-
'FFFLLRWTKPILRKGYRRRLELSDIYQIPSADSADNLSEKLEREWDRELATSKKKPKLINALRRCFFWKFM
FYGIILYLGEVTKSVQPLLLGRIIASYDPDNSDERSIAYYLAIGLCLLFLVRTLLIHPAIFGLHHIGMQMRI
AMFSLIYKKILKLSSRVLDKISTGQLVSLLSNNLNKFDEGLALAHFVWIAPLQVALLMGLLWDMLEASAFSG
LAFLIVLAFFQAWLGQRMMKYRNKRAGKINERLVITSEIIENIQSVKAYCWEDAMEKMIESIRETELKLTRK
AAYVRYFNSSAFFFSGFFVVFLAVLPYAVIKGIILRKIFTTISFCIVLRMTVTRQFPGSVQTWYDSIGAINK
IQDFLLKKEYKSLEYNLTTTGVELDKVTAFWDEGIGELFVKANQENNNSKAPSTDNNLFFSNFPLHASPVLQ
DINFKIEKGQLLAVSGSTGAGKTSLLMLIMGELEPSQGRLKHSGRISFSPQVSWIMPGTIKENIIFGVSYDE
YRYKSVIKACQLEEDISKFPDKDYTVLGDGGIILSGGQRARISLARAVYKDADLYLLDSPFGHLDIFTEKEI
FESCVCKLMANKTRILVTSKLEHLKIADKILILHEGSCYFYGTFSELQGQRPDFSSELMGFDSFDQFSAERR
NSILTETLRRFSIEGEGTGSRNEIKKQSFKQTSDFNDKRKNSIIINPLNASRKFSVVQRNGMQVNGIEDGHN
DPPERRFSLVPDLEQGDVGLLRSSMLNTDHILQGRRRQSVLNLMTGTSVNYGPNFSKKGSTTFRKMSMVPQT
NLSSEIDIYTRRLSRDSVLDITDEINEEDLKECFTDDAESMGTVTTWNTYFRYVTIHKNLIFVLILCVTVFL
VEVAASLAGLWFLKQTALKANTTQSENSTSDKPPVIVTVTSSYYIIYIYVGVADTLLAMGIFRGLPLVHTLI
TVSKTLHQKMVHAVLHAPMSTFNSWKAGGMLNRFSKDTAVLDDLLPLTVFDFIQLILIVIGAITVVSILQPY
IFLASVPVIAAFILLRAYFLHTSQQLKQLESEARSPIFTHLVTSLKGLWTLRAFGRQPYFETLFHKALNLHT
ANWFLYLSTLRWFQMRIEMIFVVFFVAVAFISIVTTGDGSGKVGIILTLAMNIMGTLQWAVNSSIDVDSLMR
SVGRIFKFIDMPTEEMKNIKPHKNNQFSDALVIENRHAKEEKNWPSGGQMTVKDLTAKYSEGGAAVLENISF
SISSGQRVGLLGRTGSGKSTLLFAFLRLLNTEGDIQIDGVSWSTVSVQQWRKAFGVIPQKVFIFSGTFRMNL
DPYGQWNDEEIWKVAEEVGLKSVIEQFPGQLDFVLVDGGCVLSHGHKQLMCLARSVLSKAKILLLDEPSAHL
DPVTSQVIRKTLKHAFANCTVILSEHRLEAMLECQRFLVIEDNKLRQYESIQKLLNEKSSFRQAISHADRLK
LLPVHHRNSSKRKPRPKITALQEETEEEVQETRL'
myAnnotations <- annotateSequence(mysterySeq)

This results in 54 GO annotations. By comparison, this sequence has merely 15 GO annotations in UniProt-GOA 29 — all of which are also predicted by this method in OMA.

Example 6 - Combining OmaDB with BgeeDB for gene expression

We go back to the lactotransferrin gene family from Example 2. We can use OmaDB in conjunction with the BgeeDB Bioconductor package 30 to retrieve expression data from the Bgee database 31 as follows.

BiocManager::install("BgeeDB")
library(BgeeDB)

# Bgee uses Ensembl gene IDs, obtainable using OmaDB’s cross-references.
trfl_xrefs <- getProtein(id='TRFL_HUMAN')$xref
trfl_ens_id <- subset(trfl_xrefs, source =='Ensembl Gene')$xref
# The Ensembl gene IDs need to be without version suffix
trfl_ens_id <- strsplit(trfl_ens_id,'.',fixed=TRUE)[[1]][1]

my_stage <-'UBERON:0034920'# Infant stage
bgee.expr <- Bgee$new(species='Homo_sapiens')
expr.data <- loadTopAnatData(bgee.expr, stage = my_stage)
gene.expr.tissue.ids <- 
    unlist(expr.data$gene2anatomy[trfl_ens_id], use.names = F)
tissues <- expr.data$organ.names
print(tissues[tissues$ID %in% gene.expr.tissue.ids, ])

Among the tissues in which lactotransferrin is expressed according to Bgee ( Table 2), we note the bone marrow and the palpebral conjunctiva (the eyelid inner surface). This is consistent with the aforementioned involvement of lactotransferrin in bone formation and anti-microbial activity.

Table 2. Human tissues in which lactotransferrin is expressed in infant stage, according to the Bgee database version 14 (output of Example 6).

ID Name
UBERON:0001812 palpebral conjunctiva
UBERON:0000178 blood
UBERON:0002371 bone marrow
UBERON:0001154 vermiform appendix
UBERON:0002084 heart left ventricle

Further tutorials on the OmaDB package can be found in the accompanying vignettes:

browseVignettes('OmaDB')

Discussion and outlook

Orthology is used for various purposes, such as species tree inference, gene evolution dynamic, or protein function prediction. The retrieval of orthologs is thus typically just the starting point of a larger analysis. Therefore, this overhaul and expansion of the OMA programmatic interface will facilitate the incorporation of OMA data in such larger analyses.

Our R package will continue to be maintained in line with the biannual Bioconductor releases. Further work to improve the package includes improvement in performance. For example, the responses are currently fully loaded into an R object of choice which, depending on the response size, may create some time lag in the response. We will also continue to update the package and the API in sync with the OMA browser to incorporate new functionalities of OMA.

Likewise, we will also maintain and further develop the Python package. In particular, we will explore the possibility of further integration with the BioPython library 32.

More generally, in OMA we will keep supporting the various ways of accessing the underlying data, including the interactive web browser and flat files in a variety of formats. The REST API is also complemented by a new SPARQL interface that enables highly specific queries, as well as federated queries over multiple resources 4. However, the query language is more complex.

We very much welcome feedback and questions from the community. We also highly appreciate contributions to the code in the form of pull requests. Our preferred channel for support is the BioStar website 33, where we monitor all posts with keyword “oma”.

Software availability

Please note that this manuscript uses version 2.0 of the OmaDB R package, which is in the development version of Bioconductor (v.3.9). Until the release of Bioconductor v.3.9 in Spring 2019, there are two possible ways of installing it:

  • 1)

    Install the development version of R (v.3.6) — required for Bioconductor v.3.9 — and install OmaDB using the command:

    BiocManager::install('OmaDB', version ='devel')
    –or–
  • 2)

    Install OmaDB 2.0 directly from the github repo using the devtools R package:

    install.packages('devtools')
    library(devtools)
    install_github('dessimozlab/omadb')

REST API available from: https://omabrowser.org/api

Documentation available from: https://omabrowser.org/api/docs

R OmaDB package available from: http://bioconductor.org/packages/OmaDB/

Source code available from: https://github.com/DessimozLab/OmaDB/

Archived source code as at time of publication: http://doi.org/10.5281/zenodo.2595086 34

License: GPL-2

omadb Python package available from: https://pypi.org/project/omadb/

Source code available from: https://github.com/DessimozLab/pyomadb/

Archived source code as at time of publication: http://doi.org/10.5281/zenodo.2530250 35

License: GPL-3

We also provide a binder to reproduce in Python the analyses done in R. This is available from: https://mybinder.org/v2/gh/DessimozLab/pyomadb/master?filepath=examples%2Fpyomadb-examples.ipynb

Acknowledgements

We thank Natasha Glover for helpful feedback on the manuscript, and Frédéric Bastian for help on the example involving BgeeDB.

Funding Statement

We acknowledge support by Swiss National Science Foundation grant 150654, UK BBSRC grant BB/M015009/1, the Swiss State Secretariat for Education, Research and Innovation (SERI), as well as a UCL Genetics, Evolution and Environment Departmental Summer Bursary (to KK).

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; peer review: 2 approved]

References

  • 1. Fitch WM: Distinguishing homologous from analogous proteins. Syst Zool. 1970;19(2):99–113. 10.2307/2412448 [DOI] [PubMed] [Google Scholar]
  • 2. Sonnhammer EL, Gabaldón T, Sousa da Silva AW, et al. : Big data and other challenges in the quest for orthologs. Bioinformatics. 2014;30(21):2993–8. 10.1093/bioinformatics/btu492 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Forslund K, Pereira C, Capella-Gutierrez S, et al. : Gearing up to handle the mosaic nature of life in the quest for orthologs. Bioinformatics. 2018;34(2):323–329. 10.1093/bioinformatics/btx542 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Altenhoff AM, Glover NM, Train CM, et al. : The OMA orthology database in 2018: retrieving evolutionary relationships among all domains of life through richer web and programmatic interfaces. Nucleic Acids Res. 2018;46(D1):D477–85. 10.1093/nar/gkx1019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Schmitt T, Messina DN, Schreiber F, et al. : Letter to the editor: SeqXML and OrthoXML: standards for sequence and orthology information. Brief Bioinform. 2011;12(5):485–8. 10.1093/bib/bbr025 [DOI] [PubMed] [Google Scholar]
  • 6. Han MV, Zmasek CM: phyloXML: XML for evolutionary biology and comparative genomics. BMC Bioinformatics. 2009;10:356. 10.1186/1471-2105-10-356 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Huber W, Carey VJ, Gentleman R, et al. : Orchestrating high-throughput genomic analysis with Bioconductor. Nat Methods. 2015;12(2):115–21. 10.1038/nmeth.3252 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Django Software Foundation. Django. [cited 2018]. Reference Source [Google Scholar]
  • 9. Folk M, Heber G, Koziol Q, et al. : An overview of the HDF5 technology suite and its applications. Proceedings of the EDBT. 2011. 10.1145/1966895.1966900 [DOI] [Google Scholar]
  • 10. Altenhoff AM, Gil M, Gonnet GH, et al. : Inferring hierarchical orthologous groups from orthologous gene pairs. PLoS One. 2013;8(1):e53786. 10.1371/journal.pone.0053786 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Alexa A, Rahnenfuhrer J: topGO: Enrichment analysis for Gene Ontology.R package version 2.28.0. Bioconductor2016. 10.18129/B9.bioc.topGO [DOI] [Google Scholar]
  • 12. Pagès H, Aboyoun P, Gentleman R, et al. : Biostrings: Efficient manipulation of biological strings. R Package Version.2017;2(0). Reference Source [Google Scholar]
  • 13. Yu G, Smith DK, Zhu H, et al. : ggtree: an r package for visualization and annotation of phylogenetic trees with their covariates and other associated data.McInerny G editor. Methods Ecol Evol. 2017;8(1):28–36. 10.1111/2041-210X.12628 [DOI] [Google Scholar]
  • 14. Lawrence M, Huber W, Pagès H, et al. : Software for computing and annotating genomic ranges. PLoS Comput Biol. 2013;9(8):e1003118. 10.1371/journal.pcbi.1003118 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. McKinney W: pandas: a foundational Python library for data analysis and statistics. Python for High Performance and Scientific Computing. 2011;1–9. Reference Source [Google Scholar]
  • 16. Train CM, Pignatelli M, Altenhoff A, et al. : iHam & pyHam: visualizing and processing hierarchical orthologous groups. Bioinformatics. 2018. 10.1093/bioinformatics/bty994 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Sukumaran J, Holder MT: DendroPy: a Python library for phylogenetic computing. Bioinformatics. 2010;26(12):1569–71. 10.1093/bioinformatics/btq228 [DOI] [PubMed] [Google Scholar]
  • 18. Huerta-Cepas J, Serra F, Bork P: ETE 3: Reconstruction, Analysis, and Visualization of Phylogenomic Data. Mol Biol Evol. 2016;33(6):1635–8. 10.1093/molbev/msw046 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Klopfenstein DV, Zhang L, Pedersen BS, et al. : GOATOOLS: A Python library for Gene Ontology analyses. Sci Rep. 2018;8(1):10872. 10.1038/s41598-018-28948-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Kluyver T, Ragan-Kelley B, Pérez F, et al. : Jupyter Notebooks-a publishing format for reproducible computational workflows.In: ELPUB2016;87–90. 10.3233/978-1-61499-649-1-87 [DOI] [Google Scholar]
  • 21. Wickham H: httr: Tools for Working with URLs and HTTP.2018. Reference Source [Google Scholar]
  • 22. Lambert LA, Perri H, Meehan TJ: Evolution of duplications in the transferrin family of proteins. Comp Biochem Physiol B Biochem Mol Biol. 2005;140(1):11–25. 10.1016/j.cbpc.2004.09.012 [DOI] [PubMed] [Google Scholar]
  • 23. Ashburner M, Ball CA, Blake JA, et al. : Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat Genet. 2000;25(1):25–9. 10.1038/75556 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Gaudet P, Dessimoz C: Gene Ontology: Pitfalls, Biases, and Remedies. Methods Mol Biol.In: Dessimoz C, Škunca N, editors. The Gene Ontology Handbook. New York, NY: Springer New York;2017;1446:189–205. 10.1007/978-1-4939-3743-1_14 [DOI] [PubMed] [Google Scholar]
  • 25. Naot D, Grey A, Reid IR, et al. : Lactoferrin--a novel bone growth factor. Clin Med Res. 2005;3(2):93–101. 10.3121/cmr.3.2.93 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Orsi N: The antimicrobial activity of lactoferrin: current status and perspectives. Biometals. 2004;17(3):189–96. 10.1023/B:BIOM.0000027691.86757.e2 [DOI] [PubMed] [Google Scholar]
  • 27. Dayhoff MO, Schwartz RM, Orcutt BC: A model of evolutionary change in proteins.In: Atlas of Protein Sequence and Structure1978;345–52. Reference Source [Google Scholar]
  • 28. Easteal S: Generation time and the rate of molecular evolution. Mol Biol Evol. 1985;2(5):450–3. 10.1093/oxfordjournals.molbev.a040361 [DOI] [PubMed] [Google Scholar]
  • 29. Huntley RP, Sawford T, Mutowo-Meullenet P, et al. : The GOA database: gene Ontology annotation updates for 2015. Nucleic Acids Res. 2015;43(Database issue):D1057–63. 10.1093/nar/gku1113 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Komljenovic A, Roux J, Wollbrett J, et al. : BgeeDB, an R package for retrieval of curated expression datasets and for gene list expression localization enrichment tests [version 2; referees: 2 approved, 1 approved with reservations]. F1000Res. 2016;5:2748. 10.12688/f1000research.9973.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Bastian F, Parmentier G, Roux J, et al. : Bgee: Integrating and Comparing Heterogeneous Transcriptome Data Among Species.In: Data Integration in the Life Sciences (Lecture Notes in Computer Science). Springer Berlin Heidelberg.2008;124–31. 10.1007/978-3-540-69828-9_12 [DOI] [Google Scholar]
  • 32. Cock PJ, Antao T, Chang JT, et al. : Biopython: freely available Python tools for computational molecular biology and bioinformatics. Bioinformatics. 2009;25(11):1422–3. 10.1093/bioinformatics/btp163 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Parnell LD, Lindenbaum P, Shameer K, et al. : BioStar: an online question & answer resource for the bioinformatics community. PLoS Comput Biol. 2011;7(10):e1002216. 10.1371/journal.pcbi.1002216 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. klarakaleb, Altenhoff A, bioc-gitadmin, et al. : DessimozLab/OmaDB: v1.99.1 (Version 1.99.2). Zenodo. 2019. 10.5281/zenodo.2595086 [DOI] [Google Scholar]
  • 35. Alex WV, Altenhoff A: DessimozLab/pyomadb: v2.0.0 (Version 2.0.0). Zenodo. 2019. 10.5281/zenodo.2530250 [DOI] [Google Scholar]
F1000Res. 2019 Apr 12. doi: 10.5256/f1000research.20395.r46493

Reviewer response for version 2

Laurent Gatto 1

Thank you very much to the authors for their detailed reply, carefully addressing all my points and suggestions.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

F1000Res. 2019 Apr 1. doi: 10.5256/f1000research.20395.r46494

Reviewer response for version 2

Bastian Greshake Tzovaras 1, Ngoc-Vinh Tran 2

The authors have successfully addressed all prior comments.

We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

F1000Res. 2019 Feb 11. doi: 10.5256/f1000research.19190.r42908

Reviewer response for version 1

Laurent Gatto 1

Kaleb et al. present two packages, namely R/Bioconductor OmoDB and python omadb, that allow users to query and use data from the Orthologous Matrix database. The article is well written and the authors provide 6 examples that convincingly demonstrate the usefulness and reach of their work.

I have a couple of comments and suggestions below, presented in chronological order. The only serious one is a request for the authors to describe the outputs in their examples a bit more (see below for details), to facilitate the adoption for users that wouldn't be familiar with R.

  • In https://omabrowser.org/api/docs, the pagination example has a typo. The genomes should be replaced with genome:

```

$ "https://omabrowser.org/api/genomes/?page=2"

HTTP/1.1 404 Not Found

Server: nginx

Date: Mon, 11 Feb 2019 06:04:30 GMT

Content-Type: text/html; charset=utf-8

Connection: keep-alive

X-Frame-Options: SAMEORIGIN

Vary: Cookie

Set-Cookie: __utmmobile=d41d8cd98f00b204e9800998ecf8427e; expires=Wed, 10-Feb-2021 06:04:30 UTC; Path=/

Set-Cookie: sessionid=9zb42ljib7apkubml1e1t742i5p6f3a6; expires=Mon, 25-Feb-2019 06:04:30 GMT; HttpOnly; Max-Age=1209600; Path=/

$ curl -I "https://omabrowser.org/api/genome/?page=2"

HTTP/1.1 200 OK

Server: nginx

Date: Mon, 11 Feb 2019 06:04:32 GMT

Content-Type: application/json

Connection: keep-alive

Link: ; rel="first", ; rel="prev", ; rel="next", ; rel="last"

X-Total-Count: 2198

Vary: Accept, Cookie

Allow: GET, HEAD, OPTIONS

X-Frame-Options: SAMEORIGIN

Set-Cookie: __utmmobile=d41d8cd98f00b204e9800998ecf8427e; expires=Wed, 10-Feb-2021 06:04:32 UTC; Path=/

Set-Cookie: sessionid=9h5n3ouuwvh4ock9dz3q4yiprmb8iw0d; expires=Mon, 25-Feb-2019 06:04:32 GMT; HttpOnly; Max-Age=1209600; Path=/

Strict-Transport-Security: max-age=15768000

```

  • In the introduction, the authors explain that 'Most data available through the OMA browser is now accessible via the API'. I think it would be useful to know what data isn't available and whether the browser and REST API would ever be equivalent in terms of data served. This might be partly addressed later, in the discussion, where the authors mention 'support for local synteny'. Some additional details would be useful to redirect users to the appropriate interface. Similarly, it would be useful to know if the R and python packages provide access to the same data, or if differences also exist there.

  • I didn't see mention of the R and python packages on the OmaDB web page. This would be a useful addition for visitors.

  • In the Bioconductor package section, the authors explain that data is provided in 'R friendly objects, namely S3 objects and data frames'. I would suggest to rephrase this and only refer to objects, as S4 objects are also returned and the nature of the technical class system is probably not necessary in the frame of this document.

  • Regarding the R package, I would suggest to add URL and BugReports fields in the packages DESCRIPTION file. This helps users find the GitHub repository and report issues. I also noted that in the 'getting started' vignette, it looks like some section a missing a space after the section markup. I have send a pull request fixing these and some other minor issue.

  • Note that the html and R version of the vignette shouldn't be included in the package source.

  • In the python package section, the authors mention that this package is also named 'omadb'. I would argue that the packages have different names, as programming languages are case sensitive and suggest to drop the also to avoid any confusion.

  • In the first sentence of the result section, authors should replace R library by R package, as they are referring to their package, not the location where the package is being installed (the library).

  • In general, it would be very useful for the authors to describe the different outputs they have. I am not expecting the authors to provide full details of the REST API responses, but describing how the results match the text would be important. For example, in example 1, they only show how to produce the `response_content_list` response. Here, it would be useful to explain that this R list directly maps the REST json message, and point to the specific documentation entry point. Such an explanation motivates the example in the text and helps users, that aren't familiar with REST, to understand the relation between the server and the package.

  • Similarly in example 2, the authors create the `seq_annotation` variable and mention that only one target sequence was identified. Here, it would be useful to show that `length(seq_annotation$targets)` is equal to 1, to back their claim, to indicate how users can verify the number of targets, and motivate the use of the first list index in later code chunks.

  • Still in example 2, the authors query and extract the hog members. These data are however already present in the first output of that example, under `seq_annotation$targets[[1]]$oma_hog_members`. It would be useful to explain why the authors send a second query to obtain that data and clarify whether `oma_hog_members` is always equivalent to calling `getHOG` and `getProtein`.

  • When trying to reproduce the code, I first failed to run the code chunks calling `getProtein`. Later, the authors clarify the software requirements in more details. It would however be useful to briefly mention, early on in the Results section, what version was used for the examples.

  • In example 5, I would suggest to update to new function name, as `getAnnotations` is expected to be deprecated in the next release, especially as the new version of the package is anyway required for the `getProtein` function.

```

> myAnnotations <- getAnnotation(mysterySeq)

Warning message:

'getAnnotation' is deprecated.

Use 'annotateSequence' instead.

See help("Deprecated")

```

  • Another example where an explanation of the output is important is example 5. The authors call `myAnnotation <- getAnnotations(mysterySeq)` and then refer to 54 GO annotation results. In repeating their analysis, I obtain a data frame with 55 observations (see below). It is this unclear whether I have a different result, if one observation should be dropped, or if my output is completely wrong (was I even expecting a data frame?).

```

> dim(myAnnotations)

[1] 55 13

```

  • In general, given the nature of the package, i.e. that it accesses an online repository that is (or can be) updated regularly, results may change, this also explaining why I may have different results.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

F1000Res. 2019 Mar 19.
Christophe Dessimoz 1

In https://omabrowser.org/api/docs, the pagination example has a typo. The genomes should be replaced with genome .

RESPONSE: Thanks for spotting this typo. It has been fixed.

In the introduction, the authors explain that 'Most data available through the OMA browser is now accessible via the API'. I think it would be useful to know what data isn't available and whether the browser and REST API would ever be equivalent in terms of data served. This might be partly addressed later, in the discussion, where the authors mention 'support for local synteny'. Some additional details would be useful to redirect users to the appropriate interface. Similarly, it would be useful to know if the R and python packages provide access to the same data, or if differences also exist there.

RESPONSE: As mentioned in the Discussion, the package currently lacks availability of the data on local synteny, mainly due to the complexity of the data representation in the API format.  We aim to bridge this gap in the next release. We have now amended the Methods section to reflect the difference between OMA browser and the API more explicitly, as well as the discussion to reassure the users the API and OMA browser will be kept in sync with further OMA developments.

Both R and Python packages use the same API and supply the same data.

I didn't see mention of the R and python packages on the OmaDB web page. This would be a useful addition for visitors.    

RESPONSE: We already had a link to the R package in the /api/docs, but we have now also included link directly from the "compute" menu.

In the Bioconductor package section, the authors explain that data is provided in 'R friendly objects, namely S3 objects and data frames'. I would suggest to rephrase this and only refer to objects, as S4 objects are also returned and the nature of the technical class system is probably not necessary in the frame of this document.    

RESPONSE: This has now been amended.

Regarding the R package, I would suggest to add URL and BugReports fields in the packages DESCRIPTION file. This helps users find the GitHub repository and report issues. I also noted that in the 'getting started' vignette, it looks like some section a missing a space after the section markup. I have send a pull request fixing these and some other minor issue.

RESPONSE: Thank you for the pull request, this has now been merged with OmaDB  version 2.0.

Note that the html and R version of the vignette shouldn't be included in the package source.

RESPONSE: This has now been amended.

In the python package section, the authors mention that this package is also named ' omadb '. I would argue that the packages have different names, as programming languages are case sensitive and suggest to drop the also to avoid any confusion.

RESPONSE: Amended as requested.

In the first sentence of the result section, authors should replace R library by R package, as they are referring to their package, not the location where the package is being installed (the library).

RESPONSE: This has now been amended.

In general, it would be very useful for the authors to describe the different outputs they have. I am not expecting the authors to provide full details of the REST API responses, but describing how the results match the text would be important. For example, in example 1, they only show how to produce the `response_content_list` response. Here, it would be useful to explain that this R list directly maps the REST json message, and point to the specific documentation entry point. Such an explanation motivates the example in the text and helps users, that aren't familiar with REST, to understand the relation between the server and the package.

RESPONSE: We agree, and further information on the output generated in the manuscript has now been added to example 1.

Similarly in example 2, the authors create the `seq_annotation` variable and mention that only one target sequence was identified. Here, it would be useful to show that `length(seq_annotation$targets)` is equal to 1, to back their claim, to indicate how users can verify the number of targets, and motivate the use of the first list index in later code chunks.

RESPONSE: This has now been updated.

Still in example 2, the authors query and extract the hog members. These data are however already present in the first output of that example, under `seq_annotation$targets[[1]]$oma_hog_members`. It would be useful to explain why the authors send a second query to obtain that data and clarify whether `oma_hog_members` is always equivalent to calling `getHOG` and `getProtein`.

RESPONSE: It is true that the hog members can also be directly accessed via the oma_hog_members attribute. However, the members are only loaded once the attribute is accessed, so we do not add unnecessary requests. Even more importantly, if we would load the hog members via the oma_hog_members attribute, it is not obvious for which taxonomic level the members are loaded. We therefore prefer to keep the current slightly more verbose way to access the data.

When trying to reproduce the code, I first failed to run the code chunks calling `getProtein`. Later, the authors clarify the software requirements in more details. It would however be useful to briefly mention, early on in the Results section, what version was used for the examples.

RESPONSE: We agree that this can be confusing, and we have now amended the Methods and the Results section to explicitly mention the usage of OmaDB v2.0 for the examples.

In example 5, I would suggest to update to new function name, as `getAnnotations` is expected to be deprecated in the next release, especially as the new version of the package is anyway required for the `getProtein` function.

RESPONSE: This was a mistake on our side and has now been amended.

Another example where an explanation of the output is important is example 5. The authors call `myAnnotation <- getAnnotations(mysterySeq)` and then refer to 54 GO annotation results. In repeating their analysis, I obtain a data frame with 55 observations (see below). It is this unclear whether I have a different result, if one observation should be dropped, or if my output is completely wrong (was I even expecting a data frame?).    In general, given the nature of the package, i.e. that it accesses an online repository that is (or can be) updated regularly, results may change, this also explaining why I may have different results.

RESPONSE: We can confirm that this is due to the December 2018 OMA release, where there are indeed 55 results returned for that particular query. The fact that the results may vary due to the continued updates of the OMA database has now been explicitly mentioned in the beginning of the methods section of the manuscript. We have also added what version of the database was used to generate the examples in the manuscript.

F1000Res. 2019 Feb 5. doi: 10.5256/f1000research.19190.r42912

Reviewer response for version 1

Bastian Greshake Tzovaras 1, Ngoc-Vinh Tran 2

The authors describe a new REST API as an interface to the well-established Orthologous Matrix database. As identifying and evaluating orthologs is a central step in many biological analyses, an easy way to query the over 2,100 species in OMA is highly valuable. To further facilitate querying the data through their API, the authors present packages for R and Python. The API is well documented on the OMA website and the R package comes with vignettes describing different use cases. The manuscript presented here focuses on the OmaDB R-package and showcases some of its functions.

Being somewhat "ahead of it's time", the R package as described in the manuscript requires both the development version of R (v3.6) and Bioconductor (v3.9). The package installation instructions at the beginning of the manuscript only glances over it, more complete instructions are only found in the Software availability section at the end.

We recommend including more explicit warnings/instructions about the required versions at the beginning, otherwise potential users might be confused when trying to follow along with the examples given in the manuscript (As happened to us and it took us some time to figure out what's going on).

While the Python package is not extensively discussed in this manuscript, the authors provide a Binder that can be used to reproduce the same analyses using Python. We recommend putting a link to it ( https://mybinder.org/v2/gh/DessimozLab/pyomadb/master?filepath=examples%2Fpyomadb-examples.ipynb) in the manuscript, to help users with taking up the Python library.

We welcome the switch from the SOAP API to a more modern REST implementation and the provided packages to interface with the API will be valuable for a lot of researchers working with orthologs.

We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

F1000Res. 2019 Mar 19.
Christophe Dessimoz 1

  1. Being somewhat "ahead of its time", the R package as described in the manuscript requires both the development version of R (v3.6) and Bioconductor (v3.9). The package installation instructions at the beginning of the manuscript only glances over it, more complete instructions are only found in the Software availability section at the end.

    We recommend including more explicit warnings/instructions about the required versions at the beginning, otherwise potential users might be confused when trying to follow along with the examples given in the manuscript (As happened to us and it took us some time to figure out what's going on).

RESPONSE: We agree that this might cause confusion and we have now updated the OmaDB package section in Methods to mention explicitly that the package version used in the manuscript is 2.0, which until April 2019 is in the development version of Bioconductor. We also point the readers to the Software Availability section where further instructions for package installation are provided. We are hesitant to amend the package installation instructions at the beginning of the manuscript to reflect this as it will change shortly.

  1. While the Python package is not extensively discussed in this manuscript, the authors provide a Binder that can be used to reproduce the same analyses using Python. We recommend putting a link to it (https://mybinder.org/v2/gh/DessimozLab/pyomadb/master?filepath=examples%2Fpyomadb-examples.ipynb) in the manuscript, to help users with taking up the Python library.

    RESPONSE: This has now been added.


Articles from F1000Research are provided here courtesy of F1000 Research Ltd

RESOURCES