Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2020 Dec 17;10:22165. doi: 10.1038/s41598-020-78469-x

Cerina: systematic circRNA functional annotation based on integrative analysis of ceRNA interactions

Jacob Cardenas 1,#, Uthra Balaji 1,#, Jinghua Gu 1,
PMCID: PMC7746713  PMID: 33335165

Abstract

Circular RNAs, a family of covalently circularized RNAs with tissue-specific expression, were recently demonstrated to play important roles in mammalian biology. Regardless of extensive research to predict, quantify, and annotate circRNAs, our understanding of their functions is still in its infancy. In this study, we developed a novel computational tool: Competing Endogenous RNA for INtegrative Annotations (Cerina), to predict biological functions of circRNAs based on the competing endogenous RNA model. Pareto Frontier Analysis was employed to integrate ENCODE mRNA/miRNA data with predicted microRNA response elements to prioritize tissue-specific ceRNA interactions. Using data from several circRNA-disease databases, we demonstrated that Cerina significantly improved the functional relevance of the prioritized ceRNA interactions by several folds, in terms of precision and recall. Proof-of-concept studies on human cancers and cardiovascular diseases further showcased the efficacy of Cerina on predicting potential circRNA functions in human diseases.

Subject terms: Data integration, Databases

Introduction

Circular RNAs (circRNAs) are a family of RNAs that form circular structures by joining the 3′ and 5′ ends covalently. Although originally considered as by-products of “splicing noise”1,2, researchers have recently discovered that circRNAs play important roles in human diseases, including cancers, neurological diseases, heart and vascular diseases, among many others. CircRNAs are highly stable and display tissue-specific expression patterns, making them promising candidates as disease biomarkers37.

Despite the rapid growth in cataloging new circRNAs, their biological functions in human diseases are yet largely unknown. Among many putative mechanisms, such as interaction with RNA binding proteins (RBP), alternative splicing competition, posttranscriptional gene regulation, and protein coding, one of the most well-studied circRNA functions is to act as the competing endogenous RNA (ceRNA) or miRNA “sponge”3,713. In the ceRNA model14,15, linear RNAs and circRNAs competitively interact with miRNAs through miRNA response elements (MREs) to leverage the amount of active miRNAs in a cell, which has been extensively demonstrated in a variety of diseases6,16,17. One notable ceRNA examples is CDR1as, a brain-enriched circRNA that is found to function as miRNA sponge for miR-718,19 in various human diseases, including colon cancer20, gastric cancer21, esophageal cancer22, and myocardial infarction23. A number of other ceRNA interactions have also been uncovered in cancer, such as circPVT1-miR125 in gastric cancer24, circITCH-miR7/miR214 in lung cancer25, circHIPK3-miR124 in liver cancer26, and circTTBK2-miR217 in glioma27. Other than cancer, the role of circRNA as microRNA sponge is also under heavy investigation in cardiovascular diseases28,29. In addition to beforementioned CDR1as-miR7 interaction in myocardial infarction, new theories have emerged hypothesizing the involvement of various circRNAs in multiple cardiovascular diseases through sequestration of miRNAs, exampled by CircRNA_081881-miR54830 and MFCAR-miR65231 interactions in ischemia/reperfusion injury and myocardial infarction, sponging effect and therapeutic potential of circRNA_000203 and cirRNA_010567 in cardiac fibrosis32,33, and protective effect of circRNA HRCR against hypotrophy and heart failure by sequestering miR22334. It was also reported that regulation of disordered vascular smooth muscle cell proliferation and migration through the circWDR77-miR124-FGF2 axis was vital in atherosclerosis pathogenesis35. In neurological disease research, in addition to the prominent role of CDR1as-miR7 sponging events in Alzheimer’s disease36,37, hundreds of circRNA were recently identified from multiple high-throughput studies to investigate circRNA-miRNA-mRNA interactions related to AD pathogenesis38,39.

Recently, there has been a surge of interest in annotating circRNA functions. Databases such as CircInteractome40, CircAtlas41, Circ2Traits42, CircNet43, TSCD44, CSCD45, and Circbank46, among others, have collected predicted MRE sites to bridge individual circRNAs to their potential functions through miRNAs. Some of these resources also report circRNA-interacting RBPs, due to their roles in circRNA formation, translation, targeted gene regulation, and transport47. Additionally, Circ2Traits annotated circRNAs that harbored disease-related single nucleotide polymorphisms (SNPs) as putative evidence for circRNA-disease associations42. CircRNADb compiled detailed information regarding internal ribosomal entry site (IRES) and open reading frame (ORF) to implicate possible protein-coding potential of circRNAs48. Recently, CircFunBase has reported a collection of more than 7,000 manually curated circRNAs on 15 different species, which is among the first to systematically summarize circRNA functions based on circRNA differential expression data49.

Amid the existing efforts to annotate individual circRNAs and their potential functions, tools for systematic circRNA functional annotation and pathway analysis are still lacking. In this work, we developed a novel computational tool for circRNA functional analysis: Competing Endogenous RNA for INtegrative Annotations (Cerina). As the first statistical method for systematic circRNA functional analysis, Cerina has several major technical advances. Firstly, Cerina paired up circRNA, linear RNA, and miRNA expression data for 11 human organs from ENCODE50 and jointly analyzed them for the first time, allowing comprehensive pan-tissue profiling of ceRNA expressions. Secondly, expression and binding data for ceRNAs are integrated and prioritized based on the principles of Pareto optimality, which further increased the biological relevance of predicted ceRNA interactions. Finally, a user-friendly, web-based interface is made available for users to query a circRNA and retrieve its interacting miRNAs, their significant target genes, and the enriched biological functions and pathways.

Methods

Processing of sequencing data

29 total RNA-Seq samples and 39 miRNA-Seq samples from 11 ENCODE tissues were analyzed in this study (Supplementary Table S1). Fastq files from replicate samples were merged before downstream analysis.

ENCODE total RNA-Seq data (linear RNA)

Sequencing quality control of ENCODE total RNA-Seq data were performed by FastQC (https://www.bioinformatics.babraham.ac.uk/projects/fastqc/). Adapter sequences were trimmed and low-quality reads (< 20) were filtered using cutadapt51. Reads from total RNA sequencing were aligned to human genome (hg19/GRCh37) using hisat252 and converted to BAM format using samtools53. The featureCounts54 tool was used to assign reads to each gene in the GENCODE55 GTF file (https://www.gencodegenes.org/human/release_19.html). Counts from the total RNA-Seq pipeline were used to approximate linear RNA gene expression. After filtering out low-expressing genes (total read counts < 10), DESeq256 was used for count data normalization. A final layer of filtering was applied by removing genes with mean normalized counts less than 10. Counts per million (CPM) is used to report and visualize mRNA expression levels.

ENCODE total RNA-Seq data (circular RNA)

We used back-splicing (BS) junction reads to approximate circRNA gene expression from ENCODE total RNA-Seq data. It was previously reported that individual circRNA detection method suffered from high false positives in BS junction prediction, yet combining results from two different algorithms (i.e., intersection) is a simple and effective remedy to significantly reduce false positives57. In a recent review paper58 comparing a dozen circRNA detection algorithms, CIRI259,60 and CIRCexplorer61 demonstrated their best overall performance in terms of accuracy and efficiency based on the simulated and real RNaseR + data sets. Hence, we developed a framework that combines predictions from both CIRI2 and CIRCexplorer to improve the specificity of circRNA detection (Supplementary Methods). Spliced reads per billion mapped reads (SRPBM) is used to report and visualize circRNA expression levels.

ENCODE miRNA-Seq

The extra-cellular RNA processing toolkit (exceRpt)62 was used to process ENCODE miRNA sequencing data. Firstly, exceRpt filtered reads were mapped to UniVec vectors and ribosomal RNA sequences, followed by alignment of the remaining reads to the human genome (hg19) and then quantified for different types of RNAs, including miRNAs. The same normalization and filtering criteria were applied to process ENCODE miRNA data. CPM is used to report and visualize miRNA expression levels.

Prediction of miRNA binding sites on linear/circular RNA

Among a total of 33,461 confidently detected circRNA from ENCODE total RNA-Seq data, 30,282 had mature sequences (hg19) from circAtlas41 available for download at http://159.226.67.237/zhao/Data/circAtlas_supply/human_sequence_v1909.txt.zip. Mature sequences of novel circRNAs were estimated using a hierarchical framework described in the Supplementary Methods.

Perl script from TargetScan 7.163 was used to identify MREs based on circRNA mature sequences. For each circRNA, the number of MREs was normalized by the length of its mature splice sequence and defined as the circRNA-miRNA binding scores SMREcirc|mir.

miRNA-gene (i.e., linear RNA) binding data were download from TargetScan 7.2 (http://www.targetscan.org/vert_72/vert_72_data_download/Conserved_Family_Info.txt.zip, http://www.targetscan.org/vert_72/vert_72_data_download/Nonconserved_Family_Info.txt.zip) and used to form miRNA-gene scores, SMREmir|gene. In addition to TargetScan, miRTarBase 7.064, a curated database of experimentally validated miRNA-target gene interactions (SMTBmir|gene) was used as another component of evidence. For each miRNA-gene pair, the number of MREs from TargetScan and the number of publications from miRTarBase were integrated to obtain the final miRNA-gene binding score (SPmir|gene) based on the Pareto Frontier Analysis described below.

Pan-tissue co-expression analysis

Most existing databases predict circRNA-miRNA interactions solely relying on sequence-based algorithms, which completely ignore tissue-specific expression information of circRNAs41,44,65. In order to form effective ceRNA networks, circRNA and miRNA both need to be expressed in the same tissue. Memczak et al. reported that CDR1as and miR-7 were both highly expressed in brain tissues, but not necessarily in other non-neuronal tissues18, which renders CDR1as a hallmark miR-7 sponge in neuronal tissues. Moreover, Guo et al. further argued that functional miRNA sponges require circRNAs to be expressed at consequential levels in the cell66. Therefore, incorporating circRNA and miRNA expression into ceRNA network analysis can help filter out false positive interactions with low or no expression. To this end, we assigned circRNA-miRNA expression scores Sexpcirc|mir to all interactions by the following methodology. First, for each tissue, circRNAs/miRNAs with no expression are excluded and the ones passed filtering were utilized to calculate the empirical cumulative distribution function (ECDF) on the mean normalized expression, giving rise to tissue-specific circRNA and miRNA ECDF scores, Sexpcirc|tissue and Sexpmir|tissue, that take values on (0, 1]. We then defined circRNA-miRNA score as Sexpcirc|mir|t=mintTSexpcirc|t,Sexpmir|t, and the final circRNA-miRNA score across all tissues is given by Sexpcirc|mir=maxtTSexpcirc|mir|t, where T is the set of all tissues from ENCODE. Assigning scores in this manner ensures that a high Sexpcirc|mir coincides with relatively high expression of the circRNA and miRNA in at least one tissue.

Integrative analysis of ceRNA interaction data using Pareto Frontier analysis

In order to improve the quality and functional relevance of the predicted ceRNA interactions, we integrated miRNA binding data and gene expression data using Pareto Frontier analysis (PFA). PFA is a technology to resolve the challenge of balancing among multiple competing objectives simultaneously to achieve an overall ranking optimality. In our case, it means to derive a combined interaction score between miRNAs and linear/circular RNAs based on various data types, such as expression data and predicted miRNA binding data. A key concept in PFA is the Pareto dominance. In the context of ranking 2-dimensional miRNA-circRNA interaction scores (expression score f1 and binding score f2), Pareto dominance is defined as: given two pairs of interactions x1 and x2, x2 is said to Pareto dominant x1 if

fnx1fnx2,for alln,
andfnx1<fnx2,for at least onen,wheren1,2.

The principle of Pareto dominance can be easily generalized for combing more than two scores. It is particularly suitable for combining asymmetric information without directly making comparisons across different data types, nor subjectively choosing a trade-off between different competing objectives. For circRNA-miRNA interactions, the length-normalized circRNA-miRNA binding score SMREcirc|mir and circRNA-miRNA co-expression score Sexpcirc|mir were combined using the PFA method to re-rank all pairs of circRNA-miRNA interactions. The new rank of each interaction pair was re-scaled by the total number of interaction pairs to obtain a final combined interaction score SPcirc|mir between 0 and 1, where 1 denotes the strongest interaction and 0 denotes no evidence for a given interaction. The new combined score SPcirc|mir is also referred to as the Pareto score of the circRNA-miRNA interaction. For circRNA-miRNA interactions that fall on the same Pareto front, their Pareto scores will be the same. Similarly, for a miRNA-gene interaction, previously described scores SMREmir|gene and SMTBmir|gene were also combined using the Pareto Frontier method to calculate a new Pareto score SPmir|gene. More details regarding PFA are provided in the Supplementary Methods.

CircRNA functional enrichment analysis

Assigning functional annotations to an individual circRNA is based on the circRNA-miRNA-gene interaction framework we have built thus far, which consists of two steps: obtaining a list of significant genes and then testing functional enrichment of these genes. In the first step, given an individual circRNA c and a set of k miRNAs Mk=m1,,mkM, where SPc|mi>0 for all ik and M is the full set of miRNAs. We define the circRNA-miRNA Pareto score vector as SPc|Mk=SPc|m1,SPc|m2,,SPc|mk and the miRNA-gene Pareto score matrix (n×k).

SPMk|GSPm1|g1SPmk|g1SPm1|gnSPmk|gn,

where G is the set of genes g1,,gn. We define the circRNA-gene Pareto score vector SPc|G=SPc|Mk×SPMk|GT=SPc|g1,,SPc|gn as the final statistic to measure the predicted association between a given circRNA and the set of all genes. Following a similar procedure as Bleazard et al. to adjust for observed bias in miRNA functional enrichment analysis, we approximate the null distribution of SPc|G (SP,null,nc|G) by randomly drawing N (e.g., N=10,000) SPMk|G matrices from SPM|G and re-computing SPc|G under each iteration67, where 1nN. Then, the statistical significance of a gene g is given by p-value =n=1NISP,null,nc|gSPc|g+1N+168, where I(x) is the indicator function that equals 1 when x is true, and 0 otherwise. Given a pre-specified statistical threshold (e.g., p-value ≤ 0.05), a list of genes surviving the threshold is identified. The second step, functional enrichment of significant genes, proceeds in standard fashion: apply Fisher’s exact test to test for overrepresentation on sets of functional terms. All gene sets, including KEGG6972 pathways and gene ontology (GO)7274 terms were obtained from the R package pathfindR72.

Tools and software used

The Cerina tool is developed based on R75 and R shiny76, which also depends on several R packages (shinydashboard77, shinyjs78, shinycssloaders79, shinyBS80, DT81, tidyverse82, dendextend83, visNetwork84, heatmaply85, Matrix86, fastcluster87, htmltools88, reshape289, and igraph90).

Additional R packages (ggolot291, plotrix92, circlize93) were used to produce the figures in this paper. Cytoscape94 was used to create circRNA-miRNA-gene-function network for the prostate cancer case study. Commercial software Lucidchart (www.lucidchart.com) was used to assemble all final version of figures. All organ icons used in this paper were under Creative Commons liscence (CC BY 3.0, https://creativecommons.org/licenses/by/3.0/), which were obtained from iconfiner (https://www.iconfinder.com/) through Lucidchart without any changes. Images “Anatomy, blood, coronary, heart, organ icon” (https://www.iconfinder.com/icons/4312967/anatomy_blood_coronary_heart_organ_icon), “Anatomy, bowel, digestion, intestine, small icon” (https://www.iconfinder.com/icons/4312981/anatomy_bowel_digestion_intestine_small_icon), “Abdomen, anatomy, cavity, diaphragm, organ icon” (https://www.iconfinder.com/icons/4312964/abdomen_anatomy_cavity_diaphragm_organ_icon), “Abdomen, digestion, gaster, organ, stomach icon” (https://www.iconfinder.com/icons/4312980/abdomen_digestion_gaster_organ_stomach_icon), and “Abdomen, anatomy, liver, metabolism, organ icon” (https://www.iconfinder.com/icons/4312973/abdomen_anatomy_liver_metabolism_organ_icon) by Eucalyp Studio; “Organs, uterus icon” (https://www.iconfinder.com/icons/1609656/organs_uterus_icon) by Design Sciences. 

Results

Cerina overview: an integrative framework

Figure 1 gives the flow chart of Cerina, which consists of several streamlined modules: starting from linear/circRNA expression quantification, MRE prediction, ceRNA interaction integration, to circRNA functional annotation. Briefly, paired total RNA and miRNA sequencing data of 11 human organs from the ENCODE project were downloaded and processed to generate linear RNA (coding and non-coding), miRNA, and circular RNA expression profiles (Fig. 1a). To reduce false-positive circRNA predictions, we combined results from CIRI2 and CircExplorer, two methods that were previously validated to have the best overall performance on the simulated and real datasets. Based on the estimated mature sequences of circRNAs, TargetScan 7.2 was employed to predict putative MREs, which were further normalized by the length of each circRNA’s mature splice sequence (Fig. 1b). Meanwhile, pan-tissue circRNA expression data were incorporated and tissue-specific ceRNA networks were also constructed (Fig. 1c). Following the Pareto dominance principle, all ceRNA interactions were ranked and grouped into a sequence of non-intersect sets called Pareto frontiers. These frontiers re-stratified all ceRNA interactions, integrating evidence from both gene expression and miRNA bindings. CeRNA interactions that fall onto the first Pareto frontier represent the circRNA-miRNA interactions with the highest confidence, either based on expression data or binding data, or both (Fig. 1d). Such procedure integratively re-prioritized a total of 1,540,275 ceRNA interactions between 33,455 circRNAs and 606 miRNAs detected in 11 ENCODE tissues. Finally, systems analysis was performed based on Pareto-ranked ceRNA interactions to identify top miRNAs, significant miRNA target genes, and enriched biological functions and pathways (Fig. 1e).

Figure 1.

Figure 1

Flow chart of Cerina. (a) Analysis workflow for ENCODE tissue RNA-Seq/miRNA-Seq data. (b) Prediction of circRNA-miRNA bindings using TargetScan. (c) Pan-tissue analysis of ceRNA interactions. Incorporation of ENCODE gene expression data allows construct of tissue-specific circRNA-miRNA interaction networks. (d) Integrative analysis of ceRNA interactions. Pareto frontiers were calculated by integrating co-expression data with TargetScan-predict MRE data. (e) Based on the circRNA-miRNA-mRNA (gene)-function axis, circRNA functional prediction was performed by permuting the connections between a given circRNA and its interacting miRNAs/mRNAs. See section “Tools and software used” for license and attribution regarding the organ images used in the figure.

Pareto Frontier analysis improves accuracy and functional relevance of ceRNA interactions

We employed Pareto Frontier Analysis to integrate circRNA-miRNA binding data with their expression data, aiming to improve functional relevance of the predicted ceRNA interactions. Figure 2 gives 2531 circRNA-miRNA interaction pairs on the first 30 Pareto fronts with the top combination scores due to either strongest circRNA-miRNA binding potentials and/or highest co-expression from ENCODE. Nine circRNA-miRNA interactions, including eight unique circRNAs and five unique miRNAs, are located on the first Pareto front. Among those is the well-studied CDR1as-miR7 interaction, where 74 miR7 binding sites were predicted over the entire body of CDR1as. This circRNA-miRNA pair was also found to be co-expressed in several tissues, such as adrenal gland (circRNA SRPBM = 1680.4; miRNA CPM = 1032.4) and thyroid gland (circRNA SRPBM = 1843.5; miRNA CPM = 3503.0).

Figure 2.

Figure 2

Pareto Frontier Analysis re-prioritize ceRNA interactions by integrating gene expression with MRE data. 2531 circRNA-miRNA interactions on the top 30 Pareto fronts. Tissue-specific expression for selected ceRNA interactions: CDR1as and miR-7, and CircSPHKAP and miR-1. R package ggplot2 v3.3.2 (https://cran.r-project.org/web/packages/ggplot2/index.html) was used to create the figure.

Besides the abovementioned interactions with both strong co-expression and binding scores, the Pareto method also highlights circRNA-miRNA pairs with unequal interaction strengths from two data sources. CircSPHKAP and miR-1-3p is one such example that ranks among the top Pareto fronts (front 19; SPcirc|mir= 0.9993254) due to strong evidence from circRNA-miRNA co-expression (Sexpcirc|mir= 0.9938584) and relatively weaker binding potential (0.27 MREs/Kb). Further scrutinization revealed that circSPHKAP (chr2: 228,881,121–228,884,872) was exclusively expressed in heart tissues (circRNA SRPBM = 1055.9, rank: 62/9281 in hearts tissues) with no detectable back-splicing junction counts in the rest of ten tissues from ENCODE, which is consistent with findings from a recent study supporting the use of circSPHKAP as a biomarker for cardiomyocytes95. On the other hand, miR-1-3p was among the highly expressed miRNA in heart tissues (CPM = 212,747), which was also known to be directly involved or implicated in various heart and cardiovascular diseases, including hypertrophic cardiomyopathy, coronary artery disease, myocardial infarction, heart failure and stroke96. Interestingly, circSPHKAP was reported to have dynamic expression changes in human induced pluripotent stem cell derived cardiomyocytes during cardiac development97, which further underscores its potential functional role in cardiac tissues.

To systematically evaluate the advantage of integrating circRNA-miRNA co-expression with MRE data over conventional MRE-based approaches, we performed functional relevance analysis of the top ranked circRNAs. We used circRNAs from CircFunBase49 that were previously reported to be differentially expressed in one or more disease studies as one of the references. Figure 3a upper panel gives the percentages of overlap between circRNAs from the top-n (1n3000) circRNA-miRNA interactions and those from CircFunBase based on three different ranking methods: the Pareto method, total number of MREs (nMRE), length-normalized number of MRE (i.e., number of MREs per kilo bases: nMRE/Kb). Apparently, Pareto integration of co-expression data with binding data significantly improved the recall of known circRNAs from CircFunBase: ~ 15% from the Pareto method compared to 2% from the length-normalized MRE method. It is worth noting that using the total number MREs yielded very low recall compared to its length-normalized counterpart. Moreover, the precision of the Pareto method was also significantly increased (Fig. 3a lower panel). Additionally, we applied similar analysis on three more circRNA databases, including CircR2Disease98, Circ2Disease99, and RefCirc (http://www.ncvar.org/RefCirc/index.php), which contained annotated disease-associated circRNAs from independent research groups. Figure 3b–d show that circRNAs prioritized by the Pareto method was consistently more enriched in known disease associations by several folds, in terms of both precision and recall, which provided strong evidence that incorporation of co-expression data significantly increased functional relevance of prioritized ceRNA interactions.

Figure 3.

Figure 3

Evaluating the performance of different circRNA-miRNA interaction ranking methods using data from several circRNA function/disease databases. Upper panel: recall (sensitivity) curve. Lower panel: precision. R package plotrix v3.7–8 (https://cran.r-project.org/web/packages/plotrix/index.html) was used to create gap plot.

Moreover, we further validated our Pareto-ranked miRNA-gene interactions on three additional miRNA target databases: miRDB100,101, miRTAR102, and miRWalk103. We considered the top 3000 miRNA-gene interactions ranked by Pareto, TargetScan, and miRTarBase and found that Pareto improved the performance, in terms of precision and recall, on all three databases (Supplementary Fig. S3). This demonstrates Pareto’s utility in combining multiple pieces of information, namely TargetScan and miRTarBase, to improve overall performance.

Cerina shiny server interface

We developed a user-friendly R Shiny web application of Cerina for researchers to visualize ceRNA interactions and perform circRNA functional enrichment analysis. The tool consists of three main components: data exploration, miRNA-circRNA network visualization, and functional enrichment analysis.

In the data exploration section (Fig. 4a,b), users can query individual circRNAs, miRNAs, and linear RNAs to view their expression profiles across the 11 ENCODE tissues. Additionally, correlation analysis of any queried pair can be visualized via scatterplots. The miRNA-circRNA network page allows users to query an individual miRNA to visualize a network of its interacting circRNAs (Fig. 4c). A downloadable table listing all circRNAs plotted in the network is also provided. The table shows detailed information such as parental gene, tissue specific expression, number of MREs, number of MREs per kilobase, and the Pareto score. Finally, in the functional enrichment component, users can enter an individual circRNA to visualize a network and download a table including all interacting miRNAs (Fig. 4d). Here, users have the option to run the permutation test using either all interacting miRNAs or a subset of “top” miRNAs to identify target genes. After running the permutation test, users can proceed to functional enrichment analysis of significant genes (e.g., p-value ≤ 0.05) on KEGG6972 pathways or gene ontology (GO)7274 terms. The enrichment results of a circRNA are output as a downloadable table that can be categorized by either the functional term (i.e., KEGG or GO term) or the binding miRNA, with graphic visualization also made available (Fig. 4e). Cerina allows users to choose a subset of miRNA/genes/functions to display in the graph (Fig. 4f). A detailed tutorial is accessible at the Cerina website.

Figure 4.

Figure 4

Web interface of Cerina. (a,b) In the data exploration section, users can query an mRNA, miRNA, or circRNA to examine its expression across different tissues. Users can also perform correlation analysis for ceRNA interactions. (c) MiRNA-circRNA interaction page allows users to visualize and report tissue-specific miRNA-circRNA interactions as a network. (d) CircRNA-miRNA exploration tab reports all miRNAs interacting with a selected circRNA as a downloadable table displaying MRE, Pareto score, and miRNA expression. (e) Functional analysis tab reports significantly enriched pathways and gene ontology terms that can be visualized as a network displaying the selected circRNA with interacting miRNAs and genes. (f) Users can choose a subset of miRNAs/genes/functions to display in the network. R packages ggplot2 v3.3.2 (https://cran.r-project.org/web/packages/ggplot2/index.html), visNetwork v2.0.9 (https://cran.r-project.org/web/packages/visNetwork/index.html), and DT v0.15 (https://cran.r-project.org/web/packages/DT/index.html), were used to create the figure.

Case studies on differentially expressed circRNAs

ceRNAs in cancers: integrative analysis with TCGA data

We first performed Cerina analysis on gastric cancer104 and prostate cancer65 datasets to demonstrate its utility to identify potential roles of circRNAs in functional sequestration of miRNAs. Enrichment analysis validated that Cerina-predicted miRNAs and their target genes were strongly associated with gastric and prostate cancer annotated by Human MicroRNA Disease Database (HMDDv3.2)96 and KEGG (Supplementary Table S2). To further explore the potential roles of circRNAs as competing endogenous RNAs in tumorigenesis, we further analyzed miRNA and mRNA expression data from The Cancer Genome Atlas105,106, allowing construction of ceRNA networks with expression changes of circRNA/mRNA that were inversely correlated with those of the miRNAs (Supplementary Methods).

In the gastric cancer dataset, circARHGEF12 (hsa_circ_0002089; chr11: 120,347,369–120,348,235), a circRNA that was down-regulated in cancer, was significantly enriched in both miRNA and pathway enrichment analysis (Supplementary Tables S2, S3). Two precursor miRNAs, hsa-mir-134 and hsa-mir-590, with predicted MREs on circARHGEF12 were significantly up-regulated in TCGA gastric cancer dataset. Differential gene expression analysis of TCGA mRNA-Seq data identified 12 genes from the KEGG gastric cancer pathway that were down-regulated in cancer tissue, eight of which had predicted interactions in Cerina with the two up-regulated miRNAs. SMAD4, hub of TGFβ signaling and a tumor suppressor for gastrointestinal carcinogenesis107 was among the down-regulated target genes of circARHGEF12, suggesting a potential tumorigenesis effect caused by un-sequester of oncogenic miR-134 and miR-590108,109. Catenin Alpha (CTNNA1 and CTNNA2) expression was also down-regulated in cancerous tissues, which was consistent to well-reported tumor-suppressor functions of CTNNA1 and CTNNA2 in various cancers110112. Interestingly, CTNNA2 was previously predicted to be part of lincRNA-mediated miR-590-3p sponge network (http://cis.hku.hk/GastricCancerMAP/index.php), unveiling a novel role of circARHGEF12 in gastric carcinogenesis and its involvement in complicated wiring of ceRNA interactions harboring miR-590.

In the prostate cancer study comparing localized primary prostate adenocarcinoma and matched normal tissues, five differentially expressed circRNAs: circHIPK3 (hsa_circ_0000284; chr11: 33,307,958–33,309,057), circN4BP2L2 (hsa_circ_0000471; chr13: 33,091,993–33,101,669), circUNC13B (hsa_circ_0008518; chr9: 35,295,692–35,313,986), circZCCHC6 (hsa_circ_0001869; chr9: 88,920,106–88,924,932), and circSENP6 (hsa_circ_0001614; chr6: 76,412,360–76,412,788), had significant enrichment in miRNAs related to “carcinoma, prostate” and KEGG “prostate cancer” pathway (Supplementary Tables S2, S4). CircHIPK3, in particular, was one of the most abundantly expressed circRNA with an average log expression (SRPBM) of 12.1, compared to the median average log expression of 2.4 among all detected circRNAs in prostate tissues. Dysregulation of circHIPK3 was frequently reported in multiple cancers113. Interestingly, both up- and down-regulation of circHIPK3 were identified in tumor tissues, indicating a dual role of circHIPK3 in cancer to regulate tumor progression through sponging different miRNAs114. As a side note, the host gene of circHIPK3 was also significantly down-regulated in the prostate cancer tissues, which was further confirmed by an independent TCGA RNA-Seq data. Integrative analysis of TCGA RNA-Seq/miRNA-Seq data revealed that two Cerina-predicted miRNAs mir-10b and mir-375 that can be sequestrated by circHIPK3 were up-regulated in TCGA prostate cancer samples. Oncogenic functions of mir-10b has been well-documented in various cancers, including oral cancer115, head and neck cancer116, hepatocellular carcinoma117, breast cancer118, and colon cancer119. Top mir-10b targets (Pareto score SPmir|gene ≥ 0.95) that were also down-regulated in tumors included HOXD10, KLF4, and PTEN, all of which had well-known tumor-suppressor functions and reduced expression in prostate cancer tissues120122. It is worth noting that depletion of mir-10b restored PTEN expression in breast cancer, which led to decreased cancer stem cell renewal through inhibition of AKT118. Mir-375, another highly expressed miRNA that can be sponged by circHIPK3, was well described as a tumor suppressor in many cancers, yet its expression was found to be up-regulated in breast and prostate cancers123. Consistently, our analysis of TCGA prostate miRNA-Seq data showed significant up-regulation of mir-375 (log2FC = 1.874, adjusted p-value = 4.85E−43). Top down-regulated mir-375 target genes (SPmir|gene≥ 0.95) included tumor suppressors such as ZFP36L2, CDKN2B, PRKCA, KLF4, and EXT1, suggesting possible protumorigenic activity of circHIPK3 implemented through ceRNA interaction with mir-375. Figure 5a gives the circHIPK3-centered ceRNA interaction network, connecting mir-10 and mir-375 to significant dysregulated KEGG pathways, including PI3K-AKT signaling and p53 signaling pathways.

Figure 5.

Figure 5

Cerina links circRNAs with potential functions in cancer and cardiovascular disease. (a) Network view of predicted circRNA-miRNA-gene-function associations for circHIPK3 in prostate cancer. For circRNA, miRNA, and genes, their colors represent their fold changes (red: up-regulated in prostate cancer; green: down-regulated in prostate cancer). (b) Circos plot showing predicted miRNAs of circTTN with Pareto score, expression in heart tissues (log2 CPM), and enrichment in immunology functions (-log2 p-value). Cytoscape v3.5.1 was used to create the circRNA-miRNA-gene-function network figure (https://cytoscape.org/). R package circlize v0.4.8 (https://cran.r-project.org/web/packages/circlize/index.html) was used to make circos plot.

Reduced circTTN expression correlates with down-regulation of immune response in end-stage dilated cardiomyopathy

In the dilated cardiomyopathy (DCM) dataset124, circTTN (hsa_circ_0141774; chr2: 179,542,851–179,585,929) had the highest abundance among all differentially expressed circRNAs. circTTN was also exclusively expressed in heart tissues (Supplementary Fig. S4). Cerina analysis revealed that circTTN had binding sites for 82 miRNAs, among them seven mature miRNAs (miR-23b-3p, miR-23a-3p, miR-24-3p, miR-181a-5p, miR-28-5p, miR-181b-5p, miR-208a-5p) with Pareto scores greater than 0.95 (Fig. 5b). Functional enrichment analysis showed that targets of these seven miRNAs were highly associated with cardiovascular and circulatory system development, which were also significantly enriched in several pathways, including TNF, FoxO, and ERBB signaling pathways. In an independent gene expression study (GSE3586)125, Barth et al. reported that end-stage DCM was characterized by excessive down-regulation of “immune response”, “inflammatory response”, and “chemokine activity”. Given the apparent under-expression of circTTN in DCM, we hence seek to investigate the possibility of circTTN-mediated suppression of immunity and inflammatory response through ceRNA interactions. Consistently, over-expression of mir-23a, mir-24, mir-28, and mir-208 in DCM patients were previously reported in one or more studies126129, which suggested a direct link between increased miRNA activity and reduced circTTN expression levels in DCM. Moreover, enrichment analysis showed that target genes of mir-23a/b were significantly associated with the down-regulation of immune-related genes in Barth’s study (Supplementary Methods), exampled by binding of mir-23a/b to CCL2, a chemokine with the most significant down-regulation in DCM. Taken together, deregulation of circTTN correlates with down-regulation of immune response in end-stage DCM patient likely through modulation of mir-23a/b and others.

Conclusion and discussion

Cerina is the first systematic circRNA functional annotation tool based on integrative analysis of competing endogenous RNA interactions. It has a collection of more than 1.5 million inferred ceRNA interactions between over 33,000 circRNAs and hundreds of miRNAs detected in 11 ENCODE tissues. Although many databases were established for searching MREs in circRNAs, none of them incorporated gene expression data for predicting circRNA-miRNA interactions. Guo et al., raised concerns regarding the functional role of thousands of low-expressing circRNAs, strongly suggesting that the expression levels of circRNAs to be taken into account when interpreting circRNA functions66. On a similar note, TargetScan also argued that, in order to mediate consequential repression of its targets, the expression of a miRNA should reach an adequate level, hence recommending removing false-positive interactions based on miRNA expressions levels (http://www.targetscan.org/vert_72/docs/FP_noncons.html). By integrating paired circRNA and miRNA expression data with the predicted MREs using a Pareto Frontier Analysis framework, we have significantly improved the accuracy and functional relevance of the identified ceRNA interactions, validated by data from several mainstream circRNA-disease databases. Through Cerina’s Shiny web interface, users can perform functional query of a circRNA to retrieve information regarding its most likely sponged miRNAs and their tissue-specific expressions, down-stream target genes, and potential enriched biological functions and pathways.

Although applicable to various disease studies, one major limitation of Cerina is that its entire functional prediction is built upon the circRNA-miRNA-mRNA axis. While this miRNA-sponge paradigm is under the spotlight for human circRNA research1839, increasing evidences have supported a number of alternative biological mechanisms, including alternative splicing regulation, RNA-binding protein sponge, posttranscriptional gene regulation, and protein-coding, among others3,713.

In the context of human cancer, circCcnb1 may directly bind H2ax and wild-type p53, which attenuates tumor-suppressor function of p53 and promotes cell proliferation by allowing Bcl2-Bclaf1 binding. On the contrary, in p53 mutant cells, the circCcnb1-H2ax compound binds Bclaf1, hence activates Bclaf1 tumor-suppressor function and leads to apoptosis130. In another breast cancer study, co-localization of circ-Amotl1 and c-myc was detected, suggesting abnormal levels of circAmotl1 to facilitates c-myc nuclear translocation through direct circRNA-protein binding131. In human glioma, a new protein encoded by circFBXW7 was discovered to have inhibitory effect of cell cycle and proliferation132.

Similarly, in non-cancer diseases, various “non-sponging” mechanistic models have been proposed for circRNAs in disease pathogenesis and progression. Examples include circ-Foxo3, a circRNA that promotes cardiac senescence binds CDK2 and p21 to form a ternary complex, blocking cell cycle progression133. Also, in a systemic lupus erythematosus (SLE), degraded circRNAs upon viral induction in monocytes was found to form short RNA duplexes that inhibited abnormal protein kinase R activation cascade, highlighting a new role of circRNA in autoimmune diseases due to its unique structure134.

On the other hand, due to the complex ceRNA networking in mammalian cells, circRNAs are a potent family, yet not the only one, of being capable of regulating protein-coding genes by sequestration of miRNAs. Other than circRNAs, small non-coding RNAs, pseudogenes, and lincRNAs, all actively participate in ceRNA interaction network through competing of shared miRNAs14,135137. Therefore, when Cerina predicts strong ceRNA associations that lead to functional outcomes, experimental validations are needed to further confirm the identified interactions, such as use pull-down assay and dual-luciferase reporter assay to confirm circRNA-miRNA binding31,34,138, or over-express/silence circRNA or their interacting miRNAs to further verify predicted ceRNA interactions and associated phenotypic changes31,34,139,140.

Supplementary Information

Supplementary Table S1. (16.9KB, xlsx)
Supplementary Table S2. (15.6KB, xlsx)
Supplementary Table S3. (13.3KB, xlsx)

Acknowledgements

We thank Dr Nicole Baldwin from Baylor Scott & White Research Institute for her technical help with the Cerina web server. We also thank Dr Xuan Wang from Baylor Scott & White Research Institute for her constructive comments of the manuscript.

Author contributions

J.G. and U.B. designed the study and circRNA detection framework. U.B. collected and processed the data. J.C. and J.G. developed the statistical methodology. J.C. implemented the method and developed the software. J.G. wrote the manuscript and interpreted the data with contribution from U.B. and J.C. All authors reviewed and approved the manuscript.

Data availability

A web service of Cerina can be accessed through: https://www.bswhealth.med/research/Pages/biostat-software.aspx.

Code availability

Source code for Cerina is available through GitHub at https://github.com/jcardenas14/CERINA.

Competing interests

The authors declare no competing interests.

Footnotes

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

These authors contributed equally: Jacob Cardenas and Uthra Balaji.

Supplementary Information

The online version contains supplementary material available at 10.1038/s41598-020-78469-x.

References

  • 1.Salzman J. Circular RNA expression: its potential regulation and function. Trends Genet. 2016;32:309–316. doi: 10.1016/j.tig.2016.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Chen LL, Yang L. Regulation of circRNA biogenesis. RNA Biol. 2015;12:381–388. doi: 10.1080/15476286.2015.1020271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Zhang Z, Yang T, Xiao J. Circular RNAs: promising biomarkers for human diseases. EBioMedicine. 2018;34:267–274. doi: 10.1016/j.ebiom.2018.07.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Lei B, Tian Z, Fan W, Ni B. Circular RNA: a novel biomarker and therapeutic target for human cancers. Int. J. Med. Sci. 2019;16:292–301. doi: 10.7150/ijms.28047. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Li S, Han L. Circular RNAs as promising biomarkers in cancer: detection, function, and beyond. Genome Med. 2019;11:15. doi: 10.1186/s13073-019-0629-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Bolha L, Ravnik-Glavac M, Glavac D. Circular RNAs: biogenesis, function, and a role as possible cancer biomarkers. Int. J. Genomics. 2017;2017:6218353. doi: 10.1155/2017/6218353. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Meng S, et al. CircRNA: functions and properties of a novel potential biomarker for cancer. Mol. Cancer. 2017;16:94. doi: 10.1186/s12943-017-0663-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Lasda E, Parker R. Circular RNAs: diversity of form and function. RNA. 2014;20:1829–1842. doi: 10.1261/rna.047126.114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Barrett SP, Salzman J. Circular RNAs: analysis, expression and potential functions. Development. 2016;143:1838–1847. doi: 10.1242/dev.128074. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Huang S, et al. The emerging role of circular RNAs in transcriptome regulation. Genomics. 2017;109:401–407. doi: 10.1016/j.ygeno.2017.06.005. [DOI] [PubMed] [Google Scholar]
  • 11.Rong D, et al. An emerging function of circRNA-miRNAs-mRNA axis in human diseases. Oncotarget. 2017;8:73271–73281. doi: 10.18632/oncotarget.19154. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Shang Q, Yang Z, Jia R, Ge S. The novel roles of circRNAs in human cancer. Mol. Cancer. 2019;18:6. doi: 10.1186/s12943-018-0934-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Verduci L, Strano S, Yarden Y, Blandino G. The circRNA-microRNA code: emerging implications for cancer diagnosis and treatment. Mol. Oncol. 2019;13:669–680. doi: 10.1002/1878-0261.12468. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Tay Y, Rinn J, Pandolfi PP. The multilayered complexity of ceRNA crosstalk and competition. Nature. 2014;505:344–352. doi: 10.1038/nature12986. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Li JH, Liu S, Zhou H, Qu LH, Yang JH. starBase v2.0: decoding miRNA-ceRNA, miRNA-ncRNA and protein-RNA interaction networks from large-scale CLIP-Seq data. Nucleic Acids Res. 2014;42:D92–D97. doi: 10.1093/nar/gkt1248. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Zhong Y, et al. Circular RNAs function as ceRNAs to regulate and control human cancer progression. Mol. Cancer. 2018;17:79. doi: 10.1186/s12943-018-0827-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Gomes CPC, et al. Circular RNAs in the cardiovascular system. Noncoding RNA Res. 2018;3:1–11. doi: 10.1016/j.ncrna.2018.02.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Memczak S, et al. Circular RNAs are a large class of animal RNAs with regulatory potency. Nature. 2013;495:333–338. doi: 10.1038/nature11928. [DOI] [PubMed] [Google Scholar]
  • 19.Hansen TB, et al. Natural RNA circles function as efficient microRNA sponges. Nature. 2013;495:384–388. doi: 10.1038/nature11993. [DOI] [PubMed] [Google Scholar]
  • 20.Weng W, et al. Circular RNA ciRS-7-A promising prognostic biomarker and a potential therapeutic target in colorectal cancer. Clin. Cancer Res. 2017;23:3918–3928. doi: 10.1158/1078-0432.CCR-16-2541. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Pan H, et al. Overexpression of circular RNA ciRS-7 abrogates the tumor suppressive effect of miR-7 on gastric cancer via PTEN/PI3K/AKT signaling pathway. J. Cell Biochem. 2018;119:440–446. doi: 10.1002/jcb.26201. [DOI] [PubMed] [Google Scholar]
  • 22.Li RC, et al. CiRS-7 promotes growth and metastasis of esophageal squamous cell carcinoma via regulation of miR-7/HOXB13. Cell Death Dis. 2018;9:838. doi: 10.1038/s41419-018-0852-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Geng HH, et al. The circular RNA Cdr1as promotes myocardial infarction by mediating the regulation of miR-7a on its target genes expression. PLoS ONE. 2016;11:e0151753. doi: 10.1371/journal.pone.0151753. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Chen J, et al. Circular RNA profile identifies circPVT1 as a proliferative factor and prognostic marker in gastric cancer. Cancer Lett. 2017;388:208–219. doi: 10.1016/j.canlet.2016.12.006. [DOI] [PubMed] [Google Scholar]
  • 25.Wan L, et al. Circular RNA-ITCH suppresses lung cancer proliferation via inhibiting the Wnt/beta-catenin pathway. Biomed. Res. Int. 2016;2016:1579490. doi: 10.1155/2016/1579490. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Chen G, Shi Y, Liu M, Sun J. circHIPK3 regulates cell proliferation and migration by sponging miR-124 and regulating AQP3 expression in hepatocellular carcinoma. Cell Death Dis. 2018;9:175. doi: 10.1038/s41419-017-0204-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Zheng J, et al. TTBK2 circular RNA promotes glioma malignancy by regulating miR-217/HNF1beta/Derlin-1 pathway. J. Hematol. Oncol. 2017;10:52. doi: 10.1186/s13045-017-0422-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Altesha MA, Ni T, Khan A, Liu K, Zheng X. Circular RNA in cardiovascular disease. J. Cell Physiol. 2019;234:5588–5600. doi: 10.1002/jcp.27384. [DOI] [PubMed] [Google Scholar]
  • 29.Fan X, et al. Circular RNAs in cardiovascular disease: an overview. Biomed. Res. Int. 2017;2017:5135781. doi: 10.1155/2017/5135781. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Deng Y-Y, et al. GW27-e1167 circular RNA related to PPARγ function as ceRNA of microRNA in human acute myocardial infarction. J. Am. Coll. Cardiol. 2016;68:C51–C52. doi: 10.1016/j.jacc.2016.07.189. [DOI] [Google Scholar]
  • 31.Wang K, et al. Circular RNA mediates cardiomyocyte death via miRNA-dependent upregulation of MTP18 expression. Cell Death Differ. 2017;24:1111–1120. doi: 10.1038/cdd.2017.61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Tang CM, et al. CircRNA_000203 enhances the expression of fibrosis-associated genes by derepressing targets of miR-26b-5p, Col1a2 and CTGF, in cardiac fibroblasts. Sci. Rep. 2017;7:40342. doi: 10.1038/srep40342. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Zhou B, Yu JW. A novel identified circular RNA, circRNA_010567, promotes myocardial fibrosis via suppressing miR-141 by targeting TGF-beta1. Biochem. Biophys. Res. Commun. 2017;487:769–775. doi: 10.1016/j.bbrc.2017.04.044. [DOI] [PubMed] [Google Scholar]
  • 34.Wang K, et al. A circular RNA protects the heart from pathological hypertrophy and heart failure by targeting miR-223. Eur. Heart J. 2016;37:2602–2611. doi: 10.1093/eurheartj/ehv713. [DOI] [PubMed] [Google Scholar]
  • 35.Chen J, Cui L, Yuan J, Zhang Y, Sang H. Circular RNA WDR77 target FGF-2 to regulate vascular smooth muscle cells proliferation and migration by sponging miR-124. Biochem. Biophys. Res. Commun. 2017;494:126–132. doi: 10.1016/j.bbrc.2017.10.068. [DOI] [PubMed] [Google Scholar]
  • 36.Lukiw WJ. Circular RNA (circRNA) in Alzheimer's disease (AD) Front. Genet. 2013;4:307. doi: 10.3389/fgene.2013.00307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Piwecka M, et al. Loss of a mammalian circular RNA locus causes miRNA deregulation and affects brain function. Science. 2017 doi: 10.1126/science.aam8526. [DOI] [PubMed] [Google Scholar]
  • 38.Wang Z, et al. Identifying circRNA-associated-ceRNA networks in the hippocampus of Abeta1-42-induced Alzheimer's disease-like rats using microarray analysis. Aging (Albany, N.Y.) 2018;10:775–788. doi: 10.18632/aging.101427. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Ma N, et al. Whole-transcriptome analysis of APP/PS1 mouse brain and identification of circRNA-miRNA-mRNA networks to investigate AD pathogenesis. Mol. Ther. Nucleic Acids. 2019;18:1049–1062. doi: 10.1016/j.omtn.2019.10.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Dudekula DB, et al. CircInteractome: a web tool for exploring circular RNAs and their interacting proteins and microRNAs. RNA Biol. 2016;13:34–42. doi: 10.1080/15476286.2015.1128065. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Ji P, et al. Expanded expression landscape and prioritization of circular RNAs in mammals. Cell Rep. 2019;26:3444–3460. doi: 10.1016/j.celrep.2019.02.078. [DOI] [PubMed] [Google Scholar]
  • 42.Ghosal S, Das S, Sen R, Basak P, Chakrabarti J. Circ2Traits: a comprehensive database for circular RNA potentially associated with disease and traits. Front. Genet. 2013;4:283. doi: 10.3389/fgene.2013.00283. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Liu YC, et al. CircNet: a database of circular RNAs derived from transcriptome sequencing data. Nucleic Acids Res. 2016;44:D209–215. doi: 10.1093/nar/gkv940. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Xia S, et al. Comprehensive characterization of tissue-specific circular RNAs in the human and mouse genomes. Brief Bioinform. 2017;18:984–992. doi: 10.1093/bib/bbw081. [DOI] [PubMed] [Google Scholar]
  • 45.Xia S, et al. CSCD: a database for cancer-specific circular RNAs. Nucleic Acids Res. 2018;46:D925–D929. doi: 10.1093/nar/gkx863. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Liu M, Wang Q, Shen J, Yang BB, Ding X. Circbank: a comprehensive database for circRNA with standard nomenclature. RNA Biol. 2019;16:899–905. doi: 10.1080/15476286.2019.1600395. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Zang J, Lu D, Xu A. The interaction of circRNAs and RNA binding proteins: an important part of circRNA maintenance and function. J. Neurosci. Res. 2020;98:87–97. doi: 10.1002/jnr.24356. [DOI] [PubMed] [Google Scholar]
  • 48.Chen X, et al. circRNADb: a comprehensive database for human circular RNAs with protein-coding annotations. Sci. Rep. 2016;6:34985. doi: 10.1038/srep34985. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Meng X, Hu D, Zhang P, Chen Q, Chen M. CircFunBase: a database for functional circular RNAs. Database (Oxford) 2019 doi: 10.1093/database/baz003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Davis CA, et al. The encyclopedia of DNA elements (ENCODE): data portal update. Nucleic Acids Res. 2018;46:D794–D801. doi: 10.1093/nar/gkx1081. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Martin M. Cutadapt removes adapter sequences from high-throughput sequencing reads. EMBnet J. 2011;17:3. doi: 10.14806/ej.17.1.200. [DOI] [Google Scholar]
  • 52.Kim D, Langmead B, Salzberg SL. HISAT: a fast spliced aligner with low memory requirements. Nat. Methods. 2015;12:357–360. doi: 10.1038/nmeth.3317. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Li H, et al. The sequence alignment/map format and SAMtools. Bioinformatics. 2009;25:2078–2079. doi: 10.1093/bioinformatics/btp352. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Liao Y, Smyth GK, Shi W. featureCounts: an efficient general purpose program for assigning sequence reads to genomic features. Bioinformatics. 2014;30:923–930. doi: 10.1093/bioinformatics/btt656. [DOI] [PubMed] [Google Scholar]
  • 55.Frankish A, et al. GENCODE reference annotation for the human and mouse genomes. Nucleic Acids Res. 2019;47:D766–D773. doi: 10.1093/nar/gky955. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Love MI, Huber W, Anders S. Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2. Genome Biol. 2014;15:550. doi: 10.1186/s13059-014-0550-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Hansen TB. Improved circRNA identification by combining prediction algorithms. Front. Cell Dev. Biol. 2018;6:20. doi: 10.3389/fcell.2018.00020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Zeng X, Lin W, Guo M, Zou Q. A comprehensive overview and evaluation of circular RNA detection tools. PLoS Comput. Biol. 2017;13:e1005420. doi: 10.1371/journal.pcbi.1005420. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Gao Y, Wang J, Zhao F. CIRI: an efficient and unbiased algorithm for de novo circular RNA identification. Genome Biol. 2015;16:4. doi: 10.1186/s13059-014-0571-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Gao Y, Zhang J, Zhao F. Circular RNA identification based on multiple seed matching. Brief Bioinform. 2018;19:803–810. doi: 10.1093/bib/bbx014. [DOI] [PubMed] [Google Scholar]
  • 61.Zhang XO, et al. Complementary sequence-mediated exon circularization. Cell. 2014;159:134–147. doi: 10.1016/j.cell.2014.09.001. [DOI] [PubMed] [Google Scholar]
  • 62.Rozowsky J, et al. exceRpt: a comprehensive analytic platform for extracellular RNA profiling. Cell Syst. 2019;8:352–357. doi: 10.1016/j.cels.2019.03.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Agarwal V, Bell GW, Nam JW, Bartel DP. Predicting effective microRNA target sites in mammalian mRNAs. Elife. 2015 doi: 10.7554/eLife.05005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Chou CH, et al. miRTarBase update 2018: a resource for experimentally validated microRNA-target interactions. Nucleic Acids Res. 2018;46:D296–D302. doi: 10.1093/nar/gkx1067. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Vo JN, et al. The landscape of circular RNA in cancer. Cell. 2019;176:869–881. doi: 10.1016/j.cell.2018.12.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Guo JU, Agarwal V, Guo H, Bartel DP. Expanded identification and characterization of mammalian circular RNAs. Genome Biol. 2014;15:409. doi: 10.1186/s13059-014-0409-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Bleazard T, Lamb JA, Griffiths-Jones S. Bias in microRNA functional enrichment analysis. Bioinformatics. 2015;31:1592–1598. doi: 10.1093/bioinformatics/btv023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Phipson B, Smyth GK. Permutation P-values should never be zero: calculating exact P-values when permutations are randomly drawn. Stat. Appl. Genet. Mol. Biol. 2010;9:39. doi: 10.2202/1544-6115.1585. [DOI] [PubMed] [Google Scholar]
  • 69.Kanehisa M, Goto S. KEGG: kyoto encyclopedia of genes and genomes. Nucleic Acids Res. 2000;28:27–30. doi: 10.1093/nar/28.1.27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Kanehisa M, Sato Y, Furumichi M, Morishima K, Tanabe M. New approach for understanding genome variations in KEGG. Nucleic Acids Res. 2019;47:D590–D595. doi: 10.1093/nar/gky962. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Kanehisa M. Toward understanding the origin and evolution of cellular organisms. Protein Sci. 2019;28:1947–1951. doi: 10.1002/pro.3715. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Ulgen E, Ozisik O, Sezerman OU. pathfindR: an R Package for comprehensive identification of enriched pathways in omics data through active subnetworks. Front. Genet. 2019;10:858. doi: 10.3389/fgene.2019.00858. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Ashburner M, et al. Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat. Genet. 2000;25:25–29. doi: 10.1038/75556. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.The Gene Ontology Consortium The Gene Ontology Resource: 20 years and still going strong. Nucleic Acids Res. 2019;47:D330–D338. doi: 10.1093/nar/gky1055. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.R Core Team. R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, Vienna, Austria, 2020).
  • 76.Chang, W., Cheng, J., Allaire, J. & McPherson, J. shiny: Web Application Framework for R (2020).
  • 77.Chang, W. shinydashboard: Create Dashboards with 'Shiny' (2018).
  • 78.Attali, D. shinyjs: Easily Improve the User Experience of Your Shiny Apps in Seconds (2020).
  • 79.Attali, D. shinycssloaders: Add Loading Animations to a 'Shiny' Output While It's Recalculating (2020).
  • 80.Bailey, E.shinyBS: Twitter Bootstrap Components for Shiny (2015).
  • 81.Xie, Y., Cheng, J. & Tan, X. DT: A Wrapper of the JavaScript Library 'DataTables' (2020).
  • 82.Wickham H, et al. Welcome to the Tidyverse. J. Open Source Softw. 2019;4:1686. doi: 10.21105/joss.01686. [DOI] [Google Scholar]
  • 83.Galili T. dendextend: an R package for visualizing, adjusting and comparing trees of hierarchical clustering. Bioinformatics. 2015;31:3718–3720. doi: 10.1093/bioinformatics/btv428. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Almende, B.V., Thieurmel, B. and Robert, T. visNetwork: Network Visualization using 'vis.js' Library (2019).
  • 85.Galili T, O'Callaghan A, Sidi J, Sievert C. heatmaply: an R package for creating interactive cluster heatmaps for online publishing. Bioinformatics. 2018;34:1600–1602. doi: 10.1093/bioinformatics/btx657. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Bates, D. & Maechler, M. Matrix: Sparse and Dense Matrix Classes and Methods (2019).
  • 87.Mullner D. fastcluster: fast hierarchical, agglomerative clustering routines for R and python. J. Stat. Softw. 2013;53:1–18. doi: 10.18637/jss.v053.i09. [DOI] [Google Scholar]
  • 88.Cheng, J., Sievert, C., Chang, W., Xie, Y. & Allen, J. htmltools: Tools for HTML (2020).
  • 89.Wickham H. Reshaping data with the reshape package. J. Stat. Softw. 2007;21:1–20. doi: 10.18637/jss.v021.i12. [DOI] [Google Scholar]
  • 90.Csardi G, Nepusz T. The igraph software package for complex network research. InterJ. Complex Syst. 2006;1695:1–9. [Google Scholar]
  • 91.Wickham H. ggplot2: Elegant Graphics for Data Analysis. Cham: Springer; 2016. [Google Scholar]
  • 92.Lemon J. Plotrix: a package in the red light district of R. R-News. 2006;6:8–12. [Google Scholar]
  • 93.Gu Z, Gu L, Eils R, Schlesner M, Brors B. circlize Implements and enhances circular visualization in R. Bioinformatics. 2014;30:2811–2812. doi: 10.1093/bioinformatics/btu393. [DOI] [PubMed] [Google Scholar]
  • 94.Shannon P, et al. Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res. 2003;13:2498–2504. doi: 10.1101/gr.1239303. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Lei W, et al. Signature of circular RNAs in human induced pluripotent stem cells and derived cardiomyocytes. Stem Cell Res. Ther. 2018;9:56. doi: 10.1186/s13287-018-0793-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Huang Z, et al. HMDD v3.0: a database for experimentally supported human microRNA-disease associations. Nucleic Acids Res. 2019;47:D1013–D1017. doi: 10.1093/nar/gky1010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Siede D, et al. Identification of circular RNAs with host gene-independent expression in human model systems for cardiac differentiation and disease. J. Mol. Cell Cardiol. 2017;109:48–56. doi: 10.1016/j.yjmcc.2017.06.015. [DOI] [PubMed] [Google Scholar]
  • 98.Fan C, Lei X, Fang Z, Jiang Q, Wu FX. CircR2Disease: a manually curated database for experimentally supported circular RNAs associated with various diseases. Database (Oxford). 2018 doi: 10.1093/database/bay044. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Yao D, et al. Circ2Disease: a manually curated database of experimentally validated circRNAs in human disease. Sci. Rep. 2018;8:11018. doi: 10.1038/s41598-018-29360-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 100.Liu W, Wang X. Prediction of functional microRNA targets by integrative modeling of microRNA binding and target expression data. Genome Biol. 2019;20:18. doi: 10.1186/s13059-019-1629-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101.Chen Y, Wang X. miRDB: an online database for prediction of functional microRNA targets. Nucleic Acids Res. 2020;48:D127–D131. doi: 10.1093/nar/gkz757. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 102.Hsu JB, et al. miRTar: an integrated system for identifying miRNA-target interactions in human. BMC Bioinform. 2011;12:300. doi: 10.1186/1471-2105-12-300. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 103.Sticht C, De La Torre C, Parveen A, Gretz N. miRWalk: an online resource for prediction of microRNA binding sites. PLoS ONE. 2018;13:e0206239. doi: 10.1371/journal.pone.0206239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 104.Shao Y, et al. Global circular RNA expression profile of human gastric cancer and its clinical significance. Cancer Med. 2017;6:1173–1180. doi: 10.1002/cam4.1055. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.Cancer Genome Atlas Research Network Comprehensive molecular characterization of gastric adenocarcinoma. Nature. 2014;513:202–209. doi: 10.1038/nature13480. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 106.Cancer Genome Atlas Research Network The molecular taxonomy of primary prostate cancer. Cell. 2015;163:1011–1025. doi: 10.1016/j.cell.2015.10.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 107.Wang LH, et al. Inactivation of SMAD4 tumor suppressor gene during gastric carcinoma progression. Clin. Cancer Res. 2007;13:102–110. doi: 10.1158/1078-0432.CCR-06-1467. [DOI] [PubMed] [Google Scholar]
  • 108.Pan JY, et al. miR-134: a human cancer suppressor? Mol. Ther. Nucleic Acids. 2017;6:140–149. doi: 10.1016/j.omtn.2016.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 109.Dong Y, Qiu G-B. Biological functions of miR-590 and its role in carcinogenesis. Front. Lab. Med. 2017;1:173–176. doi: 10.1016/j.flm.2017.11.002. [DOI] [Google Scholar]
  • 110.Lee B, et al. Homozygous deletions at 3p22, 5p14, 6q15, and 9p21 result in aberrant expression of tumor suppressor genes in gastric cancer. Genes Chromosomes Cancer. 2015;54:142–155. doi: 10.1002/gcc.22226. [DOI] [PubMed] [Google Scholar]
  • 111.Chen XX, et al. Methylation of CTNNA1 promoter: frequent but not an adverse prognostic factor in acute myeloid leukemia. Leuk Res. 2014;38:613–618. doi: 10.1016/j.leukres.2014.03.002. [DOI] [PubMed] [Google Scholar]
  • 112.Fanjul-Fernandez M, et al. Cell-cell adhesion genes CTNNA2 and CTNNA3 are tumour suppressors frequently mutated in laryngeal carcinomas. Nat. Commun. 2013;4:2531. doi: 10.1038/ncomms3531. [DOI] [PubMed] [Google Scholar]
  • 113.Rophina M, Sharma D, Poojary M, Scaria V. Circad: a comprehensive manually curated resource of circular RNA associated with diseases. Database (Oxford). 2020 doi: 10.1093/database/baaa019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 114.Xie Y, et al. The circular RNA HIPK3 (circHIPK3) and its regulation in cancer progression: review. Life Sci. 2020 doi: 10.1016/j.lfs.2019.117252. [DOI] [PubMed] [Google Scholar]
  • 115.Lu YC, et al. Oncogenic function and early detection potential of miRNA-10b in oral cancer as identified by microRNA profiling. Cancer Prev. Res. (Phila) 2012;5:665–674. doi: 10.1158/1940-6207.CAPR-11-0358. [DOI] [PubMed] [Google Scholar]
  • 116.Tu HF, Lin SC, Chang KW. MicroRNA aberrances in head and neck cancer: pathogenetic and clinical significance. Curr. Opin. Otolaryngol. Head Neck Surg. 2013;21:104–111. doi: 10.1097/MOO.0b013e32835e1d6e. [DOI] [PubMed] [Google Scholar]
  • 117.Zhu Q, et al. miR-10b exerts oncogenic activity in human hepatocellular carcinoma cells by targeting expression of CUB and sushi multiple domains 1 (CSMD1) BMC Cancer. 2016;16:806. doi: 10.1186/s12885-016-2801-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 118.Bahena-Ocampo I, et al. miR-10b expression in breast cancer stem cells supports self-renewal through negative PTEN regulation and sustained AKT activation. EMBO Rep. 2016;17:648–658. doi: 10.15252/embr.201540678. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 119.Sheedy P, Medarova Z. The fundamental role of miR-10b in metastatic cancer. Am. J. Cancer Res. 2018;8:1674–1688. [PMC free article] [PubMed] [Google Scholar]
  • 120.Zhang X, Sun Y, Wang P, Yang C, Li S. Exploration of the molecular mechanism of prostate cancer based on mRNA and miRNA expression profiles. Onco Targets Ther. 2017;10:3225–3232. doi: 10.2147/OTT.S135764. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 121.Wang J, et al. Prognostic value and function of KLF4 in prostate cancer: RNAa and vector-mediated overexpression identify KLF4 as an inhibitor of tumor cell growth and migration. Cancer Res. 2010;70:10182–10191. doi: 10.1158/0008-5472.CAN-10-2414. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 122.Jamaspishvili T, et al. Clinical implications of PTEN loss in prostate cancer. Nat. Rev. Urol. 2018;15:222–234. doi: 10.1038/nrurol.2018.9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 123.Yan JW, Lin JS, He XX. The emerging role of miR-375 in cancer. Int. J. Cancer. 2014;135:1011–1018. doi: 10.1002/ijc.28563. [DOI] [PubMed] [Google Scholar]
  • 124.Khan MA, et al. RBM20 regulates circular RNA production from the titin gene. Circ. Res. 2016;119:996–1003. doi: 10.1161/CIRCRESAHA.116.309568. [DOI] [PubMed] [Google Scholar]
  • 125.Barth AS, et al. Identification of a common gene expression signature in dilated cardiomyopathy across independent microarray studies. J. Am. Coll. Cardiol. 2006;48:1610–1617. doi: 10.1016/j.jacc.2006.07.026. [DOI] [PubMed] [Google Scholar]
  • 126.Li M, et al. MiR-1-3p that correlates with left ventricular function of HCM can serve as a potential target and differentiate HCM from DCM. J. Transl. Med. 2018;16:161. doi: 10.1186/s12967-018-1534-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 127.Ikeda S, et al. Altered microRNA expression in human heart disease. Physiol. Genomics. 2007;31:367–373. doi: 10.1152/physiolgenomics.00144.2007. [DOI] [PubMed] [Google Scholar]
  • 128.Onrat ST, Onrat E, Ercan Onay E, Yalim Z, Avsar A. The genetic determination of the differentiation between ischemic dilated cardiomyopathy and idiopathic dilated cardiomyopathy. Genet. Test Mol. Biomark. 2018;22:644–651. doi: 10.1089/gtmb.2018.0188. [DOI] [PubMed] [Google Scholar]
  • 129.Satoh M, Minami Y, Takahashi Y, Tabuchi T, Nakamura M. Expression of microRNA-208 is associated with adverse clinical outcomes in human dilated cardiomyopathy. J. Cardiol. Fail. 2010;16:404–410. doi: 10.1016/j.cardfail.2010.01.002. [DOI] [PubMed] [Google Scholar]
  • 130.Fang L, et al. Enhanced breast cancer progression by mutant p53 is inhibited by the circular RNA circ-Ccnb1. Cell Death Differ. 2018;25:2195–2208. doi: 10.1038/s41418-018-0115-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 131.Yang Q, et al. A circular RNA promotes tumorigenesis by inducing c-myc nuclear translocation. Cell Death Differ. 2017;24:1609–1620. doi: 10.1038/cdd.2017.86. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 132.Yang Y, et al. Novel role of FBXW7 circular RNA in repressing glioma tumorigenesis. J. Natl. Cancer Inst. 2018 doi: 10.1093/jnci/djx166. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 133.Du WW, et al. Foxo3 circular RNA retards cell cycle progression via forming ternary complexes with p21 and CDK2. Nucleic Acids Res. 2016;44:2846–2858. doi: 10.1093/nar/gkw027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 134.Liu CX, et al. Structure and degradation of circular RNAs regulate PKR activation in innate immunity. Cell. 2019;177:865–880. doi: 10.1016/j.cell.2019.03.046. [DOI] [PubMed] [Google Scholar]
  • 135.Salmena L, Poliseno L, Tay Y, Kats L, Pandolfi PP. A ceRNA hypothesis: the Rosetta Stone of a hidden RNA language? Cell. 2011;146:353–358. doi: 10.1016/j.cell.2011.07.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 136.Karreth FA, Pandolfi PP. ceRNA cross-talk in cancer: when ce-bling rivalries go awry. Cancer Discov. 2013;3:1113–1121. doi: 10.1158/2159-8290.CD-13-0202. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 137.Chen LL. Linking long noncoding RNA localization and function. Trends Biochem. Sci. 2016;41:761–772. doi: 10.1016/j.tibs.2016.07.003. [DOI] [PubMed] [Google Scholar]
  • 138.Zhang X, et al. Circular RNA circNRIP1 acts as a microRNA-149-5p sponge to promote gastric cancer progression via the AKT1/mTOR pathway. Mol. Cancer. 2019;18:20. doi: 10.1186/s12943-018-0935-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 139.Du WW, et al. Foxo3 circular RNA promotes cardiac senescence by modulating multiple factors associated with stress and senescence responses. Eur. Heart J. 2017;38:1402–1412. doi: 10.1093/eurheartj/ehw001. [DOI] [PubMed] [Google Scholar]
  • 140.Gupta SK, et al. Quaking inhibits doxorubicin-mediated cardiotoxicity through regulation of cardiac circular RNA expression. Circ. Res. 2018;122:246–254. doi: 10.1161/CIRCRESAHA.117.311335. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Table S1. (16.9KB, xlsx)
Supplementary Table S2. (15.6KB, xlsx)
Supplementary Table S3. (13.3KB, xlsx)

Data Availability Statement

A web service of Cerina can be accessed through: https://www.bswhealth.med/research/Pages/biostat-software.aspx.

Source code for Cerina is available through GitHub at https://github.com/jcardenas14/CERINA.


Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES