Abstract
As one of the most widespread metabolic diseases, atherosclerosis affects nearly everyone as they age; arteries gradually narrow from plaque accumulation over time reducing oxygenated blood flow to central and periphery causing heart disease, stroke, kidney problems, and even pulmonary disease. Personalized medicine promises to bring treatments based on individual genome sequencing that precisely target the molecular pathways underlying atherosclerosis and its symptoms, but to date only a few genotypes have been identified. A promising alternative to this genetic approach is the identification of pathways altered in atherosclerosis by transcriptome analysis of atherosclerotic tissues to target specific aspects of disease. Transcriptomics is a potentially useful tool for both diagnostics and discovery science, exposing novel cellular and molecular mechanisms in clinical and translational models, and depending on experimental design to identify and test novel therapeutics. The cost and time required for transcriptome analysis has been greatly reduced by the development of next generation sequencing. The goal of this resource article is to provide background and a guide to appropriate technologies and downstream analyses in transcriptomics experiments generating ever-increasing amounts of gene expression data.
Keywords: atherosclerosis, coronary aortic disease, gene set enrichment analysis, heart disease, metabolic disease, transcriptomics, pathway enrichment analysis, RNA-seq analysis, secondary gene expression analysis
1. Introduction
Often starting in adolescence [1], atherosclerosis is an initially asymptomatic ‘silent’ disease, as the artery slowly narrows from the gradual accumulation of plaques, which consist of fat, cholesterol and calcium, and often harbor bacteria [2]. As oxygenated blood flow decreases over time, symptoms emerge at middle age, and atherosclerosis disease progression spurs stroke, peripheral artery disease, kidney problems, heart disease and coronary artery disease [2]. Atherosclerosis is very costly [3]; for example, in the United States it accounts for 1.3% of hospital stays and costs $9 billion per year with all atherosclerosis-related morbidities accounting for $43.5 billion of total hospital costs per year [4,5]. While etiology is complex, inflammation is currently proposed to be one of the initial triggers for atherosclerosis [6]. Diagnosis focuses on the detection of severe arterial narrowing using physical examination, electrocardiograms, and exercise-induced stress testing, but not directly the underlying atherosclerosis disease itself [7]. Treatment of established disease typically focuses on alleviating symptoms arising from pathophysiology, starting with modifying lifestyle risk factors, such as diet restrictions and exercise to increase arterial circulation, decrease obesity and blood pressure, and cessation of smoking to prevent deposits of plaque, combined with pharmaceuticals to lower cholesterol, such as statins, blood pressure medication such as diuretics and β-blockers, or decrease clotting, such as aspirin [8,9].
Treatments that target molecular mechanisms underlying the physiological changes, in addition to treating symptoms arising from pathophysiology, are a central promise of personalized medicine—indeed, in theory, genomic data can reveal specific disease-associated associated genotypes to optimize the treatment plan [10]. In reality, only a few exact genotypes have been identified, such as homozygous deletion of angiotensin-converting enzyme I (ACE) [11], aryl hydrocarbon receptor (AHR) polymorphisms [12], and in many different studies, multiple alleles of apolipoprotein E (APOE) [13,14]. An alternative to the clinical genetics and population genetics approach is the identification of altered pathways via transcriptome analysis of atherosclerotic tissues. Transcriptome analysis allows for the detection differentially expressed genes in atherosclerotic tissue that may drive its pathogenesis. The variety of technologies available to researchers makes choosing the most appropriate platform to address and resolve specific scientific problems (or hypothesi) using transcriptome analysis a daunting task. While some researchers believe microarrays are the most reliable due to their maturity, others embrace next-generation sequencing (NGS) as the superior method because it is the current vanguard of molecular technology. Assumptions in data analysis can skew and obviate the resulting data interpretation of gene expression if the hypothesis and, most importantly, the experimental design do not mitigate the shortcomings of each platform. After gene expression has been measured, the researcher must also choose from numerous software programs and analyze expression data. Therefore, the goal of this resource article is to provide explanations of the origins, strengths, and limitations of the wide-ranging transcriptomic technologies as it pertains to gene expression analysis as guide to resources available to interpreting transcriptome experiments within the context of atherosclerosis research. As the application of transcriptomics to the field of atherosclerosis as precision medicine is in its infancy, this knowledge will assist researchers in choosing an appropriate sequencing technology and bioinformatics analysis methods to address biomedical problems and questions in atherosclerosis research addressed by experimental studies of gene expression.
2. Materials and Methods Used in Transcriptomic Studies
Transcriptome analysis creates a detailed molecular synopsis of cellular physiology by elucidating the mRNA available for translation and/or the abundance of other types of transcripts, such as noncoding RNAs or microRNAs. Techniques used in transcriptome analysis belong to two broad classes; hybridization-based or sequencing-based (Figure 1). The time and cost of transcriptome analysis has been greatly reduced by the development of microarrays and, more recently, NGS, when compared to older gene expression analysis technologies, such as expressed sequence tag (EST) libraries, or serial analysis of gene expression (SAGE). Given the variety of factors affecting atherosclerosis and the multiple pathways involved, transcriptomics is a useful tool for diagnostics, discovery science, and pinpointing molecular mechanisms in both clinical and translational models of disease. Transcriptomics provides a way to identify treatments and therapeutics with the greatest potential to affect the cellular and molecular mechanisms underlying atherosclerotic disease, in addition to novel therapeutic approaches to alleviate symptomology (Figure 1).
2.1. Origins of Transcriptomics: Gene Expression in the Evolution of Hybridization Techniques and Sequencing for RNA Identification
2.1.1. Classic Hybridization-Based Technologies: Subtractive Cloning & Differential Display
Subtractive cloning is an inexpensive and common technique in individual biomedical and clinical laboratories to analyze gene expression using readily available molecular biology resources. It is a hybridization technique used to detect genes specific to a cell or tissue using a subtraction protocol to remove all common sequences between control and experimental cDNA libraries (i.e., cell type, drug treatment, disease condition etc.) yielding a specific library representing differentially expressed genes. Hybridization of cDNA may cause bias for small fragments of cDNA that hybridize faster than long sequences, but is resolved by PCR amplification [15]. These enriched libraries can be used in conjunction with other transcriptomics techniques, such as microarray or NGS (2.1). Likewise, the other common routine hybridization technique, Differential Display, is a PCR-based method that also detects and measures differential gene expression without using specific primers, making it a robust, inexpensive discovery tool [16]. Current innovations incorporate the use of fluorescent labels with automation to yield high throughput analyses [17,18]. These techniques have been applied successfully to understand molecular and cellular pathways involved in stem cell differentiation by identifying the expressed genes causing lineage commitment into megakaryocytes, erythrocytes, and granulocytes, which play different roles in atherosclerosis disease developmental and disease progression [19].
2.1.2. Modern Hybridization-Based Technologies: Microarrays
In 1995, cDNA microarrays superseded the method of Differential Hybridization, introducing the use of miniature spotted DNA probes and fluorescent labeling of samples, reducing the redundancies after hybridization (Figure 2). Pools of known cDNAs (spots) in indexed locations on glass slides represent known genes (Figure 3A). Total sample mRNA is reverse transcribed, cRNA amplified by in vitro transcription, and then hybridized to microarray slide. The intensities of the spots produced are then recorded and analyzed by computer software to determine the expression level of a gene (Figure 3A) [20]. One advantage of cDNA microarrays over EST or SAGE sequencing techniques (Section 2.1.3) is the ability to analyze gene expression differences under various experimental conditions concurrently by using different fluorophores during the cRNA transcription (Figure 1 and Figure 3A). Microarray analysis requires substantially less poly(A) RNA (0.5–2.0 µg) compared to Subtractive Cloning, Differential Display or EST libraries methods (Figure 1), albeit microarray limitations are the quality, specificity, and signal discrepancy of the probes on the array. After introduction, microarray analysis became common and made labor-intensive EST and SAGE libraries essentially obsolete, despite that this method detects only previously discovered transcripts (e.g., from EST libraries) and its inherent inability to discover novel genes, alleles, or splice variants (Figure 1) [21]. With its high throughput method requiring low manual labor, low amount of starting RNA, and streamlined bioinformatics processing, microarrays provide an attractive alternative to sequencing for transcriptome analysis. Examples of microarray technology use in atherosclerosis research are studies on the impact of cellular senescence on gene expression patterns in vascular smooth muscle cells (VSMCs) [22], and identification of PPAR signaling pathways in animal models of atherosclerosis [23].
2.1.3. First Generation Sequencing: Sanger Sequencing, cDNA libraries, EST and SAGE
Sanger sequencing is the keystone invention for modern methods, such as NGS, to sequence for expressed genes in transcriptomic studies. Sanger sequencing is the “first-generation” method of determining DNA nucleotide sequence based on the chain-termination idea developed in 1975 [24] (Figure 2). Modern modification of this classic method is based on in vitro DNA elongation of target template, which is interrupted by labelled di-deoxynucleotides (ddNTPs) to halt DNA strand synthesis for sorting and fluorescence detection (Figure 3B) [20]. Expressed genes are identified using various methods to harvest RNA to make and use cDNA for expression studies, including subtractive cloning, EST, SAGE, differential display analysis, and microarray analysis (Figure 1 and Figure 3). Once identified, gene interactions with other genes can be pursued experimentally [20]. In the late 1970s, cDNA libraries [25] became popular for gene discovery and expression analysis, as the library clones were stable, reproducible, and recoverable representations of mRNAs isolated from distinct organs and species, although they were not embraced in the field of atherosclerosis for over 10 years until the early 1990s with sequencing of rat and rabbit aorta cDNA libraries (Figure 2) [26,27]. Meaningful data are generated with high throughput preparation of either normalized or non-normalized cDNA libraries [28].
Expressed sequence tags are derived from cDNA libraries by random sampling, followed by arraying and single-pass sequencing of the sampled clones; array replicas may be stored frozen for future use. ESTs allow for de novo gene discovery [26,27], and large-scale prediction of gene products and function (Figure 1) [29,30]. Expressed sequence tags analysis was used to identify genes overexpressed in the mouse model of atherosclerosis [16], and high-quality EST data, including heart and atherosclerosis, are available in Unigene and ENSEMBL. The next development in transcriptomics was SAGE in 1995 (Figure 3C). SAGE constructs cDNA libraries in a similar fashion to ESTs, but the end product are concatenated short tags used to identify genes (Figure 3C). One advantage of the SAGE method is the high-throughput sequencing capability, although the bioinformatics tools required to analyze the libraries are highly specialized. SAGE analysis can be successfully used for de novo expression profiling, but the short length of the SAGE tag can impair differentiating between highly homologous genes. In atherosclerosis research, SAGE was successfully used to study in vitro human endothelial cells response to atherogenic stimulus (conditioned medium of oxidized-LDL-stimulated monocytes) [31], and to identify biomarkers of atherosclerosis in circulating human monocytes [32].
2.2. Next-Generation Sequencing and Deep Transcriptome Analysis
Second generation sequencing techniques emerged in 2005 (Figure 2), and equipment fundamentally differs from first generation sequencers because multiple different DNA molecules are sequenced concurrently. As a result, tens of thousands to hundreds of millions of individual sequencing reads are produced with each run. Different principles underlying sequencing and detection, and different chemistries behind various platforms lead to large differences in read length, base call accuracy, and total number of output reads. The largest obstacle for second generation sequencers is obtaining read length to read quality ratios comparable to Sanger sequencing, with most platforms producing average reads with less than 300 bases. In addition, the samples are sequenced in a stop-read-start manner that leads to lengthy processing times, with some platforms requiring over a week for a single run to complete. To make these platforms economical, the number of reads per run has been increased through the introduction of larger machines, such as the Illumina HiSeq series, or denser chips, in the case of Ion Torrent. However, the larger sequencers have a substantially higher price and require processing at full capacity to benefit from the increased throughput and, consequently, are not typically found in individual laboratories or small research consortia. There are smaller platforms available from Illumina, 454 Roche, and Ion Torrent that produce longer length reads than the larger sequencers, thereby suit the needs of small research consortia and well-funded laboratories [33].
2.2.1. Basic Principles of NGS Sequencing
All second generation sequencing platforms require modification and amplification of sample DNA. Samples are fragmented and adapters are annealed to the ends. For platforms that use emulsion PCR (emPCR) to amplify the samples, the adapters allow the fragments to bind to complementary bases on the emulsion beads. SOLiD sequencing further modifies the fragments after amplification by adding regions that allow the fragments to covalently bond with the sequencer slide. The Illumina platform uses a bridge PCR to amplify the samples, which have been modified with adapters to the base pair with oligonucleotides embedded on the sequencer slide.
Each platform also employs a different method for generating the base calls for each sample, but only Ion Torrent does not use a light-based recording method. The base calls are reported by pyrosequencing (Figure 4) in 454 Roche platforms, and by fluorescent tag cleavage in Illumina and SOLiD platforms. The Illumina platform produces forward and reverse reads from each DNA fragment and SOLiD identifies each fragment’s bases twice, thereby increasing accuracy. Ion Torrent uses a microchip with pH meters incorporated into each well to detect the release of an H+ ion with each base incorporated.
Extension of fragments occurs during sequential “flooding” of the sequencing reaction chamber with solutions containing specific nucleotides. Illumina differs from other platforms by using a reaction mixture containing all 4 nucleotides. The Illumina nucleotides are modified with a fluorescent group plus a terminator to prevent introduction of additional bases in the cycle. The fluorescence is recorded and its tag cleaved before flooding the sequencer with the nucleotide-containing reaction mixture again. In pyrosequencing (Figure 4), the nucleotides have a modified pyrophosphate group that is cleaved after addition. SOLiD sequencing uses di-base oligonucleotides with a 3-base extended region and a fluorescent tag. An (n+1)-long primer is added after each round of synthesis which, after 5 repetitions, emits two base signals for each incorporated nucleotide. Nucleotides in Ion Torrent sequencers are added in alternating “floods” of A, T, C, and G. As each base is paired to the fragment, an H+ ion is released and detected by the sequencer microchip.
2.2.2. Development of Single-Cell RNA Sequencing Strategies
The recent ability to interrogate the transcriptome of individual cells using second generation sequencers has revealed heterogeneity in gene expression of individual cells within a population. As the name implies, single-cell RNA sequencing (scRNA-seq) relies on the isolation and amplification of transcriptomes from individual cells, and many different isolation and amplification strategies have been developed, such as Cel-seq2 [34], Smart-seq2 [35] and Drop-seq [36]. Isolation of individual cells is accomplished by using microfluidic capture chips (Cel-seq2), fluorescence activated cell sorting (Smart-seq2), or droplet emulsion (Drop-seq). Most scRNA-seq protocols, excluding Smart-seq, incorporate cell-specific barcodes during the reverse transcription reaction that allows for large-scale multiplexing. Smart-seq, in contrast to other scRNA-seq methods, generates full length cDNA and can more accurately differentiate between splice variants. A side-by-side comparison of these scRNA-seq strategies found that Drop-seq was the most cost-effective method, whereas Smart-seq was the most accurate [37]. Analyzed cells may be clustered based on expression levels of selected genes either to detect changes in cell populations or within a population induced by a disease. This strategy to separate and sequence by cell type was recently used to analyze normal and atherosclerotic aortas from mice and detected a previously unreported population of macrophages that expressed high levels of triggering receptor expressed in myeloid cells 2 (Trem2) gene in diseased aortas, including atherosclerosis [38].
2.2.3. Strengths & Caveats for Transcriptome Analysis
Next generation sequencers are powerful tools, but they are not without flaws and errors that can arise at any step of the sequencing process. Firstly, errors may be introduced by polymerase during the amplification of sample cDNA, and research indicates that this may be the primary source of errors in second generation sequencing data [39]. Secondly, errors originate from the chemistry used by the various platforms, and often manifest in nucleotide substitutions, insertions, or deletions [33]. The error rates of second generation sequencers are principally increased in homopolymeric regions caused by the incorporation of multiple bases in a single cycle. AT-enriched regions and genomes cause increased error rates in next generation sequencers, possibly from PCR artifacts and nonrandom fragmentation of sample DNA [40]. Errors due to AT-richness are most pronounced in the Ion Torrent platforms [41]. Furthermore, when utilizing single-cell sequencing strategies, comparison between samples can be greatly impaired by poor matching of samples, the stages of disease progression, and the variability between individuals can compound the inherent heterogeneity that is present when comparing individual cells. While the ability to determine the response and contribution of individual cell types to disease progression is important, more samples are necessary to identify and distinguish between inter-individual and intra-individual variations.
For next-generation RNAseq analysis, the most important parameters to consider in experimental design in order to substantially increase the quality of downstream analysis are: the number of biological replicates, the depth of sequencing (i.e., number of reads produced for each sample), read length, single-end vs. pair-end sequencing (i.e., each sequenced DNA molecule is represented by a single strand read vs. two reads from each strand), and RNA extraction. Under budgetary constraints, tradeoffs between sequencing depth and the amount of biological replicates are often made. As consistently reported, the requisite number of biological replicates (n = 3–4) is more critical for robust, reliable, and replicable analysis than sequencing depth [42,43,44,45]. As technologies improve, sequence lengths increase. For differential expression, little difference is seen if the length is >25 bps, in either single-end or pair-end sequencing. However, for greater accuracy in transcript identification and splice junction detection, reads should be pair-end and ≥100 bp [46]. The RNA extraction method impacts the ratio of RNAs present during sequencing, and a specific strategy should be chosen with the biological or biomedical question of interest in mind. For example, total RNA extraction is useful in capturing unique transcriptome features, such as noncoding RNA. However, ribosomal RNA (rRNA) comprises >90% of total RNA and should be depleted if noncoding, non-ribosomal RNA is to be assessed. Current techniques cannot completely remove rRNA, and ~2%–35% residual remains in the sample. Therefore, greater sequencing depth should be considered when using ribosomal depletion methods to counter the abundance of rRNA and improve detection of other transcripts. In eukaryotic organisms, if only protein coding genes are of interest, poly(A) selection yields greater accuracy of transcript quantification [47]. These issues are particularly critical for clinical samples from patients, which are routinely processed as formalin-fixed, paraffin-embedded (FFPE) samples, which adversely impact the quality of RNA and subsequent alignment to pseudogenes [48]. Fortuitously, side-by-side comparison of FFPE and flash-frozen samples shows a great degree of concordance (e.g., r2 in the range of 0.90–0.97 in recent studies [49,50]), proving RNAseq is a viable tool for gene quantification in clinical settings. Controls, depending upon availability, need to be non-diseased tissue, either of the same patient origin or from another individual without the disease [51]. In addition, given atherosclerosis is a common disease, patients are from genetically diverse, heterogeneous populations with variable symptomology, which requires more samples to detect meaningful changes in the transcriptome truly reflecting disease process. However, in other diseases, such as breast cancer, as few as n = 9–10 patient samples (plus samples of healthy controls), have been ample to detect specific alleles and molecular pathways [51].
Despite the errors that may occur when using second generation sequencers, several advantages over the original transcriptome technologies, such as Sanger sequencing, EST and SAGE (Figure 1, Section 2.1), warrant their use experimentally and clinically. First of all, second generation sequencers offer orders of magnitude deeper coverage of sample RNA than achieved by Sanger sequencing, via EST libraries, yielding overall faster discovery and more accurate analysis of an entire transcriptome. Also, the length and quality of sequence produced by second generation sequencers are much better than the fragments produced in SAGE, which improves transcriptome accuracy. While EST sequencing typically produced fragments of at least 500 bp, most second-generation sequencing produces shorter read lengths, albeit, read length from second generation sequencers can be increased at the expense of read depth. Next generation sequencers have advantages over microarrays because essentially all expressed transcripts and their variants can be detected, without restriction to the probes present on the microarray chip or beads [52], plus the ability to barcode different samples, or conditions, within a single sequencing procedure permits multiplexing of samples.
2.3. Third Generation Sequencing
The latest generation of sequencers is distinguished from first and second generations by eliminating sample amplification. Bypassing sample amplification reduces sample preparation time and eliminates signal mismatch and distortion errors introduced during amplification. In addition, these single-molecule sequencers produce extremely long reads, surpassing the lengths achieved by Sanger sequencing. The Pacific Biosciences Single Molecule Real Time (SMRT) sequencer utilizes pyrosequencing (Figure 4) in polymerase-embedded plates, which lower the signal-to-noise ratio to detect real-time signal processing of fluorophore cleavage. The use of pyrophosphate-labeled nucleotides in polymerase-containing plates to extend DNA at near its natural speed facilitates processivity and output length of sequencing read. Another third generation sequencing platform available now is nanopore sequencing (MinION, Oxford Nanopore Technologies, Oxford Science Park, Oxford, UK). This technology utilizes electrophoresis of DNA molecules via nanopores (5–8 nm diameter); as the DNA molecules squeeze through the pore, each nucleotide (A, T, G and C) produces a unique electromagnetic signature is detected. Similar to SMRT, nanopore sequencing can produce very long reads, up to 880 kb in a recent report [53].
Strengths & Caveats for Transcriptome Analysis
The Nanopore and SMRT sequencer both have ~10–15% error rate, distributed evenly over the length of the read [53]. Fortunately, the lack of location bias in SMRT and Nanopore reads provide sufficient coverage to extrapolate highly accurate consensus sequences. Third generation sequencers are not yet ubiquitous, but they promise several advantages over previous generation sequencers. The lack of sample amplification allows for quicker, cheaper analysis and avoids the polymerase errors caused by amplification. The long reads generated by third generation sequencers allow for more accurate assembly of large contiguous sequences, such as whole chromosomes, complete sequencing of whole genes in a single read [54], and identification of novel transcript isoforms. These platforms are excellent for whole-genome and whole-transcriptome assemblies [55,56], including complex genomes such as gorilla [57] and human [53]. However, at this time, third generation sequencers are at a disadvantage for use in transcriptome analysis for quantification of expression due to the relatively low number (e.g., ~50,000 for RSII sequencer) of output reads generated with each run comparing to, e.g., Illumina sequencers (current typical low-end is 20,000,000+ reads per sample). The long reads greatly improve de novo assembly and transcriptome analysis for gene isoform identification, and the emerging technology in the field of metagenomics, which may be important for investigating the role of microorganisms in the onset of atherosclerosis. Longer reads are also useful when assembling genomes that include large stretches of repetitive regions. These technologies are recommended for whole genome assembly and splice variant detection, albeit given the error rate currently not recommended for transcript quantification.
3. Results of Transcriptome Analysis: Unbiased Data Mining to Find a Needle in a Haystack
3.1. Differential Expression Analysis
In most cases, comparison of one or more conditions will result in a ranked list of transcripts with either relative or absolute levels of expression. The typical approaches include: (1) raw data collection (processing of image files to collect intensities for individual probes on microarrays, counts of number of reads per transcript for RNAseq data, etc.); (2) data normalization, often followed by transformation [58]; (3) statistical analysis to identify transcripts whose expression differences between conditions are significant, and most importantly, (4) downstream analysis (Figure 5).
Microarrays of any platform are substantially more rapid to process using the manufacturers’ software suites, such as Affymetrix’s Expression Console and Transcriptome Analysis Console, or Illumina’s GenomeStudio. Alternative open-source, peer-reviewed, and publicly available software for microarray analyses using the R programming language, such as affy [59], lumi [60] and limma [61], are available as installation packages from the Bioconductor portal [62]. For next-generation RNAseq analysis, the most important parameters to consider in experimental design that substantially increases the quality of downstream analysis are depth of sequencing (i.e., number of reads produced for each sample, also referred to as “coverage”), read length, and single-end vs. paired-end sequencing. These parameters vary based on the goal of the biological or clinical experiment. For example, comparison of expression between samples requires far less read depth than the identification of novel transcripts or splice variants. Journals that publish RNAseq studies sometimes have their own requirements for read depth. Furthermore, the length of sequencing reads varies depending on experimental design, with longer reads typically being used in novel transcript identification or de novo assembly generation [56]. Sequence read lengths as low as 75 bases are sufficient for differential expression analysis [43]. Finally, paired-end sequencing from both ends of a single mRNA fragment facilitates identifying splice variants and alignment [46].
Once the sequence is obtained from the raw signals, the quality of the output must be assessed, based on sequence read lengths and processing direction (single-end vs. paired-end sequencing) with either FastQC [63] or NGSQC [64]. These tools will provide GC content, overrepresented reads, PCR artifacts, and sequence quality to detect potential PCR bias or DNA contamination. It is normal for sequence quality to weaken at 3′ end and software programs, such as Trimmomatic [65] or FastQ trimmer [66], can remove these low-quality 3′ ends. Alignment is a critical step in RNA sequencing analysis because raw sequence reads must be mapped precisely to an annotated reference genome or transcriptome for the species. While it is possible to analyze RNAseq data without a reference, e.g., by using Trinity software [67], most clinical and translational models of atherosclerosis have assembled genomes available. The most common software platforms to align RNA sequence to a reference genome are TopHat [68], HiSAT [69], and STAR [70]. These platforms differ with respect to speed, memory usage, and their algorithms for handling pseudogenes [48], base and splice junction alignment precision, with HiSAT and STAR optimized to process large datasets (>108 reads), whereas TopHat is designed for smaller datasets (<2 × 107 reads).
Measurement of transcript expression in RNAseq data is based on quantifying raw counts at each genetic locus along the chromosomes using an assembled genome with programs such as HTSeq-count [71] or featureCounts [72]. This approach uses a GFF (Generic Feature Format) or GTF (General Transfer Format) file that contains gene coordinates, identifiers, and descriptions in a strict predefined format [73]. All the reads that map within the genomic coordinates of a given feature (e.g., gene, exon) contribute to the count number of this feature. The counts from the RNAseq data are corrected for sequencing depth, and often for length of gene transcripts because smaller datasets will have fewer count numbers, with the consequence that longer transcripts will have a higher representation among raw RNAseq reads. The majority of normalization methods report the amount of transcript expression as reads per kilobase of exon per million reads (RPKM), fragments per kilobase of exon per million of reads (FPKM), transcripts per million (TPM), or counts per million (CPM) [48,74,75,76].
3.2. Categorical Enrichment Analysis: An Overview of Biological Ontologies
Description of gene functions in scientific literature can vary significantly among authors, even if all of them are describing the same phenomenon. Consequently, unbiased grouping of genes by functional similarities may become a daunting endeavor. To facilitate the task of classifying the universe of genes, the methods of formal ontology were applied to create the first controlled vocabulary to standardize gene descriptions across species and disciplines. The resulting Gene Ontology (GO), and GO Consortium were formed in 1998 to create a framework for standardizing gene products description [77]. Since its inception, GO was used to annotate millions of genes, with over 1,350,000 annotations for H. sapiens, R. norvegicus, and M. musculus genes alone [78] (Figure 6A). The highest-level annotations for genes in GO is a “trinity” of Molecular Function, Cellular Component, and Biological Process hierarchies. Currently, GO uses 29,623 “Biological Process”, 11,139 “Molecular Function”, and 4,189 “Cellular Component” terms, and strict rules to describe evidence linking a gene to a term (from relatively vague “Inferred from Sequence or structural Similarity” to strong “Inferred from Experiment”), to annotate genes across the tree of life (Figure 6B); taking into account the total number of annotated genes in species (Figure 6C), currently average number of GO annotations ranges from 5 for E. coli to 21 for R. norvegicus.
GO is organized as a graph, with individual terms being nodes, and relationships between terms being edges. For example, one of the GO annotations of an “atherosclerosis gene” Apoe is “regulation of cholesterol transport (GO:0032374)”; the relationship of this term to higher-level terms is shown in Figure 7A. Currently, there are eight types of relationships between terms, and the “is_a” relationship gives this ontology a loose hierarchy, with more general terms being “parent” to more specific “child” terms [77]; other common relationships are “part_of” and “regulates” (Figure 7A). Curation remains an ongoing process, including the field of cardiovascular disease and atherosclerosis [79], and new annotations, and new GO terms are added frequently as scientific and specific knowledge expands. The dynamic nature of GO catalyzes new discoveries to be readily integrated into the existing ontology, while older annotations are updated with new information as it becomes available. Following the success of GO, other ontologies began to emerge to formalize biological and biomedical knowledge to assist in large-scale data analysis and discovery of new treatment avenues. Relevant examples (Table 1) include Mammalian Phenotype Ontology [80] and Human Disease Ontology [81,82], both used to formalize descriptions of normal and disease phenotypes, in our example specific for atherosclerosis (Figure 7B,C). Another example Ontology, Protein Ontology, describes evolutionary relation, isoforms, and complexes of proteins [83,84]. All these, and many other ontologies collectively form an Open Biological and Biomedical Ontology (OBO) Foundry and share common goals to facilitate curation, management, distribution, and analysis of data [85].
Table 1.
Resource | Description | URL | Ref |
---|---|---|---|
Databases: | |||
Gene Ontology | Central repository of terms describing gene functions across multiple biological systems | http://geneontology.org/ | [77] |
Mammalian Phenotype Ontology | Biomedical curators’ and community database of ontological terms for annotating phenotypic data | http://www.informatics.jax.org/vocab/mp_ontology/ | [80] |
Human Disease Ontology | Ontology for human disease cross-mapped to MeSH, ICD, NCI’s thesaurus, SNOMED and OMIM. | http://disease-ontology.org/ | [81] |
Protein Ontology | Ontology of protein-related entities, their explicit definitions, and relationships between them. | https://proconsortium.org/pro/pro.shtml | [84] |
Open Biological Ontologies | Collaborative effort to specify and implement best principles and practices in ontology development. Contains links to all Ontologies. | http://obofoundry.org/ | [85] |
MSigDB | A collection of annotated gene sets, such as canonical pathways gene sets, for use with GSEA. | http://software.broadinstitute.org/gsea/msigdb/index.jsp | [86] |
MetaCyc | A curated database of experimentally elucidated metabolic pathways for many organisms. | https://metacyc.org/ | [87] |
KEGG | A collection of maps representing metabolism, pathways, and associated genes. | https://www.genome.jp/kegg/ | [88] |
Reactome | A free, open-source, curated and peer-reviewed pathway database. | https://reactome.org/ | [89] |
Tools: | |||
VLAD | Tool for identification of statistically significant over- or under-represented ontology terms in lists of genes. GO gene – function annotations for human and mouse, and MP gene – phenotype annotations for mouse are pre-loaded. Allows uploading user-specified ontologies and gene – ontology mappings. Updated weekly. | http://proto.informatics.jax.org/prototypes/vlad/ | [90] |
AmiGO | Allows users to query, browse and visualize ontologies and gene annotation data for many species. Updated weekly. | http://amigo.geneontology.org/amigo | [78] |
GOrilla | A tool to identify and visualize enriched GO terms in gene lists. Can either search for GO terms at the top of a ranked gene list, or compare a target gene list to a background gene list. | http://cbl-gorilla.cs.technion.ac.il/ | [91] |
DAVID | A set of tools to identify overrepresented features in large lists of genes. | https://david.ncifcrf.gov/ | [92] |
BinGO | Cytoscape tool to visualize statistically overrepresented GO terms in a list of genes. | http://apps.cytoscape.org/apps/bingo 1 | [93] |
GSEA | A tool to determine if a gene set has significant differences between two biological states. | http://software.broadinstitute.org/gsea/downloads.jsp 1 | [86] |
1 Download link for a stand-alone tool.
4. Discussion: Using Ontologies & Pathway Analysis for Precision Medicine
Unlike DNA sequencing focusing on genome, RNA sequencing produces the snapshot of the full transcriptome supporting its potential capability to fulfill precision medicine to classify patients at both molecular and cellular levels when used in conjunction with programs for ontologies and pathway analysis. Development of RNA sequencing pipelines is important for implementation of transcriptomics as precision medicine [94], which can be used successfully to classify patient or model attributes and predict therapeutic response and ultimate outcomes [48].
The first step of ontological analysis of genes is the annotation of the gene, assuming it has not been previously annotated. Once all the gene annotations have been collected they are grouped by category, and these categories are analyzed for enrichment or depletion against a “universe set” of all the genes of an organism. The number of annotations to a distinct ontological term in a list of genes, for example, a list of downregulated genes in atherosclerotic vs. normal aorta is compared to the number of annotations to this term among genes in the universe set (i.e., all genes in the genome) to identify if the occurrence of this term in the experimental results is higher or lower than expected from a random sampling of the universe set. This analysis facilitates discovery of common biological themes, based on ontologies, within the lists of genes. Multiple tools exist for determining pathway enrichment; among preferred tools in our laboratory is the VisuaL Annotation Display (VLAD) [85], which allows to define the “universe set” (i.e., the background list of genes), rather than just GO. An example of VLAD analysis (Figure 7D) compares the overrepresented GO terms among the 100 highest-expressed genes in aortas of Apoe-/- mice fed Western diet, and the 100 highest-expressed genes in aortas of high-fat, high-cholesterol fed New Zealand White (NZW) rabbits (data from [94]), and illustrates similarities and differences between these two translational models of atherosclerosis. In this example, the lists of the highest-expressed genes (and thus presumably most important “housekeeping” genes involved in the disease) are independently analyzed to identify the common overrepresented GO categories for each list (i.e., for both rabbit and mouse aortas). In addition, VLAD allows visual comparison between two model organisms, such as mice vs. rabbits (Figure 7D), to pinpoint the commonalities and differences in “themes” of gene expression changes, based on differences in the statistical P-value of the over-represented GO terms (i.e., the relative width of the bar, Figure 7D). For example, “angiogenesis” genes have “more significant” over-representation among the 100 highest-expressed genes in rabbit atherosclerotic aortas, and “phagocytosis, engulfment” genes have “more significant” over-representation in the mouse model. In the interactive VLAD version, the output also has lists of genes from the user’s input associated with each overrepresented GO term, p-values, FDR q-values, etc. In particular, the ability to upload own “universe set” of genes allows for more precise identification of over- and underrepresented ontologies, while the ability to upload any ontology from OBO Foundry allows for the exploration of additional ontologies such as Mammalian Phenotype (Figure 7B,C) [80]. Importantly, in the online version of VLAD, GO annotations, as well as nomenclature of mouse and human genes are automatically updated weekly [90], although local installation of VLAD requires the individual laboratory to manually update gene annotations from GO. Similar tools, such as AmiGO [78], BiNGO [93], DAVID [92], GOrilla [91] (Table 1), are also very popular free peer-reviewed public resources to identify GO term overrepresentations in the lists of genes; however, many of these otherwise excellent tools lag behind in updating their gene-to-ontology annotations and mappings by as much as three to four years. Similar idea of measuring and testing overrepresentation within a group of genes of interest is implemented in Gene Set Enrichment Analysis (GSEA) [86], and commercial platforms such as Ingenuity Pathway Analysis (IPA) [95] and Pathway Studio [96].
Another useful tool to identify specific pathways in the large-scale gene expression data is MetaCyc [87], which contains a collection of curated biochemical pathways, annotated with organism-specific data on genes, pathways, proteins and compounds. MetaCyc tool, Cellular Overview, allows the user to upload gene expression data and visualize the expression upon the entire metabolic map while simultaneously retaining the ability to focus on individual pathways affected by disease or condition, such as aorta samples from atherosclerosis samples [85]. For mammals, curated databases currently include human [97], mouse [98] and cattle [99]. Differentially expressed gene lists can also be overlaid onto existing cellular pathways using portals such as Reactome [89] or the Kyoto Encyclopedia of Genes and Genomes (KEGG) [88] to explore potential secondary pathways, and dysregulated pathways specific to atherosclerotic pathology or healthy samples. Importantly, research community involvement in the process of gene annotation and curation, including creation of disease-specific ontology terms, improves the precision and quality of these resources to atherosclerosis and heart disease research [79].
Precision medicine classifies individuals according to their underlying susceptibility, prognosis, or targeting potential treatment response. Transcriptomics is an exciting tool for precision medicine, as it allows for a quick, unbiased and cost-effective identification of potential specific targets based on their under- or overexpression in the individual disease, without the need for a much more complex patient whole-genome analysis. Classifying patients based on symptoms is limited because symptoms often arise from numerous origins or multimodal pathways, as is the case with atherosclerosis. Biomedical researchers in both clinical and basic research settings need to choose transcriptome analysis to the specific characteristics of disease, and its pathology, to detect changes in the target molecular, cellular and physiological pathways under scientific scrutiny. Transcriptomics is a robust method to measure both common and unique pathways simultaneously. For unbiased detection in molecular and cellular pathways, researchers need to use a variety of tools, from read alignment to ontological analysis. Indeed, analyzing the data produced by transcriptome analysis facilitates researchers to explore gene functions, expression levels, differential gene expression, organismal responses to environmental and developmental changes, etc. in their totality, rather than narrowly focusing on specific, however they may seem to be important, pathways or genes. Embracing unbiased approaches to gene expression analysis can allow for the identification of novel disease biomarkers or even highly specific drugs, particularly impressive in the field of cancer [100], but also adopted by cardiovascular disease research community, such as discovery of the role of the RNA editing gene ADAR1 in atherosclerosis [101], or the upregulation of estrogen receptor signaling pathways in women with myocardial infraction with nonobstructive coronary artery disease caused by atherosclerosis [102]. The ongoing NHLBI TOPmed (Trans-omics for precision medicine) effort to generate ~150,000 individual genomes’ sequences and ~50,000 transcriptomes for the most prevalent cardiovascular diseases, including coronary artery disease induced by atherosclerosis, will undoubtedly lead to new exciting discoveries [103]. Thus, when analyzing transcriptomes of samples, the key focus is the difference of expression levels of various groups of functionally related genes. Although the application of transcriptomics to the field of atherosclerosis as precision medicine is in its infancy, with these few aforementioned examples [101,102], its usefulness is actively being tested [103]. This paper serves as a resource article for tools, especially for investigators with limited experience, to embrace transcriptomic techniques applicable in atherosclerosis research, and ultimately to fulfill their promise for precision medicine.
5. Conclusions
Transcriptome analysis is an exciting tool, whose efficacy and efficiency are continually improving. The variety of platforms available to perform such analyses is a great advantage to laboratories both large and small, and the high-throughputs for some of these technologies provide rapid results with great accuracy. Identification of affected pathways using transcriptomics bioinformatics tools will allow researchers and clinicians to make a focused and informed decision upon the genes to concentrate on as potential therapeutic targets in precision medicine. The application of transcriptomics can facilitate the exploration of underlying pathogenic mechanisms, identification of genetic variants, determination of treatment effects, including screening for molecular biomarkers. Importantly, expression signatures in diseased phenotypes may pinpoint precise interventions required to alleviate the disease state, a goal of precision medicine, without a need for the cost prohibitive personalized assembly and deep analysis of patient’s genome. Thus, transcriptomics can classify individuals while simultaneously facilitate discovery, testing, and the validation of new therapeutics for patients with atherosclerosis, defined at the cellular and molecular levels.
Acknowledgments
GO is supported by the National Institutes of Health (NIH), National Human Genome Research Institute (NHGRI), USA, HG002273 awarded to Judith A. Blake (The Jackson Laboratory). MetaCyc is a part of the BioCyc Database Consortium partially supported by NIH grant GM080746 from the National Institute of General Medical Sciences (NIGMS) and partially by BioCyc subscription revenues.
Author Contributions
Conceptualization, C.M.E., I.D.R., J.L., G.J., A.V.E.; methodology & software, C.M.E., I.D.R., J.L., G.J., A.V.E.; resources, C.M.E. & A.V.E.; data curation, A.V.E.; writing—original draft preparation, C.M.E., I.D.R., J.L., G.J., A.V.E.; writing—review & editing, C.M.E., A.V.E., I.D.R., J.L.; visualization, C.M.E., J.L., G.J., A.V.E.; supervision & project administration, C.M.E. & A.V.E.; funding acquisition, C.M.E. & A.V.E.
Funding
Funds partially supporting this research were from Impact Assets, Fund for Science (Epigenetics & Functional Genomics Lab to C.M.E. & A.V.E.) and Graduate Student Success Fellowship from the Office of Graduate Studies, University of South Florida to IR.
Conflicts of Interest
The authors declare no conflict of interest. The founding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.
References
- 1.McNeal C.J., Dajani T., Wilson D., Cassidy-Bushrow A.E., Dickerson J.B., Ory M. Hypercholesterolemia in youth: Opportunities and obstacles to prevent premature atherosclerotic cardiovascular disease. Curr. Atheroscler. Rep. 2010;12:20–28. doi: 10.1007/s11883-009-0072-0. [DOI] [PubMed] [Google Scholar]
- 2.Tresch D.D., Aronow W.S. Tresch and Aronow’s Cardiovascular Disease in the Elderly. 5th ed. CRC Press; Boca Raton, FL, USA: 2014. p. 800. [Google Scholar]
- 3.Ohsfeldt R.L., Gandhi S.K., Fox K.M., Bullano M.F., Davidson M. Medical and cost burden of atherosclerosis among patients treated in routine clinical practice. J. Med. Econ. 2010;13:500–507. doi: 10.3111/13696998.2010.506348. [DOI] [PubMed] [Google Scholar]
- 4.Kochanek K.D., Murphy S.L., Xu J.Q., Arias E. Mortality in the United States, 2013. National Center for Health Statistics; Hyattsville, MD, USA: 2014. [Google Scholar]
- 5.Torio C.M., Moore B.J. National Inpatient Hospital Costs: The Most Expensive Conditions by Payer, 2013. Agency for Healthcare Research and Quality; Rockville, MD, USA: 2016. [PubMed] [Google Scholar]
- 6.Pant S., Deshmukh A., GuruMurthy G.S., Pothineni N.V., Watts T.E., Romeo F., Mehta J.L. Inflammation and atherosclerosis—Revisited. J. Cardiovasc. Pharmacol. Ther. 2014;19:170–178. doi: 10.1177/1074248413504994. [DOI] [PubMed] [Google Scholar]
- 7.Lau W.L., Ix J.H. Clinical detection, risk factors, and cardiovascular consequences of medial arterial calcification: A pattern of vascular injury associated with aberrant mineral metabolism. Semin. Nephrol. 2013;33:93–105. doi: 10.1016/j.semnephrol.2012.12.011. [DOI] [PubMed] [Google Scholar]
- 8.McGill H.C., McMahan C.A., Gidding S.S. Preventing heart disease in the 21st century. Circulation. 2008;117:1216–1227. doi: 10.1161/CIRCULATIONAHA.107.717033. [DOI] [PubMed] [Google Scholar]
- 9.Torres N., Guevara-Cruz M., Velázquez-Villegas L.A., Tovar A.R. Nutrition and atherosclerosis. Arch. Med. Res. 2015;46:408–426. doi: 10.1016/j.arcmed.2015.05.010. [DOI] [PubMed] [Google Scholar]
- 10.Libby P., Ridker P.M., Hansson G.K. Progress and challenges in translating the biology of atherosclerosis. Nature. 2011;473:317–325. doi: 10.1038/nature10146. [DOI] [PubMed] [Google Scholar]
- 11.O’Malley J.P., Maslen C.L., Illingworth D.R. Angiotensin-converting enzyme DD genotype and cardiovascular disease in heterozygous familial hypercholesterolemia. Circulation. 1998;97:1780–1783. doi: 10.1161/01.CIR.97.18.1780. [DOI] [PubMed] [Google Scholar]
- 12.Huang S., Shui X., He Y., Xue Y., Li J., Li G., Lei W., Chen C. AhR expression and polymorphisms are associated with risk of coronary arterial disease in Chinese population. Sci. Rep. 2015;5:8022. doi: 10.1038/srep08022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Slooter A.J., van Duijn C.M., Bots M.L., Ott A., Breteler M.B., De Voecht J., Wehnert A., de Knijff P., Havekes L.M., Grobbee D.E., et al. Apolipoprotein e genotype, atherosclerosis, and cognitive decline: The Rotterdam study. J. Neural Transm. Suppl. 1998;53:17–29. doi: 10.1007/978-3-7091-6467-9_3. [DOI] [PubMed] [Google Scholar]
- 14.Elosua R., Ordovas J.M., Cupples L.A., Fox C.S., Polak J.F., Wolf P.A., D’Agostino R.A., O’Donnell C.J. Association of apoe genotype with carotid atherosclerosis in men and women: The framingham heart study. J. Lipid Res. 2004;45:1868–1875. doi: 10.1194/jlr.M400114-JLR200. [DOI] [PubMed] [Google Scholar]
- 15.Sagerström C.G., Sun B.I., Sive H.L. Subtractive cloning: Past, present, and future. Annu. Rev. Biochem. 1997;66:751–783. doi: 10.1146/annurev.biochem.66.1.751. [DOI] [PubMed] [Google Scholar]
- 16.Boräng S., Andersson T., Thelin A., Odeberg J., Lundeberg J. Vascular gene expression in atherosclerotic plaque-prone regions analyzed by representational difference analysis. Pathobiology. 2004;71:107–114. doi: 10.1159/000074426. [DOI] [PubMed] [Google Scholar]
- 17.Meade J.D., Cho Y.J., Fisher J.S., Walden J.C., Guo Z., Liang P. Automation of fluorescent differential display with digital readout. Methods Mol. Biol. 2006;317:23–57. doi: 10.1385/1-59259-968-0:023. [DOI] [PubMed] [Google Scholar]
- 18.Shimkets R.A., Lowe D.G., Tai J.T.-N., Sehl P., Jin H., Yang R., Predki P.F., Rothberg B.E.G., Murtha M.T., Roth M.E., et al. Gene expression analysis by transcript profiling coupled to a gene database query. Nat. Biotechnol. 1999;17:798–803. doi: 10.1038/11743. [DOI] [PubMed] [Google Scholar]
- 19.Liu X.L., Yuan J.Y., Zhang J.W., Zhang X.H., Wang R.X. Differential gene expression in human hematopoietic stem cells specified toward erythroid, megakaryocytic, and granulocytic lineage. J. Leukoc. Biol. 2007;82:986–1002. doi: 10.1189/jlb.0107014. [DOI] [PubMed] [Google Scholar]
- 20.Carulli J.P., Artinger M., Swain P.M., Root C.D., Chee L., Tulig C., Guerin J., Osborne M., Stein G., Lian J., et al. High throughput analysis of differential gene expression. J. Cell. Biochem. 1998;72:286–296. doi: 10.1002/(SICI)1097-4644(1998)72:30/31+<286::AID-JCB35>3.0.CO;2-D. [DOI] [PubMed] [Google Scholar]
- 21.Liang P., Pardee A.B. Analysing differential gene expression in cancer. Nat. Rev. Cancer. 2003;3:869–876. doi: 10.1038/nrc1214. [DOI] [PubMed] [Google Scholar]
- 22.Burton D.G.A., Giles P.J., Sheerin A.N.P., Smith S.K., Lawton J.J., Ostler E.L., Rhys-Williams W., Kipling D., Faragher R.G.A. Microarray analysis of senescent vascular smooth muscle cells: A link to atherosclerosis and vascular calcification. Exp. Gerontol. 2009;44:659–665. doi: 10.1016/j.exger.2009.07.004. [DOI] [PubMed] [Google Scholar]
- 23.Verreth W., De Keyzer D., Pelat M., Verhamme P., Ganame J., Bielicki J.K., Mertens A., Quarck R., Benhabilès N., Marguerie G., et al. Weight loss–associated induction of peroxisome proliferator–activated receptor-α and peroxisome proliferator–activated receptor-γ correlate with reduced atherosclerosis and improved cardiovascular function in obese insulin-resistant mice. Circulation. 2004;110:3259–3269. doi: 10.1161/01.CIR.0000147614.85888.7A. [DOI] [PubMed] [Google Scholar]
- 24.Sanger F., Coulson A.R. A rapid method for determining sequences in DNA by primed synthesis with DNA polymerase. J. Mol. Biol. 1975;94:441–448. doi: 10.1016/0022-2836(75)90213-2. [DOI] [PubMed] [Google Scholar]
- 25.Sim G.K., Kafatos F.C., Jones C.W., Koehler M.D., Efstratiadis A., Maniatis T. Use of a cDAN library for studies on evolution and developmental expression of the chorion multigene families. Cell. 1979;18:1303–1316. doi: 10.1016/0092-8674(79)90241-1. [DOI] [PubMed] [Google Scholar]
- 26.Koch W.J., Ellinor P.T., Schwartz A. cDNA cloning of a dihydropyridine-sensitive calcium channel from rat aorta. Evidence for the existence of alternatively spliced forms. J. Biol. Chem. 1990;265:17786–17791. [PubMed] [Google Scholar]
- 27.Sohma Y., Suzuki T., Sasano H., Nagura H., Nose M., Yamamoto T. Increased mRNA for CD63 antigen in atherosclerotic lesions of Watanabe heritable hyperlipidemic rabbits. Cell Struct. Funct. 1994;19:219–225. doi: 10.1247/csf.19.219. [DOI] [PubMed] [Google Scholar]
- 28.Nagaraj S.H., Gasser R.B., Ranganathan S. A hitchhiker’s guide to expressed sequence tag (est) analysis. Brief. Bioinform. 2007;8:6–21. doi: 10.1093/bib/bbl015. [DOI] [PubMed] [Google Scholar]
- 29.Strausberg R.L., Feingold E.A., Klausner R.D., Collins F.S. The mammalian gene collection. Science. 1999;286:455–457. doi: 10.1126/science.286.5439.455. [DOI] [PubMed] [Google Scholar]
- 30.Strausberg R.L., Feingold E.A., Grouse L.H., Derge J.G., Klausner R.D., Collins F.S., Wagner L., Shenmen C.M., Schuler G.D., Altschul S.F., et al. Generation and initial analysis of more than 15,000 full-length human and mouse cDNA sequences. Proc. Natl. Acad. Sci. USA. 2002;99:16899–16903. doi: 10.1073/pnas.242603899. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.de Waard V., van den Berg B.M.M., Veken J., Schultz-Heienbrok R., Pannekoek H., van Zonneveld A.-J. Serial analysis of gene expression to assess the endothelial cell response to an atherogenic stimulus. Gene. 1999;226:1–8. doi: 10.1016/S0378-1119(98)00577-0. [DOI] [PubMed] [Google Scholar]
- 32.Patino W.D., Mian O.Y., Kang J.-G., Matoba S., Bartlett L.D., Holbrook B., Trout H.H., Kozloff L., Hwang P.M. Circulating transcriptome reveals markers of atherosclerosis. Proc. Natl. Acad. Sci. USA. 2005;102:3423–3428. doi: 10.1073/pnas.0408032102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Glenn T.C. Field guide to next-generation DNA sequencers. Mol. Ecol. Resour. 2011;11:759–769. doi: 10.1111/j.1755-0998.2011.03024.x. [DOI] [PubMed] [Google Scholar]
- 34.Hashimshony T., Senderovich N., Avital G., Klochendler A., de Leeuw Y., Anavy L., Gennert D., Li S., Livak K.J., Rozenblatt-Rosen O., et al. Cel-seq2: Sensitive highly-multiplexed single-cell RNA-seq. Genome Biol. 2016;17:77. doi: 10.1186/s13059-016-0938-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Picelli S., Faridani O.R., Björklund Å.K., Winberg G., Sagasser S., Sandberg R. Full-length RNA-seq from single cells using smart-seq2. Nat. Protoc. 2014;9:171. doi: 10.1038/nprot.2014.006. [DOI] [PubMed] [Google Scholar]
- 36.Macosko E.Z., Basu A., Satija R., Nemesh J., Shekhar K., Goldman M., Tirosh I., Bialas A.R., Kamitaki N., Martersteck E.M., et al. Highly parallel genome-wide expression profiling of individual cells using nanoliter droplets. Cell. 2015;161:1202–1214. doi: 10.1016/j.cell.2015.05.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Ziegenhain C., Vieth B., Parekh S., Reinius B., Guillaumet-Adkins A., Smets M., Leonhardt H., Heyn H., Hellmann I., Enard W. Comparative analysis of single-cell RNA sequencing methods. Mol. Cell. 2017;65:631–643.e4. doi: 10.1016/j.molcel.2017.01.023. [DOI] [PubMed] [Google Scholar]
- 38.Cochain C., Vafadarnejad E., Arampatzi P., Pelisek J., Winkels H., Ley K., Wolf D., Saliba A.E., Zernecke A. Single-cell RNA-seq reveals the transcriptional landscape and heterogeneity of aortic macrophages in murine atherosclerosis. Circ. Res. 2018;122:1661–1674. doi: 10.1161/CIRCRESAHA.117.312509. [DOI] [PubMed] [Google Scholar]
- 39.Brodin J., Mild M., Hedskog C., Sherwood E., Leitner T., Andersson B., Albert J. PCR-induced transitions are the major source of error in cleaned ultra-deep pyrosequencing data. PLoS ONE. 2013;8:e70388. doi: 10.1371/journal.pone.0070388. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Poptsova M.S., Il’icheva I.A., Nechipurenko D.Y., Panchenko L.A., Khodikov M.V., Oparina N.Y., Polozov R.V., Nechipurenko Y.D., Grokhovsky S.L. Non-random DNA fragmentation in next-generation sequencing. Sci. Rep. 2014;4:4532. doi: 10.1038/srep04532. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Quail M.A., Smith M., Coupland P., Otto T.D., Harris S.R., Connor T.R., Bertoni A., Swerdlow H.P., Gu Y. A tale of three next generation sequencing platforms: Comparison of ion torrent, pacific biosciences and Illumina miseq sequencers. BMC Genom. 2012;13:341. doi: 10.1186/1471-2164-13-341. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Zhang Z.H., Jhaveri D.J., Marshall V.M., Bauer D.C., Edson J., Narayanan R.K., Robinson G.J., Lundberg A.E., Bartlett P.F., Wray N.R., et al. A comparative study of techniques for differential expression analysis on RNA-seq data. PLoS ONE. 2014;9:e103207. doi: 10.1371/journal.pone.0103207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Rapaport F., Khanin R., Liang Y., Pirun M., Krek A., Zumbo P., Mason C.E., Socci N.D., Betel D. Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data. Genome Biol. 2013;14:3158. doi: 10.1186/gb-2013-14-9-r95. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Liu Y., Zhou J., White K.P. RNA-seq differential expression studies: More sequence or more replication? Bioinformatics. 2014;30:301–304. doi: 10.1093/bioinformatics/btt688. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Schurch N.J., Schofield P., Gierliński M., Cole C., Sherstnev A., Singh V., Wrobel N., Gharbi K., Simpson G.G., Owen-Hughes T., et al. How many biological replicates are needed in an RNA-seq experiment and which differential expression tool should you use? RNA. 2016;22:839–851. doi: 10.1261/rna.053959.115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Chhangawala S., Rudy G., Mason C.E., Rosenfeld J.A. The impact of read length on quantification of differentially expressed genes and splice junction detection. Genome Biol. 2015;16:131. doi: 10.1186/s13059-015-0697-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Zhao S., Zhang Y., Gamini R., Zhang B., von Schack D. Evaluation of two main RNA-seq approaches for gene quantification in clinical rna sequencing: Polya+ selection versus rrna depletion. Sci. Rep. 2018;8:4781. doi: 10.1038/s41598-018-23226-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Raplee I.D., Evsikov A.V., Marin de Evsikova C. Aligning the aligners: Comparison of rna sequencing data alignment and gene expression quantification tools for clinical breast cancer research. J. Pers. Med. 2019;9:18. doi: 10.3390/jpm9020018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Eikrem O., Beisland C., Hjelle K., Flatberg A., Scherer A., Landolt L., Skogstrand T., Leh S., Beisvag V., Marti H.-P. Transcriptome sequencing (rnaseq) enables utilization of formalin-fixed, paraffin-embedded biopsies with clear cell renal cell carcinoma for exploration of disease biology and biomarker development. PLoS ONE. 2016;11:e0149743. doi: 10.1371/journal.pone.0149743. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Esteve-Codina A., Arpi O., Martinez-García M., Pineda E., Mallo M., Gut M., Carrato C., Rovira A., Lopez R., Tortosa A., et al. A comparison of RNA-seq results from paired formalin-fixed paraffin-embedded and fresh-frozen glioblastoma tissue samples. PLoS ONE. 2017;12:e0170632. doi: 10.1371/journal.pone.0170632. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Brunner A.L., Li J., Guo X., Sweeney R.T., Varma S., Zhu S.X., Li R., Tibshirani R., West R.B. A shared transcriptional program in early breast neoplasias despite genetic and clinical distinctions. Genome Biol. 2014;15:R71. doi: 10.1186/gb-2014-15-5-r71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Nookaew I., Papini M., Pornputtapong N., Scalcinati G., Fagerberg L., Uhlén M., Nielsen J. A comprehensive comparison of RNA-seq-based transcriptome analysis from reads to differential gene expression and cross-comparison with microarrays: A case study in saccharomyces cerevisiae. Nucleic Acids Res. 2012;40:10084–10097. doi: 10.1093/nar/gks804. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Jain M., Koren S., Miga K.H., Quick J., Rand A.C., Sasani T.A., Tyson J.R., Beggs A.D., Dilthey A.T., Fiddes I.T., et al. Nanopore sequencing and assembly of a human genome with ultra-long reads. Nat. Biotechnol. 2018;36:338–345. doi: 10.1038/nbt.4060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Mosher J.J., Bowman B., Bernberg E.L., Shevchenko O., Kan J., Korlach J., Kaplan L.A. Improved performance of the pacbio smrt technology for 16s rdna sequencing. J. Microbiol. Methods. 2014;104:59–60. doi: 10.1016/j.mimet.2014.06.012. [DOI] [PubMed] [Google Scholar]
- 55.Rhoads A., Au K.F. Pacbio sequencing and its applications. Genom. Proteom. Bioinform. 2015;13:278–289. doi: 10.1016/j.gpb.2015.08.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Bayega A., Wang Y.C., Oikonomopoulos S., Djambazian H., Fahiminiya S., Ragoussis J. Transcript profiling using long-read sequencing technologies. In: Raghavachari N., Garcia-Reyero N., editors. Gene Expression Analysis: Methods and Protocols. Springer; New York, NY, USA: 2018. pp. 121–147. [DOI] [PubMed] [Google Scholar]
- 57.Gordon D., Huddleston J., Chaisson M.J.P., Hill C.M., Kronenberg Z.N., Munson K.M., Malig M., Raja A., Fiddes I., Hillier L.W., et al. Long-read sequence assembly of the gorilla genome. Science. 2016;352:aae0344. doi: 10.1126/science.aae0344. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Quackenbush J. Microarray data normalization and transformation. Nat. Genet. 2002;32:496–501. doi: 10.1038/ng1032. [DOI] [PubMed] [Google Scholar]
- 59.Gautier L., Cope L., Bolstad B.M., Irizarry R.A. Affy—Analysis of Affymetrix genechip data at the probe level. Bioinformatics. 2004;20:307–315. doi: 10.1093/bioinformatics/btg405. [DOI] [PubMed] [Google Scholar]
- 60.Du P., Kibbe W.A., Lin S.M. Lumi: A pipeline for processing illumina microarray. Bioinformatics. 2008;24:1547–1548. doi: 10.1093/bioinformatics/btn224. [DOI] [PubMed] [Google Scholar]
- 61.Ritchie M.E., Phipson B., Wu D., Hu Y., Law C.W., Shi W., Smyth G.K. Limma powers differential expression analyses for RNA-sequencing and microarray studies. Nucleic Acids Res. 2015;43:e47. doi: 10.1093/nar/gkv007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Bioconductor. [(accessed on 27 April 2019)]; Available online: https://www.bioconductor.org/
- 63.Andrews S. Fastqc a Quality Control Tool for High Throughput Sequence Data. [(accessed on 27 April 2019)]; Available online: http://www.bioinformatics.babraham.ac.uk/projects/fastqc/
- 64.Dai M., Thompson R.C., Maher C., Contreras-Galindo R., Kaplan M.H., Markovitz D.M., Omenn G., Meng F. NGSQC: Cross-platform quality analysis pipeline for deep sequencing data. BMC Genom. 2010;11:S7. doi: 10.1186/1471-2164-11-S4-S7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Bolger A.M., Lohse M., Usadel B. Trimmomatic: A flexible trimmer for illumina sequence data. Bioinformatics. 2014;30:2114–2120. doi: 10.1093/bioinformatics/btu170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Gordon A., Hannon G.J. Fastx-Toolkit. [(accessed on 27 April 2019)]; Available online: http://hannonlab.cshl.edu/fastx_toolkit/
- 67.Grabherr M.G., Haas B.J., Yassour M., Levin J.Z., Thompson D.A., Amit I., Adiconis X., Fan L., Raychowdhury R., Zeng Q., et al. Full-length transcriptome assembly from RNA-seq data without a reference genome. Nat. Biotechnol. 2011;29:644–652. doi: 10.1038/nbt.1883. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Trapnell C., Roberts A., Goff L., Pertea G., Kim D., Kelley D.R., Pimentel H., Salzberg S.L., Rinn J.L., Pachter L. Differential gene and transcript expression analysis of RNA-seq experiments with TopHat and Cufflinks. Nat. Protoc. 2012;7:562–578. doi: 10.1038/nprot.2012.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Pertea M., Kim D., Pertea G.M., Leek J.T., Salzberg S.L. Transcript-level expression analysis of RNA-seq experiments with HISAT, StringTie and Ballgown. Nat. Protoc. 2016;11:1650–1667. doi: 10.1038/nprot.2016.095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Dobin A., Davis C.A., Schlesinger F., Drenkow J., Zaleski C., Jha S., Batut P., Chaisson M., Gingeras T.R. Star: Ultrafast universal RNA-seq aligner. Bioinformatics. 2013;29:15–21. doi: 10.1093/bioinformatics/bts635. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Anders S., Pyl P.T., Huber W. HTSeq—A python framework to work with high-throughput sequencing data. Bioinformatics. 2015;31:166–169. doi: 10.1093/bioinformatics/btu638. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Liao Y., Smyth G.K., Shi W. Featurecounts: An efficient general purpose program for assigning sequence reads to genomic features. Bioinformatics. 2014;30:923–930. doi: 10.1093/bioinformatics/btt656. [DOI] [PubMed] [Google Scholar]
- 73.Eilbeck K., Lewis S.E., Mungall C.J., Yandell M., Stein L., Durbin R., Ashburner M. The sequence ontology: A tool for the unification of genome annotations. Genome Biol. 2005;6:R44. doi: 10.1186/gb-2005-6-5-r44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Mortazavi A., Williams B.A., McCue K., Schaeffer L., Wold B. Mapping and quantifying mammalian transcriptomes by RNA-seq. Nat. Methods. 2008;5:621–628. doi: 10.1038/nmeth.1226. [DOI] [PubMed] [Google Scholar]
- 75.Trapnell C., Williams B.A., Pertea G., Mortazavi A., Kwan G., van Baren M.J., Salzberg S.L., Wold B.J., Pachter L. Transcript assembly and quantification by RNA-seq reveals unannotated transcripts and isoform switching during cell differentiation. Nat. Biotechnol. 2010;28:511–515. doi: 10.1038/nbt.1621. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Li B., Dewey C.N. RSEM: Accurate transcript quantification from RNA-seq data with or without a reference genome. BMC Bioinform. 2011;12:323. doi: 10.1186/1471-2105-12-323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Ashburner M., Ball C.A., Blake J.A., Botstein D., Butler H., Cherry J.M., Davis A.P., Dolinski K., Dwight S.S., Eppig J.T., et al. Gene ontology: Tool for the unification of biology. Nat. Genet. 2000;25:25–29. doi: 10.1038/75556. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Carbon S., Ireland A., Mungall C.J., Shu S., Marshall B., Lewis S., AmiGO Hub and Web Presence Working Group Amigo: Online access to ontology and annotation data. Bioinformatics. 2009;25:288–289. doi: 10.1093/bioinformatics/btn615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Lovering R.C., Roncaglia P., Howe D.G., Laulederkind S.J.F., Khodiyar V.K., Berardini T.Z., Tweedie S., Foulger R.E., Osumi-Sutherland D., Campbell N.H., et al. Improving interpretation of cardiac phenotypes and enhancing discovery with expanded knowledge in the gene ontology. Circ. Genom. Precis. Med. 2018;11:e001813. doi: 10.1161/CIRCGEN.117.001813. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Smith C.L., Goldsmith C.-A.W., Eppig J.T. The mammalian phenotype ontology as a tool for annotating, analyzing and comparing phenotypic information. Genome Biol. 2004;6:R7. doi: 10.1186/gb-2004-6-1-r7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Arze C., Feng G., Mazaitis M., Nadendla S., Felix V., Chang Y.-W.W., Schriml L.M., Kibbe W.A. Disease ontology: A backbone for disease semantic integration. Nucleic Acids Res. 2011;40:D940–D946. doi: 10.1093/nar/gkr972. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Bello S.M., Shimoyama M., Mitraka E., Laulederkind S.J.F., Smith C.L., Eppig J.T., Schriml L.M. Disease ontology: Improving and unifying disease annotations across species. Dis. Models Mech. 2018;11:dmm032839. doi: 10.1242/dmm.032839. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Bult C.J., Drabkin H.J., Evsikov A., Natale D., Arighi C., Roberts N., Ruttenberg A., D’Eustachio P., Smith B., Blake J.A., et al. The representation of protein complexes in the protein ontology (pro) BMC Bioinform. 2011;12:371. doi: 10.1186/1471-2105-12-371. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Natale D.A., Arighi C.N., Barker W.C., Blake J.A., Bult C.J., Caudy M., Drabkin H.J., D’Eustachio P., Evsikov A.V., Huang H., et al. The protein ontology: A structured representation of protein forms and complexes. Nucleic Acids Res. 2011;39:D539–D545. doi: 10.1093/nar/gkq907. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Smith B., Ashburner M., Rosse C., Bard J., Bug W., Ceusters W., Goldberg L.J., Eilbeck K., Ireland A., Mungall C.J., et al. The obo foundry: Coordinated evolution of ontologies to support biomedical data integration. Nat. Biotechnol. 2007;25:1251–1255. doi: 10.1038/nbt1346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Subramanian A., Tamayo P., Mootha V.K., Mukherjee S., Ebert B.L., Gillette M.A., Paulovich A., Pomeroy S.L., Golub T.R., Lander E.S., et al. Gene set enrichment analysis: A knowledge-based approach for interpreting genome-wide expression profiles. Proc. Natl. Acad. Sci. USA. 2005;102:15545–15550. doi: 10.1073/pnas.0506580102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Caspi R., Billington R., Ferrer L., Foerster H., Fulcher C.A., Keseler I.M., Kothari A., Krummenacker M., Latendresse M., Mueller L.A., et al. The MetaCyc database of metabolic pathways and enzymes and the BioCyc collection of pathway/genome databases. Nucleic Acids Res. 2016;44:D471–D480. doi: 10.1093/nar/gkv1164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Kanehisa M., Furumichi M., Tanabe M., Sato Y., Morishima K. Kegg: New perspectives on genomes, pathways, diseases and drugs. Nucleic Acids Res. 2017;45:D353–D361. doi: 10.1093/nar/gkw1092. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Fabregat A., Jupe S., Matthews L., Sidiropoulos K., Gillespie M., Garapati P., Haw R., Jassal B., Korninger F., May B., et al. The reactome pathway knowledgebase. Nucleic Acids Res. 2018;46:D649–D655. doi: 10.1093/nar/gkx1132. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Richardson J.E., Bult C.J. Visual annotation display (VLAD): A tool for finding functional themes in lists of genes. Mamm. Genome. 2015;26:567–573. doi: 10.1007/s00335-015-9570-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Eden E., Navon R., Steinfeld I., Lipson D., Yakhini Z. Gorilla: A tool for discovery and visualization of enriched go terms in ranked gene lists. BMC Bioinform. 2009;10:48. doi: 10.1186/1471-2105-10-48. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Jiao X., Sherman B.T., Huang D.W., Stephens R., Baseler M.W., Lane H.C., Lempicki R.A. David-ws: A stateful web service to facilitate gene/protein list analysis. Bioinformatics. 2012;28:1805–1806. doi: 10.1093/bioinformatics/bts251. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Maere S., Heymans K., Kuiper M. Bingo: A cytoscape plugin to assess overrepresentation of gene ontology categories in biological networks. Bioinformatics. 2005;21:3448–3449. doi: 10.1093/bioinformatics/bti551. [DOI] [PubMed] [Google Scholar]
- 94.Evsikov A.V., Marín de Evsikova C. Transcriptomics as precision medicine to classify in vivo models of dietary-induced atherosclerosis at cellular and molecular levels. J. Pers. Med. 2018 doi: 10.20944/preprints201809.0082.v1. [DOI] [Google Scholar]
- 95.Krämer A., Green J., Pollard J.J., Tugendreich S. Causal analysis approaches in ingenuity pathway analysis. Bioinformatics. 2014;30:523–530. doi: 10.1093/bioinformatics/btt703. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Nikitin A., Egorov S., Daraselia N., Mazo I. Pathway studio—The analysis and navigation of molecular networks. Bioinformatics. 2003;19:2155–2157. doi: 10.1093/bioinformatics/btg290. [DOI] [PubMed] [Google Scholar]
- 97.Romero P., Wagg J., Green M.L., Kaiser D., Krummenacker M., Karp P.D. Computational prediction of human metabolic pathways from the complete human genome. Genome Biol. 2004;6:R2. doi: 10.1186/gb-2004-6-1-r2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Evsikov A.V., Dolan M.E., Genrich M.P., Patek E., Bult C.J. Mousecyc: A curated biochemical pathways database for the laboratory mouse. Genome Biol. 2009;10:R84. doi: 10.1186/gb-2009-10-8-r84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Seo S., Lewin H.A. Reconstruction of metabolic pathways for the cattle genome. BMC Syst. Biol. 2009;3:33. doi: 10.1186/1752-0509-3-33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Cieślik M., Chinnaiyan A.M. Cancer transcriptome profiling at the juncture of clinical translation. Nat. Rev. Genet. 2017;19:93. doi: 10.1038/nrg.2017.96. [DOI] [PubMed] [Google Scholar]
- 101.Gatsiou A., Stellos K. Dawn of epitranscriptomic medicine. Circ. Genom. Precis. Med. 2018;11:e001927. doi: 10.1161/CIRCGEN.118.001927. [DOI] [PubMed] [Google Scholar]
- 102.Barrett T.J., Lee A.H., Smilowitz N.R., Hausvater A., Fishman G.I., Hochman J.S., Reynolds H.R., Berger J.S. Whole-blood transcriptome profiling identifies women with myocardial infarction with nonobstructive coronary artery disease. Circ. Genom. Precis. Med. 2018;11:e002387. doi: 10.1161/CIRCGEN.118.002387. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Musunuru K., Bernstein D., Cole F.S., Khokha M.K., Lee F.S., Lin S., McDonald T.V., Moskowitz I.P., Quertermous T., Sankaran V.G., et al. Functional assays to screen and dissect genomic hits. Circ. Genom. Precis. Med. 2018;11:e002178. doi: 10.1161/CIRCGEN.118.002178. [DOI] [PMC free article] [PubMed] [Google Scholar]