Abstract
Since brain tissue is not readily accessible, a new focus in search of biomarkers for schizophrenia is blood-based expression profiling of non-protein coding genes such as microRNAs (miRNAs), which regulate gene expression by inhibiting the translation of messenger RNAs. This study aimed to identify potential miRNA signature for schizophrenia by comparing genome-wide miRNA expression profiles in patients with schizophrenia vs. healthy controls. A genome-wide miRNA expression profiling was performed using a Taqman array of 365 human miRNAs in the mononuclear leukocytes of a learning set of 30 cases and 30 controls. The discriminating performance of potential biomarkers was validated in an independent testing set of 60 cases and 30 controls. The expression levels of the miRNA signature were then evaluated for their correlation with the patients' clinical symptoms, neurocognitive performances, and neurophysiological functions. A seven-miRNA signature (hsa-miR-34a, miR-449a, miR-564, miR-432, miR-548d, miR-572 and miR-652) was derived from a supervised classification with internal cross-validation, with an area under the curve (AUC) of receiver operating characteristics of 93%. The putative signature was then validated in the testing set, with an AUC of 85%. Among these miRNAs, miR-34a was differentially expressed between cases and controls in both the learning (P = 0.005) and the testing set (P = 0.002). These miRNAs were differentially correlated with patients' negative symptoms, neurocognitive performance scores, and event-related potentials. The results indicated that the mononuclear leukocyte-based miRNA profiling is a feasible way to identify biomarkers for schizophrenia, and the seven-miRNA signature warrants further investigation.
Introduction
Schizophrenia is a common and often disabling mental illness characterized not only by a varied group of clinical symptoms [1] but also wide-ranging deficits in neurocognitive and neurophysiological functions [2]–[4]. Although the underlying pathophysiology of schizophrenia remains not well understood, dysregulations of its susceptibility genes are likely to converge functionally upon illness risk [5], which may manifest as certain endophenotypes, such as abnormalities in sustained attention, executive function, or event-related potentials [6]–[7]. Biomarkers that reflect these dysregulations for schizophrenia have the potential to substantially improve the clinical management of the disorder and even revolutionize its drug development approaches [8]–[9]. Since brain tissue is not readily accessible for investigation, blood-based expression profiling is increasingly being undertaken to search for potential biomarkers for schizophrenia [10]–[13].
The rationale of searching for peripheral blood-based gene expression aberration for schizophrenia is two-folded. First, constitutional variants of susceptibility genes exhibited only limited association with schizophrenia as revealed in systematic meta-analyses of genome-wide association studies [14]. Hence, an alternative way is to look for measures that can reflect the combined effect of genetic predisposition and environmental exposure, such as aberrations of gene expression. Second, the central nervous system (CNS) may exert its influence on the gene expression of peripheral lymphocytes via cytokines, neurotransmitters, or hormones [15]–[16], which may explain the comparable gene expression levels between the peripheral blood and some CNS tissues [11]–[12], as well as the alterations in the dopamine transporter in the lymphocytes of psychotic patients [17]. Furthermore, the peripheral expression levels of some dysregulated genes were also found to be correlated with certain clinical symptoms and neurocognitive functions in patients with schizophrenia [18].
However, most of previous blood-based gene expression studies on schizophrenia [10]–[13] were limited to the expression of protein-coding genes, in which an enormous number of messenger RNAs (mRNAs) have to be examined using microarray platforms. This approach usually led to a large set of putative mRNAs related to schizophrenia and most of them were not replicated in the other studies [19]. Growing attention has been focused on the regulatory roles of microRNAs (miRNAs), which regulate gene expression by inhibiting the translation of mRNAs [20], as potential biomarkers for schizophrenia [21]–[25]. Since each miRNA can regulate the expressions of hundred of target genes, the number of discriminating miRNA markers would be much less than that of mRNAs. Indeed, in some preliminary array-based miRNA profiling studies, the expressions of less than thirty miRNAs were found to be altered in the post-mortem brains of schizophrenia patients [26]–[29]. As exemplified by the parallel changes in the levels of certain mRNAs between the CNS and peripheral blood [15]–[17], it is plausible that some expression aberrations of miRNAs might also be detectable in the peripheral mononuclear leukocytes.
In this study, we aimed to identify miRNAs that might be useful as biomarkers for schizophrenia in a two-stage manner. We first examined array-based miRNA profiles in peripheral mononuclear leukocytes from a learning set of schizophrenia patients and healthy controls, and then the discriminating performance of candidate miRNAs was validated in an independent testing set of cases and controls. The expression levels of the miRNA signature were further evaluated for their correlation with the patients' clinical symptoms, neurocognitive performances, and neurophysiological functions. Possible functions and biological mechanisms implicated in the target genes regulated by the miRNAs were then explored using database prediction.
Results
There were no differences in age or sex between patients with schizophrenia and healthy controls, whereas the patients' education levels were lower than those of the controls in both the learning and testing sets, and the patients' smoking prevalence was higher than controls' in the testing set (Table S1). Patients' mean age at onset was 23.7 for the learning set and 24.6 years for the testing set.
Out of the 365 miRNAs assayed using the Taqman Low Density Array (TLDA) in the learning set of 30 schizophrenia patients and 30 controls, the expression levels of 221 (60.5%) were detectable in the peripheral mononuclear leukocytes of ≥30% of the samples in either the schizophrenia patients or the controls. Among them, there were eight miRNAs that were differentially expressed between schizophrenia patients and healthy controls in the learning set based on a criterion of P<0.05 in the Wilcoxon rank-sum test ( Figure 1 ). From these a seven-miRNA signature (miR-34a, miR-449a, miR-564, miR-432, miR-548d, miR-572 and miR-652) was identified using stepwise logistic regression analysis, with a fold-change ranging from −1.4 to 2.5 ( Table 1 ). Among the seven, four in the human database miRNAMap [30] and one in a mouse model [31] were reported to have detectable expressions in the brain, whereas the remaining two did not. The pattern of expression gradients of these seven miRNAs can be distinguished between the two groups, as shown in Figure 2a .
Table 1. The seven microRNA-signature derived from the learning set (30 patients with schizophrenia and 30 healthy controls).
miRNA name | Chromosomal region | Location | P a value | Fold change | Expression levels in the brain |
hsa-miR-34a | 1p36.23 | Intergenic | 0.005 | 2.5 | Moderateb |
hsa-miR-449a | 5q11.2 | Intron | 0.007 | 1.9 | Lowb |
hsa-miR-564 | 3p21.31 | 3′ UTR | 0.015 | 2.4 | NA |
hsa-miR-432 | 14q32.31 | Intergenic | 0.022 | −1.4 | Highb |
hsa-miR-548d | 8q24.13 | Intron | 0.036 | 1.4 | NA |
hsa-miR-572 | 4p15.33 | Intergenic | 0.038 | 2.1 | Moderateb |
hsa-miR-652 | Xq22.3 | Intron | 0.049 | 2.4 | Moderatec |
based on the Wilcoxon rank-sum test.
miR-652 was expressed in the brain and spinal cord during embryonic stages followed by a gradual decrease after birth in a mouse model.
As an initial check for the utility of the 7-miRNA signature, the prediction accuracy at an arbitrary cut-off point in the learning set was evaluated using two different methods. For the logistic regression analysis with leave-one-out cross-validation, the raw accuracy rate was 80%, and the adjusted accuracy rate, i.e., with adjustment for potential confounders such as age, gender, education and tobacco smoking, was elevated to 83.1%. When the Support Vector Machine (SVM) [32] was used for the evaluation, the raw and adjusted accuracy rate was 84.3% and 82.1%, respectively. Meanwhile, the global performance of the seven-miRNA signature in distinguishing the schizophrenia patients from the normal controls, the area under the curve (AUC) of receiver operative characteristics, was estimated to be 0.93 for the learning set, regardless of the adjustment for confounders ( Figure 3 ). When the disease status was permuted for the seven-miRNA signature, none of the permuted AUCs exceeded the observed value of 0.93, i.e., a significance level of <0.0001 regardless of the unadjusted or adjusted model (data not shown). When the seven miRNAs were randomly selected from the pool of 221 miRNAs for 100,000 times, the mean of these AUCs were 0.69 (SD = 0.06) for the model without adjustment and 0.737 (SD = 0.05) for the model with adjustment for confounders. None of the unadjusted model (P<0.00001) and one of the adjusted model (P = 0.00001) had an AUC greater than the observed. The histograms of the permuted AUCs for these two models are displayed in Figure S1. When the number of miRNAs selected ranged from 3 to 9, the mean AUC increased slightly but remained less than 0.78 (see Table S2 for the summary of the permutations).
The discriminating accuracy of seven-miRNA signature was then evaluated in an independent testing set of 60 schizophrenia patients and 30 controls using quantitative reverse transcription-polymerase chain reaction (qRT-PCR). The differential expression gradients of the 7-miRNA signature in the testing set is illustrated in Figure 2b . The raw and adjusted accuracy rate for the logistic regression analysis with leave-one-out cross-validation was 73.3% and 80.0%, respectively, and the corresponding figure for the SVM was 76.2% and 78.3%, respectively. In terms of the global performance, the AUC was estimated to be 0.77 (without adjustment) and 0.85 (with adjustment), respectively ( Figure 3 ). The permutation-based significance level for the testing set was of <0.0001, regardless of the unadjusted or adjusted model.
Regarding the individual miRNA expression level of the seven miRNAs, the differential expression in hsa-miR-34a between the cases and controls reached statistical significance in both the learning set (P = 0.005) and the testing set (P = 0.002) ( Figure 4 ).
The distributions of subjects' clinical symptoms rated in the Positive and Negative Symptom Scale (PANSS) [33], neurocognitive performances using the Continuous Performance Test (CPT) [34]–[35] and the Wisconsin Card Sorting Test (WCST) [36], and neurophysiological functions measured as P50 suppression in auditory event-related potentials (ERPs) [37] and mismatched negativity (MMN) [38] are shown in Table S3. For the pooled sample of schizophrenia patients, some scores on the PANSS, CPT, WCST, and MMN were correlated with the expression levels of certain miRNAs, whereas none of the P50 suppression indexes showed such a correlation ( Table 2 ).
Table 2. The Spearman correlation coefficients between the seven miRNA signaturea and the clinical symptoms of schizophrenia patients from both the learning and testing sets. (Only those with P<0.05 are shown here.).
1 | 2 | 3 | 4 | 5 | 6 | 7 | |
Variable | hsa-miR-34a | hsa-miR-449a | hsa-miR-564 | hsa-miR-432 | hsa-miR-548d | hsa-miR-572 | hsa-miR-652 |
PANSS (n = 83) | |||||||
Negative scale | 0.25 | ||||||
Continuous Performance Test (n = 78) | |||||||
Undegraded d′ | −0.25 | −0.27 | |||||
Undegraded false alarm rate | 0.23 | 0.29* | |||||
Degraded ln · | 0.24 | 0.28* | |||||
Degraded false alarm rate | −0.31* | ||||||
Wisconsin Card Sorting Test (n = 78) | |||||||
Total errors | 0.28* | ||||||
Perseverative responses | 0.22 | ||||||
Perseverative errors | 0.21 | ||||||
Non-perseverative errors | 0.29* | ||||||
Categories achieved | −0.31** | 0.24* | |||||
Conceptual level response | −0.29* | ||||||
Mismatch Negativity (n = 70) | |||||||
Cz | −0.31 | ||||||
FCz | −0.28 |
The −ΔCt value of each miRNA was standardized (mean = 0, SD = 1) in the learning and testing sets, respectively.
Scores on the PANSS, MMN, and P50 were adjusted for age, gender, and educational level.
*P<0.01;
**P<0.006.
For the analyses of the predicted miRNA-target genes, 621 genes for three miRNAs (hsa-miR-34a, hsa-miR-449a, and has-miR-432) were obtained using MAMI [39] and 684 genes for two miRNAs (hsa-miR-34a and hsa-miR-449a) were obtained using TargetCombo [40] (see Table S4 for the setting in each method and the results for each miRNA). Since more information was available for the predicted target genes using MAMI, we further examined whether there were common target genes among the three miRNAs. The results revealed that there were 128 miRNA-target genes shared between hsa-miR-34a and hsa-miR-449a, 1 target gene shared between hsa-miR-34a and hsa-miR-432, and 1 target gene shared between hsa-miR-432 and hsa-miR-449a (see Table S5 for the complete list).
For each set of predicted target genes, their functions and putative pathways were explored using the software Ingenuity Pathways Analysis (IPA), version 8 (Ingenuity® Systems), with 619 (99.7%) of MAMI-based target genes and 520 (84%) of TargetCombo-based target genes were successfully mapped. The most significantly associated physiological function revealed by the IPA analysis was nervous system development and function for both sets of predicted genes (P of Fisher's exact test = 0.000002 for the MAMI and 0.0000013 for the TargetCombo). Since the MAMI-based set covered more miRNAs and predicted target genes, we further explored its canonical biological pathways, with the most significant pathways being cyclin dependent kinase 5 (Cdk5), Notch signaling, and dopamine receptor signaling pathways (Figure S2). After correction for multiple testing using the false discovery rate method, both Cdk5 and Notch signaling pathways remained significantly associated with these genes (p<0.001).
Discussion
Our two-staged search for miRNAs with aberrant levels in blood mononuclear leukocytes revealed a combination of seven miRNA expression alterations to have robustly high discriminating accuracy for schizophrenia. The differential correlation of these miRNAs with patients' negative symptoms, neurocognitive performance scores, and event-related potentials further imply that the aberration of certain functions in the brain might result in alteration of molecular abnormalities in peripheral lymphocytes [15]–[16], [41]. These changes in the post-transcriptional regulatory environment of lymphocytes in patients with schizophrenia not only have implications for the pathophysiology of the disorder [21], [28] but also provide as empirical source of non-invasive biomarkers for schizophrenia.
The use of seven miRNAs as predictors for the disease status has in general more stable prediction accuracy than using a single predictor [42]. Using hsa-miR-34a as an example, which was the most differentially expressed miRNA in the mononuclear leukocytes of patients in both the learning and the testing set, its sole prediction accuracy was only around 50% to 60% (data not shown). Since schizophrenia is a complex neurodevelopmental disorder with a varied group of clinical symptoms, the combined alterations of miRNA expression in the lymphocytes might result from the stresses from different brain regions [15], [41], [43]. This is further supported by the differential correlations of these miRNAs with patients' clinical symptoms and neurocognitive or neurophysiologic measures.
Among the seven miRNAs, the expression level of hsa-miR-34a was found to be altered in the prefrontal cortex of patients with schizophrenia [44]. The expression levels of miR-34a on the hippocampus of rats were also found to be altered in response to mood stabilizers [45]. In cultured cell lines, mood stabilizers could both lower the levels of miR-34a and elevate the levels of GRM7, a confirmed target gene regulated by miR-34a as well as a candidate gene for schizophrenia identified in recent association studies [46]. It should be noted that miR-34a was also significantly up-regulated in the blood mononuclear cells of patients with Alzheimer's disease [47]. Thus, the role of miR-34a over-expression in the pathophysiology of schizophrenia warrants further investigation. Three other miRNAs have also been implicated in neuropsychiatric disorders or neurodevelopment, e.g., miR-432 with autism in human cerebella cortex [48], miR-449 with Alzheimer's disease in cerebrospinal fluid [49], and miR-652 with embryogenesis in the mouse brain and spinal cord [31].
Despite the fact that we do not know whether the aberrant expression of the seven miRNAs were also present in the patients' CNS, the majority of them are detectable in the brain according to the literature [30]–[31]. In addition, some of the seven miRNAs identified in this study were correlated with negative symptoms, neurocognitive dysfunction, and MMN in ERPs in patients with schizophrenia. It is worthwhile to note that miR-449a significantly correlated with most features of the WCST, implying that miR-449a might be sensitive to the executive function activity in the brain. It is plausible that the CNS may exert its influence on the gene expression of peripheral lymphocytes via cytokines, neurotransmitters, or hormones [15]–[16]. Thus, it warrants further investigation regarding which molecules are involved in such influence on peripheral lymphocytes.
Taken together, the aberrant expression of the miRNAs in the peripheral lymphocytes or monocytes of schizophrenia patients could, to some extent, reflect the corresponding dysfunction in the brain, which is compatible with the predicted canonical pathways for these miRNAs, including Cdk5, Notch signaling, and dopamine receptor signaling pathways. Although our prediction analyses of miRNA-target genes and pathways were based on in-silico simulation, some of the miRNA-target genes have been validated in previous studies [50]. Hence, our results are compatible with the implication of the dysregulation of these genes and pathways in the pathophysiology of schizophrenia [5], [51]–[52]. In future work, the miRNA-target genes need to be validated in our samples by evaluating the correlation between the expression levels of miRNAs and its target genes using qRT-PCR method, and the miRNA-target interactions need to be confirmed using exogenous (e.g., to over-express certain miRNAs in neural cell lines and then examine the protein expression level of the target genes) or endogenous (e.g., conducting the manipulation of miRNAs in physiological conditions) miRNA experiments [50].
It is intriguing to note that two of the seven miRNAs, miR-34a and miR-449a, share the same seed sequence and the direction and magnitude of their fold change were similar in our study. Furthermore, they also shared similar miRNA-target genes as predicted using MAMI (Table S5). Among them, some have been confirmed in previous studies, such as delta-like 1 (DLL1) and jagged 1 (JAG1) genes, which are involved in NOTCH signaling pathway [53], B-cell CLL/lymphoma 2 (BCL1), which impacts outcomes after sever traumatic brain injury [54], and mitogen-activated protein kinase kinase 1 (MAP2K1), which is aberrantly expressed in the brain of suicide subjects [55]. Another intriguing finding is that despite the close alignment of miR-449b to miR-449a, the former was not selected as a predictive biomarker in this study. Previous studies indicated that the expression levels of miR-449a exceed those of miR-449b in all the systems analyzed [56]. Consistent with this, 70% of the 60 subjects of the learning set in this study had higher expression levels of the miR-449a than miRNA-449b in mononuclear leukocytes, which might explain the lack of association of miR-449b expression level with schizophrenia in this study.
Our results should be interpreted with several limitations in mind. First, since all the schizophrenia patients were receiving combinations of medications, the influences of psychopharmacologic medications on miRNA expression levels were not accounted for in this study. Second, despite our matching in age and gender, there were substantial differences between the patients and controls in educational level. Nevertheless, it is not known whether educational level has much influence on the expression levels of miRNA. Finally, subgroup analysis based on patients' endophenotypic characteristics was not conducted in this study due to limited sample size.
Our findings demonstrate the potential utility of a mononuclear leukocyte-based miRNA signature as biomarkers for schizophrenia, which could help elucidate the etiology of schizophrenia as well as proffer better treatments. The results of correlation between clinical symptoms and miRNA expression levels suggest that lymphocyte could reflect the metabolism of brain cells, and may be exploited as a neural and possible genetic probe in studies of psychiatric disorders [15]–[16]. Since a specific miRNA might be involved in coordinated regulation of protein expression in functional networks [24], this kind of biomarkers might contribute to new development of target therapeutic intervention in near future [8]. We conclude that genome-wide miRNA profiling is a feasible way to identify potential biomarkers for schizophrenia, and the seven-miRNA signature warrants further investigation.
Materials and Methods
Participants
From December 2007 to September 2009, we enrolled 90 patients who met the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition [57] criteria for schizophrenia at National Taiwan University Hospital, along with 60 unrelated healthy controls with a frequency matching in age and sex from a pool of staff, graduate students, and community volunteers. The sample was randomly separated into a learning set (30 cases and 30 controls) and a testing set (60 cases and 30 controls). Individuals with severe neurological abnormalities, emotional disorders, mental retardation, or prominent substance abuse problems were excluded. Each participant provided written informed consent after being given a complete description of the study. The study was approved by the institutional review board of National Taiwan University Hospital.
Clinical assessments
All the patients were interviewed using the Chinese adaptation [34] of the Diagnostic Interview for Genetic Studies (DIGS) [58] by well-trained research assistants with background in psychology or nursing. Best estimate psychiatric diagnosis was determined independently by two psychiatrists using all available information, including the DIGS, hospital records, and the interviewer's notes. If both disagreed about a diagnosis, a third one was sought and a consensus in diagnosis was reached after discussion [59].
Each patient's clinical symptoms were rated by a research psychiatrist using the PANSS [33]. The translation of the PANSS into Chinese was described elsewhere [60] and the instrument was shown to have good inter-rater reliabilities (intraclass correlation ranging from 0.64 to 0.96) in a subsequent study [61].
Neurocognitive assessments
Each participant's sustained attention was assessed using a CPT machine from Sunrise Systems, v.2.20 (Pembroke, MA, USA), with the procedure and reliability data being described in more detail elsewhere [34]–[35]. Briefly, numbers from 0 to 9 were randomly presented for 50 msec each, at a rate of one per second. Each subject undertook two CPT sessions: the undegraded 1–9 tasks and 25% degraded 1–9 tasks. Two signal-detection indexes of performance on the test, sensitivity (d′) and response criterion (ln β), were derived from the hit rate and false-alarm rate. Sensitivity measures an individual's ability to discriminate target stimuli from nontarget stimuli, whereas response criterion assesses the amount of perceptual evidence an individual requires prior to making a decision to respond to a stimulus as a signal.
Then each participant's executive function was assessed using a computerized version of the WCST [36]. Subjects were required to match response cards to the four stimulus cards along one of three dimensions (color, form, or number) by pressing one of the 1 to 4 number keys on the computer keyboard. Subjects were not informed of the correct sorting principle, nor were they told when the principle would shift during the test, but they were given feedback on the screen after each trial. Eight performance indices were used for subsequent analyses: Total Errors, Nonperseverative Errors, Perseverative Errors, Perseverative Responses, Categories Achieved, Trials to Complete First Category, Conceptual Level Response, and Failure to Maintain Set [62].
Electrophysiological assessments
Each participant was assessed for auditory ERPs using P50 suppression [37] and MMN [38]. Participants were in a sound-attenuating, electrically shielded booth, and did not smoke for at least 60 min before the testing. They were seated in a comfortable recliner and instructed to relax with their eyes open and to focus on a fixation point (P50 session) or the video monitor (MMN session). The stimuli were generated and data were recorded using Neuroscan (Neuroscan, El Paso, Texas) STIM and ACQUIRE system. Electrodes were used at up to 40 recording sites (according to International 10–20 system) utilizing an electrode cap. Auditory stimuli were presented to subjects binaurally via foam insert earphones. Electroencephalography and stimulus markers were recorded continuously, while subjects were instructed to minimize eye movements and muscle artifact during the recording.
RNA extraction and miRNA quantification
Approximately 10 ml of whole blood were collected and processed within 3 hours. Mononuclear leukocytes were separated via centrifuging with Ficoll-Paque PLUS (GE Healthcare). Since lymphocytes, monocytes, and platelets were not dense enough to penetrate into the Ficoll-Paque PLUS layer, this resulted in a concentrated band at the interface between the original blood sample and the Ficoll-Paque PLUS. This banding enabled the lymphocytes to be recovered with high yield in a small volume with little mixing with the Ficoll-Paque PLUS medium. Subsequent washing and centrifugation of the harvested cells removed platelets, plasma, and any contaminating Ficoll-Paque PLUS. The resulting cell suspension then contained highly purified, viable mononuclear leukocytes (95%±5%), in which the majority were lymphocytes (60%±20%). The suspension of mononuclear leukocytes might contain microviscles. However, the amount might be negligible since the majority of the peripheral blood microvesicles were platelet-derived [63], which were presumably washed out by the washing and centrifugation step.
Then the total RNA of these mononuclear leukocytes was extracted using TRIzol reagent (Invitrogen). The qualities of RNA extracts were found to be good, i.e., RNA integrity number (RIN)>8. In the learning set, the expression of 365 human miRNAs and endogenous control RNU48 small nuclear RNA were assayed using Multiplex RT and TaqMan® Low Density Array (TLDA) Human MicroRNA Panel v1.0 and 7900 real-time RT PCR System (Applied Biosystems). A total of 800 ng RNAs were used for each array.
The corresponding cDNAs were made using TaqMan MicroRNA reverse transcription (RT) reagents and specific primers for the miRNAs (Applied Biosystems). The amount of RNAs used for RT was 2 ng. qRT-PCR of miRNAs was performed using Taqman MicroRNA assays and 7900 real-time RT-PCR system (Applied Biosystems) with RNU48 as an endogenous control. A total of 0.8 ng RT products were used for qRT-PCR. All assays were performed in duplicate.
To confirm the comparability of TLDA-based genome-wide profiling with individual quantifications, we randomly chose 10 patients and 10 controls from the learning set and further quantified these subjects' expression levels of five miRNAs (has-miR 34a, miR-432, miR-548d, miR-659 and miR-185) using quantitative RT-PCR. Among the miRNAs detectable using TLDA, there was a significant correlation (r = 0.83, P<0.0001) in the expression levels of miRNA between the two methods (Figure S3).
Statistical analyses
The expression level of each miRNA was quantified by its normalized threshold cycle number ΔCt, in which ΔCt = [Ct (miRNA)]−[Ct (U48)], and the relative expression level was calculated as 2−(ΔCt), which is commonly used in genomewide profiling studies of miRNAs [64]. Only those miRNAs detectable in the peripheral mononuclear leukocytes of ≥30% of the samples of either the schizophrenia patients or the controls were subsequently analyzed. To select differentially expressed miRNAs for further classification, a two-sided Wilcoxon rank-sum test was used to compare the two groups' expression levels with a threshold P value of 0.05. Stepwise logistic regression analyses were then used to select a miRNA signature with the maximum acceptable α limit for adding a variable being 0.1 and the minimum acceptable α limit for removing a variable being 0.15.
We used two different methods in a supervised classification with leave-one-out cross-validation [65] to assess the prediction accuracy of the miRNA-signature in the learning set: logistic regression and SVM. Logistic regression allows for non-linear discriminant analysis and is more robust against departures from normality than discriminant analysis, whereas SVM is particularly useful for high-dimensional classification problems [32]. A supervised classification with leave-one-out cross-validation can provide a nearly unbiased estimate of the true error rate [65]. In these analyses, a confounder score method [66] was used to adjust for age, gender, education, and tobacco smoking. To assess the robustness of the predictive utility of the seven-miRNA signature, two kinds of permutations were conducted. First, keeping the seven-miRNA signature, we randomly permuted the disease status among the learning set and the testing set, respectively, for 10,000 times and the number of the permuted AUC exceeding the observed AUC was counted as permuted significance level. Second, keeping the disease status of the learning set of subjects, a certain number of miRNAs, ranging from 3 to 9, were randomly selected from the pool of 221 miRNAs and the corresponding AUC for the model without and with control of potential confounders, respectively, were calculated.
To help visualize the differential expression pattern, we adopted the method of matrix visualization using the software program Generalized Association Plots [67] to compare the miRNA expression levels between cases and controls.
For correlation analysis, either a Pearson (between array-based expression level and qRT-PCR expression level) or a Spearman (between the expression levels of miRNAs and scores on the clinical symptoms, neurocognitive tests, and ERPs) correlation coefficient was used. The expression level of individual miRNA was standardized by subtraction from the group mean followed by division by the standard deviation within each platform. Then the standardized expression levels of miRNAs from two platforms were pooled.
Target genes prediction and functional profiling
The potential target genes regulated by the miRNAs were predicted using two different methods: the MAMI MicroRNA Meta-Predictor [39] and TargetCombo [40]. These two methods incorporate several popular prediction algorithms including miRs, Targets, microT [68], PicTar [69], TargetScanS [70], miRTarget [71], and miRanda [72]. For the predicted target genes, their functions and putative pathways were explored using the IPA version 8 (Ingenuity® Systems). Fisher's exact test was used to calculate the significance of the association between the data set and the biological function or canonical pathway. The false discovery rate procedure were used to control for the multiple hypothesis testing [73].
Supporting Information
Footnotes
Competing Interests: The authors have declared that no competing interests exist.
Funding: This study was supported by grants from National Taiwan University (97R0337, 97HP0023 and 97HP0071), the National Science Council, Taiwan (NSC98-2314-B-002-125-MY3), and the National Health Research Institutes, Taiwan (NHRI-EX99-9511PP). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Tamminga CA, Holcomb HH. Phenotype of schizophrenia: a review and formulation. Mol Psychiatry. 2005;10:27–39. doi: 10.1038/sj.mp.4001563. [DOI] [PubMed] [Google Scholar]
- 2.Joyce EM, Roiser JP. Cognitive heterogeneity in schizophrenia. Curr Opin Psychiatry. 2007;20:268–272. doi: 10.1097/YCO.0b013e3280ba4975. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Turetsky BI, Calkins ME, Light GA, Olincy A, Radant AD, et al. Neurophysiological endophenotypes of schizophrenia: the viability of selected candidate measures. Schizophr Bull. 2007;33:69–94. doi: 10.1093/schbul/sbl060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.van Os J, Kenis G, Rutten BPF. The environment and schizophrenia. Nature. 2010;468:203–212. doi: 10.1038/nature09563. [DOI] [PubMed] [Google Scholar]
- 5.Harrison PJ, Weinberger DR. Schizophrenia genes, gene expression, and neuropathology: on the matter of their convergence. Mol Psychiatry. 2005;10:40–68. doi: 10.1038/sj.mp.4001558. [DOI] [PubMed] [Google Scholar]
- 6.Gottesman, Gould TD. The endophenotype concept in psychiatry: etymology and strategic intentions. Am J Psychiatry. 2003;160:636–645. doi: 10.1176/appi.ajp.160.4.636. [DOI] [PubMed] [Google Scholar]
- 7.Keshavan MS, Tandon R, Boutros NN, Nasrallah HA. Schizophrenia, “just the facts”: what we know in 2008 Part 3: neurobiology. Schizophr Res. 2008;106:89–107. doi: 10.1016/j.schres.2008.07.020. [DOI] [PubMed] [Google Scholar]
- 8.Ozdemir V, Williams-Jones B, Glatt SJ, Tsuang MT, Lohr JB, et al. Shifting emphasis from pharmacogenomics to theragnostics. Nat Biotechnol. 2006;24:942–946. doi: 10.1038/nbt0806-942. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Schwarz E, Bahn S. The utility of biomarker discovery approaches for the detection of disease mechanisms in psychiatric disorders. Br J Pharmacol. 2008;153(Suppl 1):S133–136. doi: 10.1038/sj.bjp.0707658. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Vawter MP, Ferran E, Galke B, Cooper K, Bunney WE, et al. Microarray screening of lymphocyte gene expression differences in a multiplex schizophrenia pedigree. Schizophr Res. 2004;67:41–52. doi: 10.1016/s0920-9964(03)00151-8. [DOI] [PubMed] [Google Scholar]
- 11.Glatt SJ, Everall IP, Kremen WS, Corbeil J, Sasik R, et al. Comparative gene expression analysis of blood and brain provides concurrent validation of SELENBP1 up-regulation in schizophrenia. Proc Natl Acad Sci USA. 2005;102:15533–15538. doi: 10.1073/pnas.0507666102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Sullivan PF, Fan C, Perou CM. Evaluating the comparability of gene expression in blood and brain. Am J Med Genet B Neuropsychiatr Genet. 2006;141:261–268. doi: 10.1002/ajmg.b.30272. [DOI] [PubMed] [Google Scholar]
- 13.Kuzman MR, Medved V, Terzic J, Krainc D. Genome-wide expression analysis of peripheral blood identifies candidate biomarkers for schizophrenia. J Psychiatr Res. 2009;43:1073–1077. doi: 10.1016/j.jpsychires.2009.03.005. [DOI] [PubMed] [Google Scholar]
- 14.Allen NC, Bagade S, McQueen MB, Ioannidis JP, Kavvoura FK, et al. Systematic meta-analyses and field synopsis of genetic association studies in schizophrenia: the SzGene database. Nat Genet. 2008;40:827–834. doi: 10.1038/ng.171. [DOI] [PubMed] [Google Scholar]
- 15.Gladkevich A, Kauffman HF, Korf J. Lymphocytes as a neural probe: potential for studying psychiatric disorders. Prog Neuropsychopharmacol Biol Psychiatry. 2004;28:559–576. doi: 10.1016/j.pnpbp.2004.01.009. [DOI] [PubMed] [Google Scholar]
- 16.Marques-Deak A, Cizza G, Sternberg E. Brain-immune interactions and disease susceptibility. Mol Psychiatry. 2005;10:239–250. doi: 10.1038/sj.mp.4001643. [DOI] [PubMed] [Google Scholar]
- 17.Marazziti D, Catena Dell'Osso M, Baroni S, Masala I, Dell'Osso B, et al. Alterations of the dopamine transporter in resting lymphocytes of patients with different psychotic disorders. Psychiatry Res. 2010;175:54–57. doi: 10.1016/j.psychres.2009.03.009. [DOI] [PubMed] [Google Scholar]
- 18.Liu L, Jia F, Yuan G, Chen Z, Yao J, et al. Tyrosine hydroxylase, interleukin-1beta and tumor necrosis factor-alpha are overexpressed in peripheral blood mononuclear cells from schizophrenia patients as determined by semi-quantitative analysis. Psychiatry Res. 2010;176:1–7. doi: 10.1016/j.psychres.2008.10.024. [DOI] [PubMed] [Google Scholar]
- 19.Yao Y, Schroder J, Karlsson H. Verification of proposed peripheral biomarkers in mononuclear cells of individuals with schizophrenia. J Psychiatr Res. 2008;42:639–643. doi: 10.1016/j.jpsychires.2007.07.011. [DOI] [PubMed] [Google Scholar]
- 20.Ambros V. The functions of animal microRNAs. Nature. 2004;431:350–355. doi: 10.1038/nature02871. [DOI] [PubMed] [Google Scholar]
- 21.Perkins DO, Jeffries C, Sullivan P. Expanding the ‘central dogma’: the regulatory role of nonprotein coding genes and implications for the genetic liability to schizophrenia. Mol Psychiatry. 2005;10:69–78. doi: 10.1038/sj.mp.4001577. [DOI] [PubMed] [Google Scholar]
- 22.Cheng H-YM, Papp JW, Varlamova O, Dziema H, Russell B, et al. microRNA modulation of circadian-clock period and entrainment. Neuron. 2007;54:813–829. doi: 10.1016/j.neuron.2007.05.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Kocerha J, Faghihi MA, Lopez-Toledano MA, Huang J, Ramsey AJ, et al. MicroRNA-219 modulates NMDA receptor-mediated neurobehavioral dysfunction. Proc Natl Acad Sci USA. 2009;106:3507–3512. doi: 10.1073/pnas.0805854106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Coyle JT. MicroRNAs suggest a new mechanism for altered brain gene expression in schizophrenia. Proc Natl Acad Sci USA. 2009;106:2975–2976. doi: 10.1073/pnas.0813321106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Miller BH, Wahlestedt C. MicroRNA dysregulation in psychiatric disease. Brain Res. 2010;1338:89–99. doi: 10.1016/j.brainres.2010.03.035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Perkins DO, Jeffries CD, Jarskog LF, Thomson JM, Woods K, et al. microRNA expression in the prefrontal cortex of individuals with schizophrenia and schizoaffective disorder. Genome Biol. 2007;8:R27. doi: 10.1186/gb-2007-8-2-r27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Beveridge NJ, Tooney PA, Carroll AP, Gardiner E, Bowden N, et al. Dysregulation of miRNA 181b in the temporal cortex in schizophrenia. Hum Mol Genet. 2008;17:1156–1168. doi: 10.1093/hmg/ddn005. [DOI] [PubMed] [Google Scholar]
- 28.Beveridge NJ, Gardiner E, Carroll AP, Tooney PA, Cairns MJ. Schizophrenia is associated with an increase in cortical microRNA biogenesis. Mol Psychiatry. 2010;15:1176–1189. doi: 10.1038/mp.2009.84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Hassan SS, Romero R, Pineles B, Tarca AL, Montenegro D, et al. MicroRNA expression profiling of the human uterine cervix after term labor and delivery. Am J Obstet Gynecol. 2010;202:80 e81–88. doi: 10.1016/j.ajog.2009.08.016. [DOI] [PubMed] [Google Scholar]
- 30.Hsu SD, Chu CH, Tsou AP, Chen SJ, Chen HC, et al. miRNAMap 2.0: genomic maps of microRNAs in metazoan genomes. Nucleic Acids Res. 2008;36:D165–169. doi: 10.1093/nar/gkm1012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Wheeler G, Ntounia-Fousara S, Granda B, Rathjen T, Dalmay T. Identification of new central nervous system specific mouse microRNAs. FEBS Lett. 2006;580:2195–2200. doi: 10.1016/j.febslet.2006.03.019. [DOI] [PubMed] [Google Scholar]
- 32.Guyon I, Weston J, Barnhill S, Vapnik V. Gene selection for cancer classification using support vector machines. Mach Learn. 2002;46:389–422. [Google Scholar]
- 33.Kay SR. Positive and Negative Syndromes in Schizophrenia: Assessment and Research. New York: Brunner/Mazel; 1991. [Google Scholar]
- 34.Chen WJ, Liu SK, Chang CJ, Lien YJ, Chang YH, et al. Sustained attention deficit and schizotypal personality features in nonpsychotic relatives of schizophrenic patients. Am J Psychiatry. 1998;155:1214–1220. doi: 10.1176/ajp.155.9.1214. [DOI] [PubMed] [Google Scholar]
- 35.Chen WJ, Hsiao CK, Hsiao LL, Hwu HG. Performance of the Continuous Performance Test among community samples. Schizophr Bull. 1998;24:163–174. doi: 10.1093/oxfordjournals.schbul.a033308. [DOI] [PubMed] [Google Scholar]
- 36.Lin CCH, Chen WJ, Yang H-J, Hsiao CK, Tien AY. Performance on the Wisconsin Card Sorting Test among adolescents in Taiwan: Norms, factorial structure, and relation to schizotypy. J Clin Exp Neuropsychol. 2000;22:69–79. doi: 10.1076/1380-3395(200002)22:1;1-8;FT069. [DOI] [PubMed] [Google Scholar]
- 37.Freedman R, Adler LE, Myles-Worsley M, Nagamoto HT, Miller C, et al. Inhibitory gating of an evoked response to repeated auditory stimuli in schizophrenic and normal subjects. Human recordings, computer simulation, and an animal model. Arch Gen Psychiatry. 1996;53:1114–1121. doi: 10.1001/archpsyc.1996.01830120052009. [DOI] [PubMed] [Google Scholar]
- 38.Light GA, Braff DL. Mismatch negativity deficits are associated with poor functioning in schizophrenia patients. Arch Gen Psychiatry. 2005;62:127–136. doi: 10.1001/archpsyc.62.2.127. [DOI] [PubMed] [Google Scholar]
- 39. MAMI-Meta prediction of microRNA targets: < http://mami.med.harvard.edu/>.
- 40.Sethupathy P, Megraw M, Hatzigeorgiou AG. A guide through present computational approaches for the identification of mammalian microRNA targets. Nat Methods. 2006;3:881–886. doi: 10.1038/nmeth954. [DOI] [PubMed] [Google Scholar]
- 41.Jasinska AJ, Service S, Choi OW, DeYoung J, Grujic O, et al. Identification of brain transcriptional variation reproduced in peripheral blood: an approach for mapping brain expression traits. Hum Mol Genet. 2009;18:4415–4427. doi: 10.1093/hmg/ddp397. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Tsuang MT, Nossova N, Yager T, Tsuang MM, Guo SC, et al. Assessing the validity of blood-based gene expression profiles for the classification of schizophrenia and bipolar disorder: a preliminary report. Am J Med Genet B Neuropsychiatr Genet. 2005;133:1–5. doi: 10.1002/ajmg.b.30161. [DOI] [PubMed] [Google Scholar]
- 43.van Heerden JH, Conesa A, Stein DJ, Montaner D, Russell V, et al. Parallel changes in gene expression in peripheral blood mononuclear cells and the brain after maternal separation in the mouse. BMC Res Notes. 2009;2:195. doi: 10.1186/1756-0500-2-195. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Kim AH, Reimers M, Maher B, Williamson V, McMichael O, et al. MicroRNA expression profiling in the prefrontal cortex of individuals affected with schizophrenia and bipolar disorders. Schizophr Res. 2010;124:183–191. doi: 10.1016/j.schres.2010.07.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Zhou R, Yuan P, Wang Y, Hunsberger JG, Elkahloun A, et al. Evidence for selective microRNAs and their effectors as common long-term targets for the actions of mood stabilizers. Neuropsychopharmacology. 2009;34:1395–1405. doi: 10.1038/npp.2008.131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Shibata H, Tani A, Chikuhara T, Kikuta R, Sakai M, et al. Association study of polymorphisms in the group III metabotropic glutamate receptor genes, GRM4 and GRM7, with schizophrenia. Psychiatry Res. 2009;167:88–96. doi: 10.1016/j.psychres.2007.12.002. [DOI] [PubMed] [Google Scholar]
- 47.Schipper HM, Maes OC, Chertkow HM, Wang E. MicroRNA expression in Alzheimer blood mononuclear cells. Gene Regul Syst Bio. 2007;1:263–274. doi: 10.4137/grsb.s361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Abu-Elneel K, Liu T, Gazzaniga FS, Nishimura Y, Wall DP, et al. Heterogeneous dysregulation of microRNAs across the autism spectrum. Neurogenetics. 2008;9:153–161. doi: 10.1007/s10048-008-0133-5. [DOI] [PubMed] [Google Scholar]
- 49.Cogswell JP, Ward J, Taylor IA, Waters M, Shi Y, et al. Identification of miRNA changes in Alzheimer's disease brain and CSF yields putative biomarkers and insights into disease pathways. J Alzheimers Dis. 2008;14:27–41. doi: 10.3233/jad-2008-14103. [DOI] [PubMed] [Google Scholar]
- 50.Xiao F, Zuo Z, Cai G, Kang S, Gao X, et al. miRecords: an integrated resource for microRNA-target interactions. Nucleic Acids Res. 2009;37:D105–110. doi: 10.1093/nar/gkn851. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Cheung ZH, Fu AK, Ip NY. Synaptic roles of Cdk5: implications in higher cognitive functions and neurodegenerative diseases. Neuron. 2006;50:13–18. doi: 10.1016/j.neuron.2006.02.024. [DOI] [PubMed] [Google Scholar]
- 52.Glatt SJ, Faraone SV, Lasky-Su JA, Kanazawa T, Hwu HG, et al. Family-based association testing strongly implicates DRD2 as a risk gene for schizophrenia in Han Chinese from Taiwan. Mol Psychiatry. 2009;14:885–893. doi: 10.1038/mp.2008.30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Kerns D, Vong GS, Barley K, Dracheva S, Katsel P, et al. Gene expression abnormalities and oligodendrocyte deficits in the internal capsule in schizophrenia. Schizophr Res. 2010;120:150–158. doi: 10.1016/j.schres.2010.04.012. [DOI] [PubMed] [Google Scholar]
- 54.Hoh NZ, Wagner AK, Alexander SA, Clark RB, Beers SR, et al. BCL2 genotypes: functional and neurobehavioral outcomes after severe traumatic brain injury. J Neurotrauma. 2010;27:1413–1427. doi: 10.1089/neu.2009.1256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Dwivedi Y, Rizavi HS, Zhang H, Roberts RC, Conley RR, et al. Aberrant extracellular signal-regulated kinase (ERK)1/2 signalling in suicide brain: role of ERK kinase 1 (MEK1). Int J Neuropsychopharmacol. 2009;12:1337–1354. doi: 10.1017/S1461145709990575. [DOI] [PubMed] [Google Scholar]
- 56.Lize M, Pilarski S, Dobbelstein M. E2F1-inducible microRNA 449a/b suppresses cell proliferation and promotes apoptosis. Cell Death Differ. 2009;17:452–458. doi: 10.1038/cdd.2009.188. [DOI] [PubMed] [Google Scholar]
- 57.American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. Washington, DC: American Psychiatric Association; 2000. [Google Scholar]
- 58.Nurnberger JI, Jr, Blehar MC, Kaufmann CA, York-Cooler C, Simpson SG, et al. Diagnostic interview for genetic studies. Rationale, unique features, and training. NIMH Genetics Initiative. Arch Gen Psychiatry. 1994;51:849–859. doi: 10.1001/archpsyc.1994.03950110009002. [DOI] [PubMed] [Google Scholar]
- 59.Chang C-J, Chen WJ, Liu S-K, Cheng JJ, Ou Yang W-C, et al. Morbidity risk of psychiatric disorders among the first degree relatives of schizophrenia patients in Taiwan. Schizophr Bull. 2002;28:379–392. doi: 10.1093/oxfordjournals.schbul.a006947. [DOI] [PubMed] [Google Scholar]
- 60.Cheng JJ, Ho H, Chang CJ, Lan SY, Hwu HG. Positive and Negative Syndrome Scale (PANSS): establishment and reliability study of a Mandarin Chinese language version. Chinese Psychiatry. 1996;10:251–258. [Google Scholar]
- 61.Liu SK, Hwu HG, Chen WJ. Clinical symptom dimensions and deficits on the Continuous Performance Test in schizophrenia. Schizophr Res. 1997;25:211–219. doi: 10.1016/s0920-9964(97)00026-1. [DOI] [PubMed] [Google Scholar]
- 62.Heaton RK, Chelune GJ, Talley JL, Kay GG, Curtiss G. 1993. Wisconsin Card Sorting Test Manual: Revised and Expanded: Psychological Assessment Resources Odessa, FL.
- 63.Hunter MP, Ismail N, Zhang X, Aguda BD, Lee EJ, et al. Detection of microRNA expression in human peripheral blood microvesicles. PLoS One. 2008;3:e3694. doi: 10.1371/journal.pone.0003694. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Schmittgen TD, Lee EJ, Jiang J, Sarkar A, Yang L, et al. Real-time PCR quantification of precursor and mature microRNA. Methods. 2008;44:31–38. doi: 10.1016/j.ymeth.2007.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Simon R, Radmacher MD, Dobbin K, McShane LM. Pitfalls in the use of DNA microarray data for diagnostic and prognostic classification. J Natl Cancer Inst. 2003;95:14–18. doi: 10.1093/jnci/95.1.14. [DOI] [PubMed] [Google Scholar]
- 66.Miettinen OS. Stratification by a multivariate confounder score. Am J Epidemiol. 1976;104:609–620. doi: 10.1093/oxfordjournals.aje.a112339. [DOI] [PubMed] [Google Scholar]
- 67.Wu HM, Tien YJ, Chen C. GAP: A graphical environment for matrix visualization and cluster analysis. Comput Stat Data Anal. 2010;54:767–778. [Google Scholar]
- 68.Kiriakidou M, Nelson PT, Kouranov A, Fitziev P, Bouyioukos C, et al. A combined computational-experimental approach predicts human microRNA targets. Genes Dev. 2004;18:1165–1178. doi: 10.1101/gad.1184704. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Krek A, Grun D, Poy MN, Wolf R, Rosenberg L, et al. Combinatorial microRNA target predictions. Nat Genet. 2005;37:495–500. doi: 10.1038/ng1536. [DOI] [PubMed] [Google Scholar]
- 70.Lewis BP, Burge CB, Bartel DP. Conserved seed pairing, often flanked by adenosines, indicates that thousands of human genes are microRNA targets. Cell. 2005;120:15–20. doi: 10.1016/j.cell.2004.12.035. [DOI] [PubMed] [Google Scholar]
- 71.Wang X. Systematic identification of microRNA functions by combining target prediction and expression profiling. Nucleic Acids Res. 2006;34:1646–1652. doi: 10.1093/nar/gkl068. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Betel D, Wilson M, Gabow A, Marks DS, Sander C. The microRNA.org resource: targets and expression. Nucleic Acids Res. 2008;36:D149–153. doi: 10.1093/nar/gkm995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Statist Soc Ser. 1995;B57:289–300. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.