Abstract
Emerging studies have reported circRNAs were dysregulated in HCC. However, the clinical value of these circRNAs remains to be clarified. Herein, we aimed to comprehensively explore their association with the diagnosis, prognosis, and clinicopathological characteristics of HCC. PubMed, EMBASE, Web of Science, and Cochrane Library databases were comprehensively searched for eligible studies up to October 30, 2018. The diagnostic effect was evaluated by the pooled sensitivity, specificity, and other indexes. The pooled hazard ratio (HR) for overall survival (OS) and recurrence free survival (RFS) was calculated to assess the prognostic value. Ten studies on diagnosis, 12 on prognosis, and 23 on clinicopathology were identified from the databases. A total of 11 upregulated and 11 downregulated circRNAs showed an association with clinicopathological features of HCC. For the diagnosis analyses, the pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), and diagnostic odds ratio (DOR) of circRNAs for HCC were 0.74 (95%CI: 0.65-0.82) and 0.76 (95%CI: 0.70-0.81), 3.1 (95%CI: 2.5-3.8), 0.34 (95%CI: 0.25-0.47), and 9 (95%CI: 6-14), respectively. The area under SROC curve (AUC) was 0.81 (95% CI: 0.78–0.84), indicating moderate diagnostic accuracy. In stratified analyses, the diagnostic performance of circRNAs varied based on the source of control and specimen type. For the prognosis analyses, increased expression of upregulated circRNAs was associated with worse OS (HR: 3.67, 95%: 2.07-6.48), while high expression of downregulated circRNAs was associated with better OS (HR: 0.38, 95%: 0.30-0.48). In conclusion, this study reveals that circRNAs may serve as promising diagnostic and prognostic biomarkers for HCC. However, further investigations are still required to explore the clinical value of circRNAs.
1. Introduction
Hepatocellular carcinoma (HCC), a highly heterogeneous malignancy, is the second leading cause of cancer-related death worldwide [1, 2]. Although major progress has been achieved in prevention, detection, diagnosis, and treatment, a total of 782000 cases diagnosed and 746 000 deaths were estimated to occur in 2012 worldwide [3]. Currently, due to inefficient screening, HCC is often diagnosed at advanced stages; many patients therefore miss the optimal time for surgery [4, 5]. Furthermore, failure to identify patients at high risk of metastasis and recurrence has also resulted in an unsatisfactory prognosis of HCC patients. Therefore, there is an urgent need for more effective biomarkers for early detection and prognosis prediction of HCC.
Circular RNAs (circRNAs), a novel class of noncoding RNA, are generated by ‘backsplicing' of protein-coding mRNAs or linear noncoding RNA that join an upstream 3′ splice site and downstream 5′ splice site to form a covalently closed continuous loop [6]. They are highly stable, abundant and conserved, and involved in various physiological and pathological processes. However, the biological functions of most circRNAs are still unclear. Recently, emerging studies have revealed that aberrant circRNA expression has been observed in various cancers, such as colorectal cancer, breast cancer, gastric cancer, and HCC [7]. These circRNAs played crucial roles in the cancer-associated proliferation, angiogenesis, and metastasis and might be the key factors for cancer occurrence and development. To date, a series of articles have reported that circRNAs have great potential to serve as promising biomarkers for HCC. For instance, Qin et al. [8] found hsa_circ_0001649 was significantly downregulated in HCC. It might function in tumorigenesis and metastasis and could serve as a potential biomarker in the diagnosis of HCC (AUC = 0.63). In addition, cSMARCA5 could inhibit the proliferation and migration of HCC cells. The downregulation of cSMARCA5 was significantly correlated with aggressive characteristics and might serve as an independent risk factor for overall survival (OS) and recurrence free survival (RFS) in HCC patients [9].
However, due to the variances in study design, sample size, patient characteristic, and detection methods, the clinical value of circRNAs for HCC has not yet been fully elucidated. Previously, four published meta-analyses have reported the diagnostic and prognostic value of circRNAs for human cancers [10–13]; however, they included relatively few studies and patients and did not perform detailed analyses to explore the diagnostic value of circRNAs for HCC. Therefore, we performed this systematic review and meta-analysis to explore the relationship between aberrant cirRNAs expression and the diagnosis, prognosis, and clinicopathological characteristics of HCC.
2. Methods
2.1. Search Strategy
This meta-analysis was conducted according to the PRISMA guideline (Supplement File S1) [14]. We comprehensively searched for the relevant articles in PubMed, EMBASE, Web of Science, and Cochrane Library databases (up to October 30, 2018) assessing the potential clinical utility of circRNAs for HCC. A combination of the Medical Subject Headings (MeSH) and title/abstract words was used: (liver neoplasia or carcinoma or neoplasm or cancer or tumor) and (circular RNAs or circRNAs). We also manually searched relevant reviews and bibliographies of eligible articles to find out other potential studies.
2.2. Eligibility Criteria
The eligible studies should meet the following criteria: (1) the diagnosis of HCC was pathologically confirmed; (2) about evaluating the relationship between circRNAs and the diagnosis, prognosis, or clinicopathological characteristics of HCC; (3) for diagnosis, studies could supply sufficient information to construct the diagnostic 2 × 2 tables; and (4) for prognosis, HR (hazard ratio) and its 95% confidence interval (95% CI) can be extracted or calculated from the studies [15]. The exclusion criteria were as follows: (1) duplicate articles; (2) case reports, letters, reviews, editorials, and meeting abstracts; and (3) insufficient data.
2.3. Data Extraction and Quality Assessment
The following data were extracted: first author, year of publication, country, sample size, clinicopathological features, circRNAs profiles, altered expression, specimen type, detection method, reference gene, diagnostic data, follow-up period, outcomes, and HRs with its 95% CIs.
The quality of diagnostic studies was assessed with the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS2). Meanwhile, the Newcastle-Ottawa Scale (NOS) was applied to assess the quality of prognostic studies [16], and a score ≥6 indicates high quality.
All these processes were performed independently by two reviewers (HQQ and HYD). Any discrepancies were resolved by consensus.
2.4. Statistical Analysis
All analyses were performed with the RevMan5.3 (version 1.4), STATA 12.0 (STATA Corporation, College Station, TX), Meta-Disc 1.4, and Engauge Digitizer 4.1 software. HRs with 95% CI were directly extracted from each study, if provided, or calculated according to the methods clarified by Tierney et al. [15]. A bivariate meta-analysis model was employed to calculate the pooled sensitivity, specificity, likelihood ratio (LR), diagnostic odds ratio (DOR), and HR with 95% CI, respectively. A summary receiver operator characteristic curve (SROC) was also established and corresponding AUCs with 95% CI were calculated [17, 18]. The Cochran-Q and Inconsistency index (I2) tests were applied to assess the heterogeneity among studies [19]. A P value (≤0.05) or I2 value (≥50%) indicated significant heterogeneity and the random-effects model was adopted. Otherwise, the fixed-effects model was used [20]. Spearman correlation coefficient was used to verify the threshold effect. To explore the sources of heterogeneity, we performed subgroup analysis and metaregression. Sensitivity analysis was further carried out to assess the robustness of the results. At last, publication bias was evaluated using Begg's funnel plot [21] and Deek's funnel plot, and P > 0.05 indicated no potential publication bias. All tests were two-sided and P < 0.05 was regarded as statistically significant.
3. Results
3.1. Literature Selection
As described in Figure 1, a total of 254 articles were initially identified and 151 studies remained after excluding duplicate studies. By screening the titles and abstracts, 116 articles were further excluded because of editorial, reviews, conference abstracts, or irrelevant research topic. As a result, 35 remaining articles were for full-text review, and then 6 papers were excluded due to conference abstracts or insufficient data. Ultimately, 29 articles were included in this study, including 23 studies [8, 9, 22–42] on clinicopathological features, 10 on diagnosis [8, 22, 25–27, 31–33], 10 on OS [9, 26, 28, 34, 35, 38–40, 43, 44], and 2 on RFS [9, 45].
3.2. Correlation of circRNAs Expression with Clinicopathological Features
A total of 22 circRNAs from 23 articles showed an association with clinicopathological features of HCC. As summarized in Table 1, hsa_circ_0128298, circRNA_100338, circHIPK3, Hsa_circ_001569, hsa_circ_0005075, circ-PVT1, circ-10720, circRNA101368, circ_001569, has_circ_0078710, and circ-ZEB1.33 were upregulated, whereas hsa_circ_0001445, circSMAD2, Hsa_circ_0001649, hsa_circ_0005986, CircC3P1, hsa_circ_0004018, cirZKSCAN1, cSMARCA5, hsa_circ_0003570, hsa_circ_0068669, and hsa_circ_0064428 were downregulated. Altered circRNAs expression was significantly associated with tumor stage, differentiation, size, numbers, vascular invasion, organ metastasis, and AFP (alpha-fetoprotein) in almost studies. They might play crucial roles in tumorigenesis and tumor progression of HCC. Additionally, some studies also showed a relationship of circRNAs expression with liver cirrhosis or chronic hepatitis B.
Table 1.
Study | Sample size | circRNA | Altered expression | Test Method | Specimen | Co-variants (clinicopathological parameters) |
Function | Reference |
---|---|---|---|---|---|---|---|---|
Zhang 2018 | 73/104 | hsa_circ_0001445 | Down | qRT-PCR | Tissue | Tissue: Tumor foci; Spasm: AFP | Apoptosis/proliferation/ migration/invasion |
[22] |
Spasm | ||||||||
Zhang 2018 | 86 | circSMAD2 | Down | qRT-PCR | Tissue | Differentiation | Migration/invasion/ EMT | [23] |
Qin 2016 | 89 | Hsa_circ_0001649 |
Down | qRT-PCR | Tissue | tumor size and embolus | Metastasis | [8] |
Fu 2017 | 81 | Hsa_circ_0005986 | Down | qRT-PCR | Tissue | BCLC stage, chronic hepatitis B, tumor size, MVI | Carcinogenesis | [24] |
Fu 2017 | 102 | hsa_circ_0004018 | Down | qRT-PCR | Tissue | AFP, tumor size, differentiation, BCLC and TNM stage | Carcinogenesis/metastasis | [25] |
Chen 2018 | 78 | hsa_circ_0128298 | Up | qRT-PCR | Tissue | vascular cancer embolus, lymphatic metastasis and organ metastasis | Proliferation/metastasis | [26] |
Yao 2017 | 102 | cirZKSCAN1 | Down | qRT-PCR | Tissue | tumor number, liver cirrhosis, vascular invasion and TNM stage | Growth/migration/invasion | [27] |
Huang 2017 | 80 | circRNA_100338 | Up | qRT-PCR | Tissue | Vascular invasion, Lung metastasis and TNM stage | Metastasis | [28] |
Chen 2018 | 50 | circHIPK3 | Up | qRT-PCR | Tissue | TNM stage, differentiation, HBV-DNA copy numbers and liver cirrhosis | Proliferation/migration | [29] |
Jin 2017 | 30 | Hsa_circ_001569 | Up | qRT-PCR | Tissue | tumor differentiation and TNM stage | Proliferation/ growth | [30] |
Shang 2016 | 30 | hsa_circ_0005075 | Up | qRT-PCR | Tissue | tumor size | Proliferation/invasion/ metastasis |
[31] |
Yu 2018 | 163 | cSMARCA5 | Down | qRT-PCR | Tissue | Tumor size, differentiation, TNM stage, BCLC stage, Edmondson's grade and MVI | Growth/metastasis | [9] |
Fu 2018 | 107 | hsa_circ_0003570 | Down | qRT-PCR | Tissue | tumor size, differentiation, AFP, MVI, BCLC stage and TNM stage | Recurrence/metastasis | [32] |
Yao 2018 | 100 | hsa_circ_0068669 | Down | qRT-PCR | Tissue | MVI and TMN stage | Progression | [33] |
Zhong 2018 | 47 | CircC3P1 | Down | qRT-PCR | Tissue | TNM stage, tumor size and vascular invasion | Proliferation/migration/ invasion |
[34] |
Zhang 2018 | 77 | hsa_circ_0001649 | Down | qRT-PCR | Tissue | No significant correlation | Apoptosis/proliferation/ migration/invasion |
[35] |
Zhu 2018 | 46 | circ-PV T1 | Up | qRT-PCR | Tissue | Tumor size, differentiation and TNM stage | Proliferation | [36] |
Meng 2018 | 75 | circ-10720 | Up | FISH | Tissue | Tumor stage, AFP and HBV markers | Development/progression | [37] |
Li 2018 | 51 | circRNA101368 | Up | qRT-PCR | Tissue | Tumor size, distant metastasis and TNM stage | Migration | [38] |
Liu 2018 | 70 | circ_001569 | Up | qRT-PCR | Tissue | Tumor size and TNM stage | Growth/metastasis | [39] |
Weng 2018 |
120 | hsa_circ_0064428 | Down | qRT-PCR | Tissue | Tumor size, differentiation and TNM stage | Tumourigenesis/metastasis | [40] |
Xie 2018 | 56 | has_circ_0078710 | Up | qRT-PCR | Tissue | TNM stage | Proliferation/migration/ invasion/growth |
[41] |
Gong 2018 | 64 | circ-ZEB1.33 | Up | qRT-PCR | Tissue | Tumor size and TNM stage | Proliferation | [42] |
serum |
EMT: epithelial-mesenchymal transition; BCLC: Barcelona Clinic Liver Cancer Staging System; AFP: alpha-fetoprotein; TNM: tumor-node-metastasis; MVI: microvascular invasion; FISH: fluorescence in situ hybridization; HBV: hepatitis B virus.
4. Diagnostic Meta-Analysis
4.1. Study Characteristics and Quality Assessment
The baseline characteristics of the eligible studies were summarized in Table 2. Ten studies from 8 articles with 712 cases and 811 controls were included. All of the studies were published from 2016 to 2018 and conducted in China. Most of patients were male and pathologically diagnosed with HBV-associated HCC. The quantitative reverse transcription polymerase chain reaction (qRT-PCR) was used to measure the expression of 8 circRNAs, and the most common reference gene was GAPDH. In addition, specimens contain plasma and tissue. The quality of the studies was moderate. Further details of the quality assessment were summarized in Supplement Figure S1.
Table 2.
Author, year | Country | Sample size (case/control) | Male (case) | HBsAg (case) | Tumor size (≤5) | Control | Profile | Specimen type | Method | Reference gene | Sensitivity (%) | Specificity (%) |
---|---|---|---|---|---|---|---|---|---|---|---|---|
Zhang et al. 2017 | China | 104/52 | 87 | NA | NA | healthy people | hsa_circ_0001445 | plasma | qRT-PCR (SYBR) |
GAPDH | 94.20 | 71.20 |
104/57 | 87 | NA | NA | liver cirrhosis | hsa_circ_0001445 | plasma | qRT-PCR (SYBR) |
GAPDH | 74.00 | 54.40 | ||
104/44 | 87 | NA | NA | chronic hepatitis B | hsa_circ_0001445 | plasma | qRT-PCR (SYBR) |
GAPDH | 69.20 | 72.70 | ||
Qin et al. 2016 | China | 89/89 | 74 | 66 | 50 | adjacent non-tumor tissues | hsa_circ_0001649 | tissue | qRT-PCR (SYBR) |
β-actin | 81.00 | 69.00 |
Zhang et al. 2017 | China | 102/152 | 90 | 86 | 62 | adjacent non-tumor tissues and chronic hepatitis | hsa_circ_0004018 | tissue | qRT-PCR (SYBR) |
GAPDH | 71.60 | 81.50 |
Chen et al. 2018 | China | 78/78 | 70 | 65 | NA | adjacent non-tumor tissues | hsa_circ_0128298 | tissue | qRT-PCR (SYBR) |
GAPDH | 67.40 | 80.50 |
Yao et al. 2017 | China | 102/102 | 87 | 85 | 29 | adjacent non-tumor tissues | cirZKSCAN1 | tissue | qRT-PCR (SYBR) |
GAPDH | 82.20 | 72.40 |
Shang et al. 2016 | China | 30/30 | 25 | 23 | 19 | adjacent non-tumor tissues | hsa_circ_0005075 | tissue | qRT-PCR (SYBR) |
GAPDH | 83.30 | 90.00 |
Fu et al. 2017 | China | 107/137 | 96 | 90 | 62 | chronic hepatitis and liver cirrhosis | hsa_circ_0003570 | tissue | qRT-PCR (SYBR) |
GAPDH | 44.90 | 86.80 |
Yao et al. 2018 | China | 100/70 | 14 | NA | 61 | chronic hepatitis | hsa_circ_0068669 | tissue | qRT-PCR (SYBR) |
GAPDH | 59.00 | 71.00 |
HBsAg: surface antigen of the hepatitis B virus; qRT-PCR: quantitative reverse transcription PCR; NA: not available.
4.2. Pooled Diagnostic Performance
As shown in Figure 2, considerable heterogeneity was observed among these studies (I2= 89.68%, P < 0.01 for sensitivity; I2= 75.64%, P < 0.01 for specificity). Therefore, a random-effect model was conducted. The pooled sensitivity, specificity, PLR, NLR, and DOR were 0.74 (95%CI: 0.65-0.82), 0.76 (95%CI: 0.70-0.81), 3.1 (95%CI: 2.50-3.80), 0.34 (95%CI: 0.25-0.47), and 9 (95%CI: 6 - 14), respectively. Moreover, the summary receiver operating characteristic curve (SROC) was also performed and the AUC was 0.81 (95% CI: 0.78-0.84) (Figure 3), indicating circRNAs had potential diagnostic value for HCC. In this study, threshold effect, the important source of heterogeneity, was explored. The spearman correlation coefficient was 0.248 (P=0.489), indicating no obvious threshold effect existed within included studies.
4.3. Subgroup Analysis and Meta-Regression Analysis
To explore the potential sources of heterogeneity, metaregression, and subgroup analyses were conducted according to the sample size, source of control, specimen type, reference gene, and male ratio. As presented in Table 3, circRNAs could more efficiently discriminate HCC from healthy individuals or adjacent nontumor tissues than from benign diseases (sensitivity: 0.83 versus 0.64, DOR: 14 versus 6, and AUC: 0.81 versus 0.75), and the heterogeneity reduced significantly from 71.4% to 56.7% and 55.6%, respectively. For the subgroup based on specimen type, plasma circRNAs might obtain a higher sensitivity and lower specificity (0.79 versus 0.68 and 0.65 versus 0.79, respectively). In addition, compared with the overall results, there were no significant differences in the studies with male (≥80%) or with GAPDH as a reference gene. According to the results of metaregression, none of these covariates above was responsible for the heterogeneity among included studies (p > 0.05). However, the source of control (RDOR: 2.65, 95% CI: 0.94-7.46, P = 0.06) might partially explain the heterogeneity.
Table 3.
Covariate | No. of studies | Heterogeneity | Sensitivity | Specificity | DOR | AUC | RDOR | P |
---|---|---|---|---|---|---|---|---|
I 2 test (%)/Ph | (95%CI) | (95%CI) | (95%CI) | (95%CI) | (95%CI) | |||
Sample size | . | |||||||
N ≥170 | 5 | 60.40/ 0.04 | 0.69 (0.55 - 0.80) | 0.78 (0.71 - 0.83) | 8.00 (5.00 - 12.00) | 0.81 (0.77 - 0.84) | 0.83 (0.23-3.03) | 0.74 |
N <170 | 5 | 81.10/<0.01 | 0.80 (0.67 - 0.88) | 0.74 (0.63 - 0.83) | 11.00 (5.00 - 27.00) | 0.83 (0.80 - 0.86) | ||
Source of control | ||||||||
Healthy people or adjacent non-tumor tissues | 5 | 56.70/ 0.06 | 0.83 (0.73 - 0.90) | 0.75 (0.69 - 0.80) | 14.00 (9.00 - 23.00) | 0.81 (0.78 - 0.84) | 2.65 (0.94-7.46) | 0.06 |
Liver cirrhosis or chronic hepatitis | 5 | 55.60/0.06 | 0.64 (0.54 - 0.73) | 0.75 (0.64 - 0.84) | 6.00 (4.00 – 8.00) | 0.75 (0.71 - 0.79) | ||
Specimen type | ||||||||
Plasmas | 3 | 87.30/<0.01 | 0.79 (0.74 - 0.84) | 0.65 (0.57 - 0.73) | 8.93 (2.37 – 33.64) | 0.72 (0.45 - 1.00) | 0.57 (0.13-2.56) | 0.41 |
Tissue | 7 | 60.50/ 0.02 | 0.68 (0.64 - 0.72) | 0.79 (0.75 - 0.82) | 8.62 (5.58 – 13.30) | 0.82 (0.77 - 0.87) | ||
Reference gene | 9 | 74.30/<0.01 | 0.74 (0.63 - 0.82) | 0.76 (0.70 - 0.82) | 9.00 (5.00 - 15.00) | 0.82 (0.78 - 0.85) | ||
(GAPDH) | ||||||||
Male (≥80%) | 9 | 68.40/<0.01 | 0.76 (0.66 - 0.84) | 0.76 (0.69 - 0.82) | 10.00 (6.00 – 16.00) | 0.82 (0.79 - 0.85) | ||
Overall | 10 | 71.40/<0.01 | 0.74 (0.65 - 0.82) | 0.76 (0.70 - 0.81) | 9.00 (6.00 – 14.00) | 0.81 (0.78 - 0.84) |
CI: confidence interval; DOR: diagnostic odds ratio; RDOR: Relative diagnostic odds ratio; AUC: the area under the SROC curve.
4.4. Publication Bias and Sensitivity Analysis
To evaluate the publication bias of the included studies, Deeks' funnel plot asymmetry test was performed. As indicated in Figure 4, a P value of 0.32 suggested that there was no significant publication bias. Sensitivity analysis was further performed. As displayed in Figure 5, the results were stable and not significantly affected by any individual study.
5. Prognostic Meta-Analysis
5.1. Study Characteristics and Quality Assessment
As present in Table 4, 12 studies from 11 articles with 1185 cases were included in this prognosis analysis. All these studies were conducted in China and published from 2016 to 2018. The qRT-PCR and FISH were adopted to quantify the level of circRNAs in tissues with GAPDH and b-actin as reference genes. OS and RFS were used to evaluate the outcome of the cohorts. A total of 11 different circRNAs were investigated. Increased expression of hsa_circ_0128298, ciRS-7, circRNA101368, circ_001569, and circRNA_100338 and decreased expression of CircC3P1, cSMARCA5, hsa_circ_0001649, hsa_circ_0064428, circ-ITCH, and circMTO1 were associated with worse prognosis. HRs and 95% CI were directly reported in 7 studies, and the remaining were extrapolated and calculated from Kaplan-Meier curves. The NOS scores varied from 5 to 7, suggesting that the quality of included studies was moderate. Details of quality assessment were present in Supplement Table S1.
Table 4.
Author, year | Country | Case | circRNAs | Altered expression | Specimen type | Method | Reference gene | Outcome | Follow-up (month) | Expression related to poor prognosis | HR (95%CI) | Analysis method | NOS (scores) |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Chen et al. 2018 | China | 78 | hsa_circ_0128298 | Up | tissue | qRT-PCR (SYBR) | GAPDH | OS | ~67 | Up | 6.661 (2.661-8.418) | Multivariate | 6 |
Huang et al. 2017 | China | 80 | circRNA_100338 | Up | tissue | qRT-PCR (SYBR) | GAPDH | OS | ~120 | Up | 2.75 (1.01-7.52) | Kaplan-Meier curves | 7 |
Yu et al. 2018 | China | 163 | cSMARCA5 | down | tissue | qRT-PCR (SYBR) | GAPDH | OS RFS |
~60 | down | 2.47 (1.459-4.182) 1.673 (1.08-2.591) |
Multivariate | 7 |
Xu et al. 2017 | China | 95 | ciRS-7 | Up | tissue | qRT-PCR (SYBR) | GAPDH | RFS | ~63 | Up | 1.17 (0.58 - 2.38) | Multivariate | 7 |
Zhong et al. 2018 | China | 47 | CircC3P1 | down | tissue | qRT-PCR (SYBR) | b-actin | OS | ~60 | down | 0.62 (0.11 - 3.39) | Kaplan-Meier curves | 6 |
Zhang et al. 2018 | China | 77 | hsa_circ_0001649 | down | tissue | qRT-PCR (SYBR) | GAPDH | OS | ~45 | down | 0.191 (0.053-0.682) | Multivariate | 7 |
Guo et al. 2017 | China | 288 | circ-ITCH | down | tissue | qRT-PCR (SYBR) | GAPDH | OS | ~83 | down | 0.45 (0.29 - 0.68) | Multivariate | 6 |
Han et al. 2017 | China | 116 | circMTO1 | down | tissue | FISH | - | OS | ~80 | down | 0.34 (0.22 - 0.51) | Kaplan-Meier curves | 5 |
Li et al. 2018 | China | 51 | circRNA101368 | Up | tissue | qRT-PCR (SYBR) | GAPDH | OS | ~60 | Up | 3.246 (1.098-9.594) | Multivariate | 6 |
Liu et al. 2018 | China | 70 | circ_001569 | Up | tissue | qRT-PCR (SYBR) | NA | OS | ~60 | Up | 2.291 (1.059-4.954) | Multivariate | 7 |
Weng et al. 2018 | China | 120 | hsa_circ_0064428 | down | tissue | qRT-PCR (SYBR) | NA | OS | ~72 | down | 0.36 (0.22-0.58) | Kaplan-Meier curves | 7 |
qRT-PCR: quantitative reverse transcription PCR; FISH: fluorescence in situ hybridization; OS: overall survival; RFS: recurrence free survival; NA: not available; HR: hazard ratio; NOS: the Newcastle-Ottawa scale.
5.2. Association between circRNAs and Outcomes
Due to significant heterogeneity among studies existed (I2 = 92%, P < 0.01), a random-effects model was performed. As shown in Figure 6, the pooled HR of OS was 0.90 (95%CI: 0.43-1.88) for high versus low cirRNAs expression. Stratified analysis according to altered expression was then performed. The pooled HR for upregulated circRNAs and downregulated circRNAs were 3.67 (2.07-6.48) and 0.38 (0.30-0.48), respectively (Figure 6(a)), and the heterogeneity reduced significantly from 92% to 47% and 0%, respectively. The increased expression of upregulated circRNAs or decreased expression of downregulated circRNAs was significantly related to a worse prognosis. Metaregression analysis for this subgroup suggested that altered expression was the main source of heterogeneity (P < 0.01).
Additionally, two studies including 258 patients reported HRs for RFS. The overall result revealed that circRNAs expression was not associated with RFS in HCC patients (HR: 0.79, 95%CI: 0.41-1.51, P = 0.47) (Figure 6(b)).
5.3. Publication Bias
Publication bias was checked by Begg's funnel plot. As suggested in Figure 7, a P value of 0.19 suggested that there was no significant publication bias among these studies.
6. Discussion
Increasing studies have demonstrated that circRNAs are relatively stable and detectable in body fluids and tissues and may serve as promising biomarkers for cancer diagnosis and prognosis [46]. Herein, we implemented this comprehensive review to evaluate the clinical value of circRNAs for HCC. According to the results of this study, the diagnostic accuracy of circRNAs for HCC was moderate. Moreover, altered circRNAs expression was significantly associated with tumor characteristic, and increased expression of upregulated circRNAs or decreased expression of downregulated circRNAs could predict worse OS in HCC patients. These findings indicate that circRNAs may serve as promising biomarkers for HCC diagnosis and prognosis prediction.
For diagnostic value, four previous meta-analyses concluded that the overall sensitivity, specificity, and NLR of circRNA for HCC were from 0.73 to 0.82, 0.72 to 0.79, and 0.34, with PLR ranging from 3.40 to 3.51, DOR from 10.00 to 10.21, and AUC from 0.83 to 0.86, respectively [10–13]. Consistent with these findings, in our study, the pooled sensitivity, specificity, and AUC of circRNAs were 0.74, 0.76, and 0.81, respectively, indicating a moderate diagnostic accuracy. The pooled DOR, a global measure of diagnostic performance [47], was 9, suggesting that circRNAs could effectively discriminate HCC patients from noncancerous controls. The pooled PLR was 3.1, suggesting that there was 3.1-fold higher possibility of altered expression of circRNAs for patients with HCC compared to those without. Likewise, NLR of 0.34 indicates that people with normal expression of circRNAs still have a 34% chance of having HCC. In stratified analysis, expectedly, the diagnostic value of circRNAs varied according to the source of control. CircRNAs could more efficiently discriminate HCC from healthy individuals than from benign diseases. Furthermore, in accordance with previous studies [48–50], the characteristics of detection methods may also affect the diagnostic performance of circRNAs. Plasma circRNAs might obtain higher sensitivity and lower specificity in this study. Therefore, standardized protocol needs to be established to minimize protocol-based bias, and make the results more comparable.
Although the diagnostic performance of circRNAs was not good enough to confirm or exclude the diagnosis of HCC, circRNAs still have great advantages over the traditional clinical marker, and when combined with other biomarkers or clinical examinations, circRNAs may obtain a better diagnostic performance. As Fu et al. reported, hsa_circ_0004018 is a valuable biomarker for HCC diagnosis, with its superior sensitivity to alpha-fetoprotein (AFP) [25]. Similarly, Plasma hsa_circ_0001445 also had a higher diagnostic accuracy than AFP for distinguishing HCC patients from healthy people or patients with hepatitis B. And when combined, the efficiency in distinguishing HCC from healthy controls (AUC: 0.970, 95% CI: 0.949–0.991), from cases of cirrhosis (AUC: 0.743, 95% CI: 0.664–0.821), or from cases of hepatitis B (AUC: 0.877, 95% CI: 0.817–0.938) was higher [22]. However, further multicenter and high-quality studies are still required to explore their diagnostic value as promising biomarkers.
Advanced studies have revealed that plenty of circRNAs are differentially expressed in HCC. They play crucial roles in tumorigenesis and tumor progression [6, 7, 51] and are significantly correlated with clinicopathological features, especially tumor characteristic. For instance, circSMAD2 inhibits the migration, invasion, and EMT of HCC cells by targeting miR-629 [23] and markedly associates with the differentiation degree; circC3P1 acts as a tumor suppressor via enhancing PCK1 expression by sponging miR-4641 to inhibit HCC growth and metastasis. It negatively correlated with TNM stage, tumor size, and vascular invasion and might serve as a prognostic biomarker [34]. In addition, Hsa_circ_0005986 also functioned as microRNA sponge in tumorigenesis and accelerated cell proliferation by promoting the G0/ G1 to S phase transition in liver cancer cells and was correlated with tumor diameters, stage, and microvascular invasion [24]. All these evidences suggest that circRNAs may be risk factors for the outcome in HCC patients.
However, currently, it remains controversial whether circRNAs could serve as prognostic markers. Zhang et al. reported that hsa_circ_0001649 expression was a novel independent prognostic factor for a better OS of HCC patients [35], while upregulated circRNA_100338 closely correlated with a lower cumulative survival rate and metastatic progression in HCC patients with hepatitis B [28]. Moreover, elevated ciRS-7 expression in HCC showed a shorter time of tumor recurrence than that of patients with decreased ciRS-7 expression, but no statistical significance was observed [45]. In this meta-analysis, we found that upregulated or downregulated circRNAs were significantly associated with OS in HCC, and the predictive efficacy was significant, suggesting a value of employing circRNAs as biomarkers for HCC prognosis, which were consistent with previous meta-analysis and studies [13]. Regrettably, due to limited studies (n=2), we failed to draw clear conclusions on the association between circRNAs and RFS in HCC patients. Therefore, further large-scale investigations are demanded to comprehensively and objectively investigate their promising prognostic value for HCC.
Compared with previous meta-analyses [10–13], we included more diagnostic studies, which would make our assessment more precise. What is more, further detailed analyses of diagnostic value of circRNAs for HCC were performed according to the sample size, source of control, specimen type, reference gene, and male ratio. In addition, the association between circRNAs expression and survival of HCC patients (OS and RFS) were also comprehensively evaluated. However, the following limitations merit consideration. Firstly, the number of studies and sample size are still relatively small, so our findings needed more large cohorts to validate. Secondly, due to unavailable original data, we failed to quantificationally evaluate the association of circRNAs with clinicopathological features and make more confirming conclusions. Thirdly, several HRs could not be directly extracted from 4 studies and were calculated from the Kaplan-Meier survival curves, which might be less reliable and biased our results. Fourthly, obvious heterogeneity existed across the included studies. The source of control and altered expression might be the sources of heterogeneity in diagnostic and prognostic meta-analysis, respectively. However, we failed to find other potential sources. Lastly, all included studies were conducted in China; therefore, our conclusions might not be universally suitable.
In summary, our meta-analysis indicates that aberrant circRNAs expression closely correlated with the clinicopathological characteristics of HCC, and it is possible that these circRNAs may serve as promising diagnostic and prognostic biomarkers for HCC. However, due to the limitations of this meta-analysis, well-designed, larger-size, and higher-quality prospective studies are required to confirm the clinical value of circRNAs as tumor markers and draw more definitive conclusions.
Acknowledgments
This study is funded by Wuxi Science and Technology Department (no. WX18IIAN037).
Abbreviations
- circRNAs:
Circular RNAs
- HCC:
Hepatocellular carcinoma
- qRT-PCR:
Quantitative reverse transcription PCR
- DOR:
Diagnostic odds ratio
- LR:
Likelihood ratio
- AUC:
Area under the SROC
- SROC:
Summary receiver operator characteristic curve
- QUADAS-2:
Quality Assessment of Diagnostic Accuracy Studies 2
- OS:
Overall survival
- RFS:
Recurrence free survival
- HR:
Hazard ratio
- NOS:
Newcastle-Ottawa Scale.
Ethical Approval
This study does not include human participants or animals.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Supplementary Materials
References
- 1.Shimakawa Y., Lemoine M., Njai H. F., et al. Natural history of chronic HBV infection in West Africa: a longitudinal population-based study from the Gambia. Gut. 2015;65(12) doi: 10.1136/gutjnl-2015-309892. [DOI] [PubMed] [Google Scholar]
- 2.Maluccio M., Covey A. Recent progress in understanding, diagnosing, and treating hepatocellular carcinoma. CA: A Cancer Journal for Clinicians. 2012;62(6):394–399. doi: 10.3322/caac.21161. [DOI] [PubMed] [Google Scholar]
- 3.Forner A., Reig M., Bruix J. Hepatocellular carcinoma. The Lancet. 2018;391(10127):1301–1314. doi: 10.1016/S0140-6736(18)30010-2. [DOI] [PubMed] [Google Scholar]
- 4.Schwartz M., Roayaie S., Konstadoulakis M. Strategies for the management of hepatocellular carcinoma. Nature Clinical Practice Oncology. 2007;4(7):424–432. doi: 10.1038/ncponc0844. [DOI] [PubMed] [Google Scholar]
- 5.Ilikhan S. U., Bilici M., Sahin H., et al. Assessment of the correlation between serum prolidase and alpha-fetoprotein levels in patients with hepatocellular carcinoma. World Journal of Gastroenterology. 2015;21(22):6999–7007. doi: 10.3748/wjg.v21.i22.6999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Wong C., Tsang F. H., Ng I. O. Non-coding RNAs in hepatocellular carcinoma: molecular functions and pathological implications. Nature Reviews Gastroenterology & Hepatology. 2018;15(3):137–151. doi: 10.1038/nrgastro.2017.169. [DOI] [PubMed] [Google Scholar]
- 7.Fu L., Jiang Z., Li T., Hu Y., Guo J. Circular RNAs in hepatocellular carcinoma: functions and implications. Cancer Medicine. 2018;7(7):3101–3109. doi: 10.1002/cam4.1574. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Qin M., Liu G., Huo X., et al. Hsa_circ_0001649: a circular RNA and potential novel biomarker for hepatocellular carcinoma. Cancer Biomarkers. 2016;16(1):161–169. doi: 10.3233/cbm-150552. [DOI] [PubMed] [Google Scholar]
- 9.Yu J., Xu Q., Wang Z., et al. Circular RNA cSMARCA5 inhibits growth and metastasis in hepatocellular carcinoma. Journal of Hepatology. 2018;68(6):1214–1227. doi: 10.1016/j.jhep.2018.01.012. [DOI] [PubMed] [Google Scholar]
- 10.Chen Z., Zhang L., Han G., et al. A meta-analysis of the diagnostic accuracy of circular RNAs in digestive system malignancy. Cellular Physiology and Biochemistry. 2018;45(3):962–972. doi: 10.1159/000487291. [DOI] [PubMed] [Google Scholar]
- 11.Wang M., Yang Y., Xu J., Bai W., Ren X., Wu H. CircRNAs as biomarkers of cancer: a meta-analysis. BMC Cancer. 2018;18(1) doi: 10.1186/s12885-018-4213-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Ding H., Lv Z., Yuan Y., Xu Q. The expression of circRNAs as a promising biomarker in the diagnosis and prognosis of human cancers: a systematic review and meta-analysis. Oncotarget . 2018;9(14) doi: 10.18632/oncotarget.23484. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Huang X., Zhang W., Shao Z. Prognostic and diagnostic significance of circRNAs expression in hepatocellular carcinoma patients: A meta‐analysis. Cancer Medicine. 2019;8(3):1148–1156. doi: 10.1002/cam4.1939. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Moher D., Liberati A., Tetzlaff J., Altman D. G. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine. 2009;6(7, article no. e1000097) doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Tierney J. F., Stewart L. A., Ghersi D., Burdett S., Sydes M. R. Practical methods for incorporating summary time-to-event data into meta-analysis. Trials. 2007;8, article 16 doi: 10.1186/1745-6215-8-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Margulis A. V., Pladevall M., Riera-Guardia N., et al. Quality assessment of observational studies in a drug-safety systematic review, comparison of two tools: the Newcastle-Ottawa scale and the RTI item bank. Journal of Clinical Epidemiology. 2014;6:359–368. doi: 10.2147/CLEP.S66677. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Hamza T. H., Arends L. R., Van Houwelingen H. C., Stijnen T. Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds. BMC Medical Research Methodology. 2009;9(1, article no. 73) doi: 10.1186/1471-2288-9-73. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Reitsma J. B., Glas A. S., Rutjes A. W. S., Scholten R. J. P. M., Bossuyt P. M., Zwinderman A. H. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. Journal of Clinical Epidemiology. 2005;58(10):982–990. doi: 10.1016/j.jclinepi.2005.02.022. [DOI] [PubMed] [Google Scholar]
- 19.Higgins J. P. T., Thompson S. G. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine. 2002;21(11):1539–1558. doi: 10.1002/sim.1186. [DOI] [PubMed] [Google Scholar]
- 20.Dersimonian R., Laird N. Meta-analysis in clinical trials. Controlled Clinical Trials. 1986;7(3):177–188. doi: 10.1016/0197-2456(86)90046-2. [DOI] [PubMed] [Google Scholar]
- 21.Begg C. B., Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50(4):1088–1101. doi: 10.2307/2533446. [DOI] [PubMed] [Google Scholar]
- 22.Zhang X., Zhou H., Jing W., et al. The circular RNA hsa_circ_0001445 regulates the proliferation and migration of hepatocellular carcinoma and may serve as a diagnostic biomarker. Disease Markers. 2018;2018:9. doi: 10.1155/2018/3073467.3073467 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Zhang X., Luo P., Jing W., Zhou H., Liang C., Tu J. circSMAD2 inhibits the epithelial-mesenchymal transition by targeting miR-629 in hepatocellular carcinoma. OncoTargets and Therapy. 2018;11:2853–2863. doi: 10.2147/OTT.S158008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Fu L., Chen Q., Yao T., et al. Hsa_circ_0005986 inhibits carcinogenesis by acting as a miR-129-5p sponge and is used as a novel biomarker for hepatocellular carcinoma. Oncotarget. 2017;8(27):43878–43888. doi: 10.18632/oncotarget.16709. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Fu L., Yao T., Chen Q., Mo X., Hu Y., Guo J. Screening differential circular RNA expression profiles reveals hsa_circ_0004018 is associated with hepatocellular carcinoma. Oncotarget. 2017;8(35):58405–58416. doi: 10.18632/oncotarget.16881. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Chen D., Zhang C., Lin J., Song X., Wang H. Screening differential circular RNA expression profiles reveal that hsa_circ_0128298 is a biomarker in the diagnosis and prognosis of hepatocellular carcinoma. Cancer Management and Research. 2018;Volume 10:1275–1283. doi: 10.2147/CMAR.S166740. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Yao Z., Luo J., Hu K., et al. ZKSCAN1 gene and its related circular RNA (circZKSCAN1) both inhibit hepatocellular carcinoma cell growth, migration, and invasion but through different signaling pathways. Molecular Oncology. 2017;11(4):422–437. doi: 10.1002/1878-0261.12045. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Huang X., Huang Z., Xu Y., et al. Comprehensive circular RNA profiling reveals the regulatory role of the circRNA-100338/miR-141-3p pathway in hepatitis B-related hepatocellular carcinoma. Scientific Reports. 2017;7(1, article no. 5428) doi: 10.1038/s41598-017-05432-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Chen G., Shi Y., Liu M., Sun J. circHIPK3 regulates cell proliferation and migration by sponging miR-124 and regulating AQP3 expression in hepatocellular carcinoma. Cell Death & Disease. 2018;9(2) doi: 10.1038/s41419-017-0204-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Jin H., Fang M., Man Z., Wang Y., Liu H. Circular RNA 001569 acts as an oncogene and correlates with aggressive characteristics in hepatocellular carcinoma. International Journal of Clinical and Experimental Pathology. 2017;10(3):2997–3005. [Google Scholar]
- 31.Shang X., Li G., Liu H., et al. Comprehensive circular RNA profiling reveals that hsa-circ-0005075, a new circular RNA biomarker, is involved in hepatocellular crcinoma development. Medicine. 2016;95(22) doi: 10.1097/md.0000000000003811. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Fu L., Wu S., Yao T., et al. Decreased expression of hsa_circ_0003570 in hepatocellular carcinoma and its clinical significance. Journal of Clinical Laboratory Analysis. 2018;32(2) doi: 10.1002/jcla.22239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Yao T., Chen Q., Shao Z., Song Z., Fu L., Xiao B. Circular RNA 0068669 as a new biomarker for hepatocellular carcinoma metastasis. Journal of Clinical Laboratory Analysis. 2018;32(8, article no. e22572) doi: 10.1002/jcla.22572. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Zhong L., Wang Y., Cheng Y., et al. Circular RNA circC3P1 suppresses hepatocellular carcinoma growth and metastasis through miR-4641/PCK1 pathway. Biochemical and Biophysical Research Communications. 2018;499(4):1044–1049. doi: 10.1016/j.bbrc.2018.03.221. [DOI] [PubMed] [Google Scholar]
- 35.Zhang X., Qiu S., Luo P., et al. Down-regulation of hsa_circ_0001649 in hepatocellular carcinoma predicts a poor prognosis. Cancer Biomarkers. 2018;22(1):135–142. doi: 10.3233/CBM-171109. [DOI] [PubMed] [Google Scholar]
- 36.Zhu Y.-X., Fu H.-W., Lin X., et al. Expression of hsa_circ_PVT1 in human hepatocellular carcinoma and its clinical significance. Medical Journal of Chinese People's Liberation Army. 2018;43(3):211–216. [Google Scholar]
- 37.Meng J., Chen S., Han J., et al. Twist1 regulates vimentin through Cul2 circular RNA to promote EMT in hepatocellular carcinoma. Cancer Research. 2018;78(15):4150–4162. doi: 10.1158/0008-5472.CAN-17-3009. [DOI] [PubMed] [Google Scholar]
- 38.Guan Z., Tan J., Gao W., et al. Circular RNA hsa_circ_0016788 regulates hepatocellular carcinoma tumorigenesis through miR-486/CDK4 pathway. Journal of Cellular Physiology. 2018;234(1):500–508. doi: 10.1002/jcp.26612. [DOI] [PubMed] [Google Scholar]
- 39.Liu H., Xue L., Song C., Liu F., Jiang T., Yang X. Overexpression of circular RNA circ_001569 indicates poor prognosis in hepatocellular carcinoma and promotes cell growth and metastasis by sponging miR-411-5p and miR-432-5p. Biochemical and Biophysical Research Communications. 2018;503(4):2659–2665. doi: 10.1016/j.bbrc.2018.08.020. [DOI] [PubMed] [Google Scholar]
- 40.Weng Q., Chen M., Li M., et al. Global microarray profiling identified hsa_circ_0064428 as a potential immune-associated prognosis biomarker for hepatocellular carcinoma. Journal of Medical Genetics. 2018;56(1):32–38. doi: 10.1136/jmedgenet-2018-105440. [DOI] [PubMed] [Google Scholar]
- 41.Xie B., Zhao Z., Liu Q., Wang X., Ma Z., Li H. CircRNA has_circ_0078710 acts as the sponge of microRNA-31 involved in hepatocellular carcinoma progression. Gene. 2019;683:253–261. doi: 10.1016/j.gene.2018.10.043. [DOI] [PubMed] [Google Scholar]
- 42.Gong Y., Mao J., Wu D., et al. Circ-ZEB1.33 promotes the proliferation of human HCC by sponging miR-200a-3p and upregulating CDK6. Cancer Cell International. 2018;18(1) doi: 10.1186/s12935-018-0602-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Han D., Li J., Wang H., et al. Circular RNA circMTO1 acts as the sponge of microRNA-9 to suppress hepatocellular carcinoma progression. Hepatology. 2017;66(4):1151–1164. doi: 10.1002/hep.29270. [DOI] [PubMed] [Google Scholar]
- 44.Guo W., Zhang J., Zhang D., et al. Polymorphisms and expression pattern of circular RNA circ-ITCH contributes to the carcinogenesis of hepatocellular carcinoma. Oncotarget. 2017;8(29):48169–48177. doi: 10.18632/oncotarget.18327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Xu L., Zhang M., Zheng X., Yi P., Lan C., Xu M. The circular RNA ciRS-7 (Cdr1as) acts as a risk factor of hepatic microvascular invasion in hepatocellular carcinoma. Journal of Cancer Research and Clinical Oncology. 2017;143(1):17–27. doi: 10.1007/s00432-016-2256-7. [DOI] [PubMed] [Google Scholar]
- 46.Zhang H., Jiang L., Sun D., Hou J., Ji Z. CircRNA: a novel type of biomarker for cancer. Breast Cancer. 2018;25(1):1–7. doi: 10.1007/s12282-017-0793-9. [DOI] [PubMed] [Google Scholar]
- 47.Glas A. S., Lijmer J. G., Prins M. H., Bonsel G. J., Bossuyt P. M. M. The diagnostic odds ratio: a single indicator of test performance. Journal of Clinical Epidemiology. 2003;56(11):1129–1135. doi: 10.1016/S0895-4356(03)00177-X. [DOI] [PubMed] [Google Scholar]
- 48.Dong L., Qi P., Xu M.-D., et al. Circulating CUDR, LSINCT-5 and PTENP1 long noncoding RNAs in sera distinguish patients with gastric cancer from healthy controls. International Journal of Cancer. 2015;137(5):1128–1135. doi: 10.1002/ijc.29484. [DOI] [PubMed] [Google Scholar]
- 49.Baraniskin A., Kuhnhenn J., Schlegel U., et al. Identification of microRNAs in the cerebrospinal fluid as marker for primary diffuse large B-cell lymphoma of the central nervous system. Blood. 2011;117(11):3140–3146. doi: 10.1182/blood-2010-09-308684. [DOI] [PubMed] [Google Scholar]
- 50.Hao Q. Q., Chen G. Y., Zhang J. H., Sheng J., Gao Y. Diagnostic value of long noncoding RNAs for hepatocellular carcinoma. Medicine. 2017;96(28, article no. e7496) doi: 10.1097/MD.0000000000007496. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Qiu L., Wu Y., Yu X., Tang Q., Chen L., Chen K. The emerging role of circular RNAs in hepatocellular carcinoma. Journal of Cancer. 2018;9(9):1548–1559. doi: 10.7150/jca.24566. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.