Urine microRNAs as biomarkers for bladder cancer: a diagnostic meta-analysis

Abstract

Background

The diagnostic value of microRNA (miRNA) detection in patients with bladder cancer (BCa) is controversial. We performed a diagnostic meta-analysis to evaluate current evidence on the use of miRNA assays to diagnose BCa.

Methods

We systematically searched PubMed, Embase, and Web of Science for studies published before March 31, 2015. The pooled sensitivity, specificity, positive and negative likelihood ratios, diagnostic odds ratio, and area under the curve (AUC) were calculated to evaluate the overall test performance. Subgroup analyses were used to explore the between-study heterogeneity. Deeks’ funnel plot asymmetry test was used to test publication bias. We applied the software of RevMan 5.2 and Stata 11.0 to the meta-analysis.

Results

A total of 23 studies from nine articles were included in the meta-analysis, with a total of 719 patients and 494 controls. The pooled sensitivity and specificity were 0.75 (95% confidence interval [CI], 0.68–0.80) and 0.75 (95% CI, 0.70–0.80), respectively. The pooled positive likelihood ratio was 3.03 (95% CI, 2.50–3.67); negative likelihood ratio was 0.33 (95% CI, 0.27–0.42); and diagnostic odds ratio was 9.07 (95% CI, 6.35–12.95). The pooled AUC was 0.81 (95% CI, 0.78–0.85). Subgroup analyses indicated that the multiple miRNAs assays and urine supernatant assays showed high accuracies in diagnosing BCa.

Conclusion

The miRNA assays may serve as potential noninvasive diagnostic tool for the detection of BCa. However, the clinical application of miRNA assays for BCa diagnosis still needs further validation by large prospective studies.

Introduction

Bladder cancer (BCa) is among the most common urological cancers, with more than 330,000 new cases each year and resulting in more than 130,000 deaths per year.¹ The gold standards for the initial diagnosis of BCa are cystoscopy and biopsy. However, these methods are invasive, uncomfortable, and costly.^2,3 Currently, cytology is the most widely used noninvasive diagnostic tool with median sensitivity (SEN) and specificity (SPE) values of 35% and 94%, respectively.⁴ Furthermore, bladder tumor antigen stat with a SEN of 57%–79% and SPE of 48%–95%, NMP22 (nuclear matrix protein 22) with a SEN of 49.5%–65% and SPE of 40%–87.3%, and telomerase with a SEN of 70%–100% and SPE of 60%–70% are the most common biomarkers for BCa diagnosis.⁵ These urinary markers have poor SPE and SEN for BCa diagnosis and cannot match the cytology tool. Therefore, the development of highly accurate biomarkers for the detection of BCa would benefit patients.

microRNAs (miRNAs) are nonprotein-coding RNAs that posttranscriptionally regulate gene expression. Altered expression of miRNAs plays an important role in the initiation and progression of various diseases, including cancer. Aberrant expression of miRNAs in BCa has been identified in an increasing number of studies. In addition, studies on the use of urine and blood-based miRNAs for the diagnosis of BCa have been published.^6–8 Hence, the current miRNA profiling has presented potential biomarkers for BCa diagnosis.

The diagnostic accuracy of miRNA has been widely evaluated, and emerging evidence has presented promising results, but the possible application and validity of miRNAs in diagnosing BCa remains controversial. Studies on the use of miRNA as a BCa diagnostic tool indicated a wide range of values for SEN and SPE. Such variation may be the result of differences in the types of miRNA profiled and in the specimens tested. For example, Wang et al⁹ reported the diagnostic accuracy of miR-200a for BCa and obtained a high SEN of 100% and a low SPE of 52.6%. However, Snowdon et al¹⁰ revealed a moderate SEN of 80% and a high SPE of 100% for the diagnostic accuracy of miR-125b and miR-126. In addition, the diagnostic accuracies of miRNA profiling between single and multiple miRNAs showed significant differences. Currently, no meta-analysis has been published on the diagnostic performance of miRNA assays for BCa. Therefore, we performed a meta-analysis to review and assess the overall diagnostic accuracy of miRNA assays for BCa diagnosis.

Methods

Literature search

An initial search was performed in PubMed, Medline, Embase, and Web of Science. The last search was updated on March 31, 2015. Search strings were performed for microRNA or miRNA, diagnosis or sensitivity or specificity, and bladder cancer. The search was limited to studies published in the English language. The reviewer also hand-searched the references of all included studies to ensure that a comprehensive search strategy was used.

Study selection

Two reviewers independently assessed eligible publications. Any disagreement between the two reviewers was resolved through a discussion with a third reviewer. The inclusion criteria were as follows: 1) the patients with BCa were confirmed by histopathology, 2) the diagnosis of BCa involved the use of urine miRNA, and 3) both the SEN and SPE data were provided. The exclusion criteria were as follows: 1) review articles, seminar articles, and case reports; 2) limited data (number of cases and/or controls was not provided); and 3) BCa diagnosis involved the use of blood and tissue miRNA.

Data extraction

The following data were extracted by two reviewers independently from each study: name of the first author, publishing time, country, specimen, test method, internal control, cancer type, number of BCa patients and healthy controls, miRNA profiling, and SEN and SPE data.

Quality assessment

Quality assessment was performed for each included study by independent reviewers using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool.¹¹ The assessment consisted of four key domains, including patient selection, index test, reference standard, and flow and timing. Each domain was assessed in terms of the risk of bias, and the first three domains were assessed in terms of applicability. Each domain was marked as “high”, “low”, or “unclear”, which corresponded to high risk, low risk, and unclear, respectively.

Data synthesis and statistical analysis

The data of diagnostic accuracy were calculated for each study, as follows: SEN, SPE, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and their 95% confidence intervals (CIs). The analysis of diagnostic accuracy was based on a summary receiver operating characteristic (SROC) curve and the area under curve (AUC) of the SROC.¹² The Q test and I² statistic were used to assess heterogeneity in SEN and SPE among the studies. A P-value of less than 0.1 for Q test and a value larger than 50% for I² indicated substantial heterogeneity, and subsequently, the random-effect model was applied.^13,14

In addition, we also investigated subgroup in our meta-analysis to evaluate potential sources of between-study heterogeneity. The publication bias was tested using Deeks’ funnel plot asymmetry test.¹⁵ Quality assessment was performed using RevMan 5.2, and statistical calculations were performed using STATA 11.0.

Results

Study selection and description

The flow graph of study selections is presented in Figure 1. A total of 215 potentially relevant articles were selected with an established search strategy. After a detailed evaluation, nine articles^{8–10,16–21} involving 23 studies were used for this meta-analysis (Table 1). The total number of patients and controls were 719 and 494, respectively. All studies used reverse transcription polymerase chain reaction (RT-PCR) or quantitative RT-PCR method to measure the expression of miRNAs in urine. RNU48, RNU44, and RNAU6 were used as internal controls. Of the nine included studies, four studies used urine sediment as specimens, two studies used urine supernatant, and the three other studies were based on voided urine.

Figure 1.

Flowchart of literature search and selection.

Table 1.

Summary of the publications included in this meta-analysis

Study	Country	Specimen	Method	Cancer type	Case	Control	miRNA profiling	Sensitivity (%)	Specificity (%)	QUADAS score
Mengual et al21	Spain	Voided urine	qRT-PCR	UCC	181	136	miR-187, miR-140-5p, miR-18a, miR-25, miR-204, and miR-142-3p	84.8	86.5	8
Miah et al20	UK	Urine sediment	RT-PCR	UCC	68	53	miR-15a	51.7	72	7
							miR-15b	67.8	81.3
							miR-24-1	60	58.5
							miR-27b	60.3	81.1
							miR-100	60.4	78.7
							miR-135b	71.2	74.4
							miR-203	66.1	66
							miR-212	54.2	64
							miR-328	55.4	86.8
							miR-1224	75.9	82.4
							Combination of miRs 135b/15b/1224-3p	94.5	51
Yamada et al18	Japan	Urine sediment	RT-PCR	UC	100	74	miR-96	71	89.2	5
							miR-183	74	77.3
Hanke et al8	Germany	Voided urine	RT-PCR	BCa	18	18	miR-126:miR-152	72	82	7
Snowdon et al10	USA	Voided urine	qRT-PCR	UC	8	5	miR-125b,miR-126	80	100	9
Yun et al17	Korea	Urine supernatant	RT- PCR	TCC	207	144	miR-145	77.8	61.1	7
Zhang et al16	People’s Republic of China	Urine supernatant	qRT-PCR	UCB	50	21	miR-99a and miR-125b	90	90	9
							miR-99a	78	85.7
							miR-125b	84.8	76.2
Wang et al9	People’s Republic of China	Urine sediment	qRT-PCR	BCa	51	24	miR-200a	100	52.6	9
Tölle et al19	Germany	Voided urine	qRT-PCR	BCa	36	19	miR-1255b-5p	85	68.4	9
							miR-618	70	68.4

Note: All miRNAs are determined at a statically significant level (P<0.05).

Abbreviations: miRNA, microRNA; qRT-PCR, quantitative reverse transcription polymerase chain reaction; RT-PCR, real-time polymerase chain reaction; UCC, urothelial cell carcinoma; BCa, bladder cancer; UC, urothelial carcinoma; UCB, urothelial carcinoma of the bladder; TCC, transitional cell carcinoma; QUADAS, Quality Assessment of Diagnostic Accuracy Studies.

Quality assessment of studies

The outcomes of the QUADAS-2 study quality assessment are shown in a bar graph in Figure 2. The majority of all included studies in this review fulfilled most items in QUADAS-2, indicating that the overall quality of the included studies is generally good.

Figure 2.

Overall quality assessment of included articles using the QUADAS-2 tool.

Notes: (A) Risk of bias; (B) applicability concerns.

Abbreviation: QUADAS, Quality Assessment of Diagnostic Accuracy Studies.

Diagnostic accuracy

The forest plot of SEN and SPE for miRNA assays is shown in Figure 3. Significant heterogeneity was found among the SEN and SPE results of the 23 studies because the I² for SEN is 80.24% (95% CI, 72.74%–87.75%), and the I² for SPE is 71.61% (95% CI, 59.71%–83.59%). Therefore, this meta-analysis will apply a random-effect model to evaluate all parameters. The overall results of the miRNAs diagnostic accuracy are listed in Table 2. The SEN was 0.75 (95% CI, 0.68–0.80), the SPE was 0.75 (95% CI, 0.70–0.80), the PLR was 3.03 (95% CI, 2.50–3.67), the NLR was 0.33 (95% CI, 0.27–0.42), and the DOR was 9.07 (95% CI, 6.35–12.95). The SROC curve for the 23 included studies is shown in Figure 4. The AUC of urine miRNA tests was 0.81 (95% CI, 0.78–0.85), thereby implying a relatively high diagnostic accuracy.

Figure 3.

Forest plot of (A) sensitivity and (B) specificity of miRNAs for the diagnosis of BCa.

Abbreviations: CI, confidence interval; miRNA, microRNA; BCa, bladder cancer.

Table 2.

Summary estimates of diagnostic criteria and their 95% CI

Subgroups	Sensitivity (95% CI)	Specificity (95% CI)	Positive LR (95% CI)	Negative LR (95% CI)	DOR (95% CI)	AUC (95% CI)
miRNA profiling
Single miRNA	0.72 (0.65–0.78)	0.74 (0.69–0.79)	2.79 (2.31–3.37)	0.38 (0.31–0.47)	7.30 (5.15–10.36)	0.79 (0.76–0.83)
Multiple miRNAs	0.86 (0.78–0.91)	0.82 (0.65–0.91)	4.65 (2.39–9.06)	0.17 (0.12–0.25)	27.32 (14.84–50.28)	0.91 (0.88–0.93)
Specimen
Voided urine	0.77 (0.66–0.84)	0.76 (0.63–0.85)	3.12 (1.98–4.91)	0.31 (0.21–0.47)	9.99 (4.71–21.22)	0.81 (0.78–0.85)
Urine supernatant	0.81 (0.75–0.86)	0.74 (0.60–0.85)	3.13 (1.90–5.15)	0.26 (0.18–0.37)	12.20 (5.46–27.25)	0.84 (0.81–0.87)
Urine sediment	0.73 (0.63–0.81)	0.75 (0.69–0.81)	2.96 (2.34–3.73)	0.36 (0.26–0.49)	8.20 (5.17–13.03)	0.81 (0.77–0.84)
Overall	0.75 (0.68–0.80)	0.75 (0.70–0.80)	3.03 (2.50–3.67)	0.33 (0.27–0.42)	9.07 (6.35–12.95)	0.81 (0.78–0.85)

Abbreviations: CI, confidence interval; miRNA, microRNA; DOR, diagnostic odds ratio; AUC, area under the curve; LR, likelihood ratio.

Figure 4.

The SROC of the miRNA test for the diagnosis of BCa.

Abbreviations: SROC, summary receiver operating characteristic; AUC, area under the curve; BCa, bladder cancer; miRNA, microRNA; SEN, sensitivity; SPE, specificity.

Subgroup analyses

In this meta-analysis, we also performed subgroup analyses to identify potential sources of heterogeneity. Results of the diagnostic accuracy of subgroup analyses are listed in Table 2. For single miRNA profiling assays, SEN, SPE, and AUC values were 0.72 (95% CI, 0.65–0.78), 0.74 (95% CI, 0.69–0.79), and 0.79 (95% CI, 0.76–0.83), respectively. For multiple miRNA profiling assays, the SEN, SPE, and AUC values were 0.86 (95% CI, 0.78–0.91), 0.82 (95% CI, 0.65–0.91), and 0.91 (95% CI, 0.88–0.93), respectively. Multiple miRNA profiling was more accurate than single miRNA profiling.

Our meta-analysis assessed the diagnostic accuracy of miRNAs in different urine specimens. The pooled SEN, SPE, PLR, NLR, DOR, and AUC values of urine supernatant-based assay were 0.81, 0.74, 3.13, 0.26, 12.20, and 0.84, respectively. Meanwhile, the pooled SEN, SPE, PLR, NLR, DOR, and AUC values of voided urine-based assay were 0.77, 0.76, 3.12, 0.31, 9.99, and 0.81, respectively. Urine sediment-based assay presented a modest performance in BCa diagnosis (Table 2). Urine supernatant-based assay showed higher SEN than urine sediment-based assay. Thus, urine supernatant-based assay could be more reliable for clinical application than urine sediment-based assay.

Publication bias

In our meta-analysis, Deeks’ funnel plot asymmetry test was performed to evaluate publication bias (Figure 5). The P-value of 0.996 suggested that no significant publication bias existed among the studies.

Figure 5.

Deeks’ linear regression test of funnel plot asymmetry.

Abbreviation: ESS, effective sample size.

Discussion

Urinary cytology is the gold standard of noninvasive tests. Urinary cytology tool has low SEN. The development of high-SEN and high-SPE urinary markers for the diagnosis of urinary BCa is an exciting field. Currently, numerous miRNAs have been discussed in many studies. Examples of these miRNAs include miRNA-126,¹⁰ miRNA-200c,²² and miRNA ratio.⁸ However, the SEN and SPE of these miRNAs were uneven. Therefore, we performed this meta-analysis to provide a persuasive miRNA parameter for BCa diagnosis.

In the present meta-analysis, we included nine articles, including 23 studies with a total participant population of 1,213. The urine miRNAs discriminated BCa patients from healthy controls and yielded an AUC of 0.81 (95% CI, 0.78–0.85), with pooled SEN of 0.75 (95% CI, 0.68–0.80) and SPE of 0.75 (95% CI, 0.70–0.80), thereby indicating the potential diagnostic value of miRNA as a noninvasive test. Furthermore, the pooled DOR was 9.07 (95% CI, 6.35–12.95). High DOR value indicates high accuracy, thereby suggesting that the overall accuracy of miRNAs test for BCa diagnosis is credible.

The SROC curve, AUC, and DOR values are not the only feasible strategies for clinical diagnosis. The likelihood ratio (LR), including PLR and NLR, has an equative effect on the evaluation of diagnostic accuracy. A PLR greater than 10 or an NLR less than 0.1 generates large and often conclusive changes from pretest to posttest probability. However, in our meta-analysis, a pooled PLR of 3.03 (95% CI, 2.50–3.67) suggested that patients with BCa have an ~3.03-fold higher chance of testing positive using miRNAs compared with controls. A pooled NLR of 0.33 (95% CI, 0.27–0.42) meant that the probability of the individuals with urinary BCa was 33% when the miRNAs test was negative.

We selected publications in a strict manner, but potential heterogeneity was still present in our study. We found that miRNA profiling and specimen type may have partially contributed to such heterogeneity. Therefore, subgroup analyses were performed to relieve the disturbance caused by heterogeneity. Subgroups of miRNA profiling demonstrated that a combination of multiple miRNA assays (SEN, SPE, and AUC of 0.86, 0.82, and 0.91, respectively) had a higher diagnostic performance than those of single miRNA assays (SEN, SPE, and AUC of 0.72, 0.74, and 0.79, respectively). Our results were based on one miRNA that can regulate many target genes, and one target gene that could be regulated by a number of different miRNAs.²³

Our results confirmed that urine miRNAs in voided urine, urine sediment, and supernatant are different. The levels of miRNAs after centrifugation can be monitored separately in the urine sediment and supernatant.²¹ Urine sediment generally contains renal tubular cells, normal urothelial cells, lymphocytes, red blood cells, and tumor cells. The proportion of non-BCa cells differed among urine sediments, and the obtained results can be affected by different cell types. miRNAs in urine sediment reflected intracellular expression, whereas miRNAs in urine supernatant come from microvesicles extruded from the cell surface and systemic circulation via glomerular filtration.^24,25 Therefore, compared with urinary sediment assay, urinary supernatant assay showed a relatively higher accuracy.

This meta-analysis has several limitations. Some of the significant between-study heterogeneities were found in the current meta-analysis and may have disturbed the results. The degree of heterogeneity is among the major concerns in a meta-analysis,²⁶ because nonhomogeneous data cause misleading results. Statistical heterogeneity among the studies was due to the differences in ethnicity, types of patients, specimens, and miRNAs profiled. Publication bias is possible even if a comprehensive and systematic search of literature was done. In addition, despite some studies identifying correlations between miRNAs expression and tumor stage and grade, subgroup analyses based on these variables were restricted due to limited reported data.

Conclusion

In this article, we analyzed and summarized the pooled data of SEN, SPE, PLR, NLR, DOR, and AUC from 23 studies. Urine miRNA assays could serve as markers for BCa diagnosis. We found that urine miRNA assays were more sensitive than urine cytology test in BCa diagnosis. However, the clinical application of miRNA profiling for BCa diagnosis still needs further validation by prospective studies.