Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2017 Jun 12;12(6):e0179536. doi: 10.1371/journal.pone.0179536

Prognostic value of programmed cell death ligand 1 expression in patients with head and neck cancer: A systematic review and meta-analysis

Ji Li 1, Ping Wang 2,*, Youliang Xu 3
Editor: Jung Weon Lee4
PMCID: PMC5467853  PMID: 28604812

Abstract

Background

Programmed cell death ligand 1 (PD-L1) expression was reported to be correlated with poor prognosis in various cancers. However, the relationship between PD-L1 expression and the survival of patients with head and neck cancer (HNC) remains inconclusive. In the present study, we aimed to clarify the prognostic value of PD-L1 in HNC patients using meta-analysis techniques.

Methods

A comprehensive database searching was conducted in the PubMed, EMBASE, Web of Science and Cochrane Library from inception to August 2016. Studies meeting the inclusion criteria were included. The methodological quality of included studies was assessed by the Newcastle-Ottawa quality assessment scale. Hazard ratios (HRs) with their corresponding 95% confidence intervals (CIs) were pooled by STATA 11.0 for the outcome of overall survival (OS) and disease-free survival (DFS).

Results

A total of 17 studies with 2,869 HNC patients were included in the meta-analysis. The results of meta-analysis showed that there was no significant correlation between PD-L1 expression and OS (HR, 1.23; 95% CI, 0.99–1.53; P = 0.065) or DFS (HR, 1.42; 95% CI, 1.00–2.03; P = 0.052) of HNC patients. However, the subgroup analysis suggested that positive expression of PD-L1 was associated with poor OS (HR, 1.38; 95% CI, 1.12, 1.70; P = 0.003) and DFS (HR, 1.99; 95% CI, 1.59, 2.48; P = 0.001) in HNC patients from Asian countries/regions. The subgroup analysis also showed that the correlations between PD-L1 and prognosis are variant among different subtypes of HNC. When performing sensitive analyses, we found that the results of meta-analyses were not robust.

Conclusion

The meta-analysis indicated that positive expression of PD-L1 could serve as a good predictor for poor prognosis of Asian patients with HNC. However, the findings still need to be confirmed by large-scale, prospective studies.

Introduction

Head and neck cancer (HNC) is a group of cancers that starts within the oral cavity, nasal cavity, larynx, pharynx, or salivary glands [1]. According to new data from the Global Burden of Disease Study 2013, HNC globally affected more than 4.6 million people and resulted in more than 362,000 deaths [2, 3], which made HNC the seventh most frequent cancer and the ninth most frequent cause of death from cancer. Despite the improvement of surgical techniques, as well as the introduction of radiotherapy and chemotherapy, the survival rate of HNC patients was still not significantly improved in decades [4, 5]. Therefore, it is urgent to find new therapeutic targets, which needs to uncover the biological mechanisms underlying the carcinogenesis of HNC and discover critical biomarkers for predicting prognosis of HNC.

It is well known that endogenous immune responses could recognize and eradicate malignant cells, and the ability of cancer cells to evade immune surveillance has been recognized as a distinct hallmark of cancer [6, 7]. Recently, programmed cell death ligand 1 (PD-L1) was demonstrated to be involved in the immune escape mechanism of cancer cells [8, 9]. PD-L1 is a surface glycoprotein that belongs to the B7/CD28 co-stimulatory factor superfamily [10]. In normal tissues, PD-L1 is limitedly expressed and interacts with its receptor, programmed cell death 1 (PD-1), to protect healthy cells from excessive inflammatory or autoimmune responses [11, 12]. However, interactions between PD-L1 and PD-1 in the tumor microenvironment could inhibit the proliferation of activated T-cells and promote the apoptosis of T-cells, resulting in enhanced tumor cell growth [6, 13]. Positive expression of PD-L1 was observed in various malignancies, and has been suggested to be a negative prognostic factor in breast cancer [14], renal cell cancer [15], and gastrointestinal tract cancer [16]. Blockade of PD-L1 with monoclonal antibody has shown promising results for increasing survival rates of patients with melanoma or renal cell cancer [17, 18].

Emerging evidence also suggested the prognostic role of PD-L1 expression in HNC patients. Several cohort studies showed that positive expression of PD-L1 was associated with poor survival of HNC patients [1921]. However, other studies reached inconsistent conclusions. Budczies et al. [22] and Ock et al. [23] found no significant correlation between PD-L1 expression and HNC survival. Thierauf et al. [24] reported that HNC patients with PD-L1-positive expression even had a significantly longer survival. As controversies still remain, there is an urgent need to conduct a meta-analysis to clarify the prognostic value of PD-L1 in HNC patients and draw a firm conclusion to guide clinical practice.

Materials and methods

Literature search

The preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement [25] and the reporting recommendations for tumor marker prognostic studies (REMARK) [26] were followed when we conducted and reported this meta-analysis. A comprehensive searching was carried out in electronic databases such as PubMed, EMBASE, Web of Science and the Cochrane Library from inception to August 2016. The search strategies were based on combinations of the following key words: “programmed cell death-ligand 1, PD-L1, CD274, B7-H1” AND “head and neck, oral, oropharyngeal, nasopharyngeal, laryngeal, pharynx” AND “tumor, neoplasm, cancer” AND “prognosis, survival, mortality”, without any restriction on language. Furthermore, we also used the corresponding Mesh terms such as “Antigens, CD274”, “Head and Neck Neoplasms” and “Survival”, “Prognosis”. The full electronic search strategy for PubMed database is detailed in S1 File. To identify additional potentially eligible studies, we also screened the reference lists of reviews and included articles.

Selection of studies

Studies were considered eligible if they met the following criteria: (1) cohort studies on human beings; (2) investigated the correlation between PD-L1 expression and the survival of HNC patients; (3) reported or had sufficient information to estimate the hazard ratio (HR) and its 95% confidential interval (CI) for overall survival (OS) or disease-free survival (DFS). Studies reported in reviews, letters, or conference abstracts were excluded. For the studies with duplicate data, only the most complete study was included in the analysis. Two reviewers (Ji Li and Youliang Xu) independently screened the titles and abstracts of literatures identified by the search strategy to exclude irrelevant publications. The full texts of potentially eligible studies were then carefully examined to determine whether they were included or excluded. Disagreements were resolved by discussion with a third reviewer.

Data extraction and quality assessment

Two reviewers (Ji Li and Ping Wang) independently extracted the following information using predefined data abstraction forms: first author, publication year, origin of population, subtype of HNC, type of PD-L1 expression, cut-off value for PD-L1 positive and patient survival data. For studies that showed survival data indirectly with a Kaplan-Meier curve, we used the methods described by Tierney et al. [27] to estimate.

The methodological quality of included studies was evaluated by two reviewers (Ji Li and Ping Wang) using the Newcastle-Ottawa quality assessment scale (NOS) for cohort study [28]. The scale included eight items of methodology, which were grouped into three categories: selection, comparability, and outcome. The final score (0–9) was assigned to each study based on these items. Any disagreements on the NOS score of the studies were resolved by discussion with a third reviewer.

Statistical analysis

HRs with 95% CIs were used to assess the association between PD-L1 expression and the survival (including OS and DFS) of HNC patients. Heterogeneity among studies was assessed using χ2 test and the I2 statistic. We used a random-effects model to pool data if significant heterogeneity was detected (P<0.1 or I2>50%). Otherwise, we used a fixed-effects model. Subgroup analyses were carried out by subtype of HNC, type of PD-L1 expression, origin of population, and cut-off value for PD-L1 positive. Sensitive analyses were performed based on sample size, methods of HR estimation and calculation. The potential for publication bias was assessed by the Begg’s funnel plots and Egger’s regression test. All statistical analyses were performed using STATA 11.0 software (Stata Corporation, College Station, TX, USA), and a P-value less than 0.05 was considered as significant.

Results

Study selection

A total of 536 articles were retrieved after searching the above databases, and additional searching identified seven articles. After removing the duplicates, 429 titles and abstracts were screened, and 385 records were excluded. Then we carefully read the full text of the remaining citations. 17 studies [5, 1924, 2938] investigating the correlation between PD-L1 expression and the survival of HNC patients were included. Fig 1 details the selection process.

Fig 1. Flow chart of study selection.

Fig 1

Comprehensive searching and selection of relevant articles.

Characteristics and methodological quality of the included studies

Seventeen studies were included in the meta-analysis, among which nine studies [19, 21, 23, 2934] investigated HNC patients from Asian countries/regions (including China, Japan, Korea, Taiwan and Hong Kong), five studies [5, 20, 22, 24, 38] investigated patients from European countries (including Germany, France and Greece), and three studies [3537] investigated patients from other countries (USA, Australia and Brazil). The studies were published between 2011 and 2016, and the number of HNC patients they included ranged from 23 to 517. One study examined the gene expression of PD-L1 [22], while the others examined the protein expression [5, 1921, 23, 24, 2938]. Four studies included patients diagnosed with head and neck squamous cell carcinoma (HNSCC) [5, 2224] while the remaining studies included patients diagnosed with the subtypes of HNC: six studies included patients with oral squamous cell carcinoma (OSCC) [19, 20, 29, 33, 35, 36], three studies included patients with nasopharyngeal carcinoma (NPC) [21, 30, 32], two studies included patients with oropharyngeal squamous cell carcinoma (OPSCC) [31, 37], one study included patients with laryngeal squamous cell carcinoma (LSCC) [38], and one study included patients with salivary gland carcinoma (SGC) [34]. Fourteen studies [5, 19, 20, 22, 23, 29, 3138] showed the data of OS, and 11 studies [1922, 24, 3032, 34, 36, 38] showed the data of DFS. HRs with 95% CIs were obtained from the reports in ten studies [5, 19, 22, 23, 3135, 38], and calculated from available data in seven studies [20, 21, 24, 29, 30, 36, 37]. Fourteen studies [5, 2024, 2933, 3537] provided the survival data calculated by univariate analysis, two studies [19, 34] provided the data calculated by multivariate analysis, and one study [38] provided both the data calculated by univariate analysis and by multivariate analysis.

The methodological quality of included studies was rated by NOS score. The total scores they achieved ranged from 6 to 9. The median scores were 8 (interquartile range [IQR], 8 to 8). The characteristics and methodological quality of included studies are shown in Table 1.

Table 1. Main characteristics of studies included in the meta-analysis.

Author Year Origin of population Subtype of HNC No. of patients PD-L1 expression Cut-off value for PD-L1 positive No. of positive expression Survival parameter HR estimation HR calculation NOS score
Badoual 2013 France HNSCC 64 Protein Score > 1 33 OS Reported Univariate analysis 8
Budczies 2016 Germany HNSCC 517 mRNA > median 220 OS, DFS Reported Univariate analysis 6
Chen 2015 Taiwan OSCC 218 Protein > 5% 139 OS, DFS Reported Multivariate analysis 8
Cho 2011 Korea OSCC 45 Protein Score > 2 26 OS Calculated Univariate analysis 8
Fang 2014 China NPC 139 Protein H score > 35 62 DFS Calculated Univariate analysis 8
Kim 2016 Korea OPSCC 133 Protein > 5%, > 20% 90 OS, DFS Reported Univariate analysis 9
Lee 2016 Hong Kong NPC 104 Protein > 25% 22 OS, DFS Reported Univariate analysis 8
Lin 2015 Taiwan OSCC 305 Protein Score > 1 133 OS Reported Univariate analysis 8
Mukaigawa 2016 Japan SGC 219 Protein > 1% 50 OS, DFS Reported Multivariate analysis 8
Ock 2016 Korea HNSCC 141 Protein > 5% 91 OS Reported Univariate analysis 8
Oliveira-Costa 2015 Brazil OSCC 96 Protein > 5% 47 OS Reported Univariate analysis 8
Satgunaseelan 2016 Australia OSCC 217 Protein > 5% 40 OS, DFS Calculated Univariate analysis 8
Straub 2016 Germany[22] OSCC 90 Protein > 5% 36 OS, DFS Calculated Univariate analysis 7
Thierauf 2015 Germany HNSCC 23 Protein > 10% 3 DFS Calculated Univariate analysis 6
Ukpo 2013 USA OPSCC 181 Protein > 5% 84 OS Calculated Univariate analysis 7
Vassilakopoulou 2016 Greece LSCC 238 Protein > 59th percentile of AQUA score 100 OS, DFS Reported Univariate and multivariate analysis 8
Zhang 2015 China NPC 139 Protein H score > 35 58 DFS Calculated Univariate analysis 8

HNC, head and neck cancer; HNSCC, head and neck squamous cell carcinoma; OSCC, oral squamous cell carcinoma; NPC, nasopharyngeal carcinoma; OPSCC, oropharyngeal squamous cell carcinoma; SGC, salivary gland carcinoma; LSCC, laryngeal squamous cell carcinoma; PD-L1, programmed cell death ligand 1; AQUA, automated quantitative protein analysis; OS, overall survival; DFS, disease-free survival; HR, hazard ratio; NOS, the Newcastle-Ottawa Scale.

Association between PD-L1 expression and OS of HNC patients

HRs with 95% CIs of OS obtained from 14 studies [5, 19, 20, 22, 23, 29, 3138] were pooled to investigate the association between PD-L1 expression and OS of HNC patients. As significant heterogeneity was detected (I2 = 47.5%, P = 0.021) among studies, the data were pooled with a random-effects model being used. The results showed that there was no significant difference between positive and negative expression of PD-L1 on the OS of HNC patients (HR, 1.23; 95% CI, 0.99–1.53; P = 0.065) (Fig 2). Subgroup analysis by subtype of HNC was performed. The results showed significant association between PD-L1 expression and OS in patients diagnosed with OSCC, while for patients with the other types of HNC (i.e. HNSCC, OPSCC, LSCC, NPC, and SGC), no significant association was observed. Positive expression of PD-L1 was also associated with poor OS in HNC patients from Asian countries/regions, but had no association with OS in patients from European countries. Subgroup analyses were also carried out by type of PD-L1 expression and cut-off value for PD-L1 positive. However, the results showed that there was no significant correlation between PD-L1 expression and OS of HNC patients in all the subgroups. Sensitive analyses were performed based on sample size, methods of HR estimation and HR calculation. The results showed that the meta-analysis results were not altered by these factors. The results of subgroup analysis and sensitive analysis on the outcome of OS are shown in Table 2.

Fig 2. Meta-analysis of programmed cell death ligand 1 (PD-L1) expression and the overall survival (OS) of head and neck cancer (HNC) patients.

Fig 2

Significant heterogeneity existed among the studies reporting the outcome of OS (I2 = 47.5%, P = 0.021). Therefore, a random-effects model was applied to pool the data and the results showed that there was no significant correlation between PD-L1 expression and OS of HNC patients (HR, 1.23; 95% CI, 0.99–1.53). The horizontal bars indicate the 95% CIs. The size of the square indicates the weight of the individual study in the meta-analysis. The blue hollow diamond indicates the pooled HR (the center of the diamond) with 95% CI (the extremities of the diamond). HR, hazard ratio; CI: confidence interval.

Table 2. Subgroup analysis and sensitive analysis on the outcome of overall survival.

No. of Studies No. of patients Heterogeneity Statistical model used HR (95% CI) Significance
Subtype of HNC
1. HNSCC 3 722 I2 = 20.8%; P = 0.285 Fixed 1.03 (0.80, 1.33) P = 0.827
2. OSCC 6 971 I2 = 51.4%; P = 0.067 Random 1.58 (1.11, 2.25) P = 0.011
3. OPSCC 2 314 I2 = 0.0%; P = 0.637 Fixed 1.13 (0.75, 1.71) P = 0.568
4. LSCC 1 238 NA Fixed 0.63 (0.39, 1.03) P = 0.063
5. NPC 1 104 NA Fixed 1.58 (0.56, 4.51) P = 0.390
6. SGC 1 219 NA Fixed 1.31 (0.63, 2.74) P = 0.474
PD-L1 expression
1. mRNA 1 517 NA Fixed 1.05 (0.75, 1.35) P = 0.745
2. Protein 13 2051 I2 = 49.5%; P = 0.018 Random 1.26 (0.98, 1.62) P = 0.069
Origin of population
1. Europe 4 909 I2 = 70.6%; P = 0.017 Random 1.08 (0.66, 1.78) P = 0.758
2. Asia 7 1165 I2 = 19.2%; P = 0.278 Fixed 1.38 (1.12, 1.70) P = 0.003
Cut-off value for PD-L1 positive
1. > 5% 7 1076 I2 = 54.8%; P = 0.030 Random 1.46 (1.00, 2.14) P = 0.051
2. Score > 1 2 369 I2 = 0.0%; P = 0.551 Fixed 1.17 (0.88, 1.55) P = 0.285
Sample size of studies
1. < 100 5 436 I2 = 51.6%; P = 0.067 Random 1.47 (0.89, 2.44) P = 0.134
2. > 100 9 2132 I2 = 45.6%; P = 0.065 Random 1.15 (0.91, 1.44) P = 0.251
HR estimation
1. Reported 10 2035 I2 = 51.7%; P = 0.023 Random 1.21 (0.93, 1.57) P = 0.148
2. Available data calculated 4 533 I2 = 49.0%; P = 0.118 Random 1.30 (0.80, 2.12) P = 0.289
HR Calculation
1. Multivariate analysis 3 675 I2 = 84.9%; P = 0.001 Random 1.15 (0.50, 2.67) P = 0.725
2. Univariate analysis 12 2131 I2 = 39.2%; P = 0.072 Random 1.14 (0.91, 1.43) P = 0.241

HNC, head and neck cancer; HNSCC, head and neck squamous cell carcinoma; OSCC, oral squamous cell carcinoma; OPSCC, oropharyngeal squamous cell carcinoma; LSCC, laryngeal squamous cell carcinoma; NPC, nasopharyngeal carcinoma; SGC, salivary gland carcinoma; PD-L1, programmed cell death ligand 1; HR, hazard ratio; CI, confidence interval; NA, not applicable.

Association between PD-L1 expression and DFS of HNC patients

Eleven studies [1922, 24, 3032, 34, 36, 38] provided the data of DFS, but significant heterogeneity existed among these studies (I2 = 73.1%, P < 0.001). Therefore, a random-effects model was applied to pool the data. The results showed that there was no significant correlation between PD-L1 expression and DFS of HNC patients (HR, 1.42; 95% CI, 1.00–2.03; P = 0.052) (Fig 3). The results of subgroup analysis by subtype of HNC showed that positive expression of PD-L1 was associated with poor DFS in patients diagnosed with LSCC, NPC and SGC, but had no association with DFS in patients diagnosed with HNSCC, OSCC, or OPSCC. Significant association between PD-L1 and DFS was observed in HNC patients from Asian countries/regions, but not in patients from European countries. Subgroup analysis by cut-off value for PD-L1 was conducted. The pooled result of the studies defining PD-L1 positive as H score>35 suggested a significant correlation between PD-L1 expression and DFS of HNC patients. Subgroup analyses were also performed by type of PD-L1 expression. However, the results showed that there was no significant correlation between PD-L1 expression (both gene and protein) and OS of HNC patients. When performing sensitive analysis based on sample size, the combined HR was only statistically significant in large-sample size (n > 100) studies. As for the methods of HR calculation, the HRs that were calculated by multivariate survival analysis were pooled, and the results showed that positive expression of PD-L1 was associated with poor DFS in HNC patients. Sensitive analyses were also performed by method of HR estimation, but the results showed that the meta-analysis results were not altered by this factor. The results of subgroup analysis and sensitive analysis on the outcome of DFS are shown in Table 3.

Fig 3. Meta-analysis of programmed cell death ligand 1 (PD-L1) expression and the disease-free survival (DFS) of head and neck cancer (HNC) patients.

Fig 3

Significant heterogeneity existed among the studies reporting the outcome of DFS (I2 = 73.1%, P < 0.001). Therefore, a random-effects model was applied to pool the data and the results showed that there was no significant correlation between PD-L1 expression and DFS of HNC patients (HR, 1.42; 95% CI, 1.00–2.03). The horizontal bars indicate the 95% CIs. The size of the square indicates the weight of the individual study in the meta-analysis. The blue hollow diamond indicates the pooled HR (the center of the diamond) with 95% CI (the extremities of the diamond). HR, hazard ratio; CI: confidence interval.

Table 3. Subgroup analysis and sensitive analysis on the outcome of disease-free survival.

No. of Studies No. of patients Heterogeneity Statistical model used HR (95% CI) Significance
Subtype of HNC
1. HNSCC 2 540 I2 = 79.1%; P = 0.028 Random 0.58 (0.15, 2.30) P = 0.438
2. OSCC 3 525 I2 = 68.5%; P = 0.042 Random 1.73 (0.88, 3.42) P = 0.112
3. OPSCC 1 133 NA Fixed 1.68 (0.75, 3.76) P = 0.206
4. LSCC 1 238 NA Fixed 0.59 (0.35, 1.00) P = 0.048
5. NPC 3 382 I2 = 15.0%; P = 0.308 Fixed 1.77 (1.32, 2.37) P = 0.001
6. SGC 1 219 NA Fixed 2.29 (1.25, 4.19) P = 0.007
PD-L1 expression
1. mRNA 1 517 NA Fixed 1.05 (0.65, 1.45) P = 0.812
2. Protein 10 1520 I2 = 73.8%; P < 0.001 Random 1.48 (0.99, 2.20) P = 0.056
Origin of population
1. Europe 4 868 I2 = 75.6%; P = 0.006 Random 0.84 (0.44, 1.61) P = 0.598
2. Asia 6 952 I2 = 0.0%; P = 0.463 Fixed 1.99 (1.59, 2.48) P = 0.001
Cut-off value for PD-L1 positive
1. > 5% positive expression 3 525 I2 = 68.5%; P = 0.042 Random 1.73 (0.88, 3.42) P = 0.112
2. H score > 35 2 278 I2 = 37.6%; P = 0.206 Fixed 1.71 (1.26, 2.32) P = 0.011
Sample size of studies
1. < 100 2 113 I2 = 88.3%; P = 0.003 Random 0.77 (0.10, 6.15) P = 0.806
2. > 100 9 1924 I2 = 71.7%; P < 0.001 Random 1.52 (1.06, 2.17) P = 0.022
HR estimation
1. Reported 6 1429 I2 = 78.6%; P < 0.001 Random 1.54 (0.91, 2.60) P = 0.106
2. Available data calculated 5 608 I2 = 70.9%; P = 0.008 Random 1.29 (0.73, 2.28) P = 0.386
HR Calculation
1. Multivariate analysis 2 437 I2 = 0.0%; P = 0.719 Fixed 2.50 (1.71, 3.65) P = 0.001
2. Univariate analysis 9 1600 I2 = 70.0%; P = 0.001 Random 1.23 (0.84, 1.82) P = 0.289

HNC, head and neck cancer; HNSCC, head and neck squamous cell carcinoma; OSCC, oral squamous cell carcinoma; OPSCC, oropharyngeal squamous cell carcinoma; LSCC, laryngeal squamous cell carcinoma; NPC, nasopharyngeal carcinoma; SGC, salivary gland carcinoma; PD-L1, programmed cell death ligand 1; HR, hazard ratio; CI, confidence interval; NA, not applicable.

Publication bias

The potential for publication bias was assessed by the Begg’s funnel plots and Egger’s regression test. As shown in Figs 4 and 5, funnel plot asymmetry was not found on the outcomes of OS (Begg’s P = 0.373) and DFS (Begg’s P = 0.640). The Egger’s tests also failed to reveal the significant evidence of publication bias in OS (Egger’s P = 0.880) (Fig 6) and DFS (Egger’s P = 0.416) (Fig 7).

Fig 4. Begg’s funnel plot for assessment of potential publication bias in studies investigating the correlation between programmed cell death ligand 1 (PD-L1) expression and the overall survival of head and neck cancer patients.

Fig 4

No evidence of publication bias was observed, as indicated by a symmetric funnel plot (Begg’s P = 0.373). HR, hazard ratio.

Fig 5. Begg’s funnel plot for assessment of potential publication bias in studies investigating the correlation between programmed cell death ligand 1 (PD-L1) expression and the disease-free survival of head and neck cancer patients.

Fig 5

No evidence of publication bias was observed, as indicated by a symmetric funnel plot (Begg’s P = 0.640). HR, hazard ratio.

Fig 6. Egger’s test for assessment of potential publication bias in studies investigating the correlation between programmed cell death ligand 1 (PD-L1) expression and the overall survival of head and neck cancer patients.

Fig 6

Egger's test revealed no evidence of publication bias (Egger’s P = 0.880) among the studies reporting the outcome of overall survival.

Fig 7. Egger’s test for assessment of potential publication bias in studies investigating the correlation between programmed cell death ligand 1 (PD-L1) expression and the disease-free survival of head and neck cancer patients.

Fig 7

Egger's test revealed no evidence of publication bias (Egger’s P = 0.416) among the studies reporting the outcome of disease-free survival.

Discussion

PD-L1 expression was reported to be correlated with poor prognosis in various cancers [1416, 39]. However, the relationship between PD-L1 expression and the prognosis of patients with HNC remains inconclusive. In the present study, we aimed to clarify the prognostic value of PD-L1 in HNC patients using meta-analysis techniques. To our knowledge, it is the first meta-analysis to systematically analyze the correlation between PD-L1 expression and the survival of HNC patients. The study analyzed the survival data of 2,869 HNC patients from 17 cohort studies [5, 1924, 2938], and the results showed that there was no significant difference between positive and negative expression of PD-L1 on either the OS or the DFS of HNC patients. However, the subgroup analysis suggested that positive expression of PD-L1 was associated with poor OS and DFS in HNC patients from Asian countries/regions. When performing subgroup analysis by subtype of HNC, we found that positive expression of PD-L1 correlated with poor OS in patients with OSCC, and also correlated with poor DFS in patients diagnosed with LSCC, NPC and SGC.

PD-L1 is an important immune regulatory molecule that was recently reported to be critically implicated in the immune escape mechanism of cancer cells [9]. The lack of immunologic control is currently recognized as a distinct hallmark of cancer [6], and the process of cancer immunoediting, which involves phases of elimination, equilibrium and escape, has been proposed as a mechanism by which tumors escape control [40]. Under normal circumstance, the host immune homeostasis was maintained by the balance between co-stimulatory and co-inhibitory signals. PD-1/PD-L1 is an important co-inhibitory signaling pathway aiming to protect healthy cells from excessive inflammatory or autoimmune responses [11, 12]. However, this signaling pathway was also reported to be involved in the equilibrium and escape phases of cancer immunoediting to promote the survival and growth of tumor cells [41]. PD-1 is a member of the B7/CD28 co-stimulatory factor superfamily that is widely expressed on immune cells such as T cells, B cells and NK cells. PD-L1 (also known as CD274 or B7 homolog 1) is a ligand of PD-1. It is expressed not only on activated T cells, B cells, dendritic cells, macrophages, but also on various tumor cells. Interactions between PD-L1 and PD-1 were reported to protect the tumor cells through the following mechanisms [14]. First, PD-L1 could ligate PD-1 on antigen specific T cells and leads to functional anergy or death of these effector T cells [42]. Second, interactions between PD-L1 and PD-1 could directly protect the tumor cells from apoptosis by reverse signaling through PD-L1 [43, 44]. Third, by ligation of PD-1 on regulatory T cells, PD-L1 could inhibits their ability to mediate tolerance [13]. Fourth, PD-L1 could also inhibit the immune response of cytotoxic T cells by interactions with CD80 [45]. The above evidence demonstrated that PD-L1 expression was implicated in the pathogenesis of cancers, and also suggested that positive expression of PD-L1 may be associated with poor prognosis of cancers.

Actually, the association between the expression of PD-L1 and survival in patients with cancers has been widely investigated. Recently, several studies systematically reviewed the current available evidence. In the meta-analysis conducted by Li et al. [14], they analyzed the survival data of 7,802 patients with breast cancer, and found that PD-L1 protein expression was associated with shorter OS, shorter DFS, and shorter metastasis-free survival in these patients. They concluded that high PD-L1 protein expression appeared to be a negative prognostic factor in breast cancer. Similar results were observed in patients with gastrointestinal tract cancer. Huang et al. [16] pooled the data from fifteen studies that involved 2,993 gastrointestinal tract cancer patients. The results indicated that positive PD-L1 expression status in tumor cells was a risk factor for prognosis in gastrointestinal tract cancer, especially in esophageal cancer. Besides, the prognostic value of PD-L1 expression in other tumors, such as gastric cancer [39] and renal cell carcinoma [15] were also demonstrated by meta-analysis. However, Wu et al. [46] found that the correlations between PD-L1 and prognosis are variant among different tumor types. The results of meta-analysis conducted by Zhong et al. [47] showed that PD-L1 expression did not correlate with prognosis in terms of OS in patients with non-small-cell lung cancer.

In the present study, we found that there was no significant correlation between PD-L1 expression and OS or DFS of HNC patients. However, the subgroup analysis showed that positive expression of PD-L1 was associated with poor survival in HNC patients from Asian countries/regions. Subgroup analysis by subtype of HNC showed that positive expression of PD-L1 may correlate with poor OS in patients with OSCC, and correlate with poor DFS in patients diagnosed with LSCC, NPC and SGC. The results suggested that positive expression of PD-L1 may predict poor prognosis in these subpopulations of HNC patients. Moreover, these findings would also help to establish the rationale on the usage of immunotherapies targeting the PD-1/PD-L1 pathway for these patients [48]. A recent study assessed the tolerability and antitumour efficacy of a humanized PD-1 antibody, pembrolizumab, in HNC [49]. By analyzing the data of 104 patients, the authors concluded that pembrolizumab was well tolerated and demonstrated clinically meaningful antitumour activity in patients with PD-L1-positive recurrent or metastatic HNSCC. The study suggested the therapeutic potential of targeting the PD-1/PD-L1 immune checkpoint in the subpopulations of HNC patients. Therefore, the findings of our study may have clinical implications to guide the optimal clinical application of PD-1/PD-L1 inhibitor in HNC patients.

To test the robustness of the results of meta-analysis, we conducted sensitive analysis on the outcomes of OS and DFS by sample size (large-sample vs small-sample), methods of HR estimation (directly reported vs calculated) and HR calculation (multivariate analysis vs univariate analysis). However, the sensitive analyses suggested that the results of meta-analyses were not robust, so we failed to draw a firm conclusion on the relationship between PD-L1 expression and the prognosis of HNC patients. This is a limitation of our study. Moreover, other two limitations may also exist in the present study. First, only eight [5, 21, 2931, 33, 34, 38] of the included studies reported that the PD-L1 expression was blindly observed by investigators, which may introduce detection bias to the meta-analysis. Second, the cut-off values for PD-L1 positivity varied among the included studies, so we failed to determine the optimal cut-off value for it. Future studies are suggested to choose a well-recognized cut-off value to define the positive expression of PD-L1.

Conclusions

Our meta-analysis indicated that positive expression of PD-L1 could serve as a good predictor for poor prognosis of Asian patients with HNC. However, the findings still need to be confirmed by large-scale, prospective studies. Future studies also need to determine the optimal cut-off value to define the positive expression of PD-L1.

Supporting information

S1 File. Full electronic search strategy for PubMed database.

(DOCX)

S1 Table. PRISMA 2009 checklist for this meta-analysis.

(DOC)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Argiris A, Karamouzis MV, Raben D, Ferris RL. Head and neck cancer. Lancet. 2008;371(9625):1695–709. Epub 2008/05/20. doi: 10.1016/S0140-6736(08)60728-X . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;385(9963):117–71. Epub 2014/12/23. doi: 10.1016/S0140-6736(14)61682-2 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;386(9995):743–800. Epub 2015/06/13. doi: 10.1016/S0140-6736(15)60692-4 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Sahu N, Grandis JR. New advances in molecular approaches to head and neck squamous cell carcinoma. Anticancer Drugs. 2011;22(7):656–64. Epub 2010/12/24. doi: 10.1097/CAD.0b013e32834249ba ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Badoual C, Hans S, Merillon N, Van Ryswick C, Ravel P, Benhamouda N, et al. PD-1-expressing tumor-infiltrating T cells are a favorable prognostic biomarker in HPV-associated head and neck cancer. Cancer Res. 2013;73(1):128–38. Epub 2012/11/09. doi: 10.1158/0008-5472.CAN-12-2606 . [DOI] [PubMed] [Google Scholar]
  • 6.Kerkar SP, Restifo NP. Cellular constituents of immune escape within the tumor microenvironment. Cancer Res. 2012;72(13):3125–30. Epub 2012/06/23. doi: 10.1158/0008-5472.CAN-11-4094 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Hanahan D, Weinberg RA. Hallmarks of cancer: the next generation. Cell. 2011;144(5):646–74. Epub 2011/03/08. doi: 10.1016/j.cell.2011.02.013 . [DOI] [PubMed] [Google Scholar]
  • 8.Pardoll DM. The blockade of immune checkpoints in cancer immunotherapy. Nat Rev Cancer. 2012;12(4):252–64. Epub 2012/03/23. doi: 10.1038/nrc3239 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Taube JM, Anders RA, Young GD, Xu H, Sharma R, McMiller TL, et al. Colocalization of inflammatory response with B7-h1 expression in human melanocytic lesions supports an adaptive resistance mechanism of immune escape. Sci Transl Med. 2012;4(127):127ra37 Epub 2012/03/31. doi: 10.1126/scitranslmed.3003689 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Reiss KA, Forde PM, Brahmer JR. Harnessing the power of the immune system via blockade of PD-1 and PD-L1: a promising new anticancer strategy. Immunotherapy. 2014;6(4):459–75. Epub 2014/05/13. doi: 10.2217/imt.14.9 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Freeman GJ, Long AJ, Iwai Y, Bourque K, Chernova T, Nishimura H, et al. Engagement of the PD-1 immunoinhibitory receptor by a novel B7 family member leads to negative regulation of lymphocyte activation. J Exp Med. 2000;192(7):1027–34. Epub 2000/10/04. ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Keir ME, Butte MJ, Freeman GJ, Sharpe AH. PD-1 and its ligands in tolerance and immunity. Annu Rev Immunol. 2008;26:677–704. Epub 2008/01/05. doi: 10.1146/annurev.immunol.26.021607.090331 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Duraiswamy J, Kaluza KM, Freeman GJ, Coukos G. Dual blockade of PD-1 and CTLA-4 combined with tumor vaccine effectively restores T-cell rejection function in tumors. Cancer Res. 2013;73(12):3591–603. Epub 2013/05/02. doi: 10.1158/0008-5472.CAN-12-4100 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Li X, Li M, Lian Z, Zhu H, Kong L, Wang P, et al. Prognostic role of programmed death ligand-1 expression in breast cancer: a systematic review and meta-analysis. Target Oncol. 2016. Epub 2016/07/17. doi: 10.1007/s11523-016-0451-8 . [DOI] [PubMed] [Google Scholar]
  • 15.Xu F, Xu L, Wang Q, An G, Feng G, Liu F. Clinicopathological and prognostic value of programmed death ligand-1 (PD-L1) in renal cell carcinoma: a meta-analysis. Int J Clin Exp Med. 2015;8(9):14595–603. Epub 2015/12/03. ; [PMC free article] [PubMed] [Google Scholar]
  • 16.Huang B, Chen L, Bao C, Sun C, Li J, Wang L, et al. The expression status and prognostic significance of programmed cell death 1 ligand 1 in gastrointestinal tract cancer: a systematic review and meta-analysis. Onco Targets Ther. 2015;8:2617–25. Epub 2015/10/10. doi: 10.2147/OTT.S91025 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Swaika A, Hammond WA, Joseph RW. Current state of anti-PD-L1 and anti-PD-1 agents in cancer therapy. Mol Immunol. 2015;67(2 Pt A):4–17. Epub 2015/03/10. doi: 10.1016/j.molimm.2015.02.009 . [DOI] [PubMed] [Google Scholar]
  • 18.Yang Y, Pang Z, Ding N, Dong W, Ma W, Li Y, et al. The efficacy and potential predictive factors of PD-1/PD-L1 blockades in epithelial carcinoma patients: a systematic review and meta analysis. Oncotarget. 2016. Epub 2016/08/20. doi: 10.18632/oncotarget.11291 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Chen TC, Wu CT, Wang CP, Hsu WL, Yang TL, Lou PJ, et al. Associations among pretreatment tumor necrosis and the expression of HIF-1alpha and PD-L1 in advanced oral squamous cell carcinoma and the prognostic impact thereof. Oral Oncol. 2015;51(11):1004–10. Epub 2015/09/15. doi: 10.1016/j.oraloncology.2015.08.011 . [DOI] [PubMed] [Google Scholar]
  • 20.Straub M, Drecoll E, Pfarr N, Weichert W, Langer R, Hapfelmeier A, et al. CD274/PD-L1 gene amplification and PD-L1 protein expression are common events in squamous cell carcinoma of the oral cavity. Oncotarget. 2016;7(11):12024–34. WOS:000375679600023. doi: 10.18632/oncotarget.7593 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Zhang J, Fang W, Qin T, Yang Y, Hong S, Liang W, et al. Co-expression of PD-1 and PD-L1 predicts poor outcome in nasopharyngeal carcinoma. Med Oncol. 2015;32(3):86 Epub 2015/02/24. doi: 10.1007/s12032-015-0501-6 . [DOI] [PubMed] [Google Scholar]
  • 22.Budczies J, Bockmayr M, Denkert C, Klauschen F, Groschel S, Darb-Esfahani S, et al. Pan-cancer analysis of copy number changes in programmed death-ligand 1 (PD-L1, CD274)—associations with gene expression, mutational load, and survival. Genes Chromosomes Cancer. 2016;55(8):626–39. Epub 2016/04/24. doi: 10.1002/gcc.22365 . [DOI] [PubMed] [Google Scholar]
  • 23.Ock CY, Kim S, Keam B, Kim M, Kim TM, Kim JH, et al. PD-L1 expression is associated with epithelial-mesenchymal transition in head and neck squamous cell carcinoma. Oncotarget. 2016;7(13):15901–14. WOS:000375692900047. doi: 10.18632/oncotarget.7431 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Thierauf J, Veit JA, Affolter A, Bergmann C, Grunow J, Laban S, et al. Identification and clinical relevance of PD-L1 expression in primary mucosal malignant melanoma of the head and neck. Melanoma Res. 2015;25(6):503–9. Epub 2015/09/10. doi: 10.1097/CMR.0000000000000197 . [DOI] [PubMed] [Google Scholar]
  • 25.Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–12. Epub 2009/07/28. doi: 10.1016/j.jclinepi.2009.06.005 . [DOI] [PubMed] [Google Scholar]
  • 26.McShane LM, Altman DG, Sauerbrei W, Taube SE, Gion M, Clark GM. REporting recommendations for tumour MARKer prognostic studies (REMARK). Br J Cancer. 2005;93(4):387–91. Epub 2005/08/18. doi: 10.1038/sj.bjc.6602678 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Tierney JF, Stewart LA, Ghersi D, Burdett S, Sydes MR. Practical methods for incorporating summary time-to-event data into meta-analysis. Trials. 2007;8:16 Epub 2007/06/09. doi: 10.1186/1745-6215-8-16 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Zeng X, Zhang Y, Kwong JS, Zhang C, Li S, Sun F, et al. The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review. J Evid Based Med. 2015;8(1):2–10. Epub 2015/01/17. doi: 10.1111/jebm.12141 . [DOI] [PubMed] [Google Scholar]
  • 29.Cho YA, Yoon HJ, Lee JI, Hong SP, Hong SD. Relationship between the expressions of PD-L1 and tumor-infiltrating lymphocytes in oral squamous cell carcinoma. Oral Oncol. 2011;47(12):1148–53. Epub 2011/09/14. doi: 10.1016/j.oraloncology.2011.08.007 . [DOI] [PubMed] [Google Scholar]
  • 30.Fang W, Zhang J, Hong S, Zhan J, Chen N, Qin T, et al. EBV-driven LMP1 and IFN-gamma up-regulate PD-L1 in nasopharyngeal carcinoma: Implications for oncotargeted therapy. Oncotarget. 2014;5(23):12189–202. Epub 2014/11/02. doi: 10.18632/oncotarget.2608 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Kim HS, Lee JY, Lim SH, Park K, Lee SH, Sun JM, et al. Association between PD-L1 and HPV status and the prognostic value of PD-L1 in oropharyngeal squamous cell carcinoma. Cancer Research and Treatment. 2016;48(2):527–36. doi: 10.4143/crt.2015.249 WOS:000374197200012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Lee VH, Lo AW, Leung CY, Shek WH, Kwong DL, Lam KO, et al. Correlation of PD-L1 expression of tumor cells with survival outcomes after radical intensity-modulated radiation therapy for non-metastatic nasopharyngeal carcinoma. Plos One. 2016;11(6):e0157969 Epub 2016/06/25. doi: 10.1371/journal.pone.0157969 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Lin YM, Sung WW, Hsieh MJ, Tsai SC, Lai HW, Yang SM, et al. High PD-L1 expression correlates with metastasis and poor prognosis in oral squamous cell carcinoma. Plos One. 2015;10(11):e0142656 Epub 2015/11/13. doi: 10.1371/journal.pone.0142656 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Mukaigawa T, Hayashi R, Hashimoto K, Ugumori T, Hato N, Fujii S. Programmed death ligand-1 expression is associated with poor disease free survival in salivary gland carcinomas. J Surg Oncol. 2016;114(1):36–43. Epub 2016/04/26. doi: 10.1002/jso.24266 . [DOI] [PubMed] [Google Scholar]
  • 35.Oliveira-Costa JP, de Carvalho AF, da Silveira GG, Amaya P, Wu YQ, Park KJJ, et al. Gene expression patterns through oral squamous cell carcinoma development: PD-L1 expression in primary tumor and circulating tumor cells. Oncotarget. 2015;6(25):20902–20. WOS:000360969200019. doi: 10.18632/oncotarget.3939 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Satgunaseelan L, Gupta R, Madore J, Chia N, Lum T, Palme CE, et al. Programmed cell death-ligand 1 expression in oral squamous cell carcinoma is associated with an inflammatory phenotype. Pathology. 2016. Epub 2016/09/04. doi: 10.1016/j.pathol.2016.07.003 . [DOI] [PubMed] [Google Scholar]
  • 37.Ukpo OC, Thorstad WL, Lewis JS Jr. B7-H1 expression model for immune evasion in human papillomavirus-related oropharyngeal squamous cell carcinoma. Head Neck Pathol. 2013;7(2):113–21. Epub 2012/11/28. doi: 10.1007/s12105-012-0406-z ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Vassilakopoulou M, Avgeris M, Velcheti V, Kotoula V, Rampias T, Chatzopoulos K, et al. Evaluation of PD-L1 expression and associated tumor-infiltrating lymphocytes in laryngeal squamous cell carcinoma. Clin Cancer Res. 2016;22(3):704–13. Epub 2015/09/27. doi: 10.1158/1078-0432.CCR-15-1543 . [DOI] [PubMed] [Google Scholar]
  • 39.Liu YX, Wang XS, Wang YF, Hu XC, Yan JQ, Zhang YL, et al. Prognostic significance of PD-L1 expression in patients with gastric cancer in East Asia: a meta-analysis. Onco Targets Ther. 2016;9:2649–54. Epub 2016/05/27. doi: 10.2147/OTT.S102616 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Mittal D, Gubin MM, Schreiber RD, Smyth MJ. New insights into cancer immunoediting and its three component phases—elimination, equilibrium and escape. Curr Opin Immunol. 2014;27:16–25. Epub 2014/02/18. doi: 10.1016/j.coi.2014.01.004 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Philips GK, Atkins M. Therapeutic uses of anti-PD-1 and anti-PD-L1 antibodies. Int Immunol. 2015;27(1):39–46. Epub 2014/10/18. doi: 10.1093/intimm/dxu095 . [DOI] [PubMed] [Google Scholar]
  • 42.Lyford-Pike S, Peng S, Young GD, Taube JM, Westra WH, Akpeng B, et al. Evidence for a role of the PD-1:PD-L1 pathway in immune resistance of HPV-associated head and neck squamous cell carcinoma. Cancer Res. 2013;73(6):1733–41. Epub 2013/01/05. doi: 10.1158/0008-5472.CAN-12-2384 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Azuma T, Yao S, Zhu G, Flies AS, Flies SJ, Chen L. B7-H1 is a ubiquitous antiapoptotic receptor on cancer cells. Blood. 2008;111(7):3635–43. Epub 2008/01/29. doi: 10.1182/blood-2007-11-123141 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Zandberg DP, Strome SE. The role of the PD-L1:PD-1 pathway in squamous cell carcinoma of the head and neck. Oral Oncol. 2014;50(7):627–32. Epub 2014/05/14. doi: 10.1016/j.oraloncology.2014.04.003 . [DOI] [PubMed] [Google Scholar]
  • 45.Park JJ, Omiya R, Matsumura Y, Sakoda Y, Kuramasu A, Augustine MM, et al. B7-H1/CD80 interaction is required for the induction and maintenance of peripheral T-cell tolerance. Blood. 2010;116(8):1291–8. Epub 2010/05/18. doi: 10.1182/blood-2010-01-265975 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Wu P, Wu D, Li L, Chai Y, Huang J. PD-L1 and survival in solid tumors: a meta-analysis. PLoS One. 2015;10(6):e0131403 Epub 2015/06/27. doi: 10.1371/journal.pone.0131403 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Zhong A, Xing Y, Pan X, Shi M, Xu H. Prognostic value of programmed cell death-ligand 1 expression in patients with non-small-cell lung cancer: evidence from an updated meta-analysis. Onco Targets Ther. 2015;8:3595–601. Epub 2015/12/15. doi: 10.2147/OTT.S91469 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Economopoulou P, Kotsantis I, Psyrri A. Checkpoint inhibitors in head and neck cancer: rationale, clinical activity, and potential biomarkers. Curr Treat Options Oncol. 2016;17(8):40 Epub 2016/06/18. doi: 10.1007/s11864-016-0419-z . [DOI] [PubMed] [Google Scholar]
  • 49.Seiwert TY, Burtness B, Mehra R, Weiss J, Berger R, Eder JP, et al. Safety and clinical activity of pembrolizumab for treatment of recurrent or metastatic squamous cell carcinoma of the head and neck (KEYNOTE-012): an open-label, multicentre, phase 1b trial. Lancet Oncol. 2016;17(7):956–65. Epub 2016/06/02. doi: 10.1016/S1470-2045(16)30066-3 . [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

S1 File. Full electronic search strategy for PubMed database.

(DOCX)

S1 Table. PRISMA 2009 checklist for this meta-analysis.

(DOC)

Data Availability Statement

All relevant data are within the paper and its Supporting Information files.


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES