Skip to main content
Cancers logoLink to Cancers
. 2019 Jun 28;11(7):911. doi: 10.3390/cancers11070911

Decoding Immune Heterogeneity of Triple Negative Breast Cancer and Its Association with Systemic Inflammation

Sandra Romero-Cordoba 1,2, Elisabetta Meneghini 3, Milena Sant 3, Marilena Valeria Iorio 2, Lucia Sfondrini 4, Biagio Paolini 5, Roberto Agresti 6, Elda Tagliabue 2,*, Francesca Bianchi 2
PMCID: PMC6678607  PMID: 31261762

Abstract

Triple negative breast cancer (TNBC) is an aggressive subtype with limited therapeutic options. New opportunities are emerging from current comprehensive characterization of tumor immune infiltration and fitness. Therefore, effectiveness of current chemotherapies and novel immunotherapies are partially dictated by host inflammatory and immune profiles. However, further progress in breast cancer immuno-oncology is required to reach a detailed awareness of the immune infiltrate landscape and to determine additional reliable and easily detectable biomarkers. In this study, by analyzing gene expression profiles of 54 TNBC cases we identified three TNBC clusters displaying unique immune features. Deep molecular characterization of immune cells cytolytic-activity and tumor-inflammation status reveled variability in the local composition of the immune infiltrate in the TNBC clusters, reconciled by tumor-infiltrating lymphocytes counts. Platelet-to-lymphocyte ratio (PLR), a blood systemic parameter of inflammation evaluated using pre-surgical blood test data, resulted negatively correlated with local tumoral cytolytic activity and T cell–inflamed microenvironment, whereas tumor aggressiveness score signature positively correlated with PLR values. These data highlighted that systemic inflammation parameters may represent reliable and informative markers of the local immune tumor microenvironment in TNBC patients and could be exploited to decipher tumor infiltrate properties and consequently to select the most appropriate therapies.

Keywords: TNBC, immune heterogeneity, TILs, inflammation, PLR, platelet, CBC

1. Introduction

Triple negative breast cancer (TNBC) represents a minority (10–17%) of all breast carcinomas (BC) [1], however, it stands for an important challenge in actual clinical practice due to the poor clinical outcomes compared with non-TNBC [2,3]. It is known that tumor progression and subsequent metastasis may be impaired by an effective antitumor immune response. Notably, growing evidence shows a highly diverse immunogenic activity across breast cancer subtypes that may be correlated with phenotypic heterogeneity of breast cancer [4,5,6,7]. Several studies have explored the biological and clinical significance of immune system in TNBC [8,9,10,11,12]. TNBC is associated with high density of tumor infiltrating lymphocytes (TILs) defined by histopathology evaluation, which represents a robust intratumoral inflammatory response describing triple negative (TN) tumors as an immunogenic neoplasia [4,5,6]. Diverse evidence indicated that tumor-associated inflammatory cells improve survival in BC, including TNBC [4,7,13,14]. An enhanced innate and adaptive immunity, as revealed by TILs count, improves chemotherapy [14,15] and radiotherapy responses, regardless of breast cancer subtype [16].

Nowadays, besides count of TILs and immunoscoring of T-cell subpopulations by immune pathological evaluation, other methods recently emerged to assess tumor immune landscape such as deconvolution approaches that allow to define the proportion of immune cells infiltrating the tumors [17], and gene-expression signatures that mirror the immune-state of the neoplasia and its microenvironment [18,19,20,21]. Molecular phenotyping identified tumor immune response genes as key component in the pathobiology of TNBC [22,23,24,25]. These findings have encouraged the use of immunomodulatory agents in ongoing TNBC clinical trials [9,26,27] and pointed the emergency of a deep characterization of TNBC immune-related features and their dynamics across tumor life-time, to provide new immune markers.

A chronic systemic inflammatory response is defined as an aberrantly prolonged form of protective responses against tissue homeostasis disruption [28]. Elevated systemic inflammation is consistently associated with poor outcome in many solid tumor [29,30], including TNBC breast cancer [31]. Particularly, count of white cells derived from peripheral blood cell test (complete blood count, CBC), including neutrophils, lymphocytes, platelet cells and their proportions such as neutrophil to lymphocyte ratio (NLR) and platelet to lymphocyte ratio (PLR), were found effective predictors of BC poor survival outcome [31,32,33]. For instance, PLR represented a prognostic marker for overall survival (OS) in patients who receive chemotherapy [34]. In addition, in neoadjuvant therapeutic scheme, complete pathological response was significantly higher in breast cancer patients with low PLR [35], and in hormone-receptor-negative (HR-) breast cancer increased PLR associated with poor survival [36].

Nevertheless, although there is evidence of the prognostic power of systemic hematological cell count, the relationship between local and systemic inflammatory responses in BC is still unknown. In other solid tumor types, parameters of local and systemic inflammation appeared to be independent from each other (i.e., in colon cancer) or inversely associated (i.e., in laryngeal squamous cell carcinoma) [37,38]. Although recent studies demonstrated that tumor eradication via immunotherapy requires peripheral immune cell activity [39], the association between systemic inflammation and local immune response in BC remains unexplored. Clearly, there is a major need to better understand the genomic, molecular, and biological immune landscapes of TNBC and to dissect the relationship with systemic inflammation to finally propose novel markers to track immune states and their evolution along cancer-time by accessible circulating molecules.

Here, using unsupervised clustering analysis based on immune-related gene expression signatures derived from the literature, we demonstrated the existence of three immuno-clusters in TNBC tumors. We also showed an association of tumor immune infiltrate features with the systemic hematological PLR parameter. This evidence provides a proof-of-concept of the informative value of PLR as a surrogate metric of local tumor immune landscape of TNBC patients, which may represent an accessible tool, useful for real time monitoring of immune activation at tumor site.

2. Results

2.1. Comprehensive Genomic Characterization of Immune-Cell Infiltration in Triple Negative Tumors Identifies Three Immuno-Clusters that Portray Different Immune-Landscapes

By applying the non-negative matrix factorization (NMF) algorithm on gene expression profile of annotated immune related-genes [17,19] on 57 TNBC, tumors 5 immuno-clusters (Im-Clus) were defined (Figure S1A). To get more reliable mathematical and biological groups, 54 TNBC tumors were re-classified into 3 Im-Clus (ImA n = 15, ImB n = 18, ImC n = 21) (Figure 1A) (See section of Materials and Methods for details, Figure S1B,C). Principal component analysis (PCA) demonstrated robust differences in the expression portraits between the 3 Im-Clus identified by the NMF clustering (Figure 1B). The standard clinical and pathological characteristics of our cases were described in Table S1. The majority of women were ≥50 years of age (63%) and young patients were less likely to belong to ImC (ImA 53.3%, ImB: 44.4%; ImC: 19.1%; p = 0.084).

Figure 1.

Figure 1

Immune landscape of the three immuno-clusters identified in triple negative tumors. (A) Heatmap of the expression profiles of the immune-related genes (n = 708) evaluated across the immuno-clusters (Im-Clus) defined (ImA, Imb and ImC). Violet indicates elevated gene expression while gray indicates reduced gene expression. (B) Principal component analysis (PCA) of the Im-Clus computer as a linear combination of the immune-related gene. Component 1 and 2 explain 60% of the variance. (C) Visual representation of computed immunoscores for each Im-Clust in an immunophentogram of the four immunogenicity categories of the tumors. (D) Boxplot of immune and stromal score distribution assessed by Estimated algorithm. (E) Relative abundance fractions (%) of immune cell population in individual tumors belonging to each of the Im-Clus using CIBERSORT tool. (F) Activated CD8+ T cells ssGSEA score values among the im-Clus. (G) Relative median infiltration of NK activated and resting cells, as well as CD4+ T cells and Tregs across the most significant altered immune-infiltrated population in the Im-Clus (ssGSEA of immune-related gene terms). (H) Technical validation and comparison between individual enrichment scores computed by ssGSEA on CD8+ (red boxplot) activated gene set and tumor infiltrating lymphocytes (TILs) pathological evaluation by hematoxylin/eosin evaluation (blue boxplot). * p-value ≤ 0.05.

To decipher the immune heterogeneity among the established Im-Clus, we took advantage of immune-related tools recently published in the literature. First, to investigate whether the Im-Clus show different immunophenotypes, an in silico immunophenoscore [19] was computed. Immunophenogram of ImA presents an enrichment in tumor immune-intrinsic factors, such as immunoinhibitors (e.g., programmed death-ligand 1, PD-L1) and major histocompatibility complex class molecules (e.g., HLA, TAP1), as well as an enhancement in effector cells (e.g., activated CD8 T cells (CD8+) and activated memory CD4 T cells (CD4+)), which results in a immunophenoscore of 10. Instead, ImB and ImC presented a lower enrichment of antigen processing machinery, check points immunomodulators and effector cells, which together define an immunophenoscore of 8 (Figure 1C), meaning that ImA seems to be the most immunogenic group, in comparison to ImB and C.

We then examined the distribution of stromal and immune content per Im-Clus by computing Estimate algorithm [21]. ImA was characterized by a significantly higher immune cells scores than the rest of the Im-Clus (p = 0.008), whereas ImB and mainly ImC showed a similarly distribution of stromal and immune scores (Figure 1D). Collectively, these results confirmed that ImA tumors tend to have stronger tumor immunity among the Im-Clus evaluated. In addition, when comparing tumor purity, we observed a descending pattern from ImC to ImA cluster (Kruskal–Wallis test, p ≤ 0.05) (Figure S2A). The median tumor purity of all evaluated cases computed with Estimated was 61%, in accordance to our sample inclusion criteria (Figure S2A). These results suggest that ImA malignancies contain the highest number of immune cells and ImC contain the highest number of tumor cells and stromal cell components.

Composition of infiltrating immune cells was examined by CIBERSORT method [17] and ssGSEA of immune-related gene terms [40]. Each Im-Clus presented a unique content and mixture of immune infiltrating cell populations (Figure 1E). ImA, the more immune-active group, showed the higher enrichment of CD8+ (Figure 1F), as well as a higher relative abundance of other immune-active cells such as natural killer cells (NK) and effector CD4+ [41] (Figure 1G); while the immune-suppressive subtypes, ImB and ImC, were enriched in regulatory T cells (Tregs) (Figure 1G). Moreover, the percentage of samples presenting Tregs, NK and memory B cells was lower in tumors classified as ImA than ImB and ImC (Figure S2B), whereas neutrophils were present in a higher percentage of tumors belonging to ImA (Figure S2B).

To assess whether immune phenotypes based on gene expression reflect pathological evaluations of tumor infiltrating immune cells, tumor infiltrating lymphocytes (TILs) were evaluated. There was a strong significant correlation between the percentage of TILs and the enrichment score of activated CD8+ T cells (Spearman’s ρ = 0.728, p < 0.0001) (Figure 1H). A proportion of TILs equal to or higher than 20%, a threshold reported to have a clinical relevance [42,43], occurred in 93% of ImA tumors versus 33% and 47% of ImB and ImC tumors, respectively (Figure S2C,D).

Since effective natural anti-tumor immunity requires a cytolytic immune response, cytolytic activity (CYT) was analyzed in our TN cases. ImA exhibited significantly higher CYT score compared to ImB and ImC (median: 7.11 vs. 5.40 and 5.79, p = 0.0001) (Figure 2A). Further, to explore a pre-existing adaptive immune response within tumors, we computed the Tumor Inflammation Signature (TIS) algorithm [18]. ImA presented the highest TIS score (median: 8.26 vs. 6.71 and 6.95, p = 0.0001) when compared to ImB and ImC (Figure 2B), consistent with the elevated CYT described in this immune-cluster.

Figure 2.

Figure 2

Figure 2

Local immune microenvironment and immuno-inhibitors portrait among the immune-clusters. Comparison of (A) Cytolitic activity score and (B) Tumor inflammation signature score values presented in boxplots. (C) Heatmap of gene expression of immune inhibitory molecules among the three immune clusters. Blue represent up-regulation while gray down-modulation. (D) Correlation matrix of local immune features and immune-inhibitory molecules across the Im-Clus, as measured by Spearman R coefficients. CD8+: ssGSEA enrichment score of activated CD8 t cells term; TILs: Pathological evaluation of the percentage of tumor infiltrating lymphocytes. All presented correlations are significant with p values ≤ 0.05. Statistical comparison based on Kruskal-Wallis method.

To identify the dominant determinants of immune cell infiltration in the Im-Clus, the expression of the immune inhibitors Programmed Cell Death 1, Programmed Cell Death 1 Ligand, Cytotoxic T-Lymphocyte Antigen 4 and Lymphocyte Activation protein 3 (PD-1/PD-L1/CTLA4/LAG3) was analyzed. This molecular axis resulted up-modulated in the ImA cluster in comparison to ImB and C (Figure 2C). Likely, a strong correlation between most of these immune inhibitory genes, CYT/TIS scores and the proportion of CD8+ T cells (ssGSEA CD8+ and TILs) was observed (Figure 2D), suggesting potential coordinated mechanisms and biological signaling pathways that maintain the immune surveillance or the immune evasion in each Im-Clus. Collectively, these analyses identified an extensive immune heterogeneity in TNBC and revealed three immune-clusters that represent unique biological entities with specific immune-molecular features, as illustrated by the assorted cytolytic activity and inflammatory phenotypes identified, as well as the distinct immune cell populations infiltrating the tumoral cells.

2.2. Inflammation and Tumor Immune-Features Are Correlated within TNBC Immune-Clusters

To identify cooperative immune phenotypes and functions, we determined the correlation between immune tumoral features in overall TNBC cases. We found a significant positive correlation between the CYT score, CD8+ infiltration and inflammation status (TIS) (Figure 3A), suggesting that CD8+ infiltration results in the activation of immune effectors, consistent with previous reports. [44,45]. Correlation analyses within each Im-Clus revealed heterogeneous association patterns. CYT positively correlates with TIS in ImA and C sub-groups and no correlation was observed in ImC (Figure 3B). CYT and activated CD8+ T cell were correlated only in ImA tumors (Figure 3C). These data are consistent with our previous data underlying varied features of local immune microenvironment among TNBC, and indicate the correlation of immune regulatory responses and mechanisms and the relevance of specific immune features of each immune-cluster.

Figure 3.

Figure 3

Correlation between local immune features among Im-Clus. (A) Matrix correlation of triple negative tumors among local immune features. The bubble color corresponds to the correlation direction. The number presented corresponds to the R value. All correlations presented are significant with p value < 0.05. Scatter plot of (B) cytolytic activity (CYT) vs. Tumor Inflammation Signature (TIS) and (C) CYT vs. activated CD8+ T cells and their correlation value and statistical significance reported as p value. Each Im-Clus is reported by different colors as indicated in the legend. All R coefficients are measured by Spearman method.

2.3. The Systemic Inflammatory Marker Platelet-to-Lymphocyte Ratio Correlates with Local Immune Status of the Immune-Clusters

We investigated the relationship between the systemic levels of inflammatory parameters and the TNBC Im-Clus. Notably, the median value of the systemic inflammatory marker PRL was significantly lower in ImA than in the other Im-Clus (132.2 vs. 161.6, 176.2; p = 0.045) (Figure 4A), similarly median platelets count was lower in the ImA than in the other Im-Clus (p = 0.059) (Figure 4B). Likewise, in multinomial logistic regression analysis taking ImA as a reference group, PLR counts were still significantly associated with the Im-Clus (age-adjusted OR 1.20, 95% confidence interval (CI) 1.00–1.44 for ImB and 1.24, 95% CI 1.04–1.49 for ImC) and a tendency towards significance was observed for platelets (age-adjusted OR 1.08, 95% CI 0.98–1.19 for ImB and 1.03, 95% CI 0.93–1.14 for ImC) (Table 1). As a support of these findings, PLR counts were significantly negatively correlated with TIS (Figure 4C), in accordance with the notion that TIS metric portrays the presence of inflammatory molecules [46,47]. When comparing PLR and CYT, a trend towards a negative correlation was observed (Figure 4D). As expected, systemic lymphocytes were positively correlated with TIS scores (Figure 4E), since during inflammation the cellular microenvironment becomes highly reactive mainly due to T lymphocyte action [48].

Figure 4.

Figure 4

Correlation of local immune features and the inflammatory systemic blood markers in the triple negative breast cancer cases. Distribution of (A) platelet-to-lymphocyte ratio (PLR) and (B) platelets acquired through blood sample test in the Im-Clus. Scatter plots showing the correlation of: (C) Tumor Inflammation Signature (TIS) vs. PLR, (D) CYT vs. PLR, and (E) TIS vs. lymphocytes. All R coefficients measured by Spearman method. Statistical comparison based on Kruskal-Wallis method.

Table 1.

Association between markers of systemic inflammation and immune-clusters.

Inflammation Markers ImA ImB ImC
PLR
median (range) 132.2 (75.6–210.0) 161.6 (113.8–244.5) 176.2 (90.4–241.0)
Kruskal-Wallis test p = 0.045
crude OR (95% CI) a,b Ref. 1.20 (1.00–1.43) 1.23 (1.04–1.47)
age-adjusted OR (95% CI) a,b Ref. 1.20 (1.00–1.44) 1.24 (1.04–1.49)
NLR
median (range) 2.60 (1.05–4.46) 2.36 (1.14–4.11) 2.80 (1.08–9.67)
Kruskal-Wallis test p = 0.963
crude OR (95% CI) a,c Ref. 1.03 (0.60–1.77) 1.25 (0.76–2.05)
age-adjusted OR (95% CI) a,c Ref. 1.00 (0.54–1.86) 1.20 (0.67–2.16)
Lymphocytes
median (range) 2.00 (0.90–3.90) 1.85 (0.90–2.60) 1.60 (0.70–3.40)
Kruskal-Wallis test p = 0.265
crude OR (95% CI) a,c Ref. 0.61 (0.21–1.78) 0.40 (0.13–1.25)
age-adjusted OR (95% CI) a,c Ref. 0.64 (0.22–1.87) 0.41 (0.13–1.31)
Neutrophils
median (range) 4.40 (2.10–6.50) 4.55 (1.90–7.80) 4.10 (2.00–11.60)
Kruskal-Wallis test p = 0.665
crude OR (95% CI) a,c Ref. 0.99 (0.68–1.44) 0.95 (0.65–1.37)
age-adjusted OR (95% CI) a,c Ref. 0.93 (0.61–1.41) 0.87 (0.58–1.32)
Platelets
median (range) 252 (119–452) 297 (169–489) 248 (132–521)
Kruskal-Wallis test p = 0.060
crude OR (95% CI) a,c Ref. 1.07 (0.97–1.19) 1.03 (0.93–1.13)
age-adjusted OR (95% CI) a,c Ref. 1.08 (0.98–1.19) 1.03 (0.93–1.14)

a Odds ratios of ImB and ImC (ImA as reference) by increasing inflammation marker (continuous variable) estimated from multinomial logistic regression; b OR for each 10 unit increase in inflammation marker; c OR for each unit increase in inflammation marker. PLR: Platelet-to-Lymphocyte Ratio, CI: Confidence Interval, NLR: Neutrophil-to-lymphocyte ratio, OR: Odds ratio, Ref.: Reference.

No differences or statistical associations between the Im-Clus and the other hematological inflammatory markers (NLR, lymphocytes or neutrophils) were found (Table 1, Figure S3A–F). The different counts of PLR and platelets in patients with tumors belonging to different Im-Clus indicates that specific systemic hematological markers of inflammation correlate with local immune infiltrate at tumor site in TNBC cases.

2.4. Prognostic Relevance of Local and Systemic Inflammatory Markers

None of the Im-Clus showed a significantly longer DFS outcome, probably due to the limited numbers of cases and progression events in each immuno-cluster that limit the statistical significance than ImB and ImC clusters (Figure S4). However, considering the recurrence events in each immune-clusters, we observed more events in patients whose tumors belong to ImB and ImC compared to ImA (Figure S4). To explore the clinical relevance of the Im-Clus we tested the aggressive score gene-expression signature [49], whose independent prognostic relevance has been proved previously [37,50,51]. In keeping with our previous immune-state characterization, the aggressive score also differed among the three immuno-clusters, with ImA tumors harboring the significantly lowest aggressive score, while ImB and ImC showed similar aggressive values (median: 2.85 vs. 3.94 and 3.51, p = 0.0001) (Figure 5A). Moreover, by analyzing an integrative immune score (IMS), that considers the biological cooperative activity of CYT and TIS phenotypes and the aggressive score measurement as a molecular surrogate indicator of TNBC outcome (see section of Materials and Methods for details), against the time to event (disease recurrence or censoring), all ImA tumors showed the highest IMS score and the highest event-free time (Figure 5B, Q2), notably only two ImA tumors harboring high IMS levels also presented cancer-disease event (Figure 5B, Q4). Tumors identified by the lowest IMS score and the earlier progression events were classified as ImB and C (Figure 5B, Q3). Even more, ImC tumors presenting late recurrent events were also characterized by a decreased IMS (Figure 5B, Q1).

Figure 5.

Figure 5

Clinical relevance of local and systemic inflammatory markers (A) Boxplot of computed aggressive score among Im-Clus (B) Scatterplot of follow-up time (y-axis, time to event (days), cut-off mean value) vs Integrative immune score (IMS score), IMS = ((CYT × TIS) − Aggressive score) (x-axis, cut off mean value). In each plot four different quadrants are indicated (Q1, Q2, Q3, Q4) in accordance to their value to y and x values. Circle represents no progression/recurrence event while triangle represents event. Colors represent each Im-Clus as indicated by the legend color. (C) Scatterplot of follow-up time (y-axis, time to event (days), cut-off mean value) vs. PLR values (x-axis, (cut-off mean value of ImA cluster).

The relationship between blood systemic inflammatory markers and clinical outcome was investigated. The association of PLR value, a marker of poor outcome in breast cancer, with aggressive score resulted near the significance (age-adjusted OR 2.08, 95% CI 0.69–6.30) (Table 2). Consistently, platelets were significantly associated with high aggressive score signature (age-adjusted OR 3.78, 95% CI 1.20–11.91) (Table 2). This analysis revealed that TNBCs with highest aggressive score and more abundant levels of platelets and PLR, are more likely to present poorer clinical outcomes. Further, the prognostic relationship between tumors with high CD8+ T cells score based on gene expression enrichment of the local tumor microenvironment (above median) showed less PLR levels in blood (age-adjusted OR 0.35 95%, CI 0.11–1.06). No association was detected between the tumors with high percentage of local TILs and blood platelets or lymphocytes (Table 3).

Table 2.

Association between markers of systemic inflammation and aggressive score.

Marker n High a Aggressive Score
(%) Crude OR (95% CI) b Age-Adjusted OR (95% CI) b
PLR
≤median 27 40.7 Ref.
>median 27 59.3 2.12 (0.71–6.27) 2.08 (0.69–6.30)
Lymphocyte
≤median 28 50.0 Ref.
>median 26 50.0 1.00 (0.34–2.91) 0.95 (0.31–2.83)
Platelet
≤median 27 33.3 Ref.
>median 27 66.7 4.00 (1.29–12.40) 3.78 (1.20–11.91)

a Above median value; b Binomial logistic regression.

Table 3.

Association between markers of systemic inflammation and tumor infiltrating lymphocytes (TILs).

Marker High a Activated CD8 T Cell High a TILs
(%) Crude OR
(95% CI) b
Age-Adjusted OR (95% CI) b (%) Crude OR (95% CI) b Age-Adjusted OR (95% CI) b
PLR
≤median 63.0 Ref. 40.7 Ref.
>median 37.0 0.35 (0.11–1.04) 0.35 (0.11–1.06) 32.0 0.68 (0.22–2.14) 0.70 (0.22–2.24)
Lymphocyte
≤median 42.9 Ref. 30.7 Ref.
>median 57.7 1.81 (0.62–5.35) 1.89 (0.63–5.65) 42.3 1.65 (0.53–5.16) 1.79 (0.56–5.80)
Platelet
≤median 63.0 Ref. 42.3 Ref.
>median 37.0 0.35 (0.11–1.04) 0.36 (0.12–1.10) 30.8 0.61 (0.19–1.89) 0.65 (0.20–2.09)

a Above median value; b Binomial logistic regression.

Comparing the PLR values with time to event, we observed that most of the patients with an early disease progression event, belonging to ImB and C groups, also present PLR levels above the ImA median value (Figure 5C, Q4), whereas a broad spectrum of progression times was observed in the rest of the quadrants (Figure 5C, Q1,2,3).

3. Discussion

Besides the already well-described molecular heterogeneity of TNBC tumor cells, the immune infiltrating counterpart has also emerged as a relevant contributor to define the tumor complexity [52,53]. A comprehensive portrait of immunologic landscape of breast cancer subtypes pointed out TNBC as the subtype with the strongest tumor immunogenicity [54]. Here, we have analyzed the immune states and the heterogeneity of infiltrating subpopulations in a well characterized TNBC series, integrating transcriptional-based deconvolution algorithms and effector-regulatory immune signatures. We find three robust immuno-clusters, with broad diversity in the tumor immune infiltrate composition and activation. Our data report that both cytolytic activity signature, reflecting an effective natural anti-tumor immunity, and tumor inflammation signature, denoting a T cell-inflamed microenvironment, are positively correlated with TILs among the immune-clusters. In agreement, in our TNBC series we observed a strong significant correlation between the percentage of TILs and the enrichment score of CD8+ T cells activation, the main driver of the primary antitumor immune-responses [55].

Neoplastic cells can interact with the immune cells infiltrating the tumor and activate adaptive processes, through modulation of transcriptional and signaling programs that may result in the establishment of an aggressive phenotype [51,56,57]. In keeping with immune-state characterization, the aggressive score also differed among the three immuno-clusters, with ImA tumors harboring a significantly lowest aggressive score, while ImB and ImC showed similar aggressive values. The differential capability of the immune system to mount durable antitumor immune responses, protective for metastasis and recurrence, is a clear evidence of the existence of immune subclasses in breast tumors [11,52,53]; on the other hand, tumors are able to mold the surrounding microenvironment to favor their own progression [58]. Several studies have shown a significant relationship between the number of TILs and recurrence-free survival in TNBC [15,43,59]. It has also been reported that complete pathological response following neoadjuvant chemotherapy is associated with higher TILs proportion in breast cancer patients [15,59]. Thus, TILs are today considered a prognostic factor and a predictive marker of chemotherapy response in TNBC. In the immunotherapy era, immune infiltrate characterization represents a hot topic for cancer research, especially for aggressive subtype such as TNBC, for which therapeutic options are limited. Collectively, our analysis indicates that decoding the quantitative and qualitative immune heterogeneity of the neoplastic tissues provides relevant information on the overall immune activation state at tumor site.

Recent studies have highlighted the complexity of the number and functional status of different immune networks [60,61], not only at local tumor level, but also at the systemic level, in the circulating blood tissue. Indeed, cancer-related systemic inflammatory responses are associated with alterations in circulating blood cells, mainly in their counts. Moreover, we recently demonstrated that BCs with aggressiveness features, such as TNBC, modify the surrounding microenvironment which contribute to the release of pro-inflammatory mediators [62].

Here, we found a robust association between immune clusters, representing subtypes of TNBC with different local immune features, and PLR values. Conversely, we did not find a significant association between any other hematological systemic cell count or cells ratio. Moreover, when dividing our cases based on the percentage of TILs infiltration, it is unlikely that tumors with higher percentage of TILs also present high PLR values.

Low systemic lymphocyte counts can be associated with impaired activation of adaptive immunity in different tumors [63,64,65]. Conversely, high platelets indicate systemic inflammation and can be associated with increased metastatic processes of neoplastic cells [66,67,68,69]. The differentiation of megakaryocytes to platelets could be triggered by the tumor-associated inflammatory mediators, such as IL-1, IL-3, and IL-6 [70] that accelerate tumor cell growth and dissemination; in addition, platelets cooperate to protect circulating cancer cells from the immune system [71]. We also described the role of platelet-derived growth factor receptors beta (PDGFRβ) in mediating the endothelial differentiation of triple negative breast carcinoma cells [72] and we recently described the involvement of PDGFRβ in the regulation of the CDCP1 [73], a transmembrane protein which is overexpressed in TNBCs and is involved in tumor progression [74]. Hence, high PLR values may indicate an impaired host antitumor immune status.

Growing evidence shows that PLR has clinical implications for the selection of therapeutic modalities and prognosis prediction for breast cancer patients [75,76,77] and PLR was recently associated with significantly lower progression-free survival in metastatic TNBC patients treated with carboplatin-paclitaxel or carboplatin-gemcitabine combination [78]. In agreement, our data suggest a slightly prognostic relationship between PLR value and highest aggressive score signature. As a support, negative correlations were observed between immune-signatures, percentage of TILs and aggressive score, suggesting that a less aggressive phenotype in TNBC is related to both local and systemic inflammatory features, closely connected to each other.

Collectively, these data provide strong evidence of the existence of three immune-tumoral categories correlated with systemic hematological PLR levels in TNBC. Particularly, we clearly described an immune-active subtype (ImA) that is inversely correlated with PLR and platelet values and it is associated with favorable prognosis. ImA was characterized by “T cell–inflamed” phenotype as shown by type I IFN activation represented by TIS metric, cytotoxic effector molecules as shown by the CYT score and high CD8+/CD4+ T and NK cells infiltration. In addition, this cluster presented an enriched expression of immune inhibitory pathways (PD-L1/PD-1/CTLA4 axis) induced by inflammatory process. Conversely, it was found less enriched in Treg cells. This T cell–inflamed subtype presented the lowest aggressive score and a diminished number of progression events compared to the other Im-Clus. Considering all described features, these tumors can be described as “hot” tumors with a local immune landscape that may respond to immunotherapeutic and chemotherapeutic approaches (Figure 6) [79,80,81,82]. ImB tumors, by contrast, are similar to whose which are called “T cell excluded malignancies” or “cold tumors”, which do not show strong immune response. The result is an immunosuppressed phenotype with higher PLR systemic levels and increased progression events [79,80,81,82,83]. Finally, ImC tumors can be described as “warm” or excluded tumors since they present an intermediate phenotype with positive correlations between CYT and TIS scores, and a moderate expression of immune inhibitory pathways. ImC tumors present an intrinsic immune activity able to effectively mount a T cell-mediated response, but the tumor can escape such response [83] and present an intermediate PLR metric.

Figure 6.

Figure 6

Each Immuno-cluster can be described as unique entity similar to cold, warm and hot immune tumors. Summary plot of the local and systemic immune characterization among the defined Im-Clus in our triple negative breast cancer (TNBC) cases.

Our findings agree with a prior study that described immune-landscape of TNBCs and identified subtypes based on immunogenic profiling through a ssGSEA and hierarchical clustering in different TNBC datasets [84]. The identified distinct subtypes (immunity high, medium and low) are comparable to our non-supervised approach that defined similar immune-clusters. These data further strengthen the concept and relevance of immune heterogeneity in TNBC. However, this study only analyzed local immune-environment and did not assess the correlation of hematological inflammatory markers.

There are certain limitations in the present study, including the relatively small sample size evaluated (n = 54) that may have influenced the partial clinical association observed between Im-Clus and time to disease progression. Moreover, this is a retrospective study conducted at a single institution that may not reflect other patient populations. Nonetheless, the presented strategy should serve as a proof-of-concept to show a potential step toward an improvement in real-time monitoring tools through routine blood tests that can provide information about local immunogenomic characteristics and the dynamic changes of tumor immune state during treatment, with a relevant impact on clinical decisions. This latter association could, after a robust validation in a larger cohort, improve the development of an effective and inexpensive approach that may help to guide the evaluation of local immune contexture by systemic immune markers.

4. Materials and Methods

4.1. Study Setting

A monocentric, retrospective study on patients with TNBC that receive surgery between 2002 and 2006 at Fondazione IRCCS Istituto Nazionale dei Tumori, Milan, Italy (baseline characteristics of the cases in Table S1) was performed. Histologic subtype and grade were determined according to WHO classification and Nottingham histologic grading system, respectively. An informed consent was obtained from all patients. All procedures were carried out in accordance with the Helsinki Declaration (World Medical Association, 2013) and the study was conducted after approval from the Institutional Review Board and the Independent Ethical Committee of Fondazione IRCCS Istituto Nazionale dei Tumori (Milan, Italy) (INT 160/15, 22-09-2015). Eligibility criteria were: (1) pathologically or cytologically confirmed diagnosis of primary non-metastatic TNBC, as defined by ER < 10% and PgR < 10% expression at immunohistochemistry (IHC) analysis and an IHC score for HER2 of 0 or 1+; (2) at least 60% tumor cell content evaluated by a pathologist; (3) availability of baseline (pre-surgery) absolute peripheral blood neutrophil, lymphocyte and platelet counts; (4) available information about previous treatment(s); (5) available information about previous treatment(s); (6) available information on the date of disease progression and patient death and (7) available information about gene expression profile. All subjects fulfilling these criteria were evaluated.

4.2. Evaluation of Systemic Inflammation Biomarkers

For all evaluated tumors, CBC test data were available. Absolute counts of peripheral blood neutrophils, lymphocytes, platelets and monocytes were obtained from whole blood count samples taken within 2 months prior to primary tumor surgery for each patient by CBC test. Following parameters have been calculated: (a) NLR by dividing neutrophil by lymphocyte counts; (b) PLR by dividing platelet by lymphocyte counts. Blood parameters were evaluated before TNBC surgery.

4.3. Assessment of Intratumoral Inflammation

Hematoxylin and eosin-stained tissue sections of formalin fixed paraffin-embedded tumor specimens were collected for all patients. From this slide, a certified pathologist scored the average TILs density within tumor areas. Areas of adenoma, ulceration, and necrosis were excluded from the analysis. TILs density was calculated as the ratio of the area occupied by mononuclear cell infiltrates to the entire stromal area (% TIL = area occupied by mononuclear cells in tumor stromal/total stromal area) [85]. Pathologist was blinded from patient outcomes.

4.4. Transcriptional Landscape Analysis of TNBC

Global gene expression was assessed by the Human Transcriptome Array 2.0 platform (Affymetrix, Central Expressway, Santa Clara, CA, USA). The hybridization, washing and scan procedures were performed according to the protocol proposed by the manufacturer. RMA background correction and quantile normalization were performed using the Transcriptome Analysis Console Software (V2.0, Affymetrix, Santa Clara, CA, USA). Profiling data is available thorough Gene Expression Omnibus data repository (GEO) with accession number GSE86945.

4.5. Immuno-Clusters Identification

We applied consensus clustering using non-negative matrix factorization (NMF) of selected immuno-related genes listed in the literature [17,19] on NMF bioconductor package [86] with Euclidean divergence on R environment (http://www.R-project.org). The initial number of mathematical clusters was selected based on the cophenetic correlation coefficient, which indicate the stability of the clusters. Then to get reliable robust biological clusters, we applied to strategies: (1) we first exclude the less represented cluster (C2; n = 3) since any relevant information from a mathematical point of view will be able to be obtained; (2) we then cluster together the most correlated groups, C4 and C5, as evaluated by Pearson correlation to get a more robust biological group, resulting in 3 distinctive clusters.

4.6. TNBC Immune-Clusters Characterization by Immune Gene Signatures and CIBERSORT Analysis

The immunophenoscore score [19] was computed based on the gene expression values of immune-related genes to describe four classes of immune cells: (1) effector cells, (2) immunosuppressive cells, (3) MHC molecules and (4) selected immunomodulators. The immunophenoscore values were determinate with the available R-script deposited on GitHub (https://github.com/mui-icbi/Immunophenogram). ESTIMATE algorithm [21] was performed to infer the fraction of stromal and immune cells in the bulk gene expression profiles through the R code deposited on GitHub. The relative proportions of infiltrating immune cells were explores using the CIBERSORT [17] algorithm (http://CIBERSORT.stanford.edu/), using the default signature matrix and 1000 permutations. Cytolytic activity (CYT) was calculated through a validated gene expression signature based on the geometric mean of gene expression levels of granzyme A (GZMA) and perforin-1 (PRF1) [20]. Tumor Inflammation Signature (TIS) score was calculated as the average of continuous mean of log2-transformed normalized expression of the identified genes [18]. Calculation of Aggressive score was performed as described based on normalized expression levels of CCL5 (Chemokine (CC motif) ligand 5), DDIT4 (DNA-damage-inducible genes transcript 4) and POLR1C (Polymerase (RNA) I polypeptide C, 30 Kd1a) genes [49]: (− 0.393 × CCL5 + 0.443 × DDIT4 + 0.490 × POLR1C). Finally, individual enrichment scores for ssGSEA of CD8 activated T cell gene set [19] was quantified by ssGSEA method implemented in GSVA Bioconductor library [87] with min gene set size of 5 parameter.

4.7. Statistical Analysis

The difference in clinical-pathological characteristics between Im-Clus was assessed by the Fisher’s exact test. Correlation between continuous variables was assessed by Spearman’s rank coefficient (ρ). Distributions of local and systemic inflammation markers within Im-Clus were illustrated by box plots and differences in median values were assessed by nonparametric Kruskal-Wallis rank test (* p-value ≤ 0.05; ** p-value ≤ 0.01; *** p-value ≤ 0.001; **** p-value ≤ 0.0001). Local and systemic inflammation markers were categorized according to their median value. Association between above median (high) systemic inflammation marker and Im_Clus was evaluated by multinomial logistic regression, with ImA as referent cluster. Associations between dichotomized aggressive score, local immune and systemic inflammation markers were evaluated by binomial logistic regression. Unadjusted (crude) and age-adjusted odds ratios (ORs), with 95% confidence intervals (CIs), were calculated. Time to event was defined as the time from surgery to the first event of locoregional recurrence, contralateral breast cancer, distant metastasis or the end of study. The Kaplan-Meier method was used to estimate 5-year disease free-survival (DFS) and differences between groups were assessed with the log-rank test. Being aware of the low number of our cases, to examine the disease progression in each Im_Clus according to tumor-immune signatures and systemic inflammation markers, we displayed scatter plots of the IMS integrative score (calculated as IMS = (CYT × TIS) − Aggressive score) and PLR/platelet count against time to disease progression or censoring. Two-sided p values < 0.05 were considered significant. Analyses were performed using the Stata statistical software, (release 12.0, Stata Corporation, College Station, TX, USA). Plots were generated in R environment with ggplot tool [88].

4.8. Data Availability

The datasets generated and/or analyzed during the current study are available from the corresponding author on request.

5. Conclusions

We identified three TNBC clusters displaying unique immune features. Deep molecular characterization revealed a TNBC cluster with a “T cell–inflamed” phenotype, a cluster defined as “T cell excluded malignancies” and a last cluster that presents an intermediate phenotype.

To the best of our knowledge, this is the first time that immune tumor characteristics have been related with systemic inflammatory parameters in BC. These data open the possibility to identify by a simple blood test certain subpopulations of immune-active TNBC tumors displaying an enriched expression of immune inhibitory pathways (PD-L1/PD-1/CTLA4 axis) induced by inflammatory process, that may contribute to differentiate responder patients to immune-checkpoint inhibitors therapy. As a support, both TIS and CYT gene signatures, associated with the identified Im-Clus, probe a good correlation with predictive effects of immunotherapy (anti PD-L1 response) in other tumors (melanoma, head and neck and gastric cancer) [18,20,89]. Overall, our immune characterization highlights the potential of hematic markers to mirror local tumor infiltrate in TNBC patients and could be exploited to decipher tumor infiltrate properties and consequently to select the most appropriate therapies.

Acknowledgments

The authors thank Laura Mameli for secretarial assistance and Alfredo Hidalgo-Miranda for his support to get the gene profiling of the clinical cohort.

Supplementary Materials

The following are available online at https://www.mdpi.com/2072-6694/11/7/911/s1, Table S1: Clinical-pathological characteristics of TNBC patients. Figure S1: Non-supervised clustering based on immune-related genes computed with non-negative matrix factorization (NMF) algorithm. Figure S2: Distribution of estimated tumor purities and proportion of samples infiltrated by specific immune cell population across immune-clusters. Figure S3: Distribution of systemic hematological inflammatory parameters that do not change (p-value > 0.05) among the Im-Clus (A) glucose level (B) L/M ratio (C) Neutrophils (D) Lymphocytes (E) Monocytes (F) N/L ratio, Figure S4: Kaplan Meir 5-year disease-free survival curve according to Im-Clus.

Author Contributions

Conceptualization: E.T., M.S., F.B.; Methodology: F.B., S.R.-C., E.M., B.P., R.A.; Formal Analysis: S.R.-C., E.M.; Resources: E.T., M.S., R.A.; Writing-Original Draft Preparation: F.B., S.R.-C., E.M., E.T.; Writing-Review and Editing: L.S., M.V.I., M.S.; Funding Acquisition: E.T., F.B.

Funding

This work was supported by Associazione Italiana per la Ricerca sul Cancro (20264 to E. Tagliabue), by Fondazione Umberto Veronesi (Fellowship 2018 and 2019 to Francesca Bianchi) and Cátedra Salvador Zubirán, UNAM/INCMNSZ (to Sandra Romero-Cordoba). The funding sources had no role in the study design; the collection, analysis, and interpretation of the data; the writing of the manuscript; or the decision to submit the manuscript for publication.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  • 1.Fallahpour S., Navaneelan T., De P., Borgo A. Breast cancer survival by molecular subtype: A population-based analysis of cancer registry data. CMAJ Open. 2017;5:734–739. doi: 10.9778/cmajo.20170030. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Criscitiello C., Azim H.A., Jr., Schouten P.C., Linn S.C., Sotiriou C. Understanding the biology of triple-negative breast cancer. Ann. Oncol. 2012;23:13–18. doi: 10.1093/annonc/mds188. [DOI] [PubMed] [Google Scholar]
  • 3.Reis-Filho J.S., Lakhani S.R. Breast cancer special types: Why bother? J. Pathol. 2008;216:394–398. doi: 10.1002/path.2419. [DOI] [PubMed] [Google Scholar]
  • 4.Loi S., Drubay D., Adams S., Pruneri G., Francis P.A., Lacroix-Triki M., Joensuu H., Dieci M.V., Badve S., Demaria S., et al. Tumor-Infiltrating Lymphocytes and Prognosis: A Pooled Individual Patient Analysis of Early-Stage Triple-Negative Breast Cancers. J. Clin. Oncol. 2019;37:559–569. doi: 10.1200/JCO.18.01010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Luen S., Virassamy B., Savas P., Salgado R., Loi S. The genomic landscape of breast cancer and its interaction with host immunity. Breast. 2016;29:241–250. doi: 10.1016/j.breast.2016.07.015. [DOI] [PubMed] [Google Scholar]
  • 6.Savas P., Salgado R., Denkert C., Sotiriou C., Darcy P.K., Smyth M.J., Loi S. Clinical relevance of host immunity in breast cancer: From TILs to the clinic. Nat. Rev. Clin. Oncol. 2016;13:228–241. doi: 10.1038/nrclinonc.2015.215. [DOI] [PubMed] [Google Scholar]
  • 7.Denkert C., von Minckwitz G., Darb-Esfahani S., Lederer B., Heppner B.I., Weber K.E., Budczies J., Huober J., Klauschen F., Furlanetto J., et al. Tumour-infiltrating lymphocytes and prognosis in different subtypes of breast cancer: A pooled analysis of 3771 patients treated with neoadjuvant therapy. Lancet Oncol. 2018;19:40–50. doi: 10.1016/S1470-2045(17)30904-X. [DOI] [PubMed] [Google Scholar]
  • 8.Bonsang-Kitzis H., Sadacca B., Hamy-Petit A.S., Moarii M., Pinheiro A., Laurent C., Reyal F. Biological network-driven gene selection identifies a stromal immune module as a key determinant of triple-negative breast carcinoma prognosis. Oncoimmunology. 2016;5:e1061176. doi: 10.1080/2162402X.2015.1061176. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Lehmann B.D., Bauer J.A., Chen X., Sanders M.E., Chakravarthy A.B., Shyr Y., Pietenpol J.A. Identification of human triple-negative breast cancer subtypes and preclinical models for selection of targeted therapies. J. Clin. Investig. 2011;121:2750–2767. doi: 10.1172/JCI45014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Martinez-Canales S., Cifuentes F., Lopez De Rodas Gregorio M., Serrano-Oviedo L., Galan-Moya E.M., Amir E., Pandiella A., Gyorffy B., Ocana A. Transcriptomic immunologic signature associated with favorable clinical outcome in basal-like breast tumors. PLoS ONE. 2017;12:e0175128. doi: 10.1371/journal.pone.0175128. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Miller L.D., Chou J.A., Black M.A., Print C., Chifman J., Alistar A., Putti T., Zhou X., Bedognetti D., Hendrickx W., et al. Immunogenic Subtypes of Breast Cancer Delineated by Gene Classifiers of Immune Responsiveness. Cancer Immunol. Res. 2016;4:600–610. doi: 10.1158/2326-6066.CIR-15-0149. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Safonov A., Jiang T., Bianchini G., Gyorffy B., Karn T., Hatzis C., Pusztai L. Immune Gene Expression Is Associated with Genomic Aberrations in Breast Cancer. Cancer Res. 2017;77:3317–3324. doi: 10.1158/0008-5472.CAN-16-3478. [DOI] [PubMed] [Google Scholar]
  • 13.Ignatiadis M., Van den Eynden G., Roberto S., Fornili M., Bareche Y., Desmedt C., Rothe F., Maetens M., Venet D., Holgado E., et al. Tumor-Infiltrating Lymphocytes in Patients Receiving Trastuzumab/Pertuzumab-Based Chemotherapy: A TRYPHAENA Substudy. J. Natl. Cancer Inst. 2019;111:69–77. doi: 10.1093/jnci/djy076. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Mao Y., Qu Q., Zhang Y., Liu J., Chen X., Shen K. The value of tumor infiltrating lymphocytes (TILs) for predicting response to neoadjuvant chemotherapy in breast cancer: A systematic review and meta-analysis. PLoS ONE. 2014;9:e115103. doi: 10.1371/journal.pone.0115103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Adams S., Gray R.J., Demaria S., Goldstein L., Perez E.A., Shulman L.N., Martino S., Wang M., Jones V.E., Saphner T.J., et al. Prognostic value of tumor-infiltrating lymphocytes in triple-negative breast cancers from two phase III randomized adjuvant breast cancer trials: ECOG 2197 and ECOG 1199. J. Clin. Oncol. 2014;32:2959–2966. doi: 10.1200/JCO.2013.55.0491. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Muraro E., Furlan C., Avanzo M., Martorelli D., Comaro E., Rizzo A., Fae D.A., Berretta M., Militello L., Del Conte A., et al. Local High-Dose Radiotherapy Induces Systemic Immunomodulating Effects of Potential Therapeutic Relevance in Oligometastatic Breast Cancer. Front. Immunol. 2017;8:1476. doi: 10.3389/fimmu.2017.01476. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Newman A.M., Liu C.L., Green M.R., Gentles A.J., Feng W., Xu Y., Hoang C.D., Diehn M., Alizadeh A.A. Robust enumeration of cell subsets from tissue expression profiles. Nat. Methods. 2015;12:453–457. doi: 10.1038/nmeth.3337. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Ayers M., Lunceford J., Nebozhyn M., Murphy E., Loboda A., Kaufman D.R., Albright A., Cheng J.D., Kang S.P., Shankaran V., et al. IFN-gamma-related mRNA profile predicts clinical response to PD-1 blockade. J. Clin. Investig. 2017;127:2930–2940. doi: 10.1172/JCI91190. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Charoentong P., Finotello F., Angelova M., Mayer C., Efremova M., Rieder D., Hackl H., Trajanoski Z. Pan-cancer Immunogenomic Analyses Reveal Genotype-Immunophenotype Relationships and Predictors of Response to Checkpoint Blockade. Cell Rep. 2017;18:248–262. doi: 10.1016/j.celrep.2016.12.019. [DOI] [PubMed] [Google Scholar]
  • 20.Rooney M.S., Shukla S.A., Wu C.J., Getz G., Hacohen N. Molecular and genetic properties of tumors associated with local immune cytolytic activity. Cell. 2015;160:48–61. doi: 10.1016/j.cell.2014.12.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Yoshihara K., Shahmoradgoli M., Martinez E., Vegesna R., Kim H., Torres-Garcia W., Trevino V., Shen H., Laird P.W., Levine D.A., et al. Inferring tumour purity and stromal and immune cell admixture from expression data. Nat. Commun. 2013;4:2612. doi: 10.1038/ncomms3612. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Givechian K.B., Wnuk K., Garner C., Benz S., Garban H., Rabizadeh S., Niazi K., Soon-Shiong P. Identification of an immune gene expression signature associated with favorable clinical features in Treg-enriched patient tumor samples. NPJ Genom. Med. 2018;3:14. doi: 10.1038/s41525-018-0054-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Lyons Y.A., Wu S.Y., Overwijk W.W., Baggerly K.A., Sood A.K. Immune cell profiling in cancer: Molecular approaches to cell-specific identification. NPJ Precis. Oncol. 2017;1:26. doi: 10.1038/s41698-017-0031-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Marotti J.D., de Abreu F.B., Wells W.A., Tsongalis G.J. Triple-Negative Breast Cancer: Next-Generation Sequencing for Target Identification. Am. J. Pathol. 2017;187:2133–2138. doi: 10.1016/j.ajpath.2017.05.018. [DOI] [PubMed] [Google Scholar]
  • 25.Matsumoto H., Koo S.L., Dent R., Tan P.H., Iqbal J. Role of inflammatory infiltrates in triple negative breast cancer. J. Clin. Pathol. 2015;68:506–510. doi: 10.1136/jclinpath-2015-202944. [DOI] [PubMed] [Google Scholar]
  • 26.Bianchini G., Balko J.M., Mayer I.A., Sanders M.E., Gianni L. Triple-negative breast cancer: Challenges and opportunities of a heterogeneous disease. Nat. Rev. Clin. Oncol. 2016;13:674–690. doi: 10.1038/nrclinonc.2016.66. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Stagg J., Allard B. Immunotherapeutic approaches in triple-negative breast cancer: Latest research and clinical prospects. Adv. Med. Oncol. 2013;5:169–181. doi: 10.1177/1758834012475152. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Dupre A., Malik H.Z. Inflammation and cancer: What a surgical oncologist should know. Eur. J. Surg. Oncol. 2018;44:566–570. doi: 10.1016/j.ejso.2018.02.209. [DOI] [PubMed] [Google Scholar]
  • 29.Sylman J.L., Mitrugno A., Atallah M., Tormoen G.W., Shatzel J.J., Tassi Yunga S., Wagner T.H., Leppert J.T., Mallick P., McCarty O.J.T. The Predictive Value of Inflammation-Related Peripheral Blood Measurements in Cancer Staging and Prognosis. Front. Oncol. 2018;8:78. doi: 10.3389/fonc.2018.00078. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Takeuchi H., Kawanaka H., Fukuyama S., Kubo N., Hiroshige S., Yano T. Comparison of the prognostic values of preoperative inflammation-based parameters in patients with breast cancer. PLoS ONE. 2017;12:e0177137. doi: 10.1371/journal.pone.0177137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Noh H., Eomm M., Han A. Usefulness of pretreatment neutrophil to lymphocyte ratio in predicting disease-specific survival in breast cancer patients. J. Breast Cancer. 2013;16:55–59. doi: 10.4048/jbc.2013.16.1.55. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Wariss B.R., de Souza Abrahao K., de Aguiar S.S., Bergmann A., Thuler L.C.S. Effectiveness of four inflammatory markers in predicting prognosis in 2374 women with breast cancer. Maturitas. 2017;101:51–56. doi: 10.1016/j.maturitas.2017.04.015. [DOI] [PubMed] [Google Scholar]
  • 33.Yao M., Liu Y., Jin H., Liu X., Lv K., Wei H., Du C., Wang S., Wei B., Fu P. Prognostic value of preoperative inflammatory markers in Chinese patients with breast cancer. Onco. Targets. 2014;7:1743–1752. doi: 10.2147/OTT.S69657. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Zhu Y., Si W., Sun Q., Qin B., Zhao W., Yang J. Platelet-lymphocyte ratio acts as an indicator of poor prognosis in patients with breast cancer. Oncotarget. 2017;8:1023–1030. doi: 10.18632/oncotarget.13714. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Cuello-Lopez J., Fidalgo-Zapata A., Lopez-Agudelo L., Vasquez-Trespalacios E. Platelet-to-lymphocyte ratio as a predictive factor of complete pathologic response to neoadjuvant chemotherapy in breast cancer. PLoS ONE. 2018;13:e0207224. doi: 10.1371/journal.pone.0207224. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Liu C., Huang Z., Wang Q., Sun B., Ding L., Meng X., Wu S. Usefulness of neutrophil-to-lymphocyte ratio and platelet-to-lymphocyte ratio in hormone-receptor-negative breast cancer. OncoTargets Ther. 2016;9:4653–4660. doi: 10.2147/OTT.S106017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Turner N., Wong H.L., Templeton A., Tripathy S., Whiti Rogers T., Croxford M., Jones I., Sinnathamby M., Desai J., Tie J., et al. Analysis of local chronic inflammatory cell infiltrate combined with systemic inflammation improves prognostication in stage II colon cancer independent of standard clinicopathologic criteria. Int. J. Cancer. 2016;138:671–678. doi: 10.1002/ijc.29805. [DOI] [PubMed] [Google Scholar]
  • 38.Wang J., Wang S., Song X., Zeng W., Wang S., Chen F., Ding H. The prognostic value of systemic and local inflammation in patients with laryngeal squamous cell carcinoma. OncoTargets Ther. 2016;9:7177–7185. doi: 10.2147/OTT.S113307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Spitzer M.H., Carmi Y., Reticker-Flynn N.E., Kwek S.S., Madhireddy D., Martins M.M., Gherardini P.F., Prestwood T.R., Chabon J., Bendall S.C., et al. Systemic Immunity Is Required for Effective Cancer Immunotherapy. Cell. 2017;168:487–502.e15. doi: 10.1016/j.cell.2016.12.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Barbie D.A., Tamayo P., Boehm J.S., Kim S.Y., Moody S.E., Dunn I.F., Schinzel A.C., Sandy P., Meylan E., Scholl C., et al. Systematic RNA interference reveals that oncogenic KRAS-driven cancers require TBK1. Nature. 2009;462:108–112. doi: 10.1038/nature08460. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Yuen G.J., Demissie E., Pillai S. B lymphocytes and cancer: A love-hate relationship. Trends Cancer. 2016;2:747–757. doi: 10.1016/j.trecan.2016.10.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Herrero-Vicent C., Guerrero A., Gavila J., Gozalbo F., Hernandez A., Sandiego S., Algarra M.A., Calatrava A., Guillem-Porta V., Ruiz-Simon A. Predictive and prognostic impact of tumour-infiltrating lymphocytes in triple-negative breast cancer treated with neoadjuvant chemotherapy. Ecancermedicalscience. 2017;11:759. doi: 10.3332/ecancer.2017.759. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Loi S., Sirtaine N., Piette F., Salgado R., Viale G., Van Eenoo F., Rouas G., Francis P., Crown J.P., Hitre E., et al. Prognostic and predictive value of tumor-infiltrating lymphocytes in a phase III randomized adjuvant breast cancer trial in node-positive breast cancer comparing the addition of docetaxel to doxorubicin with doxorubicin-based chemotherapy: BIG 02-98. J. Clin. Oncol. 2013;31:860–867. doi: 10.1200/JCO.2011.41.0902. [DOI] [PubMed] [Google Scholar]
  • 44.Disis M.L., Stanton S.E. Triple-negative breast cancer: Immune modulation as the new treatment paradigm. Am. Soc. Clin. Oncol. Educ. Book. 2015:25–30. doi: 10.14694/EdBook_AM.2015.35.e25. [DOI] [PubMed] [Google Scholar]
  • 45.Li Z., Qiu Y., Lu W., Jiang Y., Wang J. Immunotherapeutic interventions of Triple Negative Breast Cancer. J. Transl. Med. 2018;16:147. doi: 10.1186/s12967-018-1514-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Templeton A.J., Ace O., McNamara M.G., Al-Mubarak M., Vera-Badillo F.E., Hermanns T., Seruga B., Ocana A., Tannock I.F., Amir E. Prognostic role of platelet to lymphocyte ratio in solid tumors: A systematic review and meta-analysis. Cancer Epidemiol. Biomark. Prev. 2014;23:1204–1212. doi: 10.1158/1055-9965.EPI-14-0146. [DOI] [PubMed] [Google Scholar]
  • 47.Zhou X., Du Y., Huang Z., Xu J., Qiu T., Wang J., Wang T., Zhu W., Liu P. Prognostic value of PLR in various cancers: A meta-analysis. PLoS ONE. 2014;9:e101119. doi: 10.1371/journal.pone.0101119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Mantovani A., Allavena P., Sica A., Balkwill F. Cancer-related inflammation. Nature. 2008;454:436–444. doi: 10.1038/nature07205. [DOI] [PubMed] [Google Scholar]
  • 49.Pinto J.A., Araujo J., Cardenas N.K., Morante Z., Doimi F., Vidaurre T., Balko J.M., Gomez H.L. A prognostic signature based on three-genes expression in triple-negative breast tumours with residual disease. NPJ Genom. Med. 2016;1:15015. doi: 10.1038/npjgenmed.2015.15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Pinto J.A., Rolfo C., Raez L.E., Prado A., Araujo J.M., Bravo L., Fajardo W., Morante Z.D., Aguilar A., Neciosup S.P., et al. In silico evaluation of DNA Damage Inducible Transcript 4 gene (DDIT4) as prognostic biomarker in several malignancies. Sci. Rep. 2017;7:1526. doi: 10.1038/s41598-017-01207-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Bohling S.D., Allison K.H. Immunosuppressive regulatory T cells are associated with aggressive breast cancer phenotypes: A potential therapeutic target. Mod. Pathol. 2008;21:1527–1532. doi: 10.1038/modpathol.2008.160. [DOI] [PubMed] [Google Scholar]
  • 52.Harano K., Wang Y., Lim B., Seitz R.S., Morris S.W., Bailey D.B., Hout D.R., Skelton R.L., Ring B.Z., Masuda H., et al. Rates of immune cell infiltration in patients with triple-negative breast cancer by molecular subtype. PLoS ONE. 2018;13:e0204513. doi: 10.1371/journal.pone.0204513. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Liu Z., Li M., Jiang Z., Wang X. A Comprehensive Immunologic Portrait of Triple-Negative Breast Cancer. Transl. Oncol. 2018;11:311–329. doi: 10.1016/j.tranon.2018.01.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Nagarajan D., McArdle S.E.B. Immune Landscape of Breast Cancers. Biomedicines. 2018;6:20. doi: 10.3390/biomedicines6010020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Yu P., Fu Y.X. Tumor-infiltrating T lymphocytes: Friends or foes? Lab. Invest. 2006;86:231–245. doi: 10.1038/labinvest.3700389. [DOI] [PubMed] [Google Scholar]
  • 56.Acerbi I., Cassereau L., Dean I., Shi Q., Au A., Park C., Chen Y.Y., Liphardt J., Hwang E.S., Weaver V.M. Human breast cancer invasion and aggression correlates with ECM stiffening and immune cell infiltration. Integr. Biol. 2015;7:1120–1134. doi: 10.1039/c5ib00040h. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Bezzi M., Seitzer N., Ishikawa T., Reschke M., Chen M., Wang G., Mitchell C., Ng C., Katon J., Lunardi A., et al. Diverse genetic-driven immune landscapes dictate tumor progression through distinct mechanisms. Nat. Med. 2018;24:165–175. doi: 10.1038/nm.4463. [DOI] [PubMed] [Google Scholar]
  • 58.Lu P., Weaver V.M., Werb Z. The extracellular matrix: A dynamic niche in cancer progression. J. Cell Biol. 2012;196:395–406. doi: 10.1083/jcb.201102147. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Loi S., Michiels S., Salgado R., Sirtaine N., Jose V., Fumagalli D., Kellokumpu-Lehtinen P.L., Bono P., Kataja V., Desmedt C., et al. Tumor infiltrating lymphocytes are prognostic in triple negative breast cancer and predictive for trastuzumab benefit in early breast cancer: Results from the FinHER trial. Ann. Oncol. 2014;25:1544–1550. doi: 10.1093/annonc/mdu112. [DOI] [PubMed] [Google Scholar]
  • 60.Dunki Jacobs P.B., Ruevekamp M., Hart G.A., de Graaf P.W. Dietary influences on cell proliferation in bone marrow. Eur. J. Cancer Clin. Oncol. 1989;25:953–957. doi: 10.1016/0277-5379(89)90153-3. [DOI] [PubMed] [Google Scholar]
  • 61.Mariucci S., Rovati B., Manzoni M., Della Porta M.G., Comolli G., Delfanti S., Danova M. Lymphocyte subpopulation and dendritic cell phenotyping during antineoplastic therapy in human solid tumors. Clin. Exp. Med. 2011;11:199–210. doi: 10.1007/s10238-010-0120-7. [DOI] [PubMed] [Google Scholar]
  • 62.Agresti R., Triulzi T., Sasso M., Ghirelli C., Aiello P., Rybinska I., Campiglio M., Sfondrini L., Tagliabue E., Bianchi F. Wound Healing Fluid Reflects the Inflammatory Nature and Aggressiveness of Breast Tumors. Cells. 2019;8:181. doi: 10.3390/cells8020181. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Chen Q., Yang L.X., Li X.D., Yin D., Shi S.M., Chen E.B., Yu L., Zhou Z.J., Zhou S.L., Shi Y.H., et al. The elevated preoperative neutrophil-to-lymphocyte ratio predicts poor prognosis in intrahepatic cholangiocarcinoma patients undergoing hepatectomy. Tumour Biol. 2015;36:5283–5289. doi: 10.1007/s13277-015-3188-6. [DOI] [PubMed] [Google Scholar]
  • 64.Coussens L.M., Werb Z. Inflammation and cancer. Nature. 2002;420:860–867. doi: 10.1038/nature01322. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Rassouli A., Saliba J., Castano R., Hier M., Zeitouni A.G. Systemic inflammatory markers as independent prognosticators of head and neck squamous cell carcinoma. Head Neck. 2015;37:103–110. doi: 10.1002/hed.23567. [DOI] [PubMed] [Google Scholar]
  • 66.Gay L.J., Felding-Habermann B. Contribution of platelets to tumour metastasis. Nat. Rev. Cancer. 2011;11:123–134. doi: 10.1038/nrc3004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Raungkaewmanee S., Tangjitgamol S., Manusirivithaya S., Srijaipracharoen S., Thavaramara T. Platelet to lymphocyte ratio as a prognostic factor for epithelial ovarian cancer. J. Gynecol. Oncol. 2012;23:265–273. doi: 10.3802/jgo.2012.23.4.265. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Roxburgh C.S., McMillan D.C. Cancer and systemic inflammation: Treat the tumour and treat the host. Br. J. Cancer. 2014;110:1409–1412. doi: 10.1038/bjc.2014.90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Sharma D., Brummel-Ziedins K.E., Bouchard B.A., Holmes C.E. Platelets in tumor progression: A host factor that offers multiple potential targets in the treatment of cancer. J. Cell Physiol. 2014;229:1005–1015. doi: 10.1002/jcp.24539. [DOI] [PubMed] [Google Scholar]
  • 70.Alexandrakis M.G., Passam F.H., Moschandrea I.A., Christophoridou A.V., Pappa C.A., Coulocheri S.A., Kyriakou D.S. Levels of serum cytokines and acute phase proteins in patients with essential and cancer-related thrombocytosis. Am. J. Clin. Oncol. 2003;26:135–140. doi: 10.1097/01.COC.0000017093.79897.DE. [DOI] [PubMed] [Google Scholar]
  • 71.Bambace N.M., Holmes C.E. The platelet contribution to cancer progression. J. Thromb. Haemost. 2011;9:237–249. doi: 10.1111/j.1538-7836.2010.04131.x. [DOI] [PubMed] [Google Scholar]
  • 72.Plantamura I., Casalini P., Dugnani E., Sasso M., D’Ippolito E., Tortoreto M., Cacciatore M., Guarnotta C., Ghirelli C., Barajon I., et al. PDGFRbeta and FGFR2 mediate endothelial cell differentiation capability of triple negative breast carcinoma cells. Mol. Oncol. 2014;8:968–981. doi: 10.1016/j.molonc.2014.03.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Forte L., Turdo F., Ghirelli C., Aiello P., Casalini P., Iorio M.V., D’Ippolito E., Gasparini P., Agresti R., Belmonte B., et al. The PDGFRbeta/ERK1/2 pathway regulates CDCP1 expression in triple-negative breast cancer. BMC Cancer. 2018;18:586. doi: 10.1186/s12885-018-4500-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Turdo F., Bianchi F., Gasparini P., Sandri M., Sasso M., De Cecco L., Forte L., Casalini P., Aiello P., Sfondrini L., et al. CDCP1 is a novel marker of the most aggressive human triple-negative breast cancers. Oncotarget. 2016;7:69649–69665. doi: 10.18632/oncotarget.11935. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Okuturlar Y., Gunaldi M., Tiken E.E., Oztosun B., Inan Y.O., Ercan T., Tuna S., Kaya A.O., Harmankaya O., Kumbasar A. Utility of peripheral blood parameters in predicting breast cancer risk. Asian Pac. J. Cancer Prev. 2015;16:2409–2412. doi: 10.7314/APJCP.2015.16.6.2409. [DOI] [PubMed] [Google Scholar]
  • 76.Seretis C., Seretis F., Lagoudianakis E., Politou M., Gemenetzis G., Salemis N.S. Enhancing the accuracy of platelet to lymphocyte ratio after adjustment for large platelet count: A pilot study in breast cancer patients. Int. J. Surg. Oncol. 2012;2012:653608. doi: 10.1155/2012/653608. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Ulas A., Avci N., Kos T., Cubukcu E., Olmez O.F., Bulut N., Degirmenci M. Are neutrophil/lymphocyte ratio and platelet/lymphocyte ratio associated with prognosis in patients with HER2-positive early breast cancer receiving adjuvant trastuzumab? J. Buon. 2015;20:714–722. [PubMed] [Google Scholar]
  • 78.Vernieri C., Mennitto A., Prisciandaro M., Huber V., Milano M., Rinaldi L., Cona M.S., Maggi C., Ferrari B., Manoukian S., et al. The neutrophil-to-lymphocyte and platelet-to-lymphocyte ratios predict efficacy of platinum-based chemotherapy in patients with metastatic triple negative breast cancer. Sci. Rep. 2018;8:8703. doi: 10.1038/s41598-018-27075-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Bonaventura P., Shekarian T., Alcazer V., Valladeau-Guilemond J., Valsesia-Wittmann S., Amigorena S., Caux C., Depil S. Cold Tumors: A Therapeutic Challenge for Immunotherapy. Front. Immunol. 2019;10:168. doi: 10.3389/fimmu.2019.00168. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Galon J., Bruni D. Approaches to treat immune hot, altered and cold tumours with combination immunotherapies. Nat. Rev. Drug Discov. 2019;18:197–218. doi: 10.1038/s41573-018-0007-y. [DOI] [PubMed] [Google Scholar]
  • 81.Li J., Byrne K.T., Yan F., Yamazoe T., Chen Z., Baslan T., Richman L.P., Lin J.H., Sun Y.H., Rech A.J., et al. Tumor Cell-Intrinsic Factors Underlie Heterogeneity of Immune Cell Infiltration and Response to Immunotherapy. Immunity. 2018;49:178–193. doi: 10.1016/j.immuni.2018.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Maleki Vareki S. High and low mutational burden tumors versus immunologically hot and cold tumors and response to immune checkpoint inhibitors. J. Immunother. Cancer. 2018;6:157. doi: 10.1186/s40425-018-0479-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Mlecnik B., Bindea G., Angell H.K., Sasso M.S., Obenauf A.C., Fredriksen T., Lafontaine L., Bilocq A.M., Kirilovsky A., Tosolini M., et al. Functional network pipeline reveals genetic determinants associated with in situ lymphocyte proliferation and survival of cancer patients. Sci. Transl. Med. 2014;6:228ra237. doi: 10.1126/scitranslmed.3007240. [DOI] [PubMed] [Google Scholar]
  • 84.He Y., Jiang Z., Chen C., Wang X. Classification of triple-negative breast cancers based on Immunogenomic profiling. J. Exp. Clin. Cancer Res. 2018;37:327. doi: 10.1186/s13046-018-1002-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Salgado R., Denkert C., Demaria S., Sirtaine N., Klauschen F., Pruneri G., Wienert S., Van den Eynden G., Baehner F.L., Penault-Llorca F., et al. The evaluation of tumor-infiltrating lymphocytes (TILs) in breast cancer: Recommendations by an International TILs Working Group 2014. Ann. Oncol. 2015;26:259–271. doi: 10.1093/annonc/mdu450. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Gaujoux R., Seoighe C. A flexible R package for nonnegative matrix factorization. BMC. Bioinform. 2010;11:367. doi: 10.1186/1471-2105-11-367. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Hanzelmann S., Castelo R., Guinney J. GSVA: Gene set variation analysis for microarray and RNA-seq data. BMC Bioinform. 2013;14:7. doi: 10.1186/1471-2105-14-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Wickham H. ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag; New York, NY, USA: 2016. [Google Scholar]
  • 89.Riaz N., Havel J.J., Makarov V., Desrichard A., Urba W.J., Sims J.S., Hodi F.S., Martin-Algarra S., Mandal R., Sharfman W.H., et al. Tumor and Microenvironment Evolution during Immunotherapy with Nivolumab. Cell. 2017;171:934–949. doi: 10.1016/j.cell.2017.09.028. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials


Articles from Cancers are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES