Skip to main content
Diagnostics logoLink to Diagnostics
. 2017 Apr 21;7(2):23. doi: 10.3390/diagnostics7020023

Nuclear Molecular Imaging Strategies in Immune Checkpoint Inhibitor Therapy

Kasper F Guldbrandsen 1, Helle W Hendel 2, Seppo W Langer 3, Barbara M Fischer 4,*
Editor: Kalevi Kairemo
PMCID: PMC5489943  PMID: 28430133

Abstract

Immune checkpoint inhibitor therapy (ICT) is a new treatment strategy developed for the treatment of cancer. ICT inhibits pathways known to downregulate the innate immune response to cancer cells. These drugs have been shown to be effective in the treatment of a variety of cancers, including metastatic melanoma and lung cancer. Challenges in response evaluation of patients in ICT have risen as immune related side effects and immune cell infiltration may be confused with progressive disease. Furthermore, the timing of the evaluation scan may be challenged by relatively slow responses. To overcome this, new response criteria for evaluating these patients with morphologic imaging have been proposed. The aim of this paper is to review and discuss the current evidence for the use of molecular imaging, e.g., PET/CT (Positron Emission Tomography/Computer Tomography) with 18F-Fluorodeoxyglucoes (FDG) as an alternative imaging method for monitoring patients undergoing ICT. Following the currently available evidence, this review will primarily focus on patients with malignant melanoma.

Keywords: immune checkpoint inhibitor therapy, PET/CT, radiotracer, response evaluation/treatment monitoring

1. Introduction

Evasion of attack by the immune system is one of the hallmarks of cancer [1]. Based on the amount of mutations being accumulated by cancer cells, immune cells should register cancer cells as being foreign. One reason why this fails is because of the development of tolerance.

Several mechanisms guide the development of tolerance, including immune checkpoint pathways, which downregulates immune function to prevent immune cells from being self-reactive. Blocking these immune checkpoints stimulates an autoimmune response, but also help immune cells recognizing foreign cells such as cancer.

Drugs that inhibit immune checkpoints have shown clinical efficacy in several different types of cancer, e.g., melanoma, non-small cell lung cancer (NSCLC), renal and urothelial cancer, Hodgkin’s lymphoma and head- and neck cancer [2,3,4,5,6,7]. Encouraging results have been demonstrated especially in advanced melanoma for which the previous therapeutic options have been limited, as well as in metastatic NSCLC, currently replacing traditional platin-based chemotherapy as first-line therapy in selected patients [8,9].

The effect of immune checkpoint inhibitor therapy (ICT) on cancer cells is mediated thru activation of an immune response against the cancer cells. This indirect, immune-mediated effect has given rise to new challenges concerning response evaluation as response patterns to ICT differ from those observed with conventional anti-cancer therapy. The aim of this article is to provide an overview of the challenges and possibilities for molecular imaging, such as positron emission tomography (PET) and single-photon emission computed tomography (SPECT), in the evaluation of patients treated with ICT. In order to put the use of different imaging modalities into the right perspective, this review starts with a brief introduction to ICT and examples of current use in patients with malignant melanoma and NSCLC.

2. Immune Checkpoint Therapy

The current ICT is based on regulation of two important immune checkpoint pathways: one involving programmed cell death protein (PD-1/PD-L1) and one involving the cytotoxic T-lymphocyte-associated protein 4 (CTLA-4).

Programmed cell death protein 1 (PD-1), is a cell surface receptor that is expressed on T cells, B cells, natural killer T cells, activated monocytes, and dendritic cells [10]. T-cells require two signals to become activated. First, a signal triggered by the interaction between antigen-major histocompatibility complex (MHC) and the T cell receptor, and second a co-stimulatory signal provided by antigen-presenting cells (APCs). T-cell activation causes T cell clonal expansion, cytokine secretion and the effector function of the T cell. Binding of PD-1 to its ligand PD-L1 inhibits the co-stimulatory signal, causing a decrease in the production of cytokines and cell survival proteins, ultimately downregulating the activity of self-reactive T-cells. PD-L1 is expressed by normal immune cells as well as by many different tumor types, allowing the tumor cells to evade the immune system.

The anti-PD-1 antibodies pembrolizumab and nivolumab have shown promising results in patients with metastatic melanoma not harboring the mutation in the B-Raf proto-oncogene (BRAF-mutation) with improved survival rates when compared to the anti CTLA-4 antibody ipilimumab and chemotherapy [11,12,13]. Response has been proved durable with two-year survival rates of 43% [14]. Pembrolizumab has also been shown to be an effective treatment option in advanced NSCLC, with an overall survival of 17.3 months, compared to 8.2 months with docetaxel [3].

Another important immune checkpoint involves CTLA-4. Structurally related to the CD28 receptor, it is primarily expressed on the surface of T cells. CD28 mediates the co-stimulatory signal from APCs required for activation of T cell effector function, interacting with B7-1 and B7-2 on APCs. This effect is caused by CTLA-4 ligating with B7-1 and B7-2, resulting in a downregulatory signal.

One CTLA-4 antibody, ipilimumab, has been shown in multiple phase II/III trials to be an effective therapeutic option in the treatment of metastatic melanoma. In previously untreated patients with metastatic melanoma, the combination of ipilimumab and chemotherapy was more effective than that of chemotherapy alone, with more than double the number of long-term survivors in the ipilimumab group [8,15].

A disadvantage of therapies targeting immune checkpoint pathways is the increased rate of immune-related adverse events (irAEs), resulting from the lowered inhibition of T cell activity, thereby causing self-reactivity. Because the development irAEs are caused by increased T cell reactivity, these reactions could potentially be correlated with increased anti-tumor activity, although this effect is likely offset by discontinuation of therapy when irAEs arise.

Most reported irAEs are diarrhea, pruritus, rash, colitis vitiligo and endocrine irAEs such as thyroiditis and hypophysitis. More rarely seen are rheumatic and granulomatous irAEs such as arthritis and sarcoid-like disease. In studies with the CTLA-4 inhibitor, ipilimumab, the frequency of grade 3 or 4 irAEs is reported in the range of 10% to 43%: with studies using a dose of 10 mg/kg of ipilimumab having a higher incidence of irAEs than studies with a dose of 3 mg/kg [2,15,16]. Compared to ipilimumab, the PD-1 inhibitor, pembrolizumab, has been shown to have fewer treatment related adverse events[11], and severe adverse events has been shown to be less common with pembrolizumab than with docetaxel [3].

3. Patterns of Response

With conventional treatment modalities in cancer therapy such as chemotherapy, tumor cells are being affected directly by the drug, inhibiting mitosis and blocking extracellular growth signals, causing cell death, tumor necrosis and inhibition of tumor growth.

In contrast to this, therapies targeting immune checkpoint pathways affect cancer cells indirectly through mobilizing an immune response against the cancer cells, causing infiltration of inflammatory cells into the tumor environment, followed by inflammation and cytotoxicity. In practice, this causes response patterns during ICT that differ from those seen during chemotherapy, e.g., delayed response to treatment, or response preceded by transient worsening (so-called pseudoprogression) [17,18,19,20].

CTLA-4 blockade has been shown to frequently induce intratumoral infiltration by immune cells, in both clinical responders and non-responders, potentially causing pseudoprogression as can be seen in early and sometimes also late scans in patients undergoing ICT [21,22]. The apparent worsening can be seen as increased size of known lesions or the appearance of new ones. Trials with ipilimumab in melanoma patients have found that onset of partial response (PR) or complete response (CR) occurs after >12 weeks of treatment in up to 68% of patients with objective response (OR) [23]. Four distinct patterns of response have been described in these patients: (1) shrinkage in baseline lesions; (2) durable stable disease (sometimes followed by slow steady decline in tumor burden); (3) response after initial disease progression/transient worsening (pseudo-progression) and (4) simultaneous response in baseline lesions and presence of new lesions [24]. These patterns of response challenge the current Response Evaluation Criteria in Solid Tumors (RECIST) as the standard response criteria in trials having tumor response as endpoint [25]. In RECIST, tumor response is defined by changes in overall tumor burden from baseline measurements and the appearance of new lesions. According to RECIST, both response after initial disease progression and response in the presence of new lesions would be classified as progressive disease (PD).

Immune-Related Response Criteria (irRC)

Experience from the evaluation of cancer vaccines, where the effect on tumor cells is mediated through immune activation similar to immune checkpoint inhibitors, led to the first proposal of immune-related response criteria (irRC) in 2009. It was based on the WHO-criteria (bi-dimensional measurement of target lesion) for response evaluation [24]. In 2013, a revised irRC were published using uni-dimensional measurements [26]. The main difference between irRC and WHO as well as RECIST is the incorporation of new measurable lesions into total tumor burden instead of always representing progressive disease (PD) and that PD is defined as more than a 25% increase in total tumor burden compared with nadir, in two consecutive observations at least four weeks apart.

With these new response criteria, it has been demonstrated that among patients who received ipilimumab and were initially classified as having PD at week 12, 22 out of 227 patients had a response to therapy according to irRC [24]. Similarly, in a trial of melanoma patients receiving pembrolizumab therapy, 14% (84/592) of patients, who were initially classified as having PD according to RECIST v1.1, had non-progressive (non-PD) disease per irRC and the two-year survival rate was higher for patients having PD per RECIST v1.1 criteria and non-PD per irRC (37.5%) than for patients having PD per both criteria (17.3%) [20]. These results suggest that adapting therapy response criteria to the new response patterns seen with ICT in melanoma patients may improve the accuracy of response evaluation. Though these adapted criteria avoid discontinuing treatment in patients with delayed response or pseudoprogression, this also increases the amount of patients receiving ineffective treatment.

In March 2017, the RECIST working group suggested new guidelines for the collection of data in trials testing immunotherapeutics iRECIST [27]. Based on RECIST 1.1, it introduces a new response designation iUPD (unconfirmed progressive disease, the “i” designating the immunotherapeutic setting). If iUPD is confirmed on subsequent scans by a further increase in size of the lesion, response is designated iCPD (confirmed progressive disease). If not confirmed, response is designated as iCR, iPR or iSD and status is reset, so any increase in size of lesions in subsequent assessments is again designated iUPD. The revised guidelines also suggest that continuation of treatment in patients with iUPD should only be done if a patient is clinically stable and that the next assessment should be done within eight weeks so that patients remain candidates for alternative therapeutic strategies.

4. FDG PET/CT

As an alternative to anatomical imaging, molecular imaging modalities such as Positron Emission Tomography/Computer Tomography with 18F-Fluorodeoxyglucose (FDG PET/CT) has been suggested as a tool for faster and more accurate response evaluation during ICT. Malignant melanoma is a highly FDG-avid cancer and FDG PET/CT has been shown to be superior to CT in the detection of distant metastases and in recurrence [28,29,30,31]. FDG PET/CT has been successfully used in early response evaluation of conventional chemotherapy in different non-melanoma cancers. Thus, FDG PET/CT could be a promising alternative to CT for monitoring treatment response in patients undergoing ICT. The evidence, which we will review in the following, is however still scarce. An overview of the results is presented in Table 1.

Table 1.

FDG PET/CT 1 for response monitoring in immunotherapies.

Study No. of Patients Method of Response Assesment Results
Sachpekidis et al. [32] 22 FDG PET/CT at baseline, after two cycles of ipilimumab and post-treatment. EORTC 2 criteria used for response classification Early scan predictive of post-treatment response in 18 of 22 patients
Kong et al. [33] 27 FDG PET/CT after at least 12 months of treatment with pembrolizumab or nivolumab categorized as positive or negative for presence of metabolically active disease compared to response on CT at the time of the PET/CT scan 43% of patients with residual disease on CT had negative PET scans
Breki et al. [34] 31 FDG PET/CT at baseline, after two cycles of ipilimumab and post-treatment. Fractal and multifractal analysis compared to visual image assesment by nuclear medicine physicians. Seven patients excluded in comparison because of hypermetabolic lesions not related to melanoma (such as irAEs 3) Fractal analysis results match treatment outcome in 20 out of 24 cases
Zheng et al. (Abstract) [35] 28 Retrospective study. FDG PET/CT at baseline and after 2–4 cycles of ipilimumab treatment. Response assessed according to PERCIST 4 Two-year survival rate 31% with PMD 5 and 73% with non-PMD
Fredrickson et al. (Abstract) [36] 103 Retrospective study. FDG PET/CT at baseline and after six weeks of atezolizumab treatment evaluated according to EORTC Metabolic responders had higher overall response rate than non-responders (73.9% vs. 6.3%)

1 Positron Emission Tomography/Computer Tomography with 18F-Fluorodeoxyglucose; 2 European Organisation for Research and Treatment of Cancer; 3 Immune-related adverse events; 4 PET Response Criteria In Solid Tumors; 5 Progressive Metabolic Disease.

Sachpekidis and colleagues found that FDG PET scans evaluated using European Organization for Research and Treatment of Cancer (EORTC) criteria after two cycles of ipilimumab in patients with metastatic melanoma was predictive of final treatment response in 18 of the 22 patients enrolled. Two patients were initially classified as having stable metabolic disease (SMD), while the late scan (after four cycles) showed progressive metabolic disease (PMD), and two patients, who ended up having partial metabolic response (PMR) on the late scan, were originally wrongly classified as having PMD on the early scan [32]. Similarly, a study from Australia in 27 melanoma patients undergoing prolonged treatment with a PD-1 inhibitor found that, amongst those with residual disease on CT, 43% had negative FDG PET scans and that none of the patients with negative FDG PET scans progressed within the 6–10 months follow-up period [33].

In pre- and post-treatment, FDG PET-CT scans of melanoma patients undergoing treatment with ipilimumab, fractal and multifractal analyses showed potential as a non-operator dependent biomarker for treatment response monitoring [34]. The algorithms used did not, however, account for physiological uptake of the tracer in organs such as in the brain nor non-malignant local increases in tracer uptake associated with irAEs.

In an abstract pertaining to a retrospective study of 28 melanoma patients treated with ipilimumab who had follow-up FDG PET/CT after 2–4 cycles of treatment, PMD was highly correlated with clinical progressive disease with a positive predictive value (PPV) of 93% [35]. Two-year survival rates were 31% for patients with PMD and 73% for patients with non-PMD. These preliminary survival data on responders and non-responders are similar to those seen when evaluating treatment response using CT with irRC or RECIST [20]. In another abstract, results from a phase II study of atezolizumab (a PD-L1 inhibitor) in 138 stage IIIB/IV NSCLC patients are presented [36]. These patients underwent FDG PET/CT at baseline and at week 6 of treatment. This study found that patients with metabolic response on PET/CT at week 6 had higher ORR (overall response rate) than metabolic non-responders (73.9% vs. 6.3%).

It appears that, although response evaluation using FDG PET/CT misclassifies some after two cycles, evaluation of treatment response after four cycles using FDG PET/CT has similar accuracy in treatment response evaluation as using irRC based on CT. Thus, the potential ability of FDG-PET to diagnose response early, combined with the ability to discriminate between active and inactive residual disease on CT and an increased efficacy in the detection of metastasis could prove FDG PET/CT superior in the long term for monitoring of patients undergoing ICT. There are currently ongoing trials investigating FDG PET/CT response monitoring in metastatic melanoma patients treated with pembrolizumab and nivolumab [37,38].

Pseudoprogression

Pseudoprogression is seen on both CT and FDG-PET as a prematurely diagnoses of progressive disease (Figure 1). The apparent progression is both caused by the invasion of immune cells into the tumors causing the tumors to increase in size and to accumulate FDG and the continued tumor growth during therapy, until a sufficient immune response is developed [24]. Using irRC, two types of pseudoprogression has been described: (1) early pseudoprogression with more than 25% increase in tumor burden at 12 weeks and not confirmed as PD at the next assessment; and (2) late pseudoprogression with more than 25% increase in tumor burden after 12 weeks that was not confirmed as PD at the next assessment. Early pseudoprogression is probably most common. In the new iRECIST, both scenarios are classified as iUPD, and a patient can have several instances of iUPD, but not iCPD, before response (iCR, iPR or iSD) [27]. It is important to stress that pseudoprogression is a relatively rare phenomenon seen only in 3%–10% of the patients and that it is a retrospective diagnosis [20,24].

Figure 1.

Figure 1

Example of early pseudoprogression in a patient with malignant melanoma: (a) initial Positron Emission Tomography/Computer Tomography with 18F-Fluorodeoxyglucose; (b) first evaluation after four series of ipilimumab shows multiple new foci in the liver and the bones with highly increased LDH (lactate dehydrogenase); and (c) subsequent scans after completion of treatment showing complete disappearance of both new foci and the primary lesions.

Using metabolic response evaluation with FDG PET, no formal criteria exists for ICT. Increased tumor burden, it being in FDG-uptake (SUV) or a number of FDG-avid lesions, is usually classified as progression according to the PERCIST and EORTC criteria, both developed for evaluation during chemotherapy [39]. However, care must be taken when new lesions appear in an otherwise responding patient as this could also be due to irAE (Figure 2), e.g., when seen in the adrenals, bowel or pituitary [40].

Figure 2.

Figure 2

An example of new lesions appearing in an otherwise responding patient due to sarcoid-like irAE (immunerelated adverse event): (a) before treatment; (b) after three series of pembrolizumab; (c) after six series of pembrolizumab.

5. New Imaging Biomarkers

To recapitulate, the use of standard imaging methods, anatomical as well as functional, for prediction and early response evaluation during ICT, is hampered by pseudoprogression and late response. Thus, in the scenario of ICT, there is an urgent need for more specific imaging biomarkers, enabling non-invasive, whole-body imaging and potentially improving response evaluation and prediction.

5.1. Imaging PD-L1 (Programmed Cell Death Ligand 1)

PD-L1 expression varies greatly between different tumor types, and PD-L1 expression by tumor cells is significantly correlated with objective response and clinical benefit. In metastatic melanoma patients, it was found that patients with PD-L1 positive tumors had a median progression-free survival of 14.0 months and those with PD-L1 negative tumors had a median progression-free survival of 5.3 months, when treated with nivolumab [41]. A study involving melanoma patients treated with pembrolizumab found that PD-L1 expression was significantly associated with both progression free survival and response rate [42]. That PD-L1 could be a general prognostic marker was recently dismissed by a study in tumor samples from 982 patients collected from three trials of adjuvant therapy in early stage NSCLC, finding that PD-L1 expression was not predictive for survival benefit for adjuvant chemotherapy [43].

A number of radiotracers for non-invasive detection of PD-L1 expression have been tested in preclinical models. Maute and colleagues have developed a high affinity non-antibody based PD-1 ectodomain radiolabeled with 64Cu, showing affinity for both mouse and human PD-L1 [44]. Being a competitive antagonist of PD-L1, it was used to distinguish between PD-L1 positive and negative tumors in a syngeneic CT26 tumor model. This non-antibody based PD-L1 imaging tracer has increased renal loss compared to antibody based imaging tracer, but does not have the same problems penetrating large tumors as antibodies have [45]. Using a PD-L1 PET imaging agent, it was shown that the lungs of murine models had a particularly strong increase in the expression of PD-L1 when exposed to pro-inflammatory cytokine, giving insights into the development of pneumonitis in anti-PD-L1 therapy [46]. Another PD-L1 PET imaging agent allowed tumor PD-L1 expression to be measured just one hour after injection, making PD-L1 imaging more practical in a clinical setting [47].

SPECT imaging agents have also been developed for imaging PD-L1 biodistribution in vivo [48]. One such agent, a human and mouse cross-reactive antibody radiolabeled with 111In, showed a binding of tracer to tumor cells correlating with PD-L1 expression [49]. The study also found that predosing with unlabeled antibody increased tumor uptake, supporting the theory of tissues with natural PD-L1 expression, such as splenocytes, functions as an antigen sink. A similar antibody based SPECT imaging tracer was developed and tested in a murine model of breast cancer, confirming that predosing with unlabeled antibody reduces uptake of the imaging agent in the spleen, increasing concentration of the tracer in the blood stream [50].

5.2. 18F-Fluorothymidine PET

Another PET tracer that might be of interest in evaluating tumor response to ICT is 3′-deoxy-3′-18F-fluorothymidine (FLT). It provides a measure of cellular thymidine kinase 1 activity, which is correlated with cell proliferation [51]. However, in a study with 12 melanoma patients receiving tremelimumab, no significant changes in SUVmax were found between pre- and posttreatment FLT PET-scans [52]. An increase in SUVmax in the spleen was demonstrated, which is consistent with the expected lymphoproliferative effects of the CTLA-4 inhibitor.

5.3. T-Cell Tracking

An alternative method for imaging response to ICT is tracking the T-cell response. Anti-CD8 immuno-PET imaging agents would be able to provide information about localization and proliferation of CD8+ cell activity. T-cell activation and redistribution to tumor sites happens before any effect of treatment is seen on conventional anatomical imaging. Thus, tracking the T-cell response might provide information about the efficacy of treatment earlier than other image modalities. In one study, antibody fragments radiolabeled with 64Cu targeting murine CD8+ T-cells, showed specific uptake in the spleen and lymph nodes of antigen-positive mice [53]. A difficulty in using this radiotracer is the abundance of naturally expressed CD8 antigen in some organs, causing the radiotracer to rapidly leave the bloodstream and accumulate in these organs, thereby not reaching other areas of interest such as a tumor [53].

Another radiotracer with specificity for CD8+ T-cells, 89Zr-desferrioxamine–labeled anti-CD8 cys-diabody, demonstrated the ability to detect changes in tumor infiltrating CD8+ T-cell expression in immunocompetent murine syngeneic tumor immunotherapy models receiving anti-PD-L1 antibodies [54]. In this study, responders to treatment showed higher tumor uptake than non-responders, with more intratumoral uptake in responders and a peripheral rim of activity in non-responders. However, for these imaging probes to be validated for potential human use, humanization of the CD8 antibodies is required. Furthermore, where significantly more CD8+ cells have been found in responders to most ICTs, no such correlation has been found in patients receiving nivolumab, but more studies are required to confirm these results [55,56].

An ongoing trial is investigating the PET tracer 18F-FB-IL2 (18F-(fluorobenzoyl)interleukin-2), a tracer with high affinity for the receptor interleukin-2, that is expressed on the surface of T-cells. Using this PET-tracer, the T-cell response to treatment with ipilimumab, nivolumab or pembrolizumab will be examined in human subjects [57].

6. Discussion

ICTs have proven effective in treating a number of difficult to treat types of cancer by blocking PD-L1/PD-1 and CTLA-4 checkpoint pathways. Owing to the unconventional method in which these drugs exert their anticancer effect new response patterns are seen, causing evaluation based on CT imaging assessed by standard response criteria such as RECIST to wrongly classify some patients as having treatment failure.

New response criteria for ICT have been proposed, requiring confirmation at a later scan, if the patient is found to have progressed. These novel criteria are to the benefit of the patients who have a delayed response, avoiding discontinuation of effective treatment, but also resulting in treatment being continued in patients for whom treatment has already failed. This can potentially cause a delay in administration of alternative treatment, unnecessary adverse events and costs.

Several studies have demonstrated that patients who were previously classified as having PD per RECIST criteria but non-PD per irRC have higher two-year survival than patients who have PD per both criteria, giving credence to these new response assessment strategies. How this should translate to clinical practice is not yet clear. Guidelines suggest caution has to be taken in discontinuing treatment early until later scans confirm progressive disease [27].

As an alternative to anatomical based criteria, PET could provide functional and perhaps earlier information about the disease and response to treatment. One of the most used PET imaging radiotracers, 18F-FDG, seems to provide fairly accurate early response prediction in patients receiving ICT, although similar problems exist as to those with CT, where late responders are classified as having progressive disease. Comparative studies in larger patient samples are, however, urgently needed, before any conclusions can be drawn as to how FDG PET compares to CT in treatment response evaluation in these patients.

Other methods of molecular imaging are currently under development, potentially enabling more specific information about the immune response to the treatment and aid in patient selection, e.g., CD8 and PD-L1 imaging agents. Tracking CD8+ cells has shown that a difference in the immune response can be measured between responders and non-responders with PET imaging. This has also provided further insight to how T cells infiltrate tumors in responders and non-responders. If humanization of such radiotracers can be achieved, it can potentially improve our understanding of the response patterns observed with structural imaging and FDG-PET. With PD-L1 expression being upregulated in the tumor environment and its expression shown to be higher in responders than non-responders, imaging the expression of this receptor could help with selecting patients for treatment.

Several radiotracers have been developed for imaging PD-L1 expression, and some of them are also reactive to human PD-L1, thereby opening the possibility for testing these agents in human subjects, as is currently done in on-going clinical trials [58,59].

For both of these types of agents, the specificity for the target receptor has been classified in vitro and the diagnostic accuracy has been determined in murine models. Further research is, however, needed before the efficacy of these imaging agents can be determined [60].

7. Conclusions

The use of molecular imaging for response prediction and evaluation during ICT is in its early phase. 18F-FDG PET/CT could potentially be useful for early response evaluation; however, the current amount of data is scarce, and clinical trials comparing CT and PET/CT are urgently needed. Using 18F-FDG PET/CT for response monitoring does not, however, seem to avoid the pitfall of pseudoprogression.

Novel imaging biomarkers that more specifically address immune activation are under development. These new tracers can potentially enable not only response evaluation, but also a prediction of response to ICT.

Conflicts of Interest

The authors declare no conflict of interest.

References

  • 1.Hanahan D., Weinberg R.A. Hallmarks of cancer: The next generation. Cell. 2011;144:646–674. doi: 10.1016/j.cell.2011.02.013. [DOI] [PubMed] [Google Scholar]
  • 2.Hodi F.S., O’Day S.J., McDermott D.F., Weber R.W., Sosman J.A., Haanen J.B., Gonzalez R., Robert C., Schadendorf D., Hassel J.C., et al. Improved survival with ipilimumab in patients with metastatic melanoma. N. Engl. J. Med. 2010;363:711–723. doi: 10.1056/NEJMoa1003466. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Herbst R.S., Baas P., Kim D.W., Felip E., Perez-Gracia J.L., Han J.Y., Molina J., Kim J.H., Arvis C.D., Ahn M.J., et al. Pembrolizumab versus docetaxel for previously treated, PD-L1-positive, advanced non-small-cell lung cancer (keynote-010): A randomised controlled trial. Lancet. 2016;387:1540–1550. doi: 10.1016/S0140-6736(15)01281-7. [DOI] [PubMed] [Google Scholar]
  • 4.Motzer R.J., Escudier B., McDermott D.F., George S., Hammers H.J., Srinivas S., Tykodi S.S., Sosman J.A., Procopio G., Plimack E.R., et al. Nivolumab versus everolimus in advanced renal-cell carcinoma. N. Engl. J. Med. 2015;373:1803–1813. doi: 10.1056/NEJMoa1510665. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Balar A.V., Galsky M.D., Rosenberg J.E., Powles T., Petrylak D.P., Bellmunt J., Loriot Y., Necchi A., Hoffman-Censits J., Perez-Gracia J.L., et al. Atezolizumab as first-line treatment in cisplatin-ineligible patients with locally advanced and metastatic urothelial carcinoma: A single-arm, multicentre, phase 2 trial. Lancet. 2017;389:67–76. doi: 10.1016/S0140-6736(16)32455-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Armand P., Shipp M.A., Ribrag V., Michot J.-M., Zinzani P.L., Kuruvilla J., Snyder E.S., Ricart A.D., Balakumaran A., Rose S., et al. Programmed death-1 blockade with pembrolizumab in patients with classical hodgkin lymphoma after brentuximab vedotin failure. J. Clin. Oncol. 2016;34:3733–3739. doi: 10.1200/JCO.2016.67.3467. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Ferris R.L., Blumenschein G., Jr., Fayette J., Guigay J., Colevas A.D., Licitra L., Harrington K., Kasper S., Vokes E.E., Even C., et al. Nivolumab for recurrent squamous-cell carcinoma of the head and neck. N. Engl. J. Med. 2016;375:1856–1867. doi: 10.1056/NEJMoa1602252. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Maio M., Grob J.J., Aamdal S., Bondarenko I., Robert C., Thomas L., Garbe C., Chiarion-Sileni V., Testori A., Chen T.T., et al. Five-year survival rates for treatment-naive patients with advanced melanoma who received ipilimumab plus dacarbazine in a phase III trial. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2015;33:1191–1196. doi: 10.1200/JCO.2014.56.6018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Reck M., Rodriguez-Abreu D., Robinson A.G., Hui R., Csoszi T., Fulop A., Gottfried M., Peled N., Tafreshi A., Cuffe S., et al. Pembrolizumab versus chemotherapy for PD-L1-positive non-small-cell lung cancer. N. Engl. J. Med. 2016;375:1823–1833. doi: 10.1056/NEJMoa1606774. [DOI] [PubMed] [Google Scholar]
  • 10.Keir M.E., Butte M.J., Freeman G.J., Sharpe A.H. PD-1 and its ligands in tolerance and immunity. Ann. Rev. Immunol. 2008;26:677–704. doi: 10.1146/annurev.immunol.26.021607.090331. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Robert C., Schachter J., Long G.V., Arance A., Grob J.J., Mortier L., Daud A., Carlino M.S., McNeil C., Lotem M., et al. Pembrolizumab versus ipilimumab in advanced melanoma. N. Engl. J. Med. 2015;372:2521–2532. doi: 10.1056/NEJMoa1503093. [DOI] [PubMed] [Google Scholar]
  • 12.Ribas A., Puzanov I., Dummer R., Schadendorf D., Hamid O., Robert C., Hodi F.S., Schachter J., Pavlick A.C., Lewis K.D., et al. Pembrolizumab versus investigator-choice chemotherapy for ipilimumab-refractory melanoma (keynote-002): A randomised, controlled, phase 2 trial. Lancet Oncol. 2015;16:908–918. doi: 10.1016/S1470-2045(15)00083-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Robert C., Long G.V., Brady B., Dutriaux C., Maio M., Mortier L., Hassel J.C., Rutkowski P., McNeil C., Kalinka-Warzocha E., et al. Nivolumab in previously untreated melanoma without BRAF mutation. N. Engl. J. Med. 2015;372:320–330. doi: 10.1056/NEJMoa1412082. [DOI] [PubMed] [Google Scholar]
  • 14.Topalian S.L., Sznol M., McDermott D.F., Kluger H.M., Carvajal R.D., Sharfman W.H., Brahmer J.R., Lawrence D.P., Atkins M.B., Powderly J.D., et al. Survival, durable tumor remission, and long-term safety in patients with advanced melanoma receiving nivolumab. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2014;32:1020–1030. doi: 10.1200/JCO.2013.53.0105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Robert C., Thomas L., Bondarenko I., O’Day S., Weber J., Garbe C., Lebbe C., Baurain J.F., Testori A., Grob J.J., et al. Ipilimumab plus dacarbazine for previously untreated metastatic melanoma. N. Engl. J. Med. 2011;364:2517–2526. doi: 10.1056/NEJMoa1104621. [DOI] [PubMed] [Google Scholar]
  • 16.Eggermont A.M., Chiarion-Sileni V., Grob J.J., Dummer R., Wolchok J.D., Schmidt H., Hamid O., Robert C., Ascierto P.A., Richards J.M., et al. Adjuvant ipilimumab versus placebo after complete resection of high-risk stage III melanoma (EORTC 18071): A randomised, double-blind, phase 3 trial. Lancet Oncol. 2015;16:522–530. doi: 10.1016/S1470-2045(15)70122-1. [DOI] [PubMed] [Google Scholar]
  • 17.O’Day S.J., Maio M., Chiarion-Sileni V., Gajewski T.F., Pehamberger H., Bondarenko I.N., Queirolo P., Lundgren L., Mikhailov S., Roman L., et al. Efficacy and safety of ipilimumab monotherapy in patients with pretreated advanced melanoma: A multicenter single-arm phase II study. Ann. Oncol. 2010;21:1712–1717. doi: 10.1093/annonc/mdq013. [DOI] [PubMed] [Google Scholar]
  • 18.Wolchok J.D., Neyns B., Linette G., Negrier S., Lutzky J., Thomas L., Waterfield W., Schadendorf D., Smylie M., Guthrie T., Jr., et al. Ipilimumab monotherapy in patients with pretreated advanced melanoma: A randomised, double-blind, multicentre, phase 2, dose-ranging study. Lancet Oncol. 2010;11:155–164. doi: 10.1016/S1470-2045(09)70334-1. [DOI] [PubMed] [Google Scholar]
  • 19.Weber J.S., O’Day S., Urba W., Powderly J., Nichol G., Yellin M., Snively J., Hersh E. Phase I/II study of ipilimumab for patients with metastatic melanoma. J. Clin. Oncol. 2008;26:5950–5956. doi: 10.1200/JCO.2008.16.1927. [DOI] [PubMed] [Google Scholar]
  • 20.Hodi F.S., Hwu W.J., Kefford R., Weber J.S., Daud A., Hamid O., Patnaik A., Ribas A., Robert C., Gangadhar T.C., et al. Evaluation of immune-related response criteria and recist v1.1 in patients with advanced melanoma treated with pembrolizumab. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2016;34:1510–1517. doi: 10.1200/JCO.2015.64.0391. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Huang R.R., Jalil J., Economou J.S., Chmielowski B., Koya R.C., Mok S., Sazegar H., Seja E., Villanueva A., Gomez-Navarro J., et al. CTLA4 blockade induces frequent tumor infiltration by activated lymphocytes regardless of clinical responses in humans. Clin. Cancer Res. 2011;17:4101–4109. doi: 10.1158/1078-0432.CCR-11-0407. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Hodi F.S., Oble D.A., Drappatz J., Velazquez E.F., Ramaiya N., Ramakrishna N., Day A.L., Kruse A., Mac Rae S., Hoos A., et al. CTLA-4 blockade with ipilimumab induces significant clinical benefit in a female with melanoma metastases to the CNS. Nat. Clin. Pract. Oncol. 2008;5:557–561. doi: 10.1038/ncponc1183. [DOI] [PubMed] [Google Scholar]
  • 23.Hamid O., Urba W.J., Yellin M., Nichol G.M., Weber J., Hersh E.M., Tchekmedyian S., Hodi F.S., Weber R., O’Day S. Kinetics of response to ipilimumab (MDX-010) in patients with stage III/IV melanoma. J. Clin. Oncol. 2007;25:8525. [Google Scholar]
  • 24.Wolchok J.D., Hoos A., O’Day S., Weber J.S., Hamid O., Lebbe C., Maio M., Binder M., Bohnsack O., Nichol G., et al. Guidelines for the evaluation of immune therapy activity in solid tumors: Immune-related response criteria. Clin. Cancer Res. 2009;15:7412–7420. doi: 10.1158/1078-0432.CCR-09-1624. [DOI] [PubMed] [Google Scholar]
  • 25.Eisenhauer E.A., Therasse P., Bogaerts J., Schwartz L.H., Sargent D., Ford R., Dancey J., Arbuck S., Gwyther S., Mooney M., et al. New response evaluation criteria in solid tumours: Revised recist guideline (version 1.1) Eur. J. Cancer. 2009;45:228–247. doi: 10.1016/j.ejca.2008.10.026. [DOI] [PubMed] [Google Scholar]
  • 26.Nishino M., Giobbie-Hurder A., Gargano M., Suda M., Ramaiya N.H., Hodi F.S. Developing a common language for tumor response to immunotherapy: Immune-related response criteria using unidimensional measurements. Clin. Cancer Res. Off. J. Am. Assoc. Cancer Res. 2013;19:3936–3943. doi: 10.1158/1078-0432.CCR-13-0895. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Seymour L., Bogaerts J., Perrone A., Ford R., Schwartz L.H., Mandrekar S., Lin N.U., Litière S., Dancey J., Chen A., et al. Irecist: Guidelines for response criteria for use in trials testing immunotherapeutics. Lancet Oncol. 2017;18:e143–e152. doi: 10.1016/S1470-2045(17)30074-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Hutchings M., Loft A., Hansen M., Pedersen L.M., Buhl T., Jurlander J., Buus S., Keiding S., D’Amore F., Boesen A.M., et al. Fdg-pet after two cycles of chemotherapy predicts treatment failure and progression-free survival in hodgkin lymphoma. Blood. 2006;107:52–59. doi: 10.1182/blood-2005-06-2252. [DOI] [PubMed] [Google Scholar]
  • 29.Fuster D., Chiang S., Johnson G., Schuchter L.M., Zhuang H., Alavi A. Is 18F-FDG PET more accurate than standard diagnostic procedures in the detection of suspected recurrent melanoma? J. Nucl. Med. 2004;45:1323–1327. [PubMed] [Google Scholar]
  • 30.Reinhardt M.J., Joe A.Y., Jaeger U., Huber A., Matthies A., Bucerius J., Roedel R., Strunk H., Bieber T., Biersack H.-J., et al. Diagnostic performance of whole body dual modality 18F-FDG PET/CT imaging for N- and M-staging of malignant melanoma: Experience with 250 consecutive patients. J. Clin. Oncol. 2006;24:1178–1187. doi: 10.1200/JCO.2005.03.5634. [DOI] [PubMed] [Google Scholar]
  • 31.Strobel K., Dummer R., Steinert H.C., Conzett K.B., Schad K., Lago M.P., Soyka J.D., Veit-Haibach P., Seifert B., Kalff V. Chemotherapy response assessment in stage IV melanoma patients—Comparison of 18F-FDG-PET/CT, CT, brain MRI, and tumormarker S-100B. Eur. J. Nucl. Med. Mol. Imaging. 2008;35:1786–1795. doi: 10.1007/s00259-008-0806-1. [DOI] [PubMed] [Google Scholar]
  • 32.Sachpekidis C., Larribere L., Pan L., Haberkorn U., Dimitrakopoulou-Strauss A., Hassel J.C. Predictive value of early 18F-FDG PET/CT studies for treatment response evaluation to ipilimumab in metastatic melanoma: Preliminary results of an ongoing study. Eur. J. Nucl. Med. Mol. Imaging. 2015;42:386–396. doi: 10.1007/s00259-014-2944-y. [DOI] [PubMed] [Google Scholar]
  • 33.Kong B.Y., Menzies A.M., Saunders C.A., Liniker E., Ramanujam S., Guminski A., Kefford R.F., Long G.V., Carlino M.S. Residual FDG-PET metabolic activity in metastatic melanoma patients with prolonged response to anti-PD-1 therapy. Pigment. Cell Melanoma Res. 2016;29:572–577. doi: 10.1111/pcmr.12503. [DOI] [PubMed] [Google Scholar]
  • 34.Breki C.M., Dimitrakopoulou-Strauss A., Hassel J., Theoharis T., Sachpekidis C., Pan L., Provata A. Fractal and multifractal analysis of PET/CT images of metastatic melanoma before and after treatment with ipilimumab. EJNMMI Res. 2016;6:61. doi: 10.1186/s13550-016-0216-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Zheng J., Menda Y., Graham M., Milhem M. F-18 FDG PET/CT evaluation of treatment response to ipilimumab therapy in advanced stage melanoma. J. Nucl. Med. 2015;56:1464. [Google Scholar]
  • 36.Fredrickson J., Callahan J., Funke R., Sanabria S., Weber W., de Crespigny A., Hicks R. Utility of FDG-PET in immunotherapy: Results from a phase II study of NSCLC patients undergoing therapy with the PD-L1 inhibitor, atezolizumab (MPDL3280A) J. Nucl. Med. 2016;57:134. [Google Scholar]
  • 37.Abramson Cancer Center of the University of Pennsylvania Imaging FDG Flare in Melanoma. [(accessed on 8 January 2017)]; Available online: https://ClinicalTrials.gov/show/NCT02791594.
  • 38.Abramson Cancer Center of the University of Pennsylvania Early FDG pet in melanoma. [(accessed on 8 January 2017)]; Available online: https://ClinicalTrials.gov/show/NCT02716077.
  • 39.Wahl R.L., Jacene H., Kasamon Y., Lodge M.A. From recist to percist: Evolving considerations for PET response criteria in solid tumors. J. Nucl. Med. Off. Publ. Soc. Nucl. Med. 2009;50:122s–150s. doi: 10.2967/jnumed.108.057307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Bacanovic S., Burger I.A., Stolzmann P., Hafner J., Huellner M.W. Ipilimumab-induced adrenalitis: A possible pitfall in 18F-FDG-PET/CT. Clin. Nucl. Med. 2015;40:e518–e519. doi: 10.1097/RLU.0000000000000887. [DOI] [PubMed] [Google Scholar]
  • 41.Larkin J., Chiarion-Sileni V., Gonzalez R., Grob J.J., Cowey C.L., Lao C.D., Schadendorf D., Dummer R., Smylie M., Rutkowski P., et al. Combined nivolumab and ipilimumab or monotherapy in untreated melanoma. N. Engl. J. Med. 2015;373:23–34. doi: 10.1056/NEJMoa1504030. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Daud A.I., Hamid O., Ribas A., Hodi F.S., Hwu W.-J., Kefford R., Wolchok J., Hersey P., Weber J.S., Joseph R., et al. Abstract ct104: Antitumor activity of the anti-PD-1 monoclonal antibody MK-3475 in melanoma(mel): Correlation of tumor pd-l1 expression with outcome. Cancer Res. 2014;74:CT104. doi: 10.1158/1538-7445.AM2014-CT104. [DOI] [Google Scholar]
  • 43.Tsao M.S., Le Teuff G., Shepherd F.A., Landais C., Hainaut P., Filipits M., Pirker R., Le Chevalier T., Graziano S., Kratze R., et al. PD-L1 protein expression assessed by immunohistochemistry is neither prognostic nor predictive of benefit from adjuvant chemotherapy in resected non-small cell lung cancer. Ann. Oncol. Off. J. Eur. Soc. Med. Oncol. 2017;28:882–889. doi: 10.1093/annonc/mdx003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Maute R.L., Gordon S.R., Mayer A.T., McCracken M.N., Natarajan A., Ring N.G., Kimura R., Tsai J.M., Manglik A., Kruse A.C., et al. Engineering high-affinity PD-1 variants for optimized immunotherapy and immuno-pet imaging. Proc. Natl. Acad. Sci. USA. 2015;112:E6506–E6514. doi: 10.1073/pnas.1519623112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Lee C.M., Tannock I.F. The distribution of the therapeutic monoclonal antibodies cetuximab and trastuzumab within solid tumors. BMC Cancer. 2010;10:255. doi: 10.1186/1471-2407-10-255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Hettich M., Braun F., Bartholoma M.D., Schirmbeck R., Niedermann G. High-resolution PET imaging with therapeutic antibody-based PD-1/PD-L1 checkpoint tracers. Theranostics. 2016;6:1629–1640. doi: 10.7150/thno.15253. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Chatterjee S., Lesniak W.G., Miller M.S., Lisok A., Sikorska E., Wharram B., Kumar D., Gabrielson M., Pomper M.G., Gabelli S.B., et al. Rapid PD-L1 detection in tumors with PET using a highly specific peptide. Biochem. Biophys. Res. Commun. 2017;483:258–263. doi: 10.1016/j.bbrc.2016.12.156. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Heskamp S., Hobo W., Molkenboer-Kuenen J.D., Olive D., Oyen W.J., Dolstra H., Boerman O.C. Noninvasive imaging of tumor PD-L1 expression using radiolabeled anti-PD-L1 antibodies. Cancer Res. 2015;75:2928–2936. doi: 10.1158/0008-5472.CAN-14-3477. [DOI] [PubMed] [Google Scholar]
  • 49.Chatterjee S., Lesniak W.G., Gabrielson M., Lisok A., Wharram B., Sysa-Shah P., Azad B.B., Pomper M.G., Nimmagadda S. A humanized antibody for imaging immune checkpoint ligand PD-L1 expression in tumors. Oncotarget. 2016;7:10215–10227. doi: 10.18632/oncotarget.7143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Josefsson A., Nedrow J.R., Park S., Banerjee S.R., Rittenbach A., Jammes F., Tsui B., Sgouros G. Imaging, biodistribution, and dosimetry of radionuclide-labeled PD-L1 antibody in an immunocompetent mouse model of breast cancer. Cancer Res. 2016;76:472–479. doi: 10.1158/0008-5472.CAN-15-2141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Shields A.F., Grierson J.R., Dohmen B.M., Machulla H.J., Stayanoff J.C., Lawhorn-Crews J.M., Obradovich J.E., Muzik O., Mangner T.J. Imaging proliferation in vivo with [F-18]FLT and positron emission tomography. Nat. Med. 1998;4:1334–1336. doi: 10.1038/3337. [DOI] [PubMed] [Google Scholar]
  • 52.Ribas A., Benz M.R., Allen-Auerbach M.S., Radu C., Chmielowski B., Seja E., Williams J.L., Gomez-Navarro J., McCarthy T., Czernin J. Imaging of CTLA4 blockade–induced cell replication with 18F-FLT pet in patients with advanced melanoma treated with tremelimumab. J. Nucl. Med. 2010;51:340–346. doi: 10.2967/jnumed.109.070946. [DOI] [PubMed] [Google Scholar]
  • 53.Tavaré R., McCracken M.N., Zettlitz K.A., Knowles S.M., Salazar F.B., Olafsen T., Witte O.N., Wu A.M. Engineered antibody fragments for immuno-PET imaging of endogenous CD8+ T cells in vivo. Proc. Natl. Acad. Sci. USA. 2014;111:1108–1113. doi: 10.1073/pnas.1316922111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Tavare R., Escuin-Ordinas H., Mok S., McCracken M.N., Zettlitz K.A., Salazar F.B., Witte O.N., Ribas A., Wu A.M. An effective immuno-PET imaging method to monitor CD8-dependent responses to immunotherapy. Cancer Res. 2016;76:73–82. doi: 10.1158/0008-5472.CAN-15-1707. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Tjin E.P.M., Krebbers G., Meijlink K.J., van de Kasteele W., Rosenberg E.H., Sanders J., Nederlof P.M., van de Wiel B.A., Haanen J.B.A.G., Melief C.J.M., et al. Immune-escape markers in relation to clinical outcome of advanced melanoma patients following immunotherapy. Cancer Immunol. Res. 2014;2:538–546. doi: 10.1158/2326-6066.CIR-13-0097. [DOI] [PubMed] [Google Scholar]
  • 56.Taube J.M., Klein A., Brahmer J.R., Xu H., Pan X., Kim J.H., Chen L., Pardoll D.M., Topalian S.L., Anders R.A. Association of PD-1, PD-1 ligands, and other features of the tumor immune microenvironment with response to anti–PD-1 therapy. Clin. Cancer Res. 2014;20:5064–5074. doi: 10.1158/1078-0432.CCR-13-3271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.UMC Groningen Il2 Imaging in Metastatic Melanoma. [(accessed on 15 March 2017)]; Available online: https://ClinicalTrials.gov/show/NCT02922283.
  • 58.UMC Groningen Mpdl3280a-imaging-ist-umcg. [(accessed on 15 March 2017)]; Available online: https://ClinicalTrials.gov/show/NCT02453984.
  • 59.UMC Groningen Mpdl3280a-treatment-ist-umcg. [(accessed on 15 March 2017)]; Available online: https://ClinicalTrials.gov/show/NCT02478099.
  • 60.Graham M.M., Weber W.A. Evaluation of the efficacy of targeted imaging agents. J. Nucl. Med. 2016;57:653–659. doi: 10.2967/jnumed.115.169235. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Diagnostics are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES