Abstract
Immune-checkpoint inhibitors (ICIs) have widened the therapeutic scenario of different cancer types. Phase I/II trials have been designed to evaluate the role of ICIs both as single agents and in combination in neuroendocrine neoplasms (NENs), but as yet no randomized controlled phase III trials have been carried out. A systematic review and meta-analysis of studies published could help to reduce the biases of single-phase II trials. Efficacy data were obtained on 636 patients. Pooled percentages of the overall response rate (ORR) and disease control rate (DCR) were 10% (95% CI: 6–15%, I2 = 67%, p < 0.1) and 42% (95% CI: 28–56%, I2 = 93%, p < 0.1), respectively. Median progression-free survival (mPFS) was 4.1 months (95% CI 2.6–5.4; I2 = 96%, p < 0.1) and median overall survival (mOS) was 11 months (95% CI 4.8–21.1; I2 = 98%, p < 0.1). Among the ICIs used as single agents, the anti-PD1 toripalimab achieved the highest ORR. Combination regimens were superior to monotherapy, e.g., the ICI combination nivolumab + ipilimumab, and the ICI + anti-angiogenetic combination atezolizumab + bevacizumab, both of which warrant further investigation. Promising efficacy and a good safety profile of ICIs represent a valid opportunity for expanding the therapeutic landscape of NENs. Predictive biomarkers are needed to identify the most suitable candidates for these regimens.
Keywords: immune checkpoint inhibitors, neuroendocrine tumors, PD1, PD-L1
1. Introduction
Neuroendocrine neoplasms (NENs) are a heterogeneous group of tumors originating from neuroendocrine cells [1,2]. NENs can present at different sites, the most frequent being the gastroenteropancreatic compartment (up to 70% of all tumors) and respiratory tract (around 20%), while other regions such as the genitourinary and gynecological tracts are less frequently involved. The incidence of NENs has increased in recent years and is now estimated to be around 2.5–5 cases per 100,000 inhabitants/year in Europe and the U.S. [2,3,4]. The therapeutic approach to NENs is based on primary tumor location, grading, and staging [5]. In unresectable lesions, the mainstays of treatment are “cold” somatostatin analogs (SSAs), peptide receptor radionuclide therapy (PRRT), tyrosine kinase inhibitors (TKIs), and the mammalian target of rapamycin (mTOR) inhibitor, everolimus [5,6,7,8,9,10,11,12,13,14,15,16]. Chemotherapy also plays a role, especially for more aggressive lesions or high-grade and poorly-differentiated NENs [17,18,19,20].
In many cancer types, immunotherapy with immune checkpoint inhibitors (ICIs) has dramatically changed the natural history of the disease [21]. ICIs are monoclonal antibodies that block the negative signal for the activation of effector T-cells, thereby de-inhibiting the anti-tumor immune response [22]. To date, the main pathways targeted by ICIs are programmed cell-death protein 1 (PD-1)/programmed death-ligand 1 (PD-L1) and cytotoxic T-lymphocyte antigen-4 (CTLA-4). Several ICIs have already been approved for clinical use or are under investigation in various cancer types. For example, nivolumab, pembrolizumab, toripalimab, and spartalizumab act as anti-PD1 agents; avelumab, atezolizumab, and durvalumab are directed against PD-L1; and ipilimumab and tremelimumab bind to CTLA-4. These drugs can be used both as single agents and as combinations of anti-PD1/PD-L1 plus anti-CTLA4 [23,24,25]. However, as the immunological features of NENs are not fully understood, there is still limited evidence of the efficacy and safety of ICIs in these malignancies, mainly represented by phase I and II trials [26,27,28,29,30,31,32,33,34,35,36,37,38,39].
According to the latest WHO classification, gastroenteropancreatic G3 NENs are defined by a Ki67 proliferation index of >20%. In addition to proliferative activity, tumor differentiation appears to play a major role, further dividing the G3 NEN G3 group into G3 neuroendocrine tumors (NETs) and NECs, characterized by different prognosis and response to available therapies [40,41].
In the present systematic review and meta-analysis, we summarize what is currently known about the efficacy and safety of ICIs in NENs, and the possible implications for clinical practice.
2. Materials and Methods
2.1. Data Extraction
This systematic review and meta-analysis were conducted in accordance with the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [42,43]. A search of major databases, e.g., MEDLINE/PubMed, Cochrane, and Embase, was performed to identify studies on ICIs for the treatment of NENs published up to October 2020. The following keywords were used: “immune checkpoint inhibitors” or “ICIs” or “nivolumab” or “pembrolizumab” or “durvalumab” or “avelumab” or “atezolizumab” or “spartalizumab” or “toripalimab” or “tremelimumab” or “ipilimumab” or “anti PD1” or “anti PD-L1” or “anti-CTLA4” and “neuroendocrine tumors” or “neuroendocrine neoplasms” or “neuroendocrine carcinomas”. An additional search for Meeting Abstracts published by the American Society of Clinical Oncology (ASCO), ASCO Gastrointestinal Symposium (ASCO-GI), European Society for Medical Oncology (ESMO), and European Neuro-Endocrine Tumors Society (ENETS) annual meetings was also performed. Finally, we manually checked the citations of the included publications. Original studies published in English were considered. Reviews, letters, and personal opinions were excluded. A flowchart of the selection process is shown in Figure 1.
Two authors independently conducted a preliminary screening of titles and abstracts, followed by a second-round screening when they read the full texts of the potentially relevant articles. In the event of disagreement, a third reviewer was consulted to facilitate the final decision. Data on the population treated, treatment efficacy, and toxicity parameters were extracted and pooled from the selected studies. The following data were also collected from each study: year of publication, name of first author, country of the study; study design (phase, randomization, independent review); baseline characteristics of the included patients (median age, histologic classification, grading, staging, primary tumor location); intervention including treatment regimens, dosage and number of administered cycles; complete response (CR), partial response (PR), stable disease (SD) and progressive disease (PD) absolute frequency or, when available, outcomes expressed as overall response rate (ORR) and disease-control rate (DCR); progression-free survival (PFS) and overall survival (OS); toxicities (grades and types of trAEs and irAEs). When response and toxicities were reported at the subgroup level, the values were combined to have endpoints at the single-cohort level. PFS and OS were maintained at the subgroup level because their nature (medians) does not allow for an overall merging value.
2.2. Quality Assessment
The risk of bias was assessed by the Risk Of Bias in Non-randomized Studies of Interventions (ROBINS-I) tool for non-randomized clinical trials [44]. In this tool, risk of bias is assessed within specified domains, including (1) bias due to confounding, (2) bias in the selection of participants for the study, (3) bias in the classification of interventions, (4) bias due to deviations from intended interventions (5) bias due to missing data, (6) bias in the measurement of outcomes, (7) bias in the selection of the reported results, and (8) overall bias. Given that assessments are inherently subjective and that there are no strict or objective criteria to judge bias within the ROBINS-I tool, disagreements were resolved by the intervention of a third investigator.
2.3. Statistical Analysis
The main endpoints of ORR, DCR, any trAE, any irAE, trAEs of grade ≥3, and irAEs of grade ≥3 were pooled together using the Meta package in R software (version 3.6.1). Relative risks and 95%CIs describing the ORR of PD-L1 biomarkers were synthesized calculated using the Meta package in R. In addition, the median PFS and OS values, accompanied by their 95%CIs, were extracted and pooled estimates obtained according to the method used by McGrath et al., [45]. This meta-analysis was performed in R software using the metamedian package. Heterogeneity between study outcomes was evaluated using the I2 index and Cochrane’s Q-test (reported with p-value). Values of I2 > 50% and p < 0.1 indicated a substantial heterogeneity between studies. The pooled estimates with their 95% CI were determined using the fixed-effects model (p > 0.1) or the random-effects model (p < 0.1). While the Meta R package automatically performs the I2 and Q-test calculus, ad hoc code was written to evaluate the I2 and Q-test on PFS and OS. Subgroup analyses of primary efficacy endpoints were included to investigate the possible sources of heterogeneity and to identify differences in subsets of patients. A funnel plot of the main endpoint ORR was generated to assess potential publication bias, and its asymmetry was evaluated via linear regression test using the Meta package in R software (3.6.1).
3. Results
3.1. Characteristics of Studies
A total of 14 studies fulfilled selection criteria and were included in the systematic review and meta-analysis (Figure 1): 7 were peer-reviewed full-text publications from scientific journals [26,27,29,30,31,36,38] and 7 were conference abstracts or posters [28,32,33,34,35,37,39]. The studies in question were all non-randomized, prospective studies, 3 of which phase Ib [26,30,33]. The remaining 11 studies were phase II trials [27,28,29,31,32,35,36,37,38,39]. The majority of studies (11/14) were multicenter. An independent review was declared for 4 studies [27,28,32,39]. The main characteristics of the included studies are reported in Table 1. We differentiated between neuroendocrine tumors (NETs) and neuroendocrine carcinoma (NECs) when this was specified by the authors, and indicated cases not specifically identified as NETs or NECs as neuroendocrine neoplasms (NENs).
Table 1.
Study | Phase | Design | ICI | Target | Sample Size * | ORR No. (%) |
Median PFS, mos (Range) | Median OS, mos (Range) |
---|---|---|---|---|---|---|---|---|
Mehnert [26] (NCT02054806) |
1b | Multicohort: epNET | Pembrolizumab | PD-1 | 25 | 3 (12) | 5.6 (3.5–10.7) | 21.1 (9.1–22.4) |
Mehnert [26] (NCT02054806) |
1b | Multicohort: pNET | Pembrolizumab | PD-1 | 16 | 1 (6) | 4.5 (3.6–8.3) | 21.0 |
Strosberg [27] (NCT02628067) |
2 | Single cohort: mixNET | Pembrolizumab | PD-1 | 107 | 4 (4) | 4.1 (3.5–5.4) | 24.2 (15.8–32.5) |
Yao [28] (NCT02955069) |
2 | Multicohort: epNET | Spartalizumab | PD-1 | 62 | 6 (10) | - | - |
Yao [28] (NCT02955069) |
2 | Multicohort: pNET | Spartalizumab | PD-1 | 33 | 1 (3) | - | - |
Yao [28] (NCT02955069) |
2 | Multicohort: mixNEC | Spartalizumab | PD-1 | 21 | 1 (5) | - | - |
Patel [29] (NCT02834013) |
2 | Single cohort: epNEN | Nivolumab + ipilimumab | PD-1, CTLA-4 | 32 | 8 (25) | 4.0 (3.0–6.0) | 11 |
Lu [30] (NCT03167853) |
1b | Multicohort: mixNEC, mixNET/pNEN, epNEN, mixNEN | Toripalimab | PD-1 | 40 | 8 (20) | 2.5 (1.9–3.1) | 7.8 (5.0–10.8) |
Vijayvergia [31] (NCT02939651) |
2 | Single cohort: mixNEN | Pembrolizumab | PD-1 | 29 | 1 (3) | 2.0 (1.5–2.4) | 4.7 |
Halperin [32] (NCT03074513) |
2 | Multicohort: pNET | Atezolizumab + bevacizumab | PD-L1, TKI | 20 | 4 (20) | 19.6 | - |
Halperin [32] (NCT03074513) |
2 | Multicohort: epNET | Atezolizumab + bevacizumab | PD-L1, anti-VEGF | 20 | 3 (15) | 14.9 | - |
Zhang [33] (NCT03167853) |
1b | Multicohort: mixNEC, mixNET | Toripalimab | PD-1 | 21 | 6 (29) | 2.8 (1.6–4.0) | - |
Fottner [34] (NCT03352934) |
2 | Single cohort: mixNEN | Avelumab | PD-L1 | 29 | 2 (7) | - | 4.2 (1.0–12.0) |
Mulvey [35] (NCT03136055) |
2 | Single cohort: epNEC | Pembrolizumab | PD-1 | 13 | 1, 8 | 2.0 | - |
Frumovitz [6] (NCT02721732) |
2 | Single cohort: epNEC | Pembrolizumab | PD-1 | 7 | 0 (0) | 2.1 (0.8–3.3) | - |
Rodriguez-Freixinos [37] (NCT03278405) |
2a | Single cohort: epNEC | Avelumab | PD-L1 | 9 | 0 (0) | 3.0 (1.0–10.0) | 5.0 (2.0–15.0) |
Klein [38] (NCT02923934) |
2 | Single cohort: mixNEN | Nivolumab + ipilimumab | PD-1, CTLA-4 | 29 | 7 (24) | 4.8 (2.7–10.5) | 14.8 (4.1–21.2) |
Capdevila [39] (NCT03095274) |
2 | Multicohort:epNET | Durvalumab + tremelimumab | PD-L1, CTLA-4 | 27 | 0 (0) | 5.3 (4.5–6.0) | - |
Capdevila [39] (NCT03095274) |
2 | Multicohort:epNET | Durvalumab + tremelimumab | PD-L1, CTLA-4 | 31 | 0 (0) | 8 (4.9–11.1) | - |
Capdevila [39] (NCT03095274) |
2 | Multicohort:pNET | Durvalumab + trremelimumab | PD-L1, CTLA-4 | 32 | 2 (6) | 8.1 (3.8–12.4) | - |
Capdevila [39] (NCT03095274) |
2 | Multicohort:mixNEN | Durvalumab + tremelimumab | PD-L1, CTLA-4 | 33 | 2 (6) | 2.5 (2.1–2.7) | - |
* The sample size refers solely to patients evaluable for response. ICI: immune checkpoint inhibitor; ORR: objective response rate; PFS: progression-free survival; OS: overall survival; mos: months; ep: extra-pancreatic; p: pancreatic; mix: pancreatic and extra-pancreatic.
3.2. Patient Characteristics at Baseline
Six hundred and thirty-six patients were treated with ICIs either as monotherapy or in combination. The median age at enrolment ranged across studies from 41 to 67 years. Eastern Cooperative Oncology Group performance status (ECOG PS) at screening was 0–1 in 10/14 studies and 0–2 in the remaining 4. The most frequent site of origin of NENs was the pancreas (219 patients, 34.2%) followed by the gastrointestinal tract (201 patients, 31.4%) and lung (100 patients, 15.6%). The remaining 72 (11.3%) patients had NENs originating from other sites or of unspecified/unknown origin. The majority of patients (418, 65.3%) had grade (G) 1 or G2 NENs. Eighty-six (13.4%) patients had G3 neuroendocrine tumors (NETs) and 114 patients (17.8%) had neuroendocrine carcinomas (NECs); in 13 (2%) cases, the distinction between NET G3 and NEC was not specified. Grading was unknown in 9 (1.5%) cases.
The patients included in the studies were all pre-treated, but data on previously administered therapies were available in only 3 studies for a total of 193 patients [26,38,39]. Somatostatin analogs (SSAs) were the most widely used drugs (90 patients), followed by chemotherapy (110 patients), everolimus (76 patients), and TKIs (26 patients). Functional status was not mentioned in just under half of the studies (6/14). In the 8 articles in which this information was given, all the patients had non-functioning tumors, except the study by Strosberg et al. that included 8 functioning tumors [27].
Among ICIs targeting PD-1, 198 (31%) patients received pembrolizumab as a single agent, 116 (18.1%) were treated with spartalizumab and 63 (9.8%) with toripalimab. Thirty-nine (6.1%) patients received the anti-PD-L1 avelumab as a single agent.
The combination of anti-PD1 and anti-CTLA4 drugs was administered as durvalumab plus tremelimumab in 123 (19.2%) cases, or as nivolumab plus ipilimumab in 61 (9.5%) patients. Forty (6.3%) patients received a combination of anti-PD-L1 atezolizumab with the anti-vascular endothelial growth factor (VEGF) bevacizumab.
In 7 studies, 370 patients were evaluated for PD-L1 expression [26,27,30,31,33,36,39]. However, a PD-L1 positivity of ≥1% was an inclusion criterion in only one study [26]. ORR was the main primary endpoint, while secondary endpoints were DCR, OS, PFS, and safety.
3.3. Clinical Outcomes
Figure 2 shows the forest plots of ORR (A) and DCR (B), reported as percentages, along with their 95% confidence interval (95%CI). The efficacy analysis of the ORR was carried out on 636 patients, while only 596 patients were included in the DCR analysis. In one study, information on DCR or stable disease was not available [32]. The best response obtained was a partial response (PR) in 39 patients and stable disease (SD) in 210 patients. Three complete responses (CR) were registered. The pooled proportions of ORR and DCR were 0.10 (95% CI: 0.06–0.15, I2 = 67%, p < 0.1) and 0.42 (95% CI: 0.28–0.56, I2 = 93%, p < 0.1), respectively. The linear regression test (p = 0.212) indicated that no publication bias existed in this meta-analysis for ORR (Figure S1).
3.4. PD-L1 Biomarker for ORR
Four studies with PD-L1 expression data were included in an additional analysis to analyze the prognostic role of PD-L1 for ORR. Figure 3 shows the forest plots of ORR comparisons based on PD-L1 expression. PD-L1-positive patients had a higher ORR than those with PD-L1 negative tumors (RR = 1.22, 95% CI: 1.22–8.89, I2 = 2%, p = 0.36).
3.5. Subgroup Efficacy Analysis: ORR and DCR
For the subgroup analyses of the available data, we first grouped the studies according to the different mechanisms of action of the ICIs used (anti-PD1 monotherapy vs. anti-PD-L1 monotherapy vs. combination anti-PD1/PD-L1 + anti-CTLA4/anti-VEGF therapy), observing a general heterogeneity of the studies (I2 = 67%) and a trend of better ORR for combination regimens (0.13, 95% CI 0.06–0.29) compared to single agents (0.08, 95% CI 0.05–0.14). We then analyzed the effect of the specific drugs on the primary outcome (ORR). Among the anti-PD1 agents, toripalimab obtained the best results in terms of ORR (0.23, 95% CI 0.14–0.35), while pembrolizumab and spartalizumab produced the poorest results (0.05, 95% CI 0.03–0.09 and 0.07, 95% CI 0.03–0.13, respectively). Anti-PD1 agents also obtained the best results for ORR as a combination of nivolumab + ipilimumab (0.25, 95% CI 0.15–0.37). The drugs directed against PD-L1 showed a poorer performance, i.e., single-agent avelumab (0.05, 95% CI 0.01–0.19) and the combination of durvalumab + tremelimumab (0.03, 95% CI 0.01–0.08). One exception was the combination of the anti-PDL1 atezolizumab and the anti-VEGF bevacizumab, which obtained a higher ORR (0.18, 95% CI 0.09–0.32). There were no differences between NENs originating from the pancreas and those originating from extra-pancreatic sites (Figure 4).
The DCR subgroup analysis confirmed the same trend for ORR in the above subgroups. Anti-PD1 monotherapy and combination regimens showed a higher DCR (0.44, 95% CI 0.3–0.58 and 0.51, 95% CI 0.09–0.92, respectively) than single agents directed against PD-L1 (0.21, 95% CI 0.08–0.34), with better results when spartalizumab (0.55, 95% CI 0.46–0.64) and nivolumab + ipilimumab (0.69, 95% CI 0.57–0.81) were used. Of note, when grouping the studies according to differentiation grade, NETs showed better results (0.56, 95% CI 0.32–0.81) than NECs (0.22, 95% CI 0.13–0.30). With regard to tumor grade, G1/G2 NETs had a higher DCR (0.69, 95% CI 0.53–0.82) than G3 NETs/NECs (0.3, 95% CI 0.13–0.54). Furthermore, for DCR, differences among NEN sites of origin were not significant for the DCR (Figure 5).
3.6. PFS and OS
The forest plots of PFS and OS (reported as months), together with their 95% CI (whenever available), are shown in Figure 6. We conducted a pooled analysis of PFS for the 12 studies in which these data were reported [26,27,30,31,32,33,35,36,37,38,39]. The pooled median PFS (mPFS) was 4.1 months (95% CI 2.6–5.4; I2 = 96%, p < 0.1). Of note, the combination of atezolizumab + bevacizumab achieved the longest mPFS (19.6 months in the pancreatic NET cohort and 14.9 months in the extra-pancreatic NET cohort). Data for OS were available in 8 studies [26,27,29,30,31,34,37,38]. The pooled median OS (mOS) from the trials was 11 months (95% CI 4.8–21.1; I2 = 98%, p < 0.1).
3.7. Safety Analysis
Ten of the 14 studies reported safety outcomes (Table 2) [26,27,29,30,31,33,34,36,37,38]. The rate of all-grade toxicities ranged from 38% to 95%. In most cases, the distinction between tumor-related adverse events (trAEs) and immune-related adverse events (irAEs) was listed. these, the most frequent adverse events (AEs) were dermatologic toxicities (rash, dermatitis, pruritus; n = 135), fatigue (n = 132), gastrointestinal side-effects such as nausea/vomiting (n = 86) or diarrhea (n = 84), decreased appetite (n = 24) or, more rarely, weight loss (n = 7) or colitis (n = 9). Sixty-nine cases of increased transaminase levels were observed, and 53 patients developed hypothyroidism. G3-G4 AEs were registered in 82 patients, which led to treatment discontinuation in 32 cases. The pooled analysis carried out on treatment-related AEs (trAEs) and immune-related AEs (irAEs) revealed a 72% frequency of any-grade trAEs (95% CI: 57–87%, I2 = 89%, p < 0.1), a 22% frequency of trAEs ≥G3 (95% CI: 13–32%, I2 = 80%, p < 0.1), a 48% frequency of any-grade irAEs (95% CI: 27–69%, I2 = 92%, p < 0.1) and an 18% frequency of irAEs ≥G3 (95% CI: 6–31%, I2 = 85%, p < 0.1) (Figure 7).
Table 2.
Adverse Events | trAEs (No. Cases) | irAEs (No. Cases) | ||
---|---|---|---|---|
Any Grades | ≥Grade 3 | Any Grades | ≥Grade 3 | |
Adrenal insufficiency | 0 | 0 | 0 | 0 |
Anorexia | 23 | 1 | 23 | 1 |
Arthralgia/arthritis | 10 | 1 | 10 | 1 |
Asthenia | 12 | 1 | 12 | 1 |
Colitis/ulcerative colitis/peritonitis | 6 | 6 | 6 | 6 |
Diarrhea | 67 | 12 | 67 | 12 |
Dyspnea | 5 | 2 | 5 | 2 |
Electrolyte alterations | 17 | 3 | 17 | 3 |
Elevated alkaline phosphatase | 11 | 6 | 11 | 6 |
Elevated AST/ALT | 46 | 11 | 46 | 11 |
Elevated lipase/amylase, pancreatitis | 18 | 6 | 18 | 6 |
Fatigue | 123 | 7 | 123 | 7 |
Fever | 11 | 0 | 11 | 0 |
Hematologic alterations (anemia, decrease in white blood cells/platelets) | 41 | 3 | 41 | 3 |
Hepatitis | 2 | 2 | 2 | 2 |
Hyperbilirubinemia | 16 | 2 | 16 | 2 |
Hyperglycemia, diabetes mellitus | 18 | 5 | 18 | 5 |
Hyperthyroidism | 0 | 0 | 0 | 0 |
Hypoalbuminemia | 7 | 0 | 7 | 0 |
Hypophysitis | 1 | 0 | 1 | 0 |
Hypotension/hypertension | 4 | 2 | 4 | 2 |
Hypothyroidism | 27 | 1 | 27 | 1 |
Infusion-related reactions | 1 | 0 | 1 | 0 |
Muscular adverse events (weakness, myalgia, increased CK) | 14 | 1 | 14 | 1 |
Myocarditis | 0 | 0 | 0 | 0 |
Nausea/vomiting | 57 | 2 | 57 | 2 |
Pain (abdomen, head) | 7 | 0 | 7 | 0 |
Pneumonitis | 1 | 1 | 1 | 1 |
Proteinuria | 28 | 0 | 28 | 0 |
Retinopathy, encephalopathy | 0 | 0 | 0 | 0 |
Skin toxicity (rash, dermatitis, worsening psoriasis, pruritus) | 89 | 5 | 89 | 5 |
Weight loss | 7 | 0 | 7 | 0 |
Other gastrointestinal toxicity (dizziness, dry mouth, dysgeusia) | 7 | 0 | 7 | 0 |
AST: aspartate aminotransferase; ALT: alanine aminotransferase; CK: creatine kinase.
3.8. Risk of Bias
All the included non-randomized clinical trials were considered to be at low risk of bias, except the study by Halperin et al., which was deemed to have a moderate risk of bias [32]. More details on the risk of bias assessment, with reasons supporting each study assessment, can be found in Supplementary Table S1.
4. Discussion
In recent years, research into immuno-oncology has led to important breakthroughs in the treatment of solid tumors [21]. Although some immunological therapies, such as interferon, have already been used successfully in patients with NETs, the role of ICIs for NENs has yet to be clarified [5]. Several phase Ib/II trials recently explored single-agent and combination therapy with ICIs in this disease setting. However, the “one-fits-all” approach, albeit useful to reach the planned study accrual due to the rarity of the disease, has not provided conclusive results [46]. Our meta-analysis confirmed the heterogeneity of results across studies as a consequence of the clinical characteristics of enrolled patients (i.e., primary site, grade, percentage of metastatic cases) and the type of samples analyzed. It also enabled us to identify future directions for research into the use of ICIs in NENs.
In our meta-analysis, anti-PD1 compounds such as toripalimab produced an ORR of 23%, while the combination of anti-PD1 nivolumab with anti-CTLA4 ipilimumab reached 25% ORR in a mixed population in 2 studies [29,33,38]. Conversely, anti-PDL1 therapies generally failed in their main objective [29,37,39], which might be attributable to the heterogeneity of PD-ligand expression, PD-L1 being prevalent in lung NETs and PD-L2 in pNETs, suggesting a different clinical resistance to PD-1/PD-L1 checkpoint inhibitors [47]. The ORR was higher in PDL1 positive patients than in PDL1-negative cases.
Neo-angiogenesis appears to play a key role in NEN development and progression. NETs are, in fact, characterized by a high vascular supply and overexpression of VEGF-A. The latter induces immunosuppressive cells, e.g., tumor-associated macrophages, regulatory T cells, and myeloid-derived suppressor cells, leading to an immunosuppressive phenotype that inhibits the maturation of dendritic cells and the activation and proliferation of T cells [48]. Thus, treatment with an anti-VEGF antibody could reverse these immunosuppressive effects and promote T cell activation and dendritic cell maturation. In fact, in the study by Halperin et al., the addition of bevacizumab to atezolizumab led to an ORR of 15–20% and a PFS of 14.9–19.6 months in extra-pancreatic and pancreatic NETs, suggesting the synergistic activity of bevacizumab in converting an immune ‘cold’ tumor into a ‘hot’ one [32].
Another important issue is the short-term PFS obtained from the use of ICIs (except for Halperin’s study), similar to that observed in the placebo arms of studies on everolimus and sunitinib [12,15]. A possible explanation for this could be that ICIs are more beneficial in the early phase of the natural history of NENs, as observed in Halperin’s study. This benefit may be lost in heavily pre-treated patients due to modifications occurring in both the tumor and the microenvironment. In addition to the need for larger studies, a potential future strategy could involve the use of anti-PD1 therapy, perhaps in combination with antiangiogenic therapy, in patients selected based on grading and site of origin.
The safety profile of ICIs is also an important aspect to be considered. Our analysis revealed a range of side effects that are consistent with those previously reported in other solid tumors.
Our study has a number of limitations. First, all of the studies selected were non-randomized phase I/II trials. Furthermore, to avoid publication bias, we were obliged to include studies characterized by high population heterogeneity because of the poor accrual potential for a rare disease such as neuroendocrine neoplasia. Thus, although the meta-analysis did not yield conclusive results on the use of ICIs in NENs, it nevertheless shed light on interesting therapeutic possibilities such as the use of ICI combinations with anti-VEGF or anti-CTLA-4 therapies. Of note, even if we had conducted a comprehensive literature search with a sensitive search algorithm and an extensive manual search of reference lists and conference proceedings, we would not have been able to find unpublished data on every specific site of origin of the disease. We are fully aware that a substantial amount of information is not available to the public and, as such, cannot completely rule out publication bias.
5. Conclusions
Overall, our meta-analysis of data on ICIs in NENs revealed a high heterogeneity of treatment response. Although our results are not conclusive, they suggest that ICIs are active in NENs. Some information obtained on the different activity of anti-PD1 and anti-PDL1, and on the association with other compounds (i.e., anti-CTLA4 or anti-VEGF) could be useful for the design and development of future clinical trials.
Acknowledgments
The authors thank Gráinne Tierney for English language revision and editing.
Supplementary Materials
The following are available online at https://www.mdpi.com/article/10.3390/ph14050476/s1, Figure S1: Funnel plot of overall response rate (ORR) for publication bias, Table S1. Risk of bias for non-randomized studies.
Author Contributions
Conceptualization and methodology, A.B. and T.I.; data curation, V.F. and N.R.; resources, M.B. and C.L.; writing—original draft preparation, A.B., B.A.M. and I.A.; statistical analysis, I.A.; visualization and validation, G.D.M., M.S. and I.G.; supervision, T.I. and A.B. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability
The datasets generated and/or analyzed during the current study are available from the corresponding author on reasonable request.
Conflicts of Interest
The authors declare that there are no conflicts of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Kulke M.H., Shah M.H., Benson A.B., III, Bergsland E., Berlin J.D., Blaszkowsky L.S., Emerson L., Engstrom P.F., Fanta P., Giordano T., et al. Neuroendocrine tumors, version 1.2015. J. Natl. Compr. Cancer Netw. 2015;13:78–108. doi: 10.6004/jnccn.2015.0011. [DOI] [PubMed] [Google Scholar]
- 2.Yao J.C., Hassan M., Phan A., Dagohoy C., Leary C., Mares J.E., Abdalla E.K., Fleming J.B., Vauthey J.N., Rashid A., et al. One hundred years after “carcinoid”: Epidemiology of and prognostic factors for neuroendocrine tumors in 35,825 cases in the United States. J. Clin. Oncol. 2008;26:3063–3072. doi: 10.1200/JCO.2007.15.4377. [DOI] [PubMed] [Google Scholar]
- 3.Fraenkel M., Kim M.K., Faggiano A., Valk G.D. Epidemiology of gastroenteropancreatic neuroendocrine tumours. Best Pract. Res. Clin. Gastroenterol. 2012;26:691–703. doi: 10.1016/j.bpg.2013.01.006. [DOI] [PubMed] [Google Scholar]
- 4.Dasari A., Shen C., Halperin D., Zhao B., Zhou S., Xu Y., Shih T., Yao J.C. Trends in the incidence, prevalence, and survival outcomes in patients with neuroendocrine tumors in the United States. JAMA Oncol. 2017;3:1335–1342. doi: 10.1001/jamaoncol.2017.0589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Kaderli R.M., Spanjol M., Kollár A., Bütikofer L., Gloy V., Dumont R.A., Seiler C.A., Christ E.R., Radojewski P., Briel M., et al. Therapeutic options for neuroendocrine tumors: A systematic review and network meta-analysis. JAMA Oncol. 2019;5:480–489. doi: 10.1001/jamaoncol.2018.6720. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Caplin M.E., Pavel M., Ruszniewski P. Lanreotide in metastatic enteropancreatic neuroendocrine tumors. N. Engl. J. Med. 2014;371:224–233. doi: 10.1056/NEJMoa1316158. [DOI] [PubMed] [Google Scholar]
- 7.Caplin M.E., Pavel M., Ćwikła J.B., Phan A.T., Raderer M., Sedláčková E., Cadiot G., Wolin E.M., Capdevila J., Wall L., et al. Anti-tumour effects of lanreotide for pancreatic and intestinal neuroendocrine tumours: The CLARINET open-label extension study. Endocr. Relat. Cancer. 2016;23:191–199. doi: 10.1530/ERC-15-0490. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Rinke A., Müller H.H., Schade-Brittinger C., Klose K.J., Barth P., Wied M., Mayer C., Aminossadati B., Pape U.F., Bläker M., et al. Placebo-controlled, double-blind, prospective, randomized study on the effect of octreotide LAR in the control of tumor growth in patients with metastatic neuroendocrine midgut tumors: A report from the PROMID Study Group. J. Clin. Oncol. 2009;27:4656–4663. doi: 10.1200/JCO.2009.22.8510. [DOI] [PubMed] [Google Scholar]
- 9.Rinke A., Wittenberg M., Schade-Brittinger C., Aminossadati B., Ronicke E., Gress T.M., Müller H.H., Arnold R., PROMID study group Placebo-controlled, double-blind, prospective, randomized study on the effect of octreotide LAR in the control of tumor growth in patients with metastatic neuroendocrine midgut tumors (PROMID): Results of long-term survival. Neuroendocrinology. 2017;104:26–32. doi: 10.1159/000443612. [DOI] [PubMed] [Google Scholar]
- 10.Strosberg J., El-Haddad G., Wolin E., Hendifar A., Yao J., Chasen B., Mittra E., Kunz P.L., Kulke M.H., Jacene H., et al. Phase 3 Trial of 177Lu-Dotatate for Midgut Neuroendocrine Tumors. N. Engl. J. Med. 2017;376:125–135. doi: 10.1056/NEJMoa1607427. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Yao J.C., Shah M.H., Ito T., Bohas C.L., Wolin E.M., Van Cutsem E., Hobday T.J., Okusaka T., Capdevila J., de Vries E.G., et al. Everolimus for advanced pancreatic neuroendocrine tumors. N. Engl. J. Med. 2011;364:514–523. doi: 10.1056/NEJMoa1009290. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Yao J.C., Pavel M., Lombard-Bohas C., Van Cutsem E., Voi M., Brandt U., He W., Chen D., Capdevila J., de Vries E., et al. Everolimus for the treatment of advanced pancreatic neuroendocrine tumors: Overall survival and circulating biomarkers from the randomized, phase III RADIANT-3 study. J. Clin. Oncol. 2016;34:3906–3913. doi: 10.1200/JCO.2016.68.0702. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Yao J.C., Fazio N., Singh S., Buzzoni R., Carnaghi C., Wolin E., Tomasek J., Raderer M., Lahner H., Voi M., et al. RAD001 in advanced neuroendocrine tumours, fourth trial (RADIANT-4) study group. Everolimus for the treatment of advanced, non-functional neuroendocrine tumours of the lung or gastrointestinal tract (RADIANT-4): A randomised, placebo-controlled, phase 3 study. Lancet. 2016;387:968–977. doi: 10.1016/S0140-6736(15)00817-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Pavel M.E., Hainsworth J.D., Baudin E., Peeters M., Hörsch D., Winkler R.E., Klimovsky J., Lebwohl D., Jehl V., Wolin E.M., et al. Everolimus plus octreotide long-acting repeatable for the treatment of advanced neuroendocrine tumours associated with carcinoid syndrome (RADIANT-2): A randomised, placebo-controlled, phase 3 study. Lancet. 2011;378:2005–2012. doi: 10.1016/S0140-6736(11)61742-X. [DOI] [PubMed] [Google Scholar]
- 15.Raymond E., Dahan L., Raoul J.L., Bang Y.J., Borbath I., Lombard-Bohas C., Valle J., Metrakos P., Smith D., Vinik A., et al. Sunitinib malate for the treatment of pancreatic neuroendocrine tumors. N. Engl. J. Med. 2011;364:501–513. doi: 10.1056/NEJMoa1003825. [DOI] [PubMed] [Google Scholar]
- 16.Raymond E., Kulke M.H., Qin S., Yu X., Schenker M., Cubillo A., Lou W., Tomasek J., Thiis-Evensen E., Xu J.M., et al. Efficacy and safety of sunitinib in patients with well-differentiated pancreatic neuroendocrine tumours. Neuroendocrinology. 2018;107:237–245. doi: 10.1159/000491999. [DOI] [PubMed] [Google Scholar]
- 17.Mitry E., Baudin E., Ducreux M., Sabourin J.C., Rufié P., Aparicio T., Aparicio T., Lasser P., Elias D., Duvillard P., et al. Treatment of poorly differentiated neuroendocrine tumours with etoposide and cisplatin. Br. J. Cancer. 1999;81:1351–1355. doi: 10.1038/sj.bjc.6690325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Welin S., Sorbye H., Sebjornsen S., Knappskog S., Busch C., Oberg K. Clinical effect of temozolomide-based chemotherapy in poorly differentiated endocrine carcinoma after progression on first-line chemotherapy. Cancer. 2011;117:4617–4622. doi: 10.1002/cncr.26124. [DOI] [PubMed] [Google Scholar]
- 19.Hentic O., Hammel P., Couvelard A., Rebours V., Zappa M., Palazzo M., Maire F., Goujon G., Gillet A., Lévy P., et al. FOLFIRI regimen: An effective second-line chemotherapy after failure of etoposide-platinum combination in patients with neuroendocrine carcinomas grade 3. Endocr. Relat. Cancer. 2012;19:751–757. doi: 10.1530/ERC-12-0002. [DOI] [PubMed] [Google Scholar]
- 20.Bongiovanni A., Riva N., Ricci M., Liverani C., La Manna F., De Vita A., Foca F., Mercatali L., Severi S., Amadori D., et al. First-line chemotherapy in patients with metastatic gastroenteropancreatic neuroendocrine carcinoma. Oncol. Targets Ther. 2015;8:3613–3619. doi: 10.2147/OTT.S91971. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Robert C. A decade of immune-checkpoint inhibitors in cancer therapy. Nat. Commun. 2020;11:3801. doi: 10.1038/s41467-020-17670-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Buqué A., Bloy N., Aranda F., Castoldi F., Eggermont A., Cremer I., Fridman W.H., Fucikova J., Galon J., Marabelle A., et al. Trial Watch: Immunomodulatory monoclonal antibodies for oncological indications. Oncoimmunology. 2015;4:e1008814. doi: 10.1080/2162402X.2015.1008814. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Guo L., Wei R., Lin Y., Kwok H.F. Clinical and recent patents applications of PD-1/PD-L1 targeting immunotherapy in cancer treatment-current progress, strategy, and future perspective. Front. Immunol. 2020;11:1508. doi: 10.3389/fimmu.2020.01508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Tarhini A., Lo E., Minor D.R. Releasing the brake on the immune system: Ipilimumab in melanoma and other tumors. Cancer Biother. Radiopharm. 2010;25:601–613. doi: 10.1089/cbr.2010.0865. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Rotte A. Combination of CTLA-4 and PD-1 blockers for treatment of cancer. J. Exp. Clin. Cancer Res. 2019;38:255. doi: 10.1186/s13046-019-1259-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Mehnert J.M., Bergsland E., O’Neil B.H., Santoro A., Schellens J., Cohen R.B., Doi T., Ott P.A., Pishvaian M.J., Puzanov I., et al. Pembrolizumab for the treatment of programmed death-ligand 1-positive advanced carcinoid or pancreatic neuroendocrine tumors: Results from the KEYNOTE-028 study. Cancer. 2020;126:3021–3030. doi: 10.1002/cncr.32883. [DOI] [PubMed] [Google Scholar]
- 27.Strosberg J., Mizuno N., Doi T., Grande E., Delord J.P., Shapira-Frommer R., Bergsland E., Shah M., Fakih M., Takahashi S., et al. Efficacy and safety of pembrolizumab in previously treated advanced neuroendocrine tumors: Results from the phase II KEYNOTE-158 study. Clin. Cancer Res. 2020;26:2124–2130. doi: 10.1158/1078-0432.CCR-19-3014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Yao J.C., Strosberg J., Fazio N., Pavel M.E., Bergsland E., Ruszniewski P., Halperin D.M., Li D., Tafuto S., Raj N., et al. Spartalizumab in metastatic, well/poorly-differentiated neuroendocrine neoplasms. Endocr. Relat. Cancer. 2021 doi: 10.1530/ERC-20-0382. [DOI] [PubMed] [Google Scholar]
- 29.Patel S.P., Othus M., Chae Y.K., Giles F.J., Hansel D.E., Singh P.P., Fontaine A., Shah M.H., Kasi A., Baghdadi T., et al. A phase II basket trial of dual anti-CTLA-4 and anti-PD-1 blockade in rare tumors (DART SWOG 1609) in patients with nonpancreatic neuroendocrine tumors. Clin. Cancer Res. 2020;26:2290–2296. doi: 10.1158/1078-0432.CCR-19-3356. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Lu M., Zhang P., Zhang Y., Li Z., Gong J., Li J., Li J., Li Y., Zhang X., Lu Z., et al. Efficacy, safety, and biomarkers of toripalimab in patients with recurrent or metastatic neuroendocrine neoplasms: A multiple-center phase Ib trial. Clin. Cancer Res. 2020;26:2337–2345. doi: 10.1158/1078-0432.CCR-19-4000. [DOI] [PubMed] [Google Scholar]
- 31.Vijayvergia N., Dasari A., Deng M., Litwin S., Al-Toubah T., Alpaugh R.K., Dotan E., Hall M.J., Ross N.M., Runyen M.M., et al. Pembrolizumab monotherapy in patients with previously treated metastatic high-grade neuroendocrine neoplasms: Joint analysis of two prospective, non-randomised trials. Br. J. Cancer. 2020;122:1309–1314. doi: 10.1038/s41416-020-0775-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Halperin D.M., Liu S., Dasari A., Fogelman D.R., Bhosale P., Mahvash A., Dervin S., Estrella J., Cortazar P., Maru D.M., et al. A phase II trial of atezolizumab and bevacizumab in patients with advanced, progressive neuroendocrine tumors (NETs) J. Clin. Oncol. 2020;38:619. doi: 10.1200/JCO.2020.38.4_suppl.619. [DOI] [Google Scholar]
- 33.Zhang P., Lu M., Li J., Shen L. Efficacy and safety of PD-1 blockade with JS001 in patients with advanced neuroendocrine neoplasms: A non-randomized, open-label, phase Ib trial. Ann. Oncol. 2018;29:viii468. doi: 10.1093/annonc/mdy293.002. [DOI] [Google Scholar]
- 34.Fottner C., Apostolidis L., Ferrata M., Krug S., Michl P., Schad A., Roth W., Jaeger D., Galle P.R., Weber M.M. A phase II, open label, multicenter trial of avelumab in patients with advanced, metastatic high-grade neuroendocrine carcinomas NEC G3 (WHO 2010) progressive after first-line chemotherapy (AVENEC) J. Clin. Oncol. 2019;37:4103. doi: 10.1200/JCO.2019.37.15_suppl.4103. [DOI] [Google Scholar]
- 35.Mulvey C., Raj N.P., Chan J.A., Aggarwal R.R., Cinar P., Hope T.A., Kolli K., Zhang L., Calabrese S., Grabowsky J.A., et al. Phase II study of pembrolizumab-based therapy in previously treated extrapulmonary poorly differentiated neuroendocrine carcinomas: Results of Part A (pembrolizumab alone) J. Clin. Oncol. 2019;37:363. doi: 10.1200/JCO.2019.37.4_suppl.363. [DOI] [Google Scholar]
- 36.Frumovitz M., Westin S.N., Salvo G., Zarifa A., Xu M., Yap T.A., Rodon A.J., Karp D.D., Abonofal A., Jazaeri A.A., et al. Phase II study of pembrolizumab efficacy and safety in women with recurrent small cell neuroendocrine carcinoma of the lower genital tract. Gynecol. Oncol. 2020;158:570–575. doi: 10.1016/j.ygyno.2020.05.682. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Rodriguez-Freixinos V., Chan D., Doherty M., Wasson K., Iscoe N., Raskin W., Hallet J., Myrehaug S., Law C., Thawer A., et al. Avelumab in Unresectable/Metastatic, Progressive, Poorly Differentiated, Grade 3 Neuroendocrine Carcinomas (NECs) [(accessed on 11 May 2021)]; Available online: https://www.enets.org/avelumab-in-unresectable-metastatic-progressive-poorly-differentiated-grade-3-neuroendocrine-carcinomas-necs.html.
- 38.Klein O., Kee D., Markman B., Michael M., Underhill C., Carlino M.S., Jackett L., Lum C., Scott C., Nagrial A., et al. Immunotherapy of ipilimumab and nivolumab in patients with advanced neuroendocrine tumors: A subgroup analysis of the ca209-538 clinical trial for rare cancers. Clin. Cancer Res. 2020;26:4454–4459. doi: 10.1158/1078-0432.CCR-20-0621. [DOI] [PubMed] [Google Scholar]
- 39.Capdevila J., Teule A., López C., García-Carbonero R., Benavent M., Custodio A., Cubillo A., Alonso V., Alonso Gordoa T., Carmona-Bayonas A., et al. A multi-cohort phase II study of durvalumab plus tremelimumab for the treatment of patients (pts) with advanced neuroendocrine neoplasms (NENs) of gastroenteropancreatic or lung origin: The DUNE trial (GETNE 1601) Ann. Oncol. 2020;31:S711–S724. doi: 10.1016/j.annonc.2020.08.1370. [DOI] [Google Scholar]
- 40.Nagtegaal I.D., Odze R.D., Klimstra D., Paradis V., Rugge M., Schirmacher P., Washington K.M., Carneiro F., Cree I.A., WHO Classification of Tumours Editorial Board The 2019 WHO classification of tumours of the digestive system. Histopathology. 2020;76:182–188. doi: 10.1111/his.13975. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Lloyd R.V., Osamura R.Y., Klöppel G., Rosai J. WHO Classification of Tumours of Endocrine Organs. IARC Press; Lyon, France: 2017. [Google Scholar]
- 42.Liberati A., Altman D.G., Tetzlaff J., Mulrow C., Gøtzsche P.C., Ioannidis J.P., Clarke M., Devereaux P.J., Kleijnen J., Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. Ann. Intern. Med. 2009;151:W65–W94. doi: 10.7326/0003-4819-151-4-200908180-00136. [DOI] [PubMed] [Google Scholar]
- 43.Moher D., Liberati A., Tetzlaff J., Altman D.G., PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Ann. Intern. Med. 2009;151:264–269. doi: 10.7326/0003-4819-151-4-200908180-00135. [DOI] [PubMed] [Google Scholar]
- 44.Sterne J.A., Hernán M.A., Reeves B.C., Savović J., Berkman N.D., Viswanathan M., Henry D., Altman D.G., Ansari M.T., Boutron I., et al. ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. Br. Med. J. 2016;355:i4919. doi: 10.1136/bmj.i4919. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.McGrath S., Zhao X., Qin Z.Z., Steele R., Benedetti A. One-sample aggregate data meta-analysis of medians. Stat. Med. 2019;38:969–984. doi: 10.1002/sim.8013. [DOI] [PubMed] [Google Scholar]
- 46.Mittra A., Takebe N., Florou V., Chen A.P., Naqash A.R. The emerging landscape of immune checkpoint inhibitor based clinical trials in adults with advanced rare tumors. Hum. Vaccin Immunother. 2020:1–5. doi: 10.1080/21645515.2020.1854604. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Lamarca A., Nonaka D., Breitwieser W., Ashton G., Barriuso J., McNamara M.G., Moghadam S., Rogan J., Mansoor W., Hubner R.A., et al. PD-L1 expression and presence of TILs in small intestinal neuroendocrine tumours. Oncotarget. 2018;9:14922–14938. doi: 10.18632/oncotarget.24464. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Scoazec J.Y. Angiogenesis in neuroendocrine tumors: Therapeutic applications. Neuroendocrinology. 2013;97:45–56. doi: 10.1159/000338371. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets generated and/or analyzed during the current study are available from the corresponding author on reasonable request.