Abstract
Treatment of advanced melanoma with combined immune checkpoint inhibitor (ICI) therapy is complicated in up to 50% of cases by immune-related adverse events (irAE) that commonly include hepatitis, colitis and skin reactions. We previously reported that pre-therapy expansion of cytomegalovirus (CMV)-reactive CD4+ effector memory T cells (TEM) predicts ICI-related hepatitis in a subset of patients with Stage IV melanoma given αPD-1 and αCTLA-4. Here, we develop and validate a 10-color flow cytometry panel for reliably quantifying CD4+ TEM cells and other biomarkers of irAE risk in peripheral blood samples. Compared to previous methods, our new panel performs equally well in measuring CD4+ TEM cells (agreement = 98%) and is superior in resolving CD4+ CD197+ CD45RA- central memory T cells (TCM) from CD4+ CD197+ CD45RA+ naive T cells (Tnaive). It also enables us to precisely quantify CD14+ monocytes (CV = 6.6%). Our new “monocyte and T cell” (MoT) assay predicts immune-related hepatitis with a positive predictive value (PPV) of 83% and negative predictive value (NPV) of 80%. Our essential improvements open the possibility of sharing our predictive methods with other clinical centers. Furthermore, condensing measurements of monocyte and memory T cell subsets into a single assay simplifies our workflows and facilitates computational analyses.
Keywords: flow cytometry, assay validation, immune checkpoint inhibition, immune-related adverse events, prediction, effector memory T cells, monocytes, biomarker
Introduction
Immune checkpoint inhibitor treatment, particularly combined PD-1/CTLA-4 blockade, has dramatically improved treatment response and overall survival rates for patients with inoperable metastatic melanoma (1–6). Unfortunately, immune-related adverse reactions, such as hepatitis and colitis, are common complications that range in severity from mild reactions to life-threatening conditions (7–12). Methods to predict adverse events or tumor responses would have great clinical utility in guiding optimal therapy. Various predictive markers of adverse reactions have been reported in recent literature (13–25), including our own discovery that elevated CD4+ effector memory T cell (TEM) frequency in the blood is strongly associated with hepatitis risk after αPD-1 and αCTLA-4 treatment (26).
Our studies showed that exaggerated cytomegalovirus (CMV)-specific memory T cell responses cause liver injury in some patients with advanced melanoma receiving αPD-1 (Nivolumab) and αCTLA-4 (Ipilimumab) therapy. This surprising discovery stemmed from our observation that pre-treatment expansion of CD4+ effector memory T cells (TEM) in the blood reliably predicts hepatitis. We assume that chronic or recurrent CMV reactivation drives expansion of virus-specific CD4+ TEM cells long before starting immunotherapy (27–30); however, we are presently unable to explain why patients with metastatic melanoma might be especially susceptible to subclinical CMV reactivation. Understanding the mechanistic basis of our predictive model was important because it led us to realise that ICI-related hepatitis could be prevented with prophylactic valganciclovir. Promisingly, 4 of 4 patients classified as high-risk for hepatitis who received CMV prophylaxis starting from their first exposure to αPD-1/αCTLA-4 did not develop hepatitis (26).
Notably, our proposed etiology does not account for hepatitis in CMV-uninfected individuals, which necessarily implies that checkpoint blockade-related hepatitis has more than one cause. Hepatitis in low patients tends to occur in younger individuals with lower numbers of circulating CD14+ monocytes.
We plan to conduct a randomised, prospective, multicenter clinical trial to test the efficacy of valganciclovir prophylaxis in preventing hepatitis in CD4+ TEM high patients. Impacting our plans, the European Union passed new regulations about in vitro diagnostics (IVD) into law in 2017 (31). After a 5-year transition period, this Regulation will be mandatory from 26th May, 2022. The IVD Regulations (IVDR) set high quality and security standards. Consequently, licensing of IVD assays in Europe will require manufacturers to demonstrate the scientific validity, analytical performance and clinical performance of their product for a given indication. The scientific validity of measuring CD4+ TEM % as a risk-predictor for checkpoint blockade-related hepatitis was firmly established in our earlier studies (26). Our planned clinical trial should establish the clinical utility of our predictive models.
In this report, we describe the development of an optimised flow cytometry-based assay that consolidates measurement of CD4+ TEM cells, CD3+ T cells, PD-1+ CD8+ T cells and CD14+ monocyte frequency into a single test. This technical development streamlines sample handling in our daily clinical routine by reducing sample processing time and minimizes opportunities for technical error. In addition to assessing the analytical performance of this new assay, we investigated patient-related factors that might influence its proper interpretation. The robust preclinical performance of our “monocyte and T cell” (MoT) assay justifies its adoption for future multicentre clinical trials.
Results
Panel Design and Optimization
Previous work identified a high CD4+ TEM cell frequency in blood prior to therapy as a risk marker for PD-1/CTLA-4-related hepatitis in patients with advanced melanoma (26). In those studies, CD4+ TEM cells were defined as CD45+ CD3+ CD4+ CD8- CD45RA- CD197- events. With a view to continuity of our assay principle, this definition was not changed in our new assay. Likewise, we kept the same definition of monocytes from our previous studies – namely, CD45+ CD14+ mononuclear cells. We included CD16 into our new panel to allow a more refined subsetting of classical, intermediate and non-classical monocytes. Other groups have identified CD279 (PD-1) expression in CD8+ T cells as a marker of clinical response after αPD-1/αCTLA-4 treatment in patients with melanoma (32–37); therefore, our panel also enables quantification of CD45+ CD3+ CD4- CD8+ CD279+ events. To improve the accuracy of our cell type definitions, we included a lineage exclusion (Lin) channel to gate-out CD66b+, CD56+, CD19+ or CD20+ events. Because this panel is intended for use with fresh whole blood samples, discrimination between dead and live cells was unnecessary. Hence, our new panel included 10 parameters: CD45, Lin, CD3, CD4, CD8, CD45RA, CD197 (CCR7), CD279 (PD-1), CD14 and CD16 ( Figure 1A ).
Because we intended to develop our new panel as an IVD assay, we prioritized selection of reagents with CE/IVD labels from manufacturers with robust supply chains. With the intention of preserving as much of the original assay design as possible, T cell markers were assigned to the same channels and fluorochromes used by the DURAClone IM T cell Subset kit. Identical monoclonal antibodies (mAb) were selected for CD45, CD3, CD4, CD8, CD197 and CD279. When we compared two alternative FITC-conjugated mAb clones, we found ALB11 (Stain Index = 30.0) resolved CD45RA expression better than 2H4 (Stain Index = 14.6; Supplementary Figure 1 ). For this reason, and considering ALB11 was supplied as a CE/IVD grade reagent, we substituted 2H4-FITC with ALB11-FITC in the revised panel that was used for this study.
In previous work, we detected monocytes with CD14-PE-Cy7 (clone RMO52) and CD16-FITC (clone 3G8). For continuity, we kept CD14-PE-Cy7; however, to accommodate our T cell markers, CD16-FITC was switched for CD16-PB. Our selection of antibodies left only PE/Dazzle open for lineage exclusion.
Six of thirteen selected mAbs carry CE/IVD marking, indicating compliance with requirements for IVD products pursuant to the European Union (EU) Directive 98/79/EC. Three other mAbs are labelled as Analyte Specific Reagents (ASR), which certifies them as suitable reagents for use as active ingredients in IVD kits. All four Lin mAbs meet ISO 13485 standards. Hence, from a regulatory perspective, all antibodies chosen for our redesigned panel are suitable for inclusion into a clinical assay (38).
Next, we determined optimal concentrations of each antibody to obtain the best resolution of stained cell populations. Each antibody was titrated against fresh whole EDTA blood from healthy donors to determine a saturating amount of antibody that optimized Stain Index ( Figures 1B–N ).
Gating Strategy and Reported Parameters
Cell populations were identified according to a standardized gating strategy ( Figure 2 ). Specifically, we report the frequency of (1) CD3+ T cells % with respect to CD45+ leucocytes, (2) CD4+ TEM cell % with respect to CD4+ T cells, (3) CD14+ monocyte % with respect to CD45+ leucocytes and (4) CD279+ CD8+ T cell % with respect to CD8+ T cells. Our redesigned assay, which encompasses our choices about markers, antibodies, technical conditions, reported parameters and analysis strategy, was designated as the “MoT test”.
Assay Performance Characteristics
Precision
The precision of an analytical method is an estimate of the agreement between measured results from one sample when the assay is performed repeatedly (39). Estimating intra- and inter-assay precision allows us to guarantee the reproducibility of the measured work within a defined range.
Intra-Assay Precision
To assess intra-assay precision, we performed the MoT test with six replicates drawn from a single blood sample. One operator repeated this procedure with samples from 8 blood donors ( Figures 3A–D ). For all 4 reported values, the intra-assay precision mean CV was < 10% which is an acceptable level for such an assay (40) ( Supplementary Figure 2 ).
Inter-Assay Precision
To assess inter-assay precision, three technicians each performed the MoT test with samples from 8 healthy blood donors in parallel ( Figures 3E–H ). The inter-assay precision mean CV for all 4 reporters was < 10% which is an acceptable level for such an assay (40) ( Supplementary Figure 3 ). No statistically significant differences could be observed between operators for any of the reported values analyzed ( Figures 3I–L ). Correlations were observed between CD4+ TEM cell % and CD8+ CD279+ T cell %, between CD4+ TEM cell % and CD14+ monocyte %, as well as between CD3+ T cell and CD14+ monocyte % ( Figure 3M ).
Inter-Operator Analytical Precision
To assess the reliability of manual gating of reported populations, two experienced operators made independent analyses of 40 data files obtained from healthy donors and patients with Stage II, III and IV melanoma. Inter-operator agreement for all reported parameters was high ( Figures 4A–D ). The operators agreed in 39/40 (98%) of cases about the classification of patients’ hepatitis risk using the previously reported cut-off value of CD4+ TEM ≥ 16% (26).
Robustness
Robustness describes the susceptibility of an assay to changes in experimental conditions, both pre- and post-sample preparation (41). The purpose of stability testing is to define a range of conditions for sample handling that do not perturb assay performance. The most relevant conditions to consider in this case are sample storage temperature and storage duration before and after processing.
Pre-Processing Stability
To assess pre-processing stability, blood samples from four healthy donors were either stored at 4°C or room temperature (RT). Sample processing was either started immediately (0h) or delayed until 1h, 2h, 3h, 4h, 6h and 8h after sample collection. No significant changes in reported parameters were observed over a storage time of 8h at 4°C or RT ( Figures 5A–D ).
Post-Processing Stability
To assess the stability of samples after preparation but prior to measurement, we compared blood samples from healthy donors that were processed immediately after blood draw. Measurements were then made directly after staining (0 min) or delayed until 15, 30, 45, 60, 90 or 120 min post-processing. Samples were stored at 4°C in the dark until data acquisition. Frequencies of all reported values were stable up to 90 mins ( Figures 5E, F ). Accordingly, data must be acquired within 90 mins of sample processing, which is feasible in our clinical routine.
Accuracy
Accuracy describes the closeness of agreement between the measured value and the true value. For most diagnostic tests, accuracy is assessed by calibrating measured values to some external reference material; however, as widely discussed in the literature (42–44), this is not an easy approach to apply to flow cytometry measurements.
External Reference Materials
In principle, the accuracy of a flow cytometry-based assay can be monitored over time against a standardized reference material; however, in practice, stabilizing cells for long-term storage often alters their optical qualities. We investigated whether two commercially available reference materials (i.e., Streck CD-Chex Plus and Beckman Coulter ClearLLab Control Cells Normal) were suitable controls for the MoT test. The physical properties, autofluorescence and staining intensity of cell-surface markers of cells from both preparations were not comparable to cells from fresh blood samples ( Supplementary Figure 4 ). Therefore, these reference materials were unsuitable for our purposes.
Method Comparison
To ensure continuity of our assay principle, we must be confident that we accurately quantify the same marker populations used to generate our predictive models (45). Therefore, we next compared results from previous panel designs to those generated with the MoT test. Samples from 83 melanoma patients with Stage II, III or IV disease were analyzed in parallel using the MoT test, DURAClone IM T cell subsets tube and DURAClone IM Phenotyping Basic tube ( Figures 6A–D ). A strong correlation between methods was observed for all reported parameters besides CD14+ monocytes, which showed a moderate correlation (R2 = 0.606). Our previous work established a cut-off ≥16% CD4+ TEM cells as a predictor of checkpoint blockade-related hepatitis in CMV Ig+ patients (26). The DURAClone IM T cell subsets tube and MoT assay agreed in 81/83 cases (98%) when classifying patients as CD4+ TEM ≥16% or CD4+ TEM <16% Furthermore, the MoT test performed well in predicting hepatitis in a cohort of 16 Stage IV melanoma patients ( Figure 6E ). Hepatitis was correctly predicted in 5 of 6 CMV IgG+ CD4+ TEM ≥16% melanoma patients, which corresponds to a PPV of 83% and NPV of 80% ( Figure 6F ).
Age, Sex and Disease-Related Bias
To examine the applicability of the MoT test in a clinical setting, we analyzed blood samples from 100 patients with Stage II, III or IV melanoma. No relation to patient age was observed for CD3+ T cells ( Figure 7A ), CD4+ TEM cells ( Figure 7B ), CD279+ CD8+ T cells ( Figure 7C ) or CD14+ monocytes ( Figure 7D ). Of interest, our analysis revealed higher frequencies of CD279+ CD8+ T cells ( Figure 7G ) and CD14+ monocytes ( Figure 7H ) in male patients. CD3+ T cells ( Figure 7E ) and CD4+ TEM cells ( Figure 7F ) showed no sex-dependent differences. Notably, a tumor stage-dependent increase in CD4+ TEM cells ( Figure 7J ) was observed. CD3+ T cells, CD279+ CD8+ T cells and CD14+ monocytes showed no stage-dependent differences ( Figures 7I, K, L ).
Seasonality
Seasonality is an important environmental factor that influences immune responses (46, 47). Samples from 100 melanoma patients (Stage II, III and IV) which were stained using the MoT test were collected from December 2020 until June 2021. Season-dependent frequencies of immune cell populations were assessed ( Supplementary Figure 5 ). CD4+ T cells showed a tendency to be increased in spring and summer whereas CD8+ T cells showed a tendency decrease.
SPADE Analysis of Flow Cytometry Data Resulting From the MoT test
To further explore tumor stage-related influences over the peripheral blood T cell and monocyte compartments, we analyzed data generated using the MoT test from patients with Stage-II (n=52), -III (n=21) or –IV (n=27) melanoma. Unsupervised grouping of flow cytometry data using SPADE defined 200 cell clusters ( Supplementary Figure 6 ). Comparing cell frequencies in clusters representing >0.25% of all events ( Supplementary Figure 7 ) revealed tumor stage-associated differences in five nodes ( Figures 8A–E ). Investigating these clusters in Kaluza (software version 2.1) revealed an association between tumor stage and CD279- naïve CD8+ T cells ( Figure 8F ), CD279+ CD8+ TCM ( Figure 8G ), CD279+ CD8mid TEM ( Figure 8H ) and CD279+ CD8mid TCM ( Figure 8I ) as well as CD279high CD4+ TCM ( Figure 8J ). Hence, apart from predicting the risk of immune-related adverse reactions in melanoma patients, the MoT test also captures some information about intra- and extra-nodal metastasis of melanoma.
Discussion
Here, we developed and assessed the performance of a new flow cytometry-based assay for the prediction of checkpoint blockade-related complications. This assay is a refinement of methods used previously to develop a predictive model for hepatitis following combined αPD-1/αCTLA-4. Specifically, we adapted the assay design to include measurements of monocyte subsets together with CD279+ CD8+ T cells, which may be useful parameters for predicting treatment-related hepatitis, clinical response to therapy or tumor staging (48, 49).
The performance characteristics of the MoT test were satisfactory in all respects (50). Most importantly, we found good agreement between results from the MoT test and earlier methods; therefore, our developments have not changed the underlying principle of the assay. We now intend to have our new antibody panel custom-manufactured in a dried-down format, which is more convenient for routine diagnostic work and minimises technical variation (51, 52). Accordingly, the MoT test simplifies processing of samples, data collection and analysis without compromising accuracy, precision or robustness. These improvements will make it easier to establish our predictive method at collaborating clinical centres. Ultimately, we hope the MoT test will be registered as a CE/IVD device and implemented as a routine clinical method.
It is surprising that so much predictive information is reflected in the distribution of memory T cell and monocytes in blood of patients with melanoma. Combining all relevant parameters in a single dataset makes this information more amenable to algorithmic analysis. By collecting data from a very large number of patients, we expect to improve our prediction of checkpoint blockade-related complications and, perhaps, also to predict clinical outcomes or detect occult metastasis using a simple, relatively inexpensive test.
Materials & Methods
Study Approval and Patient Management
Peripheral blood samples were obtained from a heterogeneous group of healthy donors from the department of Transfusion Medicine at UKR or from Stage-II, -III, or –IV melanoma patients who participated in an observational clinical trial authorized by the local ethics committee (approval 16-101-0125). All participants gave full, informed written consent.
Clinical Flow Cytometry
Detailed step-by-step protocols for preparation and analysis of blood samples by flow cytometry are available as Supplementary Methods . In brief, peripheral blood samples were collected into EDTA-vacutainers by venepuncture and then delivered to the immune monitoring laboratory at ambient temperature. Pre-analytical samples were stored for up to 4 hours at 4°C until processing. Whole blood was stained with DURAClone IM Phenotyping Basic Tube (B53309), DURAClone IM T cell subsets Tube (B53328; both from Beckman Coulter, Krefeld, Germany) or with the following liquid antibodies of the MoT test: CD45RA FITC (A07786), CD197 PE (B30632), CD279 PC5.5 (B36123), CD14 PC7 (A22331), CD4 APC (IM2468), CD8 AA700 (B49181), CD3 AA750 (A94680), CD16 PB (B36292) and CD45 KrO (B36294), all from Beckman Coulter, Krefeld, Germany and the following PE/Dazzle 594 conjugated liquid antibodies CD19 (#302252), CD20 (#302348), CD56 (#318348) and CD66b (#396912) from BioLegend, San Diego, CA. Data were recorded with a Navios™ cytometer running Cytometry List Mode Data Acquisition and Analysis Software version 1.3 (Beckman Coulter). Analyses were performed using Kaluza software version 2.1 (Beckman Coulter).
Statistics and Visualisation
Data visualisation, significance tests, regression analyses and correlations were calculated using GraphPad Prism version 9.1.1 (GraphPad Software, Inc., La Jolla, USA).
SPADE Analysis
For advanced visualisation and reduction of dimensionality, multi-parameter flow cytometry data of melanoma patients were analyzed using the SPADE algorithm available on Cytobank Premium platform (Cytobank Inc., Santa Clara, CA). Briefly, whole EDTA blood samples were processed using the MoT test. Acquired data were analyzed in Kaluza (software version 2.1) according to the described gating strategy. Compensated events were exported through the CD45+ Leucocyte gate and uploaded to Cytobank. After scaling and gating of uploaded data, we ran a SPADE analysis on Lin- cells with a target number of nodes set to 200 and a density-dependent downsampling target of 10%. SPADE clusters were re-exported and further analyzed using Kaluza software version 2.1 (Beckman Coulter, Krefeld, Germany).
Data Availability Statement
Relevant data are available from the corresponding author upon reasonable request.
Ethics Statement
The studies involving human participants were reviewed and approved by Ethics Committee University of Regensburg. The patients provided their written informed consent to participate in this study.
Author Contributions
H-LS, JAH, and KK designed experiments, analyzed data and wrote the manuscript. GG provided expert statistical advice. MK provided expert flow cytometry advice. NA provided expert opinion in Laboratory Medicine. PR, LC, and FB revised the manuscript. HS and EG provided infrastructural support. SH provided clinical samples and expert Dermatological opinion. All authors contributed to the article and approved the submitted version.
Funding
The authors gratefully acknowledge the financial support of the Bristol-Myers Squibb (BMS) Immune Oncology Foundation (Award FA19-009).
Conflict of Interest
MK is a Beckman Coulter Life Sciences associate. SH has received consulting fees and speaker’s honoraria from BMS and Merck Sharp & Dohme (MSD). NA is employed by MVZ for Laboratory Medicine Raubling.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
The authors are grateful to The Bristol Myers Squibb Foundation for Immuno-Oncology (Award FA-19-009) for funding this work. Additional support was provided by the German Research Foundation to S.H. (DFG HA 8481/1-1) and J.A.H. (DFG HU 1838/1-1; DFG HU 1838/2-1). L.C. is a Marie Skłodowska-Curie Research Fellow affiliated with INsTRuCT and receives funding from the European Union’s Horizon 2020 research and innovation programme (Award 860003). The authors also thank Prof. Tobias Pukrop and staff of the Interdisciplinary Center for drug Tumor Therapy (ICT) for supporting collection of clinical samples. This work would not have been possible without the outstanding technical support of Erika Ostermeier.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fimmu.2021.765644/full#supplementary-material
Abbreviations
AA700, Allophycocyanin Alexa Fluor® 700 [Alexa Fluor® 700 carboxylic acid, succinimidyl ester, tris(triethylammonium salt)] (A700); AA750, Allophycocyanin Alexa Fluor® 750 [Alexa Fluor® 750 carboxylic acid, succinimidyl ester, tris (triethylammonium salt)] (APC-A750); APC, Allophycocyanin; ASR, Analyte Specific Reagent; B.H., Benjamini-Hochberg procedure; BMS, Bristol-Myers Squibb; CE, Conformité Européenne; CMV, cytomegalovirus; CTCAE, Common Terminology Criteria for Adverse Events; CTLA-4, cytotoxic T-lymphocyte-associated protein 4; CV, coefficient of variation; EDTA, ethylenediaminetetraacetic acid; EU, European Union; FITC, Fluoresceinisothiocyanate; FDR, False Discovery Rate; h, hour; ICB, immune checkpoint blockade; ICI, immune checkpoint inhibitor; Ig, immunoglobulin; irAE, immune-related adverse events; IVDR, in vitro diagnostic regulation; KrO, Krome Orange; K.W. test, Kruskal Wallis test; Lin, lineage; MFI, mean fluorescence intensity; min, minute; NK cell, natural killer cell; NPV, negative predictive value; PB, Pacific Blue; PC5.5, Phycoerythrin-Cyanine 5.5; PC7, Phycoerythrin-Cyanine 7; PD-1, programmed cell death protein 1; PE, Phycoerythrin; PPV, positive predictive value; RT, room temperature; RUO, research use only; SI, stain index; SD, standard deviation; SPADE, spanning-tree progression analysis of density-nomalized events; TCM, central memory T cells; TEM, effector memory T cells; TEMRA, CD45RA+ effector memory T cells; Tnaive, naive T cells; UKR, University Hospital Regensburg.
References
- 1. Larkin J, Chiarion-Sileni V, Gonzalez R, Grob J-J, Rutkowski P, Lao CD, et al. Five-Year Survival With Combined Nivolumab and Ipilimumab in Advanced Melanoma. N Engl J Med (2019) 381(16):1535–46. doi: 10.1056/NEJMoa1910836 [DOI] [PubMed] [Google Scholar]
- 2. Robert C, Ribas A, Schachter J, Arance A, Grob J-J, Mortier L, et al. Pembrolizumab Versus Ipilimumab in Advanced Melanoma (KEYNOTE-006): Post-Hoc 5-Year Results From an Open-Label, Multicentre, Randomised, Controlled, Phase 3 Study. Lancet Oncol (2019) 20(9):1239–51. doi: 10.1016/S1470-2045(19)30388-2 [DOI] [PubMed] [Google Scholar]
- 3. Robert C, Long GV, Brady B, Dutriaux C, Maio M, Mortier L, et al. Nivolumab in Previously Untreated Melanoma Without BRAF Mutation. N Engl J Med (2015) 372(4):320–30. doi: 10.1056/NEJMoa1412082 [DOI] [PubMed] [Google Scholar]
- 4. Wolchok JD, Chiarion-Sileni V, Gonzalez R, Rutkowski P, Grob J-J, Cowey CL, et al. Overall Survival With Combined Nivolumab and Ipilimumab in Advanced Melanoma. N Engl J Med (2017) 377(14):1345–56. doi: 10.1056/NEJMoa1709684 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Postow MA, Chesney J, Pavlick AC, Robert C, Grossmann K, McDermott D, et al. Nivolumab and Ipilimumab Versus Ipilimumab in Untreated Melanoma. N Engl J Med (2015) 372(21):2006–17. doi: 10.1056/NEJMoa1414428 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Hodi FS, Chiarion-Sileni V, Gonzalez R, Grob J-J, Rutkowski P, Cowey CL, et al. Nivolumab Plus Ipilimumab or Nivolumab Alone Versus Ipilimumab Alone in Advanced Melanoma (CheckMate 067): 4-Year Outcomes of a Multicentre, Randomised, Phase 3 Trial. Lancet Oncol (2018) 19(11):1480–92. doi: 10.1016/S1470-2045(18)30700-9 [DOI] [PubMed] [Google Scholar]
- 7. Postow MA, Sidlow R, Hellmann MD. Immune-Related Adverse Events Associated With Immune Checkpoint Blockade. N Engl J Med (2018) 378(2):158–68. Longo DL, Editor. doi: 10.1056/NEJMra1703481 [DOI] [PubMed] [Google Scholar]
- 8. Martins F, Sofiya L, Sykiotis GP, Lamine F, Maillard M, Fraga M, et al. Adverse Effects of Immune-Checkpoint Inhibitors: Epidemiology, Management and Surveillance. Nat Rev Clin Oncol (2019) 16(9):563–80. doi: 10.1038/s41571-019-0218-0 [DOI] [PubMed] [Google Scholar]
- 9. Schadendorf D, Wolchok JD, Hodi FS, Chiarion-Sileni V, Gonzalez R, Rutkowski P, et al. Efficacy and Safety Outcomes in Patients With Advanced Melanoma Who Discontinued Treatment With Nivolumab and Ipilimumab Because of Adverse Events: A Pooled Analysis of Randomized Phase II and III Trials. J Clin Oncol (2017) 35(34):3807–14. doi: 10.1200/JCO.2017.73.2289 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Thompson JA, Schneider BJ, Brahmer J, Andrews S, Armand P, Bhatia S, et al. Management of Immunotherapy-Related Toxicities, Version 1.2019, NCCN Clinical Practice Guidelines in Oncology. J Natl Compr Canc Netw (2019) 17(3):255–89. doi: 10.6004/jnccn.2019.0013 [DOI] [PubMed] [Google Scholar]
- 11. Teufel A, Zhan T, Härtel N, Bornschein J, Ebert MP, Schulte N. Management of Immune Related Adverse Events Induced by Immune Checkpoint Inhibition. Cancer Lett (2019) 456:80–7. doi: 10.1016/j.canlet.2019.04.018 [DOI] [PubMed] [Google Scholar]
- 12. Larkin J, Chiarion-Sileni V, Gonzalez R, Grob JJ, Cowey CL, Lao CD, et al. Combined Nivolumab and Ipilimumab or Monotherapy in Untreated Melanoma. N Engl J Med (2015) 373(1):23–34. doi: 10.1056/NEJMoa1504030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Ramos-Casals M, Brahmer JR, Callahan MK, Flores-Chávez A, Keegan N, Khamashta MA, et al. Immune-Related Adverse Events of Checkpoint Inhibitors. Nat Rev Dis Primers (2020) 6(1):38. doi: 10.1038/s41572-020-0160-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Subudhi SK, Aparicio A, Gao J, Zurita AJ, Araujo JC, Logothetis CJ, et al. Clonal Expansion of CD8 T Cells in the Systemic Circulation Precedes Development of Ipilimumab-Induced Toxicities. Proc Natl Acad Sci USA (2016) 113(42):11919–24. doi: 10.1073/pnas.1611421113 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Johnson DB, Balko JM, Compton ML, Chalkias S, Gorham J, Xu Y, et al. Fulminant Myocarditis With Combination Immune Checkpoint Blockade. N Engl J Med (2016) 375(18):1749–55. doi: 10.1056/NEJMoa1609214 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Byrne EH, Fisher DE. Immune and Molecular Correlates in Melanoma Treated With Immune Checkpoint Blockade. Cancer (2017) 123(S11):2143–53. doi: 10.1002/cncr.30444 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Gowen MF, Giles KM, Simpson D, Tchack J, Zhou H, Moran U, et al. Baseline Antibody Profiles Predict Toxicity in Melanoma Patients Treated With Immune Checkpoint Inhibitors. J Transl Med (2018) 16(1):82. doi: 10.1186/s12967-018-1452-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Tahir SA, Gao J, Miura Y, Blando J, Tidwell RSS, Zhao H, et al. Autoimmune Antibodies Correlate With Immune Checkpoint Therapy-Induced Toxicities. Proc Natl Acad Sci (2019) 116(44):22246–51. doi: 10.1073/pnas.1908079116 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Das R, Bar N, Ferreira M, Newman AM, Zhang L, Bailur JK, et al. Early B Cell Changes Predict Autoimmunity Following Combination Immune Checkpoint Blockade. J Clin Invest (2018) 128(2):715–20. doi: 10.1172/JCI96798 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Tarhini AA, Zahoor H, Lin Y, Malhotra U, Sander C, Butterfield LH, et al. Baseline Circulating IL-17 Predicts Toxicity While TGF-β1 and IL-10 Are Prognostic of Relapse in Ipilimumab Neoadjuvant Therapy of Melanoma. J Immunother Cancer (2015) 3(1):39. doi: 10.1186/s40425-015-0081-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Khan S, Khan SA, Luo X, Fattah FJ, Saltarski J, Gloria-McCutchen Y, et al. Immune Dysregulation in Cancer Patients Developing Immune-Related Adverse Events. Br J Cancer (2019) 120(1):63–8. doi: 10.1038/s41416-018-0155-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Iwama S, De Remigis A, Callahan MK, Slovin SF, Wolchok JD, Caturegli P. Pituitary Expression of CTLA-4 Mediates Hypophysitis Secondary to Administration of CTLA-4 Blocking Antibody. Sci Transl Med (2014) 6(230):230ra45. doi: 10.1126/scitranslmed.3008002 [DOI] [PubMed] [Google Scholar]
- 23. Shahabi V, Berman D, Chasalow SD, Wang L, Tsuchihashi Z, Hu B, et al. Gene Expression Profiling of Whole Blood in Ipilimumab-Treated Patients for Identification of Potential Biomarkers of Immune-Related Gastrointestinal Adverse Events. J Transl Med (2013) 11:75. doi: 10.1186/1479-5876-11-75 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Chaput N, Lepage P, Coutzac C, Soularue E, Le Roux K, Monot C, et al. Baseline Gut Microbiota Predicts Clinical Response and Colitis in Metastatic Melanoma Patients Treated With Ipilimumab. Ann Oncol (2017) 28(6):1368–79. doi: 10.1093/annonc/mdx108 [DOI] [PubMed] [Google Scholar]
- 25. Bomze D, Hasan Ali O, Bate A, Flatz L. Association Between Immune-Related Adverse Events During Anti–PD-1 Therapy and Tumor Mutational Burden. JAMA Oncol (2019) 5(11):1633. doi: 10.1001/jamaoncol.2019.3221 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Hutchinson JA, Kronenberg K, Riquelme P, Wenzel JJ, Glehr G, Schilling H-L, et al. Virus-Specific Memory T Cell Responses Unmasked by Immune Checkpoint Blockade Cause Hepatitis. Nat Commun (2021) 12(1):1439. doi: 10.1038/s41467-021-21572-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Meesing A, Razonable RR. New Developments in the Management of Cytomegalovirus Infection After Transplantation. Drugs (2018) 78(11):1085–103. doi: 10.1007/s40265-018-0943-1 [DOI] [PubMed] [Google Scholar]
- 28. Marzo AL, Klonowski KD, Bon AL, Borrow P, Tough DF, Lefrançois L. Initial T Cell Frequency Dictates Memory CD8+ T Cell Lineage Commitment. Nat Immunol (2005) 6(8):793–9. doi: 10.1038/ni1227 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Wherry EJ, Teichgräber V, Becker TC, Masopust D, Kaech SM, Antia R, et al. Lineage Relationship and Protective Immunity of Memory CD8 T Cell Subsets. Nat Immunol (2003) 4(3):225–34. doi: 10.1038/ni889 [DOI] [PubMed] [Google Scholar]
- 30. Jelley-Gibbs DM, Dibble JP, Filipson S, Haynes L, Kemp RA, Swain SL. Repeated Stimulation of CD4 Effector T Cells Can Limit Their Protective Function. J Exp Med (2005) 201(7):1101–12. doi: 10.1084/jem.20041852 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. European Parliament . In Vitro Diagnostics Regulations. Off J Eur Union (2017) L117:176–332. [Google Scholar]
- 32. Heeren AM, Rotman J, Stam AGM, Pocorni N, Gassama AA, Samuels S, et al. Efficacy of PD-1 Blockade in Cervical Cancer Is Related to a CD8+FoxP3+CD25+ T-Cell Subset With Operational Effector Functions Despite High Immune Checkpoint Levels. J Immunother Cancer (2019) 7(1):43. doi: 10.1186/s40425-019-0526-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Shirinbak S, Chan RY, Shahani S, Muthugounder S, Kennedy R, Hung LT, et al. Combined Immune Checkpoint Blockade Increases CD8+CD28+PD-1+ Effector T Cells and Provides a Therapeutic Strategy for Patients With Neuroblastoma. Oncoimmunology (2021) 10(1):1838140. doi: 10.1080/2162402X.2020.1838140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Kumagai S, Togashi Y, Kamada T, Sugiyama E, Nishinakamura H, Takeuchi Y, et al. The PD-1 Expression Balance Between Effector and Regulatory T Cells Predicts the Clinical Efficacy of PD-1 Blockade Therapies. Nat Immunol (2020) 21(11):1346–58. doi: 10.1038/s41590-020-0769-3 [DOI] [PubMed] [Google Scholar]
- 35. Kansy BA, Concha-Benavente F, Srivastava RM, Jie H-B, Shayan G, Lei Y, et al. PD-1 Status in CD8 + T Cells Associates With Survival and Anti-PD-1 Therapeutic Outcomes in Head and Neck Cancer. Cancer Res (2017) 77(22):6353–64. doi: 10.1158/0008-5472.CAN-16-3167 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Gros A, Robbins PF, Yao X, Li YF, Turcotte S, Tran E, et al. PD-1 Identifies the Patient-Specific CD8+ Tumor-Reactive Repertoire Infiltrating Human Tumors. J Clin Invest (2014) 124(5):2246–59. doi: 10.1172/JCI73639 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Zou W, Wolchok JD, Chen L. PD-L1 (B7-H1) and PD-1 Pathway Blockade for Cancer Therapy: Mechanisms, Response Biomarkers, and Combinations. Sci Transl Med (2016) 8(328):328rv4. doi: 10.1126/scitranslmed.aad7118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Cunliffe J, Derbyshire N, Keeler S, Coldwell R. An Approach to the Validation of Flow Cytometry Methods. Pharm Res (2009) 26(12):2551–7. doi: 10.1007/s11095-009-9972-5 [DOI] [PubMed] [Google Scholar]
- 39. European Medicines Agency . Note for Guidance on Validation of Analytical Procedures. London: European Medicines Agency (EMEA) (1995). [Google Scholar]
- 40. FDA . Bioanalytical Method Validation. Guidance for Industry, Silver Spring, MD: U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research (CDER); Rockville, MD: Center for Veterinary Medicine (CVM) Vol. 44. (2018). [Google Scholar]
- 41. Andreasson U, Perret-Liaudet A, van Waalwijk van Doorn LJC, Blennow K, Chiasserini D, Engelborghs S, et al. A Practical Guide to Immunoassay Method Validation. Front Neurol (2015) 6. doi: 10.3389/fneur.2015.00179 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Staats J, Divekar A, McCoy JP, Maecker HT. “Guidelines for Gating Flow Cytometry Data for Immunological Assays”. In: McCoy JP, Jr., editor. Immunophenotyping. New York, NY: Springer New York; (2019). p. 81–104. [DOI] [PubMed] [Google Scholar]
- 43. Wang L, Hoffman RA. Standardization, Calibration, and Control in Flow Cytometry. Curr Protoc Cytom (2017) 79(1):1.3.1-1.3.27. doi: 10.1002/cpcy.14 [DOI] [PubMed] [Google Scholar]
- 44. Maecker HT, McCoy JP, Nussenblatt R. Standardizing Immunophenotyping for the Human Immunology Project. Nat Rev Immunol (2012) 12(3):191–200. doi: 10.1038/nri3158 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Morgan CJ, Aban I. Methods for Evaluating the Agreement Between Diagnostic Tests. J Nucl Cardiol (2016) 23(3):511–3. doi: 10.1007/s12350-015-0175-7 [DOI] [PubMed] [Google Scholar]
- 46. Aguirre-Gamboa R, Joosten I, Urbano PCM, van der Molen RG, van Rijssen E, van Cranenbroek B, et al. Differential Effects of Environmental and Genetic Factors on T and B Cell Immune Traits. Cell Rep (2016) 17(9):2474–87. doi: 10.1016/j.celrep.2016.10.053 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Ter Horst R, Jaeger M, van de Wijer L, van der Heijden WA, Janssen AMW, Smeekens SP, et al. Seasonal and Nonseasonal Longitudinal Variation of Immune Function. J Immunol (2021) 207:696–708. doi: 10.4049/jimmunol.2000133 [DOI] [PubMed] [Google Scholar]
- 48. Reschke R, Gussek P, Boldt A, Sack U, Köhl U, Lordick F, et al. Distinct Immune Signatures Indicative of Treatment Response and Immune-Related Adverse Events in Melanoma Patients Under Immune Checkpoint Inhibitor Therapy. Int J Mol Sci (2021) 22(15):8017. doi: 10.3390/ijms22158017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Shibru B, Fey K, Fricke S, Blaudszun AR, Fürst F, Weise M, et al. Detection of Immune Checkpoint Receptors - A Current Challenge in Clinical Flow Cytometry. Front Immunol (2021) 12:694055. doi: 10.3389/fimmu.2021.694055 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50. Lee JW, Weiner RS, Sailstad JM, Bowsher RR, Knuth DW, O’Brien PJ, et al. Method Validation and Measurement of Biomarkers in Nonclinical and Clinical Samples in Drug Development: A Conference Report. Pharm Res (2005) 22(4):499–511. doi: 10.1007/s11095-005-2495-9 [DOI] [PubMed] [Google Scholar]
- 51. Allinson JL. Clinical Biomarker Validation. Bioanalysis (2018) 10(12):957–68. doi: 10.4155/bio-2018-0061 [DOI] [PubMed] [Google Scholar]
- 52. Lee JW, Devanarayan V, Barrett YC, Weiner R, Allinson J, Fountain S, et al. Fit-For-Purpose Method Development and Validation for Successful Biomarker Measurement. Pharm Res (2006) 23(2):312–28. doi: 10.1007/s11095-005-9045-3 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Relevant data are available from the corresponding author upon reasonable request.