Abstract
Background:
Checkpoint inhibitor therapy of cancer has led to markedly improved survival of a subset of patients in multiple solid malignant tumor types, yet the factors driving these clinical responses or lack thereof are not known. We have developed a mechanistic mathematical model for better understanding these factors and their relations in order to predict treatment outcome and optimize personal treatment strategies.
Methods:
Here, we present a translational mathematical model dependent on three key parameters for describing efficacy of checkpoint inhibitors in human cancer: tumor growth rate (α), tumor-immune infiltration (Λ), and immunotherapy-mediated amplification of anti-tumor response (µ). The model was calibrated by fitting it to a compiled clinical tumor response dataset (n = 189 patients) obtained from published anti-PD-1 and anti-PD-L1 clinical trials, and then validated on an additional validation cohort (n = 64 patients) obtained from our in-house clinical trials.
Results:
The derived parameters Λ and µ were both significantly different between responding versus nonresponding patients. Of note, our model appropriately classified response in 81.4% of patients by using only tumor volume measurements and within 2 months of treatment initiation in a retrospective analysis. The model reliably predicted clinical response to the PD-1/PD-L1 class of checkpoint inhibitors across multiple solid malignant tumor types. Comparison of model parameters to immunohistochemical measurement of PD-L1 and CD8+ T cells confirmed robust relationships between model parameters and their underlying biology.
Conclusions:
These results have demonstrated reliable methods to inform model parameters directly from biopsy samples, which are conveniently obtainable as early as the start of treatment. Together, these suggest that the model parameters may serve as early and robust biomarkers of the efficacy of checkpoint inhibitor therapy on an individualized per-patient basis.
Funding:
We gratefully acknowledge support from the Andrew Sabin Family Fellowship, Center for Radiation Oncology Research, Sheikh Ahmed Center for Pancreatic Cancer Research, GE Healthcare, Philips Healthcare, and institutional funds from the University of Texas M.D. Anderson Cancer Center. We have also received Cancer Center Support Grants from the National Cancer Institute (P30CA016672 to the University of Texas M.D. Anderson Cancer Center and P30CA072720 the Rutgers Cancer Institute of New Jersey). This research has also been supported in part by grants from the National Science Foundation Grant DMS-1930583 (ZW, VC), the National Institutes of Health (NIH) 1R01CA253865 (ZW, VC), 1U01CA196403 (ZW, VC), 1U01CA213759 (ZW, VC), 1R01CA226537 (ZW, RP, WA, VC), 1R01CA222007 (ZW, VC), U54CA210181 (ZW, VC), and the University of Texas System STARS Award (VC). BC acknowledges support through the SER Cymru II Programme, funded by the European Commission through the Horizon 2020 Marie Skłodowska-Curie Actions (MSCA) COFUND scheme and the Welsh European Funding Office (WEFO) under the European Regional Development Fund (ERDF). EK has also received support from the Project Purple, NIH (U54CA210181, U01CA200468, and U01CA196403), and the Pancreatic Cancer Action Network (16-65-SING). MF was supported through NIH/NCI center grant U54CA210181, R01CA222959, DoD Breast Cancer Research Breakthrough Level IV Award W81XWH-17-1-0389, and the Ernest Cockrell Jr. Presidential Distinguished Chair at Houston Methodist Research Institute. RP and WA received serial research awards from AngelWorks, the Gillson-Longenbaugh Foundation, and the Marcus Foundation. This work was also supported in part by grants from the National Cancer Institute to SHC (R01CA109322, R01CA127483, R01CA208703, and U54CA210181 CITO pilot grant) and to PYP (R01CA140243, R01CA188610, and U54CA210181 CITO pilot grant). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Research organism: Human
Introduction
Recent advances in the understanding of immunological pathways responsible for antibody- and/or cell-mediated destruction of tumors have led to the development of unique cancer therapeutics in recent years, leading to markedly improved survival in the setting of previously intractable metastatic melanoma, bladder, kidney, lung, and head and neck cancers, among several other human solid tumor types (Borghaei et al., 2015; Robert et al., 2015a; Robert et al., 2015b). In particular, one of the most successful clinical applications of immune checkpoint inhibitors includes antibodies directed against the programmed death protein 1 (PD-1) pathway, which inhibits cellular immune killing of cancer cells via complementary binding of tumor expressed programmed death ligand 1 (PD-L1) to PD-1 on immune cells (Pardoll, 2012). As a still emerging yet quite compelling immunotherapy approach in contemporary cancer medicine, targeting of immune checkpoints is being extensively investigated in ongoing and upcoming clinical trials aimed at unleashing T cell activity, augmenting immune recognition against tumor metastases, and boosting immune memory for long-lasting clinical remission post-treatment (Postow et al., 2015; Le et al., 2017). While the remarkable potential for checkpoint inhibitors in treating cancer is unequivocally exciting, the combined clinical trial experience has shown that durable effective treatment outcomes occur only in a limited subset of patients (Sharma et al., 2017). Alas, some cancer types are presumed to be minimally immunogenic, resulting in little or no response to this treatment strategy (Brahmer et al., 2012). An accumulating body of evidence has established that certain immunological features, including T cell exhaustion (e.g., Tim-3) and exclusion (Jerby-Arnon et al., 2018), senescence markers (Moreira et al., 2019) such as CD57, or immune incompetence, exhaustion, or premature senescence (e.g., loss of CD27) (Riaz et al., 2017; Vallejo, 2005), could perhaps reflect or even predict sensitivity and resistance to checkpoint inhibitor-based cancer immunotherapy. However, early attempts at identification of specific pathological biomarkers to predict immunotherapy response, including transcriptomic rubrics (Auslander et al., 2018), machine learning algorithms (Johannet et al., 2021), genomic approaches (Cormedi et al., 2021) such as tumor mutational burden (Duffy and Crown, 2019), among others (Pilard et al., 2021), have thus far shown somewhat inconsistent results, challenged further by the inherent molecular, cellular, and biophysical diversity of human tumors (Teng et al., 2015; Tumeh et al., 2014; Carbognin et al., 2015). Instead, most currently applied parameters merely document tumor responses that have already occurred as opposed to predicting it a priori; these include the standard Response Evaluation Criteria in Solid Tumor (RECIST) v1.1 (Eisenhauer et al., 2009) and even the newer proposed response assessment rubrics specific for immunotherapy (iRECIST). Considering the sheer complexity of the biological interactions between the immune system and the tumor microenvironment, one could reason that the introduction of more sophisticated mathematical analytic techniques would hopefully have potential to enhance the qualitative and quantitative understanding of such interactions and to improve malignant tumor treatment with checkpoint inhibitors, ultimately supporting the development of a predictive clinical tool that could either minimize or overcome this clear unmet need of cancer medicine.
In previous work, mechanistic mathematical models of immunomodulatory interventions for cancer control utilizing coupled ordinary differential equations (ODEs) have already allowed the prediction of tumor response after Bacillus Calmette–Guérin (BCG) administration in superficial transitional cell carcinoma of the urinary bladder and the serum prostate-specific antigen response after prostate cancer vaccine administration with considerable accuracy (Bunimovich-Mendrazitsky et al., 2016; Bunimovich-Mendrazitsky et al., 2007; Kronik et al., 2010). Moreover, other investigators have shown that mechanistic models of interleukin-21 (IL-21) therapy schedules based on tumor mass and antigenic properties can predict growth patterns of multiple tumor types in patients receiving personalized doses of IL-21 (de Pillis et al., 2005). In another notable work, mathematical modeling of neoantigen fitness based on cancer population evolution and antigen recognition potential was able to predict tumor response and patient survival following treatment with checkpoint blockade therapy, as validated in both melanoma patients treated with anti-CTLA4 and in lung cancer patients treated with anti-PD-1 therapies (Łuksza et al., 2017). Finally, modeling of chemotherapy and targeted drug therapy by our group with similar mathematical techniques was able to accurately reproduce entire dose–response curves of tumor cell kill with untargeted cytotoxic and ligand-directed agents (Pascal et al., 2013a; Hosoya et al., 2016; Dogra et al., 2018; Goel et al., 2019; Dogra et al., 2020b). These examples highlight the previous success of mathematical models to qualitatively or quantitatively discern the underlying biologically and physically relevant, often nonlinear processes present in cancer, which may otherwise be missed, and help optimize treatment delivery approaches.
The innovation and scope of the present study is to demonstrate how standard clinical measures, including radiological imaging assessments and immunohistochemical (IHC) analysis of tissue samples, may inform a mechanistic mathematical model to elucidate patient and tumor-specific attributes that would likely benefit from the application of checkpoint inhibitor-based therapy. Our model parameters, which can be determined in multiple ways (e.g., from early time point imaging and/or histopathology data), present a clear advantage over the standard measures currently used in the clinic for predicting treatment outcome and patient survival. The mathematical model presented in this report is based on an extensive series of prior methodological reports (Pascal et al., 2013a; Hosoya et al., 2016; Dogra et al., 2018; Goel et al., 2019; Dogra et al., 2020b; Das et al., 2013; Pascal et al., 2013b; Wang et al., 2016; Koay et al., 2014; Frieboes et al., 2015; Wang et al., 2015; Brocato et al., 2018; Cristini et al., 2017; Dogra et al., 2019; Brocato et al., 2019; Dogra et al., 2020a; Goel et al., 2020; Anaya et al., 2021), but with rigorous emphasis on parameters related to the cancer-immune response to the treatment with checkpoint inhibitors in the setting of patients with solid tumors. In particular, we have developed a model that contains key mechanistic biological and physical processes involved in checkpoint inhibitor therapy, which has been objectively validated against imaging data of patient tumor burden and measured response, defined by both change in total tumor burden and patient survival (Butner et al., 2020). To date, this modeling work has only examined tumor response on a bulk scale, without confirming the mechanistic links between key model parameters and the underlying biology they describe. In this work, we demonstrate how model parameters may be informed by using cell-scale IHC analysis of biopsied tissues, which are available as early as at the start of treatment, for reliable prediction of therapeutic response. Thus, this represents a key step towards clinical translation (i) by validating prior results in additional patient cohorts and (ii) demonstrating how IHC may be used with the model to predict patient response at times closer to the start of treatment. The predictions obtained through this model were compared against available retrospective clinical data from published trials with monoclonal antibodies blocking the PD-1/PD-L1 pathway for validation, thereby focusing on a quantitative relationship between tumor response and its underlying mechanisms. Taken together, these retrospective results indicate that our predictive mathematical model with the class of PD-1/PD-L1 checkpoint inhibitors has translational merit and that it should therefore be evaluated as an integral predictive biomarker in the setting of carefully designed prospective cancer investigational trials.
Methods
Mathematical model
The final mathematical model we used for comparison with clinical data is a single ODE, which determines changes in relative tumor mass over time after initiation of anti-PD-1 therapy. It is a simplified and user-friendly version originated from a complex set of partial differential equations (PDEs), which takes into account spatial relationships within the tumor microenvironment. By reducing the model to this closed-form solution, we present the model in a form that combines related biological processes (see Figure 1) into only a few easy-to-interpret values, while also ensuring the ability to obtain unique solutions when only minimal data are available. The full mathematical derivation has been demonstrated elsewhere (Butner et al., 2020) and also in Appendix 1, but its underlying cancer biology is also schematically depicted in Figure 1. It is ultimately represented by
, | (1) |
where ρ′ is the normalized tumor mass, t is time, α is a proliferation constant of tumor cells, Λ is the ratio of cancer cells (σ) to effector immune cells multiplied by the ability of immune cells (ψk) to kill cancer cells (namely, the anti-tumor immune state), µ is the effect of immunotherapy on the ability of immune cells to kill cancer cells, and represents the final long-term tumor burden, which may be calculated as
(2) |
In words, Equation (1) describes the time-course tumor burden under immunotherapy intervention as a function of three key parameters α, Λ, and µ, which represent the ability of malignant tumor cells to grow, the ability of immune cells to kill cancer cells within the tumor environment, and the potential efficacy of checkpoint inhibitor-based immunotherapy treatment. Equation (2) states that long-term tumor burden is a function of the relationship between tumor growth and kill rates [the greater of which sets the sign of response, i.e., progressive disease () or favorable clinical response ()], as scaled by the parameter . These three parameters are intrinsically abstract terms, which have multiple components in themselves. Λ is dependent on the density of malignant tumor versus immune cells at the initiation of immunotherapy (t = 0) and on the ability of each immune cell to kill tumor cells. Equation (1) assumes the following five assumptions: (i) tumor mass grows exponentially with rate α in the absence of immune cell killing; (ii) cancer cells are killed by one type of net effector immune cell (termed k); (iii) the influx of immune cells and the concentration of checkpoint inhibitor within the tumor environment reaches a drug steady state on time scales far faster (i.e., from hours to days) than clinical response (i.e., from weeks to months); (iv) all cancer cells are within an average intratumoral movement path length of effector immune cells, and the effect of cytokines in stimulating immune cell function/movement is small, thus spatial diversity effects are negligible in this particular case; and (v) the site of action of the checkpoint inhibitor takes place at the interface between the tumor cell and immune cell, with blocking of one of the immune checkpoint receptors, either on the cancer or on the immune cell, which are deemed necessary and sufficient for blockade of the immune inhibitory pathway.
While one must recognize that although these assumptions certainly represent a gross biological generalization of the true tumor-immune microenvironment complexity, they enable direct comparison with clinical response data, in which measurements of all the parameters required for a full description of immune system reaction to tumors are often not readily available in conventional clinical settings. In this retrospective mechanistic analysis, we start with a simple biophysical model to validate clinical findings and the mechanistic links between high-level model parameters and the underlying biology they describe, with the possible addition of further refining variables as an aspirational goal for future prospective translational or clinical cancer studies. The mathematical simulations and procedures conducted are fully described in Appendix 1 (Appendix 1—figures 1 and 2); finally, we also address the implications of these arbitrary choices in ‘Discussion’.
Clinical evaluation and fitting of the mathematical model
To evaluate Equation (1) with clinical data, we initially focused on clinical trials with the class of checkpoint inhibitors that specifically target the PD-1/PD-L1 pathway. In this analysis, tumor volumes over time measurements were obtained from six published clinical trial reports (Borghaei et al., 2015; Antonia et al., 2015; Le et al., 2015; Motzer et al., 2015; Powles et al., 2014; Topalian et al., 2012). As an initial retrospective proof of concept, five clinical trials of anti-PD-1 therapy plus another clinical trial of anti-PD-L1 treatment (Table 1) were included, with the combined dataset representing several common solid tumor pathology types (n = 189 cancer patients); this dataset represents our model calibration cohort. An online tool (Web Plot Digitizer [Rohatgi, 2010]) served to extract the individual patient tumor response data over time from the published clinical trials, and subsequently Equation (1) was fit to these individual and collective datasets to derive the parameters α, Λ, and µ. A unique fit (and thus set of parameter values) was obtained for the data from each individual patient, and more details on this procedure may also be found in Butner et al., 2020.
Table 1. Clinical trials with checkpoint inhibitors used to fit the mathematical model and derived values of tumor proliferation constant, α.
Reference | Tumor type histopathology | Checkpoint inhibitor monoclonal antibody | Constantα (days–1) | Calculated tumor doubling time (α–1, days) |
---|---|---|---|---|
Le et al., 2015 | CRC | Pembrolizumab (anti-PD1) | 0.0622 | 11 |
Powles et al., 2014 | UCC | Atezolizumab (anti-PD-L1) | 0.016 | 43 |
Antonia et al., 2015 | SCLC | Nivolumab (anti-PD1) | 0.014 | 50 |
Topalian et al., 2012 | MM | Nivolumab (anti-PD1) | 0.0069 | 100 |
Borghaei et al., 2015 | NSCLC | Nivolumab (anti-PD1) | 0.0069 | 100 |
Motzer et al., 2015 | RCC | Nivolumab (anti-PD1) | 0.0034 | 204 |
CRC, colorectal carcinoma; UCC, urothelial cell carcinoma; SCLC, small cell lung cancer;MM, malignant melanoma; NSCLC, non-small lung cancer; RCC, renal cell carcinoma.
The fitting procedure was performed in two sequential steps. First, the fastest progressing patient in each trial was fit to a simple exponential function to estimate α for each cancer histopathology (i.e., approximation for uninhibited tumor doubling time). Although this approximation represents a limiting factor in the study, it was necessary due to lack of pretreatment tumor measurement in the calibration cohort, which would allow for more accurate estimation of the growth kinetic without clinical intervention. As presented, α may represent the fastest tumor growth potential in the cohort and thus and overestimate the true average growth kinetic; however, because it likely represents the patient with the least response to treatment in each cohort, we take it to be a reasonable approximation of tumor growth kinetic unaffected by treatment. Second, this cancer-specific α was used to determine the remaining parameters, Λ and µ, for each individual patient by fitting Equation (1) to time-course tumor burden data (Figure 2 and Appendix 1—figure 1). The curve fitting was performed by using nonlinear least squares and the Mathematica function NonLinearModelFit (Wolfram Research I, 2017). The workflow for deriving the model parameters from the clinical data is depicted in Appendix 1—figure 1.
The results from this model calibration were checked against an additional validation patient cohort from the University of Texas M.D. Anderson Cancer Center (MDACC). Briefly, data from patients (n = 64) with non-small cell lung cancer (NSCLC) treated with pembrolizumab (MK-3475) were obtained from the investigational study NCT02444741 (a total of 95 patients were obtained; however, 18 left the study after admission, 11 were removed due to lack of pretreatment measurements, 1 was excluded because all indexed lesions were treated with XRT, and 1 discontinued treatment but continued follow-up). Serial lung tumor measurements were taken on post-contract chest CT images acquired with 2.5 mm slice thickness. All lesions that were previously indexed by the radiologist were included in order to best reproduce actual clinical practice (patients had a range of 1–12 indexed lesions; median, 3 indexed lesions). Lesion volumes were estimated as 3D spheres calculated from the geometric mean of long and short axes of each lesion at each follow-up, and then volumes were summed to generate a total volume for all indexed lesions at each follow-up time point. Because imaging data before the start of pembrolizumab treatment were available for each patient within this cohort, we were able to obtain a patient-specific pretreatment growth rate α for each patient between the imaging immediately preceding start of treatment and at the time of first immunotherapy treatment by using the exponential growth rate estimation between tumor burdens measured via imaging collected before treatment and at start of treatment. These per-patient α values were then used in Equation (1) to obtain values for Λ and µ, as described above.
Sensitivity analysis and model simulations
A sensitivity analysis was next performed on Equation (1) in two independent ways (Appendix 1—figure 2). First, each of the parameters Λ and µ were individually altered by ±10% while holding the other parameters constant to simulate the change in relative tumor mass (). Second, individual values of in the calibration cohort were varied by a uniform random variable by ±0.1 (i.e., 10%) and Equation (1) was re-fitted to these modified data to determine any changes in the derived values for Λ and µ. To determine stability of derived Λ and µ values over time, we also truncated the data at differing time points (namely, t < 30, 60, 120, 200 days), and subsequently re-fitted Equation (1) to these truncated data to determine Λ and µ. The correlation between the derived values of Λ and µ from the truncated datasets and the full composite dataset was then determined by using Spearman correlation analysis. A simulated long-term RECIST v1.1 score was then determined for each patient by projecting the expected tumor burden at t = 700 days (chosen as a time point beyond the last reported follow-up for most of the patients) by using these values of Λ and µ derived from the truncated fits in order to compare the predicted RECIST scores to the known retrospective scores. Finally, full model simulations were performed at different levels of α, Λ, and µ to determine values of based on input parameter variation.
Validation of Λ and µ by tumor-infiltrating immune cells and immunostaining
The parameters Λ and µ derived from fitting the clinical response data were compared to pathological biomarkers from additional anti-PD-1 or PD-L1 clinical trials (Borghaei et al., 2015; Robert et al., 2015b; Brahmer et al., 2012; Tumeh et al., 2014; Motzer et al., 2015; Powles et al., 2014; Topalian et al., 2012; Garon et al., 2015; Herbst et al., 2014; Kefford et al., 2014; Spira et al., 2015; Taube et al., 2014; Weber et al., 2015), as shown in Appendix 1—table 1. Specifically, we investigated the ability of Λ and µ to correlate with CD8+ tumor-infiltrating lymphocytes (TILs) and tumor PD-L1 expression, respectively. To compare the values of Λ and µ derived from fitting the clinical response data over time with the trials assessing TILs and PD-L1 expression, the extracted cancer patients were categorized into objective responders versus nonresponders by applying RECIST v1.1 (Eisenhauer et al., 2009) note that resist categories determined by lesion diameter (D) or our volume estimation are mathematically comparable by . Specifically, patients from all RECIST categories (Eisenhauer et al., 2009) were condensed into two groups for analysis, with patients who had ≥30% reduction in tumor burden (partial or complete response) grouped into the ‘favorable’ response group, and patients with either <30% disease reduction (stable disease or disease progression) into the ‘unfavorable’ response group. The last recorded time point from the response curve from each individual patient served to designate the RECIST v1.1 category as this provides the most accurate long-term treatment outcome.
After stratifying each patient into a RECIST v1.1 category, Λ and µ were compared between responding and nonresponding patients by using a Wilcoxon rank sum test and compared to the literature either as a continuous variable (Λ) or by using thresholds (µ). For comparison with biomarkers reported in the literature, Λ was converted to an estimated intratumoral CD8+ T cell count (for details, the interested reader is referred to Butner et al., 2020) by assuming each CD8+ T cell would kill one tumor cell on average (the assumed mean ‘fitness’ of the immune cell population [Mempel and Bauer, 2008]), and that there were 5558 cells/mm2 in the tumor microenvironment, as has been quantitatively measured in melanoma (Erdag et al., 2012). For comparison with PD-L1 staining, µ was converted from its raw numerical value to a percentage; no other scaling of the variable was performed as the number of cancer cells bound by anti-PD-1/PD-L1 therapy action is the dominant term in the integral specified in Equation S4 in Butner et al., 2020; this approximation and its implications are further examined in ‘Discussion.’ Assessment of objective response rates (ORRs) at standard thresholds of 1% and 5% PD-L1 staining (corresponding to µ) were used in this study. Other alternative PD-L1 cutoffs present in some studies (Table 1 and Appendix 1—table 1) were not included in this analysis due to the relatively small numbers of patients. The biomarker trials used for validation of these parameters are also presented in Appendix 1—table 1.
Results
Quantification of model parameters α, Λ, and µ
Measured tumor burden data over time from the total collective calibration patient pool (n = 189) after initiating checkpoint inhibitor-based therapy were extracted from the six reported clinical trials (Table 1). Of this population, 55 patients (29%) had objective responses by RECIST v1.1 criteria while 134 patients (71%) demonstrated stable/progressive disease. The derived tumor proliferation constant, α, was determined to range from 0.0034 (tumor doubling time of ~200 days) in renal cell carcinoma to 0.0622 (tumor doubling time of ~11 days) in non-mismatch repair colon cancer with an average α of 0.018 and average tumor doubling time of ~85 days (Table 1). In the validation NSCLC cohort, 25 patients (39%) had objective response, and 39 patients (61%) demonstrated stable/progressive disease, with individual patient proliferation constants (α) ranging from –0.0129 to 0.0602 (note that α < 0 indicates a subset of patients that had a shrinking tumor burden before start of therapy).
Having determined α for each cancer histopathology, the clinical response curves to checkpoint inhibitors for each tumor type were fit to Equation (1) to determine Λ and µ. The average root-mean-square error of fitting Equation (1) to the clinical data was only 0.4%. A sample exponential fit to extracted melanoma time-course data is shown (Appendix 1—figure 1, second panel, red curve). A sample of these curve fits for patients with melanoma from the trial by Topalian et al., 2012 is depicted in Figure 2. The derived fits from all 189 patient response curves in the calibration cohort yielded a mean ± standard error of the mean (SEM) value of Λ of 0.714 ± 0.257 in patients with partial/complete response and 0.0995 ± 0.0264 in patients with stable/progressive disease (p=0.119; Wilcoxon two-tail), while the mean ± SEM value of µ was 0.054 ± 0.014 versus 0.013 ± 0.0012 in partial/complete response versus stable/progressive disease, respectively (p<0.001). In the validation NSCLC cohort, the mean ± SEM value of Λ was 0.876 ± 0.102 in patients with partial/complete response and 0.0297 ± 0.469 in patients with stable/progressive disease (p<0.001), while the mean ± SEM value of µ was 0.0529 ± 0.00982 to –0.0064 ± 0.0032 in partial/complete response versus stable/progressive disease (p<0.001). These values are depicted in Figure 3. These results suggest that, while Λ and µ give significantly separated classification ranges for partial/complete response versus stable/progressive disease, the specific value of the binary classification threshold is likely a function of the unique disease-drug combination used, as observed in our prior studies (Butner et al., 2021). This point was explored further through a ‘leave-one-cancer-type-out’ validation study within the calibration cohort, wherein one cancer type was removed from the calibration cohort and used as validation against the parameter ranges in the reduced calibration set obtained from Borghaei et al., 2015; Antonia et al., 2015; Le et al., 2015; Motzer et al., 2015; Powles et al., 2014; and Topalian et al., 2012. Results revealed that mean ranges vary between individual cancer types, and that μ shows more consistent significant difference between response categories relative to Λ (these results are consistent with the results shown in Butner et al., 2020; these results are shown in Appendix 1—figure 3, Appendix 1—figure 3—source data 1, and explored further in ‘Discussion’).
Confirmation of model stability
The parameters α, Λ, and µ were held constant during the sensitivity analysis at three different values for each parameter. These values were the minimum, average, and maximum values derived from fitting Equation (1) to the data as described above. Changing Λ and µ from these values ± 10% yielded a maximum change in of 9.2% at t = 200 days. Varying data points randomly up to ±0.1 resulted in Spearman correlation coefficients of 0.766 and 0.919 for Λ and µ, respectively, derived from fitting these randomized data versus the actual clinical data. We note that, due to high stability observed to these perturbations in the large calibration cohort (n = 189 patients), we did not repeat this sensitivity analysis in the validation cohort. Λ values derived from fitting truncated data for the calibration cohort at various time points displayed Spearman correlation coefficients with Λ derived from fitting the full data ranging from 0.071 at t < 30 days to 0.730 at t < 200 days, while Spearman correlation coefficients for µ ranged from 0.910 (t < 30 days) to 0.921 (t < 200 days) for all truncated datasets (Table 2). In the validation cohort, Spearman correlation coefficients for Λ ranged 0.800 at t < 30 days to 0.771 at t < 200 days, and 0.800 at t < 30 days to 0.989 at t < 200 days for μ. Simulated RECIST v1.1 categorization (complete/partial response vs. stable/progressive disease) by using the values of Λ and µ derived from fitting the truncated calibration cohort data resulted in 19% misclassification by using data from t < 60 days (n = 177) and 13% misclassification at t < 200 days (n = 189) when compared to the full dataset. In the validation cohort, we observed 18.6% misclassification at t < 60 days (n = 43) and 10.9% misclassification at t <200 days (n = 64). Predicted normalized tumor mass after initiation of immunotherapy is depicted at different combinations of α, Λ, and µ (Figure 4).
Table 2. Spearman correlation coefficients between Λ and µ derived from fitting truncated datasets versus full dataset.
Calibration cohort | Validation cohort | ||||||||
---|---|---|---|---|---|---|---|---|---|
Λ | t < 60 | t < 120 | t < 200 | t = all days | Λ | t < 60 | t < 120 | t < 200 | t = all days |
t < 30 | 0.476 | 0.162 | 0.080 | 0.071 | t < 30 | 1.000 | 1.000 | 0.800 | 0.800 |
t < 60 | 0.416 | 0.309 | 0.306 | t < 60 | 0.812 | 0.658 | 0.823 | ||
t < 120 | 0.668 | 0.599 | t < 120 | 0.676 | 0.750 | ||||
t < 200 | 0.730 | t < 200 | 0.771 | ||||||
µ | t < 60 | t < 120 | t < 200 | t = all days | µ | t < 60 | t < 120 | t < 200 | t = all days |
t < 30 | 0.942 | 0.928 | 0.922 | 0.910 | t < 30 | 1.000 | 0.800 | 0.800 | 0.800 |
t < 60 | 0.968 | 0.941 | 0.946 | t < 60 | 0.974 | 0.960 | 0.963 | ||
t < 120 | 0.946 | 0.922 | t < 120 | 0.971 | 0.961 | ||||
t < 200 | 0.921 | t < 200 | 0.989 |
Analysis of model predictions
Using the binary classification of tumor response of partial/complete response as positive and stable/progressive disease as negative, receiver-operator characteristic (ROC) analysis was performed to identify optimal predictive response thresholds for μ and Λ (Figure 3, insets) as higher values of μ and Λ are expected to correspond to a more favorable patient response. Identification of optimal predictive thresholds in the calibration cohort by maximizing the Youden’s J statistic revealed cutoff thresholds where sensitivity (the proportion of correctly identified patients with partial/complete response) was higher for both Λ and μ (0.945 and 0.891, respectively), while specificity was reduced (0.381 for Λ and 0.567 μ). Response prediction thresholds were identified as 0.722 for Λ and 0.00905 for μ. Testing these same response threshold values (identified in the calibration cohort) in the validation cohort revealed sensitivity of 0.6 for Λ and for 0.960 μ, and specificity of 0.743 for Λ and 0.769 for μ in the validation cohort. We found that, in the calibration cohort, positive predictive values (PPVs; the probability a patient will be a responder when the model predicts they will be a responder: 0.381 for Λ and 0.458 for μ) were lower than the negative predictive values (NPVs; 0.889 for Λ and 0.927 for μ), indicating fewer false-negatives (stable/progressive disease) than false-positives (partial/complete response). This trend was confirmed in the validation cohort (a PPV of 0.600 for Λ and 0.723 for μ; an NPV of 0.744 for Λ and 0.968 for μ). Lastly, we note that overall accuracy was lower by both Λ and μ in the calibration cohort than were observed in the validation cohort; this is presumably due to the misbalance of patients with ORR (29% = 55 patients) versus patients with stable/progressive disease (71%, = 134 patients) while sensitivity (correctly identified patients with ORR) was higher than specificity.
Comparison of Λ and µ with clinical and pathological data
Conversion of Λ to an estimated intratumoral CD8+ T cell count yielded a predicted mean ± SEM of 3970 ± 1429 cells/mm2 in patients with partial/complete response to checkpoint inhibition and 553 ± 147 cells/mm2 in patients with stable/progressive disease (Figure 5) in the calibration cohort, and 4871 ± 567 cells/mm2 versus 165 ± 2,604 cells/mm2 in patients with partial/complete response versus stable/progressive disease in the validation cohort. Intratumoral CD8+ T cell counts referenced from Tumeh et al., 2014 are derived from two scenarios, either encompassing data in the pretreatment setting only (n = 46) or data including pathological CD8+ T cell counts encompassing both pretreatment and on treatment (n = 23). In the pretreatment setting, the average intratumoral CD8+ T cell count was 2632 ± 518 cells/mm2 in patients with partial/complete response to checkpoint inhibitors and 322 ± 133 cells/mm2 in patients demonstrating stable/progressive disease, while including on-treatment plus pretreatment data yielded an average of 3770 ± 675 cells/mm2 in patients with partial/complete response and 501 ± 113 cells/mm2 in patients with stable/progressive disease.
For comparison of µ with PD-L1 staining, data were extracted from a total of 12 published clinical trials (n = 975 cancer patients) with data on clinical response by using a PD-L1 staining cutoff of ≥1% versus <1% and 1492 patients with a cutoff of ≥5% versus <5%. The ORR of patients with these thresholds was 15% for PD-L1 staining <1% and 28% for PD-L1 staining ≥1%, and 21% and 38% for <5% and ≥5%, respectively. The ORR of patients in the calibration cohort by using the same thresholds in the derived values of µ was therefore 10% and 45% for patients with µ < 1% and ≥1%, respectively, and was 25% and 67% for patients with µ < 5% and ≥5%, while in the validation cohort, the model-predicted ORR was 9% and 71% for patients with µ < 1% and ≥1%, respectively, and was 29% and 100% for patients with µ < 5% and ≥5% (Figure 5—source data 1).
Discussion
The translational mathematical model introduced here retrospectively investigates the molecular, cellular, and biophysical mechanism(s) behind patient response to immune checkpoint inhibitor therapy, and it explores the potential clinical value of the early prediction of treatment effectiveness. The reductionist approach introduced here simplifies the rather complex biological cross-talk between the immune system with cancer cells to a set of differential equations ultimately dependent on three intrinsic parameters that represent tumor proliferation, intratumoral immune cell presence/killing efficiency (considered as baseline immune cell infiltration), and checkpoint inhibition efficacy; this latter parameter represents the active role of the checkpoint inhibitors in initiating and amplifying the anti-tumor response. We have demonstrated that these parameters may be informed using either imaging or IHC measures, enabling for robust implementation even when some of these measures are unavailable, and offering methods to calculate PD-L1 density and intratumoral CD8+ T cell counts without invasive methods or to inform the model using only IHC measures at start of treatment.
From a mechanistic standpoint, the mathematical model is fully compatible with the current understanding of the biological effect of checkpoint blockade and clinical subtypes of immunotherapy-responsive tumors (Teng et al., 2015). First, the parameter values derived from our model for intratumoral immune cell infiltration (Λ) and immunotherapy antibody efficacy (µ) correspond with the quantitative pathological measures of intratumoral CD8+ T cell infiltration and PD-L1-positive staining (Figure 4; Figure 5). Although parameters Λ and μ are not direct representations of CD8+ T cell counts or PD-L1 expression, they correlated with measured pathological biomarkers, thus providing strong experimental evidence that these mathematical parameters may be quantified from these biomarkers. This offers a unique method for clinical translation using clinically available measured quantities to provide personalized prediction of patient response, a potential that we have often found particularly lacking in prior mechanistic modeling research. By demonstrating links between model parameters and known biology, our model may also be used to quantify the associated mechanistic underpinnings of treatment failure, with the goal of suggesting clinical interventions that may overcome these deficiencies to improve patient outcome. Unfortunately, the absence of per-patient measurements of CD8+ T cell counts or PD-L1 expression corresponding to individual patient response to treatment in the cohorts examined prevented analysis of how these parameters perform on a per-patient basis. We are currently collecting in-house a new dataset containing both measures for single patients, and the results of this study will be published once complete. We are also investigating how these biomarkers may inform the model to prospectively identify pseudoprogression (a clinical phenomenon wherein lesions are observed to experience rapid volume increase followed by disease response) on a per-patient basis, based on our previous result that retrospectively known long-term parameter values are unique in pseudoprogression (Butner et al., 2020).
Moreover, the model demonstrates that the rate of immunotherapy response arises from nonlinear interactions between both adequate effector immune cell infiltration in tumors and immunotherapy efficacy within the tumor microenvironment (Figure 4). Mechanistic mathematical modeling across several cancer types (Table 1) suggests that the overlying master equation [i.e., Equation (1)] may well be universally applied, while the model parameter values presented here are likely tumor-specific. Indeed, this conclusion may be observed in Figure 3, where Λ and µ are distinctly different for ORR versus stable or progressive disease, but the values are different for the different cohorts, thereby capturing mechanistic differences across the different cancer types. However, further testing of the model in additional cancer types and larger patient cohorts remains necessary, in part due to the heterogeneous nature of solid tumors, both within individual patients and across different cancer types. The nontrivial interaction of these inputs predicted by this model is different in comparison to many established and current candidate biomarker studies (which focus on linear immunotherapy responses to just one of these markers, e.g., PD-L1 expression [Carbognin et al., 2015]), perhaps providing a plausible explanation why single biomarkers sometimes provide inconsistent predictions across multiple cancer types (Carbognin et al., 2015). Similarly, the unique insights presented herein allow for a more direct comparison of the model parameters to common pathological markers either reported in the literature or as yet to be reported, and provide a different perspective compared to other immune checkpoint inhibitor modeling studies (Łuksza et al., 2017; Wilkie and Hahnfeldt, 2013; Serre et al., 2016).
The high sensitivity at early time points (t < 60 days) demonstrated here indicates that this model may provide valuable early identification of cancer patients most likely to benefit from checkpoint inhibition therapy, with a high NPV indicating minimal false-negatives in the group predicted to receive the least benefit from therapy. Therefore, this attribute could serve as an early indicator of the efficacy of checkpoint inhibition by simply using either clinical or imaging measurements of index tumor lesions and by applying the mathematical model to project maximal effect for an individual patient. Further, the model demonstrates robustness and stability in the derived values of Λ and μ to random variations in , and by using values of Λ and μ derived from fitting limited data over time (Table 2). This result is in stark contrast to previous mathematical descriptions of immune-mediated killing of cancer cells, where a relatively small change in a single input parameter of merely ±1% could dramatically vary tumor response by up to ±50% (de Pillis et al., 2005).
Towards clinical translation of cancer models, a mathematical model with two simple terms (an exponential growth term and a regression term) has previously been used to successfully correlate and predict patient survival (Stein et al., 2008). The fundamental difference between this prior model (Stein et al., 2008) and the model reported here is that the quantification of cell death is more mechanistic, that is, depending on the specific mechanisms (Figure 1) that underlie cancer cell and immunotherapy drug interactions, hence allowing one to gain more mechanistic insight into the treatment system. As demonstrated, model parameters Λ and µ can be used to stratify responding and nonresponding patients (Figure 3), which has immediate potential utility as a biomarker for patient selection in prospective clinical trials. Moreover, the model contains biological values that, at least in principle, may either be measured (e.g., tumor burden, growth rate) or changed clinically (µ: e.g., drug dosing or dosing schedule; : e.g., radiotherapy-induced increase in PD-L1 expression, radiotherapy abscopal effect). Thus, we expect that the model (i) may be informed by using standard-of-care measurements (e.g., Figure 5) and (ii) can provide quantitative information on which parameters must be changed to maximize therapeutic benefit, providing clinicians with potentially valuable decision-making information.
Of course, as with any biomathematical model, this model is based on several educated assumptions about the interactions of immune effectors (CD8+ T cells) with cancer cells, which naturally does not reflect the sheer magnitude and complexity of the tumor-immune microenvironment. These include the presence of immunosuppressive cells (such as neutrophils, myeloid-derived suppressor cells, Treg, and M2-polarized tumor-associated macrophages), which extensively infiltrate into tumor mass and hinder the efficacy of immune checkpoint inhibitors (Jenkins et al., 2018). Moreover, effects of other immune cells, such as CD4+ T cells, are not explicitly included in the current model form; while it is likely that some of the effects from these other cells are captured within the model representation of CD8+ T cells, this assumption warrants future model development where each immune component is explicitly represented. Some of these assumptions (e.g., lack of immune cell/antibody infiltration terms) are supported with in vitro or in vivo data such as high rates of immune cell binding by anti-PD1 antibodies in the peripheral circulation (Topalian et al., 2012) and local intratumoral (as opposed to systemic myelogenous) expansion of CD8+ T cells during checkpoint inhibition (Tumeh et al., 2014; Ribas et al., 2016). Other potential model parameters would logistically be quite challenging to measure in an outpatient clinic-ready setting routinely at this time, and their inclusion remains open for follow-up confirmatory retrospective studies and ultimately for future prospective clinical trials. As such, the integration of additional prognostic biomarkers and master regulators that intrinsically (e.g., genetic stability) and extrinsically control the efficacy of immunotherapy represents open research areas for future translational investigation.
Moreover, the two response parameters derived from the model, Λ and μ, represent abstract terms, which may not precisely model intratumoral CD8+ lymphocyte infiltration and tumor cell PD-L1 staining and potentially can be modified by relevant determinants, such as tumor mutational burden (Goodman et al., 2017) or the human microbiome of the gut (Gopalakrishnan et al., 2018). Moreover, these parameters represent a simplifying average value of these fluctuating parameters. We take this to be a reasonable assumption because (i) these quantities are not directly measurable (this is also the case for cell proliferation events underlying the tumor growth rate parameter α), (ii) in our in-house data, times between patient reassessment ranged 17–91 days, so even direct measurement of these would provide an average value over this time period, and (iii) these processes take place at far shorter times than patient reassessments. By presenting the model in this reduced form, we enable simplified interpretation of the results while also providing a single, easy-to-understand scalar that contains significant information about the treatment response.
Finally, a few operational aspects of this work deserve further comment. Response was defined using RECIST v1.1 criteria, in lieu of the more recent adaptation of RECIST criteria to immunotherapy treatment (iRECIST), because the studies used to derive the model parameters in this mechanistic analysis did not incorporate these new criteria, and our use of published data for the calibration cohort limited or precluded us from obtaining a priori knowledge about nontarget lesions. Moreover, our work to date has only involved testing our model in a handful of cancer types, and further validation in additional disease phenotypes and larger total patient populations remains outstanding. These inherent study limitations notwithstanding, we will continue to improve our model to more accurately predict outcomes in the immunotherapy-specific setting of individualized cancer patients, potentially through the inclusion of additional biomarkers, as bioactive molecules such as IFNγ, CD206, CX3CR1, CD1D, and iNOS, along with cell-mediated mechanisms known to have an effect on immune checkpoint inhibitor therapy (Park et al., 2018; Gubin et al., 2018). However, we do not anticipate that such improvements and refinements would change the basic findings and the potential value of the mechanistic mathematical model reported in this work. In going forward, one hopes that knowledge broadly applicable across multiple cancer types and/or immune microenvironment control will be serially incorporated to the dynamic model upon their future discovery and validation.
In conclusion, we present a mechanistic model of immune checkpoint inhibition that is able to describe various immunotherapy response profiles, with the inputs to the model correlating with common pathological biomarkers in current clinical use. An early and robust a priori predictor for checkpoint inhibition response and outcome might provide a glimpse of the immense potential for timely adjustments and therapeutic personalization. Future prospective investigations of this computational science-assisted approach will focus on readily available clinical data as inputs to the model and further refining the complex interplay between the immune system and the cancer environment to extract other important variables for immunotherapy efficacy. Towards this end, we are currently pursuing in-house collection of per-patient, paired IHC measures of PD-L1 or T cell counts with tumor response, which will enable us to directly correlate IHC measures of interest with tumor response, while also allowing for examination of additional patient parameters, such as tumor stage or patient age. We will also obtain data from different cancer types known to be receptive to ICI therapy in order to further evaluate the potential of our model to perform as a more universal predictor across an even more diverse array of cancer phenotypes. Ultimately, the merit of this approach will rely on its future ability to reliably predict early individual patient response with the goal of improving personalized cancer care.
Appendix 1
Immunotherapy model derivation
The mechanistic model of cancer immunotherapy presented in this paper is essentially an extension of our prior mathematical model describing chemotherapy response that has been shown to predict cancer cell kill with various cytotoxic or targeted agents. In particular, we extend these equations to consider immune cell presence as necessary for cancer cell kill secondary to immunotherapy, and that immune cells respond to not only diffusion gradients within a tumor microenvironment but can also be influenced by the presence of cytokines through cell signaling pathways and chemotaxis. The model hypothesis of immunotherapy presented here is that these molecules or antibodies diffuse and block the complimentary interaction between immune checkpoint ligands expressed on cancer cells with their complementary proteins on immune cells. This mechanism renders effector immune cells potentially active for cancer cell killing; thus, the therapeutic site of action occurs within the tumor microenvironment (i.e., because our model only describes the tumor region and the factors and processes contained therein, we have made the assumption that all key mechanisms such as drug binding occur only within the tumor). These assumptions lead to the following system of PDEs:
(A1) |
(A2) |
(A3) |
(A4) |
Here , , , and represent the local concentration of cancer cells, therapeutic immune cells, immunotherapy antibodies, and cytokines, respectively. Moreover, α is the proliferation rate of tumor cells, is the specific death rate of cancer cells, is the binding coefficient of immunotherapy antibodies that block the interaction between immune inhibitory ligands on cancer cells and their counterparts on immune cells, is the coupling of immune cell activity relative to the number of cancer cells (i.e., killing and tumor infiltration capacity of the host immune system), χ is the chemotaxis coefficient, ΛC is the number of released cytokines as immunotherapy antibodies are bound, and Da and Dc are the diffusivity of antibodies and cytokines (see also Figure 1, main text).
The first equation describes the death rate of cancer cells as proportional to the concentration of therapeutic immune cells and the time history of immunotherapy antibody uptake and binding within the tumor environment. The second equation represents mass conservation of ‘effective’ therapeutic immune cells, including the rate at which these cells become ineffective at killing cancer cells. The third and fourth equations represent the concentration and diffusion of immunotherapy antibodies and cytokines in the presence of immunotherapy antibody binding.
To compare this mechanistic model with clinical immunotherapy data, we make multiple reductionist assumptions about the influence of various parameters from Equation A1-4 on immunotherapy response. These assumptions suppose that immune cells are in relatively close physical proximity to cancer cells, allowing one to ignore the influence of cytokines to guide their movement, and that the primary effector immune cell response to immunotherapy is driven by the presence of immune cells already present in the tumor at the initiation of the therapy. Furthermore, we assume uptake and binding of immunotherapy antibodies within the tumor environment to occur diffusely relative to cancer and immune cell concentrations; therefore, in this model, we set and remove the influence of immunotherapy antibody concentration. These assumptions reduced the four PDEs to the following set of coupled ODEs as follows:
(A5) |
(A6) |
Here, Equation A6 represents the change in tumor-infiltrating immune cells relative to the change in cancer cells killed by the immune system. In the case where immune cell killing is weak (i.e., , and thus ), the change in immune cell concentration within the tumor is negligible compared to the growth of the tumor, thus Equation A6 satisfies the relationship (i.e., immune cell concentration within the tumor remains roughly constant over time). When immune cell killing is sufficiently effective, then
and thus . In essence, the change in immune cells in the tumor over time is roughly equal to the immune cell coupling to cancer cells [i.e., immune cells in the tumor environment are related to the tumor volume by a coupling factor ()], which captures the immunogenicity of an individual tumor. Integrating both sides of Equation A6 over time leads to the following relationship:
(A7) |
where and represent the concentration of tumor cells and immune cells at the start of immunotherapy. We then substitute from, Equation (A7) into Equation (A5) express , and replace the concentration of tumor cells by a proportion of the original tumor cell concentration to obtain the normalized tumor mass (while noting that one may also use normalized tumor volume here) to give us one equation of tumor response represented by
(A8) |
Finally, we assume that the binding of immunotherapy antibodies within the tumor environment () and rate of tumor cell death secondary to effector immune cells () reach constant steady states on time scales faster than measurable tumor cell kill, implying , leading to
(A9) |
This ODE can be solved analytically for by integrating both sides, yielding
(A10) |
Equation A10 is the same as Equation (1) in the primary text, which is used to compare with clinical response data to immunotherapy.
Appendix 1—table 1. Studies used for derivation of pathological markers of immunotherapy response.
Reference (see main text) | Tumor type | Checkpoint inhibitor | Pathological biomarker | PD-L1 staining cutoff |
---|---|---|---|---|
Tumeh et al., 2014 | Melanoma | Pembrolizumab | CD8+ TILs | N/A |
Kefford et al., 2014 | Melanoma | Pembrolizumab | PD-L1 | 1% |
Powles et al., 2014 | UCC | Atezolizumab | PD-L1 | 1%, 5%, 10% |
Herbst et al., 2014 | NSCLC, RCC, melanoma, HNSCC, CRC, gastric and pancreatic cancer | Atezolizumab | PD-L1 | 1%, 5%, 10% |
Robert et al., 2015b | Melanoma | Nivolumab | PD-L1 | 5% |
Motzer et al., 2015 | RCC | Nivolumab | PD-L1 | 5% |
Taube et al., 2014 | NSCLC, RCC, melanoma, PC, CRC | Nivolumab | PD-L1 | 5% |
Spira et al., 2015 | NSCLC | Atezolizumab | PD-L1 | 1%, 5%, 10% |
Brahmer et al., 2012 | NSCLC | Nivolumab | PD-L1 | 1%, 5%, 10% |
Borghaei et al., 2015 | NSCLC | Nivolumab | PD-L1 | 1%, 5%, 10% |
Weber et al., 2015 | Melanoma | Nivolumab | PD-L1 | 5% |
Topalian et al., 2012 | Melanoma, RCC, NSCLC, CRC, PC | Nivolumab | PD-L1 | 5% |
Garon et al., 2015 | NSCLC | Pembrolizumab | PD-L1 | 1%, 50% |
RCC: renal cell; UCC: urothelial cell carcinoma; CRC: colorectal carcinoma; NSCLC: non-small lung carcinoma; HNSCC: head and neck squamous cell carcinoma; PC: prostate carcinoma; TIL: tumor-infiltrating lymphocytes.
Funding Statement
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Contributor Information
Zhihui Wang, Email: zwang@houstonmethodist.org.
Eugene J Koay, Email: EKoay@mdanderson.org.
Caigang Liu, Shengjing Hospital of China Medical University, China.
Mone Zaidi, Icahn School of Medicine at Mount Sinai, United States.
Funding Information
This paper was supported by the following grants:
National Science Foundation DMS-1930583 to Zhihui Wang, Vittorio Cristini.
National Institutes of Health 1R01CA253865 to Zhihui Wang, Vittorio Cristini.
National Institutes of Health 1U01CA196403 to Zhihui Wang, Eugene J Koay, Vittorio Cristini.
National Institutes of Health 1U01CA213759 to Zhihui Wang, Vittorio Cristini.
National Institutes of Health 1R01CA226537 to Zhihui Wang, Renata Pasqualini, Wadih Arap, Vittorio Cristini.
National Institutes of Health 1R01CA222007 to Zhihui Wang, Vittorio Cristini.
National Institutes of Health U54CA210181 to Zhihui Wang, Mauro Ferrari, Shu-Hsia Chen, Ping-Ying Pan, Eugene J Koay, Vittorio Cristini.
National Institutes of Health P30CA016672 to David S Hong, James W Welsh, Eugene J Koay.
National Institutes of Health P30CA072720 to Steven K Libutti, Shridar Ganesan, Renata Pasqualini, Wadih Arap.
European Commission SER Cymru II Programme to Bruna Corradetti.
National Institutes of Health U01CA200468 to Eugene J Koay.
National Institutes of Health R01CA222959 to Mauro Ferrari.
DOD Breast Cancer Research Breakthrough Level IV Award W81XWH-17-1-0389 to Mauro Ferrari.
AngelWorks to Renata Pasqualini, Wadih Arap.
Gillson Longenbaugh Foundation to Renata Pasqualini, Wadih Arap.
Marcus Foundation to Renata Pasqualini, Wadih Arap.
National Institutes of Health R01CA109322 to Shu-Hsia Chen.
National Institutes of Health R01CA127483 to Shu-Hsia Chen.
National Institutes of Health R01CA208703 to Shu-Hsia Chen.
National Institutes of Health R01CA140243 to Ping-Ying Pan.
National Institutes of Health R01CA188610 to Ping-Ying Pan.
Additional information
Competing interests
No competing interests declared.
No competing interests declared.
See COI form submitted.
Author contributions
Data curation, Formal analysis, Investigation, Methodology, Resources, Software, Validation, Writing – original draft, Writing – review and editing.
Data curation, Formal analysis, Investigation, Methodology, Resources, Software, Writing – original draft, Writing – review and editing.
Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Data curation, Investigation, Resources, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Writing – review and editing.
Investigation, Methodology, Resources, Writing – review and editing.
Investigation, Methodology, Resources, Writing – review and editing.
Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review and editing, Data curation.
Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review and editing.
Ethics
Clinical trial registration NCT02444741.
Human subjects: In-house patient cohort were obtained as de-identified data from a study conducted in accordance with the U.S. Common Rule and with Institutional Review Board Approval at MD Anderson (2014-1020), including waiver of informed consent. This work has been published in J Immunother Cancer. 2020; 8(2): e001001. PMC7555111. doi: 10.1136/jitc-2020-001001.
Additional files
Data availability
No new clinical patient data was produced in this study. Data used that was obtained from literature is available in the original publications; we have been careful to cite each of these in the manuscript. Interested researchers should reach out directly to the primary authors of these studies. Data for the in-house clinical trial cohort are from the study reported in PMC7555111; interested researchers should contact the authors of this publication with any data requests.
References
- Anaya DA, Dogra P, Wang Z, Haider M, Ehab J, Jeong DK, Ghayouri M, Lauwers GY, Thomas K, Kim R, Butner JD, Nizzero S, Ramírez JR, Plodinec M, Sidman RL, Cavenee WK, Pasqualini R, Arap W, Fleming JB, Cristini V. A Mathematical Model to Estimate Chemotherapy Concentration at the Tumor-Site and Predict Therapy Response in Colorectal Cancer Patients with Liver Metastases. Cancers. 2021;13:444. doi: 10.3390/cancers13030444. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Antonia SJ, Bendell JC, Taylor MH, Calvo E, Jaeger D, De Braud FG, Ott PA, Pietanza MC, Horn L, Le DT, Morse M, Lopez-Martin JA, Ascierto PA, Christensen O, Grosso J, Simon JS, Lin CS, Eder JP. Phase I/II study of nivolumab with or without ipilimumab for treatment of recurrent small cell lung cancer (SCLC): CA209-032. Journal of Clinical Oncology. 2015;33:7503. doi: 10.1200/jco.2015.33.15_suppl.7503. [DOI] [Google Scholar]
- Auslander N, Zhang G, Lee JS, Frederick DT, Miao B, Moll T, Tian T, Wei Z, Madan S, Sullivan RJ, Boland G, Flaherty K, Herlyn M, Ruppin E. Robust prediction of response to immune checkpoint blockade therapy in metastatic melanoma. Nature Medicine. 2018;24:1545–1549. doi: 10.1038/s41591-018-0157-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Borghaei H, Paz-Ares L, Horn L, Spigel DR, Steins M, Ready NE, Chow LQ, Vokes EE, Felip E, Holgado E, Barlesi F, Kohlhäufl M, Arrieta O, Burgio MA, Fayette J, Lena H, Poddubskaya E, Gerber DE, Gettinger SN, Rudin CM, Rizvi N, Crinò L, Antonia SJ, Dorange C, Harbison CT, Graf Finckenstein F, Brahmer JR. Nivolumab versus docetaxel in advanced nonsquamous non-small-cell lung cancer. The New England Journal of Medicine. 2015;373:1627–1639. doi: 10.1056/NEJMoa1507643. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brahmer JR, Tykodi SS, Chow LQM, Hwu W-J, Topalian SL, Hwu P, Drake CG, Camacho LH, Kauh J, Odunsi K, Pitot HC, Hamid O, Bhatia S, Martins R, Eaton K, Chen S, Salay TM, Alaparthy S, Grosso JF, Korman AJ, Parker SM, Agrawal S, Goldberg SM, Pardoll DM, Gupta A, Wigginton JM. Safety and activity of anti-PD-L1 antibody in patients with advanced cancer. The New England Journal of Medicine. 2012;366:2455–2465. doi: 10.1056/NEJMoa1200694. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brocato TA, Coker EN, Durfee PN, Lin Y-S, Townson J, Wyckoff EF, Cristini V, Brinker CJ, Wang Z. Understanding the connection between nanoparticle uptake and cancer treatment efficacy using mathematical modeling. Scientific Reports. 2018;8:7538. doi: 10.1038/s41598-018-25878-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brocato TA, Brown-Glaberman U, Wang Z, Selwyn RG, Wilson CM, Wyckoff EF, Lomo LC, Saline JL, Hooda-Nehra A, Pasqualini R, Arap W, Brinker CJ, Cristini V. Predicting breast cancer response to neoadjuvant chemotherapy based on tumor vascular features in needle biopsies. JCI Insight. 2019;4:e126518. doi: 10.1172/jci.insight.126518. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bunimovich-Mendrazitsky S, Shochat E, Stone L. Mathematical model of BCG immunotherapy in superficial bladder cancer. Bulletin of Mathematical Biology. 2007;69:1847–1870. doi: 10.1007/s11538-007-9195-z. [DOI] [PubMed] [Google Scholar]
- Bunimovich-Mendrazitsky S, Halachmi S, Kronik N. Improving bacillus Calmette-Guérin (BCG) immunotherapy for bladder cancer by adding interleukin 2 (IL-2): A mathematical model. Mathematical Medicine and Biology. 2016;33:159–188. doi: 10.1093/imammb/dqv007. [DOI] [PubMed] [Google Scholar]
- Butner JD, Elganainy D, Wang CX, Wang Z, Chen SH, Esnaola NF, Pasqualini R, Arap W, Hong DS, Welsh J, Koay EJ, Cristini V. Mathematical prediction of clinical outcomes in advanced cancer patients treated with checkpoint inhibitor immunotherapy. Science Advances. 2020;6:eaay6298. doi: 10.1126/sciadv.aay6298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Butner JD, Wang Z, Elganainy D, Al Feghali KA, Plodinec M, Calin GA, Dogra P, Nizzero S, Ruiz-Ramirez J, Martin GV, Tawbi HA, Chung C, Koay EJ, Welsh JW, Hong DS, Cristini V. A mathematical model for the quantification of a patient’s sensitivity to checkpoint inhibitors and long-term tumour burden. Nature Biomedical Engineering. 2021;5:297–308. doi: 10.1038/s41551-020-00662-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carbognin L, Pilotto S, Milella M, Vaccaro V, Brunelli M, Caliò A, Cuppone F, Sperduti I, Giannarelli D, Chilosi M, Bronte V, Scarpa A, Bria E, Tortora G. Differential activity of nivolumab, pembrolizumab and MPDL3280A according to the tumor expression of programmed death-ligand-1 (PD-L1): Sensitivity analysis of trials in melanoma, lung and genitourinary cancers. PLOS ONE. 2015;10:e0130142. doi: 10.1371/journal.pone.0130142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cormedi MCV, Van Allen EM, Colli LM. Predicting immunotherapy response through genomics. Current Opinion in Genetics & Development. 2021;66:1–9. doi: 10.1016/j.gde.2020.11.004. [DOI] [PubMed] [Google Scholar]
- Cristini V, Koay EJ, Wang Z. In: An Introduction to Physical Oncology: How Mechanistic Mathematical Modeling Can Improve Cancer Therapy Outcomes. Cristini V, editor. CRC Press, Taylor & Francis Group; 2017. An Introduction to Physical Oncology. [DOI] [Google Scholar]
- Das H, Wang Z, Niazi MKK, Aggarwal R, Lu J, Kanji S, Das M, Joseph M, Gurcan M, Cristini V. Impact of diffusion barriers to small cytotoxic molecules on the efficacy of immunotherapy in breast cancer. PLOS ONE. 2013;8:e61398. doi: 10.1371/journal.pone.0061398. [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Pillis LG, Radunskaya AE, Wiseman CL. A validated mathematical model of cell-mediated immune response to tumor growth. Cancer Research. 2005;65:7950–7958. doi: 10.1158/0008-5472.CAN-05-0564. [DOI] [PubMed] [Google Scholar]
- Dogra P, Adolphi NL, Wang Z, Lin Y-S, Butler KS, Durfee PN, Croissant JG, Noureddine A, Coker EN, Bearer EL, Cristini V, Brinker CJ. Establishing the effects of mesoporous silica nanoparticle properties on in vivo disposition using imaging-based pharmacokinetics. Nature Communications. 2018;9:4551. doi: 10.1038/s41467-018-06730-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dogra P, Butner JD, Chuang YL, Caserta S, Goel S, Brinker CJ, Cristini V, Wang Z. Mathematical modeling in cancer nanomedicine: a review. Biomedical Microdevices. 2019;21:e380-2. doi: 10.1007/s10544-019-0380-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dogra P, Butner JD, Nizzero S, Ruiz Ramírez J, Noureddine A, Peláez MJ, Elganainy D, Yang Z, Le A-D, Goel S, Leong HS, Koay EJ, Brinker CJ, Cristini V, Wang Z. Image-guided mathematical modeling for pharmacological evaluation of nanomaterials and monoclonal antibodies. Wiley Interdisciplinary Reviews. Nanomedicine and Nanobiotechnology. 2020a;12:e1628. doi: 10.1002/wnan.1628. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dogra P, Butner JD, Ruiz Ramírez J, Chuang Y-L, Noureddine A, Jeffrey Brinker C, Cristini V, Wang Z. A mathematical model to predict nanomedicine pharmacokinetics and tumor delivery. Computational and Structural Biotechnology Journal. 2020b;18:518–531. doi: 10.1016/j.csbj.2020.02.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duffy MJ, Crown J. Biomarkers for Predicting Response to Immunotherapy with Immune Checkpoint Inhibitors in Cancer Patients. Clinical Chemistry. 2019;65:1228–1238. doi: 10.1373/clinchem.2019.303644. [DOI] [PubMed] [Google Scholar]
- Eisenhauer EA, Therasse P, Bogaerts J, Schwartz LH, Sargent D, Ford R, Dancey J, Arbuck S, Gwyther S, Mooney M, Rubinstein L, Shankar L, Dodd L, Kaplan R, Lacombe D, Verweij J. New response evaluation criteria in solid tumours: Revised RECIST guideline (version 1.1) European Journal of Cancer. 2009;45:228–247. doi: 10.1016/j.ejca.2008.10.026. [DOI] [PubMed] [Google Scholar]
- Erdag G, Schaefer JT, Smolkin ME, Deacon DH, Shea SM, Dengel LT, Patterson JW, Slingluff CL., Jr Immunotype and immunohistologic characteristics of tumor-infiltrating immune cells are associated with clinical outcome in metastatic melanoma. Cancer Research. 2012;72:1070–1080. doi: 10.1158/0008-5472.CAN-11-3218. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Frieboes HB, Smith BR, Wang Z, Kotsuma M, Ito K, Day A, Cahill B, Flinders C, Mumenthaler SM, Mallick P, Simbawa E, AL-Fhaid AS, Mahmoud SR, Gambhir SS, Cristini V, Cinti C. Predictive modeling of drug response in non-Hodgkin’s lymphoma. PLOS ONE. 2015;10:e0129433. doi: 10.1371/journal.pone.0129433. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garon EB, Rizvi NA, Hui R, Leighl N, Balmanoukian AS, Eder JP, Patnaik A, Aggarwal C, Gubens M, Horn L, Carcereny E, Ahn M-J, Felip E, Lee J-S, Hellmann MD, Hamid O, Goldman JW, Soria J-C, Dolled-Filhart M, Rutledge RZ, Zhang J, Lunceford JK, Rangwala R, Lubiniecki GM, Roach C, Emancipator K, Gandhi L, KEYNOTE-001 Investigators Pembrolizumab for the treatment of non-small-cell lung cancer. The New England Journal of Medicine. 2015;372:2018–2028. doi: 10.1056/NEJMoa1501824. [DOI] [PubMed] [Google Scholar]
- Goel S, Ferreira CA, Dogra P, Yu B, Kutyreff CJ, Siamof CM, Engle JW, Barnhart TE, Cristini V, Wang Z, Cai W. Size‐Optimized Ultrasmall Porous Silica Nanoparticles Depict Vasculature‐Based Differential Targeting in Triple Negative Breast Cancer. Small. 2019;15:1903747. doi: 10.1002/smll.201903747. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goel S, Zhang G, Dogra P, Nizzero S, Cristini V, Wang Z, Hu Z, Li Z, Liu X, Shen H, Ferrari M. Sequential deconstruction of composite drug transport in metastatic breast cancer. Science Advances. 2020;6:26. doi: 10.1126/sciadv.aba4498. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goodman AM, Kato S, Bazhenova L, Patel SP, Frampton GM, Miller V, Stephens PJ, Daniels GA, Kurzrock R. Tumor mutational burden as an independent predictor of response to immunotherapy in diverse cancers. Molecular Cancer Therapeutics. 2017;16:2598–2608. doi: 10.1158/1535-7163.MCT-17-0386. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gopalakrishnan V, Spencer CN, Nezi L, Reuben A, Andrews MC, Karpinets TV, Prieto PA, Vicente D, Hoffman K, Wei SC, Cogdill AP, Zhao L, Hudgens CW, Hutchinson DS, Manzo T, Petaccia de Macedo M, Cotechini T, Kumar T, Chen WS, Reddy SM, Szczepaniak Sloane R, Galloway-Pena J, Jiang H, Chen PL, Shpall EJ, Rezvani K, Alousi AM, Chemaly RF, Shelburne S, Vence LM, Okhuysen PC, Jensen VB, Swennes AG, McAllister F, Marcelo Riquelme Sanchez E, Zhang Y, Le Chatelier E, Zitvogel L, Pons N, Austin-Breneman JL, Haydu LE, Burton EM, Gardner JM, Sirmans E, Hu J, Lazar AJ, Tsujikawa T, Diab A, Tawbi H, Glitza IC, Hwu WJ, Patel SP, Woodman SE, Amaria RN, Davies MA, Gershenwald JE, Hwu P, Lee JE, Zhang J, Coussens LM, Cooper ZA, Futreal PA, Daniel CR, Ajami NJ, Petrosino JF, Tetzlaff MT, Sharma P, Allison JP, Jenq RR, Wargo JA. Gut microbiome modulates response to anti-PD-1 immunotherapy in melanoma patients. Science. 2018;359:97–103. doi: 10.1126/science.aan4236. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gubin MM, Esaulova E, Ward JP, Malkova ON, Runci D, Wong P, Noguchi T, Arthur CD, Meng W, Alspach E, Medrano RFV, Fronick C, Fehlings M, Newell EW, Fulton RS, Sheehan KCF, Oh ST, Schreiber RD, Artyomov MN. High-dimensional analysis delineates myeloid and lymphoid compartment remodeling during successful immune-checkpoint cancer therapy. Cell. 2018;175:1443. doi: 10.1016/j.cell.2018.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herbst RS, Soria J-C, Kowanetz M, Fine GD, Hamid O, Gordon MS, Sosman JA, McDermott DF, Powderly JD, Gettinger SN, Kohrt HEK, Horn L, Lawrence DP, Rost S, Leabman M, Xiao Y, Mokatrin A, Koeppen H, Hegde PS, Mellman I, Chen DS, Hodi FS. Predictive correlates of response to the anti-PD-L1 antibody MPDL3280A in cancer patients. Nature. 2014;515:563–567. doi: 10.1038/nature14011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hosoya H, Dobroff AS, Driessen WHP, Cristini V, Brinker LM, Staquicini FI, Cardó-Vila M, D’Angelo S, Ferrara F, Proneth B, Lin Y-S, Dunphy DR, Dogra P, Melancon MP, Stafford RJ, Miyazono K, Gelovani JG, Kataoka K, Brinker CJ, Sidman RL, Arap W, Pasqualini R. Integrated nanotechnology platform for tumor-targeted multimodal imaging and therapeutic cargo release. PNAS. 2016;113:1877–1882. doi: 10.1073/pnas.1525796113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jenkins RW, Barbie DA, Flaherty KT. Mechanisms of resistance to immune checkpoint inhibitors. British Journal of Cancer. 2018;118:9–16. doi: 10.1038/bjc.2017.434. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jerby-Arnon L, Shah P, Cuoco MS, Rodman C, Su M-J, Melms JC, Leeson R, Kanodia A, Mei S, Lin J-R, Wang S, Rabasha B, Liu D, Zhang G, Margolais C, Ashenberg O, Ott PA, Buchbinder EI, Haq R, Hodi FS, Boland GM, Sullivan RJ, Frederick DT, Miao B, Moll T, Flaherty KT, Herlyn M, Jenkins RW, Thummalapalli R, Kowalczyk MS, Cañadas I, Schilling B, Cartwright ANR, Luoma AM, Malu S, Hwu P, Bernatchez C, Forget M-A, Barbie DA, Shalek AK, Tirosh I, Sorger PK, Wucherpfennig K, Van Allen EM, Schadendorf D, Johnson BE, Rotem A, Rozenblatt-Rosen O, Garraway LA, Yoon CH, Izar B, Regev A. A Cancer Cell Program Promotes T Cell Exclusion and Resistance to Checkpoint Blockade. Cell. 2018;175:984–997. doi: 10.1016/j.cell.2018.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johannet P, Coudray N, Donnelly DM, Jour G, Illa-Bochaca I, Xia Y, Johnson DB, Wheless L, Patrinely JR, Nomikou S, Rimm DL, Pavlick AC, Weber JS, Zhong J, Tsirigos A, Osman I. Using Machine Learning Algorithms to Predict Immunotherapy Response in Patients with Advanced Melanoma. Clinical Cancer Research. 2021;27:131–140. doi: 10.1158/1078-0432.CCR-20-2415. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kefford R, Ribas A, Hamid O, Robert C, Daud A, Wolchok JD, Joshua AM, Hodi FS, Gangadhar TC, Hersey P, Weber JS, Dronca RS, Patnaik A, Zarour HM, Dolled-Filhart M, Lunceford J, Emancipator K, Ebbinghaus S, Kang SP, Hwu WJ. Clinical efficacy and correlation with tumor PD-L1 expression in patients (pts) with melanoma (MEL) treated with the anti-PD-1 monoclonal antibody MK-3475. Journal of Clinical Oncology. 2014;32:3005. doi: 10.1200/jco.2014.32.15_suppl.3005. [DOI] [Google Scholar]
- Koay EJ, Truty MJ, Cristini V, Thomas RM, Chen R, Chatterjee D, Kang Y, Bhosale PR, Tamm EP, Crane CH, Javle M, Katz MH, Gottumukkala VN, Rozner MA, Shen H, Lee JE, Wang H, Chen Y, Plunkett W, Abbruzzese JL, Wolff RA, Varadhachary GR, Ferrari M, Fleming JB. Transport properties of pancreatic cancer describe gemcitabine delivery and response. The Journal of Clinical Investigation. 2014;124:1525–1536. doi: 10.1172/JCI73455. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kronik N, Kogan Y, Elishmereni M, Halevi-Tobias K, Vuk-Pavlović S, Agur Z. Predicting outcomes of prostate cancer immunotherapy by personalized mathematical models. PLOS ONE. 2010;5:12. doi: 10.1371/journal.pone.0015482. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Le DT, Uram JN, Wang H, Bartlett BR, Kemberling H, Eyring AD, Skora AD, Luber BS, Azad NS, Laheru D, Biedrzycki B, Donehower RC, Zaheer A, Fisher GA, Crocenzi TS, Lee JJ, Duffy SM, Goldberg RM, de la Chapelle A, Koshiji M, Bhaijee F, Huebner T, Hruban RH, Wood LD, Cuka N, Pardoll DM, Papadopoulos N, Kinzler KW, Zhou S, Cornish TC, Taube JM, Anders RA, Eshleman JR, Vogelstein B, Diaz LA., Jr PD-1 Blockade in tumors with mismatch-repair deficiency. The New England Journal of Medicine. 2015;372:2509–2520. doi: 10.1056/NEJMoa1500596. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Le DT, Durham JN, Smith KN, Wang H, Bartlett BR, Aulakh LK, Lu S, Kemberling H, Wilt C, Luber BS, Wong F, Azad NS, Rucki AA, Laheru D, Donehower R, Zaheer A, Fisher GA, Crocenzi TS, Lee JJ, Greten TF, Duffy AG, Ciombor KK, Eyring AD, Lam BH, Joe A, Kang SP, Holdhoff M, Danilova L, Cope L, Meyer C, Zhou S, Goldberg RM, Armstrong DK, Bever KM, Fader AN, Taube J, Housseau F, Spetzler D, Xiao N, Pardoll DM, Papadopoulos N, Kinzler KW, Eshleman JR, Vogelstein B, Anders RA, Diaz LA., Jr Mismatch repair deficiency predicts response of solid tumors to PD-1 blockade. Science. 2017;357:409–413. doi: 10.1126/science.aan6733. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Łuksza M, Riaz N, Makarov V, Balachandran VP, Hellmann MD, Solovyov A, Rizvi NA, Merghoub T, Levine AJ, Chan TA, Wolchok JD, Greenbaum BD. A neoantigen fitness model predicts tumour response to checkpoint blockade immunotherapy. Nature. 2017;551:517–520. doi: 10.1038/nature24473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mempel TR, Bauer CA. Intravital imaging of CD8+ T cell function in cancer. Clinical & Experimental Metastasis. 2008;26:311–327. doi: 10.1007/s10585-008-9196-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moreira A, Gross S, Kirchberger MC, Erdmann M, Schuler G, Heinzerling L. Senescence markers: Predictive for response to checkpoint inhibitors. Ternational Journal of Cancer. 2019;144:1147–1150. doi: 10.1002/ijc.31763. [DOI] [PubMed] [Google Scholar]
- Motzer RJ, Rini BI, McDermott DF, Redman BG, Kuzel TM, Harrison MR, Vaishampayan UN, Drabkin HA, George S, Logan TF, Margolin KA, Plimack ER, Lambert AM, Waxman IM, Hammers HJ. Nivolumab for metastatic renal cell carcinoma: results of a randomized phase II trial. Journal of Clinical Oncology. 2015;33:1430–1437. doi: 10.1200/JCO.2014.59.0703. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pardoll DM. The blockade of immune checkpoints in cancer immunotherapy. Nature Reviews. Cancer. 2012;12:252–264. doi: 10.1038/nrc3239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Park YJ, Kuen DS, Chung Y. Future prospects of immune checkpoint blockade in cancer: from response prediction to overcoming resistance. Experimental & Molecular Medicine. 2018;50:1–13. doi: 10.1038/s12276-018-0130-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pascal J, Ashley CE, Wang Z, Brocato TA, Butner JD, Carnes EC, Koay EJ, Brinker CJ, Cristini V. Mechanistic modeling identifies drug-uptake history as predictor of tumor drug resistance and nano-carrier-mediated response. ACS Nano. 2013a;7:11174–11182. doi: 10.1021/nn4048974. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pascal J, Bearer EL, Wang Z, Koay EJ, Curley SA, Cristini V. Mechanistic patient-specific predictive correlation of tumor drug response with microenvironment and perfusion measurements. PNAS. 2013b;110:14266–14271. doi: 10.1073/pnas.1300619110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pilard C, Ancion M, Delvenne P, Jerusalem G, Hubert P, Herfs M. Cancer immunotherapy: it’s time to better predict patients’ response. British Journal of Cancer. 2021;125:927–938. doi: 10.1038/s41416-021-01413-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Postow MA, Callahan MK, Wolchok JD. Immune checkpoint blockade in cancer therapy. Journal of Clinical Oncology. 2015;33:1974–1982. doi: 10.1200/JCO.2014.59.4358. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Powles T, Eder JP, Fine GD, Braiteh FS, Loriot Y, Cruz C, Bellmunt J, Burris HA, Petrylak DP, Teng S, Shen X, Boyd Z, Hegde PS, Chen DS, Vogelzang NJ. MPDL3280A (anti-PD-L1) treatment leads to clinical activity in metastatic bladder cancer. Nature. 2014;515:558–562. doi: 10.1038/nature13904. [DOI] [PubMed] [Google Scholar]
- Riaz N, Havel JJ, Makarov V, Desrichard A, Urba WJ, Sims JS, Hodi FS, Martín-Algarra S, Mandal R, Sharfman WH, Bhatia S, Hwu W-J, Gajewski TF, Slingluff CL, Jr, Chowell D, Kendall SM, Chang H, Shah R, Kuo F, Morris LGT, Sidhom J-W, Schneck JP, Horak CE, Weinhold N, Chan TA. Tumor and microenvironment evolution during immunotherapy with nivolumab. Cell. 2017;171:934–949. doi: 10.1016/j.cell.2017.09.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ribas A, Shin DS, Zaretsky J, Frederiksen J, Cornish A, Avramis E, Seja E, Kivork C, Siebert J, Kaplan-Lefko P, Wang X, Chmielowski B, Glaspy JA, Tumeh PC, Chodon T, Pe’er D, Comin-Anduix B. PD-1 blockade expands intratumoral memory T cells. Cancer Immunology Research. 2016;4:194–203. doi: 10.1158/2326-6066.CIR-15-0210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Robert C, Long GV, Brady B, Dutriaux C, Maio M, Mortier L, Hassel JC, Rutkowski P, McNeil C, Kalinka-Warzocha E, Savage KJ, Hernberg MM, Lebbé C, Charles J, Mihalcioiu C, Chiarion-Sileni V, Mauch C, Cognetti F, Arance A, Schmidt H, Schadendorf D, Gogas H, Lundgren-Eriksson L, Horak C, Sharkey B, Waxman IM, Atkinson V, Ascierto PA. Nivolumab in previously untreated melanoma without BRAF mutation. The New England Journal of Medicine. 2015a;372:320–330. doi: 10.1056/NEJMoa1412082. [DOI] [PubMed] [Google Scholar]
- Robert C, Schachter J, Long GV, Arance A, Grob JJ, Mortier L, Daud A, Carlino MS, McNeil C, Lotem M, Larkin J, Lorigan P, Neyns B, Blank CU, Hamid O, Mateus C, Shapira-Frommer R, Kosh M, Zhou H, Ibrahim N, Ebbinghaus S, Ribas A, KEYNOTE-006 investigators Pembrolizumab versus ipilimumab in advanced melanoma. The New England Journal of Medicine. 2015b;372:2521–2532. doi: 10.1056/NEJMoa1503093. [DOI] [PubMed] [Google Scholar]
- Rohatgi A. WebPlotDigitalizer: HTML5 based online tool to extractnumerical data from plot images. 2010. [April 11, 2019]. https://automeris.io/WebPlotDigitizer
- Serre R, Benzekry S, Padovani L, Meille C, André N, Ciccolini J, Barlesi F, Muracciole X, Barbolosi D. Mathematical modeling of cancer immunotherapy and its synergy with radiotherapy. Cancer Research. 2016;76:4931–4940. doi: 10.1158/0008-5472.CAN-15-3567. [DOI] [PubMed] [Google Scholar]
- Sharma P, Hu-Lieskovan S, Wargo JA, Ribas A. Primary, adaptive, and acquired resistance to cancer immunotherapy. Cell. 2017;168:707–723. doi: 10.1016/j.cell.2017.01.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spira AI, Park K, Mazières J, Vansteenkiste JF, Rittmeyer A, Ballinger M, Waterkamp D, Kowanetz M, Mokatrin A, Fehrenbacher L. Efficacy, safety and predictive biomarker results from a randomized phase II study comparing MPDL3280A vs docetaxel in 2L/3L NSCLC (POPLAR) Journal of Clinical Oncology. 2015;33:8010. doi: 10.1200/jco.2015.33.15_suppl.8010. [DOI] [Google Scholar]
- Stein WD, Figg WD, Dahut W, Stein AD, Hoshen MB, Price D, Bates SE, Fojo T. Tumor growth rates derived from data for patients in a clinical trial correlate strongly with patient survival: a novel strategy for evaluation of clinical trial data. The Oncologist. 2008;13:1046–1054. doi: 10.1634/theoncologist.2008-0075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taube JM, Klein A, Brahmer JR, Xu H, Pan X, Kim JH, Chen L, Pardoll DM, Topalian SL, Anders RA. Association of PD-1, PD-1 ligands, and other features of the tumor immune microenvironment with response to anti-PD-1 therapy. Clinical Cancer Research. 2014;20:5064–5074. doi: 10.1158/1078-0432.CCR-13-3271. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Teng MWL, Ngiow SF, Ribas A, Smyth MJ. Classifying cancers based on T-cell infiltration and PD-L1. Cancer Research. 2015;75:2139–2145. doi: 10.1158/0008-5472.CAN-15-0255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Topalian SL, Hodi FS, Brahmer JR, Gettinger SN, Smith DC, McDermott DF, Powderly JD, Carvajal RD, Sosman JA, Atkins MB, Leming PD, Spigel DR, Antonia SJ, Horn L, Drake CG, Pardoll DM, Chen L, Sharfman WH, Anders RA, Taube JM, McMiller TL, Xu H, Korman AJ, Jure-Kunkel M, Agrawal S, McDonald D, Kollia GD, Gupta A, Wigginton JM, Sznol M. Safety, activity, and immune correlates of anti-PD-1 antibody in cancer. The New England Journal of Medicine. 2012;366:2443–2454. doi: 10.1056/NEJMoa1200690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tumeh PC, Harview CL, Yearley JH, Shintaku IP, Taylor EJM, Robert L, Chmielowski B, Spasic M, Henry G, Ciobanu V, West AN, Carmona M, Kivork C, Seja E, Cherry G, Gutierrez AJ, Grogan TR, Mateus C, Tomasic G, Glaspy JA, Emerson RO, Robins H, Pierce RH, Elashoff DA, Robert C, Ribas A. PD-1 blockade induces responses by inhibiting adaptive immune resistance. Nature. 2014;515:568–571. doi: 10.1038/nature13954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vallejo AN. CD28 extinction in human T cells: altered functions and the program of T-cell senescence. Immunological Reviews. 2005;205:158–169. doi: 10.1111/j.0105-2896.2005.00256.x. [DOI] [PubMed] [Google Scholar]
- Wang Z, Butner JD, Kerketta R, Cristini V, Deisboeck TS. Simulating cancer growth with multiscale agent-based modeling. Seminars in Cancer Biology. 2015;30:70–78. doi: 10.1016/j.semcancer.2014.04.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang Z, Kerketta R, Chuang Y-L, Dogra P, Butner JD, Brocato TA, Day A, Xu R, Shen H, Simbawa E, AL-Fhaid AS, Mahmoud SR, Curley SA, Ferrari M, Koay EJ, Cristini V, Di Bernardo D. Theory and experimental validation of a spatio-temporal model of chemotherapy transport to enhance tumor cell kill. PLOS Computational Biology. 2016;12:e1004969. doi: 10.1371/journal.pcbi.1004969. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weber JS, D’Angelo SP, Minor D, Hodi FS, Gutzmer R, Neyns B, Hoeller C, Khushalani NI, Miller WH, Jr, Lao CD, Linette GP, Thomas L, Lorigan P, Grossmann KF, Hassel JC, Maio M, Sznol M, Ascierto PA, Mohr P, Chmielowski B, Bryce A, Svane IM, Grob J-J, Krackhardt AM, Horak C, Lambert A, Yang AS, Larkin J. Nivolumab versus chemotherapy in patients with advanced melanoma who progressed after anti-CTLA-4 treatment (CheckMate 037): A randomised, controlled, open-label, phase 3 trial. The Lancet. Oncology. 2015;16:375–384. doi: 10.1016/S1470-2045(15)70076-8. [DOI] [PubMed] [Google Scholar]
- Wilkie KP, Hahnfeldt P. Tumor-immune dynamics regulated in the microenvironment inform the transient nature of immune-induced tumor dormancy. Cancer Research. 2013;73:3534–3544. doi: 10.1158/0008-5472.CAN-12-4590. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wolfram Research I Illinois. 11.2MathematicaChampaign. 2017 https://www.wolfram.com/mathematica/