Skip to main content

This is a preprint.

It has not yet been peer reviewed by a journal.

The National Library of Medicine is running a pilot to include preprints that result from research funded by NIH in PMC and PubMed.

bioRxiv logoLink to bioRxiv
[Preprint]. 2023 Mar 29:2023.03.28.534600. [Version 1] doi: 10.1101/2023.03.28.534600

Mathematical modeling suggests cytotoxic T lymphocytes control growth of B16 tumor cells in collagin-fibrin gels by cytolytic and non-lytic mechanisms

Barun Majumder 1,*, Sadna Budhu 2, Vitaly V Ganusov 1,3,*
PMCID: PMC10081166  PMID: 37034693

Abstract

Cytotoxic T lymphocytes (CTLs) are important in controlling some viral infections, and therapies involving transfer of large numbers of cancer-specific CTLs have been successfully used to treat several types of cancers in humans. While molecular mechanisms of how CTLs kill their targets are relatively well understood we still lack solid quantitative understanding of the kinetics and efficiency at which CTLs kill their targets in different conditions. Collagen-fibrin gel-based assays provide a tissue-like environment for the migration of CTLs, making them an attractive system to study the cytotoxicity in vitro. Budhu et al. [1] systematically varied the number of peptide (SIINFEKL)-pulsed B16 melanoma cells and SIINFEKL-specific CTLs (OT-1) and measured remaining targets at different times after target and CTL co-inoculation into collagen-fibrin gels. The authors proposed that their data were consistent with a simple model in which tumors grow exponentially and are killed by CTLs at a per capita rate proportional to the CTL density in the gel. By fitting several alternative mathematical models to these data we found that this simple “exponential-growth-mass-action-killing” model does not precisely fit the data. However, determining the best fit model proved difficult because the best performing model was dependent on the specific dataset chosen for the analysis. When considering all data that include biologically realistic CTL concentrations (E ≤ 107 cell/ml) the model in which tumors grow exponentially and CTLs suppress tumor’s growth non-lytically and kill tumors according to the mass-action law (SiGMA model) fitted the data with best quality. Results of power analysis suggested that longer experiments (⁓ 3 – 4 days) with 4 measurements of B16 tumor cell concentrations for a range of CTL concentrations would best allow to discriminate between alternative models. Taken together, our results suggest that interactions between tumors and CTLs in collagen-fibrin gels are more complex than a simple exponential-growth-mass-action killing model and provide support for the hypothesis that CTLs impact on tumors may go beyond direct cytotoxicity.

Introduction

Cytotoxic T lymphocytes (CTLs) are important in controlling some viral infections and tumors [2, 3]. CTLs exhibit such control via several complimentary mechanisms among which direct cytotoxicity, the ability of CTLs to kill virus-infected or tumor (target) cells, is important. Killing of a target cell by a CTL in vivo is a multi-step process: 1) CTL must migrate to the site where the target is located, 2) CTL must recognize the target (typically by the T cell receptor (TCR) on the surface of T cells binding to the specific antigen presented on the surface of the target cell), 3) CTL must form a cytotoxic synapse with the target, and 4) CTL must induce apoptosis of the target cell by secreting effector molecules (e.g., perforin and granzymes) or through Fas/Fas-ligand interactions [48]. The relative contribution of these steps to the efficiency at which a population of CTLs kill their targets in vivo remains poorly understood especially in complex tissues. Improving efficacy of cancer based immunotherapies such as adoptive transfer of cancer-specific T cells will likely come from better understanding of a relative contribution of these processes to tumor control [9].

Many previous studies have provided quantitative insights into how CTLs eliminate their targets in vitro. First insights came from generating conjugates between target cells and CTLs and quantifying how quickly a target cell dies when either being bound by different number of CTLs, or when one CTL is bound to different targets [1017]. Further in vitro studies highlighted that killing by CTLs may kill multiple targets rapidly [1820] but also highlighted heterogeneity in efficacy at which individual CTLs kill their targets [21, 22]. Interestingly, killing of tumor cells in vitro may take long time (hours) with speed and turning being important in determining the likelihood that a CTL will find and kill the target [23, 24]. One study suggested that killing of targets in vitro may follow the law of mass-action [25]. Killing efficiency of CTLs has been also evaluated in so-called chromium release assays that have been a standard method in immunology to measure T cell cytotoxicity in vitro [2633].

Evaluating killing efficacy of CTLs in vivo is challenging. One approach to evaluate how a population of CTLs eliminates targets in vivo has been to perform in vivo cytotoxicity assay [34]. In the assay two populations of cells, one pulsed with a specific peptide and another one being a control, are transferred into mice carrying peptide-specific CTLs, and the relative percent of peptide-pulsed targets is determined in a given tissue (typically spleen) after different times after target cell transfer [3436]. Different mathematical models have been developed to determine specific terms describing how CTLs kill their targets and to estimate CTL killing efficacy; such estimates varied orders of magnitude between different studies often using similar or even same data [3744]. One study suggested that mass-action killing term is fully consistent with data from different in vivo cytotoxicity experiments [42] while other studies based on theoretical arguments suggested that killing should saturate at high CTL or target cell densities [38, 45, 46].

Intravital imaging has provided additional insights into how CTLs kill their targets [47, 48]. One pioneering study followed interactions between peptide-pulsed B cells and peptide-specific CTLs in lymph nodes of mice and found that CTLs and their targets form stable conjugates and move together until the target stops and dies, presumably due to the lethal hit delivered by the CTL [49]. This and other studies revealed that to kill a target in vivo, CTLs either need to interact with the target for a long time or multiple CTLs must contact a target to ensure its death [3, 5055]. Interestingly, killing of tumor cells or cells, infected with Plasmodium parasites, required hours that is longer than the killing time estimated from in vivo cytotoxicity assays [40, 51, 52, 55, 56]. This may be due to different levels of presented antigens (pulsed with a high concentration of a cognate peptide targets vs. targets expressing exogenous antigens) but may be also due to differences in intrinsic killing abilities of different T cells. Mathematical modeling provided quantification of how CTLs kill their targets and of various artifacts arising in intravital imaging experiments (e.g., zombie contracts) [57, 58]; we have recently suggested that killing efficacy of individual Plasmodium-specific CTLs is too low to rapidly eliminate a Plasmodium liver stage highlighting the importance of clusters of CTLs around the parasite for its efficient elimination [56].

Even though studying how CTLs kill their targets in vivo is ideal, such experiments are expensive, time-consuming, and low throughput. On the other hand, traditional in vitro experiments (e.g., on plates or in wells) suffer from the limitation that CTLs and targets do not efficiently migrate on flat surfaces as they do in vivo in many tissues. Collagen-fibrin gels have been proposed as a useful in vitro system to study CTL and target cell interactions that allows to better represent complex 3D environment of the tissues with low cost and higher throughput [1, 59, 60]. CTLs readily migrate in these gels with speeds similar to that of T cells in some tissues in vivo [61]. One recent study measured how CTLs, derived from transgenic mice whose TCRs are all specific for the peptide SIINFEKL (from chicken ovalbumin), can eliminate SIINFEKL peptide pulsed B16 tumor cells in collagen-fibrin gels [1]. Interestingly, the rate at which tumor cells were lost from the gel was linearly dependent on the concentration of CTLs in the gel (varied from 0 to 107 cells/ml) and was independent of the number of B16 tumor cells deposited in the gel [1]. This result suggested that the killing of B16 tumor cells in collagen-fibrin gels follows the law of mass-action, and given that the population of B16 tumor cells grew exponentially with time, the authors proposed that 3.5 × 105 cell/ml of CTLs are required to prevent B16 tumor cell accumulation in gels.

In this paper we more rigorously re-analyzed data published by Budhu et al. [1] along with two additional previously unpublished datasets on CTL killing of B16 tumor cells in collagen-fibrin gels. We found that the simple exponential growth and mass-action killing model never provided the best fit of the data, and which model (out of 4 tested) fitted the data best was dependent on the specific subset of the data used for the analysis. The model in which CTLs reduce the growth rate of B16 tumor cells and kill the tumors via a mass-action law (proportional to concentrations of the CTLs and tumors) fitted one largest dataset (431 gels) with best quality. Importantly, the type of the killing term was critical in predicting CTL concentration that would be needed to eliminate most of the tumor cells within a defined time period (100 days) suggesting the need for future experiments. Following our recent framework for experimental power analyses [62] we simulated various experimental designs and found that some designs would better allow to discriminate between alternative mathematical models of CTL-mediated control of B16 tumor cells, and thus, will allow to better predict how many CTLs are needed for tumor control.

Materials and methods

Experimental details and data

All main details of experimental design are provided in the previous publication [1]. In short, 103 – 106 SIINFEKL-pulsed B16 melanoma tumor cells (=104 – 107 cell/ml) were inoculated alone or with 103 – 106 (equivalent to 104 – 107 cell/ml) of activated OT1 T cells (CTLs) into individual wells containing collagen-fibrin gels. At different times after co-inoculation of cells, gels were digested, and the resulting solution was diluted 101 – 103 fold (depending on the initial targeted B16 cell concentration) in growth medium, and the number of surviving B16 cells in each gel was counted [1]. The data are thus given as the concentration of B16 tumor cells (in cell/ml) surviving in the gels by a given time. Budhu et al. [1] provided us with the data from their published experiments (Datasets 1, 2, and 3) as well as two additional unpublished datasets (Datasets 4 and 5).

  1. Dataset 1 (growth): SIINFEKL-pulsed B16 melanoma cells were inoculated in a 3D collagen-I-fibrin gels with target initial concentrations of 103, 104, or 105 cells/ml and no OT1 cells. The surviving B16 cells were measured at 0, 24, 48, and 72 hours after inoculation into gels. The total number of data points n = 70 (Supplemental Figure S1A).

  2. Dataset 2 (short-term growth and killing): SIINFEKL-pulsed B16 melanoma cells were in-oculated with target initial concentrations 104, 105, or 106 cells/ml each with activated CD8+ OT1 cells with concentrations 0, 104, 105, 106, or 107 cells/ml. The surviving B16 cell numbers were measured at 0 and 24 hours. The total number of data points n = 175 (Supplemental Figure S1B).

  3. Dataset 3 (long-term growth and killing): SIINFEKL-pulsed B16 melanoma cells were in-oculated with target initial concentrations 106 or 108 cells/ml each with OT1 T cells with concentrations 0, 106, or 107 cells/ml. Gels with B16 cell concentration of 108 cells/ml were unstable, and thus was not included in the analysis. Measurements of surviving B16 cells were done at at 0, 24, 48, 72, and 96 hours post inoculation into gels. The total number of data points n = 96 (Supplemental Figure S1C).

  4. Dataset 4 (growth and killing in the first 24 hours): In this previously unpublished dataset, SIINFEKL-pulsed B16 melanoma cells were co-inoculated into gels with the target initial concentration of 105 cell/ml and with OT1 T cells at the concentrations 0, 106, or 107 cell/ml. Surviving B16 cells were measured at 0, 4, 8, 12, and 24 hours post-inoculation into gels. The total number of data points n = 90 (Supplemental Figure S1D).

  5. Dataset 5 (killing at a high CTL concentration): In this previously unpublished dataset, SIINFEKL-pulsed B16 melanoma cells were co-inoculated into gels at the target initial concentration 105 cells/ml and with OT1 cells at concentrations 0 or 108 cells/ml. Surviving B16 cells were measured at 0 and 24 hours. The total number of data points n = 7 (Supplemental Figure S1E).

Experiments generating data for Datasets 1–4 were repeated three times (Experiments 1, 2, and 3), and each measurement was performed in duplicate [1]. These experimental duplicates were prepared for each experimental condition and at the specific time point each of the two gels was lysed, diluted, and the cells from each gel were plated into two 65 × 15 mm2 plates. Experiment generating Dataset 5 was performed once.

Mathematical models

Mathematical models to explain tumor dynamics.

Given previous observations of Budhu et al. [1] we assume that B16 melanoma (tumor) cells grow exponentially and are killed by OT1 CD8+ T cells (CTLs) at a rate proportional to the density of tumors. The change in the B16 cell concentration (T ) over time is then described by a differential equation of the general form

dTdt=fgETfkET, (1)

where fg(E) is the per capita growth rate and fk(E) is the death rate of tumors, and E is the CTL concentration. When E is constant, the general solution of this equation can be written as

lnTt=  lnTaα+fgEfkEt, (2)

where we let T (0) = Ta/α be the initial count which depends on the target B16 tumor cell concentration Ta subject to a scaling factor α. It was typical to recover somewhat lower B16 cell numbers from the gel than it was targeted. For example, when targeting 104 B16 tumor cells per ml in a gel it was typical to recover ∼ 4 × 103 cells/ml at time 0 (e.g., Supplemental Figure S1A).

The simplest exponential growth and mass-action killing (MA) model assumes that tumors grow exponentially and are killed by CTLs at the rate proportional to CTL density (fg(E) = r and fk(E) = kE, Figure 1A). Using eqn. (2) change in the density of targets over time is given by

lnTt=  lnTaα+rkEt, (3)
Figure 1: A schematic representation of the four main alternative models fitted to data on the dynamics of B16 tumor cells.

Figure 1:

These models are as follows: (A): an exponential growth of tumors and a mass-action killing by CTLs (MA) model (eqn. (3)); (B): an exponential growth of tumors and saturation in killing by CTLs (Saturation or Sat) model (eqn. (4)); (C) an exponential growth of tumors and killing by CTLs in accord with a powerlaw (Power) model (eqn. (5)); and (D) an exponential growth of tumors with CTL-dependent suppression of the growth and mass-action killing of tumors by CTLs (SiGMA) model (eqn. (6)). The tumor growth rate r is shown on the top of the cyan spheres which represent the B16 tumor cells T . For the suppression in growth model with a mass-action term in killing (D,“SiGMA”), the E dependent suppression rate is presented over the green arrow. The killing rate k for each model is shown in the blue arrow pointing downwards. For example, the Power model is shown by a constant growth rate r with the death rate of the tumors by E CTLs is kEn.

This model has three parameters (r, k, and α) to be estimated from the data.

The second “saturation” (Sat) model assumes that tumors grow exponentially and are killed by CTLs at a rate that saturates at high CTL densities (fg(E) = r and fkE=kEh+E, Figure 1B). Using eqn. (2) its solution is

lnTt=  lnTaα+rkEh+Et, (4)

This model has 4 parameters (r, k, h, and α) to be estimated from the data.

The third “Power” model assumes that grow exponentially and are killed by CTLs at a rate that scales as a power law with CTL density (fg(E) = r and fk(E) = kEn, Figure 1C). Using eqn. (2) its solution is

lnTt=  lnTaα+rkEnt, (5)

This model has 4 parameters (r, k, n, and α) to be estimated from the data.

In the fourth suppression-in-growth with mass-action-killing (SiGMA) model we assume that CTLs suppress growth rate of the tumor and kill the tumors according to mass-action law (fg(E)=g0+  g11+E/g2 and fkE=kE, Figure 1D). Using eqn. (2) its solution is

lnTt=  lnTaα+g0+  g11+E/g2kEt, (6)

where g0 is the B16 tumor growth rate that is independent of the CTLs, and g1 the tumor growth rate that can be reduced by CTLs via non-lytic means, and g2 is the density of CTLs at which the growth rate g2 is reduced to half of its maximal value due to CTL activity. Note that in this model the rate of tumor cell replication in the absence of CTLs is r = g0 + g1. This model has 5 parameters (g0, g1, g2, k, and α) to be estimated from the data.

Estimating initial density of tumor cells in gels.

In the general solution (eqn. (2)) we assumed that initial tumor density is proportional to the density targeted in experiments scaled by a factor α. We found that recovered concentrations of B16 tumor cells from gels at time t = 0 were consistently lower than the targeted value, and such reduction was approximately similar for different initial B16 concentrations (results not shown). Experimentally, this may arise because the clonogenic assay used to count the number of B16 tumor cells in the gels are not 100% efficient (results not shown). To check if assuming identical scaling factor α for the initial B16 concentration in different experiments we tested an alternative model where we assumed different α for different B16 cell concentrations. In this varying α model the first term in eqn. (2) can be written as ln Taiαi where i denotes the targeted B16 cell concentration. For example, a dataset containing targeted B16 concentrations of 105, 106 and 107 cell/ml would have three α: α1, α2 and α3, respectively. For fitting the model with dataset-dependent α we used the function MultiNonlinearModelFit in Mathematica. We found that allowing α to vary between different targeted B16 concentrations when fitting the SiGMA model to Datasets 1–4 marginally improved the model fit (χ42=9.5, p = 0.02) but did not influence estimates of other parameters (Table S2); in our following analyses we therefore opted for the simpler model with a single scaling parameter α.

Time to kill 90% of targets.

To evaluate efficacy of CTL-mediated control of tumors we calculated the time it takes to kill 90% of tumors initially present. For every model (eqns. (3)(6)) we solve an equation fg(E)t90fk(E)t90 = ln(0.1) to find time t90 in terms of CTL concentration E:

t90E=ln10fkEfgE (7)

Models to explain tumor growth in the first 24 hours after inoculation into gels.

In new experiments (Dataset 4) we found that growth of the tumors in the first 24 hours after inoculation into the gels may not follow a simple exponential curve. Experimentally, this delay may be due to the tumor cells adjusting to the gel environment. In order to explain this dynamics we propose two additional models. As a first alternative (Alt 1) model, we allow for a natural death of B16 tumor cells and then after a delay growth starts. The motivation for this new growth function comes from an algebraic sigmoid function which changes sign from a constant negative value to a constant positive value. The change in the concentration of B16 tumor cells in the absence of CTLs is given by

lnTt=lnTaα+r1+tt2, (8)

where the constant t′ quantifies the time at which this change in sign happens. This model has 3 parameters (α, r, and t′) to be estimated from the data.

As the second alternative (Alt 2) model, we consider a mechanistic explanation of the non-linear dynamics of the tumor cells. We assume that a fraction fd of B16 tumor cells die at rate d and the rest (1 − fd) grow at rate r. The model can be described by the following equations

Tt=  fdTaα  edt+1fdTaα  ert, (9)

where d is the death rate of the fd subset of tumor cells. This model has 4 parameters (α, fd, d, and r) to be estimated from the data.

Statistics

Natural log-transformed solutions of the models were fitted to the natural log of measured concentrations of B16 tumor cells using least squares. In the data there were 13 gels (out of 451) that had 0 B16 tumor cells recovered; these data were excluded from most of the analyses. The regression analyses were performed using function NonlinearModelFit in Mathematica (ver 11.3.0.0). For every model we calculated AIC and ∆AIC as

AICi=AICiminAICi, (10)

where subscript i denotes the model and ’min’ denotes the minimum for all the models [63]. The Akaike weight for the model i was calculated as

wi=eAICi/2ieAICi/2. (11)

To evaluate the appropriateness of assumptions of least squares-based regressions we analyzed residuals of best fits by visual inspection and using Shapiro-Wilk normality test using the function ShapiroWilkTest in Mathematica.

Results

Experiments to measure how CTLs kill targets in collagen-fibrin gels.

To estimate the density of tumor-specific CTLs needed to control growth of B16 tumor cells, Budhu et al. [1] performed a series of experiments in which variable numbers of SIINFEKL peptide-pulsed B16 tumor cells and SIINFEKL-specific CTLs (activated OT1 CD8 T cells) were co-inoculated in collagen-fibrin gels and the number of surviving tumor cells was calculated at different time points (see Supplemental Figure S1 and Materials and methods for more detail). In the absence of CTLs (Dataset 1), B16 tumor cells grew exponentially with the growth rate being approximately independent of the initial tumor density (Supplemental Figure S1A). Short-term (24 hours) experiments (Dataset 2) showed that when the density of CTLs exceeds 106 cell/ml, the density of B16 cells declines in 24 hours, suggesting that the killing rate of the tumors exceeds their replication rate (Supplemental Figure S1B). Longer (96 hours) experiments (Dataset 3) showed that at high CTL densities (> 106 cell/ml) the number of B16 targets recovered from gels declines approximately exponentially with time; interestingly, however, at an intermediate density of CTLs and B16 tumor cells of 106 cells/ml, B16 cells initially decline but then rebound and accumulate (Supplemental Figure S1C). Previously unpublished experiments (Datasets 4–5) showed a similar impact of increasing CTL density on the B16 tumor dynamics during short-term (24h) experiments (Supplemental Figure S1D-E). Budhu et al. [1] concluded that the data from short- and long-term experiments (Supplemental Figure S1A-C) are consistent with the model in which the number of B16 tumor cells grows exponentially due to cell division and are killed by CTLs at a mass-action rate (proportional to the density of targets and CTLs). Budhu et al. [1] also concluded that density of 3.5 × 105 cells/ml was critical for overall clearance of B16 tumor cells in collagen-fibrin gels.

A simple exponential-growth-and-mass-action-killing model is not consistent with the data.

The conclusion that a simple model with exponentially growing tumors and killing of the tumors by CTL via mass-action law (MA model, Figure 1A) was based on simple regression analyses of individual datasets (e.g., Dataset 1 or 3). To more rigorously investigate we proposed three additional models that made different assumptions of how CTLs impact B16 tumor cells including i) saturation in killing rate (Sat model, eqn. (4) and Figure 1B), ii) nonlinear change in the death rate of tumors with increasing CTL concentrations (Power model, eqn. (5) and Figure 1C), and iii) reduction in the tumor growth rate with increasing CTL concentrations and mass-action killing term (SiGMA model, eqn. (6) and Figure 1D). We then fitted these models including the MA model to all the data that in total includes 438 measurements (and excluded 13 gels with zero B16 tumor cells, see Materials and Methods for more detail). These data included two new unpublished datasets (Dataset 4 and 5) including the B16 tumor dynamics at physiologically high CTL concentrations (E = 108 cell/ml, Supplemental Figure S1E). Interestingly, we found that the MA model fit these data with least accuracy while the Sat model (with a saturated killing rate) fitted the data best (Supplemental Table S1). Saturation in the killing rate by CTLs is perhaps not surprising in the full dataset given that in the Dataset 5 two gels inoculated with 105 B16 tumor cells and 108 cell/ml CTLs still contained B16 tumor cells at 24 hours (Supplemental Figure S1E). Because 108 cells/ml is physiologically unrealistic density of CTLs in vivo, for most of our following analyses we excluded the Dataset 5.

Importantly, the MA model was still the least accurate at describing the data from Datasets 1–4 which is visually clear from the model fits of the data as well as from statistical comparison of alternative models using AIC (Figure 2 and Table 1). In contrast, the SiGMA model provided the best fit (Table 1). The SiGMA model is unique because it suggests that in these experiments CTLs impact tumor accumulation not only by killing the tumors but also by slowing down tumor rate of growth from the maximal value of r = g0 + g1 = 0.76/day to the minimal g0 = 0.12/day already at moderate CTL concentrations (E ≈ 104 cell/ml, Table 1). It is well recognized that CTLs are able to produce large amounts of interferon-gamma (IFNg) that may directly inhibit tumor growth, especially of IFNg-receptor expressing cells [6466]. Interestingly, while statistically the Sat and Power models fit the data worse than the SiGMA model, visually the fits of these three models are very similar (Figure 2). Furthermore, at high CTL concentrations (E = 107 cell/ml) all four models provide fits of a similar quality (Figure 2E).

Figure 2: The model assuming exponential growth of B16 tumor cells and mass-action killing by CTLs is not consistent with the B16 tumor dynamics.

Figure 2:

We fitted mass-action killing (MA, eqn. (3) and Figure 1A), saturated killing (Sat, eqn. (4) and Figure 1B), powerlaw killing (Power, eqn. (5) and Figure 1C), and saturation in growth and mass-action killing (SiGMA, eqn. (6) and Figure 1D) models to data (Datasets 1–4) that includes all our available data with CTL densities ≤ 107 cells/ml (see Materials and Methods for more detail). The data are shown by markers and lines are predictions of the models. We show model fits for data for (A): OT1 = 0, (B): OT1 = 104 cell/ml, (C): OT1 = 105 cell/ml, (D): OT1 = 106 cell/ml, and (E): OT1 = 107 cell/ml. Parameters of the best fit models and measures of relative model fit quality are given in Table 1; Akaike weights w for the model fits are shown in panel A.

Table 1: Parameters of the 4 alternative models fitted to Datasets 1–4 (excluding data with CTL = 108 cell/ml) and metrics of quality of the model fits.

Estimated parameters: α is a dimensionless scaling factor, r is given in the units of per day, h is in cells/ml, g1 is in per day and g2 is in cells/ml. The parameter k have different units in different models: per OT1 cells/ml per day, per day, per OT1 (cells/ml)n per day and per OT1 cells/ml per day for MA (eqn. (3)), Sat (eqn. (4)), Power (eqn. (5)) and SiGMA (eqn. (6)), respectively, and n is a dimensionless parameter. Parameter estimates and 95% confidence intervals for the best fit SiGMA model are: α = 2.71 (2.5 − 2.9), g0 = 0.12 (0.036 − 0.2)/day, g1 = 0.64 (0.55−0.73)/day, g2 = 6.72 (4.14−17.57)×103 cell/ml, and k = 3.3 (3.15−3.4)×107 ml/cell/day; model fits are shown in Figure 2. The best fit model (with the highest w) is highlighted in blue.

Datasets 1–4 (E ≤ 107 cell/ml): n=431
Model α r, 1/day k h n g 0 g 1 g 2 SSR AIC ∆AIC w
MA 2.77 0.576 3.79 × 107 164 814 160 0
Sat 2.81 0.744 6 5.34 × 106 118.5 677 23 0
Power 2.79 0.744 2.23 × 104 0.606 116 668 14 0
SiGMA 2.71 3.29 × 107 0.12 0.64 6715 112 654 0 1

It is important to note that even the best fit SiGMA model did not accurately describe all the data. For example, the model over-predicts the B16 counts at 24 hours for OT1 concentrations 104 and 105 cells/ml (Figure 2B&C) and under-predicts the B16 counts at 96 hours in growth (Figure 2A) and at 72 hours for OT1 concentrations 107 cells/ml (Figure 2E).

To intuitively understand why the MA model did not fit the data well we performed several regression analyses. Specifically, for every CTL and B16 tumor cell concentrations we calculated the net growth rate of the tumors rnet (Figure S1); in cases of several different targeted B16 concentrations we calculated the average net growth rate. In the absence of CTLs, the net growth rate of tumor cells was r0 = 0.62/day (Figure S2). Then for every CTL concentration we calculated the death rate of B16 tumor cells due to CTL killing as K = r0rnet. For the MA model, the death rate K should scale linearly with the CTL concentration [42], however, we found that this was not the case for B16 tumor cells in gels where the death rate scaled sublinearly with the CTL concentration (Figure S2). Importantly, this analysis also illustrates that at low CTL concentrations (104 – 105 cell/ml) we observe a much higher death rate of targets than expected at the power n = 0.57 (Figure S2). This indirectly supports the SiGMA model that predicts a higher (apparent) death rate of targets at low CTL concentrations due to reduced tumor’s growth rate.

One feature of these experimental data is that the recovery of the B16 tumor cells from the gels was typically lower than the targeted concentration that somewhat varied between different experiment and targeted B16 cell numbers (e.g., Supplemental Figure S1). Instead of fitting individual parameters to estimate the initial density of B16 tumor cells for every target B16 concentration we opted for an alternative approach. To predict initial concentration of B16 tumor cells we fitted a parameter α that scaled the targeted B16 number to the initial measured B16 concentration in the gel (see Materials and Methods for more detail). In separate analyses we investigated if assuming different α for different target B16 tumor concentrations by fitting our best fit models (for Datasets 1–4 or Datasets 1–5) with one or 5 α (see Materials and methods for more detail and Supplemental Table S2). Interestingly, the SiGMA model with varying α fitted the data (Datasets 1–4) marginally better than model with one α (F-test for nested models, p = 0.02, Supplemental Table S2). Other parameters such as the B16 tumor growth rate and CTL kill/suppression rates, however, were similar in both fits (Supplemental Table S2). In contrast, the fits of the Sat model to all data (Datasets 1–5) were similar whether we assumed different or the same α for different target B16 tumor concentrations (p = 0.37, Table S2). Because in all cases other statistical features of the model fit (e.g., residuals) were similar, in most of the following analyses we considered a single parameter α in fitting models to the data.

In our datasets we had in total 13 gels which did not contain any B16 tumor cells after co-incubation with CTLs (Supplemental Figure S1B&C); these data were excluded from the analyses so far. Data exclusion may generated biases, and we therefore investigated if instead of 0 B16 targets we assume these measurements are at the limit of detection (LOD). The true limit of detection was not defined in these experiments so we ran analyses assuming that LOD = 2 – 10 cell/ml. Importantly, inclusion of these 13 gels at the LOD did not alter our main conclusion; specifically, the SiGMA model remained the best model for Datasets 1–4 and the Sat model remains the best model when we used Datasets 1–5 (results not shown).

The best fit model varies with chosen subset of the data.

Experimental data suggest that the CTL (OT1) concentration of approximately 106 cell/ml is critical for removal of B16 melanoma cells [1]. Specifically, at concentrations E < 106 cell/ml the tumor cell concentration increases (Supplemental Figure S1A-C) while at E > 106 cell/ml tumor cell concentration declines (Supplemental Figure S1B-D). The growth and death rates of the tumors are similar when E ≈ 106 cells/ml and interestingly, in one dataset, the B16 tumor concentration initially declines but after 48h starts to increase (Supplemental Figure S1C). None of our current models could explain this latter pattern. To investigate if the data with CTL concentrations of 106 cell/ml may bias the selection of the best fit model we fitted our 4 alternative models to the data that excludes gels with B16 target concentrations of 105 and 106 cell/ml and CTL concentrations of 106 cell/ml from Dataset 3 and Dataset 4, respectively. Interestingly, for these subset of data the Power model fitted the data with best quality (based on AIC) predicting that the death rate of B16 tumor cells scales sub-linearly (n = 0.42) with CTL concentration (Supplemental Table S3). The Power model also provided the best fit if we included 7 additional gels from the Dataset 5 (with highest CTL concentrations, Supplemental Table S3). Interestingly, the MA model fitted this data subset with much better quality visually even though statistically the fit was still the worst out of all four models tested (Supplemental Table S3 and results not shown).

We further investigated if focusing on smaller subsets of data may also result in other models fitting such data best. For example, in one approach we focused on fitting the models to subsets of data with a single target B16 tumor cell concentration (Supplemental Table S4). Interestingly, for B16 concentrations of 104 and 106 cell/ml, the Power model provided the best fit but for target B16 concentration of 105 cell/ml, the Power and SiGMA models gave best fits. Including Dataset 5 in these analyses often led to the Sat model being the best (Supplemental Table S4). Finally, dividing the data into subsets for different experiments (out of 3), the Power model fitted best the data from Experiment 1 and 3 and SiGMA model fitted best the data from Experiment 2 (see Supplemental Table S5). Taken together these analyses strongly suggest that selecting the best model describing the dynamics of B16 tumor cells depends on the specific subset of data chosen for the analysis.

Alternative models predict different CTL concentrations needed to control tumor growth.

Given the difficulty of accurately determining the exact model for B16 tumor growth and its control by CTLs one could wonder why we need to do that. To address this potential criticism we calculated the time (eqn. (7)) it would take for CTLs to eliminate most (90%) of tumor cells if CTLs control tumor growth in accord with one of the 4 alternative models (e.g., with parameters given in Table 1). Interestingly, the MA model predicted the largest CTL concentration that would be required to eliminate most of the tumor cells in 100 days while the SiGMA model required the fewest (1.54 × 106cell/ml vs. 0.41 × 106cell/ml, respectively, Figure 3). The 4-fold difference may be clinically substantial in cancer therapies using adoptively transferred T cells (e.g., in tumor infiltrating lymphocyte-based therapies [67]). Interestingly, however, that the difference in predicted CTL concentration was somewhat similar for SiGMA and Power models that provided best fits for subsets of the data (Figure 3). Interestingly, the range of CTL concentrations was wider between alternative models fitted to subsets of the data (results not shown) further highlighting the need of better, more rigorous understanding how CTLs control tumor’s growth in collagen-fibrin gels.

Figure 3: The CTL concentration needed to eliminate most B16 tumor cells depends on the model of tumor control by CTLs.

Figure 3:

For every best fit model (Table 1) we calculated the time to kill 90% of B16 targets for a given concentration of CTLs (eqn. (7)). For every model we also calculated the control CTL concentration (Ec) that is required to eliminate at least 90% of the tumor cells within 100 days.

Mathematical models different from simple exponential growth are needed to explain B16 tumor dynamics in the absence of CTLs.

In our analyses so far we focused on different ways CTLs can control growth of the B16 tumor cells which assuming that in the absence of CTLs tumors growth exponentially (eqns. (3)(6)). In our new Dataset 4 in which gels were sampled at 0, 4, 8, 12, and 24 hours after inoculation we noticed that B16 tumor cells did not grow exponentially early after inoculation into gels (Supplemental Figure S1D). We therefore investigated whether a simple model in which B16 tumor cells grow exponentially is in fact consistent with our data.

First, we fitted the exponential growth model (eqn. (3) with E = 0) to all data from Dataset 1–5. Interestingly, while the model appeared to fit the data well (Figure 4A) and statistically the fit was reasonable (e.g., residuals normally distributed), model fits did not describe all the data accurately. In particular, the model over-predicted the concentration of B16 tumor cells at low (103 – 104 cell/ml) and high (108 cell/ml) targeted B16 concentrations. Lack of fit test also indicated that the model did not fit the data well (F20,154 = 7.12, p < 0.001). Finally, allowing the tumor growth rate to vary with the targeted B16 concentration resulted in a significantly improved fit (F4,170 = 19.77, p < 0.001) suggesting that the growth rate of B16 tumor cells in the absence of CTLs may be density-dependent (r0 = 0.59/day, r0 = 0.65/day, r0 = 0.64/day, and r0 = 0.85/day, r0 = −0.15/day for targeted B16 tumor cell concentrations of 103, 104, 105, 106, and 107 cell/ml, respectively, and α = 2.48).

Figure 4: Pure exponential growth (EG) model is not consistent with the data on B16 tumor dynamics in the absence of CTLs.

Figure 4:

(A): we fitted with an exponential growth model (eqn. (3) with E = 0) to data on B16 growth from all datasets 1–5 with OT1 = 0. The best fit values for the parameters along with 95% confidence intervals are: α = 2.6 (2.4 − 2.8) and r = 0.74 (0.69 − 0.79)/day. (B): we fitted exponential growth and two alternative models (eqn. (3) with E = 0 and eqns. (8)(9)) to the data from Dataset 4 for which OT1 = 0. The relative quality of the model fits is shown by Akaike weights w (see Table S6 for model parameters and other fit quality metrics). The data are shown by markers and model predictions are shown by lines.

Second, we noticed that in our new dataset with B16 tumor growth kinetics recorded in the first 24 hours after inoculation into gels (Dataset 4) does not follow a simple exponential increase (Supplemental Figure S1D). Instead, there is appreciable decline and then increase in the B16 cell concentration. We therefore fitted an exponential growth (EG) model along with two alternative models that allow for non-monotonic dynamics – i) a phenomenological model (eqn. (8)), and ii) a mechanistic model allowing for 2 sub-populations of tumor cells, one dying and another growing over time (eqn. (9)). Interestingly, while the EG model did not fit the data well, either of the alternative models described the data relatively well (Figure 4). These analyses thus strongly suggest that the dynamics of B16 tumor cells in collagen-fibrin gels in the absence of CTLs are not consistent with a simple exponential growth model.

Experiments with several measurements of B16 tumor concentrations at specifically chosen CTL densities will best allow to discriminate between alternative models.

In several alternative analyses we found that the best model describing the dynamics B16 tumor cells in collagen fibrin gels depends on specific dataset chosen for the analysis. It is unclear why this may be the case. One potential explanation is that individual datasets are not balanced, some have more measurements but on a shorter time scale while others are of a longer duration with fewer replicates. Because the exact mechanism of how CTLs impact tumor dynamics is important in predicting the concentration of CTLs needed for tumor elimination (Figure 3), we next sought to determine whether specific experimental designs may be better suited to discriminate between alternative models [62]. We therefore performed stochastic simulations to generate “synthetic” data from a given assumed model for different experimental designs and tested whether by fitting alternative models to the synthetic data we can recover the model used to generate the data.

We considered three different designs and compared two types within each design.

  • Design D1: Two time point experiment (Type A) vs four time point experiment (Type B). The two time point experiment have 48 observations. B16 target concentrations are 103, 104, 105, 105, 106, 107, 108 cells/ml, OT1 concentrations are 0, 105, 106, 107 cells/ml and time points are 0 and 24 hours. The four time point experiment have 48 observations. B16 target concentrations are 105, 106, 107 cells/ml, OT1 concentrations are 0, 105, 106, 107 cells/ml and time points are 0, 24, 48, 72 hours.

  • Design D2: Short-term experiment (Type A) vs long-term experiment (Type B). The short time experiment have 48 observations. B16 target concentrations are 105, 106, 107, OT1 concentrations are 0, 105, 106, 107 cells/ml and time points are 0, 8, 16, 24 hours. The long time experiment have 48 observations. B16 target concentrations are 105, 106, 107 cells/ml, OT1 concentrations are 0, 105, 106, 107 cells/ml, and time points are 0, 24, 48, 72 hours.

  • Design D3: More frequent OT1 experiment (Type A) vs less frequent OT1 experiment (Type B). The more frequent OT1 experiment have 40 observations. B16 target concentrations are 105, 106 cells/ml, OT1 concentrations are 0, 5 × 105, 106, 5 × 106, 107 cells/ml and time points are 0, 24, 48, 72 hours. The less frequent OT1 experiment have 40 observations. B16 target concentrations are 105, 106 cells/ml, OT1 concentrations are 0, 104, 105, 106, 107 cells/ml and time points are 0, 24, 48, 72 hours.

To draw a statistical comparison between the Types A and B of the experimental designs described above, we first chose one of the Saturation, Power, or SiGMA models with their best fit parameters (Table 1) and generated 48 observations for D1 and D2, or 40 observations for D3 for each of Types A and B. We excluded the MA model from these analyses as it never fitted the data well. In each of the generated predictions we added an error randomly chosen from the list yiy¯i, where yi is the observed B16 count in the data and y¯i is the average of yi at time t. Next, we simulated 100 replicates of such pseudo experiments, fitted the three models (Sat, Power, and SiGMA) to these 100 replicates, and computed the Akaike weights to determine the best fit model for each replicate. Due to the randomly chosen error structure for these hypothetical experiments, we found substantial variability among these 100 replicates where the best fit model was often different from the model from which the identical replicates were generated. For example, generating 100 simulated datasets from the Saturation model, we found that the Saturation model fitted these data only in 52% cases while the Power model fitted the best 36% of the time and the SiGMA model 12% of the time (first column of the first Type A matrix of Supplemental Figure S5D1).

By repeating the analysis for all three models we generated a matrix of Akaike weights with diagonal terms being heavier than the off-diagonal terms along with a constraint that the sum of a column should always add up to one (see Supplemental Figure S5). In this representation, a better experimental design among each types has a heavier diagonal than off-diagonal elements. Following this rule we see that D1 (Type B), D2 (Type B) and D3 (Type A) are the better experiment types (Supplemental Figure S5). To show that the difference between experimental design are statistically significant we used a resampling approach. We defined a test statistic measure given by

|𝒟|=||𝒟A|  |𝒟B||, (12)

where 𝒟 is the determinant of the matrix and |𝒟| is the absolute difference between two determinants. |𝒟| is equivalent to a difference in volume of two 3D parallelepipeds which edges are the columns of a matrix. For the hypothesis testing we defined the null hypothesis as: the column vectors, with constraints that the sum of elements must be unity, belong to the same class for both the experimental designs. We performed a null distribution test and a permutation test to reject the null hypothesis and showed that the column vectors which constitute the experimental designs are significantly different.

For the null distribution test, we randomly generated Type A and Type B sets of 106 matrices with their columns being normalized to unity. |𝒟| was then computed for the the Types A and B which forms a universal null distribution. The p-value is then the number of times |𝒟|null‘s are greater than observed |𝒟|obs normalized by the total number of simulations (106). The p-values for each of designs D1, D2 and D3 (Supplemental Figure 5B) confirms that a long time experiment with more time point observations and closely spaced CTL concentrations is a significantly better experimental design. For the permutation test, we generated three column matrices from all permutations of the six columns for each of designs D1, D2 and D3. The columns were chosen from the constructed matrices of Supplemental Figure S5. Then we randomly chose sets of two matrices for Types A and B from all the permutations of the previous step. |𝒟|per was computed for the Types A and B which forms a distribution. The p-value was then the number of times the permuted |𝒟|per‘s are greater than observed |𝒟|obs normalized by the total number of permuted sets (Supplemental Figure S5). With a permutation test we found that a long time experiment with more time point observations is a significantly better experiment but fail to confirm the same for closely spaced OT1 concentrations with statistical significance (see right panels of Supplemental Figure S5 for p-values). Taken together, these simulations suggest that longer experiments with at least 4 time points and a variable CTL concentration should provide best statistical power to discriminate between alternative models of B16 tumor control.

Discussion

Quantitative details of how CTLs kill their targets in vivo remain poorly understood. Here we analyzed unique data on the dynamics of SIINFEKL peptide-pulsed B16 melanoma tumor cells in collagen-fibrin gels – that may better represent in vivo tissue environments — in the presence of known numbers of SIINFEKL-specific CTLs (OT1 T cells) [1]. We found that a previously proposed model in which tumors grow exponentially and are killed by CTLs proportional to the density of CTLs (mass-action law) did not describe the experimental data well. In contrast, the model in which CTLs suppress the rate of tumor replication and kill the tumors in accord with mass-action law fitted a subset of the data (Datasets 1–4 with physiologically relevant CTL concentrations of E ≤ 107 cell/ml with best quality (Table 1). This result raises an interesting hypothesis that control of tumors by CTLs may extend beyond direct cytotoxicity, e.g., by secretion of cytokines. In fact, previous observations suggested that IFNg and TNFa may suppress tumor growth in different conditions although the ultimate effect of these cytokines on tumor progression in vivo is inconclusive as IFNg may in fact improve metastasis of some tumors [6466].

Importantly, however, fitting the alternative models to different subsets of data resulted in different best fit models, e.g., including the data with high CTL concentrations (E ≤ 108 cell/ml) typically predicted that the death rate of B16 tumor cells saturated at high CTL concentrations (Supplemental Table S1). In other cases, a power model in which the death rate of tumors scales sublinearly with the CTL concentration described subsets of the data best (Supplemental Table S3). Analysis of a new dataset on B16 tumor growth in the first 24 hours after inoculation into gels with no CTLs suggested that a simple exponential model does not describe these data adequately; instead models that allow for initial loss and then rebound in the number of B16 tumor cells was the best (Figure 4B). We also developed a novel methodology and proposed designs of experiments that may allow to better discriminate between alternative mathematical models. Our analysis suggested that longer-term experiments (0–72 hours) with 4 measurements of B16 cell concentration with several OT1 concentrations would have the highest statistical power (Figure 5).

Figure 5: Power analysis indicates that longer experiments with several, closely spaced CTL concentrations would allow to best discriminate between alternative models.

Figure 5:

We performed three sets of simulations to get insights into a hypothetical future experiment which may allow to better discriminate between alternative mathematical models. (A): Three experimental designs are: D1 – 2 time point vs 4 time point experiments; D2 — short time scale (0–24h) vs. long time scale (0–72h) experiments; D3 — more frequently chosen values of CTL concentrations vs less frequently chosen vales of CTL concentrations (see Figure S5 and Materials and methods for more details). For every experimental setup we calculate 𝒟 – the determinant of a matrix formed from a simulated experimental set whose columns are constrained. (B): We define a test measure |𝒟|obs between two sets of each of D1, D2 and D3 and compare the observed |𝒟|obs with the universal null distribution of |𝒟|null to compute the p-value. The values of 𝒟 in red in panel A shows the better experimental designs in the pairs.

Determining the exact mechanism by which CTLs control growth of B16 tumors may go beyond academic interest. In T cell-based therapies for the treatment of cancer, knowing the number of T cells required for tumor control and elimination is important. Our analysis suggests that specific details of the killing term do impact the minimal CTL concentration needed to reduce the tumor size within a defined time period (Figure 3). Other parameters characterizing impact of CTLs on tumor growth may also be important (Figure 6). For example, our analysis suggests that tumor’s growth rate, per capita killing rate by CTLs or the overall death rate of the tumors depend differently on CTL concentration given the underlying model (Figure 6A-C). The latter parameter, the death rate of CTL targets, has been estimated in several previous studies (reviewed in [44]) and ranges from 0.02/day to 500/day [37, 39, 40, 43, 6872]. While our estimates are consistent with this extremely broad range whether killing of B16 tumor cells in collagen-fibrin gels occurs similarly to elimination of targets in vivo (peptide-pulsed or virus-infected cells) remains to be determined. Interestingly, our models predict a highly variable number of B16 tumor cells killed per day especially at low CTL concentrations (Figure 6D). We estimate that a relatively small number of targets are killed per CTL per day that is in line of previous estimates for in vivo killing of peptide-pulsed targets by effector or memory CD8 T cells [42, Figure 6D].

Figure 6: Metrics to quantify efficacy of CTL-mediated control of tumors are model-dependent.

Figure 6:

For the three alternative models (Sat, Power, and SiGMA) that fitted some subsets of data with best quality we calculated metrics that could be used to quantify impact of CTLs on tumor growth depending on the concentration of tumor-specific CTLs. These metrics include (A): the growth rate of the tumors (fg in eqn. (1)); (B): per capita kill rate of tumors (per 1 CTL per day, fk/E in eqn. (1)); (C): the death rate of tumors due to CTL killing (fk in eqn. (1)). The grey box shows the range of experimentally observed death rates of targets as observed in some previous experiments (see Discussion for more detail and [44]); (E): the total number of tumors killed per day as the function of 3 different initial tumor cell concentrations (indicated on the panel); and (D): the number of tumors killed per 1 CTL/ml per day. The latter two metrics were computed by taking the difference of growth and combined killing at 24 hours. The parameters for the models are given is Table 1 and model equations are given in eqns. (4)(6).

Our work has several limitations. First, specifics of tumor cell and CTL movements in the gels remain poorly defined. Previous studies suggested that CTL motility in collagen-fibrin gels may be anisotropic creating bias in how different CTLs locate their targets [61]. Second, errors in estimating the number of surviving B16 tumor cells have not been quantified. For example, in some cases zero B16 cells were isolated from the gels while other gels in the same conditions contained tens-to-hundreds of cells (Supplemental Figure S1B-C). In our experience, the clonogenic assays typically do not allow to recover 100% of inoculated cells that is also indicated by estimated parameters α > 1. In fact, α = 2.8 suggests that only 1/2.8 = 35% of inoculated B16 tumor cells are typically recovered.

In the way of how we fitted models to data (by log-transforming model predictions and the data), we had to exclude the gels with zero B16 tumor cells from the analysis. While this exclusion did not impact our overall conclusions, future studies may need to develop methods to include 0 values in the analysis. Third, the density of gels may change over the course of experiment reducing the ability of CTLs to find their targets. Using microscopy to track tumor cells and CTLs may better define if the movement patterns of the cells change over time in the gel. Fourth, the dynamics of CTLs and loss of peptide by B6 tumor cells have not been accurately measured. In particular, we observed that at CTL concentration of 106 cells/ml and targeted B16 tumor cell concentration of 106 cell/ml, after the initial decline, B16 tumor concentration rebounded (Figure S1C). Decline in CTL concentration with time could be one explanation; however, in other conditions, B16 tumor cells continue declining exponentially, arguing against a loss of CTLs in the gels. Tumor escape could be another explanation. Future experiments would benefit from also measuring CTL concentration in the gel, along with B6 tumor cells, especially in longer (48–72h) experiments. Fifth, the final fits of the models to data did not pass the assumption of normality as the residuals were typically not-normally distributed (e.g., by Shapiro-Wilk normality test). We have tried several methods to normalize the residuals (e.g., excluding the outliers, using arcsin(sqrt) transformation) but none worked. Whether non-normal residuals led to biased parameter estimates of our best fit models remains to be determined. Sixth and finally, we assumed that every CTL is capable of killing and every target is susceptible to CTL-mediated killing which may not be accurate. Indeed, the result that Power model fits several subsets of data with best quality and predicts sublinear increase in the death rate of targets with CTL concentration may be due to heterogeneity in CTL killing efficacy. However, such a model would need to assume that inoculation of CTLs into gels results in a bias of inoculating a smaller fraction of killer T cells at higher CTL concentrations which seems unlikely.

Our work opens up avenues for future research. One curious observation of Budhu et al. [1] is that the death rate of B16 tumor cells does not depend on the concentration of the targets in the gel. We confirmed this observation as the models that include dependence of the B16 tumor cell death rate on tumor cell concentration (e.g., the updated SiGMA model with fk = kE/(1 + a1T + a2E) did not improve the fit quality (e.g., in the best fits of Datasets 1–4 we found a1 → 0 and a2 → 0). This model-driven experimental observation is inconsistent with effector to target ratio-dependence in chromium release assays and with many theoretical arguments suggesting that killing of targets (or interactions between predators and preys) should be ratio-dependent, not density-dependent [29, 7375]. Interestingly, our analysis of data from experiments on killing of peptide-pulsed targets in murine spleens by activated and memory CD8 T cells also showed no dependence on target cell concentration [42]. Future studies need to reconcile the difference between theoretical arguments and in vitro experiments and experimental observations in gels and in vivo.

The hypothesis that CTLs may impact the rate of tumor growth in collagen-fibrin gels can be tested experimentally. One such experiment could be to use two populations of tumors expressing different antigens, e.g., SIINFEKL and Pmel, in the presence or absence of SIINFEKL-specific CTLs (OT-1 T cells) [76]. Our experiments and mathematical modeling-based analyses can be extended to other types of tumor cells, CTL specifitiy, and the type of gels. Whether the CTL killing rates estimated from in vitro data correlates with CTL efficacy in vivo remains to be determined. Effective cancer immunotherapy relies on the infiltration and killing response of CD8+ T-cells [77, 78]. Increase of intratumoral CD8+ T-cells are shown to have direct correlation with radiographic reduction in tumor size in patients responding to treatment [79]. In B16 preclinical melanoma models cancer vaccines are found to induce cancer specific CD8+T-cells into tumors leading to cytotoxicity [80]. Estimating CTL killing efficiency such as kill rate per day or the number of melanoma cells killed per day could be useful in providing guidelines on cancer immunotherapy research and thus our modeling platform could therefore provide valuable insights for estimating the efficacy of T-cell based immunotherapies against cancer. The collagen-fibrin platform could be also useful to determine the killing efficiency of T cells (either expanded tumor infiltrating lymphocytes (TILs) or chimeric antigen receptor (CAR) T cells) prior to adoptively transferring them into patients; correlating this killing efficacy metric with actual success or failure of the therapy in patients may be a cheaper way to predict the overall efficacy of the therapy thus saving time and resources.

Supplementary Material

Supplement 1

Acknowledgments

We would like to thank Dr. Sam Silverstein for giving us the permission to use their unpublished data from previous experiments (Datasets 4&5). their This work was supported by the NIH grants (R01GM118553 and R01AI158963) to VVG.

Abbreviations:

CTLs

cytotoxic T lymphocytes

MA

mass action

Sat

saturation

SiGMA

suppression in growth with mass action in killing

Footnotes

Data sources

The data for the analyses is provided as a supplement to this publication and on github: https://github.com/vganusov/killing_in_gels.

Code sources

All analyses were performed in Mathematica. The sample code of fitting alternative models to the data is provided as a supplement to the paper and on github: https://github.com/vganusov/killing_in_gels.

Ethics statement

No animal or human experiments performed.

References

  • 1.Budhu S., Loike J. D., Pandolfi A., Han S., Catalano G., Constantinescu A., Clynes R. & Silverstein S. C. 2010. CD8+ T cell concentration determines their efficiency in killing cognate antigen-expressing syngeneic mammalian cells in vitro and in mouse tissues. J Exp Med, 207(1), 223–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Halle S., Halle O. & Forster R. 2017. Mechanisms and dynamics of T cell-mediated cytotoxicity in vivo. Trends in Immunology, 38(6), 432–443. doi: 10.1016/j.it.2017.04.002. [DOI] [PubMed] [Google Scholar]
  • 3.Halle S., Keyser K. A., Stahl F. R., Busche A., Marquardt A., Zheng X., Galla M., Heissmeyer V., Heller K. et al. 2016. In vivo killing capacity of cytotoxic T cells is limited and involves dynamic interactions and T cell cooperativity. Immunity, 44(2), 233–245. doi: 10.1016/j.immuni.2016.01.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Bossi G., Trambas C., Booth S., Clark R., Stinchcombe J. & Griffiths G. M. 2002. The secretory synapse: the secrets of a serial killer. Immunological Reviews, 189(1), 152–160. doi: 10.1034/j.1600-065X.2002.18913.x. [DOI] [PubMed] [Google Scholar]
  • 5.Jenkins M. R., Tsun A., Stinchcombe J. C. & Griffiths G. M. 2009. The strength of T cell receptor signal controls the polarization of cytotoxic machinery to the immunological synapse. Immunity, 31(4), 621–31. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Jenkins M. R. & Griffiths G. M. 2010. The synapse and cytolytic machinery of cytotoxic T cells. Current opinion in immunology, 22, 308–313. doi: 10.1016/j.coi.2010.02.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Dustin M. L. & Long E. O. 2010. Cytotoxic immunological synapses. Immunological Reviews, 235(1), 24–34. doi: 10.1111/j.0105-2896.2010.00904.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Ritter A. T., Asano Y., Stinchcombe J. C., Dieckmann N., Chen B.-C., Gawden-Bone C., van Engelenburg S., Legant W., Gao L. et al. 2015. Actin depletion initiates events leading to granule secretion at the immunological synapse. Immunity, 42(5), 864–876. doi: 10.1016/j.immuni.2015.04.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Villadangos J. A. 2016. Antigen-specific impairment of adoptive T-cell therapy against cancer: players, mechanisms, solutions and a hypothesis. Immunological Reviews, 272(1), 169–182. doi: 10.1111/imr.12433. [DOI] [PubMed] [Google Scholar]
  • 10.Zagury D., Bernard J., Thierness N., Feldman M. & Berke G. 1975. Isolation and characterization of individual functionally reactive cytotoxic T lymphocytes: conjugation, killing and recycling at the single cell level. European Journal of Immunology, 5(12), 818–822. doi: 10.1002/eji.1830051205. [DOI] [Google Scholar]
  • 11.Rothstein T. L., Mage M., Jones G. & McHugh L. L. 1978. Cytotoxic T lymphocyte sequential killing of immobilized allogeneic tumor target cells measured by time-lapse microcinematography. The Journal of Immunology, 121(5), 1652–1656. [PubMed] [Google Scholar]
  • 12.Chu G. 1978. The kinetics of target cell lysis by cytotoxic T lymphocytes: a description by Poisson statistics. J Immunol, 120(4), 1261–7. [PubMed] [Google Scholar]
  • 13.Perelson A. & Bell G. 1982. Delivery of lethal hits by cytotoxic T lymphocytes in multicellular conjugates occurs sequentially but at random times. J Immunol, 129(6), 2796–801. [PubMed] [Google Scholar]
  • 14.Macken C. & Perelson A. 1984. A multistage model for the action of cytotoxic T lymphocytes in multicellular conjugates. J Immunol, 132(4), 1614–24. [PubMed] [Google Scholar]
  • 15.Perelson A. S., Macken C. A., Grimm E. A., Roos L. S. & Bonavida B. 1984. Mechanism of cell-mediated cytotoxicity at the single cell level. viii. kinetics of lysis of target cells bound by more than one cytotoxic t lymphocyte. The Journal of Immunology, 132(5), 2190–2198. [PubMed] [Google Scholar]
  • 16.Perelson A. & Macken C. 1985. Quantitative models for the kinetics of cell-mediated cytotoxicity at the single cell level. Adv Exp Med Biol, 184, 551–61. [DOI] [PubMed] [Google Scholar]
  • 17.Lebow L. T., Stewart C. C., Perelson A. S. & Bonavida B. 1986. Analysis of lymphocyte-target conjugates by flow cytometry. I. Discrimination between killer and non-killer lymphocytes bound to targets and sorting of conjugates containing one or multiple lymphocytes. Natural immunity and cell growth regulation, 5, 221–237. [PubMed] [Google Scholar]
  • 18.Wiedemann A., Depoil D., Faroudi M. & Valitutti S. 2006. Cytotoxic T lymphocytes kill multiple targets simultaneously via spatiotemporal uncoupling of lytic and stimulatory synapses. Proceedings of the National Academy of Sciences, 103(29), 10 985–10 990. doi: 10.1073/pnas.0600651103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Isaaz S., Baetz K., Olsen K., Podack E. & Griffiths G. M. 1995. Serial killing by cytotoxic T lymphocytes: T cell receptor triggers degranulation, re-filling of the lytic granules and secretion of lytic proteins via a non-granule pathway. European Journal of Immunology, 25(4), 1071–1079. doi: 10.1002/eji.1830250432. [DOI] [PubMed] [Google Scholar]
  • 20.Fathi M., Charley L., Cooper L. J., Varadarajan N. & Meyer D. D. 2022. Cytotoxic T lymphocytes targeting a conserved SARS-CoV-2 spike epitope are efficient serial killers. BioTechniques, 72, 113–120. doi: 10.2144/btn-2022-0016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Varadarajan N., Julg B., Yamanaka Y. J., Chen H., Ogunniyi A. O., McAndrew E., Porter L. C., Piechocka-Trocha A., Hill B. J. et al. 2011. A high-throughput single-cell analysis of human CD8+ T cell functions reveals discordance for cytokine secretion and cytolysis. The Journal of Clinical Investigation, 121(11), 4322–4331. doi: 10.1172/JCI58653. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Vasconcelos Z., Muller S., Guipouy D., Yu W., Christophe C., Gadat S., Valitutti S. & Dupre L. 2015. Individual human cytotoxic T lymphocytes exhibit intraclonal heterogeneity during sustained killing. Cell Reports, 11(9), 1474–1485. doi: 10.1016/j.celrep.2015.05.002. [DOI] [PubMed] [Google Scholar]
  • 23.Bhat P., Leggatt G., Matthaei K. I. & Frazer I. H. 2014. The kinematics of cytotoxic lymphocytes influence their ability to kill target cells. PloS one, 9, e95 248. doi: 10.1371/journal.pone.0095248. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Qi S., Shi H., Liu L., Zhou L. & Zhang Z. 2019. Dynamic visualization of the whole process of cytotoxic T lymphocytes killing B16 tumor cells in vitro. Journal of biomedical optics, 24, 1–7. doi: 10.1117/1.JBO.24.5.051413. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Sykulev Y., Cohen R. J. & Eisen H. N. 1995. The law of mass action governs antigen-stimulated cytolytic activity of CD8+ cytotoxic T lymphocytes. Proc Natl Acad Sci U S A, 92(26), 11 990–2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Miller R. G. & Dunkley M. 1974. Quantitative analysis of the 51Cr release cytotoxicity assay for cytotoxic lymphocytes. Cell Immunol, 14(2), 284–302. [DOI] [PubMed] [Google Scholar]
  • 27.Thorn R. M. & Henney C. S. 1976. Kinetic analysis of target cell destruction by effector T cells. I. Delineation of parameters related to the frequency and lytic efficiency of killer cells. J Immunol, 117(6), 2213–9. [PubMed] [Google Scholar]
  • 28.Thorn R. M. & Henney C. S. 1977. Kinetic analysis of target cell destruction by effector T cells. II. Changes in killer cell avidity as a function of time and antigen dose. J Immunol, 119, 1973–1978. [PubMed] [Google Scholar]
  • 29.Zeijlemaker W. P., van Oers R. H., de Goede R. E. & Schellekens P. T. 1977. Cytotoxic activity of human lymphocytes: quanitative analysis of T cell and K cell cytotoxicity, revealing enzyme-like kinetics. J Immunol, 119(4), 1507–14. [PubMed] [Google Scholar]
  • 30.Thoma J. A., Touton M. H. & Clark W. R. 1978. Interpretation of 51Cr-release data: a kinetic analysis. J Immunol, 120(3), 991–7. [PubMed] [Google Scholar]
  • 31.Callewaert D. M., Johnson D. F. & Kearney J. 1978 Spontaneous cytotoxicity of cultured human cell lines mediated by normal peripheral blood lymphocytes. III. Kinetic parameters. Journal of immunology (Baltimore, Md. : 1950), 121, 710–717. [PubMed] [Google Scholar]
  • 32.Shacklett B. L. 2002. Beyond 51Cr release: New methods for assessing HIV-1-specific CD8+ T cell responses in peripheral blood and mucosal tissues. Clinical and experimental immunology, 130, 172–182. doi: 10.1046/j.1365-2249.2002.01981.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Khazen R., Muller S., Lafouresse F., Valitutti S. & Cussat-Blanc S. 2019. Sequential adjustment of cytotoxic T lymphocyte densities improves efficacy in controlling tumor growth. Scientific reports, 9, 12 308. doi: 10.1038/s41598-019-48711-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Barchet W., Oehen S., Klenerman P., Wodarz D., Bocharov G., Lloyd A. L., Nowak M. A., Hengartner H., Zinkernagel R. M. et al. 2000. Direct quantitation of rapid elimination of viral antigen-positive lymphocytes by antiviral CD8+ T cells in vivo. European Journal of Immunology, 30(5), 1356–1363. doi:. [DOI] [PubMed] [Google Scholar]
  • 35.Barber D. L., Wherry E. J. & Ahmed R. 2003. Cutting edge: Rapid in vivo killing by memory CD8 T cells. The Journal of Immunology, 171(1), 27–31. doi: 10.4049/jimmunol.171.1.27. [DOI] [PubMed] [Google Scholar]
  • 36.Byers A. M., Kemball C. C., Moser J. M. & Lukacher A. E. 2003. Cutting edge: Rapid in vivo CTL activity by polyoma virus-specific effector and memory CD8+ T cells. The Journal of Immunology, 171(1), 17–21. doi: 10.4049/jimmunol.171.1.17. [DOI] [PubMed] [Google Scholar]
  • 37.Regoes R. R., Barber D. L., Ahmed R. & Antia R. 2007. Estimation of the rate of killing by cytotoxic T lymphocytes in vivo. Proceedings of the National Academy of Sciences, 104(5), 1599–1603. doi: 10.1073/pnas.0508830104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Graw F. & Regoes R. R. 2009. Investigating CTL mediated killing with a 3D cellular automaton. PLOS Computational Biology, 5(8), 1–12. doi: 10.1371/journal.pcbi.1000466. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Yates A., Graw F., Barber D. L., Ahmed R., Regoes R. R. & Antia R. 2007. Revisiting estimates of CTL killing rates in vivo. PLOS ONE, 2(12), 1–7. doi: 10.1371/journal.pone.0001301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Ganusov V. V. & De Boer R. J. 2008. Estimating in vivo death rates of targets due to CD8 T-cell-mediated killing. Journal of Virology, 82(23), 11 749–11 757. doi: 10.1128/JVI.01128-08. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Ganusov V. V., Lukacher A. E. & Byers A. M. 2010. Persistence of viral infection despite similar killing efficacy of antiviral CD8+ T cells during acute and chronic phases of infection. Virology, 405(1), 193–200. doi: 10.1016/j.virol.2010.05.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Ganusov V. V., Barber D. L. & De Boer R. J. 2011. Killing of targets by cd8+ t cells in the mouse spleen follows the law of mass action. PLOS ONE, 6(1), 1–8. doi: 10.1371/journal.pone.0015959. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Graw F., Richter K., Oxenius A. & Regoes R. R. 2011. Comparison of cytotoxic T lymphocyte efficacy in acute and persistent lymphocytic choriomeningitis virus infection. Proceedings of the Royal Society B: Biological Sciences, 278(1723), 3395–3402. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Elemans M., Florins A., Willems L. & Asquith B. 2014. Rates of CTL killing in persistent viral infection in vivo. PLOS Computational Biology, 10(4), 1–10. doi: 10.1371/journal.pcbi.1003534. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Gadhamsetty S., Maree A. F., Beltman J. B. & de Boer R. J. 2014. A general functional response of cytotoxic T lymphocyte-mediated killing of target cells. Biophysical Journal, 106(8), 1780–1791. doi: 10.1016/j.bpj.2014.01.048. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Gadhamsetty S., Maree A. F., Beltman J. B. & de Boer R. J. 2017. A sigmoid functional response emerges when cytotoxic T lymphocytes start killing fresh target cells. Biophysical Journal, 112(6), 1221–1235. doi: 10.1016/j.bpj.2017.02.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.de la Roche M., Asano Y. & Griffiths G. M. 2016. Origins of the cytolytic synapse. Nature Reviews Immunology, 16(7), 421–432. [DOI] [PubMed] [Google Scholar]
  • 48.Hickman H. D. 2017. New insights into antiviral immunity gained through intravital imaging. Current Opinion in Virology, 22, 59–63. doi: 10.1016/j.coviro.2016.11.010. Emerging viruses: intraspecies transmission - Viral immunology. [DOI] [PubMed] [Google Scholar]
  • 49.Mempel T. R., Pittet M. J., Khazaie K., Weninger W., Weissleder R., von Boehmer H. & von Andrian U. H. 2006. Regulatory T cells reversibly suppress cytotoxic T cell function independent of effector differentiation. Immunity, 25(1), 129–141. doi: 10.1016/j.immuni.2006.04.015. [DOI] [PubMed] [Google Scholar]
  • 50.Boissonnas A., Fetler L., Zeelenberg I. S., Hugues S. & Amigorena S. 2007. In vivo imaging of cytotoxic T cell infiltration and elimination of a solid tumor. Journal of Experimental Medicine, 204(2), 345–356. doi: 10.1084/jem.20061890. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Breart B., Lemaitre F., Celli S. & Bousso P. 2008. Two-photon imaging of intratumoral CD8+ T cell cytotoxic activity during adoptive T cell therapy in mice. The Journal of Clinical Investigation, 118(4), 1390–1397. doi: 10.1172/JCI34388. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Caramalho I., Faroudi M., Padovan E., Muller S. & Valitutti S. 2009. Visualizing CTL/melanoma cell interactions: multiple hits must be delivered for tumour cell annihilation. Journal of Cellular and Molecular Medicine, 13(9b), 3834–3846. doi: 10.1111/j.1582-4934.2008.00586.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Deguine J., Breart B., Lemaitre F., Di Santo J. P. & Bousso P. 2010. Intravital imaging reveals distinct dynamics for natural killer and CD8+ T cells during tumor regression. Immunity, 33(4), 632–644. doi: 10.1016/j.immuni.2010.09.016. [DOI] [PubMed] [Google Scholar]
  • 54.Coppieters K., Amirian N. & von Herrath M. 2012. Intravital imaging of CTLs killing islet cells in diabetic mice. The Journal of Clinical Investigation, 122(1), 119–131. doi: 10.1172/JCI59285. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Cockburn I. A., Amino R., Kelemen R. K., Kuo S. C., Tse S.-W., Radtke A., Mac-Daniel L., Ganusov V. V., Zavala F. et al. 2013. In vivo imaging of CD8+ T cell-mediated elimination of malaria liver stages. Proceedings of the National Academy of Sciences, 110(22), 9090–9095. doi: 10.1073/pnas.1303858110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Bera S., Amino R., Cockburn I. A. & Ganusov V. V. 2022. Need for CD8 T cell clusters to eliminate a malaria liver stage arises in part due to heterogeneity in killing efficacy of individual effector T cells. BioRxiv, pp. 1–44.
  • 57.Beck R. J., Bijker D. I. & Beltman J. B. 2020. Heterogeneous, delayed-onset killing by multiple-hitting T cells: Stochastic simulations to assess methods for analysis of imaging data. PLoS computational biology, 16, e1007 972. doi: 10.1371/journal.pcbi.1007972. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Rastogi A., Robert P. A., Halle S. & Meyer-Hermann M. 2021. Evaluation of CD8 T cell killing models with computer simulations of 2-photon imaging experiments. PLOS Computational Biology, 16(12), 1–27. doi: 10.1371/journal.pcbi.1008428. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Gunzer M., Schafer A., Borgmann S., Grabbe S., Zanker K. S., Brocker E.-B., Kampgen E. & Friedl P. 2000. Antigen presentation in extracellular matrix: Interactions of T cells with dendritic cells are dynamic, short lived, and sequential. Immunity, 13(3), 323–332. doi: 10.1016/S1074-7613(00)00032-7. [DOI] [PubMed] [Google Scholar]
  • 60.Weigelin B. & Friedl P. 2010. A three-dimensional organotypic assay to measure target cell killing by cytotoxic T lymphocytes. Biochemical Pharmacology, 80(12), 2087–2091. doi: 10.1016/j.bcp.2010.09.004. Inflammation 2010 - Inflammatory Cell Signaling Mechanisms as Therapeutic Targets. [DOI] [PubMed] [Google Scholar]
  • 61.Wu P.-H., Giri A., Sun S. X. & Wirtz D. 2014. Three-dimensional cell migration does not follow a random walk. Proceedings of the National Academy of Sciences, 111(11), 3949–3954. doi: 10.1073/pnas.1318967111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Rajakaruna H. & Ganusov V. V. 2022. Mathematical modeling to guide experimental design: T cell clustering as a case study. Bulletin of mathematical biology, 84, 103. doi: 10.1007/s11538-022-01063-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Burnham K. P. & Anderson R. D. 2002. Model selection and multimodel inference: a practical information-theoretic approach. Springer-Verlag, New York. [Google Scholar]
  • 64.Taniguchi K., Petersson M., Hoglund P., Kiessling R., Klein G. & Karre K. 1987. Interferon gamma induces lung colonization by intravenously inoculate d B16 melanoma cells in parallel with enhanced expression of class I major histocompat ibility complex antigens. Proceedings of the National Academy of Sciences of the United States of America, 84, 3405–3409. doi: 10.1073/pnas.84.10.3405. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Rankin E. B., Yu D., Jiang J., Shen H., Pearce E. J., Goldschmidt M. H., Levy D. E., Golovkina T. V., Hunter C. A. et al. 2003. An essential role of Th1 responses and interferon gamma in infection-mediated suppression of neoplastic growth. Cancer biology & therapy, 2, 687–693. [PubMed] [Google Scholar]
  • 66.Zaidi M. R. 2019. The interferon-gamma paradox in cancer. Journal of interferon & cytokine research, 39, 30–38. doi: 10.1089/jir.2018.0087. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Luque M., Sanz-Alvarez M., Morales-Gallego M., Madoz-Gurpide J., Zazo S., Dominguez C., Cazorla A., Izarzugaza Y., Arranz J. L. et al. 2022. Tumor-infiltrating lymphocytes and immune response in HER2-positive breast cancer. Cancers, 14. doi: 10.3390/cancers14246034. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Asquith B., Edwards C. T., Lipsitch M. & McLean A. R. 2006. Inefficient cytotoxic T lymphocyte–mediated killing of HIV-1-infected cells in vivo. PLoS Biol, 4(4), e90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Goonetilleke N., Liu M. K., Salazar-Gonzalez J. F., Ferrari G., Giorgi E., Ganusov V. V., Keele B. F., Learn G. H., Turnbull E. L. et al. 2009. The first T cell response to transmitted/founder virus contributes to the control of acute viremia in HIV-1 infection. Journal of Experimental Medicine, 206(6), 1253–1272. doi: 10.1084/jem.20090365. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Asquith B. & McLean A. R. 2007. In vivo CD8+ T cell control of immunodeficiency virus infection in humans and macaques. Proceedings of the National Academy of Sciences, 104(15), 6365–6370. doi: 10.1073/pnas.0700666104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Mandl J. N., Regoes R. R., Garber D. A. & Feinberg M. B. 2007. Estimating the effectiveness of Simian Immunodeficiency Virus-specific CD8+ T cells from the dynamics of viral immune escape. Journal of Virology, 81(21), 11 982–11 991. doi: 10.1128/JVI.00946-07. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Ganusov V. V., Goonetilleke N., Liu M. K. P., Ferrari G., Shaw G. M., McMichael A. J., Borrow P., Korber B. T. & Perelson A. S. 2011. Fitness costs and diversity of the cytotoxic t lymphocyte (CTL) response determine the rate of CTL escape during acute and chronic phases of HIV infection. Journal of Virology, 85(20), 10 518–10 528. doi: 10.1128/JVI.00655-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Pilyugin S. S. & Antia R. 2000. Modeling immune responses with handling time. Bull Math Biol, 62(5), 869–90. [DOI] [PubMed] [Google Scholar]
  • 74.Abrams P. & Ginzburg L. 2000. The nature of predation: prey dependent, ratio dependent or neither? Trends Ecol Evol, 15, 337–341. [DOI] [PubMed] [Google Scholar]
  • 75.Gadhamsetty S., Marée A. F. M., Beltman J. B. & de Boer R. J. 2014. A general functional response of cytotoxic T lymphocyte-mediated killing of target cells. Biophys J, 106(8), 1780–1791. doi: 10.1016/j.bpj.2014.01.048. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Budhu S., Schaer D. A., Li Y., Toledo-Crow R., Panageas K., Yang X., Zhong H., Houghton A. N., Silverstein S. C. et al. 2017. Blockade of surface-bound TGF-β on regulatory T cells abrogates suppression of effector T cell function in the tumor microenvironment. Science Signaling, 10(494). doi: 10.1126/scisignal.aak9702. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Ott P. A. & Wu C. J. 2019. Cancer vaccines: steering T cells down the right path to eradicate tumors. Cancer discovery, 9(4), 476–481. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Ayers M., Lunceford J., Nebozhyn M., Murphy E., Loboda A., Kaufman D. R., Albright A., Cheng J. D., Kang S. P. et al. 2017. IFN-y-related mRNA profile predicts clinical response to PD-1 blockade. The Journal of Clinical Investigation, 127(8), 2930–2940. doi: 10.1172/JCI91190. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Tumeh P. C., Harview C. L., Yearley J. H., Shintaku I. P., Taylor E. J., Robert L., Chmielowski B., Spasic M., Henry G. et al. 2014. PD-1 blockade induces responses by inhibiting adaptive immune resistance. Nature, 515(7528), 568–571. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Fu J., Malm I.-J., Kadayakkara D. K., Levitsky H., Pardoll D. & Kim Y. J. 2014. Preclinical evidence that PD1 blockade cooperates with cancer vaccine TEGVAX to elicit regression of established tumors. Cancer research, 74(15), 4042–4052. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement 1

Articles from bioRxiv are provided here courtesy of Cold Spring Harbor Laboratory Preprints

RESOURCES