Skip to main content
BioMed Research International logoLink to BioMed Research International
. 2013 Sep 30;2013:726239. doi: 10.1155/2013/726239

Immune Monitoring in Cancer Vaccine Clinical Trials: Critical Issues of Functional Flow Cytometry-Based Assays

Iole Macchia 1,*, Francesca Urbani 1, Enrico Proietti 1
PMCID: PMC3806162  PMID: 24195078

Abstract

The development of immune monitoring assays is essential to determine the immune responses against tumor-specific antigens (TSAs) and tumor-associated antigens (TAAs) and their possible correlation with clinical outcome in cancer patients receiving immunotherapies. Despite the wide range of techniques used, to date these assays have not shown consistent results among clinical trials and failed to define surrogate markers of clinical efficacy to antitumor vaccines. Multiparameter flow cytometry- (FCM-) based assays combining different phenotypic and functional markers have been developed in the past decade for informative and longitudinal analysis of polyfunctional T-cells. These technologies were designed to address the complexity and functional heterogeneity of cancer biology and cellular immunity and to define biomarkers predicting clinical response to anticancer treatment. So far, there is still a lack of standardization of some of these immunological tests. The aim of this review is to overview the latest technologies for immune monitoring and to highlight critical steps involved in some of the FCM-based cellular immune assays. In particular, our laboratory is focused on melanoma vaccine research and thus our main goal was the validation of a functional multiparameter test (FMT) combining different functional and lineage markers to be applied in clinical trials involving patients with melanoma.

1. Introduction

The primary objective of immune monitoring in cancer vaccine clinical trials is to find a correlation between the efficient induction of tumor-specific T-cell responses and clinical efficacy, due to the importance of the host immune system in controlling tumor progression. However, although in several cancer vaccine trials there is indication of increased frequency of tumor-specific T-cells, no validated biomarkers exist for cancer immunotherapy as yet [1].

One reason for the lack of correlation between the immune parameters measured and objective clinical response might be the complexity of the immune responses required for a successful tumor eradication which cannot be dissected through the most frequently used T-cell assays.

Antitumor cell-mediated immunity is a key biomarker for most vaccines and immunotherapies and involves the activity of specialized cells including antigen specific cytotoxic T lymphocytes (CTLs) [2] and CD4+ helper T lymphocytes [3] as well as components of innate immunity such as macrophages, dendritic cells (DC), natural killer cells (NK), and granulocytes.

In addition, since the success of immune response against cancer is due to the balance between the effector and the suppressive compartments, immunological monitoring should also include analysis of immune suppressive cells (ISCs) such as regulatory T-cells (TREGs), myeloid-derived suppressor cells (MDSCs), and tumor-associated macrophages (TAMs) [46]. These cells play an important role in cancer progression and responses to immunotherapy. However, due to their tremendous phenotypic and functional heterogeneity, their usefulness as biomarkers of outcome or response to therapy has to await for further development of monitoring assays that better reflect their biologic significance in cancer.

In addition, a recent report [7] indicates that regulatory B cells (BREGs), a small subset of suppressor cells, may have profound effects on the development of T-cell responses, further complicating the interpretation of antitumor immune suppression in disease.

Local and systemic antitumor immune responses can show markedly different patterns and many functional responses could be missed when only peripheral blood lymphocytes (PBLs) and not tumor infiltrating lymphocytes (TILs) are evaluated; therefore, more emphasis should be put on immune monitoring also at the effector site by taking a biopsy of a metastatic lesion [8]. To this end, the concept of “Immunoscore,” initially described for colorectal cancer patients, has been recently introduced as an essential prognostic and potentially predictive tool to classify cancers, beside the traditional tumor staging classification (AJCC/UICC-TNM) [913]. This parameter might facilitate clinical decision making including rational stratification of patient treatment. Usually the immunoscore approach refers to the analysis of the location, density, and functional orientation of different immune cell populations infiltrating the tumor, including macrophages, DC, mast cells, NK cells, naïve and memory lymphocytes, B cells, and T lymphocytes (which include various subsets of T-cell: TH1, TH2, TH17, regulatory T-cells (TREGS), T follicular helper cells (TFH), and cytotoxic T-cells). Such “immune contexture” annotated in a large collections of human tumors has allowed the identification of components that are beneficial for patients and those that are deleterious [14]. For instance, in a study by Pagès et al. [15], high densities of T-cells (CD3+), cytotoxic T-cells (CD8+), and of memory T-cells (CD45RO+) were clearly associated with a longer disease-free survival (DFS) (after surgical resection of the primary tumour) and/or overall survival (OS).

However, the analysis of tumor microenvironment is not always feasible and the only samples available are those obtained from peripheral blood. Furthermore, sometimes peripheral responses should be of some relevance and could integrate and increase information given by the tumor microenvironment. For this reason, we believe that, in addition to scoring T-cells at tumor sites, the frequency and functions of T-cells circulating in the peripheral blood of cancer patients should be examined as potential biomarkers, by means of validated and standardized immune assays.

Concerning the quality of T-cell response, several papers showed that the multifunctionality of effector cells is an important factor to predict the immunological protection [25]. In particular, it has been demonstrated that the functional profile of HIV-specific CD8+ T-cells in progressors is limited compared to that of nonprogressors, which consistently maintain highly functional CD8+ T-cells and that the frequency and proportion of the HIV-specific T-cell response with highest functionality inversely correlates with viral load in the progressors [26]. In addition, other reports indicated that vaccine-induced multifunctional CD4+ and CD8+ T-cells produce greater amounts of IFN-γ than cells that secrete IFN-γ alone [27].

In the setting of cancer immunotherapy, the induction of polyfunctional NY-ESO-1-specific T-cell responses, following anti-CTLA-4 treatment of metastatic melanoma patients, has been recently shown to enhance T-cell responses and to induce durable clinical responses [28]. Further, a recent paper [29] demonstrated that the triple combination of IFN-γ, IL-2, and TNF-α represents a Th1 pattern of polycytokine secretion with greater antigen sensitivity and superior tumor recognition.

In order to get new insights in exploitation of vaccine-induced polyfunctional T-cells, standardization and validation of multiparameter assays are required.

In this review, we will overview the current technology used for immune monitoring during cancer immunotherapy in melanoma patients, focusing on a polychromatic FCM-based approach for ex vivo detection of tumor-antigen specific T lymphocytes producing multiple functional molecules simultaneously. To this aim, we will provide few experimental examples to discuss critical process steps encountered during validation of an FMT developed in our laboratory, consisting of a six-color panel for assessment of polyfunctionality of tumor-specific CD8+ T-cells in cryopreserved human peripheral blood mononuclear cells (PBMCs).

2. Overview of Immunoassays

The objective of any immune monitoring study is to collect interpretable, reliable, and reproducible data for the detection, quantification, and characterization of immune responses directed at specific antigens.

The principal techniques utilized for immune monitoring are reviewed in [30].

Measuring cytokine production and profile represents an integral part of immune monitoring during immunotherapeutic treatments [31]. First-generation immune-monitoring techniques included proliferation and cytotoxicity assays following short-term in vitro expansion; more recently, tetramer and Elispot (second-generation assays) allowed to assess directly ex vivo the frequency of vaccine specific T-cells and their ability to produce cytokines, usually IFN-γ [32]. However, this type of analyses is limited by the lack of information about the functional state of the cells. In the setting of cancer patients, where tumor escape mechanisms may induce T-cell anergy by altering lymphocyte signalling and effector functions [33], the need for third-generation assays aimed at evaluating the functional properties of rare cell populations of vaccine-induced T-cells with a multiparameter approach is becoming increasingly evident. To this aim, the development of polychromatic flow cytometry for immune monitoring has significantly contributed to progress in the field of human immunology.

In this paper, we will focus on some of the most widely used FCM-based assays for measurement of antigen-specific T-cells. In particular, intracellular cytokine staining (ICS) represents one of the main FCM-based assays and it has been previously validated by Horton et al. and De Rosa et al. [24, 34].

The CD107 mobilization assay measures the exposure of CD107 (LAMP: lysosomal associated membrane protein) a and b, present in the membrane of cytotoxic granules of CTLs, onto the cell surface as a result of degranulation and it can be used as an alternative to 51Cr release assay. In fact, a good correlation has been demonstrated between degranulation and cytotoxic activity of tumor-specific CD8+ T-cell clones and CD8+ T-cells, as measured in an FCM-based killing assay [35, 36]. Further, CD107-expressing CD8+ T-cells are shown to mediate cytolytic activity in an antigen-specific manner. Soluble major histocompatibility class I tetramers are a widely utilized tool for the direct ex vivo detection, characterization, and isolation of antigen-specific T-cells in a variety of clinical settings such as infectious, autoimmune, or neoplastic diseases [3741].

To provide a more complete assessment of the functionality of CD8+ T-cells expressing cognate T-cell receptors (TCR), measurement of CD107a and b expression can be combined with MHC-class I tetramer labeling and ICS [35].

In order to insure reproducibility and worldwide comparisons for conclusive longitudinal monitoring in multicenter studies, standardized operating procedure (SOPs), as well as standardized reagents and analysis protocols, need to be used [42].

Effective large-scale assay harmonization efforts have already been conducted for commonly used immunological assays of peripheral blood immune cell populations [43, 44].

Advances in multiparameter flow cytometric technologies and reagent applications for characterization and functional analysis of cells modulating the immune network have been recently reviewed in [45].

Researchers from Europe and the United States have started a project called Minimal Information About T-cell Assays (MIATA) [46] to standardize and harmonize commonly used assays such as the enzyme linked immunosorbent spot assay (Elispot) [47] and major histocompatibility complex tetramer assays [48]. The establishment of universally accepted guidelines for performing and presenting immunological assays in scientific publications will create a framework that will allow the comparison of immune responses across clinical trials. Many groups performed also optimization and harmonization of intracellular cytokine assays [4952].

3. Key Issues Involved in FCM-Based Assays and Development of FMT

Flow cytometry is a powerful and versatile technique, ideal for phenotyping, enumerating, and assessing the function of rare and precisely defined cell subsets at the single cell level. Functions assessed by flow cytometry include cytokine/chemokine production, CD107 expression, multimer analysis, natural cytotoxicity, antibody dependent cell cytotoxicity (ADCC), and proliferation. Critical steps for immune monitoring by flow cytometry which may affect yield, viability, and immunologic function of cells, include shipping blood variables such as temperature [16] and time delay of drawn blood processing, freezing/thawing conditions [17, 19, 51], type of anticoagulant used for blood collection, and type of density-gradient centrifugation used for the isolation of peripheral blood mononuclear cells. Other variables facing multicolor assay depend on antibodies and fluorochromes used, fixation and permeabilization reagents, instrument setup, data acquisition and analysis, reporting of results, internal quality control, external quality assessment, and flow sorting [53] (Table 1).

Table 1.

Critical issue References
Blood collection, shipment, and processing Temperature of storage [16]
Time from blood draw to sample processing [17, 18]
Freezing/thawing conditions [19]

DNAse during culture [20]

Perm/lysing reagents [21]

Flow cytometric issues Antibodies and fluorochromes [22, 23]
Spectral overlap and color compensation
Instrument setup
Data acquisition and analysis [24]

The importance of ex vivo analysis versus in vitro analysis has been addressed by [54].

The principal challenge for FCM-based assays for immune monitoring in cancer clinical trials is often due to the need of detecting rare subsets of cells avoiding the spurious positive events. This goal can be achieved by using a multiparameter approach in order to minimize the false positive and negative events by gating and subgating the cells of interest which express multiple markers simultaneously. Other critical issues are represented by in vitro T-cell culture methods when immune responses are analyzed in expanded T-cell cultures instead of ex vivo. To this aim, optimization of a cell culture method for analysis of polyfunctional T-cells has been previously dissected [55].

By setting up a procedure to assess polyfunctionality of tumor-associated antigen- (TAA-)specific cells in clinical trials, we observed a reduction of cell number at the end of the experiment, probably due to a loss of cells at different steps of cell processing (unpublished data). These observations led us to initiate a set of controlled in vitro studies to investigate the impact of different reagents and methods on recovery, viability, and immunological function of cells.

Our final goal was the optimization and validation of a reliable method, which we named FMT, for assessment of antigen specificity and effector functions against the melanocyte differentiation antigen Melan-A/MART-1. This protocol, adapted from [56], was based on a six-color panel combining CD8, MHC-tetramer, CD107a, and intracellular cytokine staining for three soluble factors with distinct properties (CD107, TNF-α, and IL-2), in response to the peptide Melan-A/MART-1 or other stimuli.

In previous experiments, based on previous reports indicating that different fixation/permeabilization buffers may affect the results of intracellular cytokine detection [21], we performed the FMT for CD107, TNF-α, and IL-2, after stimulation with Staphylococcus Enterotoxin B (SEB) and PHA and we compared two distinct standardized commercial lysing/permeabilization buffers: the Lysing/Perm solutions and the Intrasure kit (both purchased from BD Biosciences) (Figure 1).

Figure 1.

Figure 1

Comparison of intracellular and cell surface markers after treatment of cells with two different fixation/permeabilization buffers. Assessment of cytokine secretion and cytotoxic factor expression in CD8+ T-cells. Briefly, thawed PBMC from a healthy donor was cultured (1 hour at 37°C) in presence of anti-CD107a and Staphylococcus enterotoxin B (SEB; Sigma-Aldrich, Munich, Germany, used at 2 μg/mL) or PHA (HA16, Murex Biotech, Dartford, UK, used at 1.5 μg/mL) in presence of costimulatory antibodies (CD28 and CD49d). After the addition of brefeldin A (Golgi Plug) and monensin (Golgi stop) (Becton Dickinson, San Jose, CA, USA), cells were incubated for additional 5 hours. Following stimulation, final 2 mM EDTA was added to each well and incubated for 15 minutes. Cells were then incubated for 30 min at 4°C with surface antibodies (CD8), fixed, and permeabilized with the previously mentioned lysing/permeabilization buffers and stained with fluorescently labelled antibodies directed against IL-2 and TNF-α. Samples were then acquired on a FacsCanto flow cytometer instrument (BD Biosciences) and analyzed by FACSDiva and/or FlowJo software (Tree Star, Ashland). (a) Bar graph showing the percentages of total CD107a+, TNF-α +, and IL-2+ analyzed within CD8+ gated cells. (b) Bar graph showing the polyfunctionality of CD8+ T-cells upon SEB stimulation (Boolean analysis). As negative controls, we included untreated cell (only costimuli).

Overall, we found that the fixation/permeabilization with the Intrasure kit resulted in a stronger response for all the parameters analyzed and that stimulation with SEB yielded the higher percentages of CD8+ T-cells producing one, two, or three factors (Figure 1). Based on these results, we decided to use in our next experiments the Intrasure permeabilization kit and SEB as positive control.

Next, we investigated the impact of DNAse, which is usually used to digest extracellular DNA and reduce cellular clumping, on cell recovery and viability as well as its effect on cell function (Table 2).

Table 2.

w/o DNAse w/o DNAse w/o DNAse
NT SEB MART-1
% of CD8+ MART-1+∗ 0.0036 0.0039 0.0046
Number of CD8+ MART-1 34 29 38

DNAse in culture DNAse in culture DNAse in culture
NT SEB MART-1

% of CD8+ MART-1+ 0.013 0.0081 0.0077
Number of CD8+ MART-1+ 129 80 75

DNAse always DNAse always DNAse always
NT SEB MART-1

% of CD8+ MART-1+ 0.015 0.017 0.011
Number of CD8+ MART-1+ 143 153 103

*Percentage or number of cells as assessed in an FMT assay, performed on PBMCs from healthy donors, treated and labeled as in Figure 1, with the addition of HLA-A2/peptide tetramer staining at the beginning of culture (HLA-A2∗0201 peptide phycoerythrin (PE) tetrameric complexes specific for the Melan-A/MART-1 antigen).

Compared to previous reports [20] facing this issue, we try to keep the DNAse during the all steps of the FMT procedure, from thawing to culturing, even during washing steps.

Our results indicated that using DNAse after thawing PBMCs samples and during the entire procedure increased the absolute number and percentages of CD8+/MART-1+ cells as shown in Table 2 that summarizes the effect of DNAse on cell recovery at the end of FMT, by enumerating TAA-specific (Melan-A/MART-1) CD8+ T-cells in the presence or not of DNAse (DN25- SIGMA).

Soluble tetrameric MHC/peptide complexes have opened the possibility to directly identify and monitor antigen-specific CD8+ T-cells at the tumor site and in blood [40]. Multiparameter monitoring of antigen-specific T-cell responses that combines ex vivo tetramer staining with various phenotyping and functional assays provides a novel approach to assess the functional potential of tumor-specific T lymphocytes and may also facilitate the optimization of vaccination protocols.

Dextramers are multimers based on a dextran backbone bearing multiple fluorescein and streptavidin moieties, used for the analysis of relatively low frequency antigen-specific T-cells in peripheral blood. The functionality and optimization of dextramers have been previously demonstrated on human CD8+ T-cell clones with four independent antigen specificities [57].

Staining of a CD8+ line from a healthy donor with either MART-1-specific tetramers or pentamers or dextramers shows that dextramers produce a stronger signal against Melan-A antigen and a lower background signal than their tetramer and pentamer counterparts (Figure 2). Thus, dextramers could become the reagents of choice as the antigen-specific T-cell labeling transitions from basic research to clinical application.

Figure 2.

Figure 2

Comparison of different MHC multimers for detection of antigen-specific T-cells: dot plots representing percentages of CD8+ MART-1+ tetramer+/pentamer+/dextramers+ cells, analyzed within the singlets-live gate of a CD8+ expanded line obtained from a healthy donor.

Finally, validation of the FMT for analysis of the functionality of T-cells directly ex vivo was performed on a melanoma patient with discrete percentage of CD8+ MART-1+ specific T-cells.

In this assay, we evaluated the production of multiple cytokines (IFNα, TNFγ, and IL-2) and upregulation of LAMP-1 (CD107a) by tumor- (Melan-A/MART-1) specific T-cells. (Figures 3(a) and 3(b)).

Figure 3.

Figure 3

Validation of FMT (representative example of a melanoma patient). (a) Sequential gating strategy. Representative example dot plots and FACSDIVA analysis. Forward-scatter (FSC) area versus FSC height parameters were used to exclude cell doublets; cells were gated by forward and side scatter for lymphocytes; gated populations are plotted as CD8 (horizontal axis) versus tetramer staining (vertical axis). Direct ex vivo analysis cytokine production (IFNα, TNFγ, IL-2) and degranulation CD107a/LAMP-1) within CD8+ population or CD8+/MART-1 tetramer gated T-cells after stimulation with Melan-A/MART-1 peptide. (b) Histogram plots representing the individual functional combinations as a proportion of the total responding cells after stimulation with Melan-A/MART-1 peptide. Mutual exclusion, red bars: Percentage of cells expressing a certain combination of parameters (+) and not expressing the parameter indicated as (−). No mutual exclusion, blue bars: percentage of cells expressing a certain combination of parameters (+) independently from the expression of the parameter indicated with (−). The pie slices indicate the average proportion of the response producing 1, 2, 3, or 4 functions (regarding in this case “no mutual exclusion” variables). Each slice indicates one of the functions.

On our side, our FMT experiments were acquired on a BD-Canto instrument by DIVA software. We chose to analyze them by a classical approach, using a standard software dedicated to flow cytometry analysis, Flow Jo (Treestar, MA, USA) and generating graphical representation by Excel (Microsoft, WA, USA) elaboration. Gating strategy might have a potential impact on the analysis of antigen-specific polyfunctional T-cell responses. In our setting, our population of interest was defined meeting the criteria of a lymphocyte morphology, based on forward- and side-scatter parameters, singlet morphology, based on forward height scatter and forward area scatter, positivity of surface antigen expression (tetramer and CD8). Expression of 4 parameters, CD107a and the intracellular cytokines, IL-2, IFN-γ, and TNF-α, was simultaneously investigated by a 6-colors staining to assess polyfunctionality of the gated population. This sequential gating strategy is shown in Figure 3(a), along with some bidimensional plots showing some of the possible representation of parameters under study.

The possible combinations of positivity/negativity of these 4 parameters generate a large number of variables (30 for each sample). An effective way to give a graphic representation of such a lot of variables is to use histograms and pie chart (Figure 3(b)). Pie charts give a quick shot of the proportion of responding cells producing one or more functions without specifying which is the particular function [58]. We drew these graphics by elaborating FlowJo results export using a standard Excel (Microsoft, WA, USA) worksheet, adapting the Simplified Presentation of Incredibly Complex Evaluations software's approach (SPICE, Version 2.9, Mario Roederer, Vaccine Research Center, NIAID, NIH), one of the most largely utilized free Apple Mac-based data mining software [54, 58, 59].

4. Tools and Software for Analysis of Flow Cytometric Data

Traditional methods to analyze flow cytometric data involve gating of populations in one- or two-dimensional displays and manually selecting populations of interest. However, such methods are highly subjective and time consuming. Particularly, with the advent of multiple lasers flow cytometry analyzer, it is possible to have up to 18 colors of fluorescence detection simultaneously in the same sample. This leads to an enormous amount of variables, due to the all possible combinations of each parameter acquired. So that, critical is the analysis approach: bioinformatics will be surely the way to manage this kind of data in the next future. Looking back to the classical way to analyze FCS files, by manual, sequential gating, in the past years an enormous number of dedicated software has been developed by industries and academies (most of these last being freeware) [60].

Just to cite the most common among them, BD-DIVA, Miltenyi-MACSQuantify, Millipore-GuavaSuite, (acquisition and analysis commercial software, being interfaces of flow cytometer), FlowJo (one of the most common analyser software for flow cytometry), BeckmanCoulter-Kaluza, Weasel (commercial analysis software), and WinMDI, (free academic analysis software); each of them is endowed with peculiar tools and utility.

A detailed list of cytometry software and educational materials in cytometry is provided by the “original cytometry software catalog,” developed and managed by Dr. Eric Martz and by the Purdue University Cytometry Laboratories (http://www.cyto.purdue.edu/flowcyt/software/Catalog.htm).

Reviewing the new computational approach of analysis, often based on automated gating and high level of statistical analysis and representation output, several groups have developed different strategies.

Among them, open source tools like Bioconductor flowFlowJo, able to extracting information from a FlowJo workspace and deliver the data into R (one of the most common statistical processor) in the flowCore paradigm, have been developed to allow the management of high throughput data [61].

Probability binning algorithm extensively described by Roederer et al. in [62] is today a powerful tool employed, that is, to define subpopulation of cells, by means of-high resolution phenotype [63].

One unique approach, an algorithm called SPADE, utilizes downsampling, clustering, minimum spanning tree, and upsampling algorithms to generate two-dimensional branched visualizations [64, 65]. The branched tree structure incorporates information from all measurements in the data, partially addressing scalability issues. However, SPADE has many of the same subjective inputs as conventional clustering algorithms (e.g., number of clusters) and also may have issues of reproducibility and generation of nonbiological branches.

Similar to the SPADE software, the Euroflow Consortium software called INFINICYT uses nearest-neighbor analysis to associate the data around the center of the mass of cells. Adopting Euclidean distance analysis, this software associates a normal profile for a cell type (through phenotyping of multiple normal samples) to identify and characterize an abnormal profile (http://www.infinicyt.com/). Developed as a diagnostic tool, this approach is limited by the relative frequency of the cell subset of interest and restriction of the parameter chosen to determine the normal profile that was used to create the database.

An additional way to look at the data is using the probability state modeling (PSM) method and the visualization tools in GemStone (http://www.vsh.com/products/gemstone/) software for the analysis of multidimensional flow cytometry data. A probability state model is a set of generalized Q functions, one for each correlated measurement, where the common cumulative probability axis can be a surrogate for time or cellular progression. By exploiting the unique characteristics of Q functions, PSM can model any number of correlated measurements and present one comprehensive yet understandable view of the results. In summary, these various software packages work to reduce the complexity into a relatively small set of model parameters that are amenable to group statistics and comparisons.

A model-based analysis based on statistical mixture models has been recently reported by [66], for cell subtype identification in flow cytometry.

Multivariate analysis of flow cytometric data using decision trees is interestingly described in [67], where, in order to examine whether the production of a certain cytokine is depended on other cytokines, datasets from intracellular staining for six cytokines with complex patterns of co-expression were analyzed.

A number of these approaches involve some variation of clustering analysis, which can have important limitations. Other approaches have been developed in addition to clustering, including principal components analysis (PCA) and Bayesian inference. These approaches have been evaluated through the FlowCAP initiative (http://flowcap.flowsite.org/).

To standardize the universe of Flow Data, MIFlowCyt (minimal information about a flow cytometry) experiment standard has been approved by the International Society for Advancement of Cytometry for the reporting of any flow cytometry results (http://flowcyt.sourceforge.net/miflowcyt/).

Our comment on computational approach, using of command line languages, algorithm design is that it is a potent and precious tool but quite far from the mean expertise of a flow cytometer user, which should have a specific training and/or collaborating with a bioinformatician. Maybe the future will reserve us more user friendly interfaces dedicated to computational analysis of flow data.

5. Consortia and Useful Links for Harmonization and Standardization of FCM-Based Assays

Many immune monitoring Consortia have been recently created worldwide to help facilitate and harmonize immune monitoring approaches in the cancer immunotherapy field and establish rigorous quality control standards for serial monitoring of immunologic functions.

Among them, the Cancer Immunotherapy Consortium (CIC) of the Cancer Research Institute (CRI) in USA and the Association for Cancer Immunotherapy (CIMT) in Europe supported the web-based reporting framework on “Minimal Information about T-Cell Assays” MIATA [46], a project aimed at generating recommendations on the minimum information required to allow an objective and thorough interpretation of published results from immunological T-cell assays. (http://www.miataproject.org/). As mentioned before, up to date, this framework has completed proficiency panels and published harmonization guidelines for the top immune assays (Elispot, peptide-multimer assays, intracellular cytokine staining, and Luminex) [48, 68].

In addition, several links might help researcher to find their response to common questions regarding technical issues about FCM based-assays. Just to cite some of them, the Maecker lab weblog (http://www.miataproject.org/) provides research and training materials for flow cytometry and immune monitoring; the (http://cytobank.org/facselect/) might help to assist with optimization of staining conditions; the ICH Q2(R1) document (http://www.ich.org/products/guidelines/quality/article/quality-guidelines.html) is a guideline for validation of analytical procedures. In addition, a number of companies, such as the IST (http://immunositetechnologies.com/services/automation/immune-monitoring-automation.html) offer their expertise to design, develop, validate, and run polychromatic flow assays.

6. Conclusions

The development of new vaccines and immunotherapeutic strategies against cancer requires the sophisticated assessment of immune parameters (biomarkers) to reliably measure antitumor immune responses.

A wide range of advanced monitoring assays is currently used to determine phenotypical and functional characteristics of antitumor T-cells in cancer immunotherapy trials, including T-cell proliferation, cytokine profile, CTL assays, CTL-associated molecules (CD107, perforin, granzyme B, and CD154), and MHC-multimer analysis. However, these assays still fail to establish the possible correlation between immune response and clinical outcome. The lack of this correlation might reflect the methodological limitations of immunologic assays or the postvaccination absence of antitumor responses sufficiently robust to induce disease-free or overall survival.

Multiparameter flow cytometry expands platform for assessing functional profiles and patterns of immune responses. In particular, the use of polychromatic flow cytometry is likely to assume a role in defining the correlates of protection for vaccine efficacy as well as in monitoring immunotherapies in diseases such as HIV and cancer. In fact, it allows simultaneous detection of various parameters such as enumeration at the single cell level of different T-cell subsets (naïve, effector, central memory, effector memory), as well as cells belonging to the innate and myeloid compartment and providing information about the breadth and the quality of the induced immune response. The recent literature relates simultaneous expression of multiple functions (polyfunctionality) to immunity, since measurement of IFN-γ alone underestimates the total response [69].

Nevertheless, despite advances in the development of immune monitoring assays during the past decade, further advances are needed to implement throughput and standardization of such assays according to Good Laboratory Practice guidelines, such as those recently formulated based on recommendations from the iSBTc-SITC/FDA/NCI Workshop on Immunotherapy Biomarkers [70].

The goal of the present paper was to provide further insights into the development of standardized FCM-based immune assays. In particular, we revised the most common and critical issues of FCM-based technologies used for immune monitoring and evaluated the applicability of a six-color flow cytometric assay, previously developed in our laboratory, for immune monitoring in the setting of melanoma studies. This assay simultaneously measures effector cell degranulation and cytokine production by Melan-A/MART-1 specific CD8+ T-cells. We were able to define some of the crucial aspects regarding sample processing and evaluated various staining and gating strategies. Concerning flow data analysis, we might conclude that different approaches of analysis and visual representations should be performed in order to obtain a complete picture of results about polyfunctionality of tumor specific T-cells.

Ethical Approval

Shown experiments were carried out according to the principles set out in the Declaration of Helsinki in 1964 and all subsequent revisions. Blood donors received and signed appropriate informed consent.

Acknowledgment

The authors would like to thank Dr. Federica Moschella for her valuable comments and scientific contribution.

References

  • 1.Whiteside TL. Immune responses to cancer: are they potential biomarkers of prognosis? Frontiers in Oncology. 2013;3, article 107 doi: 10.3389/fonc.2013.00107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Vergati M, Intrivici C, Huen N-Y, Schlom J, Tsang KY. Strategies for cancer vaccine development. Journal of Biomedicine and Biotechnology. 2010;2010:13 pages. doi: 10.1155/2010/596432.596432 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Dobrzanski MJ. Expanding roles for CD4 T-cells and their subpopulations in tumor immunity and therapy. Frontiers in Oncology. 2013;3, article 63 doi: 10.3389/fonc.2013.00063. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Vergati M, Schlom J, Tsang KY. The consequence of immune suppressive cells in the use of therapeutic cancer vaccines and their importance in immune monitoring. Journal of Biomedicine and Biotechnology. 2011;2011:8 pages. doi: 10.1155/2011/182413.182413 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Olson BM, McNeel DG. Monitoring regulatory immune responses in tumor immunotherapy clinical trials. Frontiers in Oncology. 2013;3, article 109 doi: 10.3389/fonc.2013.00109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Marigo I, Dolcetti L, Serafini P, Zanovello P, Bronte V. Tumor-induced tolerance and immune suppression by myeloid derived suppressor cells. Immunological Reviews. 2008;222(1):162–179. doi: 10.1111/j.1600-065X.2008.00602.x. [DOI] [PubMed] [Google Scholar]
  • 7.Biragyn A, Lee-Chang C. A new paradigm for an old story: the role of regulatory B cells in cancer. Frontiers in Immunology. 2012;3, article 206 doi: 10.3389/fimmu.2012.00206. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Tjin EPM, Konijnenberg D, Krebbers G, et al. T-cell immune function in tumor, skin, and peripheral blood of advanced stage melanoma patients: implications for immunotherapy. Clinical Cancer Research. 2011;17(17):5736–5747. doi: 10.1158/1078-0432.CCR-11-0230. [DOI] [PubMed] [Google Scholar]
  • 9.Galon J, Pagès F, Marincola FM, et al. The immune score as a new possible approach for the classification of cancer. Journal of Translational Medicine. 2012;10, article 1 doi: 10.1186/1479-5876-10-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Galon J, Pag ès F, Marincola FM, et al. Cancer classification using the Immunoscore: a worldwide task force. Journal of Translational Medicine. 2012;10, article 205 doi: 10.1186/1479-5876-10-205. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Sobin LH, Compton CC. TNM seventh edition: what's new, what's changed: communication from the International Union Against Cancer and the American Joint Committee on Cancer. Cancer. 2010;116(22):5336–5339. doi: 10.1002/cncr.25537. [DOI] [PubMed] [Google Scholar]
  • 12.Wittekind C, Compton CC, Greene FL, Sobin LH. TNM residual tumor classification revisited. Cancer. 2002;94(9):2511–2516. doi: 10.1002/cncr.10492. [DOI] [PubMed] [Google Scholar]
  • 13.Ascierto PA, Capone M, Urba WJ, et al. The additional facet of immunoscore: immunoprofiling as a possible predictive tool for cancer treatment. Journal of Translational Medicine. 2013;11, article 54 doi: 10.1186/1479-5876-11-54. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Fridman WH, Pagès F, Sautès-Fridman C, Galon J. The immune contexture in human tumours: impact on clinical outcome. Nature Reviews Cancer. 2012;12(4):298–306. doi: 10.1038/nrc3245. [DOI] [PubMed] [Google Scholar]
  • 15.Pagès F, Kirilovsky A, Mlecnik B, et al. In situ cytotoxic and memory T cells predict outcome in patients with early-stage colorectal cancer. Journal of Clinical Oncology. 2009;27(35):5944–5951. doi: 10.1200/JCO.2008.19.6147. [DOI] [PubMed] [Google Scholar]
  • 16.Olson WC, Smolkin ME, Farris EM, et al. Shipping blood to a central laboratory in multicenter clinical trials: effect of ambient temperature on specimen temperature, and effects of temperature on mononuclear cell yield, viability and immunologic function. Journal of Translational Medicine. 2011;9, article 26 doi: 10.1186/1479-5876-9-26. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Disis ML, Dela Rosa C, Goodell V, et al. Maximizing the retention of antigen specific lymphocyte function after cryopreservation. Journal of Immunological Methods. 2006;308(1-2):13–18. doi: 10.1016/j.jim.2005.09.011. [DOI] [PubMed] [Google Scholar]
  • 18.Maecker HT, Moon J, Bhatia S, et al. Impact of cryopreservation on tetramer, cytokine flow cytometry, and ELISPOT. BMC Immunology. 2005;6, article 17 doi: 10.1186/1471-2172-6-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Weinberg A, Song L-Y, Wilkening C, et al. Optimization and limitations of use of cryopreserved peripheral blood mononuclear cells for functional and phenotypic T-cell characterization. Clinical and Vaccine Immunology. 2009;16(8):1176–1186. doi: 10.1128/CVI.00342-08. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.McLaughlin BE, Baumgarth N, Bigos M, et al. Nine-color flow cytometry for accurate measurement of T cell subsets and cytokine responses. Part I: panel design by an empiric approach. Cytometry A. 2008;73(5):400–410. doi: 10.1002/cyto.a.20555. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Papagno L, Almeida JR, Nemes E, Autran B, Appay V. Cell permeabilization for the assessment of T lymphocyte polyfunctional capacity. Journal of Immunological Methods. 2007;328(1-2):182–188. doi: 10.1016/j.jim.2007.09.001. [DOI] [PubMed] [Google Scholar]
  • 22.Maecker HT, Trotter J. Flow cytometry controls, instrument setup, and the determination of positivity. Cytometry A. 2006;69(9):1037–1042. doi: 10.1002/cyto.a.20333. [DOI] [PubMed] [Google Scholar]
  • 23.Kalina T, Flores-Montero J, van der Velden VH, et al. Euroflow standardization of flow cytometer instrument settings and immunophenotyping protocols. Leukemia. 2012;26(9):1986–2010. doi: 10.1038/leu.2012.122. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.De Rosa SC, Carter DK, McElrath MJ. OMIP-014: validated multifunctional characterization of antigen-specific human T cells by intracellular cytokine staining. Cytometry A. 2012;81(12):1019–1021. doi: 10.1002/cyto.a.22218. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Makedonas G, Betts MR. Polyfunctional analysis of human t cell responses: importance in vaccine immunogenicity and natural infection. Springer Seminars in Immunopathology. 2006;28(3):209–219. doi: 10.1007/s00281-006-0025-4. [DOI] [PubMed] [Google Scholar]
  • 26.Betts MR, Nason MC, West SM, et al. HIV nonprogressors preferentially maintain highly functional HIV-specific CD8+ T cells. Blood. 2006;107(12):4781–4789. doi: 10.1182/blood-2005-12-4818. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Precopio ML, Betts MR, Parrino J, et al. Immunization with vaccinia virus induces polyfunctional and phenotypically distinctive CD8+ T cell responses. Journal of Experimental Medicine. 2007;204(6):1405–1416. doi: 10.1084/jem.20062363. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Yuan J, Gnjatic S, Li H, et al. CTLA-4 blockade enhances polyfunctional NY-ESO-1 specific T cell responses in metastatic melanoma patients with clinical benefit. Proceedings of the National Academy of Sciences of the United States of America. 2008;105(51):20410–20415. doi: 10.1073/pnas.0810114105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Wilde S, Sommermeyer D, Leisegang M, et al. Human antitumor CD8+ T cells producing Th1 polycytokines show superior antigen sensitivity and tumor recognition. Journal of Immunology. 2012;189(2):598–605. doi: 10.4049/jimmunol.1102165. [DOI] [PubMed] [Google Scholar]
  • 30.de Rosa SC. Vaccine applications of flow cytometry. Methods. 2012;57(3):383–391. doi: 10.1016/j.ymeth.2012.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Clay TM, Hobeika AC, Mosca PJ, Lyerly HK, Morse MA. Assays for monitoring cellular immune responses to active immunotherapy of cancer. Clinical Cancer Research. 2001;7(5):1127–1135. [PubMed] [Google Scholar]
  • 32.Keilholz U, Martus P, Scheibenbogen C. Immune monitoring of T-cell responses in cancer vaccine development. Clinical Cancer Research. 2006;12(7, part 2):2346s–2352s. doi: 10.1158/1078-0432.CCR-05-2540. [DOI] [PubMed] [Google Scholar]
  • 33.Imai N, Ikeda H, Tawara I, Shiku H. Tumor progression inhibits the induction of multifunctionality in adoptively transferred tumor-specific CD8+ T cells. European Journal of Immunology. 2009;39(1):241–253. doi: 10.1002/eji.200838824. [DOI] [PubMed] [Google Scholar]
  • 34.Horton H, Thomas EP, Stucky JA, et al. Optimization and validation of an 8-color intracellular cytokine staining (ICS) assay to quantify antigen-specific T cells induced by vaccination. Journal of Immunological Methods. 2007;323(1):39–54. doi: 10.1016/j.jim.2007.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Betts MR, Brenchley JM, Price DA, et al. Sensitive and viable identification of antigen-specific CD8+ T cells by a flow cytometric assay for degranulation. Journal of Immunological Methods. 2003;281(1-2):65–78. doi: 10.1016/s0022-1759(03)00265-5. [DOI] [PubMed] [Google Scholar]
  • 36.Rubio V, Stuge TB, Singh N, et al. Ex vivo identification, isolation and analysis of tumor-cytolytic T cells. Nature Medicine. 2003;9(11):1377–1382. doi: 10.1038/nm942. [DOI] [PubMed] [Google Scholar]
  • 37.Altman JD, Moss PAH, Goulder PJR, et al. Phenotypic analysis of antigen-specific T lymphocytes. Science. 1996;274(5284):94–96. doi: 10.1126/science.274.5284.94. [DOI] [PubMed] [Google Scholar]
  • 38.Yee C, Greenberg P. Modulating T-cell immunity to tumours: new strategies for monitoring T-cell responses. Nature Reviews Cancer. 2002;2(6):409–419. doi: 10.1038/nrc820. [DOI] [PubMed] [Google Scholar]
  • 39.Klenerman P, Cerundolo V, Dunbar PR. Tracking T cells with tetramers: new tales from new tools. Nature Reviews Immunology. 2002;2(4):263–272. doi: 10.1038/nri777. [DOI] [PubMed] [Google Scholar]
  • 40.Pittet MJ, Speiser DE, Valmori D, et al. Ex vivo analysis of tumor antigen specific CD8+ T cell responses using MHC/peptide tetramers in cancer patients. International Immunopharmacology. 2001;1(7):1235–1247. doi: 10.1016/s1567-5769(01)00048-0. [DOI] [PubMed] [Google Scholar]
  • 41.Guillaume P, Dojcinovic D, Luescher IF. Soluble MHC-peptide complexes: tools for the monitoring of T cell responses in clinical trials and basic research. Cancer Immunity. 2009;9, article 7 [PMC free article] [PubMed] [Google Scholar]
  • 42.Singh SK, Tummers B, Schumacher TN, et al. The development of standard samples with a defined number of antigen-specific T cells to harmonize T cell assays: a proof-of-principle study. Cancer Immunology, Immunotherapy. 2013;62(3):489–501. doi: 10.1007/s00262-012-1351-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Fox BA, Schendel DJ, Butterfield LH, et al. Defining the critical hurdles in cancer immunotherapy. Journal of Translational Medicine. 2011;9, article 214 doi: 10.1186/1479-5876-9-214. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.van der Burg SH, Kalos M, Gouttefangeas C, et al. Harmonization of immune biomarker assays for clinical studies. Science translational medicine. 2011;3(108) doi: 10.1126/scitranslmed.3002785.108ps44 [DOI] [PubMed] [Google Scholar]
  • 45.O’Donnell EA, Ernst DN, Hingorani R. Multiparameter flow cytometry: advances in high resolution analysis. Immune Network. 2013;13(2):43–54. doi: 10.4110/in.2013.13.2.43. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Janetzki S, Britten CM, Kalos M, et al. “MIATA”-minimal information about T cell assays. Immunity. 2009;31(4):527–528. doi: 10.1016/j.immuni.2009.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Moodie Z, Price L, Janetzki S, Britten CM. Response determination criteria for ELISPOT: toward a standard that can be applied across laboratories. Methods in Molecular Biology. 2012;792:185–196. doi: 10.1007/978-1-61779-325-7_15. [DOI] [PubMed] [Google Scholar]
  • 48.Britten CM, Janetzki S, Ben-Porat L, et al. Harmonization guidelines for HLA-peptide multimer assays derived from results of a large scale international proficiency panel of the cancer vaccine consortium. Cancer Immunology, Immunotherapy. 2009;58(10):1701–1713. doi: 10.1007/s00262-009-0681-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Welters MJ, Gouttefangeas C, Ramwadhdoebe TH, et al. Harmonization of the intracellular cytokine staining assay. Cancer Immunology, Immunotherapy. 2012;61(7):967–978. doi: 10.1007/s00262-012-1282-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Maecker HT, McCoy JP. Corrigendum: a model for harmonizing flow cytometry in clinical trials. Nature Immunology. 2011;12(271):975–978. doi: 10.1038/ni1110-975. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Maecker HT, Rinfret A, D’Souza P, et al. Standardization of cytokine flow cytometry assays. BMC Immunology. 2005;6, article 13 doi: 10.1186/1471-2172-6-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Nomura L, Maino VC, Maecker HT. Standardization and optimization of multiparameter intracellular cytokine staining. Cytometry A. 2008;73(11):984–991. doi: 10.1002/cyto.a.20602. [DOI] [PubMed] [Google Scholar]
  • 53.Pierzchalski A, Mittag A, Tárnok A. Introduction A: recent advances in cytometry instrumentation, probes, and methods—review. Methods in Cell Biology. 2011;102:1–21. doi: 10.1016/B978-0-12-374912-3.00001-8. [DOI] [PubMed] [Google Scholar]
  • 54.Baumgaertner P, Jandus C, Rivals J-P, et al. Vaccination-induced functional competence of circulating human tumor-specific CD8 T-cells. International Journal of Cancer. 2012;130(11):2607–2617. doi: 10.1002/ijc.26297. [DOI] [PubMed] [Google Scholar]
  • 55.Lin Y, Gallardo HF, Ku GY, et al. Optimization and validation of a robust human T-cell culture method for monitoring phenotypic and polyfunctional antigen-specific CD4 and CD8 T-cell responses. Cytotherapy. 2009;11(7):912–922. doi: 10.3109/14653240903136987. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Lamoreaux L, Roederer M, Koup R. Intracellular cytokine optimization and standard operating procedure. Nature Protocols. 2006;1(3):1507–1516. doi: 10.1038/nprot.2006.268. [DOI] [PubMed] [Google Scholar]
  • 57.Batard P, Peterson DA, Devêvre E, et al. Dextramers: new generation of fluorescent MHC class I/peptide multimers for visualization of antigen-specific CD8+ T cells. Journal of Immunological Methods. 2006;310(1-2):136–148. doi: 10.1016/j.jim.2006.01.006. [DOI] [PubMed] [Google Scholar]
  • 58.Roederer M, Nozzi JL, Nason MC. SPICE: exploration and analysis of post-cytometric complex multivariate datasets. Cytometry A. 2011;79(2):167–174. doi: 10.1002/cyto.a.21015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Duvall MG, Precopio ML, Ambrozak DA, et al. Polyfunctional T cell responses are a hallmark of HIV-2 infection. European Journal of Immunology. 2008;38(2):350–363. doi: 10.1002/eji.200737768. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Bendall SC, Nolan GP, Roederersend M, Chattopadhyay PK. A deep profiler's guide to cytometry. Trends in Immunology. 2012;33(7):323–332. doi: 10.1016/j.it.2012.02.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Hahne F, LeMeur N, Brinkman RR, et al. flowcore: a bioconductor package for high throughput flow cytometry. BMC Bioinformatics. 2009;10, article 106 doi: 10.1186/1471-2105-10-106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Roederer M, Moore W, Treister A, Hardy RR, Herzenberg LA. Probability binning comparison: a metric for quantitating multivariate distribution differences. Cytometry. 2001;45(1):47–55. doi: 10.1002/1097-0320(20010901)45:1<47::aid-cyto1143>3.0.co;2-a. [DOI] [PubMed] [Google Scholar]
  • 63.Kalina T, Stuchlý J, Janda A, et al. Profiling of polychromatic flow cytometry data on B-cells reveals patients’ clusters in common variable immunodeficiency. Cytometry A. 2009;75(11):902–909. doi: 10.1002/cyto.a.20801. [DOI] [PubMed] [Google Scholar]
  • 64.Qiu P. Inferring phenotypic properties from single-cell characteristics. PLoS One. 2012;7(5) doi: 10.1371/journal.pone.0037038.e37038 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Qiu P, Simonds EF, Bendall SC, et al. Extracting a cellular hierarchy from high-dimensional cytometry data with SPADE. Nature Biotechnology. 2011;29(10):886–891. doi: 10.1038/nbt.1991. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Frelinger J, Ottinger J, Gouttefangeas C, Chan C. Modeling flow cytometry data for cancer vaccine immune monitoring. Cancer Immunology, Immunotherapy. 2010;59(9):1435–1441. doi: 10.1007/s00262-010-0883-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Simon S, Guthke R, Kamradt T, Frey O. Multivariate analysis of flow cytometric data using decision trees. Frontiers in Microbiology. 2012;3, article 114 doi: 10.3389/fmicb.2012.00114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Janetzki S, Panageas KS, Ben-Porat L, et al. Results and harmonization guidelines from two large-scale international elispot proficiency panels conducted by the cancer vaccine consortium (CVC/SVI) Cancer Immunology, Immunotherapy. 2008;57(3):303–315. doi: 10.1007/s00262-007-0380-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.De Rosa SC, Lu FX, Yu J, et al. Vaccination in humans generates broad T cell cytokine responses. Journal of Immunology. 2004;173(9):5372–5380. doi: 10.4049/jimmunol.173.9.5372. [DOI] [PubMed] [Google Scholar]
  • 70.Butterfield LH, Palucka AK, Britten CM, et al. Recommendations from the iSBTc-SITC/FDA/NCI workshop on immunotherapy biomarkers. Clinical Cancer Research. 2011;17(10):3064–3076. doi: 10.1158/1078-0432.CCR-10-2234. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from BioMed Research International are provided here courtesy of Wiley

RESOURCES