Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2017 Jan 15.
Published in final edited form as: Clin Cancer Res. 2016 Jan 15;22(2):284–290. doi: 10.1158/1078-0432.CCR-14-3336

Quantitative Imaging in Cancer Clinical Trials

Thomas E Yankeelov 1, David A Mankoff 2, Lawrence H Schwartz 3, Frank S Lieberman 4, John M Buatti 5, James M Mountz 6, Bradley J Erickson 7, Fiona MM Fennessy 8, Wei Huang 9, Jayashree Kalpathy-Cramer 10, Richard L Wahl 11, Hannah M Linden 12, Paul Kinahan 13, Binsheng Zhao 3, Nola M Hylton 14, Robert J Gillies 15, Laurence Clarke 16, Robert Nordstrom 16, Daniel L Rubin 17
PMCID: PMC4717912  NIHMSID: NIHMS732927  PMID: 26773162

Abstract

As anti-cancer therapies designed to target specific molecular pathways have been developed, it has become critical to develop methods to assess the response induced by such agents. While traditional, anatomic CT and MRI exams are useful in many settings, there is increasing evidence that these methods cannot answer the fundamental biological and physiological questions essential for assessment and, eventually, prediction of treatment response in the clinical trial setting, especially in the critical period soon after treatment is initiated. To optimally apply advances in quantitative imaging methods to trials of targeted cancer therapy, new infrastructure improvements are needed that incorporate these emerging techniques into the settings where they are most likely to have impact. In this review, we first elucidate the needs for therapeutic response assessment in the era of molecularly targeted therapy and describe how quantitative imaging can most effectively provide scientifically and clinically relevant data. We then describe the tools and methods required to apply quantitative imaging and provide concrete examples of work making these advances practically available for routine application in clinical trials. We conclude by proposing strategies to surmount barriers to wider incorporation of these quantitative imaging methods into clinical trials and, eventually, clinical practice. Our goal is to encourage and guide the oncology community to deploy standardized quantitative imaging techniques in clinical trials to further personalize care for cancer patients, and to provide a more efficient path for the development of improved targeted therapies.

Introduction

Oncology has recently developed a variety of new therapeutic agents that target specific molecular pathways as opposed to more traditional non-targeted cytotoxic chemotherapies. Similarly, medical imaging has developed from simple uses of X-rays to a range of advanced imaging techniques that are capable of quantitatively interrogating cancer biology at the physiological, cellular, and molecular levels. However, the imaging technology routinely employed in the clinical standard-of-care and clinical trial settings remains primarily dependent upon anatomic, size-based evaluation. Standard imaging response measures may not correlate with therapeutic effect and may not provide adequate early information about response and outcomes for many classes of new agents, for example, cytostatic drugs, tyrosine kinase inhibitors, anti-angiogenic and immune-based therapies. In such settings, tumor size may change little or even initially increase with effective treatment and, in fact, long term stability of tumor size may be a sign of a good response and longer term successful outcome from therapy. In light of these considerations, it is imperative that the imaging and oncology communities partner to ensure that selection of image modality, image acquisition and analyses are rationally paired with the anticipated concurrent effects of specific targeted therapies. In this review, we summarize the current state-of-the-art of cancer therapy response evaluation and limitations, review current and emerging quantitative imaging methods, and describe a framework for advancing quantitative imaging into clinical trials and practice. Our goal is to encourage the cancer and imaging communities to work jointly to develop and deploy quantitative cancer imaging methods that will support and guide improved evaluations of cancer response to modern cancer therapeutics.

Current State-of-the-Art for Response Assessment in Clinical Trials

Evidence supporting gross reduction in tumor size as a surrogate for effective therapy has led to establishment of size-based criteria for response (1-3). The most commonly used method for characterizing changes in tumor size is the Response Evaluation Criteria in Solid Tumors (RECIST; 4). The salient features of RECIST 1.1 are as follows. In a baseline (i.e., pretreatment) CT or MRI scan, up to five target lesions are identified and the sum of their longest single dimension is recorded. At follow up, the percent change in the sum of these diameters is calculated and the response is classified into complete response (disappearance of all target lesions), partial response (> 30% decrease in the sum of diameters of the target lesions), progressive disease (>20% increase in the sum of diameters of the target lesions or appearance of new lesions), or stable disease (none of the above). While RECIST is widely accepted in cancer clinical trials, the limitations of these criteria are increasingly apparent. Here we discuss representative examples from brain and lung cancer.

The challenges of a one-dimensional morphology-based measurement in glioma have been apparent for some time. Primary resection creates a cavity that makes cancer size difficult to measure and tumor margins are frequently unclear due to abnormal MRI signal intensity at resection margins caused by gliosis. Radiation related imaging changes creates confusion in response assessment because it may appear as an enhancing mass lesion and/or create enhancement months to years after initial treatment. Newer therapeutic approaches (e.g., radiation combined with temozolomide, TMZ) present a similar challenge, and more often leads to non-progression related enhancement acutely after therapy. Conventional imaging is not effective in distinguishing this “pseudo-progression” (a worsening anatomic appearance of lesions due to treatment, not due to tumor progression) versus radiation necrosis from true progression of glioma. To complicate this common scenario, patients who are thought to be progressing are often switched to anti-angiogenic agents such as bevacizumab that may produce “pseudoresponse”—a reduction in enhancement and mass effect despite continued tumor growth. The Response Assessment in Neuro-Oncology (RANO) working group was established to develop better treatment response guidelines for high grade glioma trials (5). The fundamental innovation in RANO is the incorporation of additional MRI scans into the assessment system, such as perfusion and diffusion MRI. The fundamental innovation in RANO is the incorporation of the FLAIR (fluid-attenuated inversion recovery) MRI sequence into the assessment, which can reflect non-enhancing components of tumor. The addition of functional imaging methods (e.g., diffusion and perfusion MRI, and PET using amino acid agents) that can distinguish tumor response from blood-brain barrier effects (i.e., pseudo-progression) may provide additional information on response in the future.

In lung cancer, the use of RECIST is often confounded by surrounding parenchymal structural abnormalities, before and especially after treatment, which may or may not contain tumor (6). Quantitative imaging with volumetric CT (2) or PET imaging (7) has the potential to provide early assessment of molecularly targeted therapies by assessing biological changes in tumors that are likely to be clinically relevant even in the absence of tumor shrinkage. For example, in non-small cell lung cancer patients treated with erlotinib, a small-molecule tyrosine kinase inhibitor (TKI) of the epidermal growth factor receptor (EGFR) a partial metabolic response, as measured by 2-[(18)F]-fluoro-2-deoxy-D-glucose PET (FDG-PET), is associated with improved progression free and overall survival, even in the absence of RECIST response, either during or after therapy (8). Similarly, for lung cancer treated with gefitinib (another EGFR targeted agent) volumetric CT was able to identify changes in tumor size not detected by standard RECIST measurements (9); and in another study, 3′- [(18)F]fluoro-3prime;-deoxythymidine PET (FLT-PET) indicated a decline in proliferation after one week of gefitinib treatment that predicted subsequent response at six weeks as assessed by standard, size-based criteria (10).

Overview of Quantitative Imaging Methods

Quantitative imaging refers to the systematic, objective measurement of numerically based information from digital images that is relevant to the assessment of the visualized tissue of interest. This approach differs from traditional radiological interpretation that is comprised of qualitative (visually based) assessment of the cancer by a radiologist recorded in a text report (e.g., “mild worsening of disease”) preferably with reporting of lesion morphology measurements. For clarity, we briefly describe several emerging quantitative imaging methods; the reader is encouraged to refer to Table 1 during the following discussion.

Table 1. Common imaging metrics that are appropriate for application in cancer clinical trials.

Imaging Modality Parameter Interpretation Biological Strengths/Weaknesses Technical Strengths/Weaknesses Acquisition Needs Analysis Needs
Volumetric CT tumor volume volume of tumor in mm3 Provides data to immediately assess tumor burden/non-specific Only requires routinely acquired clinical data/time consuming high spatial resolution standard of care software packages; some user skill
DCE-CT tumor enhancement qualitative or semiquantitative assessment of perfusion/permeability Insight into tumor vascular properties/qualitative in nature, additional radiation dose Easy to perform in the clinical setting/does not allow for quantitative interpretation high spatial resolution, modest temporal resolution standard of care software packages
DCE-CT vessel perfusion and permeability blood flow in units of mL(blood)/mL(tissue)/min and permeability surface area product in unit of mL/s Knowledge of tumor vascular properties/mixed measure of two vascular characteristics, additional radiation dose Increased level of rigor/requires local expertise and proper software to execute properly high temporal resolution, arterial input function specialized software; close interaction with imaging core
DCE-CT volume fractions fraction of voxel that is (e.g.) blood or extravascular extracellular space Knowledge of intra-tumoral make-up/Unproven clinical value, additional radiation dose Increased level of rigor/requires local expertise and proper software to execute properly high temporal resolution, arterial input function specialized software; close interaction with imaging core
DCE-MRI tumor enhancement qualitative or semiquantitative assessment of perfusion/permeability Insight into tumor vascular properties/qualitative or semiquantitative in nature Easy to perform in the clinical setting/does not allow for quantitative interpretation does not require high temporal resolution, moderate to high spatial resolution standard of care software packages
DCE-MRI vessel perfusion and permeability contrast agent transfer rate constant in units of min-1 containing both blood flow in units of mL(100 mL tissue)-1min-1 and permeability surface area product in unit of min-1 quantitative measure of tumor vascular properties/accuracy and precision prone to variations in data acquisition and analysis Increased level of rigor in quantitative analysis/requires local or central expertise and proper software to execute properly determination of pre-contrast T1 and arterial input function, high temporal resolution specialized software (in-house, commercial, or publicly available); close interaction with imaging scientists
DCE-MRI volume fractions fraction of voxel that is (e.g.) blood or extravascular extracellular space quantitative measure of intra-tumoral make-up/accuracy and precision prone to variations in data acquisition and analysis Increased level of rigor in quantitative analysis/requires local or central expertise and proper software to execute properly determination of pre-contrast T1 and arterial input function, high temporal resolution specialized software (in-house, commercial, or publicly available); close interaction with imaging scientists
DW-MRI apparent diffusion coefficient quantitative assessment of cell density Estimates of cellularity/non-specific Straightforward to implement in clinical settings/ADC quantification can be dependent on selection of diffusion weightings multiple image sets with different diffusion weightings standard of care software packages or specialized software (in-house, commercial, or publicly available)
FDG-PET accumulation of tracer qualitative assessment of glucose utilization Well understood interpretation in context of cancer/difficult to interpret for organs with high background Easy to perform in clinical setting/quantification issues brief scan 60 minutes post injection standard of care software packages
FDG-PET SUV semi-quantitative assessment of glucose utilization Provides rough estimate of glucose utilization/unclear clinical utility Easy to perform/lacks rigor and meaning brief scan 60 minutes post injection standard of care software packages; some user skill
FDG-PET kinetic analysis quantitative assessment of delivery, retention, and utilization of glucose Well-defined interpretation/unclear clinical utility Increased level of rigor/requires local expertise and proper software to execute properly dynamic acquisition over the uptake time (∼60 min) specialized software; close interaction with imaging core
FLT-PET accumulation of tracer qualitative assessment of cell proliferation Provides rough estimate of proliferation/difficult to interpret for certain tumors Easy to perform in clinical setting/quantification issues brief scan 60 minutes post injection standard of care software packages
FLT-PET SUV semi-quantitative assessment of cell proliferation Provides rough estimate of thymidine kinase activity/unclear clinical utility Easy to perform/lacks rigor and meaning brief scan 60 minutes post injection standard of care software packages; some user skill
FLT-PET kinetic analysis quantitative assessment of delivery, retention, and utilization of cell proliferation Well-defined interpretation/unclear clinical utility Increased level of rigor/requires local expertise and proper software to execute properly dynamic acquisition over the uptake time (∼60 min) specialized software; close interaction with imaging core

Perfusion measurements

Perfusion imaging usually involves the serial acquisition of MR or CT images before, during, and after an intravenous injection of a contrast agent. As the contrast agent enters a tissue, the signal intensity changes. The resulting signal intensity time course from a region of interest can be related to the concentration of contrast agent, which can then by analyzed with an appropriate pharmacokinetic model to estimate, for example, blood flow, vessel permeability, and tissue volume fractions (11).

Cellularity measurements

The microscopic thermally-induced behavior of molecules moving in a random pattern is referred to as self-diffusion or Brownian motion. The rate of diffusion of water molecules in cellular tissues is described by means of an apparent diffusion coefficient (ADC), the value of which largely depends on the density of barriers that a diffusing water molecule encounters, such as cell or nuclear membranes. MRI methods have been developed to measure the ADC, and in well-controlled situations the variations in ADC have been shown to correlate inversely with tissue cellularity (12), which may be used for determination of tumor response.

Metabolic measurements

The most commonly used PET imaging radiopharmaceutical in clinical practice is 2-[(18)F]-fluoro-2-deoxy-D-glucose or, simply, FDG. FDG is a glucose analogue that accumulates in areas of increased glycolytic activity, which is a near universal feature of cancer. It is well known that the activity of cell surface glucose transporters GLUT-1 and GLUT-3 (which transport FDG into the cells) and the intracellular enzyme hexokinase (which phosphorylates and traps FDG) are up-regulated in malignant cancer cells. As changes in the rate of glucose metabolism can provide an early and highly predictive indicator of response to therapy, FDG-PET is increasingly employed in clinical studies (13). However, unlike anatomic imaging-based measures, there are no widely agreed upon criteria for response by FDG-PET. There are an array of methods in current use for quantifying FDG-PET data (see Table 1), that include the standard uptake value (SUV), and, for cases where dynamic imaging is obtained, kinetic modeling. The SUV is a semi-quantitative metric based upon static uptake measurements that reports a percent of injected dose activity in a gram of tissue under investigation normalized to patient mass. Commonly used extensions of SUV include SUVmax, SUVmean, and metabolic tumor volume (MTV). Kinetic modeling is more quantitative in nature and can return estimates of the rate constants for glucose transport and consumption for a particular lesion of interest. An emerging standard that is gaining traction is the PERCIST (PET Response Criteria in Solid Tumors) response criteria have been proposed to provide systematic assessments of cancer treatment response by FDG-PET (14). These criteria rely primarily on static uptake measures such as SUV or SUL (SUV corrected for lean body mass).

Other PET radiopharmaceuticals target additional deregulated processes in cancer cells and may augment the ability of FDG to measure therapeutic response. For example, 18F-fluorothymidine (FLT) was developed as a surrogate marker of cellular proliferation (15). Once transported to the tumor intracellular space by equilibrative nucleoside transporter ENT transporters, FLT is phosphorylated by thymidine kinase-1 (TK1), which is known to have a large increase in activity during DNA synthase phase of the cell cycle (S-phase). Since FLT monophosphate is not incorporated into DNA and is impermeable to the cell membrane, it is trapped intracellularly. Thus, rapidly proliferating (tumor) cells can present an increased retention of phosphorylated FLT. However, there are subtleties to consider; FLT retention is dependent on the salvage pathway of thymidine synthesis, which is activated when a cell cannot carry out de novo synthesis of thymidine during DNA replication. Thus, the importance of determining the contribution of the thymidine salvage pathway when FLT-PET is used to image and monitor tumor proliferation has recently been emphasized. Further systematic study in a variety of tumors and treatments, as well as multi-center validation, is needed to support the use of FLT as a response marker in clinical trials. An example is the recent completion of ACRIN 6688, a multi-center trial of FLT PET to monitor early response to neoadjuvant chemotherapy in breast cancer (16).

Radiomic measurements

Tumors are phenotypically and genotypically heterogeneous and there is evidence that heterogeneity is synonymous with malignancy (17). In quantitative imaging, heterogeneity is reflected in voxel-by-voxel functional parameter maps, and is increasingly quantified with texture analysis, leading to the new field of “radiomics” (18). “Radiomics” is the process of extracting and analyzing mineable quantitative descriptors of heterogeneity from radiographic images. The overarching hypothesis of radiomics is that these high-level image features reflect the underlying tumor pathophysiology. A related approach uses these features to drive mechanism based predictive models (19). While clearly in the early days of development, such analyses may provide significant improvements in the power of image biomarkers for prediction, prognostication, or response monitoring.

Pairing of imaging and therapy

While quantitative imaging can offer much complimentary information in the care and treatment of the cancer patient, it is important to note that each imaging metric has its own set of applications for which it is optimally designed; and this is dictated by both the biological and technical considerations. For example, whole body PET/CT and diffusion MRI can readily assess metabolic and cellular responses of both primary tumor and metastatic disease to treatment, whereas current contrast enhanced MRI methods are unable to assess tumor perfusion in a whole-body examination and therefore has limited application in the metastatic setting. Another fundamental caveat is that before applying a quantitative imaging biomarker as an “endpoint”, it must be carefully validated in both the pre-clinical and clinical settings. While “ground truth” phantoms have been developed to validate a number of technical aspects of the imaging measures (20-25), there are several imaging methods for which phantom development may be impractical or not offer the proper biological insight (validating measures as biologic surrogates; e.g., cellular viability). However, there is a well-developed literature on all the methods listed in Table 1 for evaluation of cancer therapy response using clinical and/or pathological endpoints.

Consortia Efforts for Standardized Methods and Imaging in Clinical Trials

The National Cancer Institute has long recognized the importance of advanced imaging in oncology, and one of their current efforts is the Quantitative Imaging Network (QIN). The QIN is designed to promote development and validation of quantitative imaging methods and tools for the measurement of tumor response to therapies in clinical trial settings (26), with the overall goal of facilitating clinical decision-making. Key components/objectives of this effort include: 1) optimized and standardized methods for image acquisition, sharing, and cross-calibration of imaging results obtained at different centers, 2) optimized and standardized methods for quantitative image analysis, 3) tools for designing trials that involve quantitative imaging, and 4) reference data sets for development and validation of new quantitative imaging methods. The QIN attempts to build these components through four trans-network Working Groups: Data Acquisition Working Group, Image Analysis and Performance Metrics Working Group, Bioinformatics/IT and Data Sharing Working Group, and Clinical Trial Design and Development Working Group.

The Quantitative Imaging Biomarkers Alliance (QIBA) was organized in 2007 by the Radiological Society of North America (RSNA) as an initiative to advance quantitative imaging and the use of imaging biomarkers in clinical trials and clinical practice by engaging researchers, healthcare professionals and industry. The mission of QIBA is to improve the value and practicality of quantitative imaging biomarkers by reducing variability across devices, patients and time. The main output of QIBA are ‘Profiles’, which are documents that record the collaborative work by QIBA participants to provide one or more ‘Claims’ (which tell a user what quantitative results can be achieved by following the Profile) and associated ‘Details’ (which tell a vendor what must be implemented in their product and tell a user what procedures are necessary). QIN and QIBA are reciprocally-informed by having a cadre of members active in both groups. In this manner, efforts to improve quantitative imaging are complementary.

The American College of Radiology Imaging Network (ACRIN) is a clinical trials organization originally sponsored by the NCI Cancer Imaging Program to conduct clinical trials of imaging technologies as they relate to cancer. ACRIN's clinical trials encompass the full range of medical imaging research, including surveillance in high-risk populations, imaging biomarkers in early phase trials, prevention approaches in screening trials, and methodologies in comparative-effectiveness research. ACRIN recently merged with the Eastern Cooperative Oncology Group (ECOG) to form the ECOG-ACRIN Cancer Research Group with the broader mission to improve patient outcomes through earlier cancer detection and more successful therapeutic interventions. Other clinical trial networks that have active imaging committees include the Southwest Oncology Group (SWOG), the Children's Oncology Group (COG), and Alliance for Clinical Trials in Oncology.

Logistical Challenges and Approaches for Quantitative Imaging in Cancer Clinical Trials

As the workflow of imaging in a clinical trial can be quite complex, the details of how advanced imaging is actually (practically) incorporated into clinical trials vary dramatically between institutions. Specifically, there are multiple components to be considered in a trial that uses quantitative imaging endpoints: 1) selection of the appropriate imaging endpoint and modality, 2) qualification of the quantitative imaging capabilities of participating sites, 3) data collection and image analysis for imaging endpoint determination, and 4) auditing and quality control for quantitative imaging data. These are briefly summarized below, with a discussion of the infrastructure needed to support these components.

Selection of the appropriate imaging endpoint and modality

While cancer clinical trial imaging endpoints have traditionally been sized-based, and have typically used CT or anatomic MRI images to measure size, the imaging endpoint landscape has been made more complex by the specific needs of certain organ sites (e.g., brain tumors) and differing patterns of response for specific types of treatment (e.g., immunotherapy). In addition, more recently developed functional and molecular imaging methods (see Table 1) are emerging as preferred endpoints in a few instances (e.g., FDG-PET/CT for lymphoma) and may offer powerful, but not yet fully validated, response markers that are often quite predictive of key clinical endpoints such as survival. Quantitative imaging for cancer clinical trials therefore increasingly requires a panel of experts to help guide the choice of imaging modality and endpoint criteria, tailored to the disease site, patient population, and type of treatment. Many cancer centers have assembled such teams of imaging response experts, and so have most clinical trials organizations, which increasingly house imaging science committees. Some groups have also developed the infrastructure to carry studies of investigational imaging methods as exploratory endpoints to support later use as an integral marker in cancer therapy trials. Recent examples include a study of FLT-PET as an early indicator of breast cancer treatment response (ACRIN 6688), carried out across nearly 20 sites (16), which was designed to validate FLT PET/CT as an early indicator of response in a multi-center setting, and a study of hypoxia in brain tumors (ACRIN 6684), where 18F-FMISO PET and advanced MR imaging methods were tested as predictors of progression-free and overall survival patients newly diagnosed glioblastoma multiforme. The QIN was designed to serve as a scientific resource for the needs of quantitative cancer imaging for cancer centers, clinical trials groups, and other groups using quantitative cancer imaging endpoint (27).

Qualification of quantitative imaging capabilities of participating sites

To achieve valid and reproducible endpoints, all involved sites must carry out the proposed imaging specified in the clinical protocol with sufficient quality to provide valid, reproducible results. In addition to assuring the needed site investigator and staff expertise, the process of site qualification includes assurance that the imaging devices used are able to perform the type of imaging specified, that the device is performing up to specifications, that the device is operated according to the protocol specifications, that the image data is properly handled for research including proper de-identification, and that the data is transferred in a timely fashion to a central analysis site (28,29). Many trials have study-specific imaging requirements for participating sites that often include scanner qualification procedures such as scanning a specific phantom or providing patient image examples. The expansion of the number and scope of such imaging qualification procedures in clinical trials is a necessary and positive step, but it can be time consuming and costly. This consideration has spurred recent efforts to standardize and streamline the qualification process without giving up the rigor needed for meaningful qualification. The science of quantitative imaging standards and qualification is a key focus of the QIN.

Data collection and image analysis for imaging endpoint determination

Central collection of imaging data is an essential need for a therapeutic clinical trial using quantitative imaging endpoints. Once collected, it is important that the data are transferred in a timely fashion to a central collection and/or analysis site. De-identification of image sets for archiving and central analysis can be a challenge because advanced imaging methods often use private tags in the DICOM (Digital Imaging and Communications in Medicine; a widely-used standard for distributing and viewing medical images) header for image acquisition parameters that are too new to have passed through the DICOM standards process. Private tags were developed to allow vendors to store any information they wished. This allowed backward compatibility with older software, but means that Protected Health Information may sometimes be present. They also provide a place to put parameters for new imaging methods before standards ‘catch up’. Therefore, it can be important to remove some private tags to protect confidentiality but also important to maintain them when they contain important acquisitions parameters. Another challenge is the need to receive and archive images from many different types of devices, a process that has been aided by increasing image format standardization (30-32).

Image analysis presents a similar problem, assuring that the imaging metrics obtain from each measurement are consistent and reproducible, and meet the needs of the specific response criteria being used. A recent innovation involves directing the patient towards a different therapy or arm of the trial based on the results of early time point imaging data; i.e, an integral biomarker (33). In addition to requiring consistent and reproducible assessment, there is a necessity of having a panel of experts connected by a virtual network can provide centralized reads within 48 hours of acquisition. Thus, an active area of investigation, and an important focus of the QIN, is the development of tools for increasingly automated and reproducible image endpoint assessment.

Auditing and quality control for quantitative imaging data

Given the importance of assuring adherence to the imaging protocol, it is critical that the central data collection and/analysis facility site receive the data quickly, and then validate both adherence to the technical parameters, and that the images are acceptable for analysis. If the data might be submitted for FDA-approval of a therapy, it is essential to have a well-documented pathway from acquisition to final results posting. Once the images are transferred for analysis the processing methods that may be required for the new imaging methods must be understood, supported, and validated for all imaging devices included in the study; thus, careful management of all devices at all sites is required and any changes to analysis software must be confirmed to have no impact on measurements. Advances in imaging annotation and mark-up (34,35) provide a record of reader interpretation and image analysis and will be valuable tool in this regard. A final point to note is that experimental imaging methods may pose additional challenges for auditing and regulatory oversight, such as the need to carry out the study under an “investigational new drug/device” for investigational imaging probes or devices (see, e.g., 16).

Final thoughts on supporting imaging in clinical trials

This short discussion illustrates the logistic, technologic, and scientific infrastructure needs for deploying quantitative imaging in cancer clinical trials. The complexity and breadth of these needs have led to consolidation of efforts at individual cancer centers (many of whom have image shared resources, or “cores” providing such support), in pharma (where imaging Clinical research organization are frequently used), and clinical trials organizations (which has developed a centralized National Clinical Trials Network (NCTN) imaging core lab). Through its support of quantitative imaging expertise and research, the QIN provides a resource that supports the science of quantitative imaging and tools for quality control, standardized image acquisition, image analysis, and trial management key to cancer therapeutic trials.

Conclusions

As therapeutic regimens continue to grow in complexity and precision, the current clinical methods of radiological assessment of response will inevitably become inadequate. Emerging quantitative imaging methods are available for wide-scale deployment currently, and will increase in the immediate future. We posit that the current dearth of quantitative imaging in clinical trials is maintained because of insufficient awareness of the value of well defined and validated imaging endpoints in clinical trials, as well as the lack of organized infrastructure to effectively implement these alternative imaging biomarkers. These barriers are not insurmountable and it is our hope that the specific steps (outlined in section 5) will encourage and guide the oncology and imaging communities to deploy quantitative imaging techniques in clinical trials to facilitate precision care for cancer patients.

Acknowledgments

The authors thank Drs. Heather Jacene and Annick van den Abbeele for constructive criticisms and informative discussions.

D.A. Mankoff is a consultant/advisory board member for GE Healthcare and Reflexion Pharmaceuticals. J.M. Mountz is a consultant/advisory board member for ICON Medical Imaging and PAREXEL Informatics. R.L. Wahl is a consultant/advisory board member for Nihon Medi-Physics. P. Kinahan reports receiving a commercial research grant from GE Healthcare and has ownership interest (including patents) in PET/X LLC. R.J. Gillies has ownership interest (including patents) in and is a consultant/advisory board member for HealthMyne.

Grant Support: This work was supported by the NIH under award numbers U01CA142565 (T.E. Yankeelov), U01CA140207 (L.H. Schwartz), U01CA140230 (F.S. Lieberman and J.M. Mountz), U01CA140206 (J.M. Buatti), U01CA160045 (B.J. Erickson), U01CA151261 (F.M.M. Fennessy), U01CA154602 (W. Huang), U01CA154601 (J. Kalpathy-Cramer), U01CA140204 (R.L. Wahl), U01CA148131 (H.M. Linden and P. Kinahan), U01CA151235 (N.M. Hylton), U01CA143062 (R.J. Gillies), U01CA142555 (D.L. Rubin).

Footnotes

Disclosure of Potential Conflicts of Interest: No potential conflicts of interest were disclosed by the other authors.

Contributor Information

Hannah M. Linden, Email: hmlinden@u.washington.edu.

Laurence Clarke, Email: lclarke@mail.nih.gov.

Daniel L. Rubin, Email: dlrubin@stanford.edu.

References

  • 1.Piessevaux H, Buyse M, Schlichting M, Van Cutsem E, Bokemeyer C, Heeger S, et al. Use of early tumor shrinkage to predict long-term outcome in metastatic colorectal cancer treated with cetuximab. J Clin Oncol. 2013;31:3764–75. doi: 10.1200/JCO.2012.42.8532. [DOI] [PubMed] [Google Scholar]
  • 2.Zhao B, Oxnard GR, Moskowitz CS, Kris MG, Pao W, Guo P, et al. A pilot study of volume measurement as a method of tumor response evaluation to aid biomarker development. Clin Cancer Res. 2010;16:4647–53. doi: 10.1158/1078-0432.CCR-10-0125. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Jain RK1, Lee JJ, Ng C, Hong D, Gong J, Naing A, Wheler J, Kurzrock R. Change in tumor size by RECIST correlates linearly with overall survival in phase I oncology studies. J Clin Oncol. 2012;30:2684–90. doi: 10.1200/JCO.2011.36.4752. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Eisenhauer EA, Therasse P, Bogaerts J, Schwartz LH, Sargent D, Ford R, et al. New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1) Eur J Cancer. 2009;45:228–47. doi: 10.1016/j.ejca.2008.10.026. [DOI] [PubMed] [Google Scholar]
  • 5.Wen PY, Macdonald DR, Reardon DA, Cloughesy TF, Sorensen AG, Galanis E, et al. Updated response assessment criteria for high-grade gliomas: response assessment in neuro-oncology working group. J Clin Oncol. 2010;28:1963–72. doi: 10.1200/JCO.2009.26.3541. [DOI] [PubMed] [Google Scholar]
  • 6.Vansteenkiste J, Fischer BM, Dooms C, Mortensen J. Positron-emission tomography in prognostic and therapeutic assessment of lung cancer: systematic review. Lancet Oncol. 2004;5:531–40. doi: 10.1016/S1470-2045(04)01564-5. [DOI] [PubMed] [Google Scholar]
  • 7.Teng FF, Meng X, Sun XD, Yu JM. New strategy for monitoring targeted therapy: molecular imaging. Int J Nanomedicine. 2013;8:3703–13. doi: 10.2147/IJN.S51264. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Mileshkin L, Hicks RJ, Hughes BG, Mitchell PL, Charu V, Gitlitz BJ, et al. Changes in 18F-fluorodeoxyglucose and 18F-fluorodeoxythymidine positron emission tomography imaging in patients with non-small cell lung cancer treated with erlotinib. Clin Cancer Res. 2011;17:3304–15. doi: 10.1158/1078-0432.CCR-10-2763. [DOI] [PubMed] [Google Scholar]
  • 9.Zhao B, Schwartz LH, Moskowitz CS, Ginsberg MS, Rizvi NA, Kris MG. Lung cancer: computerized quantification of tumor response--initial results. Radiology. 2006;241:892–8. doi: 10.1148/radiol.2413051887. [DOI] [PubMed] [Google Scholar]
  • 10.Sohn HJ, Yang YJ, Ryu JS, Oh SJ, Im KC, Moon DH, et al. [18F]Fluorothymidine positron emission tomography before and 7 days after gefitinib treatment predicts response in patients with advanced adenocarcinoma of the lung. Clin Cancer Res. 2008;14:7423–9. doi: 10.1158/1078-0432.CCR-08-0312. [DOI] [PubMed] [Google Scholar]
  • 11.Yankeelov TE, Gore JC. Dynamic contrast enhanced magnetic resonance imaging in oncology: theory, data acquisition, analysis, and examples. Curr Med Imaging Rev. 2009;3:91–107. doi: 10.2174/157340507780619179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Anderson AW, Xie J, Pizzonia J, Bronen RA, Spencer DD, Gore JC. Effects of cell volume fraction changes on apparent diffusion in human cells. Magn Reson Imaging. 2000;18:689–695. doi: 10.1016/s0730-725x(00)00147-8. [DOI] [PubMed] [Google Scholar]
  • 13.Van den Abbeele AD. The Lessons of GIST--PET and PET/CT: a new paradigm for imaging. Oncologist. 2008;13(Suppl 2):8–13. doi: 10.1634/theoncologist.13-S2-8. [DOI] [PubMed] [Google Scholar]
  • 14.Wahl RL, Jacene H, Kasamon Y, Lodge MA. From RECIST to PERCIST: Evolving Considerations for PET response criteria in solid tumors. J Nucl Med. 2009;50(Suppl 1):122S–50S. doi: 10.2967/jnumed.108.057307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Shields AF, Grierson JR, Dohmen BM, Machulla HJ, Stayanoff JC, Lawhorn-Crews JM, et al. Imaging proliferation in vivo with F-18-FLT and positron emission tomography. Nat Med. 1998;4:1334–1336. doi: 10.1038/3337. [DOI] [PubMed] [Google Scholar]
  • 16.Kostakoglu L, Duan F, Idowu MO, Jolles PR, Bear HD, Muzi M, et al. Phase II study of 3′-deoxy-3′-18F fluorothymidine PET/CT (FLT-PET) in the assessment of early response in locally advanced breast cancer (LABC): preliminary results of ACRIN 6688. J Clin Oncol. 2014;32(5s) suppl; abstr 526. [Google Scholar]
  • 17.Gillies RJ, Verduzco D, Gatenby RA. Evolutionary dynamics of carcinogenesis and why targeted therapy does not work. Nature Reviews Cancer. 2012;12:487–93. doi: 10.1038/nrc3298. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Gatenby RA, Grove O, Gillies RJ. Quantitative imaging in cancer evolution and ecology. Radiology. 2013;269:8–14. doi: 10.1148/radiol.13122697. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Yankeelov TE, Atuegwu N, Hormuth D, Weis JA, Barnes SL, Miga MI, et al. Clinically relevant modeling of tumor growth and treatment response. Sci Transl Med. 2013;5:187ps9. doi: 10.1126/scitranslmed.3005686. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Meet Phannie, NIST's Standard ‘Phantom’ for Calibrating MRI Machines [about 3 screens] [cited 2015 Jul 24]; Available from: http://www.nist.gov/pml/electromagnetics/phannie_051110.cfm.
  • 21.Malyarenko D, Galbán CJ, Londy FJ, Meyer CR, Johnson TD, Rehemtulla A, Ross BD, Chenevert TL. Multi-system repeatability and reproducibility of apparent diffusion coefficient measurement using an ice-water phantom. J Magn Reson Imaging. 2013;37:1238–46. doi: 10.1002/jmri.23825. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Standards for x-ray computed tomography [about 2 screens] [cited 2015 Jul 24]; Available from: http://www.nist.gov/pml/div685/grp03/ctstandards.cfm.
  • 23.Zimmerman BE, Pibida L, King LE, Bergeron DE, Cessna JT, Mille MM. Development of a calibration methodology for large-volume, solid 68Ge phantoms for traceable measurements in positron emission tomography. Appl Radiat Isot. 2014;87:5–9. doi: 10.1016/j.apradiso.2013.11.049. [DOI] [PubMed] [Google Scholar]
  • 24.Doot RK, Pierce LA, II, Byrd D, Elston B, Allberg KC, Kinahan PE. Biases in multicenter longitudinal PET standardized uptake value measurements. Transl Oncol. 2014;7:48–54. doi: 10.1593/tlo.13850. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Fahey FH, Kinahan PE, Doot RK, Kocak M, Thurston H, Poussaint TY. PET phantom: Variability in PET quantitation within a multicenter consortium. Med Phys. 2010;37:3660–6. doi: 10.1118/1.3455705. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Mountz JM, Yankeelov TE, Rubin DL, Buatti JM, Erikson BJ, Fennessy FM, et al. A letter to cancer center directors: progress in quantitative imaging as a means to predict and/or measure tumor response in cancer therapy trials. J Clin Oncol. 2014;32:2115–6. doi: 10.1200/JCO.2014.55.8866. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Gerstner ER, Zhang Z, Fink JR, Muzi M, Hanna L, Greco E, et al. ACRIN 6684: Assessment of tumor hypoxia in newly diagnosed GBM using FMISO PET and MRI. J Clin Oncol. 2015;33 doi: 10.1158/1078-0432.CCR-15-2529. suppl; abstr 2024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Erickson BJ, Pan T, Marcus DS CTSA Imaging Informatics Project Group. Whitepapers on imaging infrastructure for research: part 1: general workflow considerations. J Digit Imaging. 2012;25:449–53. doi: 10.1007/s10278-012-9490-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Pan T, Erickson BJ, Marcus DS CTSA Imaging Informatics Project Group. Whitepapers on imaging infrastructure for research part three: security and privacy. J Digit Imaging. 2012;25:692–702. doi: 10.1007/s10278-012-9493-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.CTP-The RSNA Clinical Trial Processor [about 100 screens] [cited 2015 Jul 24]; Available from: http://mircwiki.rsna.org/index.php?title=CTP-The_RSNA_Clinical_Trial_Processor.
  • 31.Aryanto KY, Broekema A, Langenhuysen RG, Oudkerk M, van Ooijen PM. A web-based institutional DICOM distribution system with the integration of the Clinical Trial Processor (CTP) J Med Syst. 2015;39:45. doi: 10.1007/s10916-014-0186-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.The DICOM Standard 2015 [about 2 screens] [cited 2015 Jul 24]; Available from: http://medical.nema.org/standard.html.
  • 33.Mankoff DA, Pryma DA, Clark AS. Molecular imaging biomarkers for oncology clinical trials. J Nucl Med. 2014;55:525–8. doi: 10.2967/jnumed.113.126128. [DOI] [PubMed] [Google Scholar]
  • 34.Channin DS, Mongkolwat P, Kleper V, Rubin DL. The annotation and image mark-up project. Radiology. 2009;253:590–2. doi: 10.1148/radiol.2533090135. [DOI] [PubMed] [Google Scholar]
  • 35.Rubin DL, Willrett D, O'Connor MJ, Hage C, Kurtz C, Moreira DA. Automated tracking of quantitative assessments of tumor burden in clinical trials. Transl Oncol. 2014;7:23–35. doi: 10.1593/tlo.13796. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES