Abstract
BACKGROUND AND PURPOSE:
Brain tumor clinical trials requiring solid tumor assessment typically rely on the 2D manual delineation of enhancing tumors by ≥2 expert readers, a time-consuming step with poor interreader agreement. As a solution, we developed quantitative dT1 maps for the delineation of enhancing lesions. This retrospective analysis compares dT1 with 2D manual delineation of enhancing tumors acquired at 2 time points during the post therapeutic surveillance period of the American College of Radiology Imaging Network 6677/Radiation Therapy Oncology Group 0625 (ACRIN 6677/RTOG 0625) clinical trial.
MATERIALS AND METHODS:
Patients enrolled in ACRIN 6677/RTOG 0625, a multicenter, randomized Phase II trial of bevacizumab in recurrent glioblastoma, underwent standard MR imaging before and after treatment initiation. For 123 patients from 23 institutions, both 2D manual delineation of enhancing tumors and dT1 datasets were evaluable at weeks 8 (n = 74) and 16 (n = 57). Using dT1, we assessed the radiologic response and progression at each time point. Percentage agreement with adjudicated 2D manual delineation of enhancing tumor reads and association between progression status and overall survival were determined.
RESULTS:
For identification of progression, dT1 and adjudicated 2D manual delineation of enhancing tumor reads were in perfect agreement at week 8, with 73.7% agreement at week 16. Both methods showed significant differences in overall survival at each time point. When nonprogressors were further divided into responders versus nonresponders/nonprogressors, the agreement decreased to 70.3% and 52.6%, yet dT1 showed a significant difference in overall survival at week 8 (P = .01), suggesting that dT1 may provide greater sensitivity for stratifying subpopulations.
CONCLUSIONS:
This study shows that dT1 can predict early progression comparable with the standard method but offers the potential for substantial time and cost savings for clinical trials.
Objective, accurate, and reproducible methods to measure glioblastoma volume are important for clinicians to assess treatment response and guide appropriate therapy, both in daily practice and in clinical trials. Contrast-enhanced MR imaging is the most widely used approach and the focus of recent consensus brain tumor imaging protocol recommendations.1 However, although contrast-enhanced MR imaging has excellent spatial resolution, even slight variations in image-acquisition parameters or vendor platforms can greatly impact image quality, lesion conspicuity, and measurement of tumor volume.2 These problems are compounded by the fact that glioblastoma is histopathologically and radiographically heterogeneous in appearance, with geographically irregular margins, variable contrast enhancement, and regions of central necrosis or cystic changes.3 Furthermore, assessment of posttreatment tumor volume can be confounded by the presence of blood products that appear bright on postcontrast MR imaging and that mimic contrast-enhancing tumor,4 or in the context of therapies reducing blood-brain barrier permeability and contrast agent extravasation. For example, bevacizumab,5 used to treat recurrent glioblastoma, can decrease contrast agent extravasation independent of its effect on tumor biology.3,6 These challenges contribute to large interobserver differences (up to 50%–60%) in assessing tumor burden and evaluating treatment responses that impact both daily practice and clinical trials.4,7
As a solution, difference maps, created from the subtraction of precontrast from postcontrast images, have been used to highlight regions of contrast enhancement.8 However, unlike x-ray angiography or CT, pixel values in MR images can vary widely due to multiple factors, even for identical pulse sequences and tissue types; this variation can result in nonenhancing regions appearing in the subtraction image. In response, we developed quantitative dT1 images of contrast enhancement, which eliminate much of the normal variability in image contrast due to MR imaging system instabilities, field strength, slight differences in imaging parameters (TR, TE, and so forth), and sources of bright signal apparent on precontrast T1WI.9,10 Because dT1 images are quantitative, delineation of enhancing lesions can be automated by applying the same predetermined threshold across time points and patients.
Consequently, the dT1 tool has the potential to cause a paradigm shift in how brain tumor burden is assessed. This study compares the use of dT1 technology for semiautomatic lesion identification with the accepted standard that relies on expert readers to manually delineate enhancing lesions. The approach was to determine whether the semiautomatic determination of ROIs using dT1 images would compare with the adjudicated reads from the American College of Radiology Imaging Network 6677/Radiation Therapy Oncology Group 0625 central reader study (as reported in the primary article11) with regard to association with patient outcome.
Materials and Methods
The Radiation Therapy Oncology Group (RTOG, now NRG Oncology), in collaboration with the American College of Radiology Imaging Network (ACRIN, now Eastern Cooperative Oncology Group [ECOG]-ACRIN), both funded by the National Cancer Institute, conducted a prospective, randomized, Phase II multicenter trial (ACRIN 6677/RTOG 0625) of bevacizumab in recurrent glioblastoma multiforme. Each participating institution obtained institutional review board approval before subject accrual and conducted the trial in compliance with the Health Insurance Portability and Accountability Act. Informed consent was obtained for all subjects.
Patients
A total of 123 patients from 23 institutions with recurrent histologically proved glioblastoma or gliosarcoma were enrolled in the ACRIN 6677/RTOG 0625 trial. Detailed inclusion and exclusion criteria are available on the RTOG Web site (https://www.rtog.org/ClinicalTrials/ProtocolTable/StudyDetails.aspx?study=0625).
All patients were treated with bevacizumab (10 mg/kg IV on days 1 and 15 of a 28-day cycle) in combination with either temozolomide or irinotecan.11
Of the 123 patients enrolled, 107 patients met the inclusion criteria, defined as having imaging beyond baseline and progression data. Of these, 105 datasets could be analyzed by central reader analysis of 2D manual delineation of enhancing tumor (2D-T1), which required having an interpretable baseline image and at least 1 additional interpretable time point. Of the 105 datasets, matched pre- and postcontrast T1 images were available for 83 patients, enabling the creation of dT1 images. A matched dataset is defined as one for which the same imaging sequence and the same scanning options (eg, flow-compensation is either on or off for both) are used for both the pre- and postcontrast T1WI. Slight differences in TR and TE between the pre- and postcontrast images are acceptable. When we restricted attention to the weeks 8 and 16 time points, 74 patients were evaluable for comparison between the same 2D-T1 and dT1 image datasets at week 8 and 57 patents were evaluable for comparison at week 16.
Data-Acquisition Methods
MR imaging was performed at both 1.5T (Espree, Magnetom Avanto, Siemens, Erlangen, Germany; Signa Excite, Signa HDx, GE Healthcare, Milwaukee, Wisconsin) and 3T (Signa HDx, Signa Excite; GE Healthcare). Conventional MR imaging included precontrast T1WI, T2WI, FLAIR, and diffusion-weighted imaging.11 For both pre- and postcontrast T1WI, all sites were required to collect the data using a spin-echo sequence with the following parameter ranges: TE/TR = minimum (<15 ms)/400–600 ms, FOV = 220–240 mm, phase FOV = 75%, slice thickness/gap = 5/1 mm, matrix = 256 × 256, NEX = 1. The imaging protocol remained fixed at each site and across all time points. Following IV injection of 0.1 mmol/kg of a standard gadolinium-based contrast agent (the brand used was dictated by the preference of each site), axial 2D spin-echo (2D-T1) and 3D volumetric T1WI postcontrast images were acquired. Patients participating in the optional advanced component of the trial had dynamic contrast-enhanced, dynamic susceptibility contrast, and/or spectroscopic MR imaging at baseline, week 2, and after every 2 cycles of treatment. Results from these advanced imaging cohorts were previously reported.12–14 A complete listing of all MR imaging parameters for this protocol can be found on the ACRIN Web site (https://www.acrin.org/PROTOCOLSUMMARYTABLE/PROTOCOL6677/6677ImagingMaterials.aspx).
Image Analysis
Central Reader Analysis.
As previously described,11 all local imaging was transmitted to ACRIN for central review by 2 primary readers and 1 adjudicator, each with neuroradiology Certificates of Added Qualification and 8, 6, and 3 years, respectively, of postfellowship experience. For each distinct contrast-enhancing target lesion (≥1-cm diameter, ≥1 cm from other enhancing lesions), the largest diameter of contrast enhancement and its maximum perpendicular diameter were measured. A 2D tumor area was computed by summing over all lesions the product of maximum perpendicular diameters. Pre- and postcontrast images were reviewed simultaneously to exclude blood products from 2D measurements.
For all evaluable patients, images at each available time point were presented in random order to both primary readers who then independently made 2D-T1 measurements. After completing measurements for all time points, the primary readers were unblinded to the order of examinations. Consistent with the Macdonald and Response Assessment in Neuro-Oncology (RANO) criteria, each reader determined the time of progression on 2D-T1 when there was a >25% increase with respect to the nadir in maximal cross-sectional enhancing areas or the appearance of any new measurable enhancing tumor. Radiologic response was defined as a ≥50% decrease with respect to baseline, confirmed on the subsequent time point. Steroid dosage and clinical status were unavailable to the readers for this study. The adjudicator settled discordant times to progression between the readers by opining on the most correct times to progression. FLAIR images were not used to determine outcomes for either the 2D-T1 or dT1 analysis.
Creation of dT1 Maps
The dT1 method quantitatively compares calibrated pre-(T1) and postcontrast anatomic images, in which the calibration rule was machine-learned from input data of a given type (eg, T1WI spin-echo).9,10 Specifically, learning the calibration rule (historically referred to as the “standardization step”)15,16 requires the determination of mean intensity values at predefined landmarks, which correspond to percentiles in the distribution of pixel values, using a dataset of training images. This training step is performed only once. Next, each new input image of a given type is transformed to the standardized space (ie, calibrated) using a piecewise linear-intensity mapping function. The result is a constant dynamic range for the calibrated images so that for a given tissue type, it is possible to establish fixed gray-level windows without the need for a per-case window level adjustment.16
For routine analysis, 2D pre- and postcontrast 2D-T1 images were coregistered using a rigid mutual-information cost function, followed by application of the machine-learned calibration rule to each T1-weighted image. The calibrated-registered precontrast T1WI was subtracted from the calibrated-registered postcontrast T1WI, resulting in a dT1 image. Figure 1 illustrates the superior conspicuity of a glioblastoma with dT1 compared with a simple difference map constructed from noncalibrated images.
Fig 1.
Standardization is required for the creation of robust dT1 maps. A, Postcontrast T1WI obtained in a patient with a glioblastoma. B, A difference map created without calibration. C, A dT1 map created from the difference between calibrated post- and precontrast T1WI.
Because dT1 maps are quantitative, delineation of enhancing lesions can be semiautomated by choosing a fixed threshold and applying it consistently across time points and patients. The threshold of 3000 (calibrated units) was determined by an experienced (>20 years) neuroradiologist (S.D.R.), as previously described.10 Briefly, dT1 voxels were spatially correlated with raw dynamic susceptibility contrast MR imaging data. Voxels with no visually discernable dynamic susceptibility contrast MR imaging signal (ie, a lack of perfused tissue) were used to confirm a lack of contrast agent–perfused tissue and, thus, a lack of contrast agent enhancement. A threshold of 3000 was found to reliably make this distinction and is now routinely applied to dT1 images for the semiautomatic determination of contrast agent–enhancing ROIs. Note that the perfusion signal was used for the initial determination of a threshold. Its collection and use are not required for the routine use of dT1 maps. Generation of dT1 images was built into the IB Delta Suite software (Imaging Biometrics, Elm Grove, Wisconsin) used for this study.
A nonexpert reader (ie, an engineer with <4 years of MR imaging experience at the time of annotation) blinded to the central reader analyses coarsely defined the bounding region on each image slice using the dT1 maps. Care was taken to exclude the choroid plexus, vessels, and scalp. All pixels within the bounding region that were above 3000 were included as the final enhancing-tumor ROI. No manipulation of the tumor ROI was performed beyond identification of the initial bounding region. An experienced neuroradiologist (S.D.R.), blinded to the central reader results, reviewed and approved the final ROIs for any difficult cases. This approach mimics the current practice of having technologists preprocess data and radiologists perform a final review.
Statistical Analysis
2D-T1 results were reported previously.11 Using dT1, for each post-baseline time point, we measured the dT1 volume against the nadir value, and progression and response (R) were determined as described above for the central reader analysis. If neither the progression nor R criteria were satisfied, the time point was labeled as nonresponder/nonprogressor (NR-NP). Uninterpretable time points were ignored.
Agreement between the adjudicated 2D-T1 assessments and the dT1 assessments at weeks 8 and 16 was determined using a simple percentage agreement, as well as the Krippendorff α statistic. The latter statistic corrects for chance agreement,17 when the methods agree perfectly, α = 1, and when the methods agree as if chance had produced the results, α = 0.
For both 2D-T1 and dT1, separate landmark analysis sets were created for progression by weeks 8 and 16, and association with overall survival (OS) was reported using Kaplan-Meier curves with the log-rank test.
Statistical computations were performed using SAS Version 9.4 software (SAS Institute, Cary, North Carolina) or R Version 3.4.4 software (R project; http://www.r-project.org/), with P < .05 considered statistically significant.
Results
An example of a dT1 image created from a study patient is shown in Fig 2. The dT1 map, shown in color and gray-scale (Fig 2C, -D), clearly highlights the enhancing tumor without being confounded by the bright signal on precontrast T1WI (Fig 2A) or subtle enhancement on the postcontrast T1WI (Fig 2B).
Fig 2.
Benefit of creating a dT1 map. Shown are the pre- (A) and postcontrast (B) T1-weighted images from a patient with recurrent glioblastoma treated with bevacizumab and enrolled in the ACRIN 6677 trial. The bright signal on the precontrast image and the subtle enhancement on the postcontrast image make it difficult to determine the extent of enhancing tumor. Alternatively, the dT1 map created from the difference between calibrated pre- and calibrated postcontrast T1-weighted images clearly delineates enhancing tumor as displayed with either color (C) or in gray-scale (D).
By means of dT1, a total of 7/74 (9%) cases progressed by week 8, and 26/57 (46%) cases progressed by week 16. Of the cases that did not progress by week eight, 28/67 (42%) were R and 39/67 (58%) were NR-NP; the counts at week 16 were 23/31 (74%) and 8/31 (26%), respectively.
Cross-tabulation of week 8 status revealed perfect agreement for progression between dT1 and the adjudicated 2D-T1 reads. When nonprogressors were further subdivided into R versus NR-NP, the percentage agreement was 70.3% (95% CI, 59.1%–79.5%) with a Krippendorff α of 0.52 (95% CI, 0.35–0.70). Agreement for progression by week 16 decreased, with a percentage agreement of 73.7% (95% CI, 61.0%–83.4%) and a Krippendorff α of 0.46 (95% CI, 0.21–0.68). The percentage agreement further decreased when nonprogressors were subdivided into R versus NR-NP (percentage agreement = 52.6%; 95% CI, 39.9%–65.0%; Krippendorff α = 0.45; 95% CI, 0.22–0.65).
Given the perfect agreement for progression at week 8 between dT1 and the adjudicated 2D-T1 reads, the Kaplan-Meier curves for both methods were identical (Table 1 and Fig 3A), with a significant difference in OS (P < .0001). While 2D-T1 did not further distinguish between R and NR-NP (P = .35), there was a significant difference in OS between R and NR-NP for dT1 (P = .01; Table 1 and Fig 3B).
Table 1:
Overall survival stratified by progression status at week 8
| Sequence | Progression by Week 8? |
Progression by Week 8? (R vs NR-NP) |
|||
|---|---|---|---|---|---|
| No |
Yes |
R |
NR-NP |
P |
|
| N (%), Median OS (days) (95% CI) | N (%), Median OS (days) (95% CI) | N (%), Median OS (days) (95% CI) | N (%), Median OS (days) (95% CI) | N (%), Median OS (days) (95% CI) | |
| 2D | 67 (91%) | 7 (9%) | 18 (24%) | 49 (66%) | 7 (9%) |
| 303 (232–400) | 110 (74–192) | 364 (280–510) | 268 (217–378) | 110 (74–192) | |
| P < .0001a (n = 74) | P = .35: R vs NR-NP | ||||
| dT1 | 67 (91%) | 7 (9%) | 28 (38%) | 39 (53%) | 7 (9%) |
| 303 (232–400) | 110 (74–192) | 425.5 (311–660) | 223 (180–276) | 110 (74–192) | |
| P < .0001a (n = 74) | P = .01a: R vs NR-NP | ||||
Note:—N indicates number of patients; R, responder; NR-NP, non-responder/non-progressor; P, progression.
Significant.
Fig 3.
Kaplan-Meier curves for 2D-T1 and dT1-determined enhancing tumor. Shown are overall survival curves stratified by whether the participant progressed at or before week 8 (A), progressed at or before week 8, broken into progressing (P), responding, and nonresponding/nonprogressing (B), progressed at or before week 16 (C) and had progressed at or before week 16, broken into P, R, and NR-NP (D).
At week 16, a highly significant difference in OS was observed between progressors and nonprogressors for both T1 and dT1 (P < .0001, P = .006; Table 2 and Fig 3C). No difference in OS was observed between R and NR-NP for either method (P = .73 and P = .61; Table 2 and Fig 3D).
Table 2:
Overall survival stratified by progression status at week 16
| Sequence | Progression by Week 16? |
Progression by Week 16? (R vs NR-NP) |
|||
|---|---|---|---|---|---|
| No |
Yes |
R |
NR-NP |
P |
|
| N (%), Median OS (days) (95% CI) | N (%), Median OS (days) (95% CI) | N (%), Median OS (days) (95% CI) | N (%), Median OS (days) (95% CI) | N (%), Median OS (days) (95% CI) | |
| 2D | 36 (63%) | 21 (37%) | 16 (28%) | 20 (35%) | 21 (37%) |
| 448 (321–660) | 212 (170–268) | 437 (319–971) | 451 (232–687) | 212 (170–268) | |
| P < .0001a (n = 57) | P = .73: R vs NR-NP | ||||
| dT1 | 31 (54%) | 26 (46%) | 23 (40%) | 8 (14%) | 26 (46%) |
| 434 (319–676) | 221.5 (196–309) | 448 (319–687) | 362.5 (127, –) | 221.5 (196–309) | |
| P = .006a (n = 57) | P = .61: R vs NR-NP | ||||
Note:— – indicates those that were still alive at the end of study (i.e., no upper bound); N, number of patients; R, responder; NR-NP, non-responder/non-progressor; P, progressor.
Significant.
Discussion
The results of this study support the integration of dT1 into central reader analysis for the delineation of contrast-enhancing brain tumor. The dT1 method was comparable with expert reads for determination of early tumor progression and proved superior for further distinguishing R versus NR-NP at the week 8 time point. While agreement between the methods decreased at week 16, both methods showed a significant difference in OS based on progression status.
The result that dT1 proved better for stratifying subpopulations may be explained in several possible ways: First, due to the process of standardization (calibration) followed by subtraction, dT1 provides a consistent and objective delineation of enhancing lesions. It is less confounded by both systematic differences (vendor platforms, slight variations in imaging settings) and the subjectivity (interreader differences) that influences current approaches. This feature, in turn, can result in an improved sensitivity to enhancing lesions, that may not be apparent on postcontrast images, as illustrated in Fig 4. In addition, the superiority of using dT1 may be explained by the demonstrated benefit of volumetric measurements over standard bidimensional approaches for measuring tumor size18 and the application of a fixed physiology-based threshold to dT1 images to determine enhancing tumor burden.
Fig 4.
Potential of dT1 for improved sensitivity to the enhancing lesion. For postcontrast images (A and B), progression of the enhancing lesion, which is clearly visible at week 16 (B), was not discernable at week 8 (A). With dT1, the enhancing lesion visible earlier at week 8 (yellow arrow) (C) is becoming even more apparent at week 16 (D).
Before 2010, the MacDonald criteria were widely used to assess treatment response of high-grade gliomas19 and included the 2D measurement of enhancing tumor in conjunction with a clinical assessment and corticosteroid dose. Tumor progression on FLAIR and the recognition that contrast enhancement is nonspecific prompted the development of the updated RANO criteria, which added FLAIR to the MacDonald criteria.20 However, FLAIR also have important limitations and remain controversial.21 In fact, the parent study did not find a statistically significant survival time reduction among the isolated FLAIR progressors compared with nonprogressors.11 Even so, we are not suggesting that dT1 replace RANO as the standard assessment criteria. Rather, the results of this study show that dT1 has the potential to replace the current approach for delineating enhancing-lesion volumes, which is one aspect of the RANO assessment.
Measurement of the contrast-enhancing lesion remains central to the assessment of treatment response and was the focus of a recent effort to standardize imaging protocols for tumor-volume assessment.1 Even as new imaging biomarkers, such as those derived from perfusion- or diffusion-weighted MR imaging, are proving useful for the biologic assessment of tumor response, the analysis of such biomarkers depends on the accurate delineation of enhancing tumor. Therefore, it is necessary to be able to process these pre- and postcontrast T1WI data in a robust manner for both routine care and clinical trials.
The standard approach for lesion segmentation is the labor-intensive and time-consuming manual delineation of contrast-enhancing lesions by expert readers. Due to the subjective nature of this approach, clinical trials rely on multiple expert readers and involve additional readers to adjudicate cases for which there is disagreement. In a study that enlisted 8 board-certified radiologists to measure high-grade tumor diameters, substantial interreader disagreement was demonstrated with a rate of consensus regarding tumor progression of only 45% and only moderate reproducibility.22 This lack of agreement necessitates frequent adjudication. The primary study, from which this secondary analysis obtained its data, reported a 43% adjudication rate when using 2D-T1 and 42% for 3D-T1.11 Even more detrimental, the turnaround time for central analysis may preclude certain study designs that require assessment of progression within 48 hours, for example.
By comparison, the dT1 technology can be used by nonradiologists, as demonstrated in the present study, and requires only seconds to identify enhancing lesions. Because it is a semiautomated, dT1 overcomes the subjectivity that confounds current methods and, therefore, has the potential to provide greater consistency in lesion identification across time points and patients. These capabilities derive from the unique standardization (calibration) algorithm incorporated into the process of creating dT1 maps.10,15,23 The standardization algorithm serves to diminish slight differences in TE and TR settings for a given sequence type16 and thus lessens the importance of such variations that can result in differences in lesion conspicuity. Finally, the standardization algorithm, which has also been trained for use in the creation of relative CBV maps, resulted in substantial improvement in repeatability24 as well as consistency across time.23 Therefore, it is expected that dT1 should also result in greater repeatability; an hypothesis that should be tested in prospective studies.
The dT1 images are different from the subsequently developed, yet possibly better known, Gaussian-normalized difference maps.8 Gaussian-normalized maps require the determination of a new normalization for each patient and image, both pre- and postcontrast, which raises questions about consistency across time points and patients. dT1 uses the same calibration and threshold for each patient and image, enabling consistent quantification and automation across time points, patients, and sites.
Simple difference images, which eliminate some confounding bright signal on precontrast T1WI, are limited by variations in sequence parameter settings (eg, Fig 1). Furthermore, simple difference maps are not quantitative, thereby precluding the ability to automate lesion identification and resulting in little improvement over current methods. Consequently, the dT1 technology has the greatest likelihood of offering a substantial improvement over similar tools, with a greater potential for automation and clinical use.
Also of particular interest is that, in this study, only dT1 could predict differences in outcome for the NR-NP tumors at week 8. This greater sensitivity may result from more accurate and possibly more sensitive delineation of enhancing tumor (Fig 4) by dT1, free of precontrast bright signal, or it may be attributed to the physiologically motivated threshold used with dT1. Thus, a quantitative dT1-determined lesion may more accurately reflect active brain tumor. However, whether this same threshold should be used for other contrast-enhancing tumor types is unknown and will be the topic of future studies.
A limitation of this study is that only 1 nonradiologist determined the enhancing ROIs using dT1. A separate study characterizing the interreader agreement using the dT1 technology is warranted. Also, it is likely that all cases, particularly those with more complicated lesions, will still require expert review. Yet expert sign-offs are routine, and improving the initial step of tumor delineation with dT1 should result in improved time efficiencies to the radiologists' workflow.
Another perceived limitation is that fewer datasets could be analyzed with dT1 compared with 2D-T1. However, this limitation is not intrinsic to the dT1 method. Rather, it is because this is a retrospective analysis of data that were not collected for the purpose of creating dT1 images. Although dT1 is amenable to slight variations in parameter settings such as TE and TR and works well across vendor platforms and field strengths, it requires that the same sequence be used to collect both the pre- and postcontrast T1WI. Consequently, the issue of limited application is not of concern for prospective clinical trials.
A final limitation is that the response assessment using dT1 did not explicitly include the appearance of new lesions as an indicator of progression. However, for all cases included in this substudy, no new measurable lesions of >1 mL were present at the time of review. Thus, all statements of progression were made on the basis of the findings at the primary tumor site only. Future studies will explicitly include the presence of new lesions as an additional criterion to determine progression.
Overall, the potential impact of dT1 technology is far-reaching, given the approximately 117,000 new diagnoses of primary brain tumor per year,25 the >300,000 patients living with brain tumors who undergo repeat imaging follow-ups as part of their standard of care, and the 475 active clinical studies for glioblastoma multiforme (https://clinicaltrials.gov/). Therefore, the potential impact of the dT1 technology for daily practice and clinical trials is immense.
Conclusions
This study shows that dT1 can predict early progression comparable with the standard method, may be superior for substratification, and offers the potential for substantial time and cost savings for clinical trials.
Acknowledgments
We acknowledge Imaging Biometrics LLC (IQ-AI Ltd) for technical support, software development, and assistance with data analysis. No direct funding support was provided by Imaging Biometrics LLC for this study.
ABBREVIATIONS:
- 2D-T1
2D manual delineation of enhancing tumor
- dT1
delta T1
- NR-NP
nonresponder/nonprogressor
- OS
overall survival
- R
response
- RANO
Response Assessment in Neuro-Oncology
- ACRIN
American College of Radiology Imaging Network
- RTOG
Radiation Therapy Oncology Group
Footnotes
Disclosures: Kathleen M. Schmainda—RELATED: Grant: National Institutes of Health, Comments: The dT1 technology discussed was developed in the lab with National Institutes of Health funding (R01 CA082500 and U01CA176110)*; UNRELATED: Stock/Stock Options: Imaging Biometrics LLC/IQ-AI Ltd, Comments: ownership interest. Bradley S. Snyder—RELATED: Grant: ECOG-ACRIN, Comments: ACRIN 6677 was conducted under the auspices of ACRIN (now ECOG-ACRIN), a National Cancer Institute–funded cancer cooperative group. The Center for Statistical Sciences in the Brown University School of Public Health, where I am employed, is part of the Biostatistics Center of ECOG-ACRIN*. Todd R. Jensen—UNRELATED: Consultancy: Imaging Biometrics LLC, Comments: I am a software developer who helped carry out the dT1 method and implementation. I work as an independent medical imaging and informatics consultant, primarily doing software development. Other entities in this field that have retained my services in addition to Imaging Biometrics LLC include ADM Diagnostics Inc and Change Healthcare; Patents (Planned, Pending or Issued): Imaging Biometrics and Change Healthcare. Daniel P. Barboriak—RELATED: Grant: ECOG-ACRIN, Comments: The data used in this article came from a legacy ACRIN grant. My involvement in this project is part of my duties as imaging Co-Chair of the Brain Tumor Working Group at ECOG-ACRIN. My involvement is supported by the grant to ECOG-ACRIN from the National Cancer Institute*; UNRELATED: Consultancy: Blue Earth Diagnostics, Comments: I was compensated for participation in a medical advisory board meeting concerning the PET agent fluciclovine. This has minimal, if any, relevance to the submission; Grants/Grants Pending: National Institutes of Health, Comments: I have grants in the planning stages that concern segmentation for brain tumor images obtained in clinical trials*; OTHER RELATIONSHIPS: My lab has developed a method of performing difference imaging for measuring tumor enhancement that could be compared with this method at some point. *Money paid to the institution.
Funding support was provided through the National Institutes of Health/National Cancer Institute grants R01 CA082500, R44 CA134031, R41 NS076149, U01-CA079778, U01-CA080098, and U01-CA176110 and the Robert C. Olson MD Endowment.
REFERENCES
- 1. Ellingson BM, Bendszus M, Boxerman J, et al. ; Jumpstarting Brain Tumor Drug Development Coalition Imaging Standardization Steering Committee. Consensus recommendations for a standardized Brain Tumor Imaging Protocol in clinical trials. Neuro Oncol 2015;17:1188–98 10.1093/neuonc/nov095 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Eisenhauer EA, Therasse P, Bogaerts J, et al. . New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer 2009;45:228–47 10.1016/j.ejca.2008.10.026 [DOI] [PubMed] [Google Scholar]
- 3. Henson JW, Ulmer S, Harris GJ. Brain tumor imaging in clinical trials. AJNR Am J Neuroradiol 2008;29:419–24 10.3174/ajnr.A0963 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Kubben PL, Postma AA, Kessels AG, et al. . Intraobserver and interobserver agreement in volumetric assessment of glioblastoma mulitforme resection. Neurosurgery 2010;67:1329–34 10.1227/NEU.0b013e3181efbb08 [DOI] [PubMed] [Google Scholar]
- 5. Hurwitz H, Fehrenbacher L, Novotny W, et al. . Bevacizumab plus irinotecan, fluorouracil, and leucovorin for metastic colorectal cancer. N Engl J Med 2004;350:2335–42 10.1056/NEJMoa032691 [DOI] [PubMed] [Google Scholar]
- 6. Norden AD, Young GS, Setayesh K, et al. . Bevacizumab for recurrent malignant gliomas: efficacy, toxicity, and patterns of recurrence. Neurology 2008;70:779–87 10.1212/01.wnl.0000304121.57857.38 [DOI] [PubMed] [Google Scholar]
- 7. Provenzale JM, Ison C, Delong D. Bidimensional measurements in brain tumors: assessment of interobserver variability. AJR Am J Roentgenol 2009;193:W515–22 10.2214/AJR.09.2615 [DOI] [PubMed] [Google Scholar]
- 8. Ellingson BM, Kim HJ, Woodworth DC, et al. . Recurrent glioblastoma treated with bevacizumab: contrast-enhanced T1-weighted subtraction maps improve tumor delineation and aid prediction of survival in a multicenter clinical trial. Radiology 2014;271:200–10 10.1148/radiol.13131305 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Jensen TR, Schmainda KM. Computer-aided detection of brain tumor invasion using multiparametric MRI. J Magn Reson Imaging 2009;30:481–89 10.1002/jmri.21878 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Bedekar D, Jensen T, Rand S, et al. . Delta T1 method: an automatic post-contrast RO1 selection technique for brain tumors. In: Proceedings of the Annual Meeting of the International Society for Magnetic Resonance in Medicine, Stockholm, Sweden May 1–7, 2010 [Google Scholar]
- 11. Boxerman JL, Zhang Z, Safriel Y, et al. . Early post-bevacizumab progression on contrast-enhanced MRI as a prognostic marker for overall survival in recurrent glioblastoma: results from the ACRIN 6677/RTOG 0625 Central Reader Study. Neuro Oncol 2013;15:945–54 10.1093/neuonc/not049 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Schmainda KM, Zhang Z, Prah M, et al. . Dynamic susceptibility contrast MRI measures of relative cerebral blood volume as a prognostic marker for overall survival in recurrent glioblastoma: results from the ACRIN 6677/RTOG 0625 multicenter trial. Neuro Oncol 2015;17:1148–56 10.1093/neuonc/nou364 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Ellingson BM, Kim E, Woodworth DC, et al. . Diffusion MRI quality control and functional diffusion map results in ACRIN 6677/RTOG 0625: a multicenter, randomized, phase II trial of bevacizumab and chemotherapy in recurrent glioblastoma. Int J Oncol 2015;46:1883–92 10.3892/ijo.2015.2891 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Ratai EM, Zhang Z, Snyder BS, et al. . Magnetic resonance spectroscopy as an early indicator of response to anti-angiogenic therapy in patients with recurrent glioblastoma: RTOG 0625/ACRIN 6677. Neuro Oncol 2013;15:936–44 10.1093/neuonc/not044 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Nyúl LG, Udupa JK. On standardizing the MR image intensity scale. Magn Reson Med 1999;42:1072–81 [DOI] [PubMed] [Google Scholar]
- 16. Nyúl LG, Udupa JK, Zhang X. New variants of a method of MRI scale standardization. IEEE Trans Med Imaging 2000;19:143–50 10.1109/42.836373 [DOI] [PubMed] [Google Scholar]
- 17. Krippendorff K. Agreement and information in the reliability of coding. Communication Methods and Measures 2011;5:93–112 10.1080/19312458.2011.568376 [DOI] [Google Scholar]
- 18. Dempsey MF, Condon BR, Hadley DM. Measurement of tumor “size” in recurrent malignant glioma: 1D, 2D, or 3D? AJNR Am J Neuroradiol 2005;26:770–76 [PMC free article] [PubMed] [Google Scholar]
- 19. MacDonald DR, Cascino TL, Schold SC Jr, et al. . Response criteria for phase II studies of malignant glioma. J Clin Oncol 1990;8:1277–80 10.1200/JCO.1990.8.7.1277 [DOI] [PubMed] [Google Scholar]
- 20. Wen PY, Macdonald DR, Reardon DA, et al. . Updated response assessment criteria for high-grade gliomas: Response Assessment in Neuro-Oncology working group. J Clin Oncol 2010;28:1963–72 10.1200/JCO.2009.26.3541 [DOI] [PubMed] [Google Scholar]
- 21. Wen PY, Norden AD, Drappatz J, et al. . Response assessment challenges in clinical trials of gliomas. Curr Oncol Rep 2010;12:68–75 10.1007/s11912-009-0078-3 [DOI] [PubMed] [Google Scholar]
- 22. Provenzale JM, Ison C, Delong D. Bidimensional measurements in brain tumors: assessment of interobserver variability. AJR Am J Roentgenol 2009;193:W515–22 10.2214/AJR.09.2615 [DOI] [PubMed] [Google Scholar]
- 23. Bedekar D, Jensen TR, Schmainda KM. Standardization of relative cerebral blood volume (rCBV) image maps for ease of both inter- and intrapatient comparisons. Magn Reson Med 2010;64:907–13 10.1002/mrm.22445 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Prah MA, Stufflebeam SM, Paulson ES, et al. . Repeatability of standardized and normalized relative CBV in patients with newly diagnosed glioblastoma. AJNR Am J Neuroradiol 2015;36:1654–61 10.3174/ajnr.A4374 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Ostrom QT, Gittleman H, Fulop J, et al. . CBTRUS Statistical Report: Primary Brain and Central Nervous System Tumors Diagnosed in the United States in 2008–2012. Neuro Oncol 2015;17(Suppl 4):iv1–iv62 10.1093/neuonc/nov189 [DOI] [PMC free article] [PubMed] [Google Scholar]