Abstract
Background
Stereotactic radiosurgery (SRS) is used to manage intracranial metastases in a significant fraction of patients. Local progression after SRS can often only be detected with increased volume of enhancement on serial MRI scans which may lag true progression by weeks or months.
Methods
Patients with intracranial metastases (N = 11) were scanned using hyperpolarized C MRI prior to treatment with stereotactic radiosurgery (SRS). The status of each lesion was then recorded at six months post-treatment follow-up (or at the time of death).
Results
The positive predictive value of C-lactate signal, measured pre-treatment, for prediction of progression of intracranial metastases at six months post-treatment with SRS was 0.8 , and the AUC from an ROC analysis was 0.77 . The distribution of C-lactate z-scores was different for intracranial metastases from different primary cancer types (F = 2.46, ).
Conclusions
Hyperpolarized C imaging has potential as a method for improving outcomes for patients with intracranial metastases, by identifying patients at high risk of treatment failure with SRS and considering other therapeutic options such as surgery.
Supplementary Information
The online version contains supplementary material available at 10.1007/s11060-021-03725-7.
Keywords: Lactate, Hyperpolarized 13C MRI, Metabolism, Intracranial metastases, SRS
Importance of study
Stereotactic radiosurgery (SRS) is used to manage intracranial metastases in a significant fraction of patients. Local progression after SRS can often only be detected with increased volume of enhancement on serial MRI scans which may lag true progression by weeks or months. In this work, a safe and non-invasive method that has already been translated to patient studies is shown to be a promising new predictor of treatment failure. Predictive tools for radiation resistance prior to SRS may help identify patients better suited for upfront surgical resection or SRS dose escalation. Since the method is integrated with MRI, it can be added into the pre-treatment MRI used for radiation treatment planning with minimal change to patient workflow. The results are actionable and have the potential to improve outcomes, as the tumour lactate measurement is available prior to treatment with SRS.
Introduction
Upwards of 20% of cancer patients will develop brain metastases during the course of their illness, many of which become symptomatic [1–4]. The most common primary tumours responsible for brain metastases include lung cancer, melanoma, renal cancer, breast cancer, and colorectal cancer. The management of brain metastases has become more complex and may involve surgery, stereotactic radiosurgery (SRS), whole brain radiotherapy (WBRT), systemic therapy or best supportive care [5].
Over the past several decades, with improved imaging and radiation therapy technology, stereotactic radiosurgery (SRS) has cemented a role in the treatment of a significant proportion of patients with brain metastases. SRS has been shown to improve survival in patients with brain metastases over WBRT alone [6] and avoids the the neurocognitive side effects of WBRT [7]. However, local control of brain metastases with SRS decreases with increasing tumour diameter as the dose is dialed back to reduce the risk of radiation injury [8, 9]. Local progression can often only be detected with increased volume of enhancement on serial MRI scans which may lag true progression by weeks or months [10, 11]. Therefore predictive tools for radiation resistance prior to SRS may help identify patients better suited for dose escalation or even upfront surgical resection. If the risk of treatment failure could be better assessed beforehand, some of these patients might be reclassified as candidates for surgery, improving outcomes.
A proposed indicator of SRS treatment failure is tumour lactate accumulation. The impact of lactate accumulation on radiosensitivity was only recognized relatively recently [12], but is now well established. Lactate accumulates in malignant tumours through a number of mechanisms, including hypoxia-inducible factor 1 (HIF-1) mediated reprogramming. It has been hypothesized that lactate affects radioresistance by antioxidant properties, inducing angiogenesis, mediating resistance to apoptosis, as well as by stabilizing HIF-1 and perpetuating the activation of HIF-1 independent of hypoxia [13]. Tumour lactate levels were shown to be inversely correlated with overall and disease-free patient survival in cervical cancer, head and neck squamous cell carcinoma, and glioblastoma in humans [14–17]. However, these findings were all based on lactate measurements in biopsy or surgical tumour samples, which are not available pre-treatment for intracranial metastases.
Hyperpolarized (HP) C MRI is an new imaging approach that has the potential to predict radiation treatment failure by probing lactate metabolism in vivo. This technique uses a non-radioactive labelled metabolite, [1-C]pyruvate, as a contrast agent. Prior to imaging, the signal of [1-C]pyruvate is amplified by approximately 10,000-fold, or “hyperpolarized”, via dynamic nuclear polarization [18]. While the amplified signal is short-lived (exponential decay constant of 40s in vivo), images of [1-C]pyruvate and its metabolic products [1-C]lactate and C-bicarbonate can be obtained within a 1-minute time window after injection. Clinical applications of HP C MRI have been explored in recent years, starting with the first in-human imaging of prostate cancer patients in 2013 [19]. The application of HP C MRI in patients with brain tumours and metastases is currently an active area of investigation [20–22].
In this work, patients (N=11) with one or more newly developed intracranial metastases were scanned using hyperpolarized C MRI prior to treatment with SRS. The mean C-lactate signal from each lesion was normalized using the consistent pattern of C-lactate in the brain parenchyma. The status of each lesion was then recorded at the six months post-treatment follow-up (or at the time of death). This enabled estimation of the positive predictive value of pre-treatment [1-C]lactate signals and receiver operating characteristic (ROC) curve prediction of lesion progression at six months post-treatment with SRS.
Materials and methods
Written informed consent was obtained from patients with intracranial metastases (N = 11) prior to study participation under a protocol approved by the institutional Research Ethics Board and by Health Canada as a Clinical Trial Application. All participants had one or more newly developed intracranial metastasis and were scheduled for SRS immediately following the C imaging study.
Prior to being positioned head-first in a General Electric (GE) MR750 3.0T MRI scanner (GE Healthcare, Waukesha, WI), a 22-gauge intravenous catheter was inserted into each patient’s forearm. The patient’s head was then secured in the support for the head coil base for a standard 8-channel neurovascular receive array (Invivo Inc.). This support could be docked with either the 8-channel H array or a home-built single-tuned C birdcage coil without moving the patient’s head during the study. At the beginning of each exam, localizer images and a reference scan to be used during the C image reconstruction [23] were acquired using the scanner’s built-in body coil. The C birdcage coil was then put in place.
Each subject was injected with a 0.43 mL/kg dose of 250 mM [1-C]pyruvate via an intravenous injection at 4 mL per second using a MEDRAD Spectris solaris injector (Bayer). The doses were prepared within a sterile fluid path and hyperpolarized in a GE SPINLab polarizer equipped with a quality control module. The C image acquisition was initiated upon the completion of a saline flush. All patients tolerated the [1-C]pyruvate injection without any adverse events.
A three-dimensional (3D) spectrally-selective echo-planar imaging (SS-EPI) [23, 24] pulse sequence was used to acquire time-resolved full brain data from [1-C]lactate, [1-C]bicarbonate and [1-C]pyruvate signals (5-s temporal resolution; 12 time points; 1.5-cm isotropic spatial resolution with a 24 24 36 cm field of view).
Following the C image acquisition, the C head coil was replaced with an 8-channel H neurovascular array (Invivo Inc.) for a standard suite of anatomical brain image acquisitions. T-weighted images were acquired using 3D fast spoiled GRE (axial prescription, FOV 25.6 25.6 cm, 1-mm isotropic resolution, TR 7.6 ms, TE 2.9 ms, flip angle 11). Gadolinium enhanced T-weighted images were acquired 2 min after administering a gadolinium dose of 0.1 mmol/kg via hand injection in a subset of patients that required these images for radiation treatment planning. T-weighted images were acquired using T-FLAIR (axial, FOV 22 22 cm, in-plane resolution 0.6875 0.982 mm, 3-mm slice thickness, TR/TE 8000/120 ms, flip angle 111).
All C image reconstruction was performed offline using MATLAB R2018b (The MathWorks Inc., MA, Natick, Massachusetts). Data-driven geometric distortion artifact correction was performed as in [23]. The time-resolved images were summed to compute the area-under-the-curve (AUC) for each metabolite, which were then stored as final C images.
The structural parcellation of metabolite signals within the brain was performed using BrainParser, which uses T-weighted images to parcellate the brain into the 56 structural regions contained in the LPBA40 atlas [25]. For each subject the mean and standard deviation of the C-lactate signals across the 56 atlas regions were computed. Then the subject’s lactate value for each region, , was normalized by converting it to a z-score, , as in [26]:
1 |
A region of interest (ROI) for each metastasis was manually contoured onto each slice of the post-gadolinium T-weighted images, if available, by a radiation oncologist. In cases where post-gadolinium T-weighted images were not acquired, manual contouring was performed on the non-contrast T-weighted images or the T-weighted images. The mean C metabolite signal from each lesion, , was converted to a z-score, , using the mean and standard deviation of the C-lactate signal across anatomical brain regions, as follows:
2 |
where and are as defined above, based on the 56 brain atlas regions for that patient. The normalization of the lactate signal by converting to a z-score is needed because the level of polarization of the C-substrate at the time it is detected in each subject, which determines the signal strength, varies over a wide range and this would otherwise confound the measurement.
Treated brain metastases were evaluated at the 6 month follow-up or last follow up prior to death. Tumour response was evaluated according to the RANO brain metastases criteria [11]. No cases of radiation necrosis were seen. Lesion locations and lactate z-scores are summarized in Table 1 (Supplementary).
Results
Figure 1 shows an example of C-lactate and C-pyruvate images from one subject. In Fig. 2, the C-lactate pattern across cortical regions, expressed as a plot of z-score vs. atlas region, appeared similar to the pattern observed in healthy participants, but with weaker concordance across patients (Kendall’s W = 0.70) as compared to healthy participants (W = 0.83) [26]. Despite the moderate reduction in concordance, the range of lactate z-scores from the 56 atlas regions spanned roughly the same range in all subjects, from − 3 to 2, which is similar to the range seen in healthy volunteers [26] and sufficiently consistent across patients to justify the tumour -lactate normalization method of Eq. (2).
The metastatic lesions displayed a broad range of lactate z-scores, from − 2.23 to 3.74, as shown in Fig. 3. A different range of lactate z-scores was observed for each of the four primary tumour types: non-small cell lung carcinoma (NSCLC, N = 4), renal cell carcinoma (RCC, N = 2), breast cancer (N = 4) and colorerectal cancer (N = 1). To test whether this apparent difference was statistically significant, a 1-way ANOVA was used with the primary cancer type as a categorical variable and the lactate z-scores as the dependent variable, giving F = 2.46 and .
Based on this result and the observation that the highest lactate z-scores from each primary cancer type appeared to be associated with treatment failure (red circles in Fig. 3), the set of lactate z-scores for each primary cancer type was rescaled to a prediction score, ranging from 0 to 1. This allowed the prediction score values from all tumour types to be included in the same ROC analysis, resulting in the ROC curve shown in Fig. 4. The area-under-the-curve (AUC) was 0.77 with an optimal threshold giving a true positive rate of 0.8, a false positive rate of 0.2 and a positive predictive value of 0.8. Based on the equivalency relationship between the AUC and the parameter U derived in the Mann–Whitney U test, as described in [27], the statistical significance of this ROC result was calculated to be .
Discussion
The performance of C-lactate as a predictor of treatment failure was superior to other markers previously investigated for this purpose, such as the apparent diffusion coefficient (ADC) [28] measured after SRS. ROC analysis on the prediction of progression using ADC values at 1 week and 1 month post-radiation gave an AUC of 0.704 and 0.748, respectively. Furthermore, the AUC of C-lactate would likely improve if ROC analysis was performed on each primary cancer type separately. A limitation of the present study was that lesions from different primary cancers were pooled in the analysis, requiring rescaling to equalize the range of values for each primary cancer. In the future, a sufficient number of patients will be scanned from each primary cancer group so that ROC analysis can be performed separately.
A brain parcellation method was used in this study to normalize C signals from metastatic lesions using the C signals from other brain regions for reference. This normalization method, based on comparison to the consistent background metabolite pattern in the brain, is a key element of the analysis as it allows for a C-lactate measurement of each lesion computed from just the C-lactate images alone. This is important because elevated C-lactate signal has been shown to occur alongside elevated C-pyruvate (substrate) signal under several common conditions such as high tumour vascularity and elevated expression of MCT1 transporters [29]. The conventional analysis methods found in the literature, which involve computation of a lactate-to-pyruvate ratio or fitting a first-order rate constant to time-resolved data, both inherently reduce the number that results from the high-lactate/high-pyruvate condition. This condition, in fact, is likely a highly malignant phenotype. One of the lesions that progressed in the preliminary study fell into this category (the highest C-lactate z-score in Fig. 3).
There were several limitations to this study. The cohort of patients was small and somewhat heterogeneous. However, the small number of patients reflects the current expense and logistical challenges associated with hyperpolarized C MRI, which is still in an early trial phase. Lesions from all patients eligible for SRS were included in this preliminary study to test feasibility and enable design of future trials. However, based on these promising results, the next step will be to acquire data from larger, groups of patients grouped by primary cancer.
Another limitation of this study was the coarse spatial resolution used for the C imaging (1.5-cm isotropic). This may have led to contamination of the tumour C-lactate signal from the surrounding tissues, an effect that would be worse for smaller lesions. Thus, the positive predictive value of this method may improve with advances in the data acquisition method enabling higher spatial resolution.
Three lesions across two patients were treated with SRS prior to C imaging. The lactate z-scores from these lesions were − 1.13, − 1.29 and 1.04. Future studies should investigate whether the observed z-scores in previously treated lesions reflect treatment-related metabolic changes or are consistent with the C-lactate signal levels observed in healthy brain tissues.
Conclusions
The positive predictive value of tumour C-lactate signals, measured pre-treatment, for the prediction of progression of intracranial metastases at six months post-treatment with SRS was 0.8 , and the AUC from an ROC analysis was 0.77 . The distribution of C-lactate z-scores varied among intracranial metastases from different primary cancer types (F = 2.46, ). Hyperpolarized C imaging has thus shown potential as a method for improving outcomes in patients with intracranial metastases, by identifying patients at high risk of treatment failure with SRS and who may benefit from other therapeutic options such as surgery.
Supplementary Information
Below is the link to the electronic supplementary material.
Acknowledgements
The authors thank Julie Green and Sumeet Sachdeva for coordinating the study, and Ruby Endre and Garry Detzler for MR technical support. Funding support from Brain Canada, the Canadian Cancer Society Research Institute and the Canadian Institutes for Health Research Grant PJT152928.
Abbreviations
- DE-EPI
Dual-echo echo-planar imaging
- HP
Hyperpolarized
- LPBA40
LONI Pipeline Brain Atlas 40
- NSLSC
Non-small cell lung cancer
- RCC
Renal cell carcinoma
- ROC
Receiver operating characteristic
- W
Kendall’s coefficient of concordance
Author contributions
CYL, BJG, APC, CHC developed the data acquisition methods, CYL, RE, NDB operated the MRI scanner, CYL and CHC performed the image reconstruction and statistical analysis, HS, AS and EL assessed the subjects and performed the C-pyruvate injections, RE loaded the injector, WJP performed compounding and pharmacy release of the C-pyruvate doses, CH and HS reviewed the images, CHC and MC designed the study. All authors critically reviewed the manuscript.
Funding
Funding support from Brain Canada, the Canadian Cancer Society Research Institute and the Canadian Institutes for Health Research Grant PJT152928.
Declarations
Conflict of interest
Albert P. Chen is an employee of GE Healthcare, the manufacturer of the equipment used in this study. Charles H. Cunningham has received research support from GE Healthcare.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Rosenberg SA, DeVita VT, Lawrence TS. DeVita, Hellman, and Rosenberg’s Cancer: Principles & Practice of Oncology. Philadelphia: Lippincott, Williams & Wilkins; 2015. [Google Scholar]
- 2.Posner JB. Intracranial metastases from systemic cancer. Adv Neurol. 1978;19:579–592. [PubMed] [Google Scholar]
- 3.Percy AK, Elveback LR, Okazaki H, Kurland LT. Neoplasms of the central nervous system: epidemiologic considerations. Neurology. 1972;22(1):40–40. doi: 10.1212/WNL.22.1.40. [DOI] [PubMed] [Google Scholar]
- 4.Tsukada Y, Fouad A, Pickren JW. Central nervous system metastasis from breast carcinoma autopsy study. Cancer. 1983;52(12):2349–2354. doi: 10.1002/1097-0142(19831215)52:12<2349::AID-CNCR2820521231>3.0.CO;2-B. [DOI] [PubMed] [Google Scholar]
- 5.Nabors LB, Portnow J, Ammirati M, Brem H, Brown P, Butowski N, Chamberlain MC, De Angelis LM, Fenstermaker RA, Friedman A, et al. Central nervous system cancers, version 2. J Natl Compr Cancer Netw. 2014;12(11):1517–1523. doi: 10.6004/jnccn.2014.0151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Andrews DW, Scott CB, Sperduto PW, Flanders AE, Gaspar LE, Schell MC, Werner-Wasik M, Demas W, Ryu J, Bahary J-P, et al. Whole brain radiation therapy with or without stereotactic radiosurgery boost for patients with one to three brain metastases: phase iii results of the rtog 9508 randomised trial. The Lancet. 2004;363(9422):1665–1672. doi: 10.1016/S0140-6736(04)16250-8. [DOI] [PubMed] [Google Scholar]
- 7.Chang EL, Wefel JS, Hess KR, Allen PK, Lang FF, Kornguth DG, Arbuckle RB, Swint JM, Shiu AS, Maor MH, Meyers CA, et al. Neurocognition in patients with brain metastases treated with radiosurgery or radiosurgery plus whole-brain irradiation: a randomised controlled trial. Lancet Oncol. 2009;10(11):1037–1044. doi: 10.1016/S1470-2045(09)70263-3. [DOI] [PubMed] [Google Scholar]
- 8.Vogelbaum MA, Angelov L, Lee S-Y, Li L, Barnett GH. Local control of brain metastases by stereotactic radiosurgery in relation to dose to the tumor margin. J Neurosurg. 2006;104(6):907–912. doi: 10.3171/jns.2006.104.6.907. [DOI] [PubMed] [Google Scholar]
- 9.Shaw E, Scott C, Souhami L, Dinapoli R, Kline R, Loeffler J, Farnan N. Single dose radiosurgical treatment of recurrent previously irradiated primary brain tumors and brain metastases: final report of rtog protocol 90–05. Int J Radiat Oncol Biol Phys. 2000;47(2):291–298. doi: 10.1016/S0360-3016(99)00507-6. [DOI] [PubMed] [Google Scholar]
- 10.Suzanne RS, EricK O, Dominic TM, Eric S, Riane H, David EM, Matthew GE. The volumetric response of brain metastases after stereotactic radiosurgery and its post-treatment implications. Neurosurgery. 2014;74(1):9–16. doi: 10.1227/NEU.0000000000000190. [DOI] [PubMed] [Google Scholar]
- 11.Nancy UL, Eudocia QL, Hidefumi A, Igor JB, Daniel PB, Brigitta GB, Martin B, Paul DB, Camidge DR, Chang SM, et al. Response assessment criteria for brain metastases: proposal from the rano group. Lancet Oncol. 2015;16(6):270–278. doi: 10.1016/S1470-2045(15)70057-4. [DOI] [PubMed] [Google Scholar]
- 12.Xiao L, Fanjie Z, Bradbury CM, Kaushal A, Li L, Spitz DR, Aft RL, Gius D. 2-deoxy-d-glucose-induced cytotoxicity and radiosensitization in tumor cells is mediated via disruptions in thiol metabolism. Cancer Res. 2003;63(12):3413–3417. [PubMed] [Google Scholar]
- 13.Quennet V, Yaromina A, Zips D, Rosner A, Walenta S, Baumann M, Mueller-Klieser W. Tumor lactate content predicts for response to fractionated irradiation of human squamous cell carcinomas in nude mice. Radiother Oncol. 2006;81(2):130–135. doi: 10.1016/j.radonc.2006.08.012. [DOI] [PubMed] [Google Scholar]
- 14.Walenta S, Mueller-Klieser WF (2004) Lactate: mirror and motor of tumor malignancy. In: Seminars in radiation oncology, vol 14. Elsevier, pp. 267–274 [DOI] [PubMed]
- 15.Stefan W, Michael W, Michael L, Georg S, Kolbein S, EinarK R, Wolfgang M-K. High lactate levels predict likelihood of metastases, tumor recurrence, and restricted patient survival in human cervical cancers. Cancer Res. 2000;60(4):916–921. [PubMed] [Google Scholar]
- 16.Thomas Z, Stefan W, Martin K, Torsten ER, Wilfried W, Wolfgang M-K. Metabolic and proteomic differentials in head and neck squamous cell carcinomas and normal gingival tissue. J Cancer Res Clin Oncol. 2011;137(2):193–199. doi: 10.1007/s00432-010-0875-y. [DOI] [PubMed] [Google Scholar]
- 17.Suja S, Forrest WC, Kathleen RL, Andrea P, Susan C, Soonmee C, Sarah JN. Evaluation of MR markers that predict survival in patients with newly diagnosed GBM prior to adjuvant therapy. J Neuro-oncol. 2009;91(1):69–81. doi: 10.1007/s11060-008-9685-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Jan HA-L, Andrew ML, Neil C, John U, Denise A, Skloss TW. Dynamic nuclear polarization polarizer for sterile use intent. NMR Biomed. 2011;24(8):927–932. doi: 10.1002/nbm.1682. [DOI] [PubMed] [Google Scholar]
- 19.Nelson SJ, Kurhanewicz J, Vigneron DB, Larson PE, Harzstark AL, Ferrone M, Van Criekinge M, Chang JW, Bok R, Park I, Reed G. Metabolic imaging of patients with prostate cancer using hyperpolarized [1-13c] pyruvate. Sci Transl Med. 2013;5(198):198ra108. doi: 10.1126/scitranslmed.3006070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Vesselin ZM, Kristin LG, Rostislav B, Serge KL, Lisa MDA, Ingo KM, Cameron WB, Vivian T, Yang TJ, Holodny AI, et al. Metabolic imaging of the human brain with hyperpolarized 13c pyruvate demonstrates 13c lactate production in brain tumor patients. Cancer Res. 2018;78(14):3755–3760. doi: 10.1158/0008-5472.CAN-18-0221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Park I, Larson PE, Gordon JW, Carvajal L, Chen HY, Bok R, Van Criekinge M, Ferrone M, Slater JB, Xu D, Kurhanewicz J, et al. Development of methods and feasibility of using hyperpolarized carbon-13 imaging data for evaluating brain metabolism in patient studies. Magn Reson Med. 2018;80(3):864–873. doi: 10.1002/mrm.27077. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Gordon JW, Chen HY, Autry A, Park I, Van Criekinge M, Mammoli D, Milshteyn E, Bok R, Xu D, Li Y, Aggarwal R, et al. Translation of carbon-13 EPI for hyperpolarized MR molecular imaging of prostate and brain cancer patients. Magn Reson Med. 2019;81(4):2702–2709. doi: 10.1002/mrm.27549. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Geraghty BJ, Lau JY, Chen AP, Cunningham CH. Dual-echo epi sequence for integrated distortion correction in 3d time-resolved hyperpolarized 13c MRI. Magn Reson Med. 2018;79(2):643–653. doi: 10.1002/mrm.26698. [DOI] [PubMed] [Google Scholar]
- 24.Cunningham CH, Chen AP, Lustig M, Hargreaves BA, Lupo J, Xu D, Kurhanewicz J, Hurd RE, Pauly JM, Nelson SJ, Vigneron DB, et al. Pulse sequence for dynamic volumetric imaging of hyperpolarized metabolic products. J Magn Reson. 2008;193(1):139–146. doi: 10.1016/j.jmr.2008.03.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Shattuck DW, Mirza M, Adisetiyo V, Hojatkashani C, Salamon G, Narr KL, Poldrack RA, Bilder RM, Toga AW. Construction of a 3d probabilistic atlas of human cortical structures. Neuroimage. 2008;39(3):1064–1080. doi: 10.1016/j.neuroimage.2007.09.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Casey YL, Hany S, Benjamin JG, Albert PC, Kim AC, Ruby E, William JP, Chris H, Sandra EB, Charles HC. Lactate topography of the human brain using hyperpolarized 13c-MRI. NeuroImage. 2020;204:116202. doi: 10.1016/j.neuroimage.2019.116202. [DOI] [PubMed] [Google Scholar]
- 27.Grunkemeier G, Jin R. Receiver operating characteristic curve analysis of clinical risk models. Ann Thorac Surg. 2001;72(2):323–326. doi: 10.1016/S0003-4975(01)02870-3. [DOI] [PubMed] [Google Scholar]
- 28.Jakubovic R, Zhou S, Heyn C, Soliman H, Zhang L, Aviv R, Sahgal A. The predictive capacity of apparent diffusion coefficient (ADC) in response assessment of brain metastases following radiation. Clin Exp Metast. 2016;33(3):277–284. doi: 10.1007/s10585-016-9778-x. [DOI] [PubMed] [Google Scholar]
- 29.Granlund KL, Tee SS, Vargas HA, Lyashchenko SK, Reznik E, Fine S, Laudone V, Eastham JA, Touijer KA, Reuter VE, et al. Hyperpolarized MRI of human prostate cancer reveals increased lactate with tumor grade driven by monocarboxylate transporter 1. Cell Metab. 2020;31(1):105–114. doi: 10.1016/j.cmet.2019.08.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.