Abstract
Purpose
The aim of this multi-center study was to assess the diagnostic capability of visual assessment in L-methyl-11C-methionine positron emission tomography (MET-PET) for differentiating a recurrent brain tumor from radiation-induced necrosis after radiotherapy, and to compare it to the accuracy of quantitative analysis.
Methods
A total of 73 brain lesions (glioma: 31, brain metastasis: 42) in 70 patients who underwent MET-PET were included in this study. Visual analysis was performed by comparison of MET uptake in the brain lesion with MET uptake in one of four regions (around the lesion, contralateral frontal lobe, contralateral area, and contralateral cerebellar cortex). The concordance rate and logistic regression analysis were used to evaluate the diagnostic ability of visual assessment. Receiver-operating characteristic curve analysis was used to compare visual assessment with quantitative assessment based on the lesion-to-normal (L/N) ratio of MET uptake.
Results
Interobserver and intraobserver κ-values were highest at 0.657 and 0.714, respectively, when assessing MET uptake in the lesion compared to that in the contralateral cerebellar cortex. Logistic regression analysis showed that assessing MET uptake in the contralateral cerebellar cortex with brain metastasis was significantly related to the final result. The highest area under the receiver-operating characteristic curve (AUC) with visual assessment for brain metastasis was 0.85, showing no statistically significant difference with L/Nmax of the contralateral brain (AUC = 0.89) or with L/Nmean of the contralateral cerebellar cortex (AUC = 0.89), which were the areas that were the highest in the quantitative assessment. For evaluation of gliomas, no specific candidate was confirmed among the four areas used in visual assessment, and no significant difference was seen between visual assessment and quantitative assessment.
Conclusion
The visual assessment showed no significant difference from quantitative assessment of MET-PET with a relevant cut-off value for the differentiation of recurrent brain tumors from radiation-induced necrosis.
Introduction
Brain tumors overexpress a variety of l-amino acid transporters [1], and thus, l-methyl-11C-methionine (MET) is useful positron emission tomography (PET) tracer for imaging in neurooncology [2, 3]. The gadolinium (Gd)-enhanced magnetic resonance imaging (MRI) findings showing that radiation-induced necrosis mimics recurrent brain tumors are correct because of the breakdown of the blood-brain barrier in both states [4]. MET uptake in gliomas is closely related to both cellular proliferation [5] and the micro-vessel count [6]. The uptake of MET with recurrence due to tumor cells is different from that in radiation-induced injury where only passive diffusion across the broken blood-brain barrier occurs [7–10]. Therefore, MET-PET has the potential to differentiate recurrent brain tumors from post-radiotherapy necrosis.
The main quantitative value for differentiating between tumors and nontumoral lesions in MET-PET studies is the lesion-to-normal (L/N) background ratio. Herholz et al. showed that the optimal cut-off value was 1.47, providing a sensitivity of 76% and a specificity of 87% [2]. Terakawa et al. showed that the optimal cut-off value was different for metastatic brain tumors (L/Nmean: 1.41, sensitivity 79% and specificity 75%) and gliomas (L/Nmean: 1.58, sensitivity 75% and specificity 75%) [7]. Although MET-PET is useful for identifying tumor recurrence after radiation, the adopted L/N cut-off ratios as well as the type of standardized uptake value (SUV) used in calculating the ratio (mean or maximum) varies according to the nature of the primary lesion [7, 11].
O-(2-18F-fluoroethyl)-L-tyrosine (FET) with a cut off mean tumor-to-brain ratio of 1.95 showed a similar sensitivity (74%) and improved sensitivity (90%) for differentiation of recurrence of brain metastasis from radiation necrosis, compared to previous result on MET PET [12]. 3,4-Dihydroxy-6-[18F]fluoro-phenylalanine (18F-FDOPA) showed best sensitivity and specificity for diagnosis of recurrent GBM with T/N ratio of 1.3 [13].
Visual assessment has been a diagnostic method in PET studies. As Glaudemans et al. has suggested, visual assessment of MET-PET images may be easier to perform using criteria in which every area of uptake higher than background (normal gray matter) is considered potentially pathological [14].
The aim of our study was to assess the accuracy of visual assessment across centers, and to compare that accuracy to that of quantitative analysis.
Materials and Methods
Patients
The protocol for this retrospective observational study was approved by the institutional review board (IRB) of National Center for Global Health and Medicine and Tokyo Women's Medical University. The other participating facilities entrusted the institutional review board of National Center for Global Health with decisions on approval of the protocol for this retrospective observational study. All the IRB granted a waiver of consent for this retrospective observational study. Patient records and information were anonymized and de-identified prior to analysis.
The assessment was performed for seventy patients (38 males and 32 females; age range 26–85 years, mean 53.5 ± 14.3 years) with 73 lesions showing apparent contrast enhancement on follow-up gadolinium enhanced T1WI obtained by 1.5T MRI after intracranial irradiation (conventional radiotherapy and/or stereotactic radiosurgery). They were then imaged using MET-PET in one of three PET centers to discriminate a recurrent brain tumor from radiation-induced necrosis. The intracranial lesions were 42 metastatic brain tumors (primary lesions; lung: 27, breast: 9, colon: 1, sarcoma: 1, thyroid: 1, larynx: 1, squamous cell carcinoma: 1, kidney: 1) and 31 gliomas (anaplastic astrocytoma [grade 3]: 12, glioblastoma [grade 4]: 19). The locations of the lesions were 35 in the frontal lobe, 12 in the parietal lobe, 12 in the temporal lobe, 10 in the cerebellum, and 4 in the occipital lobe. All glioma cases were identified after surgery. Chemotherapy was employed in 27 cases of gliomas and was continuing for nine patients at the time of the MET-PET imaging. All patients had undergone conventional radiotherapy (n = 30, 50–60 Gy) or stereotactic radiosurgery (n = 40, 18–22 Gy) for gliomas or metastatic brain tumors.
Recurrence was defined as any of the following: 1) pathologic confirmation after tumor resection or biopsy, 2) death as the result of progression of the brain tumor disease, 3) increase in the size of the Gd-enhanced area on the following MRI where the lesion was matched to the MET uptake area, and 4) recurrence of the metastatic brain tumor was strongly suspected by the nuclear physician and shrinkage of the lesion was confirmed after additional radiation therapy. The defining characteristics of radiation-induced necrosis were clinical in nature. Such a lesion either remained stable or shrank in size without additional treatment as determined by a follow-up MRI (6 months or more after the PET scan). The mean interval between irradiation and the PET scan was 20.1 months for gliomas and 11.2 months for metastatic brain tumors. Final results were 48 cases of recurrent brain tumors and 25 cases of radiation-induced necrosis.
MET-PET Imaging
Patients fasted for at least 3 h prior to the PET study. In PET center (A), the PET/CT examination was performed with a Discovery LS (GE Medical Systems, Milwaukee, WI) 20 min after intravenous injection of 220.8–738.8 MBq (mean 418.7 MBq) 11C-MET, using the 3D acquisition mode (n = 13) for a 10-min static scan. For attenuation correction, a non-enhanced CT scan was acquired, and attenuation-corrected images were reconstructed using the ordered subset expectation maximization (OSEM) algorithm. In PET center (B), 42 PET/CT examinations were performed with a Biograph 16 (Siemens, Erlangen, Germany) 20 min after injection of 370 MBq 11C-MET, using the 3D acquisition mode for a 10-min static scan. For attenuation correction, a non-enhanced CT scan was acquired, and attenuation-corrected images were reconstructed using OSEM. In PET center (C), 17 PET examinations were performed using an ECAT ACCEL (Siemens) 20 min after injection of 400 MBq 11C-MET, using the 3D acquisition mode for a 10-min static scan. 68Ge/68Ga sources were used for the transmission scan. At all centers, patients were placed in the scanner so that slices parallel to the orbitomeatal line could be obtained.
PET Image Interpretation
Visual Analysis
A total of 73 lesions in 70 patients who underwent MET-PET were evaluated with visual assessment by three experienced, board-certified, nuclear medicine physicians. All reconstructed PET images were reviewed independently by the physicians on a work station, EV Insite (PSP Corporation, Tokyo, Japan). The lesion for visual assessment of the MET-PET image was determined by reference to the contrast-enhanced MRI of the brain. A visual assessment score for the MET-PET image was obtained by comparing MET uptake within the lesion to that in one of four specified areas: 1) the region surrounding the lesion, 2) the contralateral frontal lobe, 3) the entire contralateral region, and 4) the contralateral cerebellar cortex. The score was classified into five grades as follows: 1) much higher uptake, 2) slightly higher uptake, 3) almost the same uptake, 4) slightly lower uptake, and 5) much lower uptake. Finally, the results of visual assessment were reclassified into just two groups by means of consensus of three observers. The first group was “higher uptake than the reference region (grades 1 and 2)”, and the second group was “same or lower uptake than the reference region (grades 3, 4, and 5)”. To assess intraobserver reproducibility, these analyses were repeated by the same three observers approximately 3 months after the end of the first assessment. For analysis of the diagnostic value of visual assessment, we used a “consensus interpretation”, which was determined for each case as the choice selected by the majority of the readers.
Quantitative Analysis
The quantitative analysis was performed independently from the visual assessment. The region of interest (ROI) for lesions was manually located over the area corresponding to the contrast-enhanced area on the MRI. As a normal control, circular ROIs with a diameter of 10 mm were located over areas surrounding the lesion, within the gray matter of the contralateral frontal lobe, within the contralateral area, and within the contralateral cerebellar cortex.
The maximum SUV (SUVmax) and the mean SUV (SUVmean) were measured for the various ROIs, and the various L/N ratios were calculated by dividing the SUVmax of the lesion by the SUVmax of the normal control region (L/Nmax), by dividing the SUVmean of the lesion by the SUVmean of the normal control region (L/Nmean) and by dividing the SUVmax of the lesion by the SUVmean of the normal control region (L/Nmax mean)
Statistical Analysis
Levels of interobserver agreement and intraobserver reproducibility were quantified using kappa values (κ-values) by two reclassified groups [15]. Bootstrapping was used to calculate 95% confidence intervals. The values for intraobserver reproducibility are shown as the average of the three readers. The result of visual assessments, which were sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, and the area under the receiver-operating characteristic curve (AUC) value based on receiver-operating characteristic (ROC) curve analysis, were calculated from the results of consensus interpretation. The average SUVmax and SUVmean for MET uptake and the L/N ratio were expressed as the means ± standard deviation (SD), and the Mann-Whitney U test was used to evaluate the differences in these values. The Kruskal-Wallis one-way analysis of variance was used to determine the difference in MET uptake and the L/N ratio among the three PET centers.
Multivariate logistic regression analysis was performed with “Assessment of the MET uptake in the lesion compared to each region” and the final result. ROC curve analysis was used to determine the optimal index of MET-PET and the cut-off values for differential diagnosis of tumor recurrence and radiation-induced necrosis. Differences in the AUC value among the reference regions for the lesion and between visual assessment and the quantitative value were compared using the test for the equality of ROC areas [16]. Statistical analyses were performed using the statistical package Stata (version IC 11; Stata Corp., TX, USA). Values of p < 0.05 were considered significant
Results
Visual analysis
Interobserver agreement and intraobserver reproducibility among the three readers for each index are summarized in Table 1.
Table 1. Intra-and interobserver variability.
| Reference for lesion | Interobserver agreement | Intraobserver reproducibility | ||||
|---|---|---|---|---|---|---|
| Kappa value (95% CI) | Kappa value (95% CI) | |||||
| All | Glioma | Metastasis | All | Glioma | Metastasis | |
| Around | 0.568 | 0.591 | 0.541 | 0.662 | 0.685 | 0.642 |
| (0.422–0.710) | (0.081–0.860) | (0.340–0.694) | ||||
| Contralateral | 0.568 | 0.557 | 0.564 | 0.633 | 0.610 | 0.651 |
| (0.524–0.625) | (0.323–0.649) | (0.551–0.651) | ||||
| Frontal lobe | 0.532 | 0.536 | 0.507 | 0.694 | 0.657 | 0.718 |
| (0.466–0.568) | (0.499–0.588) | (0.279–0.650) | ||||
| Cerebellum | 0.657 | 0.609 | 0.689 | 0.714 | 0.697 | 0.726 |
| (0.549–0.695) | (0.470–0.689) | (0.616–0.745) | ||||
The values on intraobserver reproducibility were shown as averages of those in three readers.
The interobserver agreement was best when MET uptake in the tumor was compared to that in the contralateral cerebellar cortex (kappa = 0.657). The average intraobserver reproducibility was highest when MET uptake was compared to that in the contralateral cerebellar cortex. The result of visual analysis is shown in Table 2.
Table 2. Results of visual analysis.
| Subject | Reference for lesion | Sensitivity | Specificity | PPV | NPV | Accuracy | AUC |
|---|---|---|---|---|---|---|---|
| All lesion | Around | 91.5 | 53.8 | 78.2 | 77.8 | 78.1 | 0.73 |
| Contralateral | 89.4 | 50.0 | 76.4 | 72.2 | 75.3 | 0.70 | |
| Frontal lobe | 85.1 | 57.7 | 78.4 | 68.2 | 75.3 | 0.71 | |
| Cerebellum | 78.7 | 73.1 | 84.1 | 65.5 | 76.7 | 0.76 | |
| Glioma | Around | 85.7 | 50.0 | 78.3 | 62.5 | 74.2 | 0.68 |
| Contralateral | 81.0 | 50.0 | 77.3 | 55.6 | 71.0 | 0.65 | |
| Frontal lobe | 71.4 | 60.0 | 78.9 | 50.0 | 67.7 | 0.66 | |
| Cerebellum | 66.7 | 60.0 | 77.8 | 46.2 | 64.5 | 0.63 | |
| Brain metastasis | Around | 96.2 | 56.3 | 78.2 | 90.0 | 81.0 | 0.76 |
| Contralateral | 96.2 | 50.0 | 75.8 | 88.9 | 78.6 | 0.73 | |
| Frontal lobe | 96.2 | 56.3 | 78.2 | 90.0 | 81.0 | 0.76 | |
| Cerebellum | 88.5 | 81.3 | 88.5 | 81.3 | 85.7 | 0.85 |
PPV: positive predictive value, NPV: negative predictive value, AUC: area under the receiver-operating characteristic curve.
Visual analysis showed relatively higher AUC values for evaluating recurrence of brain metastasis than for gliomas. For visual analysis of gliomas, no statistically significant difference in the AUC values was found among the reference regions for the lesion (p = 0.32–0.79). The cerebellum showed the highest AUC value for the assessment of brain metastasis. However, no significant difference was confirmed compared to the other references for the lesion (p = 0.07–0.16).
As summarized in Table 3, logistic regression analysis showed that the contralateral cerebellum was the most influential reference region for MET uptake for the final result in cases of brain metastasis (p = 0.03).
Table 3. Logistic regression analysis of the statistical significance (p value) of the dependence of the outcome on the visual assessment.
| Reference region employed | P value | ||
|---|---|---|---|
| All lesions | Glioma | Metastasis | |
| Around | 0.24 | 0.31 | 0.99 |
| Contralateral | 0.96 | 0.89 | 0.99 |
| Frontal lobe | 0.84 | 0.87 | 0.99 |
| Cerebellum | 0.06 | 0.83 | 0.03 |
However, no influential reference area was confirmed for the final result in cases of glioma. Representative MET-PET images are shown in Fig 1.
Fig 1. (A) 60-year-old male with recurrence of brain metastasis (lung carcinoma) at left temporal lobe (arrow head).
MET uptake of the MRI-enhanced lesion showed higher than the region around the lesion, the contralateral brain, the contralateral frontal lobe and cerebellum. (B) 26-year-old male with recurrence of an anaplastic astrocytoma in the right temporal lobe. Contrast-enhanced MRI showed gadolinium-enhanced nodular lesion (arrow) in the right temporal lobe, which was the location of post-surgical resection of the primary brain tumor. MET uptake of the MRI-enhanced lesion (arrow head) showed higher than the region around the lesion, the contralateral brain, the contralateral frontal lobe and cerebellum. (C) 59-year-old female with radiation necrosis. Contrast-enhanced MRI showed gadolinium-enhanced lesion (arrow head) at the corpse callosum, which was suspected recurrent brain metastasis (lung carcinoma). MET uptake of the MRI-enhanced lesion showed slightly higher than the region around the lesion, the contralateral brain, and the contralateral frontal lobe, but similar to MET uptake at cerebellum.
Quantitative analysis
MET uptake for the cerebellum was significantly higher than for the other areas (p < 0.01), but no difference was found among the other areas (Table 4).
Table 4. Methionine uptake in normal brain areas and brain lesions.
| Subject | SUVmax (± SD) | Range | SUVmean (±SD) | Range |
|---|---|---|---|---|
| Around | 1.4 ± 0.4 | 0.7–2.2 | 1.1 ± 0.3 | 0.4–1.8 |
| Contralateral | 1.5 ± 0.4 | 0.6–2.8 | 1.2 ± 0.3 | 0.6–2.7 |
| Frontal lobe | 1.4 ± 0.3 | 0.5–2.2 | 1.2 ± 0.2 | 0.5–1.8 |
| Cerebellum | 1.7 ± 0.4 | 0.7–2.5 | 1.5 ± 0.3 | 0.7–2.3 |
| Recurrence | 2.5 ± 0.9 | 0.7–6.3 | 2.0 ± 0.8 | 0.6–5.6 |
| Glioma | 2.5 ± 1.1 | 0.7–6.3 | 2.1 ± 1.0 | 0.6–5.6 |
| Metastasis | 2.5 ± 0.8 | 1.3–4.1 | 2.0 ± 0.6 | 0.7–3.3 |
| Radiation necrosis | 1.9 ± 0.9 | 0.7–4.7 | 1.5 ± 0.7 | 0.6–4.0 |
SUVmax: maximum standardized uptake value, SUVmean: mean standardized uptake value, SD: standardized deviation.
The SUV was significantly higher for tumor recurrence than for radiation-induced necrosis (SUVmax: p < 0.006, SUVmean: p < 0.005). The SUVmax and SUVmean of gliomas were not different from those of metastasis (p = 0.35). Each of the three L/N ratios using the cerebellum as a reference was significantly lower than when using the other region as a reference (p < 0.01) (Table 5).
Table 5. Lesion-to-normal tissue ratio.
| Subject | Reference to lesion | L/N max | L/N mean | L/N max mean |
|---|---|---|---|---|
| Recurrence (Glioma and metastasis) | Around | 1.7 ± 0.6 (1.0–3.9) | 1.8 ± 0.8 (0.6–4.4) | 2.2 ± 1.0 (1.0–5.0) |
| Contralateral | 1.8 ± 0.7 (0.6–5.6) | 1.7 ± 0.8 (0.5–6.0) | 2.1 ± 0.9 (0.6–6.8) | |
| Frontal lobe | 1.9 ± 0.7 (0.9–5.1) | 1.8 ± 0.8 (0.6–5.4) | 2.1 ± 0.9 (1.1–6.1) | |
| Cerebellum | 1.5 ± 0.5 (0.7–3.8) | 1.4 ± 0.5 (0.5–3.6) | 1.7 ± 0.6 (0.8–4.1) | |
| Glioma | Around | 1.6 ± 0.7 (1.0–3.9) | 1.7 ± 0.8 (0.9–4.4) | 2.0 ± 0.9 (1.0–5.0) |
| Contralateral | 1.8 ± 1.0 (0.6–5.6) | 1.9 ± 1.1 (0.5–6.0) | 2.1 ± 1.2 (0.6–6.8) | |
| Frontal lobe | 1.8 ± 0.9 (0.9–5.1) | 1.8 ± 1.0 (0.8–5.4) | 2.0 ± 1.0 (1.1–6.1) | |
| Cerebellum | 1.5 ± 0.7 (0.7–3.8) | 1.4 ± 0.7 (0.7–3.6) | 1.6 ± 0.7 (0.8–4.1) | |
| Metastasis | Around | 1.8 ± 0.5 (1.0–3.0) | 1.9± 0.8 (0.6–4.2) | 2.5 ± 1.0 (1.2–5.0) |
| Contralateral | 1.7 ± 0.4 (0.9–2.8) | 1.6 ± 0.5 (0.6–3.2) | 2.1 ± 0.6 (1.2–3.8) | |
| Frontal lobe | 1.9 ± 0.6 (1.0–3.6) | 1.8 ± 0.6 (0.6–3.3) | 2.3 ± 0.7 (1.2–4.0) | |
| Cerebellum | 1.5 ± 0.4 (0.8–2.5) | 1.4 ± 0.4 (0.5–2.4) | 1.7 ± 0.5 (0.9–2.8) | |
| Radiation necrosis | Around | 1.3 ± 0.4 (0.6–2.1) | 1.3 ± 0.4 (0.6–2.0) | 1.8 ± 0.9 (0.7–4.9) |
| Contralateral | 1.2 ± 0.3 (0.6–2.3) | 1.2 ± 0.4 (0.7–2.4) | 1.6 ± 0.6 (0.5–3.8) | |
| Frontal lobe | 1.3 ± 0.4 (0.6–2.4) | 1.2 ± 0.4 (0.6–2.3) | 1.7 ± 0.9 (0.7–5.0) | |
| Cerebellum | 1.0 ± 0.3 (0.5–1.8) | 0.9 ± 0.3 (0.4–1.8) | 1.3 ± 0.7 (0.5–3.8) |
Range is represented in parenthesis. L/N ratio: lesion to normal tissue ratio L/Nmax: SUVmax (lesion) / SUVmax (reference), L/Nmean: SUVmean (lesion)/ SUV mean (reference), L/N max mean: SUVmax (lesion)/ SUV mean (reference).
The L/N ratio was significantly higher for tumor recurrence than for radiation-induced necrosis (p < 0.02).
Variation in MET uptake among PET centers
The results for variation in MET uptake among PET centers are shown in Tables 6 and 7.
Table 6. Differences in SUV among the three PET centers.
| Subject | SUVmax | SUVmean | ||||||
|---|---|---|---|---|---|---|---|---|
| A | B | C | P value | A | B | C | P value | |
| Around | 1.7 ± 0.3 | 1.3 ± 0.3 | 1.4 ± 0.3 | 0.02 | 1.3 ± 0.3 | 1.1 ± 0.3 | 1.2 ± 0.3 | 0.06 |
| Contralateral | 1.7 ± 0.3 | 1.4 ± 0.3 | 1.4 ± 0.5 | 0.06 | 1.3 ± 0.3 | 1.2 ± 0.3 | 1.3 ± 0.5 | 0.32 |
| Frontal lobe | 1.7 ± 0.3 | 1.3 ± 0.2 | 1.3 ± 0.3 | <0.001 | 1.4 ± 0.3 | 1.1 ± 0.2 | 1.2 ± 0.3 | <0.001 |
| Cerebellum | 2.1 ± 0.3 | 1.6 ± 0.3 | 1.6 ± 0.3 | <0.001 | 1.8 ± 0.3 | 1.4 ± 0.3 | 1.5 ± 0.3 | <0.001 |
| Lesions | 2.2 ± 0.5 | 2.4 ± 1.1 | 1.9 ± 0.7 | 0.28 | 1.6 ± 0.4 | 1.9 ± 1.0 | 1.7 ± 0.6 | 0.26 |
A: PET cancer (A), B: PET cancer (B), C: PET cancer (C).
Table 7. Differences in the L/N ratio in cases with radiation-induced necrosis among the three PET centers.
| Subject | L/N max | L/N mean | L/N max mean | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| A | B | C | P value | A | B | C | P value | A | B | C | P value | |
| Around | 1.2 ± 0.2 | 1.3 ± 0.4 | 1.4 ± 0.3 | 1.2 ± 0.2 | 1.4 ± 0.4 | 1.4 ± 0.4 | 1.7 ± 0.4 | 1.8 ± 0.7 | 1.7 ± 0.5 | |||
| Contralateral | 1.2 ± 0.3 | 1.3 ± 0.4 | 1.2 ± 0.2 | 0.36 | 1.2 ± 0.4 | 1.2 ± 0.4 | 1.1 ± 0.2 | 0.71 | 1.5 ± 0.2 | 1.6 ± 0.6 | 1.6 ± 0.4 | 0.46 |
| Frontal lobe | 1.2 ± 0.4 | 1.4 ± 0.4 | 1.3 ± 0.3 | 0.40 | 1.1 ± 0.4 | 1.2 ± 0.4 | 1.2 ± 0.3 | 0.55 | 1.6 ± 0.2 | 1.7 ± 0.9 | 1.6 ± 0.5 | 0.99 |
| Cerebellum | 1.0 ± 0.3 | 1.1 ± 0.3 | 1.1 ± 0.2 | 0.38 | 0.8 ± 0.3 | 1.0 ± 0.3 | 0.9 ± 0.3 | 0.45 | 1.2 ± 0.1 | 1.2 ± 0.6 | 1.3 ± 0.4 | 0.66 |
A: PET cancer (A), B: PET cancer (B), C: PET cancer (C), L/N ratio: lesion to normal tissue ratio L/Nmax: SUVmax (lesion) / SUVmax (reference), L/Nmean: SUVmean (lesion)/ SUV mean (reference), L/N max mean: SUVmax (lesion)/ SUV mean (reference).
Significant differences in MET uptake around the lesion, in the contralateral frontal lobe, and in the contralateral cerebellum were confirmed among the three PET centers. However, no significant difference was confirmed in the L/N ratio for cases with radiation-induced necrosis among the three PET centers. Representative MET-PET images are shown in Fig 2.
Fig 2. Representative methionine PET (MET-PET) images from the three PET centers (A, B, and C) and reference contrast-enhanced MRIs from patients with recurrent gliomas.
All lesions are indicated with arrow heads.
ROC analysis for distinguishing tumor recurrence from radiation-induced necrosis
The assessment using a cut-off value for the L/N ratio is shown in Table 8.
Table 8. The cut-off value for the L/N ratio based on ROC analysis.
| Subject | All lesions | Glioma | Metastasis | ||||
|---|---|---|---|---|---|---|---|
| SUV | L/N ratio* | AUC | L/N ratio* | AUC | L/N ratio* | AUC | |
| Around | Max | 1.4 | 0.72 | 1.5 | 0.63 | 1.4 | 0.79 |
| Mean | 1.3 | 0.70 | 1.3 | 0.61 | 1.3 | 0.76 | |
| Max mean | 1.7 | 0.68 | 1.8 | 0.69 | 1.6 | 0.71 | |
| Contralateral | Max | 1.3 | 0.79 | 1.4 | 0.68 | 1.3 | 0.89 |
| Mean | 1.3 | 0.77 | 1.4 | 0.66 | 1.3 | 0.85 | |
| Max mean | 1.7 | 0.68 | 1.8 | 0.59 | 1.6 | 0.66 | |
| Frontal lobe | Max | 1.5 | 0.72 | 1.2 | 0.60 | 1.5 | 0.81 |
| Mean | 1.4 | 0.78 | 1.2 | 0.60 | 1.4 | 0.88 | |
| Max mean | 1.6 | 0.74 | 1.4 | 0.63 | 1.6 | 0.84 | |
| Cerebellum | Max | 1.2 | 0.79 | 1.0 | 0.60 | 1.2 | 0.86 |
| Mean | 1.1 | 0.81 | 1.2 | 0.71 | 1.1 | 0.89 | |
| Max mean | 1.4 | 0.75 | 1.2 | 0.59 | 1.3 | 0.83 | |
Results for the four reference regions, three types of L/N, and two types of patient as well as for all patients. L/N ratio: lesion to normal tissue ratio, SUV: standardized uptake value, Max: SUVmax (lesion) / SUVmax (reference), Mean: SUVmean (lesion)/ SUV mean (reference), L/N max mean: SUVmax (lesion)/ SUV mean (reference), AUC: area under the receiver-operating characteristic curve.
*The number shown in L/N ratio is cut off value based on ROC analysis.
The AUC value was highest for L/Nmean using the cerebellum as a reference (AUC = 0.81), but no significant difference was confirmed among the patients. For distinguishing gliomas from radiation-induced necrosis, the L/Nmean with the cerebellum as a reference showed the highest AUC value (AUC = 0.71). For distinguishing metastasis from radiation-induced necrosis, the L/Nmax with the contralateral area as a reference (AUC = 0.89) and the L/Nmean with the cerebellum as a reference (AUC = 0.89) showed the highest AUC values.
Comparing visual and quantitative analysis
The AUC value with visual observation was 0.76, which had no significant difference with with the L/Nmean of the contralateral cerebellum (AUC = 0.81). For evaluating gliomas, no statistically significant difference was confirmed between visual assessment using the area around the lesion as a reference (AUC = 0.68) and quantitative analysis using the L/N cut-off value with the contralateral cerebellum as a reference. For evaluating metastasis, no statistically significant difference was confirmed between visual assessment using the contralateral cerebellum as a reference (AUC = 0.85) and quantitative analysis using L/N cut-off values of 1.3 with the contralateral side as a reference (AUC = 0.89) and 1.1 with the contralateral cerebellum as a reference (AUC = 0.89) (Table 8). The results of quantitative analysis with the two highest AUC values are shown in Table 9.
Table 9. Results of quantitative analysis.
| Lesion | Subject | SUV | Cut off value | Sensitivity | Specificity | PPV | NPV | Accuracy | AUC |
|---|---|---|---|---|---|---|---|---|---|
| All lesions | Contralateral | Max | 1.3 | 75.0 | 72.0 | 83.7 | 60.0 | 74.0 | 0.79 |
| Cerebellum | Mean | 1.1 | 67.8 | 84.0 | 58.2 | 58.3 | 74.0 | 0.81 | |
| Glioma | Contralateral | Max | 1.4 | 66.7 | 60.0 | 77.8 | 46.2 | 64.5 | 0.68 |
| Cerebellum | Mean | 1.2 | 52.4 | 90.0 | 91.7 | 47.4 | 64.5 | 0.71 | |
| Metastasis | Contralateral | Max | 1.3 | 81.5 | 85.7 | 91.7 | 72.0 | 83.3 | 0.89 |
| Cerebellum | Mean | 1.1 | 81.5 | 86.7 | 91.7 | 72.0 | 83.3 | 0.89 |
AUC: area under the receiver-operating characteristic curve.
The quantitative value showed a lower sensitivity and higher specificity than visual analysis, although no significant difference in the AUC values was found. As a consequence, no significant difference between quantitative evaluation and visual analysis was identified.
Discussion
The results from this multi-center study showed that visual assessment was not significantly different from quantitative assessment of MET-PET with a relevant cut-off value for the differentiation of recurrent brain tumors from radiation-induced necrosis.
The L/N ratio has been used for differentiation, but the cut-off ratio is different in each study [7, 8, 17–19]. The variation may be caused by several factors within the PET scan protocol, which has not been standardized. No studies have assessed observer variability in MET-PET for differentiation of recurrent brain tumors from radiation-induced necrosis. Therefore, we expected that visual assessment may solve the problem.
The cerebellum appeared to be the best candidate reference area for visual assessment because of high interobserver agreement, intraobserver reproducibility, and specificity. This region may be useful only for cases of suspected recurrence of brain metastasis. However, the low sensitivity of the cerebellum as a reference for lesions was a serious limitation for visual assessment. We did not find a relevant reference area for assessing gliomas, although the region around the lesion showed the best value for visual analysis. Unfortunately, a combination of these parameters for assessment did not improve the diagnosis (data not shown).
Distribution of normal MET uptake, which is obtained by recalculating the images as ratios to whole-brain mean uptake, is higher in the occipital cortex, cerebellum, and thalamus than in other regions [20]. In our study, quantitative analysis showed the same trend. A wide variation in MET uptake appeared to be confirmed in the occipital cortex, cerebellum, basal ganglia, and brain stem [20]. In contrast, uptake in the cortex, except the occipital area and white matter, showed low variation. MET uptake in the thalamus is similar to that in the cerebrum and shows little variation. Therefore, the thalamus is a candidate reference area, but the small area of this region made reliable identification difficult, and thus, we did not include it as a reference area in this study.
A remarkable point is that the results of visual assessment were different for gliomas compared to brain metastases. The cerebellum is the most influential region for differentiating between recurrence of brain metastasis and radiation-induced necrosis. The present study showed a wide range of MET uptake for glioma lesions (range of SUVmax: 0.7–6.3) and a relatively higher SD (1.1) than metastasis (0.8). Another assumed cause of the wide range with MET uptake for glioma lesion is that most of the cases we included were in the post-operative state. According to the quantitative result, MET uptake for glioma lesions was similar to that for metastatic lesions. Nevertheless, the L/N ratio was higher in metastatic lesions than gliomas, indicating that several unknown factors regarding gliomas and the variation in MET uptake for these lesions may have affected the result. In several articles evaluating MET-PET for differentiation of recurrence from radiation-induced necrosis, the mean L/N ratio was higher in gliomas than in brain metastases.
Our results indicate that the quantitative result was not significantly different from visual assessment. The problem with quantitative assessment is determining the cut-off value. Each facility will be able to estimate the cut-off value using retrospective observation analysis and matching of the L/N ratio for each MET-PET image and the patient’s prognosis or intervening pathological diagnosis. According to our result, we expected that visual assessment may be useful as a brief reference for estimating the range of cut-off values.
High-dose radiation therapies and repeated radiotherapies prolong patient survival, but they also increase the incidence of radiation-induced necrosis [21, 22]. In this study, MET uptake was assessed with reference to Gd-enhanced lesions seen on MRI. Symptomatic brain edema occurred in both recurrent tumors and radiation-induced necrosis. Therefore, assessment of brain edema using Gd-enhanced T1-weighted MRI as references should also be included when evaluating the patient after radiotherapy.
18F-FET PET can provide valuable information for differentiation of high-grade glioma or brain metastasis from treatment-related changes in the brain tissue [12, 23]. In addition to the T/B ratio of 18F-FET uptake, 18F-FET kinetics showed potential diagnostic value for the differentiation [12].
Recently, bevacizumab was reported to be effective for improving perilesional edema around the necrotic core, although this drug cannot induce functional recovery of necrotic tissue [24–26]. 18F-boronophenylalanine, which is an amino acid tracer similar to MET, is useful for diagnosing radiation-induced necrosis and predicting the efficacy of bevacizumab in progressive radiation-induced necrosis [27].
A limitation of this study is that it is a retrospective study, and we could not obtain histological confirmation of all cases at the time of MET-PET to differentiate recurrence from radiation-induced necrosis. All patients in this study underwent radiation therapy after pathological confirmation after a surgical procedure or clinical diagnosis based on film evidence. Therefore, clinical follow-up is valid in cases of suspected recurrence and has the ethical advantage of avoiding an invasive procedure such as a biopsy. MET-PET is an acceptable method for assessing CNS tumors as it avoids invasive procedures.
This study included only patient with grade III and IV glioma, it might cause a bias in this study. The lack of PET image quality control across the three facilities is another limitation of this retrospective study, although the L/N ratio was not significantly different among the three PET centers.
Conclusion
The results of this multicenter study show that the cerebellum is the best candidate for visual assessment for distinguishing recurrence of brain metastasis from radiation-induced necrosis because of the high interobserver agreement, intraobserver reproducibility, and AUC value. MET uptake in a suspected lesion, compared to uptake in the contralateral cerebellum, was significantly related to the final result. Quantitative values were not significantly different from visual assessment for differentiating recurrent brain tumors from radiation-induced necrosis.
Data Availability
All relevant data are within the paper.
Funding Statement
This study was supported by a research grant from the Japan Radiological Society (KJ22-11) (http://www.radiology.jp/).
References
- 1. Ishiwata K, Kubota K, Murakami M, Kubota R, Sasaki T, Ishii S, et al. (1993) Re-evaluation of amino acid PET studies: can the protein synthesis rates in brain and tumor tissues be measured in vivo? J Nucl Med 34 (11):1936–43. [PubMed] [Google Scholar]
- 2. Herholz K, Holzer T, Bauer B, Schröder R, Voges J, Ernestus RI, et al. (1998) 11C-Methionine PET for differential diagnosis of low-grade gliomas. Neurology 50 (5):1316–22. [DOI] [PubMed] [Google Scholar]
- 3. Pirotte B, Goldman S, Massager N, David P, Wikler D, Vandesteene A, et al. (2004) Comparison of 18F-FDG and 11Cmethionine for PET-guided stereotactic brain biopsy of gliomas. J Nucl Med 45 (8): 1293–8. [PubMed] [Google Scholar]
- 4. Hygino da Cruz LC Jr, Rodriguez I, Domingues RC, Gasparetto EL, Sorensen AG (2011). Pseudoprogression and pseudoresponse: imaging challenges in the assessment of posttreatment glioma. AJNR Am J Neuroradiol 32(11):1978–85. 10.3174/ajnr.A2397 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Chung JK, Kim YK, Kim SK, Lee YJ, Paek S, Yeo JS, et al. (2002) Usefulness of 11C-methionine PET in the evaluation of brain lesions that are hypo- or isometabolic on 18F-FDG PET. Eur J Nucl Med Mol Imaging 29 (2):176–82. [DOI] [PubMed] [Google Scholar]
- 6. Kracht LW, Friese M, Herholz K, Schroeder R, Bauer B, Jacobs A, et al. (2003) Methyl-[11C]- l-methionine uptake as measured by positron emission tomography correlates to microvessel density in patients with glioma. Eur J Nucl Med Mol Imaging 30 (6):868–73. [DOI] [PubMed] [Google Scholar]
- 7. Terakawa Y, Tsuyuguchi N, Iwai Y, Yamanaka K, Higashiyama S, Takami T, et al. (2008) Diagnostic Accuracy of 11C-Methionine PET for Differentiation of Recurrent Brain Tumors from Radiation Necrosis After Radiotherapy. J Nucl Med 49 (5):694–9. 10.2967/jnumed.107.048082 [DOI] [PubMed] [Google Scholar]
- 8. Tsuyuguchi N, Sunada I, Iwai Y, Yamanaka K, Tanaka K, Takami T, et al. (2003) Methionine positron emission tomography of recurrent metastatic brain tumor and radiation necrosis after stereotactic radiosurgery: is a differential diagnosis possible? J Neurosurg 98 (5): 1056–64. [DOI] [PubMed] [Google Scholar]
- 9. Tripathi M, Sharma R, Varshney R, Jaimini A, Jain J, Souza MM, et al. (2012) Comparison of F-18 FDG and C-11 methionine PET/CT for the evaluation of recurrent primary brain tumors. Clin Nucl Med 37 (2): 158–63. 10.1097/RLU.0b013e318238f51a [DOI] [PubMed] [Google Scholar]
- 10. Yamane T, Sakamoto S, Senda M (2010) Clinical impact of (11)C methionine PET on expected management of patients with brain neoplasm. Eur J Nucl Med Mol Imaging 37 (4): 685–90. 10.1007/s00259-009-1302-y [DOI] [PubMed] [Google Scholar]
- 11. Grosu AL, Astner ST, Riedel E, Nieder C, Wiedenmann N, Heinemann F, et al. (2011) An interindividual comparison of O-(2-[18F] fluoroethyl)-L-tyrosine (FET)- and L-[methyl-11C] methionine (MET)-PET in patients with brain gliomas and metastases. Int J Radiat Oncol Biol Phys 81 (4):1049–58. 10.1016/j.ijrobp.2010.07.002 [DOI] [PubMed] [Google Scholar]
- 12. Galldiks N, Stoffels G, Filss CP, Piroth MD, Sabel M, Ruge MI, et al. (2012). Role of O-(2-(18)F-fluoroethyl)-L-tyrosine PET for differentiation of local recurrent brain metastasis from radiation necrosis. J Nucl Med 53(9):1367–74. 10.2967/jnumed.112.103325 [DOI] [PubMed] [Google Scholar]
- 13. Karunanithi S, Sharma P, Kumar A, Khangembam BC, Bandopadhyaya GP, Kumar R, et al. (2013). 18F-FDOPA PET/CT for detection of recurrence in patients with glioma: prospective comparison with 18F-FDG PET/CT. Eur J Nucl Med Mol Imaging 40(7):1025–35. 10.1007/s00259-013-2384-0 [DOI] [PubMed] [Google Scholar]
- 14. Glaudemans AW, Enting RH, Heesters MA, Dierckx RA, van Rheenen RW, Walenkamp AM, et al. (2013) Value of 11C-methionine PET in imaging brain tumors and metastases. Eur J Nucl Med Mol Imaging 40 (4): 615–35. 10.1007/s00259-012-2295-5 [DOI] [PubMed] [Google Scholar]
- 15. Fleiss JL, Levin B, Paik MC (2003) Statistical Methods for Rates and Proportions. 3rd ed Chapter 18. New York: Wiely, 598–626. [Google Scholar]
- 16. DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44 (3):837–45. [PubMed] [Google Scholar]
- 17. Kim YH, Oh SW, Lim YJ, Lee SH, Kang KW, Jung HW, et al. (2010) Differentiating radiation necrosis from tumor recurrence in high grade gliomas: assessing the efficacy of 18F-FDG PET, 11Cmethionine PET and perfusion MRI. Clin Neurol Neurosurg 112 (9):758–65. 10.1016/j.clineuro.2010.06.005 [DOI] [PubMed] [Google Scholar]
- 18. Tsuyuguchi N, Takami T, Sunada I, Iwai Y, Yamanaka K, Tanaka K, et al. (2004) Methionine positron emission tomography for differentiation of recurrent brain tumor and radiation necrosis after stereotactic radiosurgery–in malignant glioma. Ann Nucl Med 18 (4):291–6. [DOI] [PubMed] [Google Scholar]
- 19. Okamoto S, Shiga T, Hattori N, Kubo N, Takei T, Katoh N, et al. (2011) Semiquantitative analysis of C-11 methionine PET may distinguish brain tumor recurrence from radiation necrosis even in small lesions. Ann Nucl Med 25 (3): 213–20. 10.1007/s12149-010-0450-2 [DOI] [PubMed] [Google Scholar]
- 20. Coope DJ, Cízek J, Eggers C, Vollmar S, Heiss WD, Herholz K (2007) Evaluation of primary brain tumors using 11C-methionine PET with reference to a normal methionine uptake map. J Nucl Med 48 (12):1971–80. [DOI] [PubMed] [Google Scholar]
- 21. Andrews DW, Scott CB, Sperduto PW, Flanders AE, Gaspar LE, Schell MC, et al. (2004) Whole brain radiation therapy with or without stereotactic radiosurgery boost for patients with one to three brain metastases: phase III results of the RTOG 9508 randomized trial. Lancet 2363 (9422): 1665–72. [DOI] [PubMed] [Google Scholar]
- 22. Laperriere N, Zuraw L, Cairncross G (2002) Cancer Care Ontario Practice Guidelines Initiative Neuro-Oncology Disease Site Group: Radiotherapy for newly diagnosed malignant glioma in adults: a systematic review. Radiother Oncol 64 (3): 259–73. [DOI] [PubMed] [Google Scholar]
- 23. Po¨pperl G, Go¨tz C, Rachinger W, Gildehaus FJ, Tonn JC, Tatsch K (2004) Value of O-(2-[18F]fluoroethyl)-L-tyrosine PET for the diagnosis of recurrent glioma. Eur J Nucl Med Mol Imaging 31 (11):1464–70. [DOI] [PubMed] [Google Scholar]
- 24. Torcuator R, Zuniga R, Mohan YS, Rock J, Doyle T, Anderson J, et al. (2009) Initial experience with Bevacizumab treatment for biopsy confirmed cerebral radiation necrosis. J Neurooncol 94 (1): 63–8. 10.1007/s11060-009-9801-z [DOI] [PubMed] [Google Scholar]
- 25. Matuschek C, Bölke E, Nawatny J, Hoffmann TK, Peiper M, Orth K, et al. (2011) Bevacizumab as a treatment option for radiation-induced cerebral necrosis. Strahlenther Onkol 187 (2):135–9. 10.1007/s00066-010-2184-4 [DOI] [PubMed] [Google Scholar]
- 26. Nonoguchi N, Miyatake S, Fukumoto M, Furuse M, Hiramatsu R, Kawabata S, et al. (2011) The distribution of vascular endothelial growth factor-producing cells in clinical radiation necrosis of the brain:pathological consideration of their potential roles. J Neurooncol 105 (2):423–31. 10.1007/s11060-011-0610-9 [DOI] [PubMed] [Google Scholar]
- 27. Furuse M, Nonoguchi N, Kawabata S, Yoritsune E, Takahashi M, Inomata T, et al. (2013) Bevacizumab treatment for symptomatic radiation necrosis diagnosed by amino acid PET. Jpn J Clin Oncol 43 (3):337–41. 10.1093/jjco/hys231 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All relevant data are within the paper.