Abstract
Simple Summary
The aim of this study was to assess the efficacy of radiomics features obtained by EOB-MRI phase in order to predict clinical outcomes following liver resection in Colorectal Liver Metastases Patients, and evaluate recurrence, mutational status, pathological characteristic (mucinous) and surgical resection margin. Ours results confirmed the capacity of radiomics to identify, as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach. These results were confirmed by external validation dataset. We obtained a good performance considering the single textural significant metric in the identification of front of tumor growth (expansive versus infiltrative) and tumor budding (high grade versus low grade or absent), in the recognition of mucinous type and in the detection of recurrences.
Abstract
The aim of this study was to assess the efficacy of radiomics features obtained by EOB-MRI phase in order to predict clinical outcomes following liver resection in Colorectal Liver Metastases Patients, and evaluate recurrence, mutational status, pathological characteristic (mucinous) and surgical resection margin. This retrospective analysis was approved by the local Ethical Committee board of National Cancer of Naples, IRCCS “Fondazione Pascale”. Radiological databases were interrogated from January 2018 to May 2021 in order to select patients with liver metastases with pathological proof and EOB-MRI study in pre-surgical setting. The cohort of patients included a training set (51 patients with 61 years of median age and 121 liver metastases) and an external validation set (30 patients with single lesion with 60 years of median age). For each segmented volume of interest by 2 expert radiologists, 851 radiomics features were extracted as median values using PyRadiomics. non-parametric test, intraclass correlation, receiver operating characteristic (ROC) analysis, linear regression modelling and pattern recognition methods (support vector machine (SVM), k-nearest neighbors (KNN), artificial neural network (NNET), and decision tree (DT)) were considered. The best predictor to discriminate expansive versus infiltrative front of tumor growth was HLH_glcm_MaximumProbability extraxted on VIBE_FA30 with an accuracy of 84%, a sensitivity of 83%, and a specificity of 82%. The best predictor to discriminate tumor budding was Inverse Variance obtained by the original GLCM matrix extraxted on VIBE_FA30 with an accuracy of 89%, a sensitivity of 96% and a specificity of 65%. The best predictor to differentiate the mucinous type of tumor was the HHL_glszm_ZoneVariance extraxted on VIBE_FA30 with an accuracy of 85%, a sensitivity of 46% and a specificity of 95%. The best predictor to identify tumor recurrence was the LHL_glcm_Correlation extraxted on VIBE_FA30 with an accuracy of 86%, a sensitivity of 52% and a specificity of 97%. The best linear regression model was obtained in the identification of the tumor growth front considering the height textural significant metrics by VIBE_FA10 (an accuracy of 89%; sensitivity of 93% and a specificity of 82%). Considering significant texture metrics tested with pattern recognition approaches, the best performance for each outcome was reached by a KNN in the identification of recurrence with the 3 textural significant features extracted by VIBE_FA10 (AUC of 91%, an accuracy of 93%; sensitivity of 99% and a specificity of 77%). Ours results confirmed the capacity of radiomics to identify as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach.
Keywords: Liver metastasis, Magnetic Resonance Imaging, artificial intelligence, radiomics
1. Introduction
Radiomics is a rapidly evolving field of research concerned with the extraction of quantitative metrics—the so-called radiomics features—within medical images. Radiomic features capture tissue and lesion characteristics such as heterogeneity and shape and may, alone or in combination with demographic, histologic, genomic, or proteomic data, be used for clinical problem solving. In oncology, the assessment of tissue heterogeneity is of particular interest; genomic analyses have demonstrated that the degree of tumor heterogeneity is a prognostic determinant of survival and an obstacle to cancer control. Studies have demonstrated that radiomics features are strongly correlated with heterogeneity indices at the cellular level [1,2,3,4,5,6,7,8]. Therefore, that Radiomics could support cancer detection, diagnosis, evaluation of prognosis and response to treatment, so as could supervise disease status [9,10,11,12,13,14]. Using standard of care images that are usually obtained in a clinical setting, Radiomics analysis is a cost-effective and highly feasible implement for clinical decision support, providing prognostic and/or predictive biomarkers which enables a fast, low-cost, and repeatable tool for longitudinal monitoring [15,16,17,18,19,20]. Even though individual features may correlate with genomic data, so-called radiogenomics, or clinical outcomes, the impact of radiomics is increased when the data are processed using machine learning techniques. Nowadays, several studies have assessed the role of radiogenomics in hepatocellular carcinoma, but only a few have examined liver metastases [1,2,3].
During the work-up of patients with liver metastases, imaging plays an important role, since it enables one to estimate the number and sites of lesions, to assess the resectability, and to evaluate the response to treatment and drug toxicities [21,22,23,24,25]. Though computed tomography (CT) is routinely used for primary staging and disease surveillance, Magnetic Resonance imaging (MRI) is a valuable diagnostic technique in oncologic settings since it allows one to assess morphological and functional data [21,22,23,24]. Moreover, several liver-specific contrast agents have been introduced to improve lesions detection and characterization. Gadobenate dimeglumine (Gd-BOPTA) and gadolinium ethoxybenzyl diethylenetriamine pentaacetic acid (Gd-EOB-DTPA) allow one to obtain data on the lesions vascularization during the different phases of contrast study and functional data in the delayed, hepatobiliary phase (EOB-phase).
In this context, the possibility to correlate radiomics parameters obtained by MRI studies to recurrences, mutational status, pathological characteristic (mucinous and tumor budding), and surgical resection margin offers notable advantages over qualitative imaging assessment, allowing a better patient selection for cancer therapy, treatment response prediction, and discrimination of favorable subsets of patients from those with poor prognosis. In the present study, we assessed the efficacy of radiomics features obtained by EOB-MRI phase to predict clinical outcomes following liver resection in Colorectal Liver Metastases Patients.
2. Materials and Methods
2.1. Dataset Characteristics
This study aligned with National appropriate guidelines and procedures. The National Cancer Institute of Naples Ethical Committee board approved this retrospective study, renouncing the need for informed patient consent given the study nature.
Radiological archive was evaluated from January 2018 to May 2021 in order to choose patients with: (1) liver metastases with pathological proof; (2) EOB-MRI study in pre-surgical setting after neoadjuvant chemotherapy; (3) MR images of high quality; (4) a follow-up CT scan of at least six months after surgery. The exclusion criteria were: (1) discordance among the imaging diagnosis and the pathologically ones, (2) no EOB-MRI phase studies; (3) no high-quality MR images.
The cohort of patients included a training set and an external validation set. The internal training set consisted of 51 patients (33 women and 18 men) with a median age of 61 years (range 35–82 years) and 121 liver metastases. The validation cohort consisted of 30 patients with single lesion (10 women and 20 men) with 60 years of median age (range 40–78 years). The external validation patient dataset was provided by “Careggi Hospital”, Florence, Italy.
No liver metastases identified by EOB-MRI during the period investigated in this retrospective study were pathologically confirmed and thus not included in the study.
The patient characteristics are summarized in Table 1.
Table 1.
Patient Description | Numbers (%)/Range |
---|---|
Gender | Men 53 (65.4%) |
Women 28 (34.6%) | |
Age | 61 years; range: 35–82 years |
Primary Cancer Site | |
Colon | 52 (64.2%) |
Rectum | 29 (35.8%) |
Prior Chemotherapy | 81 (100%) |
Hepatic Metastases Description | |
Patients with single nodule | 52 (64.2%) |
Patients with multiple nodules | 29 (35.8%)/range: 2–13 metastases |
Nodule size (mm) | mean size 36.4 mm; range 7–58 mm |
Front of Tumor Growth | |
expansive | 30 (37.0%) |
infiltrative | 51 (63.0%) |
Tumor Budding | |
Absent | 12 (14.8%) |
Low grade | 14 (17.3%) |
High grade | 55 (67.9%) |
Mucinous Carcinoma | 25 (30.9%) |
Recurrence | 19 (23.5%) |
RAS Mutation | 42 (51.9%) |
2.2. MR Imaging Protocol
MR studies were performed with 2 1.5T MR tomographs: a Magnetom Symphony (Siemens, Erlangen, Germany) and Magnetom Aera (Siemens). The MRI images were acquired before and after an intravenous (IV) contrast agent (CA) injection.
In this study, a radiomics features extraction was made on volumetric interpolated breath-hold examination (VIBE) T1-weighted SPAIR with controlled respiration used to acquire images after IV CA injection with a liver-specific CA (0.1 mL/kg of Gd-EOB-BPTA—Primovist, Bayer Schering Pharma, Berlin, Germany). The VIBE T1-W sequence was acquired with 2 different flip angles (10 and 30 degrees). A power injector (Spectris Solaris® EP MR, MEDRAD Inc., Indianola, IA, USA) was used to administrate the CA at an infusion rate of 2 mL/s, as descripted in our previous studies [26,27]. Table 2 reports MR Sequence parameters.
Table 2.
Sequence | Orientation | TR/TE/FA (ms/ms/deg.) |
AT (min) |
Acquisition Matrix | ST/Gap (mm) | FS |
---|---|---|---|---|---|---|
Trufisp T2-W | Coronal | 4.30/2.15/80 | 0.46 | 512 × 512 | 4/0 | without |
HASTE T2-W | Axial | 1500/90/170 | 0.36 | 320 × 320 | 5/0 | without and with (SPAIR) |
HASTE T2w | Coronal | 1500/92/170 | 0.38 | 320 × 320 | 5/0 | without |
In-Out phase T1-W | Axial | 160/2.35/70 | 0.33 | 256 × 192 | 5/0 | without |
VIBE T1-W_FA10 |
Axial | 4.80/1.76/10 | 0.18 | 320 × 260 | 3/0 | with (SPAIR) |
VIBE T1-W_FA30 |
Axial | 4.80/1.76/30 | 0.18 | 320 × 260 | 3/0 | with (SPAIR) |
Note: W = Weighted, TR = Repetition time, TE = Echo time, FA = Flip angle, AT = Acquisition time, SPAIR = Spectral Adiabatic Inversion Recovery, VIBE = Volumetric interpolated breath hold examination, HASTE = HASTE = Half-Fourier-Acquired Single-shot Turbo spin Echo.
2.3. Image Processing
Regions of interest (ROIs) were manually drawn slice-by-slice by 2 expert radiologists with 22 and 15 years of abdominal imaging experience, respectively; first separately and then together and in accordance with each other, annotating all of the slices of the lesions. The segmentation was performed on arterial phase of VIBE T1-W images for both sequences acquired using 10 and 30 degrees of flip angle. For these reasons, we performed the analysis on 2 sequence VIBE_FA10 (VIBE T1-W images with flip angle 10°) and VIBE_FA30 (VIBE T1-W images with flip angle 30°). Manual definition of the ROIs was made using segmentation tool of 3DSlicer (https://www.slicer.org/; accessed on 21 December 2021).
2.4. MRI Post-Processing with Pyradiomics Tool
For each volume of interest, 851 radiomics features were extracted as median values using open-source PyRadiomics python package [28].
We used wavelet filtering (LLH, LHL, LHH, LLL, HLL, HLH, HHL, HHH high (H) or low (L) -pass filters along the X and Y axis and a Z-axis) to six different matrices:
First Order (FIRST ORDER): describes the individual values of voxels obtained as a result of ROI cropping. These are generally histogram-based properties (energy, entropy, kurtosis, skewness);
Shape based features both 2D and 3D measures;
Gray Level Co-occurrence Matrix (GLCM): calculates how often the same and similar pixel values come together in an image and records statistical measurements according to this matrix. These resulting values numerically characterize the texture of the image;
Gray Level Run Length Matrix (GLRLM): Defined as the number of homogeneous consecutive pixels with the same gray tone and quantifies the gray-level studies;
Gray Level Size Zone Matrix (GLSZM): Properties based on this matrix assign voxel counts according to the logic of measuring gray-level regions in an image;
Neighboring Gray Tone Difference Matrix (NGTDM): Digitization of textures obtained from filtered images and their fractal properties;
Gray Level Dependence Matrix (GLDM): Number of bound voxels at x distance from the central voxel;
The extracted features are in compliance with feature definitions as described by the Imaging Biomarker Standardization Initiative (IBSI) [29] and as reported in (https://readthedocs.org/projects/pyradiomics/downloads/; accessed on 21 December 2021).
Median values of radiomics features were considered for each segmented volume of interest.
A graphical representation of the radiomics process and of the extracted features has been reported in Figure 1. However, Radiomics involves 3D qualitative and quantitative high throughput extraction of digital imaging data that cannot be represented as an image.
Radiomics analysis was performed blinded to the clinical and pathological data in pre-surgical setting after neoadjuvant chemotherapy. No registration techniques to reduce movements artefacts were applied, however, the use of median value of extracted metrics allows one to reduce the influence of artefacts.
2.5. Statistical Analysis
Statistical analysis includes both univariate and multivariate approaches performed considering a per-lesion analysis. The statistical analyses were performed using the Statistics and Machine Toolbox of MATLAB R2021b (MathWorks, Natick, MA, USA).
2.6. Univariate Analysis
The assessment of observer variability was performed by calculating the intraclass correlation coefficient.
A non-parametric Kruskal-Wallis test was performed to identify differences statistically significant among clinical parameters and radiomics metrics of two groups (front of tumor growth: expansive versus infiltrative; tumor budding: high grade versus low grade or absent; mucinous type and presence of recurrence).
Receiver operating characteristic (ROC) analysis was performed using the Youden index to calculate the optimal cut-off for each metric and then the area under the ROC curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and accuracy.
A p value < 0.05 was considered as significant.
2.7. Multivariate Analysis
A multivariate analysis was performed in order to identify the combinations of variables which best predict the outcomes: (1) front of tumor growth: expansive versus infiltrative; (2) tumor budding: high grade versus low grade or absent; (3) mucinous type; (4) presence of recurrence.
Given the high number of textural features, a first selection of variables was made based on the results obtained from the univariate analysis: significant at nonparametric Kruskal-Wallis test and with an accuracy ≥ 75%. A linear regression modelling was used to assess the best linear combination of significant textural features for each outcome. The linear regression model was used to assess the accuracy of linear combination and ROC analysis with Youden index was used to identify the optimal cut-off value. Considering the optimal cut-off value, we reported accuracy, sensitivity, specificity, PPV and NPV.
Pattern recognition techniques including support vector machine (SVM), k-nearest neighbors (KNN), artificial neural network (NNET), and decision tree (DT) were performed to calculate the diagnostic performance considering all of the features and/or a subset of features after a feature selection approach [30]. The best model was identified calculating the highest area under ROC curve and highest accuracy. Each classifier was trained with a 10-k fold cross validation; therefore, median values of AUC, accuracy, sensitivity, and specificity were calculated. Moreover, an external validation cohort was used to validate the findings of the best classifier.
3. Results
3.1. Univariate Analysis Findings
The median value of intraclass correlation coefficients for features was 0.92 (range 0.86–0.96). The size of the lesion did not affect the extracted metrics (p-value > 0.05 at the Kruskal-Wallis test performed between the 2 groups: lesions < 2 cm and lesions ≥ 2 cm). In addition, the RAS mutational status did not affect the extracted metrics (p-value > 0.05 at the Kruskal-Wallis test performed between the groups). Therefore, considering homogeneous the two groups respect to the extracted radiomics metrics, RAS mutational was not considered for the following analysis.
There were no differences between the extracted radiomics metrics on VIBE_FA10 and on VIBE_FA30 (p-value > 0.05 at the Kruskal-Wallis test).
Significant radiomics metrics for each outcome at univariate analysis are reported in Table 3.
Table 3.
Significant Textural Features Extracted by | VIBE_FA10 Respect to the Front of Tumor Growth | VIBE_FA30 Respect to the Front of Tumor Growth | VIBE_FA10 Respect to the Tumor Budding | VIBE_FA30 Respect to the Tumor Budding | VIBE_FA10 Respect to the Mucinous Type | VIBE_FA30 Respect to the Mucinous Type | VIBE_FA10 Respect to Recurrence | VIBE_FA30 Respect to Recurrence |
---|---|---|---|---|---|---|---|---|
Wavelet_HHL_glcm_MaximumProbability | Wavelet_HLH_glcm_MaximumProbability | Wavelet_HHL_glcm_MaximumProbability | Original_glcm_InverseVariance | Wavelet_HHH_ngtdm_Busyness | Wavelet_HHL_glszm_ZoneVariance | Wavelet_LLH_glrlm_ShortRunEmphasis | Wavelet_LHL_glcm_Correlation | |
AUC | 0.66 | 0.68 | 0.70 | 0.70 | 0.65 | 0.63 | 0.48 | 0.74 |
Sensitivity | 0.92 | 0.83 | 0.94 | 0.96 | 0.42 | 0.46 | 0.31 | 0.52 |
Specificity | 0.62 | 0.82 | 0.68 | 0.65 | 0.95 | 0.96 | 1.00 | 0.97 |
PPV | 0.80 | 0.89 | 0.89 | 0.89 | 0.69 | 0.75 | 1.00 | 0.84 |
NPV | 0.82 | 0.74 | 0.81 | 0.83 | 0.86 | 0.87 | 0.84 | 0.85 |
Accuracy | 0.81 | 0.84 | 0.88 | 0.89 | 0.84 | 0.85 | 0.85 | 0.86 |
Cut-off | 0.28 | 0.28 | 0.28 | 0.35 | 1306.26 | 1,289,504.66 | 0.84 | 0.46 |
Note: GLCM, Gray Level Co-occurrence Matrix; GLSZM, Gray Level Size Zone Matrix; GLRLM, Gray Level Run Length Matrix; GLDM, Gray Level Dependence Matrix; NGTDM, Neighboring Gray Tone Difference Matrix.
Among the significant features to differentiate the front of tumor growth on VIBE_FA10, 8 textural parameters obtained an accuracy ≥ 75%. Among these 8 features, the best predictor to discriminate expansive versus infiltrative front of tumor growth was HHL_glcm_MaximumProbability with an accuracy of 81%, a sensitivity of 92%, a specificity of 62%, a PPV and a NPV of 80% and 82%, respectively.
Among the significant features to differentiate the front of tumor growth on VIBE_FA30, 15 textural parameters obtained an accuracy ≥ 75%. Among these 15 features, the best predictor to discriminate expansive versus infiltrative front of tumor growth was HLH_glcm_MaximumProbability (the same feature of previous case obtained with another wavelet filter HLH respect to HHL) with an accuracy of 84%, a sensitivity of 83%, a specificity of 82%, a PPV and a NPV of 89% and 74%, respectively.
Among the significant features to differentiate the tumor budding on VIBE_FA10, 8 textural parameters obtained an accuracy ≥ 85%. Among these 8 features, the best predictor to discriminate tumor budding was again the HHL_glcm_MaximumProbability with an accuracy of 88%, a sensitivity of 94%, a specificity of 68%, a PPV and a NPV of 89% and 81%, respectively.
Among the significant features to differentiate the tumor budding on VIBE_FA30, 16 textural parameters obtained an accuracy ≥ 85%. Among these 16 features, the best predictor to discriminate tumor budding was Inverse Variance obtained by the original GLCM matrix with an accuracy of 89%, a sensitivity of 96%, a specificity of 65%, a PPV and a NPV of 89% and 83%, respectively.
Among the significant features to differentiate the mucinous type of tumor on VIBE_FA10, 8 textural parameters obtained an accuracy ≥ 80%. Among these 8 features, the best predictor to differentiate the mucinous type of tumor was the HHH_ngtdm_Busyness with an accuracy of 84%, a sensitivity of 65%, a specificity of 42%, a PPV and a NPV of 69% and 86%, respectively.
Among the significant features to differentiate the mucinous type of tumor on VIBE_FA30, 12 textural parameters obtained an accuracy ≥ 80%. Among these 12 features, the best predictor to differentiate the mucinous type of tumor was the HHL_glszm_ZoneVariance with an accuracy of 85%, a sensitivity of 46%, a specificity of 95%, a PPV and a NPV of 71% and 87%, respectively.
Among the significant features to identify tumor recurrence on VIBE_FA10, 3 textural parameters obtained an accuracy ≥ 80%. Among these 3 features, the best predictor to identify tumor recurrence was the LLH_glrlm_ShortRunEmphasis with accuracy of 85%, a sensitivity of 31%, a specificity of 100%, a PPV and a NPV of 100% and 84%, respectively.
Among the significant features to identify tumor recurrence on VIBE_FA30, 8 textural parameters obtained an accuracy ≥ 80%. Among these 8 features, the best predictor to identify tumor recurrence was the LHL_glcm_Correlation with an accuracy of 86%, a sensitivity of 52%, a specificity of 97%, a PPV and a NPV of 84% and 85%, respectively.
In total, 26 features extracted by VIBE_FA10 were resulted significant at univariate analysis while 48 were resulted significand among those extracted on VIBE_FA30. Figure 2 shows a heat map.
3.2. Multivariate Analysis Findings
3.2.1. Linear Regression Analysis Findings
Linear regression models obtained good results in each considered classification problem (1. Front of tumor growth: expansive versus infiltrative; 2. tumor budding: high grade versus low grade or absent; 3. mucinous type; 4. presence of recurrence) with an accuracy in the range of 72 to 89% Table 4 and Table 5, Figure 3 and Figure 4. The best linear regression model was obtained in the identification of the front of tumor growth considering the height textural significant metrics by VIBE_FA10 (AUC of 72%, an accuracy of 89%; sensitivity of 93% and a specificity of 82%). The coefficients of this linear models are reported in the Table 6.
Table 4.
Linear Regression of Significant Features | AUC | Sensitivity | Specificity | PPV | NPV | Accuracy | Cut-Off |
Linear regression of the textural features extracted from the VIBE_FA10 with respect to the front of tumor growth | 0.72 | 0.93 | 0.82 | 0.90 | 0.88 | 0.89 | 1.49 |
Linear regression of the textural features extracted from the VIBE_FA10 with respect to the tumor budding | 0.78 | 0.84 | 0.84 | 0.94 | 0.65 | 0.84 | 1.54 |
Linear regression of the textural features extracted from the VIBE_FA10 with respect to the mucinous type | 0.80 | 0.85 | 0.82 | 0.56 | 0.95 | 0.83 | 0.28 |
Linear regression of the textural features extracted from the VIBE_FA10 with respect to the recurrence presence | 0.63 | 0.52 | 0.88 | 0.59 | 0.84 | 0.79 | 3.81 |
Pattern Recognition Analysis with Significant Features | Dataset | AUC | Accuracy | Sensitivity | Specificity |
Training
Time [sec] |
Model Type and Parameters |
KNN | Training set | 0.96 | 0.91 | 0.84 | 0.95 | 8.7 | Weighted KNN; number of neighbors:10; distance metric: Euclidean; distance weight: squared inverse |
Validation set | 0.97 | 0.92 | 1 | 0.86 | |||
Training set | 0.89 | 0.93 | 0.81 | 0.97 | 3.9 | ||
Validation set | 0.9 | 0.93 | 0.73 | 1 | |||
Training set | 0.93 | 0.89 | 0.94 | 0.73 | 3.2 | ||
Validation set | 0.95 | 0.88 | 0.91 | 0.8 | |||
Training set | 0.91 | 0.93 | 0.99 | 0.77 | 9.21 | ||
Validation set | 0.97 | 0.94 | 0.9 | 0.91 |
Table 5.
Linear Regression of Significant Features | AUC | Sensitivity | Specificity | PPV | NPV | Accuracy | Cut-Off |
Linear regression of the textural features extracted from the VIBE_FA30 with respect to the front of tumor growth | 0.55 | 0.88 | 0.56 | 0.77 | 0.74 | 0.76 | 8.81 |
Linear regression of the textural features extracted from the VIBE_FA30 with respect to the tumor budding | 0.65 | 0.96 | 0.64 | 0.82 | 0.91 | 0.84 | 0.56 |
Linear regression of the textural features extracted from the VIBE_FA30 with respect to the mucinous type | 0.26 | 1.00 | 0.04 | 0.64 | 1.00 | 0.64 | −0.17 |
Linear regression of the textural features extracted from the VIBE_FA30 with respect to the recurrence presence | 0.79 | 0.90 | 0.66 | 0.47 | 0.95 | 0.72 | 0.27 |
Pattern Recognition Analysis with Significant Features | Dataset | AUC | Accuracy | Sensitivity | Specificity |
Training
time [sec] |
Model Type and Parameters |
KNN | Training set | 0.96 | 0.90 | 0.91 | 0.89 | 13.4 | Weighted KNN; number of neighbors:10; distance metric: Euclidean; distance weight: squared inverse |
Validation set | 0.95 | 0.80 | 0.67 | 1 | |||
Training set | 0.94 | 0.93 | 0.84 | 0.96 | 8.3 | ||
Validation set | 0.94 | 0.89 | 0.89 | 0.89 | |||
Training set | 0.93 | 0.91 | 0.96 | 0.73 | 7.51 | ||
Validation set | 0.89 | 0.88 | 0.89 | 0.8 | |||
Training set | 0.9 | 0.94 | 0.98 | 0.84 | 8.4 | ||
Validation set | 0.85 | 0.91 | 0.94 | 0.8 |
Table 6.
Linear Regression of the Textural Features Extracted by VIBE_FA10 with Respect to the Front of Tumor Growth | Coefficients | p Value | p Value |
Intercept | −7.37 | 0.08 | 0.000 |
original_shape_SurfaceVolumeRatio | −0.85 | 0.58 | |
wavelet_LHL_glszm_SmallAreaLowGrayLevelEmphasis | 1.50 | 0.19 | |
wavelet_LLH_glcm_InverseVariance | 4.15 | 0.00 | |
wavelet_HHH_glrlm_ShortRunHighGrayLevelEmphasis | 0.14 | 0.00 | |
wavelet_HHH_glrlm_ShortRunEmphasis | 6.25 | 0.51 | |
wavelet_HHH_glrlm_RunPercentage | −6.73 | 0.57 | |
wavelet_HHH_glrlm_RunLengthNonUniformityNormalized | 5.15 | 0.40 | |
wavelet_HHL_glcm_MaximumProbability | 16.11 | 0.00 | |
Linear Regression of the Textural Features Extracted by VIBE_FA10 with Respect to the Tumor Budding | Coefficients | p value | p value |
Intercept | −17.88 | 0.00 | 0.000 |
wavelet_HLL_gldm_LargeDependenceLowGrayLevelEmphasis | 0.11 | 0.32 | |
wavelet_HLL_glrlm_LongRunLowGrayLevelEmphasis | −3.28 | 0.33 | |
wavelet_HLL_glszm_GrayLevelNonUniformityNormalized | −4.28 | 0.05 | |
wavelet_LLH_glrlm_GrayLevelNonUniformityNormalized | 2.15 | 0.07 | |
wavelet_HLH_glcm_JointEnergy | 48.41 | 0.00 | |
wavelet_HLH_firstorder_10Percentile | 0.00 | 0.96 | |
wavelet_HHH_glcm_MaximumProbability | 1.42 | 0.87 | |
wavelet_HHL_glcm_MaximumProbability | 24.94 | 0.00 | |
Linear Regression of the Textural Features Extracted by VIBE_FA10 with Respect to the Mucinous Type | Coefficients | p value | p value |
Intercept | 3.31 | 0.14 | 0.000 |
wavelet_LHL_gldm_DependenceNonUniformity | 0.00 | 0.03 | |
wavelet_LHL_ngtdm_Strength | −1.20 | 0.08 | |
wavelet_LHL_ngtdm_Busyness | 0.00 | 0.07 | |
wavelet_LHH_glcm_ClusterTendency | 7.50 | 0.00 | |
wavelet_HLH_gldm_DependenceEntropy | −0.03 | 0.97 | |
wavelet_HLH_firstorder_Mean | 0.12 | 0.59 | |
wavelet_HHH_ngtdm_Busyness | 0.00 | 0.08 | |
wavelet_HHL_gldm_DependenceEntropy | −1.44 | 0.04 | |
Linear Regression of the Textural Features Extracted by VIBE_FA10 with Respect to the Recurrence Presence | Coefficients | p value | p value |
Intercept | −2.95 | 0.05 | 0.030 |
wavelet_LLH_glrlm_ShortRunEmphasis | 8.19 | 0.04 | |
wavelet_LLH_glrlm_RunLengthNonUniformityNormalized | −5.25 | 0.10 | |
wavelet_HHH_ngtdm_Busyness | 0.00 | 0.49 | |
Linear Regression of the Textural Features Extracted by VIBE_FA30 with Respect to the Front of Tumor Growth | Coefficients | p value | p value |
Intercept | −4.868 | 0.010 | 0.000 |
original_glcm_InverseVariance | 1.484 | 0.260 | |
wavelet_HLL_gldm_GrayLevelVariance | −4.907 | 0.206 | |
wavelet_HLL_glcm_InverseVariance | 4.257 | 0.165 | |
wavelet_HLL_glcm_DifferenceVariance | −0.967 | 0.182 | |
wavelet_HLL_glcm_SumEntropy | 1.329 | 0.195 | |
wavelet_HLL_glcm_SumSquares | −0.462 | 0.540 | |
wavelet_HLL_firstorder_RobustMeanAbsoluteDeviation | 0.360 | 0.244 | |
wavelet_HLL_firstorder_MeanAbsoluteDeviation | −0.612 | 0.161 | |
wavelet_HLL_firstorder_RootMeanSquared | 0.153 | 0.273 | |
wavelet_HLL_firstorder_RootMeanSquared | 0.823 | 0.717 | |
wavelet_HLL_firstorder_Variance | 0.010 | 0.162 | |
wavelet_LHH_glrlm_ShortRunLowGrayLevelEmphasis | −0.018 | 0.944 | |
wavelet_HLH_glcm_MaximumProbability | 8.613 | 0.051 | |
wavelet_HLH_glcm_MaximumProbability | 0.903 | 0.817 | |
wavelet_LLL_gldm_SmallDependenceLowGrayLevelEmphasis | 24.740 | 0.440 | |
Linear Regression of the Textural Features Extracted by VIBE_FA30 with Respect to the Tumor Budding | Coefficients | p value | p value |
Intercept | 5.220 | 0.521 | 0.000 |
original_glcm_InverseVariance | 2.978 | 0.008 | |
wavelet_HLL_glcm_JointEnergy | −12.594 | 0.008 | |
wavelet_HLL_glcm_Idm | 114.999 | 0.000 | |
wavelet_HLL_glcm_Id | −123.518 | 0.002 | |
wavelet_HLL_firstorder_Uniformity | −18.651 | 0.011 | |
wavelet_HLL_firstorder_10Percentile | −0.005 | 0.801 | |
wavelet_HLL_glrlm_GrayLevelNonUniformityNormalized | 14.712 | 0.009 | |
wavelet_HLL_glszm_GrayLevelNonUniformityNormalized | −0.804 | 0.458 | |
wavelet_LHL_glcm_Idm | −71.494 | 0.012 | |
wavelet_LHL_glcm_Id | 79.815 | 0.014 | |
wavelet_LHH_firstorder_10Percentile | −0.003 | 0.941 | |
wavelet_LLH_firstorder_Uniformity | 10.540 | 0.002 | |
wavelet_LLH_glrlm_GrayLevelNonUniformityNormalized | −12.808 | 0.002 | |
wavelet_LLH_glszm_GrayLevelNonUniformityNormalized | 2.066 | 0.156 | |
wavelet_HHL_glcm_JointEnergy | 1.672 | 0.853 | |
wavelet_HHL_firstorder_10Percentile | 0.202 | 0.006 | |
Linear Regression of the Textural Features Extracted by VIBE_FA30 with Respect to the Mucinous Type | Coefficients | p value | p value |
Intercept | 13.293 | 0.018 | 0.000 |
original_shape_SurfaceVolumeRatio | −2.669 | 0.000 | |
wavelet_LHH_gldm_DependenceNonUniformity | 0.004 | 0.113 | |
wavelet_LHH_gldm_GrayLevelNonUniformity | 0.000 | 0.710 | |
wavelet_HLH_gldm_DependenceNonUniformity | −0.014 | 0.000 | |
wavelet_HLH_glrlm_GrayLevelNonUniformity | 0.005 | 0.003 | |
wavelet_HHH_gldm_DependenceNonUniformity | −0.002 | 0.473 | |
wavelet_HHH_glszm_ZonePercentage | 67.121 | 0.000 | |
wavelet_HHH_ngtdm_Busyness | 0.000 | 0.000 | |
wavelet_HHL_gldm_DependenceNonUniformity | 0.012 | 0.000 | |
wavelet_HHL_glrlm_GrayLevelNonUniformity | −0.005 | 0.004 | |
wavelet_HHL_glszm_ZoneVariance | 0.000 | 0.462 | |
wavelet_LLL_glcm_Idmn | −12.578 | 0.025 | |
Linear Regression of the Textural Features Extracted by VIBE_FA30 with Respect to the Recurrence Presence | Coefficients | p value | p value |
Intercept | −0.018 | 0.966 | 0.000 |
original_glszm_ZonePercentage | 0.852 | 0.540 | |
wavelet_HLL_glcm_Correlation | −0.464 | 0.684 | |
wavelet_LHL_glcm_Correlation | 5.324 | 0.001 | |
wavelet_LHL_glcm_SumEntropy | −0.243 | 0.474 | |
wavelet_LHL_glcm_Imc2 | v2.956 | 0.037 | |
wavelet_LHL_glcm_ClusterTendency | −0.014 | 0.891 | |
wavelet_HLH_glcm_Correlation | 2.266 | 0.341 | |
wavelet_HHL_glrlm_HighGrayLevelRunEmphasis | 0.033 | 0.010 |
3.2.2. Pattern Recognition Approaches Findings
Considering the significant texture metrics tested with pattern recognition approaches, the best performance for each outcome (1. Front of tumor growth: expansive versus infiltrative; 2. tumor budding: high grade versus low grade or absent; 3. mucinous type and 4. presence of recurrence) was reached by a KNN, both considering the features extracted by VIBE_FA10 and VIBE_FA30. The accuracy was always major to 88% (Table 4 and Table 5, Figure 5 and Figure 6) both on training and validation set and the best results was obtained in the identification of recurrence with the 3 textural significant features extracted by VIBE_FA10 (AUC of 91%, an accuracy of 93%; sensitivity of 99% and a specificity of 77%).
4. Discussions
Ours results confirmed the capacity of radiomics to identify as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach. In fact, the possibility to correlate radiomics parameters to RAS status offers notable advantages over qualitative imaging assessment, allowing one to tailor cancer therapy to the patient, to predict response to treatment, to distinguish favorable subsets of patients from those with poor prognosis, to select patients that may benefit of surgical treatment. Literature data underlines the role of several features, as RAS mutation, front of tumor growth, tumor budding and mucinous type as a strong prognostic and predictive biomarker in patients subjected to target therapy or surgical resection. In this scenario, our results confirmed the possibility of radiomics to allow one to tailor cancer therapy at the patient, to predict response to treatment, to detect favorable subsets of patients from those with poor prognosis and to select patients that may benefit from surgical treatment [5,6].
Our results were confirmed by external validation dataset. We obtained a good performance considering the single textural significant metric in the identification of front of tumor growth (expansive versus infiltrative) and tumor budding (high grade versus low grade or absent), in the recognition of mucinous type and in the detection of recurrences. The median value of intraclass correlation coefficients for features was 0.92.
With regard to the front of tumor growth on VIBE_FA10, the best performance was obtained with HHL_glcm_MaximumProbability with an accuracy of 81%; while on VIBE_FA30, the best performance was with HLH_glcm_MaximumProbability (the same feature of previous case obtained with another wavelet filter HLH respect to HHL) with an accuracy of 84%. Among significant features to differentiate the tumor budding on VIBE_FA10, the best predictot was again the HHL_glcm_MaximumProbability with an accuracy of 88% while on VIBE_FA30, the best performance was of the Inverse Variance extracted by the original GLCM matrix with an accuracy of 89%.
Regarding to differentiate the mucinous type of tumor on VIBE_FA10, the best predictor was the HHH_ngtdm_Busyness with an accuracy of 84% while on VIBE_FA30, the best performance was obtained by the HHL_glszm_ZoneVariance with an accuracy of 85%.
Among the significant features to identify tumor recurrence on VIBE_FA10, the best performance was obtained by the LLH_glrlm_ShortRunEmphasis with an accuracy of 85% while on VIBE_FA30, the best predictor was the LHL_glcm_Correlation with an accuracy of 86%.
Therefore, all of the significant and better predictors for each outcome except that the Inverse Variance obtained by the original GLCM matrix were Higher-order statistics features obtained by statistical methods after wavelet transform. However, all of these metrics capture certain statistical regularities of tumor lesions through images linked to the heterogeneity of gray levels on the segmented volume of interest.
Considering a linear regression models or neural network classifiers in a multivariate approach was possible to increase the performance in terms of accuracy, sensitivity, and specificity. The best linear regression model was obtained in the identification of the front of tumor growth considering the height textural significant metrics by VIBE_FA10 (AUC of 72%, an accuracy of 89%; sensitivity of 93% and a specificity of 82%) while the best results with a KNN was obtained in the identification of recurrence with the 3 textural significant features (AUC of 91%, an accuracy of 93%; sensitivity of 99% and a specificity of 77%).
Research has shown the association between entropy and prognosis [31,32,33,34,35,36,37,38,39,40]. Homogeneity in the texture of healthy liver tissue is predictive of worse survival. Andersen et al. [32] demonstrated a link between homogeneity features and overall survival (OS). Rahmim et al. [37] showed as radiomics data of heterogeneity, obtained by FDG PET study, were prognosticators of lower OS [37]. Research has shown the degree of skewness was inversely correlated with KRAS status, while the entropy was related to OS [34]. Moreover, the opportunity to identify the patients for recurrence has been shown [37,38,39,40,41]. Ravanelli et al. [39] correlated high CT uniformity and low OS and Progression Free Survival (PFS).
Radiomics and radiogenomics are emerging fields with important weaknesses that need to be taken into account. The main limit is the heterogeneity of software analysis and the variety of the metrics in different hospitals. Therefore, the segmentation of lesion may affect results [41].
The present study had several limitations: (1) the small population size considered, although the analysis was conducted on a homogeneous sample and on all individual lesions; (2) the retrospective nature of the study, (3) a manual segmentation, that, although research has supported automatic segmentation to avoid inter-observer variability, in our opinion, the manual approach is more realistic. Moreover, we did not assess the impact of the contrast administration and the different phases of contrast study (arterial, portal and transitional phase) respect to EOB-phase, data that we are evaluating in a future paper. However, we evaluated the impact of different flip angle (10 and 30). Additionally, we did not evaluate the impact of chemotherapy on our data.
5. Conclusions
Ours results confirmed the capacity of radiomics to identify, as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach. These results were confirmed by external validation dataset. We obtained a good performance considering the single textural significant metric in the identification of front of tumor growth (expansive versus infiltrative) and tumor budding (high grade versus low grade or absent), in the recognition of mucinous type and in the detection of recurrences.
Acknowledgments
The authors are grateful to Alessandra Trocino, librarian at the National Cancer Institute of Naples, Italy. Moreover, for the collaboration, authors are grateful for the research support to Paolo Pariate, Martina Totaro and Andrea Esposito of Radiology Division, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Napoli, Italy.
Author Contributions
Data curation, V.G.; Formal analysis, V.G. and R.F.; Investigation, V.G., F.D.M., C.C., S.V.S., F.D.A., A.O., G.N., R.G., V.P., V.M., M.C.B., F.T., F.I. and A.P.; Methodology, V.G., R.F., F.D.M., C.C., S.V.S., F.D.A., A.O., G.N., R.G., V.P., V.M., M.C.B., F.T., F.I. and A.P.; Writing—original draft, V.G.; Writing—review & editing, V.G. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
This study aligned with National appropriate guidelines and procedures. The National Cancer Institute of Naples (80131 Naples, Italy) Ethical Committee board approved this retrospective study.
Informed Consent Statement
This study aligned with National appropriate guidelines and procedures. Renouncing the need for informed patient consent given the study nature.
Data Availability Statement
Data and material are available at https://zenodo.org/record/6299754#.Yh-ezOjMK3A.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Granata V., Fusco R., Costa M., Picone C., Cozzi D., Moroni C., La Casella G.V., Montanino A., Monti R., Mazzoni F., et al. Preliminary Report on Computed Tomography Radiomics Features as Biomarkers to Immunotherapy Selection in Lung Adenocarcinoma Patients. Cancers. 2021;13:3992. doi: 10.3390/cancers13163992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Granata V., Fusco R., Barretta M.L., Picone C., Avallone A., Belli A., Patrone R., Ferrante M., Cozzi D., Grassi R., et al. Radiomics in hepatic metastasis by colorectal cancer. Infect. Agent Cancer. 2021;16:39. doi: 10.1186/s13027-021-00379-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Fusco R., Piccirillo A., Sansone M., Granata V., Rubulotta M.R., Petrosino T., Barretta M.L., Vallone P., Di Giacomo R., Esposito E., et al. Radiomics and Artificial Intelligence Analysis with Textural Metrics Extracted by Contrast-Enhanced Mammography in the Breast Lesions Classification. Diagnostics. 2021;11:815. doi: 10.3390/diagnostics11050815. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Fusco R., Granata V., Mazzei M.A., Meglio N.D., Roscio D.D., Moroni C., Monti R., Cappabianca C., Picone C., Neri E., et al. Quantitative imaging decision support (QIDSTM) tool consistency evaluation and radiomic analysis by means of 594 metrics in lung carcinoma on chest CT scan. Cancer Control. 2021;28:1073274820985786. doi: 10.1177/1073274820985786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Granata V., Fusco R., Avallone A., De Stefano A., Ottaiano A., Sbordone C., Brunese L., Izzo F., Petrillo A. Radiomics-Derived Data by Contrast Enhanced Magnetic Resonance in RAS Mutations Detection in Colorectal Liver Metastases. Cancers. 2021;13:453. doi: 10.3390/cancers13030453. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Granata V., Fusco R., Risi C., Ottaiano A., Avallone A., De Stefano A., Grimm R., Grassi R., Brunese L., Izzo F., et al. Diffusion-Weighted MRI and Diffusion Kurtosis Imaging to Detect RAS Mutation in Colorectal Liver Metastasis. Cancers. 2020;12:2420. doi: 10.3390/cancers12092420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Petralia G., Summers P.E., Agostini A., Ambrosini R., Cianci R., Cristel G., Calistri L., Colagrande S. Dynamic contrast-enhanced MRI in oncology: How we do it. Radiol. Med. 2020;125:1288–1300. doi: 10.1007/s11547-020-01220-z. [DOI] [PubMed] [Google Scholar]
- 8.Ria F., Samei E. Is regulatory compliance enough to ensure excellence in medicine? Radiol. Med. 2020;125:904–905. doi: 10.1007/s11547-020-01171-5. [DOI] [PubMed] [Google Scholar]
- 9.Zhang A., Song J., Ma Z., Chen T. Combined dynamic contrast-enhanced magnetic resonance imaging and diffusion-weighted imaging to predict neoadjuvant chemotherapy effect in FIGO stage IB2-IIA2 cervical cancers. Radiol. Med. 2020;125:1233–1242. doi: 10.1007/s11547-020-01214-x. [DOI] [PubMed] [Google Scholar]
- 10.Crimi F., Capelli G., Spolverato G., Bao Q.R., Florio A., Milite Rossi S., Cecchin D., Albertoni L., Campi C., Pucciarelli S., et al. MRI T2-weighted sequences-based texture analysis (TA) as a predictor of response to neoadjuvant chemo-radiotherapy (nCRT) in patients with locally advanced rectal cancer (LARC) Radiol. Med. 2020;125:1216–1224. doi: 10.1007/s11547-020-01215-w. [DOI] [PubMed] [Google Scholar]
- 11.Kirienko M., Ninatti G., Cozzi L., Voulaz E., Gennaro N., Barajon I., Ricci F., Carlo-Stella C., Zucali P., Sollini M., et al. Computed tomography (CT)-derived radiomic features differentiate prevascular mediastinum masses as thymic neoplasms versus lymphomas. Radiol. Med. 2020;125:951–960. doi: 10.1007/s11547-020-01188-w. [DOI] [PubMed] [Google Scholar]
- 12.Zhang L., Kang L., Li G., Zhang X., Ren J., Shi Z., Li J., Yu S. Computed tomography-based radiomics model for discriminating the risk stratification of gastrointestinal stromal tumors. Radiol. Med. 2020;125:465–473. doi: 10.1007/s11547-020-01138-6. [DOI] [PubMed] [Google Scholar]
- 13.Gurgitano M., Angileri S.A., Rodà G.M., Liguori A., Pandolfi M., Ierardi A.M., Wood B.J., Carrafiello G. Interventional Radiology ex-machina: Impact of Artificial Intelligence on practice. Radiol. Med. 2021;126:998–1006. doi: 10.1007/s11547-021-01351-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Scapicchio C., Gabelloni M., Barucci A., Cioni D., Saba L., Neri E. A deep look into radiomics. Radiol. Med. 2021;126:1296–1311. doi: 10.1007/s11547-021-01389-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Wei J., Jiang H., Gu D., Niu M., Fu F., Han Y., Song B., Tian J. Radiomics in liver diseases: Current progress and future opportunities. Liver Int. 2020;40:2050–2063. doi: 10.1111/liv.14555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Saini A., Breen I., Pershad Y., Naidu S., Knuttinen M.G., Alzubaidi S., Sheth R., Albadawi H., Kuo M., Oklu R. Radiogenomics and Radiomics in Liver Cancers. Diagnostics. 2018;9:4. doi: 10.3390/diagnostics9010004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.De la Pinta C., Castillo M.E., Collado M., Galindo-Pumariño C., Peña C. Radiogenomics: Hunting Down Liver Metastasis in Colorectal Cancer Patients. Cancers. 2021;13:5547. doi: 10.3390/cancers13215547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Nardone V., Reginelli A., Grassi R., Boldrini L., Vacca G., D’Ippolito E., Annunziata S., Farchione A., Belfiore M.P., Desideri I., et al. Delta radiomics: A systematic review. Radiol. Med. 2021;126:1571–1583. doi: 10.1007/s11547-021-01436-7. [DOI] [PubMed] [Google Scholar]
- 19.Brunese L., Brunese M.C., Carbone M., Ciccone V., Mercaldo F., Santone A. Automatic PI-RADS assignment by means of formal methods. Radiol. Med. 2021;127:83–89. doi: 10.1007/s11547-021-01431-y. [DOI] [PubMed] [Google Scholar]
- 20.Van der Lubbe M.F.J.A., Vaidyanathan A., de Wit M., van den Burg E.L., Postma A.A., Bruintjes T.D., Bilderbeek-Beckers M.A.L., Dammeijer P.F.M., Bossche S.V., Van Rompaey V., et al. A non-invasive, automated diagnosis of Menière’s disease using radiomics and machine learning on conventional magnetic resonance imaging: A multicentric, case-controlled feasibility study. Radiol. Med. 2021;27:72–82. doi: 10.1007/s11547-021-01425-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Granata V., Fusco R., Avallone A., Cassata A., Palaia R., Delrio P., Grassi R., Tatangelo F., Grazzini G., Izzo F., et al. Abbreviated MRI protocol for colorectal liver metastases: How the radiologist could work in pre surgical setting. PLoS ONE. 2020;15:e0241431. doi: 10.1371/journal.pone.0241431. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Granata V., Fusco R., Venanzio Setola S., Mattace Raso M., Avallone A., De Stefano A., Nasti G., Palaia R., Delrio P., Petrillo A., et al. Liver radiologic findings of chemotherapy-induced toxicity in liver colorectal metastases patients. Eur. Rev. Med. Pharmacol. Sci. 2019;23:9697–9706. doi: 10.26355/eurrev_201911_19531. [DOI] [PubMed] [Google Scholar]
- 23.Granata V., Fusco R., Maio F., Avallone A., Nasti G., Palaia R., Albino V., Grassi R., Izzo F., Petrillo A. Qualitative assessment of EOB-GD-DTPA and Gd-BT-DO3A MR contrast studies in HCC patients and colorectal liver metastases. Infect. Agent Cancer. 2019;14:40. doi: 10.1186/s13027-019-0264-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Granata V., Fusco R., de Lutio di Castelguidone E., Avallone A., Palaia R., Delrio P., Tatangelo F., Botti G., Grassi R., Izzo F., et al. Diagnostic performance of gadoxetic acid-enhanced liver MRI versus multidetector CT in the assessment of colorectal liver metastases compared to hepatic resection. BMC Gastroenterol. 2019;19:129. doi: 10.1186/s12876-019-1036-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Granata V., Fusco R., Avallone A., Catalano O., Piccirillo M., Palaia R., Nasti G., Petrillo A., Izzo F. A radiologist’s point of view in the presurgical and intraoperative setting of colorectal liver metastases. Future Oncol. 2018;14:2189–2206. doi: 10.2217/fon-2018-0080. [DOI] [PubMed] [Google Scholar]
- 26.Granata V., Fusco R., Catalano O., Avallone A., Palaia R., Botti G., Tatangelo F., Granata F., Cascella M., Izzo F., et al. Diagnostic accuracy of magnetic resonance, computed tomography and contrast enhanced ultrasound in radiological multimo-dality assessment of peribiliary liver metastases. PLoS ONE. 2017;12:e0179951. doi: 10.1371/journal.pone.0179951. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Granata V., Fusco R., Catalano O., Filice S., Amato D.M., Nasti G., Avallone A., Izzo F., Petrillo A. Early Assessment of Colorectal Cancer Patients with Liver Metastases Treated with Antiangiogenic Drugs: The Role of Intravoxel Incoherent Motion in Diffusion-Weighted Imaging. PLoS ONE. 2015;10:e0142876. doi: 10.1371/journal.pone.0142876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Van Griethuysen J.J.M., Fedorov A., Parmar C., Hosny A., Aucoin N., Narayan V., Beets-Tan R.G.H., Fillion-Robin J.C., Pieper S., Aerts H.J.W.L. Computational Radiomics System to Decode the Radiographic Phenotype. Cancer Res. 2017;77:e104–e107. doi: 10.1158/0008-5472.CAN-17-0339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Zwanenburg A., Vallières M., Abdalah M.A., Aerts H.J.W.L., Andrearczyk V., Apte A., Ashrafinia S., Bakas S., Beukinga R.J., Boellaard R., et al. The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping. Radiology. 2020;295:328–338. doi: 10.1148/radiol.2020191145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Fusco R., Sansone M., Filice S., Carone G., Amato D.M., Sansone C., Petrillo A. Pattern Recognition Approaches for Breast Cancer DCE-MRI Classification: A Systematic Review. J. Med. Biol. Eng. 2016;36:449–459. doi: 10.1007/s40846-016-0163-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Beckers R.C.J., Trebeschi S., Maas M., Schnerr R.S., Sijmons J.M.L., Beets G.L., Houwers J.B., Beets-Tan R.G.H., Lambregts D.M.J. CT texture analysis in colorectal liver metastases and the surrounding liver parenchyma and its potential as an imaging biomarker of disease aggressiveness, response and survival. Eur. J. Radiol. 2018;102:15–21. doi: 10.1016/j.ejrad.2018.02.031. [DOI] [PubMed] [Google Scholar]
- 32.Andersen I.R., Thorup K., Andersen M.B., Olesen R., Mortensen F.V., Nielsen D.T., Rasmussen F. Texture in the monitoring of regorafenib therapy in patients with colorectal liver metastases. Acta Radiol. 2019;60:1084–1093. doi: 10.1177/0284185118817940. [DOI] [PubMed] [Google Scholar]
- 33.Zhang H., Li W., Hu F., Sun Y., Hu T., Tong T. MR texture analysis: Potential imaging biomarker for predicting the chemotherapeutic response of patients with colorectal liver metastases. Abdom. Radiol. 2018;44:65–71. doi: 10.1007/s00261-018-1682-1. [DOI] [PubMed] [Google Scholar]
- 34.Lubner M.G., Stabo N., Lubner S.J., del Rio A.M., Song C., Halberg R.B., Pickhardt P.J. CT textural analysis of hepatic metastatic colorectal cancer: Pre-treatment tumor heterogeneity correlates with pathology and clinical outcomes. Abdom. Imaging. 2015;40:2331–2337. doi: 10.1007/s00261-015-0438-4. [DOI] [PubMed] [Google Scholar]
- 35.Simpson A.L., Doussot A., Creasy J.M., Adams L.B., Allen P.J., DeMatteo R.P., Gönen M., Kemeny N.E., Kingham T.P., Shia J., et al. Computed Tomography Image Texture: A Noninvasive Prognostic Marker of Hepatic Recurrence After Hepatectomy for Metastatic Colorectal Cancer. Ann. Surg. Oncol. 2017;24:2482–2490. doi: 10.1245/s10434-017-5896-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Ganeshan B., Miles K.A., Young R.C., Chatwin C.R. Hepatic Enhancement in Colorectal Cancer: Texture Analysis Correlates with Hepatic Hemodynamics and Patient Survival. Acad. Radiol. 2007;14:1520–1530. doi: 10.1016/j.acra.2007.06.028. [DOI] [PubMed] [Google Scholar]
- 37.Rahmim A., Bak-Fredslund K.P., Ashrafinia S., Lu L., Schmidtlein C., Subramaniam R.M., Morsing A., Keiding S., Horsager J., Munk O.L. Prognostic modeling for patients with colorectal liver metastases incorporating FDG PET radiomic features. Eur. J. Radiol. 2019;113:101–109. doi: 10.1016/j.ejrad.2019.02.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Dercle L., Lu L., Schwartz L.H., Qian M., Tejpar S., Eggleton P., Zhao B., Piessevaux H. Radiomics Response Signature for Identification of Metastatic Colorectal Cancer Sensitive to Therapies Targeting EGFR Pathway. J. Natl. Cancer Inst. 2020;112:902–912. doi: 10.1093/jnci/djaa017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Ravanelli M., Agazzi G.M., Tononcelli E., Roca E., Cabassa P., Baiocchi G.L., Berruti A., Maroldi R., Farina D. Texture features of colorectal liver metastases on pretreatment contrast-enhanced CT may predict response and prognosis in patients treated with bevacizumab-containing chemotherapy: A pilot study including comparison with standard chemotherapy. Radiol. Med. 2019;124:877–886. doi: 10.1007/s11547-019-01046-4. [DOI] [PubMed] [Google Scholar]
- 40.Taghavi M., Staal F.C., Simões R., Hong E.K., Lambregts D.M., van der Heide U.A., Beets-Tan R.G., Maas M. CT radiomics models are unable to predict new liver metastasis after successful thermal ablation of colorectal liver metastases. Acta Radiol. 2021;17:2841851211060437. doi: 10.1177/02841851211060437. [DOI] [PubMed] [Google Scholar]
- 41.Rizzetto F., Calderoni F., de Mattia C., Defeudis A., Giannini V., Mazzetti S., Vassallo L., Ghezzi S., Sartore-Bianchi A., Marsoni S., et al. Impact of inter-reader contouring variability on textural radiomics of colorectal liver metastases. Eur. Radiol. Exp. 2020;4:62. doi: 10.1186/s41747-020-00189-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data and material are available at https://zenodo.org/record/6299754#.Yh-ezOjMK3A.