Abstract
Hepatocellular carcinoma (HCC) is the most common form of liver cancer. Radiomics is a promising tool that may increase the value of magnetic resonance imaging (MRI) in the management of HCC. The purpose of our study is to develop an MRI-based radiomics approach to preoperatively detect HCC and predict its histological grade. Thirty-eight HCC patients at staging who underwent axial T2-weighted and dynamic contrast-enhanced MRI (DCE-MRI) were considered. Three-dimensional volumes of interest (VOIs) were manually placed on HCC lesions and normal hepatic tissue (HT) on arterial phase post-contrast images. Radiomic features from T2 images and arterial, portal and tardive post-contrast images from DCE-MRI were extracted by using Pyradiomics. Feature selection was performed using correlation filter, Wilcoxon-rank sum test and mutual information. Predictive models were constructed for HCC differentiation with respect to HT and HCC histopathologic grading used at each step an imbalance-adjusted bootstrap resampling (IABR) on 1000 samples. Promising results were obtained from radiomic prediction models, with best AUCs ranging from 71% to 96%. Radiomics MRI based on T2 and DCE-MRI revealed promising results concerning both HCC detection and grading. It may be a suitable tool for personalized treatment of HCC patients and could also be used to develop new prognostic biomarkers useful for HCC assessment without the need for invasive procedures.
Keywords: hepatocellular carcinoma, radiomics, MRI
1. Introduction
Hepatocellular carcinoma (HCC) is the most common form of liver neoplasia and is one of the most common causes of tumor deaths worldwide, accounting for 75–85% of primary liver cancers [1]. Early diagnosis and accurate staging assessment are crucial in the management of HCC, primarily to optimize the treatment and improve prognosis [2,3]. According to the degree of differentiation of cancer cells, HCC can be classified into poorly differentiated HCC, moderately differentiated HCC and well-differentiated HCC [4,5]. Previous studies have reported that the overall survival rate of patients with HCC from well- to moderately differentiated HCC was higher than that of patients with poorly differentiated HCC, and the risk of recurrence was lower [4,6]. HCC grade is usually confirmed by postoperative pathologic examination of tumor samples [7]. However, the preoperative evaluation of the HCC differentiation degree is of critical importance in view of personalized treatment options [4]. Liver biopsy is now the most common procedure to obtain information on HCC grade in the preoperative setting [8]. However, it is an invasive procedure and is susceptible to sampling errors [9,10]. Imaging plays a crucial role in HCC diagnosis and grading [2]. Currently, all major clinical practice guidelines recommend the use of multiphasic computed tomography (CT) and magnetic resonance imaging (MRI) with extracellular contrast agents as the first-line imaging modalities for HCC diagnosis and staging [11,12,13]. Although CT is largely available, rapid, and requires less expertise in performing and interpreting images than MRI, its drawbacks include radiation exposure and the relatively low contrast associated to soft tissues, that obliges to use iodinate contrast agents. Conversely, the higher soft-tissue contrast of MRI allows the evaluation of a large number of tissue properties that may be useful for HCC management [12,13,14]. In dynamic contrast-enhanced MRI (DCE-MRI), the signal intensity during the arterial, portal venous, and delayed phases reflect differences in the distribution of contrast agent between the vascular and extravascular spaces in liver tumors and parenchyma [15]. This technique is gaining importance for diagnosis and staging of HCC and is considered as the most sensitive method for detecting small HCC lesions and precancerous nodules that are considered to have a high risk for developing HCC [12,13,16]. Information from DCE-MRI can be supplemented with other MRI sequences, which can help to comprehensively assess the liver of patients at risk of HCC [17,18]. Recent studies have shown that the addition of T2-weighted imaging to DCE-MRI can improve the diagnostic performance of MRI in the detection of HCC compared to DCE-MRI alone. This could be particularly useful for small lesions (<1–2 cm) since they may show hypervascularity but not washout, thus increasing the suspicion for underlying HCC [17,19,20]. Thus far, the imaging evaluation of HCC has been mostly based on the assessment of tumor size and the subjective interpretation of qualitative descriptors, which are prone to variations [19,20]. Chang et al. [21] found that low arterial enhancement on DCE-MRI and low ADC were associated with worse histological HCC grades. An et al. [22] found that a qualitative approach based on DWI and subtracted DCE-MRI helped predict HCC grades. These studies suggest that the different pathological features between HCC and other liver lesions, as well as those between different HCC grades, could be reflected in MRI. However, pathological features are difficult to distinguish with the naked eyes. Moreover, this process is operator dependent, subjective, time-consuming, and lacking in reproducibility. In the last years, to improve image-based HCC detection and characterization, the use of quantitative image descriptors is gaining more and more popularity in the research field. This approach is called radiomics and consists of the extraction of a large number of features from the imaging data, which are supposed to contain information reflecting the underlying tissue biology [23,24,25]. In the past decade, radiomics studies for management of HCC patients have substantially increased, with most of them aiming at assessing the power of radiomic features for prediction of microvascular invasion, overall survival [26], recurrence and treatment response [27,28,29]. Recent studies aimed at reviewing the state of the art in radiomics of HCC, highlighting the main principles, clinical applications, and limitations [30,31,32,33,34]. However, what emerges from these works is that the majority of radiomic studies on HCC were based on CT, and only a few of them investigated multiparametric MRI [35,36]. In addition, there are few studies evaluating the power of MRI radiomic features in discriminating the differentiation degree of HCC [37,38,39,40]. However, linking robust radiomics features with histopathological findings could improve clinical decision making without resorting to invasive procedures. Therefore, using the publicly available LIHC cohort from The Cancer Imaging Archive (TCIA) [41,42,43], we aimed at investigating the ability of radiomic features extrapolated from preoperative T2 and DCE-MRI in both differentiating normal liver tissue from HCC and predicting HCC histological grade.
2. Materials and Methods
2.1. Study Population
A total of 237 studies of 97 patients with histopathologically proven HCC and the associated clinical data were downloaded from The Cancer Imaging Archive Liver Hepatocellular Carcinoma (TCGA/TCIA-LIHC) data collection [41,42,43]. Among these, 38 patients were selected according to the following criteria: acquisitions including both dynamic MRI with contrast medium injection and T2, patients that had not received prior treatment for their disease (ablation, chemotherapy, or radiotherapy). Exclusion criteria included: patients with artifacts on MR images, incomplete imaging data, incomplete clinical data that are functional to the study aim. Characteristics of included patients are reported in Table 1.
Table 1.
Clinical Characteristic | Value |
---|---|
Age (mean ± SD) | 57.8 ± 15.3 |
Sex (n (%)) | |
Male | 26 (68.4) |
Female | 12 (31.6) |
Risk factors (n (%)) | |
HBV | 3 (7.9) |
HBV|tobacco | 2 (5.3) |
HCV | 5 (13.2) |
HCV|tobacco | 2 (5.3) |
HCV|alcohol | 1 (2.63) |
Alcohol | 9 (23.7) |
Tobacco | 1 (2.6) |
Tobacco|BCP | 1 (2.6) |
NAFLD | 2 (5.3) |
Hemochromatosis | 1 (2.6) |
No history of RF | 10 (26.3) |
NA | 1 (2.6) |
PH 1 (n (%)) | |
Y | 9 (23.7) |
N | 29 (76.3) |
Histologic grade (n (%)) | |
G1 | 7 (18.4) |
G2 | 15 (39.5) |
G3 | 16 (42.1) |
AJCC stage 2 (n (%)) | |
I | 15 (39.5) |
II | 12 (31.6) |
III | 10 (26.3) |
IV | 1 (2.6) |
2.2. MRI Acquisition Protocol
All MRI examinations were performed using 1.5 T MRI machine (19 studies on Siemens equipment (Munich, Germany) and 18 on GE Medical Systems device (Wauwatosa, WI, USA)) with a dedicated phased-array body coil. A standard abdominal MRI protocol containing following sequences was acquired: axial fat-suppressed T2-weighted (repetition time (TR) = 4500 ms, echo time (TE) = 751 ms, slice thickness = 4 mm, matrix size = 384 × 384), a spoiled GRE 3D sequence for DCE-MRI (TR = 4.48 ms, TE = 1.632 ms, slice thickness = 3 mm, matrix size = 512 × 512).
2.3. Image Preprocessing and 3D ROIs Segmentations
Three-dimensional volumes of interest (VOIs) encompassing the HCC were manually obtained by using ITK-SNAP (version 3.6.0, http://www.itksnap.org, accessed on 29 October 2021) on the arterial phase by a radiologist with 8 years of experience. The round brush shape tool was used to segment the HCC on the axial plane, slice by slice, with the possibility to visualize the extension of lesion on the coronal and sagittal planes. VOIs were also drawn in the healthy liver tissue (HT) on the arterial phase images of the same patients. In this case, VOIs were drawn on three consecutive slices of a liver small portion, being careful to exclude the blood vessels. T2 images were all resliced on arterial phase images. During the segmentation procedure, the radiologist was blinded to all clinical information relative to the included patients. Prior to radiomic features extraction, normalization was applied on both three phases from DCE-MRI images and T2 images intensities. Specifically, the intensities were normalized by centering them at their respective mean value with standard deviation of all gray values in the original image [50,51].
2.4. Radiomic Analysis
2.4.1. Radiomic Features Extraction
The radiomic workflow of the study is summarized in Figure 1. A total of 386 radiomics features were extracted from segmented VOIs (both HCC and HT) by using the open source Python package Pyradiomics [52] (https://pyradiomics.readthedocs.io/en/latest/, accessed on 16 December 2021). The extracted radiomics features were categorized into three groups: shape features (n = 14), first-order features (n = 18) and texture features (n = 75).
First order and textural features were extracted from each MRI investigated sequence (T2 and arterial, portal, and tardive post-contrast acquisition). A detailed list of the extracted radiomics features are listed in the Supplementary Materials (Table S1). The computing algorithms can be found at www.radiomics.io (accessed on 16 December 2021), and the image biomarker standardization initiative (IBSI) presents a document to standardize the nomenclature and definition of radiomic features [53]. Refer to Supplementary Materials (Section S2) for the Pyradiomics parameter file used for feature extraction.
Five classification tasks were investigated: HCC vs. HT, G1 + G2 vs. G3, G1 vs. G2, G1 vs. G3, G2 vs. G3, with G1, G2 and G3 standing for well-, moderately and poorly differentiated HCC, respectively. Supplementary analyses were also performed to investigate the ability of T2 and DCE-MRI radiomic features in predicting AJCC stage (See Supplementary Section S6). Procedures described in the following two paragraphs are to be considered per classification task. Examples of well-differentiated, moderately differentiated and poorly differentiated HCC are shown in Figure 2, Figure 3 and Figure 4, respectively.
2.4.2. Radiomic Feature Selection
Feature selection was performed in three steps. In the first step, a correlation filter based on the absolute values of pairwise Spearman’s correlation (ρ) coefficient was used to reduce feature redundancy. Threshold for ρ was set to 0.8. Briefly, if two features had ρ > 0.8, the variable with the largest mean absolute correlation is removed. The second step involved a further feature restriction through a univariate analysis and was performed by using non-parametric Wilcoxon rank-sum test to investigate the statistical significance with respect to the outcome. For the HCC/HT classification task, step II was also performed by means of the paired Wilcoxon signed-rank test to explore the same task in a paired setting. The significantly different features were then selected. The third step consisted of ranking the remaining features based on the mutual information (MI) between the distribution of the values of a certain feature and the membership to a particular class. Features are evaluated independently, and the final feature selection occurs by aggregating the 5 top ranked ones [54,55,56]. All steps were implemented using Matlab R2020a (The MathWorks Inc., Natick, MA, USA).
2.4.3. Multivariable Prediction Models Building and Analysis
For each classification task, the reduced feature set was used to build logistic regression models of order m from 1 to 5 that would best predict the presence of HCC and its grade using an imbalanced-adjusted bootstrap resampling (IABR) approach on 1000 bootstrap samples [57] that, one by one, added to the mth model the feature that maximized the 0.632 + bootstrap area under the receiver operating characteristic curve (AUC) of the models of order m. Specifically, 1000 bootstrap samples were randomly drawn with replacement from the available dataset and used as training set. The testing set consisted of the instances not appearing in the bootstrap sample. Then, the probability of picking a positive and a negative instance in the bootstrap sample was made the same by applying the imbalance-adjustment step [58,59].
For each model order, the combination of features maximizing the 0.632+ area under the receiver operating characteristic curve (AUC) within 1000 bootstrap training and testing samples was identified. Finally, IABR on 1000 samples was performed again for all models in order to evaluate prediction performances [57,60].
Finally, for each classification task, the prediction model was obtained choosing the order that maximize the AUC and computing the final model logistic regression coefficients for the selected combination of features according to the following equation [57]:
(1) |
Equation (1) represents a multivariable model composed by a linear combination of p variables where xi is the vector of input variables (radiomic features) of the ith patient, N is the total number of patients, and β is the set of regression coefficients of the model that are calculated by means of a logistic regression model described by the following equation [57]:
(2) |
such that the conditional probability of the set of binary outcome values {0,1} given the input data xi is maximized for i = 1.
DeLong method with Bonferroni correction was applied to compare the predictive ability of the resulting logistic regression models [61].
3. Results
3.1. Radiomic Features Selection
Considering the HCC/HT classification task, step I of feature selection returned 48 radiomic features. Then, Wilcoxon rank-sum test used in step II of feature selection (unpaired setting) revealed significant results for 29 radiomic features, of which there were two shape features, eight features extracted from arterial images, four from portal images, ten from T2 images and the remaining five from tardive images (see Supplementary Table S2). In a paired setting, paired Wilcoxon signed-rank test revealed significant results for the same 29 features and five additional features: three extracted from T2 images, one from arterial images and 1 from portal images (see Supplementary Table S3). The top five features selected after the MI-based feature selection step (step III) are listed in Table 2 and were the same both considering paired and unpaired setting. For the G1 + G2/G3 classification task, the step I of feature selection returned 52 radiomic features. Then, Wilcoxon rank-sum test used in step II of feature selection revealed significant results for six radiomic features, of which there was one from arterial images, one from portal images, one from tardive images and three from portal images (see Supplementary Table S4). The top five features selected after the MI-based feature selection step (step III) are listed in Table 2. Finally, concerning the classification tasks aiming at predicting differences between G1, G2, and G3 among each other, step I and step II of feature selection returned, respectively, 49 and 6 (for G1/G2), 56 and 6 (for G1/G3) and 53 and 6 (for G2/G3) features. Refer to Supplementary Tables S5–S7 for features remaining after step II and to Table 2 for the top five features selected after the MI-based feature selection step (step III).
Table 2.
Classification Task | Top 5 Selected Features |
---|---|
HCC/HT | T2 gldm Dependence Non Uniformity Normalized |
T2 glszm Small Area Low Gray Level Emphasis | |
T2 glrlm Long Run High Gray Level Emphasis | |
ART firstorder Minimum | |
ART gldm Large Dependence Low Gray Level Emphasis | |
G1 + G2/G3 | PORT gldm Large Dependence Low Gray Level Emphasis |
ART glszm Size Zone Non Uniformity Normalized | |
PORT glcm Maximum Probability | |
PORT glszm Small Area Low Gray Level Emphasis | |
T2 glszm Low Gray Level Zone Emphasis | |
G1/G2 | PORT ngtdm Strength |
T2 gldm Low Gray Level Emphasis | |
ART firstorder 10Percentile | |
ART firstorder Skewness | |
TARD firstorder Maximum | |
G1/G3 | SHAPE Surface Volume Ratio |
T2 gldm Large Dependence High Gray Level Emphasis | |
PORT glcm Maximum Probability | |
ART glcm Cluster Shade | |
ART firstorder Skewness | |
G2/G3 | PORT gldm Large Dependence Low Gray Level Emphasis |
PORT glszm Zone Percentage | |
PORT ngtdm Complexity | |
PORT glszm Large Area Low Gray Level Emphasis | |
TARD glrlm Long Run Low Gray Level Emphasis |
3.2. Multivariable Prediction Models
Multivariable logistic regression models for the HCC/HT classification task revealed high prediction performances for any model order. However, based on Figure 5 and prediction performance metrics (Supplementary Table S8), the second order model was the simplest multivariable model with the best prediction performances was (AUC = 96%, sen = 94%, spec = 91%, and acc = 92% respectively). However, the DeLong test performed for each pair of models built for HCC/HT classification task was not significant (see Supplementary Table S13).
Concerning classification tasks for HCC grading, prediction performances were overall lower than those shown for the HCC/HT classification task. Based on Figure 5 and prediction performance metrics (Supplementary Table S9), we determined that the fourth-order model was the simplest multivariable one with the best prediction performances for G1 + G2/G3 classification task (AUC = 74%, sen = 64%, spec = 69%, acc = 67%, respectively) with respect to the first-order model and the higher-order models. For G1/G2 classification task, performances were overall higher across the five model orders in terms of AUC (90–95%), sensitivity (83–91%) and accuracy (79–88%). However, the model of order four was chosen due to a higher specificity (81%). Similar results were also obtained for models built for G1/G3 classification task, the inspection of which resulted in choosing the third-order model, due to higher performances compared with the other models (AUC = 89%, sen = 84%, spec = 76%, acc = 83%). Finally, the second-order model was chosen for G2/G3 classification task, although values of AUC, sensitivity specificity and accuracy were overall lower than those obtained for the other classification tasks (71%, 61%, 66%, 63%, respectively). Here again, the DeLong test performed for each pair of models built for grading classification tasks was not significant (see Supplementary Table S13). Prediction performances for each classification task are reported in Supplementary Tables S8–S12 and showed in Figure 5.
The computation of the multivariable model coefficients according to Equations (1) and (2) led to the following prediction models for HCC/HT, G1 + G2/G3, G1/G2, G1/G3 and G2/G3, classification tasks:
gHCC/HT(xi) = −21.4 × (T2 gldm Dependence Non Uniformity Normalized) + 7.41 × (T2 glrlm Long Run High Gray Level Emphasis) + 0.18, | (3) |
gG1+G2/G3(xi) = 0.62 × (PORT gldm Large Dependence Low Gray Level Emphasis) − 1.74 × (PORT glcm Maximum Probability) − 7.17 × (T2 glszm Low Gray Level Zone Emphasis) + 0.99 × (ART glszm Size Zone Non Uniformity Normalized) − 2.5, | (4) |
gG1/G2(xi) = −10.39 × (PORT ngtdm Strength) − 11.34 × (T2 gldm Low Gray Level Emphasis) − 8.98 × (ART firstorder 10Percentile) + 4.58 × (TARD firstorder Maximum) + 9.38, | (5) |
gG1/G3(xi) = 4.08 × (T2 gldm Large Dependence High Gray Level Emphasis) + 9.61 × (T2 gldm Large Dependence High Gray Level Emphasis) − 7.52 × (PORT glcm Maximum Probability) + 3.93, | (6) |
gG2/G3(xi) = 1.53 × (PORT ngtdm Complexity) − 1.59 × (PORT glszm Large Area Low Gray Level Emphasis) − 0.31 | (7) |
4. Discussion
In this study, we described a radiomics approach using preoperative T2 and arterial, portal, and tardive post-contrast images from DCE-MRI for detection and grading of HCC. Predictive radiomics signatures were separately built for five classification tasks, the first of which was designed to distinguish HCC from normal liver, and the remaining four to predict the aggressiveness of HCC based on the histopathological findings. Specifically, we assessed the predictive ability of radiomic features to distinguishing between well-, moderately and poorly differentiated HCC per pair. Moreover, we evaluated if radiomic features could be able to differentiate the combination of well- and moderately differentiated HCC from poorly differentiated HCC. Promising results were obtained from all five classification tasks, with best AUCs ranging from 71% to 96%. Prediction model for HCC/HT classification task showed high performances, with most relevant features arising from T2 and arterial phase of DCE-MRI, and almost all from the textural feature group. This could be related to the typical HCC dynamic enhancement pattern and hyperintensity on T2-weighted with respect to surrounding tissues and could be reflected by textural differences between HCC and normal liver parenchyma. Two features associated with GLRLM and GLDM matrices constituted the radiomic model for HCC/HT classification task. The GLRLM gave the size of homogeneous runs for each grey level and depicted intensity homogeneity in a given direction. The result might suggest that the intensity homogeneity between HT and HCC was different. Moreover, GLDM dependence non-uniformity normalized is associated with the homogeneity within the VOI and suggest that HCC and HT are different in terms of tissue homogeneity [53]. These results could be related to the discrepant microscopic features of HCC and HT. In particular, HT was more inclined to be uniform, while HCC was nonuniform due to cytological atypia and heterogeneity of cancerous cells. Although the literature is lacking in MRI radiomics studies aiming at distinguish normal hepatic tissue from HCC, textural features from both T2 and arterial phase of DCE-MRI were found to be able to characterize HCC from benign liver lesions, as well as other liver cancer types [62,63,64]. Starmans et al. [64] found that T2 radiomic features were able to predict liver tumor benignity with an AUC ranging from 0.75 to 0.92. T2 texture features were also found to be superior to qualitative diagnosis using DCE-MRI and DWI for distinguishing HCC from dysplastic nodules in study by Zhong et al. [60]. The 2D texture analysis performed by Stocker et al. [61] revealed that features from arterial phase were the most promising for distinguish HCC from benign lesions.
Only Hectors et al. investigated the power of histogram characteristics arising from multiparametric MRI in HCC and liver parenchyma. However, no textural features were investigated [65]. Moreover, Raman et al. built a textural-based radiomics model for distinguishing HCC and normal liver and found a 98.4% performance accuracy. However, the comparison with our results was not possible since this model was based on features extracted from CT. Moreover, while they evaluated normal tissue of healthy volunteers, in our study, HT regions were placed on healthy liver parenchyma of cancer patients [66].
Concerning the four classification tasks for prediction of HCC grading, performances were overall high for every selected model (AUC ranging from 71% to 95%), with features participating in model building mostly arising from second-order textural group. Higher performances were obtained from G1/G2 and G1/G3 classification tasks (best AUCs of 93% and 88%, respectively) with respect to those obtained from G1 + G2 vs. G3 and G2/G3 classification tasks, meaning that the models were better in distinguishing well-differentiated HCC from both moderately and poorly differentiated HCC than in distinguishing poorly differentiated HCC from both moderately differentiated and the well- and moderately differentiated HCC grouped together. Notably, textural features that contributed most to the prediction of HCC grade were GLCM, GLDM and GLSZM features. The GLCM is associated with pair-wise arrangement of pixels with the same gray-level and is then able to highlight local heterogeneity information. Therefore, it could be deduced that the different pathological grades might impact the gray value of the image. The GLDM and GLSZM, being associated with the homogeneity within the VOI and the size of homogeneous zone in the VOI, suggest that the intensity homogeneity between G1, G2 and G3 HCC was different [61]. On a physical basis, these results could be related to the discrepant microscopic features of G1, G2 and G3 HCC [4].
Features contributing to building models aimed at grading HCC involved not only features from arterial and T2, but also features from portal and tardive DCE-MRI phases reflecting radiological workflow where washin and washout provide valuable info to characterize and differentiate liver lesions.
These results were in line with those by Feng et al. who found that features from T2 and arterial phase were supposed to be important to predict the differentiated degree of HCC [37]. Different from our results, they did not find any relevant results relating to the association of features from portal phase with histological degree. In addition, Choi et al. found promising results from MRI texture analysis. However, different from us, they investigated textural features from T2 and only the arterial phase from DCE-MRI, but also those from apparent diffusion coefficient map [67]. Zhou et al. found that textural features from T2 and arterial phase of DCE-MRI were associated with the histological differentiation of HCC. However, they did not evaluate features arising from the portal and delayed DCE-MRI phases [38]. On the contrary, Hectors et al. found no significant association between DCE-MRI radiomics features and pathological grade [65,68]. A recent study by Yang et al. revealed that MRI-based radiomics signatures built using T1, T2 and postcontrast DCE-MR images were able to predict poorly differentiated HCC with an AUC ranging from 0.58 to 0.72 [69]. However, any information on selected features constituting the prediction models was provided, thus preventing further comparison with our results.
Although prediction models were mostly based on textural features, several first order histogram features were found to be associated with differentiation of HCC from normal liver, as well as its histopathological grading, and contributed to prediction models building. This was in line with consideration by Hectors et al. who found that histogram analysis of multiparametric MRI features was promising for non-invasive HCC characterization on the imaging, histologic and genomics levels [65]. In addition, Feng et al. found histogram-derived features arising from T2 and both arterial and portal phase from DCE-MRI. Notably, the 10th percentile of DCE-MRI arterial phase was found to be correlated with the differentiated HCC degree [37]. This feature was found to be relevant in the G1/G2 classification task also in our study.
Conversely, we found that shape features were the most inefficient since none of them contributed to building the most powerful predictive models in the explored classification tasks. This was in accordance with considerations made in previous radiomic studies, and it could be justified by changes in shape and volume depending on different stages during disease progression [37,70]. In contrast, the higher-order statistic features, specifically texture features, occupied a significant position and could provide more valuable information according to our results.
Although the HCC/HT classification task could be of lesser clinical impact than those related to HCC grading, the promising results obtained could help strengthen the power of second-order textural MRI features, which proved to be useful in different HCC management steps such as characterization, grading, prediction of survival, recurrence, and microvascular invasion [67,71,72,73].
To the best of our knowledge, this is the first radiomic study aiming at investigating the power of T2 and post-contrast images from DCE-MRI for both HCC detection and grading. To date, relative few studies have dealt with radiomic features extracted from MR images, mainly due to the difficulties in standardizing MRI acquisitions that are characterized by a huge number of acquisition parameters and variations across manufacturers [30].
Despite our encouraging results, our study suffers from several limitations. First, the patient population was too small and unbalanced to generalize results, mainly concerning the building of models for prediction of HCC grade. Only seven patients had well-differentiated HCC, and this has made the dataset used for G1/G2 and G1/G3 classification tasks unbalanced. A larger and more balanced study group is thus needed to better conduct a radiomic analysis and build more robust prediction models using part of the dataset for the training, and part for testing and validating the performance of the classifiers with external datasets [60,74,75]. However, the IABR strategy we used for model building and performance prediction is a common reliable approach in case of small and imbalanced datasets [57,59]. Another source of bias of this study was that information on contrast agent type, concentration and flow rate was not available for all patients and could affect lesion/background dynamic enhancement and signal [76,77]. Moreover, the existing lack of standardization in radiomic investigations, in terms of image acquisition, processes, segmentation methods, and radiomics analysis tools, could lead to discrepancies in radiomic feature measurements that are not due to underlying biological variations. Reproducibility of radiomic features is of key importance to clinical applications in the field of HCC. Given that different institutions use different imaging techniques and equipment, and that these differences can have a direct impact on radiomic features, efforts are needed to develop a consistent methodology for extracting and processing the features. Of note, we used Pyradiomics software [52] for feature extraction, which (i) is compliant with IBSI guidelines (which promote standardization of radiomic analysis [53,78]), (ii) allows for a reproducible extraction of radiomic features due to the parameter files that could be shared and re-used and (iii) can also be used starting from DICOM input images with the file name pointing to a DICOM Segmentation Image object, thus automatically obtaining radiomic features without any intermediate steps. This allows for a reproducible feature extraction that can be achieved under real clinical conditions that usually involve DICOM objects.
Moreover, detailed reporting and documentation of radiomics studies is essential in order to develop this emerging field in terms of clinical translation and to improve the reproducibility of study outcomes. The radiomics quality score (RQS) has been introduced to assess radiomics studies in terms of their compliance with best-practice procedures and to provide a reference guide for the drafting of manuscripts of radiomics studies [24]. Although we proceeded to report in detail all steps of radiomic workflow performed in our study, the RQS remained low, mainly due to the lack of a prospective design, the absence of a validation test, and the missing incorporation of features beyond radiomics (such as clinical and/or molecular data) within the models. This consideration is in line with results by Wakabayashi et al. who performed a quantitative review on radiomics in HCC and found that RQS of the investigated studies ranged from low to moderate, with a mean ± standard deviation of 8.35 ± 5.38 [36].
Notably, we used 3D VOIs for lesion segmentation, and this should reduce inter-reader variability by eliminating the need to select a single-slice corresponding to a portion of a lesion, as well as enable a comprehensive description of the lesion given the increased number of voxels considered for radiomic features computation [79]. However, manual segmentation of 3D ROIs is time- and labor-consuming and is prone to user variability. More accurate and automatic tumor segmentation tools are needed to improve the quality of the radiomic analysis in future works [24].
Finally, because of its higher sensitivity, better spatial resolution, and soft-tissue characterization, MRI may provide more robust texture features for tumor heterogeneity assessment than CT [80]. However, given that the image signal intensities of tissues are strongly influenced by the MR acquisition parameters and MR images are more prone to artifacts that affect the quantitative analysis of texture features; simulating the textural composition of tissues with MR images can be more complicated than with CT. As a result, MRI-based radiomics signatures may be more predictive of tumor heterogeneity than CT-based radiomics, but they may be more vulnerable to fluctuations in imaging parameters [35]. However, we normalized MRI raw images to account for the varying intensity ranges of MRI data and improve the robustness of radiomics features, as indicated by the IBSI guidelines [50,52,78,79].
Based on the obtained preliminary results, radiomics may be a suitable tool for personalized treatment of HCC patients. The non-invasive nature of this approach could complement or replace tumor biopsy and could also be used to develop new prognostic biomarkers useful for HCC detection and grading without the need for invasive procedures. However, it is difficult to translate radiomic results into clinical practice, mainly due to the missing standardization of radiomic workflow and the resulting heterogeneity among HCC radiomics studies. In the future, it will be important to perform analysis on a more consistent patient sample that will make it possible to validate models on a validation set and to test different machine learning models. Moreover, it will be important to establish reproducible and interpretable radiomic markers for diagnosis and grading of HCC and to combine radiomic data with clinical/laboratory information and other omics data such as genomic and pathomic data [81,82,83]. The integration between quantitative data at different scales (radiological, pathological, molecular) will surely improve diagnostics and molecular knowledge about HCC, and this would have direct implications in clinical decision-making process. Moreover, this could be useful for the validation of the radiomic approach in clinical practice as “virtual biopsy” and to discover genotype–phenotype correlations [84].
5. Conclusions
In conclusion, our preliminary results support the significant role of T2 and DCE-MRI radiomic features for HCC diagnosis and grading. This could provide additional information on the biological aggressiveness of HCC and could be of great clinical impact with a view to personalized options involving the most minimal invasive procedures. Further studies are required to investigate the generalizability of our models and translate our results into clinical practice. By demonstrating clinical utility and reproducibility, radiomics models can prove their potential as a clinical decision-making tool that facilitates HCC diagnosis and grading.
Acknowledgments
All results shown here are in whole or part based upon data generated by the TCGA Research Network: https://www.cancer.gov/tcga (accessed on 30 September 2021).
Supplementary Materials
The following are available online at https://www.mdpi.com/article/10.3390/diagnostics12051085/s1, Section S1. Selected features after Spearman correlation filter and Wilcoxon rank-sum test steps of feature selection. Section S2. PyRadiomics parameter file. Section S3. Selected features after Spearman correlation filter and Wilcoxon rank-sum test steps of feature selection. Section S4. Prediction performances of multivariable logistic regression models. Section S5. Results of DeLong test with Bonferroni correction. Section S6. Supplementary analysis for AJCC stage prediction.
Author Contributions
C.C. and V.B. conceived the study; C.C. and N.G. contributed to imaging data curation; V.B. and N.G. performed data processing and analysis; V.B. wrote the original draft; C.C. and M.S. reviewed and edited the manuscript and supervised the project. All authors have read and agreed to the published version of the manuscript.
Funding
This work was supported by the “Ricerca Corrente” Grant from Italian Ministry of Health (IRCCS Synlab SDN).
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of the Istituto Nazionale Tumori Fondazione G. Pascale (protocol number 1/20).
Informed Consent Statement
Not applicable.
Data Availability Statement
The datasets for this study are available from The Cancer Imaging Archive (TCIA). Link: https://wiki.cancerimagingarchive.net/display/Public/TCGA-LIHC (accessed on 30 September 2021).
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Sung H., Ferlay J., Siegel R.L., Laversanne M., Soerjomataram I., Jemal A., Bray F. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J. Clin. 2021;71:209–249. doi: 10.3322/caac.21660. [DOI] [PubMed] [Google Scholar]
- 2.Ozer Etik D., Suna N., Boyacioglu A.S. Management of Hepatocellular Carcinoma: Prevention, Surveillance, Diagnosis, and Staging. Exp. Clin. Transplant. 2017;15:31–35. doi: 10.6002/ect.TOND16.L9. [DOI] [PubMed] [Google Scholar]
- 3.Crissien A.M., Frenette C. Current Management of Hepatocellular Carcinoma. Gastroenterol. Hepatol. N. Y. 2014;10:153–161. [PMC free article] [PubMed] [Google Scholar]
- 4.Martins-Filho S.N., Paiva C., Azevedo R.S., Alves V.A.F. Histological Grading of Hepatocellular Carcinoma—A Systematic Review of Literature. Front. Med. 2017;4:193. doi: 10.3389/fmed.2017.00193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Atupelage C., Nagahashi H., Kimura F., Yamaguchi M., Tokiya A., Hashiguchi A., Sakamoto M. Computational Hepatocellular Carcinoma Tumor Grading Based on Cell Nuclei Classification. J. Med. Imaging. 2014;1:034501. doi: 10.1117/1.JMI.1.3.034501. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Sasaki K., Matsuda M., Ohkura Y., Kawamura Y., Inoue M., Hashimoto M., Ikeda K., Kumada H., Watanabe G. In Hepatocellular Carcinomas, Any Proportion of Poorly Differentiated Components Is Associated with Poor Prognosis after Hepatectomy. World J. Surg. 2014;38:1147–1153. doi: 10.1007/s00268-013-2374-1. [DOI] [PubMed] [Google Scholar]
- 7.Jin Y.-J., Cho S.G., Lee K.Y., Kim J.M., Lee J.W. Association between Relative Liver Enhancement on Gadoxetic Acid Enhanced Magnetic Resonance Images and Histologic Grade of Hepatocellular Carcinoma. Medicine. 2017;96:e7580. doi: 10.1097/MD.0000000000007580. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Pawlik T.M., Gleisner A.L., Anders R.A., Assumpcao L., Maley W., Choti M.A. Preoperative Assessment of Hepatocellular Carcinoma Tumor Grade Using Needle Biopsy: Implications for Transplant Eligibility. Ann. Surg. 2007;245:435–442. doi: 10.1097/01.sla.0000250420.73854.ad. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Silva M.A., Hegab B., Hyde C., Guo B., Buckels J.A.C., Mirza D.F. Needle Track Seeding Following Biopsy of Liver Lesions in the Diagnosis of Hepatocellular Cancer: A Systematic Review and Meta-Analysis. Gut. 2008;57:1592–1596. doi: 10.1136/gut.2008.149062. [DOI] [PubMed] [Google Scholar]
- 10.Wang L., Wang J., Zhang X., Li J., Wei X., Cheng J., Ling Q., Xie H., Zhou L., Xu X., et al. Diagnostic Value of Preoperative Needle Biopsy for Tumor Grading Assessment in Hepatocellular Carcinoma. PLoS ONE. 2015;10:e0144216. doi: 10.1371/journal.pone.0144216. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.European Association For The Study Of The Liver. European Organisation For Research And Treatment Of Cancer EASL-EORTC Clinical Practice Guidelines: Management of Hepatocellular Carcinoma. J. Hepatol. 2012;56:908–943. doi: 10.1016/j.jhep.2011.12.001. [DOI] [PubMed] [Google Scholar]
- 12.Choi J.-Y., Lee J.-M., Sirlin C.B. CT and MR Imaging Diagnosis and Staging of Hepatocellular Carcinoma: Part II. Extracellular Agents, Hepatobiliary Agents, and Ancillary Imaging Features. Radiology. 2014;273:30–50. doi: 10.1148/radiol.14132362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Choi J.-Y., Lee J.-M., Sirlin C.B. CT and MR Imaging Diagnosis and Staging of Hepatocellular Carcinoma: Part I. Development, Growth, and Spread: Key Pathologic and Imaging Aspects. Radiology. 2014;272:635–654. doi: 10.1148/radiol.14132361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Coskun M. Hepatocellular Carcinoma in the Cirrhotic Liver: Evaluation Using Computed Tomography and Magnetic Resonance Imaging. Exp. Clin. Transpl. 2017;15:36–44. doi: 10.6002/ect.TOND16.L10. [DOI] [PubMed] [Google Scholar]
- 15.Niendorf E., Spilseth B., Wang X., Taylor A. Contrast Enhanced MRI in the Diagnosis of HCC. Diagnostics. 2015;5:383–398. doi: 10.3390/diagnostics5030383. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Kobayashi S., Matsui O., Gabata T., Koda W., Minami T., Ryu Y., Kozaka K., Kitao A. Relationship between Signal Intensity on Hepatobiliary Phase of Gadolinium Ethoxybenzyl Diethylenetriaminepentaacetic Acid (Gd-EOB-DTPA)-Enhanced MR Imaging and Prognosis of Borderline Lesions of Hepatocellular Carcinoma. Eur. J. Radiol. 2012;81:3002–3009. doi: 10.1016/j.ejrad.2012.03.029. [DOI] [PubMed] [Google Scholar]
- 17.Chan M.V., Huo Y.R., Trieu N., Mitchelle A., George J., He E., Lee A.U., Chang J., Yang J. Non-Contrast MRI for Hepatocellular Carcinoma Detection: A Systematic Review and Meta-Analysis—A Potential Surveillance Tool? Clin. Gastroenterol. Hepatol. 2021;20:44–56. doi: 10.1016/j.cgh.2021.02.036. [DOI] [PubMed] [Google Scholar]
- 18.Lan H., Lin G., Zhong W. A Meta-analysis of the Added Value of Diffusion Weighted Imaging in Combination with Contrast-enhanced Magnetic Resonance Imaging for the Diagnosis of Small Hepatocellular Carcinoma Lesser or Equal to 2 Cm. Oncol. Lett. 2020;20:2739–2748. doi: 10.3892/ol.2020.11805. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Tang A., Singal A.G., Mitchell D.G., Hecht E.M., Fowler K.J., Kulik L., Parikh N.D., Kono Y., Sirlin C.B. Introduction to the Liver Imaging Reporting and Data System for Hepatocellular Carcinoma. Clin. Gastroenterol. Hepatol. 2019;17:1228–1238. doi: 10.1016/j.cgh.2018.10.014. [DOI] [PubMed] [Google Scholar]
- 20.Marks R.M., Masch W.R., Chernyak V. LI-RADS: Past, Present, and Future, From the AJR Special Series on Radiology Reporting and Data Systems. AJR Am. J. Roentgenol. 2021;216:295–304. doi: 10.2214/AJR.20.24272. [DOI] [PubMed] [Google Scholar]
- 21.Chang W.-C., Chen R.-C., Chou C.-T., Lin C.-Y., Yu C.-Y., Liu C.-H., Chou J.-M., Hsu H.-H., Huang G.-S. Histological Grade of Hepatocellular Carcinoma Correlates with Arterial Enhancement on Gadoxetic Acid-Enhanced and Diffusion-Weighted MR Images. Abdom. Imaging. 2014;39:1202–1212. doi: 10.1007/s00261-014-0168-z. [DOI] [PubMed] [Google Scholar]
- 22.An C., Park M.-S., Jeon H.-M., Kim Y.-E., Chung W.-S., Chung Y.E., Kim M.-J., Kim K.W. Prediction of the Histopathological Grade of Hepatocellular Carcinoma Using Qualitative Diffusion-Weighted, Dynamic, and Hepatobiliary Phase MRI. Eur. Radiol. 2012;22:1701–1708. doi: 10.1007/s00330-012-2421-6. [DOI] [PubMed] [Google Scholar]
- 23.Lambin P., Rios-Velazquez E., Leijenaar R., Carvalho S., van Stiphout R.G.P.M., Granton P., Zegers C.M.L., Gillies R., Boellard R., Dekker A., et al. Radiomics: Extracting More Information from Medical Images Using Advanced Feature Analysis. Eur. J. Cancer. 2012;48:441–446. doi: 10.1016/j.ejca.2011.11.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Lambin P., Leijenaar R.T.H., Deist T.M., Peerlings J., de Jong E.E.C., van Timmeren J., Sanduleanu S., Larue R.T.H.M., Even A.J.G., Jochems A., et al. Radiomics: The Bridge between Medical Imaging and Personalized Medicine. Nat. Rev. Clin. Oncol. 2017;14:749–762. doi: 10.1038/nrclinonc.2017.141. [DOI] [PubMed] [Google Scholar]
- 25.Brancato V., Aiello M., Basso L., Monti S., Palumbo L., Di Costanzo G., Salvatore M., Ragozzino A., Cavaliere C. Evaluation of a Multiparametric MRI Radiomic-Based Approach for Stratification of Equivocal PI-RADS 3 and Upgraded PI-RADS 4 Prostatic Lesions. Sci. Rep. 2021;11:643. doi: 10.1038/s41598-020-80749-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Wang X.-H., Long L.-H., Cui Y., Jia A.Y., Zhu X.-G., Wang H.-Z., Wang Z., Zhan C.-M., Wang Z.-H., Wang W.-H. MRI-Based Radiomics Model for Preoperative Prediction of 5-Year Survival in Patients with Hepatocellular Carcinoma. Br. J. Cancer. 2020;122:978–985. doi: 10.1038/s41416-019-0706-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Ji G.-W., Zhu F.-P., Xu Q., Wang K., Wu M.-Y., Tang W.-W., Li X.-C., Wang X.-H. Machine-Learning Analysis of Contrast-Enhanced CT Radiomics Predicts Recurrence of Hepatocellular Carcinoma after Resection: A Multi-Institutional Study. EBioMedicine. 2019;50:156–165. doi: 10.1016/j.ebiom.2019.10.057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Ning P., Gao F., Hai J., Wu M., Chen J., Zhu S., Wang M., Shi D. Application of CT Radiomics in Prediction of Early Recurrence in Hepatocellular Carcinoma. Abdom. Radiol. 2020;45:64–72. doi: 10.1007/s00261-019-02198-7. [DOI] [PubMed] [Google Scholar]
- 29.Kloth C., Thaiss W.M., Kärgel R., Grimmer R., Fritz J., Ioanoviciu S.D., Ketelsen D., Nikolaou K., Horger M. Evaluation of Texture Analysis Parameter for Response Prediction in Patients with Hepatocellular Carcinoma Undergoing Drug-Eluting Bead Transarterial Chemoembolization (DEB-TACE) Using Biphasic Contrast-Enhanced CT Image Data. Acad. Radiol. 2017;24:1352–1363. doi: 10.1016/j.acra.2017.05.006. [DOI] [PubMed] [Google Scholar]
- 30.Lewis S., Hectors S., Taouli B. Radiomics of Hepatocellular Carcinoma. Abdom. Radiol. 2021;46:111–123. doi: 10.1007/s00261-019-02378-5. [DOI] [PubMed] [Google Scholar]
- 31.Borhani A.A., Catania R., Velichko Y.S., Hectors S., Taouli B., Lewis S. Radiomics of Hepatocellular Carcinoma: Promising Roles in Patient Selection, Prediction, and Assessment of Treatment Response. Abdom. Radiol. 2021;46:3674–3685. doi: 10.1007/s00261-021-03085-w. [DOI] [PubMed] [Google Scholar]
- 32.Castaldo A., De Lucia D.R., Pontillo G., Gatti M., Cocozza S., Ugga L., Cuocolo R. State of the Art in Artificial Intelligence and Radiomics in Hepatocellular Carcinoma. Diagnostics. 2021;11:1194. doi: 10.3390/diagnostics11071194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Miranda Magalhaes Santos J.M., Clemente Oliveira B., Araujo-Filho J.d.A.B., Assuncao A.N., Jr., de M. Machado F.A., Carlos Tavares Rocha C., Horvat J.V., Menezes M.R., Horvat N. State-of-the-Art in Radiomics of Hepatocellular Carcinoma: A Review of Basic Principles, Applications, and Limitations. Abdom. Radiol. 2020;45:342–353. doi: 10.1007/s00261-019-02299-3. [DOI] [PubMed] [Google Scholar]
- 34.Harding-Theobald E., Louissaint J., Maraj B., Cuaresma E., Townsend W., Mendiratta-Lala M., Singal A.G., Su G.L., Lok A.S., Parikh N.D. Systematic Review: Radiomics for the Diagnosis and Prognosis of Hepatocellular Carcinoma. Aliment. Pharm. 2021;54:890–901. doi: 10.1111/apt.16563. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Masokano I.B., Liu W., Xie S., Marcellin D.F.H., Pei Y., Li W. The Application of Texture Quantification in Hepatocellular Carcinoma Using CT and MRI: A Review of Perspectives and Challenges. Cancer Imaging. 2020;20:67. doi: 10.1186/s40644-020-00341-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Wakabayashi T., Ouhmich F., Gonzalez-Cabrera C., Felli E., Saviano A., Agnus V., Savadjiev P., Baumert T.F., Pessaux P., Marescaux J., et al. Radiomics in Hepatocellular Carcinoma: A Quantitative Review. Hepatol. Int. 2019;13:546–559. doi: 10.1007/s12072-019-09973-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Feng M., Zhang M., Liu Y., Jiang N., Meng Q., Wang J., Yao Z., Gan W., Dai H. Texture Analysis of MR Images to Identify the Differentiated Degree in Hepatocellular Carcinoma: A Retrospective Study. BMC Cancer. 2020;20:611. doi: 10.1186/s12885-020-07094-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Zhou W., Zhang L., Wang K., Chen S., Wang G., Liu Z., Liang C. Malignancy Characterization of Hepatocellular Carcinomas Based on Texture Analysis of Contrast-Enhanced MR Images. J. Magn. Reson. Imaging. 2017;45:1476–1484. doi: 10.1002/jmri.25454. [DOI] [PubMed] [Google Scholar]
- 39.Geng Z., Zhang Y., Wang S., Li H., Zhang C., Yin S., Xie C., Dai Y. Radiomics Analysis of Susceptibility Weighted Imaging for Hepatocellular Carcinoma: Exploring the Correlation between Histopathology and Radiomics Features. MRMS. 2021;20:253–263. doi: 10.2463/mrms.mp.2020-0060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Shi G., Han X., Wang Q., Ding Y., Liu H., Zhang Y., Dai Y. Evaluation of Multiple Prognostic Factors of Hepatocellular Carcinoma with Intra-Voxel Incoherent Motions Imaging by Extracting the Histogram Metrics. CMAR. 2020;12:6019–6031. doi: 10.2147/CMAR.S262973. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Erickson B.J., Kirk S., Lee Y., Bathe O., Kearns M., Gerdes C., Rieger-Christ K., Lemmerman J. Radiology Data from The Cancer Genome Atlas Liver Hepatocellular Carcinoma [TCGA-LIHC] Collection. Cancer Imaging Arch. 2016 doi: 10.7937/K9/TCIA.2016.IMMQW8UQ. [DOI] [Google Scholar]
- 42.Clark K., Vendt B., Smith K., Freymann J., Kirby J., Koppel P., Moore S., Phillips S., Maffitt D., Pringle M., et al. The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository. J. Digit. Imaging. 2013;26:1045–1057. doi: 10.1007/s10278-013-9622-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.TCGA-LIHC. [(accessed on 30 September 2021)]. Available online: https://wiki.cancerimagingarchive.net/display/Public/TCGA-LIHC.
- 44.Weinreb J., Kumari S., Phillips G., Pochaczevsky R. Portal Vein Measurements by Real-Time Sonography. AJR Am. J. Roentgenol. 1982;139:497–499. doi: 10.2214/ajr.139.3.497. [DOI] [PubMed] [Google Scholar]
- 45.Pinto-Silva R.A., de Queiroz L.C., Azeredo L.M., Silva L.C.d.S., Lambertucci J.R. Ultrasound in Schistosomiasis Mansoni. Mem. Inst. Oswaldo. Cruz. 2010;105:479–484. doi: 10.1590/S0074-02762010000400021. [DOI] [PubMed] [Google Scholar]
- 46.Geleto G., Getnet W., Tewelde T. Mean Normal Portal Vein Diameter Using Sonography among Clients Coming to Radiology Department of Jimma University Hospital, Southwest Ethiopia. Ethiop. J. Health Sci. 2016;26:237–242. doi: 10.4314/ejhs.v26i3.6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Edge S.B., Compton C.C. The American Joint Committee on Cancer: The 7th Edition of the AJCC Cancer Staging Manual and the Future of TNM. Ann. Surg. Oncol. 2010;17:1471–1474. doi: 10.1245/s10434-010-0985-4. [DOI] [PubMed] [Google Scholar]
- 48.Fleming I.D. AJCC Cancer Staging Manual. American Joint Committee on Cancer; Chicago, IL, USA: 1997. [Google Scholar]
- 49.Green F., Page D., Fleming I.D., Fritz A., Balch C., Haller D., Morrow M. Others AJCC Cancer Staging Manual. Volume 6. Springer; New York, NY, USA: 2002. pp. 32–34. [Google Scholar]
- 50.Scalco E., Belfatto A., Mastropietro A., Rancati T., Avuzzi B., Messina A., Valdagni R., Rizzo G. T2w-MRI Signal Normalization Affects Radiomics Features Reproducibility. Med. Phys. 2020;47:1680–1691. doi: 10.1002/mp.14038. [DOI] [PubMed] [Google Scholar]
- 51.Duron L., Balvay D., Vande Perre S., Bouchouicha A., Savatovsky J., Sadik J.-C., Thomassin-Naggara I., Fournier L., Lecler A. Gray-Level Discretization Impacts Reproducible MRI Radiomics Texture Features. PLoS ONE. 2019;14:e0213459. doi: 10.1371/journal.pone.0213459. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Van Griethuysen J.J.M., Fedorov A., Parmar C., Hosny A., Aucoin N., Narayan V., Beets-Tan R.G.H., Fillion-Robin J.-C., Pieper S., Aerts H.J.W.L. Computational Radiomics System to Decode the Radiographic Phenotype. Cancer Res. 2017;77:e104–e107. doi: 10.1158/0008-5472.CAN-17-0339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Zwanenburg A., Vallières M., Abdalah M.A., Aerts H.J.W.L., Andrearczyk V., Apte A., Ashrafinia S., Bakas S., Beukinga R.J., Boellaard R., et al. The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-Based Phenotyping. Radiology. 2020;295:328–338. doi: 10.1148/radiol.2020191145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Vergara J.R., Estévez P.A. A Review of Feature Selection Methods Based on Mutual Information. Neural. Comput. Applic. 2014;24:175–186. doi: 10.1007/s00521-013-1368-0. [DOI] [Google Scholar]
- 55.Zaffalon M., Hutter M. Robust Feature Selection by Mutual Information Distributions. arXiv. 20140206006 [Google Scholar]
- 56.Roffo G. Feature Selection Library (MATLAB Toolbox) arXiv. 20181607.01327 [Google Scholar]
- 57.Vallières M., Freeman C.R., Skamene S.R., El Naqa I. A Radiomics Model from Joint FDG-PET and MRI Texture Features for the Prediction of Lung Metastases in Soft-Tissue Sarcomas of the Extremities. Phys. Med. Biol. 2015;60:5471–5496. doi: 10.1088/0031-9155/60/14/5471. [DOI] [PubMed] [Google Scholar]
- 58.Efron B. Bootstrap Methods: Another Look at the Jackknife. Ann. Statist. 1979;7:1–26. doi: 10.1214/aos/1176344552. [DOI] [Google Scholar]
- 59.Efron B., Tibshirani R. Improvements on Cross-Validation: The .632+ Bootstrap Method. J. Am. Stat. Assoc. 1997;92:548. doi: 10.2307/2965703. [DOI] [Google Scholar]
- 60.Sahiner B., Chan H.-P., Hadjiiski L. Classifier Performance Prediction for Computer-Aided Diagnosis Using a Limited Dataset: Classifier Performance Prediction Using a Limited Data Set. Med. Phys. 2008;35:1559–1570. doi: 10.1118/1.2868757. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.DeLong E.R., DeLong D.M., Clarke-Pearson D.L. Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach. Biometrics. 1988;44:837–845. doi: 10.2307/2531595. [DOI] [PubMed] [Google Scholar]
- 62.Zhong X., Tang H., Lu B., You J., Piao J., Yang P., Li J. Differentiation of Small Hepatocellular Carcinoma From Dysplastic Nodules in Cirrhotic Liver: Texture Analysis Based on MRI Improved Performance in Comparison Over Gadoxetic Acid-Enhanced MR and Diffusion-Weighted Imaging. Front. Oncol. 2020;9:1382. doi: 10.3389/fonc.2019.01382. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Stocker D., Marquez H.P., Wagner M.W., Raptis D.A., Clavien P.-A., Boss A., Fischer M.A., Wurnig M.C. MRI Texture Analysis for Differentiation of Malignant and Benign Hepatocellular Tumors in the Non-Cirrhotic Liver. Heliyon. 2018;4:e00987. doi: 10.1016/j.heliyon.2018.e00987. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Starmans M., Klein S., van der Voort S.R., Thomeer M.G., Miclea R.L., Niessen W.J. Classification of Malignant and Benign Liver Tumors Using a Radiomics Approach. In: Angelini E.D., Landman B.A., editors. Image Processing, Proceedings of the Medical Imaging 2018, Houston, TX, USA, 2 March 2018. SPIE; Urberin, Washington, DC, USA: 2018. p. 48. [Google Scholar]
- 65.Hectors S.J., Wagner M., Bane O., Besa C., Lewis S., Remark R., Chen N., Fiel M.I., Zhu H., Gnjatic S., et al. Quantification of Hepatocellular Carcinoma Heterogeneity with Multiparametric Magnetic Resonance Imaging. Sci. Rep. 2017;7:2452. doi: 10.1038/s41598-017-02706-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Raman S.P., Schroeder J.L., Huang P., Chen Y., Coquia S.F., Kawamoto S., Fishman E.K. Preliminary Data Using Computed Tomography Texture Analysis for the Classification of Hypervascular Liver Lesions: Generation of a Predictive Model on the Basis of Quantitative Spatial Frequency Measurements—A Work in Progress. J. Comput. Assist. Tomogr. 2015;39:383–395. doi: 10.1097/RCT.0000000000000217. [DOI] [PubMed] [Google Scholar]
- 67.Choi J.M., Yu J.-S., Cho E.-S., Kim J.H., Chung J.-J. Texture Analysis of Hepatocellular Carcinoma on Magnetic Resonance Imaging: Assessment for Performance in Predicting Histopathologic Grade. J. Comput. Assist. Tomogr. 2020;44:901–910. doi: 10.1097/RCT.0000000000001087. [DOI] [PubMed] [Google Scholar]
- 68.Hectors S.J., Lewis S., Besa C., King M.J., Said D., Putra J., Ward S., Higashi T., Thung S., Yao S., et al. MRI Radiomics Features Predict Immuno-Oncological Characteristics of Hepatocellular Carcinoma. Eur. Radiol. 2020;30:3759–3769. doi: 10.1007/s00330-020-06675-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Yang X., Yuan C., Zhang Y., Wang Z. Magnetic Resonance Radiomics Signatures for Predicting Poorly Differentiated Hepatocellular Carcinoma: A SQUIRE-Compliant Study. Medicine. 2021;100:e25838. doi: 10.1097/MD.0000000000025838. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Wu J., Liu A., Cui J., Chen A., Song Q., Xie L. Radiomics-Based Classification of Hepatocellular Carcinoma and Hepatic Haemangioma on Precontrast Magnetic Resonance Images. BMC Med. Imaging. 2019;19:23. doi: 10.1186/s12880-019-0321-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Zhang J., Liu X., Zhang H., He X., Liu Y., Zhou J., Guo D. Texture Analysis Based on Preoperative Magnetic Resonance Imaging (MRI) and Conventional MRI Features for Predicting the Early Recurrence of Single Hepatocellular Carcinoma after Hepatectomy. Acad. Radiol. 2019;26:1164–1173. doi: 10.1016/j.acra.2018.10.011. [DOI] [PubMed] [Google Scholar]
- 72.Li Z., Mao Y., Huang W., Li H., Zhu J., Li W., Li B. Texture-Based Classification of Different Single Liver Lesion Based on SPAIR T2W MRI Images. BMC Med. Imaging. 2017;17:42. doi: 10.1186/s12880-017-0212-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Zhu Y., Feng B., Wang S., Wang L., Wu J., Ma X., Zhao X. Model-based Three-dimensional Texture Analysis of Contrast-enhanced Magnetic Resonance Imaging as a Potential Tool for Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma. Oncol. Lett. 2019;18:720–732. doi: 10.3892/ol.2019.10378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Forghani R., Savadjiev P., Chatterjee A., Muthukrishnan N., Reinhold C., Forghani B. Radiomics and Artificial Intelligence for Biomarker and Prediction Model Development in Oncology. Comput. Struct. Biotechnol. J. 2019;17:995–1008. doi: 10.1016/j.csbj.2019.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Vabalas A., Gowen E., Poliakoff E., Casson A.J. Machine Learning Algorithm Validation with a Limited Sample Size. PLoS ONE. 2019;14:e0224365. doi: 10.1371/journal.pone.0224365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Norvell D. Study Types and Bias—Don’t Judge a Study by the Abstract’s Conclusion Alone. Evid. Based Spine Care J. 2010;1:7–10. doi: 10.1055/s-0028-1100908. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Tripepi G., Jager K.J., Dekker F.W., Zoccali C. Selection Bias and Information Bias in Clinical Research. Nephron. Clin. Pr. 2010;115:c94–c99. doi: 10.1159/000312871. [DOI] [PubMed] [Google Scholar]
- 78.Zwanenburg A., Leger S., Vallières M., Löck S. Initiative, for the I.B.S. Image Biomarker Standardisation Initiative. arXiv. 20161612.07003 [Google Scholar]
- 79.Parmar C., Rios Velazquez E., Leijenaar R., Jermoumi M., Carvalho S., Mak R.H., Mitra S., Shankar B.U., Kikinis R., Haibe-Kains B., et al. Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation. PLoS ONE. 2014;9:e102107. doi: 10.1371/journal.pone.0102107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Li J., Wang J., Lei L., Yuan G., He S. The Diagnostic Performance of Gadoxetic Acid Disodium-Enhanced Magnetic Resonance Imaging and Contrast-Enhanced Multi-Detector Computed Tomography in Detecting Hepatocellular Carcinoma: A Meta-Analysis of Eight Prospective Studies. Eur. Radiol. 2019;29:6519–6528. doi: 10.1007/s00330-019-06294-6. [DOI] [PubMed] [Google Scholar]
- 81.Saltz J., Almeida J., Gao Y., Sharma A., Bremer E., DiPrima T., Saltz M., Kalpathy-Cramer J., Kurc T. Towards Generation, Management, and Exploration of Combined Radiomics and Pathomics Datasets for Cancer Research. AMIA Jt. Summits Transl. Sci. Proc. 2017;2017:85–94. [PMC free article] [PubMed] [Google Scholar]
- 82.Gupta R., Kurc T., Sharma A., Almeida J.S., Saltz J. The Emergence of Pathomics. Curr. Pathobiol. Rep. 2019;7:73–84. doi: 10.1007/s40139-019-00200-x. [DOI] [Google Scholar]
- 83.Wu M., Tan H., Gao F., Hai J., Ning P., Chen J., Zhu S., Wang M., Dou S., Shi D. Predicting the Grade of Hepatocellular Carcinoma Based on Non-Contrast-Enhanced MRI Radiomics Signature. Eur. Radiol. 2019;29:2802–2811. doi: 10.1007/s00330-018-5787-2. [DOI] [PubMed] [Google Scholar]
- 84.Tselikas L., Sun R., Ammari S., Dercle L., Yevich S., Hollebecque A., Ngo-Camus M., Nicotra C., Deutsch E., Deschamps F., et al. Role of Image-Guided Biopsy and Radiomics in the Age of Precision Medicine. Chin. Clin. Oncol. 2019;8:57. doi: 10.21037/cco.2019.12.02. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets for this study are available from The Cancer Imaging Archive (TCIA). Link: https://wiki.cancerimagingarchive.net/display/Public/TCGA-LIHC (accessed on 30 September 2021).