Abstract
Objectives
The purpose of this study aimed at investigating the reliability of radiomics features extracted from contrast-enhanced CT in differentiating pancreatic cystadenomas from pancreatic neuroendocrine tumors (PNETs) using machine-learning methods.
Methods
In this study, a total number of 120 patients, including 66 pancreatic cystadenomas patients and 54 PNETs patients were enrolled. Forty-eight radiomic features were extracted from contrast-enhanced CT images using LIFEx software. Five feature selection methods were adopted to determine the appropriate features for classifiers. Then, nine machine learning classifiers were employed to build predictive models. The performance of the forty-five models was evaluated with area under the curve (AUC), accuracy, sensitivity, specificity, and F1 score in the testing group.
Results
The predictive models exhibited reliable ability of differentiating pancreatic cystadenomas from PNETs when combined with suitable selection methods. A combination of DC as the selection method and RF as the classifier, as well as Xgboost+RF, demonstrated the best discriminative ability, with the highest AUC of 0.997 in the testing group.
Conclusions
Radiomics-based machine learning methods might be a noninvasive tool to assist in differentiating pancreatic cystadenomas and PNETs.
Keywords: pancreatic cystadenomas, pancreatic neuroendocrine tumors, radiomics, machine learning, differentiation, pNETs, CT
Introduction
Pancreatic neuroendocrine tumors (PNETs), a rare group of heterogeneous tumors originated from ductal pluripotent stem cells, account for less than 5% of pancreatic neoplasms and 7% of all NETs (1–3). Its incidence has increased in recent years, reaching 0.48 per 100 000 persons per year in the United States. This increase is probably due to the improvement in modern imaging and endoscopic technologies (4). Based on the clinical manifestations, PNETs have two subtypes, functional and non-functional PNETs. The most common functional PNETs includes insulinoma, gastrinoma, and glucagonoma. However, about 2/3 of all PNETs are non-functional, making the diagnosis difficult in clinical practice (5). For localized and advanced, but resectable PNETs, surgery is the first-line therapy capable of improving the clinical outcome (6–8). Pancreatic cystadenomas including serous pancreatic cystadenomas and mucinous pancreatic cystadenomas, account for approximately 46.3% of all surgically removed pancreatic cystic tumors (9). Serous cystadenomas are rare glycogen-rich lesions, which arise from pancreatic ductal epithelium (10). But mucinous cystadenomas are cystic epithelial tumors, consisting of ovarian stromata and mucus-producing columnar epithelium (11). In clinical practice, most pancreatic cystadenoma patients are asymptomatic or manifest non-specific symptoms (12). The management of patients is different due to the biological differences of PNETs and pancreatic cystadenomas. The endoscopic ultrasound fine-needle aspiration (EUS-FNA) is considered the best approach to diagnosis pancreatic tumors, but it is invasive and not completely accurate due to the small size of samples (13, 14). Therefore, a preoperative differential diagnosis is vital to identify the most appropriate therapies and improve clinical management.
Generally, computed tomography (CT) is the most effective imaging technique for initial detection and tumor staging among pancreatic patients (15–18). Previous studies showed that CT could clearly show the tumor site and boundary, maximum diameter, cyst wall characteristics, enhancement degree and other imaging signs, which may contribute to differentiating pancreatic cystadenoma from PNETs (18–21). Radiomics is a high-throughput method to extract quantitative imaging features, which can conduct mining and analysis of image feature data in depth. The strength of radiomics is to provide an objective, repeatable, non-invasive and low-risk diagnostic tool, which helps to derive a comprehensive characterization of tumors heterogeneity. It has plenty of applications including biological feature prediction and tumor classification (14, 22, 23). According to recent studies, the radiological features extracted from CT images are helpful for differentiating pancreatic neoplasms (19, 24, 25), as well as the prediction of PNETs grading (21). For example, He et al. developed three models to differentiate non-functional PNET and pancreatic ductal adenocarcinoma (PDAC), which all showed good performance (26). The AUC of the validation cohort was 0.884 in the LASSO based model that integrated clinicoradiological features and radiomic. Another study built a radiomics model based on non-contrast MRI to predict grades of non-functional PNETs and the AUC was 0.769 in the training cohort and 0.729 in the validation cohort (27). However, there are no studies to differentiate pancreatic cystadenomas from PNETs. Therefore, we conducted this study to identify pancreatic cystadenomas and PNETs using machine learning methods based on enhanced CT image features.
Materials and Methods
Patient Selection
We retrospectively included all patient with pancreatic cystadenomas including pancreatic mucinous and serous cystadenoma or PNETs in West China hospital from January 2013 to May 2018 in this study. We initially identified 356 eligible patients according to criteria as followed: (1) pathological diagnosis of pancreatic cystadenomas or PNETs; (2) enhanced-contrast CT examination before biopsy or surgery. Then 92 of 356 patients without exact pathological evidence supporting pancreatic cystadenomas or PNETs were excluded. In addition, 144 patients lacking abdominal enhanced-contrast CT images before surgery were also excluded. Finally, we enrolled 120 qualified patients, consisting of 66 pancreatic cystadenomas patients and 54 PNETs patients. The patient selection process was illustrated in Figure 1 . All procedures conformed to the Declaration of Helsinki, as well as its later amendments.
CT Image Acquisition
All the contrast-enhanced CT images were collected from the patients before they received any treatment. A single 64-MDCT scanner (Brilliance64, Philips Medical Systems, Eindhoven, The Netherlands) were used for scanning. The tube voltage was 120 kVp, and tube current was 200 mAs. The gantry rotation time was 0.42 s, and the detector collimation was 0.75 mm. The matrix was 512×512 and beam pitch was 0.891. The slice thickness was 1.0 mm and reconstruction increment was 5.0 mm. Before the examination, patients were administrated with 1.5-2.0 mL/kg of nonionic contrast material (Omnipaque 350, GE Healthcare) intravenously at 3 mL/s. Images were obtained at 60-65 s for portal venous phase.
ROI Segmentation and Texture Extraction
All the contrast-enhanced CT images (400-bit gray scale) were obtained through searching the picture archiving and communication system (PACS). The lesion segmentation and texture analysis were acquired with a local image features extraction software (LIFEx v3.74, CEA-SHFJ, Orsay, France) (9). Briefly, the two-dimensional region of interest (ROI) was firstly obtained by drawing the outline of each tumor in the portal vein phase CT images ( Figure 2 ) and then three-dimensional ROIs were automatically generated with default setting (28, 29). In order to reduce bias in the evaluation of derived radiomic features, the whole process was performed independently by two experienced radiologists without relevant knowledge of pancreatic tumor diagnosis and a third radiologist evaluated and selected the more accurate ROIs. The ROIs included the whole tumor while avoiding vascular shadows and surrounding adipose tissue. Then the textural parameters were calculated automatically based on the ROIs by the computer software LIFEx. Forty-eight texture features were extracted, including histogram-based matrix, shape-based matrix, gray-level co-occurrence matrix (GLCM), gray-level run length matrix (GLRLM), neighborhood gray-level dependence matrix (NGLDM) and gray-level zone length matrix (GLZLM). The association among texture parameters was analyzed by Pearson correlation coefficient test.
Machine Learning Model
In this study, five feature selection methods, namely, random forest (RF), distance correlation (DC), least absolute shrinkage and selection operator (LASSO), gradient boosting decision tree (GBDT) and eXtreme gradient boosting (Xgboost) were used to analyze the texture parameters and several clinicoradiological features (gender, age, size, location of lesions and calcification of lesions). Then, discriminative models were built by nine machine learning classifiers, which covers linear discriminant analysis (LDA), RF, Adaboost, support vector machine (SVM), GaussianNB, k-nearest neighbor (KNN), GBDT, logistic regression (LR) and decision tree (DT). Patients meeting the criteria were randomly assigned to either training group or validation group. The ration of patient number in training group to validation group was 4:1. The classification models were generated from the training group and the discriminative capability of models were tested in the validation group. We performed 10-fold cross validation with 1000 repetition to guarantee the real distribution of classification. The sensitivity, specificity, accuracy and F1 score were calculated accordingly after establishing a confusion matrix. Besides, the area of receiver operating characteristic curve (AUC) was recorded to assess the discriminative ability of the classification models. The machine learning algorithm was completed by the Python programming language and sklear-Package. The whole study process was shown in Figure 3 .
Results
Patient Characteristics
In this study, a total number of 120 patients (including 66 individuals with pancreatic cystadenomas and 54 patients with PNETs) were enrolled. The median age of all patients was 50.26 (ranging from 24 to 77) in the group of pancreatic cystadenomas, and 54 (ranging from 29 to 73) in the PNETs group. Of the 66 patients with pancreatic cystadenomas, 15 (22.7%) were males and 51 (77.3%) were females. In PNETs group, there were 32 (59.3%) male and 22 (40.7%) female patients. In the patients with pancreatic cystadenomas, 40.9% of lesions were located in the pancreatic head, whereas 59.1% were in the pancreatic body-tail. Of the 54 patients with PNETs, the tumor was located in the head of pancreas in 23 patients (42.6%) and in the pancreatic body-tail in 31 patients. The average size of pancreatic cystadenomas and PNETs was 4.1 cm (range 0.8-12.0 cm) and 4.19 cm (range 1.0-12.0 cm) respectively. The summary of patient and lesion characteristics were recorded in Table 1 .
Table 1.
Characteristics | Pancreatic cystadenomas | Pancreatic neuroendocrine tumors |
---|---|---|
Number | 66 | 54 |
Mean age (range) (year) | 50.26 (24-77) | 50.48 (29-73) |
Gender | ||
Male | 15 (22.7%) | 32 (59.3%) |
Female | 51 (77.3%) | 22 (40.7%) |
Location | ||
Head | 27 (40.9%) | 23 (42.6%) |
Body or tail | 39 (59.1%) | 31 (57.4%) |
Maximum diameter (range) (cm) | 4.1 (0.8-12) | 4.19 (1-12) |
Texture Parameters Selection
Most texture parameters were uncorrelated or weakly correlated according to the result of Pearson correlation coefficient test, only a few parameters showing strong positive or negative correlation ( Figure 4 ). Different texture parameters were selected in five feature selection methods, however, no clinicoradiological feature was selected using the five feature selection methods ( Table 2 ). LASSO selected the most number of parameters, including maxValue, HISTO_Skewness, SHAPE_Sphericity, GLRLM_SRLGE, GLRLM_GLNU, GLRLM_RLNU, GLRLM_RP, GLZLM_SZE, GLZLM_LGZE, GLZLM_SZLGE, GLZLM_LZLGE, GLZLM_GLNU, GLZLM_ZLNU, GLZLM_ZP and Xgboost selected only four parameters.
Table 2.
DC | RF | LASSO | Xgboost | GBDT |
---|---|---|---|---|
meanValue | meanValue | maxValue | meanValue | HISTO_Kurtosis |
HISTO_Kurtosis | HISTO_Kurtosis | HISTO_Skewness | HISTO_Kurtosis | GLRLM_SRHGE |
GLZLM_HGZE | PARAMS_YSpatialResampling | SHAPE_Sphericity | GLRLM_HGRE | GLRLM_LRHGE |
GLZLM_SZHGE | GLRLM_HGRE | GLRLM_SRLGE | GLRLM_LRHGE | GLZLM_HGZE |
GLRLM_HGRE | GLRLM_SRHGE | GLRLM_GLNU | GLZLM_SZHGE | |
GLRLM_SRHGE | GLRLM_LRHGE | GLRLM_RLNU | ||
GLZLM_SZE | GLZLM_SZE | GLRLM_RP | ||
GLZLM_HGZE | GLZLM_SZE | |||
GLZLM_SZHGE | GLZLM_LGZE | |||
GLZLM_SZLGE | ||||
GLZLM_LZLGE | ||||
GLZLM_GLNU | ||||
GLZLM_ZLNU | ||||
GLZLM_ZP |
DC, distance correlation; RF, random forest; LASSO, least absolute shrinkage and selection operator; Xgboost, eXtreme gradient boosting; GBDT, gradient boosting decision tree; GLZLM, gray-level zone length matrix; HGZE, High Grey Level Zone Emphasis; GLRLM, Gray Level Run Length Matrix; SZHGE, Short Zone High Grey Level Emphasis; HGRE, High Gray Level Run Emphasis; SRHGE, Short-Run High Grey Level Emphasis; SZE, Short Zone Emphasis; LRHGE, Long-Run High Grey Level Emphasis; SRLGE, Short-Run Low Grey Level Emphasis; GLNU, Grey Level Non-Uniformity; RLNU, Run Length Non-Uniformity; RP, Run Percentage; LGZE, Low Gray Level Zone Emphasis; SZLGE, Short Zone Low Grey Level Emphasis; LZLGE, Long Zone Low Grey Level Emphasis; ZP, Zone Percentage.
Machine-Learning Model Evaluation
Through a random combination of five feature selection methods and nine machine-learning classifiers, we acquired a total of forty-five predictive models for distinguishing pancreatic cystadenomas from PNETs. The AUC, accuracy, sensitivity, specificity and F1 score of all models in the testing group were shown in Table 3 . The result revealed that radiomics-based machine learning models were able to differentiate pancreatic cystadenoma from PNETs, with AUC more than 0.743 in the validation cohort ( Figure 5 ). It is noteworthy that the combination of DC as the selection method and RF as the classifier, as well as Xgboost+RF, demonstrated the best discriminative ability, with the highest AUC of 0.997 in the testing group. The receiver operating characteristic (ROC) curves of 10 fold for DC+RF and Xgboost+RF in the testing group were shown in Figure 6 . For the model (DC+RF) in the testing group, the accuracy, sensitivity, specificity and F1 score were 0.983, 0.980, 0.986 and 0.980, respectively. The mean AUC for DC+RF was 0.9977 (Std= 0.0024; 95% CI, 0.9976 to 0.9979) after 1000 repetition. As for the model of Xgboost+RF, the accuracy, sensitivity, specificity and F1 score were 0.992, 0.980, 1.000 and 0.989 respectively in the validation group and the mean AUC was 0.9962 (Std=0.0033; 95% CI, 0.9960 to 0.9964) after 1000 repetition.
Table 3.
DC | RF | LASSO | Xgboost | GBDT | |||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
AUC | Accuracy | Sensitivity | Specificity | F1-score | AUC | Accuracy | Sensitivity | Specificity | F1-score | AUC | Accuracy | Sensitivity | Specificity | F1-score | AUC | Accuracy | Sensitivity | Specificity | F1-score | AUC | Accuracy | Sensitivity | Specificity | F1-score | |
LDA | 0.907 | 0.858 | 0.797 | 0.912 | 0.832 | 0.915 | 0.917 | 0.847 | 0.971 | 0.890 | 0.901 | 0.867 | 0.763 | 0.955 | 0.832 | 0.947 | 0.917 | 0.817 | 1.000 | 0.894 | 0.918 | 0.875 | 0.810 | 0.929 | 0.850 |
SVM | 0.853 | 0.700 | 0.633 | 0.757 | 0.653 | 0.972 | 0.725 | 0.430 | 0.971 | 0.542 | 0.777 | 0.642 | 0.267 | 0.957 | 0.365 | 0.946 | 0.833 | 0.650 | 0.986 | 0.764 | 0.966 | 0.908 | 0.817 | 0.986 | 0.886 |
RF | 0.997 | 0.983 | 0.980 | 0.986 | 0.980 | 0.994 | 0.975 | 0.960 | 0.986 | 0.969 | 0.975 | 0.950 | 0.947 | 0.952 | 0.948 | 0.997 | 0.992 | 0.980 | 1.000 | 0.989 | 0.989 | 0.992 | 0.980 | 1.000 | 0.989 |
Adaboost | 0.990 | 0.967 | 0.960 | 0.967 | 0.961 | 0.990 | 0.967 | 0.960 | 0.967 | 0.961 | 0.976 | 0.975 | 1.000 | 0.952 | 0.977 | 0.990 | 0.975 | 0.940 | 1.000 | 0.964 | 0.990 | 0.975 | 0.943 | 1.000 | 0.966 |
KNN | 0.959 | 0.925 | 0.870 | 0.971 | 0.908 | 0.983 | 0.967 | 0.967 | 0.971 | 0.964 | 0.760 | 0.675 | 0.647 | 0.700 | 0.634 | 0.932 | 0.925 | 0.890 | 0.957 | 0.912 | 0.969 | 0.975 | 0.940 | 1.000 | 0.967 |
GaussianNB | 0.973 | 0.942 | 0.893 | 0.986 | 0.928 | 0.973 | 0.775 | 0.523 | 0.986 | 0.654 | 0.986 | 0.975 | 0.963 | 0.986 | 0.971 | 0.926 | 0.633 | 0.223 | 0.971 | 0.292 | 0.926 | 0.608 | 0.167 | 0.971 | 0.209 |
LR | 0.862 | 0.692 | 0.613 | 0.757 | 0.633 | 0.946 | 0.708 | 0.393 | 0.971 | 0.492 | 0.743 | 0.675 | 0.360 | 0.940 | 0.458 | 0.935 | 0.708 | 0.377 | 0.986 | 0.502 | 0.909 | 0.625 | 0.170 | 1.000 | 0.276 |
GBDT | 0.989 | 0.975 | 0.980 | 0.969 | 0.972 | 0.979 | 0.983 | 0.980 | 0.986 | 0.980 | 0.976 | 0.975 | 1.000 | 0.952 | 0.977 | 0.993 | 0.983 | 0.980 | 0.986 | 0.980 | 0.983 | 0.983 | 0.980 | 0.983 | 0.981 |
DT | 0.975 | 0.975 | 0.980 | 0.969 | 0.972 | 0.983 | 0.983 | 0.980 | 0.986 | 0.980 | 0.976 | 0.975 | 1.000 | 0.952 | 0.977 | 0.990 | 0.992 | 0.980 | 1.000 | 0.989 | 0.982 | 0.983 | 0.980 | 0.983 | 0.981 |
DC, distance correlation; RF, random forest; LASSO, least absolute shrinkage and selection operator; Xgboost, eXtreme gradient boosting; GBDT, gradient boosting decision tree; LDA, linear discriminant analysis; SVM, support vector machine; KNN, k-nearest neighbor; LR, logistic regression; DT, decision tree; AUC, area under curve.
Discussion
Contrast‐enhanced CT and MRI are widely used for identification of pancreatic neoplasms, which is not sufficiently specific due to the overlapping of anatomical imaging features between different pancreatic tumors (30). Furthermore, PNETs identification is to exploit somatostatin analog radiotracers for CT and MRI imaging, which is easily affected by intra-/inter-observer variability (31). The accuracy for manual identification of tumor lesions is only 60%-70%, even by highly-trained radiologists (32). To date, EUS-FNA is considered the best approach to diagnosis pancreatic tumors based on cytopathologic features. However, it is invasive with the possibility for puncture failure, as well as unable to reflect tumor heterogeneity accurately due to the small size and limited number of samples (14, 33).
Radiomics combine quantitative image analysis with machine learning or artificial intelligence methods to select out and classify target features in the sample images. It has been applied in modern medical care including diagnosis, risk stratification, virtual biopsy and radiogenomics (34). Several studies have investigated the utility of machine learning based-radiomics on the differentiation of pancreatic mucinous cystadenomas from pancreatic serous cystadenomas (35, 36) and the prediction of PNETs grading (13, 21, 37–39). However, no studies reported how to differentiate pancreatic cystadenomas from PNETs. Given the similar incidence, nonspecific symptoms and various biological behaviors of pancreatic cystadenomas and PNETs, we conducted this study by combining radiomics and machine learning method to distinguish these two types of pancreatic lesions. This is the first study that utilized enhanced CT images features and machine learning methods to differentiate pancreatic cystadenomas from PNETs so far.
Different radiomic features were obtained from preoperative contrast-enhanced CT images. Then the establishment of predictive models were based on five feature-selection methods and nine machine-learning classifiers. Our results proved that the combination of predictive models and appropriate selection methods could differentiate pancreatic cystadenomas from PNETs, with AUC more than 0.743 in the validation cohort. Notably, the combination of DC as the selection method and RF as the classifier, as well as Xgboost+RF, seemed to be optimal in differentiating the two types of pancreatic lesions, with the highest AUC of 0.997 in the testing group. For the model (DC+RF) in the testing group, the accuracy, sensitivity, specificity and F1 score were 0.983, 0.980, 0.986 and 0.980, respectively. In addition, the accuracy, sensitivity, specificity and F1 score were 0.992, 0.980, 1.000 and 0.989 respectively in the validation group for the model of Xgboost+RF. RF classifier is an excellent classification algorithm that has been widely used in many studies (40–42). Previous studies have investigated the diagnostic performance of PNETs from PDACs based on CT features and texture analysis. Yu et al. used LASSO and univariate logistic regression (ULR) analyses to select CT radiomic features and generated four multivariate logistic regression (MLR) models. The highest AUC was 0.926 in the model built with CT radiomic features extracted from portal venous phase (43). Another study developed a MLR model to discriminate PNETs from solid pseudopapillary tumors (SPTs) (44). The model incorporating MRI radiomics features and sex and age of patients exhibited the best discriminative ability with AUC of 0.97 and 0.86 in the training and validation cohort separately. Compared with previous studies, we developed more predictive models by employing more selection methods and classifiers to identify the best model.
However, our study existed several limitations. First of all, this study was conducted in a retrospective fashion, which had unavoidable selection bias. Second, it was a single-center study with a small group of patients. Multicenter studies with more patients would be helpful to confirm these findings. Third, there was subjectivity when manually defining the tumor boundary on CT images.
Conclusion
This study concluded that radiomics-based machine learning method was able to preoperatively differentiate pancreatic cystadenomas from PNETs, which may guide clinical decision-making for better treatment. The feature selection method DC or Xgboost and classifier RF showed a good prospect in discriminating pancreatic cystadenomas from PNETs. However, more large-scale multicenter studies are required to supplement more evidence concerning the feasibility of this method in clinical practice.
Data Availability Statement
The dataset generated for this study can be obtained from the correspondence author.
Ethics Statement
The studies involving human participants were reviewed and approved by The Ethics Administration Office of the West China Hospital, Sichuan University. Written informed consent to participate in this study was provided by the participants’ legal guardian/next of kin.
Author Contributions
XH and JY collected images, extracted features, performed statistical analysis and drafted the manuscript. JL collected image data and extracted texture feature. PC and ZZ collected image data and drafted the manuscript. AA and YX revised the manuscript. XM participated in study conception and manuscript revision. All authors contributed to the article and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
- 1. Lewis RB, Lattin GE, Jr, Paal E. Pancreatic Endocrine Tumors: Radiologic-Clinicopathologic Correlation. Radiographics (2010) 30(6):1445–64. 10.1148/rg.306105523 [DOI] [PubMed] [Google Scholar]
- 2. Öberg K, Knigge U, Kwekkeboom D, Perren A. Neuroendocrine Gastro-Entero-Pancreatic Tumors: ESMO Clinical Practice Guidelines for Diagnosis, Treatment and Follow-Up. Ann Oncol (2012) 23 Suppl 7:vii124–30. 10.1093/annonc/mds295 [DOI] [PubMed] [Google Scholar]
- 3. Lawrence B, Gustafsson BI, Chan A, Svejda B, Kidd M, Modlin IM. The Epidemiology of Gastroenteropancreatic Neuroendocrine Tumors. Endocrinol Metab Clin North Am (2011) 40(1):1–18, vii. 10.1016/j.ecl.2010.12.005 [DOI] [PubMed] [Google Scholar]
- 4. Dasari A, Shen C, Halperin D, Zhao B, Zhou S, Xu Y, et al. Trends in the Incidence, Prevalence, and Survival Outcomes in Patients With Neuroendocrine Tumors in the United States. JAMA Oncol (2017) 3(10):1335–42. 10.1001/jamaoncol.2017.0589 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Dumlu EG, Karakoç D, Özdemir A. Nonfunctional Pancreatic Neuroendocrine Tumors: Advances in Diagnosis, Management, and Controversies. Int Surg (2015) 100(6):1089–97. 10.9738/INTSURG-D-14-00204.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Falconi M, Bartsch DK, Eriksson B, Klöppel G, Lopes JM, O'Connor JM, et al. Enets Consensus Guidelines for the Management of Patients With Digestive Neuroendocrine Neoplasms of the Digestive System: Well-Differentiated Pancreatic non-Functioning Tumors. Neuroendocrinology (2012) 95(2):120–34. 10.1159/000335587 [DOI] [PubMed] [Google Scholar]
- 7. Hill JS, McPhee JT, McDade TP, Zhou Z, Sullivan ME, Whalen GF, et al. Pancreatic Neuroendocrine Tumors: The Impact of Surgical Resection on Survival. Cancer (2009) 115(4):741–51. 10.1002/cncr.24065 [DOI] [PubMed] [Google Scholar]
- 8. Falconi M, Eriksson B, Kaltsas G, Bartsch DK, Capdevila J, Caplin M, et al. Enets Consensus Guidelines Update for the Management of Patients With Functional Pancreatic Neuroendocrine Tumors and Non-Functional Pancreatic Neuroendocrine Tumors. Neuroendocrinology (2016) 103(2):153–71. 10.1159/000443171 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Nioche C, Orlhac F, Boughdad S, Reuzé S, Goya-Outi J, Robert C, et al. Lifex: A Freeware for Radiomic Feature Calculation in Multimodality Imaging to Accelerate Advances in the Characterization of Tumor Heterogeneity. Cancer Res (2018) 78(16):4786–9. 10.1158/0008-5472.CAN-18-0125 [DOI] [PubMed] [Google Scholar]
- 10. Valsangkar NP, Morales-Oyarvide V, Thayer SP, Ferrone CR, Wargo JA, Warshaw AL, et al. 851 Resected Cystic Tumors of the Pancreas: A 33-Year Experience at the Massachusetts General Hospital. Surgery (2012) 152(3 Suppl 1):S4–12. 10.1016/j.surg.2012.05.033 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Zhao ZM, Jiang N, Gao YX, Yin ZZ, Zhao GD, Tan XL, et al. Clinical Diagnosis and Management of Pancreatic Mucinous Cystadenoma and Cystadenocarcinoma: Single-center Experience With 82 Patients. World J Gastrointest Oncol (2020) 12(6):642–50. 10.4251/wjgo.v12.i6.642 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Bai XL, Zhang Q, Masood N, Masood W, Zhang Y, Liang TB. Pancreatic Cystic Neoplasms: A Review of Preoperative Diagnosis and Management. J Zhejiang Univ Sci B (2013) 14(3):185–94. 10.1631/jzus.B1200283 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Zhao Z, Bian Y, Jiang H, Fang X, Li J, Cao K, et al. Ct-Radiomic Approach to Predict G1/2 Nonfunctional Pancreatic Neuroendocrine Tumor. Acad Radiol (2020) 27(12):e272–81. 10.1016/j.acra.2020.01.002 [DOI] [PubMed] [Google Scholar]
- 14. Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More Than Pictures, They Are Data. Radiology (2016) 278(2):563–77. 10.1148/radiol.2015151169 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Del Frate C, Zanardi R, Mortele K, Ros PR. Advances in Imaging for Pancreatic Disease. Curr Gastroenterol Rep (2002) 4(2):140–8. 10.1007/s11894-002-0051-x [DOI] [PubMed] [Google Scholar]
- 16. Hasan A, Visrodia K, Farrell JJ, Gonda TA. Overview and Comparison of Guidelines for Management of Pancreatic Cystic Neoplasms. World J Gastroenterol (2019) 25(31):4405–13. 10.3748/wjg.v25.i31.4405 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Yuan D, Yu W, Ren XB, Pan WD, Zhang LH. Characterization and Diagnostic Accuracy of Serous Cystadenomas and Mucinous Neoplasms of the Pancreas With Multi-Slice Helical Computed Tomography. Zhongguo Yi Xue Ke Xue Yuan Xue Bao (2007) 29(2):232–7. [PubMed] [Google Scholar]
- 18. Al-Hawary M. Role of Imaging in Diagnosing and Staging Pancreatic Cancer. J Natl Compr Canc Netw (2016) 14(5 Suppl):678–80. 10.6004/jnccn.2016.0191 [DOI] [PubMed] [Google Scholar]
- 19. Guo C, Zhuge X, Wang Q, Xiao W, Wang Z, Wang Z, et al. The Differentiation of Pancreatic Neuroendocrine Carcinoma From Pancreatic Ductal Adenocarcinoma: The Values of CT Imaging Features and Texture Analysis. Cancer Imaging (2018) 18(1):37. 10.1186/s40644-018-0170-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Canellas R, Burk KS, Parakh A, Sahani DV. Prediction of Pancreatic Neuroendocrine Tumor Grade Based on CT Features and Texture Analysis. AJR Am J Roentgenol (2018) 210(2):341–6. 10.2214/AJR.17.18417 [DOI] [PubMed] [Google Scholar]
- 21. Gu D, Hu Y, Ding H, Wei J, Chen K, Liu H, et al. CT Radiomics may Predict the Grade of Pancreatic Neuroendocrine Tumors: A Multicenter Study. Eur Radiol (2019) 29(12):6880–90. 10.1007/s00330-019-06176-x [DOI] [PubMed] [Google Scholar]
- 22. Meng X, Xia W, Xie P, Zhang R, Li W, Wang M, et al. Preoperative Radiomic Signature Based on Multiparametric Magnetic Resonance Imaging for Noninvasive Evaluation of Biological Characteristics in Rectal Cancer. Eur Radiol (2019) 29(6):3200–9. 10.1007/s00330-018-5763-x [DOI] [PubMed] [Google Scholar]
- 23. Zhang Q, Xiao Y, Suo J, Shi J, Yu J, Guo Y, et al. Sonoelastomics for Breast Tumor Classification: A Radiomics Approach With Clustering-Based Feature Selection on Sonoelastography. Ultrasound Med Biol (2017) 43(5):1058–69. 10.1016/j.ultrasmedbio.2016.12.016 [DOI] [PubMed] [Google Scholar]
- 24. Reinert CP, Baumgartner K, Hepp T, Bitzer M, Horger M. Complementary Role of Computed Tomography Texture Analysis for Differentiation of Pancreatic Ductal Adenocarcinoma From Pancreatic Neuroendocrine Tumors in the Portal-Venous Enhancement Phase. Abdom Radiol (NY) (2020) 45(3):750–8. 10.1007/s00261-020-02406-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Lin X, Xu L, Wu A. Differentiation of Intrapancreatic Accessory Spleen From Small Hypervascular Neuroendocrine Tumor of the Pancreas: Textural Analysis on Contrast-Enhanced Computed Tomography. Acta Radiol (2019) 60: (5):553–60. 10.1177/0284185118788895 [DOI] [PubMed] [Google Scholar]
- 26. He M, Liu Z, Lin Y, Wan J, Li J, Xu K, et al. Differentiation of Atypical non-Functional Pancreatic Neuroendocrine Tumor and Pancreatic Ductal Adenocarcinoma Using CT Based Radiomics. Eur J Radiol (2019) 117:102–11. 10.1016/j.ejrad.2019.05.024 [DOI] [PubMed] [Google Scholar]
- 27. Bian Y, Zhao Z, Jiang H, Fang X, Li J, Cao K, et al. Noncontrast Radiomics Approach for Predicting Grades of Nonfunctional Pancreatic Neuroendocrine Tumors. J Magn Reson Imaging (2020) 52(4):1124–36. 10.1002/jmri.27176 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Nardone V, Tini P, Pastina P, Botta C, Reginelli A, Carbone SF, et al. Radiomics Predicts Survival of Patients With Advanced non-Small Cell Lung Cancer Undergoing PD-1 Blockade Using Nivolumab. Oncol Lett (2020) 19(2):1559–66. 10.3892/ol.2019.11220 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Chen C, Guo X, Wang J, Guo W, Ma X, Xu J. The Diagnostic Value of Radiomics-Based Machine Learning in Predicting the Grade of Meningiomas Using Conventional Magnetic Resonance Imaging: A Preliminary Study. Front Oncol (2019) 9:1338. 10.3389/fonc.2019.01338 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Al-Hawary MM, Francis IR, Anderson MA. Pancreatic Solid and Cystic Neoplasms: Diagnostic Evaluation and Intervention. Radiol Clin North Am (2015) 53(5):1037–48. 10.1016/j.rcl.2015.05.005 [DOI] [PubMed] [Google Scholar]
- 31. Li J, Lu J, Liang P, Li A, Hu Y, Shen Y, et al. Differentiation of Atypical Pancreatic Neuroendocrine Tumors From Pancreatic Ductal Adenocarcinomas: Using Whole-Tumor CT Texture Analysis as Quantitative Biomarkers. (2018) 7(10):4924–31. 10.1002/cam4.1746 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Sahani DV, Sainani NI, Blake MA, Crippa S, Mino-Kenudson M, del-Castillo CF. Prospective Evaluation of Reader Performance on MDCT in Characterization of Cystic Pancreatic Lesions and Prediction of Cyst Biologic Aggressiveness. AJR Am J Roentgenol (2011) 197(1):W53–61. 10.2214/AJR.10.5866 [DOI] [PubMed] [Google Scholar]
- 33. Strobel O, Hinz U, Gluth A, Hank T, Hackert T, Bergmann F, et al. Pancreatic Adenocarcinoma: Number of Positive Nodes Allows to Distinguish Several N Categories. Ann Surg (2015) 261(5):961–9. 10.1097/SLA.0000000000000814 [DOI] [PubMed] [Google Scholar]
- 34. Dalal V, Carmicheal J, Dhaliwal A, Jain M, Kaur S, Batra SK. Radiomics in Stratification of Pancreatic Cystic Lesions: Machine Learning in Action. Cancer Lett (2020) 469:228–37. 10.1016/j.canlet.2019.10.023 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Yang J, Guo X, Ou X, Zhang W, Ma X. Discrimination of Pancreatic Serous Cystadenomas From Mucinous Cystadenomas With Ct Textural Features: Based on Machine Learning. Front Oncol (2019) 9:494. 10.3389/fonc.2019.00494 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Xie H, Ma S, Guo X, Zhang X, Wang X. Preoperative Differentiation of Pancreatic Mucinous Cystic Neoplasm From Macrocystic Serous Cystic Adenoma Using Radiomics: Preliminary Findings and Comparison With Radiological Model. Eur J Radiol (2020) 122:108747. 10.1016/j.ejrad.2019.108747 [DOI] [PubMed] [Google Scholar]
- 37. Luo Y, Chen X, Chen J, Song C, Shen J, Xiao H, et al. Preoperative Prediction of Pancreatic Neuroendocrine Neoplasms Grading Based on Enhanced Computed Tomography Imaging: Validation of Deep Learning With a Convolutional Neural Network. Neuroendocrinology (2020) 110(5):338–50. 10.1159/000503291 [DOI] [PubMed] [Google Scholar]
- 38. Gao X, Wang X. Deep Learning for World Health Organization Grades of Pancreatic Neuroendocrine Tumors on Contrast-Enhanced Magnetic Resonance Images: A Preliminary Study. Int J Comput Assist Radiol Surg (2019) 14(11):1981–91. 10.1007/s11548-019-02070-5 [DOI] [PubMed] [Google Scholar]
- 39. Bian Y, Jiang H, Ma C, Wang L, Zheng J, Jin G, et al. Ct-Based Radiomics Score for Distinguishing Between Grade 1 and Grade 2 Nonfunctioning Pancreatic Neuroendocrine Tumors. AJR Am J Roentgenol (2020), 1–12. 10.2214/AJR.19.22123 [DOI] [PubMed] [Google Scholar]
- 40. Yao X, Sun K, Bu X, Zhao C, Jin Y. Classification of White Blood Cells Using Weighted Optimized Deformable Convolutional Neural Networks. Artif Cells Nanomed Biotechnol (2021) 49(1):147–55. 10.1080/21691401.2021.1879823 [DOI] [PubMed] [Google Scholar]
- 41. Sanner MF, Dieguez L, Forli S. Improving Docking Power for Short Peptides Using Random Forest. J Chem Inf Model (2021) 61(6):3074–90. 10.1021/acs.jcim.1c00573 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Kimura K, Yoshida S. Usefulness of Texture Features of Apparent Diffusion Coefficient Maps in Predicting Chemoradiotherapy Response in Muscle-Invasive Bladder Cancer. Eur Radiol (2021). 10.1007/s00330-021-08110-6 [DOI] [PubMed] [Google Scholar]
- 43. Yu H, Huang Z, Li M, Wei Y, Zhang L, Yang C, et al. Differential Diagnosis of Nonhypervascular Pancreatic Neuroendocrine Neoplasms From Pancreatic Ductal Adenocarcinomas, Based on Computed Tomography Radiological Features and Texture Analysis. Acad Radiol (2020) 27(3):332–41. 10.1016/j.acra.2019.06.012 [DOI] [PubMed] [Google Scholar]
- 44. Shi YJ, Zhu HT, Liu YL, Wei YY, Qin XB, Zhang XY, et al. Radiomics Analysis Based on Diffusion Kurtosis Imaging and T2 Weighted Imaging for Differentiation of Pancreatic Neuroendocrine Tumors From Solid Pseudopapillary Tumors. Front Oncol (2020) 10:1624. 10.3389/fonc.2020.01624 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The dataset generated for this study can be obtained from the correspondence author.