Skip to main content
Sensors (Basel, Switzerland) logoLink to Sensors (Basel, Switzerland)
. 2022 Jul 4;22(13):5044. doi: 10.3390/s22135044

Form Factors as Potential Imaging Biomarkers to Differentiate Benign vs. Malignant Lung Lesions on CT Scans

Francesco Bianconi 1,*, Isabella Palumbo 2, Mario Luca Fravolini 1, Maria Rondini 3, Matteo Minestrini 4, Giulia Pascoletti 5, Susanna Nuvoli 3, Angela Spanu 3, Michele Scialpi 6, Cynthia Aristei 2, Barbara Palumbo 4
Editor: Barry K Lavine
PMCID: PMC9269784  PMID: 35808538

Abstract

Indeterminate lung nodules detected on CT scans are common findings in clinical practice. Their correct assessment is critical, as early diagnosis of malignancy is crucial to maximise the treatment outcome. In this work, we evaluated the role of form factors as imaging biomarkers to differentiate benign vs. malignant lung lesions on CT scans. We tested a total of three conventional imaging features, six form factors, and two shape features for significant differences between benign and malignant lung lesions on CT scans. The study population consisted of 192 lung nodules from two independent datasets, containing 109 (38 benign, 71 malignant) and 83 (42 benign, 41 malignant) lung lesions, respectively. The standard of reference was either histological evaluation or stability on radiological followup. The statistical significance was determined via the Mann–Whitney U nonparametric test, and the ability of the form factors to discriminate a benign vs. a malignant lesion was assessed through multivariate prediction models based on Support Vector Machines. The univariate analysis returned four form factors (Angelidakis compactness and flatness, Kong flatness, and maximum projection sphericity) that were significantly different between the benign and malignant group in both datasets. In particular, we found that the benign lesions were on average flatter than the malignant ones; conversely, the malignant ones were on average more compact (isotropic) than the benign ones. The multivariate prediction models showed that adding form factors to conventional imaging features improved the prediction accuracy by up to 14.5 pp. We conclude that form factors evaluated on lung nodules on CT scans can improve the differential diagnosis between benign and malignant lesions.

Keywords: lung cancer, radiomics, form factors, computed tomography

1. Introduction

According to the World Health Organisation, lung cancer is the second most common form of neoplastic disorder and the first cause of cancer-related deaths worldwide [1]. The most common forms of lung cancer are Non-Small Cell Lung Cancer (NSCLC), which accounts for ≈84% of the cases, followed by Small Cell Lung Cancer (SCLC) with ≈13% [2]. The American Cancer Society’s projections for 2022 place the number of new cases and fatalities in the USA at ≈230.000 and ≈130.000, respectively, with an overall chance of developing lung cancer in a lifetime of about 1 in 15 for men and 1 in 17 for women [2]. In Italy there were, in 2020, ≈41.000 newly diagnosed cases (≈67% men) and ≈13.300 deaths (≈69% men [3]).

The survival of patients with lung cancer strongly depends on the stage at which the disease is first detected, and early diagnosis is a key to maximise the treatment outcome. In Italy the 5-year overall survival is estimated at 16% for men and 23% for women [3]. At an early, stage lung cancer usually appears as a round, solid, subsolid, or ground-glass opacity (lung nodule), although only a small fraction of such abnormalities (estimated between 3.7% and 5.5%) actually represent malignancies [4]. The evaluation of suspicious lung lesions involves the assessment of clinical (e.g., age, sex, history of smoking, exposure, and other risk factors) and radiographic features such as size, margins, contour, density, and internal characteristics [5,6]. The updated guidelines (2017) from the Fleischner Society [7] recommend no routine followup for low-risk patients with solid and subsolid lung nodules smaller than 6 mm; in the other cases, the management may involve periodic CT scans, PET/CT imaging, and/or tissue sampling.

In recent years, quantitative computerised analysis of imaging data (radiomics) has introduced opportunities for the management of patients with suspicious and/or confirmed lung cancer [8,9,10,11,12,13]. The overall objective of radiomics is to extract quantitative data from the input images, which should be ideally repeatable, interpretable, and, of course, correlated with the clinical endpoint of interest [14]. The rationale behind this paradigm is that medical images are a source of diagnostic and prognostic data not directly revealed through traditional qualitative visual inspection [10,15,16,17,18,19,20]. The extraction of quantitative information in a mineable way also enables the resulting data to be fed into artificial intelligence algorithms to build automatic classification and/or regression models [21,22]. Furthermore, whereas other diagnostic procedures, such as biopsy, usually focus on a limited portion of the lesion, radiomics enables full-field analysis of the region of interest [23].

The radiomics pipeline involves six steps [12,21]: acquisition, preprocessing, segmentation, feature extraction, postprocessing, and data analysis. Feature extraction, in particular, consists of computing a set of quantitative parameters (features) from the imaging data. Ideally, the features should correlate with the clinical endpoint investigated—benignity or malignancy—in this case. Feature extraction methods can be classified into two main families: the ‘conventional’ (also referred to as ‘traditional’ or ‘hand-designed’) ones and those based on deep learning [24,25]. The conventional features can be further categorised into shape and texture features [15,26].

The literature has consistently reported the potential benefits of radiomics in several decision-making scenarios related to the management of patients with lung cancer. These include, among others, the discrimination between histological subtypes and between primary vs. metastatic lesions [27,28,29,30,31], prediction of the overall survival, disease-free survival, and response to therapy [32,33,34,35,36], and the detection of gene mutation status [37,38]. In particular, the role of deep learning and/or conventional features to help discriminate a benign vs. a malignant lung lesion on a CT scan has been assessed in a number of previous studies [39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54]. In this context, however, shape features have received little attention on their own, since they are usually investigated along with texture features to build high-dimensional predictive models in which the role of each single feature is not the main focus of the study [46,48,51,55]. Yet, shape features have a number of potential advantages, which make them particularly appealing in radiomics, such as intuitive interpretation and robustness to changes in the acquisition and reconstruction settings [56,57]. Among the three-dimensional shape features most commonly used to discriminate benign vs. malignant lung lesions on CT scans are the compactness, sphericity, spiculation, spherical disproportion, and the surface-to-volume ratio [48,55,58,59,60].

The objective of this study was to investigate one specific class of shape features, form factors, and, in particular, the potential of elongation, flatness, and compactness as recently defined in [61] to discriminate between benign and malignant lung lesions on CT scans. The main advantage of these parameters is that they have simple mathematical definitions and relatively easy/intuitive interpretation, as they can be seen as percentages of an overall form, respectively elongated (rod-like), flat (platy), and compact (equant). Furthermore, these parameters have all values in [0, 1], which facilitates clinical readings and comparisons.

We tested the above features along with three other form factors (Kong’s elongation and flatness and maximum projection sphericity), three conventional features (maximum 3D diameter, volume, and surface area), and two shape features (sphericity and volume density) for significant differences between benign and malignant lung nodules. Furthermore, we evaluated the effectiveness of these features within multivariate prediction models to discriminate between benign and malignant lesions.

The remainder of the paper is organised as follows. We describe the materials and methods in Section 2 including a description of the study population, the image acquisition and lesion delineation procedure, the feature extraction step, and the statistical analysis. We report the main results in Section 3 followed by a thorough discussion of the results in Section 4. We conclude the paper with some final considerations (Section 5), the main limitations of the study, and prospective future research (Section 6). Mathematical formulations of the imaging features are reported in Appendix A.

2. Materials and Methods

2.1. Study Population

We considered a total of 192 lung lesions from two retrospective datasets, denoted as ‘SSR-1’ and ‘LUNGx’ in this paper.

Dataset ‘SSR-1’ contained baseline CT scans of 109 lung nodules (38 benign, 71 malignant) from as many patients (45 females, 64 males, age = 68.3 ± 8.9 (44–84) year) who received a thoracic PET/CT at the Unit of Nuclear Medicine of the Università degli Studi di Sassari, Sassari, Italy, between November 2014 and May 2019. Benignity or malignancy was assessed via histological examination. The CT scans for attenuation correction were acquired in helicoidal mode on a Discovery 710 PET/CT system (GE Healthcare, Chicago, IL, USA) with the following settings: tube voltage 120 kVp, slice thickness 3.75 mm, spacing between slices 3.27 mm, in-plane inter-voxel spacing 1.37 mm in both directions, and image size 512 px × 512 px. Table 1 summarises the characteristics of the patient series; further details about the acquisition procedure are available in [51].

Table 1.

Dataset SSR-1: Characteristics of the patient series.

Attribute [Data Format] Value
Demographics
Age [Mean ± SD] 68.3 ± 8.9 year
Female [N (%)] 45 (41.3)
Male [N (%)] 64 (58.7)
Histology
Benign [N (%)] 38 (34.9)
Malignant [N (%)] 71 (65.1)
Adenocarcinoma [N (%)] 45 (41.3)
Atypical carcinoid (NSCLC) [N (%)] 1 (0.9)
Metastasis [N (%)] 1 (0.9)
Neuroendocrine tumour [N (%)] 1 (0.9)
Small-cell lung cancer [N (%)] 2 (1.8)
Spinocellular carcinoma [N (%)] 4 (3.7)
Squamous cell carcinoma [N (%)] 9 (8.3)
Unspecified [N (%)] 8 (7.3)

Dataset ‘LUNGx’ included 83 nodules (42 benign, 41 malignant) from 70 patients (42 females, 28 males, age = 60.2 ± 13.4 (18–84) year) who underwent thoracic CT examination at The University of Chicago, Chicago, IL, USA between February 2006 and May 2007. Benignity or malignancy was determined by followup imaging (stability over two years and/or spontaneous resolution were considered indicative of benignity) and/or histological assessment. The scans were obtained from different systems (see [62] for details), and the acquisition settings were: tube voltage 120–140 kVp, slice thickness 1.00 mm, spacing between slices 1.00 mm, in-plane inter-voxel spacing 0.55–0.90 mm in both directions, and image size 512 px × 512 px. This dataset is publicly accessible through The Cancer Imaging Archive (TCIA [63,64]). The characteristics of the patient series are reported in Table 2.

Table 2.

Dataset LUNGx: Characteristics of the patient series.

Attribute [Data Format] Value
Demographics
Age [Mean ± SD] 60.2 ± 13.4 year
Female [N (%)] 42
Male [N (%)] 28
Histology
Benign [N (%)] 42 (50.6)
Malignant [N (%)] 41 (49.4)
Adenocarcinoma [N (%)] 17 (20.5)
Carcinoid tumour [N (%)] 2 (2.4)
Small-cell lung cancer [N (%)] 9 (10.8)
Squamous cell carcinoma [N (%)] 1 (1.2)
Suspicious lung cancer [N (%)] 2 (2.4)
Unspecified NSCLC [N (%)] 10 (12.0)

2.2. Lesion Delineation

In both datasets the three-dimensional regions of interest (ROI) representing the suspicious areas were delineated manually, slice-by-slice, on the open-access LIFEx 7.1.0 platform [65], as shown in Figure 1. The segmentation was carried out together by two experts, one radiation oncologist (I.P., >15 year experience) and one nuclear medicine specialist (B.P., >20 year experience).

Figure 1.

Figure 1

Illustration of the lesion delineation process. The top row shows the cropped areas from contiguous axial slices containing the suspicious lesion; the fuchsia overlays in the bottom row indicate the manually-delineated regions of interest. The lesion in the picture was diagnosed as adenocarcinoma in a 76-year-old man.

2.3. Shape Features

A total of 11 shape features were extracted from each ROI as detailed in Table 3. Mathematical definitions and formulae are reported in Appendix A. All the features, apart from the conventional ones, represented dimensionless quantities, and were, therefore, volume-independent by definition. Furthermore, they all had values in [0, 1], which facilitated empirical evaluations, comparisons, and potential translation into clinical practice.

Table 3.

Summary table of the shape features considered in this study (see Appendix A for the mathematical definitions and formulae).

Group Name Acronym/Abbreviation
Conventional Maximum 3D diameter Max3Ddiam
Surface area SurfArea
Voxel volume Volume
Form factors Angelidakis elongation AEL
Angelidakis flatness AFL
Angelidakis compactness ACO
Kong elongation KEL
Kong flatness KFL
Maximum projection sphericity MPS
Other Sphericity -
Volume density VDN

As for the form factors, these were defined by the ratios of the three main dimensions of the lesion, which in the remainder we refer to as length (l), breadth (b), and thickness (t), with lbt. We took the side lengths (sorted in descending order of magnitude) of the rectangular axis-aligned bounding box of the ROI, respectively, as l, b, and t (also refer to Figure 2 and Figure 3 for a graphical explanation). Although this was a simplified way to compute these parameters (other approaches, for instance based on the principal axes of inertia, are also possible), it had the clear advantages of ease of calculation and straightforward interpretation.

Figure 2.

Figure 2

Adenocarcinoma in a 76-year-old man: lesion on the CT scan (left) and the reconstructed three-dimensional volume within the axis-aligned bounding box (right).

Figure 3.

Figure 3

Fibrosis in a 46-year-old man: lesion on the CT scan (left) and the reconstructed three-dimensional volume within the axis-aligned bounding box (right).

2.4. Univariate Analysis

For each of the shape features described in Section 2.3, significant differences between the benign and malignant group were assessed by the nonparametric Mann–Whitney U test [66]. Correction for multiple tests was based on the Benjiamini–Hochberg procedure [67] at a false discovery ratio FDR=0.05.

2.5. Multivariate Prediction Models

The ability of the form factors to improve the discrimination capability between the benign and malignant lesions beyond standard imaging features was also assessed through multivariate prediction models. To this end, we considered two feature sets denoted as base, which included the conventional imaging features, that is, maximum 3D diameter, surface area, and volume, and extended, composed of all the features of the base set plus the form factors that were significantly different between the benign and malignant group in both datasets, which were: AFL, ACO, KFL, and MPS (see Table 4 and Table 5).

Table 4.

Results of the univariate analysis on the SSR-1 dataset. Units of measure: maximum 3D diameter [mm], surface area [mm2], and volume [mm3]; all other features are in dimensionless units (range 0–1).

Feature Benign Malignant p-Value Significant
Max 3D diameter 18.8 ± 7.4 23.6 ± 7.7 0.001 Yes
Surface area 846.7 ± 630.3 1414.4 ± 819.6 <0.001 Yes
Voxel volume 2138.1 ± 2369.2 4209.2 ± 3481.3 <0.001 Yes
Angelidakis elongation 0.077 ± 0.056 0.070 ± 0.059 0.193 No
Angelidakis flatness 0.123 ± 0.111 0.077 ± 0.079 0.009 Yes
Angelidakis compactness 0.800 ± 0.115 0.853 ± 0.097 0.008 Yes
Kong elongation 0.140 ± 0.096 0.126 ± 0.099 0.200 No
Kong flatness 0.205 ± 0.163 0.136 ± 0.124 0.010 Yes
Maximum projection sphericity 0.810 ± 0.117 0.864 ± 0.092 0.005 Yes
Sphericity 0.774 ± 0.067 0.769 ± 0.061 0.280 No
Volume density 0.435 ± 0.112 0.431 ± 0.097 0.274 No

Table 5.

Results of the univariate analysis on the LUNGx dataset. Units of measure: maximum 3D diameter [mm], surface area [mm2], and volume [mm3]; all other features are in dimensionless units (range 0–1).

Feature Benign Malignant p-Value Significant
Max 3D diameter 23.5 ± 15.1 26.1 ± 10.4 0.029 No
Surface area 1457.2 ± 1882.1 1698.9 ± 1252.6 0.012 Yes
Voxel volume 2782.5 ± 4550.9 3436.0 ± 3432.3 0.011 Yes
Angelidakis elongation 0.070 ± 0.078 0.069 ± 0.059 0.334 No
Angelidakis flatness 0.201 ± 0.139 0.132 ± 0.096 0.015 Yes
Angelidakis compactness 0.730 ± 0.152 0.799 ± 0.110 0.017 Yes
Kong elongation 0.127 ± 0.126 0.126 ± 0.103 0.382 No
Kong flatness 0.315 ± 0.198 0.224 ± 0.139 0.014 Yes
Maximum projection sphericity 0.734 ± 0.148 0.803 ± 0.105 0.019 Yes
Sphericity 0.662 ± 0.129 0.625 ± 0.087 0.036 No
Volume density 0.359 ± 0.096 0.339 ± 0.071 0.047 No

Prediction models based on linear Support Vector Machines (lSVM) were fitted and tested both internally (intra-dataset) and externally (across datasets) through four train/test combinations: SSR-1/SSR-1, LUNGx/LUNGx, SSR-1/LUNGx and LUNGx/SSR-1 (see Table 6 for the details of the results). Since the magnitude of the base features differed significantly from that of the form factors, all the features were preliminarily normalised to zero-mean and unit-variance (Z score). The normalisation was carried out feature by feature separately and independently on the two datasets (each dataset was blind to the data contained in the other one). The optimal value for the lSVM penalty factor C was determined through a grid search over C{0.01,0.1,1.0,10.0}. For each feature set + classifier combination, we retained the value of C that achieved the best performance. The performance of the prediction models was estimated as the percentage of nodules of the test set classified correctly (accuracy). For intra-dataset validation the split into train and test set was based on the leave-one-out procedure.

Table 6.

Performance of the classification models. Accuracy columns report the percentage (fraction) of the samples of the test set classified correctly; the gain is the difference between the base and extended feature sets.

Training Set Test Set Accuracy (Base)
[% (Fraction)]
Accuracy (Extended)
[% (Fraction)]
Gain
[pp (Fraction)]
SSR-1 SSR-1 65.1 (71/109) 66.1 (72/109) 0.9 (1/109)
LUNGx LUNGx 54.2 (45/83) 62.7 (52/83) 8.4 (7/83)
SSR-1 LUNGx 49.4 (41/83) 63.8 (53/83) 14.5 (12/83)
LUNGx SSR-1 57.8 (63/109) 63.9 (71/109) 7.3 (8/109)

2.6. Estimation of the Cutoff Thresholds

To facilitate the interpretation of the form factors and further demonstrate their potential use on a practical level, we computed the optimal cutoff thresholds that maximised the overall classification accuracy over the two datasets considered separately and together. In Table 7, we provide the cutoff values for each of the form factors that were significantly different between the benign and malignant group.

Table 7.

Estimated cutoff values for malignancy. The range for all parameters is 0–1.

Feature Dataset Avg. over Datasets
SSR-1 LUNGx SSR-1 + LUNGx
ACO >0.746 >0.765 >0.769 >0.760
AFL <0.245 <0.248 <0.248 <0.246
KFL <0.368 <0.415 <0.396 <0.393
MPS >0.697 >0.701 >0.706 >0.701

3. Results

The results of the univariate analysis are summarised in Table 4 and Table 5; a visual representation of the data in the form of boxplots/stripplots is also available in Figure 4 and Figure 5. As can be seen, the malignant lesions were on average larger in both datasets, which is logical and consistent with the literature [40,68,69,70,71]. Regarding the form factors, four of them (AFL, ACO, KFL, and MPS) were significantly different between the two groups in both datasets. Specifically, AFL and KFL were higher in the benign group, whereas ACO and MPS were higher in the malignant group. In other words, the benign lesions were, on average, flatter than the malignant ones; conversely, the malignant ones were more isotropic (equant) than the benign ones. The other two shape features considered in this study (sphericity and volume density) did not show statistically significant differences between the two groups in either dataset.

Figure 4.

Figure 4

Figure 4

Boxplots/stripplots of the features that were significantly different between the benign and malignant tumours in the SSR-1 dataset.

Figure 5.

Figure 5

Figure 5

Boxplots/stripplots of the features that were significantly different between the benign and malignant tumours in the LUNGx dataset.

Table 6 shows the accuracy of the multivariate prediction models built upon the base and extended feature sets as described in Section 2.5. We would like to emphasize that it is not the absolute accuracy value that matters here (ideally, this could be increased by adding more clinical and/or radiomics features) but the gain that could be obtained by adding the form factors to the base features. This ranged between 0.9 pp and 14.5 pp and was particularly pronounced when the LUNGx dataset was used as a training set. This is interesting, as this dataset was specifically designed for a competition (‘LUNGx Challenge for Computerized Lung Nodule Classification’) and is considered particularly difficult [62,72].

4. Discussion

In recent years the use of quantitative imaging features coupled with automatic classifiers has gained considerable attention as a means to assist the clinician in the diagnosis and management of suspicious lung lesions. In this context, shape descriptors have been investigated as potential imaging biomarkers to differentiate benign vs. malignant lung lesions on CT scans, since morphological features such as irregular borders and spiculation are known to be associated with malignancy [6,7,73]. Consequently, most previous studies have focused on how to quantify these features by suitable mathematical parameters [44,46,48].

Our results suggest a potential link between overall lesion shape and benignity/malignancy. Specifically, we found that lesion flatness was associated with benignity and compactness (equancy) with malignancy. This is congruent with the findings reported by Takashima et al. [74], where the manually-assessed three-dimensional shape ratio was significantly different between benign and malignant lesions, with the latter again leaning towards equancy. Our result for flatness also confirmed the one reported by Peikert et al. [75], although the authors did not discuss this finding further, as their work focused on a multiparametric classification model and not on the individual features. Regarding the KEL and KFL, a comparison with the literature indicates that our findings were again in good agreement with those presented by Peikert et al. [75]. No comparison was possible for the other form factors of AEL, ACO, AFL, and MPS, as we are not aware of any previous study investigating these parameters. Finally, sphericity and volume density were not statistically significant in our study. The result for sphericity contrasted with Dhara et al. [55], where this parameter was significantly different between the benign and malignant group, although in [55] it is not indicated which group had the higher values.

From a clinical standpoint, the most relevant finding of this work is that the benign lesions had on average a tendency to be flatter than the malignant ones; conversely, the malignant ones leaned toward a more isotropic (equant) morphology. We demonstrated that four form factors among those investigated here were significantly different between the benign and malignant group in both datasets, suggesting that they could be used in clinical decision making. To clarify the potential use of these parameters, we have reported the optimal cutoff values for benignity/malignancy for each of the form factors that were significantly different between the benign and malignant lesions. However, further studies, ideally prospective and on larger cohorts of patients, are needed to confirm these findings before translation into clinical practice.

5. Conclusions

The diagnostic evaluation of suspicious lung nodules detected on CT scans represents a significant challenge for the clinician. The traditional radiographic approach involves manual assessment of specific features such as size, contour, margins, internal characteristics, spiculation, and lobulation. In recent years, the quantitative analysis of imaging data coupled with machine learning algorithms (radiomics) has opened up new perspectives in the field. In this scenario, the objective of this work was to investigate one specific subset of morphological features (form factors) as potential imaging biomarkers to discriminate between benign and malignant lung lesions on CT scans.

We found that four form factors (ACO, AFL, KFL, and MPS) were significantly different between the benign and malignant groups in both datasets. Furthermore, we demonstrated that these parameters could improve the accuracy of automated classification models for discriminating benign vs. malignant lesions. Our findings lead to the speculation that malignant lesions have a tendency to grow more isotropically than the benign ones. This hypothesis, however, needs to be validated in future studies. Future work should also address potential links between tumour microenvironment and overall shape.

6. Limitations and Future Work

This work was not exempt from limitations; two of the limitations were the retrospective nature and the relatively contained sample size. The results should be validated in larger and, ideally, prospective studies. The biological links between overall shape as quantified by the form factors (particularly in terms of flatness vs. equancy) and the potentially different spatial growth patterns for malignant and benign lesions also remain unclear and should be investigated in future studies.

Abbreviations

The following abbreviations are used in this manuscript:

ACO Angelidakis compactness
AEL Angelidakis elongation
AFL Angelidakis flatness
CT Computed Tomography
FDR False discovery ratio
KEL Kong elongation
KFL Kong flatness
MPS Maximum projection sphericity
NSCLC Non-Small Cell Lung Cancer
PET Positron Emission Tomography
ROI Region(s) of interest
SCLC Small Cell Lung Cancer
lSVM Linear Support Vector Machines
TCIA The Cancer Imaging Archive

Appendix A. Shape Features

Appendix A.1. Conventional

Appendix A.1.1. Voxel Volume

The total volume defined as the sum of the volume of each voxel in the region of interest. This is indicated as V in the remainder of this Appendix A.

Appendix A.1.2. Surface Area

The total area of the triangular mesh that approximates the boundary of the region of interest. This is indicated as A in the remainder of this Appendix A.

Appendix A.1.3. Maximum 3D Diameter

The Euclidean distance between the centroids of the two most apart voxels in the region of interest.

Appendix A.2. Form Factors

Let l, b, and t denote the side lengths of the axis-aligned bounding box enclosing the region of interest sorted in descending order (lbt).

Angelidakis compactness, elongation, and flatness (ACO, AEL, and AFL)

ACO=2tl+t (A1)
AEL=ltlt+b2tl+t (A2)
AFL=b2lt+b2tl+t (A3)

By definition AEL, AFL, and ACO have all values in (0, 1] and add up to unity [61]. Larger values of AEL, AFL, and ACO, respectively, indicate higher elongation, flatness, and compactness. The main advantage of these parameters is that they can be seen as percentages of an overall form, respectively, rod-like, platy, and equant.

Kong elongation and flatness

KEL=1bl (A4)
KFL=1tb (A5)

Kong elongation and flatness [76] are a variation of the classic breadth-to-length and thickness-to-breadth form factors [77]. The advantage of KEL and KFL is that a flat particle has a high value of KEL, and an elongated one has a high value of KFL.

Maximum projection sphericity

MPS=t2bl3 (A6)

The ratio between the maximum projection area of the region of interest and that of a sphere with the same volume. It reflects the difference of forces (drag and gravitational) of a body immersed in a fluid [78]. It is a measure of equancy.

Appendix A.3. Others

Sphericity

36πV23A (A7)

The ratio between the surface area of a sphere with the same volume as the region of interest and the surface area of the region of interest.

Volume density

VVaabb (A8)

The ratio between the volume of the region of interest and that of the axis-aligned bounding box (Vaabb).

Author Contributions

Conceptualization, F.B., S.N., C.A. and B.P.; data curation, I.P., M.R., M.M., S.N. and A.S.; formal analysis, M.L.F. and B.P.; funding acquisition, F.B. and A.S.; investigation, I.P., M.R., M.M., G.P. and B.P.; methodology, F.B., I.P., M.L.F., C.A. and B.P.; resources, M.L.F. and A.S.; software, F.B.; supervision, A.S., M.S., C.A. and B.P.; validation, M.L.F., S.N. and M.S.; visualization, F.B. and G.P.; writing—original draft, F.B.; writing—review and editing, F.B., I.P., M.L.F., M.R., M.M., G.P., S.N., A.S., M.S., C.A. and B.P. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Dataset ‘LUNGx’: This is an open-access public dataset containing anonymised data; therefore, its use does not constitute research on human subjects. Dataset ‘SSR-1’: Patients underwent PET/CT scan for clinical purposes (lung cancer staging) in compliance with the international guidelines. All the procedures performed in this study were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Formal ethical approval was not required due to the retrospective nature of the study and the analysis of anonymous clinical data.

Informed Consent Statement

Dataset ‘LUNGx’: This is an open-access public dataset containing anonymised data; therefore, its use does not constitute research on human subjects. Dataset ‘SSR-1’: Written informed consent was obtained from all the subjects. In the informed consent, patients signed an item accepting that their data could be used for scientific purposes in anonymised form.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This work was partially supported by the Università degli Studi di Sassari, Italy, within the framework Fondo Ateneo Ricerca 2020 and by the Department of Engineering, Università degli Studi di Perugia, Italy, through the project Shape, colour and texture features for the analysis of two- and three-dimensional images: methods and applications (Fundamental Research Grants Scheme 2019).

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.World Health Organization Cancer. 2021. [(accessed on 24 August 2021)]. Available online: https://www.who.int/news-room/fact-sheets/detail/cancer.
  • 2.American Cancer Society Key Statistics for Lung Cancer. 2022. [(accessed on 24 June 2022)]. Available online: https://www.cancer.org/cancer/lung-cancer/about/key-statistics.html.
  • 3.Altavilla G., Di Maio M. I Numeri del Cancro in Italia. Intermedia Editore; Brescia, Italy: 2022. Polmone; pp. 56–57. Chapter 3.6. [Google Scholar]
  • 4.McWilliams A., Tammemagi M.C., Mayo J.R., Roberts H., Liu G., Soghrati K., Yasufuku K., Martel S., Laberge F., Gingras M., et al. Probability of cancer in pulmonary nodules detected on first screening CT. N. Engl. J. Med. 2013;369:910–919. doi: 10.1056/NEJMoa1214726. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Edey A., Hansell D. Incidentally detected small pulmonary nodules on CT. Clin. Radiol. 2009;64:872–884. doi: 10.1016/j.crad.2009.03.006. [DOI] [PubMed] [Google Scholar]
  • 6.Chan E.Y., Gaur P., Ge Y., Kopas L., Santacruz J.F., Gupta N., Munden R.F., Cagle P.T., Kim M.P. Management of the solitary pulmonary nodule. Arch. Pathol. Lab. Med. 2017;141:927–931. doi: 10.5858/arpa.2016-0307-RA. [DOI] [PubMed] [Google Scholar]
  • 7.MacMahon H., Naidich D.P., Goo J.M., Lee K.S., Leung A.N.C., Mayo J.R., Mehta A.C., Ohno Y., Powell C.A., Prokop M., et al. Guidelines for management of incidental pulmonary nodules detected on CT images: From the Fleischner Society 2017. Radiology. 2017;284:228–243. doi: 10.1148/radiol.2017161659. [DOI] [PubMed] [Google Scholar]
  • 8.Huang Y., Liu Z., He L., Chen X., Pan D., Ma Z., Liang C., Tian J., Liang C. Radiomics signature: A potential biomarker for the prediction of disease-free survival in early-stage (I or II) non-small cell lung cancer. Radiology. 2016;281:947–957. doi: 10.1148/radiol.2016152234. [DOI] [PubMed] [Google Scholar]
  • 9.Bianconi F., Fravolini M., Bello-Cerezo R., Minestrini M., Scialpi M., Palumbo B. Evaluation of shape and textural features from CT as prognostic biomarkers in non-small cell lung cancer. Anticancer Res. 2018;38:2155–2160. doi: 10.21873/anticanres.12456. [DOI] [PubMed] [Google Scholar]
  • 10.Thawani R., McLane M., Beig N., Ghose S., Prasanna P., Velcheti V., Madabhushi A. Radiomics and radiogenomics in lung cancer: A review for the clinician. Lung Cancer. 2018;115:34–41. doi: 10.1016/j.lungcan.2017.10.015. [DOI] [PubMed] [Google Scholar]
  • 11.Kaseda K. Recent and current advances in FDG-PET imaging within the field of Clinical Oncology in NSCLC: A review of the literature. Diagnostics. 2020;10:561. doi: 10.3390/diagnostics10080561. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Bianconi F., Palumbo I., Spanu A., Nuvoli S., Fravolini M.L., Palumbo B. PET/CT radiomics in lung cancer: An overview. Appl. Sci. 2020;5:1718. doi: 10.3390/app10051718. [DOI] [Google Scholar]
  • 13.Wu Y.J., Wu F.Z., Yang S.C., Tang E.K., Liang C.H. Radiomics in Early Lung Cancer Diagnosis: From Diagnosis to Clinical Decision Support and Education. Diagnostics. 2022;12:1064. doi: 10.3390/diagnostics12051064. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Mayerhoefer M., Materka A., Langs G., Häggström I., Szczypiński P., Gibbs P., Cook G. Introduction to Radiomics. J. Nucl. Med. 2020;61:488–495. doi: 10.2967/jnumed.118.222893. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Rizzo S., Botta F., Raimondi S., Origgi D., Fanciullo C., Morganti A.G., Bellomi M. Radiomics: The facts and the challenges of image analysis. Eur. Radiol. Exp. 2018;2:36. doi: 10.1186/s41747-018-0068-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Oikonomou A., Khalvati F., Tyrrell P., Haider M., Tarique U., Jimenez-Juan L., Tjong M., Poon I., Eilaghi A., Ehrlich L., et al. Radiomics analysis at PET/CT contributes to prognosis of recurrence and survival in lung cancer treated with stereotactic body radiotherapy. Sci. Rep. 2018;8:4003. doi: 10.1038/s41598-018-22357-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Zhu X., Dong D., Chen Z., Fang M., Zhang L., Song J., Yu D., Zang Y., Liu Z., Shi J., et al. Radiomic signature as a diagnostic factor for histologic subtype classification of non-small cell lung cancer. Eur. Radiol. 2018;28:2772–2778. doi: 10.1007/s00330-017-5221-1. [DOI] [PubMed] [Google Scholar]
  • 18.Fornacon-Wood I., Faivre-Finn C., O’Connor J.P.B., Price G.J. Radiomics as a personalized medicine tool in lung cancer: Separating the hope from the hype. Lung Cancer. 2020;146:197–208. doi: 10.1016/j.lungcan.2020.05.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Bianconi F., Palumbo I., Fravolini M., Chiari R., Minestrini M., Brunese L., Palumbo B. Texture analysis on [18F]FDG PET/CT in non-small-cell lung cancer: Correlations between PET features, CT features, and histological types. Mol. Imaging Biol. 2019;21:1200–1209. doi: 10.1007/s11307-019-01336-3. [DOI] [PubMed] [Google Scholar]
  • 20.van Timmeren J.E., Cester D., Tanadini-Lang S., Alkadhi H., Baessler B. Radiomics in medical imaging—“How-to” guide and critical reflection. Insights Imaging. 2020;11:91. doi: 10.1186/s13244-020-00887-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Papadimitroulas P., Brocki L., Christopher Chung N., Marchadour W., Vermet F., Gaubert L., Eleftheriadis V., Plachouris D., Visvikis D., Kagadis G.C., et al. Artificial intelligence: Deep learning in oncological radiomics and challenges of interpretability and data harmonization. Phys. Med. 2021;83:108–121. doi: 10.1016/j.ejmp.2021.03.009. [DOI] [PubMed] [Google Scholar]
  • 22.Ibrahim A., Primakov S., Beuque M., Woodruff H.C., Halilaj I., Wu G., Refaee T., Granzier R., Widaatalla Y., Hustinx R., et al. Radiomics for precision medicine: Current challenges, future prospects, and the proposal of a new framework. Methods. 2021;188:20–29. doi: 10.1016/j.ymeth.2020.05.022. [DOI] [PubMed] [Google Scholar]
  • 23.Chen B., Zhang R., Gan Y., Yang L., Li W. Development and clinical application of radiomics in lung cancer. Radiat. Oncol. 2017;12:154. doi: 10.1186/s13014-017-0885-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Hosny A., Aerts H.J., Mak R.H. Handcrafted versus deep learning radiomics for prediction of cancer therapy response. Lancet Digit. Health. 2019;1:e106–e107. doi: 10.1016/S2589-7500(19)30062-7. [DOI] [PubMed] [Google Scholar]
  • 25.Riquelme D., Akhloufi M.A. Deep learning for lung cancer nodules detection and classification in CT scans. AI. 2020;1:28–67. doi: 10.3390/ai1010003. [DOI] [Google Scholar]
  • 26.Bianconi F., Fravolini M., Palumbo I., Palumbo B. Shape and texture analysis of radiomic data for Computer-assisted Diagnosis and prognostication: An overview; Proceedings of the International Conference on Design Tools and Methods in Industrial Engineering (ADM); Modena, Italy. 9–10 September 2019; pp. 3–14. [Google Scholar]
  • 27.Bianconi F., Kather J., Reyes-Aldasoro C. Evaluation of colour pre-processing on patch-based classification of H&E-stained images; Proceedings of the 15th European Congress on Digital Pathology, ECDP 2019; Warwick, UK. 10–13 April 2019; pp. 56–64. [Google Scholar]
  • 28.Linning E., Lu L., Li L., Yang H., Schwartz L.H., Zhao B. Radiomics for Classifying Histological Subtypes of Lung Cancer Based on Multiphasic Contrast-Enhanced Computed Tomography. J. Comput. Assist. Tomogr. 2019;43:300–306. doi: 10.1097/RCT.0000000000000836. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Kirienko M., Cozzi L., Rossi A., Voulaz E., Antunovic L., Fogliata A., Chiti A., Sollini M. Ability of FDG PET and CT radiomics features to differentiate between primary and metastatic lung lesions. Eur. J. Nucl. Med. Mol. Imaging. 2018;45:1649–1660. doi: 10.1007/s00259-018-3987-2. [DOI] [PubMed] [Google Scholar]
  • 30.Yan M., Wang W. Development of a Radiomics Prediction Model for Histological Type Diagnosis in Solitary Pulmonary Nodules: The Combination of CT and FDG PET. Front. Oncol. 2020;10:555514. doi: 10.3389/fonc.2020.555514. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Ferreira-Junior J.R., Koenigkam-Santos M., Magalhães Tenório A.P., Faleiros M.C., Garcia Cipriano F.E., Fabro A.T., Näppi J., Yoshida H., de Azevedo-Marques P.M. CT-based radiomics for prediction of histologic subtype and metastatic disease in primary malignant lung neoplasms. Int. J. Comput. Assist. Radiol. Surg. 2020;15:163–172. doi: 10.1007/s11548-019-02093-y. [DOI] [PubMed] [Google Scholar]
  • 32.Shi L., He Y., Yuan Z., Benedict S., Valicenti R., Qiu J., Rong Y. Radiomics for response and outcome assessment for non-small cell lung cancer. Technol. Cancer Res. Treat. 2018;17:1533033818782788. doi: 10.1177/1533033818782788. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Mu W., Qi J., Lu H., Schabath M., Balagurunathan Y., Tunali I., Gillies R. Radiomic biomarkers from PET/CT multi-modality fusion images for the prediction of immunotherapy response in advanced non-small cell lung cancer patients; Proceedings of the Medical Imaging 2018: Computer-Aided Diagnosis; Houston, TX, USA. 10–15 February 2018; p. 105753S. [Google Scholar]
  • 34.Chetan M.R., Gleeson F.V. Radiomics in predicting treatment response in non-small-cell lung cancer: Current status, challenges and future perspectives. Eur. Radiol. 2021;31:1049–1058. doi: 10.1007/s00330-020-07141-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Chang R., Qi S., Yue Y., Zhang X., Song J., Qian W. Predictive Radiomic Models for the Chemotherapy Response in Non-Small-Cell Lung Cancer based on Computerized-Tomography Images. Front. Oncol. 2021;11:646190. doi: 10.3389/fonc.2021.646190. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Li R., Peng H., Xue T., Li J., Ge Y., Wang G., Feng F. Prediction and verification of survival in patients with non-small-cell lung cancer based on an integrated radiomics nomogram. Clin. Radiol. 2022;77:e222–e230. doi: 10.1016/j.crad.2021.12.002. [DOI] [PubMed] [Google Scholar]
  • 37.Sacconi B., Anzidei M., Leonardi A., Boni F., Saba L., Scipione R., Anile M., Rengo M., Longo F., Bezzi M., et al. Analysis of CT features and quantitative texture analysis in patients with lung adenocarcinoma: A correlation with EGFR mutations and survival rates. Clin. Radiol. 2017;72:443–450. doi: 10.1016/j.crad.2017.01.015. [DOI] [PubMed] [Google Scholar]
  • 38.Nguyen Ho L., Le T.V. Model for predicting EGFR mutation status in lung cancer. Breathe. 2019;15:340–342. doi: 10.1183/20734735.0250-2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Han F., Wang H., Zhang G., Han H., Song B., Li L., Moore W., Lu H., Zhao H., Liang Z. Texture feature analysis for computer-aided diagnosis on pulmonary nodules. J. Digit. Imaging. 2014;28:99–115. doi: 10.1007/s10278-014-9718-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Suo S., Cheng J., Cao M., Lu Q., Yin Y., Xu J., Wu H. Assessment of heterogeneity difference between edge and core by using texture analysis: Differentiation of malignant from inflammatory pulmonary nodules and masses. Acad. Radiol. 2016;23:1115–1122. doi: 10.1016/j.acra.2016.04.009. [DOI] [PubMed] [Google Scholar]
  • 41.Dennie C., Thornhill R., Sethi-Virmani V., Souza C.A., Bayanati H., Gupta A., Maziak D. Role of quantitative computed tomography texture analysis in the differentiation of primary lung cancer and granulomatous nodules. Quant. Imaging Med. Surg. 2016;6:6–15. doi: 10.3978/j.issn.2223-4292.2016.02.01. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Song Q.Z., Zhao L., Luo X.K., Dou X.C. Using Deep Learning for classification of lung nodules on computed tomography images. J. Healthc. Eng. 2017;2017:8314740. doi: 10.1155/2017/8314740. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Wilson R., Devaraj A. Radiomics of pulmonary nodules and lung cancer. Transl. Lung Cancer Res. 2017;6:86–91. doi: 10.21037/tlcr.2017.01.04. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Ferreira J.R., Jr., Oliveira M.C., de Azevedo-Marques P.M. Characterization of pulmonary nodules based on features of margin sharpness and texture. J. Digit. Imaging. 2018;31:451–463. doi: 10.1007/s10278-017-0029-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Causey J.L., Zhang J., Ma S., Jiang B., Qualls J.A., Politte D.G., Prior F., Zhang S., Huang X. Highly accurate model for prediction of lung nodule malignancy with CT scans. Sci. Rep. 2018;8:9286. doi: 10.1038/s41598-018-27569-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Balagurunathan Y., Schabath M.B., Wang H., Liu Y., Gillies R.J. Quantitative imaging features improve discrimination of malignancy in pulmonary nodules. Sci. Rep. 2019;9:8528. doi: 10.1038/s41598-019-44562-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Nasrullah N., Sang J., Alam M.S., Mateen M., Cai B., Hu H. Automated lung nodule detection and classification using deep learning combined with multiple strategies. Sensors. 2019;19:3722. doi: 10.3390/s19173722. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Wu W., Hu H., Gong J., Li X., Huang G., Nie S. Malignant-benign classification of pulmonary nodules based on random forest aided by clustering analysis. Phys. Med. Biol. 2019;64:035017. doi: 10.1088/1361-6560/aafab0. [DOI] [PubMed] [Google Scholar]
  • 49.Wu W., Pierce L., Zhang Y., Pipavath S., Randolph T., Lastwika K., Lampe P., Houghton A., Liu H., Xia L., et al. Comparison of prediction models with radiological semantic features and radiomics in lung cancer diagnosis of the pulmonary nodules: A case-control study. Eur. Radiol. 2019;29:6100–6108. doi: 10.1007/s00330-019-06213-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Gao N., Tian S., Li X., Huang J., Wang J., Chen S., Ma Y., Liu X., Guo X. Three-dimensional texture feature analysis of pulmonary nodules in CT images: Lung cancer predictive models based on support vector machine classifier. J. Digit. Imaging. 2019;33:414–422. doi: 10.1007/s10278-019-00238-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Palumbo B., Bianconi F., Palumbo I., Fravolini M.L., Minestrini M., Nuvoli S., Stazza M.L., Rondini M., Spanu A. Value of shape and texture features from 18F-FDG PET/CT to discriminate between benign and malignant solitary pulmonary nodules: An experimental evaluation. Diagnostics. 2020;10:696. doi: 10.3390/diagnostics10090696. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Astaraki M., Zakko Y., Toma Dasu I., Smedby O., Wang C. Benign-malignant pulmonary nodule classification in low-dose CT with convolutional features. Phys. Med. 2021;83:146–153. doi: 10.1016/j.ejmp.2021.03.013. [DOI] [PubMed] [Google Scholar]
  • 53.Rundo L., Ledda R.E., di Noia C., Sala E., Mauri G., Milanese G., Sverzellati N., Apolone G., Gilardi M.C., Messa M.C., et al. A low-dose CT-based radiomic model to improve characterization and screening recall intervals of indeterminate prevalent pulmonary nodules. Diagnostics. 2021;11:1610. doi: 10.3390/diagnostics11091610. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Jing R., Wang J., Li J., Wang X., Li B., Xue F., Shao G., Xue H. A wavelet features derived radiomics nomogram for prediction of malignant and benign early-stage lung nodules. Sci. Rep. 2021;11:22330. doi: 10.1038/s41598-021-01470-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Dhara A.K., Mukhopadhyay S., Dutta A., Garg M., Khandelwal N. A Combination of shape and texture features for classification of pulmonary nodules in lung CT Images. J. Digit. Imaging. 2016;29:466–475. doi: 10.1007/s10278-015-9857-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Fornacon-Wood I., Mistry H., Ackermann C.J., Blackhall F., McPartlin A., Faivre-Finn C., Price G.J., O’Connor J.P.B. Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platform. Eur. Radiol. 2020;30:6241–6250. doi: 10.1007/s00330-020-06957-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Bianconi F., Fravolini M., Palumbo I., Pascoletti G., Nuvoli S., Rondini M., Spanu A., Palumbo B. Impact of lesion delineation and intensity quantisation on the stability of texture features from lung nodules on CT: A reproducible study. Diagnostics. 2021;11:1224. doi: 10.3390/diagnostics11071224. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.He X., Sahiner B., Gallas B.D., Chen W., Petrick N. Computerized characterization of lung nodule subtlety using thoracic CT images. Phys. Med. Biol. 2014;59:897–910. doi: 10.1088/0031-9155/59/4/897. [DOI] [PubMed] [Google Scholar]
  • 59.Wang J., Liu X., Dong D., Song J., Xu M., Zang Y., Tian J. Prediction of malignant and benign of lung tumor using a quantitative radiomic method; Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS); Orlando, FL, USA. 16–20 August 2016; pp. 1272–1275. [DOI] [PubMed] [Google Scholar]
  • 60.Limkin E.J., Reuzé S., Carré A., Sun R., Schernberg A., Alexis A., Deutsch E., Ferté C., Robert C. The complexity of tumor shape, spiculatedness, correlates with tumor radiomic shape features. Sci. Rep. 2019;9:4329. doi: 10.1038/s41598-019-40437-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Angelidakis V., Nadimi S., Utili S. Elongation, flatness and compactness indices to characterise particle form. Powder Technol. 2022;396:689–695. doi: 10.1016/j.powtec.2021.11.027. [DOI] [Google Scholar]
  • 62.Armato S.G., III, Drukker K., Li F., Hadjiiski L., Tourassi G.D., Engelmann R.M., Giger M.L., Redmond G., Farahani K., Kirby J.S., et al. LUNGx Challenge for computerized lung nodule classification. J. Med. Imaging. 2016;3:044506. doi: 10.1117/1.JMI.3.4.044506. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Clark K., Vendt B., Smith K., Freymann J., Kirby J., Koppel P., Moore S., Phillips S., Maffitt D., Pringle M., et al. The cancer imaging archive (TCIA): Maintaining and operating a public information repository. J. Digit. Imaging. 2013;26:1045–1057. doi: 10.1007/s10278-013-9622-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.The Cancer Imaging Archive (TCIA) [(accessed on 30 November 2021)]. Available online: http://www.cancerimagingarchive.net/
  • 65.Nioche C., Orlhac F., Boughdad S., Reuze S., Goya-Outi J., Robert C., Pellot-Barakat C., Soussan M., Frouin F.E., Buvat I. LIFEx: A freeware for radiomic feature calculation in multimodality imaging to accelerate advances in the characterization of tumor heterogeneity. Cancer Res. 2018;78:4786–4789. doi: 10.1158/0008-5472.CAN-18-0125. [DOI] [PubMed] [Google Scholar]
  • 66.Mann H.B., Whitney D.R. On a test of whether one of two random variables is stochastically larger than the other. Ann. Math. Stat. 1947;18:50–60. doi: 10.1214/aoms/1177730491. [DOI] [Google Scholar]
  • 67.Lee S., Lee D.K. What is the proper way to apply the multiple comparison test? Korean J. Anesthesiol. 2018;71:353–360. doi: 10.4097/kja.d.18.00242. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Zhao L., Tong L., Lin J., Tang K., Zheng S.S., Li W.F., Cheng D., Yin W.W., Zheng X.W. Characterization of solitary pulmonary nodules with 18F-FDG PET/CT relative activity distribution analysis. Eur. Radiol. 2015;25:1837–1844. doi: 10.1007/s00330-015-3592-8. [DOI] [PubMed] [Google Scholar]
  • 69.Larici A.R., Farchione A., Franchi P., Ciliberto M., Cicchetti G., Calandriello L., del Ciello A., Bonomo L. Lung nodules: Size still matters. Eur. Respir. Rev. 2017;26:170025. doi: 10.1183/16000617.0025-2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Evangelista L., Cuocolo A., Pace L., Mansi L., Del Vecchio S., Miletto P., Sanfilippo S., Pellegrino S., Guerra L., Pepe G., et al. Performance of FDG-PET/CT in solitary pulmonary nodule based on pre-test likelihood of malignancy: Results from the ITALIAN retrospective multicenter trial. Eur. J. Nucl. Med. Mol. Imaging. 2018;11:1898–1907. doi: 10.1007/s00259-018-4016-1. [DOI] [PubMed] [Google Scholar]
  • 71.Taralli S., Scolozzi V., Foti M., Ricciardi S., Forcione A.R., Cardillo G., Calcagni M.L. 18F-FDG PET/CT diagnostic performance in solitary and multiple pulmonary nodules detected in patients with previous cancer history: Reports of 182 nodules. Eur. J. Nucl. Med. Mol. Imaging. 2019;46:429–436. doi: 10.1007/s00259-018-4226-6. [DOI] [PubMed] [Google Scholar]
  • 72.Armato S.G., Hadjiiski L., Tourassi G.D., Drukker K., Giger M.L., Li F., Redmond G., Farahani K., Kirby J.S., Clarke L.P. Special Section Guest Editorial: LUNGx Challenge for computerized lung nodule classification: Reflections and lessons learned. J. Med. Imaging. 2015;2:20103. doi: 10.1117/1.JMI.2.2.020103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Truong M.T., Ko J.P., Rossi S.E., Rossi I., Viswanathan C., Bruzzi J.F., Marom E.M., Erasmus J.J. Update in the evaluation of the solitary pulmonary nodule. Radiographics. 2014;34:1658–1679. doi: 10.1148/rg.346130092. [DOI] [PubMed] [Google Scholar]
  • 74.Takashima S., Sone S., Li F., Maruyama Y., Hasegawa M., Matsushita T., Takayama F., Kadoya M. Small solitary pulmonary nodules (<1 cm) detected at population-based CT screening for lung cancer: Reliable high-resolution CT features of benign lesions. Am. J. Roentgenol. 2003;180:955–964. doi: 10.2214/ajr.180.4.1800955. [DOI] [PubMed] [Google Scholar]
  • 75.Peikert T., Duan F., Rajagopalan S., Karwoski R.A., Clay R., Robb R., Qin Z., Sicks J., Bartholmai B.J., Maldonado F. Novel high-resolution computed tomography-based radiomic classifier for screen-identified pulmonary nodules in the National Lung Screening Trial. PLoS ONE. 2018;13:e0196910. doi: 10.1371/journal.pone.0196910. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Kong D., Fonseca J. Quantification of the morphology of shelly carbonate sands using 3D images. Geotechnique. 2018;68:249–261. doi: 10.1680/jgeot.16.P.278. [DOI] [Google Scholar]
  • 77.Blott S.J., Pye K. Particle shape: A review and new methods of characterization and classification. Sedimentology. 2008;55:31–63. doi: 10.1111/j.1365-3091.2007.00892.x. [DOI] [Google Scholar]
  • 78.Benn D.I., Ballantyne C.K. The description and representation of particle shape. Earth Surf. Process. Landf. 1993;18:665–672. doi: 10.1002/esp.3290180709. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.


Articles from Sensors (Basel, Switzerland) are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES