Table 2.
The performance of top semantic features, feature combinations, and lung-RADS in predicting nodule malignancy at each screening round (a: baseline scan, b: first follow-up scan, c: second follow-up scan)
| 2a Baseline scan (T0) | ||||||
|---|---|---|---|---|---|---|
| Features | Semantics | Lung-RADS | Combined† | |||
| Sensitivity/ Specificity |
E[AUC]* [CI] |
Testing AUC |
Sensitivity/ Specificity |
E[AUC] CI |
AUC [CI] |
|
| Border definition | 0.579 / 0.834 | 0.719 [0.582,0.825] | 0.787 | 0.399 – 0.466 / 0.750 – 0.794 | 0.600 [0.404,0.719] | 0.743 [0.601,0.878] |
| Contour | 0.372 / 0.915 | 0.689 [0.484,0.864] | 0.835 | 0.685 [0.471,0.851] | ||
| Border definitionFocal fibrosis | 0.571 / 0.839 | 0.692 [0.542,0.825] | 0.789 | 0.732 [0.587,0.881] | ||
| Border definition solidity Vessel attachment | 0.549 / 0.858 | 0.731 [0.582,0.896] | 0.782 | 0.704 [0.512,0.913] | ||
| Short axial diameter Contour Border definition solidity | 0.525 / 0.888 | 0.741 [0.574,0.855] | 0.927 | 0.732 [0.555,0.852] | ||
| 2b First follow-up scan (T1) | ||||||
|---|---|---|---|---|---|---|
| Features | Semantics | Lung-RADS | Combined† | |||
| Sensitivity/ Specificity |
E[AUC]* [CI] |
Testing§ AUC |
AUC | E[AUC] CI |
AUC [CI] |
|
| Contour | 0.689 / 0.898 | 0.823 [0.722,0.944] | 0.835 | 0.537 – 0.621/0.949 – 0.970 | 0.760 [0.614,0.919] | 0.875 [0.775,0.944] |
| Border definition | 0.695 / 0.815 | 0.741 [0.595,0.864] | 0.787 | 0.846 [0.752,0.983] | ||
| Location Contour | 0.678 / 0.905 | 0.833 [0.739,0.925] | 0.820 | 0.886 [0.793,0.969] | ||
| Contour Vessel attachment Focal emphysema | 0.687 / 0.901 | 0.882 [0.776,0.966] | 0.843 | 0.835 [0.525,0.967] | ||
| Location Contour solidity Focal fibrosis | 0.665 / 0.907 | 0.897 [0.807,0.974] | 0.825 | 0.897 [0.807,0.974] | ||
| 2c Second follow-up scan (T2) | ||||||
|---|---|---|---|---|---|---|
| Features | Semantics | Lung-RADS | Combined† | |||
| Sensitivity/ Specificity |
E[AUC]* [CI] |
Testing AUC |
Sensitivity/ Specificity |
E[AUC] CI |
AUC [CI] |
|
| Contour | 0.829 / 0.871 | 0.876 [0.742,0.97] | 0.835 | 0.767 – 0.847/0.953 – 0.973 | 0.867 [0.760,0.973] | 0.958 [0.877,0.993] |
| Border definition | 0.729 / 0.806 | 0.802 [0.642,0.924] | 0.787 | 0.938 [0.845,0.992] | ||
| Location Contour | 0.816 / 0.881 | 0.897 [0.757,0.979] | 0.820 | 0.962 [0.883,0.991] | ||
| Contour Vessel attachment Focal emphysema | 0.823 / 0.881 | 0.903 [0.786,0.974] | 0.843 | 0.965 [0.894,0.994] | ||
| Location Short axial diameter Contour Focal emphysema | 0.744 / 0.943 | 0.947 [0.881,0.987] | 0.923 | 0.968 [0.913,0.995] | ||
†
It indicates the combination of lung-RADS with semantic features.
§
there are only 2 screening rounds for the testing cohort, so we used the same dataset for baseline and the first follow-up scan.
*
E[AUC] means average area under the receiver-operating characteristic curve, CI stands for confidence interval.