Table 1.
MP‐NN performance for lung adenocarcinoma (LUAD) diagnosis
| Characteristics | Threshold | AUC (95% CI) | Sensitivity [%] | Specificity [%] | PPV [%] | NPV [%] | Accuracy [%] | p1 value a) | p2 value b) |
|---|---|---|---|---|---|---|---|---|---|
| Training set | |||||||||
| AD (Stage 0‐IV) | |||||||||
| CEA | 5 ng mL−1 | 0.570 (0.540–0.600) | 23.79 | 92.75 | 70.51 | 62.57 | 63.70 | / | / |
| Met‐NN | 0.521 | 0.908 (0.894–0.923) | 86.63 | 78.94 | 74.97 | 89.02 | 82.18 | <0.001 | <0.001 |
| MP‐NN | 0.433 | 0.952 (0.942–0.961) | 91.45 | 86.86 | 83.52 | 93.31 | 88.79 | <0.001 | |
| AD (Stage 0‐II) | |||||||||
| CEA | 5 ng mL−1 | 0.527 (0.494–0.561) | 9.61 | 92.75 | 40.74 | 66.42 | 64.35 | / | / |
| Met‐NN | 0.521 | 0.908 (0.892–0.923) | 86.68 | 78.94 | 68.10 | 91.95 | 81.58 | <0.001 | <0.001 |
| MP‐NN | 0.433 | 0.943 (0.931–0.955) | 89.96 | 86.86 | 78.03 | 94.34 | 87.92 | <0.001 | |
| AD (Stage 0) | |||||||||
| CEA | 5 ng mL−1 | 0.679 (0.613–0.745) | 0.00 | 92.75 | 0.00 | 92.54 | 86.30 | / | / |
| Met‐NN | 0.521 | 0.916 (0.886–0.946) | 92.42 | 78.94 | 24.70 | 99.29 | 79.87 | <0.001 | <0.001 |
| MP‐NN | 0.433 | 0.945 (0.925–0.965) | 89.39 | 86.86 | 33.71 | 99.10 | 87.04 | <0.001 | |
| Test set | |||||||||
| AD (Stage 0‐IV) | |||||||||
| CEA | 5 ng mL−1 | 0.529 (0.485–0.573) | 20.32 | 97.47 | 85.33 | 62.81 | 65.07 | / | / |
| Met‐NN | 0.521 | 0.782 (0.750–0.814) | 76.19 | 63.45 | 60.15 | 78.63 | 68.80 | <0.001 | 0.004 |
| MP‐NN | 0.433 | 0.809 (0.779–0.839) | 76.19 | 67.59 | 62.99 | 79.67 | 71.20 | <0.001 | |
| AD (Stage 0‐II) | |||||||||
| CEA | 5 ng mL−1 | 0.575 (0.528–0.622) | 7.59 | 97.47 | 62.07 | 65.94 | 65.77 | / | / |
| Met‐NN | 0.521 | 0.775 (0.741–0.810) | 75.53 | 63.45 | 52.96 | 82.63 | 67.71 | <0.001 | 0.463 |
| MP‐NN | 0.433 | 0.782 (0.748–0.817) | 71.73 | 67.59 | 54.66 | 81.44 | 69.05 | <0.001 | |
| AD (Stage 0) | |||||||||
| CEA | 5 ng mL−1 | 0.636 (0.524–0.748) | 0.00 | 97.47 | 0.00 | 93.60 | 91.38 | / | / |
| Met‐NN | 0.521 | 0.794 (0.726–0.862) | 75.86 | 63.45 | 12.15 | 97.53 | 64.22 | 0.027 | 0.002 |
| MP‐NN | 0.433 | 0.843 (0.789–0.898) | 82.76 | 67.59 | 14.55 | 98.33 | 68.53 | 0.003 | |
AUC = area under curve; NPV = negative predictive value; PPV = positive predictive value; CI = confidence interval.
a)
The p1 values indicate the statistical significance for the differences of AUC as compared with traditional tumor marker CEA.
b)
The p2 values indicate the statistical significance for the differences of AUC between Met‐NN and MP‐NN.