Table 2.
Prediction performance of 3 different models for primary tumor resistance to NAC and tumor PCR in the training and test cohort.
| Models | Cohorts | AUC | ACC | SENS | SPEC | PPV | NPV |
|---|---|---|---|---|---|---|---|
| Clinical_resistance | Training | 0.691 (0.597-0.779) |
0.669 (0.583-0.748) |
0.656 (0.535-0.776) |
0.682 (0.567-0.790) |
0.656 (0.534-0.867) |
0.682 (0.571-0.791) |
| Test | 0.697 (0.535-0.853) |
0.605 (0.465-0.742) |
0.476 (0.269-0.696) |
0.727 (0.526-0.905) |
0.625 (0.385-0.866) |
0.593 (0.400-0.774) |
|
| DL_resistance | Training | 0.964 (0.933-0.988) |
0.921 (0.874-0.960) |
0.934 (0.867-0.985) |
0.909 (0.838-0.967) |
0.905 (0.825-0.968) |
0.937 (0.873-0.985) |
| Test | 0.872 (0.747-0.963) |
0.814 (0.697-0.930) |
0.857 (0.699-1.00) |
0.773 (0.583-0.950) |
0.783 (0.591-0.950) |
0.850 (0.667-1.000) |
|
| DL_Clinical_resistance | Training | 0.986 (0.971-0.997) |
0.929 (0.882-0.968) |
0.934 (0.870-1.000) |
0.924 (0.853-0.984) |
0.919 (0.841-0.983) |
0.938 (0.878-1.000) |
| Test | 0.911 (0.814-0.979) |
0.791 (0.651-0.970) |
0.905 (0.765-1.000) |
0.682 (0.474-0.869) |
0.731 (0.552-0.895) |
0.882 (0.708-1.000) |
|
| Clinical_PCR | Training | 0.733 (0.638-0.823) |
0.708 (0.630-0.787) |
0.660 (0.527-0.792) |
0.737 (0.642-0.831) |
0.596 (0.460-0.729) |
0.787 (0.693-0.871) |
| Test | 0.745 (0.563-0.902) |
0.581 (0.442-0.720) |
0.688 (0.444-0.916) |
0.519 (0.333-0.708) |
0.458 (0.261-0.655) |
0.737 (0.526-0.933) |
|
| DL_PCR | Training | 0.901 (0.836-0.953) |
0.835 (0.764-0.897) |
0.894 (0.795-0.977) |
0.800 (0.707-0.885) |
0.724 (0.604-0.836) |
0.927 (0.859-0.984) |
| Test | 0.847 (0.705-0.959) |
0.767 (0.628-0.883) |
0.688 (0.444-0.909) |
0.815 (0.654-0.958) |
0.688 (0.444-0.909) |
0.815 (0.655-0.956) |
|
| DL_Clinical_PCR | Training | 0.952 (0.909-0.984) |
0.827 (0.756-0.889) |
0.979 (0.927-1.000) |
0.738 (0.636-0.829) |
0.687 (0.577-0.796) |
0.983 (0.944-1.000) |
| Test | 0.880 (0.751-0.973) |
0.721 (0.581-0.860) |
0.875 (0.688-1.000) |
0.630 (0.444-0.815) |
0.583 (0.381-0.789) |
0.895 (0.739-1.000) |
The data in brackets are the 95% confidence intervals. Training cohort, n = 127; test cohort, n = 43.
Abbreviations: PCR: pathological complete response; DL: deep learning; AUC: area under the receiver operating characteristic curve; ACC: accuracy; SENS: sensitivity; SPEC: specificity; PPV: positive predictive value; NPV: negative predictive value.