Table 3.
Performance metrics of biomarker-based models
| Metrics | pCR-score-based | sTILs-baseda | Subtype-baseda | Baselinea | Integratedb | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| Mean (95% CI) | P | Mean (95% CI) | P | Mean (95% CI) | P | Mean (95% CI) | P | Mean (95% CI) | P | |
| F1 score | 0.503 (0.424–0.581) | – | 0.250 (0.181–0.320) | < 0.001 | 0.386 (0.252–0.519) | 0.100 | 0.565 (0.491–0.639) | 0.196 | 0.682 (0.631–0.732) | 0.002 |
| Accuracy | 0.853 (0.827–0.879) | – | 0.810 (0.786–0.834) | < 0.001 | 0.815 (0.785–0.846) | 0.008 | 0.840 (0.808–0.873) | 0.380 | 0.884 (0.859–0.909) | < 0.001 |
| AUC | 0.822 (0.784–0.861) | – | 0.780 (0.753–0.806) | < 0.001 | 0.818 (0.782–0.855) | 0.858 | 0.839 (0.812–0.866) | 0.485 | 0.890 (0.863–0.916) | 0.001 |
| Sensitivity | 0.396 (0.314–0.474) | – | 0.173 (0.118–0.226) | < 0.001 | 0.370 (0.230–0.511) | 0.730 | 0.541 (0.433–0.648) | 0.026 | 0.633 (0.552–0.715) | < 0.001 |
| PPV | 0.781 (0.699–0.864) | – | 0.494 (0.377–0.612) | < 0.001 | 0.418 (0.278–0.559) | < 0.001 | 0.686 (0.571–0.801) | 0.424 | 0.785 (0.707–0.863) | 0.022 |
| Specificity | 0.971 (0.959–0.984) | – | 0.969 (0.961–0.978) | 1.000 | 0.936 (0.912–0.960) | 0.057 | 0.918 (0.876–0.961) | 0.092 | 0.945 (0.924–0.973) | 0.180 |
| NPV | 0.864 (0.835–0.893) | – | 0.823 (0.798–0.851) | < 0.001 | 0.855 (0.815–0.895) | 0.472 | 0.889 (0.857–0.922) | 0.070 | 0.910 (0.884–0.936) | 0.144 |
| TP | 3.250 (2.590–3.910) | – | 1.438 (1.004–1.871) | < 0.001 | 2.875 (1.794–3.956) | 0.791 | 4.500 (3.527–5.473) | 0.092 | 5.313 (4.517–6.108) | 0.021 |
| FN | 5.313 (4.118–6.508) | – | 7.125 (5.993–8.258) | < 0.001 | 5.688 (3.897–7.478) | 0.791 | 4.063 (2.780–5.345) | 0.092 | 3.250 (2.287–4.213) | 0.021 |
| FP | 1.000 (0.565–1.435) | – | 1.063 (0.757–1.368) | 1.000 | 2.250 (1.413–3.087) | 0.057 | 2.813 (1.367–4.258) | 0.092 | 1.750 (0.936–2.564) | 0.180 |
| TN | 33.44 (32.41–34.47) | – | 33.38 (32.29–34.46) | 1.000 | 32.19 (31.14–33.29) | 0.057 | 31.63 (29.84–33.41) | 0.092 | 32.69 (31.24–34.14) | 0.180 |
Bold indicates statistical significance (P < 0.05)
pCR pathological complete response; sTILs stromal tumor-infiltrating lymphocytes; OR odds ratio; CI confidence interval; AUC area under the curve
aP value was from that the comparisons with pCRscore-based model
bsolely refers to the P value was from the comparisons of baseline model and integrated model (baseline: sTILs + subtype; integrated: sTILs + subtype + pCR-score)