Table 6.
Inter‐rater agreement and agreement between Ariol automated CK56 and EGFR scores (dichotomized using the ROC method) for cores in TMAs from participating studies
| Marker | Comparison | N | % Pos. | Observed Agreement | Kappa (95%CI) | Se (%) | Sp (%) | PPV (%) | NPV (%) |
|---|---|---|---|---|---|---|---|---|---|
| CK5/6 | Inter‐rater agreementa | 357 | 11.9 | 91.6 | 0.74 (0.66, 0.83) | 96.6 | 90.6 | 67.1 | 99.3 |
| Ariol vs raterb ‐ all | 1897 | 10.4 | 89.4 | 0.49 (0.44, 0.53) | 61.6 | 92.6 | 49.2 | 95.4 | |
| Ariol vs raterb – ER+ | 1107 | 6.4 | 89.1 | 0.41 (0.35, 0.46) | 71.8 | 90.3 | 33.6 | 97.9 | |
| Ariol vs raterb – ER− | 360 | 21.1 | 86.9 | 0.57 (0.47, 0.67) | 56.6 | 95.1 | 75.4 | 89.1 | |
| EGFR | Inter‐rater agreementc | 760 | 10.5 | 94.5 | 0.73 (0.66, 0.81) | 90.7 | 94.9 | 66.0 | 98.9 |
| Ariol vs raterb | 1914 | 9.8 | 84.1 | 0.44 (0.40, 0.48) | 87.7 | 83.7 | 36.9 | 98.4 | |
| Ariol vs raterb – ER+ | 1041 | 1.3 | 86.2 | 0.14 (0.11, 0.17) | 100.0 | 86.0 | 8.9 | 100.0 | |
| Ariol vs raterb – ER− | 342 | 39.5 | 82.2 | 0.63 (0.53, 0.74) | 83.7 | 81.2 | 74.3 | 88.4 |
% Pos., % positive cores for reference rater; Se, sensitivity; Sp, Specificity; PPV, positive predictive value; NPV, negative predictive value.
a
Includes data from CNIO‐BCS, MCBCS, ORIGO, SBCS.
b
Includes data from SEARCH re‐analysis.
c
Includes data from ABCS, CNIO‐BCS, KBCP, MCBCS, ORIGO, SBCS.