Table 2.
Comparison of weighted algorithm performance for each algorithm alone and combined compared to gold-standard chart abstraction, and among subpopulations
| Algorithm 7 | Algorithm 9 | High Specificity and PPV Combination 1 | High Sensitivity Combination 2 | |
|---|---|---|---|---|
| N recurrences (%) | 388 (66%) | 234 (39%) | 117 (20%) | 505 (84%) |
| Overall (N=600) 3 | % (95% CI) | % (95% CI) | % (95% CI) | % (95% CI) |
| Sensitivity | 78% (49–93) | 65% (45–82) | 64% (44–80) | 80% (49–94) |
| Specificity | 88% (85–90) | 93% (92–95) | 98% (97–99) | 83% (80–86) |
| PPV | 36% (31–74) | 46% (39–53) | 72% (63–80) | 29% (25–34) |
| NPV | 98% (93–99) | 97% (93–99) | 97% (93–99) | 98% (92–100) |
| No second breast cancer (N=523) | ||||
| Sensitivity | 77% (47–93) | 66% (43–83) | 65% (43–82) | 78% (47–85) |
| Specificity | 90% (88–92) | 94% (92–95) | 98% (97–99) | 85% (82–88) |
| PPV | 40% (34–46) | 47% (40–55) | 75% (66–83) | 31% (27–37) |
| NPV | 98% (92–99) | 97% (93–99) | 97% (93–99) | 80% (92–100) |
| Censored in 2014 (N=556) | ||||
| Sensitivity | 96% (89–98) | 79% (68–87) | 78% (67–86) | 100% (96–100) |
| Specificity | 91% (89–93) | 96% (95–97) | 98% (97–99) | 89% (86–91) |
| PPV | 29% (23–36) | 43% (34–53) | 58% (46–69) | 25% (20–31) |
| NPV | 100% (100–100) | 99% (99–100) | 99% (99–99) | 100% (100–100) |
| Recurrence algorithm dates <6 months apart (N=549) | ||||
| Sensitivity | 76% (44–92) | 59% (38–78) | 58% (37–76) | 76% (44–93) |
| Specificity | 88% (86–90) | 94% (92–95) | 99% (98–99) | 84% (80–87) |
| PPV | 32% (27–38) | 42% (34–50) | 74% (62–83) | 26% (21–31) |
| NPV | 98% (93–99) | 97% (93–99) | 97% (93–99) | 98% (92–100) |
High Specificity and PPV Combination categorized discordant algorithm pairs as negative
High Sensitivity Combination categorized discordant algorithm pairs as positive
The overall population includes the entire study sample with 388 discordant records between algorithms, 95 records where the algorithms agreed there was no recurrence, 66 records where the algorithms agreed there was a recurrence, and 51 additional records where the algorithms agreed there was a recurrence but the recurrence dates from each algorithm were >6 months apart.
Abbreviations: PPV (Positive predictive value), NPV (Negative predictive value)