Table 3. Agreement Metrics for Patient-Reported and Electronic Health Record (EHR)–Derived Follow-up Eventsa.
| Variable | % (95% CI) | κ Statistic | ||||
|---|---|---|---|---|---|---|
| Overall agreement | Sensitivity | Specificity | PPV | NPV | ||
| Full population (N = 15 076) | ||||||
| Coronary revascularization | 95.0 (94.7-95.4) | 58.6 (55.1-62.0) | 97.1 (96.9-97.4) | 54.2 (50.8-57.5) | 97.6 (97.3-97.9) | 0.54 (0.51-0.57) |
| MI | 97.3 (97.0-97.5) | 33.0 (28.0-38.2) | 98.8 (98.7-99.0) | 40.7 (34.9-46.7) | 98.4 (98.2-98.6) | 0.35 (0.30-0.40) |
| Stroke | 98.8 (98.6-98.9) | 34.2 (26.7-42.3) | 99.4 (99.3-99.6) | 38.8 (30.5-47.6) | 99.3 (99.2-99.4) | 0.36 (0.29-0.43) |
| Bleeding | 99.1 (98.9-99.2) | 36.6 (25.5-48.9) | 99.4 (99.2-99.5) | 21.9 (14.8-30.4) | 99.7 (99.6-99.8) | 0.27 (0.19-0.35) |
| Sensitivity analysis population (n = 14 476)b | ||||||
| Coronary revascularization | 95.4 (95.1-95.8) | 65.5 (61.9-69.0) | 97.0 (96.7-97.3) | 53.8 (50.4-57.2) | 98.1 (97.9-98.4) | 0.57 (0.54-0.60) |
| MI | 97.6 (97.3-97.8) | 39.0 (33.4-44.9) | 98.8 (98.6-99.0) | 40.1 (34.3-46.2) | 98.7 (98.5-98.9) | 0.38 (0.33-0.44) |
| Stroke | 98.9 (98.7-99.0) | 40.5 (31.8-49.6) | 99.4 (99.3-99.5) | 38.1 (29.8-46.8) | 99.5 (99.3-99.6) | 0.39 (0.31-0.46) |
| Bleeding | 99.1 (98.9-99.2) | 41.9 (29.5-55.2) | 99.3 (99.2-99.5) | 21.9 (14.8-30.4) | 99.7 (99.6-99.8) | 0.28 (0.20-0.37) |
Abbreviations: MI, myocardial infarction; NPV, negative predictive value; PPV, positive predictive value.
a
Electronic health record data were used as the criterion standard for all clinical event comparisons.
b
Restricted population excluded 600 patients with no visits after randomization and excluded EHR events that occurred after the patient’s final portal visit.