Table 3.
Performance characteristics of an auto-populating electronic Pulmonary Embolism Severity Index
| Index Variable | Values n | Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | NPV (95% CI) | Accuracy % (95% CI) | Cases needing editing (N=593) N (%; 95% CI) | Reason for prevalent inaccuracies |
|---|---|---|---|---|---|---|---|---|
| All 11 variables | 6,523 | 96.9 (96.0–97.9) |
99.8 (99.7–99.9) |
99.1 (98.6–99.6) |
99.2 (99.0–99.5) |
99.2 (99.0–99.4) |
47 (7.9; 6.0–10.4) |
|
| Demographics | 1,186 | 100.0 | 100.0 | 100.0 | 100.0 |
100.0 (99.6–100.0) |
0 (0; 0–0.8) |
|
| Age | 593 | 100.0 | -- | 100.0 | -- | 100.0 (99.2–100.0) |
||
| Sex (male) | 593 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 (99.2–100.0) |
||
| Comorbidities | 1,779 |
87.1 (82.2–92.0) |
99.4 (99.0–99.8) |
93.9 (90.3–97.6) |
98.6 (98.0–99.2) |
98.1 (97.4–98.7) |
33 (5.6; 4.0–7.7) |
Problem List incomplete or erroneous |
| Cancer | 593 | 70.0 (53.6–86.4) |
99.8 (99.5–100.0) |
95.5 (86.8–100.0) |
98.4 (97.4–99.4) |
98.3 (96.9–99.1) |
||
| Heart failure | 593 | 83.3 (72.1–94.6) |
99.6 (99.1–100.0) |
94.6 (87.3–100.0) |
98.7 (97.8–99.7) |
98.5 (97.1–99.3) |
||
| Chronic lung disease | 593 | 93.4 (88.7–98.1) |
98.6 (97.5–99.6) |
93.4 (88.7–98.1) |
98.6 (97.5–99.6) |
97.6 (96.0–98.6) |
||
| Vital signs | 2,965 |
95.3 (92.8–97.9) |
100.0 |
99.6 (98.8–100.0) |
99.6 (99.3–99.8) |
99.6 (99.2–99.8) |
13 (2.2; 1.3–3.8) |
Inaccessibility of pre-arrival and unstructured values |
| Pulse | 593 | 99.1 (97.2–100.0) |
100.0 | 100.0 | 99.8 (99.3–99.8) |
99.8 (98.9–100.0) |
||
| Systolic blood pressure | 593 | 97.0 (92.9–100.0) |
100.0 | 100.0 | 99.6 (99.1–100.0) |
99.7 (98.7–100.0) |
||
| Respiratory rate | 593 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 (99.2–100.0) |
||
| Temperature | 593 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 (99.2–100.0) |
||
| Arterial oxygen saturation | 593 | 81.6 (70.8–92.5) |
99.8 (99.5–100.0) |
97.6 (92.8–100.0) |
98.4 (97.3–99.4) |
98.3 (96.9–99.1) |
||
| Altered mental status (AMS) | 593 |
44.4 (12.0–76.9) |
100.0 | 100.0 |
99.2 (98.4–99.9) |
99.2 (98.0–99.7) |
5 (0.8; 0.3–2.0) |
Insensitivity of our AMS identification formula |
Sens, sensitivity; Spec, specificity; PPV, positive predictive value; NPV, negative predictive value; CI, confidence interval