Table 3.
Agreement between Survey and Automated Chart Review (N = 1,578)
| Complication | Frequency
|
Agreement
|
|||||
|---|---|---|---|---|---|---|---|
| Survey Negative; Chart Review Negative | Survey Negative; Chart Review Positive | Survey Positive; Chart Review Negative | Survey Positive; Chart Review Positive | Positive Agreement (%) | Negative Agreement (%) | Kappa (95% CI) | |
| Myocardial infarction | 1,566 | 5 | 6 | 1 | 15 | > 99 | 0.15 (−0.12 to 0.42) |
| Cardiac arrest | 1,571 | 2 | 5 | 0 | 0 | > 99 | 0.00 (0.00 to 0.00) |
| Congestive heart failure | 1,545 | 10 | 16 | 7 | 35 | 99 | 0.34 (0.15 to 0.53) |
| Arrhythmia | 1,461 | 31 | 58 | 28 | 39 | 97 | 0.36 (0.25 to 0.46) |
| Angina | 1,568 | 2 | 8 | 0 | 0 | > 99 | 0.00 (0.00 to 0.00) |
| Stroke | 1,555 | 12 | 5 | 6 | 41 | 99 | 0.41 (0.18 to 0.64) |
| Deep venous thrombosis | 1,558 | 0 | 20 | 0 | 0 | 99 | — |
| Pulmonary embolism | 1,560 | 10 | 3 | 5 | 43 | > 99 | 0.43 (0.18 to 0.69) |
| Wound infection | 1,526 | 16 | 32 | 4 | 14 | 98 | 0.13 (0.00 to 0.25) |
| Respiratory arrest | 1,571 | 0 | 7 | 0 | 0 | > 99 | — |
| Respiratory failure | 1,556 | 0 | 19 | 3 | 24 | 99 | 0.24 (0.02 to 0.46) |
| Pneumonia | 1,531 | 26 | 11 | 10 | 35 | 99 | 0.34 (0.18 to 0.50) |
| Kidney failure requiring dialysis | 1,561 | 1 | 13 | 3 | 30 | > 99 | 0.30 (0.04 to 0.56) |
| Nerve injury | 1,478 | 62 | 36 | 2 | 4 | 97 | 0.01 (−0.04 to 0.06) |
| Gastrointestinal bleed | 1,546 | 22 | 8 | 2 | 12 | 99 | 0.11 (−0.04 to 0.26) |
| Peptic ulcer | 1,571 | 0 | 7 | 0 | 0 | > 99 | — |
| Severe pain > 1 day | 1,387 | 3 | 187 | 1 | 1 | 94 | 0.01 (−0.01 to 0.02) |
| Severe nausea/vomiting > 1 day | 1,365 | 150 | 35 | 28 | 23 | 94 | 0.18 (0.11 to 0.26) |
Kappa is undefined if either the survey or the chart review identifies zero cases of a particular complication.