Table 5.
Agreement between Automated and Manual Chart Review (N = 750)
| Complication | Frequency
|
Agreement
|
|||||
|---|---|---|---|---|---|---|---|
| Automated Review Negative; Manual Review Negative | Automated Review Negative; Manual Review Positive | Automated Review Positive; Manual Review Negative | Automated Review Positive; Manual Review Positive | Positive Agreement (%) | Negative Agreement (%) | Kappa (95% CI) | |
| Myocardial infarction | 746 | 0 | 4 | 0 | 0 | > 99 | — |
| Cardiac arrest | 749 | 0 | 1 | 0 | 0 | > 99 | — |
| Congestive heart failure | 736 | 1 | 12 | 1 | 13 | 99 | 0.13 (−0.10 to 0.36) |
| Arrhythmia | 686 | 17 | 21 | 26 | 58 | 97 | 0.55 (0.42 to 0.68) |
| Angina | 746 | 3 | 1 | 0 | 0 | > 99 | 0.00 (0.00 to 0.00) |
| Stroke | 738 | 0 | 8 | 4 | 50 | > 99 | 0.50 (0.19 to 0.80) |
| Deep venous thrombosis | 743 | 7 | 0 | 0 | 0 | > 99 | — |
| Pulmonary embolism | 738 | 0 | 9 | 3 | 40 | > 99 | 0.40 (0.08 to 0.71) |
| Wound infection | 729 | 8 | 12 | 1 | 9 | 98 | 0.08 (−0.09 to 0.24) |
| Respiratory arrest | 750 | 0 | 0 | 0 | 0 | 100 | — |
| Respiratory failure | 746 | 1 | 2 | 1 | 40 | > 99 | 0.40 (−0.15 to 0.94) |
| Pneumonia | 724 | 2 | 22 | 2 | 14 | 98 | 0.13 (−0.04 to 0.31) |
| Kidney failure requiring dialysis | 745 | 1 | 3 | 1 | 33 | > 99 | 0.33 (−0.16 to 0.82) |
| Nerve injury | 713 | 11 | 25 | 1 | 5 | 97 | 0.03 (−0.07 to 0.13) |
| Gastrointestinal bleed | 733 | 2 | 15 | 0 | 0 | 99 | 0.00 (−0.01 to 0.00) |
| Peptic ulcer | 749 | 1 | 0 | 0 | 0 | > 99 | — |
| Severe pain > 1 day | 571 | 175 | 3 | 1 | 1 | 87 | 0.00 (−0.02 to 0.02) |
| Severe nausea/vomiting > 1 day | 550 | 90 | 28 | 82 | 58 | 90 | 0.49 (0.41 to 0.57) |
Note that these 750 patients are a subset of the 1,578 patients shown in table 3. Kappa is undefined if either the automated or the manual chart review identifies zero cases of a particular complication.