Table 6.
Agreement between Composite Assay (Combination of Survey and Automated Chart Review) and Manual Chart Review (N = 750)
| Complication | Frequency
|
Agreement
|
|||||
|---|---|---|---|---|---|---|---|
| Combined Review Negative; Manual Review Negative | Combined Review Negative; Manual Review Positive | Combined Review Positive; Manual Review Negative | Combined Review Positive; Manual Review Positive | Positive Agreement (%) | Negative Agreement (%) | Kappa (95% CI) | |
| Myocardial infarction | 740 | 0 | 10 | 0 | 0 | > 99 | — |
| Cardiac arrest | 744 | 0 | 6 | 0 | 0 | > 99 | — |
| Congestive heart failure | 720 | 1 | 28 | 1 | 7 | 98 | 0.06 (−0.06 to 0.18) |
| Arrhythmia | 640 | 5 | 67 | 38 | 51 | 95 | 0.47 (0.37 to 0.57) |
| Angina | 739 | 2 | 8 | 1 | 17 | > 99 | 0.16 (−0.12 to 0.45) |
| Stroke | 733 | 0 | 13 | 4 | 38 | > 99 | 0.38 (0.11 to 0.64) |
| Deep venous thrombosis | 728 | 2 | 15 | 5 | 37 | 99 | 0.36 (0.13 to 0.59) |
| Pulmonary embolism | 735 | 0 | 12 | 3 | 33 | > 99 | 0.33 (0.05 to 0.61) |
| Wound infection | 698 | 7 | 43 | 2 | 7 | 97 | 0.06 (−0.04 to 0.15) |
| Respiratory arrest | 743 | 0 | 7 | 0 | 0 | 100 | — |
| Respiratory failure | 728 | 0 | 20 | 2 | 17 | 99 | 0.16 (−0.03 to 0.36) |
| Pneumonia | 715 | 0 | 31 | 4 | 21 | 98 | 0.20 (0.03 to 0.36) |
| Kidney failure requiring dialysis | 733 | 0 | 15 | 2 | 21 | 99 | 0.21 (−0.04 to 0.45) |
| Nerve injury | 682 | 6 | 56 | 6 | 16 | 96 | 0.14 (0.03 to 0.25) |
| Gastrointestinal bleed | 726 | 1 | 22 | 1 | 8 | 98 | 0.08 (−0.07 to 0.22) |
| Peptic ulcer | 742 | 1 | 7 | 0 | 0 | > 99 | 0.00 (−0.01 to 0.00) |
| Severe pain > 1 day | 462 | 97 | 112 | 79 | 43 | 82 | 0.25 (−0.17 to 0.32) |
| Severe nausea/vomiting > 1 day | 526 | 79 | 52 | 93 | 59 | 89 | 0.48 (0.40 to 0.55) |
Note that these 750 patients are a subset of the 1,578 patients shown in table 3. Kappa is undefined if either the composite assay or the manual chart review identifies zero cases of a particular complication.