Table 1.
Performance of the “AutoDiscrepancy” script in discriminating “agreement” reports from “discrepancy” reports
| Emergency department | Inpatient | |
|---|---|---|
| Total number of studies | 2,428 | 7,293 |
| Overall discrepancies correctly identified by the Autodiscrepancy code | 186/228 (81.6%) | 347/467 (74.3%) |
| Major discrepancies correctly identified by the Autodiscrepancy code | 64/78 (82.1%) | 106/124 (85.5%) |
| Minor discrepancies correctly identified by the Autodiscrepancy code | 122/150 (81.3%) | 241/343 (70.3%) |
| Agreements correctly identified by the Autodiscrepancy code | 1,764/2,200 (80.2%) | 5,917/6,826 (86.7%) |
| Agreements INCORRECTLY identified as discrepancies by the Autodiscrepancy code | 436/2,200 (19.8%) | 909/6,826 (13.3%) |
| Discrepancies INCORRECTLY identified as agreement by the Autodiscrepancy code | 42/228 (18.4%) | 120/467 (25.7%) |
| Overall true-negative rate | 80.20% | 86.70% |
| Overall true-positive rate | 81.60% | 74.30% |
| Major discrepancy true-positive rate | 82.10% | 85.50% |
| Major discrepancy true-positive rate | 81.30% | 70.30% |
| Overall false-negative rate | 18.40% | 25.70% |