Table 2.
Best system (MCRF2) performance (F values) per document type
AGE | DATE | ID | INST | LOC | NAME | OTH | PH | All PHI | |
Asthma action plan | 100 | 96.59 | 80 | 96.47 | 100 | 95.17 | 98.11 | 69.72 | 92.19 |
Brief OpNote | 100 | 99.12 | 98.51 | 80 | 100 | 94.56 | 35.29 | 100 | 95.17 |
Communication body | 95.24 | 93.07 | 75 | 82.35 | 80 | 97.02 | 80.99 | 50 | 92.11 |
Consult note | 92.96 | 98.5 | 80 | 93.62 | 75 | 98.35 | 90 | 80 | 95.94 |
DC summaries | 92.89 | 98.12 | 98.26 | 94.54 | 77.27 | 96.37 | 75.62 | 97.96 | 94.55 |
ED medical student | 96.77 | 69.23 | 100 | 66.67 | 0 | 95.45 | 96.7 | 100 | 92.13 |
ED notes | 85.71 | 80 | 100 | 72.73 | 100 | 72.73 | 45.83 | 50 | 65.84 |
ED provider notes | 96.71 | 90.48 | 100 | 76.19 | 0 | 80 | 92.35 | 50 | 92.47 |
ED provider reassess. | 100 | 100 | 100 | 100 | 100 | 85.71 | 92.31 | 100 | 92.86 |
H&P | 92.75 | 97.31 | 80 | 87.1 | 0 | 94.51 | 83.72 | 50 | 92.55 |
Med student | 88.1 | 98.22 | 0 | 69.44 | 50 | 95.87 | 76.06 | 100 | 92.93 |
Operative report | 90.91 | 98.68 | 100 | 100 | 100 | 93.94 | 94.31 | 100 | 96.48 |
OR nursing | 100 | 100 | 100 | 100 | 100 | 88.89 | 0 | 100 | 81.82 |
Patient instructions | 100 | 94.74 | 100 | 62.5 | 66.67 | 87.91 | 55 | 90.62 | 81.51 |
Pharmacy note | 50 | 91.2 | 100 | 100 | 100 | 72 | 65.31 | 100 | 88.01 |
Plan of care note | 100 | 96.97 | 100 | 50 | 0 | 91.09 | 78.12 | 66.67 | 87.35 |
Pre-Op_evaluation | 100 | 99.37 | 100 | 100 | 100 | 94.49 | 100 | 100 | 98.6 |
Procedure note | 100 | 98.06 | 100 | 96.3 | 0 | 93.51 | 91.36 | 100 | 94.96 |
Progress notes Outp | 88.08 | 95.53 | 94.12 | 73.3 | 71.79 | 93.8 | 70.29 | 81.25 | 90.9 |
Progress notes Inp | 93.23 | 98.19 | 93.88 | 87.91 | 54.55 | 93.32 | 76.64 | 98.41 | 94.75 |
Referral | 100 | 100 | 100 | 90.91 | 0 | 100 | 100 | 100 | 93.75 |
Telephone encounter | 100 | 91.94 | 100 | 56.25 | 40 | 88.21 | 47.62 | 76.36 | 82.16 |
All labeled notes | 92.9 | 97.51 | 97.04 | 90.17 | 73.02 | 94.75 | 78.68 | 91.54 | 93.54 |
Unlabeled notes | 92.44 | 97.44 | 97.07 | 87.68 | 83.65 | 94.68 | 80.09 | 95.92 | 93.58 |
External notes | 94.87 | 96.79 | 69.57 | 63.89 | 70.59 | 85.31 | 60.71 | 82.22 | 91.88 |
All notes | 93.22 | 97.46 | 96.48 | 89.08 | 77.7 | 94.52 | 78.91 | 92.61 | 93.48 |
Zero F value is the consequence of insufficient representation of a particular PHI type in that particular note category (eg, if there was one Location PHI element in 20 notes and it was missed then the F value was zero).
DC, discharge; ED, emergency department; H&P, history and physical; OR, operating room; PHI, protected health information.