Skip to main content
. Author manuscript; available in PMC: 2020 Jun 1.
Published in final edited form as: Int J Med Inform. 2019 Mar 5;126:19–25. doi: 10.1016/j.ijmedinf.2019.03.002

Table 2.

Coding time, consistency and accuracy for usual and map-assisted coding

Usual coding Map-assisted coding
Metric Mean (SD) Mean (SD)
Coding time (minute)
Coder 1 8.51 (5.86) 8.62 (6.89)
Coder 2 8.68 (3.63) 9.13 (4.95)
Coder 3 8.85 (4.85) 8.02 (4.6)
Coder 4 9.78 (8.11) 4.11 (2.61)
All coders 8.95 (5.81) 7.48 (5.34)

Coding consistency (Jaccard coefficient)
All coders 0.53 (0.27) 0.6 (0.27)

Coding accuracy
Recall
Coder 1 0.83 (0.2) 0.85 (0.2)
Coder 2 0.82 (0.19) 0.8 (0.2)
Coder 3 0.84 (0.16) 0.86 (0.16)
Coder 4 0.72 (0.25) 0.76 (0.22)
All coders 0.8 (0.21) 0.81 (0.2)
Precision
Coder 1 0.78 (0.21) 0.79 (0.23)
Coder 2 0.86 (0.17) 0.82 (0.18)
Coder 3 0.75 (0.18) 0.81 (0.19)
Coder 4 0.78 (0.23) 0.83 (0.2)
All coders 0.79 (0.2) 0.81 (0.2)
F-score
Coder 1 0.79 (0.2) 0.81 (0.2)
Coder 2 0.84 (0.18) 0.8 (0.18)
Coder 3 0.78 (0.16) 0.82 (0.16)
Coder 4 0.73 (0.26) 0.78 (0.2)
All coders 0.79 (0.19) 0.80 (0.19)