Skip to main content
. Author manuscript; available in PMC: 2013 Dec 1.
Published in final edited form as: J Biomed Inform. 2012 Jun 9;45(6):1042–1048. doi: 10.1016/j.jbi.2012.05.006

Table 2.

Performance for various majority opinion levels measured by the 2008AA reference standard

Experimental
Condition
Unanimous Strong
majority
Weak
majority
Unanimous
+ Strong
Majoriyt
Unanimous
+ Strong
Majority +
Weak
Majority
# of concepts
identified without
error by auditors
9 30 10 39 49
# of the concepts in
row above
confirmed without
error by NLM
0 8 3 8 11
# of concepts
identified with
error by auditors
31 58 40 89 129
# of the concepts in
row above
confirmed with
error by NLM
14 40 29 54 83
Total # of concepts
with a majority
40 88 50 128 178
2008AA reference
standard
without
error
13 22 10 35 45
with
error
27 66 40 93 133