Skip to main content
. 2019 Jul 11;26(11):1314–1322. doi: 10.1093/jamia/ocz102

Table 4.

Characteristics of annotation processes for 9 users for Random Sampling (PL) and Cost-CAUSE (AL) in each 120-minute annotation

User Method Number of sentences F1 Entities per sentence Words per sentence Entity words per sentence Entity density Time Words per minute
User1 PL 920 0.79 1.40 11.37 2.97 0.26 119.97 87.16
AL 664 0.71 2.06 12.80 4.39 0.34 120.22 70.71
User2 PL 553 0.77 1.44 11.48 2.98 0.26 119.41 53.18
AL 415 0.72 2.17 12.33 4.50 0.36 120.64 42.43
User3 PL 766 0.79 1.34 10.73 2.74 0.26 119.88 68.58
AL 525 0.71 1.98 12.16 3.95 0.32 120.19 53.13
User4 PL 842 0.82 1.42 11.64 3.03 0.26 119.56 81.97
AL 550 0.74 2.38 14.47 4.78 0.33 120.44 66.10
User5 PL 910 0.83 1.43 12.15 3.12 0.26 119.85 92.22
AL 616 0.78 2.44 14.29 4.88 0.34 120.44 73.07
User6 PL 745 0.80 1.41 11.51 2.99 0.26 120.01 71.44
AL 570 0.74 2.06 11.20 4.32 0.39 120.22 53.11
User7 PL 435 0.75 1.27 11.11 2.63 0.24 119.46 40.47
AL 388 0.78 1.86 10.26 3.42 0.33 120.56 33.01
User8 PL 875 0.79 1.38 10.95 2.81 0.26 119.95 79.89
AL 637 0.77 2.00 11.90 3.83 0.32 120.10 63.10
User9 PL 617 0.84 1.44 11.45 2.93 0.26 120.23 58.77
AL 445 0.78 2.28 12.52 4.69 0.37 120.04 46.42

Abbreviations: AL, active learning; PL, passive learning.