Table 7.
Results from the first ranked system (Sydney), customized MedEx system, CRF (all features), SVM (all features) systems, Simple Majority, Local CRF-based and SVM-based voting on the test set from the 2009 i2b2 challenge: “m” stands for medication, “do” for dosage, “mo” for mode, “f” for frequency, “du” for duration, “r” for reason
| ALL | m | do | mo | f | du | r | ||
|---|---|---|---|---|---|---|---|---|
|
Sydney |
Pre |
93.78 |
93.51 |
94.78 |
96.45 |
96.59 |
69.71 |
76.04 |
| |
Re |
85.03 |
88.31 |
88.91 |
91.28 |
91.25 |
40.93 |
38.83 |
| |
F-score |
89.19 |
90.84 |
91.75 |
93.80 |
93.85 |
51.58 |
51.41 |
|
Customized MedEx |
Pre |
89.51 |
89.97 |
94.95 |
96.23 |
92.18 |
50.94 |
62.31 |
| |
Re |
84.95 |
89.68 |
84.04 |
88.14 |
89.80 |
60.62 |
47.87 |
| |
F-score |
87.17 |
89.83 |
89.16 |
92.01 |
90.97 |
55.36 |
54.14 |
|
CRF |
Pre |
94.11 |
93.71 |
95.92 |
97.26 |
95.60 |
71.88 |
77.52 |
| |
Re |
84.89 |
89.19 |
87.37 |
90.19 |
90.73 |
38.86 |
40.97 |
| |
F-score |
89.26 |
91.39 |
91.44 |
93.59 |
93.10 |
50.45 |
53.63 |
|
SVM |
Pre |
93.35 |
93.98 |
94.79 |
96.56 |
95.37 |
68.73 |
68.54 |
| |
Re |
85.42 |
89.18 |
88.73 |
91.01 |
91.71 |
38.34 |
40.75 |
| |
F-score |
89.21 |
91.51 |
91.66 |
93.71 |
93.50 |
49.22 |
51.12 |
|
Simple Majority Voting |
Pre |
93.91 |
93.62 |
95.86 |
97.23 |
95.58 |
72.73 |
75.90 |
| |
Re |
85.76 |
90.19 |
87.62 |
90.44 |
91.20 |
44.21 |
43.67 |
| |
F-score |
89.65 |
91.87 |
91.55 |
93.71 |
93.34 |
54.99 |
55.44 |
|
Local CRF-Based Voting |
Pre |
94.20 |
93.96 |
94.84 |
96.56 |
95.27 |
74.07 |
83.39 |
| |
Re |
85.11 |
89.18 |
88.80 |
91.01 |
91.71 |
34.54 |
37.13 |
| |
F-score |
89.42 |
91.51 |
91.72 |
93.71 |
93.46 |
47.11 |
51.38 |
|
Local SVM-Based Voting |
Pre |
93.03 |
94.06 |
94.77 |
96.56 |
95.37 |
66.94 |
65.83 |
| |
Re |
85.76 |
89.18 |
88.71 |
90.98 |
91.66 |
42.66 |
44.52 |
| F-score | 89.24 | 91.55 | 91.64 | 93.69 | 93.48 | 52.11 | 53.12 |