Table 2.
Micro precision, recall and F-measure for different system configurations, with highest value for each measure per category in bold
| Acc | BAC |
CON |
EXP |
GOA |
MET |
MOT |
OBS |
RES |
MOD |
OBJ |
HYP |
||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Features | Classifier | P | R | F | P | R | F | P | R | F | P | R | F | P | R | F | P | R | F | P | R | F | P | R | F | P | R | F | P | R | F | P | R | F | |
| Base | Multinomial | 14 | 19 | 19 | 19 | 9 | 9 | 9 | 10 | 10 | 10 | 1 | 1 | 1 | 11 | 11 | 11 | 1 | 1 | 1 | 13 | 14 | 14 | 21 | 22 | 21 | 9 | 9 | 9 | 3 | 3 | 3 | 2 | 2 | 2 |
| ngrams | CRFSuite | 45.3 | 45 | 60 | 51 | 35 | 28 | 31 | 72 | 74 | 73 | 42 | 17 | 24 | 29 | 28 | 28 | 24 | 11 | 15 | 49 | 49 | 49 | 43 | 43 | 43 | 49 | 47 | 48 | 42 | 26 | 32 | 24 | 12 | 16 |
| LibLinear | 39.9 | 41 | 47 | 44 | 26 | 23 | 25 | 61 | 67 | 64 | 27 | 18 | 22 | 24 | 24 | 24 | 15 | 12 | 14 | 43 | 45 | 44 | 38 | 37 | 38 | 39 | 39 | 39 | 31 | 25 | 27 | 17 | 13 | 15 | |
| LibSVM | 41.2 | 41 | 50 | 45 | 30 | 22 | 25 | 66 | 66 | 66 | 30 | 23 | 26 | 26 | 25 | 26 | 22 | 15 | 18 | 48 | 44 | 46 | 39 | 44 | 41 | 45 | 38 | 41 | 33 | 28 | 30 | 21 | 13 | 16 | |
| Hist+ngram | LibLinear | 41.2 | 44 | 52 | 47 | 29 | 27 | 28 | 68 | 70 | 69 | 32 | 19 | 24 | 26 | 26 | 26 | 15 | 12 | 13 | 44 | 45 | 45 | 40 | 38 | 39 | 43 | 42 | 42 | 31 | 23 | 26 | 17 | 12 | 14 |
| LibSVM | 44.9 | 45 | 62 | 52 | 36 | 27 | 30 | 74 | 66 | 70 | 39 | 12 | 19 | 28 | 31 | 29 | 26 | 05 | 08 | 49 | 43 | 46 | 42 | 49 | 45 | 52 | 42 | 46 | 39 | 19 | 26 | 23 | 09 | 13 | |
| All Binary | CRFSuite | 34.7 | 60 | 51 | 55 | 51 | 32 | 39 | 78 | 72 | 75 | 39 | 13 | 19 | 33 | 17 | 22 | 28 | 10 | 15 | 53 | 40 | 46 | 46 | 31 | 37 | 58 | 37 | 45 | 42 | 18 | 25 | 28 | 06 | 10 |
| LibLinear | 34.6 | 53 | 60 | 56 | 41 | 39 | 40 | 69 | 73 | 71 | 32 | 21 | 25 | 27 | 25 | 26 | 23 | 18 | 20 | 45 | 47 | 46 | 44 | 43 | 43 | 45 | 45 | 45 | 35 | 26 | 30 | 18 | 12 | 14 | |
| All Multi | CRFSuite | 50.4 | 56 | 65 | 60 | 46 | 42 | 44 | 74 | 78 | 76 | 41 | 21 | 28 | 31 | 29 | 30 | 29 | 13 | 18 | 50 | 52 | 51 | 46 | 49 | 47 | 53 | 52 | 52 | 42 | 28 | 34 | 26 | 14 | 18 |
| LibLinear | 47.7 | 54 | 60 | 57 | 43 | 40 | 41 | 69 | 73 | 71 | 35 | 20 | 25 | 29 | 28 | 28 | 22 | 16 | 18 | 47 | 49 | 48 | 45 | 44 | 45 | 49 | 49 | 49 | 38 | 28 | 32 | 21 | 15 | 18 | |
| Libsvm | 51.6 | 56 | 68 | 62 | 50 | 41 | 45 | 72 | 78 | 75 | 37 | 20 | 26 | 33 | 25 | 29 | 25 | 06 | 10 | 53 | 47 | 50 | 46 | 57 | 51 | 54 | 52 | 53 | 43 | 29 | 34 | 32 | 13 | 19 | |