Table 6.
System performance for normalized entity recognition on the EMEA test corpus. Data shown in italic font presents runs that were submitted after the official deadline. The median and average are computed solely using the official runs. A *symbol indicates statistically significant difference of a run with the runs ranked before and after it, per student test.
Team | TP | FP | FN | Precision | Recall | F-measure |
---|---|---|---|---|---|---|
Erasmus-run3.unofficial* | 1542 | 672 | 872 | 0.697 | 0.639 | 0.666 |
Erasmus-run1* | 1630 | 1709 | 1190 | 0.488 | 0.578 | 0.529 |
Erasmus-run2* | 1607 | 1732 | 1126 | 0.481 | 0.588 | 0.529 |
SIBM-run1* | 592 | 1611 | 966 | 0.269 | 0.380 | 0.315 |
SIBM-run2* | 467 | 1736 | 735 | 0.212 | 0.389 | 0.274 |
BITEM-run1* | 347 | 1856 | 430 | 0.158 | 0.447 | 0.233 |
| ||||||
average | 0.322 | 0.476 | 0.376 | |||
median | 0.269 | 0.477 | 0.315 |