Table 11:
Performance metrics calculated for ensemble of submissions as described in Section 4.3 The “Top 3 Team” shows the ensemble generated from submissions of top 3 teams. The “All Teams” ensemble uses submissions from all teams. For each team in both ensembles, only the best run is used. So, all ensembles in “Top 3 Teams” are ensembles of three different systems.
| Shared | Top 3 teams | All Teams | ||||
|---|---|---|---|---|---|---|
| Task | Recall | Precision | F-score | Recall | Precision | F-score |
| Task 1:NER | 0.8334 | 0.87297 | 0.8527 | 0.7847 | 0.9094 | 0.8425 |
| Task 2:RI | 0.8935 | 0.8625 | 0.8777 | 0.8782 | 0.7845 | 0.8287 |
| Task 3:NER-RI | 0.5841 | 0.7616 | 0.6612 | 0.4633 | 0.8580 | 0.6017 |