Table 9.
Average ranks for each system and each batch of phase B of Task 1b, for the “exact” answers
| System | Batch 1 | Batch 2 | Batch 3 |
|---|---|---|---|
| Wishart-S1 | 2.0 | 1.0 | - |
| Wishart-S2 | 2.0 | - | - |
| Wishart-S3 | 2.0 | - | - |
| Baseline1 | 4.66 | 2.33 | 2.33 |
| Baseline2 | 4.33 | 4.0 | 2.66 |
| main system | 6.0 | 4.33 | 3.0 |
| system 2 | - | 5.33 | 3.33 |
| system 3 | - | 5.5 | 3.66 |
| system 4 | - | 5.5 | - |
The final rank is calculated across the individual ranks of the systems for the different types of questions. A dash symbol (-) is used whenever the system did not participate to the corresponding batch.