Table 3.
Document triage task results for all submissions
| Team number | Submission | Avg prec | Precision | Recall | F1 | Data format |
|---|---|---|---|---|---|---|
| 374 | Run 1 | 0.6616 | 0.5864 | 0.8338 | 0.6886 | JSON |
| Run 2 | 0.6677 | 0.5700 | 0.8736 | 0.6898 | JSON | |
| Run 3 | 0.6929 | 0.6070 | 0.7898 | 0.6864 | JSON | |
| 375 | Run 1 | 0.6822 | 0.5783 | 0.7713 | 0.6610 | JSON |
| Run 2 | 0.6722 | 0.5936 | 0.7116 | 0.6473 | JSON | |
| Run 3 | 0.6744 | 0.5361 | 0.8849 | 0.6677 | JSON | |
| 379 | Run 1 | 0.4904 | 0.4649 | 0.3480 | 0.3981 | XML |
| 405 | Run 1 | 0.5871 | 0.5484 | 0.5710 | 0.5595 | JSON |
| 414 | Run 1 | 0.4847 | 0.4734 | 0.5824 | 0.5223 | XML |
| Run 2 | 0.5057 | 0.4927 | 0.7202 | 0.5851 | XML | |
| Run 3 | 0.5077 | 0.5022 | 0.9801 | 0.6641 | XML | |
| 418 | Run 1 | 0.6959 | 0.6136 | 0.7670 | 0.6818 | XML |
| Run 2 | 0.7068 | 0.5944 | 0.8139 | 0.6871 | XML | |
| Run 3 | 0.7158 | 0.6289 | 0.7656 | 0.6906 | XML | |
| 419 | Run 1 | 0.5797 | 0.5713 | 0.8253 | 0.6752 | XML |
| Run 2 | 0.5986 | 0.5865 | 0.6065 | 0.5964 | XML | |
| Run 3 | 0.6334 | 0.5992 | 0.6222 | 0.6105 | XML | |
| 420 | Run 1 | 0.6439 | 0.5438 | 0.8736 | 0.6703 | JSON |
| 421 | Run 1 | 0.6678 | 0.5850 | 0.8111 | 0.6798 | XML |
| Run 2 | 0.7253 | 0.6073 | 0.7997 | 0.6904 | XML | |
| Run 3 | 0.7084 | 0.5857 | 0.8352 | 0.6885 | XML | |
| 433 | Run 1 | 0.6632 | 0.5413 | 0.8835 | 0.6713 | JSON |
| BASELINE | - | 0.6515 | 0.6122 | 0.6435 | 0.6274 | - |