Table 9.
Teams | Gold standard (50 selected articles) | Silver standard (50 selected articles) | Silver standard (All 507 articles) | |||||||
---|---|---|---|---|---|---|---|---|---|---|
TAP-5 | TAP-10 | TAP-20 | TAP-5 | TAP-10 | TAP-20 | TAP-5 | TAP-10 | TAP-20 | ||
Kuo et al. (Team 74) | 1st run | 0.2137 | 0.2509 | 0.2509 | 0.3820 | 0.3820 | 0.3820 | 0.4873 | 0.4873 | 0.4873 |
2nd run | 0.2083 | 0.2480 | 0.2480 | 0.3855 | 0.3855 | 0.3855 | 0.4871 | 0.4871 | 0.4871 | |
3rd run | 0.2099 | 0.2495 | 0.2495 | 0.3890 | 0.3890 | 0.3890 | 0.4916 | 0.4916 | 0.4916 | |
Our method (Team 83) | 1st run | 0.3254 | 0.3538 | 0.3535 | 0.3567 | 0.3600 | 0.3600 | 0.4591 | 0.4591 | 0.4591 |
2nd run | 0.3216 | 0.3435 | 0.3435 | 0.3291 | 0.3291 | 0.3291 | 0.4323 | 0.4323 | 0.4323 | |
3rd run | 0.3297 | 0.3514 | 0.3514 | 0.3382 | 0.3382 | 0.3382 | 0.4327 | 0.4327 | 0.4327 | |
Liu et al. (Team 98) | 1st run | 0.2835 | 0.3012 | 0.3103 | 0.3343 | 0.3535 | 0.3629 | 0.3818 | 0.3899 | 0.3875 |
2nd run | 0.2909 | 0.3079 | 0.3087 | 0.3354 | 0.3543 | 0.3634 | 0.3790 | 0.3878 | 0.3868 | |
3rd run | 0.3013 | 0.3183 | 0.3303 | 0.3710 | 0.4116 | 0.4672 | 0.4086 | 0.4511 | 0.4648 | |
Lai et al. (Team 101) | 1st run | 0.1896 | 0.2288 | 0.2385 | 0.3590 | 0.3859 | 0.3859 | 0.4289 | 0.4289 | 0.4289 |
2nd run | 0.1672 | 0.2150 | 0.2418 | 0.3239 | 0.3945 | 0.4132 | 0.4294 | 0.4408 | 0.4408 | |
3rd run | 0.1812 | 0.2141 | 0.2425 | 0.3258 | 0.4109 | 0.4109 | 0.4536 | 0.4536 | 0.4536 |