Table 7.
Results of our five runs submitted to the challenge, as well as the median and average.
Configuration | Entity Pair (P/R/F%) | + Relation (P/R/F%) | + Novel (P/R/F%) | ||||||
---|---|---|---|---|---|---|---|---|---|
run0 | 66.06 | 78.33 | 71.67 | 46.82 | 57.05 | 51.43 | 36.19 | 44.71 | 40.00 |
run1 | 63.91 | 85.72 | 73.22 | 47.23 | 65.98 | 55.05 | 36.88 | 53.00 | 43.50 |
run2 | 59.75 | 88.96 | 71.48 | 43.67 | 68.79 | 53.42 | 33.68 | 54.77 | 41.71 |
run3 | 64.52 | 86.19 | 73.79 | 47.28 | 65.40 | 54.88 | 36.68 | 51.87 | 42.97 |
run4 | 66.18 | 84.63 | 74.27 | 48.26 | 63.27 | 54.76 | 37.76 | 50.37 | 43.16 |
Median | 77.93 | 69.65 | 73.56 | 51.64 | 54.79 | 53.17 | 41.61 | 39.88 | 40.73 |
Average | 69.22 | 68.6 | 67.03 | 49.01 | 48.39 | 47.74 | 36.15 | 35.73 | 35.22 |
Results are presented in terms of F1 score. The best scores are highlighted in bold.