Table 8.
Performance comparisons (F-score) with top-ranking systems on the three datasets
| Method | Team | DB-2013 | ML-2013 | Overall-2013 | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| P(%) | R(%) | F(%) | P(%) | R(%) | F(%) | P(%) | R(%) | F(%) | ||
| SVM | RAIHANI [17] | – | – | 74.0 | – | – | 43.0 | 73.7 | 68.7 | 71.1 |
| Context-Vector [15] | – | – | 72.4 | – | – | 52.0 | – | – | 68.4 | |
| Kim [16] | – | – | 69.8 | – | – | 38.2 | – | – | 67.0 | |
| FBK-irst [11] | 66.7 | 68.6 | 67.6 | 41.9 | 37.9 | 39.8 | 64.6 | 65.6 | 65.1 | |
| WBI [12] | 65.7 | 60.9 | 63.2 | 45.3 | 30.5 | 36.5 | 64.2 | 57.9 | 60.9 | |
| UTurku [14] | 73.8 | 53.5 | 62.0 | 59.3 | 16.8 | 26.2 | 73.2 | 49.9 | 59.4 | |
| NN | MCCNN [21] | – | – | 70.8 | – | – | – | 76.0 | 65.3 | 70.2 |
| Liu CNN [22] | 77.0 | 66.7 | 71.5 | 61.4 | 45.3 | 52.1 | 75.7 | 64.7 | 69.8 | |
| Zhao SCNN [23] | 73.6 | 67.0 | 70.2 | 39.4 | 39.1 | 39.2 | 72.5 | 65.1 | 68.6 | |
| Ours | Att-BLSTM | 78.9 | 75.7 | 77.3 | 71.8 | 59.0 | 64.7 | 78.4 | 76.2 | 77.3 |
The highest scores are highlighted in bold