Table 15.
Dataset | Measures | Our models | State-of-the-art models | ||||
---|---|---|---|---|---|---|---|
CNN-base | DE-CNN-5CV | DE-CNN-TSF | DE-CNN-TSC | DE-CNN-G1 | Combined LSTM [57] | ||
ArTwitter | Acc | 90.95 | 93.28 | 92.25 | 92.61 | 93.28 | 87.27 |
Prc | 89.76 | 93.30 | 90.85 | 91.24 | 92.14 | 87.36 | |
Rec | 93.03 | 93.74 | 94.45 | 94.75 | 95.05 | 87.27 | |
F1 | 91.32 | 93.44 | 92.57 | 92.91 | 93.55 | 87.28 | |
| |||||||
STD | CNN-base | DE-CNN-5CV | DE-CNN-TSF | DE-CNN-TSC | DE-CNN-TS-G1 | Stacking (eclf14) [21] | |
Acc | 87.24 | 88.31 | 88.36 | 88.25 | 88.14 | 85.28 | |
Prc | 80.26 | 79.66 | 80.41 | 79.07 | 79.09 | 61.04 | |
Rec | 64.82 | 71.58 | 70.69 | 72.25 | 71.36 | 67.14 | |
F1 | 71.39 | 75.33 | 75.14 | 75.36 | 74.93 | 63.95 | |
| |||||||
AAQ | CNN-base | DE-CNN-5CV | DE-CNN-TSF | DE-CNN-TSC | DE-CNN-G1 | NuCSV [7] | |
Acc | 84.69 | 87.15 | 87.43 | 88.01 | 87.50 | 80.21 | |
Prc | 83.62 | 87.38 | 86.75 | 88.08 | 86.70 | 83.00 | |
Rec | 86.48 | 87.05 | 88.49 | 88.07 | 88.77 | 76.50 | |
F1 | 85.00 | 87.16 | 87.58 | 88.03 | 87.70 | 79.62 | |
| |||||||
ASTD-B | CNN-base | DE-CNN-5CV | DE-CNN-TSF | DE-CNN-TSC | DE-CNN-G1 | Combined-LSTM [57] | |
Acc | 80.47 | 81.60 | 80.72 | 82.28 | 82.48 | 81.63 | |
Prc | 81.08 | 81.89 | 82.18 | 82.66 | 81.86 | 82.32 | |
Rec | 79.72 | 81.35 | 78.84 | 81.85 | 83.48 | 81.63 | |
F1 | 80.27 | 81.54 | 80.32 | 82.17 | 82.57 | 81.64 | |
| |||||||
AJGT | CNN-base | DE-CNN-5CV | DE-CNN-TSF | DE-CNN-TSC | DE-CNN-G1 | SVM (bigrams) [52] | |
Acc | 90.16 | 92.72 | 92.56 | 93.17 | 93.06 | 88.72 | |
Prc | 89.62 | 91.80 | 91.86 | 92.79 | 92.36 | 92.08 | |
Rec | 91.00 | 93.89 | 93.44 | 93.67 | 93.89 | 84.89 | |
F1 | 90.24 | 92.81 | 92.63 | 93.19 | 93.10 | 88.27 |