TABLE IV.
Comparison of Models with Precision (P), Recall (R), F-score (F), Accuracy AND MCC. averaged over 10-fold cross-validation.
| Model | P | R | F | Accuracy | MCC |
|---|---|---|---|---|---|
| Word2Vec + AdaBoost | 0.76 | 0.83 | 0.80 | 0.75 | 0.46 |
| Word2Vec + RF | 0.83 | 0.82 | 0.82 | 0.79* | 0.57 |
| Word2Vec + GradientBoost | 0.78 | 0.81 | 0.80 | 0.75 | 0.48 |
| LSTM | 0.68 | 0.91 | 0.78 | 0.71 | 0.47 |
| GRU | 0.66 | 0.83 | 0.73 | 0.67 | 0.44 |
| BERT | 0.88 | 0.73 | 0.80 | 0.76* | 0.51 |