Table 2.
Average performance of 10 runs on the validation set. Italics represent the best model for each performance metric.
Model | Precision (SD) | Recall (SD) | F1 score (SD) |
Random | 0.099 (0.01) | 0.103 (0.01) | 0.101 (0.01) |
SVMa | 0.386 (0) | 0.638 (0) | 0.481 (0) |
CLAPAb | 0.581 (0.03) | 0.623 (0.03) | 0.599 (0.01) |
BERTc | 0.54 (0.03) | 0.602 (0.04) | 0.567 (0.01) |
baCLAPAd | 0.603 (0.02) | 0.652 (0.03) | 0.625 (0.007) |
aSVM: support vector machine.
bCLAPA: collocated long short-term memory with attentive pooling and aggregated representation.
cBERT: bidirectional encoder representations from transformers.
dbaCLAPA: bidirectional encoder representations from transformers–assisted collocated long short-term memory with attentive pooling and aggregated representation.