Table 2.
Performance of the models for the first task of article screening using the adjusted datasetA
| srBERTmy355K | srBERTmix | Original BERT | K-neighbors | SVC | DecisionTree | RandomForest | Adaboost | MultinomialNB | |
|---|---|---|---|---|---|---|---|---|---|
| AUC | 90.016 | 50.000 | 50.000 | 58.976 | 50.000 | 66.258 | 66.431 | 57.319 | 53.158 |
| Accuracy | 89.380 | 77.120 | 71.009 | 75.590 | 77.123 | 77.594 | 78.420 | 78.066 | 77.241 |
| Precision | 68.900 | 0.000 | 0.000 | 44.715 | 0.000 | 51.163 | 53.416 | 56.061 | 51.515 |
| Recall | 91.100 | 0.000 | 0.000 | 28.351 | 0.000 | 45.361 | 44.330 | 19.072 | 8.763 |
| F1 | 78.460 | 0.000 | 0.000 | 34.700 | 0.000 | 48.087 | 48.451 | 28.462 | 14.978 |
SR systematic review, BERT bidirectional encoder representations from transformers, srBERTmy355K srBERTmy model trained for 355 K steps, AUC area under the curve, SVC support vector classification, MultinomialNB multinomial naive Bayes model