Table 5.
Average performances of the R-BERT (Bidirectional Encoder Representations from Transformers) models on data sets with different properties (the binary relation data set yields the best F1-score).
| Data set properties and category | F1-score, mean (SD) | |
| Split ratio for training and test data sets | ||
|
|
90%:10% | 0.9297 (0.0078) |
|
|
80%:20% | 0.9248 (0.0078) |
| Relation set | ||
|
|
Binary relation set | 0.9466 (0.0048) |
|
|
Quaternary relation set | 0.9078 (0.0110) |
| Ordered entity pair of drug and suicidal entities | ||
|
|
Yes | 0.9284 (0.0058) |
|
|
No | 0.9260 (0.0103) |