Table 5. Model Comparison, in Predictive Accuracy.
| Validation |
Testing |
|||||||
|---|---|---|---|---|---|---|---|---|
| PLR |
PLR |
non-PLR |
SmPC |
|||||
| Binary | Multiclass | Binary | Multiclass | Binary | Multiclass | Binary | Multiclass | |
| RF | 0.94 | 0.81 | 0.92 | 0.81 | 0.88 | 0.73 | 0.85 | 0.66 |
| SVM | 0.95 | 0.85 | 0.93 | 0.81 | 0.88 | 0.74 | 0.85 | 0.66 |
| BERT | 0.96 | 0.88 | 0.95 | 0.84 | 0.89 | 0.74 | 0.89 | 0.67 |
| ALBERT | 0.96 | 0.87 | 0.95 | 0.84 | 0.89 | 0.72 | 0.87 | 0.66 |
| DistilBERT | 0.96 | 0.88 | 0.94 | 0.83 | 0.88 | 0.74 | 0.89 | 0.66 |
| RoBERTa | 0.97 | 0.88 | 0.95 | 0.83 | 0.89 | 0.74 | 0.90 | 0.66 |