Table 1:
Performance of fine-tuned BioBERT-base models with ClinVar data compared to a pre-trained BioBERT-base model that has not been fine-tuned using ClinVar data on test data from the raw-data dataset.
| Model | Accuracy | Precision | Recall | F1 Score | AUC-ROC |
|---|---|---|---|---|---|
|
| |||||
| BioBERT-base + ClinVar (evidence-only) | 0.9720 | 0.9721 | 0.9702 | 0.9711 | 0.9974 |
| BioBERT-base + ClinVar (rule-based) | 0.9805 | 0.9795 | 0.9802 | 0.9798 | 0.9987 |
| BioBERT-base + ClinVar (raw-data) | 0.7207 | 0.8157 | 0.7193 | 0.7264 | 0.9500 |
| BioBERT-base [9] | 0.3760 | 0.1601 | 0.3133 | 0.1919 | 0.5122 |