TABLE 7. Performance of BioBERT and BERT With/Without Our Debiasing Method on NCBI-Disease, BC5CDRdis, and BC5CDRchem.
and
Indicate Performance Increases and Decreases When Using the Method, Respectively. The Best Scores are Highlighted in Bold.
| Overall | In-depth | |||||
|---|---|---|---|---|---|---|
| Model | P | R | F1 |
 |
 |
 |
| NCBI-disease | ||||||
| BioBERT | 86.7 | 90.5 | 88.6 | 95.5 | 80.9 | 84.1 |
| + Debias. | 85.0 | 90.2 | 87.5 | 94.2
|
81.5
|
86.1
|
| BERT | 83.8 | 87.6 | 85.6 | 95.0 | 79.0 | 70.7 |
| + Debias. | 82.0 | 87.0 | 84.5 | 93.1
|
80.0
|
73.2
|
| BC5CDRdis | ||||||
| BioBERT | 82.4 | 86.3 | 84.3 | 93.2 | 74.9 | 73.7 |
| + Debias. | 80.4 | 86.3 | 83.3 | 92.3
|
77.1
|
74.7
|
| BERT | 78.5 | 81.4 | 79.9 | 91.5 | 64.0 | 63.4 |
| + Debias. | 75.7 | 81.0 | 78.3 | 89.9
|
66.2
|
64.7
|
| BC5CDRchem | ||||||
| BioBERT | 92.1 | 93.1 | 92.6 | 97.8 | 82.1 | 87.0 |
| + Debias. | 91.2 | 93.1 | 92.1 | 97.1
|
82.8
|
88.2
|
| BERT | 89.8 | 90.0 | 89.9 | 97.0 | 72.4 | 81.1 |
| + Debias. | 87.3 | 90.7 | 89.0 | 96.6
|
73.7
|
83.9
|