Table 9.
Prediction samples from BERT and BioBERT on NER and QA datasets
| Task | Dataset | Model | Sample |
|---|---|---|---|
| NER | NCBI disease | BERT | WT1 missense mutations, associated with male pseudohermaphroditism in Denys–Drash syndrome, fail to … |
| BioBERT | WT1 missense mutations, associated with male pseudohermaphroditism in Denys–Drash syndrome, fail to … | ||
| BC5CDR (Drug/Chem.) | BERT | … a case of oral penicillin anaphylaxis is described, and the terminology … | |
| BioBERT | … a case of oral penicillin anaphylaxis is described, and the terminology … | ||
| BC2GM | BERT | Like the DMA, but unlike all other mammalian class II A genes, the zebrafish gene codes for two cysteine residues … | |
| BioBERT | Like the DMA, but unlike all other mammalian class II A genes, the zebrafish gene codes for two cysteine residues … | ||
| QA | BioASQ 6b-factoid | Q: Which type of urinary incontinence is diagnosed with the Q tip test? | |
| BERT | A total of 25 women affected by clinical stress urinary incontinence (SUI) were enrolled. After undergoing (…) Q-tip test, … | ||
| BioBERT | A total of 25 women affected by clinical stress urinary incontinence (SUI) were enrolled. After undergoing (…) Q-tip test, … | ||
| Q: Which bacteria causes erythrasma? | |||
| BERT | Corynebacterium minutissimum is the bacteria that leads to cutaneous eruptions of erythrasma … | ||
| BioBERT | Corynebacterium minutissimum is the bacteria that leads to cutaneous eruptions of erythrasma … |
Note: Predicted named entities for NER and predicted answers for QA are in bold.