Skip to main content
. 2021 Dec 1;9(12):e26407. doi: 10.2196/26407

Table 2.

Overall concept extraction performances from the free-text section of Chinese adverse drug reaction (ADR) reports.

Model Precision (%), mean (SD) Recall (%), mean (SD) F1 score (%), mean (SD)
CRFa ++ [21] 94.4 (0.32) 93.1 (0.28) 93.9 (0.08)
Word2Vec + Bi-LSTMb-CRF [21] 94.6 (0.33) 94.1 (0.30) 94.4 (0.29)
BERTc + Bi-LSTM-CRF-Radical 95.2 (0.07) 95.2 (0.07) 95.2 (0.06)
Fine-tuning BERT + Bi-LSTM-CRF 96.0 (0.05) 95.5 (0.08) 96.0 (0.06)
Fine-tuning BBCd-Radical 96.4 (0.04) 96.0 (0.03) 96.2 (0.04)

aCRF: conditional random field.

bBi-LSTM: bidirectional long short-term memory.

cBERT: Bidirectional Encoder Representations from Transformers.

dBBC: BERT-Bi-LSTM-CRF.