Table 2.
Performance metrics of the CRF NER model on the 213 final evaluation documents
| Label | Standard resources | Extended resources | ||||
|---|---|---|---|---|---|---|
| Precision | Recall | F1 | Precision | Recall | F1 | |
| Route | 94.4 | 87.4 | 90.8 | 94.8 | 89.5 | 92.1 |
| Drug | 90.1 | 83.7 | 86.8 | 91.1 | 86.1 | 88.6 |
| Dose | 89.2 | 83.5 | 86.3 | 89.8 | 85.4 | 87.5 |
| Frequency | 85.2 | 79.2 | 82.1 | 88.7 | 83.2 | 85.8 |
| Severity | 86.8 | 77.3 | 81.8 | 87.3 | 75.7 | 81.0 |
| SSLIF | 79.1 | 80.2 | 79.7 | 80.1 | 80.4 | 80.2 |
| Duration | 75.4 | 69.1 | 72.2 | 74.6 | 68.4 | 71.4 |
| ADE | 75.7 | 32.5 | 45.5 | 75.8 | 38.5 | 51.1 |
| Indication | 63.2 | 33.8 | 44.1 | 67.0 | 38.7 | 49.1 |
| Overall micro | 82.8 | 76.7 | 79.6 | 83.8 | 78.1 | 80.9 |
ADE adverse drug event, CRF conditional random field, NER named entity recognition, SSLIF other signs, symptoms, and diagnoses