Table 6. Performance comparison of entity relation extraction results under different systems.
| Category | BIO | BIEO | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BiLSTM + CRF | IDCNN + CRF | BiLSTM + CRF | IDCNN + CRF | ||||||||||||
| P (%) | R (%) | F1 | P (%) | R (%) | F1 | P (%) | R (%) | F1 | P (%) | R (%) | F1 | ||||
| All | 84.76 | 82.62 | 0.8387 | 84.36 | 82.31 | 0.8371 | 83.46 | 81.12 | 0.8227 | 83.61 | 82.02 | 0.8269 | |||
| Exam-disease | 84.14 | 82.72 | 0.8286 | 83.91 | 82.61 | 0.8296 | 82.11 | 81.21 | 0.8166 | 82.82 | 81.98 | 0.8206 | |||
| Exam-exam results | 82.12 | 81.42 | 0.8260 | 81.81 | 80.92 | 0.8206 | 80.21 | 79.92 | 0.8006 | 80.81 | 79.72 | 0.8010 | |||
| Location-symptoms | 85.99 | 87.51 | 0.8691 | 86.79 | 87.93 | 0.8691 | 85.19 | 86.23 | 0.8571 | 84.89 | 86.53 | 0.8681 | |||
| Location-exam results | 83.42 | 82.86 | 0.8197 | 81.82 | 82.46 | 0.8195 | 81.14 | 80.66 | 0.8090 | 81.74 | 81.06 | 0.8079 | |||
BIO, Begin-Intermediate-Other sequence annotation; BIEO, Begin-Intermediate-End-Other sequence annotation; BiLSTM, bidirectional long- and short-term memory; CRF, conditional random field; IDCNN, iterated dilated convolutional neural network.