Table 5.
Ten-fold cross-validation performance of RE and FD on the BC-V training set
| Att-BiLSTM (14) (%) | BERT (14) (%) | SBEL-BERT (ours) (%) | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Types | P | R | F1 | P | R | F1 | P | R | F1 |
| Relations | 61.7 | 60.8 | 61.3(±1.4) | 72.9 | 68.6 | 70.5(±0.3) | 72.4 | 69.0 | 70.5(±0.2) |
| increases | 65.1 | 73.4 | 69.2(±1.4) | 73.5 | 69.2 | 71.1(±1.6) | 73.2 | 70.3 | 71.5(±1.6) |
| decreases | 54.2 | 40.0 | 46.0(±2.4) | 71.4 | 67.3 | 68.9(±2.6) | 70.5 | 65.5 | 67.6(±2.0) |
| Functions | 53.9 | 54.0 | 53.9(±2.5) | 55.6 | 46.5 | 50.2(±0.5) | 55.4 | 47.0 | 50.5(±0.9) |
| act | 52.3 | 59.8 | 56.0(±4.1) | 56.5 | 46.4 | 50.4(±3.7) | 57.6 | 47.7 | 51.4(±4.4) |
| deg | 58.8 | 16.9 | 26.3(±16.0) | 52.6 | 41.2 | 43.5(±11.1) | 52.4 | 40.5 | 43.0(±13.2) |
| pmod | 59.5 | 32.8 | 42.3(±5.8) | 54.4 | 48.0 | 49.5(±7.2) | 54.6 | 47.9 | 49.8(±6.2) |
| sec | 51.7 | 23.1 | 31.9(±9.2) | 55.3 | 47.5 | 49.1(±9.0) | 58.4 | 53.2 | 53.3(±12.0) |
| tloc | – | – | – | – | – | – | 46.0 | 36.9 | 37.2(±20.0) |
| complex | – | – | – | – | – | – | 48.3 | 41.3 | 43.8(±6.0) |