Performance in Stage 1 on the BC-V test set without considering functions
Att-BiLSTM (14) (%) | BERT (14) (%) | SBEL-BERT (ours) (%) | |||||||
---|---|---|---|---|---|---|---|---|---|
Evaluation levels | P | R | F1 | P | R | F1 | P | R | F1 |
Term | 56.3 | 63.6 | 58.6(±0.9) | 65.2 | 49.0 | 55.9(±2.6) | 59.7 | 60.1 | 59.8(±0.8) |
FS | 66.7 | 23.1 | 34.3(±1.4) | 76.3 | 30.0 | 42.1(±6.4) | 72.7 | 51.5 | 59.6(±4.5) |
Function | 36.8 | 11.7 | 17.7(±2.1) | 35.3 | 15.5 | 20.8(±5.4) | 32.9 | 26.0 | 28.5(±3.0) |
RS | 57.6 | 67.8 | 62.3(±1.7) | 80.2 | 61.5 | 69.4(±2.6) | 73.0 | 71.6 | 72.2(±1.1) |
Relation | 27.7 | 36.6 | 31.6(±1.8) | 46.2 | 33.8 | 38.8(±1.4) | 40.0 | 41.2 | 40.4(±1.0) |
State(REL) | 16.0 | 23.3 | 19.0(±1.2) | 31.2 | 22.8 | 26.2(±0.8) | 27.4 | 28.5 | 27.8(±0.7) |
State(MRG) | 18.7 | 24.8 | 21.3(±1.8) | 33.7 | 24.8 | 28.3(±1.4) | 29.8 | 30.8 | 30.1(±1.4) |