Table 5.
Results of the four training cases
Model | Test set | Validation set | Training set | ||||||
---|---|---|---|---|---|---|---|---|---|
F1 | Precision | Recall | F1 | Precision | Recall | F1 | Precision | Recall | |
Base model | 0.8499 | 0.8437 | 0.8562 | 0.8435 | 0.8379 | 0.8491 | 0.9498 | 0.9404 | 0.9595 |
+ lexicon | 0.8554 | 0.8604 | 0.8505 | 0.8493 | 0.8570 | 0.8418 | 0.9986 | 0.9983 | 0.9989 |
+ case | 0.8604 | 0.8571 | 0.8637 | 0.8533 | 0.8536 | 0.8530 | 0.9963 | 0.9952 | 0.9973 |
+ lexicon + case | 0.8574 | 0.8505 | 0.8645 | 0.8527 | 0.8482 | 0.8572 | 0.9422 | 0.9336 | 0.9510 |