Table 5.
Imbalanced training data: test set scores with length ≤ 3 primitive patterns for causative relations
Imbalance in training set | Min. Frequency: 1000 | Min. Frequency: 500 | Min. Frequency: 100 | ||||||
---|---|---|---|---|---|---|---|---|---|
|
|
|
|||||||
Prec. | Rec. | F-score | Prec. | Rec. | F-score | Prec. | Rec. | F-score | |
|N| = 2 · |P| | 0.531 | 0.685 | 0.597 | 0.626 | 0.710 | 0.665 | 0.667 | 0.728 | 0.696 |
|N| = 4 · |P| | 0.619 | 0.667 | 0.642 | 0.721 | 0.684 | 0.702 | 0.761 | 0.689 | 0.723 |
|N| = 10 · |P| | 0.762 | 0.597 | 0.669 | 0.799 | 0.623 | 0.700 | 0.817 | 0.621 | 0.705 |