TABLE III. Ablation Study of Our Two-Track Data Selection Approach. No Online Data Selection Approach is Adopted. (PRE.–Precision, REC.–Recall (%)) *The Training Period Using Offline Data Selection Approach Includes the Time Consumption of Self-Supervised Learning (0.3 Hour).
|
|
Number of Negative Samples | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 14% (246) | 28% (500) | 56% (1,000) | ALL (1,785) | ||||||||||
| PRE. | REC. | F1 | PRE. | REC. | F1 | PRE. | REC. | F1 | PRE. | REC. | F1 | ||
| - | - | 81.0 | 68.0 | 73.9 | 68.8 | 88.0 | 77.2 | 82.0 | 82.0 | 82.0 | 81.5 | 88.0 | 84.6 |
| √ | - | 65.7 | 88.0 | 75.2 | 72.1 | 88.0 | 79.3 | 81.1 | 86.0 | 83.5 | - | - | - |
| - | √ | 79.2 | 76.0 | 77.6 | 81.6 | 80.0 | 80.8 | 92.9 | 78.0 | 84.8 | - | - | - |
| √ | √ | 74.5 | 82.0 | 78.1 | 74.2 | 92.0 | 82.1 | 93.0 | 80.0 | 86.0 | - | - | - |
| w/ Pre-training | 60.3 | 88.0 | 71.5 | 65.2 | 90.0 | 75.6 | 74.6 | 88.0 | 80.7 | - | - | - | |
| Training period* | 2.5 hour | 4.6 hours | 9.5 hours | 19.6 hours | |||||||||