Table 7.
Performance comparison of masking input methods
Method | Accuracy | Precision | Recall | F1-score |
---|---|---|---|---|
Default | *0.700 **(0.018) | 0.646 (0.019) | 0.647 (0.016) | 0.642 (0.013) |
Entity Marker–Entity Start | 0.857 (0.012) | 0.825 (0.029) | 0.836 (0.007) | 0.828 (0.015) |
Masked Input | 0.844 (0.013) | 0.811 (0.023) | 0.826 (0.011) | 0.817 (0.012) |
Two Masked Sentence Input | 0.866 (0.014) | 0.837 (0.018) | 0.847 (0.013) | 0.840 (0.014) |
Two Sentence Entity Token Input | 0.865 (0.012) | 0.839 (0.019) | 0.845 (0.014) | 0.840 (0.015) |
The best scores are in bold
*Mean
**Standard deviation