Table 4.
Comparison of four types of invalid response identification results.
| True positive | True negative | False positive | False negative | Accuracy | Precision | Recall | F1 | |
|---|---|---|---|---|---|---|---|---|
| Content omission | 30 | 930 | 0 | 0 | 1 | 1 | 1 | 1 |
| Avoidance interference | 47 | 899 | 0 | 14 | 0.98 | 1 | 0.77 | 0.87 |
| Meaningless | 129 | 827 | 1 | 3 | 0.99 | 0.99 | 0.97 | 0.98 |
| Off-topic | 77 | 873 | 0 | 10 | 0.98 | 1 | 0.88 | 0.93 |
| Overall | 0.99 | 0.99 | 0.90 | 0.94 |