TABLE 6.
Method | ROC-AUC | PR-AUC | Recall | |
---|---|---|---|---|
Human | CAT-CPI | 0.986 ± 0.001 | 0.948 ± 0.002 | 0.971 ± 0.003 |
-CNN | 0.980 ± 0.001 | 0.942 ± 0.004 | 0.942 ± 0.003 | |
-Trans | 0.982 ± 0.001 | 0.939 ± 0.001 | 0.936 ± 0.003 | |
Word2vec | 0.982 ± 0.001 | 0.925 ± 0.003 | 0.949 ± 0.003 | |
-P_Trans | 0.981 ± 0.001 | 0.954 ± 0.003 | 0.936 ± 0.003 | |
-FR | 0.966 ± 0.001 | 0.923 ± 0.002 | 0.955 ± 0.001 | |
Davis | CAT-CPI | 0.920 ± 0.001 | 0.481 ± 0.001- | 0.888 ± 0.023 |
-CNN | 0.914 ± 0.003 | 0.473 ± 0.011 | 0.849 ± 0.007 | |
-Trans | 0.912 ± 0.004 | 0.443 ± 0.005 | 0.848 ± 0.001 | |
Word2vec | 0.908 ± 0.002 | 0.436 ± 0.003 | 0.881 ± 0.004 | |
-P_Trans | 0.918 ± 0.002 | 0.478 ± 0.004 | 0.856 ± 0.007 | |
-FR | 0.853 ± 0.004 | 0.305 ± 0.017 | 0.824 ± 0.022 |