Table 4.
Performance of models based on CPD test data. TP, TN, FP and FN stand for True Positive, True Negative, False Positive and False Negative, respectively.
Features | Method | Accuracy (%) | Precision (%) | Recall (%) | F1 (%) | TP | TN | FP | FN |
---|---|---|---|---|---|---|---|---|---|
With network features | LR | 66.98 | 67.23 | 66.98 | 67.05 | 79 | 63 | 32 | 38 |
SVM | 66.04 | 66.06 | 66.04 | 65.16 | 93 | 47 | 48 | 24 | |
RF | 76.42 | 77.39 | 76.42 | 76.47 | 84 | 78 | 17 | 33 | |
ANN | 72.17 | 72.14 | 72.17 | 72.16 | 88 | 65 | 30 | 29 | |
GCN | 85.38 | 86.57 | 85.38 | 85.07 | 112 | 69 | 26 | 5 | |
GAT | 89.15 | 89.47 | 89.15 | 89.06 | 111 | 78 | 17 | 6 | |
Without network features | LR | 58.96 | 63.77 | 58.96 | 57.59 | 48 | 77 | 18 | 69 |
SVM | 61.32 | 60.95 | 61.32 | 60.32 | 88 | 42 | 53 | 29 | |
RF | 60.38 | 60.98 | 60.38 | 60.48 | 69 | 59 | 36 | 48 | |
ANN | 61.79 | 61.47 | 61.79 | 60.72 | 83 | 48 | 47 | 34 | |
GCN | 87.26 | 88.31 | 87.26 | 87.03 | 113 | 72 | 23 | 4 | |
GAT | 89.15 | 90.04 | 89.15 | 88.99 | 114 | 75 | 20 | 3 |