Table 3. Results on independent tests.
Testing | Training | Method | Evaluation Metrics | ||||
---|---|---|---|---|---|---|---|
Sn | Sp | ACC | MCC | AUC | |||
Intron | intron | RF | 0.8229 | 0.9544 | 0.8887 | 0.7841 | 0.9458 |
SVM | 0.8362 | 0.9297 | 0.8830 | 0.7693 | 0.9333 | ||
KNN | 0.4981 | 0.5067 | 0.5024 | 0.0047 | 0.8268 | ||
LR | 0.7752 | 0.9562 | 0.8658 | 0.7439 | 0.9366 | ||
exon | RF | 0.4667 | 0.9924 | 0.7298 | 0.5398 | 0.8794 | |
SVM | 0.4133 | 0.9962 | 0.7050 | 0.5042 | 0.9021 | ||
KNN | 0.4971 | 0.5010 | 0.4990 | -0.0019 | 0.6256 | ||
LR | 0.2514 | 1 | 0.6261 | 0.3794 | 0.8934 | ||
combine | RF | 0.6019 | 0.9848 | 0.7935 | 0.6353 | 0.9253 | |
SVM | 0.8398 | 0.8328 | 0.8363 | 0.6726 | 0.9096 | ||
KNN | 0.4981 | 0.5067 | 0.5024 | 0.0047 | 0.7977 | ||
LR | 0.3505 | 1 | 0.6755 | 0.4611 | 0.8886 | ||
Exon | intron | RF | 1 | 0.0012 | 0.5006 | 0.0244 | 0.8412 |
SVM | 0.9990 | 0.0310 | 0.5150 | 0.1195 | 0.6938 | ||
KNN | 0.4983 | 0.5027 | 0.5005 | 0.0010 | 0.5459 | ||
LR | 0.9989 | 0.0258 | 0.5123 | 0.1072 | 0.8309 | ||
exon | RF | 0.8584 | 0.8245 | 0.8414 | 0.6833 | 0.9165 | |
SVM | 0.8401 | 0.8419 | 0.8410 | 0.6820 | 0.9151 | ||
KNN | 0.4992 | 0.5014 | 0.5003 | 0.0006 | 0.8001 | ||
LR | 0.7421 | 0.8951 | 0.8186 | 0.6448 | 0.9081 | ||
combine | RF | 0.8568 | 0.8247 | 0.8407 | 0.6819 | 0.9141 | |
SVM | 0.8398 | 0.8328 | 0.8363 | 0.6726 | 0.9096 | ||
KNN | 0.4994 | 0.5009 | 0.5001 | 0.0003 | 0.7980 | ||
LR | 0.7349 | 0.8906 | 0.8128 | 0.6333 | 0.9015 | ||
Combine | intron | RF | 0.9921 | 0.0444 | 0.5182 | 0.1144 | 0.8270 |
SVM | 0.4983 | 0.5028 | 0.5006 | 0.0012 | 0.5555 | ||
KNN | 0.9884 | 0.0686 | 0.5285 | 0.1455 | 0.8165 | ||
LR | 0.9914 | 0.0723 | 0.5318 | 0.1618 | 0.6955 | ||
exon | RF | 0.8320 | 0.8390 | 0.8355 | 0.6710 | 0.9110 | |
SVM | 0.8142 | 0.8478 | 0.8310 | 0.6624 | 0.9055 | ||
KNN | 0.4993 | 0.5009 | 0.5009 | 0.0002 | 0.7908 | ||
LR | 0.7045 | 0.9024 | 0.8034 | 0.6191 | 0.8968 | ||
combine | RF | 0.8463 | 0.8326 | 0.8395 | 0.6790 | 0.9126 | |
SVM | 0.8294 | 0.8394 | 0.8344 | 0.6689 | 0.9077 | ||
KNN | 0.4994 | 0.5011 | 0.5004 | 0.0005 | 0.7979 | ||
LR | 0.7173 | 0.8956 | 0.8065 | 0.6229 | 0.8979 |