Table 6.
Feature selection method | Prediction method | nfold | mse | roc_auc | roc_auc_prob | Accuracy | f1_score | Precision_score | Recall_score | Sensitivity | Specificity | mcc |
---|---|---|---|---|---|---|---|---|---|---|---|---|
Mann_Whitney | RandomForest | Validation | 0.088235 | 0.911765 | 0.932526 | 0.911765 | 0.911458 | 0.917544 | 0.911765 | 0.852941 | 0.970588 | 0.829288 |
Mann_Whitney | RandomForest | 9 | 0.092593 | 0.85119 | 0.962302 | 0.907407 | 0.905939 | 0.905332 | 0.907407 | 0.75 | 0.952381 | 0.725032 |
Mann_Whitney | RandomForest | 8 | 0.092593 | 0.880952 | 0.906746 | 0.907407 | 0.908701 | 0.910778 | 0.907407 | 0.833333 | 0.928571 | 0.740888 |
Mann_Whitney | RandomForest | 7 | 0.203704 | 0.660714 | 0.878968 | 0.796296 | 0.785258 | 0.780247 | 0.796296 | 0.416667 | 0.904762 | 0.358569 |
Mann_Whitney | RandomForest | 6 | 0.425926 | 0.39881 | 0.420635 | 0.574074 | 0.580027 | 0.5862 | 0.574074 | 0.083333 | 0.714286 | − 0.1968 |
Mann_Whitney | RandomForest | 5 | 0.185185 | 0.791667 | 0.801587 | 0.814815 | 0.823413 | 0.841374 | 0.814815 | 0.75 | 0.833333 | 0.531105 |
Mann_Whitney | RandomForest | 4 | 0.203704 | 0.720238 | 0.861111 | 0.796296 | 0.799143 | 0.802585 | 0.796296 | 0.583333 | 0.857143 | 0.428326 |
Mann_Whitney | RandomForest | 3 | 0.203704 | 0.720238 | 0.869048 | 0.796296 | 0.799143 | 0.802585 | 0.796296 | 0.583333 | 0.857143 | 0.428326 |
Mann_Whitney | RandomForest | 2 | 0.148148 | 0.785714 | 0.944444 | 0.851852 | 0.851852 | 0.851852 | 0.851852 | 0.666667 | 0.904762 | 0.571429 |
Mann_Whitney | RandomForest | 1 | 0.212121 | 0.67451 | 0.69281 | 0.787879 | 0.782343 | 0.778467 | 0.787879 | 0.466667 | 0.882353 | 0.367765 |
Mann_Whitney | RandomForest | 0 | 0.106061 | 0.813725 | 0.899346 | 0.893939 | 0.889562 | 0.890572 | 0.893939 | 0.666667 | 0.960784 | 0.681747 |
Mann_Whitney | SVM | Validation | 0.102941 | 0.897059 | 0.943772 | 0.897059 | 0.897037 | 0.897403 | 0.897059 | 0.882353 | 0.911765 | 0.794461 |
Mann_Whitney | SVM | 9 | 0.111111 | 0.839286 | 0.968254 | 0.888889 | 0.888889 | 0.888889 | 0.888889 | 0.75 | 0.928571 | 0.678571 |
Mann_Whitney | SVM | 8 | 0.092593 | 0.910714 | 0.94246 | 0.907407 | 0.910837 | 0.920798 | 0.907407 | 0.916667 | 0.904762 | 0.762443 |
Mann_Whitney | SVM | 7 | 0.203704 | 0.660714 | 0.763889 | 0.796296 | 0.785258 | 0.780247 | 0.796296 | 0.416667 | 0.904762 | 0.358569 |
Mann_Whitney | SVM | 6 | 0.481481 | 0.363095 | 0.363095 | 0.518519 | 0.540873 | 0.56652 | 0.518519 | 0.083333 | 0.642857 | − 0.24929 |
Mann_Whitney | SVM | 5 | 0.166667 | 0.803571 | 0.765873 | 0.833333 | 0.839506 | 0.851282 | 0.833333 | 0.75 | 0.857143 | 0.563545 |
Mann_Whitney | SVM | 4 | 0.222222 | 0.708333 | 0.795635 | 0.777778 | 0.783615 | 0.791667 | 0.777778 | 0.583333 | 0.833333 | 0.395285 |
Mann_Whitney | SVM | 3 | 0.203704 | 0.779762 | 0.847222 | 0.796296 | 0.807411 | 0.832362 | 0.796296 | 0.75 | 0.809524 | 0.500851 |
Mann_Whitney | SVM | 2 | 0.166667 | 0.803571 | 0.911706 | 0.833333 | 0.839506 | 0.851282 | 0.833333 | 0.75 | 0.857143 | 0.563545 |
Mann_Whitney | SVM | 1 | 0.227273 | 0.688235 | 0.74902 | 0.772727 | 0.775268 | 0.778182 | 0.772727 | 0.533333 | 0.843137 | 0.368143 |
Mann_Whitney | SVM | 0 | 0.151515 | 0.807843 | 0.887582 | 0.848485 | 0.851705 | 0.856706 | 0.848485 | 0.733333 | 0.882353 | 0.590021 |
DCor | RandomForest | Validation | 0.102941 | 0.897059 | 0.916955 | 0.897059 | 0.896499 | 0.905836 | 0.897059 | 0.823529 | 0.970588 | 0.802846 |
DCor | RandomForest | 9 | 0.111111 | 0.809524 | 0.958333 | 0.888889 | 0.88513 | 0.884848 | 0.888889 | 0.666667 | 0.952381 | 0.662541 |
DCor | RandomForest | 8 | 0.092593 | 0.880952 | 0.886905 | 0.907407 | 0.908701 | 0.910778 | 0.907407 | 0.833333 | 0.928571 | 0.740888 |
DCor | RandomForest | 7 | 0.203704 | 0.660714 | 0.857143 | 0.796296 | 0.785258 | 0.780247 | 0.796296 | 0.416667 | 0.904762 | 0.358569 |
DCor | RandomForest | 6 | 0.425926 | 0.39881 | 0.380952 | 0.574074 | 0.580027 | 0.5862 | 0.574074 | 0.083333 | 0.714286 | − 0.1968 |
DCor | RandomForest | 5 | 0.185185 | 0.791667 | 0.791667 | 0.814815 | 0.823413 | 0.841374 | 0.814815 | 0.75 | 0.833333 | 0.531105 |
DCor | RandomForest | 4 | 0.203704 | 0.720238 | 0.865079 | 0.796296 | 0.799143 | 0.802585 | 0.796296 | 0.583333 | 0.857143 | 0.428326 |
DCor | RandomForest | 3 | 0.203704 | 0.720238 | 0.875 | 0.796296 | 0.799143 | 0.802585 | 0.796296 | 0.583333 | 0.857143 | 0.428326 |
DCor | RandomForest | 2 | 0.148148 | 0.785714 | 0.938492 | 0.851852 | 0.851852 | 0.851852 | 0.851852 | 0.666667 | 0.904762 | 0.571429 |
DCor | RandomForest | 1 | 0.212121 | 0.65098 | 0.696732 | 0.787879 | 0.775564 | 0.770248 | 0.787879 | 0.4 | 0.901961 | 0.33955 |
DCor | RandomForest | 0 | 0.106061 | 0.790196 | 0.917647 | 0.893939 | 0.885811 | 0.894481 | 0.893939 | 0.6 | 0.980392 | 0.678357 |
Boruta | RandomForest | Validation | 0.102941 | 0.897059 | 0.933391 | 0.897059 | 0.895956 | 0.914634 | 0.897059 | 0.794118 | 1 | 0.811503 |
Boruta | RandomForest | 9 | 0.092593 | 0.880952 | 0.954365 | 0.907407 | 0.908701 | 0.910778 | 0.907407 | 0.833333 | 0.928571 | 0.740888 |
Boruta | RandomForest | 8 | 0.111111 | 0.839286 | 0.865079 | 0.888889 | 0.888889 | 0.888889 | 0.888889 | 0.75 | 0.928571 | 0.678571 |
Boruta | RandomForest | 7 | 0.203704 | 0.660714 | 0.855159 | 0.796296 | 0.785258 | 0.780247 | 0.796296 | 0.416667 | 0.904762 | 0.358569 |
Boruta | RandomForest | 6 | 0.407407 | 0.410714 | 0.605159 | 0.592593 | 0.592593 | 0.592593 | 0.592593 | 0.083333 | 0.738095 | − 0.17857 |
Boruta | RandomForest | 5 | 0.185185 | 0.791667 | 0.865079 | 0.814815 | 0.823413 | 0.841374 | 0.814815 | 0.75 | 0.833333 | 0.531105 |
Boruta | RandomForest | 4 | 0.148148 | 0.815476 | 0.863095 | 0.851852 | 0.855743 | 0.862302 | 0.851852 | 0.75 | 0.880952 | 0.598574 |
Boruta | RandomForest | 3 | 0.12963 | 0.857143 | 0.934524 | 0.87037 | 0.875171 | 0.88604 | 0.87037 | 0.833333 | 0.880952 | 0.662994 |
Boruta | RandomForest | 2 | 0.092593 | 0.910714 | 0.950397 | 0.907407 | 0.910837 | 0.920798 | 0.907407 | 0.916667 | 0.904762 | 0.762443 |
Boruta | RandomForest | 1 | 0.19697 | 0.707843 | 0.866667 | 0.80303 | 0.80059 | 0.798576 | 0.80303 | 0.533333 | 0.882353 | 0.426119 |
Boruta | RandomForest | 0 | 0.090909 | 0.823529 | 0.895425 | 0.909091 | 0.903813 | 0.909091 | 0.909091 | 0.666667 | 0.980392 | 0.727607 |