Table 2. SVM accuracy results (ACC ± STD) on top 20 features using 5-fold CV on different data sets.
TFS methods are compared against our methods (SMBA and SMBA-CSFS). FS: Fisher Score, mRMR: Minimum-Redundancy-Maximum-Relevance, MI: Mutual Information, RFS: Robust Feature Selector, EN: Elastic Net, BSL: all features. The best results are highlighted in bold. The number in parentheses is the number of features when the performance is achieved.
| Average Accuracy of top 20 features (%) | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| ALLAML | LEUKEMIA | CLL_SUB_111 | GLIOMA | LUNG_C | LUNG_D | DLBCL | CARCINOM | GCM | |
| Fisher | 96.84 ± 0.04(19) | 98.95 ± 0.02(16) | 75.20 ± 0.1(19) | 80 ± 0.04(13) | 91.94 ± 0.02(19) | 91.24 ± 0.1(20) | 97.11 ± 0.02(19) | 65.33 ± 0.05(20) | 94.9 ± 0.00(20) |
| Relief | 95.78 ± 0.04(8) | 97.89 ± 0.03(12) | 76.45 ± 0.03(15) | 80 ± 0.07(19) | 97.12 ± 0.01(20) | 95.2 ± 0.03(14) | 99.76 ± 0.00(20) | 86.52 ± 0.03(18) | 97.14 ± 0.01(20) |
| mRMR | 66.14 ± 0.13(12) | 98.95 ± 0.02(9) | 71.27 ± 0.1(20) | 66.67 ± 0.1(17) | 95.68 ± 0.013(19) | 95.22 ± 0.02(20) | 99.03 ± 0.01(16) | 89.57 ± 0.04(20) | 97.79 ± 0.01(20) |
| MI | 96.84 ± 0.042(15) | 98.95 ± 0.02(10) | 81.03 ± 0.06(17) | 78.33 ± 0.04(12) | 97.41 ± 0.014(17) | 94.53 ± 0.03(18) | 98.79 ± 0.01(19) | 93.25 ± 0.05(20) | 95.58 ± 0.01(20) |
| ls-21 | 71.34 ± 0.14(19) | 59.42 ± 0.2(12) | 60.30 ± 0.14(19) | 55 ± 0.07(20) | 92.66 ± 0.05(19) | 93.86 ± 0.04(20) | 92.52 ± 0.01(20) | 66.99 ± 0.03(20) | 96.56 ± 0.01(20) |
| ll-21 | 83 ± 0.11(15) | 88.36 ± 0.06(20) | 73.12 ± 0.06(15) | 0.75 ± 0.12(17) | 98.27 ± 0.015(16) | 93.24 ± 0.04(16) | 94.44 ± 0.02(19) | 83.49 ± 0.03(20) | 97.69 ± 0.01(20) |
| RFS | 87 ± 0.01(15) | 74.33 ± 0.1(18) | 64.73 ± 0.09(15) | 66.67 ± 0.07(17) | 94.10 ± 0.022(20) | 89.77 ± 0.02(19) | 91.06 ± 0.03(18) | 81.85 ± 0.07(18) | 96.77 ± 0.01(20) |
| LASSO | 98.95 ± 0.02(17) | 71.3 ± 0.08(21) | 68.02 ± 0.06(20) | 83.33 ± 0.05(17) | 97.99 ± 0.012(16) | 92.51 ± 0.03(12) | 99.52 ± 0.01(16) | 82.14 ± 0.05(18) | 97.07 ± 0.01(20) |
| EN | 98.95 ± 0.02(17) | 71.3 ± 0.08(21) | 68.02 ± 0.06(20) | 83.33 ± 0.05(17) | 97.99 ± 0.012(16) | 92.51 ± 0.03(12) | 99.52 ± 0.01(16) | 82.14 ± 0.05(18) | 97.07 ± 0.01(20) |
| SMBA | 93.68 ± 0.084(16) | 88.36 ± 0.06(20) | 70.60 ± 0.10(19) | 71.67 ± 0.134(17) | 97.84 ± 0.00(20) | 92.55 ± 0.03(20) | 99.28 ± 0.01(20) | 83.49 ± 0.03(20) | 97.69 ± 0.01(20) |
| SMBA-CSFS | 88.24 ± 0.04(20) | 81.93 ± 0.02(20) | 75.53 ± 0.06(20) | 73.34 ± 0.18(16) | 98.41 ± 0.014(19) | 97.93 ± 0.03(19) | 98.30 ± 0.02(13) | 94.95 ± 0.02(19) | 99.2 ± 0.01(20) |
| BSL | 97.89 ± 0.04 | 98.95 ± 0.021 | 84.26 ± 0.06 | 85 ± 0.1 | 99.57 ± 0.00 | 98.62 ± 0.02 | 100 ± 0.00 | 98.65 ± 0.01 | 100 ± 0.00 |