Table 3. Classification error rate, sensitivity and Brier score produced by Random Forest, k-Nearest Neighbors and Support Vector Machine classifiers on Breastcancer dataset based on genes selected by the given methods. The best result is shown in bold.
| RF | KNN | SVM | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Genes | POS | RPOS | GClust | sigF | Wilc | mRmR | POS | RPOS | GClust | sigF | Wilc | mRmR | POS | RPOS | GClust | sigF | Wilc | mRmR | |
| 5 | Err | 0.296 | 0.239 | 0.261 | 0.490 | 0.390 | 0.455 | 0.314 | 0.206 | 0.313 | 0.448 | 0.405 | 0.402 | 0.310 | 0.260 | 0.512 | 0.522 | 0.384 | 0.367 |
| BS | 0.013 | 0.010 | 0.165 | 0.287 | 0.254 | 0.277 | 0.014 | 0.011 | 0.290 | 0.275 | 0.261 | 0.254 | 0.021 | 0.011 | 0.262 | 0.251 | 0.262 | 0.244 | |
| sen | 0.784 | 0.837 | 0.810 | 0.621 | 0.722 | 0.661 | 0.706 | 0.862 | 0.798 | 0.703 | 0.761 | 0.760 | 0.704 | 0.776 | 0.558 | 0.506 | 0.714 | 0.791 | |
| 10 | Err | 0.308 | 0.224 | 0.261 | 0.514 | 0.360 | 0.462 | 0.276 | 0.240 | 0.297 | 0.501 | 0.390 | 0.396 | 0.272 | 0.214 | 0.522 | 0.484 | 0.351 | 0.456 |
| BS | 0.013 | 0.011 | 0.168 | 0.278 | 0.225 | 0.266 | 0.013 | 0.013 | 0.202 | 0.304 | 0.251 | 0.254 | 0.022 | 0.013 | 0.261 | 0.260 | 0.237 | 0.260 | |
| sen | 0.757 | 0.858 | 0.818 | 0.613 | 0.709 | 0.654 | 0.786 | 0.842 | 0.819 | 0.677 | 0.754 | 0.764 | 0.750 | 0.796 | 0.575 | 0.412 | 0.704 | 0.743 | |
| 15 | Err | 0.323 | 0.179 | 0.202 | 0.519 | 0.337 | 0.414 | 0.297 | 0.204 | 0.241 | 0.514 | 0.391 | 0.401 | 0.262 | 0.215 | 0.515 | 0.462 | 0.350 | 0.427 |
| BS | 0.013 | 0.009 | 0.145 | 0.275 | 0.222 | 0.246 | 0.012 | 0.008 | 0.182 | 0.324 | 0.255 | 0.256 | 0.046 | 0.010 | 0.262 | 0.260 | 0.235 | 0.255 | |
| sen | 0.709 | 0.864 | 0.848 | 0.643 | 0.767 | 0.719 | 0.781 | 0.835 | 0.810 | 0.685 | 0.768 | 0.763 | 0.741 | 0.781 | 0.564 | 0.354 | 0.742 | 0.798 | |
| 20 | Err | 0.290 | 0.195 | 0.199 | 0.481 | 0.377 | 0.468 | 0.279 | 0.207 | 0.257 | 0.473 | 0.408 | 0.395 | 0.225 | 0.215 | 0.542 | 0.409 | 0.386 | 0.474 |
| BS | 0.014 | 0.011 | 0.155 | 0.265 | 0.234 | 0.258 | 0.014 | 0.010 | 0.188 | 0.284 | 0.260 | 0.256 | 0.041 | 0.013 | 0.259 | 0.254 | 0.251 | 0.265 | |
| sen | 0.767 | 0.853 | 0.851 | 0.694 | 0.717 | 0.686 | 0.794 | 0.815 | 0.840 | 0.734 | 0.745 | 0.763 | 0.793 | 0.798 | 0.526 | 0.390 | 0.673 | 0.781 | |
| 25 | Err | 0.300 | 0.186 | 0.223 | 0.495 | 0.366 | 0.473 | 0.256 | 0.186 | 0.271 | 0.462 | 0.404 | 0.393 | 0.250 | 0.223 | 0.523 | 0.406 | 0.377 | 0.427 |
| BS | 0.012 | 0.010 | 0.156 | 0.270 | 0.229 | 0.265 | 0.012 | 0.010 | 0.178 | 0.279 | 0.260 | 0.251 | 0.033 | 0.010 | 0.264 | 0.254 | 0.246 | 0.259 | |
| sen | 0.777 | 0.883 | 0.832 | 0.694 | 0.726 | 0.659 | 0.801 | 0.829 | 0.838 | 0.693 | 0.753 | 0.759 | 0.790 | 0.798 | 0.567 | 0.397 | 0.691 | 0.790 | |
| 30 | Err | 0.268 | 0.197 | 0.242 | 0.411 | 0.350 | 0.454 | 0.261 | 0.192 | 0.258 | 0.436 | 0.387 | 0.394 | 0.249 | 0.198 | 0.455 | 0.418 | 0.351 | 0.457 |
| BS | 0.009 | 0.008 | 0.158 | 0.248 | 0.222 | 0.261 | 0.011 | 0.009 | 0.182 | 0.281 | 0.250 | 0.253 | 0.031 | 0.009 | 0.260 | 0.253 | 0.236 | 0.262 | |
| sen | 0.823 | 0.870 | 0.836 | 0.733 | 0.736 | 0.694 | 0.813 | 0.834 | 0.818 | 0.708 | 0.776 | 0.767 | 0.787 | 0.794 | 0.661 | 0.365 | 0.698 | 0.767 | |