Table 6.
Classifier performances on training and test data.
| Classifier | Status | Wt. Accuracy | ROC | Recall | Precision | F1 Score | |||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Train | Test | Train | Test | Train | Test | Train | Test | Train | Test | ||
| Decision Tree | A | 80.9 | 83.8 | 93.7 | 90.7 | 77.8 | 77.8 | 85.0 | 83.8 | ||
| I | 79.3 | 89.9 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | |||
| P | 82.0 | 67.8 | 33.3 | 50.0 | 50.0 | 50.0 | 40.0 | 50.0 | |||
| R | 56.9 | 73.4 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | |||
| N | 99.0 | 98.1 | 100.0 | 100.0 | 0.9 | 72.7 | 94.7 | 84.2 | |||
| O | 94.2 | 75.4 | 94.1 | 62.5 | 80.0 | 55.6 | 86.5 | 58.8 | |||
| Wt. Ave | 78.3 | 74.1 | 81.8 | 83.5 | 78.3 | 74.1 | 66.5 | 62.7 | 71.8 | 67.9 | |
| Naïve Bayes | A | 85.6 | 84.1 | 89.0 | 83.3 | 77.9 | 75.0 | 83.1 | 78.9 | ||
| I | 83.4 | 87.6 | 6.7 | 0.0 | 9.1 | 0.0 | 7.7 | 0.0 | |||
| P | 95.2 | 98.8 | 16.7 | 0.0 | 50.0 | 0.0 | 25.0 | 0.0 | |||
| R | 85.1 | 80.5 | 13.3 | 0.0 | 40.0 | 0.0 | 20.0 | 0.0 | |||
| N | 99.4 | 100.0 | 94.4 | 100.0 | 89.5 | 72.7 | 91.9 | 84.2 | |||
| O | 97.8 | 86.4 | 70.6 | 50.0 | 75.0 | 50.0 | 72.7 | 50.0 | |||
| Wt. Ave | 73.7 | 67.1 | 88.0 | 86.1 | 73.7 | 67.1 | 69.8 | 59.2 | 70.7 | 62.8 | |
| Support Vector Machine | A | 81.7 | 76.0 | 92.9 | 87.0 | 84.9 | 81.0 | 88.7 | 83.9 | ||
| I | 85.6 | 81.0 | 13.3 | 0.0 | 100.0 | 0.0 | 85.6 | 0.0 | |||
| P | 99.3 | 99.1 | 83.3 | 50.0 | 71.4 | 50.0 | 76.9 | 50.0 | |||
| R | 87.9 | 76.8 | 46.7 | 28.6 | 70.0 | 50.0 | 56.0 | 36.4 | |||
| N | 99.7 | 99.1 | 100.0 | 100.0 | 90.0 | 72.7 | 94.7 | 84.2 | |||
| O | 99.2 | 78.0 | 100.0 | 75.0 | 85.0 | 60.0 | 91.9 | 66.7 | |||
| Wt. Ave | 84.3 | 75.3 | 86.1 | 79.3 | 84.3 | 75.3 | 85.0 | 69.3 | 81.8 | 71.7 | |