Table 2.
Classification accuracies for all classifiers and feature sets. Blue/red intensities denote the overestimation/underestimation of the CV techniques compared to the ground truth (G.T.) for k-fold and block columns, and compared to chance () for trial-random k-fold (t.r. k-f) and trial-random block (t.r. bl.) columns. Heat map intensities are calculated separately for the ranges in , , and . Bolded values were found to be significantly different, as per Section 4.2.5.
High Seperability | Low Seperability | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Classifier | Trial Duration | Feature | G.T. | k-Fold | Block | t.r. k-f | t.r. bl. | G.T. | k-Fold | Block | t.r. k-f | t.r. bl. |
SVM | 15 s | Bandpower | 94.58 | 93.43 | 92.41 | 55.67 | 49.73 | 67.41 | 67.34 | 62.07 | 55.06 | 49.32 |
Spectral Ent. | 95.02 | 93.68 | 92.29 | 57.14 | 49.21 | 65.71 | 67.36 | 64.62 | 55.08 | 51.72 | ||
RMS | 91.53 | 90.09 | 89.12 | 55.38 | 49.54 | 62.14 | 66.64 | 63.11 | 53.41 | 46.96 | ||
Variance | 91.83 | 90.29 | 89.11 | 52.92 | 50.07 | 62.18 | 65.59 | 63.84 | 52.85 | 48.84 | ||
15 s avg | 93.24 | 91.87 | 90.73 | 55.28 | 49.64 | 64.36 | 66.73 | 63.41 | 54.10 | 49.21 | ||
60 s | Bandpower | 94.58 | 94.58 | 91.57 | 71.82 | 50.61 | 67.41 | 77.37 | 56.30 | 73.33 | 46.22 | |
Spectral Ent. | 95.02 | 94.43 | 91.17 | 70.84 | 45.53 | 65.71 | 77.80 | 55.16 | 71.84 | 58.40 | ||
RMS | 91.53 | 90.47 | 86.53 | 62.52 | 42.67 | 62.14 | 72.05 | 59.51 | 64.47 | 48.56 | ||
Variance | 91.83 | 90.58 | 86.62 | 62.40 | 41.74 | 62.18 | 71.16 | 58.50 | 60.37 | 53.85 | ||
60 s avg | 93.24 | 92.52 | 88.97 | 66.90 | 45.14 | 64.36 | 74.59 | 57.37 | 67.50 | 51.76 | ||
LDA | 15 s | Bandpower | 95.05 | 93.23 | 93.14 | 55.96 | 51.78 | 66.72 | 67.55 | 64.54 | 55.87 | 47.82 |
Spectral Ent. | 95.24 | 93.32 | 92.97 | 54.98 | 50.34 | 66.18 | 68.26 | 65.52 | 54.46 | 52.62 | ||
RMS | 92.55 | 90.31 | 89.55 | 53.54 | 47.60 | 63.18 | 66.46 | 63.76 | 53.15 | 46.82 | ||
Variance | 91.67 | 89.44 | 88.32 | 53.44 | 48.37 | 64.10 | 67.15 | 64.36 | 53.41 | 51.68 | ||
15 s avg | 93.63 | 91.58 | 91.00 | 54.48 | 49.52 | 65.05 | 67.36 | 64.55 | 54.22 | 49.73 | ||
60 s | Bandpower | 95.05 | 94.05 | 91.00 | 73.58 | 50.39 | 66.72 | 78.08 | 56.97 | 73.45 | 48.43 | |
Spectral Ent. | 95.24 | 93.92 | 90.60 | 72.50 | 40.96 | 66.18 | 77.89 | 57.78 | 72.25 | 55.96 | ||
RMS | 92.55 | 91.60 | 87.63 | 63.61 | 46.83 | 63.18 | 72.63 | 61.47 | 64.99 | 48.62 | ||
Variance | 91.67 | 90.59 | 85.74 | 64.26 | 43.47 | 64.10 | 71.96 | 57.91 | 65.07 | 51.24 | ||
60 s avg | 93.63 | 92.54 | 88.74 | 68.49 | 45.41 | 65.05 | 75.14 | 58.53 | 68.94 | 51.06 | ||
KNN | 15 s | Bandpower | 92.85 | 92.23 | 91.76 | 54.06 | 50.39 | 62.78 | 65.06 | 61.50 | 54.86 | 50.00 |
Spectral Ent. | 93.09 | 92.75 | 91.93 | 57.57 | 46.70 | 62.67 | 66.57 | 62.67 | 56.08 | 49.58 | ||
RMS | 88.51 | 86.22 | 84.86 | 56.04 | 49.71 | 59.19 | 63.00 | 59.86 | 51.81 | 47.99 | ||
Variance | 87.77 | 85.82 | 84.72 | 53.74 | 49.19 | 60.87 | 62.55 | 59.84 | 53.47 | 51.94 | ||
15 s avg | 90.55 | 89.26 | 88.32 | 55.35 | 49.00 | 61.38 | 64.29 | 60.97 | 54.05 | 49.88 | ||
60 s | Bandpower | 92.85 | 93.65 | 88.53 | 78.67 | 41.70 | 62.78 | 78.00 | 51.50 | 76.66 | 51.27 | |
Spectral Ent. | 93.09 | 93.84 | 88.32 | 75.10 | 48.26 | 62.67 | 74.71 | 53.83 | 73.56 | 46.25 | ||
RMS | 88.51 | 87.29 | 81.34 | 64.70 | 45.24 | 59.19 | 67.55 | 55.71 | 65.25 | 48.82 | ||
Variance | 87.77 | 87.57 | 80.72 | 64.19 | 47.28 | 60.87 | 67.08 | 54.81 | 62.94 | 49.13 | ||
60 s avg | 90.55 | 90.59 | 84.73 | 70.67 | 45.62 | 61.38 | 71.83 | 53.96 | 69.60 | 48.87 |