Table 2. Quantitative evaluation of all methods on different test sets.
Regression analysis | Bland and Altman | |||||||
Method | Mean SI±SD | ICC | Slope | y-intercept | R2 | Bias | 95% limits | |
Fulldataset (unsupervisedmethods) | WHASA | 0.72±0.16 | 0.96 | 0.86 | 5.9 | 0.94 | −4.4 | [−39 30] |
FS | 0.40±0.13 | 0.52 | 0.29 | 4.64 | 0.82 | −49 | [−144 47] | |
Threshold | 0.54±0.15 | 0.53 | 0.29 | 12.16 | 0.80 | −41 | [−136 54] | |
Test Set 1 | WHASA | 0.74±0.15 | 0.96 | 0.85 | 8.3 | 0.93 | −4.5 | [−42 33] |
Best kNN | 0.71±0.19 | 0.90 | 0.79 | 29 | 0.83 | 11 | [−44 66] | |
Best SVM | 0.72±0.16 | 0.89 | 0.68 | 17 | 0.88 | −10 | [−65 44] | |
Test Set 2 | WHASA | 0.71±0.16 | 0.96 | 0.87 | 5.3 | 0.93 | −3.2 | [−36 30] |
Best kNN | 0.63±0.22 | 0.87 | 0.73 | 19 | 0.79 | 0.3 | [−56 57] | |
Best SVM | 0.67±0.18 | 0.92 | 0.78 | 9.4 | 0.87 | −5.1 | [−51 41] | |
Test Set 3 | WHASA | 0.71±0.17 | 0.96 | 0.86 | 6.5 | 0.93 | −4.2 | [−41 32] |
Best kNN | 0.70±0.19 | 0.91 | 0.75 | 22 | 0.86 | 3.0 | [−49 55] | |
Best SVM | 0.70±0.19 | 0.94 | 0.80 | 15 | 0.90 | −0.9 | [−45 43] |