Skip to main content
. 2020 Mar 26;43(7):zsaa045. doi: 10.1093/sleep/zsaa045

Table 5.

Performance of Machine Learning Classifiers

Dataset Normalization Oversampling AUC Accuracy Balanced accuracy d Kappa Precision Sensitivity Specificity
Apple Watch FALSE None 0.918 (0.040) 0.918 (0.040) 0.753 (0.083) 2.228 (0.319) 0.544 (0.117) 0.936 (0.050) 0.974 (0.029) 0.532 (0.187)
FALSE Oversampling 0.917 (0.037) 0.872 (0.077) 0.825 (0.060) 2.154 (0.377) 0.514 (0.145) 0.962 (0.038) 0.890 (0.095) 0.760 (0.156)
TRUE None 0.926 (0.040) 0.928 (0.029) 0.789 (0.063) 2.347 (0.373) 0.602 (0.102) 0.943 (0.039) 0.976 (0.022) 0.602 (0.136)
TRUE Oversampling 0.922 (0.041) 0.882 (0.039) 0.853 (0.048) 2.237 (0.398) 0.533 (0.154) 0.967 (0.033) 0.898 (0.049) 0.807 (0.105)
Oura Ring FALSE None 0.897 (0.053) 0.914 (0.045) 0.692 (0.083) 1.926 (0.428) 0.441 (0.149) 0.929 (0.050) 0.977 (0.021) 0.407 (0.176)
FALSE Oversampling 0.888 (0.063) 0.839 (0.075) 0.780 (0.079) 1.855 (0.451) 0.404 (0.135) 0.960 (0.039) 0.853 (0.096) 0.707 (0.208)
TRUE None 0.892 (0.063) 0.906 (0.050) 0.689 (0.082) 1.827 (0.454) 0.418 (0.135) 0.925 (0.051) 0.971 (0.031) 0.407 (0.174)
TRUE Oversampling 0.896 (0.062) 0.844 (0.057) 0.805 (0.067) 1.876 (0.462) 0.422 (0.153) 0.964 (0.030) 0.855 (0.071) 0.755 (0.143)
ECG + Link FALSE None 0.924 (0.039) 0.917 (0.049) 0.755 (0.070) 2.321 (0.330) 0.560 (0.112) 0.938 (0.047) 0.970 (0.049) 0.540 (0.170)
FALSE Oversampling 0.923 (0.037) 0.870 (0.082) 0.830 (0.055) 2.191 (0.350) 0.521 (0.140) 0.966 (0.035) 0.883 (0.105) 0.776 (0.144)
TRUE None 0.926 (0.041) 0.922 (0.043) 0.788 (0.065) 2.383 (0.436) 0.595 (0.113) 0.943 (0.040) 0.968 (0.045) 0.607 (0.147)
TRUE Oversampling 0.924 (0.042) 0.878 (0.048) 0.856 (0.043) 2.253 (0.372) 0.536 (0.156) 0.970 (0.029) 0.890 (0.059) 0.821 (0.096)

Values in each cell are the mean and SD across nights.