Table 2.
Comparison of Device Sleep–Wake Classification Relative to Ground Truth Sleep–Wake Classification Derived From PSG Staging
Source | Accuracy | Balanced accuracy | d′ | Kappa | Precision | Sensitivity | Specificity |
---|---|---|---|---|---|---|---|
Naïve Model (result of always predicting Sleep, for reference) | 0.876 (0.064) | 0.500 (0.000) | 0.646 (0.204) | 0.000 (0.000) | 0.876 (0.064) | 1.000 (0.000) | 0.000 (0.000) |
ActiGraph Link with “Cole–Kripke” algorithm | 0.891 (0.046) | 0.752 (0.070) | 1.807 (0.375) | 0.482 (0.120) | 0.940 (0.042) | 0.936 (0.050) | 0.568 (0.163) |
ActiGraph Link with “Sadeh” algorithm | 0.880 (0.054) | 0.779 (0.071) | 1.874 (0.463) | 0.487 (0.146) | 0.949 (0.041) | 0.912 (0.064) | 0.647 (0.163) |
Actiwatch Spectrum Plus algorithm | 0.904 (0.050) | 0.674 (0.065) | 1.831 (0.327) | 0.424 (0.121) | 0.914 (0.055) | 0.982 (0.012) | 0.366 (0.136) |
Oura Ring | 0.899 (0.046) | 0.686 (0.075) | 1.771 (0.502) | 0.423 (0.150) | 0.923 (0.042) | 0.963 (0.039) | 0.410 (0.165) |
The “naïve” model is not a device but is instead the performance that is obtained by classifying every in-bed epoch as sleep, included here for reference. Values displayed within each cell are the mean and SD across nights.