Table 3.
Epoch-by-epoch agreement: classification for detecting individual sleep stage.
| Variable | Wake stagea | Light stagea | Deep stagea | REMb stagea | ||||||||||||||||||||||||
|
|
F1 | Sensitivity | Specificity | F1 | Sensitivity | Specificity | F1 | Sensitivity | Specificity | F1 | Sensitivity | Specificity | ||||||||||||||||
| Airable |
|
|
|
|
|
|
|
|
|
|
|
|
||||||||||||||||
|
|
SleepRoutine (n=67)c | 0.7065d | 0.7246d | 0.9269 | 0.7436d | 0.7054 | 0.7665d | 0.5355 | 0.6712 | 0.8973 | 0.7596d | 0.7394 | 0.9609d | |||||||||||||||
|
|
SleepScore (n=38) | 0.4057 | 0.3665 | 0.8696 | 0.5147 | 0.4355 | 0.7272 | 0.3574 | 0.5247 | 0.8264 | 0.3418 | 0.4587 | 0.7895 | |||||||||||||||
|
|
Pillow (n=74) | 0.2828 | 0.1934 | 0.9572 | 0.3409 | 0.2490 | 0.7534 | 0.2673 | 0.8594d | 0.4449 | 0.1440 | 0.1140 | 0.9126 | |||||||||||||||
| Nearable |
|
|
|
|
|
|
|
|
|
|
|
|
||||||||||||||||
|
|
Withings Sleep Tracking Mat (n=75) | 0.4419 | 0.4172 | 0.8854 | 0.5764 | 0.5328 | 0.6336 | 0.3800 | 0.5633 | 0.8270 | 0.4001 | 0.3964 | 0.8906 | |||||||||||||||
|
|
Google Nest Hub 2 (n=33) | 0.3296 | 0.3068 | 0.8649 | 0.5619 | 0.5772 | 0.4518 | 0.1245 | 0.1308 | 0.8883 | 0.1876 | 0.1805 | 0.8514 | |||||||||||||||
|
|
Amazon Halo Rise (n=28) | 0.5967 | 0.6612 | 0.8921 | 0.7142 | 0.6609 | 0.7484 | 0.4575 | 0.5467 | 0.9018 | 0.7283 | 0.7490d | 0.9401 | |||||||||||||||
| Wearable |
|
|
|
|
|
|
|
|
|
|
|
|
||||||||||||||||
|
|
Google Pixel Watch (n=30) | 0.3456 | 0.2277 | 0.9784d | 0.7150 | 0.7657 | 0.5620 | 0.5922d | 0.6937 | 0.9290 | 0.6146 | 0.6548 | 0.9029 | |||||||||||||||
|
|
Galaxy Watch 5 (n=22) | 0.4755 | 0.4814 | 0.9104 | 0.7346 | 0.7280 | 0.6412 | 0.4963 | 0.4752 | 0.9481d | 0.5982 | 0.6265 | 0.9058 | |||||||||||||||
|
|
Fitbit Sense 2 (n=26) | 0.3807 | 0.2714 | 0.9602 | 0.7262 | 0.7734d | 0.5727 | 0.5564 | 0.6710 | 0.9247 | 0.6623 | 0.6812 | 0.9297 | |||||||||||||||
|
|
Apple Watch 8 (n=26) | 0.5493 | 0.4481 | 0.9624 | 0.6680 | 0.6649 | 0.5737 | 0.3073 | 0.4130 | 0.8412 | 0.4394 | 0.4276 | 0.9070 | |||||||||||||||
|
|
Oura Ring 3 (n=53) | 0.4527 | 0.3822 | 0.9264 | 0.5953 | 0.5072 | 0.7630 | 0.4272 | 0.7784 | 0.7974 | 0.5993 | 0.7118 | 0.8716 | |||||||||||||||
aIndividual sleep stage classification was used to categorize each class and the remaining classes.
bREM: rapid eye movement.
cThe number in parenthesis indicates the number of participants tested with each device.
dTop-performing consumer sleep tracker.