Table 4.
Epoch-by-epoch agreement.
| Sleep stage | Sensitivity, mean (SD; 95% CI) | Specificity, mean (SD; 95% CI) | Accuracy, mean (SD; 95% CI) | MCCa, mean (SD; 95% CI) | F1-score, mean (SD; 95% CI) | |
| Sleep or wake | ||||||
|
|
AWSb | 0.95 (0.02; 0.94-0.96) | 0.34 (0.12; 0.28-0.4) | 0.78 (0.06; 0.74-0.81) | 0.37 (0.11; 0.32-0.43) | 0.85 (0.05; 0.83-0.88) |
|
|
WSAc | 0.95 (0.09; 0.92-0.98) | 0.37 (0.16; 0.31-0.42) | 0.75 (0.09; 0.71-0.78) | 0.41 (0.15; 0.36-0.46) | 0.83 (0.07; 0.8-0.85) |
|
|
Emfitd | 0.99 (0.03; 0.97-1) | 0.22 (0.14; 0.15-0.3) | 0.67 (0.11; 0.61-0.73) | 0.35 (0.16; 0.26-0.43) | 0.78 (0.08; 0.73-0.82) |
|
|
Somnofy | 0.97 (0.06; 0.94-1) | 0.58 (0.17; 0.5-0.67) | 0.81 (0.08; 0.76-0.85) | 0.63 (0.12; 0.57-0.69) | 0.85 (0.07; 0.82-0.88) |
| REMe | ||||||
|
|
WSA | 0.4 (0.22; 0.32-0.48) | 0.86 (0.1; 0.83-0.89) | 0.82 (0.09; 0.79-0.85) | 0.24 (0.16; 0.18-0.3) | 0.32 (0.16; 0.27-0.38) |
|
|
Emfit | 0.25 (0.19; 0.15-0.35) | 0.8 (0.06; 0.77-0.83) | 0.76 (0.06; 0.73-0.79) | 0.12 (0.08; 0.07-0.16) | 0.18 (0.11; 0.13-0.24) |
|
|
Somnofy | 0.62 (0.25; 0.49-0.74) | 0.88 (0.08; 0.84-0.92) | 0.86 (0.08; 0.82-0.9) | 0.39 (0.18; 0.3-0.49) | 0.42 (0.18; 0.32-0.51) |
| NREMf | ||||||
|
|
WSA | 0.83 (0.12; 0.79-0.87) | 0.52 (0.13; 0.47-0.56) | 0.68 (0.07; 0.66-0.71) | 0.38 (0.13; 0.33-0.42) | 0.74 (0.06; 0.72-0.76) |
|
|
Emfit | 0.83 (0.11; 0.78-0.89) | 0.44 (0.13; 0.37-0.51) | 0.64 (0.11; 0.58-0.7) | 0.35 (0.14; 0.27-0.42) | 0.7 (0.1; 0.65-0.76) |
|
|
Somnofy | 0.84 (0.07; 0.81-0.88) | 0.69 (0.12; 0.63-0.75) | 0.76 (0.07; 0.72-0.8) | 0.53 (0.13; 0.47-0.6) | 0.77 (0.08; 0.73-0.81) |
| Light sleep | ||||||
|
|
WSA | 0.54 (0.13; 0.49-0.58) | 0.65 (0.13; 0.61-0.7) | 0.59 (0.06; 0.57-0.61) | 0.2 (0.11; 0.16-0.24) | 0.52 (0.08; 0.49-0.55) |
|
|
Emfit | 0.63 (0.09; 0.58-0.67) | 0.54 (0.1; 0.48-0.59) | 0.57 (0.08; 0.53-0.61) | 0.17 (0.14; 0.1-0.24) | 0.53 (0.1; 0.47-0.58) |
|
|
Somnofy | 0.67 (0.1; 0.62-0.72) | 0.69 (0.09; 0.64-0.73) | 0.68 (0.06; 0.65-0.71) | 0.35 (0.14; 0.28-0.42) | 0.61 (0.11; 0.55-0.66) |
| Deep sleep | ||||||
|
|
WSA | 0.79 (0.23; 0.71-0.87) | 0.83 (0.09; 0.8-0.86) | 0.82 (0.06; 0.8-0.84) | 0.47 (0.15; 0.42-0.52) | 0.51 (0.16; 0.45-0.56) |
|
|
Emfit | 0.39 (0.24; 0.26-0.52) | 0.85 (0.03; 0.84-0.87) | 0.79 (0.05; 0.77-0.82) | 0.21 (0.16; 0.13-0.29) | 0.28 (0.17; 0.19-0.37) |
|
|
Somnofy | 0.54 (0.21; 0.43-0.65) | 0.93 (0.04; 0.91-0.95) | 0.89 (0.04; 0.87-0.91) | 0.46 (0.21; 0.35-0.57) | 0.51 (0.21; 0.4-0.62) |
aMCC: Matthew correlation coefficient.
bAWS: Actiwatch Spectrum.
cWSA: Withings sleep analyzer.
dEmfit: Emfit-QS.
eREM: rapid eye movement.
fNREM: non–rapid eye movement.