Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Nov 9;15(11):e0237279. doi: 10.1371/journal.pone.0237279

Quantitative detection of sleep apnea with wearable watch device

Junichiro Hayano 1,*, Hiroaki Yamamoto 2, Izumi Nonaka 2, Makoto Komazawa 3, Kenichi Itao 3, Norihiro Ueda 1, Haruhito Tanaka 2, Emi Yuda 4
Editor: Allan R Martin5
PMCID: PMC7652322  PMID: 33166293

Abstract

The spread of wearable watch devices with photoplethysmography (PPG) sensors has made it possible to use continuous pulse wave data during daily life. We examined if PPG pulse wave data can be used to detect sleep apnea, a common but underdiagnosed health problem associated with impaired quality of life and increased cardiovascular risk. In 41 patients undergoing diagnostic polysomnography (PSG) for sleep apnea, PPG was recorded simultaneously with a wearable watch device. The pulse interval data were analyzed by an automated algorithm called auto-correlated wave detection with adaptive threshold (ACAT) which was developed for electrocardiogram (ECG) to detect the cyclic variation of heart rate (CVHR), a characteristic heart rate pattern accompanying sleep apnea episodes. The median (IQR) apnea-hypopnea index (AHI) was 17.2 (4.4–28.4) and 22 (54%) subjects had AHI ≥15. The hourly frequency of CVHR (Fcv) detected by the ACAT algorithm closely correlated with AHI (r = 0.81), while none of the time-domain, frequency-domain, or non-linear indices of pulse interval variability showed significant correlation. The Fcv was greater in subjects with AHI ≥15 (19.6 ± 12.3 /h) than in those with AHI <15 (6.4 ± 4.6 /h), and was able to discriminate them with 82% sensitivity, 89% specificity, and 85% accuracy. The classification performance was comparable to that obtained when the ACAT algorithm was applied to ECG R-R intervals during the PSG. The analysis of wearable watch PPG by the ACAT algorithm could be used for the quantitative screening of sleep apnea.

Introduction

Sleep apnea is a common health problem affecting 10–30% of adults [1, 2] and is associated with sleepiness, reduced sleep quality, reduced labor and learning capacity, frequent traffic accidents [3, 4], and increased cardiovascular disease risk [5]. Due to the limited clinical resources of standard sleep apnea testing by polysomnography (PSG), a variety of simple test devices have been developed to screen for sleep apnea at home [6, 7]. However, many patients may not have the opportunity to be tested, because most patients with sleep apnea don’t have strong subjective symptoms or awareness to motivate them to visit a clinic or to access such devices. Recently, wearable watch devices with photoplethysmography (PPG) sensors have become popular. Although most of such devices still do not provide stable pulse wave signals during daily physical activities, they can generally deliver reliable signals during sleeping [810]. If sleep apnea could be screened by the pulse wave signals acquired by these devices, it could be a considerable solution for this situation.

In this study, we examined if sleep apnea can be detected from PPG signals by applying an automated algorithm that has been developed for sleep apnea detection from R-R intervals of electrocardiography (ECG). The algorithm is called auto-correlated wave detection with adaptive threshold (ACAT) [1113]. It detects the cyclic variations of heart rate (CVHR), a characteristic pattern of R-R interval variations accompanying sleep apnea episodes [14]. In a previous study of 862 subjects undergoing polysomnographic examination, the hourly frequency of CVHR detected by the ACAT algorithm showed a correlation coefficient of 0.84 with the apnea-hypopnea index (AHI) and detected subjects with AHI ≥15 with 83% sensitivity and 88% specificity [11]. Although studies of pulse interval (PI) variability have reported important differences in the amplitude of short-term fluctuation components from those of R-R interval (RRI) variability [1520], ACAT algorithm may be robust to such differences because the cycle length of CVHR is long (25–130 s) and ACAT has ability to adapt the detection threshold according to the changes in CVHR amplitude.

Materials and methods

Ethics approval and consent to participate

This study was performed according to the protocol that has been approved by the Research Ethics Committee of Nagoya City University Graduate School of Medical Sciences and Nagoya City University Hospital (No. 60-20-0004). All subjects participated in this study gave their written informed consent.

Subjects

The subjects of this study were consecutive patients who underwent a diagnostic overnight PSG for sleep disordered breathing at Gifu Mates Sleep Clinic (Gifu, Japan) between March 2020 and May 2020. The inclusion criterion was adults of age ≥20 years. Subjects were excluded if he or she had continuous atrial fibrillation, acute illness or chronic disease exacerbation requiring hospitalization within the last 3 months, or were pregnant or breastfeeding.

Protocol

Subjects visited a sleep clinic in the evening and spent overnight in a PSG testing chamber equipped with an Alice diagnostic sleep system (Philips Respironics, Murrysville, PA, USA). During the PSG, they wore a wearable watch device (E4 wristband, Empatica, Milano, Italy) on their left wrist and made a continuous recording of the PPG.

Measurements

The PSG examination was started at 20:00 h and the data were collected from 21:00 h to 06:00 h the next morning. The standard PSG montages consisting of F4-M1, F4-M2, C4-M1, C3-M2, O2-M1, and O1-M2 electroencephalograms, left and right electrooculograms, a submental electromyogram, a nasal pressure cannula, oronasal airflows, left and right tibial electromyograms, thoracoabdominal inductance plethysmograms, pulse oxy-metric arterial blood oxygen saturation (SpO2), a neck microphone, body position sensors, and a modified lead II ECG.

Sleep stages and respiratory events were scored according to the AASM Manual for the Scoring of Sleep and Associated Events [21] by registered polysomnogram technicians. The average hourly frequencies of apneic episodes, hypopneic episodes, and the combination were defined as apneic index (AI), hypopneic index (HI), and apnea-hypopnea index (AHI), respectively. The average hourly frequencies of apneic episodes were also measured by the types (obstructive, central, and mixed). Additionally, the averages of hourly frequency of 2% and 3% oxygen desaturations were also measured. In the present study, time in bed instead of total sleep time was used as the denominator in the calculation of these indices. Subjects with AHI between 5 and 15 were defined as mild, those with AHI between 15 and 30 as moderate, and those with AHI ≥30 as severe sleep apnea.

The ECG signal of the polygraph was sampled at a frequency of 100 Hz for the entire length of the PSG. All QRS complexes were identified and labeled as normal (sinus rhythm), ventricular ectopic, supraventricular ectopic, and artifact, and R-R interval time series were generated using only consecutive sinus rhythm R waves.

The wearable watch device (E4 wristband) emitted green light and recorded PPG as the inverted intensity of reflected light at a sampling frequency of 64 Hz and a resolution of 0.9 nW/digit. The PPG data were uploaded offline to the manufacturer’s cloud via the Internet (E4 connect, Empatica, Milan, Italy), where the PI time series were measured as the foot-to-foot intervals of the pulse waves with motion artifacts removed [22, 23].

Data analysis

Both ECG RRI and PPG PI time series were analyzed by the same ACAT algorithm. The detail of this algorithm has been reported previously [11, 12]. Briefly, the ACAT algorithm is a time-domain method to detect the CVHR as cyclic and autocorrelated dips in beat interval time series and determines the temporal position of the dips comprising the CVHR (Figs 1 and 2). The ACAT algorithm are comprised of the following steps: First, the interval time series are smoothed by second-order polynomial fitting, and all dips with widths between 10 and 120 s and depth-to-width ratios of >0.7 ms/s are detected. Also, the upper and lower envelopes of the interval variations are calculated as the 95th and 5th percentile points, respectively, within a moving window with a width of 130 s. Second, the dips that met the following criteria are considered CVHR: (1) a relative dip depth >40% of the envelope range at the point of dip (adaptive threshold), (2) inter-dip intervals (cycle length) between 25 and 130 s, (3) a waveform similar to those of the two preceding and two subsequent dips with a mean morphological correlation coefficients >0.4 (autocorrelated wave), and (4) three cycle lengths between four consecutive dips that meet the following equivalence criteria: (3-2l1/s) (3-2l2/s) (3-2l3/s) >0.8, where l1, l2, and l3 are three consecutive cycle lengths and s = (l1+l2+l3)/3. Finally, the number of dips comprising the CVHR is counted and the mean hourly frequency of the dips is calculated as Fcv.

Fig 1. Algorithm of autocorrelated wave detection with adaptive threshold (ACAT).

Fig 1

The algorithm detects the temporal positions of cyclic variation of heart rate (CVHR) in the beat interval time series as the cyclic and autocorrelated dips that meet four specific criteria (modified from Fig 1 in Ref. [11]).

Fig 2. Detection of CVHR from photoplethysmography (PPG) pulse interval time series by the ACAT algorithm in a representative subject (a 66-y male with a body mass index of 27.0 kg/m2 and an apnea-hypopnea index of 79.3).

Fig 2

Panel a: original pulse interval time series. Panel b: second-order polynomial fitting line (solid line) and the upper and lower envelopes of the fitting line (dashed lines). Panel c: the relative dip depth to the envelope width at the time. Panel d: mean morphological correlation coefficients of dip with the two preceding and two subsequent dips. Panel e: temporal positions (blue bars) of dips detected as CVHR.

To compare the performance of Fcv to estimate AHI, the following time-domain, frequency-domain, and nonlinear indices of pulse rate variability were also computed from both PPG PI and ECG RRI time series: the standard deviation of normal-to-normal (N-N) intervals (SDNN), the standard deviation of 5-min average N-N interval (SDANN), the root mean square of successive differences in N-N interval (rMSSD), deceleration capacity of N-N intervals (DC) [24], short-term (4–11 beats) and long-term (>11 beats) scaling exponents computed by detrended fluctuation analysis (α1 and α2) of N-N intervals [25], and the spectral exponent (β), the total power, ultra-low-frequency (<0.0033 Hz) power (ULF), very-low-frequency (0.0033–0.04 Hz) power (VLF), low-frequency (0.04–0.15 Hz) power (LF), high-frequency (0.14–0.40 Hz) power (HF), and LF-to-HF power ratio (LF/HF) of N-N interval variation. The N-N interval of PI was defined as the interval between 400 and 1400 ms with a difference <20% from the local average interval. The N-N interval of RRI was defined as the interval of consecutive beats in sinus rhythm. All these indices were calculated for the entire data length of the PSG study. The total power, ULF, VLF, LF, and HF were calculated as natural-log transformed values.

Statistical analysis

The program package of Statistical Analysis System (SAS institute, Cary, NC, USA) was used for statistical analyses. Relationships between quantitative variables were evaluated by linear regression analysis and Pearson’s correlation coefficients. Differences in quantitative variables between groups dichotomized by AHI level were evaluated by t-test. The discriminant performance of indices between dichotomized AHI groups was evaluated by the area under the curve (AUC) of receiver-operating characteristic (ROC) curve. The significance of differences in AUC between indices were evaluated with Hanley and McNeil’s method [26]. The discriminatory performance of indices with cutoff thresholds was evaluated with the sensitivity, specificity, accuracy, and positive and negative predictive values (PPV and NPV, respectively). The GLM procedure was used to evaluate the factors that influence the relationship between Fcv and AHI, by which examining if the factors had a significant effect on the linear regression model of AHI by Fcv. Statistical significance was considered for P <0.05.

Results

Subjects’ characteristics

Forty-one consecutive patients (age [IQR], 47 [42–58] year, 7 females) who underwent diagnostic PSG for sleep disordered breathing were studied (Table 1). They had a body mass index (BMI) of 25.4 (IQR, 23.4–28.2) kg/m2 and an Epworth Sleepiness Scale score of 4.5 (1.3–16.6). In the PSG study, the median AHI (IQR) was 17.2 (4.4 to 28.4), 22 (54%) of the subjects had an AHI ≥15, and the proportion of obstructive, central, and mixed apnea episodes were 85%, 4%, and 11%, respectively.

Table 1. Patients’ characteristics (n = 41).

Age, y 48 (42–58)
Female (%) 7 (17%)
Body mass index, kg/m2 25.4 (23.4–28.2)
Systolic blood pressure, mm Hg 128 (114–139)
Diastolic blood pressure, mm Hg 81 (74–91)
Epworth Sleepiness Scale score 4.5 (1.3–16.6)
Time in bed, min 471 (448–479)
Total sleep time, min 375 (332–418)
Sleep efficiency, % 81.4 (74.4–88.2)
AHI 17.2 (4.4–28.4)
AI 1.5 (0.5–6.9)
HI 12.0 (4.4–16.2)
OAI 1.3 (0.2–6.9)
CAI 0.1 (0.0–0.3)
MAI 0.1 (0.0–0.4)
2% ODI 15.2 (3.6–26.1)
3% ODI 8.0 (2.4–20.5)
AHI >15 (%) 22 (54%)

Data are median (IQR) or number (%).

The denominator in the calculation of the apnea and hypopnea indices is time in bed.

AHI = apnea-hypopnea index; AI = apnea index; HI = hypopnea index; OAI = obstructive apnea index; CAI = central apnea index; MAI = mixed apnea index; ODA = oxygen desaturation index.

Detection of CVHR from PPG PI and ECG RRI time series

Fig 3 shows ECG RRI and PPG PI time series simultaneously recorded in a representative subject. Although the two trends differ in the fine structure of fluctuations, the repeated dips corresponding to CVHR (blue bars) appear similarly in both trends. Among indices of PI and RRI variability, those reflecting long-term fluctuations (mean NN interval, SDNN, SDANN, and total power) showed closer correlations between PI and RRI than those reflecting short-term fluctuations (DFA α1, LF, and HF) (Table 2). Fcv measured from PI correlated with Fcv from RRI at r = 0.90 (Fig 4b).

Fig 3. R-R interval and pulse interval time series from simultaneously recoded electrocardiogram (ECG) and PPG in a representative subject (a 66-y male with an AHI of 79.3).

Fig 3

Vertical blue lines show the temporal positions of CVHR.

Table 2. Correlations between pulse interval and R-R interval variability indices calculated from simultaneously recorded photoplethysmography (PPG) and electrocardiography (ECG) (n = 41).

Correlation coefficient r
Mean NN interval 0.99
SDNN 0.96
SDANN 0.96
rMSSD 0.74
DC 0.88
DFA α1 0.42
DFA α2 0.74
β 0.64
Total power 0.90
ULF 0.89
VLF 0.74
LF 0.69
HF 0.64
LF/HF 0.74
Fcv 0.90

All correlation coefficients are significant.

NN = normal-to-normal; SDNN = standard deviation of NN interval; SDAPI = standard deviation of 5-min average NN intervals; rMSSD = root mean square of successive differences in NN interval; DC = deceleration capacity of NN intervals; DFA = detrended fluctuation analysis; α1 and α2 = short-term (4–11 beats) and long-term (>11 beats) scaling exponents of NN interval fluctuation; β = spectral exponent of NN interval fluctuation; ULF = ultra-low-frequency (<0.0033 Hz) power of NN interval variation; VLF = very-low-frequency (0.0033–0.04 Hz) power; LF = low-frequency (0.04–0.15 Hz) power; HF = high-frequency (0.14–0.40 Hz) power; LF/HF = LF-to-HF ratio; Fcv = frequency of cyclic variation.

Fig 4. Relationships of PPG and ECG Fcv with AHI.

Fig 4

In all panels a-c, the plots represent individual subjects. The solid line in each panel represents the linear regression line of the data for all subjects. Horizontal and vertical dashed lines in panels a and c represent the thresholds of 15 for AHI, 11 /h for PPG Fcv, and 15 /h for ECG Fcv, respectively.

Relationships between PI and RRI variability and sleep apnea indices

Table 3 shows the correlation coefficients of PI and RRI variability indices with sleep apnea indices. Fcv measured from PI correlated with AHI at r = 0.81, while Fcv from RRI at r = 0.85. Common to both PI and RRI, Fcv showed closer correlations with AI than with HI, and with OAI than with CAI, and it also showed close correlations with 2% and 3% ODIs. No such strong correlations were observed for either time-domain, frequency-domain, or nonlinear indices of variabilities of either PI or RRI, although weak positive correlations were observed between VLF and AI for both PI and RRI.

Table 3. Correlations of PPG pulse interval and ECG R-R interval variability indices with sleep apnea indices (n = 41).

AHI AI HI OAI CAI MAI 2% ODI 3% ODI
PPG pulse interval
 SDNN 0.00 0.20 -0.24 0.18 0.10 0.15 0.02 0.06
 SDANN 0.02 0.17 -0.18 0.17 0.03 0.11 0.02 0.05
 rMSSD -0.14 0.04 -0.32* 0.05 -0.02 0.01 -0.12 -0.07
 DC 0.02 0.08 -0.07 0.05 0.19 0.12 0.02 0.04
 DFA α1 0.17 0.27 -0.02 0.22 0.26 0.31* 0.17 0.18
 DFA α2 -0.22 -0.32* -0.01 -0.31* -0.15 -0.22 -0.23 -0.26
 β -0.21 -0.24 -0.09 -0.23 -0.21 -0.14 -0.21 -0.21
 Total power -0.02 0.20 -0.29 0.21 0.07 0.07 -0.01 0.04
 ULF -0.20 -0.05 -0.31* -0.02 -0.11 -0.12 -0.19 -0.15
 VLF 0.13 0.31* -0.15 0.30 0.22 0.20 0.14 0.17
 LF 0.04 0.21 -0.18 0.19 0.25 0.16 0.05 0.08
 HF 0.10 0.23 -0.10 0.24 0.16 0.05 0.10 0.13
 LF/HF -0.08 -0.05 -0.09 -0.11 0.10 0.17 -0.10 -0.12
 Fcv 0.81* 0.80* 0.53* 0.76* 0.29 0.58* 0.83* 0.83*
ECG R-R interval
 SDNN 0.00 0.18 -0.24 0.17 0.10 0.14 0.01 0.04
 SDANN -0.09 0.04 -0.22 0.03 0.01 0.05 -0.09 -0.06
 rMSSD 0.06 0.27 -0.23 0.30 0.02 0.06 0.08 0.11
 DC 0.06 0.16 -0.10 0.12 0.25 0.19 0.06 0.08
 DFA α1 -0.01 0.08 -0.12 0.03 0.16 0.18 0.00 0.03
 DFA α2 0.08 0.01 0.13 0.08 -0.05 -0.22 0.06 0.04
 β -0.02 -0.17 0.18 -0.16 -0.12 -0.10 -0.03 -0.05
 Total power 0.07 0.29 -0.25 0.30 0.13 0.13 0.08 0.12
 ULF -0.11 0.05 -0.26 0.08 -0.01 -0.07 -0.10 -0.07
 VLF 0.19 0.40* -0.16 0.38* 0.24 0.28 0.21 0.25
 LF 0.00 0.29 -0.38* 0.26 0.25 0.21 0.02 0.08
 HF 0.06 0.26 -0.22 0.27 0.14 0.08 0.07 0.11
 LF/HF -0.05 -0.03 -0.06 -0.10 0.11 0.18 -0.07 -0.10
 Fcv 0.85* 0.80* 0.60* 0.74* 0.33* 0.62* 0.85* 0.85*

*Significant correlation coefficients.

The abbreviations are explained in the footnote to Tables 1 and 2.

Performance of screening for moderate-to-severe sleep apnea

To examine the performance of the Fcv of PI and RRI as indicators for screening sleep apnea, the Fcv was compared between subjects with AHI <15 (no or mild sleep apnea) and those with AHI ≥15 (moderate-to-severe sleep apnea). While no significant group difference was observed for any variability index of either PI or RRI, Fcv was greater in subjects with moderate-to-severe sleep apnea for both PI and RRI (Table 4). The AUC of ROC curve for the group classification was 0.84 and 0.89 for the Fcv of PI and RRI, respectively, which were significantly greater than the AUC of any other variability indices.

Table 4. PPG pulse interval and ECG R-R interval variability indices in patients grouped by AHI and the discriminant performance of the indices.

AHI ≤15 (n = 19) AHI >15 (n = 22) P (t-test) AUC
PPG pulse interval
 SDNN, ms 86 ± 35 77 ± 26 0.3 0.54*
 SDANN, ms 58 ± 26 54 ± 21 0.5 0.54*
 rMSSD, ms 53 ± 20 43 ± 18 0.1 0.68
 DC, ms 8.1 ± 2.4 7.8 ± 3 0.7 0.50*
 DFA α1 0.93 ± 0.13 0.95 ± 0.23 0.8 0.54*
 DFA α2 1.01 ± 0.07 1.00 ± 0.13 0.7 0.58*
 β 1.19 ± 0.14 1.15 ± 0.22 0.5 0.62*
 Total power, ms2 8.7 ± 0.6 8.5 ± 0.8 0.2 0.58*
 ULF, ms2 8.2 ± 0.8 7.7 ± 0.9 0.06 0.66
 VLF, ms2 7.2 ± 0.5 7.0 ± 1.2 0.5 0.47*
 LF, ms2 5.9 ± 0.7 5.5 ± 1.4 0.2 0.53*
 HF, ms2 5.7 ± 0.8 5.5 ± 1.6 0.5 0.46*
 LF/HF 1.4 ± 0.7 1.3 ± 0.8 0.5 0.59*
 Fcv, /h 6.4 ± 4.6 19.6 ± 12.3 <0.0001 0.84
ECG R-R interval
 SDNN, ms 94 ± 43 85 ± 29 0.4 0.53
 SDANN, ms 67 ± 42 55 ± 21 0.3 0.55
 rMSSD, ms 39 ± 22 37 ± 21 0.7 0.51
 DC, ms 9.8 ± 2.1 9.3 ± 3.3 0.6 0.50
 DFA α1 1.13 ± 0.28 1.07 ± 0.43 0.6 0.53
 DFA α2 1.02 ± 0.08 1.08 ± 0.15 0.1 0.62
 β 1.13 ± 0.15 1.19 ± 0.16 0.2 0.61
 Total power, ms2 8.7 ± 0.5 8.6 ± 0.8 0.5 0.53
 ULF, ms2 7.9 ± 0.6 7.7 ± 0.9 0.4 0.55†
 VLF, ms2 7.6 ± 0.7 7.6 ± 0.9 0.8 0.50
 LF, ms2 6.4 ± 0.6 5.9 ± 1.1 0.06 0.61
 HF, ms2 5.7 ± 1.1 5.5 ± 1.2 0.4 0.50
 LF/HF 2.52 ± 1.7 1.87 ± 1.15 0.1 0.60
 Fcv, /h 8.1 ± 5 26.9 ± 15.2 <0.0001 0.89

*Significantly smaller than the AUC of PPG Fcv.

Significantly smaller than the AUC of ECG Fcv.

AUC = area under the receiver-operating curve for classification between patients with AHI ≤15 and >15. The other abbreviations are explained in the footnotes to Tables 1 and 2.

ROC curve analysis revealed that the optimal cutoff of Fcv to screening moderate-to-sever sleep apnea was 11 /h for PI and 15 /h for RRI. With these cutoff values, the Fcv of PI detected moderate-to-sever sleep apnea with 89% specificity, 82% sensitivity, 81% NPV, 90% PPV, and 85% accuracy, and the Fcv of RRI detected it with 95% specificity, 82% sensitivity, 82% NPV, 95% PPV, and 88% accuracy (Table 5). Fig 4 show the linear relationships between the Fcv of PI and RRI and AHI with the cutoff values.

Table 5. Classification performance of PPG and ECG Fcv between patients grouped by AHI.

AHI ≤15 AHI >15
PPG pulse interval Fcv <11/h 17 4 NPV = 81%
Fcv ≥11/h 2 18 PPV = 90%
Specificity = 89% Sensitivity = 82% Accuracy = 85%
ECG R-R interval Fcv <15/h 18 4 NPV = 82%
Fcv ≥15/h 1 18 PPV = 95%
Specificity = 95% Sensitivity = 82% Accuracy = 88%

NPV = negative predictive value; PPV = positive predictive value. The other abbreviations are explained in the footnotes to Tables 1 and 2.

Factors affecting the relationships between Fcv and AHI

The effects of age, sex, BMI (both continuous and dichotomized at 25 kg/m2), systolic and diastolic blood pressures, Epworth Sleepiness Scale score, time in bed, total sleep time, and sleep efficiency on the relationships of Fcv and AHI were analyzed by the GLM procedure. None of these factors, however, had a significant impact on the relationships for the Fcv of either PI or RRI.

In the case-based analyses, Fcv of PI was <11 /h in four subjects with AHI >15 (false negative) and FCV of PI was >11 /h in two subjects with AHI <15 (false positive). Among the false-negative cases, one subject had frequent ventricular ectopic beats (54% of total beats) during the PSG, while Fcv of ECG was >15 /h and correctly detected CVHR even in this case. In the other three false-negative subjects, ECG Fcv was also <15 /h. Beat interval variations associated with their sleep apnea episodes showed large cycle length variability and were excluded from CVHR by the cyclicity criteria (Fig 1). In the false-positive cases, non-specific beat interval variations were misidentified as CVHR due to over-adjustment for low CVHR amplitudes during the classification step based on the relative depth criteria (Fig 1). This error did not occur with ECG Fcv.

Discussions

By applying the ACAT algorithm developed for the automated detection of sleep apnea from ECG, we investigated if sleep apnea can be detected from PPG signals obtained by a wearable watch device. We observed that the Fcv measured from PPG correlated with AHI at r = 0.81 and Fcv values ≥11 /h detected subjects with moderate-to-severe sleep apnea (AHI ≥15) with 89% specificity, 82% sensitivity, 81% NPV, 90% PPV, and 85% accuracy. The classification performance of the Fcv of PPG was comparable to that of ECG. Our findings indicate that by using the ACAT algorithm, PPG signal obtained from a wearable watch device can be used to screen patients with moderate-to-severe sleep apnea.

To our knowledge, this is the first study to show that sleep apnea episodes in adults can be quantitatively detected by PPG pulse wave signals of wearable watch devices. In a study of simultaneous recording of PPG and ECG in normal subjects and patients with obstructive sleep apnea during sleep, Khandoker et al [27] analyzed pulse rate and heart rate variability. They found that frequency domains and complexity analysis measures of both pulse rate and heart rate variability differ between 2-min epochs of normal and sleep apnea events. They also observed that several variability measures (SDNN, rMSSD, HF, LF/HF, and sample entropy) of pulse rate and heart rate differ significantly during sleep apnea. They concluded that pulse rate variability could discriminate between epochs with and without sleep apnea, but it does not precisely reflect heart rate variability in sleep disordered breathing. Using the Apple Watch device, Tison et al [28] collected PPG pulse rate and step count continuously for an average of 8.9 weeks in 6,115 subjects. They performed machine learning using deep neural networks and reported that the developed model predicted prevalent sleep apnea with 90.4% sensitivity and 59.8% specificity. The present study is in the same line with these earlier studies, but none of the earlier studies has reported the quantitative relationships of metrics derived from PPG with AHI. The method we reported here detects each episode of sleep apnea as the CVHR of PI and thus, it can estimate the number and temporal positions of sleep apnea episodes.

The ACAT algorithm we used to detect CVHR has been developed and optimized for ECG RRI [1113], but the present study indicated that the ACAT algorithm can also be used for PPG PI and performs as well as for ECG RRI. Many studies have reported discrepancies and non-substitution of pulse rate and heart rate variability [1519], particularly in various diseases including sleep apnea [27]. Nonetheless, the present study showed equivalence of PPG and ECG in the detection of sleep apnea. This seems to be due to the characteristics of CVHR and to the features of ACAT algorithm. Although inconsistencies in pulse rate and heart rate variability have been reported with indicators that quantify short-term fluctuations such as LF and HF components [8, 16, 19], CVHR is a long-term fluctuation with a cycle length between 25 and 130 s. In fact, we observed almost the same wave forms of CVHR for ECG RRI and PPG PI, while higher-frequency fluctuations showed apparent differences (Fig 3). Consistent with this, closer correlations between RRI and PI were observed for indices reflecting long-term fluctuations than for those reflecting short-term fluctuations (Table 2). Additionally, the ACAT algorithm performs the preprocessing of PI signals by 2nd-order polynomial fitting with 20-s moving window to remove high frequency fluctuations with a cycle length <~20 s (Figs 1 and 2). Furthermore, the algorithm uses an adaptive threshold (depth relative to the envelope range) to detect dips, rather than a fixed threshold. These features are considered to enhance robustness of the algorithm against differences in short-term components and in amplitudes between heart rate and pulse rate variability.

For both PI and RRI, Fcv closely correlated with 2% and 3% ODI, and showed closer correlations with AI than with HI (Table 3). These suggest that CVHR may be more likely to occur with apnea causing hypoxemia than with hypopnea. In an earlier study, Nakano et al. [29] reported the effect of BMI on the relationship between ODI and AHI. They reported that 3% ODI ≥15 was the optimal cutoff to detect moderate-to-severe sleep apnea (AHI ≥15) in patients with BMI ≥25 kg/m2, while 3% ODI ≥10 was the optimal cutoff in patients with BMI <25 kg/m2, suggesting that sleep apnea in obese patients has a greater apnea-to-hypopnea ratio than that in non-obese patients. In the present study, we observed no significant impact of BMI on the relationship between Fcv and AHI; but we observed no significant difference either in apnea-to-hypopnea ratio between those with BMI ≥25 kg/m2 and <25 kg/m2 among patients with AHI ≥15 (apnea-to-hypopnea ratio, 1.3 ± 1.4 vs. 0.4 ± 0.3, P = 0.07). Further studies are needed to clarify the impacts of obesity on the estimation of AHI by Fcv.

Given the widespread availability of wearable watch devices with a PPG sensor, the results of the present study show great potential for using this social resource as a cost-effective large-scale screening of sleep apnea. Sleep apnea is an increased risk of traffic accidents [3, 4] and cardiovascular diseases [5], and this risk may be reduced by treatment [3032]. Finding patients who have been left undiagnosed will have great benefits to social safety and the health care economy. Currently, many excellent portable devices are available for sleep apnea screening, but their use depends on the patient’s motivation. Even if the diagnostic accuracy of PPG sleep apnea detection is comparable to other Type 4 portable devices [33], PPG wearable devices used regardless of motivation may contribute to the detection of sleep apnea in previously unscreened populations.

This study has several limitations. First, we used only one type of wearable watch device (E4 wristband, Empatica, Milano, Italy) and the pulse wave signals were analyzed by the manufacturer’s cloud application via Internet (E4 connect, Empatica, Milan, Italy). Therefore, the results may vary when using other types of device and when measuring PI in other ways. The ACAT algorithm, however, uses only smoothed PI data (2nd-order polynomial fitting with 20-s moving window), which makes the algorithm robust against noises and variations in the accuracy of PI measurement. Second, the ACAT algorithm was developed to detect sleep apnea from sinus rhythm ECG and is not applicable to atrial fibrillation. We excluded subjects who showed continuous atrial fibrillation during the PSG, but sleep apnea, particularly its central form, often accompanies atrial fibrillation [5]. Development of sleep apnea detection algorithms under atrial fibrillation is desired. Third, this study compared the Fcv frequency with AHI whose denominator was time in bed. This is because the PPG method cannot estimate total sleep time (time in bed minus time of awakening). As a result, the Fcv frequency can underestimate AHI with total sleep time as the denominator. To compensate for this difference, a method of estimating sleep efficiency from wearable devices need to be incorporated. Finally, this study used the ACAT algorithm to detect CVHR by PPG, but the classification criteria of this algorithm are optimized for ECG detection of CVHR. The performance of CVHR detection by PPG may be improved by PPG-specific classification criteria. These limitations are topics for future studies.

Conclusions

We examined if sleep apnea can be quantitatively detected from PPG pulse intervals by an automated algorithm called ACAT. The Fcv of PI measured by the ACAT correlated with AHI at r = 0.81 and Fcv values ≥11 /h detected subjects with moderate-to-severe sleep apnea (AHI ≥15) with a PPV of 90%. The analysis of nighttime PPG by the ACAT algorithm could be used for the quantitative screening for sleep apnea.

Acknowledgments

The ACAT algorithm is implemented in a Suzuken Holter ECG scanner (Cardy Analyzer 05, Suzuken Co., Ltd., Nagoya, Japan) and is commercially available.

Data Availability

The data contain potentially identifying or sensitive patient information and cannot be shared publicly. The use of the data is limited to the purpose and method of research approved by the Research Ethics Committee of the Graduate School of Medicine, Nagoya City University and Nagoya City University Hospital (approval number 60-20-0004). However, other researchers may send data access requests to irb_jimu@med.nagoya-cu.ac.jp or the corresponding author (address: hayano@acm.org).

Funding Statement

This study is partly funded by WINFrontier Co., Ltd. This company participated in the study design and supported the data collection, but did not have any additional role in the data analysis, decision to publish, or preparation of the manuscript. The company also provided support in the form of salaries for two of the authors (M.K. and K.I.). The specific roles of these authors are articulated in the ‘author contributions’ section.

References

  • 1.Young T, Peppard PE, Gottlieb DJ (2002) Epidemiology of obstructive sleep apnea: a population health perspective. Am J Respir Crit Care Med 165: 1217–1239. 10.1164/rccm.2109080 [DOI] [PubMed] [Google Scholar]
  • 2.Franklin KA, Lindberg E (2015) Obstructive sleep apnea is a common disorder in the population-a review on the epidemiology of sleep apnea. J Thorac Dis 7: 1311–1322. 10.3978/j.issn.2072-1439.2015.06.11 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Shiomi T, Arita AT, Sasanabe R, Banno K, Yamakawa H, et al. (2002) Falling asleep while driving and automobile accidents among patients with obstructive sleep apnea-hypopnea syndrome. Psychiatry Clin Neurosci 56: 333–334. 10.1046/j.1440-1819.2002.01004.x [DOI] [PubMed] [Google Scholar]
  • 4.Tregear S, Reston J, Schoelles K, Phillips B (2009) Obstructive sleep apnea and risk of motor vehicle crash: systematic review and meta-analysis. J Clin Sleep Med 5: 573–581. [PMC free article] [PubMed] [Google Scholar]
  • 5.Somers VK, White DP, Amin R, Abraham WT, Costa F, et al. (2008) Sleep apnea and cardiovascular disease: an American Heart Association/American College Of Cardiology Foundation Scientific Statement from the American Heart Association Council for High Blood Pressure Research Professional Education Committee, Council on Clinical Cardiology, Stroke Council, and Council On Cardiovascular Nursing. In collaboration with the National Heart, Lung, and Blood Institute National Center on Sleep Disorders Research (National Institutes of Health). Circulation 118: 1080–1111. 10.1161/CIRCULATIONAHA.107.189375 [DOI] [PubMed] [Google Scholar]
  • 6.Cooksey JA, Balachandran JS (2016) Portable Monitoring for the Diagnosis of OSA. Chest 149: 1074–1081. 10.1378/chest.15-1076 [DOI] [PubMed] [Google Scholar]
  • 7.Kundel V, Shah N (2017) Impact of Portable Sleep Testing. Sleep Med Clin 12: 137–147. 10.1016/j.jsmc.2016.10.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Hayano J, Barros AK, Kamiya A, Ohte N, Yasuma F (2005) Assessment of pulse rate variability by the method of pulse frequency demodulation. BiomedEng Online 4: 62 10.1186/1475-925X-4-62 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Lu S, Zhao H, Ju K, Shin K, Lee M, et al. (2008) Can photoplethysmography variability serve as an alternative approach to obtain heart rate variability information? J Clin Monit Comput 22: 23–29. 10.1007/s10877-007-9103-y [DOI] [PubMed] [Google Scholar]
  • 10.Gil E, Orini M, Bailon R, Vergara JM, Mainardi L, et al. (2010) Photoplethysmography pulse rate variability as a surrogate measurement of heart rate variability during non-stationary conditions. Physiol Meas 31: 1271–1290. 10.1088/0967-3334/31/9/015 [DOI] [PubMed] [Google Scholar]
  • 11.Hayano J, Watanabe E, Saito Y, Sasaki F, Fujimoto K, et al. (2011) Screening for obstructive sleep apnea by cyclic variation of heart rate. Circ Arrhythm Electrophysiol 4: 64–72. 10.1161/CIRCEP.110.958009 [DOI] [PubMed] [Google Scholar]
  • 12.Hayano J, Tsukahara T, Watanabe E, Sasaki F, Kawai K, et al. (2013) Accuracy of ECG-based screening for sleep-disordered breathing: a survey of all male workers in a transport company. Sleep Breath 17: 243–251. 10.1007/s11325-012-0681-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Hayano J, Yasuma F, Watanabe E, Carney RM, Stein PK, et al. (2017) Blunted cyclic variation of heart rate predicts mortality risk in post-myocardial infarction, end-stage renal disease, and chronic heart failure patients. Europace 19: 1392–1400. 10.1093/europace/euw222 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Guilleminault C, Connolly S, Winkle R, Melvin K, Tilkian A (1984) Cyclical variation of the heart rate in sleep apnoea syndrome. Mechanisms, and usefulness of 24 h electrocardiography as a screening technique. Lancet 1: 126–131. 10.1016/s0140-6736(84)90062-x [DOI] [PubMed] [Google Scholar]
  • 15.Constant I, Laude D, Murat I, Elghozi JL (1999) Pulse rate variability is not a surrogate for heart rate variability. Clin Sci (Lond) 97: 391–397. [PubMed] [Google Scholar]
  • 16.Wong JS, Lu WA, Wu KT, Liu M, Chen GY, et al. (2012) A comparative study of pulse rate variability and heart rate variability in healthy subjects. J Clin Monit Comput 26: 107–114. 10.1007/s10877-012-9340-6 [DOI] [PubMed] [Google Scholar]
  • 17.Schafer A, Vagedes J (2013) How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram. Int J Cardiol 166: 15–29. 10.1016/j.ijcard.2012.03.119 [DOI] [PubMed] [Google Scholar]
  • 18.Rapalis A, Petrenas A, Simaityte M, Bailon R, Marozas V (2018) Towards pulse rate parametrization during free-living activities using smart wristband. Physiol Meas 39: 055007 10.1088/1361-6579/aac24a [DOI] [PubMed] [Google Scholar]
  • 19.Yuda E, Yamamoto K, Yoshida Y, Hayano J (2020) Differences in pulse rate variability with measurement site. J Physiol Anthropol 39: 4 10.1186/s40101-020-0214-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Yuda E, Shibata M, Ogata Y, Ueda N, Yambe T, et al. (2020) Pulse rate variability: a new biomarker, not a surrogate for heart rate variability. J Physiol Anthropol 39: 21 10.1186/s40101-020-00233-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Berry RB, Brooks R, Gamaldo CE, Harding SM, Lloyd RM, et al. (2015) The AASM manual for the scoring of sleep and associated events: Rules, terminology and technical specifications. Version 2.2 Darien, Illinois: American Academy of Sleep Medicine. [Google Scholar]
  • 22.McCarthy C, Pradhan N, Redpath C, Adler A. Validation of the Empatica E4 wristband; 2016; Ottawa, ON, Canada. pp. 1–4.
  • 23.Corino VDA, Laureanti R, Ferranti L, Scarpini G, Lombardi F, et al. (2017) Detection of atrial fibrillation episodes using a wristband device. Physiol Meas 38: 787–799. 10.1088/1361-6579/aa5dd7 [DOI] [PubMed] [Google Scholar]
  • 24.Bauer A, Kantelhardt JW, Barthel P, Schneider R, Makikallio T, et al. (2006) Deceleration capacity of heart rate as a predictor of mortality after myocardial infarction: cohort study. Lancet 367: 1674–1681. 10.1016/S0140-6736(06)68735-7 [DOI] [PubMed] [Google Scholar]
  • 25.Peng CK, Havlin S, Stanley HE, Goldberger AL (1995) Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time series. CHAOS 5: 82–87. 10.1063/1.166141 [DOI] [PubMed] [Google Scholar]
  • 26.Hanley JA, McNeil BJ (1983) A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 148: 839–843. 10.1148/radiology.148.3.6878708 [DOI] [PubMed] [Google Scholar]
  • 27.Khandoker AH, Karmakar CK, Palaniswami M (2011) Comparison of pulse rate variability with heart rate variability during obstructive sleep apnea. Med Eng Phys 33: 204–209. 10.1016/j.medengphy.2010.09.020 [DOI] [PubMed] [Google Scholar]
  • 28.Tison GH, Singh AC, Ohashi DA, Hsieh JT, Ballinger BM, et al. (2017) Cardiovascular Risk Stratification Using Off-the-Shelf Wearables and a Multi-Task Deep Learning Algorithm. Circulation 136: A21042. [Google Scholar]
  • 29.Nakano H, Ikeda T, Hayashi M, Ohshima E, Itoh M, et al. (2004) Effect of body mass index on overnight oximetry for the diagnosis of sleep apnea. Respir Med 98: 421–427. [DOI] [PubMed] [Google Scholar]
  • 30.Marin JM, Carrizo SJ, Vicente E, Agusti AG (2005) Long-term cardiovascular outcomes in men with obstructive sleep apnoea-hypopnoea with or without treatment with continuous positive airway pressure: an observational study. Lancet 365: 1046–1053. [DOI] [PubMed] [Google Scholar]
  • 31.Young T, Finn L, Peppard PE, Szklo-Coxe M, Austin D, et al. (2008) Sleep disordered breathing and mortality: eighteen-year follow-up of the Wisconsin sleep cohort. Sleep 31: 1071–1078. [PMC free article] [PubMed] [Google Scholar]
  • 32.Cassar A, Morgenthaler TI, Lennon RJ, Rihal CS, Lerman A (2007) Treatment of obstructive sleep apnea is associated with decreased cardiac death after percutaneous coronary intervention. J Am Coll Cardiol 50: 1310–1314. 10.1016/j.jacc.2007.06.028 [DOI] [PubMed] [Google Scholar]
  • 33.Collop NA, Anderson WM, Boehlecke B, Claman D, Goldberg R, et al. (2007) Clinical guidelines for the use of unattended portable monitors in the diagnosis of obstructive sleep apnea in adult patients. Portable Monitoring Task Force of the American Academy of Sleep Medicine. J Clin Sleep Med 3: 737–747. [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Allan R Martin

11 Sep 2020

PONE-D-20-22289

Quantitative detection of sleep apnea with wearable watch device

PLOS ONE

Dear Dr. Hayano,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The manuscript describes an interesting and novel approach to screening for sleep apnea, with clinical relevance. The methods are sound and the manuscript is well written. With appropriate revisions that address the reviewers comments, this manuscript is a good candidate for publication.

Please submit your revised manuscript by Oct 26 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Allan R. Martin

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3. Thank you for stating the following in the Competing Interests section:

[The authors have declared that no competing interests exist.].   

We note that one or more of the authors are employed by a commercial company: WINFrontier Co., Ltd.,

  1. Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form.

Please also include the following statement within your amended Funding Statement.

“The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement.

2. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc.  

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

Additional Editor Comments (if provided):

The manuscript describes an interesting and novel approach to screening for sleep apnea, with clinical relevance. The methods are sound and the manuscript is well written. I recommend that the manuscript is accepted after minor revisions.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear authors,

This article presented an interesting new method of OSAS wide screening based on cardiac activity.

I have only minor comments to formulate.

Please reduce the occurrence of acronyms to improve the understanding of your text.

Short title could be improved (Sleep apnea detection by photoplethismography for example)

l.43-44: add 'sleepiness, reduced sleep quality between 'with' and 'reduced labor...'Please revise the reference if necessary.

l.103-104: The choice of TIB for AHI calculation is unusual with PSG. It leads to an underestimate of the severity of OSAS like with ventolatory polygraphy.

l.175-176 and l. 246-247: the sentences are not clear and need a reformulation.

l.288-290: PPV would be more appropriate. So, you could replace '89%... accuracy' by '90% positive predictive value'

In the discussion and the conclusion, it may be fuitful to compare the efficiency of your method of detection to other ones.

I am thinking particularly about automatic one-channel polygraphy (RU SLEEPING for example). In other words, your method seems to be as efficient as previously mentionned method.

Reviewer #2: This study by Hayano et al. was designed to investigate if PPG signal data could be used to detect sleep apnea.

The authors already established the screening method for sleep apnea by cyclic variations of heart rate (CVHR) from ECG r-r interval using ACAT algorithm.

Hayano J, Watanabe E, Saito Y, Sasaki F, Fujimoto K, et al. (2011) Screening for obstructive sleep apnea by cyclic variation of heart rate. Circ Arrhythm Electrophysiol 4: 64-72.

Hayano J, Tsukahara T, Watanabe E, Sasaki F, Kawai 328 K, et al. (2013) Accuracy of ECG based screening for sleep-disordered breathing: a survey of all male workers in a transport company. Sleep Breath 17: 243-251.

The authors investigated the diagnostic value of CVHR from PPG pulse rate (PPG-Fcv) and concluded it could be used for the quantitative screening for sleep apnea. It is interesting topic, I have just a few comments.

1. I think you cannot evaluate PPG-Fcv if the patients have atrial fibrillation or other arrhythmic disease. Atrial fibrillation is sometimes accompanied by SAS, you should mention this problem as a limitation.

2. In figure 4-a, there are four patients with high-AHI and low-PPG Fcv (false-negative), and two patients with low-AHI and high-PPG Fcv (false-positive). It may not be a big problem in number, please add more discussion as to the main cause of false positive and false negative.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Dr COSTE Olivier (MD, PhD) - Lyon (France)

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Nov 9;15(11):e0237279. doi: 10.1371/journal.pone.0237279.r002

Author response to Decision Letter 0


21 Sep 2020

Reviewer #1: Dear authors,

This article presented an interesting new method of OSAS wide screening based on cardiac activity.

I have only minor comments to formulate.

Please reduce the occurrence of acronyms to improve the understanding of your text.

[Response] We removed unnecessary acronyms, thank you.

Short title could be improved (Sleep apnea detection by photoplethismography for example)

[Response] We revised short title to “Sleep apnea detection by photoplethysmography” as recommended.

l.43-44: add 'sleepiness, reduced sleep quality between 'with' and 'reduced labor...'Please revise the reference if necessary.

[Response] We revised as indicated, thank you (L46).

l.103-104: The choice of TIB for AHI calculation is unusual with PSG. It leads to an underestimate of the severity of OSAS like with ventolatory polygraphy.

[Response] The PPG method cannot estimate TST because the duration of awakening during TIB cannot be determined. Therefore, the frequency of Fcv detected in PPG can only be expected to correlate with AHI whose denominator was time in bed. Consequently, Fcv estimated by PPG can under-estimate the AHI with TST as the denominator. To adjust this difference, a method of estimating sleep efficiency (TST-to-TIB ratio) from wearable devices need to be incorporated. We added this point to study limitation (L378-382).

l.175-176 and l. 246-247: the sentences are not clear and need a reformulation.

[Response] We revised these sentences, thank you (L203-204 and L331-334).

l.288-290: PPV would be more appropriate. So, you could replace '89%... accuracy' by '90% positive predictive value'

[Response] We revised as indicated, thank you (393).

In the discussion and the conclusion, it may be fuitful to compare the efficiency of your method of detection to other ones.

I am thinking particularly about automatic one-channel polygraphy (RU SLEEPING for example). In other words, your method seems to be as efficient as previously mentionned method.

[Response] The diagnostic accuracy of PPG sleep apnea detection is comparable to other Type 4 devices. However, the use of portable devices depends on patient’s motivation. PPG wearable devices used regardless of motivation may contribute to the detection of sleep apnea in previously unscreened populations. We added this to discussion (L362-366).

Reviewer #2: This study by Hayano et al. was designed to investigate if PPG signal data could be used to detect sleep apnea.

The authors already established the screening method for sleep apnea by cyclic variations of heart rate (CVHR) from ECG r-r interval using ACAT algorithm.

Hayano J, Watanabe E, Saito Y, Sasaki F, Fujimoto K, et al. (2011) Screening for obstructive sleep apnea by cyclic variation of heart rate. Circ Arrhythm Electrophysiol 4: 64-72.

Hayano J, Tsukahara T, Watanabe E, Sasaki F, Kawai 328 K, et al. (2013) Accuracy of ECG based screening for sleep-disordered breathing: a survey of all male workers in a transport company. Sleep Breath 17: 243-251.

The authors investigated the diagnostic value of CVHR from PPG pulse rate (PPG-Fcv) and concluded it could be used for the quantitative screening for sleep apnea. It is interesting topic, I have just a few comments.

1. I think you cannot evaluate PPG-Fcv if the patients have atrial fibrillation or other arrhythmic disease. Atrial fibrillation is sometimes accompanied by SAS, you should mention this problem as a limitation.

[Response] We added the following description to limitations (L374-378): The ACAT algorithm was developed to detect sleep apnea from sinus rhythm ECG and is not applicable to atrial fibrillation. We excluded subjects who showed continuous atrial fibrillation during the PSG, but sleep apnea, particularly its central form, often accompanies atrial fibrillation [5]. Development of a sleep apnea detection algorithm by PPG under atrial fibrillation is desired.

2. In figure 4-a, there are four patients with high-AHI and low-PPG Fcv (false-negative), and two patients with low-AHI and high-PPG Fcv (false-positive). It may not be a big problem in number, please add more discussion as to the main cause of false positive and false negative.

[Response] We added a paragraph for the causes of classification errors (L288-297) and also added sentences to limitation (L382-385).

In the case-based analyses, Fcv of PI was <11/h in four subjects with AHI >15/h (false negative) and FCV of PI was >11/h in two subjects with AHI <15/h (false positive) (Fig 4a). Among the false-negative cases, one subject had frequent ventricular ectopic beats (54% of total beats) during the PSG, while Fcv of ECG detected CVHR correctly even in this case. In the other three false-negative subjects, ECG Fcv was also <15/h. Beat interval variations associated with their sleep apnea episodes showed large cycle length variability and were excluded from CVHR by the cyclicity criteria (Fig 1). In the false-positive cases, non-specific beat interval variations were misidentified as CVHR due to over-adjustment for low CVHR amplitudes during the classification step based on the relative depth criteria (Fig 1). This error did not occur with ECG Fcv.

Limitations

Finally, this study used the ACAT algorithm to detect CVHR by PPG, but the classification criteria of this algorithm are optimized for ECG detection of CVHR. The performance of CVHR detection by PPG may be improved by PPG-specific classification criteria and is a topic for future studies.

Decision Letter 1

Allan R Martin

22 Oct 2020

Quantitative detection of sleep apnea with wearable watch device

PONE-D-20-22289R1

Dear Dr. Hayano,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Allan R. Martin

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have carefullly answered to my requirements during the revision process.

Therefore, this manuscript is now acceptable for publication.

Reviewer #2: The authors improved the manuscript according to the Reviewer's comments, and my comments have been addressed appropriately.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Olivier COSTE

Reviewer #2: No

Acceptance letter

Allan R Martin

28 Oct 2020

PONE-D-20-22289R1

Quantitative detection of sleep apnea with wearable watch device

Dear Dr. Hayano:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Allan R. Martin

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    The data contain potentially identifying or sensitive patient information and cannot be shared publicly. The use of the data is limited to the purpose and method of research approved by the Research Ethics Committee of the Graduate School of Medicine, Nagoya City University and Nagoya City University Hospital (approval number 60-20-0004). However, other researchers may send data access requests to irb_jimu@med.nagoya-cu.ac.jp or the corresponding author (address: hayano@acm.org).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES