Abstract
Objectives:
To evaluate the impact of a mentoring program to encourage staff-delivered sleep-promoting strategies on sleep, function, depression, and anxiety among skilled nursing facility (SNF) residents.
Setting and Participants:
Seventy-two residents (mean age 75±15 years; 55.9% female, 41% non-Hispanic white, 35% black, 20% Hispanic, 3% Asian) of two New York City urban SNFs.
Methods:
Using a modified stepped-wedge unit-level intervention, expert mentors provided SNF staff webinars, in-person workshops and weekly sleep pearls via text messaging. Resident data were collected at baseline, post-intervention (V1), and 3-month follow-up (V2), including wrist actigraphy, resident behavioral observations, Pittsburgh Sleep Quality Index (PSQI), Patient Health Questionnaire-9 (PHQ-9) depression scale, Brief Anxiety and Depression Scale (BADS), Brief Cognitive Assessment Tool (BCAT), and select Minimum Data Set 3.0 (MDS 3.0) measures. Linear mixed models were fit for continuous outcomes and mixed effects logistic models for binary outcomes. Outcomes were modeled as a function of time. Planned contrasts compared baseline to V1 and V2.
Results:
There was significant improvement in PSQI scores from baseline to V1 (p=.010), and from baseline to V2 (p=.007). Other significant changes between baseline and V1 included decreased depression (PHQ-9) (p=.027), increased daytime observed out of bed (p= <0.001), and increased daytime observed being awake (p <0.001). At V2 (versus baseline) being observed out of bed decreased (p < 0.001). Daytime sleeping by actigraphy increased from baseline to V1 (p=.005), but not V2. MDS 3.0 Activities of Daily Living (ADLs) and pain showed improvements by the second quarter following implementation of SLUMBER (p’s ≤ 0.022). There were no significant changes in BADS or BCAT between baseline and V1 or V2.
Conclusions and Implications:
SNF residents had improvements in sleep quality and depression with intervention, but improvements were not sustained at 3-months follow-up. The COVID-19 pandemic led to premature study termination, so full impacts remain unknown.
Keywords: sleep, skilled nursing facilities, depression, quality improvement
Brief summary:
The SLUMBER staff mentoring sleep intervention program led to short-term improvements in nursing home residents’ sleep quality and depression.
INTRODUCTION
Among the 1.4 million Americans who reside in skilled nursing facilities (SNFs),1 over two-thirds experience sleep problems.2,3 Residents seldom sleep for a full hour at night and are seldom awake for a full hour during the day,4,5 and those with dementia have even poorer sleep quality.6,7 Poor sleep is strongly correlated with multiple negative conditions and symptoms including circadian dysregulation, depressed mood,8 anxiety,9 pain,10 cognitive impairment,11 physical disability, and decreased engagement in activities.3 Resident sleep difficulties are also a source of stress for nursing staff.12,13
Residents who are sleepy during the day spend more time in bed, engage in fewer social and physical activities, and require more assistance with ADLs than residents who are more alert,3 and sleep disruption is related to less daytime activity participation among SNF residents.14 The relationship between poor sleep and functional impairment is likely bidirectional. Residents with poor nighttime sleep are likely to sleep more during the day and are more depressed, both of which limit participation in activities to enhance cognitive and other domains of function. Sleep disturbance may also increase social isolation, with greater risk for morbidity and mortality.15 Use of sedating medications for sleep may be ineffective and contribute to declining health.16
Dependencies in ADLs17,18 require frequent interactions with staff to meet ongoing care needs;19 however, nursing care practices (which impact time spent in bed, bright light exposure, and nighttime environmental noise) and institutional environments may contribute to impaired sleep.20 Prior research shows that 93% of nursing home staff received no training about sleep or sleep improvement strategies after completing their nursing education.21 Interventions focused on the environment and staff interactions with residents are essential to achieving better sleep.
The current study evaluated a mentored staff-directed approach to improving sleep in nursing home residents called Improving Sleep Using Mentored Behavioral and Environmental Restructuring (SLUMBER). We hypothesized that SLUMBER would improve residents’ subjective and objective sleep quality, decrease depression and anxiety, and improve function (including cognitive function, daytime wakefulness and time out of bed).
METHODS
Study Design
We designed SLUMBER as a four-year hybrid type I effectiveness/implementation randomized modified stepped wedge trial (SWT) in which all clusters (SNF units) receive the intervention but at different time points22 to test the effects of this sleep-focused education and behavioral program for staff on resident outcomes (NCT03327324). The study protocol was previously published (see Chodosh, et al.23). The main analytic approach was a pre-versus-post intervention evaluation with each resident unit as the unit of randomization. Due to COVID-related restrictions implemented in March 2020, New York City SNFs limited non-staff entry, leading to suspension of in-person study activities 1 year early. Therefore, study recruitment and data collection were conducted from March 2018 through March 2020.
We collected baseline data prior to intervention implementation on each unit. Assessments were repeated immediately after the intervention (V1) and again at 3-months follow-up (V2). All study procedures were reviewed and approved by the New York University Grossman School of Medicine Institutional Review Board.
Setting and Participants
We initiated SLUMBER at three not-for-profit SNFs in New York City (bed size: 362 to 500 residents). Facility units averaged 40 beds/unit and residents were ethnically diverse (40–45% other than non-Hispanic White). We randomized the order of facility engagement and units received the intervention within each facility in random order. Prior to unit-level study initiation, letters were sent to residents’ families/next-of-kin informing them of the planned research and the opportunity to opt out of participation. Due to premature termination of study activities because of the COVID-19 pandemic, only data from the first two facilities are available for these analyses.
We conducted the intervention with staff at the unit level and study assessments were performed among individual residents living on those participating units. All unit residents were eligible, except those that staff indicated should not be approached due to inability to communicate, significant behavioral concerns (e.g., risk for physical aggression), severe illness, or family preferences to opt out.
Inclusion criteria were: (1) living on the participating unit; (2) ability to communicate and follow simple commands in English or Spanish; and (3) ability to provide verbal informed consent or with their surrogate (using IRB-approved procedures).
Procedures
At each facility, leadership identified two units for participation based on unit size and likely resident eligibility. Data collection during baseline included use of resident-worn sleep monitoring devices (wrist actigraphs), behavioral observation by research staff (9am-5pm, every 15 minutes for 3 days), questionnaires (administered to residents in interview format by research staff), and specific MDS 3.024 survey items collected quarterly by facility staff, including the surveys before and after baseline assessments. Actigraphy, 3-day behavioral observations, and resident questionnaires were repeated immediately post-intervention (V1; 3–4 months after baseline) and again 3-months later (V2). We used MDS 3.0 data measures closest to these assessment periods for analysis.
SLUMBER Intervention
The intervention with SNF staff took place over a 3-to-4-month period on each unit and included three main components: (1) three webinars; (2) four in-person workshops; and (3) short message service (SMS) text messages reinforcing SLUMBER content, sleep facts, and resident tips. Across all units, 293 staff members participated in one or more activities across all three facilities (245 participated in the two fully engaged facilities). This included 193 CNAs, 62 licensed professional nurses and/or registered nurses, 10 social workers and 28 other facility staff members (e.g., activities director, psychologist). Details of the intervention components are described in Supplementary Table S1.
A sleep psychologist remotely conducted three 20-minute webinars with each shift (day, evening, and night) based on content developed by the intervention team. These live sessions were recorded and made available to all unit staff who wished to provide their contact number via a texted link using a mass messaging platform. A URL was provided, and the recording could be viewed on a smartphone, tablet, or computer. On average 5.4 staff members attended the live presentation of the webinar per shift on each unit.
The four workshops were conducted with staff on each shift by an interdisciplinary team of sleep/geriatrics experts including a geriatrician, a clinical psychologist and one or more nurse practitioners. Workshops reinforced webinar content and focused on unit-specific and resident-specific sleep-related issues and challenges. Using a collaborative “mentoring” style approach, proposed solutions were identified and a plan to evaluate these approaches was developed during the workshop. On average, 4.8 staff members attended the workshop sessions per shift on each unit.
Reminders about the webinar and workshop schedule, core webinar information, and tips and strategies to improve sleep were shared in a weekly text message during and after the intervention phase.
Study Measures and Assessments
Study measures have been previously described (see Chodosh et al. 2023),23 and are summarized below. Demographic data, including age, gender and race/ethnicity were extracted from MDS 3.0. Length of stay at the facility was calculated as the days from first facility admission to the baseline assessment date.
Sleep measures
For objective sleep assessment, participants wore a wrist actigraph (Micro Motionlogger, Ambulatory Monitoring Inc., Ardsley, NY) on the dominant wrist (common in nursing home research due to low activity levels in this setting) for at least three consecutive days and nights. The actigraph is a small watch-sized device that is useful in longitudinal, naturalistic assessments of sleep-wake patterns. Since daily sleep diaries may not capture a resident’s “sleep period” in nursing homes,25 we used pre-specified time for daytime (8AM-4PM) and nighttime (10PM-6AM). Actigraphy measures included: 1) percent of nighttime asleep (the main actigraphy outcome and an estimate of sleep efficiency), 2) number of nighttime awakenings, and 3) nighttime total sleep time.
We assessed resident-reported sleep quality using the Pittsburgh Sleep Quality Index (PSQI), which consists of 18-items evaluating sleep quality and sleep disturbances over the previous month. The PSQI is reported as a total score (range 0–21) and three subscales: sleep efficiency, perceived sleep quality, and daily disturbances.26
Psychological symptom measures
Depression was assessed via questionnaire using the Patient Health Questionnaire (PHQ-9), which includes 9 items to assesses the frequency (0, not at all, to 3, nearly every day) of depressive symptoms over the previous 2 weeks. In the MDS 3.0 development study in 71 SNFs,27 86% of residents completed the instrument with very good agreement between PHQ-9 and a gold standard (weighted κ=.69, 95% CI=.61-.76). Anxiety and depression were assessed with the Brief Anxiety and Depression Scale (BADS), an 8-item measure of depression and generalized anxiety.28
Functional Status and Pain measures
Cognitive function was assessed using the Brief Cognitive Assessment Tool (BCAT),29 a 21-item instrument. Total scores range from 0–50 and a score <38 is indicative of dementia. The BCAT measures contextual memory, executive control, and attentional capacity. Physical function was calculated from MDS 3.0 resident assessments using a total score from seven ADL items (i.e., bed mobility, transfer, locomotion on unit, dressing, eating, toilet use, personal hygiene)30 with a range 0–28 where higher scores indicate more impairment. Pain intensity (MDS 3.0) was measured over the preceding 5 days on a scale of 0 to 10, where higher scores indicate more pain.
Observed behaviors
We measured daytime activity using behavioral observations from 9am-5pm over a 3-day period, where research staff observed participants every 15 minutes noting whether the resident was in or out of bed, and whether they were observed to be awake or asleep.3
Data Analysis
Power analysis:
While a priori power calculations were done for the study, we also performed a power analysis using available data at the point when data collection was halted due to the COVID pandemic, focusing on two primary outcomes: sleep efficiency (by actigraphy) and sleep quality (PSQI total score). We computed Pearson correlations to estimate correlations of the outcomes across the three time points. The Variance Inflation Factor (VIF) was computed as a function of cluster size and intraclass correlation to estimate the variance accounting for the clustering of observations within facilities and units.31 We calculated the detectable effect size assuming power=80%, alpha=0.05, and two-tailed tests, using the calculated correlations and VIF values. There was sufficient power to detect a 10.9% change in actigraphy sleep efficiency from baseline to post-intervention (V1; d=0.68), and an 11% change from baseline to 3-months follow-up (V2; d=0.69). Computations for PSQI found sufficient power to detect a 2.3 unit change in total PSQI from baseline to V1 (d=0.55), and sufficient power to detect a 2.9 unit change in total PSQI from baseline to V2 (d=0.70). These power calculations were similar to the a priori analysis with anticipated power to detect effect sizes of d≥=0.60.
Data analysis:
We used mixed effects models, with a fixed effect for facility, to assess changes in sleep outcomes due to intervention. When applied to repeated measure designs, mixed-effects models accommodate incomplete data across time points (e.g., due to resident death) and can permit specification of a wide variety of residual covariance structures.32 We analyzed continuous outcomes using a three-level linear mixed-effects model with time nested within residents, and residents nested within SNF units. Time is represented as three levels: baseline, V1, and V2. Non-independence of residuals across time were modeled using an unstructured residual covariance matrix. Hypothesis testing compared baseline versus V1, and baseline versus V2. Marginal means were computed for each outcome as a function of the three levels of time.
For the two daytime observed behaviors, a two-level mixed effects logistic regression with random intercepts was estimated with time (baseline, V1 and V2) nested within person. Two contrasts were performed with respect to time; (1) V1 versus baseline; and (2) V2 versus baseline. Estimated marginal probabilities were estimated at each time point.
For analyses of MDS 3.0 data, we created 90-day bins (Quarters), beginning from the start of the intervention as day 0. The baseline quarter was the 90 days before the intervention start. Planned contrasts included: (1) baseline quarter versus the first intervention quarter and (2) baseline quarter versus the post-intervention quarter. Tests of the stability of the measures prior to the intervention were tested via planned contrasts comparing all available pre-intervention quarters to the baseline quarter. Analyses were conducted using Stata version 1536.
RESULTS
Participant flow and characteristics:
Through March 2020, 241 residents had been approached for screening, of whom 92 (38%) enrolled in the study and completed the pre-intervention baseline assessments. Data from 72 (78%) residents with at least one outcome measure completed at baseline from Facilities 1 and 2 were included in the outcome analyses (Figure 1). Data from Facility 3 were dropped as outcome data were not collected (due to COVID-19). There were significant differences across facilities in terms of age, race/ethnicity, pain, cognitive function and some sleep variables at baseline (see Table 1).
Figure 1.
CONSORT-style diagram showing participant flow through the study.
Table 1:
Sample demographics for two participating facilities
| Total (𝑁=72) | Facility 1 (𝑁=38) | Facility 2 (𝑁=34) | 𝑝-value | |
|---|---|---|---|---|
| Age (years)2, Mean±SD [Min-Max] | 74.6±15.2 [21–96] | 64.5±13.6 [21–95] | 85.6±7.0 [70–96] | <0.001 |
| Gender2, n (%) | ||||
| Male | 25 (38.5%) | 15 (44.1%) | 10 (32.3%) | 0.445 |
| Female | 40 (61.5%) | 19 (55.9%) | 21 (67.7%) | |
| Race/Ethnicity1,2 | ||||
| White | 27 (41.5%) | 3 (8.8%) | 24 (77.4%) | <0.001 |
| Asian | 2 (3.1%) | 0 (0.0%) | 2 (6.5%) | 0.224 |
| Black/African American | 23 (35.4%) | 22 (64.7%) | 1 (3.2%) | <0.001 |
| Hispanic | 13 (20.0%) | 9 (26.5%) | 4 (12.9%) | 0.222 |
| Native Hawiian/Pacific Islander | 0 (0%) | 0 (0%) | 0 (0%) | N/A |
| Length of stay (days),2 Mean±SD [Min-Max] | 877±788 [15–3704] | 879±729 [15–2695] | 876±860 [31–3704] | 0.987 |
| Pain in last 5 days,2 n (%) | ||||
| No | 49 (75.4%) | 20 (58.8%) | 29 (93.5%) | |
| Yes | 16 (24.6%) | 14 (41.2%) | 2 (6.5%) | 0.001 |
| Pain Intensity2, Mean±SD [Min-Max] | 1.0±1.9 [0–6] | 1.6±2.2 [0–6] | 0.2±1.0 [0–5] | 0.001 |
| BCAT total score2, Mean±SD [Min-Max] | 27.6±10.1 [7–50] | 28.8±10.0 [7–50] | 26.1±10.1 [7–42] | 0.273 |
| ADL tot A-J, excluding C D F,2 Mean±SD [Min-Max] | 16.6±5.5 [0–24] | 16.3±5.8 [0–24] | 16.9±5.2 [0–23] | 0.691 |
| PHQ-9 Total,3 Mean±SD | 3.6±4.3 | 4.5±4.5 | 2.5±3.8 | 0.052 |
| PSQI Total,3 Mean±SD | 8.0±4.2 | 9.1±3.9 | 6.7±4.2 | 0.018 |
| PSQI F1, Sleep Efficiency,3 Mean±SD | 3.4±2.0 | 4.0±1.8 | 2.7±2.1 | 0.008 |
| PSQI F2, Sleep Quality,3 Mean±SD | 3.1±2.3 | 3.3±2.3 | 2.9±2.4 | 0.493 |
| PSQI F3, Daily Disturbances,3 Mean±SD | 1.6±1.2 | 1.9±1.3 | 1.2±1.1 | 0.024 |
| Sleep Efficiency (Acti),4 Mean±SD [Min-Max] | 75.2±16.4 [34–99] | 67.1±15.9 [37–94] | 83.0±12.7 [34–99] | <0.001 |
| Wake Time (Minutes, Acti),4 Mean±SD [Min-Max] | 119±795 [6–317] | 158±77 [30–302] | 82±61 [6–317] | <0.001 |
Results shown (% of non-missing) or Mean (SD), unless otherwise noted. Abbreviations: BCAT=Brief Cognitive Assessment Tool; ADL=Activities of Daily Living; PHQ-9=Patient Health Questionaire-9; PSQI=Pittsburgh Sleep Quality Inventory; Acti=Actigraphy.
Results shown as n(% of non-missing) for each response, multiple responses were allowed.
𝑁=[65, 34, 31].
𝑁=[69, 38, 31].
𝑁=[63, 31, 32].
Effects of the intervention on outcomes
The intervention demonstrated a significant reduction (improvement) in PSQI total score from baseline to V1, and from baseline to V2. Although the PSQI subscale findings varied by time point, there was significant improvement on the sleep efficiency subscale at V1, and on the daytime disturbances subscale at V2. There was a significant increase in minutes of daytime sleep (by actigraphy) from baseline to V1 (p=.005), which was not significant at V2. There were no significant changes in the other actigraphy variables (Tables 2 and 3).
Table 2.
Contrast Estimates with Sample Size, Standard Error, Confidence Intervals and P-Values for Each Outcome.
| V1 vs baseline | V2 vs baseline | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| N 3 | Estimate | (SE) | [95% CI] | p-value | Estimate | (SE) | [95% CI] | p-value | |
|
Actigraphy
% Sleep Efficiency (nighttime)1 |
67 | 0.44 | (1.84) | [−3.17, 4.04] | 0.813 | −0.26 | (1.96) | [−4.10, 3.57] | 0.894 |
| # Of Awakenings (nighttime)1 | 67 | −0.58 | (0.92) | [−2.39, 1.23] | 0.531 | 0.34 | (1.18) | [−1.98, 2.66] | 0.772 |
| Minutes Sleep (daytime napping)1 | 65 | 56.67 | (19.67) | [18.11, 95.23] | 0.004 | 35.75 | (21.25) | [−5.90, 77.39] | 0.092 |
|
PSQI Total Score |
69 | −1.22 | (0.47) | [−2.14, −0.30] | 0.009 | −1.53 | (0.57) | [−2.66, −0.41] | 0.008 |
| Factor 1: Sleep Efficiency1 | 69 | −0.56 | (0.28) | [−1.11, −0.01] | 0.048 | −0.59 | (0.31) | [−1.20, 0.02] | 0.060 |
| Factor 2: Sleep Quality1 | 69 | −0.42 | (0.27) | [−0.95, 0.12] | 0.127 | −0.51 | (0.28) | [−1.05, 0.03] | 0.062 |
| Factor 3: Daily Disturbances1 | 69 | −0.24 | (0.14) | [−0.52, 0.04] | 0.092 | −0.40 | (0.17) | [−0.74, −0.06] | 0.023 |
| PHQ-9 1 | 69 | −1.18 | (0.54) | [−2.23, −0.12] | 0.028 | −0.99 | (0.67) | [−2.30, 0.32] | 0.140 |
| BADS | |||||||||
| Anxiety1 | 69 | −0.33 | (0.31) | [−0.94, 0.27] | 0.279 | −0.12 | (0.39) | [−0.89, 0.65] | 0.756 |
| Depression1 | 69 | −0.09 | (0.23) | [−0.54, 0.36] | 0.695 | −0.17 | (0.37) | [−0.89, 0.55] | 0.641 |
| Total Score1 | 69 | −0.42 | (0.41) | [−1.22, 0.38] | 0.302 | −0.24 | (0.66) | [−1.54, 1.05] | 0.711 |
| BCAT | 69 | −0.52 | (0.60) | [−1.68, 0.65] | 0.387 | −0.23 | (1.03) | [−2.25, 1.78] | 0.820 |
|
| |||||||||
|
Behavioral Observations Out of Bed2 |
70 | 0.0361 | (0.0067) | [0.0230, 0.0492] | <0.001 | −0.0393 | 0.0075 | [−0.0541, −0.0245] | <0.001 |
|
| |||||||||
| Awake2 | 70 | 0.0300 | (0.0071) | [.0161, .0438] | <0.001 | −.0124 | .0083 | [−.0287, .0039] | 0.137 |
Note: V1 = post-intervention; V2 = 3-months post-intervention. Actigraphy = wristwatch device worn by subjects for three consecutive days. Abbreviations: PSQI= Pittsburgh Sleep Quality Index; PHQ-9 = Patient Health Questionnaire-9; BCAT = Brief Cognitive Assessment Tool; BADS = Brief Anxiety and Depression Scale.
Linear mixed model.
Mixed effects logistic model.
Number of subjects (residents)
Table 3.
Estimated Margins from Mixed Model (see Table 2), with standard error SE and 95% confidence interval by Outcome and Time-Point
| Baseline | V1 | V2 | |||||||
|---|---|---|---|---|---|---|---|---|---|
|
| |||||||||
| Estimate | (SE) | [95% CI] | Estimate | (SE) | [95% CI] | Estimate | (SE) | [95% CI] | |
|
Actigraphy
% Sleep Efficiency (nighttime)1 |
74.48 | (1.82) | [70.92, 78.05] | 74.92 | (2.17) | [70.67, 79.17] | 74.22 | (2.41) | [69.50, 78.95] |
| # Of Awakenings (nighttime) 1 | 11.71 | (0.74) | [10.27, 13.15] | 11.13 | (0.88) | [9.40, 12.86] | 12.05 | (1.14) | [9.82, 14.29] |
| Minutes Sleep (daytime napping) 1 | 310.04 | (18.63) | [273.52,346.55] | 366.71 | (24.90) | [317.90,415.52] | 345.79 | (23.91) | [298.93,392.64] |
|
PSQI
Total Score 1 |
8.06 | (0.49) | [7.11, 9.01] | 6.84 | (0.45) | [5.95, 7.72] | 6.53 | (0.53) | [5.50, 7.56] |
| Factor 1: Sleep Efficiency 1 | 3.40 | (0.23) | [2.94, 3.86] | 2.84 | (0.24) | [2.37, 3.31] | 2.81 | (0.22) | [2.37, 3.24] |
| Factor 2: Sleep Quality 1 | 3.09 | (0.28) | [2.54, 3.65] | 2.68 | (0.27) | [2.15, 3.20] | 2.58 | (0.32) | [1.96, 3.20] |
| Factor 3: Daily Disturbances 1 | 1.57 | (0.14) | [1.28, 1.85] | 1.33 | (0.13) | [1.08, 1.58] | 1.17 | (0.15) | [0.87, 1.47] |
| PHQ-9 1 | 3.64 | (0.50) | [2.65, 4.63] | 2.46 | (0.45) | [1.57, 3.35] | 2.65 | (0.59) | [1.50, 3.80] |
| BADS | |||||||||
| Anxiety 1 | 3.10 | (0.35) | [2.42, 3.78] | 2.76 | (0.37) | [2.04, 3.49] | 2.98 | (0.47) | [2.05, 3.90] |
| Depression 1 | 2.29 | (0.19) | [1.91, 2.67] | 2.20 | (0.26) | [1.69, 2.71] | 2.12 | (0.34) | [1.45, 2.79] |
| Total Score 1 | 5.39 | (0.48) | [4.45, 6.34] | 4.97 | (0.54) | [3.91, 6.04] | 5.15 | (0.72) | [3.74, 6.56] |
| BCAT 1 | 28.56 | (1.24) | [26.12, 30.99] | 28.04 | (1.31) | [25.47, 30.61] | 28.32 | (1.49) | [25.39, 31.25] |
|
| |||||||||
|
Behavioral Observations Out of Bed2 |
0.4892 | (0.0409) | [.4091, .5694] | .5253 | (.0409) | [.4451,.6055] | .4499 | (.0404) | [.3707, .5694] |
|
| |||||||||
| Awake2 | 0.7457 | (0.0244) | [.6979, .7935] | .7759 | .0231 | [.7304, .8210] | .7333 | (.0254) | [.6834, .7832] |
Note: V1 = immediately post-intervention; V2 = 3-months post-intervention. Actigraphy = wrist watch device worn by subjects for three consecutive days. Abbreviations: PSQI= Pittsburgh Sleep Quality Index; PHQ-9 = Patient Health Questionnaire-9; BCAT = Brief Cognitive Assessment Tool; BADS = Brief Anxiety and Depression Scale.
Marginal means from linear mixed model.
Marginal probabilities from mixed effects logistic model.
PHQ-9 total scores were lower at V1 compared to baseline, but not at V2. Anxiety/depression as assessed with BADS did not change from baseline to V1 or V2 (Tables 2 and 3).
Cognitive function (BCAT total score) showed no significant changes from baseline to V1 or V2 (Tables 2 and 3). MDS 3.0 assessments of ADLs and pain showed no significant changes across the quarters prior to intervention. ADLs and pain were not significantly different comparing the first intervention quarter to the baseline quarter; however, both were significantly improved comparing the post-intervention quarter to baseline. ADLs improved (increased) by 0.74 (p=0.022, 95% CI=[0.10, 1.38]) and pain improved (decreased) by −0.55 (p=0.034, 95% CI=[−1.06, −0.04]) (Supplemental Tables S2 and S3 and Figure S1).
Daytime behavioral observations out of bed and awake both showed significant improvements (increases) from baseline to V1; however, observations out of bed decreased from baseline to V2, and there was no change from baseline to V2 in observations awake (Tables 2 and 3).
DISCUSSION
This study examined the impact of SLUMBER, a mentored staff-directed approach to improving sleep in nursing home residents, on resident outcomes. The intervention led to improved self-reported sleep quality between baseline and post-intervention assessment, and improvement was sustained at 3-month follow-up. Sustained improvement in subjective sleep over 6 months from a staff mentoring program like SLUMBER has not been found in prior studies. One prior study of a staff education intervention found improvement in PSQI-measured sleep quality after the initial 3-month intervention but no change from baseline to 6-months.33 Of note, we found that the PSQI subscale of sleep efficiency improved at V1 but was not sustained at V2, while the PSQI daytime dysfunction scale showed no change at V1 but improved at V2, suggesting that daytime symptoms may take longer to improve than nighttime sleep.
We found no change in nighttime sleep measured by actigraphy. Daytime sleep (by actigraphy) increased (worsened) from baseline to V1 but showed no overall change from baseline to V2. A prior staff education study that included actigraphy showed less daytime and more nighttime sleep in the intervention versus control groups.34 In that study participants had severe dementia and the intervention was implemented by research staff. Results in prior research involving research staff implementation of interventions have had mixed results, with some reporting improved sleep by actigraphy,35–37 and another reporting no change.38
Using direct observations of enrolled residents, we found that, with intervention, residents were more awake and out of bed during the daytime at post-intervention, but this was not sustained (it was reversed) at V2. The reason for this is unclear; however, in the absence of a control group, it is difficult to know whether this trend represents a natural worsening of sleepiness among residents over time. In addition, we were not able to directly observe staff behavior due to the pragmatic nature of this trial (i.e., observation itself can change behavior in unnatural ways) and privacy of non-enrolled residents.
PHQ-9 depression scores improved from baseline to V1 but were not sustained at V2, and there was no change in measures of anxiety. These findings of improvement in depression but not anxiety are consistent with results from a study in Turkey in which research staff provided CBT to cognitively intact residents in NHs.39
We found no immediate changes in ADL function or cognitive function following the intervention, but some improvement in ADLs at the post-intervention quarter. This is consistent with the PSQI findings showing delayed improvements in daytime symptoms after the intervention began.
While this study had multiple strengths including its pragmatic approach, diversity of patients and staff and interdisciplinary mentoring team, there are notable limitations. First, we do not know the frequency and intensity of sleep-promoting strategies used by facility staff in their direct work with individual residents. Staff were responsible for all residents on each unit (not only enrolled residents), and non-consented residents may have benefited from the intervention in ways that could not be captured within the study. Also, some factors contributing to poor sleep may not have been addressed in the intervention and the etiology of sleep disturbance in SNFs is multifactorial. The COVID-19 pandemic impacted data collection and prevented sufficient data collection at the third facility resulting in a small sample size that prevented subgroup analyses.
Aside from data on general attendance at webinars and workshops, we lack individual staff data and it is not clear what specific strategies they implemented during their work shifts. Also, the relationship between participating staff characteristics (e.g., level of training) and resident-level outcomes is unknown. Informal comments at workshops suggested that facilities use staff working on non-engaged units and staff from outside agency on the intervention units may have diluted the impact of SLUMBER at some points during the study. As recently demonstrated,40 staffing shortages and care provided by less familiar agency staff may independently contribute to decreased total nighttime sleep among residents.
Although our intervention provided staff with access to an interdisciplinary team of experts and allowed the ability to build on intervention approaches in real time, this is unlikely to be feasible in other SNF settings. However, SLUMBER focus on mentoring and multicomponent aspects of behavioral and environmental restructuring may be useful in other settings.
In conclusion, the SLUMBER intervention improved resident self-reported sleep quality and depression symptoms although no changes in actigraphy measures of nighttime sleep, ADLs or cognitive function were found. Improved subjective sleep quality and depression may be early indicators of benefit while outcomes related to daytime functioning may emerge later. The COVID-19 pandemic forced early termination of the study, so the full impact of the intervention is unknown. Content, strategies, and technology used in this study may provide direction for future models of sleep intervention among SNF residents.
Supplementary Material
Acknowledgements:
This study was supported by the National Institute of Nursing Research, the National Institute on Aging, and the National Heart, Lung, and Blood Institute of the National Institutes of Health, and VA Health Services Research & Development Service.
Conflicts of Interest and Sources of Funding:
This study was supported by the National Institute of Nursing Research (R01NR016461, PI: Chodosh), National Institute on Aging (K23AG055668, PI: Song), and the National Heart, Lung, and Blood Institute (K24HL143055, PI: Martin) of the National Institutes of Health. Dr. Martin is supported by a VA HSR&D Research Career Scientist Award (RCS 20-191). The content is solely the responsibility of the authors and does not necessarily represent the official views of the Department of Veterans Affairs, National Institutes of Health, or the U.S. Government.
Footnotes
The authors report no conflicts with any product mentioned or concept discussed in this article.
REFERENCES
- 1.Nursing Home Data Compendium 2015 Edition (https://www.cms.gov/Medicare/Provider-Enrollment-and-certification/CertificationandComplianc/Downloads/nursinghomedatacompendium_508-2015.pdf) Accessed 1/5/2024. 2015.
- 2.Valenza MC, Cabrera-Martos I, Martín-Martín L, Pérez-Garzón VM, Velarde C, Valenza-Demet G. Nursing homes: impact of sleep disturbances on functionality. Arch Gerontol Geriatr. May-Jun 2013;56(3):432–6. doi: 10.1016/j.archger.2012.11.011 [DOI] [PubMed] [Google Scholar]
- 3.Martin JL, Webber AP, Alam T, Harker JO, Josephson KR, Alessi CA. Daytime sleeping, sleep disturbance and circadian rhythms in nursing home residents. American Journal of Geriatric Psychiatry. 2006 2006;14(2):121–129. In File. [DOI] [PubMed] [Google Scholar]
- 4.Pat-Horenczyk R, Klauber MR, Shochat T, Ancoli-Israel S. Hourly profiles of sleep and wakefulness in severely versus mild-moderately demented nursing home patients. Aging Clin Exp Res. 1998 1998;10:308–315. In File. [DOI] [PubMed] [Google Scholar]
- 5.Jacobs D, Ancoli-Israel S, Parker L, Kripke DF. Twenty-four hour sleep-wake patterns in a nursing home population. Psychol and Aging. 1989 1989;4(3):352–356. In File. [DOI] [PubMed] [Google Scholar]
- 6.Kume Y, Kodama A, Sato K, Kurosawa S, Ishikawa T, Ishikawa S. Sleep/awake status throughout the night and circadian motor activity patterns in older nursing-home residents with or without dementia, and older community-dwelling people without dementia. Int Psychogeriatr. Dec 2016;28(12):2001–2008. doi: 10.1017/s1041610216000910 [DOI] [PubMed] [Google Scholar]
- 7.Bloom HG, Ahmed I, Alessi CA, et al. Evidence-based recommendations for the assessment and management of sleep disorders in older persons. Journal of the American Geriatrics Society. 2009 2009;57(5):761–789. In File. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Chau R, Kissane DW, Davison TE. Risk Factors for Depression in Long-term Care: A Prospective Observational Cohort Study. Clin Gerontol. Jul 2 2019:1–14. doi: 10.1080/07317115.2019.1635548 [DOI] [PubMed] [Google Scholar]
- 9.Smalbrugge M, Pot AM, Jongenelis L, Grundy CM, Beekman AT, Eefsting JA. The impact of depression and anxiety on well being, disability and use of health care services in nursing home patients. Psychiatric Services. 9/1/2002 2002;53(9):1159–1165. Not in File. [DOI] [PubMed] [Google Scholar]
- 10.Zanocchi M, Maero B, Nicola E, et al. Chronic pain in a sample of nursing home residents: prevalence, characteristics, influence on quality of life. Archives of Gerontology and Geriatrics. 11/13/2007 2007;epub ahead of pringIn File. [DOI] [PubMed] [Google Scholar]
- 11.Saito Y, Kume Y, Kodama A, Sato K, Yasuba M. The association between circadian rest-activity patterns and the behavioral and psychological symptoms depending on the cognitive status in Japanese nursing-home residents. Chronobiol Int. Nov 2018;35(12):1670–1679. doi: 10.1080/07420528.2018.1505752 [DOI] [PubMed] [Google Scholar]
- 12.Wilfling D, Dichter MN, Trutschel D, Köpke S. Nurses’ burden caused by sleep disturbances of nursing home residents with dementia: multicenter cross-sectional study. BMC Nurs. 2020;19:83. doi: 10.1186/s12912-020-00478-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Webster L, Powell K, Costafreda S, Livingston G. The impact of sleep disturbances on care home residents with dementia: the SIESTA qualitative study. International Psychogeriatrics. 2020;32(7):839–847. [DOI] [PubMed] [Google Scholar]
- 14.Martin JL, Fiorentino L, Jouldjian S, Mitchell M, Josephson KR, Alessi CA. Poor self-reported sleep quality predicts mortality within one year of inpatient post-acute rehabilitation among older adults. Sleep. 2011 2011;134(12):1715–1721. In File. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Dale MC, Burns A, Panter L, Morris J. Factors affecting survival of elderly nursing home residents. International Journal of Geriatric Psychiatry. 2001 2001;16:70–76. Not in File. [DOI] [PubMed] [Google Scholar]
- 16.Bourgeois J, Elseviers MM, Van Bortel L, Petrovic M, Vander Stichele RH. One-year evolution of sleep quality in older users of benzodiazepines: a longitudinal cohort study in belgian nursing home residents. Drugs Aging. 2014 2014;31(9):677–682. In File. [DOI] [PubMed] [Google Scholar]
- 17.Alessi CA, Schnelle JF. Approach to sleep disorders in the nursing home setting. Sleep Medicine Reviews. 2000 2000;4(1):45–56. In File. [DOI] [PubMed] [Google Scholar]
- 18.Wang J, Kane RL, Eberly LE, Virnig BA, Chang LH. The effects of resident and nursing home characteristics on activities of daily living. J Gerontol A Biol Sci Med Sci. Apr 2009;64(4):473–80. doi: 10.1093/gerona/gln040 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Havig AK, Skogstad A, Veenstra M, Romøren TI. Real teams and their effect on the quality of care in nursing homes. BMC Health Serv Res. Dec 1 2013;13:499. doi: 10.1186/1472-6963-13-499 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Shochat T, Martin J, Marler M, Ancoli-Israel S. Illumination levels in nursing home patients: effects on sleep and activity rhythms. J Sleep Res. 2000 2000;9(4):373–380. In File. [DOI] [PubMed] [Google Scholar]
- 21.Wilfling D, Berg A, Dörner J, et al. Attitudes and knowledge of nurses working at night and sleep promotion in nursing home residents: multicenter cross-sectional survey. BMC Geriatr. Mar 31 2023;23(1):206. doi: 10.1186/s12877-023-03928-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Copas AJ, Lewis JJ, Thompson JA, Davey C, Baio G, Hargreaves JR. Designing a stepped wedge trial: three main designs, carry-over effects and randomisation approaches. Trials. Aug 17 2015;16:352. doi: 10.1186/s13063-015-0842-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Chodosh J, Mitchell MN, Cadogan M, et al. Improving sleep using mentored behavioral and environmental restructuring (SLUMBER): A randomized stepped-wedge design trial to evaluate a comprehensive sleep intervention in skilled nursing facilities. Contemp Clin Trials. Mar 2023;126:107107. doi: 10.1016/j.cct.2023.107107 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Saliba D, Buchanan J, Edelen MO, et al. MDS 3.0: brief interview for mental status. J Am Med Dir Assoc. Sep 2012;13(7):611–7. doi: 10.1016/j.jamda.2012.06.004 [DOI] [PubMed] [Google Scholar]
- 25.Ancoli-Israel S, Martin JL, Blackwell T, et al. The SBSM Guide to Actigraphy Monitoring: Clinical and Research Applications. Behav Sleep Med. 2015;13 Suppl 1:S4–S38. doi: 10.1080/15402002.2015.1046356 [DOI] [PubMed] [Google Scholar]
- 26.Buysse DJ, Reynolds CFI, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry Res. 1989 1989;28(2):193–213. In File. [DOI] [PubMed] [Google Scholar]
- 27.Saliba D, DiFilippo S, Edelen MO, Kroenke K, Buchanan J, Streim J. Testing the PHQ-9 interview and observational versions (PHQ-9 OV) for MDS 3.0. J Am Med Dir Assoc. Sep 2012;13(7):618–25. doi: 10.1016/j.jamda.2012.06.003 [DOI] [PubMed] [Google Scholar]
- 28.Mansbach WE, Mace RA, Clark KM. The Brief Anxiety and Depression Scale (BADS): a new instrument for detecting anxiety and depression in long-term care residents. Int Psychogeriatr. Apr 2015;27(4):673–81. doi: 10.1017/s1041610214002397 [DOI] [PubMed] [Google Scholar]
- 29.Mansbach WE, MacDougall EE, Rosenzweig AS. The Brief Cognitive Assessment Tool (BCAT): a new test emphasizing contextual memory, executive functions, attentional capacity, and the prediction of instrumental activities of daily living. J Clin Exp Neuropsychol. 2012;34(2):183–94. doi: 10.1080/13803395.2011.630649 [DOI] [PubMed] [Google Scholar]
- 30.Morris JN, Fries BE, Morris SA. Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. Nov 1999;54(11):M546–53. doi: 10.1093/gerona/54.11.m546 [DOI] [PubMed] [Google Scholar]
- 31.Singh J, Liddy C, Hogg W, Taljaard M. Intracluster correlation coefficients for sample size calculations related to cardiovascular disease prevention and management in primary care practices. BMC Res Notes. Mar 20 2015;8:89. doi: 10.1186/s13104-015-1042-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Littell WP, Pendergast J, Natarajan R. Modelling covariance structure in the analysis of repeated measures data. Statistics in Medicine. 2000 2000;19:1793–1819. Not in File. [DOI] [PubMed] [Google Scholar]
- 33.Gattinger H, Hantikainen V, Ott S, Stark M. Effectiveness of a mobility monitoring system included in the nursing care process in order to enhance the sleep quality of nursing home residents with cognitive impairment. Health and Technology. 2017/11/01 2017;7(2):161–171. doi: 10.1007/s12553-016-0168-9 [DOI] [Google Scholar]
- 34.Li J, Grandner MA, Chang YP, Jungquist C, Porock D. Person-Centered Dementia Care and Sleep in Assisted Living Residents With Dementia: A Pilot Study. Behav Sleep Med. Mar-Apr 2017;15(2):97–113. doi: 10.1080/15402002.2015.1104686 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Alessi CA, Yoon EJ, Schnelle JF, Al-Samarrai NR, Cruise PA. A randomized trial of a combined physical activity and environmental intervention in nursing home residents: Do sleep and agitation improve? JAGS. 1999 1999;47:784–791. In File. [DOI] [PubMed] [Google Scholar]
- 36.Alessi CA, Martin JL, Webber AP, Kim EC, Harker JO, Josephson KR. Randomized controlled trial of a nonpharmacological intervention to improve abnormal sleep/wake patterns in nursing home residents. Journal of the American Geriatrics Society. 2005 2005;53(5):619–626. In File. [DOI] [PubMed] [Google Scholar]
- 37.Schnelle JF, Alessi CA, Al-Samarrai NR, Fricker RD, Ouslander JG. The nursing home at night: effects of an intervention on noise, light and sleep. JAGS. 1999 1999;47:430–438. In File. [DOI] [PubMed] [Google Scholar]
- 38.Ouslander JG, Connell BR, Bliwise DL, Endeshaw Y, Griffiths P, Schnelle JF. A nonpharmacological intervention to improve sleep in nursing home patients: results of a controlled clinical trial. J Am Geriatr Soc. Jan 2006;54(1):38–47. doi: 10.1111/j.1532-5415.2005.00562.x [DOI] [PubMed] [Google Scholar]
- 39.Dolu I, Nahcivan NO. Impact of a nurse-led sleep programme on the sleep quality and depressive symptomatology among older adults in nursing homes: A non-randomised controlled study. Int J Older People Nurs. Mar 2019;14(1):e12215. doi: 10.1111/opn.12215 [DOI] [PubMed] [Google Scholar]
- 40.Taani MH, Kovach CR. Do Daytime Activity, Mood and Unit Tumult Predict Nighttime Sleep Quality of Long-Term Care Residents? Healthcare (Basel). Dec 23 2021;10(1)doi: 10.3390/healthcare10010022 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

