Abstract
Purpose of Review
We summarized peer-reviewed literature investigating the effect of virtual mindfulness-based interventions (MBIs) on sleep quality. We aimed to examine the following three questions: (1) do virtual MBIs improve sleep quality when compared with control groups; (2) does the effect persist long-term; and (3) is the virtual delivery method equally feasible compared to the in-person delivery method?
Recent Findings
Findings suggest that virtual MBIs are equivalent to evidence-based treatments, and to a limited extent, more effective than non-specific active controls at reducing some aspects of sleep disturbance. Overall, virtual MBIs are more effective at improving sleep quality than usual care controls and waitlist controls. Studies provide preliminary evidence that virtual MBIs have a long-term effect on sleep quality. Moreover, while virtual MBI attrition rates are comparable to in-person MBI attrition rates, intervention adherence may be compromised in the virtual delivery method.
Summary
This review highlights virtual MBIs as a potentially effective alternative to managing sleep disturbance during pandemic-related quarantine and stay-at-home periods. This is especially relevant due to barriers of accessing in-person interventions during the pandemic. Future studies are needed to explore factors that influence adherence and access to virtual MBIs, with a particular focus on diverse populations.
Keywords: Virtual, Mindfulness, Meditation, Sleep quality, Insomnia
Introduction
A recent meta-analysis (n = 54,231) reported that disrupted sleep affects approximately 40% of the general and healthcare populations during the novel coronavirus pneumonia (COVID-19) pandemic [1••]. Several factors contribute to the rising rate of disrupted sleep, including decreased physical activity from home quarantine, increased screen time from teleworking, and the barrage of stress-inducing news related to the pandemic [2•,3•]. Pandemic-induced poor sleep quality is concerning, given that sleep disturbances are associated with increased risk for adverse physical health outcomes [4, 5], mood dysregulation [6, 7], decreased cognitive function [8, 9], and compromised immune system [10, 11]. Moreover, sleep quality is directly linked to vaccine immune response [12]. As such, addressing sleep disturbance during the pandemic is critical for population well-being.
Pharmaceutical sleep aids and behavioral therapy (e.g., cognitive behavioral therapy (CBT)) are two forms of evidence-based treatments available to address poor sleep. However, medication can cause adverse side effects (e.g., memory loss, behavioral changes, headaches) and result in abuse and dependence [13, 14]. While CBT is more tolerable, it can be expensive, inaccessible, and may not be a viable standalone treatment for all patients [15–17]. For instance, individuals with substantial sleep deprivation (i.e., total sleep time < 3.65 h) may not be able to endure certain components of CBT, such as sleep restriction, and usually require additional time commitment to experience improvement in sleep quality [16, 18]. In this case, adjunctive strategies are needed to promote retention and encourage a clinical response. Furthermore, the structure of CBT may not be feasible for populations that have a greater propensity for decreased motivation (e.g., individuals facing multiple mental and physical health conditions) [15]. As such, alternative approaches are needed to increase patient choice and sustain treatment engagement. Mindfulness-based interventions (MBIs), such as mindfulness-based stress reduction (MBSR) and acceptance and commitment therapy (ACT), have demonstrated efficacy in improving sleep quality and may serve as an alternative treatment for sleep disturbance [19, 20]. Mindfulness training involves a non-judgmental awareness of the present moment [21]. MBIs consist of 1- to 2-month instructional courses that include weekly mindfulness exercises and lectures. While there are many MBIs with different lecture material and supplementary content, they incorporate a common set of exercises involving formal meditation (e.g., sitting meditations, walking meditations, body scans) and informal practices (e.g., cultivating awareness in daily activities such as eating, breathing, and walking). Traditionally, MBIs take place in-person and in a community-based setting [22]. Due to the pandemic, traveling to and from wellness destinations and participating in large group gatherings are limited in safety and feasibility.
Technological advances have enabled the virtual delivery of behavioral interventions across a range of personal devices, which can circumvent some of the challenges encountered with in-person delivery of behavioral interventions during a pandemic [23]. For instance, virtual MBIs, which are delivered via an online or offline program and accessed via technological devices, such as laptops or mobile phones, have the potential to increase accessibility. Examples of virtual MBI program interfaces include self-guided web-based applications and therapist-led video conference sessions. Research comparing the efficacy of virtual MBIs to in-person MBIs suggests that the two delivery methods are comparable. For example, Wolever and colleagues [24] found that virtual and in-person MBIs produced similar improvements in stress, as well as sleep quality. They also observed lower rates of attrition in the virtual mindfulness group (3.8%) compared to the in-person mindfulness group (27.3%), suggesting that the virtual delivery method may be more feasible. On the other hand, a study comparing teleconference-based ACT to in-person ACT found that both delivery methods improved physical and mental health symptoms, but not sleep disturbance [25]. Given the increased disruption of sleep and social distancing guidelines resulting from the COVID-19 pandemic, there is a significant need to test the efficacy of sleep interventions that are accessible from the home. The objective of this study is to systematically review randomized controlled trials that employed a virtual MBI in populations with clinically significant sleep disturbance. Furthermore, to assess for relative efficacy, comparator groups (i.e., specific active controls (evidence-based treatments), nonspecific active controls, usual care controls, and waitlist controls) were analyzed separately. We aim to examine the following three questions: (1) do virtual MBIs improve sleep quality when compared with control groups; (2) does the effect persist long-term; and (3) is the virtual delivery method equally feasible compared to the in-person delivery method?
Method
Search Strategies
The review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines [26]. PubMed, Scopus, Embase, Cochrane Library, and Web of Science databases were searched for peer-reviewed articles in English through December 3, 2020, with no start date restriction. For search terms, three main subject-heading domains were combined with the AND operator: (online OR internet OR digital OR m-health OR e-health OR computer* OR web* OR app OR smartphone OR mobile application) AND (mindful* OR meditate* OR Vipassana OR “acceptance and commitment therapy”) AND (sleep [TIAB] OR insomnia [TIAB]). The TIAB function was used only for searches in PubMed. Upon completion of the search, two investigators independently examined the title and abstract of each trial to assess for eligibility. Afterwards, the full text article was downloaded for all potentially eligible trials and screened for inclusion. The bibliography of identified trials and germane review articles were manually surveyed for additional references.
Inclusion and Exclusion Criteria
We included published articles of randomized controlled trials in adults (age ≥ 18 years) with clinically significant sleep disturbance that employed a virtual MBI. Included studies also had assessments of pre-intervention and post-intervention sleep quality. Sleep quality measures included both objective and subjective validated measurements, such as actigraphy, diary-reported sleep quality, and self-reported sleep quality questionnaires: the Insomnia Severity Index (ISI), the Medical Outcomes Study-Sleep Scale (MOS-SS), the Pittsburgh Sleep Quality Index (PSQI), and the Basic Nordic Sleep Questionnaire (BNSQ). The pre-intervention sleep quality mean score (i.e., baseline weighted average) was used to determine if each study cohort had clinically relevant sleep disturbance based on established cut-off scores. Studies with baseline weighted average scores above the minimum established clinical cutoffs for sleep disturbance were included in the review (i.e., ISI > 8; MOS-SS > 20; PSQI > 5) [27–29]. Studies were excluded if they included children, adolescents, and experienced meditators, as well as experimental comparators (e.g., in-person MBIs). Table 1 provides a detailed summary of the inclusion and exclusion criteria.
Table 1.
Detailed inclusion and exclusion summary
Inclusion | Exclusion | |
---|---|---|
Population | Adult populations with clinically significant sleep disturbance (i.e., had an ICD insomnia diagnosis or met symptom severity threshold defined by sleep quality questionnaires) | Children, adolescents, and experienced meditators (i.e., ≥ 1000 practice hours) |
Intervention |
Virtual mindfulness-based interventions (i.e., mindfulness exercises delivered via an online or offline program and accessed via computer, laptop, or other technological devices, such as a tablet or mobile phone) No limit on minimum or maximum duration |
In-person mindfulness-based interventions, movement-based therapies (e.g., tai chi and yoga), and integrative therapies (i.e., interventions with multiple modalities and only a small component of mindfulness exercises) |
Comparator | Specific active controls (i.e., evidence-based treatments) non-specific active controls, usual care controls, or waitlist controls | Experimental interventions or experimental administration (e.g., comparing app-based mindfulness meditation to in-person mindfulness meditation) |
Outcome | Validated subjective or objective measure of sleep quality with pre-intervention and post-intervention assessments | No validated measure of sleep quality or only a pre-intervention assessment |
Study design | Randomized controlled trials | Non-randomized controlled trials |
Other | Quantitative, peer-reviewed studies reported in English including dates through December 3, 2020, with no start date restriction | Abstracts, reviews, and non-published trials, as well as published trials on duplicate participant samples and in languages other than English |
Data Extraction and Analysis
Two investigators independently extracted data from the eligible articles for further analysis. Data extracted included the author, publication year, population type, sample size, mindfulness intervention features, control intervention features, intervention duration, intervention hours, sleep quality scale, and assessment data. Discrepancies in eligibility and data extraction were resolved through contact with corresponding authors and discussion and consensus with a third investigator. When possible and not reported, standard deviations were calculated using available data. The feasibility of the virtual delivery method was determined by comparing intervention adherence and attrition rates to benchmarks used in clinical trials (i.e., adherence rates > 80% and attrition rates < 20%), as well as adherence and attrition rates from our prior meta-analysis [19], which employed similar inclusion/exclusion criteria using an in-person delivery method. Per protocol definitions of adherence were used and attrition rates were defined as the percent of randomized participants that did not complete the post-intervention assessment.
Results
Search Results
A total of 911 records were initially identified for inclusion in the review. After removing duplicates (n = 344), another 527 records were further excluded based on title and abstract. A full-text assessment of the remaining 40 articles was conducted and 10 studies with 2777 participants were included in the review (see Fig. 1, CONSORT flow diagram).
Fig. 1.
Flow diagram from record identification to final study inclusion
Characteristics of Included Studies
The major characteristics of the 10 included studies can be found in Table 2. The studies were published from 2012 to 2020, and sample sizes ranged from 21 to 2081. Mindfulness meditation was the most commonly employed MBI (n = 4), followed by acceptance and commitment therapy (n = 3). The majority of studies used a web-based app as the intervention delivery method (n = 8). Expected mindfulness durations ranged from 4 to 16 h over 4 to 8 weeks. All studies included at least one subjective sleep measure, and one study used a combination of subjective and objective sleep measures.
Table 2.
Study characteristics grouped by control type
Authors, year | Control type | Population | Mindfulness na |
Control nb |
Mindfulness intervention | Mindfulness intervention delivery mode | Comparison intervention | Comparison intervention delivery mode | Intervention duration | Intervention hoursc | Scale /V0 meand |
---|---|---|---|---|---|---|---|---|---|---|---|
Hesser et al., 2012 | SAC | Tinnitus | 35 | 32 | ACT | Web-based App | CBT | Web-based App | 8 weeks | 16 |
ISI 13.91 |
Low et al., 2020 | SAC | Insomnia | 12 | 11 | MM | Mobile App | Progressive muscle relaxation | Mobile App | 40 or 60 dayse | 6.67 or 10 |
ISI 13.61 |
Mak et al., 2017 | SAC | Young adults | 1041 | 1040 | MM | Web-based App | CBT | Web-based App | 8 weeks | 5 |
MOS-SS 26.49 |
Boettcher et al., 2014 | NSAC | Anxiety disorders | 45 | 46 | MM | Web-based App | Discussion forum | Web-based App | 8 weeks | 16 |
ISI 11.74 |
Hesser et al., 2012 | NSAC | Tinnitus | 35 | 32 | ACT | Web-based App | Discussion forum | Web-based App | 8 weeks | 16 |
ISI 13.49 |
Messer et al., 2019 | UCC | Cancer survivors | 11f | 10f | MBSR | Web-based App | Usual care | NA | 6 weeks | 8 |
PSQI 11.57 |
Simister et al., 2018 | UCC | Fibromyalgia | 33 | 34 | ACT | Web-based App | Usual care | NA | 8 weeks | NR |
PSQI 12.97 |
Chapoutot et al., 2020 | Waitlist | Insomnia with hypnotic dependence | 16 | 16 | ACT-enhanced CBT | Video-conference | Waitlist | NA | 8 weeks | 4 |
PSQI 14.80 |
Lappalainen et al., 2019 | Waitlist | Insomnia | 43 | 43 | ACT | Web-based App | Waitlist | NA | 6 weeks | NR |
ISI 16.96 |
Nissen et al., 2020 | Waitlist | Cancer survivors | 104 | 46 | MBCT | Web-based App | Waitlist | NA | 8 weeks | NR |
ISI 11.73 |
Querstret et al., 2017 | Waitlist | Working adults | 63 | 64 | MM | Web-based App | Waitlist | NA | 4 weeks | NR |
PSQI 11.26 |
ACT acceptance and commitment therapy, CBT cognitive behavioral therapy, ISI Insomnia Severity Index, MBCT mindfulness-based cognitive therapy, MBSR mindfulness-based stress reduction, MM mindfulness meditation, MOS-SS Medical Outcomes Study-Sleep Scale, NA not applicable, NR not reported, NSAC nonspecific active control, PSQI Pittsburgh Sleep Quality Index, SAC specific active control, UCC usual care control
aMindfulness sample size is reported as participants initially randomized to the intervention group
bControl sample size is reported as participants initially randomized to the control group
cMindfulness hours are reported as expected hours per intervention, excluding home practice
dThe V0 sleep quality mean score (i.e., baseline weighted average) was used to determine if each study cohort had clinically relevant sleep disturbance based on established cut-off scores
eDue to time constraints, some participants were asked to complete 40 days of mindfulness meditation instead of 60 days; both groups were combined in the analysis.-
fTwo participants dropped out of the study after randomization. The study did not report the two participants’ group affiliation; thus, the sample sizes reflect the number of participants who completed the intervention
Change in Sleep Quality from Pre- to Post-intervention
Herein, we briefly report the results of the 10 randomized controlled trials that met our eligibility criteria, stratified by control group type. Table 3 provides a more comprehensive depiction of the results.
Table 3.
The relative effect of virtual mindfulness-based interventions on sleep quality outcomes
Authors, year | Sleep quality outcome | Mindfulness pre-intervention mean (SD) | Mindfulness post-intervention mean (SD) | Within-group effect size/P-value | Control pre-intervention mean (SD) | Control post-intervention mean (SD) | Within-group effect size/P-value | Between-group effect sizeb/P-value | Group × Time effect sizeb/P-value |
---|---|---|---|---|---|---|---|---|---|
Specific active controls | |||||||||
Hesser et al., 2012 | ISI | 13.23 (5.80) | 8.48 (5.43) |
NR p < 0.05 |
14.66 (6.30) | 9.93 (6.85) |
NR p < 0.05 |
NR NR |
NR p > 0.16 |
Low et al., 2020 | ISI | 13.33 (3.47) | 7.67 (3.28) |
d = 1.61 p < 0.05 |
13.91 (1.97) | 7.73 (4.03) |
d = 1.97 p < 0.05 |
NR NR |
ηp2 = 0.003 p = 0.79 |
ATG-TIB | 476.31 (161.94) | 520.80 (87.70) |
d = 0.34 NS |
510.80 (37.56) | 511.00 (48.75) |
d = 0.00 NS |
NR NR |
ηp2 = 0.33 p = 0.28 |
|
ATG-TST | 436.60 (42.28) | 447.30 (87.11) |
d = 0.15 NS |
411.00 (88.81) | 428.40 (39.59) |
d = 0.25 NS |
NR NR |
ηp2 = 0.46 p = 0.86 |
|
ATG-SOL | 10.30 (5.80) | 3.00 (2.07) |
d = 1.67 p < 0.05 |
5.70 (5.20) | 5.60 (3.83) |
d = 0.02 p < 0.05 |
NR NR |
ηp2 = 0.02 p = 0.02 |
|
ATG-WASO | 70.50 (20.89) | 64.40 (23.48) |
d = 0.27 p < 0.05 |
91.00 (81.43) | 75.90 (24.64) |
d = 0.26 p < 0.05 |
NR NR |
ηp2 = 0.01 p = 0.86 |
|
ATG-SE | 83.00 (5.00) | 86.20 (3.60) |
d = 0.73 NS |
83.40 (8.88) | 83.80 (3.40) |
d = 0.05 NS |
NR NR |
ηp2 = 0.37 p = 0.51 |
|
ATG-SFI | 24.90 (4.70) | 25.20 (5.50) |
d = 0.05 NS |
25.30 (8.00) | 23.30 (7.04) |
d = 0.25 NS |
NR NR |
ηp2 = 0.58 p = 0.46 |
|
SD-TWT | 68.10 (44.77) | 51.01 (21.24) |
d = 0.48 p < 0.05 |
46.42 (30.09) | 25.22 (19.34) |
d = 0.83 p < 0.05 |
NR NR |
ηp2 = 0.005 p = 0.77 |
|
Mak et al., 2017 | MOS-SS | 26.03 (19.91) | 17.58 (37.60) |
d = 0.44 p < 0.05 |
26.92 (19.65) | 19.13 (38.53) |
d = 0.41 p < 0.05 |
NR p > 0.05 |
NR p = 0.91 |
Nonspecific active controls | |||||||||
Boettcher et al., 2014 | ISI | 12.20 (5.70) | 7.30 (4.70) |
d = 0.82 p < 0.05 |
11.30 (6.10) | 9.20 (6.30) |
d = 0.45 p < 0.05 |
d = 0.36 p = 0.75 |
NR p = 0.02 |
Hesser et al., 2012 | ISI | 13.23 (5.80) | 8.48 (5.43) |
NR p < 0.05 |
13.78 (6.54) | 11.22 (6.97) |
NR NR |
d = 0.42 NR |
NR p > 0.10 |
Usual care controls | |||||||||
Messer et al., 2019 | PSQI | 10.57 (3.45) | 8.50 (3.14) |
NR NR |
12.67 (3.07) | 12.75 (3.02) |
NR NR |
d = 1.14 p < 0.01 |
NR NR |
Simister et al., 2018 | PSQI | 12.67 (3.80) | 10.24 (3.60) |
NR p < 0.05 |
13.26 (3.80) | 13.00 (3.47) |
NR p < 0.05 |
d = 0.79 p = 0.02 |
NR p = 0.06 |
Waitlist controls | |||||||||
Chapoutot et al., 2020 | ISI | 21.00 (4.40) | 10.70 (5.20) |
d = 1.90 p < 0.05 |
19.20 (3.90) | 17.20 (3.50) |
NR NR |
NR NR |
d = 1.98 p < 0.001 |
PSQI | 14.70 (4.10) | 9.10 (3.90) |
NR NR |
14.90 (3.10) | 12.30 (2.80) |
NR NR |
NR NR |
d = 0.82 p = 0.02 |
|
SD-TST | 6.60 (0.30) | 6.50 (0.20) |
NR NR |
6.00 (0.20) | 6.30 (0.20) |
NR NR |
NR NR |
d = 1.56 p = 0.09 |
|
SD-SOL | 0.60 (0.10) | 0.20 (0.10) |
NR NR |
0.70 (0.10) | 0.60 (0.10) |
NR NR |
NR NR |
d = 1.48 p = 0.29 |
|
SD-NWAK | 1.40 (0.30) | 0.90 (0.40) |
d = 0.85 p < 0.05 |
1.30 (0.30) | 1.70 (0.40) |
NR NR |
NR NR |
d = 0.49 p < 0.001 |
|
SD-WASO | 0.80 (0.48) | 0.30 (0.30) |
d = 0.90 p < 0.05 |
0.60 (0.50) | 0.60 (0.50) |
NR NR |
NR NR |
d = 3.90 p = 0.01 |
|
SD-SE | 76.10 (2.70) | 85.20 (2.30) |
d = 0.69 NR |
76.90 (2.60) | 79.10 (2.20) |
NR NR |
NR NR |
d = 2.58 p = 0.03 |
|
Lappalainen et al., 2019 | BNSQa | 21.77 (4.45) | 19.91 (5.25) |
NR p < 0.05 |
21.65 (4.07) | 21.57 (4.45) |
NR NR |
d = 0.42 NR |
NR p = 0.001 |
Nissen et al., 2020 | ISI | 11.70 (5.50) | 10.30 (6.00) |
d = 0.23 p = 0.13 |
11.80 (6.30) | 10.10 (6.90) |
d = 0.26 p = 0.25 |
NR NR |
d = 0.06 p = 0.76 |
Querstret et al., 2017 | PSQI | 11.72 (3.81) | 8.22 (5.79) |
ηp2 = 0.19 p < 0.001 |
10.79 (5.07) | 10.45 (5.07) |
ηp2 = 0.38 p < 0.001 |
ηp2 = 0.16 p < 0.001 |
NR NR |
ATG actigraphy, BNSQ Basic Nordic Sleep Questionnaire, ISI Insomnia Severity Index, MOS-SS Medical Outcomes Study-Sleep Scale, NR not reported, NS not significant, NWAK number of awakenings, PSQI Pittsburgh Sleep Quality Index, SD sleep diary, SE sleep efficiency, SFI Sleep Fragmentation Index, SOL sleep onset latency, TIB time in bed, TST total sleep time, TWT total wake time, WASO wake after sleep onset
aThe study used ISI to screen for sleep disturbance and BNSQ as an outcome measure
bPositive effect sizes should be interpreted in favor of the mindfulness group
Effect size (d) interpretation: 0.2 = small effect, 0.5 = medium effect, 0.8 = large effect
Partial eta squared (ηp2) interpretation: 0.01 = small effect, 0.06 = medium effect, 0.14 = large effect
P-values in bold are statistically significant at < 0.05
Specific Active Controls
Three of the included studies used specific active control groups (i.e., evidence-based treatments), with a total of 2171 participants. Hesser et al. [30] and Mak et al. [31] reported significant within-group effects on self-reported sleep quality for the virtual mindfulness and virtual CBT groups, with no significant difference between interventions over time. However, at 1-year follow-up, Hesser et al. [30] found a decreased maintenance effect for the virtual mindfulness group compared to the virtual CBT group. On the other hand, at 3-month follow-up, Mak et al. [31] reported a similar maintenance effect on sleep quality improvement in the virtual mindfulness and virtual CBT groups. Low et al. [32] reported significant within-group effects on self-reported sleep quality, actigraphy-measured sleep onset latency, actigraphy-measured wake after sleep onset, and diary-reported total wake time for the virtual mindfulness and virtual progressive muscle relaxation groups. The virtual mindfulness group also had a greater reduction in actigraphy-measured sleep onset latency over time, relative to the virtual progressive muscle relaxation group. No significant group by time interaction effects were found for the self-reported sleep measures.
Non-specific Active Controls
Two of the included studies used non-specific active control groups, with a total of 158 participants. Boettcher et al. [33] reported significant within-group effects on self-reported sleep quality in both the virtual mindfulness and virtual discussion forum control groups; however, the virtual mindfulness group had greater improvements over time, relative to the virtual discussion forum control group. At 6-month follow-up, sleep improvement was maintained in the virtual mindfulness group. On the other hand, Hesser et al. [30] reported a significant within-group effect on self-reported sleep quality in the virtual mindfulness group only, with no significant difference between the virtual mindfulness and virtual discussion forum interventions over time.
Usual Care Controls
Two of the included studies used usual care control groups, with a total of 88 participants. Messer et al. [34] reported a large between-group effect on self-reported sleep quality in favor of the virtual mindfulness group. Simister et al. [35] reported significant within-group effects on self-reported sleep quality in both the virtual mindfulness and usual care control groups. Although there was a medium between-group effect in favor of the virtual mindfulness group, the group by time interaction effect was not significant. At 3-month follow-up, the between-group effect on sleep quality was still in favor of the virtual mindfulness group but slightly attenuated (d = .53).
Waitlist Controls
Four of the included studies used waitlist control groups, with a total of 395 participants. Chapoutot et al. [36] reported small to large group by time interaction effects on self-reported sleep quality and diary-reported number of awakenings, wake after sleep onset, and sleep efficiency, in favor of the virtual mindfulness group. At 6-month follow-up, improvement in self-reported sleep quality was maintained in the virtual mindfulness group; however, improvement in diary-reported sleep measures (number of awakenings and wake after sleep onset) was not maintained. Lappalainen et al. [37] reported a group by time interaction effect on self-reported sleep quality, in favor of the virtual mindfulness group. At 6-month follow-up, improvement in sleep quality was maintained in the virtual mindfulness group. Nissen et al. [38] reported no significant within-group effect on self-reported sleep quality in the virtual mindfulness or waitlist control groups, as well as no significant group by time interaction effect. At 6-month follow-up, there was no change in sleep quality in either group. Querstret et al. [39] reported significant within-group effects on self-reported sleep quality for the virtual mindfulness and waitlist control groups, with a large between-group effect in favor of the virtual mindfulness group. At 3- and 6-month follow-up, sleep quality improvement was maintained in the virtual mindfulness group.
Feasibility of Virtual Delivery Method
Adherence rates were reported in all but two studies. The definition of intervention adherence varied between studies. The most common definition used was the average number of mindfulness exercises or sessions completed out of the total offered, followed by self-reported engagement with course materials. Due to variations in adherence definitions, we could not compare adherence rates across studies, although rates ranged from 31 to 100%. Two (20%) virtual MBI studies had adherence rates above 80%; meanwhile, seven (39%) in-person MBI studies had adherence rates above this same level [19]. Attrition rates were reported in all but one study, which ranged from 0 to 90%. Six (60%) virtual MBI studies had attrition rates below 20%; similarly, 12 (67%) in-person MBI studies had attrition rates below this same level [19].
Discussion
To our knowledge, this is the first study to systematically analyze the effects of virtual MBIs on sleep quality among populations with clinically significant sleep disturbance. Our findings suggest that virtual MBIs are comparable to evidence-based treatments (e.g., CBT), and to a limited extent, more effective than non-specific active controls at reducing sleep disturbance. Overall, virtual MBIs are more effective at improving sleep quality than usual care controls and waitlist controls. Our findings are aligned with other systematic reviews and meta-analyses, which found improvements in stress and psychiatric symptoms in clinical and general populations following virtual MBIs [40•,41•,42•]. Our findings, in conjunction with prior literature, have global implications for improving mental and physical health during a pandemic and could inform the implementation of virtual MBIs during physical distancing, quarantine, and lockdown periods.
Of the eight studies that included follow-up assessments, six studies reported a maintenance effect at follow-up, providing promising evidence that virtual MBIs have a long-term effect on sleep quality improvement. However, two findings warrant further investigation. First, it is unclear whether virtual MBIs are comparable to evidence-based treatments at sustaining sleep improvement long term. While Mak et al. [31] reported a similar maintenance effect for virtual mindfulness meditation and virtual CBT, Hesser et al. [30] observed a decreased maintenance effect for virtual acceptance and commitment therapy compared to virtual CBT. The discrepancy could be attributed to intervention characteristics and sample characteristics, including the severity of sleep disturbance. Second, a maintenance effect may be dependent on the type of sleep measurement used. At follow-up, Chapoutot et al. [36] found a maintenance effect on self-reported sleep quality, but not on diary-reported sleep measures. As such, virtual MBIs may provide more lasting benefits on some aspects of sleep but not all. For long-term and well-rounded benefits, participants may need to practice mindfulness exercises for longer durations and beyond study requirements. Sustained involvement is critical in mindfulness training, as continuity of practice is deemed essential for cultivating and enhancing well-being [22, 43].
Adherence rates ranged widely in the reviewed studies (31 to 100%), which were lower than our prior meta-analysis that examined the effects of in-person MBIs in sleep-disturbed populations [19]. Possible explanations for the lower adherence rates observed in virtual MBIs may be related to lack of therapist guidance, distractions in the home environment, or technical problems accessing the intervention [42•, 44, 45]. Caution is needed when interpreting these findings due to heterogeneity in adherence definitions used across studies, which ranged from computer-measured minutes spent on course materials to self-reported hours spent completing course materials. Only one study included in the review examined the relationship between adherence and changes in sleep quality score [34], finding a positive correlation (r = 0.39; p = 0.042). However, it is important to recognize that improvements in sleep quality may not be due entirely to greater adherence rates. Prior research suggests that for some participants a shorter period of intense engagement in virtual MBIs may be enough to prompt behavior change, while other individuals may require prolonged and personalized training [46, 47•]. As such, this may explain the association between low adherence rates and improved sleep quality demonstrated in some of the studies reviewed. Attrition rates also ranged widely in the reviewed studies, with one large-scale study conducted by Mak et al. [31] reporting an attrition rate of 90%. With the exception of Mak et al. [31], the attrition rates for the other reviewed studies (0 to 31%) are lower than the rates reported by a prior study that examined virtual MBIs in clinical and nonclinical populations (7.7 to 52.3%) [48] and are similar to our prior meta-analysis that examined the effects of in-person MBIs in sleep-disturbed populations (0 to 50%) [19]. There are characteristics that seem to correlate with lower attrition rates; two reviewed studies identified younger age, male gender, increased well-being at baseline, higher treatment expectancy, and prior experience with mind-body interventions as key factors [31, 38].
The current findings shed light on important clinical implications that could inform the implementation and dissemination of virtual MBIs during a pandemic. Findings indicate that virtual MBIs may be as effective as evidence-based treatments and may alleviate some aspects of moderate to severe sleep disturbances. From a clinical standpoint, virtual MBIs could complement other established sleep treatments or serve as second-line treatments when first-line treatments are not effective or available [49••]. The accessibility and flexibility of virtual MBIs allow patients and the general public to have increased agency for their own care [50•]. For individuals who are infected with SARS-CoV-2 and have limited access to mental health professionals, they can safely access MBIs via virtual platforms in quarantine or isolation rooms. On a population level, continuous access to effective self-guided care may help prevent further psychological and physiological harm imposed by a global health crisis.
The findings should be interpreted in the context of several limitations. First, the review summarized studies that were not focused on evaluating virtual MBIs during a pandemic. As such, the reader needs to interpret the findings with caution, given that the pandemic has imposed additional stressors [51], which may influence treatment efficacy. This caution was previously raised by Fischer et al. [49••], who also used pre-pandemic data to extrapolate the efficacy of self-guided interventions on sustaining mental well-being during the pandemic. Second, we examined randomized controlled trials with various types of control groups, including usual care controls and waitlist controls, raising the probability that the reported benefits could be the result of nonspecific effects (e.g., expectations). Despite limitations associated with using these types of control groups, usual care controls and waitlist controls remain ethical approaches to evaluating the effects of mind-body therapies [52]. Third, we were only able to identify a few studies in each control group type, which prevented us from conducting a meta-analysis that would have otherwise provided more precise estimates of study efficacy. Fourth, measurements of adherence varied greatly and lacked standardization in the reviewed studies, making comparison between studies challenging. Finally, since females constituted the majority of participants (except in one study), the generalizability of the results to other demographics, such as men and those identified as nonbinary, is limited. This discrepancy is consistent with a meta-analysis of mindfulness studies in nonclinical populations, which found that 56 to 100% participants were women (mean = 78%) [53]. Even though virtual MBIs have the potential to reach wider populations, utilization will be limited if only certain populations are willing to engage in or have access to virtual MBIs.
Future studies should investigate the impact of adherence rates on symptom improvement. The development of a standardized adherence definition may aid in comparison across studies. Additional investigation is needed to understand how to reduce attrition rates in targeted populations (e.g., healthcare providers), increase engagement in men, and remove barriers for marginalized groups that may not have access to technology. The review only identified one study that used a combination of subjective and objective sleep measures. Future research could employ more objective measures to investigate the effect of virtual MBIs on objective sleep factors, such as actigraphy-measured sleep onset latency and total sleep time, which can offer insights into specific sleep parameters that virtual MBIs target. Some studies included additional intervention strategies, such as cognitive and behavioral strategies, leading us to question whether mindfulness-based components have added benefits. This should be addressed in future studies that thoroughly dismantle multi-component interventions.
Conclusion
Overall, this review provides evidence that suggest virtual MBIs can be beneficial in improving some aspects of sleep quality in adults with sleep disturbance. Given that the prevalence of sleep disturbance is increasing during the COVID-19 pandemic and that in-person interventions have become largely infeasible, virtual MBIs may be an effective alternative to manage sleep abnormalities, or a potential addition to standard telehealth care. Further investigation is needed to explore factors that influence adherence and access to virtual MBIs, with a particular focus on diverse populations.
Acknowledgements
We thank Ninet Sinaii, PhD, MPH; Biostatistics and Clinical Epidemiology Service, Clinical Center, National Institutes of Health, for her expert advice on data interpretation. The views expressed in this article are those of the authors and do not reflect the official policy of the United States Government. Publication materials have been reviewed by the National Institutes of Health. There is no objection to its presentation and/or publication.
Code Availability
Not applicable.
Data Availability
Not applicable.
Declarations
Conflict of Interest
The authors declare no competing interests.
Human and Animal Rights and Informed Consent
This article does not contain any studies with human or animal subjects performed by any of the authors.
Ethics Approval
Not applicable.
Consent to Participate
Not applicable.
Consent for Publication
Not applicable.
Footnotes
This article is part of the Topical Collection on Sleep Disorders
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
Papers of particular interest, published recently, have been highlighted as: • Of importance •• Of major importance
- 1.••.Jahrami H, BaHammam AS, Bragazzi NL, Saif Z, Faris M, Vitiello MV. Sleep problems during the COVID-19 pandemic by population: a systematic review and meta-analysis. J Clin Sleep Med. 2021;17(2):299–313. doi: 10.5664/jcsm.8930. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.•.Gupta R, Grover S, Basu A, Krishnan V, Tripathi A, Subramanyam A, et al. Changes in sleep pattern and sleep quality during COVID-19 lockdown. Indian J Psychiatry. 2020;62(4):370–378. doi: 10.4103/psychiatry.IndianJPsychiatry_523_20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.•.Martínez-de-Quel Ó, Suárez-Iglesias D, López-Flores M, Pérez CA. Physical activity, dietary habits and sleep quality before and during COVID-19 lockdown: a longitudinal study. Appetite. 2021;158:105019. doi: 10.1016/j.appet.2020.105019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Afolalu EF, Ramlee F, Tang NKY. Effects of sleep changes on pain-related health outcomes in the general population: a systematic review of longitudinal studies with exploratory meta-analysis. Sleep Med Rev. 2018;39:82–97. doi: 10.1016/j.smrv.2017.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Jike M, Itani O, Watanabe N, Buysse DJ, Kaneita Y. Long sleep duration and health outcomes: a systematic review, meta-analysis and meta-regression. Sleep Med Rev. 2018;39:25–36. doi: 10.1016/j.smrv.2017.06.011. [DOI] [PubMed] [Google Scholar]
- 6.Cox RC, Olatunji BO. A systematic review of sleep disturbance in anxiety and related disorders. J Anxiety Disord. 2016;37:104–129. doi: 10.1016/j.janxdis.2015.12.001. [DOI] [PubMed] [Google Scholar]
- 7.Palagini L, Bastien CH, Marazziti D, Ellis JG, Riemann D. The key role of insomnia and sleep loss in the dysregulation of multiple systems involved in mood disorders: a proposed model. J Sleep Res. 2019;28(6):e12841. doi: 10.1111/jsr.12841. [DOI] [PubMed] [Google Scholar]
- 8.Bubu OM, Brannick M, Mortimer J, Umasabor-Bubu O, Sebastião YV, Wen Y, et al. Sleep, cognitive impairment, and Alzheimer's disease: a systematic review and meta-analysis. Sleep. 2017;40(1). 10.1093/sleep/zsw032. [DOI] [PubMed]
- 9.Lo JC, Groeger JA, Cheng GH, Dijk DJ, Chee MW. Self-reported sleep duration and cognitive performance in older adults: a systematic review and meta-analysis. Sleep Med. 2016;17:87–98. doi: 10.1016/j.sleep.2015.08.021. [DOI] [PubMed] [Google Scholar]
- 10.Irwin MR, Olmstead R, Carroll JE. Sleep disturbance, sleep duration, and inflammation: a systematic review and meta-analysis of cohort studies and experimental sleep deprivation. Biol Psychiatry. 2016;80(1):40–52. doi: 10.1016/j.biopsych.2015.05.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Miller MA, Cappuccio FP. Inflammation, sleep, obesity and cardiovascular disease. Curr Vasc Pharmacol. 2007;5(2):93–102. doi: 10.2174/157016107780368280. [DOI] [PubMed] [Google Scholar]
- 12.Benedict C, Cedernaes J. Could a good night's sleep improve COVID-19 vaccine efficacy? Lancet Respir Med. 2021. 10.1016/S2213-2600(21)00126-0. [DOI] [PMC free article] [PubMed]
- 13.Buscemi N, Vandermeer B, Friesen C, Bialy L, Tubman M, Ospina M, Klassen TP, Witmans M. The efficacy and safety of drug treatments for chronic insomnia in adults: a meta-analysis of RCTs. J Gen Intern Med. 2007;22(9):1335–1350. doi: 10.1007/s11606-007-0251-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Holbrook AM, Crowther R, Lotter A, Cheng C, King D. Meta-analysis of benzodiazepine use in the treatment of insomnia. CMAJ. 2000;162(2):225–233. [PMC free article] [PubMed] [Google Scholar]
- 15.Fernandez E, Salem D, Swift JK, Ramtahal N. Meta-analysis of dropout from cognitive behavioral therapy: magnitude, timing, and moderators. J Consult Clin Psychol. 2015;83(6):1108–1122. doi: 10.1037/ccp0000044. [DOI] [PubMed] [Google Scholar]
- 16.Ong JC, Kuo TF, Manber R. Who is at risk for dropout from group cognitive-behavior therapy for insomnia? J Psychosom Res. 2008;64(4):419–425. doi: 10.1016/j.jpsychores.2007.10.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Koffel E, Bramoweth AD, Ulmer CS. Increasing access to and utilization of cognitive behavioral therapy for insomnia (CBT-I): a narrative review. J Gen Intern Med. 2018;33(6):955–962. doi: 10.1007/s11606-018-4390-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Vincent N, Lewycky S, Finnegan H. Barriers to engagement in sleep restriction and stimulus control in chronic insomnia. J Consult Clin Psychol. 2008;76(5):820–828. doi: 10.1037/0022-006x.76.5.820. [DOI] [PubMed] [Google Scholar]
- 19.Rusch HL, Rosario M, Levison LM, Olivera A, Livingston WS, Wu T, Gill JM. The effect of mindfulness meditation on sleep quality: a systematic review and meta-analysis of randomized controlled trials. Ann N Y Acad Sci. 2019;1445(1):5–16. doi: 10.1111/nyas.13996. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Salari N, Khazaie H, Hosseinian-Far A, Khaledi-Paveh B, Ghasemi H, Mohammadi M, Shohaimi S. The effect of acceptance and commitment therapy on insomnia and sleep quality: a systematic review. BMC Neurol. 2020;20(1):300. doi: 10.1186/s12883-020-01883-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Kabat-Zinn J, Hanh TN. Full catastrophe living: Using the wisdom of your body and mind to face stress, pain, and illness: Delta; 2009.
- 22.Winbush NY, Gross CR, Kreitzer MJ. The effects of mindfulness-based stress reduction on sleep disturbance: a systematic review. Explore (NY) 2007;3(6):585–591. doi: 10.1016/j.explore.2007.08.003. [DOI] [PubMed] [Google Scholar]
- 23.Soh HL, Ho RC, Ho CS, Tam WW. Efficacy of digital cognitive behavioural therapy for insomnia: a meta-analysis of randomised controlled trials. Sleep Med. 2020;75:315–325. doi: 10.1016/j.sleep.2020.08.020. [DOI] [PubMed] [Google Scholar]
- 24.Wolever RQ, Bobinet KJ, McCabe K, Mackenzie ER, Fekete E, Kusnick CA, Baime M. Effective and viable mind-body stress reduction in the workplace: a randomized controlled trial. J Occup Health Psychol. 2012;17(2):246–258. doi: 10.1037/a0027278. [DOI] [PubMed] [Google Scholar]
- 25.Herbert MS, Afari N, Liu L, Heppner P, Rutledge T, Williams K, Eraly S, VanBuskirk K, Nguyen C, Bondi M, Atkinson JH, Golshan S, Wetherell JL. Telehealth versus in-person acceptance and commitment therapy for chronic pain: a randomized noninferiority trial. J Pain. 2017;18(2):200–211. doi: 10.1016/j.jpain.2016.10.014. [DOI] [PubMed] [Google Scholar]
- 26.Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009;62(10):e1–34. doi: 10.1016/j.jclinepi.2009.06.006. [DOI] [PubMed] [Google Scholar]
- 27.Bastien CH, Vallières A, Morin CM. Validation of the Insomnia Severity Index as an outcome measure for insomnia research. Sleep Med. 2001;2(4):297–307. doi: 10.1016/s1389-9457(00)00065-4. [DOI] [PubMed] [Google Scholar]
- 28.Smith MT, Wegener ST. Measures of sleep: The Insomnia Severity Index, Medical Outcomes Study (MOS) Sleep Scale, Pittsburgh Sleep Diary (PSD), and Pittsburgh Sleep Quality Index (PSQI) Arthritis Care Res. 2003;49(S5):S184–SS96. doi: 10.1002/art.11409. [DOI] [Google Scholar]
- 29.Zagalaz-Anula N, Hita-Contreras F, Martínez-Amat A, Cruz-Díaz D, Lomas-Vega R. Psychometric properties of the medical outcomes study sleep scale in Spanish postmenopausal women. Menopause. 2017;24(7):824–831. doi: 10.1097/gme.0000000000000835. [DOI] [PubMed] [Google Scholar]
- 30.Hesser H, Gustafsson T, Lundén C, Henrikson O, Fattahi K, Johnsson E, Westin VZ, Carlbring P, Mäki-Torkko E, Kaldo V, Andersson G. A randomized controlled trial of Internet-delivered cognitive behavior therapy and acceptance and commitment therapy in the treatment of tinnitus. J Consult Clin Psychol. 2012;80(4):649–661. doi: 10.1037/a0027021. [DOI] [PubMed] [Google Scholar]
- 31.Mak WW, Chio FH, Chan AT, Lui WW, Wu EK. The efficacy of internet-based mindfulness training and cognitive-behavioral training with telephone support in the enhancement of mental health among college students and young working adults: Randomized controlled trial. J Med Internet Res. 2017;19(3):e84. doi: 10.2196/jmir.6737. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Low T, Conduit R, Varma P, Meaklim H, Jackson ML. Treating subclinical and clinical symptoms of insomnia with a mindfulness-based smartphone application: a pilot study. Internet Interv. 2020;21:100335. doi: 10.1016/j.invent.2020.100335. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Boettcher J, Aström V, Påhlsson D, Schenström O, Andersson G, Carlbring P. Internet-based mindfulness treatment for anxiety disorders: a randomized controlled trial. Behav Ther. 2014;45(2):241–253. doi: 10.1016/j.beth.2013.11.003. [DOI] [PubMed] [Google Scholar]
- 34.Messer D, Horan JJ, Larkey LK, Shanholtz CE. Effects of internet training in mindfulness meditation on variables related to cancer recovery. Mindfulness. 2019;10(10):2143–2151. doi: 10.1007/s12671-019-01182-y. [DOI] [Google Scholar]
- 35.Simister HD, Tkachuk GA, Shay BL, Vincent N, Pear JJ, Skrabek RQ. Randomized controlled trial of online acceptance and commitment therapy for fibromyalgia. J Pain. 2018;19(7):741–753. doi: 10.1016/j.jpain.2018.02.004. [DOI] [PubMed] [Google Scholar]
- 36.Chapoutot M, Peter-Derex L, Schoendorff B, Faivre T, Bastuji H, Putois B. Telehealth-delivered CBT-I programme enhanced by acceptance and commitment therapy for insomnia and hypnotic dependence: a pilot randomized controlled trial. J Sleep Res. 2021;30(1):e13199. doi: 10.1111/jsr.13199. [DOI] [PubMed] [Google Scholar]
- 37.Lappalainen P, Langrial S, Oinas-Kukkonen H, Muotka J, Lappalainen R. ACT for sleep - Internet-delivered self-help ACT for sub-clinical and clinical insomnia: a randomized controlled trial. J Contextual Behav Sci. 2019;12:119–127. doi: 10.1016/j.jcbs.2019.04.001. [DOI] [Google Scholar]
- 38.Nissen ER, O'Connor M, Kaldo V, Højris I, Borre M, Zachariae R, Mehlsen M. Internet-delivered mindfulness-based cognitive therapy for anxiety and depression in cancer survivors: a randomized controlled trial. Psychooncology. 2020;29(1):68–75. doi: 10.1002/pon.5237. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Querstret D, Cropley M, Fife-Schaw C. Internet-based instructor-led mindfulness for work-related rumination, fatigue, and sleep: assessing facets of mindfulness as mechanisms of change. A randomized waitlist control trial. J Occup Health Psychol. 2017;22(2):153–169. doi: 10.1037/ocp0000028. [DOI] [PubMed] [Google Scholar]
- 40.•.Gál É, Ștefan S, Cristea IA. The efficacy of mindfulness meditation apps in enhancing users' well-being and mental health related outcomes: a meta-analysis of randomized controlled trials. J Affect Disord. 2021;279:131–142. doi: 10.1016/j.jad.2020.09.134. [DOI] [PubMed] [Google Scholar]
- 41.•.Sevilla-Llewellyn-Jones J, Santesteban-Echarri O, Pryor I, McGorry P, Alvarez-Jimenez M. Web-based mindfulness interventions for mental health treatment: systematic review and meta-analysis. JMIR Ment Health. 2018;5(3):e10278. doi: 10.2196/10278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.•.Zhang Y, Xue J, Huang Y. A meta-analysis: Internet mindfulness-based interventions for stress management in the general population. Medicine (Baltimore) 2020;99(28):e20493. doi: 10.1097/md.0000000000020493. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Carmody J, Baer RA. Relationships between mindfulness practice and levels of mindfulness, medical and psychological symptoms and well-being in a mindfulness-based stress reduction program. J Behav Med. 2008;31(1):23–33. doi: 10.1007/s10865-007-9130-7. [DOI] [PubMed] [Google Scholar]
- 44.Chadi N, Weisbaum E, Vo DX, Ahola KS. Mindfulness-based interventions for adolescents: time to consider telehealth. J Altern Complement Med. 2020;26(3):172–175. doi: 10.1089/acm.2019.0302. [DOI] [PubMed] [Google Scholar]
- 45.Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res. 2009;11(2):e13. doi: 10.2196/jmir.1194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Michie S, Yardley L, West R, Patrick K, Greaves F. Developing and evaluating digital interventions to promote behavior change in health and health care: recommendations resulting from an international workshop. J Med Internet Res. 2017;19(6):e232. doi: 10.2196/jmir.7126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.•.Russell L, Ugalde A, Milne D, Austin D, Livingston PM. Digital characteristics and dissemination indicators to optimize delivery of internet-supported mindfulness-based interventions for people with a chronic condition: systematic review. JMIR Ment Health. 2018;5(3):e53. doi: 10.2196/mental.9645. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Fish J, Brimson J, Lynch S. Mindfulness interventions delivered by technology without facilitator involvement: what research exists and what are the clinical outcomes? Mindfulness. 2016;7(5):1011–1023. doi: 10.1007/s12671-016-0548-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.••.Fischer R, Bortolini T, Karl JA, Zilberberg M, Robinson K, Rabelo A, et al. Rapid review and meta-meta-analysis of self-guided interventions to address anxiety, depression, and stress during COVID-19 social distancing. Front Psychol. 2020;11:2795. doi: 10.3389/fpsyg.2020.563876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.•.Ho CS, Chee CY, Ho RC. Mental health strategies to combat the psychological impact of COVID-19 beyond paranoia and panic. Ann Acad Med Singap. 2020;49(3):155–160. doi: 10.47102/annals-acadmedsg.202043. [DOI] [PubMed] [Google Scholar]
- 51.Taylor S, Landry CA, Paluszek MM, Fergus TA, McKay D, Asmundson GJG. COVID stress syndrome: concept, structure, and correlates. Depress Anxiety. 2020;37(8):706–714. doi: 10.1002/da.23071. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Kinser PA, Robins JL. Control group design: enhancing rigor in research of mind-body therapies for depression. Evid Based Complement Alternat Med. 2013;2013:140467–140410. doi: 10.1155/2013/140467. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Khoury B, Sharma M, Rush SE, Fournier C. Mindfulness-based stress reduction for healthy individuals: a meta-analysis. J Psychosom Res. 2015;78(6):519–528. doi: 10.1016/j.jpsychores.2015.03.009. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.