Hybrid Delivery of Mindfulness Meditation and Perceived Stress in Pediatric Resident Physicians: A Randomized Clinical Trial of In-Person and Digital Mindfulness Meditation

Abstract

Physicians are experiencing epidemic levels of work-related stress and burnout. Determine efficacy of mindfulness meditation delivered as a hybrid (in-person and digital) format to reduce perceived stress in pediatric residents. Pediatric residents (n = 66) were block randomized to a hybrid Mindful Awareness Practices (MAPs) intervention, comprised of one in-person 60–min session and 6-week access to a digitally delivered MAPs curriculum (n = 27) or wait-list control (n = 39). Perceived Stress Scale (PSS) was administered at baseline and post-intervention as the primary outcome measure. A priori secondary outcomes were measured using the Abbreviated Maslach Burnout Inventory-9, Beck Depression Inventory, Beck Anxiety Inventory, UCLA Loneliness Scale, and Pittsburgh Sleep Quality Index. After the first session, 58% participated at least one digital session (M = 2.0; SD = 1.3). MAPs participants showed significant decrease in PSS compared to controls, with between-group mean difference of 2.20 (95% CI 0.47–3.93) at post-intervention (effect size 0.91; 0.19–1.62). No secondary outcome group differences were detected. Exposure to a hybrid mindfulness intervention was associated with improvement in perceived stress among pediatric residents.

Trial Registration: NCT03613441.

Introduction

The silent suffering of physicians and other caregivers due to stress, burnout and depression is rising to epidemic proportions in many specialties. (Nasca, 2016).

The World Health Organization defines burnout (characterized by “feelings of energy depletion or exhaustion; increased mental distance from one’s job, or feelings of negativism or cynicism related to one’s job; and reduced professional efficacy”) as a failure of stress management in the workplace (2019). The Accreditation Council for Graduate Medical Education (ACGME) has focused its recent attention on physician wellness as it is increasingly clear clinician burnout needs to be tackled early in professional development. By the end of medical school, nearly half of medical school graduates endorse symptoms of stress and burnout and over a third endorse symptoms of depression (Brazeau et al., 2014; Dyrbye & Shanafelt, 2016; Dyrbye et al., 2006). This finding is striking because medical students begin their training with similar or better mental health than age-matched peers (Chaukos et al., 2017). Research focused on pediatric residents similarly reveals that they frequently experience burnout and mental health symptoms (Baer et al., 2017; Cellini et al., 2017; Kemper et al., 2020; McKinley et al., 2017; Olsen et al., 2015; Pantaleoni et al., 2014). Stress has been found to be a potent risk factor for psychological symptoms (i.e., depression, anxiety) and emotional exhaustion in more than 50% of resident physicians across all specialties (Dyrbye & Shanafelt, 2016; Dyrbye et al., 2011, 2014; Slavich & Irwin, 2014).

In addition to depression and burnout, stress in resident physicians is also associated with substance dependence and suicide (Dyrbye et al., 2011; Oreskovich et al., 2015; van der Heijden et al., 2008; Wallace et al., 2009), suboptimal patient care (i.e., treatment and medication errors, failure to adhere to best practices, reduced attentiveness to patients, and failure to fully discuss treatment options or answer patient questions) (Dyrbye & Shanafelt, 2016; Fahrenkopf et al., 2008; Matsuo et al., 2021; Shanafelt et al., 2002; West et al., 2009), an erosion of professionalism (Dyrbye et al., 2014), and career dissatisfaction leading to increased likelihood of abandoning medicine (Becker et al., 2006). Although less well studied among physicians, loneliness has also been linked to burnout among internal medicine residents (Shapiro et al., 2015). Increased social support has been shown to reduce loneliness and subsequently reduce burnout among trainees (Rogers et al., 2016). Finally, high levels of perceived stress are associated with poor sleep and fatigue (Arafat & Kabir, 2017; Levey, 2001). Residents suffering from sleep deprivation have an increased risk of medical errors, injuries, alcohol and drug use, and conflict with other health professionals (Baldwin & Daugherty, 2004).

With growing recognition that burnout is a complex construct, there is an emerging understanding that both individual-focused as well as structural or organizational strategies can result in reductions in symptoms of burnout among healthcare professional as reported in recent meta-analyses (Spinelli et al., 2019; West et al., 2016). The most commonly studied individual-focused interventions have involved mindfulness or stress management approaches. Mindfulness interventions train one in the systematic practice of attending to moment-by-moment experiences, thoughts, and emotions from a nonjudgmental perspective (Black et al., 2015; Lamothe et al., 2018). Mindfulness interventions have been demonstrated to have moderate effects on perceived stress (the degree to which life situations are appraised as stressful) and to reduce symptoms of insomnia, loneliness, depression, and anxiety (Chen et al., 2020; Goyal et al., 2014; Oman et al., 2006; Romcevich et al., 2018; Spinelli et al., 2019; Thimmapuram et al., 2021). Among pediatric resident physicians, mindfulness has been associated with lower stress, decreased burnout, and greater confidence in providing compassionate care (Kemper et al., 2019; Reed et al., 2018). However, the few existing randomized controlled trials have demonstrated mixed support for utility of mindfulness skills in reducing burnout among resident physicians (Fraiman et al., 2022; Ireland et al., 2017; Lebares et al., 2018; Verweij et al., 2018). Additionally, only one small pilot study, to our knowledge, has evaluated whether or not hybrid (in-person and digital) delivery of mindfulness reduces perceived stress in resident physicians (Romcevich et al., 2018). They detected a significant decrease in perceived stress as well as improved resilience and decreased levels of burnout.

We conducted a randomized controlled clinical trial to examine the effect of a low-cost, community-accessible mindfulness-based intervention, known as Mindful Awareness Practices (MAPs) (Black et al., 2015) on perceived stress in pediatric resident physicians. In contrast to prior studies targeting physicians in training which have been delivered in person (Ireland et al., 2017; Lebares et al., 2018; Verweij et al., 2018), we offered mindfulness training in a hybrid format, with the initial session in person followed by a digital format. As compared to a wait-list control, the research-based curriculum, MAPs, was hypothesized to confer improvements on the primary outcome, perceived stress. Perceived stress was chosen as the primary outcome because, based on the published research to date, it appears to be an important precursor to a variety of negative outcomes and potentially more sensitive to mindfulness techniques than burnout, which was also measured. Additionally, it was hypothesized that hybrid MAPs would lead to improvements in depression, anxiety, loneliness, and sleep quality based on prior evidence (Black et al., 2015; Bower et al., 2015; Creswell et al., 2012; Lopez-Maya et al., 2019).

Methods

Trial Design and Randomization

This was a single-site, parallel-group, randomized control trial. Prior to the start of the trial, residents were assigned to various geographic training sites within the UCLA pediatric residency training program without interaction with study investigators. Based on these geographic assignments, two blocks were constructed and used as the unit of randomization. One block was allocated 1:1 to MAPs and the other block was allocated to wait-list control using computerized random number generation before the start of the trial. The University of California, Los Angeles institutional review board approved all procedures. Participants provided written informed consent.

Setting and Participants

The study was conducted at the University of California, Los Angeles from September 2017 to March 2018. Inclusion criteria were status as resident physician in the pediatric and medicine-pediatric program at the UCLA Mattel Children’s Hospital. All participants spoke English and had not received prior training in MAPs.

Procedures

Participants who consented to study procedures completed assessments at baseline prior to the intervention and immediately post-intervention. Participants were blinded to the randomization until the start of the intervention. Data collectors were unaware of group assignment and were instructed to treat all participants in the same manner. Additionally, self-report questionnaires were anonymous, matched via a participant-derived identifier number, and completed privately by participants. After study completion, the MAPs intervention was opened to the control condition, according to the wait-list design.

Interventions

Mindful Awareness Practices (MAPs) is a mindfulness-based intervention developed by Diana Winston at UCLA’s Mindful Awareness Research Center (MARC). MAPs is a weekly 2-h, 6-session group-based curriculum in mindfulness meditation that is widely available in-person and online (http://marc.ucla.edu). Mindfulness exercises include mindful breathing, mindful sitting, mindful eating, mindful listening, appreciation meditation, friendly or loving-kindness meditation, mindful walking, and mindful movement as previously described (Black et al., 2015). MAPs trains one in the systematic practice of attending to moment-by-moment experiences, thoughts, and emotions from a nonjudgmental perspective (Brown & Ryan, 2003) is similar to Mindfulness-Based Stress Reduction (MBSR), yet is more accessible by not requiring a day-long retreat or Hatha yoga.

Given the time constraints of resident physicians, the MAPs course was modified with the first session being teacher-delivered, and the five remaining sessions being delivered in a digital format, as self-study sessions via a secure mobile app. The in-person session was thought to be important to give the participants a guided, teacher taught experience of mindfulness meditation. Prior studies using a digital-only format of mindfulness have found benefit for depressive, anxiety, and insomnia symptoms, although adherence rates are low (Huberty, Green, et al., 2021; Huberty, Green, et al., 2021; Huberty, Puzia, et al., 2021; Huberty, Puzia, et al., 2021). The app was developed as a participatory mobile health framework using a web application platform called UCLA CHORUS (Arevian, Bell, et al., 2018; Arevian, O’Hora, et al., 2018) which is identical to the content of online sessions available through UCLA’s MARC and the app “UCLA Mindful”.

Diana Winston, who originated the MAPs curriculum and has more than 20 years of teaching experience in mindfulness, delivered the in-person session and oversaw fidelity of the mobile app relative to the previously developed online MAPs course available through MARC (Bower et al., 2015; Lopez-Maya et al., 2019). Each session introduced the participants to another aspect of mindfulness meditation as per the MAPs course. The participants were then asked to complete 5–20 min daily of mindfulness practice using the guided meditations available through the app (with a weekly increase in practice by 5 min). A trained mindfulness educator was also available for questions via an anonymous discussion board during the intervention period.

The wait-list control was informed of the MAPs intervention at the time of consent and were eligible to enroll in the MAPs intervention in the format described above following study completion.

Outcomes and Assessments

Self-report questionnaires were administered before and after the intervention with all post-intervention assessments completed within 2 weeks after the intervention (week 8).

The primary outcome was perceived stress, which was measured using the Perceived Stress Scale (PSS). This is a widely validated 14-item self-report questionnaire and measures the degree to which situations in one’s life are appraised as stressful (Cohen et al, 1983). Participants are asked to indicate how often they felt or thought a certain way on a 5-point Likert scale (for example, “In the last month, how often have your felt that you were unable to control the important things in your life?”. Scores may range from 0 to 40 with higher scores indicating higher levels of perceived stress. Because the PSS is not a diagnostic instrument with an established clinical threshold, minimal meaningful change was defined using relative change in the PSS (i.e., percentage change from baseline) and the optimal threshold of 28%, a cut-point validated for work-related stress by the external anchor of Patient’s Global Impression of Change (Eskildsen et al., 2015). PSS was specified as the primary outcome in the protocol to the institutional review board prior to enrollment of participants.

Secondary outcomes, which were also planned and a priori, were those thought to be related to the perceived stress of resident physicians including the reflected the causes and consequences of psychological distress suffered by physicians and included multiple well-validated measures: Abbreviated Maslach Burnout Inventory-9 (MBI) (Maslach et al., 1996), Beck Depression Inventory (BDI) (Beck et al., 1996), Beck Anxiety Inventory (BAI) (Beck & Steer, 1990), UCLA Loneliness Scale (Russell et al., 1980), and Pittsburgh Sleep Quality Index (PSQI) (Buysse et al., 1989; Cole et al., 2006).

Adherence to digital MAPs and mindfulness practice was evaluated at post-intervention, using previously reported methods (Black et al., 2015; Bower et al., 2015; Lopez-Maya et al., 2019), by self-report of number of completed sessions, number of days with at least 5 min of mindfulness practice, and number of minutes of practice per day in the last week, which was summed to create total number of practice minutes per week.

Demographic information was obtained at baseline including age, sex, ethnicity, marital status, and residency training year.

Sample Size

A power analysis was conducted in G × Power (http://www.gpower.hhu.de/en.html). Based on previous meta-analytic trials and mean treatment effect (d = .4, a medium effect size), an estimated final total sample size of 52 participants provided statistical power of 80% (a = .05) to detect a between-group effect for psychological stress, i.e., primary outcome perceived stress (Black et al., 2015). An attrition rate of 10% was anticipated, making our target enrollment 29 participants per group.

Statistical Analysis

Between-group change in the mean perceived stress at post-intervention was the primary outcome in the intent-to-treat (ITT) population (i.e., participants randomized and allocated to the intervention with attendance at first in-person session). Analyses were performed in SAS software, version 9.4 (SAS Inc., Cary, NC, USA). Between-group contrasts in outcomes across the intervention period were tested using generalized linear mixed modeling (MIXED command with full information maximum likelihood estimation to allow for analysis of participants with missing data) with pairwise comparisons, adjusted baseline levels of the outcome. Estimated mean differences and effect sizes (Cohen d with Hedges bias correction for small sample size) with their 95% confidence intervals are provided. Exploratory analyses were also conducted to explore whether change in the primary outcome, PSS, achieved a threshold for minimally clinically important change and whether this change differed between MAPs vs control. The proportion of participants who achieved this relative change in the PSS in the MAPs vs control was tested by Likelihood ratio test.

Results

Participant Flow and Characteristics

Participant flow through enrollment, randomization, follow-up, and analysis phases of the trial is shown in Fig. 1. Eligible participants who agreed to participate and completed the baseline assessment were randomized by block; 27 were randomized and allocated to the hybrid MAPs, and 39 were assigned to wait-list controls. Among participants allocated to MAPs, all attended the first in-person session. However, only 58% of those allocated to MAPs participated in any of the digital sessions, with an overall completion of 2.0 digital sessions (SD, 1.3) in the total group. The mean number of days of self-directed mindfulness practice per week was 2.2 days (SD, 1.9) and mean number of minutes per day was 7.0 min (SD, 12.8). Minutes of self-directed mindfulness practice per week ranged from 0 to 240 min, with 53% (n = 14) practicing at least 10 min per week.

Fig. 1.

Consolidated Standards of Reporting Trials (CONSORT) flow diagram of single-site, parallel-group randomized clinical trial of MAPs compared with wait-list control for perceived stress in pediatric resident physicians. ITT intent-to-treat, MAPs Mindful Awareness Practices, control wait-list control. Reasons for declining to participate were time limitations

Table 1 lists summary descriptive statistics for the study groups at baseline. None of the baseline variables differed across groups. The baseline raw mean scores of self-reported stress (MAPs: 26.4 [SD, 5.2] vs control: 25.8 [SD, 6.2] showed no significant differences between study groups. Of note, these means reflect moderate levels of perceived stress in this residency population. Table 2 displays intent-to-treat model-derived estimates for primary and secondary outcome measures, revealing moderately elevated levels of emotional exhaustion and frequent feelings of loneliness, low-range severity of depression and anxiety symptoms, and sleep quality below the threshold of sleep impairment (PSQI < 5).

Table 1.

Baseline demographic characteristics by intervention group

Variable	MAPs (n = 27)	Wait-list control (n = 39)	p value
Demographic characteristics
Age, 25–34 y	26 (96%)	37 (100%)	.43
Female sex, No. (%)	24 (89%)	28 (74%)	.21
Married, No. (%)	22 (81%)	23 (61%)	.11
Race/ethnicity, No. (%)a			.24
Asian/Pacific Islander	13 (48%)	13 (34%)
Hispanic/Latino	0	1 (3%)
White	13 (48%)	17 (45%)
Other	1 (4%)	7 (18%)
Residency training year, No. (%)b			.11
PGY-1	13 (48%)	10 (27%)
PGY-2	7 (26%)	8 (27%)
PGY-3/4	7 (26%)	19 (51%)

^aOne participant declined to answer race/ethnicity question

^bTwo participants declined to answer residency training year question

Table 2.

Intent-to-treat model estimates for primary and secondary outcome measures

	Estimated mean (SD)
	MAPs (n = 27)		Wait-list control (n = 39)		Value (95% CI)
Outcome, scale range	Baseline	Post-intervention	Baseline	Post-intervention	Difference in post-intervention values	Effect sizec
Primary outcome
Perceived stress scale, 0–70a	25.9 (7.3)	22.4 (7.4)d	25.8 (6.0)	24.1 (6.1)	2.20 (0.47–3.93)	0.91 (0.19–1.62)
Secondary outcomes
Maslach burnout inventory, 0–18
Emotional exhaustiona	10.7 (4.8)	9.7 (4.9)	10.6 (4.0)	10.2 (4.1)	0.48 (− 0.66–1.62)	0.30 (− 0.41–1.01)
Depersonalizationa	6.0 (4.8)	5.6 (4.7)	5.9 (4.0)	6.0 (4.1)	0.37 (− 0.77–1.51)	0.23 (− 0.48–0.94)
Personal accomplishmentb	13.8 (3.9)	14.1 (3.9)	13.9 (3.1)	13.9 (3.3)	− 0.25 (− 1.17–0.67)	− 0.20 (− 0.92–0.52)
Beck depression inventory, 0–63a	6.8 (6.0)	7.2 (6.2)	6.8 (5.0)	6.4 (5.2)	− 0.80 (− 2.23–0.63)	− 0.40 (− 1.10–0.31)
Beck anxiety inventory, 0–63a	6.8 (7.4)	4.2 (7.5)d	6.1 (6.1)	4.3 (6.5)d	0.08 (− 1.70–1.86)	0.03 (− 0.69–0.75)
UCLA loneliness scale, 20–80a	37.6 (10.3)	37.2 (10.5)	37.4 (8.5)	37.9 (8.8)	0.65 (− 1.78–3.09)	0.19 (− 0.52–0.90)
Pittsburgh Sleep Quality Index, 0–21a	5.0 (3.2)	4.9 (3.2)	5.2 (2.7)	4.7 (2.8)	− 0.14 (− 0.90–0.63)	− 0.13 (− 0.84–0.59)

^aLower scores indicate improvement

^bHigher scores indicated improvement

^cBias-corrected Hedges g covarying for baseline values

^dSignificant change from baseline to post-intervention at p < 0.05

Primary Outcome

Primary and secondary outcome ITT analyses included participants randomized and allocated to group assignment regardless of measured program adherence or missing data (n = 66). The Perceived Stress Scale (PSS) score improved by a mean of 3.5 in the MAPs group and by a mean of 1.7 in the control group, indicating greater improvement in the MAPs group (between-group mean difference, 2.20; 95% CI 0.47–3.93) with a large effect size 0.91 (0.19–1.62) (Table 2 and Fig. 2). At post-intervention, number of minutes of mindfulness practice negatively correlated with scores on the PSS (r = − 0.39, p = 0.05), suggesting that amount of daily mindfulness practice was associated with lower levels of perceived stress.

Fig. 2.

Estimated Perceive Stress Scale score at baseline and post-intervention. Data are given as means (SEs). MAPs Mindful Awareness Practices, control wait-list control. p = .002 for difference between groups, covarying for baseline Perceived Stress Scale score

Exploratory analyses tested whether relative change in the primary outcome, PSS, achieved a threshold for minimally clinically important change in MAPs versus control groups. Using the optimal threshold for detection of minimal meaningful change for work-related stress (Eskildsen et al., 2015), the proportion who reported they achieved a meaningful change was 32% in MAPs vs 13% in control, but did not reach statistical significance (χ² = 3.1, p = 0.08).

Secondary Outcomes

Changes over time were statistically equivalent across treatment groups for the secondary outcomes including levels of burnout or symptoms of depression, anxiety, loneliness, and sleep disturbance.

Inclusion of covariates such as residency year, marital status, and ethnicity did not significantly alter the results.

Discussion

This randomized controlled trial examined the effect of a hybrid, in-person and digital, mindfulness meditation program on perceived stress in resident physicians undergoing training in pediatrics and medicine-pediatrics. To our knowledge, this study is the first to demonstrate the efficacy of a hybrid mindfulness curriculum, delivered an in-person and digital format, to improve perceived stress relative to a wait-list control group in physicians in training. The effect size of 0.9 for improvement in perceived stress was large, which is notable given meta-analytic findings comparing various meditation treatment modalities with mean effect sizes for psychological distress of small to medium magnitude. Moreover, the effect of hybrid MAPs to improve perceived stress is especially compelling given the rather modest rates of adherence to the digital format (see limitation section below). Finally, exploratory findings suggest that a meaningful change in the PSS occurred at an over two-fold greater rate in MAPs as compared to control. While further research is needed to determine if this meaningful change construct is a valuable way to examine outcomes, these results have important preliminary implications for the value of mindfulness interventions to mitigate work-related stress of physicians in training.

The large effect of hybrid MAPs to reduce perceived stress may be due to the efficacy of this specific mindfulness curriculum, sample characteristics, demand characteristics, and/or expectancy effects. The in-person MAPs curriculum has been previously reported to be effective in improving sleep disturbance (Black et al., 2015) as well as reducing depressive symptoms (Bower et al., 2015; Lopez-Maya et al., 2019) despite limited effects of other meditation approaches on these outcomes (Goyal et al., 2014). Thus, the MAPs approach might be uniquely impactful. Because all participants had at least moderate levels of stress at baseline, they may also have been primed to benefit from the MAPs intervention. Since participants could not be blinded to the fact that they were receiving the intervention, some may have changed their actions and behaviors to become less stressed unrelated to MAPs.

The present study did not demonstrate effects on secondary outcomes of depression, anxiety, burnout, loneliness, or sleep disturbance. Thus, there are now two randomized clinical trials of mindfulness meditation with pediatric resident physicians that have failed to demonstrate an impact on burnout (Fraiman et al., 2022). This likely reflects the multiple workplace- and nonworkplace-related factors associated with burnout and the need for not only individual-based but systems-wide interventions to reduce stress. Mindfulness meditation might need to be combined with other individual-based interventions that improve motivation, communication skills, teamwork, and engagement in participatory and self-care programs; or structural changes that modify work demands, schedule, and/or shift duration (Aryankhesal et al., 2019; West et al., 2016). Further, interventions may need to be tailored to the specific environmental stressors.

Our study has some important limitations to consider. Despite delivery of mindfulness training via a convenient mobile app, measured adherence to the intervention was low. While even intermittent adherence to mobile-based apps for mindfulness is reported to improve reports of well-being (Clarke & Draper, 2019), our findings are more robust than one might expect. Although many residents did not subsequently access the digital format, it could be that the initial session was sufficient to teach the core skills to residents or served as a reminder to them to use previously learned skills. Additionally, the measured level of practice in this study was “formal practice,” however, we anecdotally discovered that participants informally practiced by using mindful awareness to be present in the moment in daily activities. This suggests that teaching residents to integrate these skills within their workflow might be more feasible than formal practice and that measurement of workflow practice (as opposed to formal practice) is needed to better describe adherence. As discussed above, expectancy effects may have also played a role in explaining our large effect size. The study was also conducted at a single institution, with participants limited to residents in Pediatrics, and with a high proportion of Asian ethnicity, which potentially limits the generalizability of the results. Resident physicians were asked to complete the mindfulness-based intervention outside of work hours, which adds to their stressful schedule and likely contributed to low adherence. Engagement of the residency training program in delivering mindfulness training or other tools to reduce psychological stress during formal work hours would likely optimize adherence and better promote resilience.

Conclusions

Exposure to training in MAPs mindfulness meditation, delivered in person and digitally, was associated with reduced levels of perceived stress in resident physicians. Targeting work-related stress with MAPs has the potential to mitigate the development of clinician burnout and to promote physician well-being.

Abbreviations

PSS

Perceived stress scale

MBI

Abbreviated Maslach Burnout Inventory-9

BDI

Beck depression inventory

BAI

Beck anxiety inventory

PSQI

Pittsburgh Sleep Quality Index

MAPs

Mindful Awareness Practices (MAPs)

Author Contributions

All authors contributed to the study conception and design. Material preparation, data collection, and analysis were performed by DRP, MRI, YB, MF, and DW. First draft of manuscript was written by DRP. All authors commented on the previous versions of the manuscript.

Funding

This research was funded by the UCLA Semel Institute for Neuroscience and Norman Cousins Center for Psychoneuroimmunology, NIH National Center for Advancing Translational Science (NCATS) UCLA CTSI Grant No. UL1TR001881.

Data Availability

Available.

Code Availability

Not applicable.

Declarations

Conflict of interest

Denise R. Purdie, Myke Federman, Alan Chin, Diana Winston, Brenda Bursch, Richard Olmstead, Yonca Bulut, Michael R. Irwin report no conflicts of interest in this work.

Ethical Approval

The University of California, Los Angeles institutional review board approved all procedures, IRB#16–001817.

Consent to Participate

Informed written consent was obtained from all individual participants included in the study.

Consent for Publication

Not applicable.

Human and Animal Rights

This study has been approved by the appropriate ethics committee and have therefore been performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments.