Abstract
Objective.
The objectives of this study were to develop and refine EMPOWER (Enhancing and Mobilizing the Potential for Wellness and Resilience), a brief manualized cognitive-behavioral, acceptance-based intervention for surrogate decision-makers of critically ill patients and to evaluate its preliminary feasibility, acceptability, and promise in improving surrogates’ mental health and patient outcomes.
Method.
Part 1 involved obtaining qualitative stakeholder feedback from 5 bereaved surrogates and 10 critical care and mental health clinicians. Stakeholders were provided with the manual and prompted for feedback on its content, format, and language. Feedback was organized and incorporated into the manual, which was then re-circulated until consensus. In Part 2, surrogates of critically ill patients admitted to an intensive care unit (ICU) reporting moderate anxiety or close attachment were enrolled in an open trial of EMPOWER. Surrogates completed six, 15–20 min modules, totaling 1.5–2 h. Surrogates were administered measures of peritraumatic distress, experiential avoidance, prolonged grief, distress tolerance, anxiety, and depression at pre-intervention, post-intervention, and at 1-month and 3-month follow-up assessments.
Results.
Part 1 resulted in changes to the EMPOWER manual, including reducing jargon, improving navigability, making EMPOWER applicable for a range of illness scenarios, rearranging the modules, and adding further instructions and psychoeducation. Part 2 findings suggested that EMPOWER is feasible, with 100% of participants completing all modules. The acceptability of EMPOWER appeared strong, with high ratings of effectiveness and helpfulness (M = 8/10). Results showed immediate post-intervention improvements in anxiety (d = −0.41), peritraumatic distress (d = −0.24), and experiential avoidance (d = −0.23). At the 3-month follow-up assessments, surrogates exhibited improvements in prolonged grief symptoms (d = −0.94), depression (d = −0.23), anxiety (d = −0.29), and experiential avoidance (d = −0.30).
Significance of results.
Preliminary data suggest that EMPOWER is feasible, acceptable, and associated with notable improvements in psychological symptoms among surrogates. Future research should examine EMPOWER with a larger sample in a randomized controlled trial.
Keywords: Critical care, Grief, Intensive care unit, Intervention, Surrogate decision-making
Introduction
Research has repeatedly shown that surrogate decision-makers of critically ill patients receiving intensive care are at heightened risk of significant psychological distress, including posttraumatic stress disorder (PTSD) and prolonged grief disorder (PGD) (Anderson et al., 2008; Siegel et al., 2008; Wright et al., 2010; Rodriguez Villar et al., 2012; Kentish-Barnes et al., 2015; Lovell et al., 2015; Derry et al., 2020; Greenberg et al., 2021). Involvement in making end-of-life decisions appears to be a particularly significant source of stress (Azoulay et al., 2005). This is largely due to the intense emotional conflict surrogates frequently experience, as their wish to make decisions that are in accordance with the patient’s values may be at odds with their fear of feeling responsible for the patient’s well-being and death, their desire to preserve the patient’s life, and the need to protect the welfare of their family (Schenker et al., 2012). Often, intensive care unit (ICU) clinical staff approach surrogates to make life-and-death decisions, such as consenting to Do Not Resuscitate (DNR) orders, on short notice and with little mental preparation, exacerbating this internal conflict. Surrogates may be in a state of shock about patients’ deteriorating health, grief-stricken over the prospect of their loved ones’ impending deaths, and coping with trauma-provoking patient suffering and medical realities in the ICU. Being in such a distressed psychological state understandably can have an impact on a surrogate’s decision-making capacity. Thus, guilt, regret, and protracted grief following the patient’s death are common (Hickman et al., 2012; Lovell et al., 2015).
There have been several efforts to address the mental health needs of surrogates. However, prior intervention trials have produced mixed results (Lautrette et al., 2007; White et al., 2012, 2018; Curtis et al., 2013; Carson et al., 2016; Cox et al., 2019; Dionne-Odom et al., 2020). A primary limitation of these clinical trials is that they have targeted mental health outcomes without utilizing explicit mental health interventions. The current proof-of-concept study aims to address this limitation. We developed and pilot tested a brief mental health intervention called EMPOWER (Enhancing and Mobilizing the POtential for Wellness and Emotional Resilience), which uses ultra-brief (Sperry and Binensztok, 2019), evidence-based cognitive-behavioral, acceptance-based techniques to reduce experiential avoidance, grief, anxiety, and peritraumatic distress (Prigerson et al., 2019).
Our conceptual model posits that symptoms of grief, anxiety, traumatic stress, and related maladaptive coping reactions, such as dissociation and avoidance, interfere with engaging in value-concordant and empowered end-of-life decision-making (Glick et al., 2018). We highlight the role in coping of experiential avoidance, which is the natural tendency to avoid unpleasant feelings and consideration of negative outcomes (Plumb et al., 2004; Gamez et al., 2011, 2014) and which has been associated with PTSD and PGD (Marx and Sloan, 2005; Bishop et al., 2018; Williams et al., 2019; Serrano-Ibanez et al., 2021). There are many subtle ways avoidance may manifest for surrogates. As the prospect of losing the patient weighs on them, they may push for more aggressive care, attempting to avoid their grief. Faced with the prospect of the patient suffering, they may seek reassurance from clinicians, attempting to avoid feelings of guilt. Fearful of making the “wrong” decision, they may avoid engaging in goals of care discussions and end-of-life decisions. This avoidance is likely to be detrimental, as advance care planning and goals of care discussions have been associated with higher quality, less aggressive, and more value-consistent end-of-life care, as well as better patient quality of life (Mack et al., 2010). Both of these predict better bereavement adjustment of the caregiver (Wright et al., 2008; Garrido and Prigerson, 2014).
The ability of surrogates to engage in end-of-life decision-making on the patient’s behalf relies on them to be emotionally “present” and thinking clearly. EMPOWER aims to reduce surrogates’ experiential avoidance and to empower them in their decision-making role (Tunzi, 2012), providing them with tools to cope with distress related to the patient’s impending death as well as to adjust following the patient’s ICU discharge or death.
Guided by the Stage Model of Behavioral Therapies (Rounsaville et al., 2001), the present study focused on Stage IA (e.g., intervention development and refinement) and had two objectives: (1) to develop and refine EMPOWER using feedback from bereaved surrogates and from expert critical care and mental health clinicians and (2) to determine preliminary feasibility, acceptability, and effects of EMPOWER on surrogate mental health and patient outcomes.
Methods
Study design and procedures
This Institutional Review Board-approved study (Weill Cornell Medicine IRB #1610017622; Clinicaltrials.gov Registration # NCT03276550) involved refinement of the EMPOWER intervention manual (Part 1) followed by a single-arm pilot trial of EMPOWER (Part 2).
Part 1 used a modified Delphi approach that involved gathering opinions from experts, keeping feedback anonymous, identifying and summarizing feedback themes, and circulating modifications back to experts until consensus is reached (de Meyrick, 2003). Key informants were nominated by targeted sampling (de Meyrick, 2003) of ICU and mental health clinicians, ensuring representation from different training and specialties and bereaved surrogates of patients who had been admitted to the ICU. Consented surrogates and clinicians were provided with a copy of the EMPOWER intervention manual and a survey primarily conducted by interview, which included prompts to elicit structured feedback on its content, format, and language. Interviews were audio-recorded and transcribed using a professional service. Following analysis of round one feedback, key informants were provided with an updated manual to offer any additional feedback. Key informants received $50 for their participation.
Part 2 was an open trial of EMPOWER implemented in the ICU of an urban academic medical center. Individuals were eligible if they were the healthcare proxy or surrogate of a non-communicative, critically ill patient, as indicated in the patient’s medical record or by the ICU medical team. Patients had to be at least age 21 or older, lack of decisional capacity (e.g., on ventilator, unconscious, or cognitively impaired rendering them unable to talk), admitted to an ICU or step-down unit during their current hospitalization, and considered by the ICU attending or fellow to be near the end of life (patients whose ICU physicians or fellows would not be surprised if they did not survive more than 3 months; Haydar et al., 2019). Surrogate decision-makers had to be English-speaking, report a very close attachment to the patient (a summed score of at least 8 on two items from the Partner Dependence Scale) (Johnson et al., 2006; 2007), and be at least moderately anxious (greater than 5 on either anxiety item of the McGill Quality of Life Scale) (Cohen et al., 1995).1 Screening scores were selected based on pilot data, indicating that anxiety and attachment issues are key risks for poor coping among caregivers (Prigerson et al., 2009; Wright et al., 2010; Garrido and Prigerson, 2014; Higgins et al., 2015). Exclusion criteria included current suicidal ideation.
Surrogates were identified by reviewing the ICU census with the ICU clinical staff several times a week to identify patients lacking decisional capacity. After obtaining permission from attending physicians, research assistants approached the surrogate in the ICU. If the surrogate was interested and eligible, informed consent was obtained. Access to patients’ charts was permitted through a Health Insurance Portability and Accountability Act (HIPAA) waiver.
Surrogates were assessed with self-report measures pre-intervention/baseline (Time 1 [T1]), post-intervention (within a week of the surrogate’s completion of the baseline assessment) (T2), 1-month post-baseline (T3), and 3-months post-baseline (T4). They were also invited to complete a qualitative exit interview to provide feedback on EMPOWER. Patient outcomes included and intensity of care. Participants received $25 per assessment completed for a maximum of $100. The EMPOWER intervention was delivered by the lead intervention developer, WGL, who is a licensed clinical psychologist, for the first four cases. In preparation for a subsequent feasibility pilot randomized controlled trial, additional interventionists were thoroughly trained through didactics and review of recordings of the initial cases. Interventionists included a Master’s level advanced clinical psychology doctoral student, an experienced licensed social worker, and a more recently licensed social worker. All four interventionists had prior experience working with family caregivers and bereaved populations.
Intervention and conceptual model description
EMPOWER incorporates evidence-based cognitive-behavioral approaches (Bryant et al., 2003, 2008, 2014; Boelen et al., 2007; Gartlehner et al., 2013; Litz et al., 2014; Birur et al., 2016), acceptance-based principles to build distress tolerance (Orsillo and Batten, 2005; Walser and Westrup, 2007; Kelly et al., 2015; McLean and Follette, 2016), and meaning-centered grief therapy techniques (Lichtenthal et al., 2019; Neimeyer, 2012, 2016) to reduce experiential avoidance and symptoms of anxiety, grief, and traumatic stress. The program targets individuals reporting distress and at risk of poor outcomes in the longer term. It consists of six discrete ~15-min modules delivered flexibly in a setting that is frequently prone to multiple interruptions and crises such as the ICU. The six modules may be done in a single session or in parts over the course of 2–3 days, though this varies and may take longer, depending on the surrogate’s preference and availability.
The intervention uses empathic support, psychoeducation, and experiential exercises, and is tailored to the most pressing and distressing challenges that the surrogate reports, be they fears of losing the patient, worries about decision-making, concerns about family, or a combination of stressors. Table 1 provides an overview of the intervention content and structure. EMPOWER begins in Module 1 with an assessment of the surrogate’s most significant sources of distress and provision of empathic support. In Module 2, the surrogate engages in breathing retraining, grounding exercises, and mindfulness meditation to address acute emotional and physiological stress responses (e.g., symptoms of hyperarousal and/or dissociation) in order to facilitate processing of the subsequent psychoeducation. The surrogate is taught how to use these tools to manage symptoms and assist with processing information provided by the patient’s medical team moving forward.
Table 1.
EMPOWER | |||
---|---|---|---|
In ICU | Delivered in single or multiple sessions | Module 1 | Nurturance, understanding, and joining |
Module 2 | Breathing retraining, grounding exercises, and mindfulness meditation | ||
Module 3 | Psychoeducation about trauma, grief, and the cognitive-behavioral model | ||
Module 4 | Increasing acceptance and sense of permission to experience challenging emotions | ||
Module 5 | Connecting with the patient’s voice | ||
Module 6 | Using the EMPOWER toolbox and coping rehearsal | ||
Phone | 2 weeks post-Module 6 | Booster Call 1 | Check-in and review of psychoeducation and coping skills |
Phone | 4 weeks post-Module 6 | Booster Call 2 | Check-in and review of psychoeducation and coping skills |
In Module 3, they are provided with psychoeducation about experiential avoidance and the cognitive-behavioral model to help facilitate emotional processing (Foa et al., 2007). They are taught how experiential avoidance can manifest in many ways — through the pursuit of aggressive care of the patient, avoidance of making significant decisions, ruminative worry, and/or reassurance-seeking — and how such behaviors reflect the individual’s efforts, whether conscious or not, to “get away”, or flee, from the difficult cognitions and emotions. Surrogates are taught about how such avoidance is negatively reinforcing — bringing short-term respite, but paradoxically maintaining their distress. In Module 4, acceptance-based principles and coping strategies are reviewed. The surrogate’s ability to tolerate distress in real time and throughout the EMPOWER encounter are highlighted to help increase acceptance of these aversive states and foster self-compassion (Orsillo and Batten, 2005; Walser and Westrup, 2007).
EMPOWER targets key attachment issues related to grief and any decision-making challenges in Module 5. This module also reviews psychoeducation and discusses strategies for preventing regrets. It invites an imaginal dialogue with the patient to garner the patient’s support in the surrogate’s struggle to consider the patient’s wishes and values, and to facilitate quality decision-making and empowerment (Tunzi, 2012; Cox et al., 2015). The intervention concludes in Module 6 with a review of the key EMPOWER principles and coping rehearsal for anticipated stressful situations. Two booster calls are conducted (two and four weeks later) to review the key principles of EMPOWER, to discuss successes and challenges applying the coping strategies in real-life scenarios, and to engage in coping rehearsal for anticipated stressful situations. Since, in many cases, the patient has died prior to one of the booster calls, this call often provides acute meaning-centered bereavement support and reviews how to apply the EMPOWER principles in coping with post-loss grief and bereavement.
EMPOWER focuses largely on exercises that involve carefully titrated exposure to distress during the intervention. Importantly, however, interventionists must be careful to work within the surrogate’s “therapeutic window”; that is, to adequately activate the individual’s emotions without exceeding their capacity to tolerate distress (Briere and Lanktree, 2013). The interventionist pays careful attention to the surrogate’s ability to regulate affect so as to avoid re-traumatizing them. The focus on providing individually tailored tools for higher-risk individuals distinguishes EMPOWER from interventions like critical incident stress debriefing (Mitchell and Everly, 1995; Gartlehner et al., 2013). Ultimately, EMPOWER aims to help surrogates make difficult decisions by building tolerance for painful feelings and negative intrusive thoughts, and by minimizing future chronic avoidance (e.g., of emotional triggers), so that normative acute stress and grief responses do not escalate into pathological reactions like PTSD and PGD (Marx and Sloan, 2005; Bishop et al., 2018; Williams et al., 2019; Serrano-Ibanez et al., 2021). The intervention manual also notes adaptations for various cultural and ethnic populations and the importance of cultural competence in delivering EMPOWER to diverse surrogate groups.
Assessment of feasibility and acceptability
We assessed the proportion of surrogates approached for the open trial who (a) consented, (b) declined participation, and (c) were ineligible. We also assessed delivery of EMPOWER by recording the number of modules completed and reasons not completed. Feasibility of (a) recruitment, (b) implementation, (c) measurement, and (d) retention were examined. Surrogate satisfaction at T2 and attrition at T4 were used to evaluate acceptability. Part 2 participants were also invited to complete a qualitative exit interview about their experience with EMPOWER and to provide any additional feedback about acceptability and to further refine the intervention.
Self-report measures
Demographic and background information
Surrogates self-reported demographic information during the baseline interview. Demographic information for patients, as well as medical information including DNR order completion, intubation, extubation, and withdrawal of life-sustaining care, were obtained through medical chart abstraction.
Psychological outcomes
Peritraumatic distress, the primary outcome, was measured at T1 and T2 by the Peritraumatic Distress Inventory (PDI), a reliable (α = 0.76) and valid 13-item test that measures the extent to which an individual experienced distress at the time of a critical incident event and in the subsequent minutes or hours (Brunet et al., 2001; Bunnell et al., 2018). By inference, the event corresponded to the ICU stay of the patient, and to remove any ambiguity, this was made explicit for the final participant. Due to their lack of relevance in the ICU setting, items 4 and 7 of the PDI were not administered to participants, yielding a modified 11-item version, with scores ranging from 0 to 44, with higher scores representing greater peritraumatic distress. Symptoms of intrusion and avoidance, often used as an indicator of PTSD, were measured at T2, T3, and T4 using the reliable (α = 0.79–0.94) Impact of Event Scale-Revised (Weiss and Marmar, 1996). The first item of this measure was not administered to participants, leaving a total of 21 items, with scores ranging from 0 to 88, and higher scores representing greater PTSD symptomology. Instructions were modified to specify that participants were to respond to the items regarding “stressful events in the ICU” rather than “stressful life events” as is detailed in the original instructions (Weiss and Marmar, 1996). The first nine participants were asked to specify an index event in the ICU, whereas the final participant was asked to respond based on the ICU stay in general.
Experiential avoidance was measured by the Brief Experiential Avoidance Questionnaire (BEAQ) (Gamez et al., 2014), a 15-item measure assessing six dimensions of experiential avoidance that has demonstrated good internal consistency. Scores range from 15 to 90, with higher scores representing greater experiential avoidance. Anticipatory grief was measured by the 12-item PG-12 (Zhang et al., 2006; Prigerson et al., 2008. 2009), and post-loss PGD symptom severity was assessed by the widely used, valid, 13-item PG-13 (Zhang et al., 2006; Prigerson et al., 2008, 2009). Combined scores on these measures were used to index pre- or post-loss grief intensity, with scores ranging from 11 to 55, and higher scores representing greater grief intensity.
For the first three participants enrolled, anxiety and depression were measured by the Hospital Anxiety and Depression Scale (HADS), a valid and reliable 14-item measure of anxiety and depression used in both hospital and community settings (Zigmond and Snaith, 1983). The measure has demonstrated reliability in caregivers (α = 0.85 for anxiety; α = 0.84 for depression) (Gough and Hudson, 2009). Scores for both anxiety and depression subscales range from 0 to 21, with greater scores representing greater symptoms. For the remaining seven participants, anxiety was measured using the Generalized Anxiety Disorder-7 (GAD-7), a valid and reliable 7-item measure of generalized anxiety symptoms (scores ranging from 0 to 21) (Spitzer et al., 2006), and depression was measured with the widely used 9-item Patient Health Questionnaire-9 (PHQ-9), with scores ranging from 0 to 27 (Kroenke et al., 2001).
Distress tolerance was indexed by the summed score of items 1, 2, 8, and 9 of the 14-item Distress Tolerance Scale (DTS), which assesses an individual’s ability to endure negative emotional states (Simons and Gaher, 2005). The summed score of these items can range from 0 to 20, with greater scores representing greater ability to tolerate distress. Decision-making self-efficacy was measured by the Family Decision-Making Self-efficacy Scale: Unconscious Patient Scenario (FDMSS), a 13-item valid and reliable assessment of confidence of family members in their ability to make decisions with or for a terminally ill loved one (Nolan et al., 2009). Using a modified response scale of 1–6, scores ranged from 13 to 78, with higher scores representing greater self-efficacy. Satisfaction with and helpfulness of the EMPOWER components was measured by a Post-Intervention Satisfaction Questionnaire (PISQ), an assessment of helpful treatment components and satisfaction with the intervention. All participants received a single categorical item inquiring about treatment length. The final seven participants were asked to rate the helpfulness and effectiveness of the EMPOWER intervention on a Likert-style scale where 0 represented “not at all” and 10 represented “extremely”. These participants also rated how helpful EMPOWER was on four ICU-related domains (i.e., “It helped me to think through what the patient wanted,” “It helped make me less stressed”) on a similar Likert-style 0 to 10 scale, where 0 represented “not at all helpful” and 10 represented “extremely helpful”.
Data analysis
Part 1 key informant interviews were transcribed and content analyzed, a well-established, systematic qualitative analysis approach in health research (Morse, 1994), to identify themes from participants’ narratives. We followed Morse’s (1994) guidelines for conducting rigorous qualitative research (e.g., consensus coding and thematic saturation) using Atlas.ti software. Coding of feedback was overseen by KER and WGL, who have extensive experience in qualitative methods for intervention development. A preliminary codebook was developed a priori by KER and WGL that included general feedback categories (e.g., feedback on intervention format, intervention materials, module content, and satisfaction with intervention). Interviews were independently coded by at least two team members using this codebook. Consensus meetings were led by KER, and the codebook was iteratively modified as new themes were identified (Charmaz, 2004; Hill et al., 2005). Themes around feedback and suggested changes to EMPOWER were summarized, and manual modifications were made incorporating feedback. Additional feedback from key informants on the modifications and revised manual, as well as feedback provided in the exit interviews with open trial participants, followed the same procedures used in the first round. Minor modifications were made, resulting in a finalized EMPOWER intervention manual.
For Part 2, we computed descriptive statistics to characterize the feasibility and acceptability of EMPOWER by examining helpfulness/satisfaction ratings, rates of recruitment, attrition, and number of modules and booster calls completed. Targets were completion of 4–6 modules for feasibility and almost all positive feedback for acceptability. To evaluate the preliminary effects of EMPOWER, we used descriptive statistics and Dunlap’s d within-subjects effect-size estimates (Dunlap et al., 1996) at each longitudinal timepoint relative to baseline.
Results
Part 1
We enrolled five bereaved surrogates of patients who were uncommunicative and died in the ICU and 10 ICU (n = 7) and mental health (n = 3) clinicians, including nurses, social workers, psychologists, and a critical care physician, to obtain their feedback on EMPOWER. This number of key informants was selected to ensure sufficiently comprehensive feedback about the manual from multiple perspectives (Morse, 1994). Themes of stakeholder feedback consisted of general feedback on the intervention approach, format and materials, reasons EMPOWER may be helpful to surrogates, elements of each module and booster session that should remain or be modified, and suggested additions to the intervention. Overall, both provider and surrogate stakeholders viewed EMPOWER as having the potential to benefit surrogates, with only one surrogate stakeholder out of five noting a preference for standard psychotherapy. Participants also provided feedback more broadly on important considerations for interventionists delivering EMPOWER, given the unique needs of surrogates and the ICU setting. Stakeholders described the importance of providing surrogates with psychoeducation about the purpose of EMPOWER and intervention techniques used in the modules. Feedback suggested that interventionists delivering EMPOWER should also be familiar with the myriad challenges of the ICU setting and that it would be important for them to be attentive to the patient’s case in order to best partner with the surrogate. They noted the critical need for interventionists to be mindful of the surrogate’s receptivity and shifting needs due to the ever-changing nature of the ICU setting. To that end, stakeholders shared either observed or personal experiences of surrogates in the ICU, of which interventionists should be aware. Elements of these experiences were woven in throughout the manual to further tailor it to this unique population. Despite stakeholders noting some potential challenges of providing an intervention in the ICU, they emphasized the need for such an intervention and the utility of EMPOWER’s flexible, modular nature.
Feedback on the EMPOWER format resulted in several changes, including reducing or further defining clinical jargon (e.g., mindfulness and trauma), improving navigability (e.g., table of contents), changing the use of binary gender terms to non-binary (e.g., they/them/their), making EMPOWER applicable for a broad range of illness scenarios, and changing the order of several modules. Stakeholders provided suggestions for changes to module format and content, with most feedback centering on the provision of more instructions for interventionists and, similarly, more psychoeducation on intervention techniques for surrogates. Detailed content and formatting changes made in each of the six modules are summarized in Table 2. Finally, participants suggested minor modifications to the handouts included in the EMPOWER manual to clarify exercise instructions and increase their relevance.
Table 2.
Module 1: Nurturance, understanding, and joining |
---|
• Added instruction for interventionist to mention manual will be used throughout |
• Added instruction for interventionist to describe the modular nature of EMPOWER |
• Added question: “How are other people around you coping and how does it affect your coping?” |
• Added notes for interventionist about themes of the caregiver experience (e.g., drive to focus on patient to determent of the caregiver’s needs) |
Module 2: Breathing retraining, grounding exercises, and mindfulness meditation |
• Added instructions for interventionist to not refer to the increased risk of PTSD to enhance sensitivity |
• Added psychoeducation and rationale for Module 2 topic |
• Modified breathing, mindfulness, and grounding exercises |
• Added instruction for interventionist to carefully assess appropriateness of exercises based on caregiver history of prior trauma |
Module 3: Psychoeducation about trauma, grief, and the cognitive-behavioral model |
• Expanded psychoeducation on anticipatory grief and peritraumatic stress |
• Added instruction for interventionist on presenting the cognitive-behavioral model |
• Provided examples of socratic questions to facilitate cognitive-restructuring exercise |
Module 4: Increasing acceptance and sense of permission to experience challenging emotions |
• Changed module order from 6 to 4 |
Module 5: Connecting with the patient’s voice |
• Changed module order from 4 to 5 |
• Modified language “empty chair” to “imaginal conversation” exercise |
Module 6: Using the EMPOWER toolbox and coping rehearsal |
• Changed module order from 5 to 6 |
• Added instruction for interventionist to summarize challenges that may arise in the future |
• Added guidance for interventionist on how to conclude the module |
Round 2 feedback and exit interviews included positive feedback on the manual, with only minor additional changes suggested. These included slight changes to handout language for clarity and several recommendations for interventionists similar to those provided in the first round (e.g., interventionists should be attentive to medical circumstances of the patient and shifting surrogate needs and emotions).
Part 2
Participant characteristics
Details about the 10 surrogates who participated in the open trial are presented in Table 3. The majority of participants were under age 65, White, non-Hispanic, high school graduates, and adult children of the patients. Data for nine of the patients whom the surrogates were caring for were available. Four of the nine had active cancer (split evenly between liquid and solid tumor cancers). Two patients died between the T1 and T2 assessments. Three patients died between the T2 assessment and the T3 assessment 1-month post-baseline. One patient died between the T3 assessment and the T4 assessment 3-months post-baseline, leaving four patients who survived the study period.
Table 3.
Characteristic | Surrogates (n = 10) |
Patients (n = 9) |
||
---|---|---|---|---|
n | % | n | % | |
Age | ||||
64 or younger | 8 | 80 | 3 | 33 |
65 or older | 2 | 20 | 6 | 67 |
Gender | ||||
Male | 4 | 40 | 4 | 44 |
Female | 6 | 60 | 5 | 56 |
Race | ||||
White | 8 | 80 | 4 | 44 |
Black | 1 | 10 | 1 | 11 |
Other | 1 | 10 | 2 | 22 |
Missing | 0 | 0 | 2 | 22 |
Ethnicity | ||||
Hispanic | 0 | 0 | 1 | 11 |
Non-Hispanic | 7 | 70 | 5 | 56 |
Missing | 3 | 30 | 3 | 33 |
Religion | ||||
Christianity | 3 | 30 | 3 | 33 |
Judaism | 3 | 30 | 2 | 22 |
Other | 2 | 20 | 2 | 22 |
None | 2 | 20 | 1 | 11 |
Missing | 0 | 0 | 1 | 11 |
Education | ||||
Some high school | 1 | 10 | ||
High school graduate/GED | 1 | 10 | ||
Some college | 2 | 20 | ||
Undergraduate degree | 1 | 10 | ||
Graduate/professional degree | 5 | 50 | ||
Relationship to the patient | ||||
Son/daughter | 6 | 60 | ||
Spouse/partner | 3 | 30 | ||
Parent | 1 | 10 | ||
Any counseling or treatment for emotional problem in the past? | ||||
Yes | 4 | 40 | ||
No | 3 | 30 | ||
Missing | 3 | 30 |
Feasibility and acceptability
Recruitment was challenging, as expected with this population. We received consent to approach 87 patient-surrogate dyads. For 23 of these dyads (26%), the patient died, was discharged, or regained decision-making capacity before the surrogate could be approached. Of the 64 surrogates who were approached, 49 (77%) declined participation. Reasons for refusal included reporting a sufficient level of support, feeling too busy to participate and concerns about the time commitment involved in participating, and not wanting to leave the patient’s bedside. Fifteen participants (23%) completed the screening process. Of these, one participant did not meet eligibility criteria, and four dropped out before receiving the intervention due to scheduling challenges and/or declining patient status. This yielded a total of 10 participants who completed the baseline assessment and received the EMPOWER intervention. Two surrogate decision-makers withdrew from the study. One surrogate withdrew while completing the T2 assessment, as the indexed patient had died a week prior and they no longer wished to participate. Thus, post-intervention, follow-up, and patient data are missing for this participant. The other was an international participant who was lost to follow-up when they returned to their home country during the study period. In all, six participants completed the T3 assessment, and eight completed the T4 assessment. Surrogates were enrolled a median 22 days after the patient’s ICU admission (minimum 3 days, maximum 38 days).
Overall, EMPOWER appeared feasible, with 100% of participants who began the intervention completing all six modules. Completion of the booster calls was less consistent. Of the nine participants eligible for a booster call (excluding the participant who dropped during administration of T2), five completed both booster calls. The remaining four participants did not complete any booster calls.
Acceptability of the EMPOWER intervention appeared strong, with post-intervention ratings of effectiveness and helpfulness both averaging an 8 out of 10 (see Table 4 for additional post-intervention ratings from the PISQ). Exit interviews provided more evidence of acceptability. In responding to a question about whether EMPOWER was helpful, a 31-year-old surrogate caring for her mother with metastatic non-small-cell lung cancer stated, “And, you know, when everything was said and done — because my mother did pass the day after — I think it was a huge, huge help.” Another, a 51-year-old surrogate caring for her husband with acute myeloid leukemia commented about the intervention, “I thought it was fabulous.” When asked whether what was discussed in EMPOWER was actually applicable to what was going on in the ICU setting, she responded, “Yeah, because I think I used that··· used that and it opened my eyes. Yeah, I definitely do.” In response to a question about whether the intervention was helpful, a 67-year-old caring for her husband with myelodysplastic syndrome replied, “Well I think that it’s very helpful. I think it should continue.” When a separate surrogate was asked what helped most, the 57-year-old caring for her mother with chronic obstructive pulmonary disease expressed, “And actually was a professional who I felt safe – I felt like, you know, not only did somebody have my back, there’s a lot of people who give you advice and support but this is someone that knew what she was talking about.”
Table 4.
Continuous items (n = 6) | M | SD |
---|---|---|
How effective did you think the entire EMPOWER session was? | 8.0 | 2.3 |
How helpful did you find the EMPOWER session(s)? | 8.0 | 2.8 |
It helped me to focus | 7.2 | 3.8 |
It helped me to make decisions regarding the patient’s care | 7.3 | 2.3 |
It helped me to think through what the patient wanted | 8.0 | 2.8 |
It helped make me less stressed | 8.0 | 2.4 |
Categorical items (n = 9) | n | % |
How would you rate the length of this treatment? | ||
Too brief | 2 | 22.2 |
Too long | 1 | 11.1 |
Just right | 6 | 66.7 |
Exploration of preliminary efficacy
Table 5 shows pooled descriptive statistics and effect-size estimates for outcomes of interest. Examining acute effects immediately after the 6-module, 1.5- to 2-h intervention, a small within-subjects effect at T2 was observed for the primary outcome, peritraumatic distress (Dunlap’s d ≥ 0.2). A large within-subjects effect at T2 was observed for anxiety as measured by the HADS Anxiety Subscale among the two participants who received it (Dunlap’s d ≥ 0.8), and a small-to-moderate effect was observed for anxiety as measured by the GAD-7 (Dunlap’s 0.2 >d < 0.5). There was also a small effect at T2 on experiential avoidance (Dunlap’s d ≥ 0.2).
Table 5.
Pre-intervention (T1) |
Post-intervention (T2) |
1-month follow-up (T3) |
3-month follow-up (T4) |
|||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Measure | n | M | SD | Minimum | Maximum | n | Diff. | d | n | Diff. | d | n | Diff. | d |
Peritraumatic Distress Inventory (PDI) | 9 | 17.2 | 9.8 | 7 | 33 | 8 | −1.8 | −0.24 | ||||||
Patient Health Questionnaire 9 (PHQ-9) | 7 | 8.7 | 4.3 | 4 | 16 | 7 | −0.1 | −0.03 | 4 | −2.3 | −0.65 | 6 | −1.2 | −0.23 |
Generalized Anxiety Disorder 7 (GAD-7) | 7 | 13.4 | 4.8 | 5 | 19 | 7 | −1.7 | −0.41 | 4 | −1.5 | −0.24 | 5 | −1.4 | −0.29 |
HADS Depression | 3 | 13.3 | 3.8 | 9 | 16 | 2 | −1.0 | 0.00 | ||||||
HADS Anxiety | 3 | 15.7 | 3.5 | 12 | 19 | 2 | −3.5 | −0.90 | ||||||
Prolonged Grief 12/13 (PG-12/PG-13)a | 10 | 35.7 | 8.1 | 21 | 48 | 9 | −0.2 | −0.03 | 6 | −3.0 | −0.45 | 7 | −6.7 | −0.94 |
Brief Experiential Avoidance Questionnaire (BEAQ) | 10 | 47.4 | 12.7 | 33 | 70 | 9 | −4.3 | −0.23 | 6 | −3.0 | −0.21 | 7 | −5.0 | −0.30 |
Distress Tolerance Scale (DTS) | 9 | 11.7 | 5.5 | 6 | 20 | 8 | 0.0 | 0.00 | 6 | −1.2 | −0.23 | 7 | 0.7 | 0.14 |
Family Decision-Making Self Efficacy Scale (FDMSE) | 9 | 70.7 | 9.1 | 51 | 78 | 8 | −1.4 | −0.15 | ||||||
Impact of Events Scale-Revised (IES-R)b | 5 | 30.0 | 12.9 | 14 | 44 | 4 | −6.0 | −0.25 | 4 | −2.00 | 0.15 |
All participants were administered PG-12 at baseline and were administered PG-12 or PG-13 based on patient vital status at following timepoints.
First administered post-intervention (T2).
At 1-month post-baseline (T3), a moderate within-subjects effect was observed for depression (Dunlap’s 0.5 ≤ d < 0.8); a small-to-moderate effect was observed for prolonged grief symptoms (Dunlap’s 0.2 ≤ d < 0.5); and small effects were observed for anxiety, experiential avoidance, and posttraumatic stress symptoms (Dunlap’s d ≥ 0.2). At 3-months post-baseline (T4), we found a large effect on prolonged grief symptoms (Dunlap’s d > 0.8) and small intervention effects for depression, anxiety, and experiential avoidance (Dunlap’s d ≥ 0.2).
Patient outcomes were also examined. We found that DNR orders were placed for four out of the nine patients with available data during their indexed ICU stay. For two of these patients, these orders were placed before study enrollment. For the other two patients, these orders were placed 25 and 27 days, respectively, after receiving the EMPOWER intervention. All nine patients were receiving mechanical ventilation. Extubation occurred in four patients. Withdrawal of life-sustaining care did not occur in any of the patients.
Discussion
The overall goal of this study was to develop, refine, and pilot test of a brief manualized psychological intervention, EMPOWER, to determine its preliminary feasibility, acceptability, and promise in improving surrogates’ mental health symptoms and patient outcomes. EMPOWER was designed to be adaptable to the fast-paced, often chaotic, ICU milieu, using ultra-brief, evidence-based interventions (Sperry and Binensztok, 2019) to reduce peritraumatic stress, grief, anxiety, and experiential avoidance. EMPOWER targets surrogates who are anxious and/or closely attached to the patient because these individuals are at greatest risk for developing poor outcomes, such as PTSD and PGD, following the patient’s death or discharge from the ICU (Bryant et al., 2008; Andrews et al., 2009; Prigerson et al., 2009; Gartlehner et al., 2013). Importantly, unlike many interventions developed for grief and trauma, EMPOWER was developed by incorporating both provider and surrogate feedback, improving its acceptability and utility for the uniquely challenging circumstances of the ICU. In Part 1 of the study, we used participant feedback to improve the comprehensibility of EMPOWER’s psychoeducation and exercises by minimizing the use of jargon and reorganizing the order of the content so that it would be more digestible.
We found that recruitment for the Part 2 open trial of EMPOWER was feasible, although there were challenges to enrolling surrogates, with only 23% of those approached consenting. This is understandable given that EMPOWER approaches family surrogates in, perhaps, one of the most stressful times of their lives. We observed that some surrogates expressed interest in the EMPOWER intervention but did not want to complete the assessments and therefore did not consent to the study. Completion of the intervention itself appeared to be highly feasible, with 100% of participants completing all six of the brief modules, exceeding our target. However, only five of the nine participants still participating after T2 completed booster calls. There are many explanations for this, including caregiving demands, patients’ health fluctuations, and coping with acute grief when the patient had died. Completion of the second booster call among all those who were able to complete the first suggests participants may have found the calls helpful. The intervention itself appeared highly acceptable, with surrogates providing high ratings of effectiveness and helpfulness as well as generally positive feedback in the exit interviews.
On average, reductions in psychological symptoms were observed among our small sample of surrogates. Surrogates are often weighed down by anxiety and anticipatory grief over the impending death of the patient while faced with making life-and-death decisions on the patient’s behalf in the potentially traumatic conditions of the ICU. The fact that after just 1.5–2 h of intervention over approximately 1 week, participants reported decreases in acute symptoms, including peritraumatic stress, anxiety, and experiential avoidance, has important implications. Such symptom improvements may not only translate into reducing suffering for surrogates themselves, but they may also help surrogates better engage in and process critical communication with the patient’s ICU care team.
Over time, the impact of applying the coping tools taught through EMPOWER appeared to have been beneficial, as we observed reductions in symptoms of experiential avoidance, prolonged grief, depression, anxiety, and posttraumatic stress symptoms 1-month after the intervention. At 3-months post-baseline, the effect on prolonged grief symptoms increased and gains appeared maintained for depression, anxiety, and experiential avoidance. For the most part, observed effects were small to moderate. However, given the limited amount of time EMPOWER takes to administer and the fact that 60% of participants also became bereaved during the study time period, these preliminary findings are encouraging.
While the small sample size in the present study precluded mediation analyses, our findings that experiential avoidance decreased in parallel with reductions in other psychological outcomes suggest that it may serve as a mechanism of change. By reducing experiential avoidance, surrogates’ ability to tolerate distress and be emotionally activated (Fernandez-Rodriguez et al., 2018) during the ICU stay may increase. This, in turn, may help them to digest medical information they are given, make decisions that are aligned with their and the patient’s values, and allow them to be more present with and emotionally available for the patient, whose time may be limited. Thus, reducing experiential avoidance may assist with improving end-of-life decision-making on behalf of the patient and minimize regrets (Hickman et al., 2012). Furthermore, given that experiential avoidance is an important predictor of psychiatric disorders, including depression, anxiety, prolonged grief, and PTSD (Marx and Sloan, 2005; Spinhoven et al., 2016, 2017; Williams et al., 2019; Serrano-Ibanez et al., 2021), reducing such avoidance may have longer-term psychological benefits.
It should be noted that the goal of EMPOWER is not to eliminate grief, anxiety, and traumatic stress reactions, but rather to help surrogates to respond to these reactions adaptively (e.g., minimizing experiential avoidance) and compassionately, helping to reduce numbing by titrating exposure to difficult feelings whenever possible. It additionally provides a space to do their “due diligence” in reflecting on their and the patient’s values and circumstances, so that they may feel empowered in the decision-making process (Tunzi, 2012).
Study limitations and future directions
This proof-of-concept evaluation has several limitations, including the small sample size, homogeneity with respect to race and ethnicity, and the use of a within-subjects design. The absence of a comparison group, though typical of early pilot work, limits conclusions that can be drawn about observed improvements of symptoms, which may have decreased naturally over time. Further complicating our ability to draw conclusions is the fact that several participants became bereaved, and at varying time points, during the study period; this is a challenge inherent to this type of research but is an important consideration in interpreting the findings. Another weakness of the study was the use of self-report assessments, which can be influenced by differing interpretations of questions and response scales. As we received feedback from participants about unclear assessment items, we removed items and/or selected new measures in preparation for a pilot randomized controlled trial. We thus have partial data in several instances, and our findings should be considered with this limitation in mind.
The next step in developing EMPOWER is conducting a Stage IB feasibility randomized controlled trial to prepare for a larger-scale efficacy trial (Rounsaville et al., 2001). We will focus on strengthening recruitment strategies and supporting completion of booster calls, or eliminating them if we find that they are not wanted or impactful. We also plan on exploring the mediating role of experiential avoidance, including any distinctions between the effects of global vs. momentary experiential avoidance (Levin et al., 2018), in future trials. Although we did not find evidence of EMPOWER impacting patient outcomes, including consenting to DNR orders or withdrawal of life support, in the present trial, given our single-arm design, small sample size, and the diversity of patient circumstances we observed, we will continue to investigate whether the intervention impacts patient care. The identification of facilitators and barriers to future dissemination and implementation of EMPOWER should also be a focus, including how the intervention may integrate into bereavement services (McAdam and Erikson, 2016). Although obstacles to the delivery of an effective mental health intervention in the ICU loom large, the need for such an intervention could not be greater. Our observation of its preliminary feasibility, acceptability, and promise in reducing a range of psychological symptoms suggests that further evaluation is warranted.
Funding
This research was supported by National Cancer Institute (NCI) grant R21CA218313 (Prigerson/Lichtenthal) and American Cancer Society grant 130534-PEP-17-053-01-PCSM. Research efforts were additionally supported by NCI grants R35CA197730 (Prigerson), K07CA172216 (Lichtenthal), P30CA008748 (Thompson), and T32CA009461 (Ostroff).
Footnotes
Conflict of interest
None declared.
For the first seven participants, surrogates were eligible if they had a Partner Dependency Score of > 8 or reported at least a 5 on a 1–10 scale of any of the following emotions, with 1 being “not at all” and 10 being “extremely”: upset, frustrated, angry, stressed, anxious, confused, or worried. For the final three participants, the distress item was changed to a score of >5 on either McGill Quality of Life anxiety question, rated from 0 to 10.
References
- Anderson WG, Arnold RM, Angus DC, et al. (2008) Posttraumatic stress and complicated grief in family members of patients in the intensive care unit. Journal of General Internal Medicine 23(11), 1871–1876. doi: 10.1007/s11606-008-0770-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Andrews B, Brewin CR, Stewart L, et al. (2009) Comparison of immediate-onset and delayed-onset posttraumatic stress disorder in military veterans. Journal of Abnormal Psychology 118(4), 767–777. doi: 10.1037/a0017203 [DOI] [PubMed] [Google Scholar]
- Azoulay E, Pochard F, Kentish-Barnes N, et al. (2005) Risk of post-traumatic stress symptoms in family members of intensive care unit patients. American Journal of Respiratory and Critical Care Medicine 171(9), 987–994. doi: 10.1164/rccm.200409-1295OC [DOI] [PubMed] [Google Scholar]
- Birur B, Moore NC and Davis LL (2016) An evidence-based review of early intervention and prevention of posttraumatic stress disorder. Community Mental Health Journal. doi: 10.1007/s10597-016-0047-x [DOI] [PubMed] [Google Scholar]
- Bishop LS, Ameral VE and Palm Reed KM (2018) The impact of experiential avoidance and event centrality in trauma-related rumination and posttraumatic stress. Behavior Modification 42(6), 815–837. doi: 10.1177/0145445517747287 [DOI] [PubMed] [Google Scholar]
- Boelen PA, de Keijser J, van den Hout MA, et al. (2007) Treatment of complicated grief: A comparison between cognitive-behavioral therapy and supportive counseling. Journal of Consulting and Clinical Psychology 75(2), 277–284. doi: 10.1037/0022-006X.75.2.277 [DOI] [PubMed] [Google Scholar]
- Briere J and Lanktree CB (2013) Integrative Treatment of complex Trauma for Adolescents (ITCT-A): A Guide for the Treatment of Multiply-Traumatized Youth, 2nd ed. Los Angeles, CA: USC Adolescent Trauma Treatment Training Center, National Child Traumatic Stress Network, U.S. Department of Substance Abuse and Mental Health Services Administration. [Google Scholar]
- Brunet A, Weiss DS, Metzler TJ, et al. (2001) The peritraumatic distress inventory: A proposed measure of PTSD criterion A2. The American Journal of Psychiatry 158(9), 1480–1485. doi: 10.1176/appi.ajp.158.9.1480 [DOI] [PubMed] [Google Scholar]
- Bryant RA, Moulds ML and Nixon RV (2003) Cognitive behaviour therapy of acute stress disorder: A four-year follow-up. Behaviour Research and Therapy 41(4), 489–494. [DOI] [PubMed] [Google Scholar]
- Bryant RA, Mastrodomenico J, Felmingham KL, et al. (2008) Treatment of acute stress disorder: A randomized controlled trial. Archives of General Psychiatry 65(6), 659–667. doi: 10.1001/archpsyc.65.6.659 [DOI] [PubMed] [Google Scholar]
- Bryant RA, Kenny L, Joscelyne A, et al. (2014) Treating prolonged grief disorder: A randomized clinical trial. JAMA Psychiatry 71(12), 1332–1339. doi: 10.1001/jamapsychiatry.2014.1600 [DOI] [PubMed] [Google Scholar]
- Bunnell BE, Davidson TM and Ruggiero KJ (2018) The peritraumatic distress inventory: Factor structure and predictive validity in traumatically injured patients admitted through a level I trauma center. Journal of Anxiety Disorders 55, 8–13. doi: 10.1016/j.janxdis.2018.03.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carson SS, Cox CE, Wallenstein S, et al. (2016) Effect of palliative care-Led meetings for families of patients With chronic critical illness: A randomized clinical trial. Jama 316(1), 51–62. doi: 10.1001/jama.2016.8474 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Charmaz K (2004) Premises, principles, and practices in qualitative research: Revisiting the foundations. Qualitative Health Research 14(7), 976–993. doi: 10.1177/1049732304266795 [DOI] [PubMed] [Google Scholar]
- Cohen SR, Mount BM, Strobel MG, et al. (1995) The McGill quality of life questionnaire: A measure of quality of life appropriate for people with advanced disease. A preliminary study of validity and acceptability. Palliative Medicine 9(3), 207–219. doi: 10.1177/026921639500900306 [DOI] [PubMed] [Google Scholar]
- Cox CE, Wysham NG, Walton B, et al. (2015) Development and usability testing of a Web-based decision aid for families of patients receiving prolonged mechanical ventilation. Annals of Intensive Care 5, 6. doi: 10.1186/s13613-015-0045-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cox CE, White DB, Hough CL, et al. (2019) Effects of a personalized Web-based decision Aid for surrogate decision makers of patients With prolonged mechanical ventilation: A randomized clinical trial. Annals of Internal Medicine. doi: 10.7326/M18-2335 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Curtis JR, Back AL, Ford DW, et al. (2013) Effect of communication skills training for residents and nurse practitioners on quality of communication with patients with serious illness: A randomized trial. Jama 310(21), 2271–2281. doi: 10.100l/jama.2013.282081 [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Meyrick J (2003) The Delphi method and health research [journal; peer reviewed journal]. Health Education 103(1). doi: 10.1108/09654280310459112 [DOI] [Google Scholar]
- Derry HM, Lief L, Schenck EJ, et al. (2020) Peritraumatic stress among caregivers of patients in the intensive care unit. Annals of the American Thoracic Society 17(5), 650–654. doi: 10.1513/AnnalsATS.201908-647RL [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dionne-Odom JN, Ejem DB, Wells R, et al. (2020) Effects of a telehealth early palliative care intervention for family caregivers of persons With advanced heart failure: The ENABLE CHF-PC randomized clinical trial. JAMA Network Open 3(4), e202583. doi: 10.1001/jamanetworkopen.2020.2583 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dunlap WP, Cortina JM, Vaslow JB, et al. (1996) Meta-analysis of experiments with matched groups or repeated measures designs [peer reviewed]. Psychological Methods 1(2). doi: 10.1037/1082-989X.1.2.170 [DOI] [Google Scholar]
- Fernandez-Rodriguez C, Paz-Caballero D, Gonzalez-Fernandez S, et al. (2018) Activation vs. experiential avoidance as a transdiagnostic condition of emotional distress: An empirical study. Frontiers in Psychology 9, 1618. doi: 10.3389/fpsyg.2018.01618 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Foa EB, Hembree EA and Rothbaum BO (2007) Prolonged Exposure Therapy for PTSD : Emotional Processing of Traumatic Experiences : Therapist Guide. Oxford University Press. Table of contents available at: http://www.loc.gov/catdir/toc/ecip072/2006032823.html. Publisher description: http://www.loc.gov/catdir/enhancements/fy0725/2006032823-d.html. [Google Scholar]
- Gamez W, Chmielewski M, Kotov R, et al. (2011) Development of a measure of experiential avoidance: The multidimensional experiential avoidance questionnaire. Psychological Assessment 23(3), 692–713. doi: 10.1037/a0023242 [DOI] [PubMed] [Google Scholar]
- Gamez W, Chmielewski M, Kotov R, et al. (2014) The brief experiential avoidance questionnaire: Development and initial validation. Psychological Assessment 26(1), 35–45. doi: 10.1037/a0034473 [DOI] [PubMed] [Google Scholar]
- Garrido MM and Prigerson HG (2014) The end-of-life experience: Modifiable predictors of caregivers’ bereavement adjustment. Cancer 120 (6), 918–925. doi: 10.1002/cncr.28495 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gartlehner G, Forneris CA, Brownley KA, et al. (2013) AHRQ Comparative Effectiveness Reviews. In Interventions for the Prevention of Posttraumatic Stress Disorder (PTSD) in Adults After Exposure to Psychological Trauma. Rockville, MD: Agency for Healthcare Research and Quality. [PubMed] [Google Scholar]
- Glick DR, Motta M, Wiegand DL, et al. (2018) Anticipatory grief and impaired problem solving among surrogate decision makers of critically ill patients: A cross-sectional study. Intensive and Critical Care Nursing 49, 1–5. doi: 10.1016/j.iccn.2018.07.006 [DOI] [PubMed] [Google Scholar]
- Gough K and Hudson P (2009) Psychometric properties of the hospital anxiety and depression scale in family caregivers of palliative care patients. Journal of Pain and Symptom Management 37(5), 797–806. doi: 10.1016/j.jpainsymman.2008.04.012 [DOI] [PubMed] [Google Scholar]
- Greenberg JA, Basapur S, Quinn TV, et al. (2021) Psychological symptoms among surrogates of critically Ill patients during and before the COVID-19 pandemic. Chest. doi: 10.1016/j.chest.2020.12.056 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haydar SA, Strout TD, Bond AG, et al. (2019) Prognostic value of a modified surprise question designed for use in the emergency department setting. Clinical and Experimental Emergency Medicine 6(1), 70–76. doi: 10.15441/ceem.17.293 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hickman RL Jr., Daly BJ and Lee E (2012) Decisional conflict and regret: Consequences of surrogate decision making for the chronically critically ill. Applied Nursing Research 25(4), 271–275. doi: 10.1016/j.apnr.2011.03.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Higgins PC, Garrido MM and Prigerson HG (2015) Factors predicting bereaved caregiver perception of quality of care in the final week of life: Implications for health care providers. Journal of Palliative Medicine 18 (10), 849–857. doi: 10.1089/jpm.2015.29001.hp [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hill CE, Knox S, Thompson BJ, et al. (2005) Consensual qualitative research: An update [journal; peer reviewed journal]. Journal of Counseling Psychology 52(2), 196–205. [Google Scholar]
- Johnson JG, Vanderwerker LC, Bornstein RF, et al. (2006) Development and validation of an instrument for the assessment of dependency among bereaved persons. Journal of Psychopathology and Behavioral Assessment 28(4), 26–641. [Google Scholar]
- Johnson JG, Zhang B, Greer JA, et al. (2007) Parental control, partner dependency, and complicated grief among widowed adults in the community. The Journal of Nervous and Mental Disease 195(1), 26–30. doi: 10.1097/01.nmd.0000252009.45915.b2 [DOI] [PubMed] [Google Scholar]
- Kelly MM, Sido H, Forsyth JP, et al. (2015) Acceptance and commitment therapy smoking cessation treatment for veterans with posttraumatic stress disorder: A pilot study. Journal of Dual Diagnosis 11(1), 50–55. doi: 10.1080/15504263.2014.992201 [DOI] [PubMed] [Google Scholar]
- Kentish-Barnes N, Chaize M, Seegers V, et al. (2015) Complicated grief after death of a relative in the intensive care unit. European Respiratory Journal 45(5), 1341–1352. doi: 10.1183/09031936.00160014 [DOI] [PubMed] [Google Scholar]
- Kroenke K, Spitzer RL and Williams JB (2001) The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine 16(9), 606–613. doi: 10.1046/j.1525-1497.2001.016009606.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lautrette A, Darmon M, Megarbane B, et al. (2007) A communication strategy and brochure for relatives of patients dying in the ICU. New England Journal of Medicine 356(5), 469–478. doi: 10.1056/NEJMoa063446 [DOI] [PubMed] [Google Scholar]
- Levin ME, Krafft J, Pierce B, et al. (2018) When is experiential avoidance harmful in the moment? Examining global experiential avoidance as a moderator. Journal of Behavior Therapy and Experimental Psychiatry 61, 158–163. doi: 10.1016/j.jbtep.2018.07.005 [DOI] [PubMed] [Google Scholar]
- Lichtenthal WG, Catarozoli C, Masterson M, et al. (2019) An open trial of Meaning-centered grief therapy: Rationale and preliminary evaluation. Palliative and Supportive Care 17(1), 2–12. doi: 10.1017/s1478951518000925 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Litz BT, Schorr Y, Delaney E, et al. (2014) A randomized controlled trial of an internet-based therapist-assisted indicated preventive intervention for prolonged grief disorder. Behaviour Research and Therapy 61, 23–34. doi: 10.1016/j.brat.2014.07.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lovell GP, Smith T and Kannis-Dymand L (2015) Surrogate end-of-life care decision makers’ postbereavement grief and guilt responses. Death Studies 39(10), 647–653. doi: 10.1080/07481187.2015.1047062 [DOI] [PubMed] [Google Scholar]
- Mack JW, Weeks JC, Wright AA, et al. (2010) End-of-life discussions, goal attainment, and distress at the end of life: Predictors and outcomes of receipt of care consistent with preferences. Journal of Clinical Oncology 28(7), 1203–1208. doi: 10.1200/JCO.2009.25.4672 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marx BP and Sloan DM (2005) Peritraumatic dissociation and experiential avoidance as predictors of posttraumatic stress symptomatology. Behaviour Research and Therapy 43(5), 569–583. doi: 10.1016/j.brat.2004.04.004 [DOI] [PubMed] [Google Scholar]
- McAdam JL and Erikson A (2016) Bereavement services offered in adult intensive care units in the United States. American Journal of Critical Care 25(2), 110–117. doi: 10.4037/ajcc2016981 [DOI] [PubMed] [Google Scholar]
- McLean C and Follette VM (2016) Acceptance and commitment therapy as a nonpathologizing intervention approach for survivors of trauma. Journal of Trauma & Dissociation 17(2), 138–150. doi: 10.1080/15299732.2016.1103111 [DOI] [PubMed] [Google Scholar]
- Mitchell JT and Everly GS Jr. (1995) The critical incident stress debriefing (CISD) and the prevention of work-related traumatic stress among high risk occupational groups. In Everly GS Jr. & Lating JM (eds.), Plenum Series on Stress and Coping. Psychotraumatology: Key Papers and Core Concepts in Post-Traumatic Stress. New York, NY: Plenum Press, pp. 267–280. [Google Scholar]
- Morse JM (1994) Designing funded qualitative research. In Denzin NK & Lincoln YS (eds.), Handbook of Qualitative Research. Thousand Oaks, CA: Sage Publications, Inc., pp. 220–235. [Google Scholar]
- Neimeyer RA (2012) Techniques of Grief Therapy: Creative Practices for Counseling the Bereaved. New York, NY: Routledge. [Google Scholar]
- Neimeyer RA (2016) Techniques of Grief Therapy: Assessment and Intervention. New York, NY: Routledge. [Google Scholar]
- Nolan MT, Hughes MT, Kub J, et al. (2009) Development and validation of the family decision-making self-efficacy scale. Palliative Support Care 7(3), 315–321. doi: 10.1017/s1478951509990241 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Orsillo SM and Batten SV (2005) Acceptance and commitment therapy in the treatment of posttraumatic stress disorder. Behavior Modification 29(1), 95–129. doi: 10.1177/0145445504270876 [DOI] [PubMed] [Google Scholar]
- Plumb JC, Orsillo SM and Luterek JA (2004) A preliminary test of the role of experiential avoidance in post-event functioning. Journal of Behavior Therapy and Experimental Psychiatry 35(3), 245–257. doi: 10.1016/j.jbtep.2004.04.011 [DOI] [PubMed] [Google Scholar]
- Prigerson HG, Vanderwerker LC and Maciejewski PK (Eds) (2008) A Case for the Inclusion of Prolonged Grief Disorder in DSM-V. In Stroebe MS, Hansson RO, Schut H, & Stroebe W (Eds.), Handbook of bereavement research and practice: Advances in theory and intervention (p. 165–186). Washington, DC: American Psychological Association Press. [Google Scholar]
- Prigerson HG, Horowitz MJ, Jacobs SC, et al. (2009) Prolonged grief disorder: Psychometric validation of criteria proposed for DSM-V and ICD-11. PLoS Medicine 6(8), e1000121. doi: 10.1371/journal.pmed.1000121 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prigerson HG, Viola M, Brewin CR, et al. (2019) Enhancing & Mobilizing the Potential for Wellness & Emotional Resilience (EMPOWER) among surrogate decision-makers of ICU patients: Study protocol for a randomized controlled trial. Trials 20(1), 408. doi: 10.1186/s13063-019-3515-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rodriguez Villar S, Sanchez Casado M, Prigerson HG, et al. (2012) Prolonged grief disorder in the next of kin of adult patients who die during or after admission to intensive care. Chest 141(6), 1635–1636. [DOI] [PubMed] [Google Scholar]
- Rounsaville BJ, Carroll KM and Onken LS (2001) A stage model of behavioral therapies research: Getting started and moving on from stage I. Clinical Psychology: Science and Practice 8, 133–142. [Google Scholar]
- Schenker Y, Crowley-Matoka M, Dohan D, et al. (2012) I don’t want to be the one saying ‘we should just let him die’: Intrapersonal tensions experienced by surrogate decision makers in the ICU. Journal of General Internal Medicine 27(12), 1657–1665. doi: 10.1007/s11606-012-2129-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Serrano-Ibanez ER, Ruiz-Parraga GT, Gomez-Perez L, et al. (2021) The relationship between experiential avoidance and posttraumatic stress symptoms: A moderated mediation model involving dissociation, guilt, and gender. Journal of Trauma & Dissociation, 1–15. doi: 10.1080/15299732.2020.1869647 [DOI] [PubMed] [Google Scholar]
- Siegel MD, Hayes E, Vanderwerker LC, et al. (2008) Psychiatric illness in the next of kin of patients who die in the intensive care unit. Critical Care Medicine 36(6), 1722–1728. doi: 10.1097/CCM.0b013e318174da72 [DOI] [PubMed] [Google Scholar]
- Simons JS and Gaher RM (2005) The distress tolerance scale: Development and validation of a self-report measure. Motivation and Emotion 29, 83–102. [Google Scholar]
- Sperry L and Binensztok V (2019) Ultra-brief Cognitive Behavioral Interventions: A new Practice Model for Mental Health and Integrated Care. New York, NY: Routledge. [Google Scholar]
- Spinhoven P, Drost J, de Rooij M, et al. (2016) Is experiential avoidance a mediating, moderating, independent, overlapping, or proxy risk factor in the onset, relapse and maintenance of depressive disorders? Cognitive Therapy and Research 40, 150–163. doi: 10.1007/s10608-015-9747-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spinhoven P, van Hemert AM and Penninx B (2017) Experiential avoidance and bordering psychological constructs as predictors of the onset, relapse and maintenance of anxiety disorders: One or many? Cognitive Therapy and Research 41(6), 867–880. doi: 10.1007/s10608-017-9856-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spitzer RL, Kroenke K, Williams JB, et al. (2006) A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine 166(10), 1092–1097. doi: 10.1001/archinte.166.10.1092 [DOI] [PubMed] [Google Scholar]
- Tunzi M (2012) A new standard for incapacitated patient decision making: The clinical standard of surrogate empowerment. Journal of Clinical Ethics 23(4), 316–330. [PubMed] [Google Scholar]
- Walser RD and Westrup D (2007) Acceptance and Commitment Therapy for the Treatment of Post-Traumatic Stress Disorder and Trauma-Related Problems: A Practitioner’s Guide to Using Mindfulness and Acceptance Strategies. New Harbinger Publications. Table of contents only available at: http://www.loc.gov/catdir/toc/ecip077/2006102707.html. [Google Scholar]
- Weiss DS and Marmar CR (1996) The impact of event scale - revised. In Wilson J & Keane TM (eds.), Assessing Psychological Trauma and PTSD. New York, NY: Guildford, pp. 399–411. [Google Scholar]
- White DB, Cua SM, Walk R, et al. (2012) Nurse-led intervention to improve surrogate decision making for patients with advanced critical illness. American Journal of Critical Care 21(6), 396–409. doi: 10.4037/ajcc2012223 [DOI] [PMC free article] [PubMed] [Google Scholar]
- White DB, Angus DC, Shields AM, et al. (2018) A randomized trial of a family-support intervention in intensive care units. New England Journal of Medicine 378(25), 2365–2375. doi: 10.1056/NEJMoa1802637 [DOI] [PubMed] [Google Scholar]
- Williams JL, Hardt MM, Henschel AV, et al. (2019) Experiential avoidance moderates the association between motivational sensitivity and prolonged grief but not posttraumatic stress symptoms. Psychiatry Research 273, 336–342. doi: 10.1016/j.psychres.2019.01.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wright AA, Zhang B, Ray A, et al. (2008) Associations between end-of-life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment. Jama 300(14), 1665–1673. doi: 10.1001/jama.300.14.1665 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wright AA, Keating NL, Balboni TA, et al. (2010) Place of death: Correlations with quality of life of patients with cancer and predictors of bereaved caregivers’ mental health. Journal of Clinical Oncology 28(29), 4457–4464. doi: 10.1200/JCO.2009.26.3863 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang B, El-Jawahri A and Prigerson HG (2006) Update on bereavement research: Evidence-based guidelines for the diagnosis and treatment of complicated bereavement. Journal of Palliative Medicine 9(5), 1188–1203. doi: 10.1089/jpm.2006.9.1188 [DOI] [PubMed] [Google Scholar]
- Zigmond AS and Snaith RP (1983) The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica 67(6), 361–370. doi: 10.1111/j.1600-0447.1983.tb09716.x [DOI] [PubMed] [Google Scholar]