Abstract
Introduction
Although as many as 75% of the >2 million annual intensive care unit (ICU) survivors experience symptoms of psychological distress that persist for months to years, few therapies exist that target their symptoms and accommodate their unique needs. In response, we developed LIFT, a mobile app-based mindfulness intervention. LIFT reduced distress symptoms more than either a telephone-based mindfulness program or education control in a pilot randomized clinical trial (LIFT1).
Objective
To describe the methods of a factorial experimental clinical trial (LIFT2) being conducted to aid in the development and implementation of the version of the LIFT intervention that is optimized across domains of effect, feasibility, scalability, and costs.
Methods and analysis
The LIFT2 study is an optimization trial conceptualized as a component of a larger multiphase optimization strategy (MOST) project. The goal of LIFT2 is to use a 2 × 2 × 2 factorial experimental trial involving 152 patients to determine the ideal components of the LIFT mobile mindfulness program for ICU survivors across factors including (1) study introduction by call from a therapist vs. app only, (2) response to persistent or worsening symptoms over time by therapist vs. app only, and (3) high dose vs. low dose. The primary trial outcome is change in depression symptoms 1 month from randomization measured by the PHQ-9 instrument. Secondary outcomes include anxiety, post-traumatic stress disorder, and physical symptoms; measures of feasibility, acceptability, and usability; as well as themes assessed through qualitative analysis of semi-structured interviews with study participants conducted after follow up completion. We will use general linear models to compare outcomes across the main effects and interactions of the factors.
Keywords: Critical illness, Intensive care units, Psychological distress, Depression, Anxiety, Post-traumatic stress disorder, Mindfulness, Multiphase optimization strategy, MOST, Optimization, Factorial experimental trial
Abbreviations: ICU, intensive care unit; MOST, multiphase optimization strategy; PTSD, post-traumatic stress disorder; RCT, randomized clinical trial
Highlights
-
•
Intensive care unit (ICU) survivors experience psychological distress but have few therapies.
-
•
LIFT is a self-guided mobile app-based mindfulness intervention we developed for ICU survivors.
-
•
LIFT2 is a factorial experimental clinical trial using a multiphase optimization strategy (MOST).
-
•
LIFT2 tests the impact of 3 intervention factors on effect, feasibility, scalability, and costs.
1. Introduction
As survival has improved for the 2 million people with cardiorespiratory failure managed annually in US intensive care units (ICUs), it has become apparent that these patients suffer from severe and persistent post-discharge symptoms of psychological distress including depression, anxiety, and post-traumatic stress disorder (PTSD). However, few targeted interventions exist that are relevant to patients' experiences and that accommodate their many physical, social, and financial barriers to personalized care.
Mindfulness is a practice of non-judgmental awareness that can alleviate distress by uncoupling emotional reactions and habitual behavior from unpleasant symptoms, thoughts, and emotions [1,2]. Standard mindfulness training, typically provided face to face in group settings, has proven efficacious in improving psychological distress in various patient populations [3,4]. However, in-person therapy is infeasible for the many ICU survivors with new disabilities, financial distress, and great distance from referral centers [5].
Therefore, we developed a telephone-delivered mindfulness-based training program for ICU survivors called LIFT and found that it was associated with improved symptoms of depression, anxiety, and PTSD in an uncontrolled pilot evaluation [6]. Next, we adapted the LIFT program to a self-directed mobile mindfulness training app to overcome the inconvenience of scheduled weekly telephone sessions, and then compared it to telephone-based mindfulness and an education control in a pilot randomized controlled trial (LIFT1) [7]. This trial provided compelling evidence for the mobile mindfulness app's feasibility, adherence, retention, and clinically meaningful and comparatively greater impact on depression, anxiety, and physical symptoms compared to both telephone-based Lift content as well as a critical illness-themed education control. It also showed how the LIFT program could be improved further by better targeting a population more likely to respond (and less likely to drop out), improving the app's delivery of content through a variety of media formats (video, audio, text, interactive exercises), and automating features to improve user engagement such as individualizing content in response to participant symptoms over time.
Having addressed these gaps, we are now initiating a 2 × 2 × 2 factorial clinical trial (LIFT2) that is conceptualized as the Optimization Phase within the multiphase optimization strategy (MOST) framework. Through this trial, we will optimize mobile mindfulness by assessing three intervention components and their interactions among 152 cardiorespiratory failure survivors with high levels of psychological distress just after hospital discharge. At the conclusion of this trial, we will deliver a mobile mindfulness system fully optimized for usability, efficiency, scalability, and clinical impact that will be off-the-shelf ready for a next-step definitive RCT (LIFT3)—and can serve as a model for distance-based mind and body interventions.
In this manuscript, we describe the factorial clinical trial's design, methods, and planned analyses.
2. Materials and methods
2.1. Study objective
The overall objective of the LIFT2 trial is to optimize the mobile mindfulness training intervention (i.e., LIFT) by identifying which components contribute most meaningfully to feasibility, usability, and clinical impact on symptoms of psychological distress assessed over a 3-month follow up period. Fig. 1 demonstrates an overview of past, current, and proposed future work on the LIFT intervention.
Fig. 1.
Orientation of the LIFT2 trial in a multiphase optimization strategy (MOST) framework.
2.2. Study design
This is a prospective 3-factor factorial experimental trial with 3-month follow up conducted among survivors of cardiorespiratory failure managed in adult intensive care units (ICUs) at three health systems across the United States. The trial uses the MOST methodological framework [8]. Specifically, as part of the optimization phase of MOST, are employing a factorial randomized trial to optimize constraints of feasibility, usability, and impact [9]. In this trial, all participants will receive some version of LIFT; there will be no control comparator. Table 1 and Fig. 2 demonstrate the 8 conditions tested in this 2 × 2 × 2 trial. Data are collected at the time participants return home from the hospital (Time 1 [T1]; also the time of randomization), 1 month post-randomization (Time 2 [T2]), and 3 months post-randomization (Time 3 [T3]).
Table 1.
Intervention factors evaluated in the trial.
| Condition | Dosea | Approach to non-respondersb | Method to initiate interventionc |
|---|---|---|---|
| 1 | High (High) | Therapist (High) | Therapist (High) |
| 2 | High (High) | Therapist (High) | App (Low) |
| 3 | High (High) | App (Low) | Therapist (High) |
| 4 | High (High) | App (Low) | App (Low) |
| 5 | Standard (Low) | Therapist (High) | Therapist (High) |
| 6 | Standard (Low) | Therapist (High) | App (Low) |
| 7 | Standard (Low) | App (Low) | Therapist (High) |
| 8 | Standard (Low) | App (Low) | App (Low) |
Dose quantified as high (twice daily meditation) and standard (once daily meditation).
Approach to participants whose weekly PHQ-9 score is either >20 or higher than prior week's score.
Method to initiation intervention is the initial method of introducing the LIFT mobile app to participants.
Fig. 2.
Study overview and timing of data collection.
2.3. Study sites
This study is being conducted at 3 health systems including Duke University (includes the Duke Medical Center [Clinical and Data Coordinating Center] and Duke Regional Community Hospital) in Durham, NC; the University of Washington / Harborview Medical Center in Seattle; and the University of Colorado in Denver.
2.4. Participant eligibility
We aim to randomize 152 participants to ensure that 120 complete the 1-month follow up. Given their recent critical illness, patients' expected physical health status will initially be moderately poor, though the expectation for recovery will be relatively favorable. Cognition must be intact for participation, however, and will be expected to be normal at the time we approach patients for informed consent.
2.4.1. Inclusion criteria
The inclusion criteria shown in Table 2 are designed to identify adults treated in an ICU for cardiorespiratory failure who are at high risk of having persistent psychological distress after hospital discharge.
Table 2.
Inclusion and exclusion criteria.
| Inclusion criterion | Definition |
|---|---|
| Adult | Age ≥ 18 years |
| Acute cardiorespiratory failure |
Acute respiratory failure, defined as ≥1 of the following:
Acute cardiac / circulatory failure, defined as ≥1 of the following:
|
| ICU setting | Managed in an adult medical, cardiac, trauma, surgical, or neurological ICU for ≥24 h during the time of meeting Inclusion Criteria #2 |
| Cognitive status intact |
|
| Absence of severe and/or persistent mental illness |
|
| English fluency | It is not feasible at this time to deliver LIFT in other languages because of study staff language limitations. Also, many study instruments are not validated in languages other than English. |
| Exclusion criteria, in-hospital | Description/rationale |
|---|---|
| Hospitalized within the preceding 3 months with life-threatening illness or injury. Patients may be enrolled into the study if they had a hospitalization within the preceding 3 months that is determined to be non-serious admissions that are non-life threatening and/or potentially impacting patient's well-being long-term or likely to precipitate additional future admissions. Examples of non-serious, non-life-threatening hospitalizations could be, but may not be limited to, admission for a bronchoscopy, admission for deep vein thrombosis, or admission to ED resulting in overnight stay for cardiac work-up). |
These poor prognosis phenotype factors identify those with unstable medical or psychological illnesses that are expected to result in rapid readmission, death, or care in a facility for weeks to months that would disrupt both intervention delivery and outcomes ascertainment. As such, these factors would be a distraction for participants to comply with the intervention. We believe that different interventions than LIFT would likely be needed to better assist these patients. |
| Complex medical care expected soon after discharge (e.g., planned surgeries, transplantation evaluation, extensive travel needs for hemodialysis, disruptive chemotherapy/radiation regimen) | |
| Admitted from a location other than home (e.g., nursing home, long-term acute care facility, inpatient rehabilitation facility) | |
| Unable to complete study procedures as determined by staff | |
| Admitted from a location other than home (e.g., nursing home, long-term acute care facility, inpatient rehabilitation facility) | |
|
Lack of reliable smartphone with cellular data plan or Wi-Fi |
Without smartphone access, participants cannot access the intervention, complete surveys required to gauge symptoms, and other activities. In LIFT1 using this criterion and identical inclusion criteria, only 6% of otherwise eligible participants were excluded based on this factor. |
| Exclusion criteria, at time of T1 Data Collection (i.e., at the time of arrival home) | Rationale |
|---|---|
| Low baseline psychological distress symptoms, defined as a PHQ-9 < 5 | The rationale for excluding patients with low baseline psychological distress is that they have little ability to demonstrate responsiveness to the intervention using the study outcomes measures. |
| Failure to randomize within 2 months post-discharge | This criterion serves to exclude those who could confound results by initiating the intervention during a different time frame than other participants. LIFT1 showed that the longer it took to randomize participants, the more likely they were to dropout. |
2.4.2. Exclusion criteria
The criteria shown in Table 2 are designed to exclude those likely to drop out or display non-adherence due to medical illness that is unstable or likely to worsen, a high likelihood of needing multiple disruptive post-discharge medical procedures, or a non-supportive social situation. The majority of these exclusion criteria were applied successfully in the LIFT1 trial as well as a coping skills training intervention trial [7,10]. Revised criteria have been informed by these same trials as well as data defining ICU survivor poor outcome phenotypes more likely to be non-adherent or drop out due to unstable medical illness [11].
2.5. Recruitment
This study involves a two-step screening strategy:
Step 1—hospital-based screening to identify cardiorespiratory failure survivors
Clinical research coordinators at each site screen adult medical, cardiac, surgical / trauma ICUs daily for potentially eligible patients (i.e., those who meet the definition of ‘cardiorespiratory failure’ in Table 2) using an EHR-based algorithm. Patients are approached for informed consent in the hospital around the time of planned transfer from the ICU to the hospital ward to increase the likelihood they have recovered sufficiently to possess decisional capacity. Prospective participants are shown a 2-min study informational video (available at lift.duke.edu) at the time of the approach as well. Given the current concerns of coronavirus transmission, potential participants are often approached by distance as well using a combination of calls, emails, and texts. After obtaining informed consent, a research coordinator assists each participant in downloading the LIFT mobile app from the relevant app store onto their device and establishing a login. This process creates an individual user profile in the app platform.
Step 2—home-based screening at T1 to identify and then randomize those with elevated distress
After obtaining informed consent, site coordinators monitor the participant's hospital course and update the app study staff dashboard with the date of discharge. Two days later, the app platform sends an alert within the Lift app that prompts the participant to complete the PHQ-9, GAD-7, and PTSS scales within the app. The coordinator monitors the participant's progress in completing the scales; failure to complete the initial survey within a week of discharge, will prompt the coordinator to call the participant for the screening interview. Based on real-time within-app survey scoring, patients with elevated symptoms of psychological distress (i.e., PHQ-9 score > 5) are auto-randomized to one of 8 intervention conditions described below and shown in Fig. 2. The ~25–30% who lack elevated distress are not randomized, and their session will end with an explanatory message displayed in the app. After three 48-h cycles of auto-prompts without randomization or survey completion post-randomization, the coordinator calls the participant for the screening interview.
2.6. Experimental condition allocation
The combination of the three factors each at two levels results in 8 experimental conditions. Allocation of the patients into one of the 8 experimental conditions (152 patients randomized with 19 in each condition) occurs at the time of T1 data collection completion (i.e., the first data collection after arrival home from the hospital). To ensure balance between the conditions on these important confounders, allocation is stratified by site (Duke, Colorado, Washington), medical vs. surgical ICU, depression symptom score at T1 (PHQ-9 < 15, ≥15), physical symptom score at T1 (PHQ-10 < 10, ≥10), and age (<50, ≥50). Because of the large number of stratification variables relative to the experimental condition size, treatment assignment is conducted via a dynamic allocation minimization method [12]. This algorithm is programmed directly within the LIFT mobile app platform; details of the algorithm are in Appendix A. Because of the automated allocation procedure and the fact that our data system gives restricted views based on user login password, no study staff is able to ascertain treatment assignment in the data system except for the study manager. Therefore, all other study staff remain masked to patients' experimental conditions throughout.
2.7. Duration of subject participation and study
It requires 3 months for participants to complete the entire study from the time of randomization, including the intervention and all the follow up surveys. Based on our past similar studies, we anticipate a time period of approximately 2 weeks between the time of in-hospital informed consent (generally performed just after transfer from ICU to the ward) and randomization. During this period, the remaining medical issues are managed in the hospital and the study coordinators will intermittently check on each patient's progress both in-person and via the medical record, being careful to note if there is a change of plans and the patient requires transfer to a care facility (in which case they become ineligible).
We estimate that from the time the factorial experiment trial opens to enrollment, it will require 40–45 months to complete data collection (~36 months for cumulative enrollment with 4–5 months to complete all long-term follow up; this time does not include start up) and 4–6 months to perform all final data analyses.
2.8. Retention plan
Having performed 2 multi-center RCTs testing psychobehavioral interventions for ICU survivors that included long follow-up periods, we have fine-tuned strategies to optimize adherence and retention. First, the stringent eligibility criteria are designed to exclude those most likely to drop out due to medical illness, substance abuse, and other issues. Second, the LIFT mobile app itself was designed to be a convenient and flexible self-management tool that allows participants to complete all study outcomes surveys. Third, the study manager will prepare weekly reports using LIFT app analytics that identify randomized participants who are not logging into the LIFT app (or doing so infrequently). This will allow proactively delivered reminder emails/texts, followed by telephone calls if necessary, to encourage more consistent participation with LIFT in a timely manner. Fourth, we compensate participants for their effort each time they complete a study procedure. Last, to we will attempt to attenuate loss to follow up using the guidance of recent guidelines from clinical research experts [13].
2.9. Intervention
LIFT intervention and core content
LIFT is initiated early after discharge to maximally attenuate the overall trajectory of distress [5,14]. Those randomized to the intervention will receive a separate alert linking them to one of 8 study webpages that explains the study arm to which they belong. Thereafter, the LIFT app guides the user through each week's activities using text and visual prompts as relevant to the factor-based condition to which they are randomized. At the end of each week, the LIFT app prompts completion of the PHQ-9 within its user interface; the app platform will generate real-time alerts to PIs prompting calls to patients who endorse the PHQ-9's suicidal ideation item plus a branching logic item about intent.
LIFT content for all factor conditions includes 4 weekly app-based sessions as tested in the original LIFT study [7]. Each session is composed of three parts: 1. Video presentation describing rationale (3–5 min.), 2. Audio guided meditation (8–10 min.), and 3. Other relevant in-app exercises (e.g., tips to help apply mindfulness to daily life; 1–3 min.). Table 3 and eFig. 1 (eFigs. and eTables are found in Appendix B) show the didactic elements of LIFT by week and how they map to distress triggers in our conceptual model. Appendix C demonstrates detailed elements of the LIFT mobile app and its content.
LIFT factors—description, rationale, operationalization
Table 3.
LIFT skills presented by intervention week.
| Timeframe | Description of skills taught | Relevant app content |
|---|---|---|
| Week 1 | Subjects are provided with a rationale for mindfulness and learn to use awareness of breathing, a core meditation technique that begins to cultivate skills of mindful, non-reactive observation. | 1. Weekly animated video introducing topic 2. Weekly audio guided meditation by male or female voice 3. Other unique text, graphics, and video supplemental content |
| Week 2 | Introduces awareness of body systems that are working well or less well as a way to continue to cultivate skills of observing, describing, and non-judgmental attention. | |
| Week 3 | Participants practice awareness of emotions and mindful acceptance, which is designed to acknowledge difficult emotions and cultivate feelings of kindness and compassion towards oneself and others. | |
| Week 4 | Introduces mindfulness in everyday life, using awareness of the present moment as a way to focus non-judging attention on the body, particularly at the time of sleep. |
This trial will evaluate three LIFT factors, chosen based on patient feedback and staff experience from the LIFT study, that represent potentially important tradeoffs in convenience, personalization, effort, cost, scalability, and possibly effect (Fig. 3 , eFig. 2).
-
•
Factor 1—Method of intervention initiation
Fig. 3.
Three intervention factors evaluated in the trial; next page.
We will compare therapist-based initiation of the LIFT program to app-based initiation. The therapist-based approach will follow a specific protocol: Following randomization, the therapist will call the patient to explain the rationale for LIFT, discuss the study timelines and milestones, lead the participant through an awareness of breathing exercise, and answer all questions (total time ~ 15–30 min). Patients randomized to the app-based approach will receive similar content through a short explanatory video that explains the rationale for the study, a quick ‘how to’ overview of the app and study, and a review of key LIFT elements likely to enhance success. The app approach is initiated by an email or text (per participant preference) with links to study materials and the LIFT website (lift.duke.edu). The method to initiate LIFT is important to study because app-based automation is more convenient, cheaper, and efficient at reducing startup delays than scheduling a therapist call—a factor associated with dropout in other psychosocial interventions delivered to ICU survivors [10]. However, some LIFT1 patients felt the ability to personalize an initial guided exercise and to ask questions about using the app were valuable. Altogether, understanding the comparative and combined effects of these LIFT factors is a critical step in building an intervention optimized for a successful RCT.
-
•
Factor 2—Dose
We will compare standard dose vs. high-dose LIFT. Standard-dose LIFT is similar to the 4-week program tested in the LIFT pilot RCT, with the expectation that participants listen to one guided meditation per day. High-dose LIFT includes the expectation of two mindfulness sessions a day. The rationale for testing the dose factor is that a standard dose was convenient and effective in LIFT1, though more practice time was strongly correlated with effect. Although a higher dose would provide greater practice time and recapitulate the dose used in recent successful mindfulness trials including the initial uncontrolled LIFT pilot [6,15,16], it may be less convenient and lead to non-adherence.
-
•
Factor 3—Response to symptoms
We will compare a therapist-based approach to an app-based approach to those with persistent or worsening symptoms, defined as a participant who each week has either a PHQ-9 > 20 or an increase in PHQ-9 > 5 units compared to the prior week. The therapist-based approach involves contacting the non-responder patient via their preferred method of communication (email, text, phone) to arrange a telephone call. In the 15–30-min call, a protocol similar to that tested in each therapist-delivered session in the LIFT study's telephone-based mindfulness arm will be followed: the rationale for call is given, patient identifies current stressors, and the therapist explains a rationale for how mindfulness could address the stressor-associated distress. At the conclusion of the call, the therapist uses her judgement regarding the need for further attention for severe symptoms per our Distress Management Protocol. All therapist calls (as well as their date, time, length, and key content) are logged into the LIFT study staff platform for subsequent export to a study REDCap database. The app-based approach to non-responders uses the app's logic to display hovering messages and notifications within the app that may be applicable to the user. Depending on whether emotional or somatic depression symptoms are dominating the PHQ-9 score for the individual, a unique video is shown within the app that features the study interventionists leading a brief exercise in which the participant is coached by the interventionist in the application of mindfulness for the symptoms the participant has endorsed. The app-based approach to non-responders has 8 unique videos, 2 for each week (i.e., one tailored to emotional symptoms, one tailored to somatic symptoms). We believe the stepped approach to non-responders (i.e., persistent or increasing PHQ-9 score from week to week) is the most exciting opportunity to enhance LIFT's impact. A LIFT app-based approach guiding users to symptom-relevant content using sophisticated algorithms applied to patient-reported data is a highly scalable way to automate precision medicine with dynamic engagement. Yet while therapist input is time-intensive, this added personalization may yield a greater impact than an app-only approach.
2.10. Outcomes measures
Survey-based data collection occurs three times as shown in Table 4 : at T1 (week of arrival home; pre-randomization), T2 (1 month post-randomization), and T3 (3 months post-randomization). We allow T2 data collection to be completed up to 6 weeks post-randomization and T3 up to 4 months post-randomization if absolutely necessary, though all efforts are made to obtain data per the timeline. The default strategy for data collection is through the LIFT mobile app itself, which is linked to the secured cloud-based study data system. Study staff blinded to experimental condition will conduct a telephone interview for those participants who are non-compliant with the LIFT mobile app-assisted surveys (~5% in our experience).
Table 4.
Trial outcomes and data collected.
| Optimization outcomes | In hospital | T1a | T2a | T3a | Other |
|---|---|---|---|---|---|
| Primary outcome | |||||
| Depression (PHQ-9)b | x | x | x | ||
| Secondary outcomes | |||||
| Acceptability & usability: CSQ (target mean ≥ 10), SUS (target mean ≥ 85) | x | x | |||
| Feasibility: Target rates of consent (≥70%), eligibility (≥70% of screen positive), randomization (≥80% of eligible), adherence (≥75% of all procedures), retention (≥75%), therapist calls required (<3) | x | ||||
| Psychological distress symptoms: Anxiety (GAD-7), PTSD (PTSS) | x | x | x | ||
| Physical symptoms: PHQ-10 | x | x | x | ||
| Quality of life: visual analog scale | x | x | x | ||
| Other measures | |||||
| Mindfulness: Mindful Attention Awareness Scale (MAAS) | x | x | x | ||
| Sociodemographics: Age, gender, race, ethnicity, employment, insurance, education, marital status, psychiatric therapies, health literacy, social support, financial distress | x | ||||
| Clinical characteristics: Medical comorbidities, illness severity, delirium during ICU stay, ICU diagnosis, ICU service, duration of ventilation, length of stay | x | ||||
| Patient post-discharge factors: Functional status, use of psychiatric therapies, readmissions | x | x | x | ||
| Intervention adherence web analytics data: Number of LIFT sessions viewed, total time viewing materials, intervention elements utilized most (videos, audio), symptoms survey completion, number of therapist / staff calls required | Web analytics | ||||
| Semi-structured interview: to determine user experiences with the intervention. | X | ||||
T1 (pre-randomization / baseline), T2 (1 mo. post-randomization), T3 (3 mo. post-randomization).
Weekly also. The primary study outcome.
2.10.1. Primary outcome
The Patient Health Questionnaire-9 (PHQ-9) assessed at T2 is the primary outcome of the trial. It is a 9-item depression scale (range 0–27; scores ≥10 are elevated) [[17], [18], [19]] that is short and highly responsive to psychosocial interventions [20].
2.10.2. Secondary outcomes
We also measure psychological distress using the Generalized Anxiety Disorder-7 (GAD-7) and the Post-Traumatic Stress Syndrome inventory (PTSS)—scales used successfully in the LIFT pilot trial. The 7-item GAD (range 0 to 21; scores ≥7 are elevated) has response choices that mirror the PHQ-9 [21]. The PTSS is a 10-item post-traumatic stress disorder (PTSD) symptom scale (range 10–70; ≥20 is notably elevated) used frequently to assess ICU-related traumas by anchoring memory recall to hospitalization [22]. It has excellent reliability, responsiveness, and is highly specific and sensitive compared to DSM-IV criteria [23]. Quality of life is assessed with a 100-point visual analog scale used successfully in numerous ICU survivor studies [24]. Distress associated with physical symptoms is measured using a 10-item survey adapted from the PHQ-15 (range 0–30; higher scores denote greater distress) by collapsing all pain-themed items into a single item [25].
Feasibility is evaluated by comparing observed to target rates of consent (target: 75%), completion of weekly surveys (target: 75%), 3-month retention (target: 70%), and number of therapist calls (target: <3 per participant). We will use app analytics to quantify participants' LIFT mobile app adherence (e.g., frequency and duration of use). Acceptability is measured with the Client Satisfaction Questionnaire (CSQ; target mean ≥ 10) [26] and by analysis of semi-structured interviews conducted 3 months post-randomization. Usability is assessed with the industry standard Systems Usability Scale (SUS) [27].
2.11. Data collection and management
All non-clinical data entry is done by participants via the LIFT mobile app as prompted by alerts within the app. Coordinators abstract medical charts for hospital-based data (e.g., illness severity, ICU and hospital length of stay, diagnosis), entering data directly into the digital data system via password-protected linkage. All clinical values and measurements is abstracted from site EHR systems and derived from processes of normal hospital (and ICU) care; no post-discharge laboratory or clinical testing will be done. Study staff complete electronic case report forms securely integrated within the REDCap data system. Using tested password-based customization strategies, the LIFT platform allows each site's study team to view their site's own patient-level data including experimental condition. Only the study manager is able to view all patient-level data and experimental conditions. We are using a parallel study operations workflow tracking application to record participant contacts survey completion, and adverse events. Study personnel utilize these data systems to create scheduled reports on the trial's conduct (e.g., study milestones) to enhance the study's quality. We monitor the quality and consistency of data in a number of ways. Monthly data cleaning is done by the study manager and statistical team using customized reports that identify missing, outlier, or nonsensical data to allow correction.
2.12. Human subjects and regulatory oversight
Our study includes standards such as strict PI oversight, a Distress Management Protocol used successfully in the LIFT study, safety monitoring by an independent DSMB and a central IRB, and distress monitoring within the LIFT app itself. We do not enroll from vulnerable populations.
This study includes redundant technological and human processes designed to protect the safety of participants. Each week the LIFT app uses a series of messages as needed (hovering box on screen, email with link, text with link—all strategies we have used successfully) to prompt the user to complete the PHQ-9 survey within the app interface. The PHQ-9 includes a single item addressing suicidality, to which we added branching logic about intent and plan for clarity (see Appendix C section ‘LIFT2 Popup Messages & Logic Statements‘for details). By virtue of the LIFT mobile app's integration with the study data system, real-time alerts will be sent to the PIs and the study manager to notify them of the presence of two situations representing extreme distress that will prompt activation of either our Distress Management Protocol or the Suicidal Ideation Protocol—each of which involves immediate contact from study staff:
-
•
Endorsement of both suicidal ideation (a response other than ‘none’) via the PHQ-9's relevant item as well as an active plan for self-harm based on branching logic item prompted by a ‘positive’ PHQ-9 response (action: site PI calls the participant within 24 h); note only 9 such calls were prompted over 15 months in the LIFT1 trial.
-
•
Participant requests a call for severe symptoms or unmanageable distress via the app, email, text, or phone call (action: therapist will call participant within 48 h; content of call will be tailored to participant's stressors though will emphasize selected content within the LIFT app)
Based on an internal algorithm, the LIFT app displays a message to the participant after entering the survey that they should expect a call from study staff to check in on their progress (a benign message worded to minimize concern).
2.13. Statistical analysis
The main goal of our intention-to-treat analyses is to estimate main effects and interactions of combined experimental conditions to be able to determine which LIFT use case is best. That is, would LIFT impact be greater by accepting the “high” level of a factor instead of the simpler default “low” level of the factor (Table 1). Our overall analytic approach will be guided by frameworks presented by Collins and Collins & Kugler [28,29]. To understand general patterns in the data, we will first calculate raw means, medians, and measures of variability at each time point for the primary and secondary outcomes. These will be grouped by the main effect of each factor (e.g. standard vs high-dose), collapsed over the other factors. We will also examine these descriptive statistics by groups as defined by the two-way and three-way interactions of the factors. More details on the statistical analysis plan and power calculations are shown in Appendix D.
A constrained longitudinal general linear model with unstructured covariance to take into account repeated measures on individuals over time will be used to estimate changes in the primary and secondary outcomes from T1 to T2 and from T1 to T3 [30]. Often for trial analyses, intervention group and time are dummy coded indicator variables (i.e., levels 0 and 1) in model specification. Instead, given our factorial design, the main effects and interactions will be represented with effect coding (i.e., levels −1 and 1). In the scenario of balanced sample sizes across the factors, effect coding results in a model with uncorrelated coefficients.
Using the estimated model coefficients, we will first determine if any of the main effects indicate improvement of at least 2 points on the PHQ-9 at T2. Candidate components not reaching these benchmarks will be set to the “low” level of the component. We will then carefully examine the interactions, starting with those that include the largest main effect factor. Estimated means and plots will be used to explore the impact of the interactions and whether they are “synergistic” or “antagonistic.” The final “screened in” set of combinations (i.e., main effects and synergistic interactions indicating improvement of at least 2 points on the PHQ-9) will provide evidence of possible optimized intervention components.
As a next step in the decision-making process, we will examine the secondary outcomes and the sustained intervention effects at T3, potentially reconsidering decisions made in the previous step. As an additional part of this step of the decision-making process, we will examine feasibility and adherence metrics for all components, as well as open-ended study participant study staff feedback. We will also consider the timing of participant randomization relevant to the COVID pandemic, as well as whether participants were admitted with COVID-related illnesses.
We recognize that the experience of study participants and study staff alike may be valuable considerations when determining the optimized intervention case [31]. Therefore we will use a stratified purposive design to sample 75 participants (~2 / mo.) across sites, a number sufficient for theme saturation [32], at the time of T3 (3 months post-randomization). These 30-min semi-structured one-on-one telephone interviews conducted by study staff will explore app access, use, and satisfaction with content [33,34]. Theoretical sampling will ensure sufficient variability in characteristics that may influence experiences, stratifying cases by response (high vs. low), app use (high vs. low), demographics (age, gender), baseline distress (moderate vs. high), and factor group. We will use modified grounded theory methods [35,36] to inductively and iteratively develop frameworks to describe patients' experiences with the LIFT2 intervention [[37], [38], [39]]. These qualitative data may be particularly helpful in understanding important negative or positive qualities of intervention factors not otherwise captured by surveys. They will also be useful in identifying user experience issues that could prove to be barriers to future feasibility of certain intervention approaches.
2.14. Sample size and power considerations
We calculated power for the test of a main effect or factor interaction in a constrained longitudinal general linear model with unstructured covariance matrix via simulation. Based on LIFT pilot data, the baseline standard deviation of PHQ-9 was assumed to be 5.3 and the covariance between time points ranged from 3.9 to 11.5 (eTable 1). We examined a range of sample sizes at T2, from 120 to 200 participants. 500 simulated datasets were simulated under the alternative model, with power calculated as the proportion of times the estimated coefficient was found to be statistically significant at p < 0.05. Results indicated that with 120 total patients at T2 (15 per experimental condition; 152 total at T1 assuming 20% dropout by T2), we will have ~89% power to detect a factor main effect or factor interaction effect of 2 units on the PHQ-9 scale (eTable 2).
3. Results
Thus far, we have enrolled 37 participants in 5 months in the factorial trial (registered at: NCT04038567). Lessons learned to date have included balancing eligibility factors with individual sites' unique patient population characteristics and practice patterns (e.g., removing the exclusion for discharge to nursing home given common practice of brief post-discharge nursing home stays in Colorado); standard challenges deploying mobile apps to a population that is diverse in age, geography, and technological confidence; and the completely new challenges of attempting to conduct clinical research during a pandemic in which direct patient contact is impossible due to infection control concerns.
4. Discussion
4.1. The LIFT program fills an important clinical care gap
For years, thought leaders have stressed the need to improve post-discharge outcomes for ICU survivors ‘beyond 28-day mortality,’ a time when patients often feel forgotten [[40], [41], [42]]. Prior to the LIFT1 pilot trials, there were only a handful of trials that targeted patients' distress—none of which had positive results. The LIFT mobile mindfulness program has evidence of impact, fills a treatment gap, addresses research priorities in distress symptoms and self-management, and can provide a model for the scalable web-based delivery of mind-body interventions. It also represents a paradigmatic shift from hospital-based, mortality-focused interventions to home-based, patient-centered self-management.
The LIFT program's key innovation is its real-time personalization of therapy as a component of self-management [43,44]. LIFT prompts patient self-report of symptoms within the app itself, translates symptom severity and trajectory into risk profiles, and then can automatically step care up or down—all in weekly cycles [45]. This approach contrasts with less efficient standard protocols in which all participants receive telephone calls or clinic visits regardless of symptom status, likely worsening retention. Because LIFT can be disseminated through the web and can automate every step from distress screening to long-term follow-up, it is ideal for a low-cost pragmatic trial. If later found to be efficacious, health systems could implement LIFT via the web for their thousands of annual ICU survivors. Such an automated, symptom-responsive, population-scalable approach that could also be personalized and self-managed would represent an evolution in the delivery of mind-body therapy.
4.2. Key knowledge gap relevant to LIFT—and how this trial will address it
There is also a key knowledge gap for the LIFT program—just how much human contact, if any, is required. The LIFT pilot RCT demonstrated that the clinical effect on depression, anxiety, and physical symptoms of the app-delivered intervention was more powerful than the therapist-delivered version [7]. However, the therapist-delivered version had slightly better adherence and retention. Furthermore, participants reported that they particularly enjoyed speaking with the study interventionist. These observations underscore a debate that has existed for years unresolved about just what exactly constitutes the ‘ideal contact’ between patient and clinician and what is a sufficient minimal and optimal dose of therapy [46]. Beyond clinical impact, clinicians and researchers have concerns about scalability, feasibility, and cost—all of which are moderated by the amount of study staff involvement in the delivery and oversight of the intervention.
For these reasons the optimization phase of the MOST methodology is ideal. MOST will use engineering principles and randomized experimentation to determine which factors of LIFT, a complex intervention, optimize constraints of clinical impact, acceptability, and feasibility. As such, this trial will determine which LIFT build is most sustainable, streamlined, and efficient for a future RCT. Factorial experiments are ideal because they require far fewer participants than would a standard RCT with multiple arms [47], yet are able to provide a substantial amount of information on individual intervention components.
4.3. Limitations and alternative approaches
First, while we have considered hospital-based interventions, no in-hospital intervention has improved depression, and ICU patients' illnesses and delirium would make LIFT infeasible. Second, while we recognize that some participants may have psychiatric distress symptoms that precede their hospitalization, our RCT experience demonstrates that this population is just as likely to respond to therapy. However, those with severe psychiatric illness (e.g., psychosis) will be excluded. Third, we will use the PHQ-9 and the PTSS instead of the Hospital Anxiety and Depression Scale (HADS) and the revised Impact of Events Scale (IES-R) as recommended by a recent Delphi consensus of critical care researchers [48]. However, the PTSS is also commonly used among ICU patients [49] and past participant feedback has consistently indicated that that the PHQ-9 is easier to understand than the longer HADS. The PHQ-9 and GAD-7 also share an identical response structure, which improves usability for those completing surveys on mobile devices. Last, we considered other designs such as stepped-wedge or cluster RCTs, though these designs were less advantageous because of our post-discharge focus and the absence of other care processes or contamination risks. An adaptive trial design was also considered, though the LIFT intervention itself is capable of auto-stepped care that adapts to symptom trajectories.
4.4. Conducting clinical research in a pandemic
Currently acute infection with the severe acute respiratory syndrome novel coronavirus 2 which leads to coronavirus disease 2019 (COVID-19) is causing the largest pandemic of pneumonia, a key LIFT trial inclusion criterion, in over 100 years [50,51]. It is expected that COVID-19 infection will likely place patients at even higher risk of distress than other forms of cardiorespiratory illness given the global state of emergency and economic stress [52,53]. The COVID-19 pandemic represents a unique threat to patient-centered care given new norms of ‘social distancing,’ limited healthcare resources that serve as barriers to distress assessment and timely treatment, and economic devastation of those impacted by it [49,54,55]. Additionally, most research institutions have banned study staff from conducting clinical research that includes direct patient contact. These barriers require a novel approach that we believe can be effectively provided by LIFT. LIFT's ‘touchless deployment’ allows automated screening, consenting, intervention activation, and data collection without direct patient contact—critical for successful enrollment of patients with and without COVID in this trial. Additionally, LIFT is a self-guided mobile app that works on any device, giving it the flexibility and scalability required in a pandemic. That said, refocusing our teams' focus on conducting clinical research that begins in a hospital setting presents numerous logistical, regulatory, and methodological challenges.
4.5. Other potential implementation challenges and how to address them
There may be other challenges as well. Should technological challenges arise, our past experience has provided numerous lessons learned about how to develop creative, cost-conscious solutions with our app programming consultants. We recognize that patients will occasionally have questions about the app or surveys, though study staff solved these within 24 h by email or phone in LIFT. LIFT's web app build allows use on any operating system and any digital device via cellular or Wi-Fi or internet connections. This approach is highly accessible, as only 6% of otherwise eligible patients were excluded from LIFT1 because of no smartphone or computer [7].
5. Conclusions
We developed a self-directed mobile mindfulness training mobile app called LIFT to meet the unique needs of patients who are recovering from serious cardiorespiratory illness. We are now conducting a 2 × 2 × 2 factorial clinical trial that is conceptualized as the Optimization Phase within the multiphase optimization strategy (MOST) framework in which we will assess three intervention components and their interactions with the goal of optimizing LIFT across outcomes of usability, efficiency, scalability, and clinical impact. At the conclusion of this factorial trial, LIFT will be off-the-shelf ready for a next-step definitive RCT that can serve as a model for distance-based mind and body interventions.
The following are the supplementary data related to this article.
Informational video for prospective participants in the trial.
Supplementary data, mobile app details, and statistical plan.
Funding
This work was supported by the National Institutes of Health (grant numbers R34 AT008819 and U01 AT009974). The funder had no involvement in study design; in the collection, analysis and interpretation of data; in the writing of the report; and in the decision to submit the article for publication.
CRediT statement
Conceptualization: CEC, LP, JG, TG, CH, MM.
Methodology: MKO, JAG, CEC, CH, MM.
Formal analysis: MKO, JAG.
Investigation: CEC, CH, MM, MKO, LP, JAG, AF, AU, HM, BM, JM.
Data Curation: MKO, JAG, CEC, CH, MM.
Writing - Original Draft: CEC, CH, MM, MKO, LP, JG, JAG, AF, AU, TG, HM, BM, JM.
Writing - Review & Editing: CEC, CH, MM, MKO, LP, JG, JAG, AF, TG, AU, HM, BM, JM.
Project administration: CEC, AF.
Funding acquisition: CEC, CH, MM, MKO, LP, JAG.
Suggested peer reviewers
Ann Long, University of Washington.
Erin Kross, University of Washington.
Ann Parker, Johns Hopkins University.
Ramona Hopkins, University of Utah.
Samuel Brown, University of Utah / Intermountain Health.
Acknowledgements
Andrew Corcoran (Duke Health Technology Systems); Edward Barber and Jennifer McLaughlin (Pattern Health); Derek Jones, MDiv; Wen Reagan, PhD.
References
- 1.Kabat-Zinn J. Delta Publishing; New York, NY: 1990. Full Catastrophe Living. [Google Scholar]
- 2.Ludwig D.S., Kabat-Zinn J. Mindfulness in medicine. JAMA. 2008;300:1350–1352. doi: 10.1001/jama.300.11.1350. [DOI] [PubMed] [Google Scholar]
- 3.Fjorback L.O., Arendt M., Ornbol E., Fink P., Walach H. Mindfulness-based stress reduction and mindfulness-based cognitive therapy: a systematic review of randomized controlled trials. Acta Psychiatr. Scand. 2011;124:102–119. doi: 10.1111/j.1600-0447.2011.01704.x. [DOI] [PubMed] [Google Scholar]
- 4.Gotink R.A., Chu P., Busschbach J.J., Benson H., Fricchione G.L., Hunink M.G. Standardised mindfulness-based interventions in healthcare: an overview of systematic reviews and meta-analyses of RCTs. PLoS One. 2015;10 doi: 10.1371/journal.pone.0124344. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
- 5.Cox C.E., Docherty S.L., Brandon D.H., Whaley C., Attix D.K., Clay A.S., Dore D.V., Hough C.L., White D.B., Tulsky J.A. Surviving critical illness: acute respiratory distress syndrome as experienced by patients and their caregivers. Crit. Care Med. 2009;37:2702–2708. doi: 10.1097/CCM.0b013e3181b6f64a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Cox C.E., Porter L.S., Buck P.J., Hoffa M., Jones D., Walton B., Hough C.L., Greeson J.M. Development and preliminary evaluation of a telephone-based mindfulness training intervention for survivors of critical illness. Ann. Am. Thor. Soc. 2014;11:173–181. doi: 10.1513/AnnalsATS.201308-283OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Cox C.E., Hough C.L., Jones D.M., Ungar A., Reagan W., Key M.D., Gremore T., Olsen M.K., Sanders L., Greeson J.M., Porter L.S. Effects of mindfulness training programmes delivered by a self-directed mobile app and by telephone compared with an education programme for survivors of critical illness: a pilot randomised clinical trial. Thorax. 2019;74:33–42. doi: 10.1136/thoraxjnl-2017-211264. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Collins L.M., Murphy S.A., Strecher V. The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. Am. J. Prev. Med. 2007;32:S112–S118. doi: 10.1016/j.amepre.2007.01.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Collins L.M., Trail J.B., Kugler K.C., Baker T.B., Piper M.E., Mermelstein R.J. Evaluating individual intervention components: making decisions based on the results of a factorial screening experiment. Transl. Behav. Med. 2014;4:238–251. doi: 10.1007/s13142-013-0239-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Cox C.E., Hough C.L., Carson S.S., White D.B., Kahn J.M., Olsen M.K., Jones D.M., Somers T.J., Kelleher S.A., Porter L.S. Effects of a telephone- and web-based coping skills training program compared with an education program for survivors of critical illness and their family members. A randomized clinical trial. Am. J. Respir. Crit. Care Med. 2018;197:66–78. doi: 10.1164/rccm.201704-0720OC. [DOI] [PubMed] [Google Scholar]
- 11.Brown S.M., Wilson E.L., Presson A.P., Dinglas V.D., Greene T., Hopkins R.O., Needham D.M., N.A.N. with the National Institutes of Health Understanding patient outcomes after acute respiratory distress syndrome: identifying subtypes of physical, cognitive and mental health outcomes. Thorax. 2017;72:1094–1103. doi: 10.1136/thoraxjnl-2017-210337. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Han B., Enas N.H., McEntegart D. Randomization by minimization for unbalanced treatment allocation. Stat. Med. 2009;28:3329–3346. doi: 10.1002/sim.3710. [DOI] [PubMed] [Google Scholar]
- 13.Eakin M.N., Eckmann T., Dinglas V.D., Akinremi A.A., Hosey M., Hopkins R.O., Needham D.M. Association between participant contact attempts and reports of being bothered in a National, Longitudinal Cohort Study of ARDS Survivors. Chest. 2020;158:588–595. doi: 10.1016/j.chest.2020.02.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Bienvenu O.J., Colantuoni E., Mendez-Tellez P.A., Dinglas V.D., Shanholtz C., Husain N., Dennison C.R., Herridge M.S., Pronovost P.J., Needham D.M. Depressive symptoms and impaired physical function after acute lung injury: a 2-year longitudinal study. Am. J. Respir. Crit. Care Med. 2012;185:517–524. doi: 10.1164/rccm.201103-0503OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Cherkin D.C., Sherman K.J., Balderson B.H., Cook A.J., Anderson M.L., Hawkes R.J., Hansen K.E., Turner J.A. Effect of mindfulness-based stress reduction vs cognitive behavioral therapy or usual care on back pain and functional limitations in adults with chronic low back pain: a randomized clinical trial. JAMA. 2016;315:1240–1249. doi: 10.1001/jama.2016.2323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Polusny M.A., Erbes C.R., Thuras P. Mindfulness-based stress reduction for posttraumatic stress disorder among veterans: a randomized clinical trial. JAMA. 2015;314:456–465. doi: 10.1001/jama.2015.8361. [DOI] [PubMed] [Google Scholar]
- 17.Kroenke K., Spitzer R.L., Williams J.B. The PHQ-9: validity of a brief depression severity measure. J. Gen. Intern. Med. 2001;16:606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Lowe B., Unutzer J., Callahan C.M., Perkins A.J., Kroenke K. Monitoring depression treatment outcomes with the patient health questionnaire-9. Med. Care. 2004;42:1194–1201. doi: 10.1097/00005650-200412000-00006. [DOI] [PubMed] [Google Scholar]
- 19.Martin A., Rief W., Klaiberg A., Braehler E. Validity of the Brief Patient Health Questionnaire Mood Scale (PHQ-9) in the general population. Gen. Hosp. Psychiatry. 2006;28:71–77. doi: 10.1016/j.genhosppsych.2005.07.003. [DOI] [PubMed] [Google Scholar]
- 20.Lowe B., Schenkel I., Carney-Doebbeling C., Gobel C. Responsiveness of the PHQ-9 to psychopharmacological depression treatment. Psychosomatics. 2006;47:62–67. doi: 10.1176/appi.psy.47.1.62. [DOI] [PubMed] [Google Scholar]
- 21.Spitzer R.L., Kroenke K., Williams J.B., Lowe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch. Intern. Med. 2006;166:1092–1097. doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
- 22.Schelling G., Stoll C., Haller M., Briegel J., Manert W., Hummel T., Lenhart A., Heyduck M., Polasek J., Meier M., Preuss U., Bullinger M., Schuffel W., Peter K. Health-related quality of life and posttraumatic stress disorder in survivors of the acute respiratory distress syndrome. Crit. Care Med. 1998;26:651–659. doi: 10.1097/00003246-199804000-00011. [DOI] [PubMed] [Google Scholar]
- 23.Stoll C., Kapfhammer H.P., Rothenhausler H.B., Haller M., Briegel J., Schmidt M., Krauseneck T., Durst K., Schelling G. Sensitivity and specificity of a screening test to document traumatic experiences and to diagnose post-traumatic stress disorder in ARDS patients after intensive care treatment. Intensive Care Med. 1999;25:697–704. doi: 10.1007/s001340050932. [DOI] [PubMed] [Google Scholar]
- 24.EuroQol G. EuroQol—a new facility for the measurement of health-related quality of life. Health Policy. 1990;16:199–208. doi: 10.1016/0168-8510(90)90421-9. [DOI] [PubMed] [Google Scholar]
- 25.Kroenke K., Spitzer R.L., Williams J.B. The PHQ-15: validity of a new measure for evaluating the severity of somatic symptoms. Psychosom. Med. 2002;64:258–266. doi: 10.1097/00006842-200203000-00008. [DOI] [PubMed] [Google Scholar]
- 26.Attkisson C.C., Zwick R. The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval. Program Plann. 1982;5:233–237. doi: 10.1016/0149-7189(82)90074-x. [DOI] [PubMed] [Google Scholar]
- 27.Brooke J. System Usability Scale (SUS): a retrospective. J. Usability Stud. 2013;8:29–40. [Google Scholar]
- 28.Collins L.M. 1st ed. Springer; New York, NY: 2018. Optimization of Behavioral, Biobehavioral, and Biomedical Interventions: The Multiphase Optimization Strategy (MOST) (Statistics for Social and Behavioral Sciences) [Google Scholar]
- 29.Collins L.M., Kugler K.C. Springer; New York, NY: 2018. Optimization of Behavioral, Biobehavioral, and Bbiomedical Interventions: The Multiphase Optimization Strategy (MOST), Optimization of Behavioral, Biobehavioral, and Biomedical Interventions: Advanced Topics. [Google Scholar]
- 30.Fitzmaurice G.M., Laird N.M., Ware J.H. John Wiley & Sons; Hoboken, N.J: 2012. Applied Longitudinal Analysis. [Google Scholar]
- 31.Huffman J.C., Millstein R.A., Celano C.M., Healy B.C., Park E.R., Collins L.M. Developing a psychological-behavioral intervention in cardiac patients using the multiphase optimization strategy: lessons learned from the field. Ann. Behav. Med. 2020 Feb 21;54(3):151–163. doi: 10.1093/abm/kaz035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Corbin J.M., Strauss A.L. Fourth ed. SAGE; Los Angeles: 2015. Basics of Qualitative Research : Techniques and Procedures for Developing Grounded Theory. [Google Scholar]
- 33.Patton M.Q. 3rd ed. Sage Publications; Thousand Oaks, CA: 2002. Qualitative Research and Evaluation Methods. [Google Scholar]
- 34.Sandelowski M. Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-method studies. Res. Nurs. Health. 2000;23:246–255. doi: 10.1002/1098-240x(200006)23:3<246::aid-nur9>3.0.co;2-h. [DOI] [PubMed] [Google Scholar]
- 35.Strauss A.L., Corbin J.M. 2nd ed. Sage Publications; Thousand Oaks: 1998. Basics of Qualitative Research : Techniques and Procedures for Developing Grounded Theory. [Google Scholar]
- 36.Glaser B.G., Strauss A.L. Aldine de Gruyter; New York, N.Y: 1967. The Discovery of Grounded Theory : Strategies for Qualitative Research. [Google Scholar]
- 37.O'Cathain A., Thomas K.J., Drabble S.J., Rudolph A., Hewison J. What can qualitative research do for randomised controlled trials? A systematic mapping review. BMJ Open. 2013;3 doi: 10.1136/bmjopen-2013-002889. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Hesse-Biber S. Weaving a multimethodology and mixed methods praxis into randomized control trials to enhance credibility. Qual. Inq. 2012;18:876–889. [Google Scholar]
- 39.Bonell C., Fletcher A., Morton M., Lorenc T., Moore L. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc. Sci. Med. 2012;75:2299–2306. doi: 10.1016/j.socscimed.2012.08.032. [DOI] [PubMed] [Google Scholar]
- 40.Davidson J.E., Aslakson R.A., Long A.C., Puntillo K.A., Kross E.K., Hart J., Cox C.E., Wunsch H., Wickline M.A., Nunnally M.E., Netzer G., Kentish-Barnes N., Sprung C.L., Hartog C.S., Coombs M., Gerritsen R.T., Hopkins R.O., Franck L.S., Skrobik Y., Kon A.A., Scruth E.A., Harvey M.A., Lewis-Newby M., White D.B., Swoboda S.M., Cooke C.R., Levy M.M., Azoulay E., Curtis J.R. Guidelines for family-centered care in the neonatal, pediatric, and adult ICU. Crit. Care Med. 2017;45:103–128. doi: 10.1097/CCM.0000000000002169. [DOI] [PubMed] [Google Scholar]
- 41.Govindan S., Iwashyna T.J., Watson S.R., Hyzy R.C., Miller M.A. Issues of survivorship are rarely addressed during intensive care unit stays. Baseline results from a statewide quality improvement collaborative. Ann. Am. Thor. Soc. 2014;11:587–591. doi: 10.1513/AnnalsATS.201401-007BC. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Needham D.M., Davidson J., Cohen H., Hopkins R.O., Weinert C., Wunsch H., Zawistowski C., Bemis-Dougherty A., Berney S.C., Bienvenu O.J., Brady S.L., Brodsky M.B., Denehy L., Elliott D., Flatley C., Harabin A.L., Jones C., Louis D., Meltzer W., Muldoon S.R., Palmer J.B., Perme C., Robinson M., Schmidt D.M., Scruth E., Spill G.R., Storey C.P., Render M., Votto J., Harvey M.A. Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Crit. Care Med. 2012;40:502–509. doi: 10.1097/CCM.0b013e318232da75. [DOI] [PubMed] [Google Scholar]
- 43.Insel T.R. Digital phenotyping: technology for a new science of behavior. JAMA. 2017;318:1215–1216. doi: 10.1001/jama.2017.11295. [DOI] [PubMed] [Google Scholar]
- 44.Topol E.J. The future of medicine is in your smartphone: new tools are tilting health-care control from doctors to patients. 2015. https://www.wsj.com/articles/the-future-of-medicine-is-in-your-smartphone-1420828632 Available at:
- 45.Krumholz H.M., Terry S.F., Waldstreicher J. Data acquisition, curation, and use for a continuously learning health system. JAMA. 2016;316:1669–1670. doi: 10.1001/jama.2016.12537. [DOI] [PubMed] [Google Scholar]
- 46.Carmody J., Baer R.A. How long does a mindfulness-based stress reduction program need to be? A review of class contact hours and effect sizes for psychological distress. J. Clin. Psychol. 2009;65:627–638. doi: 10.1002/jclp.20555. [DOI] [PubMed] [Google Scholar]
- 47.Collins L.M., Dziak J.J., Li R. Design of experiments with multiple independent variables: a resource management perspective on complete and reduced factorial designs. Psychol. Methods. 2009;14:202–224. doi: 10.1037/a0015826. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Turnbull A.E., Sepulveda K.A., Dinglas V.D., Chessare C.M., Bingham C.O., 3rd, Needham D.M. Core domains for clinical research in acute respiratory failure survivors: an international modified Delphi Consensus Study. Crit. Care Med. 2017;45:1001–1010. doi: 10.1097/CCM.0000000000002435. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Long A.C., Kross E.K., Davydow D.S., Curtis J.R. Posttraumatic stress disorder among survivors of critical illness: creation of a conceptual model addressing identification, prevention, and management. Intensive Care Med. 2014;40:820–829. doi: 10.1007/s00134-014-3306-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Wu D., Wu T., Liu Q., Yang Z. The SARS-CoV-2 outbreak: what we know. Int. J. Infect. Dis. 2020 May;94:44–48. doi: 10.1016/j.ijid.2020.03.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Lai C.C., Shih T.P., Ko W.C., Tang H.J., Hsueh P.R. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and coronavirus disease-2019 (COVID-19): the epidemic and the challenges. Int. J. Antimicrob. Agents. 2020;55:105924. doi: 10.1016/j.ijantimicag.2020.105924. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Qiu J., Shen B., Zhao M., Wang Z., Xie B., Xu Y. A nationwide survey of psychological distress among Chinese people in the COVID-19 epidemic: implications and policy recommendations. Gen. Psychiatr. 2020;33 doi: 10.1136/gpsych-2020-100213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Lai J., Ma S., Wang Y., Cai Z., Hu J., Wei N., Wu J., Du H., Chen T., Li R., Tan H., Kang L., Yao L., Huang M., Wang H., Wang G., Liu Z., Hu S. Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019. JAMA Netw. Open. 2020;3 doi: 10.1001/jamanetworkopen.2020.3976. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Herridge M.S., Chu L.M., Matte A., Tomlinson G., Chan L., Thomas C., Friedrich J.O., Mehta S., Lamontagne F., Levasseur M., Ferguson N.D., Adhikari N.K., Rudkowski J.C., Meggison H., Skrobik Y., Flannery J., Bayley M., Batt J., Santos C.D., Abbey S.E., Tan A., Lo V., Mathur S., Parotto M., Morris D., Flockhart L., Fan E., Lee C.M., Wilcox M.E., Ayas N., Choong K., Fowler R., Scales D.C., Sinuff T., Cuthbertson B.H., Rose L., Robles P., Burns S., Cypel M., Singer L., Chaparro C., Chow C.W., Keshavjee S., Brochard L., Hebert P., Slutsky A.S., Marshall J.C., Cook D., Cameron J.I., R.P. Investigators, G. Canadian Critical Care Trials The RECOVER Program: disability risk groups and 1-year outcome after 7 or more days of mechanical ventilation. Am. J. Respir. Crit. Care Med. 2016;194:831–844. doi: 10.1164/rccm.201512-2343OC. [DOI] [PubMed] [Google Scholar]
- 55.Cox C.E., Porter L.S., Hough C.L., Kahn J.M., Carson S.S., Curtis J.R., White D.B., Keefe F.J. Telephone-based coping skills training for acute lung injury survivors & their informal caregivers. Intens. Care Med. 2011;37:S135. doi: 10.1007/s00134-012-2567-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Informational video for prospective participants in the trial.
Supplementary data, mobile app details, and statistical plan.



