Abstract
Background
Hospitalization offers an opportunity for healthcare providers to initiate advance care planning (ACP) conversations, yet such conversations occur infrequently. Barriers to these conversations include attitudes, skill, and time. Our objective was to develop a theory-based, provider-level intervention to increase the frequency of ACP conversations in hospitals.
Methods
We followed a systematic process to develop a theory-based, provider-level intervention to increase ACP conversations between providers and their hospitalized patients. Using principles established in Intervention Mapping and the Behavior Change Wheel, we identified a behavioral target, a theory of behavior change, behavior change techniques, and a mode of delivery. We addressed a limitation of these two processes of intervention development by also establishing a framework of design principles to structure the selection of intervention components. We partnered with a game development company to translate the output into a video game.
Results
We identified willingness to engage in ACP conversations as the primary contributor to ACP behavior, and attitudes as a modifiable source of this willingness. We selected self-determination theory, and its emphasis on increasing autonomous motivation, as a relevant theory of behavior change and means of changing attitudes. Second, we mapped the components of autonomous motivation (i.e., autonomy, competence, and relatedness) to relevant behavior change techniques (e.g., identity). Third, we decided to deliver the intervention using a video game and to use the narrative engagement framework, which describes the use of stories to educate, model behavior, and immerse the user, to structure our selection of intervention components. Finally, in collaboration with a game development company, we used this framework to develop an adventure video game (Hopewell Hospitalist).
Conclusions
The systematic development of a theory-based intervention facilitates the mechanistic testing of the efficacy of the intervention, including the specification of hypotheses regarding mediators and moderators of outcomes. The intervention will be tested in a randomized clinical trial.
Supplementary Information
The online version contains supplementary material available at 10.1186/s43058-021-00216-8.
Keywords: Behavioral interventions, Hospitalists, Healthcare providers advance care planning, Attitudes, Motivation, Education
Contributions to the literature.
Increasing the frequency of advance care planning conversations (ACP) in the hospital has the potential to achieve national priorities for improving the quality of care provided to patients at the end-of-life.
Existing interventions have had limited success at changing provider behavior.
We describe the use of a step-wise, theory-based process of intervention development to increase providers’ autonomous motivation for engaging in ACP conversations.
This work contributes to the literature by providing a new method of intervention development, and promoting a better understanding of the psychology of health professionals.
Background
Advance Care Planning (ACP) is an ongoing process of reflection and communication among patients, their family, and the health care team about patients’ preferences, values, and goals of care [1–10]. Participation in these conversations not only stimulates dialogue, but also allows patients to articulate (or potentially to construct) their preferences for care. The products of ACP conversations, such as advance directives, can increase the quality of care for patients at the end-of-life, improve outcomes for family members and caregivers, and decrease costs of care [6, 7].
Unfortunately, across most countries (e.g., USA, Japan, Belgium, the Netherlands), ACP remains rare [1–4]. Hospitalizations offer one opportunity for healthcare professionals to initiate these conversations [5]. However, existing quality improvement efforts, which use text-based education, reminders, incentives, and outreach by opinion leaders, have had variable success at changing behavior in this area [8–10].
Our objective was to develop a theory-based, provider-level intervention to increase the frequency of ACP conversations in hospitals. Behavioral interventions most frequently originate opportunistically—as the product of developer intuition and available resources [11–13]. However, theory-based interventions offer a number of advantages: (1) they have an increased likelihood of success; (2) they allow comparison across domains and populations; (3) they provide an opportunity to test the validity of theory [14–17]. In this paper we describe the process we followed to ensure the mapping of theoretical principles to intervention components during the development process. This process was an amalgam and extension of two well-described methods of building theory-based interventions: Intervention Mapping and the Behavior Change Wheel.
Methods
Overview of our process
We identified two dominant strategies in the dissemination and implementation literature for building theory-based interventions: Intervention Mapping and the Behavior Change Wheel [12, 16]. These well-established processes offer clear, systematic guidance for developing a theory-based, rather than theory-inspired, intervention. They start by defining the target behavior, progress to specification of what needs to change, and end with the identification of appropriate behavior change techniques [12, 16–18]. However, they have important limitations. For example, Intervention Mapping lacks a comprehensive taxonomy of behavior change techniques that users can reference when attempting to operationalize behavior change objectives [16]. The Behavior Change Wheel explicitly divorces selection of behavior change techniques from theories of behavior, instead of focusing on the function of the intervention (i.e. to persuade or train) as the driver of technique selection [19]. Most notably, both strategies ignore the complexity of instantiating behavior change techniques into the intervention, and the potential influence that the quality that those processes have on efficacy [12, 16]. For all these reasons, we combined and extended the steps outlined by Intervention Mapping and the Behavior Change Wheel, and summarize our process in Table 1. We describe Phases 1–3 in this manuscript.
Table 1.
Phase of Intervention Development | Intervention Mapping [13] | Behavior Change Wheel [9] |
---|---|---|
Phase 1 – Understand the behavior and specify the target for change |
Step 1: Logic model of the problem • Establish and work with a planning group • Conduct a needs assessment • Describe the context for the intervention including the population, setting, and community • State program goals |
Stage 1: Understand the behavior 1. Define the problem in behavioral terms 2. Select target behavior 3. Specify target behavior 4. Identify what needs to change |
Step 2: Program outcomes and objectives – logic model of change • State expected outcomes for behavior and environment • Specify performance objectives for behavioral and environmental outcomes • Select determinants for behavioral and environmental outcomes • Construct matrices of change objectives • Create a logic model of change |
||
Phase 2 – Identify theoretical basis for proposed behavior change and select relevant behavior change techniques |
Step 3: Program design • Generate program themes, components, scope, and sequence • Choose theory and evidence-based change methods • Select or design practical applications to deliver change methods |
Stage 2: Identify intervention options 1. Intervention functions 2. Policy categories Stage 3: Identify content and implementation options 3. Behavior change techniques |
Phase 3 – Identify mode of delivery, choose design principles to guide selection of intervention components, and develop the intervention. |
Step 4: Program production • Prepare plans for program materials • Draft messages, materials, and protocols • Pre-test, refine, and produce materials |
Stage 3: Identify content and implementation options 4. Mode of delivery |
Phase 4 – Assess the fidelity of intervention delivery |
Step 5: Program implementation plan • Identify potential program users • State outcomes and performance objectives for program use • Construct matrices of change objectives for program use • Design implementation interventions |
N/A |
Phase 5 – Assess intervention efficacy and test mediators and moderators of the outcome. |
Step 6: Evaluation plan • Write effect and process evaluation questions • Develop indicators and measures for assessment • Specify the evaluation design • Complete the evaluation plan |
N/A |
Phase 1: Understand the behavior and specify the target for intervention
We reviewed the literature to address two questions: (1) what criteria should providers use when deciding when/whether to have ACP conversations; (2) what barriers and facilitators of the behavior exist [1, 5, 8–10, 20–27]. We found recommendations issued by the Society of Hospital Medicine for providers when making decisions about ACP conversations [5]. To further enrich this information, we performed (a) a Delphi-panel study to generate expert consensus guidelines for ACP conversations in the hospital; (b) semi-structured interviews with a sample of hospital leaders responsible for leading ACP quality improvement efforts across the country. The details of these studies have been published elsewhere [21, 22].
From the literature review, Delphi panel, and interviews, we identified modifiable sources of influence on ACP behavior and selected one key source of influence to target in our intervention. This decision was informed by our assessment of the effectiveness of other interventions, the likelihood of behavior change, the spillover effect of change on other sources of influence, and the ability to measure the influential variable(s).
Phase 2: Identify theoretical basis of behavior change and select relevant behavior change techniques
Next, we reviewed existing theories of behavior to identify those aligned with the determinants of providers’ behavior [16, 28]. Our decision to tie intervention development explicitly to scientific theories (rather than focusing more generally on intervention function as advocated by the Behavior Change Wheel approach) reflected two considerations: (1) we wanted to exploit the explanatory power of theory, increasing our ability to predict mediators and moderators of the intervention’s efficacy; (2) we wanted to assess the applicability of the theory, thereby allowing us to further our understanding of health professionals’ decision-making. We selected a primary theory based on its alignment with the determinant of behavior selected in Phase 1 and its ability to address our over-arching programmatic goal of ensuring that the intervention would contribute to, rather than undermine, “joy in work” [29].
Once we identified a relevant theory, we reviewed a taxonomy of behavior change techniques—general methods for influencing the determinants of behaviors—to select those most suited to achieve our objective of changing the determinants of providers’ ACP conversations [30].
Phase 3: Identify mode of delivery, choose framework of engagement to guide selection of intervention components, and develop the intervention
As we progressed to intervention development, we debated the optimal mode of delivery. We considered the following criteria: (1) how to ensure fidelity of intervention delivery; (2) how to maximize the likelihood of effectiveness; (3) how to minimize resources required to disseminate the intervention widely. We screened different modes of delivering behavioral interventions and specifically reviewed the literature on the efficacy of serious games—“games in which education (in its various forms) is the primary goal rather than entertainment”—at improving clinician skill outcomes [31–34]. Once we had selected the mode of delivery (a customized video game), we next considered how to instantiate behavior change techniques into the intervention and how to design game components.
We drew on two bodies of research to identify design principles for our intervention. First, we reviewed the literature on “flow,” defined as a state in which people are so involved in an activity that nothing else seems to matter. Experiences that promote flow traditionally do one of the following: (1) provide competition (e.g., playing sports); (2) give the illusion of controlling chance (e.g., gambling); (3) scramble ordinary perception (e.g., skydiving), or (4) create alternative realities (e.g., reading) [28]. Second, we reviewed the literature on persuasion to identify message features (e.g. content, structure, style) associated with behavior change [35]. These bodies of work overlap in their agreement that narrative, information presented in the form of a story, has the power both to immerse and to persuade and could provide the framework for our behavior change techniques [36, 37].
Next, a multi-disciplinary group of hospitalists, palliative care physicians, and intensivists created game content, identifying five didactic principles that we wanted to communicate during the game (see Additional File 1). Finally, in collaboration with the game development company, with which we had partnered, we selected intervention components (game content, mechanics, and design features) that mapped to domains of engagement. The game development team incorporated intervention components into an existing game, developed previously for a separate project [38].
Results
We summarize our progression through Phases 1–3 of intervention development in Table 2 and Fig. 1.
Table 2.
Phase 1 | Phase 2 | Phase 3 | |||
---|---|---|---|---|---|
Specify the target behavior | Identify the target determinant of behavior | Identify theory of behavior change | Specify components of theory of behavior change | Select behavior change techniques | Identify design principles |
Increase the frequency with which providers have Advance Care Planning (ACP) conversations with hospitalized patients over the age of 65. | Provider attitudes towards ACP conversations | Self-determination theory | Autonomy |
Natural consequences • Health consequences • Salience of consequences • Anticipated regret • Emotional consequences |
Narrative Engagement Framework: narrative knowledge |
Competency |
Comparison of behavior • Demonstration of the behavior • Social comparison Identity • Identification of self as role model • Framing/reframing |
Narrative Engagement Framework: behavioral modeling | |||
Relatedness |
Comparison of behavior • Information of other's approval Reward and threat • Social reward |
Narrative Engagement Framework: engagement |
Phase 1: Understand the behavior and specify the target for intervention
The Society of Hospital Medicine recommends that hospitalists have ACP conversations for all newly hospitalized patients with “serious illness,” and suggests the use of disease-specific criteria or hospitalists’ response to the surprise question (i.e., “Would you be surprised if this patient died in the next 12 months?”) to screen patients [5]. Based upon our review of clinical practice guidelines, we initially expected that it might be necessary to create and to disseminate rules to help providers recognize patients with “serious illness.” Yet, through a Delphi process, an expert panel recommended that hospitalists have ACP conversations with all patients, over the age of 65 admitted for management of an acute medical problem [21]. These results reframed our behavioral problem from one of recognition (i.e., training providers to detect patients who needed ACP conversations) to one of willingness (i.e., persuading providers to make ACP conversations a priority for all patients over 65 and not just the sickest) [39].
Based on a review of the literature, combined with semi-structured interviews with leaders at acute care hospitals, we identified three categories of barriers that might influence providers’ willingness to have ACP conversations in the hospital: (1) skills—providers felt as if they did not have the communication skills that they needed to have complex, emotionally-laden conversations; (2) attitudes—providers described worry about provoking strong emotions in patients and families with conversations, and the use of avoidance as a strategy to manage their own emotions around challenging topics; and (3) practical barriers—providers identified lack of available time and lack of patient decisional capacity as impediments to ACP conversations [8, 9, 22–27].
Finally, we considered the best target for our intervention. We found no behavioral interventions that effectively modified providers’ attitudes in this domain. We therefore specified that providers’ attitudes towards having ACP conversations with all patients over 65 (and not just those with serious illness) would serve as our intervention target. Our objective was to achieve an increase in the frequency with which providers had ACP conversations (i.e., the target behavior).
Phase 2: Identify theoretical basis of behavior change and specify relevant behavior change techniques
Phase 2a: Identify theory of behavior change
We reviewed multiple theories of behavior that addressed constructs related to attitudes, including beliefs, intention, and motivation: theory of planned behavior, stage theories, social cognitive theory, and theories of self-regulation [16]. Self-determination theory (a theory of self-regulation) appeared to have the greatest alignment with our programmatic goal of ensuring that our intervention promoted, rather than undermined, “joy in work” [40]. In self-determination theory, motivation satisfies three needs: competence (the feeling of mastery of important tasks), autonomy (the feeling of volition associated with action), and relatedness (the feeling of belonging and connectedness with others). These basic psychological needs contribute to health and well-being when met, or pathology and ill-being when unmet. Unlike other theories of behavior (e.g., social cognitive theory), self-determination theory describes a spectrum of motivation, ranging from amotivation (lacking the intention to act) to extrinsic motivation (performing an activity to achieve secondary gain) to intrinsic motivation (performing an activity because it produces inherent satisfaction). As the locus of behavioral control shifts from external to internal, motivation becomes increasingly autonomous or self-determined. Autonomous motivation can occur because the task generates innate satisfaction (intrinsic motivation) or because it aligns with deeply held values (integrated regulation of extrinsic motivation). Interventions that maximize autonomous motivation promote persistence, positive affect, enhanced performance, and greater psychological well-being [41, 42]. Autonomous motivation most closely aligned with the construct of willingness that we sought to target. Moreover, self-determination theory asserts that this type of sustainable motivation “emerges from one’s sense of self and is accompanied by feelings of willingness and engagement.”
Phase 2b: Identify behavior change techniques
Michie et al. developed a comprehensive list of 93 distinct behavior change techniques and categorized them into a hierarchical structure using Delphi methods [30]. We reviewed the taxonomy to identify techniques that aligned with our objective of maximizing providers’ autonomous motivation for engaging in ACP conversations. We identified four groups of relevant techniques: (1) providing providers with information about the natural consequences of ACP conversations; (2) allowing providers to make comparisons of the behavior; (3) providing providers with information about reward and threat associated with the behavior; (4) linking the behavior to the providers’ professional identity. We list the techniques we selected in Table 2.
Phase 3: Identify mode of delivery, choose design principles to guide selection of intervention components, and develop the intervention
Phase 3a: Identify mode of delivery
We identified a serious video game as most likely to meet our objectives of a high-fidelity, effective mode of delivery. In addition, although costly to develop, a game would require relatively few resources to disseminate, facilitating the scalability of the initiative [43]. Finally (and pragmatically), we had a game that we could repurpose for this project, which further reduced costs.
Phase 3b: Select overarching design principles to guide selection of intervention components
We decided to use the narrative engagement framework to instantiate behavior change principles into the intervention, as it aligned with decisions regarding the behavioral target, the behavior change techniques, and the mode of delivery [44]. Narrative is defined as “talk organized around significant or consequential experiences, with characters undertaking some action, within a context, with implicit or explicit beginning and end points, and significance for the narrator and his/her audience” [45]. Narratives have had great success in health promotion efforts (e.g., reduction of sexually transmitted infections, increase in mammogram screening) as a means of education and persuasion, and may allow the delivery of behavior change techniques in other domains [46, 47]. Narratives achieve their effect through communication of knowledge, behavioral modeling, and engagement [44, 47–49]. We describe key elements of narrative engagement and how they map to our behavioral target in Tables 2 and 3.
Table 3.
Domain | Description | Function | Selection of intervention components |
---|---|---|---|
Narrative knowledge | Narrative knowledge is defined as information that is presented already integrated within a mental model (defined as a representation of the decision problem) |
• Reduces cognitive load required for processing complex information • Reduces counter-arguing provoked by exposure to a new or controversial argument • Increases memorability of the knowledge contained in the story |
• Game content – Teaching cases |
Behavioral modeling | Behavioral modeling is defined as opportunities to observe others’ behavior |
• Allows the development of new rules for one's own actions. • Offers vicarious experience with the consequences of effective and ineffective behavior |
• Game content – Teaching cases |
Engagement |
Engagement is defined as immersion in the health narrative promoted by: • Realism: believable actions and consequences • Interest: intensity of attention attracted to the story • Identification: a feeling of unity with the characters • Transportation: a cognitive or emotional shift in the state of consciousness. |
• Increases acceptance of the knowledge embedded in the story • Increases willingness to practice the modeled behaviors • Increases memorability of the experience. |
• Game content - Teaching cases (realism) • Game content - Diagnostic cases (interest) • Game content - Resuscitation cases (interest, transportation) • Game content - flashbacks, mystery, in-game relationships (interest, identification, transportation) • Game mechanics (e.g. tap to act) (interest, transportation) • Game design (e.g. music) (transportation) • Game graphics (e.g. color of text bubbles) (interest, transportation) |
Phase 3c: Develop the intervention
Finally, we worked with a video game company (Schell Games) to develop the game intervention. We used as our template a game that we had previously developed to recalibrate providers heuristics in trauma triage [38]. We kept the art and game mechanics but modified the story and the in-game interactions to deliver the behavior change techniques identified above. We summarize the game components in Table 3 and Fig. 1. We show an example of the game content mapped to behavior change techniques and domains of the narrative engagement framework in Table 4 and in Additional File 1. We include a full description of the final product (Hopewell Hospitalist) in Additional File 1.
Table 4.
Dialogue option After examining and speaking with Benjamin and Moira, the player opts for: |
Initial encounter Demonstration of behavior (BCT) Behavioral modeling (NEF) |
Second encounter Natural consequences (BCT) Narrative knowledge and engagement (NEF) |
Feedback from in-game character Comparison of behavior and reward/threat (BCT) Narrative knowledge and engagement (NEF) |
---|---|---|---|
Advance care planning (ACP) conversation |
...Andy: Hmm…how much information about what the future may hold would be helpful hear?” Moira: “Since his wife died, I’m his only family. I would want to know what might be coming.” Andy: “Ok. It looks like he has a pretty serious pneumonia. ... Given that this is his second serious hospitalization and infection in the last little while, I’m worried he might not have the strength to recover.” Moira: “What do you mean?” Andy: “It’s possible he may have more trouble breathing and we’d be faced with a decision about the ICU and life support. If that happened, there is a risk he could die. Moira: “Oh my God. I knew he was weak but just didn’t think he was that sick!” ...Andy: “What are the things that are most important to him?” Moira: “He’s stubborn and never could do anything that wasn’t his idea first. He wants to be out fishing with his son and grandson, and reading those spy novels he loves.” ... Andy: “Could I make a recommendation?” Moira: “Yes, please.” Andy: “Given what you’ve told me about what matters most to Benjamin, I think a short trial of ICU-level care would make sense as long as we think that he could recover sufficiently to return home and live independently.” Moira: “That makes sense to me” |
...Andy: “When we talked last time, we decided that Benjamin would be open to a short trial of a breathing machine in the ICU if we get him through the illness and back home. Do you still think that would be what he would want?” Moira: “I’ve been thinking about this ever since we first talked and yes, I do think he would want a chance to get better. But what if he doesn’t?” Andy: “I can hear your worry. If he doesn’t improve in the next few days, then I worry he could die or, if he survives, need a long stay in a rehab facility…” Moira: “He said he’d never go to a nursing home…” Andy: “I remember you saying that. Let’s hope for the best, but if he doesn’t turn around, we will be prepared to shift our focus to comfort measures only.” Moira: “I’m so glad I’ve been telling him how much I love him these last few days.” |
Felix: “I hear Benjamin’s sister is having a hard time.” Andy: “Her brother is dying. So yeah. But at least she knows she is doing what he wanted.” Felix: “It’s great that you had the conversation when he came in. Things might have gone differently otherwise.” Andy: “I just figured…70 year old guy, bad pneumonia, second recent admission. Even if he made it through this hospitalization, his risk of needing a nursing home or having a complication was pretty high.” Felix: “I know. It’s so helpful to the family to talk about before a crisis. Waiting until the patient is decompensating or already in the ICU on life support means that no one is prepared. Everyone’s in panic mode. Then families end up racked with guilt later making decisions about withdrawing life support.” Andy: “They don’t tell you about this part in med school – death is a taboo topic! But knowing how good it can feel to really help people through these hard times would have made me more motivated to learn how to have the conversation in med school.” |
Code status elicitation |
Andy: “Do you know if your brother would want CPR?” Moira: “CPR? Like with the paddles? Well yeah, he would want that. I mean otherwise he would just die, right?” Andy: “Right. I don’t think he’ll arrest, but I always like to ask to be sure I know what people would want, you know, in the worst-case scenario. It sounds like he would want us to do everything.” Moira: “Well yeah, do everything you can to help him!” |
Andy: “Your brother has a pretty serious pneumonia that we’ve been treating with antibiotics. Unfortunately, it looks like he’s gotten sicker and we may need to move him to the ICU and intubate him. (sharing medical update) Had you ever talked about whether he’d want a breathing machine if he got this sick? Moira: “No, never. This has all happened so fast I just don’t know what to think.” Andy: “Ok, well let’s think together. What are the things that are most important to him?” Moira: “I just don’t know. How can this be happening? You said he would be okay. He was fine when he came in. I just…” Andy: “I know that this is hard, but we need to make some important decisions here.” Moira: “I am never going to have a chance to say goodbye, am I?” |
Felix: “I hear the family of the patient Benjamin is having a hard time.” Andy: “Yes. His sister is struggling because they never really spoke about his wishes.” Felix: “But this is his second recent admission, isn’t it?” Andy: “Yes. He was in with osteo a couple of weeks ago.” Felix: “Do you think it would have helped if you started the goals of care conversation earlier?” Andy: “What do you mean?” Felix: “Well, 70 year-old guy who comes in after a recent admission and now has another bad problem? Best case scenario he could have bounced back and made it home, but there was a reasonable risk he’d deteriorate and end up in the unit on the vent. Even if he survives the vent he’s got about a 70% chance of dying in the next year. If you’d had a real sit-down discussion with them about that risk and assessed his goals and preferences, maybe this part wouldn’t be so hard.” Andy: “I guess I just didn’t think it was time yet.” Felix: “When you think ‘it’s time,’ it’s probably already too late. There’s no harm in hoping for the best but preparing for the worst. It can make hard decisions you might have to make later a little easier for both you and the family.” |
Discussion
This paper describes the application of a novel process of intervention development, grounded in principles derived from programs like the Behavior Change Wheel and Intervention Mapping but modified to address pragmatic concerns. Most importantly, we spent significant effort identifying methods to instantiate behavior change techniques into the intervention that would optimize engagement while simultaneously aligning with change objectives. The product of our effort, an adventure video game titled Hopewell Hospitalist, is designed to increase providers’ autonomous motivation for ACP conversations and thereby change their attitudes towards, their willingness to engage in, and frequency of having these conversations.
We began intervention development with three goals. Our first goal was to ensure that the intervention had a robust grounding in psychological and behavioral theory. A 2017 scoping review found that only 47% of implementation studies targeting healthcare professionals explicitly used theories of behavior change [50]. Additionally, even when theory served as the foundation of an intervention, the application occurred inconsistently—only 10% of studies with theory-based interventions reported links between behavior change techniques and theoretical constructs [28]. The NIH’s Science of Behavior Change Program recommends that the development of behavioral interventions begin with a clear conceptual model and employ a mechanistic approach to facilitate the testing of mediators and moderators of efficacy [14]. To facilitate this process, we combined and modified the principles from the Behavior Change Wheel and Intervention Mapping, which allowed us to describe transparently our approach to theory-based behavioral intervention development, including the selection of specific intervention components, in a format that will allow other researchers to compare our work to other development approaches.
Our second goal was to maximize engagement. Both the Behavior Change Wheel and Intervention Mapping focus on the identification of relevant theoretical principles with limited consideration of design. However, engagement potentially mediates the efficacy of behavioral interventions [33, 51, 52]. Little is known about design features that definitively produce engagement. The literature on the topic is complicated by differences in definitions of engagement used by researchers in human-computer interaction and behavioral science [51]. Human-computer interaction research focuses on the experience of engagement, referencing the subjective feeling of immersion produced by the intervention. In contrast, behavioral science research focuses on the behavioral consequences of engagement, such as duration and depth of usage of the intervention. Although correlated, these constructs have important distinctions. For example, an immersive experience can but does not have to increase usage. The majority of efforts to understand engagement with behavioral interventions in healthcare have focused on strategies that promote usability, such as navigation autonomy, message tone, or reminders to use the intervention [52–54]. Less is known about strategies that increase immersion [55, 56]. We plan to test both the success of our strategy to use the narrative engagement framework to induce an immersive experience, and the ways in which the experience and behavioral consequences of engagement mediate the effect of the intervention.
Our third development goal was to ensure that the intervention would foster “joy in work.” Burnout—emotional exhaustion, feelings of cynicism and detachment from work, and a sense of low personal accomplishment—pervades healthcare [57]. Approximately 54% of physicians endorse at least one symptom of burnout, which contributes in turn to increased medical errors, worsened clinical outcomes, and rising costs [29]. Paradoxically, interventions to improve the quality of care can have unintended consequences by having negative effects on professional satisfaction [58]. As a remedy, the Institute of Healthcare Improvement recommends that organizations focus on encouraging staff to appreciate the meaning and purpose of their work [29]. We used this as our guiding principle during the phases of intervention development, attempting to tie ACP conversations to values that attract many providers to the profession (e.g., altruism, relatedness) and therefore promote the integrated regulation of extrinsically motivated behavior.
This project had three main limitations. First, we grounded the intervention in a single theory: self-determination theory [59]. The selection of a different theory (e.g., theory of information processing) or the use of an integrated framework of theories of behavior change (e.g., the Theoretical Domains Framework) might have produced different results. Second, we focused narrowly on provider attitudes and motivation without explicit consideration of other influences on providers’ willingness to engage in these conversations (e.g., time constraints) or ecological moderators of behavior (e.g., hospital norms). Many programs to address these variables already exist, so that our work adds to the portfolio of available interventions. Finally, the intervention that we constructed was multi-dimensional, relying on both behavior change techniques and design elements to affect behavior. These different aspects of intervention design may interact in complex ways that will be difficult to disentangle. Similarly, we anticipate the potential for spillover from our main behavioral target (motivation/attitudes) to other drivers of willingness. For example, the behavioral modeling that we included to foster engagement may influence communication skills. Ideally, intervention design would allow for the systematic manipulation of each component of the intervention to identify the combination that provides the best results [60]. However, this was outside the scope of our budget.
Conclusions
We developed a novel process for building behavioral interventions to improve the performance of healthcare providers by adapting principles from the dissemination and implementation literature. This process focused on the need to ground the intervention in theoretical principles of behavior, to maximize the experience of engagement, and to foster joy in work. We used it to build a customized video game to increase the frequency of ACP conversations between providers and hospitalized older patients and plan to test the effect of the intervention in a future randomized clinical trial, which will allow us to better understand the success of our theoretical and design principles.
Supplementary Information
Acknowledgements
The authors thank the game development team at Schell Games and the physicians at the University of Pittsburgh who participated in pilot testing.
Authors’ contributions
Study concept, design, analysis, interpretation: DM, MAM, JSCC, CBM, AEB, DM. Drafting of the manuscript: DM. Critical revision of the manuscript for important intellectual content: MAM, JSCC, CBM, AEB. All authors read and approved the final manuscript.
Funding
• P01 AG019783 (Barnato)
• The Patrick and Catherine Weldon Donaghue Medical Research Foundation (Barnato)
• DP2 LM012339 (Mohan)
Availability of data and materials
Hopewell Hospitalist will be made available for public access on the Apple Store once the trial, testing its efficacy, is complete.
Declarations
Ethics approval and consent to participate
Not applicable
Consent for publication
Not applicable
Competing interests
None
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Institute of Medicine . Dying in America: improving quality and honoring individual preferences near the end of life. Washington, DC: The National Academies Press; 2015. [PubMed] [Google Scholar]
- 2.Hamano J, Oishi A, Morita T, Kizawa Y. Frequency of discussing and documenting advance care planning in primary care: secondary analysis of a multicenter cross-sectional observational study. BMC Palliat Care. 2020;19(1):32. doi: 10.1186/s12904-020-00543-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Meeussen K, van den Block L, Echteld M, Bossuyt N, Bilsen J, van Casteren V, Abarshi E, Donker G, Onwuteaka-Philipsen B, Deliens L. Advance care planning in Belgium and The Netherlands: a nationwide retrospective study via sentinel networks of general practitioners. J Pain Symptom Manag. 2011;42(4):565–577. doi: 10.1016/j.jpainsymman.2011.01.011. [DOI] [PubMed] [Google Scholar]
- 4.Sharp T, Moran M, Kuhn I, et al. Do the elderly have a voice? Advance care planning discussions with frail and older individuals: a systematic literature review and narrative synthesis. Br J Gen Pract. 2013;63(615):e657–e668. doi: 10.3399/bjgp13X673667. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Anderson WG, Berlinger N, Ragland J, et al. Hospital-based prognosis and goals of care discussions with seriously ill patients: a pathway to integrate a key primary palliative care process into the workflow of hospitalist physicians and their teams. Garrison: Society of Hospital Medicine and The Hastings Center; 2017.
- 6.Weathers E, Ronan O'C, Cornally N, et al. Advance care planning: a systematic review of randomized clinical trials conducted with older adults. Maturitas. 2016;91:101–109. doi: 10.1016/j.maturitas.2016.06.016. [DOI] [PubMed] [Google Scholar]
- 7.Houben CHM, Spruit MA, Groenen MTJ, et al. Efficacy of advance care planning: a systematic review and meta-analysis. JAMDA. 2015;15:477–489. doi: 10.1016/j.jamda.2014.01.008. [DOI] [PubMed] [Google Scholar]
- 8.Howard M, Bernard C, Klein D, Elston D, Tan A, Slaven M, Barwich D, You JJ, Heyland DK. Barriers to and enablers of advance care planning with patients in primary care. Can Fam Physician. 2018;64(4):e190–e198. [PMC free article] [PubMed] [Google Scholar]
- 9.Lund S, Richardson A, May C. Barriers to Advance Care Planning at the end of life: an explanatory systematic review of implementation studies. PLoS One. 2015;10(2):e0116629. doi: 10.1371/journal.pone.0116629. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Heyland DK, Barwich D, Pichora D, Dodek P, Lamontagne F, You JJ, Tayler C, Porterfield P, Sinuff T, Simon J, ACCEPT (Advance Care Planning Evaluation in Elderly Patients) Study Team. Canadian Researchers at the End of Life Network (CARENET) Failure to engage hospitalized elderly patients and their families in Advance Care Planning. JAMA Intern Med. 2013;173(9):778–787. doi: 10.1001/jamainternmed.2013.180. [DOI] [PubMed] [Google Scholar]
- 11.Michie S, van Stralen MM, West R. The behavior change wheel: a new method for characterizing and designing behavior change interventions. Implement Sci. 2011;6(1):42. doi: 10.1186/1748-5908-6-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Miche S, Atkins L, West R. The Behavior Change Wheel: A Guide to Designing Interventions. UK: Silverback Publishing; 2014. [Google Scholar]
- 13.Colquhoun HL, Squires JE, Kolehmainen N, Fraser C, Grimshaw JM. Methods for designing interventions to change healthcare professionals’ behavior: a systematic review. Implement Sci. 2017;12(1):30. doi: 10.1186/s13012-017-0560-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Nielsen L, Riddle M, King JW, NIH Science of Behavior Change Implementation Team. Aklin WM, Chen W, Clark D, Collier E, Czajkowski S, Esposito L, Ferrer R, Green P, Hunter C, Kehl K, King R, Onken L, Simmons JM, Stoeckel L, Stoney C, Tully L, Weber W. The NIH Science of Behavior Change Program: transforming the science through a focus on mechanisms of change. Behav Res Ther. 2018;101:3–11. doi: 10.1016/j.brat.2017.07.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Michie S, Johnston M, Francis J, et al. From theory to intervention: mapping theoretically derived behavioral determinants to behavior change techniques. Appl Psychol. 2008;47:660–680. doi: 10.1111/j.1464-0597.2008.00341.x. [DOI] [Google Scholar]
- 16.Eldredge LKB, Markham CM, Ruiter RAC, et al. Planning Health Promotion Programs: An Intervention Mapping Approach. San Francisco: Jossey-Bass; 2016. [Google Scholar]
- 17.Kok G, Schaalma H, Ruiter RAC, van Empelen P, Brug J. Intervention Mapping: a protocol for applying health psychology to prevention programs. J Health Psychol. 2004;9(1):85–98. doi: 10.1177/1359105304038379. [DOI] [PubMed] [Google Scholar]
- 18.Fernandez ME, Ruiter RAC, Markham CM, Kok G. Intervention Mapping: theory- and evidence-based health promotion program planning. Front Public Health. 2019;7:209. doi: 10.3389/fpubh.2019.00209. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Fahy N, Greenhalgh T, Shaw S. PHOENIX: a new framework for applying psychological theories to the adoption of innovations by healthcare professionals. 2020. [Google Scholar]
- 20.Centers for Medicare and Medicaid Services . Quality Measures Fact Sheet: Advance Care Plan (ACP) (NQF #0326) 2019. [Google Scholar]
- 21.Mohan D, Sacks OA, O'Malley J, et al. A new standard for advance care planning conversations in the hospital: results from a Delphi panel. J Gen Intern Med. 2021;36(1):69–76. doi: 10.1007/s11606-020-06150-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Sacks OA, Knutzen KE, Rudolph MA, Mohan D, Barnato AE. Advance Care Planning and professional satisfaction from ‘doing the right thing’: interviews with hospitalist chiefs. J Pain Symptom Manag. 2020;60(4):e31–e34. doi: 10.1016/j.jpainsymman.2020.06.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Vanderhaeghen B, Bossuyt I, Opdebeeck S, Menten J, Rober P. Toward hospital implementation of Advance Care Planning: should hospital professionals be involved? Qual Health Res. 2018;28(3):456–465. doi: 10.1177/1049732317735834. [DOI] [PubMed] [Google Scholar]
- 24.Fulmer T, Escobedo M, Berman A, Koren MJ, Hernández S, Hult A. Physician views on Advance Care Planning and end-of-life care conversations. J Am Geriatr Soc. 2018;66(6):1201–1205. doi: 10.1111/jgs.15374. [DOI] [PubMed] [Google Scholar]
- 25.Mullick A, Sallnow L. An introduction to advance care planning in practice. BMJ. 2013;347(oct21 3):f6064. doi: 10.1136/bmj.f6064. [DOI] [PubMed] [Google Scholar]
- 26.Fulmer T, Escobedo M, Berman A, Koren MJ, Hernández S, Hult A. Physicians’ views on Advance Care Planning and end-of-life care conversations. J Am Geriatr Soc. 2018;66(6):1201–1205. doi: 10.1111/jgs.15374. [DOI] [PubMed] [Google Scholar]
- 27.Fanta L, Tyler J. Physician perceptions of barriers to Advance Care Planning. SD Med. 2017;70:303–309. [PubMed] [Google Scholar]
- 28.Davis R, Campbell R, Hildon Z, et al. Theories of behavior and behavior change across the social and behavioral sciences: a scoping review. Health Psychol. 2015;9:323–344. doi: 10.1080/17437199.2014.941722. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Perlo J, Balik B, Swensen S, et al. IHI framework for improving joy in work. Cambridge: Institute for Healthcare Improvement; 2017. [Google Scholar]
- 30.Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95. doi: 10.1007/s12160-013-9486-6. [DOI] [PubMed] [Google Scholar]
- 31.Graafland M, Schraagen JM, Schijven MP. Systematic review of serious games for medical education and surgical skills training. Br J Surg. 2012;99(10):1322–1330. doi: 10.1002/bjs.8819. [DOI] [PubMed] [Google Scholar]
- 32.Primack BA, Carroll MV, McNamara M, Klem ML, King B, Rich M, Chan CW, Nayak S. Role of video games in improving health-related outcomes. Am J Prev Med. 2012;42(6):630–638. doi: 10.1016/j.amepre.2012.02.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ward M, Shé E, de Brún A, et al. The co-design, implementation and evaluation of a serious board game ‘PlayDecide patient safety’ to educate junior doctors about patient safety and the importance of reporting safety outcomes. BMC Med Educ. 2019;19(1):232. doi: 10.1186/s12909-019-1655-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Marques MM, Carey RN, Norris E, Evans F, Finnerty AN, Hastings J, Jenkins E, Johnston M, West R, Michie S. Delivering behavior change interventions: development of a mode of delivery ontology. Wellcome Open Res. 2021;5:125. doi: 10.12688/wellcomeopenres.15906.2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Czikszentmihalyi M. Flow: The Psychology of Optimal Experience. New York: Harper Perennial; 2008. [Google Scholar]
- 36.Shen L, Bigsby E. The Effects of Message Features: Content, Structure and Style. In: Dillard JP, Shen L, editors. The SAGE Handbook of Persuasion: Developments in Theory and Practice. Washington DC: Sage Publications; 2013. [Google Scholar]
- 37.Bilandzic H, Busselle R. Narrative Persuasion. In: Dillard JP, Shen L, editors. The SAGE Handbook of Persuasion: Developments in Theory and Practice. Washington DC: Sage Publications; 2013. [Google Scholar]
- 38.Mohan D, Farris C, Fischhoff B, Rosengart MR, Angus DC, Yealy DM, Wallace DJ, Barnato AE. Efficacy of educational video game versus traditional educational apps at improving physician decision making in trauma triage: randomized controlled trial. BMJ. 2017;359:j5416. doi: 10.1136/bmj.j5416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Macmillan NA, Creelman CD. Detection Theory: A User’s Guide. New York: Lawrence Erlbaum Associates; 2005. [Google Scholar]
- 40.Deci EL, Ryan RM. Facilitating optimal motivation and psychological well-being across life's domains. Can Psychol. 2008;49(1):14–23. doi: 10.1037/0708-5591.49.1.14. [DOI] [Google Scholar]
- 41.Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55(1):68–78. doi: 10.1037/0003-066X.55.1.68. [DOI] [PubMed] [Google Scholar]
- 42.Stone DN, Deci EL, Ryan RM. Beyond talk: Creating autonomous motivation through self-determination theory. J Gen Manag. 2009;34(3):75–91. doi: 10.1177/030630700903400305. [DOI] [Google Scholar]
- 43.Michie S, Yardley L, West R, Patrick K, Greaves F. Developing and evaluating digital interventions to promote behavior change in health and health care: recommendations resulting from an international workshop. J Med Internet Res. 2017;19(6):e232. doi: 10.2196/jmir.7126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Miller-Day M, Hecht ML. Narrative Means to Preventative Ends: A Narrative Engagement Framework for Designing Prevention Interventions. Health Commun. 2013;28(7):657–670. doi: 10.1080/10410236.2012.762861. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Kreuter MW, Green MC, Capella JN, et al. Narrative communication in cancer prevention and control: a framework to guide research and application. Ann Behav Med. 2007;33(3):221–235. doi: 10.1007/BF02879904. [DOI] [PubMed] [Google Scholar]
- 46.Berkley-Patton J, Goggin K, Liston R, Bradley-Ewing A, Neville S. Adapting effective narrative-based HIV-prevention interventions to increase minorities’ engagement in HIV/AIDS services. Health Commun. 2009;24(3):199–209. doi: 10.1080/10410230902804091. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Moyer Gusé E, Nabi RL. Explaining the Effects of Narrative in an Entertainment Television Program: Overcoming Resistance to Persuasion. Hum Commun Res. 2010;36(1):26–52. doi: 10.1111/j.1468-2958.2009.01367.x. [DOI] [Google Scholar]
- 48.Thorndyke PW. Cognitive structures in comprehension and memory of narrative discourse. Cogn Psychol. 1977;9(1):77–110. doi: 10.1016/0010-0285(77)90005-6. [DOI] [Google Scholar]
- 49.Bower GH, Morrow DG. Mental models in narrative comprehension. Science. 1990;247(4938):44–48. doi: 10.1126/science.2403694. [DOI] [PubMed] [Google Scholar]
- 50.Liang L, Bernhardsson S, Vemoij RWM, et al. Use of theory to plan or evaluate guideline implementation among physicians: a scoping review. Implement Sci. 2017;12(1):26. doi: 10.1186/s13012-017-0557-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Perski O, Blandford A, West R, et al. Conceptualizing engagement with digital behavior change interventions: a systematic review using principles from critical interpretive synthesis. TBM. 2017;7:254–267. doi: 10.1007/s13142-016-0453-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Morrison LG, Yardley L, Powell J, Michie S. What design features are used in effective e-health interventions? A review using techniques from critical interpretive synthesis. Telemed E Health. 2012;18(2):137–144. doi: 10.1089/tmj.2011.0062. [DOI] [PubMed] [Google Scholar]
- 53.Kelders SM, Kok RN, Ossebaard HC, van Gemert-Pijnen JEWC. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res. 2012;14(6):e152. doi: 10.2196/jmir.2104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.McClure JB, Shortreed SM, Bogard A, et al. The effect of program design on engagement with an internet smoking intervention: randomized factorial trial. J Med Internet Res. 2013;15(3):e69. doi: 10.2196/jmir.2508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Boyle EA, Connolly TM, Hainey T, Boyle JM. Engagement in digital entertainment games: a systematic review. Comput Hum Behav. 2012;28(3):771–780. doi: 10.1016/j.chb.2011.11.020. [DOI] [Google Scholar]
- 56.O'Brien HL, Toms EG. What is user engagement? A conceptual framework for defining user engagement with technology. J Am Soc Inf Sci Technol. 2008;59(6):938–955. doi: 10.1002/asi.20801. [DOI] [Google Scholar]
- 57.Maslach C, Leiter MP. Understanding the burnout experience: recent research and its implications for psychiatry. World Psychiatry. 2016;15(2):103–111. doi: 10.1002/wps.20311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Friedberg MW, Chen PG, et al. Factors Affecting physician professional satisfaction and their implications for patient care, health systems, and health policy. Santa Monica: RAND Corporation; 2013. [PMC free article] [PubMed] [Google Scholar]
- 59.Ntoumanis N, Ng JYY, Prestwich A, Quested E, Hancox JE, Thøgersen-Ntoumani C, Deci EL, Ryan RM, Lonsdale C, Williams GC. A meta-analysis of self-determination theory-informed intervention studies in the health domain: effects on motivation, health behavior, physical, and psychological health. Health Psychol Rev. 2020;15(2):1–30. doi: 10.1080/17437199.2020.1718529. [DOI] [PubMed] [Google Scholar]
- 60.Collins L. Optimization of behavioral, biobehavioral, and biomedical interventions: the multiphase optimization strategy. Pennsylvania: Springer; 2018. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Hopewell Hospitalist will be made available for public access on the Apple Store once the trial, testing its efficacy, is complete.