Skip to main content
BMJ Open logoLink to BMJ Open
. 2022 Jul 12;12(7):e057026. doi: 10.1136/bmjopen-2021-057026

Electronic nudge tool technology used in the critical care and peri-anaesthetic setting: a scoping review protocol

Lisa McIlmurray 1,, Bronagh Blackwood 1, Martin Dempster 2, Frank Kee 3, Charles Gillan 4, Rachael Hagan 4, Lynne Lohfeld 5, Murali Shyamsundar 1
PMCID: PMC9277380  PMID: 35820751

Abstract

Introduction

Electronic clinical decision support (eCDS) tools are used to assist clinical decision making. Using computer-generated algorithms with evidence-based rule sets, they alert clinicians to events that require attention. eCDS tools generating alerts using nudge principles present clinicians with evidence-based clinical treatment options to guide clinician behaviour without restricting freedom of choice. Although eCDS tools have shown beneficial outcomes, challenges exist with regard to their acceptability most likely related to implementation. Furthermore, the pace of progress in this field has allowed little time to effectively evaluate the experience of the intended user. This scoping review aims to examine the development and implementation strategies, and the impact on the end user of eCDS tools that generate alerts using nudge principles, specifically in the critical care and peri-anaesthetic setting.

Methods and analysis

This review will follow the Arksey and O’Malley framework. A search will be conducted of literature published in the last 15 years in MEDLINE, EMBASE, CINAHL, CENTRAL, Web of Science and SAGE databases. Citation screening and data extraction will be performed by two independent reviewers. Extracted data will include context, e-nudge tool type and design features, development, implementation strategies and associated impact on end users.

Ethics and dissemination

This scoping review will synthesise published literature therefore ethical approval is not required. Review findings will be published in topic relevant peer-reviewed journals and associated conferences.

Keywords: adult intensive & critical care, intensive & critical care, paediatric intensive & critical care, anaesthetics, paediatric anaesthesia


Strengths and limitations of this study.

  • This review will provide a comprehensive overview of the development and implementation strategies required to embed the electronic clinical decision support technology in clinical practice.

  • The search strategy includes reviewing six electronic databases with peer-reviewed literature, relevant article bibliographies and a range of grey literature sources.

  • Only articles published in English will be reviewed which may introduce bias and limit generalisability.

Background and rationale

Evidence-based practice amalgamates best research evidence with appropriate clinician experience.1 2 Traditionally, efforts to improve clinician awareness and adherence to evidence-based practice has relied on implementation of up-to-date training that has varied in effectiveness.3–6 Promoting evidence-based practice relies on the clinician’s ability to digest, retain and recall large volumes of information in time-critical and often pressurised environments. Integrating behavioural change techniques with nudge methodologies to augment clinician behaviour by presenting evidence-based treatment recommendations has shown promise in recent years.7–11 Many of us are familiar with receiving recommendations for products when online shopping; this concept is known as ‘nudging’. Simply put, nudging refers to the use of tools to provide information in an environment that subtly guides one to make a decision beneficial to them, without forcing an outcome.12 Electronic or digital nudge (e-nudge) tools use a combination of (i) information technology (IT) design functionality; (ii) information received and disseminated and (iii) interactive elements, to guide user behaviour without restricting freedom of choice.12 The goal of e-nudge tools in healthcare is to augment clinician behaviour, improve healthcare delivery and improve patient outcomes.13

Early models of electronic clinical decision support (eCDS) technologies have used computer-generated algorithms, with evidence-based rule sets, to merely screen data to identify events or patients that needed to be brought to the attention of their clinician.14 eCDS systems may generate an alert in a variety of formats, for example, a pop-up message on screen, pager device and/or text message to a designated mobile device or email. More recent evolution of eCDS tools has led to the integration of nudge principles progressing to the point of presenting clinicians with one or more evidence-based options for clinical treatment or diagnostic modalities in tandem with an alert.15 This offers clinicians a sense of final decision-making autonomy, while steering them towards the most appropriate behaviours or actions. Integrating nudge principles into evidence-based eCDS models in this way aims to standardise detection while optimising treatment plans and resource allocation to the right patient, in the right format, at the right time.16 Existing eCDS tools generating alerts using nudge principles have demonstrated improved adherence to evidence-based practice guidelines, rationalised resource distribution and enhanced multidisciplinary communication.16–21

Critically ill patients are generally the most heterogeneous populations in hospitals with high rates of acute and chronic multimorbidity.22 Therefore, critical care clinicians, and indeed anaesthetists, use numerous evidence-based guidelines in time-critical and, often, pressurised environments. These require accurate retention, recall and application of diverse theoretical knowledge leading to cognitive overload.23 24 eCDS technology using nudge principles can capture validated guidelines in electronic form to prompt and advise clinicians, thereby reducing cognitive overload and assisting clinicians in their clinical decisions. In the critical care and the peri-anaesthetic settings, sophisticated technology with established capability for automated recording of multiple data sources makes these environments ideal for exploiting digitisation and introduction of eCDS tools generating alerts using nudge principles.22–24

Although eCDS technology incorporating nudge techniques have shown beneficial outcomes in antibiotic stewardship, prescribing practices and sepsis, such tools have not been without their problems.20 25–27 They are inconsistently applied by clinicians28 and challenges exist with regard to their acceptability.27 The pace of progress in this field has allowed little time to effectively evaluate the experience of the intended user.29 To design eCDS technology generating alerts using nudge principles for successful implementation, developers need to focus on engaging with key stakeholders to understand how innovative technology dynamically interacts with the pre-existing healthcare culture.13 30 Addressing the challenges during the preparative or prototype phase will ultimately aid overall acceptance of such sophisticated tools.31 This scoping review, therefore, aims to identify literature related to the critical care or peri-anaesthetic area that specifically addresses the development and implementation of eCDS technology with alerts using nudge principles and any associated impact on end users.

Methods

This scoping review will be guided by the five distinct steps of the Arksey and O’Malley framework,32 the Joanna Briggs Institute2 and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews checklist.33 We aim to begin the review in April 2022 and complete it by July 2022. Adjustments may be required to the planned protocol as the review develops. Should this occur, we will report any deviations in the final review with a rationale for the changes.

Step 1: defining the research question

A key component to successful practice change, regardless of the change model followed, is preparation. This scoping review aims to explore the literature focusing on the critical care and peri-anaesthetic setting to identify (i) What type and for what purpose have e-nudge tools been developed? (ii) How have e-nudge tools been developed and by whom? (iii) What implementation strategies or frameworks, if any, have been used? (iv) What evaluation methods, if any, have been used to measure the success of these implementation strategies on end users?

A review of this kind has the potential to shed light on the area of e-nudge tool technology use in the critical and peri-anaesthetic care setting, and provide valuable information on the strengths and weaknesses of implementation strategies.32

Step 2: identifying relevant articles/studies

Through a consultation process within the research team a search strategy has been developed supported by key inclusion criteria. Key inclusion criteria (table 1) were categorised using the simplified population, concept, context34 mnemonic offered by the Joanna Briggs Institute in the updated guidance for scoping reviews.35

Table 1.

Population, concept and context criteria

Population eCDS tool generating alerts using nudge principles from human data
Patient and care providers
Any age from preterm to adulthood
Any sex/ethnic origin
Concept Development, implementation and evaluation of associated impact on end users
eCDS technology generating alerts using nudge principles
Context Articles will not be limited by geographic location
All critical care and peri-anaesthetic inpatient care settings will be examined*

*May extend to acute care inpatient setting if literature yield is insufficient.

eCDS, electronic clinical decision support.

Inclusion

We will include studies conducted in the neonatal, paediatric or adult critical care and peri-anaesthetic settings. Should the search yield few studies, we will extend the search to acute care in hospitals. Studies will be considered that address development, implementation and end user evaluation with preterm (neonatal) to adult participants of any age, sex, ethnicity or geographic location.

Exclusion

We will exclude studies of eCDS nudge technology implemented in the outpatient or community setting. We will exclude eCDS tools whose sole purpose was to screen and alert without the addition of recommending favourable treatment outcomes to the end user.

Search strategy

We will follow the three-step process recommended by the Joanna Briggs Institute.35 Step 1 recommends a preliminary search using one online database. For this, we will use MEDLINE. The proposed search strategy is shown in online supplemental material 1. Step 2 uses an index of keywords and index terms derived from the results of the initial search. Possible terms are shown in table 2. The list of keywords and index terms will be used to perform a second round of searches using the following databases: EMBASE, CINAHL, CENTRAL, Web of Science and SAGE. These databases have been chosen as they cover the vast majority of publications in this area. Following on from database searches an examination of grey literature will be carried out.36 In step 3, we will review the reference lists of all studies identified in steps 1 and 2 to identify any relevant missed studies. The final list of studies will be stored in a reference management package with duplicates removed. Searches will be restricted to the English language.

Table 2.

Search strategy*

Tool identification terms (OR) Process terms (OR)
Clinical decision support Implementation science or implementation
Decision support systems Development
Computer-assisted diagnosis Validation
Computer-assisted decision making Setting terms (OR)
Decision support techniques Critical care or intensive care or ICU
Artificial intelligence Paediatric intensive care units or PICU
Cognitive aid Neonatal intensive care units or NICU
CDSS Peri-operative or anaesthesia or peri-anaesthesia
Nudge Limits
Choice behaviour or decision making or choice architecture or health behaviour English language
<15 years

*Tool identification terms will be combined with process terms and setting terms then limited to the last 15 years and the English language.

Supplementary data

bmjopen-2021-057026supp001.pdf (54.2KB, pdf)

Step 3: study selection

Study selection will be conducted in two phases. First, study citations will be stored in a reference management system (Endnote). LMc will screen titles and abstracts for eligibility using the inclusion/exclusion criteria. The citations will be classified as ‘included’, ‘excluded’ and ‘uncertain’. A second reviewer will check the citations in these citation categories. Any uncertainties will be discussed, and agreement reached between both reviewers. Should conflict arise, a third reviewer may be consulted to reach agreement. Given that the purpose of a scoping review is to present the available evidence in a chosen topic area rather than seeking the best available evidence, quality of evidence presented will not be assessed as part of this review process.

Step 4: charting the data

The process of charting the data refers to the extraction of data from the included studies. By extracting data consistently using a data extraction form (online supplemental material 2), we aim to extract relevant information corresponding to the aims of the scoping review questions. Two reviewers will pilot the data extraction form on a minimum of two studies to ensure reliability. All reviewers will be involved in the data extraction process. Pairs of reviewers will independently extract data from all included studies. Any conflicts or discrepancies in data extraction will be agreed by consultation with a third reviewer. The data extracted will include specific details about the context, focus of the eCDS technology, type of alert, style of nudge principles employed, style of paper (developmental, implementation or evaluation of eCDS tool), how the tool was developed (eg, clinician led or IT developer led) and tested, the implementation strategies and support resources used to introduce the tool in practice and the evaluation strategies used to assess success for end users.

Supplementary data

bmjopen-2021-057026supp002.pdf (106KB, pdf)

Step 5: collating, summarising and reporting the results

We will analyse quantitative data using appropriate descriptive statistics and present the results in tabular form. We will analyse qualitative data using content analysis37 and will summarise and present data in narrative form. All summaries will describe how the results relate to the review aim and questions. As is the norm for scoping reviews, the resulting narrative will not evaluate the strength of the evidence in a quantitative form.33 38 Instead, it will focus on available literature discussing the development and implementation strategies of eCDS tools with alerts using nudge principles to highlight any frameworks reported in the literature and their associated effectiveness in practice.

Patient and public involvement

Patients and/or public were not involved in the design of this scoping review protocol. However, intensive care unit (ICU) survivors and relatives of ICU patients have had significant input in the wider design of the multipart ATTITUDE study. The ATTITUDE study is a pre-intervention and post-intervention quality improvement project using non-participant observations and key informant interviews to design and implement a nudge tool technology to expedite invasive mechanical ventilation weaning in intensive care (ORECNI Research Ethics Committee Ref. 21/NI/0044).

Ethics and dissemination

This scoping review will collect and synthesise data in published literature therefore ethical approval is not required. We anticipate this review will highlight areas where there are gaps in the information that may be explored in future studies. The results will also provide essential information to critical care professionals, information technology experts and behavioural change scientists interested in designing and/or implementing eCDS technology with alerts using nudge principles for clinical practice, particularly in the field of critical care and per-anaesthetic care. Review findings will be published in a peer-reviewed journal and presented at relevant healthcare and computational science conferences.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @LisaMcilmurray

Contributors: LM, MS and BB conceptualised the project and drafted all aspects of the project methodology and manuscript. LL, MD, CG, RH and FK developed aspects of the background and search strategy, in addition to reviewing and commented on all aspects of the manuscript.

Funding: This scoping review will be conducted as part of a larger study funded by The Health Foundation (grant ID 842017).

Competing interests: None declared.

Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Ethics statements

Patient consent for publication

Not applicable.

References

  • 1.Black AT, Balneaves LG, Garossino C, et al. Promoting evidence-based practice through a research training program for point-of-care clinicians. J Nurs Adm 2015;45:14–20. 10.1097/NNA.0000000000000151 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Peters MDJ, Marnie C, Tricco AC, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Implement 2021;19:3–10. 10.1097/XEB.0000000000000277 [DOI] [PubMed] [Google Scholar]
  • 3.Courtright KR, Dress EM, Singh J, et al. Prognosticating outcomes and Nudging decisions with electronic records in the intensive care unit trial protocol. Ann Am Thorac Soc 2021;18:336–46. 10.1513/AnnalsATS.202002-088SD [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Connors AF. A controlled trial to improve care for seriously ill hospitalized patients. The study to understand prognoses and preferences for outcomes and risks of treatments (support). The support principal Investigators. JAMA 1995;274:1591–8. [PubMed] [Google Scholar]
  • 5.Curtis JR, Back AL, Ford DW, et al. Effect of communication skills training for residents and nurse practitioners on quality of communication with patients with serious illness: a randomized trial. JAMA 2013;310:2271–81. 10.1001/jama.2013.282081 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Rangachari P, Rissing P, Rethemeyer K. Awareness of evidence-based practices alone does not translate to implementation: insights from implementation research. Qual Manag Health Care 2013;22:117–25. 10.1097/QMH.0b013e31828bc21d [DOI] [PubMed] [Google Scholar]
  • 7.Komorowski M, Celi LA, Badawi O, et al. The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat Med 2018;24:1716–20. 10.1038/s41591-018-0213-5 [DOI] [PubMed] [Google Scholar]
  • 8.Patel MS, Day SC, Halpern SD, et al. Generic medication prescription rates after health system-wide redesign of default options within the electronic health record. JAMA Intern Med 2016;176:847–8. 10.1001/jamainternmed.2016.1691 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Meeker D, Linder JA, Fox CR, et al. Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial. JAMA 2016;315:562–70. 10.1001/jama.2016.0275 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Patel MS, Volpp KG, Small DS, et al. Using active choice within the electronic health record to increase influenza vaccination rates. J Gen Intern Med 2017;32:790–5. 10.1007/s11606-017-4046-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Takvorian SU, Ladage VP, Wileyto EP, et al. Association of behavioral nudges with high-value evidence-based prescribing in oncology. JAMA Oncol 2020;6:1104–6. 10.1001/jamaoncol.2020.0746 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Jesse M, Jannach D. Digital nudging with recommender systems: survey and future directions. Comput Hum Behav Rep 2021;3:100052. 10.1016/j.chbr.2020.100052 [DOI] [Google Scholar]
  • 13.Harrison JD, Patel MS. Designing Nudges for success in health care. AMA J Ethics 2020;22:E796–801. 10.1001/amajethics.2020.796 [DOI] [PubMed] [Google Scholar]
  • 14.Middleton B, Sittig DF, Wright A. Clinical decision support: a 25 year retrospective and a 25 year vision. Yearb Med Inform 2016;1:S103–16. 10.15265/IYS-2016-s034 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Langford BJ, Leung E, Haj R, et al. Nudging in microbiology laboratory evaluation (NIMBLE): a scoping review. Infect Control Hosp Epidemiol 2019;40:1400–6. 10.1017/ice.2019.293 [DOI] [PubMed] [Google Scholar]
  • 16.Fackler JC, Rehman M, Winslow RL. Please welcome the new team member: the algorithm. Pediatr Crit Care Med 2019;20:1200–1. 10.1097/PCC.0000000000002149 [DOI] [PubMed] [Google Scholar]
  • 17.Bright TJ, Wong A, Dhurjati R, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med 2012;157:29–43. 10.7326/0003-4819-157-1-201207030-00450 [DOI] [PubMed] [Google Scholar]
  • 18.Warttig S, Alderson P, Evans DJ, et al. Automated monitoring compared to standard care for the early detection of sepsis in critically ill patients. Cochrane Database Syst Rev 2018;6:CD012404. 10.1002/14651858.CD012404.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Parks DA, Short RT, McArdle PJ, et al. Improving adherence to intraoperative Lung-Protective ventilation strategies using near real-time feedback and individualized electronic reporting. Anesth Analg 2021;132:1438–49. 10.1213/ANE.0000000000005481 [DOI] [PubMed] [Google Scholar]
  • 20.Selby NM, Hill R, Fluck RJ, et al. Standardizing the early identification of acute kidney injury: the NHS England national patient safety alert. Nephron 2015;131:113–7. 10.1159/000439146 [DOI] [PubMed] [Google Scholar]
  • 21.Selker HP, Beshansky JR, Griffith JL, et al. Use of the electrocardiograph-based thrombolytic predictive instrument to assist thrombolytic and reperfusion therapy for acute myocardial infarction. A multicenter, randomized, controlled, clinical effectiveness trial. Ann Intern Med 2002;137:87–95. 10.7326/0003-4819-137-2-200207160-00006 [DOI] [PubMed] [Google Scholar]
  • 22.Castela Forte J, Perner A, van der Horst ICC. The use of clustering algorithms in critical care research to unravel patient heterogeneity. Intensive Care Med 2019;45:1025–8. 10.1007/s00134-019-05631-z [DOI] [PubMed] [Google Scholar]
  • 23.Faiola A, Srinivas P, Duke J. Supporting clinical cognition: a Human-Centered approach to a novel ICU information visualization Dashboard. AMIA Annu Symp Proc 2015. 2015:560–9. [PMC free article] [PubMed] [Google Scholar]
  • 24.Park J, Zhong X, Dong Y, et al. Investigating the cognitive capacity constraints of an ICU care team using a systems engineering approach. BMC Anesthesiol 2022;22:10. 10.1186/s12871-021-01548-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Downing NL, Rolnick J, Poole SF, et al. Electronic health record-based clinical decision support alert for severe sepsis: a randomised evaluation. BMJ Qual Saf 2019;28:762–8. 10.1136/bmjqs-2018-008765 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Manaktala S, Claypool SR. Evaluating the impact of a computerized surveillance algorithm and decision support system on sepsis mortality. J Am Med Inform Assoc 2017;24:88–95. 10.1093/jamia/ocw056 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Editor M, Johnson M, Vera A. No AI is an island: the case for Teaming intelligence. In: Ai magazine. 40, 2019: 16–28. [Google Scholar]
  • 28.Ruppel H, Liu V. To catch a killer: electronic sepsis alert tools reaching a fever pitch? BMJ Qual Saf 2019;28:693–6. 10.1136/bmjqs-2019-009463 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Giannini HM, Ginestra JC, Chivers C, et al. A machine learning algorithm to predict severe sepsis and septic shock: development, implementation, and impact on clinical practice. Crit Care Med 2019;47:1485–92. 10.1097/CCM.0000000000003891 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Kanagasundaram NS, Bevan MT, Sims AJ, et al. Computerized clinical decision support for the early recognition and management of acute kidney injury: a qualitative evaluation of end-user experience. Clin Kidney J 2016;9:57–62. 10.1093/ckj/sfv130 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Arts DL, Medlock SK, van Weert HCPM, et al. Acceptance and barriers pertaining to a general practice decision support system for multiple clinical conditions: a mixed methods evaluation. PLoS One 2018;13:e0193187. 10.1371/journal.pone.0193187 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005;8:19–32. 10.1080/1364557032000119616 [DOI] [Google Scholar]
  • 33.Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018;169:467–73. 10.7326/M18-0850 [DOI] [PubMed] [Google Scholar]
  • 34.Kao SS, Peters MDJ, Ooi EH. Pediatric tonsillectomy quality of life assessment instruments: a scoping review protocol. JBI Database System Rev Implement Rep 2017;15:1222–7. 10.11124/JBISRIR-2016-003131 [DOI] [PubMed] [Google Scholar]
  • 35.Peters MDJ, Marnie C, Tricco AC, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evidence Synthesis 2020;18:2119–26. 10.11124/JBIES-20-00167 [DOI] [PubMed] [Google Scholar]
  • 36.Adams J, Hillier-Brown FC, Moore HJ, et al. Searching and synthesising 'grey literature' and 'grey information' in public health: critical reflections on three case studies. Syst Rev 2016;5:164. 10.1186/s13643-016-0337-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Tricco AC, Lillie E, Zarin W, et al. A scoping review on the conduct and reporting of scoping reviews. BMC Med Res Methodol 2016;16:15. 10.1186/s12874-016-0116-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Munn Z, Peters MDJ, Stern C, et al. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol 2018;18:143. 10.1186/s12874-018-0611-x [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2021-057026supp001.pdf (54.2KB, pdf)

Supplementary data

bmjopen-2021-057026supp002.pdf (106KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES