Abstract
Objective
Variable rate intravenous insulin infusions (VRIII) is a high-risk medication that has a potential to cause significant patient harm if used in error. Complex preparation of VRIII in clinical areas and the need for frequent monitoring and adjustment increase the complexity of using VRIII. An emerging approach, called Resilient Healthcare, proposes understanding complexity of work by exploring how work is assumed to be done and compare it with everyday work. This study aimed to explore how VRIII is perceived to be used by healthcare practitioners, focusing on one aspect of Resilient Healthcare: understanding how work is assumed to be done, using a method called hierarchical task analysis (HTA).
Design
A qualitative study using document analysis and focus groups.
Setting
A vascular surgery unit in an acute National Health Service teaching hospital in the UK.
Participants
Stakeholders/users in different professional roles involved in the process of using VRIII.
Results
The HTA showed the complexity of using VRIII and highlighted more than 115 steps required to treat elevated blood glucose. The process of producing hospital-specific guidelines was iterative. Careful consideration was taken to coordinate the development and implementation of guidelines. Documents provided detailed clinical instructions related to the use of VRIII but practitioners selectively used them, often in deference to senior colleagues. Intentional adaptations, for example, proactively asking for a VRIII prescription occurred and were acknowledged as part of providing individualised patient care.
Conclusion
Using VRIII to treat elevated blood glucose is a complex but necessary process mediated by a range of factors such as organisational influences. Adaptive strategies to mitigate errors were common and future research can build on insights from this study to develop a broader understanding of how VRIII is used and to understand how adaptations are made in relation to the use of VRIII.
Keywords: diabetes & endocrinology, quality in health care, protocols & guidelines, qualitative research
Strengths and limitations of this study.
To the best of our knowledge, this is the first study to explore Work As Imagined in relation to the use of variable rate intravenous insulin infusions (VRIII).
Multiple data sources, that is, document analysis and focus group meetings were used to understand how work is imagined while using VRIII.
This is the first study that used hierarchical task analysis to illustrate the tasks that were expected to be done while using VRIII.
The low number of focus groups participants might not represent the perspectives of all the staff who might have given different views on the tasks of using VRIII.
Discussions with focus groups participants about the guidelines that were implemented a few years ago may have been a potential source of recall bias.
Introduction
Controlling blood glucose (BG) in hospitalised patients is very important for optimal patient outcomes. Globally, variable rate intravenous insulin infusions (VRIII) is considered the treatment of choice to achieve optimal BG levels in hospital inpatients who are not eatingand those with some acute illnesses, for example, sepsis.1 2 Studies reported in the scientific literature describe benefits from using VRIII to control elevated BG levels, including reduced mortality, less time spent in hospital and improved wound healing.3 4 However, if used incorrectly, it can result in patient harm from hypoglycaemia, rebound hyperglycaemia and diabetic ketoacidosis.5
Complex systems and clinical complexity
Contemporary healthcare systems have been described as complex adaptive system (CAS) where components in a system act in a dynamic network, constantly react in unpredictable and non-linear ways resulting in the emergence of outcomes 6 7 The level of complexity in healthcare systems has increased exponentially with each new diagnostic, therapeutic and technological discovery.8 The use of VRIII is also complex and can result in unpredictable outcomes. A range of factors such as medication-related factors, for example, the limited evidence for a threshold for starting VRIII1; patient-related factors, for example, associated comorbidities9; provider-related factors, for example, fear of hypoglycaemia10; task-related factors, for example, frequent (hourly) BG monitoring1 and hospital-related factors, for example, complex and variable guidelines and staff shortages,9 contribute and influence the clinical complexity of using VRIII.
Safety in the use of VRIII
A variety of national and international interventions and initiatives have been reported to improve the safety of using VRIII, including using advanced glucose monitoring technology that measures BG continuously and alerts for hypoglycaemia or hyperglycaemia episodes,11 specialist diabetes nurses,12 the Think Glucose campaign,13 double checking, standardisation of VRIII guidelines, providing ready-to-administer injectable medications and extra education and training for healthcare staff.14 In the UK, the Joint British Diabetes Societies for Inpatient Care (JBDS-IP) was established in 2008 to improve inpatient diabetes care through standard setting and clinical guidelines development.15 A recent audit assessed the breadth of the JBDS-IP guidelines’ adoption in the UK.15 It was found that 88% of the surveyed hospitals adopted the VRIII guidelines for medical inpatients, and around 58% of healthcare practitioners in these hospitals felt that the guidelines’ adoption had improved clinical outcomes and patient safety.15 Despite the high adoption of the VRIII guidelines and other safety initiatives, the 2018 National Diabetes Inpatient Audit (NaDIA) revealed that the percentage of inappropriate use and duration of use of VRIII have not changed significantly since 2011 and that errors still persist.5 A possible explanation for this is that some traditional safety approaches, for example, standardised practice do not always take into account the constantly changing and complex nature of healthcare systems. Greenhalgh and Papoutsi illustrated the need to design and implement research methods that appreciate dynamic interactions and emergence in CASs, and understand from different perspectives how the whole system works.16 Recent safety literature shows a growing interest in what is called Safety-II, which advocates investigating how things go right instead of only focusing on how a particular failure had happened (Safety-I). Resilient Healthcare (RHC) acknowledges that variability in performance is inevitable. It does not argue for a total replacement of Safety-I with Safety-II, rather proposes that it is necessary to focus on how everyday work can be performed successfully (what goes right) as well as how work has failed (what can go wrong) in order to improve safety.17 18 Various data collection methodshave been used to study RHC, including using the four capabilities of RHC, that is, respond, monitor, anticipate and learn, investigating performance variability and Work As Done (WAD) and integrating RHC with other safety paradigms.17
Modelling ‘work as imagined’
Work is defined as a physical or cognitive effort/activity directed toward achieving a specific goal or task.19 This study is part of a wider project for which there is a published protocol.20 There have been many research studies discussing the quality of different process modelling approaches.21 22 Although a sequential flow diagram is considered the most commonly used process mapping approach in healthcare, there have been precedents for using hierarchical task analysis (HTA) for analysing and mapping complex healthcare systems.23 24 An HTA is known as a prerequisite task analysis that is developed from general to specific. HTA answers what must the user know or do to achieve the goal.25 However, the sequential process map is developed step by step and linearly to answer what are the methods that the user must go through in order to complete a specific activity.26 Colligan et al conducted a study to examine the effect of a sequential flow diagram and HTA on the healthcare practitioner’s judgement. The results of that study found that HTA was easier to produce graphically and review as the mapping progressed, flexible in representing specific goals which did not correspond to specific acts or times, and encompassing unpredictability of healthcare activities with a focus on goal rather than the precise method. HTA is one of the most commonly used task analysis techniques27 to understand and analyse the complexity of the work. In this study, HTA was used to investigate work is imagined (WAI) in the use of VRIII from different perspectives. HTA was developed based on the theory of performance and has been used to describe system dynamics and human-system interfaces.28 HTA is a flexible and generic tool and has been applied in different domains25 27 such as in the process control and power generation industries and recently in medication administration and management.29 30 The use of VRIII is driven by the need to identify and achieve the goal of patient care despite the variability in patients, availability of staff and the demands on the system.
Study aim
In this study, we aimed to systematically explore WAI when using VRIII from multiple perspectives. The findings of this study may be the first step for healthcare practitioners and policy makers to create robust understanding of the reality of WAI to improve patient safety in relation to the use of VRIII.
Methods
Study design
This research drew on the constructivism paradigm, which emphasises the importance of the context in the process of knowledge construction and accumulation.31 This paradigm shaped our view of what type of knowledge about WAI would be of value.32 For the purpose of this study, a descriptive, systematic approach was applied to establish empirical data with a view to exploring how WAI in the use of VRIII.33 The researchers interpreted and analysed data from documents and focus groups (FGs) drawing on their own experiences, in order to construct a deep understanding of WAI as it is described in the guidelines and how practitioners think they use the VRIII guidelines. This study was conducted in three phases: (1) document analysis; (2) FG discussions; (3) the development of the HTA by merging of the data from both sources. Figure 1 illustrates the study phases to represent WAI in the use of VRIII.
Figure 1.
Diagram summarising the three different phases of the study. VRIII, variable rate intravenous insulin infusions.
Study setting
The study was conducted at the vascular surgery unit of an acute National Health Service (NHS) teaching hospital in the UK.
Phase 1: document analysis
All current hospital-specific documents that described key tasks related to the use of VRIII to treat elevated BG in adult in-patients, such as indications for use, prescribing, administration, monitoring, adjusting infusion rates and transition to other medication, and were readily available on the hospital’s intranet (see box 1), were included. These documents were used to develop understanding and discover insights relevant to what is expected when using VRIII.
Box 1. Documents related to the use of variable rate intravenous insulin infusions (VRIII).
Guidelines for VRIII in adults.
Guidelines for management of diabetic ketoacidosis in adults.
Guidelines for management of hyperosmolar hyperglycaemic state in adults.
Managing diabetes in adult inpatients before, during and after operations and procedures.
The management of hypoglycaemia in adult inpatients.
Hand hygiene policy.
Aseptic non-touch technique (peripheral and central access intravenous therapy).
Recording Line Insertion and Visual Infusion Phlebitis Score.
Patient identification policy.
Visual Infusion Phlebitis Score.
Procedure for preparing and administering injectable medicines.
Phase 2: FGs
Sample
A purposive sample of stakeholders/users with different key responsibilities (guidelines developers, managers and healthcare practitioners) involved in treating elevated BG using VRIII were recruited. There is no definite sample size for qualitative research. It depends on a range of factors including the underpinning methodology, the scope of the research question, and the resources available.34 Summary information about FG participants’ characteristics can be found in Table 1.
Table 1.
Characteristics of focus groups (FG) participants
| FG1 guidelines developers | FG2 managers | FG3 healthcare practitioners | |
| Sample | Diabetes consultants, pharmacist and diabetes specialist nurses. | Nurses (ward manager, deputy sister, diabetes nurse specialist and diabetes link nurse that is, registered nurse with an expressed interest in diabetes and a formal link to diabetes specialist team). | Foundation year doctors (medical graduates entering the medical workforce as ‘junior doctors’ on a 2-year work-based training programme) and Nurses (Sister/Charge Nurse). |
| Role | Develop and disseminate guidelines for the use of IV insulin infusions. | Implement guidelines, allocate resourcesand staff training. Diabetes Link Nurse acts as a conduit between front line practitioners and the inpatient diabetes specialist team. | Work at the vascular surgery unit using intravenous insulin infusions and do not have a management role. |
| No of potential participants | 4 | 10 | 20 |
| No of recruited participants (%) | 4 (100) | 3 (30) | 4 (20) |
Recruitment
Participant recruitment for the three FGs was undertaken over 6 months (December 2018–May 2019). Specifically, the hospital collaborator sent an email invitation letter and participant information sheet outlining the purpose of the study to potential participants for FGs 1 and 2. The clinical and managerial leads sent an email invitation letter and participant information sheet for FG3. The researcher attended two ward meetings to meet as many healthcare practitioners as possible to explain the aim and methods of the study. Interested participants contacted the researcher directly via email. On the day of the FG and prior to the session, the researcher explained the study to the participants again, allowed time for any other questions they may have about the study and took informed consent.
Data collection
The three FG meetings took place in a quiet meeting room at the vascular surgery unit and lasted approximately 30–45 min, each. The research team, including the hospital collaborator, developed the FG topic guide (see online supplemental file 1). The topic guide was informed by the results of the document analysis. A topic guide included open-ended questions, and a case scenario of treating elevated BG was used in all FG meetings to discuss the treatment plan based on their understanding of the VRIII guidelines used in their hospital. MHI (PhD candidate, pharmacist) moderated all the FG meetings. All meetings were audiorecorded, and the recordings transcribed verbatim.
bmjopen-2020-041848supp001.pdf (117.1KB, pdf)
Phase 3: data analysis
Data gathered from both documents and FG meetings were analysed using both inductive and deductive analytical approaches. The analysis began by analysing documents deductively, codes were determined based on the literature to provide details on the key tasks in the process of treating elevated BG using VRIII. Coding for the documents was conducted by a single researcher (MHI) with the aid of NVivo V.12, a qualitative data management software. Initial codes were then discussed within the research team (MHI, RL and KR) and mutually refined until they reached consensus.
After the initial stage of document analysis was completed, FG transcripts were analysed using both inductive and deductive analytical approaches. To enhance credibility, three of the authors participated in analysing the transcripts. MHI, RL and KR independently coded the transcripts. The three researchers discussed their codes until they reached consensus. Then codes from documents and FGs were constructed into candidate categories. For example, initial codes relating to preparing guideline were identified as ‘best practice’ (MHI), ‘consensus, no robust evidence’ (KR), and ‘contextualise the national guidelines’ (RL). Working together, MHI, RL and KR reinterpreted these codes into ‘understand the context’. The categories from both document analysis and FGs were combined and refined according to the HTA objectives of identifying the overall goals, subgoals, subtasks, operations and analysing plans to explain how goals were obtained. HTA development comprised various steps, including defining task under analysis, determining the overall goal, determining task subgoals, breaking down subgoals until an appropriate operation was reached, and analysing plans to explain how goals were reached.27 The HTA was constructed using the Microsoft Visio Professional 2019 software.
Developing the HTA was an iterative process. The researchers identified and agreed on the task under analysis and the overall goals. Three key subgoals from both the documents and FG transcripts were identified, reflecting important patterns in helping to answer the research question. Descriptions of subgoals were used to explain how goals were achieved. The draft HTA was validated with the wider research team and healthcare practitioners from the study hospital to establish the fit between the participants’ views and the researchers’ representation of the final HTA.35
Patient and public involvement
Patients and the public were not involved in the development of the research question, study design, recruitment and conduct of the study.
Results
The final HTA diagram is presented in Figure 2. The overall HTA goal resulting from our analyses and interpretation of the hospital documents and FG participants’ perspectives on how work was imagined in the use of VRIII, was to treat elevated BG in hospitalised patients using VRIII. Three key subgoals were identified: produce hospital-specific VRIII guidelines, implement the guidelines and use the guidelines. Each of these subgoals is presented individually, below. For clarity, representative quotations from participants are reported below; additional quotations can be found in online supplemental files 2 and 3.
Figure 2.
Hierarchical task analysis diagram of the process of treating elevated BG using VRIII. #FG1; *FG2; ˆFG3. APP, as per policy; BG, blood glucose; EPMA, Electronic Prescribingand Medicines Administration; IV, intravenous; JBDS, Joint British Diabetes Societies; MMTC, Medicine Management Therapeutics Committee; NaDIA, National Diabetes Inpatient Audit; PowerPlan, Electronic prescribing and laboratory testbundle based on the local hospital guidelines; QI, Quality Improvement.
bmjopen-2020-041848supp002.pdf (130.1KB, pdf)
bmjopen-2020-041848supp003.pdf (71.6KB, pdf)
Produce hospital-specific VRIII guidelines
A multidisciplinary team, composed of diabetes/acute medicine consultants, pharmacists and adult diabetes inpatient nurse specialists, was responsible for preparing hospital-specific VRIII guidelines. Producing guidelines took place in several iterative stages. ‘Preparing a first draft’ sub-goal was based on several resources such as the relevant JBDS-IP guidelines,2 the NaDIA,5 local incident reports, feedback, audits, quality improvement (QI) projects and intuition. FG1 data showed that all participants perceived ‘reviewing the clinical content and context by multidisciplinary team’ to be vital. Although the JBDS guidelines were used as the standard as they are considered best practice, it was clear that the hospital did not solely rely on these guidelines.
‘That draft was based on loads of previous proformas and sequential learning and then when we done that we initially sent it round our Think Glucose…. So there is not necessarily a really a robust evidence base or, if you look at the JBDS… some of the ones where we could not just follow the template guidelines verbatim’. FG1
The hospital used different resources (eg, consulting the Think Glucose Group, which is a multidisciplinary group of healthcare professionals at the study hospital concerned with inpatient diabetes, an inpatient specialist nursing team who have extensive hands-on experience, and junior doctors) to adapt the national guidelines to make it relevant to their hospital. The guidelines were ‘live’ documents and underwent review, revision and then approved by a committee when required, in appropriate situations.
Implement the guidelines
Second, implement the guidelines started from a formal ‘launch’ of the electronic prescribing and laboratory test care bundle (PowerPlan). This progressed in parallel with widespread communication by ‘making the guidelines available on the hospital intranet’ and accessible to all practitioners, followed by ‘training’ relevant staff about the new guidelines. The importance of informing relevant staff was recognised where ‘launch’ consisted of several subgoals. The subgoal ‘prepare staff group-specific material’ was described by participants in all three FGs. This involved, for example, the adult diabetes inpatient nurse specialists providing a fact sheet to the link nurses, inviting them to explain the rationale of changes made to other nurses. Matrons also sent memos and emails to ward sisters requesting they inform all staff of the new changes.
‘… so he [link nurse] would go to the ward meeting and say this is happening.…, the ward sister, may get a memo from her matron saying please can you get all your staff to revisit this policy? We'd also have ward-based training. So it isn't just one thing, it’s different methods of reinforcing a change of practice or a change of policy’. FG2
‘Train staff how to use the guidelines’ was another major subgoal in the task of implementing guidelines. To accomplish this subgoal:
The guideline developers ensured that new junior doctors were taught how to prescribe VRIII. As the task of prescribing VRIII is complicated, the junior doctors were asked to use the PowerPlan, which was based on the local hospital guidelines. In addition, the doctors sometimes followed a hyperlink on the PowerPlan to access the full guidelines.
Healthcare practitioners indicated that doctors were provided with a generic induction handbook not specific to VRIII as part of the training process when they joined the vascular surgery unit.
Diabetes Link Nurses and ward sisters provided a brief (10 min) ward-based training covering three main points on a topic related to in-hospital diabetes management.
The consultant body used medical grand round meetings to inform doctors about the latest changes and to discuss the rationale of new guidelines (eg, Hyperosmolar Hyperglycaemic State) and provide further information around them.
Feedback was sought within 2 months of implementing the new guidelines, to identify any problems that had arisen, with responses being provided in separate communications.
Update on Diabetes Link Nurse study days: the Diabetes Link Nurses were asked general questions and specifically probed about areas such as how often they managed to complete BG monitoring, where compliance might be difficult and to ascertain whether it was achievable, such as how often they managed to complete BG monitoring.
This way of training was used to gather as much feedback as possible in order to gain awareness of the problems practitioners faced and to devise solutions to them. It was clear from the three FGs that practitioners learnt by observing the practice of senior practitioners. The training and teaching relating to new practices happened through cascading—the ‘chain of influence’ technique36 by which staff influenced one another in making decisions and resolving disagreements.
‘…I think we found out that we don’t have the time or the staff to sit down for an hour and provide in-depth teaching to someone so [they've] started this what they call espresso teaching’. FG3
Use the guidelines
To accomplish this subgoal, almost all participants stated that staff are expected to follow the guidelines to ‘deliver appropriate patient care’. As delivering patient care was perceived to have a direct consequence on patients’ BG treatment, deliver patient care was further decomposed to ten sub-goals, using data from analysing the 11 documents related to the use of VRIII. The ten subgoals were ‘complying with infection control precautions’, ‘identify patient’, ‘gather patient information’, ‘identify the diagnosis’, ‘prescribe’, ‘assemble components of VRIII’, ‘administer’, ‘monitor’, ‘refer for specialist diabetes advice’ and ‘confirm suitability to stop VRIII’. HTA diagrams for each sub-goal can be found in online supplemental file 4. The documents were clear and comprehensive and contained details about the aim, scope, responsibilities, training and monitoring compliance with precautions relating to specific tasks. There were, however, a lack of clarity in a couple of documents. In ‘The Management of Hypoglycaemia in Adult Inpatients Guidelines’, for example, when and at what rate to restart VRIII after managing hypoglycaemia was unclear. In ‘Guidelines for VRIII in Adults’, there was inconsistent guidance for example, it was stated to ‘continue VRIII for one hour after the subcutaneous insulin (SC) has been administered to allow time for the insulin to be absorbed’, while in the summary page it was recommended to ‘stop intravenous insulin at time of first prescribed dose’ of SC insulin. One of the guideline developers was contacted and this inconsistency was rectified. Participants in each FG discussed a variety of ways that are used to review patient care, such as QI projects, audits, comments and feedback from practitioners, and local incident reports.
bmjopen-2020-041848supp004.pdf (1.2MB, pdf)
Almost all participants agreed that the number of deviations from prescribed practice in the hospital was low. FG1 participants highlighted various situations in which healthcare practitioners might deviate, such as new doctors coming from a different Trust that have different guidelines, intentional deviations based on specialist advice related to a patient’s case, difficulty with hourly monitoring for VRIII (resulting in monitoring being done every 2 hours instead of every hour), and the active choice to discontinue long-acting insulin when using VRIII. Unintentional deviation might occur because of challenges within the Electronic Prescribing and Medicines Administration (ePMA). For example, the FG1 participants highlighted that nurses were unclear about the order that prescribed intravenous fluids should be administered. As the ePMA system is not designed to show the order in which fluids are to be administered, FG1 participants emphasised the importance of a separate flow sheet to remind practitioners of the order in which to administer intravenous fluids. FG1 participants respond to deviations by having conversations and asking questions to identify the reasons behind the deviation, giving feedback, finding a compromise, providing immediate informal education, and finally changing the wording of guidelines if required. If deviations become a pattern, the Diabetes Specialist Team would conduct localised education in the ward and modify the content of mandatory training materials.
‘So the insulin, you know the safe use of insulin is mandatory. Training has been modified based on incident and patterns that we see, so serious incidence and patterns that we see’. FG1
Discussion
The HTA showed the complexity of using VRIII by highlighting more than 115 steps required to achieve the key goal of treating elevated BG using VRIII. While HTA is typically applied to represent what people do,29 37 HTA was used in this study to explore the process of treating elevated BG using VRIII. The HTA illustrated how the use of VRIII was expected to be done, and how practitioners use VRIII in a wider system in a hierarchy of goals. The study highlighted three key subgoals.
Produce hospital-specific VRIII guidelines
Producing hospital-specific VRIII guidelines was iterative and inclusive, with different specialities and committees included. Almost all participants described the documents as very practical, clear and user-friendly. The documents contained clear details about the aim, scope, responsibilities, training and monitoring compliance for specific tasks but the documents were written in a technical way that not every novice can understand unless they are very well experienced in hospital work generally and insulin use specifically. The comprehensive documentation could inadvertently result in a negative effect, as the large number of documents related to VRIII could confuse healthcare practitioners. Consistent with previous studies,38 39 however, the importance of this comprehensiveness should not be underestimated; it serves as a backup and has a positive effect on patient safety by providing practitioners with all the information they need for using VRIII.
Implement the guidelines
The training and teaching around new changes to guidelines happens by cascading the ‘chain of influence’ technique, in which members influence one another in making decisions and resolving disagreements.36 This way of training can be expressed as applying tacit knowledge, including skills, experiences, intuition and judgement, that is difficult to transfer to another person by means of writing it down or verbalising it.40 While there was agreement that the hospital environment was very supportive in terms of training and education, there was a mix of proactive and reactive approaches to training new staff. If new staff did not know how to use VRIII, senior staff would train them. Senior staff would inform front-line practitioners about new changes or the training they needed with front-line practitioners often taking on a passive role. The current study showed that specific teaching sessions for junior doctors on using PowerPlan to prescribe VRIII were an essential part of the guidelines’ implementation process to ensure patient safety while using VRIII. Lack of knowledge is one of the key barriers in delivering appropriate diabetes care.41 42 An interventional controlled multicentre study was conducted to assess the impact of a strategy focused on educating healthcare practitioners. The strategy’s impact on the quality of care was limited and there was no significant difference between controlled and interventional hospitals’ education strategies for changing practitioners' behaviour.43 Similarly, a systematic review conducted by Bain et al concerning educational interventions to improve prescribing performance, concluded that education was an important part of QI strategies in insulin prescribing; however, it was less effective when used in isolation.44 It can thus be suggested that further work is needed that directly evaluate the effectiveness of the educational strategies used in the study hospital by exploring how challenging it is to achieve and sustain behaviour change.
Use the guidelines
The majority of the FG participants highlighted the importance of following the guidelines in order to deliver appropriate patient care while using VRIII. This finding is consistent with that of Sampson and Jones who concluded that the growing use of the JBPD-IP guidelines since 2011, has resulted in harm reduction related to the number of hypoglycaemic events and the unnecessary use of insulin infusions.15 Many studies described various challenges with the use of VRIII such as the risk of hypoglycaemia, frequency of monitoring, insufficient nurse-to-patient ratio and confusion about the target BG level.9 10 45 In contrast to previous studies, participants only mentioned two main challenges: sequence of administering intravenous fluids, and frequency of BG monitoring. On the one hand, the findings might not represent all the challenges healthcare practitioners face at hospital; on the other, the results are not necessarily transferable to all the vascular surgery unit healthcare practitioners and the whole Trust.
The general conclusion of earlier evaluations of ePMA systems in hospitals has been that they can improve quality, not least by reducing medication prescribing and administration errors.46–48 However, one recent study found that although pharmacists valued a number of safety features associated with ePMA, they also perceived an overall increase in medication risk.49 In a retrospective audit of VRIII comparing ePMA with bespoke paper proforma, there was improved completion of tasks where prompts were inbuilt but in other areas, completion rates were inconsistent.50 This study found that nurses do not usually refer to the guidelines and doctors use the PowerPlan feature within the ePMA when prescribing. The fact that doctors usually rely on the ePMA might have mixed consequences. On one hand, it might save time in prescribing, as doctors are busy. On the other, if the ePMA system is not working for example, freezes, safety challenges might rise such as delaying patients receiving their medications and affecting the efficiency of ward rounds.
Prescribing intravenous fluids is a complex and an ever changing situation in which indication, fluid type, volume and rate depend on the pathophysiological changes that affect fluid balance in disease states.51 52 In this study, prescribing intravenous fluids on the ePMA found another layer of complexity which was the lack of clarity about the order in which prescribed intravenous fluids should be administered. This result is in line with one study which found that some medications, such as insulin and intravenous fluids, were not safely prescribed using the system because their protocols did not fit easily into the structures embedded in the software.53
The availability of a fully staffed diabetes inpatient team is recommended to enhance patient safety and reduce insulin prescribing errors.54 It has been suggested that the introduction of specialist diabetes pharmacists can support the implementation of insulin-prescribing interventions and decrease the percentage of insulin prescribing errors.55 In this study, although the role of specialist diabetes nurses was reported in all the activities required to treat elevated BG using VRIII, nothing was mentioned about the role of specialist diabetes pharmacists in treating elevated BG using VRIII.
Adaptations to work was part of everyday work. Although the general thinking between participants was about errors and how to avoid them (Safety I), guideline developers explicitly acknowledged the occurrence of intentional deviation from guidelines, as patients’ treatment should be individualised based on their situation. Nurses usually anticipate the needs of patients prior to surgery and sometimes proactively ask for a VRIII prescription, but doctors do not always provide such prescriptions as doing so may not be appropriate for the patient. There seems to be a need for careful thinking about flexibility and trade-offs in practice, and to set and define patient safety boundaries. These results reflect those of Vos et al, which showed that some behaviours that might be considered deviations from best practice when administering intravenous infusions resulted from reasoned clinical judgement by nurses with the aim of improving patient care.56
The HTA provided a better understanding from multiple perspectives of the use of VRIII, and of organisational influences such as how policies and guidelines were written, what was permitted, and how mandatory training was expected to be conducted. These results are broadly consistent with those of Raduma-Tomàs et al, who found that the application of the HTA provided a detailed description of the doctors’ handover process, enabled the identification of strengths and weaknesses in the performance of handover activities, and allowed for specific problems to be targeted for improvement.57 HTA has been used in health information technology by modifying existing designs or creating new ones.58 59 Roosan et al used HTA and interactive infographics to develop a mobile prototype designed to deliver the patient package-insert information for the medication risperidone in an interactive way that helped patients gain an improved overall knowledge of the medication.58 Another study used HTA to assess the effect of implementing new health information technology on the workflow of the medication administration process.60 Its analysis of the HTA diagrams resulted in providing 15 recommendations for healthcare facilities to facilitate the transition to the new health information technology system.60 The developed HTA could serve as an effective form of system documentation, enable guidelines developers to redesign guidelines and protocols based on the developed HTA, and help software engineers to gain familiarity with the tasks required while using VRIII in a systematic way which may enhance the design and usability of electronic systems as well as their ability to support individual/organisational contexts of use.
Clinical implications
WAI surrounding the use of VRIIIs was mainly related to the production, implementation and use of VRIII guidelines used in the study hospital. As the guidelines were implemented and used as part of the ePMA system, system designers in the study site may be able to use the developed HTAs to understand which trigger point of clinical care they can use to change and improve patient safety. For example, the study found that the ePMA system was not designed to show nurses the order in which fluids need to be administered—which makes it difficult for nurses to make the appropriate decisions. System designers might reduce the confusion by redesigning the ePMA system in a way that would enable doctors to prescribe intravenous fluids in a certain order and nurses to receive intravenous fluids prescriptions as graphs plotted from a timeline perspective.61 Data visualisation can reduce cognitive load and the amount of information needed to be searched before making decisions.62 63 A recent study found that developing a web-based timeline software, that graphically displays administered medication (y-axis) against time (x-axis), improved healthcare practitioners' interactions with the medical record system.63 The graphical timeline software allowed healthcare practitioners to click on a medication name to display specific dosing and timing which resulted in reducing the time spent on medication review and easing the viewing of medication administration.63 In the study site, developing an intravenous fluids graphical timeline software that shows the order of administering the prescribed intravenous fluids may reduce the confusion in administering intravenous fluids and improve confidence in deciding the order of intravenous fluids administration without delay.
Another example of a trigger point of care that might be improved is the task of frequent BG monitoring, especially given the growing challenges facing the NHS, for example, the shortage of healthcare practitioners and the current pressure forced on healthcare practitioners by the Coronavirus (COVID-19) pandemic,64 65 which makes it difficult for this task to be conducted hourly. Evidence suggests that in-hospital use of continuous glucose monitoring (CGM) provides a practical alternative to frequent inpatient fingerstick testing. CGM works by inserting a sensor subcutaneously to measure the glucose level in the interstitial fluid, and results are provided every 5–10 min, 24 hours a day.64 CGM incorporates predictive alerts for hypoglycaemia or hyperglycaemia which can be directly integrated into the electronic health record to alert the healthcare practitioners before the glucose sensor reaches the low or high threshold.66 Considering the implementation of this technology may decrease the burden of glucose monitoring for healthcare practitioners and decrease the risk of hypo/hyperglycaemia events.
Strengths and limitations
The application of HTA revealed the importance of in-depth understanding of how WAI and how guidelines are used to treat elevated BG using VRIII. Methodologically, this is the first study to explore WAI in relation to the use of VRIII using the HTA. Future research can build on insights from the study findings, and indicate how and where within the BG treatment process safety challenges might occur, thus allowing for specific challenges to be targeted and extraordinary work/adaptations to be highlighted to improve patient safety when using VRIII. Limitations associated with this study include the subjectivity of the healthcare professionals who participated in the FGs. The low number of staff who participated, especially in FGs 2 and 3, means that this analysis may not represent the perspectives of all the staff who use VRIII. Other participants might have given different views on the process of using VRIII. However, by purposive sampling of a diverse range of practitioners, this risk may have been somewhat mitigated. The purpose of qualitative studies is not to replicate or generalise the findings, however, qualitative studies are concerned with credibility and transferability.67 Although the results from qualitative studies of small sample size may not always statistically represent the whole population of interest; they are qualitatively transferable. In this study, credibility and transferability were ensured by using a member check technique to confirm the accuracy of the developed HTAs, data triangulation using two data sources (documents and FGs) and thorough, detailed description of the contexts relating to the use of VRIIIs and the participants' accounts. Finally, it is necessary to acknowledge that guidelines discussed in this study were implemented a number of years ago and participants were not given a topic guide prior to the discussions hence there could be recall bias. In hindsight, it would be better to provide participants with key discussion topics, so they have time to consider past events before the FG meetings.
Conclusion
This study set out to understand from various perspectives how VRIII were expected to be used to treat elevated BG in the clinical environment. Using the HTA methodology, a detailed and systematic description of the tasks needed to use VRIII was successfully developed. The novel exploration of WAI within this context has important implications, revealing that the tasks required to treat elevated BG using VRIII are far more complex than merely implementing and adhering to national guidelines. Specifically, the complexity was found in various tasks/subtasks including understanding the context, prescribing intravenous fluids using ePMA and BG monitoring frequency. These complexities have been shown herein to play a key role and have possible broader implications in different healthcare context with similar challenges. Various strategies were expected to be used to enhance safety while using VRIII, among them training and intentional deviations/adaptations. However, further work is required to extend the scope for understanding how VRIII is used by assessing the impact and efficacy of the reported strategies on the actual process of using VRIII. The study results provided a deep understanding of the reality of WAI. The next stage is to conduct video observations20 in order to understand how guidelines are used in practice, situations where the guidelines could not be delivered as written, type of challenges and context-dependent adaptations and to explore the gap/misalignments between WAI and WAD in order to find strategies to minimise the gap to improve patient care delivery.
Supplementary Material
Acknowledgments
We would like to thank every participant for their involvement in this study.
Footnotes
Twitter: @Mais_iflaifel, @rosemaryhlim
Contributors: MHI, RL, KR, CC and FG conceived and designed the study. CC and MHI facilitated the recruitment of the participants. MHI was responsible for data collection with support and guidance from RL, CC and KR. MHI, RL and KR coded and analysed the data. MHI drafted the initial manuscript and the HTA. All authors edited the HTAs and CC extensively reviewed and commented on the HTA. All authors extensively edited drafts of the manuscript and accepted the final version of the manuscript.
Funding: This work was supported by University of Reading [grant numbers GS16-123, 2017].
Competing interests: None declared.
Patient consent for publication: Not required.
Ethics approval: The study was approved by the University of Reading Research Ethics Committee (UREC) (ref: 18/03), NHS Research Ethics Committee (REC) and Health Research Authority (HRA) (ref: 18/SC/0456).
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement: Data are available on reasonable request. The unpublished data used and/or analysed during the current study are available from the corresponding author on reasonable request.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
References
- 1.American Diabetes Association . 15. Diabetes care in the hospital: standards of medical care in diabetes-2020. Diabetes Care 2020;43:S193–202. 10.2337/dc20-S015 [DOI] [PubMed] [Google Scholar]
- 2.George S, Dale J, Stanisstreet D, et al. A guideline for the use of variable rate intravenous insulin infusion in medical inpatients. Diabet Med 2015;32:706–13. 10.1111/dme.12756 [DOI] [PubMed] [Google Scholar]
- 3.Furnary AP, Wu Y, Bookin SO. Effect of hyperglycemia and continuous intravenous insulin infusions on outcomes of cardiac surgical procedures: the Portland diabetic project. Endocr Pract 2004;10:21–33. 10.4158/EP.10.S2.21 [DOI] [PubMed] [Google Scholar]
- 4.Umpierrez GE, Hellman R, Korytkowski MT, et al. Management of hyperglycemia in hospitalized patients in non-critical care setting: an endocrine Society clinical practice guideline. J Clin Endocrinol Metab 2012;97:16–38. 10.1210/jc.2011-2098 [DOI] [PubMed] [Google Scholar]
- 5.NHS Digital . The 2017 national diabetes inpatient audit (NaDIA) annual report England and Wales, 2018. [Google Scholar]
- 6.Plsek PE, Greenhalgh T. Complexity science: the challenge of complexity in health care. BMJ 2001;323:625–8. 10.1136/bmj.323.7313.625 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Braithwaite J, Clay-Williams R, Nugus P. Health care as a complex adaptive system. : Hollnagel E, Braithwaite J, Wears RL, . Resilient health care. Farnham, Surrey: Ashgate Publishing, 2013: 57–73. [Google Scholar]
- 8.Islam R, Weir C, Del Fiol G. Clinical complexity in medicine: a measurement model of task and patient complexity. Methods Inf Med 2016;55:14–22. 10.3414/ME15-01-0031 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Gosmanov AR. A practical and evidence-based approach to management of inpatient diabetes in non-critically ill patients and special clinical populations. J Clin Transl Endocrinol 2016;5:1–6. 10.1016/j.jcte.2016.05.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Kelly JL. Continuous insulin infusion: when, where, and how? Diabetes Spectr 2014;27:218–23. 10.2337/diaspect.27.3.218 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.DeSalvo D, Buckingham B. Continuous glucose monitoring: current use and future directions. Curr Diab Rep 2013;13:657–62. 10.1007/s11892-013-0398-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Kerr M. Inpatient care for people with diabetes: the economic case for change, 2011. Available: https://www.diabetes.org.uk/resources-s3/2017-10/Inpatient%20Care%20for%20People%20with%20Diabetes%20%20The%20Economic%20Nov%202011_1.pdf [Accessed 26 Apr 2020].
- 13.Ryder B, Burbridge W, Braycotton L, et al. Inpatient diabetes: do-it-yourself electronic referral system to support and enhance the think glucose project. Practical Diabetes 2014;31:194–6. 10.1002/pdi.1864 [DOI] [Google Scholar]
- 14.National Patient Safety Agency . Promoting safer use of injectable medicines. patient safety alert 20 2007. Available: www.npsa.nhs.uk/EasySiteWeb/GatewayLink.aspx?alId=2269
- 15.Sampson M, Jones C, Joint British Diabetes Societies (JBDS) for Inpatient Care . Joint British diabetes societies for inpatient care: clinical guidelines and improving inpatient diabetes care. Diabet Med 2018;35:988–91. 10.1111/dme.13672 [DOI] [PubMed] [Google Scholar]
- 16.Greenhalgh T, Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Med 2018;16:95. 10.1186/s12916-018-1089-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Braithwaite J, Wears RL, Hollnagel E. Resilient health care: turning patient safety on its head. Int J Qual Health Care 2015;27:418–20. 10.1093/intqhc/mzv063 [DOI] [PubMed] [Google Scholar]
- 18.Iflaifel M, Lim RH, Ryan K, et al. Resilient health care: a systematic review of conceptualisations, study methods and factors that develop resilience. BMC Health Serv Res 2020;20:324. 10.1186/s12913-020-05208-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Medical Dictionary for the Health Professions and Nursing . Work 2012. Available: https://medical-dictionary.thefreedictionary.com/work [Accessed 15 Jun 2020].
- 20.Iflaifel MH, Lim R, Ryan K, et al. Understanding safety differently: developing a model of resilience in the use of intravenous insulin infusions in hospital in-patients-a feasibility study protocol. BMJ Open 2019;9:e029997. 10.1136/bmjopen-2019-029997 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Jun GT, Ward J, Morris Z, et al. Health care process modelling: which method when? Int J Qual Health Care 2009;21:214–24. 10.1093/intqhc/mzp016 [DOI] [PubMed] [Google Scholar]
- 22.Lyons M. Towards a framework to select techniques for error prediction: supporting novice users in the healthcare sector. Appl Ergon 2009;40:379–95. 10.1016/j.apergo.2008.11.004 [DOI] [PubMed] [Google Scholar]
- 23.O'Donnell JM, Goode JS, Henker RA, et al. An ergonomic protocol for patient transfer that can be successfully taught using simulation methods. Clin Simul Nurs 2012;8:e3–14. 10.1016/j.ecns.2010.05.003 [DOI] [Google Scholar]
- 24.Colligan L, Anderson JE, Potts HWW, et al. Does the process MAP influence the outcome of quality improvement work? A comparison of a sequential flow diagram and a hierarchical task analysis diagram. BMC Health Serv Res 2010;10:7. 10.1186/1472-6963-10-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Annett J. Hierarchical task analysis. : Hollnagel E, . Hand book of cognitive task design. New Jersey: Lawrence Erlbaum Associates, 2003: 17–35. [Google Scholar]
- 26.Heher YK, Chen Y, Yigu C. Process mapping: a cornerstone of quality improvement. Cancer Cytopathol 2017;125:887–90. 10.1002/cncy.21946 [DOI] [PubMed] [Google Scholar]
- 27.Stanton NA, Salmon PM, Rafferty LA. Human factors methods: a practical guide for engineering and design. 2nd ed. England: Ashgate, 2013. [Google Scholar]
- 28.Stanton NA. Hierarchical task analysis: developments, applications, and extensions. Appl Ergon 2006;37:55–79. 10.1016/j.apergo.2005.06.003 [DOI] [PubMed] [Google Scholar]
- 29.Lane R, Stanton NA, Harrison D. Applying hierarchical task analysis to medication administration errors. Appl Ergon 2006;37:669–79. 10.1016/j.apergo.2005.08.001 [DOI] [PubMed] [Google Scholar]
- 30.Medication management in community care: using hierarchical task analysis to describe complex systems. Contemporary Ergonomics & Human Factors 2017: Proceedings of the Annual Conference of the Chartered Institute of Ergonomics & Human Factors. Daventry, Northamptonshire, UK 2017.
- 31.Gray D. Doing research in the real world. 3rd edn. London: SAGE, 2014. [Google Scholar]
- 32.Hollnagel E, Braithwaite J, Wears R. Delivering resilient health care. Abingdon, Oxon: Routledge, 2019. [Google Scholar]
- 33.Havinga J, Dekker S, Rae A. Everyday work investigations for safety. Theor Issues Ergon Sci 2018;19:213–28. 10.1080/1463922X.2017.1356394 [DOI] [Google Scholar]
- 34.Holloway I. Qualitative research in health care. McGraw-Hill International (UK) LTD, 2005. [Google Scholar]
- 35.Lincoln YS, Guba EG, Pilotta JJ. Naturalistic inquiry. Newbury Park, CA: SAGE, 1985: 438–9. [Google Scholar]
- 36.Hage J. Hierarchy. : Nicholson N, . The Blackwell encyclopedic dictionary of organizational behavior. 212. John Wiley and Sons Ltd, 1995. [Google Scholar]
- 37.Chana N, Porat T, Whittlesea C, et al. Improving specialist drug prescribing in primary care using task and error analysis: an observational study. Br J Gen Pract 2017;67:e157–67. 10.3399/bjgp17X689389 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Thapa N, Goldberg M, Weiss I. Abstract #321: efficacy and safety of a computerized intravenous insulin dosing protocol in the critical care setting. Endocrine Practice 2016;22:98. 10.1016/S1530-891X(20)45029-3 [DOI] [Google Scholar]
- 39.Taylor BE, Schallom ME, Sona CS, et al. Efficacy and safety of an insulin infusion protocol in a surgical ICU. J Am Coll Surg 2006;202:1–9. 10.1016/j.jamcollsurg.2005.09.015 [DOI] [PubMed] [Google Scholar]
- 40.Dampney K, Busch P, Richards D. The meaning of tacit knowledge. Australasian J Inform Sys 2007;10. [Google Scholar]
- 41.Hommel I, van Gurp PJ, den Broeder AA, et al. Reactive rather than proactive diabetes management in the perioperative period. Horm Metab Res 2017;49:527–33. 10.1055/s-0043-105501 [DOI] [PubMed] [Google Scholar]
- 42.Hommel I, van Gurp PJ, Tack CJ, et al. Perioperative diabetes care: room for improving the person centredness. Diabet Med 2015;32:561–8. 10.1111/dme.12600 [DOI] [PubMed] [Google Scholar]
- 43.Hommel I, Wollersheim H, Tack CJ, et al. Impact of a multifaceted strategy to improve perioperative diabetes care. Diabet Med 2017;34:278–85. 10.1111/dme.13130 [DOI] [PubMed] [Google Scholar]
- 44.Bain A, Hasan SS, Babar Z-U-D. Interventions to improve insulin prescribing practice for people with diabetes in hospital: a systematic review. Diabet Med 2019;36:948–60. 10.1111/dme.13982 [DOI] [PubMed] [Google Scholar]
- 45.Kolanczyk DM, Dobersztyn RC. Challenges with insulin in the inpatient setting. Diabetes Spectr 2016;29:146–52. 10.2337/diaspect.29.3.146 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Franklin BD, O'Grady K, Donyai P, et al. The impact of a closed-loop electronic prescribing and administration system on prescribing errors, administration errors and staff time: a before-and-after study. Qual Saf Health Care 2007;16:279–84. 10.1136/qshc.2006.019497 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Franklin BD, Jacklin A, Barber N. The impact of an electronic prescribing and administration system on the safety and quality of medication administration. Int J Pharm Pract 2008;16:375–9. 10.1211/ijpp.16.6.0006 [DOI] [Google Scholar]
- 48.Fowlie F, Bennie M, Jardine G. Evaluation of an electronic prescribing and administration system in a British Hospital. Pharm J 2000;265. [Google Scholar]
- 49.McLeod M, Karampatakis GD, Heyligen L, et al. The impact of implementing a hospital electronic prescribing and administration system on clinical pharmacists' activities - a mixed methods study. BMC Health Serv Res 2019;19:156. 10.1186/s12913-019-3986-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Leon C, Crowley C. Intravenous Insulin Infusions after the implementation of an electronic prescribing system [Poster]. UKCPA Pharmacy Together Conference Hammersmith 2019.
- 51.National Institute for Health and Care Excellence . CG174: intravenous fluid therapy in adults in hospital, 2017. Available: https://www.nice.org.uk/guidance/CG174 [Accessed 09 Oct 2020]. [PubMed]
- 52.Mathur A, Johnston G, Clark L. Improving intravenous fluid prescribing. J R Coll Physicians Edinb 2020;50:181–7. 10.4997/JRCPE.2020.224 [DOI] [PubMed] [Google Scholar]
- 53.Barber N, Cornford T, Klecun E. Qualitative evaluation of an electronic prescribing and administration system. Qual Saf Health Care 2007;16:271–8. 10.1136/qshc.2006.019505 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Watts E, Rayman G. Making hospitals safe for people with diabetes diabetes UK, 2018. [Google Scholar]
- 55.Bain A, Hasan SS, Kavanagh S, et al. Strategies to reduce insulin prescribing errors in UK hospitals: results from a national survey. Diabet Med 2020;37:1176–84. 10.1111/dme.14209 [DOI] [PubMed] [Google Scholar]
- 56.Vos J, Franklin BD, Chumbley G, et al. Nurses as a source of system-level resilience: secondary analysis of qualitative data from a study of intravenous infusion safety in English hospitals. Int J Nurs Stud 2020;102:103468. 10.1016/j.ijnurstu.2019.103468 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Raduma-Tomàs MA, Flin R, Yule S, et al. The importance of preparation for doctors' handovers in an acute medical assessment unit: a hierarchical task analysis. BMJ Qual Saf 2012;21:211–7. 10.1136/bmjqs-2011-000220 [DOI] [PubMed] [Google Scholar]
- 58.Roosan D, Li Y, Law A, et al. Improving medication information presentation through interactive visualization in mobile Apps: human factors design. JMIR Mhealth Uhealth 2019;7:e15940. 10.2196/15940 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Phipps DL, Meakin GH, Beatty PCW. Extending hierarchical task analysis to identify cognitive demands and information design requirements. Appl Ergon 2011;42:741–8. 10.1016/j.apergo.2010.11.009 [DOI] [PubMed] [Google Scholar]
- 60.Huang Y-H, Gramopadhye AK. Recommendations for health information technology implementation in rural hospitals. Int J Health Care Qual Assur 2016;29:454–74. 10.1108/IJHCQA-09-2015-0115 [DOI] [PubMed] [Google Scholar]
- 61.Islam R, Mayer J, Clutter J. Supporting novice clinicians cognitive strategies: system design perspective. IEEE EMBS Int Conf Biomed Health Inform 2016;2016:509–12. 10.1109/BHI.2016.7455946 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Belden JL, Wegier P, Patel J, et al. Designing a medication timeline for patients and physicians. J Am Med Inform Assoc 2019;26:95–105. 10.1093/jamia/ocy143 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Gordon WJ, Bhan I. Graphical timeline software for inpatient medication review. Health Informatics J 2019;25:62–70. 10.1177/1460458216682355 [DOI] [PubMed] [Google Scholar]
- 64.Galindo RJ, Aleppo G, Klonoff DC, et al. Implementation of continuous glucose monitoring in the hospital: emergent considerations for remote glucose monitoring during the COVID-19 pandemic. J Diabetes Sci Technol 2020;14:822–32. 10.1177/1932296820932903 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.NHS Improvement . Performance of the NHS provider sector for the quarter ended 31 December 2018, 2018. Available: https://improvement.nhs.uk/resources/quarterly-performance-nhs-provider-sector-quarter-3-201819/ [Accessed 30 Sep 2020].
- 66.Espinoza J, Shah P, Raymond J. Integrating continuous glucose monitor data directly into the electronic health record: proof of concept. Diabetes Technol Ther 2020;22:570–6. 10.1089/dia.2019.0377 [DOI] [PubMed] [Google Scholar]
- 67.Korstjens I, Moser A. Series: practical guidance to qualitative research. Part 4: Trustworthiness and publishing. Eur J Gen Pract 2018;24:120–4. 10.1080/13814788.2017.1375092 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2020-041848supp001.pdf (117.1KB, pdf)
bmjopen-2020-041848supp002.pdf (130.1KB, pdf)
bmjopen-2020-041848supp003.pdf (71.6KB, pdf)
bmjopen-2020-041848supp004.pdf (1.2MB, pdf)


