Skip to main content
PLOS One logoLink to PLOS One
. 2021 Feb 25;16(2):e0247499. doi: 10.1371/journal.pone.0247499

Time spent by hospital personnel on drug changes: A time and motion study from an in-and outpatient hospital setting

Joo Hanne Poulsen 1,*,#, Lotte Stig Nørgaard 1, Peter Dieckmann 2,3,4, Marianne Hald Clemmensen 5,#
Editor: Susan Horton6
PMCID: PMC7906352  PMID: 33630933

Abstract

Introduction

Medicines used at Danish public hospitals are purchased through tendering. Together with drug shortage, tendering result in drug changes, known to compromise patient safety, increase medicine errors and to be resource demanding for healthcare personnel. Details on actual resources required in the clinic setting to manage drug changes are unknown. The aim of the study is to explore time spend by hospital personnel in a drug change situation when dispensing medicine to in- and outpatients in a hospital setting in the Capital Region of Denmark.

Method

A time and motion study, using direct observation combined with time-registration tools, such as eye-tracking, video recording and manual time tracking. Data were obtained from observing nurses and social and health care assistants with dispensing authority while dispensing or extraditing medicine before and after the implementation of drug changes in two clinical setting; a cardiology ward and a rheumatology outpatient clinic.

Results

Hospital personnel at the cardiology inpatient ward spent 20.5 seconds on dispensing a drug, which was increased up to 28.4 seconds by drug changes. At the rheumatology outpatient clinic, time to extradite medicine increased from 8 minutes and 6 seconds to 15 minutes and 36 seconds by drug changes due to tender. Similarly, drug changes due to drug shortage prolonged the extradition time to 16 minutes and 54 seconds. Statistical analysis reveal that drug changes impose a significant increase in time to dispense a drug for both in- and outpatients.

Conclusion

Clinical hospital personnel spent significantly longer time on drug change situations in the dispensing of medicine to in- and outpatients in a hospitals. This study emphasizes that implementing drug changes do require extra time, thus, the hospital management should encounter this and ensure that additional time is available for the hospital personnel to ensure a safe drug dispensing process.

Introduction

Healthcare systems worldwide are under constant economic restraints. With the increasing use of medicine and new expensive medical treatments, healthcare expenses are increasing globally [1]. In Denmark, hospital medicine expenses have increased from DKK 4.3 billion in 2007 to DKK 7.9 billion in 2015 [2]. These expenditures will continue to grow driven by the development of new, highly priced drugs together with the increasing number of patients requiring treatment due to demographic changes [36]. Consequently, there is an urgent need to utilize and optimize healthcare resources.

In Denmark, the principles of the healthcare system, primarily funded by tax, are based on a free and equal access to healthcare to all citizens [6]. Medical treatment is free of charge for patients admitted to a hospital, just as some patients get medicine extradited and free of charge for self-administration through outpatient clinics at hospitals [6]. Medicines used at public hospitals are purchased through tendering and procurement maintained by Amgros, a national organization owned by the 5 Danish regions [7]. This entails an annual invitation to drug tenders, and when drugs are procured from a new supplier, a drug change (DC) occurs [3, 7]. This set-up aims to provide the Danish hospitals with medicines at the lowest possible cost [7, 8].

Implementing DCs is a field of growing interest, mainly due to patient safety concerns [913] and emerging evidence of large resources being used to implement DCs, especially in relation to drug shortages (DSs) [1418]. The majority of the literature focusing on DSs are based on surveys (retrospective studies) or on self-reported data [1518]. A European survey revealed that nearly 50% of all hospital pharmacists reported spending a minimum of 5 hours/week managing DSs [16]. Additionally, self-reported data from Belgium hospital and community pharmacists revealed median times of 109 and 25 minutes respectively spent on managing drug supply problems per week [15, 17]. In the USA, annual labor cost related to managing DSs were estimated as high as US$ 259 million per year in 2019 [18]. Thus, managing DSs and implementing DCs following shortages are continuously causing increased expenses in hospitals. Hence, optimizing resources spend by hospital personnel are of great interest to healthcare systems.

DCs challenge patient safety and an increasing number of medication errors related to DCs have also been reported [9, 12, 13]. Additionally, treatment with a new drug unfamiliar to hospital personnel are challenges described in the literature [1113]. DCs also generate insecurity among patients who self-administer their medicine at home [9, 19]. Thus, the importance of e.g. nurse-led activities related to patient education, as well as providing information and continuity of care are important indicators for improving adherence to medical treatment in outpatient clinics [2023].

The focus of this study is the DC situation, meaning the actual changes to new drugs unfamiliar to the dispensing personnel. As already mentioned, DCs can be caused by tendering or DS, but they can also be initiated by activities related to the implementation of new clinical guidelines [9]. However, regardless of cause or origin, the general term DC will be used throughout this paper.

To the best of our knowledge, no studies exploring time spent on DCs in the clinical setting using direct observations and time-registrations have been published. Additionally, eye-tracking technology is introduced as a time registration tool, where a head-mounted eye-tracker composes Tobii Pro Glasses [24], which allows the capturing of a first person perspective video of the focus of attention [25]. Tobii eye-tracker has demonstrated suitability in research areas such as marketing and consumer research, clinical research and education [2426]. Thus, this study aims to explore the time spend by hospital personnel in a drug change situation when dispensing medicine to in- and outpatients in a hospital setting in the Capital Region of Denmark.

Methods

Setting

The study was undertaken at Bispebjerg and Frederiksberg Hospital (BFH), which is one out of seven main hospitals in the Danish Capital Region with an uptake area of approximately 480.000 citizens. BFH has approximately 80.000 acute admissions and 400.000 outpatient visits each year [27, 28].

Based on an internal list containing the expected DCs due to tender, two clinical settings known to experience several DCs were identified and included in this study by two authors (JHP and MHC) [29]; an inpatient cardiology ward and an outpatient rheumatology clinic.

Sub-study 1: Cardiology ward (inpatient setting)

At the 60-bed cardiology ward, nurses and social and health care assistants (SHAs) with dispensing authority manually dispense and administer medicines to hospitalized patients. The majority of the dispensing personnel are nurses, with an average of 15 nurses present during the day shift and 12 nurses during the evening shift [30]. The medicine inventory room at the ward primarily consists of standard medicine assortment with high-frequent medicine adjusted according to its general use, area of specialization and expenditures. Additionally, a smaller amount of non-standard medicine assortment is also available at the ward. In the current study, the focus is on the dispensing of standard medicine assortment as DCs primarily occur within this group. Medicine at the hospital is ordinarily provided at 8 am, noon, 5 pm and 10 pm with dispensing approximately 1 hour prior to administration.

The medicine is dispensed from large original containers into a small beaker. The dispensing process includes 6 steps (Table 1) with step 3–6 of particular interest in the current study, as they are the ones affected by DCs.

Table 1. The dispensing process at the cardiology ward.
1. Look up the patient Enter the electronic system, locate patient, find medicine list
2. Prepare the dispensing Print patient label, put label on medicine beaker or its lid
3. Searching and fetching Identify and fetch drug from shelves
4. Barcode scanning Barcode scan the container as a control measure
5. Dispense the dose Dispense tablet, capsule, suppository, ready-to-use preparation.
6. Validate and complete Check the dispensing of prescribed drug

Sub-study 2: Rheumatology outpatient clinic

The rheumatology outpatient clinic covers approximately 12.000 patients spread over 32.000 visits each year. The main activities in the clinic are diagnoses, treatment and rehabilitation of patients diagnosed with rheumatology [28, 31].

Patients can be either given medical treatment on-site (infusions) or medicine can be extradited for self-administration at home (primarily subcutaneous injections). The latter involves a nurse-led patient consultation consisting of the steps shown in Table 2, all of interest to this study.

Table 2. Steps in nurse-led patient consultation.
Preparation • Access to and reading of the electronic patient record, including check of latest blood sample result
• Look up and reading about medicine (if necessary)
Consultation • Professional aspects of treatment (effect, side effect, questions etc.)
• Practical aspects of the treatment (ordering new blood tests, appointment making, a new consultation time etc.)
Other • Dispensing and medicine extradition for 8–12 weeks
• Documentation in the electronic patient record

Design

A purposive sampling strategy was applied as the inclusion of clinical settings was based on expected DCs, thus they are assumed to contribute to the purpose of this study [32]. Subsequently, participants from these clinical settings were included using a convenient sampling strategy [32]. The intent of the study was not to collect generalizable data, but to get an insight into two highly relevant medical areas affected by DCs. The design of the study was a time and motion study using direct observations and time-registration tools such as eye-tracking, video recording and manual time tracking to collect data. The participants were followed in real-time during medicine dispensing prior to and after DCs were registered [33, 34].

As the dispensing process at the cardiology ward involves seconds, the use of a refined and detailed data collection technique is required. Thus, the eye tracking was used in this setting. Additionally, the dispensing process at the rheumatology outpatient setting contain other activities and patients, thus, the use of an overall time measurement, such as a stopwatch was more useful in this setting. The use of the details provided by the eye tracking were not relevant in outpatient setting, just as the physical presence of the glasses would induce a considerable disturbance in the patient consultation. Thus, different data collecting technique were used for in- and outpatient settings.

For both clinical settings, a description of the workflow related to the dispensing phase was outlined based on information from regional guidelines [35]. An observational data collecting scheme containing the different time-components for the nurse-led patient consultation was outlined. A pilot study for both sub-studies was carried out beforehand and minor adjustments were made accordingly. The actual implementation of DCs is effective from April 1st 2019. Thus, data were collected in a baseline and a comparison period prior to and after April 1st respectively.

The recruitment of nurses and SHAs with dispensing authority took place in close collaboration with the departmental nurse and responsible nurse for medicine at the two settings. Newsletters about the study were send to all relevant personnel, followed by two staff meetings where written and verbal information were provided. Subsequently, participants volunteered to the study through email registration.

Sub-study 1: Cardiology ward (inpatient setting)

Time registrations were made by direct observation combined with eye-tracking technology (Tobii Pro Glasses 2) [24]. In case of loss of eye tracking data, a Go-Pro camera (Hero 4) was set up in the medication room as a recording back-up. The use of direct observations of participants gave details to the dispensing process, which was subsequently used to extract relevant data from the eye-tracking recording.

The participants were asked to perform their usual dispensing routine while wearing recording eye-tracking glasses, which enabled a focus on participants’ realistic behavior [36]. Eye-tracking combined with direct observation provided insight into the many nuances of the general dispensing phase and the many components in the available IT-system in hospitals. The study focus was the dispensing steps 3–6 (Table 1): searching and fetching; barcode scanning; dispense the dose. Through eye-tracking recordings and observational notes, the different elements in the dispensing process were divided into time intervals of interests using compatible software to Tobii Pro Glasses. More specifically, in the software the duration of the entire dispensing process was displayed in one timeline (from beginning to end of the recording) and from there, time spent on step 3–6 in the dispensing of each drug was divided into individual time intervals (segments). Potential irrelevant time aspects to this study were identified and subsequently discarded, e.g. step 1–2 in the dispensing process, disruptions from colleagues or typing irrelevant information into the electronic system etc. The time division, also referred to as coding in this study, was performed immediately after each observation. An example of the coding of relevant and irrelevant time intervals related to medicine dispensing in the cardiology ward for a particular scenario covering the dispensing process step 3–6 for Hexalactone has been provided in Fig 1.

Fig 1. Coding of relevant and irrelevant time intervals–an example.

Fig 1

An example of coding of relevant and irrelevant time intervals related to medicine dispensing at the cardiology ward for a particular scenario covering the dispensing process step 3–6 for Hexalactone.

At the cardiology ward, each nurse and SHA was responsible for dispensing medicines to 4–5 patients at each of the four administration periods from 8 am, noon, 5 pm and 10 pm (day and evening shift). Together with eye-tracking, the use of direct observation with continuous time registration on specific dispensing elements requires a 1:1 participant to observer ratio, thus, only one nurse or SHA could be followed a day and an evening shift respectively.

Nine nurses and one SHA with dispensing authority were observed in two shifts (day or evening) in a 1) baseline period consisting of five consecutive weekdays in March 2019 and 2) a comparison period with many assumed DCs in April and May 2019. The comparison phase took place over a two month period, as the same 10 participants from baseline in preferably the same shifts (day or evening) were observed. JHP registered all observations.

Sub-study 2: Rheumatology outpatient clinic

The time registration was performed by the use of a stopwatch on a mobile phone, while joining nurse-led patient consultations as an observer. The different phases in the consultation was marked using the “round-bottom” in the stopwatch function.

Metex pre-filled syringe (PFS). The observational focus was Methotrexate subcutaneous injection administered in pen and pre-filled syringe (PFS). From the tendering it was known that Methotrexate marketed as Metex® PFS (all strengths) would change to Injexate® PFS (all strengths). Of the 12.000 patients from the outpatient clinic, this specific generic change was estimated to affect around 1250 to 1500 patients [31]. The treatment with 15, 20 and 25 mg was specifically studied, as these strengths are the commonly most used (Fig 2).

Fig 2. Drug changes due to tender and drug shortage.

Fig 2

Drug changes due to tender (Metex PFS change to Injexate PFS) and drug shortage of Metex Pen 25 mg with alternatives (Injexate PFS 25 mg or 2x Metex pen 12,5 mg).

Eight nurses employed at the outpatient clinic were recruited for direct observations for five consecutive weekdays from 8 am to 2.30 pm (4.30 pm on Thursdays) in a baseline period in March 2019. Both Metex pen and PFSs were included in the baseline registrations, since both represent the patients’ accustomed treatment (both when it comes to name, looks and device). DCs were observed in a comparison period for five consecutive weekdays in April 2019 and only included Injexate PFS. First author (JHP) performed the observations together with six pharmacy internship students, who had received guidance on how to observe and complete the observational data collecting scheme.

A follow-up phase was scheduled (approximately) 3–6 months after both Injexate® PFS 15, 20 and 25 mg were well-implemented. The purpose was to explore time spent on nurse-led patient consultation and extradition of Injexate PFS after patients had become more familiar with the treatment, hence, estimating the expenses related to the change from Metex to Injexate PFS. However, Injexate PFS (all strengths) went into a shortage period (July–late November 2019), thus, the follow-up took place between February and March 2020.

Metex pen. Metex injections were available in pen and PFS. Whether the patients were treated with one or the other depended on patient and/or doctor preferences. Metex pen (all strengths) was not supposed to undergo a DC due to tender, thus, no changes for patients in treatment with Metex pens were planned. However, Metex pens 25 mg went into DS while data were collected in March and April 2019. Thus, time spent on nurse-led patient consultation concerning DS of Metex pens 25 mg was also included in the study (Fig 1).

Economic impact

To estimate the economic impact on time spent on DCs at the cardiology ward and outpatient setting, cost data used in this study were extracted from the Danish Medicines Councils guideline “Valuation of unit costs” [37]. The guideline contained specific unit costs related to e.g. personnel expenses and references for calculating unit costs. The data will be converted to USD using the 2019 average exchange rate (USD 1 = DKK 6,67) [38]. All cost values in cents will be rounded off to the next integer.

At the cardiology ward, the economic impact was estimated at ward level based on: 1) the average number of dispensed drugs; 2) the percentage of drugs undergoing DCs and ‘semi-drug changes’; 3) the average number of dispensing nurses in day and evening shift; 4) the time spent on DCs; and 5) conversion into total expenses in USD.

At the rheumatology outpatient clinic, the economic impact was calculated per outpatient clinic based on: 1) the number of patients affected by the DC, 2) the time spent on the DC and 3) conversion into total expenses in USD.

Ethic

The study is a non-interventional, descriptive study using direct observation, time-registration and eye-tracking technology. The ethic committee in the Regional Committee was consulted, and it waived a formal review of the study (Journal no: H-18053511). Participants were informed both verbally and in writing about the nature of the study, the publication plans and that they could withdraw from the study at any time without further consequences. All participants signed a consent form and were anonymized in the study.

This study did not assess the incidence of medication error, but only focused on time spent on medicine form dispensing or extradition. However, if any dispensing error occurred during the observations, the observer would note and react to this.

Data analysis

Time spent on DCs at the cardiology ward was extracted using “iMotion software” compatible to Tobii Pro Glasses 2. In situations where recording back-up from the Go-pro camera (Hero 4) were relevant, VLC media player 3.0.6 (January 9, 2019) was used to extract data. Time registrations from both sub-studies were registered in Excel 2016. All statistical analyses were performed using IMB SPSS Statistics 25.

Normal distributions of data were tested using the Kolmogorov-Smirnov Test for sub-study 1 (> 50 samples) and the Shapiro-Wilk Test for sub-study 2 (< 50 samples). Data were subsequently analyzed using a one-way ANOVA followed by Tukey HSD post hoc test. A Kruskal–Wallis test was used for analysis where normal distribution could not be assumed. Statistical significance was accepted at P<0.05.

Results

Below, data from the cardiology ward are displayed in seconds as one drug dispensing takes less than a minute. Data from the rheumatology outpatient clinic are displayed in minutes as a nurse-led patient consultation takes several minutes.

Sub-study 1: Cardiology ward (inpatient setting)

Ten nurses were included from the cardiology ward of which nine were women. Working experience varied from less than one year to more than 5 years.

In the baseline period, 199 drugs were dispensed of which 161 were included as they belonged to the standard medicine assortment. Excluded recordings (N = 38) covered dispensing of non-standard medicine assortment, measurement or preparation of dose as they include additional dispensing elements and thus, is not of interest to the study.

In the comparison period, 227 drugs were dispensed of which 35 were included, as they underwent a ‘semi-drug change’ (N = 26) or an implemented drug change (N = 9). Excluded recordings (N = 192) covered drug dispensing where no changes were registered from baseline to comparison, including standard and non-standard medicine assortment and measurement or preparation of dose. The term ‘semi-drug change’ is not standardized, but used in this study to cover situations where there is a discrepancy between the prescribed drug (e.g. Bisacodyl marketed as Toilax®) and the physical available drug (e.g. Bisacodyl marketed as Dulcolax®) in the medicine inventory room. This phenomenon emerged when the hospital pharmacy supplies the drug procured from a new supplier and the electronic system is changed accordingly, but some of the “old” drug is still available in the inventory room. Thus, the “new” prescribed drug is not immediately available for dispensing, but is already up for prescription. An implemented DC refers to the situation where the “new” prescribed drug is the drug available for dispensing.

Table 3 displays the mean time spent in seconds per drug dispensed in the cardiology ward. As shown in Table 3 a ‘semi-drug change’ prolonged a drug dispensing with approximately 8 seconds whereas an implemented DC took approximately 5 seconds longer than a drug dispensing under baseline conditions.

Table 3. Mean time (seconds) spent per drug dispensed (N).

Cardiology ward Type N (no) Mean (sec) Standard Deviation (sec) Median (sec) Minimum (sec) Maximum (sec)
Baseline Standard assortment 161 20,5 10,8 17,4 8,6 72,2
Comparison Semi- drug changes 26 28,4* 16,3 22,5 14 90
Drug changes (implemented) 9 25,9 15,6 18,2 11,2 59,2

*P = 0.003 (Kruskall-Wallis test). Pairwise comparison showed a significant difference between baseline and semi-drug changes (P = 0.001).

Sub-study 2: Rheumatology outpatient clinic

Eight nurses were included from the rheumatology outpatient clinic of which seven were women. Working experience varied between 1 year and up to more than 10 years.

On average, a nurse-led patient consultation including drug dispensing took 8 minutes and 6 seconds under baseline conditions. In comparison, the same process took on average 15 minutes and 36 seconds and 16 minutes and 54 seconds for DCs due to tendering and DS respectively. Thus, a nurse-led patient consultation took significantly more time when it included a DC. A follow-up after the implementation of Injexate revealed that time spent on nurse-patient consultation returned to baseline levels (Table 4).

Table 4. Mean time spent in minutes per nurse-led patient consultation (N).

Outpatient Clinic Type N (no) Mean (min) Standard Deviation (min) Median (min) Minimum (min) Maximum (min)
Baseline Metex pen or syringe 14 8 min 6 sec 2 min 36 sec 8 min 6 sec 4 min 24 sec 12 min 48 sec
Comparison Injexate syringe 9 15 min 36 sec* 5 min 42 sec 16 min 24 sec 7 min 6 sec 27 min 54 sec
Follow-up Injexate syringe 5 8 min 54 sec 3 min 24 sec 9 min 24 sec 4 min 18 sec 13 min 36 sec
Drug shortage Injexate syringe 25 mg 7 16 min 54 sec* 4 min 48 sec 19 min 8 min 42 sec 21 min 6 sec
2x Metex pen 12,5 mg

*P< 0.001 (one-way ANOVA followed by Turkey HSD post hoc test). Pairwise comparison showed a significant difference between baseline and 1) comparison (P = 0.001), 2) drug shortage (P<0.001).

Economic impact

From the Danish Medicines Councils guideline “Valuation of unit costs”, the unit cost for a nurse in hospital is 84 USD/hour, including overhead expenses in hospital and ward, time for non-patient related tasks, breaks and absences other than holiday (e.g. competency development) [37].

Cardiology ward (inpatient setting). Data were obtained from the observations at the cardiology ward and based on the number of dispensed drugs in baseline and comparison, the average number of dispensed drugs is 10 drugs per nurse per shift. The percentage of drugs undergoing ‘semi-drug changes’ and DCs were 11.5% and 4% respectively. Thus, the time spent per nurse in one shift on ‘semi-drug changes’ = 9 seconds (10 drugs x 11.5% x 7.9 seconds) and DCs = 2 seconds (10 drugs x 4% x 5.4 seconds), a total of 11 seconds per nurse per shift.

At the cardiology ward, 15 nurses and SHA’s dispenses during the day and 12 nurses and SHA’s during the evening, leaving the extra time spent on ‘semi-drug changes’ and DCs at the cardiology ward to 303 seconds per day (27 nurses x 11 seconds). This corresponds to expenses of 7 USD per day at the cardiology ward. Assuming that ‘semi-drug changes’ and DC implementation affect the dispensing time for a period of 4 weeks, the cardiology ward ends up spending a total of 196 USD.

Rheumatology outpatient clinic. Implementing one DC per patient consultation will take 7 min 30 seconds longer (comparison minus baseline), corresponding to 10.5 USD. Thus, with 1250–1500 patients in Methotrexate subcutaneous injection, the extra time spent on DCs for these patients adds up to a minimum of 156 hours and 15 minutes and a maximum of 187 hours and 30 minutes, corresponding to expenses for one rheumatology outpatient clinic of 13.125–15.750 USD.

Discussion

When experiencing implemented DCs or ‘semi-drug changes’ in the inpatient setting, the extra time spent on dispensing one drug by hospital personnel was on average 5 and 8 seconds respectively. The statistical analysis reveals a statistically significant difference between baseline and ‘semi-drug changes’. In the outpatient clinic, DC due to tender and shortage prolonged the patient encounter significantly by 7 minutes and 30 seconds and 8 minutes and 48 second respectively. Each sub-study will be discussed after a general discussion of DCs.

In this study, the observed DCs are considered to be of a more simple character (generics) compared to more complex changes related to situations involving therapeutic substitution, unlicensed medicine and differences in drug strength [912]. Other studies describe general aspects of DCs, including potential patient safety consequences, but they do not involve time registrations related to the changes [912]. From the literature, time studies concerning DCs due to shortage exist in smaller numbers, but they are based on self-reports or surveys of time spent on managing DSs on a weekly basis [1418]. Self-reported data from Belgian hospital pharmacists revealed median times of 109 minutes per week spent on managing drug supply problems per week [17]. Additionally, surveys from European hospital pharmacists report spending a minimum of 5 hours/week, whereas it is estimated that U.S. pharmacy staff spent as much as 8.6 million personnel hour of labor per year on DSs across all U.S. hospitals [16, 18]. However, these results are entirely based on reports from hospital pharmacists and hospital managers, with no inclusion of the clinical setting and the hospital personnel. Our study, on the other hand explore time spent on DCs by hospital personnel in two clinical settings, which makes it is difficult to compare our findings with the existing hospital pharmacy literature.

Sub-study 1: Cardiology ward (inpatient setting)

An interesting finding was the discovery of the ‘semi-drug change’ characterized by a discrepancy in prescribed drug and available drug in the inventory room. Significant difference was found for ‘semi-drug changes’ compared to baseline and although no significant difference was found for implemented drug changes, extra time (5 seconds) was registered in the comparison period. The extra time used on a drug dispensing could be due to hospital personnel spending time on searching for a particular prescribed drug. This is a subtask that reportable could end up being time consuming for the hospital personnel [25], just as changes in trade names, labels and/or physical packaging unfamiliar to the hospital personnel are other potential causes reported in the literature [911].

Furthermore, a discrepancy in prescribed drug and available drug in the inventory room might lead to medication errors. This has been reported in a Norwegian study where 42 out of 100 nurses experienced medication errors related to generic substitution, because doctors had failed to prescribe from revised drug lists owing to DCs caused by tender [13]. Additionally, ‘semi-drug changes’ could lead to omitted and/or delayed treatment, as nurses may be unaware of synonymous trade names (generics) between the prescribed drug and the available generic drug in the medicine room [9,11,12]. One way of overcoming some of the consequences would be to use generic (pharmacological) names in the entire medication process instead of trade names. Thus, there will be a congruency between names used in prescribing and dispensing in hospitals [13, 39]. However, drugs with the same generic names, but different formulations could lead to look-alike/sound-alike errors [9, 12, 39]. Other reported ways of overcoming challenges related to ‘semi-drug changes’ are to involve healthcare and regulatory authorities to ensure safer drug names, registration of the same dose units and avoid look-alike packaging [9, 12, 13]. More technical solutions, such as automated medicine cabinets, barcode scanning and updating electronic prescribing systems have also been mentioned in the literature [9, 12, 13]. However, this study only focused on time spent on drug dispensing and did not involve the incidence of omitted and/or delayed treatment.

No follow-up at the cardiology ward took place and thus, claiming that the extra time spent on DCs are related to immediate expenses due to tender are not possible. However, the follow-up data from the rheumatology outpatient clinic indicates that the extra time observed in relation to DC diminished over time and returns to baseline. Thus, one could assume a similar trend at the cardiology ward as the nurses and SHA become more familiar with dispensing of the implemented drugs.

Sub-study 2: Rheumatology outpatient clinic

The nurses at the rheumatology outpatient clinic spent almost twice as much time managing the change from Metex PFS (baseline) to Injexate PFS (comparison), but at follow-up, the extra time had diminished and the consultation time resembled baseline data. Thus, the additional time spend on changing from Metex to Injexate highlights the immediate expenses related to a specific DC due to tender. Additionally, twice as much time managing the DC due to DS of Metex pen was found.

Possible explanations for the significant time differences are various. When drugs change, nurses are insufficiently prepared for the changes. Primarily, they become aware of DCs when the actual change is implemented with no time to inform or prepare patients beforehand. Even though the route of administration and dosage form are similar for the alternative drug, a change in trade name and/or packaging are potential components compromising patient safety [9, 10, 40]. Additionally, the physical appearance of the device itself (syringe injection) may look or even feel different to inject/administer, thus, patients might feel insecure using it [9]. Such situations require a high degree of information, communication and patient involvement if mistakes or non-compliance are to be avoided [20, 21, 40]. From the literature, nurse-led care is found to provide effective patient education and information, as well as access and continuity of care. This is directly associated with higher satisfaction amongst patients, leading to an increase in adherence to medical treatments [20, 22, 23]. Additionally, despite obvious time pressure during nurse’s working hours, one study reported that it did not hinder the nurses from providing satisfactory emotional support and answering questions from patients, which was perceived as a genuine interest in the well-being of the patient [23]. Thus, the significant time difference for nurse-led patient consultation related to DCs can be considered necessary and valued to patients.

Economic impact

Scrutinizing DC data at the cardiology ward reveal that drug dispensing only seems to be slightly more time consuming (5.4 to 7.9 seconds). However, recalculating and upscaling the results to cover the entire cardiology ward end up in a scale considered relevant in relation to the time used and expenses spent on the drug dispensing process. At the cardiology ward, a total of 27 nurses and SHA’s cover the dispensing process in both day and evening shifts. Estimating that ‘semi-drug change’ and DC affect dispensing time in a period of 4 weeks leads to a calculated extra time of 2 hours and 22 minutes or 196 USD spent on the assumed ‘semi-drug change’ and DC at this particular cardiology ward. This extra time and expenses does not immediately seem to have a clinical and economic impact, especially not on a daily basis with extra time corresponding to 303 seconds and 7 USD. However, the size of the cardiology ward is assumed to cover a standard medical ward in the Capital Region of Denmark. Thus, multiplication of the expenses with the total number of medical wards will show a considerably amount of additional expenses spent locally, regionally or even nationally. It should be emphasized that the estimated 4 weeks period with ‘semi-drug change’ and DC are based on assumptions, since the actual duration of the periods are unknown.

Looking at the extra time spent on one DC from Metex to Injexate in one rheumatology outpatient clinic, the impact of additional expenses are considerable, 13.125–15.750 USD. This corresponds to extra time in the range of 156 hours and 15 minutes and 187 hours and 30 minutes, affecting 1250–1500 patients. Thus, multiplication of the expenses with the number of rheumatology outpatient clinics will show a considerably amount of additional expenses spent used for this kind of drug change. Further, another relevant point of discussion is the estimated consequences of DCs in the clinical setting. Assuming that 12 nurse-led patient consultations are generally scheduled on a daily basis, based on our findings, implementing one DC per patient consultation will take 7 min 30 seconds longer (comparison minus baseline), which sums up to 90 minutes extra time spent on consultations per day. As a result, less nurse-led patient consultations during the implementation phase can be scheduled, which is a noticeable disadvantage for the clinical practice. Thus, implementing DCs may indeed affect the workload of nurses, but it is difficult to estimate the exact consequences for each outpatient clinic as it will depend on the contextual and organizational setting.

A more general discussion relates to whether or not the DC expenses compensate for the gained savings associated with tender and procurement. The incoming bids for tender and actual procurement savings are unknown to the research group, thus, a direct comparison cannot be made. Further studies should elucidate the economic consequences, including all relevant expenses related to the tendering and procurement process and the implementation of DCs. The details of our study show how much extra time a DC in two clinical settings requires and that this extra time spent in an outpatient setting decreases over time. However, a potential explanation for the decrease of time needs further research beyond this study, but in a restrained healthcare system. Extra time is not only money, but also additional pressure on the hospital personnel with potential risks of errors.

Strengths and limitations

One strength of this study is the use of direct observation in real-time combined with collecting quantitative data, using eye-tracking technology. This enabled us to make a clear distinction and division of the many nuances and aspects related to the IT system in the dispensing process. The precision of the time registrations would have been impossible without eye-tracking data combined with the detailed observational notes containing practical information of what was being prescribed and dispensed, as well as potential time-wasting activities.

Both surveys and self-reports are low cost methods to quantify information about time spend on managing DSs. The major disadvantages with these methods are biases, such as intentional/unintentional over-estimation about time spent in order to exhibit socially desirable behavior or they simply face problems remembering [33, 41]. These biases are met in this study by the use of direct observations.

A limitation with time and motion studies are their resource demanding nature, since a time and motion study and eye-tracking require a 1:1 participant to observer ratio, thus, restricting the number of participants that can be included [33, 41]. Another essential limitation with direct observations and the presence of an external observer is related to the participants’ change of behavior while being observed, also referred to as the Hawthorne effect [41, 42]. The extent of the Hawthorne effect is difficult to estimate in the study, but the observer is assumed to have affected the observed participants to a minor extent. Additionally, the physical appearance of the go-pro camera and the eye-tracking glasses mounted to the participant’s head have indeed also affected the participants while being observed. The Hawthorne effect in this matter is impossible to avoid, unless the nurses and SHA became accustomed to working with the glasses. Further, as the same participants and observer is present in baseline and comparison, the Hawthorne effect is assumed equally widespread in both data collection periods, although the effect has not been measured.

At the cardiology ward, the same person (JHP) performed all the observations and coding of data. This may have resulted in personal and intra-rating bias, which could potentially affect the reliability of the study [43]. Obviously, having two or more researcher performing the observations and coding independently, discuss their finding or calculating a coder reliability, would enhance the overall reliability and reduce potential personal bias in the study. One way to minimize the potential intra-rating bias is to reduce the risk of “coder-drift”, which refers to applying the coding differently due to boredom or fatigue when coding larger data set at once [43]. However, in this study the coding was performed immediately after each observation and thus potentially reducing intra-rating bias [43]. Further, Fig 1 displays the coding frame for the observations hereby increasing the transparency of the coding of included and discarded time. Conversely, having the same person performing the data collection results in less observation bias and reliability issues compared to the outpatient clinic, where pharmacy internship students were involved too. Despite the guidance of students, there might be differences in the perception of the time registrations in the consultation elements. However, these differences are considered to have minor influence on the registered time differences and overall findings.

Consultation with the hospital pharmacy led to the expectation of implementation of DCs at the cardiology ward within 1–3 weeks after April 1st, which was therefore chosen as the comparison period. Even though the actual implementation of DCs were effective from April 1st, relatively few DCs were observed in the cardiology ward in the comparison period (April and May), which potentially affects the reliability of the results. The physical changes in the medicine inventory rooms depend on current surplus medicine stock from hospital pharmacy and the hospital ward/clinic. Thus, it is difficult to pick the right moment for observations in order to capture the actual implementation of DCs. However, an expansion of the comparison period would most likely have produced more data.

A potential limitation related to the rheumatology outpatient clinic is the differences between patients and their individual knowledge and need for information related to the DC. Thus, some of the patients in either baseline, comparison or shortage situation might not fully reflect the patient population at the rheumatology outpatient clinic. Rathe et al. (2013) found a positive association among patients between a generic change and previous positive DC experiences within the same drug type [40]. In our case, some patients having been in long time treatment with Methotrexate subcutaneous injection may be more acceptable to DCs as they are likely to have experienced DCs earlier. Further, this study focusses on a generic DC due to tender, but one could image that dealing with DC from originator to biosimilar would require extra resources for nursing education and patient information, due to another complexity of the DC. However, another study would be required in order to explore this perspective in details.

Another perspective for the time differences might be due to the diversity among nurses. One might argue that participants who voluntarily signup for the study may be more skilled compared to those who did not sign up. Although nurse characteristics might affect the extra time spent on DCs in the dispensing and patient consultation, it cannot solemnly explain the significant findings in this study, though. By choosing purposive sampling combined with the few data points, one can never claim generalizable results and the external validity may be considered relatively low, but data still provides relevant insights into the resources related to DCs.

Conclusion

This study revealed that hospital personnel spent significantly longer time on dispensing of medicine when experiencing a ‘semi-drug change’ in the inpatient setting. Also in the hospital outpatient setting a significant increase in time to extradite medicine was seen after DCs. Until now, the knowledge about resource requirement for managing drug changes has been related to hospital pharmacy personnel, but the present study adds detailed information on how DCs also affect clinical personnel. Furthermore, DCs are also known to challenge the patient safety and it is thus important that the clinical personnel spent extra time and focus on the drug dispensing process to ensure patient safety. The current study does not reveal if the extra time spent on drug dispensing was specifically used on patient safety activities. Future studies are needed to elucidate this perspective. However, this study emphasizes that implementing DCs do require extra time and financial expenses, thus, the hospital management should encounter this and ensure that additional time and resources are available for the clinical personnel to ensure a safe drug dispensing process.

Supporting information

S1 Dataset. Time spent by hospital personnel at the in- and outpatient hospital setting.

(XLSX)

Acknowledgments

The authors would like to thank all participants, the departmental nurses and the nurses responsible for medicine at the cardiology ward and the rheumatology outpatient clinic for their time, help and contribution to this study. Additionally, a huge thank you to the pharmacy internship students, who helped with the data collection. A special thank goes to the hospital pharmacy at BFH and the hospital pharmacy logistic department in the Hospital Pharmacy, Capital Region, for contributing with their valuable knowledge, experience in the field and for helping with enabling this study.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

JHP is doing a co-financed PhD study funded by Amgros I/S, Copenhagen Academy for Medical Education and Simulation (CAMES), The Hospital Pharmacy in the Capital Region of Denmark and the University of Copenhagen. Peter Dieckmann holds a professorship at the University of Stavanger that is funded by an unconditional grant of the Laerdal Foundation (Stavanger, Norway) to the University of Stavanger. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.World Health Organization. Global Spending on Health: A World in Transition [Internet]. Global Report. 2019. Available from: https://www.who.int/health_financing/documents/health-expenditure-report-2019/en/
  • 2.Sundheds- og Ældreministeriet. Sammenfattende rapport over sygehusmedicin og styregruppens anbefalinger. 2016.
  • 3.Danske Regioner. Medicin [Internet]. 2020 [cited 2020 May 14]. Available from: https://www.regioner.dk/sundhed/medicin
  • 4.Godman B, Shrank W, Wettermark B, Andersen M, Bishop I, Burkhardt T, et al. Use of generics-a critical cost containment measure for all healthcare professionals in europe? Pharmaceuticals. 2010;3(8):2470–94. 10.3390/ph3082470 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Dylst P, Vulto A, Simoens S. Tendering for outpatient prescription pharmaceuticals: What can be learned from current practices in Europe? Health Policy (New York) [Internet]. 2011;101(2):146–52. Available from: 10.1016/j.healthpol.2011.03.004 [DOI] [PubMed] [Google Scholar]
  • 6.Ministry of Health. Healthcare in Denmark—an overview [Internet]. 2017 [cited 2020 May 1]. p. 73. Available from: https://www.sum.dk/Aktuelt/Publikationer/~/media/Filer - Publikationer_i_pdf/2016/Healthcare-in-dk-16-dec/Healthcare-english-V16-dec.ashx
  • 7.Amgros. About Amgros [Internet]. website. 2018 [cited 2018 Jul 2]. Available from: http://www.amgros.dk/en/about/about-amgros/
  • 8.Wadmann S, Kjellberg J. Value-based procurement of hospital medicines [Internet]. 2018. Available from: https://www.kora.dk/media/8626485/11552_value-based_procurement.pdf [Google Scholar]
  • 9.Poulsen JH, Rishøj RM, Fischer H, Kart T, Nørgaard LS, Sevel C, et al. Drug change: ‘a hassle like no other’. An in-depth investigation using the Danish patient safety database and focus group interviews with Danish hospital personnel. Ther Adv Drug Saf. 2019;10:204209861985999. 10.1177/2042098619859995 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Larsen LK, Outzen EM, Gazerani P, Plet H. Complexity of Drug Substitutions Caused by Drug Tenders: A Mixed-Methods Study in Denmark. Hosp Pharm [Internet]. 2019; Available from: https://journals.sagepub.com/doi/10.1177/0018578719894980#articleCitationDownloadContainer [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Becker ML, Al Hadithy AFY, van den Bemt PMLA, Hunfeld NGM. Switching to different generic medicines: A checklist for safety issues. Eur J Hosp Pharm. 2013;20(2):74–7. [Google Scholar]
  • 12.Berman A. Reducing Medication Errors Through Naming, Labeling, and Packaging. J Med Syst [Internet]. 2004;28(1):9–29. Available from: http://link.springer.com/10.1023/B:JOMS.0000021518.60670.10 [DOI] [PubMed] [Google Scholar]
  • 13.Håkonsen H, Hopen HS, Abelsen L, Ek B, Toverud EL. Generic substitution: A potential risk factor for medication errors in hospitals. Adv Ther. 2010;27(2):118–26. 10.1007/s12325-010-0007-8 [DOI] [PubMed] [Google Scholar]
  • 14.Gulbis BE, Ruiz MC, Denktas AE. The impact of drug shortages on the pharmacy, nursing, and medical staff’s ability to effectively care for critically ill patients. Crit Care Nurs Q. 2013;36(4):400–6. 10.1097/CNQ.0b013e3182a10ffe [DOI] [PubMed] [Google Scholar]
  • 15.De Weerdt E, Simoens S, Casteels M, Huys I. Time investment in drug supply problems by flemish community pharmacies. Front Pharmacol. 2017;8(AUG):1–8. 10.3389/fphar.2017.00568 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.European Association of Hospital Pharmacists (EAHP). Medicines Shortages in Europe [Internet]. 2018. Available from: http://www.medicinesshortages.eu/
  • 17.De Weerdt E, De Rijdt T, Simoens S, Casteels M, Huys I. Time spent by Belgian hospital pharmacists on supply disruptions and drug shortages: An exploratory study. PLoS One. 2017;12(3):1–15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Vizient Drug Shortages Task Force. Drug shortages and labor costs. Measuring the hidden costs of drug shortages ob U.S. hospitals [Internet]. 2019. Available from: https://www.vizientinc.com/-/media/documents/sitecorepublishingdocuments/public/vzdrugshortageslaborcost_fullreport.pdf
  • 19.Rathe J, Larsen P, Andersen M, Paulsen M, Jarbøl D, Thomsen J, et al. Associations between generic substitution and patients’ attitudes, beliefs and experiences. Eur J Clin Pharmacol. 2013;69(10):1827–36. 10.1007/s00228-013-1539-z [DOI] [PubMed] [Google Scholar]
  • 20.Koksvik HS, Hagen KB, Rødevand E, Mowinckel P, Kvien TK, Zangi HA. Patient satisfaction with nursing consultations in a rheumatology outpatient clinic: A 21-month randomised controlled trial in patients with inflammatory arthritides. Ann Rheum Dis. 2013;72(6):836–43. 10.1136/annrheumdis-2012-202296 [DOI] [PubMed] [Google Scholar]
  • 21.Larsson I, Arvidsson S, Bergman S, Arvidsson B. Patients’ perceptions of drug information given by a rheumatology nurse: A phenomenographic study. Musculoskeletal Care. 2010;8(1):36–45. 10.1002/msc.164 [DOI] [PubMed] [Google Scholar]
  • 22.Hill J, Thorpe R, Bird H. Outcomes for patients with RA: a rheumatology nurse practitioner clinic compared to standard outpatient care. Musculoskeletal Care. 2003;1(1):5–20. 10.1002/msc.35 [DOI] [PubMed] [Google Scholar]
  • 23.Mäkeläinen P, Vehviläinen-Julkunen K, Pietilä AM. Rheumatoid arthritis patient education: RA patients’ experience. J Clin Nurs. 2009;18(14):2058–65. 10.1111/j.1365-2702.2008.02763.x [DOI] [PubMed] [Google Scholar]
  • 24.Tobii Pro. Tobii Pro Glasses 2 [Internet]. [cited 2020 May 14]. Available from: https://www.tobiipro.com/product-listing/tobii-pro-glasses-2/
  • 25.Rodriguez ND, Lilius J, Bjorklund S, Majors J, Rautanen K, Danielsson-Ojala R, et al. Can IT health-care applications improve the medication tray-filling process at hospital wards? An exploratory study using eye-tracking and stress response. 2014 IEEE 16th Int Conf e-Health Networking, Appl Serv Heal 2014. 2014;423–8.
  • 26.Harezlak K, Kasprowski P. Application of eye tracking in medicine: A survey, research issues and challenges. Comput Med Imaging Graph [Internet]. 2018;65:176–90. Available from: 10.1016/j.compmedimag.2017.04.006 [DOI] [PubMed] [Google Scholar]
  • 27.Region Hovedstaden. Bispebjerg Hospital: Om hospitalet [Internet]. [cited 2020 May 1]. Available from: https://www.bispebjerghospital.dk/om-hospitalet/Sider/default.aspx
  • 28.Region Hovedstaden. Frederiksberg Hospital: om Hospitalet [Internet]. [cited 2020 May 1]. Available from: https://www.frederiksberghospital.dk/om-hospitalet/Sider/default.aspx
  • 29.Region Hovedstadens Apotek. Skiftelisten pr. 1. april 2019 (version 3). 2019.
  • 30.Cardiology ward. Cardiology ward at Bispebjerg Hospital: estimated kapacity of dispensing personnel. 2020.
  • 31.Rheumatology Outpatient Clinic. Rheumatology Outpatient Clinic: estimated kapacity. 2020.
  • 32.Etikan I. Comparison of Convenience Sampling and Purposive Sampling. Am J Theor Appl Stat [Internet]. 2016;5(1):1. Available from: http://www.sciencepublishinggroup.com/journal/paperinfo?journalid = 146&doi = 10.11648/j.ajtas.20160501.11 [Google Scholar]
  • 33.Burke TA, McKee JR, Wilson HC, Donahue RMJ, Batenhorst AS, Pathak DS. A Comparison of Time-and-Motion and Self-Reporting Methods of Work Measurement. J Nurs Adm [Internet]. 2000;30(3):118–25. Available from: https://journals.lww.com/jonajournal/Fulltext/2000/03000/A_Comparison_of_Time_and_Motion_and_Self_Reporting.3.aspx?casa_token = M1yznkbcbTwAAAAA:hy68dAQVzQ7eK4ROuzpAW5s8HbVm0W2NTqVXVC5UXLIxHnAdLMRk-QOYj9J71vLNwHe1TmlkyM5KMBGyuXVSGUpNd5VSIF7wy6s 10.1097/00005110-200003000-00003 [DOI] [PubMed] [Google Scholar]
  • 34.Zheng K, Guo MH, Hanauer DA. Using the time and motion method to study clinical work processes and workflow: Methodological inconsistencies and a call for standardized research. J Am Med Informatics Assoc. 2011;18(5):704–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Lægemiddelkomitéer i Region Hovedstaden. Lægemiddeldispensering og -administration. Copenhagen; 2018.
  • 36.Khachatryan H, Rihn AL. Eye-Tracking Methodology and Applications in Consumer Research. Electron Data Inf Source UF/IFAS Ext. 2014;1–5. [Google Scholar]
  • 37.Medicinrådet. Værdisætning af enhedsomkostninger [Internet]. 2020. Available from: https://medicinraadet.dk/media/12930/vaerdisaetning-af-enhedsomkostninger-vers-13.pdf
  • 38.Danmarks Nationalbank. DNVALA: Yearly exchange rates by currency, type and methodology [Internet]. 2020 [cited 2020 Nov 11]. Available from: https://nationalbanken.statistikbank.dk/statbank5a/selectout/print.asp?pxfile = D:%5Cftproot%5CLocalUser%5Cstatbank%5Cstatbank5a%5CTemp%5C202011117950303610885DNVALA.px&outfile = D:%5Cftproot%5CLocalUser%5Cstatbank%5Cstatbank5a%5CTemp%5C202011117950303610885D
  • 39.Nelson S, Slørdal L, Spigset O. Forskrivning av virkestoff i stedet for preparat—På høy tid. Tidsskr den Nor Laegeforening. 2006;126(4):441–3. [PubMed] [Google Scholar]
  • 40.Rathe J, Andersen M, Jarbøl DE, Christensen RD, Hallas J, Søndergaard J. Generic switching and non-persistence among medicine users: A combined population-based questionnaire and register study. PLoS One. 2015;10(3):1–22. 10.1371/journal.pone.0119688 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Lopetegui M, Yen PY, Lai A, Jeffries J, Embi P, Payne P. Time motion studies in healthcare: What are we talking about? J Biomed Inform [Internet]. 2014;49(March):292–9. Available from: 10.1016/j.jbi.2014.02.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Ampt A, Westbrook J, Creswick N, Mallock N. A comparison of self-reported and observational work sampling techniques for measuring time in nursing tasks. J Heal Serv Res Policy. 2007;12(1):18–24. 10.1258/135581907779497576 [DOI] [PubMed] [Google Scholar]
  • 43.Mackey A, Gass SM. Part II. Data Coding, Analysis, and Replication. In: Research Methods in Second Language Acquisition A practical guide. Wiley-Blackwell Publishing Ltd; 2014. p. 204–20. [Google Scholar]

Decision Letter 0

Susan Horton

16 Oct 2020

PONE-D-20-21353

Time spent by hospital personnel on drug changes: A time and motion study from an in-and outpatient hospital setting

PLOS ONE

Dear Dr. Poulsen,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Nov 30 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Susan Horton

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.  Thank you for stating the following in the Financial Disclosure section:

"JHP is a part of a co-financed PhD study funded by Amgros I/S, Copenhagen Academy for Medical Education and Simulation (CAMES), The Hospital Pharmacy in the Capital Region of Denmark and the University of Copenhagen. Peter Dieckmann holds a professorship at the University of Stavanger that is funded by an unconditional grant of the Laerdal Foundation (Stavanger, Norway) to the University of Stavanger. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

We note that you received funding from a commercial source: Amgros I/S.

Please provide an amended Competing Interests Statement that explicitly states this commercial funder, along with any other relevant declarations relating to employment, consultancy, patents, products in development, marketed products, etc.

Within this Competing Interests Statement, please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your amended Competing Interests Statement within your cover letter. We will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have performed an empirical time and motion study to identify the time spent by hospital personnel on drug changes. Data has been collected for inpatient (cardiology wing) and outpatient (rheumatology wing) of a Danish hospital. Have used certain statistical methods to compare the results. However, there are some major issues that have not been addressed in this paper.

1) The data has been collected by a single person in this study (JHP). This definitely leads to personal bias in all the data collection aspects. It would have been better if at least two members were involved in data collection stage.

2) The authors have mentioned that it would not be possible to measure the Hawthorne effect. But this is an experimental study which has been carried out using sophisticated techniques like Tobii eye tracker, Go pro camera etc. Unless the nurses and SHA are trained on these methods, the impact created by these equipment on the behaviour cannot be underestimated.

3) In the cardiology wing, data has been collected in March 2019 (baseline) and April-May 2019 (immediately after DCs are introduced). This is definitely not a good comparison period because the authors have taken a baseline period wherein the nurses and SHAs were very well versed with the existing drugs (March 2019), and the study period of April-May 2019 is a learning phase even for an experienced nurse/SHA. If the data was collected a few months after the drug change (DC), the actual impact of the time could have been assessed and concluded.

4) In pages 7 & 8 of the manuscript, the authors mention how the software used for collecting data of Tobii glass tracker works. "Potential irrelevant times have been discarded". The authors need to explain more on how they decided irrelevant time. Moreover observing times from video and using it for data collection purpose can include 'bias'. Need to be addressed appropriately.

5) The authors should explain why they have used different data collection techniques for inpatient (eye tracker, video etc.) and outpatient (mobile stop watch) setting.

6) I did a quick data analysis for cardiology ward (baseline) and cardiology ward (comparison).The data points for comparison period is very less. More over, the authors have taken an "average of averages" for the time comparison. This is definitely not a correct practise. For instance, even in base line phase average time taken by nurse 5 is 30.7 sec and that of nurse 7 is 14 seconds. So nurses cannot be treated as "homogeneous units" in data analysis. Need more explanation on this.

Reviewer #2: Comments have been pasted from a Word document (attached) as info was lost due to the way the system saves info. Data provided support the conclusions, however the data set is quite limited. The authors have taken a non-biased approach to measuring time impact, using eye-tracking technology rather than just direct observation – this is commendable. The appropriately cite the difficulty with other reports of time impact of drug changes using survey methods, which are affected by recall bias. Unlike most other publications that focus on pharmacy activities, this report focuses on nursing activity and the impact of drug changes. This situation may be more relevant to hospitals that put more drug control in the hands of pharmacy personnel and that use more automated systems, such as Automated Dispensing Units, barcode technology and even unit dose medications. Most North American institutions have medication orders written by generic name and drug selection is not required by nursing personnel. Thus drug changes (in brand provided) do not impact nursing time. The changes reported by the authors were not significant in all categories, with only semi-drug changes causing a significant increase in time spent by nursing – these changes were relatively short-lived, with time spent returning almost to baseline. IN the outpatient setting of rheumatology clinic, time was impacted more significantly, but for a brief interval only for drug changes and also for drug shortage situations, which may occur at any time of year, regardless of contract changes.

The authors suggest (lines 282-286) that system changes such as prescribing using generic names could prevent confusion during drug changes. Inventory management was briefly alluded to as the medication room continued to have stock of the previous brand, leading to incongruence between prescribed drug name and available drug name.

The authors suggest that administrators should be made aware of the need for additional time (resource) to adapt to drug changes, but they have not provided a financial cost for this additional resource by extrapolating their data to an entire hospital implementing numerous drug changes annually. Most administrators would require more evidence than this small sample size to justify changes in resource allocation.

It would have been interesting to have the researchers measure the time impact on nursing personnel, particularly in the outpatient rheumatology unit of switching brands of biologic medications from reference brand to biosimilar, as nursing education and support of patients is crucial for acceptance and adherence in that scenario.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: comments on PONE-D-20-21353.docx

PLoS One. 2021 Feb 25;16(2):e0247499. doi: 10.1371/journal.pone.0247499.r002

Author response to Decision Letter 0


26 Nov 2020

Dear reviewers at PLOS ONE

Thank you for a thorough reading and constructive criticism of our manuscript entitled "Time spent by hospital personnel on drug changes: A time and motion study from an in-and outpatient hospital setting”. We are pleased with the opportunity to revise the original manuscript and we especially thank you for your relevant comments to the article. You have pointed out important aspects that needs clarifications, which we have tried our best to respond to. With these improvements, we hope to attract readers all over the health care sector, health authorities and the pharmaceutical industry.

It is with great pleasure that we send this rebuttal letter that responds to your suggested revision of the original manuscript for resubmission to PLOS ONE. We hope the revised article meets your expectations satisfactorily. Again, we thank you for your professional opinion, constructive feedback and input. Enjoy the revised article.

On behalf of all co-authors,

Yours sincerely,

Joo Hanne Poulsen

________________________________________

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

We hope that the revised manuscript appears technically sound, and that the data support the conclusions.

________________________________________

2. Has the statistical analysis been performed appropriately and rigorously?

Answer to reviewer #1: Please see the detailed comments under section 5, item 6.

________________________________________

3. Have the authors made all data underlying the findings in their manuscript fully available?

No comment

________________________________________

4. Is the manuscript presented in an intelligible fashion and written in standard English?

Thank you.

________________________________________

5. Review Comments to the Author

Reviewer #1:

1) The data has been collected by a single person in this study (JHP). This definitely leads to personal bias in all the data collection aspects. It would have been better if at least two members were involved in data collection stage.

Answer to reviewer #1, question 1: We agree that this is a limitation in the study, which will be discussed more clearly in the revised manuscript under “strength and limitations”. In continuation of #reviewer comment 4), these limitations have been clarified and discussed in the revised manuscript.

We hope that it meets your comment satisfactorily.

2) The authors have mentioned that it would not be possible to measure the Hawthorne effect. But this is an experimental study which has been carried out using sophisticated techniques like Tobii eye tracker, Go pro camera etc. Unless the nurses and SHA are trained on these methods, the impact created by these equipment on the behaviour cannot be underestimated.

Answer to reviewer #1, question 2: We agree that the Hawthorne effect should not be underestimated. The use of an eye tracker in this study has affected the nurses and SHA, but the magnitude of the effect is unfamiliar, as nurses and SHA could be either faster or slower in the presence of an observer, eye tracking and go-pro camera. However, we have stated this limitation more clearly in the revised manuscript.

“The extent of the Hawthorne effect is difficult to estimate in the study, but the observer is assumed to have affected the observed participants to some extent. However, the general impression is that this bias diminished over time, since the participants became more and more comfortable with being observed [32]. Additionally, the physical appearance of the go-pro camera and the eye-tracking glasses mounted to the participant’s head have indeed also affected the participants while being observed. However, just as the bias related to the observer’s presence, the general level of interference of the glasses is assumed to diminish over time as participants become more accustomed with the glasses. The Hawthorne effect in this matter is impossible to escape, unless the nurses and SHA became accustomed to working with the glasses”.

We hope that it meets your comment satisfactorily.

3) In the cardiology wing, data has been collected in March 2019 (baseline) and April-May 2019 (immediately after DCs are introduced). This is definitely not a good comparison period because the authors have taken a baseline period wherein the nurses and SHAs were very well versed with the existing drugs (March 2019), and the study period of April-May 2019 is a learning phase even for an experienced nurse/SHA. If the data was collected a few months after the drug change (DC), the actual impact of the time could have been assessed and concluded.

Answer to reviewer #1, question 3: Thank you for your observation. We would like to emphasize that the purpose of the study was to explore the time spent by hospital personnel in a drug change situation. Thus, we were specifically interested in this phase immediately after a DC, which is the phase where the personnel gets familiar with the new drug. Furthermore, we were interested in exploring, whether the DS phase would persist long term, but this was only explored in the outpatient clinic. However, we acknowledge that the meaning of a

“DC situation” may be unclear. Thus, in the introduction section (line 74) we attempt to clarify what a DC situation embodies (changes to drugs new/unfamiliar to the dispensing personnel).

“The focus of this study is the DC situation, meaning the actual changes to new drugs unfamiliar to the dispensing personnel”.

Further, in the discussion, an additional statement is applied to the fact that no follow-up from the cardiology ward was made.

“No follow-up at the cardiology ward took place and thus, claiming that the extra time spent on DCs are related to immediate expenses due to tender are not possible. However, the follow-up data from the rheumatology outpatient clinic indicates that the extra time observed in relation to DC diminished over time and returns to baseline. Thus, one could assume a similar trend at the cardiology ward as the nurses and SHA become more familiar with dispensing of the implemented drugs”.

We hope that our specifications meet your comment satisfactorily.

4) In pages 7 & 8 of the manuscript, the authors mention how the software used for collecting data of Tobii glass tracker works. "Potential irrelevant times have been discarded". The authors need to explain more on how they decided irrelevant time. Moreover observing times from video and using it for data collection purpose can include 'bias'. Need to be addressed appropriately.

Answer to reviewer #1, question 4: We agree that there is a bias related to the use of observing time from video and using it as data. Further, having one researcher (JHP) performing the coding may have resulted in intra-rating bias. These limitations have been clarified and discussed in the revised manuscript.

“At the cardiology ward, the same person (JHP) performed all the observations and coding of data. This may have resulted in personal and intra-rating bias, which could potentially affect the reliability of the study [40]. Obviously, having two or more researcher performing the observations and coding independently, discuss their finding or calculating a coder reliability, would enhance the overall reliability and reduce potential personal bias in the study. One way to minimize the potential intra-rating bias is to reduce the risk of “coder-drift”, which refers to applying the coding differently due to boredom or fatigue when coding larger data set at once [40]. However, in this study the coding was performed immediately after each observation and thus potentially reduce intra-rating bias [40]. Further, figure 1 displays the coding frame for the observations hereby increasing the transparency of the coding of included and discarded time. Conversely, having the same person performing the data collection results in less observation bias and reliability issues compared to the outpatient clinic, where pharmacy internship students were involved too. Despite the guidance of students, there might be differences in the perception of the time registrations in the consultation elements. However, these differences are considered to have minor influence on the registered time differences and overall findings”.

Additionally, based on your relevant comment, figure 1 has been added to increase the transparency of the data analysis. Figure 1 provides an example of the coding of relevant and irrelevant time intervals related to medicine dispensing at the cardiology ward.

“The time division, also referred to as coding in this study, was performed immediately after each observation. An example of the coding of relevant and irrelevant time intervals related to medicine dispensing step 3-6 at the cardiology ward is provided in Fig 1”. See Fig 1. Coding of relevant and irrelevant time intervals – an example. An example of coding of relevant and irrelevant time intervals related to medicine dispensing at the cardiology ward.

We hope that our specifications and supplement of the table to the manuscript meet your comment satisfactorily.

5) The authors should explain why they have used different data collection techniques for inpatient (eye tracker, video etc.) and outpatient (mobile stop watch) setting.

Answer to reviewer #1, question 5: We agree with your comment. Hence, in the method section, the reasons for the different data collection techniques are highlighted further.

“As the dispensing process at the cardiology ward involves seconds, the use of a refined and detailed data collection technique is required. Thus, the eye tracking was used in this setting. Additionally, the dispensing process at the rheumatology outpatient setting contain other activities and patients, thus, the use of an overall time measurement, such as a stopwatch was more useful in this setting. The use of the details provided by the eye tracking were not relevant in outpatient setting, just as the physical presence of the glasses would induce a considerable disturbance in the patient consultation. Thus, different data collecting technique were used for in- and outpatient settings”.

We hope that our specifications meet your comment satisfactorily.

6) I did a quick data analysis for cardiology ward (baseline) and cardiology ward (comparison).The data points for comparison period is very less. More over, the authors have taken an "average of averages" for the time comparison. This is definitely not a correct practise. For instance, even in base line phase average time taken by nurse 5 is 30.7 sec and that of nurse 7 is 14 seconds. So nurses cannot be treated as "homogeneous units" in data analysis. Need more explanation on this.

Answer to reviewer #1, question 6: Thank you for the comment. We acknowledge and agree that the nurses are not a homogeneous group, however; we are unsure what is meant by the “average of averages”. The supporting information contain raw data for baseline, comparison and follow-up (outpatient clinic) and from this raw data, averages are calculated. Thus, we do not calculate an average for one specific nurse and then calculate the averages for all nurses afterwards. Further, we are aware of the differences between the registered dispensing, thus, the standard deviation, as well as the minimum and maximum, are outlined in the manuscript. In these tables the variations between the different time points appear. Additionally, we do not focus on the time differences between the individual nurses at the cardiology ward. It is not of relevance to the study to adjust for the individual nurse before and after the DCs, as this would entail the dispensing of the exact same drug in both periods, which is not measured and thus not focused on in this study.

We are happy to present data in another way, however; a clarification of the comment in further details would be needed for us to comply to the comment satisfactorily.

_____________________________________________________________

Reviewer #2: Comments have been pasted from a Word document (attached) as info was lost due to the way the system saves info. Data provided support the conclusions, however the data set is quite limited.

Answer to reviewer #2: We fully agree with the comment and we have stated that more clearly in the manuscript in terms of affecting the reliability of results.

“Even though the actual implementation of DCs were effective from April 1st, relatively few DCs were observed in the cardiology ward in the comparison period (April and May), which potentially affects the reliability of the results”.

We hope that our specifications meet your comment satisfactorily.

The authors have taken a non-biased approach to measuring time impact, using eye-tracking technology rather than just direct observation – this is commendable. The appropriately cite the difficulty with other reports of time impact of drug changes using survey methods, which are affected by recall bias. Unlike most other publications that focus on pharmacy activities, this report focuses on nursing activity and the impact of drug changes. This situation may be more relevant to hospitals that put more drug control in the hands of pharmacy personnel and that use more automated systems, such as Automated Dispensing Units, barcode technology and even unit dose medications. Most North American institutions have medication orders written by generic name and drug selection is not required by nursing personnel. Thus drug changes (in brand provided) do not impact nursing time. The changes reported by the authors were not significant in all categories, with only semi-drug changes causing a significant increase in time spent by nursing – these changes were relatively short-lived, with time spent returning almost to baseline. IN the outpatient setting of rheumatology clinic, time was impacted more significantly, but for a brief interval only for drug changes and also for drug shortage situations, which may occur at any time of year, regardless of contract changes.

The authors suggest (lines 282-286) that system changes such as prescribing using generic names could prevent confusion during drug changes. Inventory management was briefly alluded to as the medication room continued to have stock of the previous brand, leading to incongruence between prescribed drug name and available drug name.

The authors suggest that administrators should be made aware of the need for additional time (resource) to adapt to drug changes, but they have not provided a financial cost for this additional resource by extrapolating their data to an entire hospital implementing numerous drug changes annually. Most administrators would require more evidence than this small sample size to justify changes in resource allocation.

Answer to reviewer #2: We fully agree with the comment. Thus, we have calculated and thus transitioned the reportable time spent on dispensing and extradition of medicine from in- and outpatient settings into economical expenses in USD. Details and additional sections are provided in order to calculate the economic impact. Thus, they are found in the method section for both sub-studies, a new economic impact section (in method and results), just as the discussion and conclusion of the economic impact is changed accordingly to the results.

We hope that this supplement meets your comment satisfactorily.

It would have been interesting to have the researchers measure the time impact on nursing personnel, particularly in the outpatient rheumatology unit of switching brands of biologic medications from reference brand to biosimilar, as nursing education and support of patients is crucial for acceptance and adherence in that scenario.

Answer to reviewer #2: We agree with this perspective. It would have been highly interesting to explore DCs of biosimilar medicines from the perspectives of nursing and patient education, but the focus of this study was on general DCs due to tendering. A comment in the discussion section containing DC from originator to biosimilar are included. However, another study would be required in order to explore this perspective in details.

“Further, this study focusses on a generic DC due to tender, but one could image that dealing with DC from originator to biosimilar would require extra resources for nursing education and patient information, due to another complexity of the DC. However, another study would be required in order to explore this perspective in details”.

We hope that this supplement meets your comment satisfactorily.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Susan Horton

21 Dec 2020

PONE-D-20-21353R1

Time spent by hospital personnel on drug changes: A time and motion study from an in-and outpatient hospital setting

PLOS ONE

Dear Dr. Poulsen,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please ensure that you address comments 1, 3 and 4 of reviewer 1. Please respond to comment 2 of reviewer 1 as well as possible given the data that you have.

Please submit your revised manuscript by Feb 04 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Susan Horton

Academic Editor

PLOS ONE

Additional Editor Comments (if provided):

Reviewer 2 is satisfied with the changes made; I hope you can respond to Reviewer 1's remaining questions.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I have gone through the comments that you have provided. There are a few unanswered questions.

1) Can you please clarify the objective of the study? If the focus is only on seeing the time change during DC, it is very important to explain the duration of this effect? For example, say if a new drug change has happened on April 1st, till what time do you observe this increased drug dispensing time? Is it till May 1st or June 1st etc..

2) You mention that ". The extent of the Hawthorne effect is difficult to estimate in the study, but the observer is assumed to have affected the observed participants to some extent. However, , but the general impression is that this bias diminished over time, since the participants became more and more comfortable with being observed"?

What is the meaning diminished over time? This is again connected to previous question. If this claim has to be made, then you need to have the following data. Before drug change, identify the base line time for dispensing with and without observer. Quantify the difference between the two. Once you notice that there is no statistical difference in the base line time of dispensing for baseline (with and without observer), you need to look for effect in situations of drug change. I comment this based on your results in Table 3. For baseline, you have 20.5 +/- 10.5 as the time. However after DC it is 28.4 +/- 16.3. Higher standard deviation can be due to presence of observer or due to the change in drugs. This is definitely not a good thing. Again, you do not mention how many days did this increased time (28.4 sec) lasted after DC.

3) Figure 1 is unclear. Please provide a better quality picture and an example of timelines for a particular scenario.

4) To add further, since I noticed that the standard deviation is higher in DC, I wonder if it would be due to the effect of uncertainty in the measurements in itself. Can you please provide how much is the uncertainty of the measurement system?

Reviewer #2: The authors have addressed my comments very well. The paper reads well and the authors have made adjustments based on other reviewer comments also. The strengths and limitations section as well as economic impact have been enhanced.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Lauren F. Charbonneau, RPh, BScPharm, Manager, Pharmacy Sunnybrook Odette Cancer Centre

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Feb 25;16(2):e0247499. doi: 10.1371/journal.pone.0247499.r004

Author response to Decision Letter 1


3 Feb 2021

Dear reviewer #1 at PLOS ONE

Once again, thank you for a thorough reading and constructive criticism of our manuscript entitled "Time spent by hospital personnel on drug changes: A time and motion study from an in-and outpatient hospital setting”. We thank you for your comments to the article, and we have tried our best to respond to the aspects that needs further clarifications.

It is with great pleasure that we send this rebuttal letter that responds to your suggested revision of the original manuscript for resubmission to PLOS ONE. We hope the revised article meets your expectations satisfactorily.

On behalf of all co-authors,

Yours sincerely,

Joo Hanne Poulsen

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

We hope that the revised manuscript is now acceptable for publication.

________________________________________

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

We hope that the revised manuscript appears technically sound, and that the data support the conclusions

________________________________________

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

We believe that the statistical analysis that have been performed are appropriate and relevant and we hope that the revised manuscript is found acceptable for publication. ________________________________________

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I have gone through the comments that you have provided. There are a few unanswered questions.

1) Can you please clarify the objective of the study? If the focus is only on seeing the time change during DC, it is very important to explain the duration of this effect? For example, say if a new drug change has happened on April 1st, till what time do you observe this increased drug dispensing time? Is it till May 1st or June 1st etc.

Thank you for your comment. We would like to emphasize that the aim of the study is to explore time spend by hospital personnel in a drug change situation when dispensing medicine to in- and outpatients in a hospital setting in the Capital Region of Denmark. Thus, the focus of this study is on the specific DC situation, meaning the time where the drugs are actually changing to new drugs unfamiliar to the dispensing personnel. We acknowledge that it would be an interesting aspect to know the duration of the effect, but our study was not designed to answer this question.

In this study, we have thus not explored the length or duration of the period of ‘semi-drug change’ and DC. Therefore, we are unable to answer how long the duration of the effect on dispensing time that we have observed is. In the study, we assume a 4 week period of ‘semi-drug change’ and DC when calculating the economic impact, but the actual duration of the periods are unknown with our dataset. Thus, based on your comment, we will emphasize this further in the discussion of the economic impact (line 370-380).

At the cardiology ward, a total of 27 nurses and SHA’s cover the dispensing process in both day and evening shifts. Estimating that ‘semi-drug change’ and DC affect dispensing time in a period of 4 weeks leads to a calculated extra time of 2 hours and 22 minutes or 196 USD spent on the assumed ‘semi-drug change’ and DC at this particular cardiology ward. This extra time and expenses does not immediately seem to have a clinical and economic impact, especially not on a daily basis with extra time corresponding to 303 seconds and 7 USD. However, the size of the cardiology ward is assumed to cover a standard medical ward in the Capital Region of Denmark. Thus, multiplication of the expenses with the total number of medical wards will show a considerably amount of additional expenses spent locally, regionally or even nationally. It should be emphasized that the estimated 4 weeks period with ‘semi-drug change’ and DC are based on assumptions, since the actual duration of the periods are unknown in this study.

We hope that our specifications meet your comment satisfactorily.

2) You mention that ". The extent of the Hawthorne effect is difficult to estimate in the study, but the observer is assumed to have affected the observed participants to some extent. However, , but the general impression is that this bias diminished over time, since the participants became more and more comfortable with being observed"?

What is the meaning diminished over time? This is again connected to previous question. If this claim has to be made, then you need to have the following data. Before drug change, identify the base line time for dispensing with and without observer. Quantify the difference between the two. Once you notice that there is no statistical difference in the base line time of dispensing for baseline (with and without observer), you need to look for effect in situations of drug change. I comment this based on your results in Table 3. For baseline, you have 20.5 +/- 10.5 as the time. However after DC it is 28.4 +/- 16.3. Higher standard deviation can be due to presence of observer or due to the change in drugs. This is definitely not a good thing. Again, you do not mention how many days did this increased time (28.4 sec) lasted after DC.

Thank you for your comment. We have chosen to delete and re-write the sentence to meet your comment (line 418-428). We do not measure the Hawthorne effect, and therefore we do not know whether or not it diminishes over time, thus we simply wishes to acknowledge that it is theoretically present. However, as the same participants and observer is present in baseline and comparison, we assume that the Hawthorne effect is equally widespread in both data collection periods. In addition to this assumption, we have not changed any procedures or done anything differently in the data collection periods that can either minimize, maximize or affect the Hawthorne effect from one period to another.

The extent of the Hawthorne effect is difficult to estimate in the study, but the observer is assumed to have affected the observed participants to a minor extent. Additionally, the physical appearance of the go-pro camera and the eye-tracking glasses mounted to the participant’s head have indeed also affected the participants while being observed. The Hawthorne effect in this matter is impossible to avoid, unless the nurses and SHA became accustomed to working with the glasses. Further, as the same participants and observer is present in baseline and comparison, the Hawthorne effect is assumed equally widespread in both data collection periods, although the effect has not been measured in this study.

In terms of the standard deviations (SD) in baseline versus comparison, we acknowledge that there is a difference in SD’s. Based on the already assumed Hawthorne effect in both data collection periods, we do not assume that the Hawthorne effect has had a significant impact on SD. With regard to DCs, we agree that the effect on both mean and SD can be due to the change in drugs or ‘semi-drug change’. Another relevant factor that may impact the SD is the sample size. In baseline, the sample size is N = 161, whereas it is N = 35 (DCs and ‘semi-drug changes’) in comparison, and thus the calculation of SD in comparison is based on a relatively small sample size, which implies a larger SD. We have not included this in the discussion as it is a statistical technicality and the study was not designed to collect generalizable data and thus no power calculation were performed before data collection.

With regard to the duration of the effect on dispensing time we hope that our provided specifications meet the comment by Reviewer #1 satisfactorily.

3) Figure 1 is unclear. Please provide a better quality picture and an example of timelines for a particular scenario.

Thank you for your observation. Smaller corrections to figure 1 have been made in order to demonstrate more clearly how the coding of relevant and irrelevant time intervals related to dispensing at the cardiology ward have been divided and the time included or discarded in the study. An example of a time line for a particular scenario covering the dispensing process step 3-6 for Hexalactone has been provided (line 157-162).

An example of the coding of relevant and irrelevant time intervals related to medicine dispensing in the cardiology ward for a particular scenario covering the dispensing process step 3-6 for Hexalactone has been provided in Fig 1.

Fig 1. Coding of relevant and irrelevant time intervals – an example. An example of coding of relevant and irrelevant time intervals related to medicine dispensing at the cardiology ward for a particular scenario covering the dispensing process step 3-6 for Hexalactone.

We hope that the quality of figure 1 is more clear now and that the amendments meet the reviewers comment satisfactorily.

4) To add further, since I noticed that the standard deviation is higher in DC, I wonder if it would be due to the effect of uncertainty in the measurements in itself. Can you please provide how much is the uncertainty of the measurement system?

Thank you for the comment. We are not entirely sure what is meant with the “uncertainty of the measurement system”. Throughout the data collection, the same measurement methods in the in- and outpatient setting respectively have been used. Thus, we assume that the measurement methods hold the same uncertainty in both baseline and comparison.

Reviewer #2: The authors have addressed my comments very well. The paper reads well and the authors have made adjustments based on other reviewer comments also. The strengths and limitations section as well as economic impact have been enhanced.

Thank you very much for review and constructive feedback.

Attachment

Submitted filename: Response to Reviewer #1 at Plos One.docx

Decision Letter 2

Susan Horton

9 Feb 2021

Time spent by hospital personnel on drug changes: A time and motion study from an in-and outpatient hospital setting

PONE-D-20-21353R2

Dear Dr. Poulsen,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Susan Horton

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Thank you for addressing the remaining reviewer comments.

Reviewers' comments:

Acceptance letter

Susan Horton

12 Feb 2021

PONE-D-20-21353R2

Time spent by hospital personnel on drug changes: A time and motion study from an in-and outpatient hospital setting

Dear Dr. Poulsen:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Susan Horton

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Dataset. Time spent by hospital personnel at the in- and outpatient hospital setting.

    (XLSX)

    Attachment

    Submitted filename: comments on PONE-D-20-21353.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewer #1 at Plos One.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES