Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Sep 19;17(9):e0274907. doi: 10.1371/journal.pone.0274907

Impact of systematic medication review in emergency department on patients’ post-discharge outcomes—A randomized controlled clinical trial

Lisbeth Damlien Nymoen 1,2,*, Trude Eline Flatebø 1, Tron Anders Moger 3, Erik Øie 4, Espen Molden 2,5, Kirsten Kilvik Viktil 1,2
Editor: Raphael Cinotti6
PMCID: PMC9484649  PMID: 36121830

Abstract

Introduction

The main objective of this study was to investigate whether systematic medication review conducted by clinical pharmacists can impact clinical outcomes and post-discharge outcomes for patients admitted to the emergency department.

Method

This parallel group, non-blinded, randomized controlled trial was conducted in the emergency department, Diakonhjemmet Hospital, Oslo, Norway. The study was registered in ClinicalTrials.gov, Identifier: NCT03123640 in April 2017. From April 2017 to May 2018, patients ≥18 years were included and randomized (1:1) to intervention- or control group. The control group received standard care from emergency department physicians and nurses. In addition to standard care, the intervention group received systematic medication review including medication reconciliation conducted by pharmacists, during the emergency department stay. The primary outcome was proportion of patients with an unplanned contact with hospital within 12 months from inclusion stay discharge.

Results

In total, 807 patients were included and randomized, 1:1, to intervention or control group. After excluding 8 patients dying during hospital stay and 10 patients lacking Norwegian personal identification number, the primary analysis comprised 789 patients: 394 intervention group patients and 395 control group patients. Regarding the primary outcome, there was no significant difference in proportion of patients with an unplanned contact with hospital within 12 months after inclusion stay discharge between groups (51.0% of intervention group patients vs. 53.2% of control group patients, p = 0.546).

Conclusion

As currently designed, emergency department pharmacist-led medication review did not significantly influence clinical- or post-discharge outcomes. This study did, however pinpoint important practical implementations, which can be used to design tailored pharmacist-led interventions and workflow regarding drug-related issues in the emergency department setting.

Introduction

Over several decades transitions of care, for instance admission to an emergency department (ED), have been identified as a key risk event regarding drug-related patient safety [1, 2]. More than 60% of drug histories registered by physicians in the ED does not reflect patients’ actual drug use before admission [36]. Incomplete information about patients’ drug use during transition of care can lead to medication errors and drug-related problems during and after a hospital stay [710]. It is reported that up to 27% of hospital prescribing errors is linked to inaccurate or incomplete ED drug histories [8]. Hence, errors occurring during the ED stay can stick with the patient during the entire hospital stay. Drug-related problems are also common in the ED, it has been reported that 85% of patients admitted to the ED has at least one drug-related problem [11]. Furthermore, drug-related problems leading to ED visits has been reported to affect up to 30% of patients admitted to the ED [1218].

The increasing worldwide challenge with crowding in the ED [1921], force ED physicians to prioritize their time to ensure that all admitted patients receive appropriate emergency care. In several countries obtaining drug histories is a task assigned to ED physicians, and it has been reported that ED physicians down-prioritize obtaining drugs histories when the ED is crowded [22]. In addition, a growing body of evidence suggests that ED physicians do not recognize drug-related problems and drug-related ED visits in the fast-paced workflow, which can led to misdiagnosing and treatment of the symptoms instead of the actual problem [14, 15, 23, 24].

Integrating pharmacists in ED care has been reported to increase the quality of drug histories obtained in the ED [4, 25, 26], reduce medication errors during and after hospital stay [2729], and reduce delay of care [30]. Furthermore, systematic medication review conducted by pharmacists in the ED has been found to increase recognition of drug-related ED visits [14, 15]. Previous randomized controlled trials (RCT) investigating impact of pharmacist-led interventions on clinical outcomes have included patients from hospital wards (i.e., in-hospital patients) [3138]. Systematic reviews meta-analyzing results from these RCTs conclude that pharmacists-led interventions conducted in hospital wards reduce medication errors, reduce subsequent ED revisits [39], decreases drug-related hospital revisits, and all-cause readmissions [26]. The interventions in some of the prior RCTs have demanded massive resources due to follow up, for instance following the patient with several medication reconciliations and medication reviews during the entire hospital stay and further contacting the patients, by phone after discharge [3134, 38]. As hospital resources in the real-world setting is not unlimited, studies investigating more pragmatic and more implementable interventions are necessary. When initiating the presented study, no prior RCTs had investigated the impact of pharmacists-led interventions in the ED-setting on clinical outcomes. However, as length of hospital stay has decreased worldwide the last decades [40], drug-related ED visits are common, and frequent registration of incorrect drug histories in the ED is concerning, it is important to investigate interventions conducted during the ED stay i.e., early during the hospital admission to prevent drug-related harm during and after a hospital stay [8, 9].

Prior studies did not provide certain evidence with regards to what patient groups who could benefit from an ED pharmacist-led intervention. Surgical referral reason had been reported as a risk factor for clinically relevant medication discrepancies at admission to the ED [3, 41, 42], and medical referral reason had been identified as a risk factor for drug-related hospital admissions [43]. Further, no certain evidence with regards to a relevant age cut-off was presented in prior studies. Therefore, the aim of the presented study was to perform a RCT to investigate whether implementing pharmacist-led systematic medication reviews in the ED could impact clinical and post-discharge outcomes for a general ED population.

Methods

Study design

This parallel group, non-blinded RCT was conducted at the ED, Diakonhjemmet Hospital, a local, urban hospital in Oslo, Norway. Patients were included consecutively in periods from 24 April 2017 until the predetermined target number of 800 patients was enrolled on 16 May 2018. Fig 1 presents the patient flow of the study.

Fig 1. Flow chart of patients eligible for inclusion in the Emergency Department (ED).

Fig 1

The study was approved by the institutional review board at Diakonhjemmet Hospital and the Regional Committee for Medical and Health Research Ethics (2015/1356/ REK south-eastern A). Written informed consent was obtained from all patients before inclusion. The study was designed and reported according to the CONSORT 2010 Statement [44] (S1 Appendix CONSORT checklist). The study was registered in ClinicalTrials.gov, Identifier: NCT03123640 in April 2017, and closed for new participants May 2018. Fig 2 gives a graphical depiction of the study design. S2 Appendix shows the original study protocol, protocol amendments, and the timeline of the study with milestones.

Fig 2. Study design.

Fig 2

During emergency department (ED) stay the Intervention group (a) received standard care and pharmacist conducted systematic medication review (identifying drug-related problem), including medication reconciliation (obtaining patients’ actual drug lists). Findings from medication reconciliation and medication review were discussed with ED physician and documented in the electronical patient record. The control group (b) received standard care (by physicians and nurses).

Data for 12 months follow-up was harvested from the Norwegian Patient Registry (18/12607-10), a national registry which comprise information about all hospitalizations (including both isolated ED visits and admissions with or without ED visits). Data available from the Norwegian Patient Registry is routinely reported from all Norwegian hospitals. Each patient was followed for 12 months from their inclusion stay discharge and follow-up was stopped for the last patient on 30 May 2019.

To standardize study procedures, written operation procedures were developed regarding the inclusion- and randomization procedure, the data collection process, and the intervention deliverance. All involved study pharmacists were familiar with these operational procedures before study start.

Study setting

In Norway general practitioners (GPs) and the municipal emergency clinics have a gatekeeper function and handle less severe conditions. More severe conditions are referred from GPs or municipal emergency clinics or other healthcare personnel of the primary healthcare e.g., nursing home physicians, or paramedics, to the hospitals’ EDs. The referring healthcare personnel set a tentative referral reason after assessing the patient’s symptoms and conducting an initial examination (before the ED admission). Based on the tentative referral reason patients are allocated to see a physician from the Department of Internal Medicine (Medical referral reasons), or a physician from the Department of Surgery (Surgical referral reasons) at admission to the investigated ED.

In Norwegian EDs, physicians are responsible for obtaining and registering patients’ drug lists at admission (drug-history taking). In some Norwegian EDs clinical pharmacists are conducting medication reconciliation and communicate their findings to ED physicians. However, this is not established as standard care, and due to limited ED pharmacist resources majority of drug histories are obtained and registered by ED physicians without a systematic medication reconciliation. In the investigated ED at Diakonhjemmet Hospital the ED is normally covered by a 0.5 full-time equivalent pharmacist position. During the data collection of the presented RCT, these pharmacist resources together with additional pharmacist resources was utilized to conduct the intervention. Some Norwegian hospital wards received clinical pharmacist service, in Diakonhjemmet Hospital 15 hospital wards are covered by 4.7 full-time equivalent pharmacist positions as part of standard care.

Participants

Annually, 13500 patients 18 years or older with both medical and gastrointestinal or orthopedic surgical symptoms are referred to the ED at Diakonhjemmet Hospital. The average length of stay in the investigated ED was 3.2 hours in 2018. All patients arriving at the investigated ED, willing to/capable of providing written, informed consent were eligible for inclusion. Unconscious patients were not included e.g., severe intoxications. Patients aged ≥65 with hip-fracture were admitted to a specialized ED at another location, hence these patients were not included. The patient inclusion was performed by study pharmacists working shifts according to a pre-set study schedule, either between 9:00 am and 4:00 pm or between 4:00 pm and 10:00 pm, on both weekdays and weekends.

Originally an exclusion criterion regarding terminal ill patients with short life expectancy was stated. This criterion was not feasible to meet in the fast-paced workflow of the ED. Hence, patients were included regardless of this issue. Patients readmitted during the study period were not invited for ‘a second’ inclusion.

Randomization

In line with the developed inclusion and randomization operation procedure, patients were randomized to intervention- or control-group (1:1) by study pharmacists, after inclusion, i.e., after patients had given written, informed consent. Department of Biostatistics and Epidemiology at Oslo University Hospital organized the randomization sequence. This department had no contact with patients, study pharmacists or ED personnel. A random number generator program was used for randomization sequencing with a permuted block design. The study pharmacists were blinded to block size, which was randomly varied between 2–8 patients per block, average block size was 5.0 ± 2.2. Allocation information cards was packed in sequentially numbered, sealed, opaque envelopes by an independent administrator who took no further part in the study, and delivered to study pharmacists. The envelopes were assigned to each individual participant and opened in numbered sequence.

It was neither feasible to blind patients nor study pharmacists to the allocation after randomization. It was also impossible to blind the hospital staff regarding which of the patients belonged to the intervention group. Affiliates at the ED and hospital were, however, unable to distinguish between patients randomized to the control group and patients not participating in the study.

The Norwegian Patient Registry providing outcome data were blinded to group allocation.

Intervention

The control group received standard care during the ED stay, consisting of triage-nurse consultation (often included physical measurements), consultation by physician (including physical examination, medical and medication history taking) and nurse consultation. In addition, laboratory tests and other tests (e.g., x-rays, fecal occult blood test) were taken, analyzed, and assessed by physicians during the ED stay. Regarding ethical concerns, patients from the control group were excluded after randomization if; 1) Physicians at the ED requested an assessment from a pharmacist regarding the control group patient, 2) Study pharmacist revealed obvious drug-related problems of major clinical relevance during inclusion of the control group patient and had to intervene.

The intervention group received, in addition to standard care, a systematic medication review including medication reconciliation conducted by a study pharmacist early during the ED stay. The intervention was based on the integrated medicine management (IMM)-model [45], adjusted to the fast-paced workflow of the ED-setting [3], and conducted by experienced clinical pharmacists (study pharmacists).

The medication reconciliation consisted of a standardized patient interview, including use of a checklist with specific questions about drugs often omitted, e.g., eyedrops, inhalation drugs, contraceptives, drugs not taken daily etc. If the patient received assistance with taking drugs, the supporting person/personnel was contacted to be interviewed. In addition, sources providing information on drug prescribing, e.g., electronical prescription database, drug-list of patients with multidose drug dispensing, GPs, and other hospitals, were used to verify drugs in use and the respective dosages and brand names. The medication reconciliation was preferably conducted before the ED physician consultation [3], thus the ED physicians could utilize the results from the medication reconciliation during their consultation. Due to the critically illness of some patients and occasional ED crowding the medication reconciliation was not completed before ED physicians’ consultations for all included patients. The ED physician in charge of the patient was, however always alerted orally when the medication reconciliation was conducted. In addition, the complete drug list was documented in the hospital’s electronic patient record by the study pharmacists.

Following the reconciliation, a systematic medication review was performed. All drugs in the reconciled list were assessed according to predefined drug-related problems categories; drug monitoring, adherence issues, adverse effects, drug-interactions, non-optimal drug therapy, unnecessary drug, based on a validated medication review-tool [46] (detailed description of the drug-related problems categories are presented in S3 Appendix). The systematic medication review was conducted by interviewing patients and assessing initial examinations performed by ED nurses as well as laboratory tests results. In addition, computer resources were utilized (e.g., interaction databases, summary of product characteristics for drugs, and medical databases), and referral letters from GPs and municipal emergency were reviewed. After identifying drug-related problems in the medication review, possible actions to manage or solve the problems were suggested by the study pharmacists and documented in the electronic patient record, as well as orally communicated to the ED physician in charge of the patient.

After discharge an interdisciplinary team consisting of two chief physicians and three experienced clinical pharmacists classified all identified drug-related problems according to clinical relevance (issues of importance for the patient treatment). The interdisciplinary team had access to the following information for all intervention group patients; demographic data, results from laboratory tests during hospital stay, tentative referral reasons, final diagnoses (documented in the discharge note by the physician discharging the patient), the patient’s reconciled drug list, and identified drug-related problems. The interdisciplinary team classified the drug-related problems as clinically relevant to identify in the ED, clinically relevant to identify during the hospital stay, or not clinically relevant during the ED/hospital stay.

To investigate the efficiency of the intervention, implementation of study pharmacists’ recommendations regarding the documented reconciled drug list and drug-related problems was assessed. A study pharmacist retrospectively reviewed admission notes and discharge notes written by physicians, in addition to assessing laboratory tests from the ED visit ordered according to the medication review findings. The drug lists for intervention group patients documented by physicians at admission were considered complete if there were no medication discrepancies (e.g., omissions, additions, dosage discrepancies) regarding regular drugs compared with the reconciled drug list documented by study pharmacists. Physicians’ acceptance of the study pharmacists’ recommendations regarding drug-related problems was determined by reviewing if changes related to the recommendations were made in the drug list during ED/ hospital stay.

Outcome measures

To investigate clinical and post-discharge impact of the intervention, objective outcome measures which were possible to measure with a high degree of precision was desirable [47], in contrast to prior ED studies investigating more subjective outcomes [2730]. Relevant outcome measures were chosen based on outcomes in RCTs investigating pharmacist-led interventions in hospital wards [32, 37, 38]. The primary outcome measure was proportion of patients with an unplanned contact with hospital within 12 months after inclusion stay discharge (both ED revisits and hospital readmissions). This was chosen as primary outcome as only 12 months data were available for sample size calculation. S2 Appendix original study protocol and protocol amendments comprise further explanation of chosen outcomes.

Secondary follow-up outcomes were:

  • Proportion of patients with an unplanned contact with hospital within 180 days after inclusion stay discharge

  • Number of unplanned contacts with hospital per patient within 12 months after inclusion stay discharge

  • Time to next unplanned contact with a hospital within 12 months after inclusion stay discharge

Secondary inclusion stay outcomes were:

  • Proportion of patients not hospitalized following admission to the ED (patients with conditions resolved in the ED)

  • Length of stay at the ED

  • Overall length of hospital stay

  • Efficiency of the intervention (working model for conducting medication reconciliation and medication review in the ED-setting)

Amendment to study outcomes after the study commenced, although before any outcome data files were available:

  • Proportion of patients with an unplanned contact with hospital:
    • within 90 days after inclusion stay discharge
    • within 30 days after inclusion stay discharge

It was decided to add these amendments due to the relatively short intervention compared with the long follow-up time.

Sample size calculation

The sample size calculation was based on an expected readmission frequency of 50% during 12 months following inclusion [45], which is also in line with Norwegian readmission frequency. A 10% reduction in hospital readmissions was defined as a clinically relevant effect of the intervention, which was considered realistic according to earlier studies and accounting for our general population [32]. Accordingly, it was calculated that 385 patients would have to be included into each group, with significance level of 5% and study power of 80%. To compensate for dropouts, it was decided to include 400 patients in each project group, i.e., a total of 800 patients.

Statistical analysis

Data handling were conducted in EpiData manager and EpiData entry client 4.4.3.1 r691, EpiData Software [48]. Statistical analyses were carried out in STATA Statistical Software: Release 16., StataCorp LLC 2019. Demographic statistics are given as median and interquartile ranges (IQRs) for continuous variables and as percentage for categorical variables.

Pearson’s chi-square test was applied to determine proportion of patients with unplanned contact with hospital during follow-up time (primary outcome), significance level was set to 0.05. Logistic regression was applied to determine odds ratio with 95% confidence interval (CI). The Kaplan-Meier estimator was used to estimate the survival function regarding time to next unplanned contact with hospital (event). Kaplan-Meier curves and log-rank test were applied to present a visual representation and test difference between groups, respectively. Cox proportional hazards model was utilized to determine hazard ratios and 95% CI. Negative binomial regression was utilized to compare mean length of stay and number of unplanned hospital events within 12 months after inclusion stay discharge, in the latter individual patient-time in study was applied as exposure-variable. Mann-Whitney U test was applied to compare median length of stay. For the secondary outcomes comparative analyses were explorative.

Analyses of mortality data revealed that 83% of patient who died within 12 months after inclusion stay discharge had an unplanned contact with hospital before date of death. Sensitivity analyses on the primary outcome and the survival analysis to determine time to next contact with hospital was conducted. In sensitivity analyses death was included as competing risk in the outcome measures (both death during hospital stay and within 12 months from inclusion stay discharge) (Table A and Fig A in S4 Appendix). In addition, sensitivity analysis on inclusion stay outcomes was conducted with patients who died during hospital stay (Table B in S4 Appendix). The sensitivity analyses revealed that results did not change and there was no difference between group in survival curve with death as event (Fig B in S4 Appendix). To clarify interpretation of the outcome measures it was therefore decided to excluded patients who died during hospital stay from both inclusion stay analysis and follow-up analysis. Further, in the primary outcome and survival analysis death within 12 months from inclusion stay discharge was censored. However, in the negative binomial regression, time of death within 12 months from inclusion stay discharge was accounted for through the exposure variable.

Intention-to-treat analysis was conducted on all patients with follow-up data allocated to each group. Per-protocol analysis was conducted on intervention group patients where the intervention medication reconciliation was completed, excluding patients were 1) no drugs were recorded by physicians in the electronical patient record (based on retrospective assessment of admission-note, medication chart and discharge note) and 2) information about regular drugs was omitted by physicians from the electronical patient record for unknown reason (based on retrospective assessment of admission-note and medication chart). All control group patients with follow-up data were included in per-protocol analysis.

Results

During the data-collection shifts between 24 April 2017 to 16 May 2018, approximately 1900 patients were admitted to the ED at Diakonhjemmet Hospital and were eligible for inclusion. Of these, 831 (43.7%) patients were assessed for eligibility for inclusion (Fig 1), whereas the remaining patients were not assessed due to ED crowding which exceeded study pharmacists’ capacity. Eighteen patients were excluded before randomization as they were not capable of providing written, informed consent or declined to participate. A total of 813 patients were included and randomized. After randomization, 6 patients were excluded, leaving 807 patients eligible for inclusion stay analysis, 405 in the intervention group and 402 in the control group (Fig 1).

Mean age for included patients (n = 807) was 65.4 years (±18.5), median age was 69.2 years (IQR 26.6, range 18.7–99.4). A total of 56.8% of the patients were aged over 65 years and 51.7% were men. Table 1 shows demographics for included patients in their allocated group.

Table 1. Demographics of included patients.

Variable Categories Intervention group n = 405 Control group n = 402
Age Median, years (IQR, range) 67.2 (27.3, 18.7–96.4) 70.2 (25.1, 19.1–99.4)
Patients ≥65 years number (%) 218 (53.8) 240 (59.7)
Sex (men) number (%) 212 (52.4) 205 (51.0)
Distribution of referral reasons number (%) Medical 281 (69.4) 282 (70.2)
Surgical 123 (30.4) 119 (29.6)
Rheumatological e 1 (0.3) 1 (0,3)
Triage category [49] number (%) Triage 1 0 1 (0,3)
Triage 2 127 (31.9) 136 (34.4)
Triage 3 157 (39.5) 147 (37.2)
Triage 4 111 (27.9) 110 (27.9)
Triage 5 3 (0,8) 1 (0,3)
Admitted from number (%) General practitioner 105 (25.9) 123 (30.6)
Nursing home 10 (2.5) 12 (3.0)
Other hospital 40 (9.9) 38 (9.5)
Municipal emergency room 134 (33.1) 112 (27.9)
Emergency medical communication centre 47 (11.6) 43 (10.7)
Directly to emergency department f 6 (1.5) 7 (1.7)
Various g 63 (15.6) 67 (16.7)
Living situation before admission number (%) Home without help 354 (87.4) 330 (82.1)
Home with assistant living (home care and/or multidose packed drugs) 40 (9.9) 55 (13.7)
Nursing home/ Rehabilitation 11 (2.7) 17 (4.2)
Admissions to DHa 12 months before inclusion stay admission Median number of admissions (IQR, range) 0 (1, 0–26) 0 (1, 0–28)
Number of patients with at least one admission (%) 128 (31.6) 148 (36.8)
Tentative referral reasons [50] (communicated by referring healthcare personnel) b number (%) Symptoms, signs, and abnormal clinical and laboratory findings, not elsewhere classified 149 (36.8) 144 (35.8)
Diseases of the circulatory system 88 (21.7) 93 (23.1)
Diseases of the digestive system 37 (9.1) 40 (10.0)
Injury, poisoning, and certain other consequences of external causes 31 (7.7) 31 (7.7)
Diseases of the respiratory system 25 (6.2) 32 (8.0)
Discharge diagnoses [50] (set by the hospital physician discharging the patient) b number (%) Diseases of the circulatory system 115 (28.4) 120 (29.9)
Symptoms, signs, and abnormal clinical and laboratory findings, not elsewhere classified 84 (20.7) 70 (17.4)
Diseases of the respiratory system 65 (16.0) 68 (16.9)
Diseases of the digestive system 57 (14.1) 56 (13.9)
Factors influencing health status and contact with health services 48 (11.9) 56 (13.9)
Endocrine, nutritional, and metabolic diseases 48 (11.9) 43 (10.7)
Number of regular drugs registered by physicians at admission per patient with a registered drug list Median regular drugs (IQR, range) 4 (IQR 6, 0–16) h 3 (IQR 6, 0–19)
Patients where no drug list was registered by physicians at admission number (%) 64 (15.8) 61 (15.2)
Number of regular drugs registered by study pharmacists at admission c per intervention group patient Median regular drugs (IQR, range) 4 (IQR 6, 0–19) -
Patients receiving pharmacist service in hospital wards (not part of the intervention) number (%) d Medication reconciliation 3 (0.7) 12 (3.0)
Medication review 63 (15.6) 48 (11.9)
Mortality number (%) Died during hospital stay 6 (1.5) 2 (0.5)
Died within 12 months from inclusion stay discharge 33 (8.4) 37 (9.4)

a DH: Diakonhjemmet Hospital

b The table presents only the most frequent tentative referral reasons and discharge diagnoses, each patient had 1–3 tentative referral reasons and 1–7 discharge diagnoses

c After conducting medication reconciliation as part of the investigated intervention

d Pharmacist service on hospital wards was part of standard care at Diakonhjemmet Hospital and was not part of the investigated intervention

e Patients with rheumatological referral reasons are seldom admitted to the investigated ED, majority of these patients are admitted elective

f Patients arrived directly to the emergency department without referral

g Various includes unlimited referral (patients with frequent hospitalization/ or patients with unresolved conditions can be offered this solution, and can contact the hospital directly when needed), patients with complications after recent surgical or medical hospital treatment (within 3 months), elective admissions, transfer from other unit at Diakonhjemmet Hospital, e.g., out-patient clinic, psychiatry unit

h Reconciled drug list documented by study pharmacist was available when physicians documented drug lists for intervention group patients

Intention-to-treat primary analysis revealed that 201 patients (51.0%) in the intervention group (n = 394) and 210 patients (53.2%) in the control group (n = 395) had an unplanned contact with hospital (ED-visit or hospital admission) within 12 months after inclusion stay discharge. The intervention had no statistically significant impact on the primary outcome, p = 0.546, OR 0.92, 95%CI 0.69, 1.21. According to per-protocol analysis 130 (48.7%) intervention group patients (n = 267) compared with 210 (53.2%) control group patients (n = 395) had an unplanned contact with hospital (ED-visit or hospital admission) within 12 months after inclusion stay discharge. However, the difference was not statistically significant, p = 0.258, OR 0.84, 95%CI 0.61, 1.14.

The intention-to-treat analysis revealed that median time to next unplanned contact with hospital (ED-visit or hospital admission) (Fig 3A) was 330 days for the intervention group and 308 days for the control group (p = 0.755, HR 0.97, 95%CI 0.80, 1.18). In the per-protocol analysis, the median time to next unplanned contact with hospital (ED-visit or hospital admission) (Fig 3B) exceeded follow-up time for the intervention group and was 308 days for the control group (p = 0.378, HR 0.91, 95%CI 0.73, 1.13).

Fig 3. Time to next unplanned contact with hospital (ED-visit or hospital admission).

Fig 3

(A) Intention-to-treat analysis of patients with follow-up data, intervention group (n = 394) vs. control group (n = 395) (B) Per-protocol analysis of patients with follow-up data, intervention group (n = 267) vs. control group (n = 395).

For intervention group patient where a drug list was registered by ED physicians at admission (n = 341) the median number of registered drugs were in line with the median number of drugs registered by study pharmacists in the reconciled drug lists (Table 1), and higher than the number of registered drugs per patient in the control group. However, for 64 (15.8%) patients in the intervention group no drug list were registered by physicians at admission (Table 1). Medication reconciliation conducted by study pharmacists revealed that these 64 intervention group patients in fact used median 2 (IQR 5, 0–15) regular drugs. In addition, it was revealed that for 66 (16.3%) of the intervention group patients the drug list was not correct, information regarding one or more of their regular drugs was incorrectly registered by physicians for unknown reason.

A total of 646 drug-related problems were identified and documented by study pharmacists through medication review. The interdisciplinary team assessed 23.1% of the drug-related problems to be clinically relevant to identify during the ED stay. Among these the most frequent drug-related problems were adverse effects (25.5%), drug monitoring (10.1%), adherence issues (9.4%) and drug-interactions (9.4%). Further, 50.9% of the drug-related problems were found to be clinically relevant during the hospital stay, whereas 26.0% were not clinically relevant to the patients’ treatment during hospital stay. Physicians implemented the study pharmacists’ recommendations for 44.8% of the drug-related problems where the interdisciplinary team concluded clinically relevant to identify during the ED or hospital stay.

Further analysed secondary outcomes is presented in Table 2.

Table 2. Secondary outcomes (Intention-to-treat analysis) comparing intervention- and control group patients.

Inclusion stay endpoints Intervention group Control group P-value
n = 399 n = 400
Patients not hospitalized Number (%) 129 (32.3%) 130 (32.5%) 0.959 a
Length of emergency department stay, Median, hours (IQR, range) 3.1 (2.1, 0.6–10.6) 3.0 (1.9, 0.6–8.9) 0.079 b
Mean, hours (±SD) 3.5 (±1.5) 3.3 (±1.4) 0.119 c
Length of hospital stay Median, days (IQR, range) 1.0 (2.0, 0.0–37.8) 1.0 (2.7, 0.0–34.1) 0.730 b
Mean, days (±SD) 2.1 (±4.1) 1.7 (±2.9) 0.073 c
Follow-up endpoints n = 394 n = 395
Patients in contact with hospital within 180 days from inclusion stay discharge Number (%) 163 (41.4%) 163 (41.3%) 0.976 a
Patients in contact with hospital within 90 days from inclusion stay discharge Number (%) 141 (35.8%) 125 (31.7%) 0.219 a
Patients in contact with hospital within 30 days from inclusion stay discharge Number (%) 89 (22.6%) 87 (22.0%) 0.849 a
Number of contacts with hospital within 12 months from inclusion stay discharge Median, IQR, range 1 (2, 0–34) 1 (2, 0–28) 0.523 c

Inclusion stay endpoints are presented for all patients who survived the inclusion stay. Follow-up endpoints are presented for all patients with available follow-up data.

a P-values generated with Pearson’s chi-square test

b P-values generated with Mann-Whitney U test

c P-values generated with negative binomial regression

Discussion

Pharmacists-led ED medication review did not significantly reduce the proportion of patients with an unplanned contact with hospital compared with standard care in the present study. These results are in line with three recent ED studies investigating similar interventions [5153]. Santolaya-Perrín et al. [51] conducted a RCT investigating the efficacy of a medication review program in the ED. It was reported that the program had no overall impact on the number of ED revisits and hospital readmissions compared with standard care, no other clinical and post-discharge outcomes was investigated [51]. One arm in a RCT conducted by Graabaek et al. [52] investigated impact of a pharmacist-led medication review in the ED on drug‐related readmissions, it was reported that the intervention had no impact on the chosen outcome. A quasi-randomized trial conducted by Hohl et al. [53] investigated clinical impact of pharmacists-led ED medication reviews, and report an 8% reduction in median length of stay in hospital within 30 days from discharge compared with standard care. However, a follow-up study to the quasi-randomized study found that pharmacist-led ED medication review did not result in long-term changes to outpatient health services utilization [54]. The results from our study and the other studies conducted in the ED are however in contrast with RCTs investigating impact of pharmacists-led interventions on clinical outcomes for patients in hospital wards. These in-hospital RCTs have reported reduction in ED revisits and hospital readmissions [32, 33, 35, 39], and further reduction in overall survival [38] as effects of their interventions. The difference in impact between RCTs conducted in hospital wards and studies performed in the ED may be explained by the patient population, the study setting, the degree of acceptance of pharmacists’ recommendations and the pragmatic nature of the ED interventions compared with the in-hospital interventions. The RCTs reporting effects on clinical outcomes after in-hospital pharmacist-led intervention investigated specific risk patient groups [32, 33, 35, 38], such as patients older than 80 years [32], patients using specific risk-drugs [33], multimorbid patients [38] or having specific prior diagnoses [35]. The three recent ED studies also included specific patient groups; patients aged over 65 years [51, 52], and patients at high risk of adverse drug events [53]. In the presented RCT we aimed to investigate the impact of the intervention in a general, real-world ED population with both medical and surgical referral reasons and regardless of patients’ age. This led to inclusion of a heterogeneous group of patients. The study population varied widely regarding their need for healthcare utilization post-discharge (0–34 unplanned contacts during 12 months). In addition, patients in need of a hospital admission following their ED stay were included alongside of patient who were directly discharged from the ED, indicating variation in the severity of their acute problems. This diversity in patient population may have obscured the effect of the intervention.

The ED setting is a challenging study setting compared with the hospital ward setting. Average length of stay in the investigated ED was 3.2 hours in 2018, and the limited timeframe may have affected the communication between physicians and study pharmacists necessary for implementation of the intervention. The acceptance of the study pharmacists’ recommendations on drug-related problems in our study was similar to the acceptance reported in two of the recent ED studies [51, 52]. However, the acceptance reported by Santolaya-Perrín et al. varied between the investigated study sites (27–53%) [51], and a statistically significant reduction in number of ED revisits and hospital readmissions was reported in the two study sites with the highest acceptance [51]. Hohl et al. [53] and the follow-up study [54] did not investigate this concern, however reported that low acceptance of pharmacists’ recommendations could be a study limitation. Earlier RCTs conducted in hospital wards [32, 37, 38] has reported higher acceptance of pharmacists’ recommendations compared to our study. Studies identifying non-adherence to pharmacist recommendations as a threat to the success of medication review interventions have been published after data collection of our study was finalized [54, 55]. Despite the low acceptance of study pharmacists’ recommendations our explanatory analyses estimated that median time until next unplanned contact with hospital was more than 57 days longer for the patients who received the intervention as planned (per-protocol) compared with standard care. Indicating that the intervention may have prolonged time until next unplanned contact with hospital for those patients where findings from the intervention was used by physicians at admission. These results must be verified by future research.

In the real-world work-chain healthcare professionals have to rely on the next link of the chain for follow-up [56]. The presented study aimed to investigate a pragmatic less resource-demanding intervention than used in prior RCTs conducted in hospital wards [3134, 38]. Hence, the study pharmacists did no further follow-up after communicating findings from the intervention to the ED physicians responsible for treating the patient and registering the findings in the electronic patient record. The reconciled drug lists documented by study pharmacists were, however, only used by physicians in 66% of the intervention group patients (per-protocol patients). Indicating that the working model for medication reconciliation used in our study, may not represent the most efficient working model in the time-pressured ED setting. A proposal for working model redesign to improve drug information flow is to assign the task of obtaining drug histories to trained clinical pharmacists, and further the pharmacists should document their findings directly in the medication chart [57]. This practice is currently not systematically implemented in Norway.

Regarding drug-related problems identified during ED medication review, it must be considered whether the ED is the suitable setting for identification. In the ED setting, the focus is on the acute problem bringing the patient to hospital, thus preventative long-term drug management decisions may not be prioritized [54]. A recent study conducted at Diakonhjemmet hospital reported that ED physicians conduct numerous essential tasks and distributes a minor proportion of their time on drug-related tasks, on average 7.8 minutes were spent on obtaining and registering a patient’s drug list at admission [58]. Pharmacist-led medication reconciliation conducted efficiently in the ED may reduce the physicians’ workload [58], however, assessments regarding identified drug-related problems requires dialogue and may be more challenging in the time-pressured environment of the ED. However, 23.1% of the drug-related problems identified by study pharmacists in our study were found to be clinically relevant to identify during ED visit. In addition, drug-related ED visits are common [1218, 59], and frequently not recognized by ED physicians in the fast-paced workflow [14, 15, 23]. A sub-study we recently published, investigating the intervention group in the presented RCT, reported that ED pharmacists efficiently flagged drug-related ED visits early during the ED visit [59].

If conducting medication review in the ED, the working model for medication review must be redesigned to fit the ED setting, for instance by focusing mainly on flagging ED visits that could be drug-related and identifying drug-related problems important to solve immediately, such as adverse effects, adherences issues, drug monitoring and interactions. Other identified drug-related problems must be followed-up during hospital stay or by healthcare personnel in the primary healthcare. However, our results indicates that this follow-up cannot solely rely on the next link of the chain. A referral of the patient to follow-up by a clinical pharmacist at a hospital ward can be a feasible solution. And for patients directly discharged from ED, the ED pharmacist can write a follow-up note addressed to relevant health care personnel in the primary healthcare [51, 60].

Regarding length of stay, explorative analyses revealed that the median and average length of stay in the ED were longer (6 minutes and 12 minutes longer, respectively) for the intervention group compared with the control group. Further, there was no difference in median length of hospital stay, however, average length of hospital stay was 10 hours longer for the intervention group compared with standard care. Many factors are known to influence length of stay both in ED and in hospital, e.g., physician and nurse staffing, accessibility of medical information, in-hospital capacity, patients’ age, and patients’ condition [61, 62]. It can, however, not be ruled out that the intervention prolonged the ED and/or hospital stay for some of the patients. These results must be verified by future research.

Strengths and limitations

This study was an RCT, and there was not observed any differences between demographics in groups at ED admission. Further, no evidence of random differences in standards of care during the hospital stay was observed between study groups. However, given the single study location, in one specific healthcare system (where patients are referred to the ED by healthcare personnel of the primary healthcare system), the results are not necessarily generalizable to EDs in other countries. Three study pharmacists were involved in conducting the intervention and strict guidelines for the deliverance of the intervention were made, which limits the inter-individual variability.

A strength with our RCT is that the chosen outcomes were objective measures, possible to measure with a high degree of precision. However, data for the outcome measures were harvested from routinely collected data (data from the Norwegian Patient Registry), which according to a recent meta-research study [63] makes it more challenging to reveal treatment benefits compared with traditional RCTs not using routinely collected data. Further, a core outcome set with recommended outcomes for studies investigating impact of medication review-interventions was recently published [64]. The core outcome set lists drug-related admissions, outcomes related to drug use (e.g., overuse, underuse) and patient-reported outcomes as recommended [64]. These outcomes are more subjective compared to our chosen outcomes; however, it can be argued that these outcomes may have been more sensitive to the impact of the investigated intervention.

Blinding to group allocation was not possible due to the nature of the intervention. Hence, a spillover effect of the intervention to control group patients cannot be ruled out. In addition, registration of clinical pharmacists’ ward activities revealed that 14.9% of the control groups patients and 16.3% of the intervention group patients received pharmacist service during their hospital stay (at hospital wards), as part of standard care. This may have affected the results and making it more difficult to reveal differences between groups.

Only 41.6% of patients admitted to the ED were assessed regarding eligibility for inclusion. Study pharmacists had no specific criteria for which patients to include in case of ED crowding. Summary statistics from Diakonhjemmet Hospital for the period from 2017 to 2018 reveal that 57.2% of patients admitted to the ED were aged over 65 years, further 73% of patients were referred with a medical referral reason, 27% with a surgical referral reason. Hence, both the annual age-distribution and distribution regarding referral reason were similar to the study population in the presented study. However, selection bias regarding other variables cannot be rejected.

An interdisciplinary team was utilized to assess the clinical relevance of the identified drug-related problems in this study, verifying the importance of the intervention findings. Further, adherence to the intervention findings was registered. Despite designing the study to be sufficiently powered, the number of intervention group patients that could be included in per-protocol analysis did not reach calculated sample size. Hence, the assumptions underlying the sample size computation were not realized for the intervention group in these analyses, and the results should therefore be interpreted with some caution.

Conclusion

This RCT revealed that ED pharmacist-led medication review as currently designed, did not significantly impact clinical outcomes or post-discharge outcomes. Nevertheless, exploratory analyses revealed promising results for patients receiving the intervention as intended. Our results indicates that future studies in this field could benefit from pharmacists taking on a more active role to ensure higher acceptance of their clinically relevant recommendations. The presented proposals for redesign of the pharmacist-led intervention are that pharmacists should document their findings from medication reconciliation directly in the medication chart. Further, ED pharmacists should focus on flagging ED visits suspected to be drug-related and revealing acute drug-related problems, such as adverse effects, adherences issues, drug monitoring, and interactions, which can be discussed with ED physicians. Patients in need of further evaluation and management of their drug list, should be referred to a targeted pharmacist service in hospital wards. Results from the presented RCT can be used to tailor pharmacist-led medication review to the ED setting in future studies. Additional studies with a redesigned intervention should be conducted to verify the results from the presented RCT.

Supporting information

S1 Appendix. CONSORT checklist.

(PDF)

S2 Appendix. Original study protocol, protocol amendments, and the timeline of the study with milestones.

(PDF)

S3 Appendix. Detailed description of the drug-related problems categories.

(PDF)

S4 Appendix. Sensitivity analyses and survival curves.

(PDF)

Acknowledgments

The authors thank Ann-Christin Riddarsporre who contributed as study pharmacist, Therese Tran and Ingrid Kinne Tunestveit who summarized patient information presented to the interdisciplinary team, Merethe Nilsen and Aasmund Godø who contributed as members of the interdisciplinary team, employees at the emergency department and physicians affiliated to the emergency department during the data collection for the positive attitude to the study, and finally, Andrew H. Reiner at Oslo Center for Biostatistics and Epidemiology for valuable support during the preparation of outcome data files.

Data Availability

The data that support the findings of this study are not publicly available, because of the content of sensitive patient information and indirect patient identifiers, imposed by the Regional Committee for Medical and Health Research Ethics (REC) (2015/1356/ REK south-eastern A). Data may be obtained from a third party, Diakonhjemmet Hospital (contact via e-mail: postmottak@diakonsyk.no) on reasonable request, but restrictions apply to the availability of these data, which were used under license for the current study, and thus cannot be made publicly available. Deidentified participant data are available from the authors on reasonable request and with permission of Diakonhjemmet Hospital and REC (contact via e-mail: rek-sorost@medisin.uio.no).

Funding Statement

The study was funded by Diakonhjemmet Hospital Pharmacy AS, Diakonhjemmet Hospital fund for research, innovation and professional development and Diakonhjemmet Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.World Health Organization, Transitions of Care: Technical Series on Safer Primary Care. Geneva; 2016. Licence: CC BY-NC-SA 3.0 IGO. https://apps.who.int/iris/bitstream/handle/10665/252272/9789241511599-eng.pdf [cited 2022 May 16].
  • 2.World health Organization, Medication Safety in Transitions of Care. Geneva; 2019 (WHO/UHC/SDS/2019.9). Licence: CC BY-NC-SA 3.0 IGO. https://www.who.int/publications/i/item/WHO-UHC-SDS-2019.9 [cited 2022 April 17].
  • 3.Damlien L, Davidsen N, Nilsen M, Godø A, Moger TA, Viktil KK. Drug safety at admission to emergency department: an innovative model for PRIOritizing patients for MEdication Reconciliation (PRIOMER). Eur J Emerg Med. 2017;24(5):333–9. doi: 10.1097/MEJ.0000000000000355 [DOI] [PubMed] [Google Scholar]
  • 4.Choi YJ, Kim H. Effect of pharmacy-led medication reconciliation in emergency departments: A systematic review and meta-analysis. J Clin Pharm Ther. 2019;44(6):932–45. doi: 10.1111/jcpt.13019 [DOI] [PubMed] [Google Scholar]
  • 5.Caglar S, Henneman PL, Blank FS, Smithline HA, Henneman EA. Emergency department medication lists are not accurate. J Emerg Med. 2011;40(6):613–6. doi: 10.1016/j.jemermed.2008.02.060 [DOI] [PubMed] [Google Scholar]
  • 6.Tong EY, Roman CP, Mitra B, Yip GS, Gibbs H, Newnham HH, et al. Reducing medication errors in hospital discharge summaries: a randomised controlled trial. Med J Aust. 2017;206(1):36–9. doi: 10.5694/mja16.00628 [DOI] [PubMed] [Google Scholar]
  • 7.Institute for Healthcare Improvements, Medication Reconciliation to Prevent Adverse Drug Events (2018) http://www.ihi.org/Topics/ADEsMedicationReconciliation/Pages/default.aspx [cited 2022 May 10].
  • 8.Santell JP. Reconciliation failures lead to medication errors. Jt Comm J Qual Patient Saf. 2006;32(4):225–9. doi: 10.1016/s1553-7250(06)32029-6 [DOI] [PubMed] [Google Scholar]
  • 9.Kahn JM, Angus DC. Going home on the right medications: prescription errors and transitions of care. JAMA. 2011;306(8):878–9. doi: 10.1001/jama.2011.1209 [DOI] [PubMed] [Google Scholar]
  • 10.Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. The incidence and severity of adverse events affecting patients after discharge from the hospital. Ann Intern Med. 2003;138(3):161–7. doi: 10.7326/0003-4819-138-3-200302040-00007 [DOI] [PubMed] [Google Scholar]
  • 11.Nielsen TR, Andersen SE, Rasmussen M, Honoré PH. Clinical pharmacist service in the acute ward. Int J Clin Pharm. 2013;35(6):1137–51. doi: 10.1007/s11096-013-9837-1 [DOI] [PubMed] [Google Scholar]
  • 12.McLachlan CY, Yi M, Ling A, Jardine DL. Adverse drug events are a major cause of acute medical admission. Intern Med J. 2014;44(7):633–8. doi: 10.1111/imj.12455 [DOI] [PubMed] [Google Scholar]
  • 13.Zed PJ, Abu-Laban RB, Balen RM, Loewen PS, Hohl CM, Brubacher JR, et al. Incidence, severity and preventability of medication-related visits to the emergency department: a prospective study. CMAJ. 2008;178(12):1563–9. doi: 10.1503/cmaj.071594 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Hohl CM, Zed PJ, Brubacher JR, Abu-Laban RB, Loewen PS, Purssell RA. Do emergency physicians attribute drug-related emergency department visits to medication-related problems? Ann Emerg Med. 2010;55(6):493–502.e4. doi: 10.1016/j.annemergmed.2009.10.008 [DOI] [PubMed] [Google Scholar]
  • 15.Roulet L, Ballereau F, Hardouin JB, Chiffoleau A, Moret L, Potel G, et al. Assessment of adverse drug event recognition by emergency physicians in a French teaching hospital. Emerg Med J. 2013;30(1):63–7. doi: 10.1136/emermed-2011-200482 [DOI] [PubMed] [Google Scholar]
  • 16.Jatau AI, Aung MM, Kamauzaman TH, Rahman AF. Prevalence of Drug-Related Emergency Department Visits at a Teaching Hospital in Malaysia. Drugs Real World Outcomes. 2015;2(4):387–95. doi: 10.1007/s40801-015-0045-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Al-Arifi M, Abu-Hashem H, Al-Meziny M, Said R, Aljadhey H. Emergency department visits and admissions due to drug related problems at Riyadh military hospital (RMH), Saudi Arabia. Saudi Pharm J. 2014;22(1):17–25. doi: 10.1016/j.jsps.2013.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Nickel CH, Ruedinger JM, Messmer AS, Maile S, Peng A, Bodmer M, et al. Drug-related emergency department visits by elderly patients presenting with non-specific complaints. Scand J Trauma Resusc Emerg Med. 2013;21:15. doi: 10.1186/1757-7241-21-15 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Mentzoni I, Bogstrand ST, Faiz KW. Emergency department crowding and length of stay before and after an increased catchment area. BMC Health Serv Res. 2019;19(1):506. doi: 10.1186/s12913-019-4342-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Di Somma S, Paladino L, Vaughan L, Lalle I, Magrini L, Magnanti M. Overcrowding in emergency department: an international issue. Intern Emerg Med. 2015;10(2):171–5. doi: 10.1007/s11739-014-1154-8 [DOI] [PubMed] [Google Scholar]
  • 21.Schuur JD, Venkatesh AK. The growing role of emergency departments in hospital admissions. N Engl J Med. 2012;367(5):391–3. doi: 10.1056/NEJMp1204431 [DOI] [PubMed] [Google Scholar]
  • 22.Welch S, Finckh A. (2019). Prescribing errors in emergency department medication history taking: will electronic medication management systems help?. Journal of Pharmacy Practice and Research, 49, 400–402. [Google Scholar]
  • 23.Roulet LBF, Hardouin JB, Chiffoleau A, Potel G, Asseray N. Adverse drug event nonrecognition in emergency departments: an exploratory study on factors related to patients and drugs. J Emerg Med. 2014. [DOI] [PubMed] [Google Scholar]
  • 24.Mogensen CB, Thisted AR, Olsen I. Medication problems are frequent and often serious in a Danish emergency department and may be discovered by clinical pharmacists. Dan Med J. 2012;59(11):A4532. [PubMed] [Google Scholar]
  • 25.Mekonnen AB, McLachlan AJ, Brien JA. Effectiveness of pharmacist-led medication reconciliation programmes on clinical outcomes at hospital transitions: a systematic review and meta-analysis. BMJ Open. 2016;6(2):e010003. doi: 10.1136/bmjopen-2015-010003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Hatch J, Becker T., Fish J. T. Difference between Pharmacist-Obtained and Physician-Obtained Medication Histories in the Intensive Care Unit. Hospital Pharmacy. 2011;46 (4):262–8. [Google Scholar]
  • 27.Patanwala AE, Sanders AB, Thomas MC, Acquisto NM, Weant KA, Baker SN, et al. A prospective, multicenter study of pharmacist activities resulting in medication error interception in the emergency department. Ann Emerg Med. 2012;59(5):369–73. doi: 10.1016/j.annemergmed.2011.11.013 [DOI] [PubMed] [Google Scholar]
  • 28.Rothschild JM, Churchill W, Erickson A, Munz K, Schuur JD, Salzberg CA, et al. Medication errors recovered by emergency department pharmacists. Ann Emerg Med. 2010;55(6):513–21. doi: 10.1016/j.annemergmed.2009.10.012 [DOI] [PubMed] [Google Scholar]
  • 29.Stasiak P, Afilalo M, Castelino T, Xue X, Colacone A, Soucy N, et al. Detection and correction of prescription errors by an emergency department pharmacy service. CJEM. 2014;16(3):193–206. doi: 10.2310/8000.2013.130975 [DOI] [PubMed] [Google Scholar]
  • 30.Marconi GP, Claudius I. Impact of an emergency department pharmacy on medication omission and delay. Pediatr Emerg Care. 2012;28(1):30–3. doi: 10.1097/PEC.0b013e31823f232d [DOI] [PubMed] [Google Scholar]
  • 31.Farris KB, Carter BL, Xu Y, Dawson JD, Shelsky C, Weetman DB, et al. Effect of a care transition intervention by pharmacists: an RCT. BMC Health Serv Res. 2014;14:406. doi: 10.1186/1472-6963-14-406 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Gillespie U, Alassaad A, Henrohn D, Garmo H, Hammarlund-Udenaes M, Toss H, et al. A comprehensive pharmacist intervention to reduce morbidity in patients 80 years or older: a randomized controlled trial. Arch Intern Med. 2009;169(9):894–900. doi: 10.1001/archinternmed.2009.71 [DOI] [PubMed] [Google Scholar]
  • 33.Phatak A, Prusi R, Ward B, Hansen LO, Williams MV, Vetter E, et al. Impact of pharmacist involvement in the transitional care of high-risk patients through medication reconciliation, medication education, and postdischarge call-backs (IPITCH Study). J Hosp Med. 2016;11(1):39–44. doi: 10.1002/jhm.2493 [DOI] [PubMed] [Google Scholar]
  • 34.Kripalani S, Roumie CL, Dalal AK, Cawthon C, Businger A, Eden SK, et al. Effect of a pharmacist intervention on clinically important medication errors after hospital discharge: a randomized trial. Ann Intern Med. 2012;157(1):1–10. doi: 10.7326/0003-4819-157-1-201207030-00003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Hawes EM, Maxwell WD, White SF, Mangun J, Lin FC. Impact of an outpatient pharmacist intervention on medication discrepancies and health care resource utilization in posthospitalization care transitions. J Prim Care Community Health. 2014;5(1):14–8. doi: 10.1177/2150131913502489 [DOI] [PubMed] [Google Scholar]
  • 36.Shah M, Norwood CA, Farias S, Ibrahim S, Chong PH, Fogelfeld L. Diabetes transitional care from inpatient to outpatient setting: pharmacist discharge counseling. J Pharm Pract. 2013;26(2):120–4. doi: 10.1177/0897190012451907 [DOI] [PubMed] [Google Scholar]
  • 37.Lisby M, Thomsen A, Nielsen LP, Lyhne NM, Breum-Leer C, Fredberg U, et al. The effect of systematic medication review in elderly patients admitted to an acute ward of internal medicine. Basic Clin Pharmacol Toxicol. 2010;106(5):422–7. doi: 10.1111/j.1742-7843.2009.00511.x [DOI] [PubMed] [Google Scholar]
  • 38.Lea M, Mowé M, Molden E, Kvernrød K, Skovlund E, Mathiesen L. Effect of medicines management versus standard care on readmissions in multimorbid patients: a randomised controlled trial. BMJ Open. 2020;10(12):e041558. doi: 10.1136/bmjopen-2020-041558 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.De Oliveira GS, Castro-Alves LJ, Kendall MC, McCarthy R. Effectiveness of Pharmacist Intervention to Reduce Medication Errors and Health-Care Resources Utilization After Transitions of Care: A Meta-analysis of Randomized Controlled Trials. J Patient Saf. 2021;17(5):375–80. doi: 10.1097/PTS.0000000000000283 [DOI] [PubMed] [Google Scholar]
  • 40.OECD (2021), Health at a Glance 2021: OECD Indicators, OECD Publishing, Paris, 10.1787/ae3016b9-en. [cited 2022 January 6]. [DOI]
  • 41.Crook M, Ajdukovic M, Angley C, Soulsby N, Doecke C, Stupans I, et al. Eliciting comprehensive medication histories in the emergency department: the role of the pharmacist. Pharm Pract (Granada). 2007;5(2):78–84. doi: 10.4321/s1886-36552007000200005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Unroe KT, Pfeiffenberger T, Riegelhaupt S, Jastrzembski J, Lokhnygina Y, Colón-Emeric C. Inpatient medication reconciliation at admission and discharge: A retrospective cohort study of age and other risk factors for medication discrepancies. Am J Geriatr Pharmacother. 2010;8(2):115–26. doi: 10.1016/j.amjopharm.2010.04.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Kongkaew C, Hann M, Mandal J, Williams SD, Metcalfe D, Noyce PR, et al. Risk factors for hospital admissions associated with adverse drug events. Pharmacotherapy. 2013;33(8):827–37. doi: 10.1002/phar.1287 [DOI] [PubMed] [Google Scholar]
  • 44.Schulz KF, Altman DG, Moher D, Group C. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7(3):e1000251. doi: 10.1371/journal.pmed.1000251 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Scullin C, Scott MG, Hogg A, McElnay JC. An innovative approach to integrated medicines management. J Eval Clin Pract. 2007;13(5):781–8. doi: 10.1111/j.1365-2753.2006.00753.x [DOI] [PubMed] [Google Scholar]
  • 46.Ruths S, Viktil KK, Blix HS. Classification of drug-related problems. Tidsskr Nor Laegeforen. 2007;127(23):3073–6. [PubMed] [Google Scholar]
  • 47.Asmar R, Hosseini H. Endpoints in clinical trials: does evidence only originate from ’hard’ or mortality endpoints? J Hypertens Suppl. 2009;27(2):S45–50. doi: 10.1097/01.hjh.0000354521.75074.67 [DOI] [PubMed] [Google Scholar]
  • 48.Christiansen TB and Lauritsen JM. (Ed.) EpiData—Comprehensive Data Management and Basic Statistical Analysis System. Odense Denmark, EpiData Association, 2010-. http://www.epidata.dk.
  • 49.Mackway-Jones K MJ, Windle J. Emergency Triage Manchester Triage Group, 3rd Edition, John Wiley & Sons Inc, 2013, ISBN: 9781118299067.
  • 50.World Health Organization. (2015). International statistical classification of diseases and related health problems, 10th revision, Fifth edition, 2016. World Health Organization.
  • 51.Santolaya-Perrín R, Calderón-Hernanz B, Jiménez-Díaz G, Galán-Ramos N, Moreno-Carvajal MT, Rodríguez-Camacho JM, et al. The efficacy of a medication review programme conducted in an emergency department. Int J Clin Pharm. 2019;41(3):757–66. doi: 10.1007/s11096-019-00836-0 [DOI] [PubMed] [Google Scholar]
  • 52.Graabaek T, Hedegaard U, Christensen MB, Clemmensen MH, Knudsen T, Aagaard L. Effect of a medicines management model on medication-related readmissions in older patients admitted to a medical acute admission unit-A randomized controlled trial. J Eval Clin Pract. 2019;25(1):88–96. doi: 10.1111/jep.13013 [DOI] [PubMed] [Google Scholar]
  • 53.Hohl CM, Partovi N, Ghement I, Wickham ME, McGrail K, Reddekopp LN, et al. Impact of early in-hospital medication review by clinical pharmacists on health services utilization. PLoS One. 2017;12(2):e0170495. doi: 10.1371/journal.pone.0170495 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Kitchen SA, McGrail K, Wickham ME, Law MR, Hohl CM. Emergency department-based medication review on outpatient health services utilization: interrupted time series. BMC Health Serv Res. 2020;20(1):254. doi: 10.1186/s12913-020-05108-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Lisby M, Bonnerup DK, Brock B, Gregersen PA, Jensen J, Larsen ML, et al. Medication Review and Patient Outcomes in an Orthopedic Department: A Randomized Controlled Study. J Patient Saf. 2018;14(2):74–81. doi: 10.1097/PTS.0000000000000173 [DOI] [PubMed] [Google Scholar]
  • 56.Frankel RM, Tilden VP, Suchman A. Physicians’ Trust in One Another. JAMA. 2019;321(14):1345–6. doi: 10.1001/jama.2018.20569 [DOI] [PubMed] [Google Scholar]
  • 57.Should hospital pharmacists prescribe?contre. Can J Hosp Pharm. 2014;67(5):390–3. [PMC free article] [PubMed] [Google Scholar]
  • 58.Nymoen LD, Tran T, Walter SR, Lehnbom EC, Tunestveit IK, Øie E, et al. Emergency department physicians’ distribution of time in the fast paced-workflow-a novel time-motion study of drug-related activities. Int J Clin Pharm. 2021. doi: 10.1007/s11096-021-01364-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Nymoen LD, Björk M, Flatebø TE, Nilsen M, Godø A, Øie E, et al. Drug-related emergency department visits: prevalence and risk factors. Intern Emerg Med. 2022. doi: 10.1007/s11739-022-02935-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Cavanaugh J, Pinelli N, Eckel S, Gwynne M, Daniels R, Hawes EM. Advancing Pharmacy Practice through an Innovative Ambulatory Care Transitions Program at an Academic Medical Center. Pharmacy (Basel). 2020;8(1). doi: 10.3390/pharmacy8010040 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Asplin BR, Magid DJ, Rhodes KV, Solberg LI, Lurie N, Camargo CA. A conceptual model of emergency department crowding. Ann Emerg Med. 2003;42(2):173–80. doi: 10.1067/mem.2003.302 [DOI] [PubMed] [Google Scholar]
  • 62.Khosravizadeh O, Vatankhah S, Bastani P, Kalhor R, Alirezaei S, Doosty F. Factors affecting length of stay in teaching hospitals of a middle-income country. Electron Physician. 2016;8(10):3042–7. doi: 10.19082/3042 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Mc Cord KA, Ewald H, Agarwal A, Glinz D, Aghlmandi S, Ioannidis JPA, et al. Treatment effects in randomised trials using routinely collected data for outcome assessment versus traditional trials: meta-research study. BMJ. 2021;372:n450. doi: 10.1136/bmj.n450 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Beuscart JB, Knol W, Cullinan S, Schneider C, Dalleur O, Boland B, et al. International core outcome set for clinical trials of medication review in multi-morbid older patients with polypharmacy. BMC Med. 2018;16(1):21. doi: 10.1186/s12916-018-1007-9 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Larry Allan Weinrauch

24 Mar 2022

PONE-D-22-04157Impact of systematic medication review in emergency department on patients’ post-discharge outcomes -a randomized controlled clinical trialPLOS ONE

Dear Dr. Lisbeth Damlien Nymoen

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by May 08 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Larry Allan Weinrauch, MD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. 

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

In determining the best use of our pharmacy colleagues as part of the treatment team what have you discerned from this interaction?

Does pharmacy led parallel intervention trigger meaningful interaction or discussion with the ED team?

This effort was a "gatekeeper in" effort, and meaningful interaction with the team might have been helpful early in the stay, however with handoffs of care within the hospital and outside of the hospital these discussions get lost or fumbled. As such, are our outcomes suggesting an absence of statistical benefit true, or would we be better off with a "gatekeeper out" effort to drive better outcomes? As you point out, practitioner time is limited. How can we best husband our resources?

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

********** 

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

********** 

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

********** 

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

********** 

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a well-conducted and designed clinical trial with unfortunately negative results. Sample size and randomization are clearly delineated, and statistical plan both per-protocol and intent-to-treat are clearly stated with proper techniques. I have a few minor comments:

1. careful copyediting: Change "Statistics" to "Statistical Analysis" in the section heading; numerous errors (e.g., Pearson chi should be Pearson's chi-square test)

2. EMA guidelines no longer support the use of p-values to determine balance in baseline tables. This is because a p-value>.05 does not mean the null hypothesis is true, along with the issue of multiple testing since .05 is meaningless with so many tests.

3. Again, your statement that significance is set at .05 has no meaning except perhaps for the primary outcome analysis, which is confirmatory, because of the multiple testing issue. Secondary outcomes are either exploratory or there should be a Bonferroni-type correction.

4. In the conclusions, it should be stated as to whether the assumptions underlying the sample size computation were realized (not the sample size itself, but the assumptions).

Reviewer #2: TO THE AUTHORS:

The group presented an original investigation examining pharmacist-led efforts to improve medication safety during emergency department visits in this analysis. This study represents a continuation of the prior work in terms of scholarly work around the scientific concepts around medications safety within the emergency department environment. I would recommend revising the text to include a specific message, including more data from your cohort, and further refining the presented materials. Nevertheless, the aim of the manuscript should be to clarify the observation within the context of the submitted data and the specifics of the population selection and hopefully more work in the future around specific diagnosis or service line to reduce the heterogeneity of the targeted admissions. Furthermore, the conclusion should focus on extrapolating the results to positively refine the current work and positively impact the care. The presented manuscript could carry a different message regarding the importance of pharmacist-led efforts and the lessons learned for future initiatives. In addition, I have the following suggestions.

Suggestions:

• Although the rationale for this study and the primary hypothesis is stated clearly, I would recommend revising the introduction and focusing on the unique role of the pharmacist during a hospital visit, see https://pubmed.ncbi.nlm.nih.gov/?term=pharmacist+led+intervention+medication+reconciliation+admission&sort=pubdate&size=200

• Please provide the number of patients that were considered for the study before they were assessed for eligibility. Please add the number to both the results section and the figure.

• Please state clearly why hospitalization to medical or surgical wards was not chosen as the point of randomization but rather all comers to the emergency department, which could include those with high risk and low risk and a vast array of diagnoses

• Please provide the clinical characteristics of the population in both arms and compare the number of medications or categories across the two arms

• Please state the software name that was used for the analysis

• I would recommend shortening the discussion

• Please provide a statement about any possible variation of clinical management after the intervention, i.e., is there any reason for the reader to think that the patients in the intervention arm had different standards of care randomly than those in the control arm? In other words, did the intervention of pharmacist-led affect future decisions? during the emergency department stay that could lead to downstream effects of differentiation in the provided quality of care.

• Please provide more evidence for choosing your specific endpoints using the presented one; the hospitalization is a specific endpoint; however, it does not capture GP calls, admissions without emergency department visits.

Reviewer #3: This is an interesting paper on a randomised trial of pharmacist chart review in patients admitted to the emergency department. This is a complex sort of trial to run and a little harder than the usual drug trial, so the authors are to be commended on what they have done here. As with this sort of trial generally ,the reporting can get complex and as such I have a few areas of clarification:

1. Choice of endpoint - the idea of an unplanned hospital contact makes a lot of sense from a cost and resource point of view, as well as the appropriate severity. One presumes that causality is so woolly that it becomes hard to get to the most sensitive outcome which would be clinically relevant medication error. However, excluding deaths is probably not necessarily appropriate; death is worse than hospitalisation, and certainly unplanned, so at the very least an analysis showing no difference in interpretation if the deaths are included would be important - excluding these patients isn't according to the principle of ITT and the missing data is informatively missing.

2. The authors are to be commended on putting sufficient information in the sample size calculation to make it reproducible

3. Subversion of randomisation - envelopes are of course supremely subvertable; can the authors please confirm that the envelopes were opened in numbered sequence? What was put in place to stop a person opening the envelope before deciding whether or not to enrol? What was the average block length as it is this and not the variability that affects guessing next allocation (see the numerous papers on this)

4. Please do not test the baseline characteristics - if the randomisation works appropriately any differences MUST be down to chance.

5. The confidence intervals for effect do not rule out a 30% reduction in hospital contact - does this not imply the results are inconclusive here

6. It's unclear to me the extent to which pharmacists identify issues as part of routine as opposed to only during the sort of intensive note review here. This could be made clearer - is there also evidence of complete adherence to study protocol in both arms? Is there any chance of dilution of effect because of either a halo effect or because of time pressures lowering adherence? This may be in the bottom of page 17, but it would help to understand whether these pharmacy interventions largely replicated the intervention group and found nothing different (i.e. adherence was about 85% for control and 100% for intervention?

********** 

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PLOS One Review 2022.pdf

PLoS One. 2022 Sep 19;17(9):e0274907. doi: 10.1371/journal.pone.0274907.r002

Author response to Decision Letter 0


1 Jul 2022

Thank you for the invitation to submit a revised version of our manuscript to PLOS ONE.

In this letter we respond to each point raised by the academic editor and reviewers during the review process. And the manuscript is thoroughly revised to clarify and elaborate the addressed topics. The page references provided in this letter refers to the revised manuscript without tracked changes (“Manuscript”).

We sincerely thank the Academic Editor and all three reviewers for providing us with constructive and insightful comments to clarify the interpretation of our findings and improve our manuscript to meet PLOS ONE’s publication criteria.

During the manuscript revision we have ensured that our manuscript meets PLOS ONE's style requirements. In addition, in the revised cover letter we have explained the details regarding ethical and legal restrictions constraining our sharing of the data set utilized for analysis in this manuscript. Changes in reference list can be found after response to reviewers.

Thank you for considering our revised manuscript.

Additional Editor Comments:

In determining the best use of our pharmacy colleagues as part of the treatment team what have you discerned from this interaction?

- Our study revealed that pharmacists-led interventions have to be tailored to the fast-paced workflow of the emergency department. We revealed low acceptance of pharmacists’ recommendations in our study compared with similar in-hospital interventions, however, in line with recent studies investigating pharmacists-led interventions in the emergency department (Santolaya-Perrín et.al. 2019, Graabæk et.al. 2018). Low acceptance of pharmacists’ recommendations has recently been identifying as a threat to the success of medication review interventions (Lisby et.al. 2018, Kitchen et.al. 2020).

- Based on the experience from the presented study, our proposals for redesign of emergency department pharmacist-led interventions are presented in the revised manuscript (in the discussion section, se specific pages below, and conclusion, page 25). For the treatment team and the patient to take full advantage of the available pharmacists’ resources, pharmacist must take on an even more active role in the emergency department and actively refer patients to follow-up:

- Pharmacists should document their findings from medication reconciliation directly in the medication chart (page 22).

- Further, sort out and prioritize acute drug-related problems which can be discussed with emergency department physicians, and make a referral to a targeted pharmacist service in hospital wards for handling other drug-related problems (page 22-23).

- Flag emergency department visits that could be drug-related early during the emergency department stay (Nymoen et.al. 2022), which can be discussed with the emergency department physicians or referred to follow-up by an in-hospital pharmacist.

Does pharmacy led parallel intervention trigger meaningful interaction or discussion with the ED team?

- Based on experience from our RCT and our results we believe that pharmacist-led interventions can trigger meaningful interactions with the ED team. However, it is important that the interventions used by ED pharmacists are tailored to fit the fast-paced workflow in the ED, as described above and highlighted in our revised manuscript.

This effort was a "gatekeeper in" effort, and meaningful interaction with the team might have been helpful early in the stay, however with handoffs of care within the hospital and outside of the hospital these discussions get lost or fumbled. As such, are our outcomes suggesting an absence of statistical benefit true, or would we be better off with a "gatekeeper out" effort to drive better outcomes? As you point out, practitioner time is limited. How can we best husband our resources?

- Despite our negative results regarding clinical impact in the presented study, we believe that a pharmacist-led “gatekeeper in” effort has several advantages compared with a “gatekeeper out” effort, especially if combined with targeted pharmacist service in hospital wards as suggested in the revised manuscript (page 22-23). The introduction and discussion section in the manuscript is revised thoroughly to elaborate the advantages of an “gatekeeper-in” effort.

- We agree that a “gatekeeper out” effort may drive better outcomes, however we believe that with a redesigned “gatekeeper in”-intervention as proposed in our revised manuscript (page 22-23), both increased patient safety during a hospital stay and impact on post-discharge outcomes may be achievable.

Reviewers' comments:

- We are pleased that none of the reviewers had objections or comments regarding the listed questions.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

- Reviewer #1: Yes

- Reviewer #2: Yes

- Reviewer #3: Yes

________________________________________

2. Has the statistical analysis been performed appropriately and rigorously?

- Reviewer #1: Yes

- Reviewer #2: Yes

- Reviewer #3: Yes

________________________________________

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

- Reviewer #1: Yes

- Reviewer #2: Yes

- Reviewer #3: Yes

________________________________________

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

- Reviewer #1: Yes

- Reviewer #2: Yes

- Reviewer #3: Yes

________________________________________

5. Review Comments to the Author

Reviewer #1

This is a well-conducted and designed clinical trial with unfortunately negative results. Sample size and randomization are clearly delineated, and statistical plan both per-protocol and intent-to-treat are clearly stated with proper techniques.

- Thank you, Reviewer #1, for acknowledging our effort to clearly delineate the methodology and statistical plan of the presented study

I have a few minor comments:

1. careful copyediting: Change "Statistics" to "Statistical Analysis" in the section heading; numerous errors (e.g., Pearson chi should be Pearson's chi-square test)

- This is corrected in the revised manuscript (page 13).

2. EMA guidelines no longer support the use of p-values to determine balance in baseline tables. This is because a p-value>.05 does not mean the null hypothesis is true, along with the issue of multiple testing since .05 is meaningless with so many tests.

- We agree with this statement and the tests of baseline characteristics is removed from the revised manuscript (table 1, page 16, and throughout the manuscript).

3. Again, your statement that significance is set at .05 has no meaning except perhaps for the primary outcome analysis, which is confirmatory, because of the multiple testing issue. Secondary outcomes are either exploratory or there should be a Bonferroni-type correction.

- We agree, this is rephrased in the “Statistical Analysis” section (page 13) and revised throughout the results section.

4. In the conclusions, it should be stated as to whether the assumptions underlying the sample size computation were realized (not the sample size itself, but the assumptions).

- In the revised manuscript this is rephrased to align with this comment (page 25).

Reviewer #2

TO THE AUTHORS:

The group presented an original investigation examining pharmacist-led efforts to improve medication safety during emergency department visits in this analysis. This study represents a continuation of the prior work in terms of scholarly work around the scientific concepts around medications safety within the emergency department environment. I would recommend revising the text to include a specific message, including more data from your cohort, and further refining the presented materials. Nevertheless, the aim of the manuscript should be to clarify the observation within the context of the submitted data and the specifics of the population selection and hopefully more work in the future around specific diagnosis or service line to reduce the heterogeneity of the targeted admissions. Furthermore, the conclusion should focus on extrapolating the results to positively refine the current work and positively impact the care. The presented manuscript could carry a different message regarding the importance of pharmacist-led efforts and the lessons learned for future initiatives.

- Thank you, Reviewer #2, for recognizing that our study is a continuation of prior work within the topic of drug safety in emergency department.

- The manuscript has been thoroughly revised to clarify our results, experiences, and lessons learned. Further, the conclusion has been revised to underline the knowledge gained through the presented RCT, which is valuable when designing future studies in this field (page 25).

- Our RCT was designed and powered to investigate a general emergency department population, thus our data were analyzed as originally intended. Sub-group analyses of specific patient-groups could have been interesting. However, as the study was not designed and powered for this, the results from such sub-group analyses may have been unreliable and affected by many factors (Brookes ST, Whitley E, Peters TJ, Mulheran PA, Egger M, Davey Smith G. Subgroup analyses in randomised controlled trials: quantifying the risks of false-positives and false-negatives. Health Technol Assess. 2001;5(33):1-56. doi: 10.3310/hta5330). No changes are conducted regarding this issue in the revised manuscript.

In addition, I have the following suggestions.

Suggestions:

Although the rationale for this study and the primary hypothesis is stated clearly, I would recommend revising the introduction and focusing on the unique role of the pharmacist during a hospital visit, see https://pubmed.ncbi.nlm.nih.gov/?term=pharmacist+led+intervention+medication+reconciliation+admission&sort=pubdate&size=200

- We agree, in the revised manuscript the introduction section is elaborated to highlight the unique roles of the pharmacist during a hospital stay, and also within the emergency department setting (page 3-4).

Please provide the number of patients that were considered for the study before they were assessed for eligibility. Please add the number to both the results section and the figure.

- As stated in the original manuscript, all patients admitted to the emergency department during the data-collection shifts were in principle eligible for inclusion (1900 patients). Unfortunately, due to occasionally ED crowding which exceeded study pharmacists’ capacity only 831 of these were assessed for eligibility with regards to willingness and capability of providing written, informed consent. In the revised manuscript we have rephrased to clarify (page 14) and added the total number of eligible patients to Fig. 1 Flow chart of patients eligible for inclusion in the Emergency Department (ED) (page 5).

Please state clearly why hospitalization to medical or surgical wards was not chosen as the point of randomization but rather all comers to the emergency department, which could include those with high risk and low risk and a vast array of diagnoses

- When designing our study, no prior studies had investigated the impact on clinical outcomes of pharmacist-led medication review interventions in emergency department setting. Thus, prior literature did not provide certain evidence with regards to what patient groups could benefit from such interventions. Introducing specific inclusion criteria (for instance medical or surgical referral reason, or only patients over 65 years) could have decreased the heterogeneity of the included patients, however possible valuable information of some patient groups would have been lost. A justification for this decision is added in the introduction of the revised manuscript (page 4).

Please provide the clinical characteristics of the population in both arms and compare the number of medications or categories across the two arms

- In the original manuscript comparison of clinical characteristics such as number of medications and mortality during study period were presented for both arms in text. However, we agree that it is clarifying if these data are presented in table form. In the revised manuscript clinical characteristics for the population is presented for both arms in addition to demographics in Table 1 (page 16-17).

Please state the software name that was used for the analysis

- We used Stata Statistical Software: Release 16 for the analyses, which was stated in the Statistical Analysis section of the original manuscript. To clarify we have elaborated the Software information in the revised manuscript (page 13).

I would recommend shortening the discussion

- Through the revision of the manuscript, we have aimed to present and discuss our findings as concisely as possible.

Please provide a statement about any possible variation of clinical management after the intervention, i.e., is there any reason for the reader to think that the patients in the intervention arm had different standards of care randomly than those in the control arm? In other words, did the intervention of pharmacist-led affect future decisions? during the emergency department stay that could lead to downstream effects of differentiation in the provided quality of care.

- This issue was our main hypothesis for this study (presented in the original protocol: Appendix S2). We hypothesized that if we obtained an accurate medication history (through medication reconciliation) and addressed clinically relevant drug-related problems (through medication review) early during the emergency department stay, this would have positive downstream effects. For instance, lead to a more efficient emergency department- and hospital stay, due to treatment decisions being made based on the correct drug list, and in addition identified drug-related problems could be solved before the patient was discharged. And as a sum of these positive downstream effects, we assumed to reveal an impact on clinical outcomes such as unplanned contact with hospital and time to next unplanned contact.

- A statement regarding that we observed no evidence of random difference in standards of care during the hospital stay between the intervention arm and the control arm is added in the revised manuscript (page 23).

- In retrospect we can see that we relied too much on the next link in the treatment chain to follow up our intervention findings, and that is why we have recommended redesigning the intervention for future research in our manuscript (page 22-23 and page 25).

Please provide more evidence for choosing your specific endpoints using the presented one; the hospitalization is a specific endpoint; however, it does not capture GP calls, admissions without emergency department visits.

- A justification for chosen outcomes is added in the method section of the revised manuscript (page 11). In addition, we have added a discussion of strengths and limitations of our chosen endpoints (page 24).

- In the revised manuscript we have elaborated what data we harvested from the Norwegian Patient Registry (all hospitalizations, including both isolated emergency department visits and hospital admissions with or without emergency department visits) (page 6). Data on GP calls and GP visits are not included in the Norwegian Patient Registry. However, contact with GP can be challenging to interpretate as an outcome, as this can both indicate worsening of patients’ conditions and appropriate follow-up of patients, whereas unplanned contact with hospital (which was chosen as outcome) clearly indicates an acute worsening in patients’ condition.

- The revised S2 Appendix comprise an explanation of the discrepancy between what was stated in the clinicaltrials.gov filling and the presented primary outcome.

Reviewer #3

This is an interesting paper on a randomised trial of pharmacist chart review in patients admitted to the emergency department. This is a complex sort of trial to run and a little harder than the usual drug trial, so the authors are to be commended on what they have done here.

- Thank you, Reviewer #3, for recognizing the complexity of the study and for acknowledging our effort.

As with this sort of trial generally, the reporting can get complex and as such I have a few areas of clarification:

1. Choice of endpoint - the idea of an unplanned hospital contact makes a lot of sense from a cost and resource point of view, as well as the appropriate severity. One presumes that causality is so woolly that it becomes hard to get to the most sensitive outcome which would be clinically relevant medication error. However, excluding deaths is probably not necessarily appropriate; death is worse than hospitalisation, and certainly unplanned, so at the very least an analysis showing no difference in interpretation if the deaths are included would be important - excluding these patients isn't according to the principle of ITT and the missing data is informatively missing.

- We agree that death is a competing risk to unplanned contact with hospital. In the revised manuscript we have clarified why death were censored in analyses (page 13-14).

- In the revised S4 Appendix Sensitivity analyses we have added sensitivity analyses on the primary outcome with overall death as a competing risk to unplanned contact with hospital. In line with the previous submitted sensitity analyses (Original S4 Appendix), the additional sensitivity analyses revealed that our results did not change.

2. The authors are to be commended on putting sufficient information in the sample size calculation to make it reproducible

- Thank you for acknowledging our effort to make this section unambiguous.

3. Subversion of randomisation - envelopes are of course supremely subvertable; can the authors please confirm that the envelopes were opened in numbered sequence?

- Yes, the randomization envelopes were assigned to each individual participant and opened in numbered sequence, this is clarified in the revised manuscript (page 8).

What was put in place to stop a person opening the envelope before deciding whether or not to enrol?

- An operation procedure was developed for the inclusion and randomization procedure in this study. This operation procedure stated that an envelope should be assigned to a participant and opened after inclusion, i.e., after the patient had given written informed consent. All three study pharmacists were acquainted with the inclusion and randomization procedure before study start. No further actions were put in place to prevent the addressed issue. Information regarding the developed procedure is added in the revised manuscript (page 6 and page 8).

What was the average block length as it is this and not the variability that affects guessing next allocation (see the numerous papers on this)

- The average block length was 5.0 ± 2.2 (range 2-8), which is also added in the revised manuscript (page 8).

4. Please do not test the baseline characteristics - if the randomisation works appropriately any differences MUST be down to chance.

- We agree with this statement and the test of baseline characteristics is removed from the revised manuscript (table 1, page 16).

5. The confidence intervals for effect do not rule out a 30% reduction in hospital contact - does this not imply the results are inconclusive here

- In principle we agree with this comment, however the sample size of this study was calculated based on a superiority study design, and not a non-inferiority study design. Therefore, the presented result only indicates no significant difference, hence failure to show superiority of the intervention. No changes are conducted regarding this issue in the revised manuscript.

6. It's unclear to me the extent to which pharmacists identify issues as part of routine as opposed to only during the sort of intensive note review here. This could be made clearer

- In the revised manuscript we have added information regarding the study setting to claify routinely pharmacists service vs. RCT intervention in the investigated ED, and further clarified pharmacist service at hospital wards at Diakonhjemmet Hospital (part of standard care) (page 6-7).

Is there also evidence of complete adherence to study protocol in both arms? Is there any chance of dilution of effect because of either a halo effect or because of time pressures lowering adherence? This may be in the bottom of page 17, but it would help to understand whether these pharmacy interventions largely replicated the intervention group and found nothing different (i.e. adherence was about 85% for control and 100% for intervention?

- Study protocol only covered pharmacist intervention vs. standard care during the ED visit, and adherence to study protocol in both arms is described in Fig.1 Flow chart of patients eligible for inclusion in the Emergency Department (ED) (number of patients receiving allocated intervention and standard care).

- Pharmacists service at hospital ward was part of standard care during the hospital stay and were not part of the investigated intervention. Information regarding these acitivities was presented because they could have diluted the effect of the intervention as described in limitations (page 24). A relatively low share of the included patients received pharmacist service during their hospital stay (Table 1, page 16). This should not be interpreted as the remaining included patients did not need a pharmacist intervetion, it is rather an result of limited pharmacist resouces in hospital wards at Diakonhjemmet Hospital (page 7). The number of patients receiving medication reconciliation by pharmacists at hospital wards were lower in the intervention group compared with the control group, which may indicate that the intervention medication reconciliation was satisfying. With regards to medication review, a higher number of intervention group patients received this from pharmacists at hospital wards compared with control group patients. This may be coincidental or hospital wards pharmacist could be following up on drug-related problems revealed during the intervention medication review conducted in the ED. In general, medication review can be repeted several times during a hospital stay with new findings every time due to frequent changes in drug treatment during a hospital stay, and rapid changes in the patient’s condition during a hospital stay.

________________________________________

Changes to reference list:

- Added an reference for the EpiData Software used for data management in the presented study (reference number 48).

o 48. Christiansen TB and Lauritsen JM. (Ed.) EpiData - Comprehensive Data Management and Basic Statistical Analysis System. Odense Denmark, EpiData Association, 2010-. Http://www.epidata.dk.

- After submitting the original manuscript it was discovered that Lisby et al. 2010 was not conducted in the emergency department but in an acute hospital ward of internal medicine. Hence, before initiating our study no prior RCT had investigated the clinical impact of pharmacists-led interventions in the ED-setting, this is clarified in the revised manuscript (page 4), and the reference to Lisby et al. 2010 (reference number 38) is referenced together with the other prior in-hospital RCTs in the introduction and discussion sections.

o Lisby M, Thomsen A, Nielsen LP, Lyhne NM, Breum-Leer C, Fredberg U, et al. The effect of systematic medication review in elderly patients admitted to an acute ward of internal medicine. Basic Clin Pharmacol Toxicol. 2010;106(5):422-7.

- During the revision of the introduction and disussion several new references were added. In the introduction references were added to highlight the unique roles of the pharmacist during a hospital stay as recommended by Reviewer #2. And to clarify why a gatekeeper-in effort was chosen in the presented RCT (in reference to Editors comment). In the discussion references were added to clarify discussion of our findings and discuss chosen endpoints, as requested by Reviewer #2 and Reviewer #3.

o New references compared with the original manuscript:

o 1. World Health Organization, Transitions of Care: Technical Series on Safer Primary Care. Geneva; 2016. Licence: CC BY-NC-SA 3.0 IGO. Available at: https://apps.who.int/iris/bitstream/handle/10665/252272/9789241511599-eng.pdf [cited 2022 May 16].

o 2. World health Organization, Medication Safety in Transitions of Care. Geneva;2019 (WHO/UHC/SDS/2019.9). Licence: CC BY-NC-SA 3.0 IGO. Available at: https://www.who.int/publications/i/item/WHO-UHC-SDS-2019.9 [cited 2022 April 17].

o 7. Institute for Healthcare Improvements, Medication Reconciliation to Prevent Adverse Drug Events (2018) Availablefrom: http://www.ihi.org/Topics/ADEsMedicationReconciliation/Pages/default.aspx [cited 2022 May 10].

o 12. McLachlan CY, Yi M, Ling A, Jardine DL. Adverse drug events are a major cause of acute medical admission. Intern Med J. 2014;44(7):633-8.

o 13. Zed PJ, Abu-Laban RB, Balen RM, Loewen PS, Hohl CM, Brubacher JR, et al. Incidence, severity and preventability of medication-related visits to the emergency department: a prospective study. CMAJ. 2008;178(12):1563-9.

o 16. Jatau AI, Aung MM, Kamauzaman TH, Rahman AF. Prevalence of Drug-Related Emergency Department Visits at a Teaching Hospital in Malaysia. Drugs Real World Outcomes. 2015;2(4):387-95.

o 17. Al-Arifi M, Abu-Hashem H, Al-Meziny M, Said R, Aljadhey H. Emergency department visits and admissions due to drug related problems at Riyadh military hospital (RMH), Saudi Arabia. Saudi Pharm J. 2014;22(1):17-25.

o 18. Nickel CH, Ruedinger JM, Messmer AS, Maile S, Peng A, Bodmer M, et al. Drug-related emergency department visits by elderly patients presenting with non-specific complaints. Scand J Trauma Resusc Emerg Med. 2013;21:15.

o 25. Mogensen CB, Thisted AR, Olsen I. Medication problems are frequent and often serious in a Danish emergency department and may be discovered by clinical pharmacists. Dan Med J. 2012;59(11):A4532.

o 28. Patanwala AE, Sanders AB, Thomas MC, Acquisto NM, Weant KA, Baker SN, et al. A prospective, multicenter study of pharmacist activities resulting in medication error interception in the emergency department. Ann Emerg Med. 2012;59(5):369-73.

o 29. Rothschild JM, Churchill W, Erickson A, Munz K, Schuur JD, Salzberg CA, et al. Medication errors recovered by emergency department pharmacists. Ann Emerg Med. 2010;55(6):513-21.

o 30. Stasiak P, Afilalo M, Castelino T, Xue X, Colacone A, Soucy N, et al. Detection and correction of prescription errors by an emergency department pharmacy service. CJEM. 2014;16(3):193-206.

o 31. Marconi GP, Claudius I. Impact of an emergency department pharmacy on medication omission and delay. Pediatr Emerg Care. 2012;28(1):30-3.

o 41. Crook M, Ajdukovic M, Angley C, Soulsby N, Doecke C, Stupans I, et al. Eliciting comprehensive medication histories in the emergency department: the role of the pharmacist. Pharm Pract (Granada). 2007;5(2):78-84.

o 42. Unroe KT, Pfeiffenberger T, Riegelhaupt S, Jastrzembski J, Lokhnygina Y, Colón-Emeric C. Inpatient medication reconciliation at admission and discharge: A retrospective cohort study of age and other risk factors for medication discrepancies. Am J Geriatr Pharmacother. 2010;8(2):115-26.

o 43. Kongkaew C, Hann M, Mandal J, Williams SD, Metcalfe D, Noyce PR, et al. Risk factors for hospital admissions associated with adverse drug events. Pharmacotherapy. 2013;33(8):827-37.

o 47. Asmar R, Hosseini H. Endpoints in clinical trials: does evidence only originate from 'hard' or mortality endpoints? J Hypertens Suppl. 2009;27(2):S45-50.

o 52. Graabaek T, Hedegaard U, Christensen MB, Clemmensen MH, Knudsen T, Aagaard L. Effect of a medicines management model on medication-related readmissions in older patients admitted to a medical acute admission unit-A randomized controlled trial. J Eval Clin Pract. 2019;25(1):88-96.

o 59. Nymoen LD, Björk M, Flatebø TE, Nilsen M, Godø A, Øie E, et al. Drug-related emergency department visits: prevalence and risk factors. Intern Emerg Med. 2022.

o 61. Asplin BR, Magid DJ, Rhodes KV, Solberg LI, Lurie N, Camargo CA. A conceptual model of emergency department crowding. Ann Emerg Med. 2003;42(2):173-80.

o 62. Khosravizadeh O, Vatankhah S, Bastani P, Kalhor R, Alirezaei S, Doosty F. Factors affecting length of stay in teaching hospitals of a middle-income country. Electron Physician. 2016;8(10):3042-7.

o 63. Mc Cord KA, Ewald H, Agarwal A, Glinz D, Aghlmandi S, Ioannidis JPA, et al. Treatment effects in randomised trials using routinely collected data for outcome assessment versus traditional trials: meta-research study. BMJ. 2021;372:n450.

o 64. Beuscart JB, Knol W, Cullinan S, Schneider C, Dalleur O, Boland B, et al. International core outcome set for clinical trials of medication review in multi-morbid older patients with polypharmacy. BMC Med. 2018;16(1):21.

- During revision of the introduction, the following references were removed from the revised manuscript:

o Ashcroft DM, Lewis PJ, Tully MP, Farragher TM, Taylor D, Wass V, et al. Prevalence, Nature, Severity and Risk Factors for Prescribing Errors in Hospital Inpatients: Prospective Study in 20 UK Hospitals. Drug Saf. 2015;38(9):833-43

o Blenkinsopp A, Bond C, Raynor DK. Medication reviews. Br J Clin Pharmacol. 2012;74(4):573-80.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Raphael Cinotti

7 Sep 2022

Impact of systematic medication review in emergency department on patients’ post-discharge outcomes -a randomized controlled clinical trial

PONE-D-22-04157R1

Dear Dr. Lisbeth Damlien Nymoen,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Raphael Cinotti, MD, PhD

Academic Editor

PLOS ONE

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

Reviewer #2: Yes

Reviewer #3: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #2: Yes

Reviewer #3: (No Response)

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: (No Response)

Reviewer #2: Yes

Reviewer #3: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: (No Response)

Reviewer #2: Yes

Reviewer #3: (No Response)

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: All my comments were addressed. Congratulations on this scholarly work. Please make sure to upload all Appendix materials as stated.

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

**********

Acceptance letter

Raphael Cinotti

9 Sep 2022

PONE-D-22-04157R1

Impact of systematic medication review in emergency department on patients’ post-discharge outcomes -a randomized controlled clinical trial

Dear Dr. Nymoen:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Raphael Cinotti

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. CONSORT checklist.

    (PDF)

    S2 Appendix. Original study protocol, protocol amendments, and the timeline of the study with milestones.

    (PDF)

    S3 Appendix. Detailed description of the drug-related problems categories.

    (PDF)

    S4 Appendix. Sensitivity analyses and survival curves.

    (PDF)

    Attachment

    Submitted filename: PLOS One Review 2022.pdf

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    The data that support the findings of this study are not publicly available, because of the content of sensitive patient information and indirect patient identifiers, imposed by the Regional Committee for Medical and Health Research Ethics (REC) (2015/1356/ REK south-eastern A). Data may be obtained from a third party, Diakonhjemmet Hospital (contact via e-mail: postmottak@diakonsyk.no) on reasonable request, but restrictions apply to the availability of these data, which were used under license for the current study, and thus cannot be made publicly available. Deidentified participant data are available from the authors on reasonable request and with permission of Diakonhjemmet Hospital and REC (contact via e-mail: rek-sorost@medisin.uio.no).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES