Skip to main content
PLOS One logoLink to PLOS One
. 2021 Oct 18;16(10):e0257656. doi: 10.1371/journal.pone.0257656

Does information structuring improve recall of discharge information? A cluster randomized clinical trial

Victoria Siegrist 1,2, Rui Mata 2, Wolf Langewitz 3, Heike Gerger 4,5, Stephan Furger 6, Ralph Hertwig 7, Roland Bingisser 1,*
Editor: Alessandra Solari8
PMCID: PMC8523048  PMID: 34662341

Abstract

Objectives

The impact of the quality of discharge communication between physicians and their patients is critical on patients’ health outcomes. Nevertheless, low recall of information given to patients at discharge from emergency departments (EDs) is a well-documented problem. Therefore, we investigated the outcomes and related benefits of two different communication strategies: Physicians were instructed to either use empathy (E) or information structuring (S) skills hypothesizing superior recall by patients in the S group.

Methods

For the direct comparison of two communication strategies at discharge, physicians were cluster-randomized to an E or a S skills training. Feasibility was measured by training completion rates. Outcomes were measured in patients immediately after discharge, after 7, and 30 days. Primary outcome was patients’ immediate recall of discharge information. Secondary outcomes were feasibility of training implementation, patients’ adherence to recommendations and satisfaction, as well as the patient-physician relationship.

Results

Of 117 eligible physicians, 80 (68.4%) completed the training. Out of 256 patients randomized to one of the two training groups (E: 146 and S: 119) 196 completed the post-discharge assessment. Patients’ immediate recall of discharge information was superior in patients in the S-group vs. E-group. Patients in the S-group adhered to more recommendations within 30 days (p = .002), and were more likely to recommend the physician to family and friends (p = .021). No differences were found on other assessed outcome domains.

Conclusions and practice Implications

Immediate recall and subsequent adherence to recommendations were higher in the S group. Feasibility was shown by a 69.6% completion rate of trainings. Thus, trainings of discharge information structuring are feasible and improve patients’ recall, and may therefore improve quality of care in the ED.

1 Introduction

The need to communicate effectively is pervasive in healthcare [1], and it is of utmost importance in the acute care setting such as the emergency department (ED) [1]. Patients are typically discharged within few hours once life-threatening conditions have been excluded, but serious conditions may still be under investigation in the outpatient setting. An effective communication has an impact on both physicians and patients: Physicians’ communicative behaviour was found to be linked to the charge of malpractice claims [2], and patients’ health outcomes were shown to be related to the quality of the communication with physicians [3]. Furthermore, patients need to be well-informed to be able to follow treatment recommendations [4]. Previous studies have found that patients only recall a fraction of the information given [47]. Therefore, the importance of information delivery at ED discharge, and its downstream implications for recall and patient outcomes have been emphasized [8, 9].

Several communication strategies have been found to improve recall of medical information, for instance, provision of written information [1012]. However, the provision of written information is difficult in a busy ED environment and has not uniformly shown benefits [1315], possibly due to the fact that written discharge information often exceed patients’ health literacy and their levels of reading and understanding skills [16, 17].

Among the verbal communication strategies, information structuring seems to be the most promising strategy for improving information recall: Several studies have found improved recall in proxy-patients if medical information was explicitly structured [1820]. These studies used a specific way of information structuring, the “book metaphor” technique: Discharge information was provided with an initial “table of contents” followed by “chapter headings” [21]. The use of the mnemonic “InFARcT” (Information on diagnosis; Follow-up; Advice on self-care; Red flags; complete Treatment) was shown to significantly improve recall [1820]. Structuring the content of information given can take many forms; in pre-medication visits [22] the topics to be dealt with differ from discharge communication from patient to patient. So far however, improved recall of discharge information by explicitly structuring discharge information has only been shown in proxy patients (i.e. student populations), and never in ED patients.

We therefore designed a cluster randomized clinical trial to investigate the effects of information structuring on patients’ recall, adherence to recommendations, and satisfaction. As a control group, some clusters of physicians were trained using empathy skills, ensuring a credible control group that does not focus on conveying information per se. Empathy skills seem particularly relevant in acute care because ED patients suffer from high levels of stress and anxiety [23, 24]. Furthermore, several studies found positive effects on patients’ outcomes if physicians used empathy skills [2527]. Consequently, we compared the effects of training physicians’ information structuring (S) skills with training their empathy (E) skills. We hypothesized that explicit information structuring using the book metaphor and the InFARcT mnemonic would be feasible, and would improve patients’ information recall, their adherence to instructions [4], and patients’ satisfaction [26, 27].

2 Methods

2.1 Design, setting and participants

This two-arm, cluster randomized controlled trial was conducted at the ED of the University Hospital Basel, Switzerland. The study was approved by the local ethics committee “Ethikkommission Nordwest- und Zentralschweiz” (EKNZ 2014–379) on December 3, 2014 and the protocol was published on ClinicalTrials.gov (NCT02468869). Physicians and patients were enrolled between April 1, 2015 and May 31, 2017. The registration for the clinical trial on ClinicalTrials.gov took place on October 12, 2015 because of changes in the study team. Nevertheless, this did not affect the study conduct or results. All authors confirm that all ongoing and related trials for this intervention are registered.

2.1.1 Physicians

As study physicians we included new residents starting at the ED of the University Hospital Basel. Physicians were clustered according to their first day at work (January 1st, April 1st, July 1st, and October 1st). Eight clusters of physicians were included (see Fig 1). Physicians were blinded regarding cluster randomization and the content of the other communication skills training. They gave written informed consent before undergoing three teaching modules of communication training (see section 2.2).

Fig 1. Flow chart of trained physicians and included patients.

Fig 1

2.1.2 Patients

Patients were eligible if they presented to the ED with chest or abdominal pain and were discharged by a physician under study. Patients were not eligible if they met one of the following exclusion criteria: they did not provide written consent, were younger than 18 years old, non-German speaking, or had a diagnosis of dementia.

2.1.3 Randomization

For cluster randomization, we determined the content of the communication training for the first cluster of physicians using an electronic randomizer tool (randomizer.org) generating a random sequence, based on which each cluster of physicians starting shift-work at the ED was randomly assigned to one of the two communication trainings (E or S).

2.2 Interventions

Physicians received a communication training consisting of three distinct modules: i) communication with ED patients (group instruction of 30 minutes, identical for all clusters), ii) according to randomization: either empathy training (ET group instruction of 75 minutes) or structure skills training (ST; group instruction of 75 minutes), and iii) feedback on the job by an expert in communication (individual instruction of 15 minutes; detailed information in S1 File). The communication expert rated the physician’s ability using the techniques conveyed earlier on a numeric rating scale from 1 to 6. Only after completing all three modules, physicians were able to participate in the study by performing audio-taped discharge communications.

2.3 Procedure

Patients presenting to the ED were screened for the main complaint of chest or abdominal pain using the web-based electronic health record. The electronic health record was fed with information from the attending physician, showing the collected information, such as main complaint, almost in real time. If patients were eligible, trained study personnel explained the study procedure and informed consent was obtained right after patient history was obtained. Patients were blinded to the communication training which their physician had received. Information on demographics, mental and physical health (12-Item Short Form Health Survey; SF-12) [28], anxiety and depression (Hospital Anxiety and Depression Scale; HADS-D) [29] was obtained right after informed consent was given. Data were recorded using the web-based software secuTrial® by study personnel.

After study personnel completed all surveys with the patient, the physician was given an audio recorder for recording the discharge communication. Immediately after the physician formally discharged the patient, trained study personnel assessed patient satisfaction and their recall of the discharge information. Before discharge, appointments were made for the follow-up calls 7 and 30 days later (see Fig 2).

Fig 2. Study overview.

Fig 2

2.4 Assessments

2.4.1 Primary outcome: Immediate discharge information recall

The primary outcome of the study was patients’ immediate recall of discharge information as a function of physicians’ communication training. This outcome was assessed right after the discharge communication was completed but before the patient left the hospital. The conversation between the researcher and the patient was recorded with an audio recorder. Recall performance of discharge information was assessed by the ratio between the number of utterances conveyed to the patient and the number of utterances recalled at discharge. Recall was assessed by asking patients the question: “Please share with me all the information that you recall from your discharge communication.” After the last utterance was shared proactively by the patient, the interviewer would probe and ask “is there any additional information that you remember from your discharge communication?”. The interview was stopped once the patient stated that there is nothing else that he or she recalls.

2.4.2 Secondary outcomes: Feasibility, long-term recall (day 7 and 30), adherence, satisfaction, and patient-physician-relationship

The feasibility of the training within the daily routines of ED was assessed by the percentage of physicians completing all three training modules during the study period. Long-term recall of discharge information was assessed on day 7 and 30 after discharge via telephone interviews. The researcher was calling the patient on the phone at the time they agreed upon before the patient left the ED at day 0. The recording of the conversation started after obtaining the consent of the patient regarding the recording. Adherence, also assessed via telephone interviews, was defined as the overall self-reported adherence in the first month relative to the total number of recommendations given by the physician at discharge. Patients were asked “which recommendations did you follow since your visit?”. Patients’ satisfaction was measured immediately after discharge via telephone interview on four visual analogue scales. Each of these scales ranged from 0 to10 (0 indicating “not at all” and 10 indicating “very much”) with the following dimensions: (1) “How easy was it to understand what your doctor said?”; (2) “How structured was the communication?”; (3) “How informative was the communication?”; and (4) “How strongly would you recommend the doctor to family and friends?”. Additionally, 7 days after discharge, patients completed the German version of the Patient Reaction Assessment (PRA-D) [30, 31], which measures the perceived quality of relationship between patient and physician. PRA-D reflects patients’ perceived quality of the informative (i.e. patient information index) and affective (i.e. patient affective index) behaviours of the physician, and patients’ perceived ability to initiate communication (i.e. patient communication index).

2.4.3 Characteristics and content of discharge information

Audio recordings of the discharge communication, patients’ information recall, and patients’ reports on adherence were transcribed with the software f4transkript. A detailed coding scheme was developed to specify all types of utterances that could be found in the transcripts (for detailed information see S1 Table). An utterance was defined as the smallest speech segment that expresses or implies a complete thought and that a coder can classify.

Based on the previous studies on the use of the book metaphor and the InFARcT mnemonic [1416], we predefined seven main categories of utterances, which we called chapters according to the book metaphor: (1) explicit structure (e.g. introduction by providing title and chapter-headings of the information to follow), (2) Information on diagnosis, (3) Follow-up, (4) Advice on self-care, (5) Red-flags, (6) complete Treatment, and (7) other. After study completion, two independent coders, blinded to physicians’ ID, cluster, and group, rated the transcripts of the discharge communication. Over 100 distinct utterances were identified and subsumed to the seven utterance categories.

In addition to the content of the discharge communication with respect to the 7 utterance categories, we compared the duration of the discharge communication, the number of recommendations given by the physician, and the number of patient contributions during discharge communication (i.e. questions asked and inputs given by the patient).

A manipulation check was conducted by rating each discharge communication based on the audio recording and the transcript by two blinded and independent raters regarding the amount of empathic communication elements and explicit structure elements. The two items indicating the presence of structure elements were “physician gives an outline” and “physician leads explicitly from one segment to another”. The two items indicating empathy elements were “physician reacts when the patient shows an emotion” and “physician checks with the patient whether his concerns are clear”. These were evaluated by rating each manipulation check with 0 (not given), 1 (partially given), 2 (completely given), or as “not applicable”.

2.5 Sample size and statistical analyses

The study was powered at 80% (two-sided test, α-level of .05) to detect a difference in recall performance for two patient groups discharged either by a physician trained in empathy or structured discharge communication. With an estimated effect size of .4 (as deduced from a previously conducted laboratory experiment) a total sample size of 200 was required. We used an alpha level of .05 for all statistical tests.

Analyses were conducted using R (version 3.6.1.) in RStudio using the packages tidyverse [32] and lme4 [33] for calculating linear mixed effects models. For group comparisons, linear ANOVA analysis was used for continuous variables and Pearson’s two-tailed chi-square test of independence for categorical variables. The primary dependent variable was patients’ immediate recall performance of discharge information. To investigate the recall performance of participants, linear mixed effects models were performed by taking the recall performance (i.e. number of utterances recalled by the patient) as the dependent variable and the group (i.e. E and S), as well as the utterances given by the physician during discharge as independent variables. This was done to investigate the effect of physician’s communications trainings on patients’ recall while controlling for the number of utterances given by the physician. Further, we included cluster ID (8 levels) and physician ID (63 levels) as nested random factor into the model to account for possible cluster-physician effects due to the randomization. This analysis, thus, reflects the total success of the training including the possibility that patients’ recall may depend on the number of utterances given by the physician, which can be seen as a result of the respective training in itself. In addition, the analyses were repeated with patients’ relative recall performance of discharge information at day 7 and 30. Effect sizes were labelled following Funder and Ozer’s (2019) recommendations [34].

Patients’ adherence to recommendations was the overall self-reported adherence to recommendations within one month once reported in absolute numbers and once in relative numbers (i.e. adherence divided by the number of recommendations given by the physician).

Patient satisfaction ratings showed ceiling effects and were therefore converted from interval into integer numbers. This permitted the computation of an ordinal model with the R package ordinal [35]. Each of the four satisfaction ratings were analysed with a cumulative link mixed model [35]. The models controlled for the random effects cluster and physician. Due to the skewed distribution of the patient satisfaction data we report medians and interquartile ranges (IQR) instead of means and standard deviations (SD).

3 Results

3.1 Participants

3.1.1 Physicians

A total of 117 physicians started their residency and were eligible during the study period, 115 signed consent (Fig 1). Four clusters of physicians were randomized to E, and four clusters to S. Cluster size ranged from 12 to 20 physicians. 80 physicians completed all three teaching modules during the study period, and 63 of them treated at least one patient within the context of this study (range: 1 to 19 patients per physician of which the discharge communication was recorded and included in the study). Physicians were on average 30.7 years old (SD = 3.9) and had previous experience of 2.9 years (SD = 1.9). Almost half of the physicians were women (47.6%). Physicians in groups E and S scored equally well in understanding and applying the communication skills taught in modules ii) empathy or structure skills, and iii) feedback on the job (Table 1). As physicians were cluster randomized to one of two communication trainings, there were no significant differences between physicians in E and S clusters in terms of age, sex, nationality, civil status, work experience, time spent on training, or proficiency in German. A detailed overview of physician’s demographics can be found in Table 1.

Table 1. Physician and patient characteristics.
Physician Characteristics Empathy Structure Overall p-value1
(N = 33) (N = 30) N = 63
Age, in years, mean (SD) 30.4 (3.15) 31.0 (4.56) 30.7 (3.87) .54
Sex, N (%) .99
    Male 17 (51.5%) 16 (53.3%) 33 (52.4%)
    Female 16 (48.5%) 14 (46.7%) 30 (47.6%)
Nationality, N (%) .12
    Switzerland 7 (21.2%) 13 (43.3%) 20 (31.7%)
    Germany 18 (54.5%) 11 (36.7%) 29 (46.0%)
    Austria 2 (6.1%) 4 (13.3%) 6 (9.5%)
    Other 6 (18.2%) 2 (6.7%) 8 (12.7%)
Native language, N (%) .62
    German 26 (78.8%) 26 (86.7%) 52 (82.5%)
    Other 7 (21.2%) 4 (13.3%) 11 (17.5%)
Civil status, N (%) .19
    Single 25 (75.8%) 26 (86.7%) 51 (81.0%)
    Divorced 0 (0.0%) 1 (3.3%) 1 (1.6%)
    Married 8 (24.2%) 3 (10.0%) 11 (17.5%)
Work experience, in years, mean (SD) 2.8 (1.86) 3.1 (1.92) 2.9 (1.88) .58
    Unknown 1 0 1
Communication skills, mean (SD)
    Theory: Empathy vs structure skills 6.9 (1.52) 7.1 (2.04) 7.0 (1.77) .73
    Training on the job 4.7 (0.63) 4.6 (0.83) 4.6 (0.73) .79
Patient Characteristics Empathy Structure Overall p-value
(N = 111) (N = 85) (N = 196)
Complaint, N (%) .019
    Abdominal pain 63 (56.8%) 33 (38.8%) 96 (49.0%)
    Chest pain 48 (43.2%) 52 (61.2%) 100 (51.0%)
Sex, N (%) .76
    Female 46 (41.4%) 38 (44.7%) 84 (42.9%)
    Male 65 (58.6%) 47 (55.3%) 112 (57.1%)
Age, in years, mean (SD) 44.5 (17.37) 45.1 (15.12) 44.8 (16.39) .80
Education, N(%) .99
    ≤ Apprenticeship 59 (53.2%) 46 (54.1%) 105 (53.6%)
    ≥ High School 52 (46.8%) 39 (45.9%) 91 (46.4%)
Nationality, N (%) .40
    Swiss 77 (69.4%) 55 (64.7%) 132 (67.3%)
    German 9 (8.1%) 12 (14.1%) 21 (10.7%)
    Other 25 (22.5%) 18 (21.2%) 43 (21.9%)
Native Language, N (%) .60
    German 87 (78.4%) 63 (74.1%) 150 (76.5%)
    Other 24 (21.6%) 22 (25.9%) 46 (23.5%)
Civil Status, N (%) .27
    Married 47 (42.3%) 44 (51.8%) 91 (46.4%)
    Never married 43 (38.7%) 29 (34.1%) 72 (36.7%)
    Divorced 17 (15.3%) 8 (9.4%) 25 (12.8%)
    Seperated 2 (1.8%) 4 (4.7%) 6 (3.1%)
    Widowed 2 (1.8%) 0 (0.0%) 2 (1.0%)
SF-12, mean (SD)
    Physical Health 45.6 (10.20) 48.7 (9.38) 47.0 (9.94) .031
    Mental Health 50.1 (10.30) 51.1 (10.41) 50.6 (10.33) .50
HADS, mean (SD)
    Anxiety 6.0 (3.69) 5.9 (3.88) 6.0 (3.77) .91
    Depression 4.0 (3.70) 3.4 (3.23) 3.7 (3.50) .26

Note. Characteristics of the physicians who treated patients according to the training which they had received, and of the patients who completed post-discharge assessments.

1 Continuous variables: Linear ANOVA; Categorical variables: Pearson’s two-tailed chi-square test of independence.

3.1.2 Patients

In total, 1,915 patients were screened for eligibility (Fig 2). Of those, 1650 (80.0%) were not included because they did not meet inclusion criteria. A total of 265 patients were included in the study: 146 and 119 were treated by physicians of the E and S group, respectively. 196 (74.0%) patients completed the post-discharge assessment (111 in the E and 85 in the S group). Dropout rate from inclusion to post-discharge assessment was 26.0% (24.0% in the E and 28.6% in the S group). Patients had a mean age of 44.8 years (SD = 16.4), 42.9% were women (Table 1), and 76.5% reported to be German native speakers. With the exception of the physical health subscale of SF-12, there were no differences between the two groups in sex, age, nationality, proficiency in German, civil status, education, health related quality of life (SF-12), and anxiety and depression scores (HADS-D), indicating that the patient groups were comparable.

3.2 Discharge communication

3.2.1 Characteristics

Physicians’ empathy and structuring skills during discharge communication were rated for each recorded discharge conversation. The manipulation check revealed that discharge communication was significantly more structured in S-trained physicians (mean = 2.6, SD = 1.3) compared to E-trained physicians (mean = 0.1, SD = 0.3) (difference = -2.54, 95% CI [-2.82, -2.25], t(91.31) = -17.59, p < .001). There were no significant differences in empathy ratings between E-trained (mean = 1.81, SD = 0.73) and S-trained (mean = 1.59, SD = 0.88) physicians (difference = 0.22, 95% CI [-0.01, 0.46], t(162.36) = 1.89, p = .061). Further, analyzing the recordings of the discharge conversations there was no difference between the two groups on the dimension’s duration of discharge communication (p = .345), number of patient contributions (mean in group E = 9.77, mean in group S = 8.53, difference = 1.25, 95% CI [-1.34, 3.83], t(173.01) = 0.95, p = .343), and number of recommendations given by the physician (mean in group E = 4.44, mean in group S = 4.71, difference = -0.26, 95% CI [-0.82, 0.29], t(193.51) = -0.95, p = .345).

3.2.2 Content

Regarding the content of discharge communications, physicians conveyed on average 39.0 (SD = 15.0; range: 7 to 108) utterances during the discharge conversation with their patients (for visual representation of the raw data see S1 and S2 Figs). The S-trained physician group expressed significantly more utterances in the categories explicit structuring (p < .001), Advice on self-care (p = .038), Red flags (p < .001), and complete Treatment (p = .048) utterances, as compared to the E group. Physicians in the S group provided fewer diagnosis related (p = .012), and “other” (p < .001) utterances than physicians in the E group. Also, there were no significant differences regarding information on follow-up (p = .955) between the S-trained and the E-trained physician group, as well as the overall total of utterances (p = .963). Values are reported in Table 2.

Table 2. Discharge communication characteristics and content.
Empathy Structure Overall p-value1
(N = 111) (N = 85) (N = 196)
Utterances by the physician, mean (SD)
Explicit structure (book metaphor) 0.1 (0.37) 3.4 (1.98) 1.5 (2.12) < .001
Information on diagnosis 14.1 (6.83) 11.8 (5.85) 13.1 (6.51) .012
Follow-up 6.7 (6.08) 6.7 (4.86) 6.7 (5.57) .955
Advice on self-care 2.2 (3.17) 3.1 (2.94) 2.6 (3.10) .038
Red Flag 3.6 (2.93) 5.3 (1.86) 4.3 (2.66) < .001
complete Treatment 10.1 (6.97) 7.7 (9.05) 9.1 (8.01) .048
Other 2.2 (1.80) 1.1 (1.61) 1.7 (1.81) < .001
Total of utterances 38.9 (14.25) 39.0 (16.06) 39.0 (15.02) .963

Note. Discharge communication characteristics and content across all patient-physician encounters and by study group at discharge, as rated by blind and independent raters.

1 Linear ANOVA.

3.3 Primary outcome: Immediate recall

An overview of patients’ absolute and relative recall for all three time points of assessment are provided in Table 3 (for visual representation of the raw data see S1 and S2 Figs). It is important to note that patients’ recall of information was conditional on the physicians mentioning of the respective information during discharge. Therefore, the number of patients in individual analyses varies largely because in some cases only few physicians mentioned a particular item. For instance, the book metaphor was used by 5 physicians in the E group (4.5%) while it was used by 73 physicians in the S group (85,9%). This result as well as the lower number of physicians mentioning advise on self-care and red-flag items (see Table 3) can be considered as additional manipulation checks, confirming the success of the manipulation of training content. Overall, immediate absolute recall of patients was on average 10.3 (SD = 4.7) utterances, corresponding to 27.8% of all utterances provided by the physicians.

Table 3. Recall of discharge information.

Empathy Structure Total p-value1
Absolute Relative Absolute Relative Absolute Relative Absolute Relative
Immediately after discharge N = 111 N = 85 N = 196
Explicit structure (book metaphor) .239 .231
    N-Miss 106 106 12 12 118 118
    Mean (SD) 0.00 (0.00) 0.00 (0.00) 0.70 (1.31) 0.15 (0.28) 0.65 (1.28) 0.14 (0.27)
    Range 0.00–0.00 0.00–0.00 0.00–5.00 0.00–1.00 0.00–5.00 0.00–1.00
Information on diagnosis .486 .081
    N-Miss 1 1 0 0 1 1
    Mean (SD) 3.94 (2.75) 0.29 (0.19) 3.67 (2.49) 0.34 (0.20) 3.82 (2.63) 0.31 (0.20)
    Range 0.00–14.00 0.00–0.83 0.00–13.00 0.00–1.00 0.00–14.00 0.00–1.00
Follow-up .834 .219
    N-Miss 10 10 2 2 12 12
    Mean (SD) 2.30 (2.49) 0.32 (0.29) 2.23 (1.76) 0.37 (0.31) 2.27 (2.19) 0.34 (0.30)
    Range 0.00–15.00 0.00–1.00 0.00–7.00 0.00–1.00 0.00–15.00 0.00–1.00
Advice on self-care .124 .064
    N-Miss 52 52 16 16 68 68
    Mean (SD) 0.78 (1.20) 0.22 (0.33) 1.14 (1.43) 0.33 (0.37) 0.98 (1.34) 0.28 (0.35)
    Range 0.00–5.00 0.00–1.00 0.00–5.00 0.00–1.00 0.00–5.00 0.00–1.00
Red Flag .718 .776
    N-Miss 32 32 1 1 33 33
    Mean (SD) 1.37 (1.36) 0.29 (0.31) 1.45 (1.62) 0.28 (0.30) 1.41 (1.50) 0.29 (0.30)
    Range 0.00–5.00 0.00–1.00 0.00–6.00 0.00–1.00 0.00–6.00 0.00–1.00
complete Treatment .968 .394
    N-Miss 6 6 6 6 12 12
    Mean (SD) 2.28 (2.18) 0.25 (0.22) 2.29 (2.81) 0.28 (0.27) 2.28 (2.46) 0.26 (0.24)
    Range 0.00–12.00 0.00–1.00 0.00–19.00 0.00–1.00 0.00–19.00 0.00–1.00
Other .627 .570
    N-Miss 20 20 40 40 60 60
    Mean (SD) 0.20 (0.52) 0.06 (0.19) 0.16 (0.37) 0.09 (0.24) 0.18 (0.47) 0.07 (0.20)
    Range 0.00–3.00 0.00–1.00 0.00–1.00 0.00–1.00 0.00–3.00 0.00–1.00
Recall performance .049 .018
    Mean (SD) 9.69 (4.78) 0.26 (0.11) 11.02 (4.52) 0.30 (0.11) 10.27 (4.70) 0.28 (0.11)
    Range 1.00–30.00 0.04–0.55 1.00–30.00 0.09–0.64 3.00–26.00 0.04–0.64
7 days after discharge N = 98 N = 73 N = 171
Explicit structure (book metaphor) .619 .284
    N-Miss 93 93 11 11 104 104
    Mean (SD) 0.20 (0.45) 0.20 (0.45) 0.40 (0.90) 0.09 (0.20) 0.39 (0.87) 0.10 (0.22)
    Range 0.00–1.00 0.00–1.00 0.00–4.00 0.00–1.00 0.00–4.00 0.00–1.00
Information on diagnosis .188 .599
    N-Miss 1 1 0 0 1 1
    Mean (SD) 2.98 (2.53) 0.21 (0.18) 2.51 (1.97) 0.23 (0.17) 2.78 (2.31) 0.22 (0.17)
    Range 0.00–10.00 0.00–0.83 0.00–11.00 0.00–0.69 0.00–11.00 0.00–0.83
Follow-up .501 .935
    N-Miss 8 8 1 1 9 9
    Mean (SD) 1.14 (1.46) 0.17 (0.23) 1.00 (1.21) 0.17 (0.22) 1.08 (1.35) 0.17 (0.22)
    Range 0.00–6.00 0.00–1.00 0.00–5.00 0.00–1.00 0.00–6.00 0.00–1.00
Advice on self-care .454 .863
    N-Miss 48 48 13 13 61 61
    Mean (SD) 0.78 (1.33) 0.14 (0.22) 0.60 (1.18) 0.15 (0.26) 0.68 (1.25) 0.14 (0.24)
    Range 0.00–5.00 0.00–0.71 0.00–7.00 0.00–1.00 0.00–7.00 0.00–1.00
Red Flag .062 .085
    N-Miss 28 28 1 1 29 29
    Mean (SD) 0.63 (1.14) 0.12 (0.23) 1.03 (1.37) 0.19 (0.25) 0.83 (1.28) 0.15 (0.24)
    Range 0.00–4.00 0.00–1.00 0.00–5.00 0.00–1.00 0.00–5.00 0.00–1.00
complete Treatment .115 .534
    N-Miss 6 6 6 6 12 12
    Mean (SD) 1.61 (1.90) 0.18 (0.20) 1.16 (1.50) 0.16 (0.19) 1.42 (1.76) 0.17 (0.20)
    Range 0.00–13.00 0.00–1.00 0.00–9.00 0.00–1.00 0.00–13.00 0.00–1.00
Other .180 .211
    N-Miss 15 15 34 34 49 49
    Mean (SD) 0.12 (0.42) 0.05 (0.17) 0.03 (0.16) 0.01 (0.08) 0.09 (0.36) 0.04 (0.15)
    Range 0.00–3.00 0.00–1.00 0.00–1.00 0.00–0.50 0.00–3.00 0.00–1.00
Recall performance .936 .894
    Mean (SD) 6.47 (3.83) 0.18 (0.10) 6.42 (3.30) 0.17 (0.11) 6.45 (3.60) 0.18 (0.11)
    Range 0.00–18.00 0.00–0.53 0.00–14.00 0.00–0.57 0.00–18.00 0.00–0.57
30 days after discharge N = 83 N = 60 N = 143
Explicit structure (book metaphor) .324 .249
    N-Miss 78 78 9 9 87 87
    Mean (SD) 0.00 (0.00) 0.00 (0.00) 0.39 (0.87) 0.09 (0.18) 0.36 (0.84) 0.08 (0.18)
    Range 0.00–0.00 0.00–0.00 0.00–3.00 0.00–0.60 0.00–3.00 0.00–0.60
Information on diagnosis .722 .188
    N-Miss 1 1 0 0 1 1
    Mean (SD) 2.44 (2.09) 0.18 (0.15) 2.32 (1.93) 0.21 (0.17) 2.39 (2.01) 0.19 (0.16)
    Range 0.00–7.00 0.00–0.55 0.00–8.00 0.00–0.50 0.00–8.00 0.00–0.55
Follow-up .573 .678
    N-Miss 8 8 1 1 9 9
    Mean (SD) 0.85 (1.20) 0.14 (0.21) 0.97 (1.07) 0.15 (0.17) 0.90 (1.14) 0.14 (0.19)
    Range 0.00–4.00 0.00–1.00 0.00–3.00 0.00–0.67 0.00–4.00 0.00–1.00
Advice on self-care .618 .835
    N-Miss 39 39 12 12 51 51
    Mean (SD) 0.68 (1.03) 0.14 (0.22) 0.56 (1.24) 0.15 (0.28) 0.62 (1.14) 0.14 (0.25)
    Range 0.00–4.00 0.00–1.00 0.00–7.00 0.00–1.00 0.00–7.00 0.00–1.00
Red Flag .692 .746
    N-Miss 25 25 1 1 26 26
    Mean (SD) 0.84 (1.14) 0.16 (0.25) 0.93 (1.24) 0.18 (0.24) 0.89 (1.19) 0.17 (0.24)
    Range 0.00–3.00 0.00–1.00 0.00–4.00 0.00–0.80 0.00–4.00 0.00–1.00
complete Treatment .134 .757
    N-Miss 4 4 6 6 10 10
    Mean (SD) 1.11 (1.34) 0.12 (0.18) 0.80 (0.94) 0.13 (0.21) 0.98 (1.20) 0.13 (0.19)
    Range 0.00–5.00 0.00–1.00 0.00–3.00 0.00–1.00 0.00–5.00 0.00–1.00
Other .301 .848
    N-Miss 11 11 27 27 38 38
    Mean (SD) 0.11 (0.43) 0.04 (0.15) 0.03 (0.17) 0.03 (0.17) 0.09 (0.37) 0.03 (0.16)
    Range 0.00–3.00 0.00–1.00 0.00–1.00 0.00–1.00 0.00–3.00 0.00–1.00
Recall performance .436 .330
    Mean (SD) 5.30 (3.06) 0.15 (0.09) 5.70 (2.94) 0.16 (0.09) 5.47 (3.01) 0.15 (0.09)
    Range 0.00–12.00 0.00–0.38 0.00–14.00 0.00–0.44 0.00–14.00 0.00–0.44

Note. Recall of discharge information immediately after discharge, one week and one months later, and adherence to recommendations one week and one months later. Recall of discharge information is reported conditional on the respective information being mentioned during discharge. Accordingly, missing values can be explained by the physician not mentioning the respective information during discharge, which reduces the number of patients in the respective analysis. No imputation of missing data was conducted. Absolute, absolute value; relative, relative value; SD, standard deviation; range, the area of variation between upper and lower limits; N-miss, number of missing values.

1 Linear ANOVA.

The mixed-effects model for immediate recall had a substantial explanatory power (R2 = .27). The model’s intercept was at 3.62 (SE = 0.84, 95% CI [1.97, 5.27], p < .001). The effect of group was positive with a small, significant effect (beta = 1.31, SE = 0.58, std. beta = 0.28, p < .05). The effect of number of utterances given by the physician was positive with a significant medium effect (beta = 0.16, SE = 0.02, std. beta = 0.50, p < .001).

In summary, patients in the S-group had a significantly higher immediate recall in comparison to patients in the E-group immediately after discharge (see Table 3).

3.4 Secondary outcomes: Long-term recall

At day 7, patients recalled on average 6.5 (SD = 3.6) utterances. The mixed effects model for recall at 7 days had substantial total explanatory power (R2 = .07). The model’s intercept was at 3.99 (SE = 0.77, 95% CI [2.48, 5.50], p < .001). The effect of group was negative and can be considered as tiny and not significant (beta = -0.08, SE = 0.54, std. beta = -0.02, p = .886). The effect of number of utterances given by the physician was positive and can be considered as small and significant (beta = 0.06, SE = 0.02, std. beta = 0.27, p < .001).

At day 30, patients recalled on average 5.5 (SD = 3.0) utterances. The model had a substantial total explanatory power (R2 = .04). The model’s intercept was at 3.92 (SE = 0.77, 95% CI [2.41, 5.42], p < .001). The effect of group was positive and can be considered as very small and not significant (beta = 0.57, SE = 0.56, std. beta = 0.19, p = .310). The effect of number of utterances given by the physician was positive and can be considered as very small and not significant (beta = 0.03, SE = 0.02, std. beta = 0.16, p = .056).

In summary, there were no significant differences between the two groups regarding the 7 day recall performance. Also, we found no significant differences between the two groups at day 30 recall performance (see Table 3).

3.5 Secondary outcomes: Feasibility, adherence, satisfaction and patient-physician-relationship

Feasibility was shown by a 69.6% training completion rate. Out of 117 eligible physicians 80 completed all teaching modules and 63 physicians discharged patients under study conditions.

Patients adhered to an average of a total of 1.5 recommendations given by the physicians (SD = 1.2) after 30-days (Table 4). Adherence to the recommendations given by the physician within 30 days was significantly higher in the S-group as compared to the E-group for absolute (p = .002) and relative (p = .004) values. In addition, adherence to recommendations within a month correlated significantly with immediate recall in the E group (r(81) = .29, p = .007) and the S group (r(58) = .32, p = .012).

Table 4. Patients’ adherence, satisfaction, and PRA-D scores.

Empathy Structure Total p-value1
(N = 111) (N = 85) (N = 196)
Adherence to recommendations
Recommendations given by the physician .205
    Mean (SD) 4.38 (2.21) 4.78 (1.81) 4.55 (2.05)
    Range 0.00–10.00 2.00–12.00 0.00–12.00
Adherence within one month (Absolute) .002
    N-Miss 28 25 53
    Mean (SD) 1.19 (1.11) 1.82 (1.27) 1.45 (1.21)
    Range 0.00–5.00 0.00–5.00 0.00–5.00
Adherence within one month (Relative) .004
    N-Miss 29 25 54
    Mean (SD) 0.27 (0.25) 0.39 (0.27) 0.32 (0.26)
    Range 0.00–1.00 0.00–1.00 0.00–1.00
Patient satisfaction
Comprehensibility of the discharge communication .209
    N-Miss 0 4 4
    Median (IQR) 9.80 (1.05) 9.90 (1.0) 9.80 (1.00)
Structuredness of the discharge communication .028
    N-Miss 0 4 4
    Median (IQR) 9.10 (2.00) 9.40 (1.30) 9.15 (2.00)
Recommendation of the physician to family and friends .021
    N-Miss 0 4 4
    Median (IQR) 9.50 (1.00) 10.00 (1.00) 10.00 (1.00)
Informativeness of the discharge communication .175
    N-Miss 6 11 17
    Median (IQR)s 9.40 (2.00) 9.50 (1.00) 9.50 (1.5)
Patient Reactions Assessment (PRA-D)
Patient affective index .199
    N-Miss 12 11 23
    Mean (SD) 30.21 (4.66) 31.08 (3.99) 30.58 (4.40)
Patient communication index .305
    N-Miss 12 11 23
    Mean (SD) 30.75 (5.73) 31.58 (4.59) 31.10 (5.27)
Patient information index .200
    N-Miss 12 11 23
    Mean (SD) 27.44 (5.37) 28.50 (5.31) 27.90 (5.35)
Total .124
    N-Miss 12 11 23
    Mean (SD) 88.40 (11.88) 91.16 (11.23) 89.58 (11.65)

Note. Patients’ adherence to physicians’ recommendations, self-rated satisfaction, and patient-physician-relationship, across all patient-physician encounters and by study group. Missing satisfaction and PRA-D values can be explained by the fact that the respective items were added to the questionnaire later on in the process of data collection, after the first patients had been included in the study; the pattern can be considered completely at random accordingly, and no imputation of missing values was conducted. N-miss, number of missing values. 1 Linear ANOVA

Patients’ ratings were high in both groups on all four dimensions of satisfaction (Table 4). Patients in the S-group had higher satisfaction ratings on structure (p = .028) and recommendation (p = .021) compared with the E group, and groups did not differ on their ratings of comprehension (p = .209) and informativeness (p = .175).

There were no significant differences between the groups on the subscales of the perceived quality of relationship between patient and physician measured with the PRA-D (Table 4).

4 Discussion

We designed two communication trainings for physicians, involving either explicit information structuring or empathy skills. We evaluated the feasibility of conducting these communication trainings within the ED of the University Hospital in Basel, Switzerland and we evaluated the respective effects of the two trainings on patients’ recall of discharge information, their adherence to recommendations during a 30-day period after discharge, and their satisfaction with the physician after discharge from the ED. The main finding of our study shows superiority of S over E on patients’ immediate recall performance. Further, the feasibility of trainings containing three short sessions in the first weeks of residency was shown, and patients in the S group showed higher adherence to recommendations and were similarly satisfied with the physician compared with the E group.

Empathy skills have been shown to improve patients’ outcomes and satisfaction [36]. Our manipulation check revealed that empathic communication skills were shown similarly in both training groups. Thus, our study evaluated the additional effect of focusing on structuring skills as a complement to communicating in an empathic way. This ensured that the comparison group was not obviously inferior to the explicit structure intervention. Therefore, the comparison of S versus E regarding recall was expected to be of only small superiority in our study. The patients who were treated by a physician who used the trained structuring methods recalled on average 1.33 more information items compared with patients who were treated by physicians who were trained in empathy. This observed small difference between the two training groups are in line with the findings of a meta-analysis on the effects of communication training on patient outcomes [37] in oncology. The difference of more than one item additionally recalled in the S group was judged to be relevant by most emergency physicians (data not shown), although a limit for clinical relevance has never been formally established. The relevance of the superior recall observed in patients in the S group is underlined by the fact that the enhanced recall was associated with enhanced adherence to the physicians’ recommendations in the S group as compared with patients in the E group. Given the rather low overall adherence to recommendations even a small increase in adherence may be considered a success. Previous findings confirm our observation that patient recall is associated with adherence to recommendations [6, 38, 39].

In the present study, patients’ satisfaction was high in both groups, but patients in the S group more strongly endorsed they would recommend their physician to family and friends in comparison to physicians in the E group. This finding was unexpected, as we would have expected patient satisfaction to be higher in the E group. However, the similar results between the two groups on satisfaction might reflect the observation that discharge communications did not differ with respect to empathy between the two groups, as rated by independent and blind raters. Overall, our results show that the non-information outcomes were achieved equally well between the empathy and the information intervention, meaning patients value the quality of their information from healthcare providers as well as the quality of their relationships with providers.

Our study implemented parsimonious trainings, which were shorter than previously studied interventions [37, 40], but lead to a comparably high number of physicians completing the training (69.6%). This demonstrates the feasibility of applying brief communication trainings within ED practice. Nevertheless, the minimal effort and duration of trainings may be one reason for the observed small differences between S and E groups. However, the short duration of trainings match with the requirements within an extremely busy ED. Taken together, a communication training that is highly standardized, but of minimal duration, can be considered as feasible, is associated with a high satisfaction, and, if specifically focusing on information structuring, may be superior to a training focusing on empathic communication alone, with respect to patients’ information recall and longer-term adherence to recommendations.

Our study has several limitations. First, our study was a single center study, the number of physicians in each cluster was small and the patient sample comprised patients with chest and abdominal pain only. However, our population is comparable to other European EDs and our sample of physicians is representative. All but two eligible physicians were initially included, and 69.6% of the physicians completed all three modules of the communication training. Patients with chest and abdominal pain were chosen as a study population because these complaints have a high prevalence in Eds [41, 42]. Second, the communication trainers could not be blinded to the interventions. Yet, physicians’ test scores in standardized tests showed that both groups were similarly successful in learning and applying their communication skills. Third, the current study did not check for relevance of the recalled utterances because experts cannot easily define which items are most relevant in discharge communication [43]. Fourth, patients’ adherence was based on self-reports. We were not able to check whether patients actually adhered to the recommendations (e.g. by testing serum concentrations of the prescribed drugs). However, patients’ self-reported adherence was low, and bias would likely apply to both groups and should therefore not account for differences between E and S trainings. Fifth, 46.0% of the randomized patients were not available for analyses at last follow-up. While in a more standardized setting this number would be considered high, it is important to note, that half of the losses to follow up did not even take part in the immediate assessments. Of those patients who were assessed immediately after discharge 73.0% were assessed one month later again, which reflects a reasonable completion rate. Sixth, we did not include a standard care or no-training control group. For future research it would be interesting to investigate the effects of both presented trainings with the standard of care in EDs, in order to clarify the absolute efficacy of implementing such trainings. It is also possible that focusing on empathy may even interfere with the physicians’ primary tasks of conveying relevant information, or with patients’ information recall, as previous research may suggest [44]. However, our study did not aim at investigating this question. Seventh, though training helped with immediate recall, the waning effect remains to be a concern. We therefore suggest a second structured information as a follow-up to boost recall and support patient adherence. Effects of such an additional structured intervention, however, should be studied in the future. Last, the original clinical trial protocol that was submitted to the local ethics committee was amended: 1) we were planning to include a total of 400 participants within one year to guarantee a power of over .9. Including 400 patients within one year was not feasible as many of the screened patients did not meet the inclusion criteria. This led to an extension of the study period that was approved by the local ethics committee, an increase in the number of physician clusters and a decrease of included patients (i.e. 196). Nevertheless, a smaller sample size of 200 patients still guaranteed satisfactory power level of above .8 and the longer recruitment did not bear the risk of biasing the study results. 2) feasibility was added as a secondary outcome although this variable was not included in the originally published protocol. This was important as the communication skills training under investigation needed to be easy to follow and implementable in clinical practice.

5 Conclusion

Our results suggest that teaching explicit information structuring to physicians is feasible in terms of physicians’ training completion rate, and the application of their skills in practice. Our study suggests that the mix of empathic communication and structured information provision may improve patients’ recall of information, their adherence to recommendations and also their satisfaction with ED treatment. Given the low intensity of training, and the design of the study as a comparative trial, only a small superiority of information structuring could be shown in terms of patients’ immediate recall and adherence to recommendations. Finally, patient satisfaction was high and there was no trade-off in the information structuring group as compared to the group with physicians trained in empathy skills. The observed findings, but also the lack of a standard of care or no-training control in our study, as well as the observation of inconsistent findings in previous studies on implementing communication strategies in ED to increase information patients’ recall and adherence to recommendations indicate the need for further research.

Supporting information

S1 Checklist

(DOC)

S1 File. Content of the communication training.

(DOCX)

S1 Protocol

(DOCX)

S1 Table. Coding scheme.

(DOCX)

S1 Fig. Visual representation of the raw data.

(DOCX)

S2 Fig. Visual representation of the raw data from discharge to 30 days follow-up assessment.

(DOCX)

Acknowledgments

The authors thank Marianne Benz, Leona Knüsel, Dominik Maiori, Valentina Steffen, Doreen Eckardt, Laura Fässler, Anna Becker, David Bachmann, Galya Iseli, and Isabelle Keller for their support in data collection and Laura Wiles for editing the manuscript.

Data Availability

Anonymized data are available on OSF under the following link: https://osf.io/84q3r/.

Funding Statement

This project was funded by the Swiss National Science Foundation (CR31I3_159841). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Eisenberg EM, Murphy AG, Sutcliffe K, Wears R, Schenkel S, Perry S, et al. Communication in emergency medicine: Implications for patient safety. Commun Monogr. 2005;72(4):390–413. [Google Scholar]
  • 2.Levinson W, Roter DL, Mullooly JP, Dull VT, Frankel RM. Physician-patient communication: The relationship with malpractice claims among primary care physicians and surgeons. JAMA. 1997;277(7):553–9. doi: 10.1001/jama.277.7.553 [DOI] [PubMed] [Google Scholar]
  • 3.Street RL, Makoul G, Arora NK, Epstein RM. How does communication heal? Pathways linking clinician-patient communication to health outcomes. Patient Educ Couns. 2009;74(3):295–301. doi: 10.1016/j.pec.2008.11.015 [DOI] [PubMed] [Google Scholar]
  • 4.Laws MB, Lee Y, Taubin T, Rogers WH, Wilson IB. Factors associated with patient recall of key information in ambulatory specialty care visits: Results of an innovative methodology. PLoS One. 2018;13(2):1–13. doi: 10.1371/journal.pone.0191940 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Gabrijel S, Grize L, Helfenstein E, Brutsche M, Grossman P, Tamm M, et al. Receiving the diagnosis of lung cancer: Patient recall of information and satisfaction with physician communication. J Clin Oncol. 2008;26(2):297–302. doi: 10.1200/JCO.2007.13.0609 [DOI] [PubMed] [Google Scholar]
  • 6.Jansen J, Butow PN, Van Weert JCM, Van Dulmen S, Devine RJ, Heeren TJ, et al. Does age really matter? Recall of information presented to newly referred patients with cancer. J Clin Oncol. 2008;26(33):5450–7. doi: 10.1200/JCO.2007.15.2322 [DOI] [PubMed] [Google Scholar]
  • 7.Kessels RPC. Patients’ memory for medical information. J R Soc Med [Internet]. 2003;96(5):219–22. Available from: http://journals.sagepub.com/doi/10.1177/014107680309600504 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Engel KG, Buckley BA, Mccarthy DM, Forth VE, Adams JG. Communication amidst chaos: Challenges to patient communication in the emergency department. J Sci Commun. 2010;17(10):449–52. [Google Scholar]
  • 9.Vashi A, Rhodes K V. “Sign right here and you’re good to go”: A content analysis of audiotaped emergency department discharge instructions. Ann Emerg Med [Internet]. 2011;57(4):315–322.e1. Available from: 10.1016/j.annemergmed.2010.08.024 [DOI] [PubMed] [Google Scholar]
  • 10.Smith HK, Manjaly JG, Yousri T, Upadhyay N, Taylor H, Nicol SG, et al. Informed consent in trauma: Does written information improve patient recall of risks? A prospective randomised study. Injury. 2012;43(9):1534–8. doi: 10.1016/j.injury.2011.06.419 [DOI] [PubMed] [Google Scholar]
  • 11.Mauffrey C, Prempeh EM, John J, Vasario G. The influence of written information during the consenting process on patients’ recall of operative risks. A prospective randomised study. Int Orthop. 2008;32(4):425–9. doi: 10.1007/s00264-007-0361-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Langdon IJ, Hardin R, Learmonth ID. Informed consent for total hip arthroplasty: Does a written information sheet improve recall by patients? Ann R Coll Surg Engl. 2002;84(6):404–8. doi: 10.1308/003588402760978201 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Sustersic M, Gauchet A, Foote A, L. B. How best to use and evaluate Patient Information Leaflets given during a consultation: A systematic review of literature reviews. Heal Expect. 2017;20(4):531–42. doi: 10.1111/hex.12487 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.van der Meulen N, Jansen J, van Dulmen S, Bensing J, van Weert J. Interventions to improve recall of medical information in cancer patients: A systematic review of the literature. Psycho‐Oncology J Psychol Soc Behav Dimens Cancer. 2008;17(9):857–68. doi: 10.1002/pon.1290 [DOI] [PubMed] [Google Scholar]
  • 15.Watson PWB, McKinstry B. A systematic review of interventions to improve recall of medical advice in healthcare consultations. J R Soc Med. 2009;102(6):235–43. doi: 10.1258/jrsm.2009.090013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Powers RD. Emergency department patient literacy and the readability of patient-directed materials. Ann Emerg Med. 1988;17(2):124–6. doi: 10.1016/s0196-0644(88)80295-6 [DOI] [PubMed] [Google Scholar]
  • 17.Williams DM, Counselman FL, Caggiano CD. Emergency department discharge instructions and patient literacy: A problem of disparity. Am J Emerg Med. 1996;14(1):19–22. doi: 10.1016/S0735-6757(96)90006-6 [DOI] [PubMed] [Google Scholar]
  • 18.Langewitz W, Ackermann S, Heierle A, Hertwig R, Ghanim L, Bingisser R. Improving patient recall of information: Harnessing the power of structure. Patient Educ Couns [Internet]. 2015;98(6):716–21. Available from: doi: 10.1016/j.pec.2015.02.003 [DOI] [PubMed] [Google Scholar]
  • 19.Ackermann S, Ghanim L, Heierle A, Hertwig R, Langewitz W, Mata R, et al. Information structuring improves recall of emergency discharge information: A randomized clinical trial. Psychol Health Med [Internet]. 2016;22(6):646–62. Available from: doi: 10.1080/13548506.2016.1198816 [DOI] [PubMed] [Google Scholar]
  • 20.Siegrist V, Langewitz W, Mata R, Maiori D, Hertwig R, Bingisser R. The influence of information structuring and health literacy on recall and satisfaction in a simulated discharge communication. Patient Educ Couns. 2018;101(12):2090–6. doi: 10.1016/j.pec.2018.08.008 [DOI] [PubMed] [Google Scholar]
  • 21.Kiessling C, Langewitz W. The longitudinal curriculum “social and communicative competencies” within Bologna-reformed undergraduate medical education in Basel. GMS Z Med Ausbild. 2013;30(3):1–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Jadin SMM, Langewitz W, R Vogt D, Urwyler A. Effect of structured pre-anesthetic communication on preoperative patient anxiety. J Anesth Clin Res. 2017;8(10). [Google Scholar]
  • 23.Byrne G, Robert H. Patient anxiety in the accident and emergency department. Jounral Clin Nurs. 1996;39(6):289–95. [PubMed] [Google Scholar]
  • 24.Ekwall A. Acuity and anxiety from the patient’s perspective in the emergency department. J Emerg Nurs. 2013;39(6):534–8. doi: 10.1016/j.jen.2010.10.003 [DOI] [PubMed] [Google Scholar]
  • 25.Hojat M, Louis DZ, Markham FW, Wender R, Rabinowitz C, Gonnella JS. Physicians’ empathy and clinical outcomes for diabetic patients. Acad Med. 2011;86(3):359–64. doi: 10.1097/ACM.0b013e3182086fe1 [DOI] [PubMed] [Google Scholar]
  • 26.Kim SS, Kaplowitz S, Johnston M V. The effects of physician empathy on patient satisfaction and compliance. Eval Heal Prof. 2004;27(3):237–51. doi: 10.1177/0163278704267037 [DOI] [PubMed] [Google Scholar]
  • 27.Menendez ME, Chen NC, Mudgal CS, Jupiter JB, Ring D. Physician empathy as a driver of hand surgery patient satisfaction. J Hand Surg Am [Internet]. 2015;40(9):1860–5. Available from: doi: 10.1016/j.jhsa.2015.06.105 [DOI] [PubMed] [Google Scholar]
  • 28.Ware J, Kosinski M, Keller SD. A 12-item short-form health survey: Construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34(3):220–33. doi: 10.1097/00005650-199603000-00003 [DOI] [PubMed] [Google Scholar]
  • 29.Herrmann-Lingen C, Buss U, Snaith P. Hospital Anxiety and Depression Scale-Deutsche Version (HADS-D). Huber. 2011. [Google Scholar]
  • 30.Galassi JP, Schanberg R, Ware WB. The patient reactions assessment: A brief measure of the quality of the patient-provider medical relationship. Psycholoical Assess. 1992;4(3):346–351. [Google Scholar]
  • 31.Brenk-Franz K, Hunold G, Galassi JP, Tiesler F, Herrmann W, Freund T, et al. Quality of the physician-patient relationship–evaluation of the German version of the Patient Reactions Assessment (PRA-D). Z Allgemeinmed. 2016;92(3):103–8. [Google Scholar]
  • 32.Wickham H, Averick M, Bryan J, Chang W, D’Agostino McGowan L, François R, et al. Welcome to the Tidyverse. J Open Source Softw. 2019;4(43):1686. [Google Scholar]
  • 33.Bates D, Mächler M, Bolker BM, Walker SC. Fitting linear mixed-effects models using lme4. arxiv.org/abs/1406.5823. 2014. [Google Scholar]
  • 34.Funder DC, Ozer DJ. Evaluating effect size in psychological research: Sense and nonsense. Adv Methods Pract Psychol Sci. 2019;2(2):156–68. [Google Scholar]
  • 35.Christensen RHB. ordinal—regression models for ordinal data. R Packag version. 2015;28. [Google Scholar]
  • 36.Derksen F, Bensing J, Lagro-Janssen A. Effectiveness of empathy in general practice: A systematic review. Br J Gen Pract. 2013;63(606):e76–84. doi: 10.3399/bjgp13X660814 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Barth J, Lannen P. Efficacy of communication skills training courses in oncology: A systematic review and meta-analysis. Ann Oncol. 2011;22(5):1030–40. doi: 10.1093/annonc/mdq441 [DOI] [PubMed] [Google Scholar]
  • 38.Dong L, Lee JY, Harvey AG. Do improved patient recall and the provision of memory support enhance treatment adherence? J Behav Ther Exp Psychiatry [Internet]. 2017;54:219–28. Available from: doi: 10.1016/j.jbtep.2016.08.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Linn AJ, van Dijk L, Smit EG, Jansen J, van Weert JCM. May you never forget what is worth remembering: The relation between recall of medical information and medication adherence in patients with inflammatory bowel disease. J Crohn’s Colitis [Internet]. 2013;7(11):e543–50. Available from: doi: 10.1016/j.crohns.2013.04.001 [DOI] [PubMed] [Google Scholar]
  • 40.Liénard A, Merckaert I, Libert Y, Bragard I, Delvaux N, Etienne AM, et al. Is it possible to improve residents breaking bad news skills? A randomised study assessing the efficacy of a communication skills training program. Br J Cancer. 2010;103(2):171–7. doi: 10.1038/sj.bjc.6605749 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Cordell WH, Keene KK, Giles BK, Jones JB, Jones JH, Brizendine EJ. The high prevalence of pain in emergency medical care. Am J Emerg Med. 2002;20(3):165–9. doi: 10.1053/ajem.2002.32643 [DOI] [PubMed] [Google Scholar]
  • 42.Bingisser R, Dietrich M, Ortega RN, Malinovska A, Bosia T, Nickel CH. Systematically assessed symptoms as outcome predictors in emergency patients. Eur J Intern Med. 2017;45:8–12. doi: 10.1016/j.ejim.2017.09.013 [DOI] [PubMed] [Google Scholar]
  • 43.Ackermann S, Heierle A, Bingisser M-B, Hertwig R, Padiyath R, Nickel CH, et al. Discharge communication in patients presenting to the emergency department with chest pain: Defining the ideal content. Health Commun [Internet]. 2016;31(5):557–65. Available from: doi: 10.1080/10410236.2014.979115 [DOI] [PubMed] [Google Scholar]
  • 44.Lehmanna V, Labrie NH., Van den Weert JCM, van Dulmen S, de Haes HCJM, Kersten MJ, et al. Provider caring and structuring treatment information to improve cancer patients’ recall: Does it help? Patient Educ Couns. 2020;103(1):55–62. doi: 10.1016/j.pec.2019.07.011 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Beryne Odeny

4 Dec 2020

PONE-D-20-21645

Does Information Structuring Improve Recall of Discharge Information? A Cluster Randomized Clinical Trial

PLOS ONE

Dear Dr. Siegrist,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The manuscript has been evaluated by three reviewers, and their comments are available below.

The reviewers have raised a number of concerns that need attention. They request additional information on methodological aspects of the study (such as additional information on sample size determination and statistical analyses) and a deeper synthesis and discussion of your results to support your conclusions.

Could you please revise the manuscript to carefully address the concerns raised?

Please submit your revised manuscript by January 8, 2020. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Beryne Odeny

Staff Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for including your ethics statement:  "The study was approved in writing by the local ethics committee (EKNZ 2014-379) and the protocol was published on ClinicalTrials.gov (NCT02468869)."   

Please amend your current ethics statement to include the full name of the ethics committee/institutional review board(s) that approved your specific study.

Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”).

For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research.

3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

4. Please upload a copy of Figure 3, to which you refer in your text (line 273). If the figure is no longer to be included as part of the submission please remove all reference to it within the text.

5. Please include a caption for figure 3.

6. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a very well-done study of an oft discussed but rarely studied phenomenon. While the ultimate conclusions of the research are not earth-shattering, they represent a solid step forward in taking communication processes seriously in health settings. I have a few observations that might help the authors to improve their presentation and arguments.

1. I noticed early on that the sample was restricted to residents and that you say in passing that the residents conducted the patient discharge. In many parts of the world the discharge conversation is delegated or assigned to nurses or medical social workers, so it would be important for you to comment on whether residents always do discharges at this hospital or whether there is some variability…and whether you think your findings regarding structured communication would apply if other roles were involved.

2. I found it fascinating that in your manipulation check you discovered that both groups of residents were equally empathic; I suppose that speaks well for their training in general. This does mean that your finding of the value of structured communication really is on top of a baseline level of empathy. You make this clear in the conclusion, but I just wanted to comment that from your hypotheses I was anticipating that the empathy training was not going to turn out to be very useful.

3. I could use a little more detail on how you measured immediate recall, especially since it is one of the few places you found a significant difference. I went into the study protocol to see that there were five-minute conversations, but there ought to be more about this in the paper.

4. I suppose that the most significant finding is that structured communication drives adherence weeks out, so it is a little disappointing that your measure of this is solely self-report. But I see no reason to think that these self-reports would vary for other reasons that would counteract your conclusions. An interesting follow-up study might identify more behavioral outcome measures to really clinch the value of this approach.

5. I think it might help for you to explain that structured communication can take many forms and that you chose a particular operationalization with INFARCT; I know you want to make claims about the structured approach but there could be some different ways to get to the same end.

6. Finally, as a qualitative health researcher myself I found myself wanting a closer analysis of these discharge conversations that goes beyond the coding and capturing of utterances. Mere recall of an utterance is one thing, but there are a number of other communication factors that could also improve the likelihood of patients grasping the physician’s meaning. This is not a criticism of your study but an observation that other methods such as conversation analysis or ethnography could shed even more light on this phenomenon.

Reviewer #2: The manuscript entitled ‘Does Information Structuring Improve Recall of Discharge Information? A Cluster Randomized Clinical Trial.’ with the aim to assess the information structuring using the book metaphor and the InFARcT mnemonic and improvement on patients’ information recall, their adherence to instructions and patients’ satisfaction.

This study is quite interesting, however, the manuscript requires improvement.

Comments

Abstract

Line 34, one or two lines of introduction/background to be provided before the objectives.

Methods

The duration of the patients in ED and assessment to be clearly stated.

Line 123-127, the allocation concealment, blinding to be stated.

Line 146-149, the period of assessment to be clearly stated.

Line 160, for Immediately discharged assessment, the period/time point to be clearly stated.

Line 185 - 190, for the telephone conversation recording at 7 and 30 days and the method of recording to be clearly stated.

Sample size calculation and statistical analysis

1 or 2 tailed test, sample size for each group and attrition rates consideration to be stated. The accepted level of significance to be stated.

Results

Line 256, what range refers to, to be clearly stated.

Table 1, at least one decimal point for percentages figures. Symbol <= , >= to be replaced with ≤, ≥ respectively. The decimal points for p values to be standardized. All the decimal points for the figures quoted in text to follow the exact figures in the table.

However, based on CONSORT guidelines, all statistical tests on group comparison at baseline to be avoided. As such all the description on the ‘statistical analysis’ on baseline to be avoided.

Line 287 3.2.1., Line 302 3.2.2, Line 314 Table 2, the time point/period of assessment to be clearly stated.

Line 332-337 & 342-355, results to be presented/tabulated in table form.

Line 334, 350, for substantial total explanatory power values, need to discuss more on the values and the reasons.

Line 378-379, the p value for t test or correlation test to clearly separated.

Line 383, for informativeness (p = .199), p value is 0.175. 0.199 is for patient affective index.

Line 385, p >0.124 to follow Table 4 p=0.124

Table 2, statistical test to be denoted in the table footnote.

Table 3, Absolute, Relative, Range to be clearly denoted in the table footnote.

Table 3 & 4, N- Miss to be clearly denoted in the table footnote or replaced with the word ‘missing’.

Effect size could be provided where applicable.

A section to be provided to describe the missing data at overall and various time period i.e percentages etc.

For the list of references, journal name and style to follow journal format.

Reviewer #3: This is an interesting study that tested the effectiveness of the structured discharge information presentation training relative to empathy training. The study was well conducted and the paper well written. The findings should be of interest to researchers and clinicians who are interested in intervention aimed to improve clinician-patient communication.

I have a few observations and minor suggestions for revisions.

1. There is no reason to think INFARcT training would be superior to empathy training on any outcomes other than recall and structure of information giving. The fact that information structure was superior to empathy was largely because the coding scheme was based on the INFARcT training itself. This is less about quality of information giving and more about fidelity of the intervention. I think this should be acknowledged in the discussion.

2. While there were differences in self reported adherence and recommending the physician, there is not theoretical reason provided for why this should be the case. While the study did not test a theoretical explanation, the authors should offer at least some speculation because I feel it inadequate to draw any conclusions on adherence (even if self-reported) and physician recommendation simply based on the assumption 'it must have been INFARcT training.'

3. I would argue that the rationale for comparing INFARcT to empathy training is that empathy is considered the gold standard for effective communication is not convincing. Empathy is important, but quality of information exchange, perhaps shared decision-making (though less relevant in ED) are just as important. Thus, a better rationale needs to be provided (perhaps authors were interested in comparing an information intervention to a relationship-focused one). Or argue empathy as a control condition because it does not focus on information per se.

4. I think the physician-patient relationship outcome is mislabeled. The PRA assesses patient perceptions of the quality of communication--physician informative, caring, and patient feels comfortable communicating. I suggest label it perceived quality of communication or perceived quality of relationship (i.e., needs 'quality' in the label).

5. In discussion, I think authors could say that the non information outcomes were acheived equally (for the most part) between the empathy and the information intervention, meaning patients value the quality of their information from providers as well as the quality of their relationships with providers.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Oct 18;16(10):e0257656. doi: 10.1371/journal.pone.0257656.r002

Author response to Decision Letter 0


31 May 2021

Dear editor, dear reviewers,

We would like to express our thanks for your valuable inputs and believe that the manuscript has improved by your comments.

Point-to-point reply to editor’s comments:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming.

Answer: We have thoroughly revised our manuscript according to PLOS ONE’s style requirements.

2. Thank you for including your ethics statement: "The study was approved in writing by the local ethics committee (EKNZ 2014-379) and the protocol was published on ClinicalTrials.gov (NCT02468869)."

Please amend your current ethics statement to include the full name of the ethics committee/institutional review board(s) that approved your specific study.

Answer: We have amended the current ethics statement including the full name of the ethics committee that approved our study. You can find the full name of the ethics committee that approved the study on page 5-6, lines 123-128. Please find the updated wording below.

“The study was approved by the local ethics committee “Ethikkommission Nordwest- und Zentralschweiz” (EKNZ 2014-379) on December 3, 2014 and the protocol was published on ClinicalTrials.gov (NCT02468869).”

3. Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”).

Answer: We have added the current ethics statement including the full name of the ethics committee that approved our study to the Ethics Statement field of the submission

4. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

Answer: After consultation with the responsible ethics committee, there are no restrictions as long as data is anonymized. Therefore, we uploaded the minimal anonymized data set necessary to replicate our study findings to a stable, public repository and provide you with the relevant URL: https://osf.io/84q3r/

5. Please upload a copy of Figure 3, to which you refer in your text (line 273). If the figure is no longer to be included as part of the submission please remove all reference to it within the text.

Answer: We have updated the Figure name from Figure 3 to Figure 2, that was referred to in line 273 (now, it is line: 381).

6. Please include a caption for figure 3.

Answer: A caption for Figure 2 is already included (no Figure 3 will be shown in the manuscript).

7. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Answer: We now have included captions for our supporting information files at the end of the manuscript on page 35 and updated any in-text citations to match accordingly.

Point-to-point reply to reviewers’ comments:

Reviewer #1

This is a very well-done study of an oft discussed but rarely studied phenomenon. While the ultimate conclusions of the research are not earth-shattering, they represent a solid step forward in taking communication processes seriously in health settings. I have a few observations that might help the authors to improve their presentation and arguments.

1. I noticed early on that the sample was restricted to residents and that you say in passing that the residents conducted the patient discharge. In many parts of the world the discharge conversation is delegated or assigned to nurses or medical social workers, so it would be important for you to comment on whether residents always do discharges at this hospital or whether there is some variability…and whether you think your findings regarding structured communication would apply if other roles were involved.

Answer: Thank you for this input. We were indeed not aware of health care systems in which nurses or even social workers discharge patients from an Emergency Department. Therefore, we have not tested for this option, but we believe that similar outcomes might be found in other professional groups as well: Why should the effect on patients’ recall differ according to the information-giving subject’s profession? As we pointed out, the approach is minimalistic, teaching is highly formalized and concise, and the results, as shown by the plots in the Appendix section “S3 Visual representation of the raw data”, indicate that the formal teaching of structuring discharge information actually resulted in a higher structure of information-giving.

2. I found it fascinating that in your manipulation check you discovered that both groups of residents were equally empathic; I suppose that speaks well for their training in general. This does mean that your finding of the value of structured communication really is on top of a baseline level of empathy. You make this clear in the conclusion, but I just wanted to comment that from your hypotheses I was anticipating that the empathy training was not going to turn out to be very useful.

Answer: Indeed, we were fascinated by the same finding as most residents tend to have a short professional experience, suffer from extreme pressure due to high workload, and have a high turn-over in most European Emergency Departments. We are not aware of any study with such high empathy ratings in Emergency Medicine. We have updated the wording to make this point even clearer in the discussion. Please find the updated wording below (page 26, lines 542-546).

“Our manipulation check revealed that empathic communication skills were shown similarly in both training groups. Thus, our study evaluated the additional effect of focusing on structuring skills as a complement to communicating in an empathic way. This ensured that the comparison group was not obviously inferior to the explicit structure intervention.”

3. I could use a little more detail on how you measured immediate recall, especially since it is one of the few places you found a significant difference. I went into the study protocol to see that there were five-minute conversations, but there ought to be more about this in the paper.

Answer: We have added a more in-depth description of the measurement of immediate recall in the manuscript under “2.4.1 Primary outcome: Immediate discharge information recall” (page 8, lines 193-198):

“Recall was assessed by asking patients the question: “Please share with me all the information that you recall from your discharge communication.” After the last utterance was shared proactively by the patient, the interviewer would probe and ask “is there any additional information that you remember from your discharge communication?”. The interview was stopped once the patient stated that there is nothing else that he or she recalls.”

4. I suppose that the most significant finding is that structured communication drives adherence weeks out, so it is a little disappointing that your measure of this is solely self-report. But I see no reason to think that these self-reports would vary for other reasons that would counteract your conclusions. An interesting follow-up study might identify more behavioral outcome measures to really clinch the value of this approach.

Answer: As the study design was quite ambitious for a communication study, particularly in the challenging environment of an inner-city Emergency Department, it was not feasible to use a more “objective measurement” for adherence. A large part of adherence studies relies on self-report. Objective measurements of, e.g. compliance with medication, is extremely challenging. Adherence to asthma medication was shown to be similar, if self-reports were compared to measurement of the contents of spray containers. However, micro-chip packed containers used in other studies showed that the consumption may occur very asymmetrically, such as in the last few hours before the study visit. Therefore, it would have been a challenge to find an “objective method” to measure adherence in 200 patients, not only with individual medication, but also with other medical instructions to be followed. As the method was exactly the same for both groups, we believe that even if the results may be biased in favor of adherence, it is impacted in both groups in a similar way. We agree that more studies are needed in this respect.

5. I think it might help for you to explain that structured communication can take many forms and that you chose a particular operationalization with INFARCT; I know you want to make claims about the structured approach but there could be some different ways to get to the same end.

Answer: This is a point well taken. This study uses a “proof-of-principle” approach. For decades, the theory that formally structured information-giving could aid recall in critical situations, such as in emergency discharge, was widely discussed and was part of teaching in medical communication. However, there was not one real-life study to gather evidence on this topic. We have added the following sentence in the introduction of the manuscript to clarify that structured communication can take many forms (page 5, lines: 100-102):

“Structuring the content of information given can take many forms; in pre-medication visits (22) the topics to be dealt with differ from discharge communication from patient to patient.”

6. Finally, as a qualitative health researcher myself I found myself wanting a closer analysis of these discharge conversations that goes beyond the coding and capturing of utterances. Mere recall of an utterance is one thing, but there are a number of other communication factors that could also improve the likelihood of patients grasping the physician’s meaning. This is not a criticism of your study but an observation that other methods such as conversation analysis or ethnography could shed even more light on this phenomenon.

Answer: We absolutely agree that there is much more to this very important aspect in medicine and more specifically communication in healthcare. As discharge communication is closely linked to patient satisfaction and medical outcomes, it needs to be studied in much more detail. Other methods, such as conversation analysis or ethnography could indeed shed much more light on this phenomenon. On the other hand, a quantitative proof-of-principle approach cannot be replaced by qualitative health research – neither can qualitative research be replaced by the assessment of quantitative effects in larger populations. We therefore believe that this research is a good starting point for future research.

Reviewer #2

The manuscript entitled ‘Does Information Structuring Improve Recall of Discharge Information? A Cluster Randomized Clinical Trial.’ with the aim to assess the information structuring using the book metaphor and the InFARcT mnemonic and improvement on patients’ information recall, their adherence to instructions and patients’ satisfaction.

This study is quite interesting, however, the manuscript requires improvement.

Comments

Abstract

Line 34, one or two lines of introduction/background to be provided before the objectives.

Answer: Thank you for this important input. We have added more background information to the abstract in the objectives section. Please find the updated wording below (page 2, lines: 36-42):

“The impact of the quality of discharge communication between physicians and their patients is critical on patients’ health outcomes. Nevertheless, low recall of information given to patients at discharge from emergency departments (EDs) is a well-documented problem. Therefore, we investigated the outcomes and related benefits of two different communication strategies: Physicians were instructed to either use empathy (E) or information structuring (S) skills hypothesizing superior recall by patients in the S group.”

Methods

The duration of the patients in ED and assessment to be clearly stated.

Answer: We agree with the reviewer that it would have been interesting to have a look at the duration of the patients in ED and the assessments but given the complexity of the study design and the focus on the effect of structured vs. unstructured discharge communication, these measures were not assessed.

Line 123-127, the allocation concealment, blinding to be stated.

Answer: We have added information on the allocation concealment. Please find the updated wording below (page 6, lines 133-138):

“As study physicians we included new residents starting at the ED of the University Hospital Basel. Physicians were clustered according to their first day at work (January 1st, April 1st, July 1st, and October 1st). Eight clusters of physicians were included. Physicians were blinded regarding cluster randomization and the content of the other communication skills training. They gave written informed consent before undergoing three teaching modules of communication training (see section 2.2).”

Line 146-149, the period of assessment to be clearly stated.

Answer: We have added information on the period of assessment. Please find the updated wording below (page 7, lines: 165-175):

“Patients presenting to the ED were screened for the main complaint of chest or abdominal pain using the web-based electronic health record. The electronic health record was fed with information from the attending physician, showing the collected information, such as main complaint, almost in real time. If patients were eligible, trained study personnel explained the study procedure and informed consent was obtained right after patient history was obtained. Patients were blinded to the communication training which their physician had received. Information on demographics, mental and physical health (12-Item Short Form Health Survey; SF-12)(28), anxiety and depression (Hospital Anxiety and Depression Scale; HADS-D)(29) was obtained right after informed consent was given. Data were recorded using the web-based software secuTrial® by study personnel.”

Line 160, for Immediately discharged assessment, the period/time point to be clearly stated.

Answer: We have added information on the time point of discharge assessments. Please find the updated wording below (page 7, lines: 186-190):

“The primary outcome of the study was patients’ immediate recall of discharge information as a function of physicians’ communication training. This outcome was assessed right after the discharge communication was completed but before the patient left the hospital.”

Line 185 - 190, for the telephone conversation recording at 7 and 30 days and the method of recording to be clearly stated.

Answer: We have added information on the method of recording of the immediate recall but also of the follow-up telephone conversations. Please find the updated wording below (page7, lines: 186-191 & lines: 202-206):

“2.4.1 Primary outcome: Immediate discharge information recall. The primary outcome of the study was patients’ immediate recall of discharge information as a function of physicians’ communication training. This outcome was assessed right after the discharge communication was completed but before the patient left the hospital. The conversation between the researcher and the patient was recorded with an audio recorder.”

“Long-term recall of discharge information was assessed on day 7 and 30 after discharge via telephone interviews. The researcher was calling the patient on the phone at the time they agreed upon before the patient left the ED at day 0. The recording of the conversation started after obtaining the consent of the patient regarding the recording.”

Sample size calculation and statistical analysis

1 or 2 tailed test, sample size for each group and attrition rates consideration to be stated. The accepted level of significance to be stated.

Answer: Sample sizes are stated in the tables for each group and condition. Attrition rates are stated in Figure 2. We have added information on the test methods and accepted level of significance. Please find the updated wording below (pages 10-11, lines: 255-263).

“The study was powered at 80% (two-sided test, �-level of .05) to detect a difference in recall performance for two patient groups discharged either by a physician trained in empathy or structured discharge communication. With an estimated effect size of .4 (as deduced from a previously conducted laboratory experiment) a total sample size of 200 was required. We used an alpha level of .05 for all statistical tests.

Analyses were conducted using R (version 3.6.1.) in RStudio using the packages tidyverse(32) and lme4(33) for calculating linear mixed effects models. For group comparisons, linear ANOVA analysis was used for continuous variables and Pearson’s two-tailed chi-square test of independence for categorical variables.”

Results

Line 256, what range refers to, to be clearly stated.

Answer: We have added information to clarify what the range referred to in line 256. Please find the updated wording below (page 12, lines: 296-299):

“80 physicians completed all three teaching modules during the study period, and 63 of them treated at least one patient within the context of this study (range: 1 to 19 patients per physician of which the discharge communication was recorded and included in the study).”

Table 1, at least one decimal point for percentages figures. Symbol <= , >= to be replaced with ≤, ≥ respectively. The decimal points for p values to be standardized. All the decimal points for the figures quoted in text to follow the exact figures in the table.

Answer: We have changed Table 1 accordingly: We added one decimal point for percentages, we replaced the symbols <= & >= with ≤ & ≥, and we standardized decimal points for p-values, as well as adapted and standardized decimal points in text, figures, and tables.

However, based on CONSORT guidelines, all statistical tests on group comparison at baseline to be avoided. As such all the description on the ‘statistical analysis’ on baseline to be avoided.

Answer: We agree that this is a recommendation in the CONSORT guidelines. Although, we randomized physicians to one of the two communication trainings, we wanted to ensure that clustering physicians to one condition did not lead to a systematic bias. Therefore, we thought it is important to report that the cluster randomization worked and did not bias the results. Nevertheless, if the reviewer feels strongly about this point, we are happy to remove the p-values and any references regarding group differences at baseline.

Line 287 3.2.1., Line 302 3.2.2, Line 314 Table 2, the time point/period of assessment to be clearly stated.

Answer: We have amended the sections 3.2.1 (pages 15 & 16, lines: 396-397 & 410-411)); 3.2.2 (page 16, 420-421), and Table 2 (page 16, line: 438) to clarify that the time point of assessment that is mentioned refers to the time at discharge.

Line 332-337 & 342-355, results to be presented/tabulated in table form.

Answer: The manuscript already includes four tables. Given that there are only a few results presented in section 3.2.1, we would like to abstain from adding another table as an additional table might make it more difficult to digest the results for the reader.

Line 334, 350, for substantial total explanatory power values, need to discuss more on the values and the reasons.

Answer: We have given more information on the values chosen and the reasons for these choices by providing the appropriate reference in the method section 2.5 (page 11, lines: 277-278).

Line 378-379, the p value for t test or correlation test to clearly separated.

Answer: We confirm that we are reporting the results of the correlation only. We improved the readability of the correlation reporting. Please find the exact wording below (page 24, lines: 503-504):

“In addition, adherence to recommendations within a month correlated significantly with immediate recall in the E group (r(81) = .29, p = .007) and the S group (r(58) = .32, p = .012).”

Line 383, for informativeness (p = .199), p value is 0.175. 0.199 is for patient affective index.

Answer: Thank you for this input. This is a mistake that we have corrected accordingly.

Line 385, p >0.124 to follow Table 4 p=0.124

Answer: We agree that the reporting of four different p-values like this can be confusing and therefore decided to now refer the reader to table 4, which is reporting the exact p-values of the PRA-D subscales (page 24, lines: 509-510).

Table 2, statistical test to be denoted in the table footnote.

Answer: We have denoted the statistical test in the table footnote, namely linear ANOVA (page 16: line: 439)

Table 3, Absolute, Relative, Range to be clearly denoted in the table footnote.

Answer: We have denoted all information necessary in the table footnote of Table 3.

Table 3 & 4, N- Miss to be clearly denoted in the table footnote or replaced with the word ‘missing’.

Answer: We have clearly denoted this information in the footnotes of Tables 3 & 4.

Effect size could be provided where applicable.

Answer: Effect sizes are reported for key results. If the reviewer is referring to specific additional results, we are happy to provide the effect sizes there as well.

A section to be provided to describe the missing data at overall and various time period i.e percentages etc.

Answer: Section “3.1.2 Patients” provides this information, please find the wording below (page 14, 381-386).

“In total, 1,915 patients were screened for eligibility (Figure 2). Of those, 1650 (80.0%) were not included because they did not meet inclusion criteria. A total of 265 patients were included in the study: 146 and 119 were treated by physicians of the E and S group, respectively. 196 (74.0%) patients completed the post-discharge assessment (111 in the E and 85 in the S group). Dropout rate from inclusion to post-discharge assessment was 26.0% (24.0% in the E and 28.6% in the S group).”

For the list of references, journal name and style to follow journal format.

Answer: Thank you for this input. We are now using “Vancouver” style for our references as recommended in the guidelines of PLOS ONE. 

Reviewer #3

This is an interesting study that tested the effectiveness of the structured discharge information presentation training relative to empathy training. The study was well conducted and the paper well written. The findings should be of interest to researchers and clinicians who are interested in intervention aimed to improve clinician-patient communication.

I have a few observations and minor suggestions for revisions.

1. There is no reason to think INFARcT training would be superior to empathy training on any outcomes other than recall and structure of information giving. The fact that information structure was superior to empathy was largely because the coding scheme was based on the INFARcT training itself. This is less about quality of information giving and more about fidelity of the intervention. I think this should be acknowledged in the discussion.

Answer: Thank you for this input. Indeed, the main point is about fidelity of the intervention. We have therefore amended the discussion accordingly. Please find the updated wording below (page 26, lines 542-546).

“Our manipulation check revealed that empathic communication skills were shown similarly in both training groups. Thus, our study evaluated the additional effect of focusing on structuring skills as a complement to communicating in an empathic way. This ensured that the comparison group was not obviously inferior to the explicit structure intervention.”

2. While there were differences in self reported adherence and recommending the physician, there is not theoretical reason provided for why this should be the case. While the study did not test a theoretical explanation, the authors should offer at least some speculation because I feel it inadequate to draw any conclusions on adherence (even if self-reported) and physician recommendation simply based on the assumption 'it must have been INFARcT training.'

Answer: This is an important point. There are some theoretical considerations that deal with the human need ‘to make sense of their life’. Some of them center around the term ‘coherent narrative’. Apparently, human beings want to identify a certain structure within a seemingly chaotic situation to have the impression of predictability. We did not include these more general concepts in the paper because we felt it would go beyond the research scope. However, there are some empirical findings by Robinson and colleagues (2012) (doi: 10.1016/j.pain.2011.02.010), Enzer and colleagues (2003) (doi: 10.1093/intqhc/mzg056) and a good review article that describe that patients, contrary to health care professionals, highly appreciate explicit structure, the elements of which have been described in detail by Gobat and colleagues (2015) (doi: 10.1016/j.pec.2015.03.024).

3. I would argue that the rationale for comparing INFARcT to empathy training is that empathy is considered the gold standard for effective communication is not convincing. Empathy is important, but quality of information exchange, perhaps shared decision-making (though less relevant in ED) are just as important. Thus, a better rationale needs to be provided (perhaps authors were interested in comparing an information intervention to a relationship-focused one). Or argue empathy as a control condition because it does not focus on information per se.

Answer: Many thanks for this suggestion. We tried to design a study with a control group that receives as much communication skills training as the information structuring group. Therefore, no formal training of residents in the control group was not an option for the study team. We agree that the role of empathy has been a matter of debate (Hoffstädt and colleagues (2020), doi: 10.1089/pmr.2020.0052; MacNaughton (2009), doi: 10.1016/S0140-6736(09)61055-2) and that labeling empathy training as the “gold standard” might lead to confusion. We therefore omitted this wording in the manuscript (i.e. in the introduction and discussion). We now provide our reasoning for choosing empathy, defined as the doctor’s ability to respond to emotions as a credible control group that does not focus on the provision of information per se (page 4, lines: 109-110):

“As a control group, some clusters of physicians were trained using empathy skills, ensuring a credible control group that does not focus on conveying information per se.”

4. I think the physician-patient relationship outcome is mislabeled. The PRA assesses patient perceptions of the quality of communication--physician informative, caring, and patient feels comfortable communicating. I suggest label it perceived quality of communication or perceived quality of relationship (i.e., needs 'quality' in the label).

Answer: You are correct. Therefore, we have therefore renamed the category to “perceived quality of relationship between patient and physician” (page 9, lines: 217-218).

5. In discussion, I think authors could say that the non information outcomes were acheived equally (for the most part) between the empathy and the information intervention, meaning patients value the quality of their information from providers as well as the quality of their relationships with providers.

Answer: This is an interesting aspect. We have added a sentence to the discussion about the “non information outcomes” that were achieved equally between the empathy and the information intervention. Please find the sentence below (page 27, lines: 570-573).

“Overall, our results show that the non-information outcomes were achieved equally well between the empathy and the information intervention, meaning patients value the quality of their information from healthcare providers as well as the quality of their relationships with providers.”

Thank you again for your valuable input. We believe that the manuscript has significantly improved by your thoughts and considerations.

Kind regards,

Dr. Victoria Siegrist & Prof. Dr. Roland Bingisser, representing all authors of the manuscript

Attachment

Submitted filename: Response to editor_final.docx

Decision Letter 1

Alessandra Solari

17 Jun 2021

PONE-D-20-21645R1

Does Information Structuring Improve Recall of Discharge Information? A Cluster Randomized Clinical Trial

PLOS ONE

Dear Dr. Siegrist,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the point raised by Reviewer #2.

Please submit your revised manuscript by July 5th. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Alessandra Solari, M.D.

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

Reviewer #3: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: (No Response)

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: (No Response)

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for addressing my concerns in this revision. I continue to feel that this is an important contribution. This time through I focused more on the fact that while the training helped with immediate recall, that effect faded over time. This suggests to me that you may want to more directly suggest some follow up structured action to ensure that there is appropriate follow up for ED patients.

Reviewer #2: The authors have put in great effort to address the comments.

Minor comments

Line 246, 346, the term linear ANOVA to be rephrased to reflect actual test name.

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Eric Mark Eisenberg

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Oct 18;16(10):e0257656. doi: 10.1371/journal.pone.0257656.r004

Author response to Decision Letter 1


4 Jul 2021

Reviewer #1:

Thank you for addressing my concerns in this revision. I continue to feel that this is an important contribution. This time through I focused more on the fact that while the training helped with immediate recall, that effect faded over time. This suggests to me that you may want to more directly suggest some follow up structured action to ensure that there is appropriate follow up for ED patients.

Answer: Thank you for your valuable input. We are convinced that the revised version has improved due to your feedback. We have now added a few sentences in the limitations section of the discussion suggesting some follow up structured action to ensure that there is appropriate follow up for ED patients (lines: 507-510):

“Seventh, though training helped with immediate recall, the waning effect remains to be a concern. We therefore suggest a second structured information as a follow-up to boost recall and support patient adherence. Effects of such an additional structured intervention, however, should be studied in the future.”

Reviewer #2:

The authors have put in great effort to address the comments.

Minor comments

Line 246, 346, the term linear ANOVA to be rephrased to reflect actual test name.

Answer: The term in lines 246 and 346 reflects the actual test name. Please note that Table 2 describes the differences in discharge communication by physicians. We chose linear ANOVA for group comparison as described in the methods section (lines: 245-246). Linear-mixed effects model analyses were used for the primary outcome in patients so that we could control for random factors such as cluster (lines: 249 – 257). Now all table footnotes include the name of the statistical test that was performed to ensure clarity.

With this rebuttal letter and the marked-up copy of our manuscript, we hope to answer all questions raised and would like to thank all reviewers and the editor once more for their valuable input.

Kind regards,

Dr. Victoria Siegrist & Prof. Dr. Roland Bingisser, representing all authors of the manuscript

Attachment

Submitted filename: Rebuttal letter.docx

Decision Letter 2

Alessandra Solari

8 Sep 2021

Does Information Structuring Improve Recall of Discharge Information? A Cluster Randomized Clinical Trial

PONE-D-20-21645R2

Dear Dr. Siegrist :

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Alessandra Solari, M.D.

Academic Editor

PLOS ONE

Acceptance letter

Alessandra Solari

7 Oct 2021

PONE-D-20-21645R2

Does Information Structuring Improve Recall of Discharge Information? A Cluster Randomized Clinical Trial

Dear Dr. Siegrist:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Alessandra Solari

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Checklist

    (DOC)

    S1 File. Content of the communication training.

    (DOCX)

    S1 Protocol

    (DOCX)

    S1 Table. Coding scheme.

    (DOCX)

    S1 Fig. Visual representation of the raw data.

    (DOCX)

    S2 Fig. Visual representation of the raw data from discharge to 30 days follow-up assessment.

    (DOCX)

    Attachment

    Submitted filename: Response to editor_final.docx

    Attachment

    Submitted filename: Rebuttal letter.docx

    Data Availability Statement

    Anonymized data are available on OSF under the following link: https://osf.io/84q3r/.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES