Skip to main content
Journal of Medical Internet Research logoLink to Journal of Medical Internet Research
. 2015 Jun 24;17(6):e158. doi: 10.2196/jmir.4379

Comparing Patients’ Opinions on the Hospital Discharge Process Collected With a Self-Reported Questionnaire Completed Via the Internet or Through a Telephone Survey: An Ancillary Study of the SENTIPAT Randomized Controlled Trial

Berengere Couturier 1,2,3,, Fabrice Carrat 1,2,3, Gilles Hejblum 2,3; SENTIPAT Study Group1
Editor: Gunther Eysenbach
Reviewed by: Kirsten Engel
PMCID: PMC4526961  PMID: 26109261

Abstract

Background

Hospital discharge, a critical stage in the hospital-to-home transition of patient care, is a complex process with potential dysfunctions having an impact on patients’ health on their return home. No study has yet reported the feasibility and usefulness of an information system that would directly collect and transmit, via the Internet, volunteer patients’ opinions on their satisfaction concerning the organization of hospital discharge.

Objective

Our primary objective was to compare patients’ opinions on the discharge process collected with 2 different methods: self-questionnaire completed on a dedicated website versus a telephone interview. The secondary goal was to estimate patient satisfaction.

Methods

We created a questionnaire to examine hospital discharge according to 3 dimensions: discharge logistics organization, preplanned posthospital continuity-of-care organization, and patients’ impressions at the time of discharge. A satisfaction score (between 0 and 1) for each of those dimensions and an associated total score were calculated. Taking advantage of the randomized SENTIPAT trial that questioned patients recruited at hospital discharge about the evolution of their health after returning home and randomly assigned them to complete a self-questionnaire directly online or during a telephone interview, we conducted an ancillary study comparing satisfaction with the organization of hospital discharge for these 2 patient groups. The questionnaire was proposed to 1141 patients included in the trial who were hospitalized for ≥2 days, among whom 867 eligible patients had access to the Internet at home and were randomized to the Internet or telephone group.

Results

Of the 1141 patients included, 755 (66.17%) completed the questionnaire. The response rates for the Internet (39.1%, 168/430) and telephone groups (87.2%, 381/437) differed significantly (P<.001), but their total satisfaction scores did not (P=.08) nor did the satisfaction subscores (P=.58 for discharge logistics organization, P=.12 for preplanned posthospital continuity-of-care organization, and P=.35 for patients’ impressions at the time of discharge). The total satisfaction score (median 0.83, IQR 0.72-0.92) indicated the patients’ high satisfaction.

Conclusions

The direct transmission of personal health data via the Internet requires patients’ active participation and those planning surveys in the domain explored in this study should anticipate a lower response rate than that issued from a similar survey conducted by telephone interviews. Nevertheless, collecting patients’ opinions on their hospital discharge via the Internet proved operational; study results indicate that conducting such surveys via the Internet yields similar estimates to those obtained via a telephone survey. The results support the establishment of a permanent dedicated website that could also be used to obtain users’ opinions on other aspects of their hospital stay and follow-up.

Trial Registration

Clinicaltrials.gov NCT01769261; http://clinicaltrials.gov/ct2/show/NCT01769261 (Archived by WebCite at http://www.webcitation.org/6ZDF5bdQb).

Keywords: hospital information systems, patient-centered care, patient discharge, patient satisfaction, quality of health care

Introduction

Hospital discharge constitutes a pivotal step in a hospitalized patient’s management between the hospital and the return home. Discharge organization conditions the subsequent continuity of care, at least in part. Hospital discharge is a complex process that requires the participation of different actors (including the patient and his/her entourage) and the use of some documents and tools (eg, checklist and discharge package/brochure, patient records, discharge summaries, nursing discharge notes, medical prescriptions). The complexity of the process can explain the occurrence of organizational dysfunctions during its course that could potentially affect the health of individuals far after the hospitalization [1].

The opinion of health professionals on how discharge is organized has been the topic of several studies [2-6] and some of those studies also obtained patients’ opinions [3-6]. Hence, the patient has become a major player and a key partner at the center of the health care system [7]. Collecting his/her opinions on the organization of care seemed to be a relevant way to evaluate the quality of the process, for example, to ascertain its perceived quality as experienced by the patient [8,9]. Some studies evaluated the quality of the hospital discharge process based on patients’ opinions [10-15]. These studies involved various specific tools, administered at different times in regards to the hospital discharge moment, and based on various modes of administration: telephone, face-to-face interview, or self-administered paper questionnaires. None of those investigations sought the participation of patients via the Internet, even though its use by patients has increased markedly [16].

In this context, we undertook a study aimed at estimating the contribution of a system based on the direct transmission via a dedicated website of volunteer patients’ self-reported experiences on their own hospital discharge process. In particular, we wanted to explore the feasibility of such an information collection method by examining patients’ response rates and determining whether the information collected via the Internet was of similar quality as that obtained during a telephone interview, which is more difficult to conduct and more expensive to put in place.

First, we created a questionnaire concerning the hospital discharge process according to 3 dimensions: discharge logistics organization, preplanned posthospital continuity-of-care organization, and the patients’ impressions during discharge. Then, we collected patients’ responses to the questionnaire according to 2 different methods requiring the patient’s more- or less-active participation in reporting his/her opinions: patient’s direct transmission of information on a dedicated website or a classical telephone interview. We took advantage of the multicenter, randomized SENTIPAT trial (described in Methods) that had already randomized patients at discharge with Internet access at home to transmit personal information via the Internet or by telephone and a third group without Internet at home who were included to determine the representativeness of the randomized sample. For our ancillary study focused on the organization of hospital discharge, the primary objective was to compare the satisfaction of internet and telephone groups, hypothesizing no significant difference according to the data-collection method. The secondary goal was to analyze patients’ opinions on the different components of discharge process.

Methods

Overview

This investigation was conceived as an ancillary study of the multicenter, randomized SENTIPAT trial [17]. We took advantage of the trial to examine patients’ opinions on the organization of their hospital discharge. SENTIPAT participants were also asked to describe their experience with this process.

General Description of the SENTIPAT Trial

This multicenter (5 adult acute care units in a Parisian teaching hospital participated voluntarily: digestive and general surgery, gastroenterology, hepatology, infectious diseases, and internal medicine), randomized trial focused on the evolution of patients’ health on returning home posthospitalization (follow-up duration: 6 weeks). The principal objective was to determine whether the information directly transmitted by the volunteer patients via a dedicated website was comparable with that obtained during a telephone interview. It was a noninferiority trial (the main judgment criterion was the percentage of patients reporting at least one clinically significant adverse event occurring during the 42 days after hospital discharge).

Consecutive patients with Internet access at home were eligible for inclusion. They were enrolled the day of hospital discharge and randomized into 2 groups (stratified by department): Internet or telephone follow-up. Patients not eligible (ie, with the same characteristics as those randomized but without Internet access at home) were also included at a ratio of 1:4 of noneligible to eligible patients.

Lastly, 2550 patients (510 from each unit) were initially planned. Between February 25, 2013 and September 8, 2014, we enrolled 2090 patients who were not cognitively impaired and did not have a behavioral disorder, who spoke and wrote French, and were returning home after an acute care hospitalization, regardless of the type of stay—standard hospitalization (scheduled or not) on weekdays only (maximum Monday to Friday or any combination thereof) or outpatient hospitalization (1 day)—and not opposed to participating in the trial.

Characteristics of the Ancillary Study Focusing on the Discharge Process

Patients

This study concerned the 1141 patients included whose hospitalization lasted 2 or more days. The results of patients whose hospitalization lasted only 1 day (n=949) are reported in Multimedia Appendix 1; the organization of the discharge process after these very short stays was logically analyzed independently of those of longer duration.

Questionnaire Structure

Several tools have been developed to collect patients’ opinions on their hospital-to-home transition, including The Care Transition Measure [11], The Patient Continuity of Care Questionnaire [13], the Brief PREPARED instrument [12], or the Readiness for Hospital Discharge Scale [15]. None of these explore the 3 hospital discharge-related dimensions of interest to us. Therefore, we constructed a specific questionnaire, based on French national recommendations [18-20], and an international literature review (BC, FC, and GH, unpublished data, 2015).

The questionnaire explored 3 hospital discharge dimensions (henceforth referred to as 3 items) addressed in 17 questions (Table 1): discharge logistics organization (Q1, Q2, Q3, Q4, Q5, and Q11C-E), henceforth referred to as item 1; preplanned posthospital continuity-of-care organization (Q6, Q7, Q8, Q9, and Q10), henceforth referred to as item 2; and the patients’ impressions during discharge (Q11A, B, F, and G), henceforth referred to as item 3. Several questions (Q1, Q6 and Q8) specifically attempt to document specific aspects of the hospital-discharge process; the corresponding responses and a general discussion of the questionnaire are given in Multimedia Appendix 2.

Table 1.

Discharge questionnaire and satisfaction scoring.

Item and question Response choices Score
Discharge logistics organization


Q1. Who decided when you would be discharged from the hospital?a Staff physician of the unit in which you were hospitalized


Yourself


Your entourage


Your primary care physician


Other

Q2. Were you informed by a doctor or nurse of the modalities of your discharge (date, time, transportation: taxi, ambulance...)? Yes 1


No 0

Q3. Were you consulted for the choice of discharge date and time? Yes 1


No 0

Q4. Were the discharge date and time compatible with your return home and/or your entourage? Yes 1


No 0

Q5. Was the scheduled discharge time respected? Yes 1


No 0

Q11C. At discharge, what did you think of the time needed to obtain your medical and administrative documents? Reasonable 1


Too long 0

Q11D. At discharge, what did you think of the time needed for your transportation to arrive? Reasonable 1


Too long 0


Not concerned NA

Q11E. At discharge, did you have any difficulties dealing with the administrative discharge formalities? Yes 0


No 1


Not concerned NA
Preplanned posthospital continuity-of-care organization

Q6. At discharge, what documents were you given concerning your subsequent care? Check all that applya Prescription(s)


Discharge summary


Letter for primary care physician


Nursing discharge notes


Information booklet(s)


Appointment for a next hospitalization


Appointment for your next consultation


Appointment for your complementary test(s)


Other, specify


None

Q7. What did you think about the information provided by the medical or nursing staff when you received those discharge documents? Highly satisfied 1


Satisfied 0.75


Poorly satisfied 0.25


Not at all satisfied 0


No information given 0


Not concerned NA

Q8. Did you meet with a social worker during your hospitalization to discuss the organization of your return home?a Yes


No

Q9. Was your primary care physician informed of your hospitalization? Yes 1


No 0


I don’t know 0


I don’t have a primary care physician NA

Q10. Did you have the phone number of the unit in which you were hospitalized (should you need it)? Yes 1


No 0
Patient’s impressions of the hospital discharge process

Q11A. At discharge, what did you think about its organization? Well planned 1


A sense of haste, upheaval 0

Q11B. At discharge, what did you think about returning home? Relieved 1


Anxious 0

Q11F. At discharge, what did you think about the information provided? Sufficient 1


Insufficient 0

Q11G. At discharge, what did you think about the health care team’s availability and listening to you? Sufficient 1


Insufficient 0

a Question intended to document the situation but not to be a score component.

Questionnaire Administration

For the telephone and noneligible patients, the hospital discharge questionnaire was administrated during a telephone interview with a clinical research technician 7 days after discharge (the appointment was scheduled the day of discharge), with a maximum of 3 attempts to contact them. For the Internet group, the same questionnaire was available on the dedicated website on the day of discharge (D0) and was completed directly online by the patient, who had been given oral and written instructions (information sheet) to connect for the first time 7 days postdischarge. “Reminders” were sent once weekly for 6 weeks after discharge to potential responders (of the Internet group) who had not completed the discharge questionnaire yet.

Statistical Analyses

A patient satisfaction score concerning the hospital discharge process was calculated for each of the 3 items (see scores accorded in Table 1). Each subscore was calculated with a normalized sum of all the item questions (range 0-1), each question within a given item having the same weight, and the total score was computed (mean of the 3 subscores, range 0-1). Questions not concerning the patient (eg, Q11D did not concern patients who used public transportation) were not included in the calculations.

The global distribution of the responses for each discharge questionnaire question was assessed. Between-group qualitative variable (eg, sex) differences were compared with Fisher’s exact test and quantitative variables (eg, scores, age, hospitalization duration, and level of education that was considered as a 4-level ordinal variable) were compared with either the Mann-Whitney-Wilcoxon test or, for matched-paired data, Wilcoxon’s signed rank test. A P value ≤.05 defined significance of usual comparisons. However, the significance threshold was lower when a Bonferroni correction was applied for multiple comparisons, as indicated where appropriate. Missing data were taken into account as follows: nonresponding patients and incomplete questionnaires were excluded from the analyses. Also, for questions not concerning the patient, the response “nonapplicable” was used and they were not included in the analyses. All statistical computations used the R program.

Results

Patient Characteristics and Response Rates

A total of 755 (66.17%) completed discharge questionnaires were collected from the 1141 patients included after a hospital stay of 2 or more days (Figure 1). The relative contribution of each unit ranged from 13.41% (153/1141) to 35.58% (406/1141) and their response rates did not significantly differ from one unit to another (P=.08) and ranged from 60.3% (132/219) to 70.0% (284/406). Patients’ median age was 55 (IQR 39-66) years and 591 of 1141 (51.80%) were women. Hospitalization lasted a median 6 (IQR 3-10) days (median 7, IQR 4-11 and median 3, IQR 2-3 days for standard and weekday-only hospitalizations, respectively) (Table 2). Responders were significantly older than nonresponders (P<.001) for comparable sex distributions, level of education, and hospitalization durations. Internet, telephone, and noneligible group patients completed the questionnaire within median 6 (IQR 3-16), median 7 (IQR 7-9), and median 7 (IQR 7-8) days postdischarge, respectively, with respective Internet and telephone response rates of 39.1% (168/430) and 87.2% (381/437, P<.001). Noneligible patients were significantly older than telephone patients were (P<.001) and their response rate was significantly lower (75.2%, 206/274 vs 87.2%, 381/437, P<.001).

Figure 1.

Figure 1

Flowchart of patients with a hospital stay of ≥2 days included in the SENTIPAT trial who responded or not to the discharge questionnaire according to the type of hospitalization and the recruitment unit. IQ: incomplete questionnaires; surgery: general and digestive surgery; infectious: infectious and tropical diseases.

Table 2.

Characteristics of patients with a hospital stay of 2 or more days.

Characteristic Total Responders Nonresponders P
Group, n (%)




All 1141 755 (66.17) 386 (33.83)

Internet 430 168 (39.1) 262 (60.9) <.001a

Telephone 437 381 (87.2) 56 (12.8)

Noneligible 274 206 (75.2) 68 (24.8) <.001b
Sex (male/female), n




All 550/591 365/390 185/201 .90

Internet 204/226 79/89 125/137

Telephone 228/209 198/183 30/26

Noneligible 118/156 88/118 30/38
Age (years), median (IQR)




All 55 (39-66) 56 (41-67) 51 (34-64) <.001

Internet 51 (36-63) 55 (38-63) 48 (34-62)

Telephone 52 (34-64) 52 (36-64) 47 (30-66)

Noneligible 65 (52-74) 66 (55-75) 62 (49-72)
Length of hospital stay (days), median (IQR)




All 6 (3-10) 6 (3-10) 6 (3-9) .92

Internet 6 (3-9) 5.5 (3-9) 6 (3-9)

Telephone 6 (3-10) 6 (3-10) 8 (3-10)

Noneligible 7 (3-11) 7 (3-12) 7 (3-9)
Level of education, c n (%)




All


.95


Level 1 223 (19.54) 152 (20.1) 71 (18.4)


Level 2 365 (31.99) 233 (30.9) 132 (34.2)


Level 3 150 (13.15) 103 (13.6) 47 (12.2)


Level 4 401 (35.14) 267 (35.4) 134 (34.7)


Do not wish to answer 2 (0.18) 0 (0.0) 2 (0.5)

Internet





Level 1 48 (11.2) 17 (10.1) 31 (11.8)


Level 2 138 (32.1) 51 (30.4) 87 (33.2)


Level 3 61 (14.2) 25 (14.9) 36 (13.7)


Level 4 182 (42.3) 75 (44.6) 107 (40.8)


Do not wish to answer 1 (0.2) 0 (0.0) 1 (0.4)

Telephone





Level 1 47 (10.8) 38 (10.0) 9 (16)


Level 2 139 (31.8) 121 (31.8) 18 (32)


Level 3 68 (15.6) 62 (16.3) 6 (11)


Level 4 182 (41.6) 160 (42.0) 22 (39)


Do not wish to answer 1 (0.2) 0 (0.0) 1 (2)

Noneligible





Level 1 128 (46.7) 97 (47.1) 31 (46)


Level 2 88 (32.1) 61 (29.6) 27 (40)


Level 3 21 (7.7) 16 (7.8) 5 (7)


Level 4 37 (13.5) 32 (15.5) 5 (7)


Do not wish to answer 0 (0.0) 0 (0.0) 0 (0)

a Internet vs telephone.

b Noneligible vs telephone.

c The levels of education were coded as follows: level 1, at most junior high school; level 2, high school; level 3, college; level 4, bachelor’s degree or above.

Comparisons of Internet and Telephone Groups’ Satisfaction Scores

Box plot comparisons between the Internet and telephone groups for each of the 3 items or their total scores (Figure 2) revealed no important differences as confirmed by the corresponding statistical comparison results; all were associated with nonsignificant P values (Table 3). Moreover, the telephone and noneligible groups did not differ significantly for the total score or its 3 subscores.

Figure 2.

Figure 2

Box plots of score distributions according to Internet (I), telephone (T), or noneligible (NE) group. Item 1: discharge logistics organization; item 2: preplanned posthospital continuity-of-care organization; item 3: patient’s impressions of the hospital discharge process. The bold horizontal line is the median, the bottom and top borders of the boxes are 25th and 75th percentiles, respectively; the T-bar below and above the boxes represent 2.5th and 97.5th percentiles, respectively; the small white circles are outliers of the latter limits.

Table 3.

Distribution of satisfaction scores (percentiles) of the 755 responders with a hospital stay of 2 or more days according to group.

Score Percentile P a

5% 10% 25% 50% 75% 90% 95%
Total








All 0.47 0.56 0.72 0.83 0.92 0.97 0.97

Internet 0.46 0.51 0.67 0.81 0.89 0.97 0.97 .08b

Telephone 0.48 0.56 0.72 0.83 0.92 0.97 1

Noneligible 0.50 0.61 0.73 0.86 0.94 0.97 0.97 .03c
Discharge logistics organization








All 0.50 0.57 0.80 0.86 1 1 1

Internet 0.45 0.57 0.71 0.85 1 1 1 .58b

Telephone 0.50 0.57 0.71 0.86 1 1 1

Noneligible 0.50 0.60 0.83 0.86 1 1 1 .06c
Preplanned posthospital continuity-of-care organization




All 0.33 0.33 0.58 0.67 0.92 1 1

Internet 0.25 0.33 0.58 0.67 0.92 1 1 .12b

Telephone 0.33 0.33 0.58 0.67 0.92 1 1

Noneligible 0.33 0.33 0.58 0.67 0.92 1 1 .45c
Patient’s impressions of the hospital discharge process




All 0.25 0.50 0.75 1 1 1 1

Internet 0.25 0.43 0.75 1 1 1 1 .35b

Telephone 0.25 0.50 0.75 1 1 1 1

Noneligible 0.50 0.50 0.75 1 1 1 1 .09c

a Mann-Whitney-Wilcoxon tests with the corresponding Bonferroni correction for 2 comparisons: the telephone group was compared with the Internet and noneligible groups; all comparisons yielded nonsignificant P values.

b Internet vs telephone.

c Noneligible vs telephone.

Satisfaction Scores for All Responders

Overview

The total satisfaction score was median 0.83 (IQR 0.72-0.92), with respective items 1-3 subscores of median 0.86 (IQR 0.8-1), median 0.67 (IQR 0.58-0.92), and median 1 (IQR 0.75-1). The box plots (Figure 2) for the entire population of responders differed in shape from one item to another. The Wilcoxon signed rank test confirmed that item 2 was significantly less well-rated than item 1 (P<.001), which was less well-rated than item 3 (P<.001) (Figure 2). The main characteristics associated with each of the 3 items are presented subsequently.

Item 1: Discharge Logistics Organization

Figure A3-1 in Multimedia Appendix 3 shows that 87.9% (664/755) of patients were informed of the modalities (eg, date and time, transportation) of their discharge; 53.1% (401/755) declared not having been consulted for the discharge date and time, and 92.6% (699/755) considered that those choices did not pose a problem. For 90.7% (685/755), the time was respected, 91.7% (676/737 excluding 18/755 patients not concerned) deemed the waiting time for medical and administrative discharge documents satisfactory, and 90.3% (650/720 excluding 35/755 patients not concerned) did not encounter difficulties completing administrative discharge procedures.

Item 2: Preplanned Posthospital Continuity-of-Care Organization

The explanations provided by the medical and/or nursing staff to accompany the document delivered at discharge (36/755 patients not concerned) were considered poorly satisfactory or totally unsatisfactory for 11.1% (80/719) and 16.0% (115/719) declared having received no explanations (Figure A3-2, Multimedia Appendix 3). According to 23.4% (177/755) of patients, their primary care physicians were not informed of their hospitalizations and 16.6% (125/755) did not know if they had been informed or not. In addition, 89.4% (675/755) had the telephone numbers of the unit in which they were hospitalized, if needed.

Item 3: Patients’ Impressions During the Discharge Process

Figure A3-3 (see Multimedia Appendix 3) describes patients’ impressions of the discharge process. Notably, 85.0% (642/755) thought that their discharge had been well planned. Those with the opposing opinion were significantly younger (P<.001). In addition, patients anxious about their return home (13.8%, 104/755) were significantly younger than those relieved at the idea of going home (P<.001). Moreover, 20.3% (153/755) of the patients thought they lacked information at discharge. Finally, 9.5% (72/755) of the patients judged hospital caregivers insufficiently available and that they listened insufficiently to the patient.

Discussion

Main Results and Comparison With Previous Findings

This study was designed to investigate patients’ opinions of the hospital discharge process with a questionnaire administered either by self-reporting directly online or by a traditional telephone interview. Response rates to our questionnaire showed that patients are willing to assume an active partnership role—87.2% for the telephone group (with Internet access at home) and 75.2% for noneligible patients (without Internet access at home)—values close to the average response rate for 13 studies that included a telephone inquiry to obtain patients’ impressions of hospital care delivered (ie, mean 70%, range 24%-91%) [21]. However, such interviews are more cumbersome and expensive to organize (eg, interviewer, scheduling of calls) and implement as routine practice over the long term. Responders were significantly older than nonresponders, with a similar observed pattern in the Internet and the telephone groups, and this might reflect individuals’ greater availability or interest in health care questions, which increases globally with age.

Given the rising availability and utilization of the Internet in all populations, this easy, low-cost approach as a means of collecting patients’ opinions might be an attractive alternative to telephone calls. In our study, the Internet patients’ response rate was lower (39.1%, 168/430) than the telephone patients’ response rate (87.2%, 381/437). In many respects, it is not surprising. For example, ignoring an invitation to actively enter personal data on a website is much easier than ignoring a live person who reaches another by phone. Nevertheless, the 39% response rate observed in our study exceeded that usually reached with Internet surveys, according to a meta-analysis of 39 studies (median 27%, range 14.5%-51%) [22]. Nonetheless, the information reported by online patients did not differ significantly from those collected by phone. Obtaining patients’ opinions on the discharge process is in-line with current initiatives to achieve a patient-centered health care system [23-25]. Our observations suggest that long-term implementation of an information system, similar to that developed for this study, would enable patients to directly transmit their hospital discharge experiences. The scores observed for the 3 dimensions of the discharge process explored herein indicate an overall positive patient perception: discharge logistics organization (median 0.86, IQR 0.8-1), preplanned posthospital continuity-of-care organization (median 0.67, IQR 0.58-0.92), and patients’ impressions of the process (median 1, IQR 0.75-1). Discharge logistics organization, in particular, was judged globally satisfactory even though approximately half of patients were not involved in the scheduling of their discharge date and time.

Pertinently, our results also identify several difficulties, notably hospital transmission of information to primary care physicians and the patient, and thereby also indicate how to potentially improve performance. Only 20.3% (153/755) of patients declared having left the hospital with a discharge summary and/or letter for their primary care physician. These observations agree with those previously reported by authors investigating discharge summary availability at the time of discharge for health care professionals responsible for posthospitalization continuity of care [26-33]. For example, in their review, Kripalani et al [28] indicated that only a median 14.5% (range 9%-20%) and median 52% (range 51%-77%) of primary care physicians had received discharge summaries 1 and 4 weeks after discharge, respectively.

In addition, more than a quarter of patients deemed the medical and/or nursing explanations of their discharge documents as poor or unsatisfactory, or had received none. Moreover, one-fifth of patients reported a lack of information at discharge. This absence of information and/or delivery of information not corresponding to patient expectations was also noted previously [13,27,34,35]. Other than the strict enumeration of the hospital discharge instructions provided to the patient by health professionals at discharge, the patient’s understanding of them is not always optimal [36,37], notably concerning medical treatments to be pursued [38-41], and can be underestimated by health professionals [42,43]. The findings of Horwitz et al [37] are particularly interesting because despite the demonstration of a gap between the information given to the patients and their understanding of it, the patients “were uniformly positive in their assessment of discharge care” as in our study. In a 2014 systematic revue [44] of 36 studies targeting patients’ opinions on quality of care, only 2 addressed the quality of the discharge process [45,46] and they reported globally positive impressions. However, 2 other studies [10,14] examined the association between patient satisfaction with the discharge process and the hospital readmission rate within 30 days, an important health outcome measure, and found it to be significant suggesting this impression reflects, at least in part, the quality of hospital care. Nevertheless, the associated performance differences were relatively modest, thereby suggesting that improving patient satisfaction with discharge organization would also have a minor impact on health in terms of solid outcome measures.

Limitations

Our study has several limitations. Inherent to studies requiring an active participation, responders constitute an intrinsic biased selection sample of patients. An example of a demographic status significantly associated with the responder status is age. Moreover, differences are introduced by the questionnaire administration mode (Internet vs telephone). The response rate observed in the Internet group is somewhat disappointing, but another study on patient satisfaction also reported similar response rates: 34% and 78% in the Internet and telephone groups, respectively [47]. Nevertheless, even if a similar response rate had been observed in the telephone and Internet groups, this would not exclude different selection biases from one group to the other (eg, inherent to the mode of administration). The major result of the study is that despite the biases of this study (potential or not), the estimates issued from the 2 groups are very similar; therefore, an Internet-based survey in the domain investigated should be considered as a useful alternative to a “reference” telephone survey. Nonetheless, collecting patients’ opinions via the Internet, as done in this study, has numerous advantages. First, unlike the telephone interview that inserts a third person and a potential information bias (survey subjectivity), resorting to the Internet allows self-administration of the questionnaire, triggering the patient’s active participation. Finally, this method of data collection is less costly than managing a telephone cohort and yields comparable information. However, the similar scores in the telephone and Internet mode of administration observed in this study are based on a particular newly developed questionnaire deployed in a given patient population; therefore, this limits the generalizability (external validity) of the results.

Conclusions

The results of this study advocate for establishing a permanent information system that would enable volunteering patients to express their opinions concerning hospital discharge. Such an information system could also be used for other management issues related to health care organization. Those planning to design similar surveys via the Internet should anticipate a response rate comparable to that observed in the present study. Nevertheless, the concept of sentinel patient explored in this study could constitute, in the future, an essential tool in a patient-centered approach to the organization of care.

Acknowledgments

The SENTIPAT study group Scientific Committee: Fabrice Carrat, Bérengère Couturier, Gilles Hejblum, Morgane Le Bail, Alain-Jacques Valleron, and the subsequently mentioned heads and physicians within the poles and units in which patients were recruited.

Personnel of the study group within the poles and units concerned: heads: Marc Beaussier, Jean-Paul Cabane, Olivier Chazouillères, Jacques Cosnes, Jean-Claude Dussaule, Pierre-Marie Girard, Emmanuel Tiret, and Dominique Pateron; additional corresponding physicians: Laurent Beaugerie, Laurence Fardet, Laurent Fonquernie, François Paye, and Laure Surgers; and nursing supervisors: Françoise Cuiller, Catherine Esnouf, Hélène Haure, Valérie Garnier, Josselin Mehal-Birba, Nelly Sallée, and Sylvie Wagener.

The authors are indebted to the excellent technical team of the study, including the clinical research technicians: Élodie Belladame, Azéline Chevance, Magali Girard and Laurence Nicole, who included patients, collected baseline data, and interviewed the patients followed-up by telephone; and the software staff, especially Pauline Raballand, but also Frédéric Chau and Frédéric Fotré, who created and maintained the trial’s dedicated website.

We thank all the medical and nursing and administrative staff of the General and Digestive Surgery (including Ambulatory Surgery), Gastroenterology, Hepatology, Infectious Diseases, and Internal Medicine departments of Hôpital Saint-Antoine; and we thank all patients who participated in the study.

The Assistance Publique-Hôpitaux de Paris (Département de la Recherche Clinique et du Développement) was the trial sponsor. The SENTIPAT study was funded by grant AOM09213 K081204 from Programme Hospitalier de Recherche Clinique 2009 (Ministère de la Santé). This work was supported by a grant from Assistance Publique-Hôpitaux de Paris, program “Recherche Infirmière.” The sponsor and the funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Multimedia Appendix 1

Analysis of discharge-questionnaire responses of patients with 1-day hospital stays.

Multimedia Appendix 2

Additional information about the discharge questionnaire.

jmir_v17i6e158_app2.pdf (68.5KB, pdf)
Multimedia Appendix 3

Other figures supplementing the main manuscript.

jmir_v17i6e158_app3.pdf (455.5KB, pdf)
Multimedia Appendix 4

CONSORT-EHEALTH checklist V1.6.1 [48].

jmir_v17i6e158_app4.pdf (878.6KB, pdf)

Footnotes

Authors' Contributions: Study conception and design: BC, FC, and GH; data acquisition: BC and GH; analysis and interpretation of data: BC, FC, and GH; first draft of the paper: BC and GH; all authors approved the final version of the paper.

Conflicts of Interest: None declared.

References

  • 1.Neale G, Woloshynowych M, Vincent C. Exploring the causes of adverse events in NHS hospital practice. J R Soc Med. 2001 Jul;94(7):322–330. doi: 10.1177/014107680109400702. http://europepmc.org/abstract/MED/11418700 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Graumlich JF, Grimmer-Somers K, Aldag JC. Discharge planning scale: community physicians' perspective. J Hosp Med. 2008 Dec;3(6):455–464. doi: 10.1002/jhm.371. [DOI] [PubMed] [Google Scholar]
  • 3.Graumlich JF, Novotny NL, Nace GS, Aldag JC. Patient and physician perceptions after software-assisted hospital discharge: cluster randomized trial. J Hosp Med. 2009 Jul;4(6):356–363. doi: 10.1002/jhm.565. [DOI] [PubMed] [Google Scholar]
  • 4.Grimmer K, Moss J. The development, validity and application of a new instrument to assess the quality of discharge planning activities from the community perspective. Int J Qual Health Care. 2001 Apr;13(2):109–116. doi: 10.1093/intqhc/13.2.109. http://intqhc.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=11430660 . [DOI] [PubMed] [Google Scholar]
  • 5.Weiss M, Yakusheva O, Bobay K. Nurse and patient perceptions of discharge readiness in relation to postdischarge utilization. Med Care. 2010 May;48(5):482–486. doi: 10.1097/MLR.0b013e3181d5feae. [DOI] [PubMed] [Google Scholar]
  • 6.Weiss ME, Costa LL, Yakusheva O, Bobay KL. Validation of patient and nurse short forms of the Readiness for Hospital Discharge Scale and their relationship to return to the hospital. Health Serv Res. 2014 Feb;49(1):304–317. doi: 10.1111/1475-6773.12092. http://europepmc.org/abstract/MED/23855675 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Laine C, Davidoff F. Patient-centered medicine. A professional evolution. JAMA. 1996 Jan 10;275(2):152–156. [PubMed] [Google Scholar]
  • 8.Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States. N Engl J Med. 2008 Oct 30;359(18):1921–1931. doi: 10.1056/NEJMsa0804116.359/18/1921 [DOI] [PubMed] [Google Scholar]
  • 9.Manary MP, Boulding W, Staelin R, Glickman SW. The patient experience and health outcomes. N Engl J Med. 2013 Jan 17;368(3):201–203. doi: 10.1056/NEJMp1211775. [DOI] [PubMed] [Google Scholar]
  • 10.Boulding W, Glickman SW, Manary MP, Schulman KA, Staelin R. Relationship between patient satisfaction with inpatient care and hospital readmission within 30 days. Am J Manag Care. 2011 Jan;17(1):41–48. http://www.ajmc.com/pubMed.php?pii=12805 .12805 [PubMed] [Google Scholar]
  • 11.Coleman EA, Mahoney E, Parry C. Assessing the quality of preparation for posthospital care from the patient's perspective: the care transitions measure. Med Care. 2005 Mar;43(3):246–255. doi: 10.1097/00005650-200503000-00007.00005650-200503000-00007 [DOI] [PubMed] [Google Scholar]
  • 12.Graumlich JF, Novotny NL, Aldag JC. Brief scale measuring patient preparedness for hospital discharge to home: Psychometric properties. J Hosp Med. 2008 Dec;3(6):446–454. doi: 10.1002/jhm.316. [DOI] [PubMed] [Google Scholar]
  • 13.Hadjistavropoulos H, Biem H, Sharpe D, Bourgault-Fagnou M, Janzen J. Patient perceptions of hospital discharge: reliability and validity of a Patient Continuity of Care Questionnaire. Int J Qual Health Care. 2008 Oct;20(5):314–323. doi: 10.1093/intqhc/mzn030. http://intqhc.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=18635587 .mzn030 [DOI] [PubMed] [Google Scholar]
  • 14.Jha AK, Orav EJ, Epstein AM. Public reporting of discharge planning and rates of readmissions. N Engl J Med. 2009 Dec 31;361(27):2637–2645. doi: 10.1056/NEJMsa0904859.361/27/2637 [DOI] [PubMed] [Google Scholar]
  • 15.Weiss ME, Piacentine LB. Psychometric properties of the Readiness for Hospital Discharge Scale. J Nurs Meas. 2006;14(3):163–180. doi: 10.1891/jnm-v14i3a002. [DOI] [PubMed] [Google Scholar]
  • 16.Ohno-Machado L. Focusing on the patient: mHealth, social media, electronic health records, and decision support systems. J Am Med Inform Assoc. 2014 Dec;21(6):953. doi: 10.1136/amiajnl-2014-003341.amiajnl-2014-003341 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.ClinicalTrials.gov. [2015-01-16]. Sentinel Patients: Value of an Information System Collecting Patient's Own Report on His Healthcare Management (SENTIPAT) https://clinicaltrials.gov/show/NCT01769261 .
  • 18.Agence Nationale d'Accréditation et d'Evaluation en Santé Préparation de la sortie du patient hospitalisé. 2001. [2015-01-16]. http://www.has-sante.fr/portail/upload/docs/application/pdf/2009-08/preparation_de_la_sortie_du_patient_hospitalise_guide_2001.pdf .
  • 19.Haute Autorité de Santé. Rapport de l'expérimentation nationale. Audit clinique ciblé appliqué à la préparation de la sortie du patient hospitalisé. 2006. [2015-01-16]. http://www.has-sante.fr/portail/upload/docs/application/pdf/psp_-_rapport_final.pdf .
  • 20.Haute Autorité de Santé Manuel de certification des établissements de santé V2010. 2009. [2015-01-16]. http://www.has-sante.fr/portail/upload/docs/application/pdf/2008-12/20081217_manuel_v2010_nouvelle_maquette.pdf .
  • 21.Castle NG, Brown J, Hepner KA, Hays RD. Review of the literature on survey instruments used to collect data on hospital patients' perceptions of care. Health Serv Res. 2005 Dec;40(6 Pt 2):1996–2017. doi: 10.1111/j.1475-6773.2005.00475.x. http://europepmc.org/abstract/MED/16316435 .HESR475 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Shih TH, Fan X. Comparing response rates from Web and mail Surveys: a meta-analysis. Field Methods. 2008 Mar 03;20(3):249–271. doi: 10.1177/1525822X08317085. [DOI] [Google Scholar]
  • 23.Davis K, Schoenbaum SC, Audet AM. A 2020 vision of patient-centered primary care. J Gen Intern Med. 2005 Oct;20(10):953–957. doi: 10.1111/j.1525-1497.2005.0178.x. http://europepmc.org/abstract/MED/16191145 .JGI178 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Epstein RM, Fiscella K, Lesser CS, Stange KC. Why the nation needs a policy push on patient-centered health care. Health Aff (Millwood) 2010 Aug;29(8):1489–1495. doi: 10.1377/hlthaff.2009.0888. http://content.healthaffairs.org/cgi/pmidlookup?view=long&pmid=20679652 .29/8/1489 [DOI] [PubMed] [Google Scholar]
  • 25.Stewart M. Towards a global definition of patient centred care. BMJ. 2001 Feb 24;322(7284):444–445. doi: 10.1136/bmj.322.7284.444. http://europepmc.org/abstract/MED/11222407 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Bell CM, Schnipper JL, Auerbach AD, Kaboli PJ, Wetterneck TB, Gonzales DV, Arora VM, Zhang JX, Meltzer DO. Association of communication between hospital-based physicians and primary care providers with patient outcomes. J Gen Intern Med. 2009 Mar;24(3):381–386. doi: 10.1007/s11606-008-0882-8. http://europepmc.org/abstract/MED/19101774 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Kripalani S, Jackson AT, Schnipper JL, Coleman EA. Promoting effective transitions of care at hospital discharge: a review of key issues for hospitalists. J Hosp Med. 2007 Sep;2(5):314–323. doi: 10.1002/jhm.228. [DOI] [PubMed] [Google Scholar]
  • 28.Kripalani S, LeFevre F, Phillips CO, Williams MV, Basaviah P, Baker DW. Deficits in communication and information transfer between hospital-based and primary care physicians: implications for patient safety and continuity of care. JAMA. 2007 Feb 28;297(8):831–841. doi: 10.1001/jama.297.8.831.297/8/831 [DOI] [PubMed] [Google Scholar]
  • 29.Li JY, Yong TY, Hakendorf P, Ben-Tovim D, Thompson CH. Timeliness in discharge summary dissemination is associated with patients' clinical outcomes. J Eval Clin Pract. 2013 Feb;19(1):76–79. doi: 10.1111/j.1365-2753.2011.01772.x. [DOI] [PubMed] [Google Scholar]
  • 30.van Walraven C, Seth R, Austin PC, Laupacis A. Effect of discharge summary availability during post-discharge visits on hospital readmission. J Gen Intern Med. 2002 Mar;17(3):186–192. doi: 10.1046/j.1525-1497.2002.10741.x. http://europepmc.org/abstract/MED/11929504 .jgi10741 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.van Walraven C, Seth R, Laupacis A. Dissemination of discharge summaries: not reaching follow-up physicians. Can Fam Physician. 2002 Apr;48:737–742. http://www.cfp.ca/cgi/pmidlookup?view=long&pmid=12046369 . [PMC free article] [PubMed] [Google Scholar]
  • 32.van Walraven C, Taljaard M, Bell CM, Etchells E, Stiell IG, Zarnke K, Forster AJ. A prospective cohort study found that provider and information continuity was low after patient discharge from hospital. J Clin Epidemiol. 2010 Sep;63(9):1000–1010. doi: 10.1016/j.jclinepi.2010.01.023.S0895-4356(10)00146-0 [DOI] [PubMed] [Google Scholar]
  • 33.van Walraven C, Taljaard M, Etchells E, Bell CM, Stiell IG, Zarnke K, Forster AJ. The independent association of provider and information continuity on outcomes after hospital discharge: implications for hospitalists. J Hosp Med. 2010 Sep;5(7):398–405. doi: 10.1002/jhm.716. [DOI] [PubMed] [Google Scholar]
  • 34.Charles C, Gauld M, Chambers L, O'Brien B, Haynes RB, Labelle R. How was your hospital stay? Patients' reports about their care in Canadian hospitals. CMAJ. 1994 Jun 1;150(11):1813–1822. http://www.cmaj.ca/cgi/pmidlookup?view=reprint&pmid=8199958 . [PMC free article] [PubMed] [Google Scholar]
  • 35.Soler RS, Canal DJ, Noguer CB, Poch CG, Motge NB, Gil MDG. Continuity of care and monitoring pain after discharge: patient perspective. J Adv Nurs. 2010 Jan;66(1):40–48. doi: 10.1111/j.1365-2648.2009.05136.x.JAN5136 [DOI] [PubMed] [Google Scholar]
  • 36.Albrecht JS, Gruber-Baldini AL, Hirshon JM, Brown CH, Goldberg R, Rosenberg JH, Comer AC, Furuno JP. Hospital discharge instructions: comprehension and compliance among older adults. J Gen Intern Med. 2014 Nov;29(11):1491–1498. doi: 10.1007/s11606-014-2956-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Horwitz LI, Moriarty JP, Chen C, Fogerty RL, Brewster UC, Kanade S, Ziaeian B, Jenq GY, Krumholz HM. Quality of discharge practices and patient understanding at an academic medical center. JAMA Intern Med. 2013 Oct 14;173(18):1715–1722. doi: 10.1001/jamainternmed.2013.9318. http://europepmc.org/abstract/MED/23958851 .1729535 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Kerzman H, Baron-Epel O, Toren O. What do discharged patients know about their medication? Patient Educ Couns. 2005 Mar;56(3):276–282. doi: 10.1016/j.pec.2004.02.019.S0738399104001089 [DOI] [PubMed] [Google Scholar]
  • 39.Makaryus AN, Friedman EA. Patients' understanding of their treatment plans and diagnosis at discharge. Mayo Clin Proc. 2005 Aug;80(8):991–994. doi: 10.4065/80.8.991.S0025-6196(11)61579-6 [DOI] [PubMed] [Google Scholar]
  • 40.Pullar T, Roach P, Mellor EJ, McNeece J, Judd A, Feely M, Cooke J. Patients' knowledge concerning their medications on discharge from hospital. J Clin Pharm Ther. 1989 Feb;14(1):57–59. doi: 10.1111/j.1365-2710.1989.tb00222.x. [DOI] [PubMed] [Google Scholar]
  • 41.Ziaeian B, Araujo KL, Van Ness PH, Horwitz LI. Medication reconciliation accuracy and patient understanding of intended medication changes on hospital discharge. J Gen Intern Med. 2012 Nov;27(11):1513–1520. doi: 10.1007/s11606-012-2168-4. http://europepmc.org/abstract/MED/22798200 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Calkins DR, Davis RB, Reiley P, Phillips RS, Pineo KL, Delbanco TL, Iezzoni LI. Patient-physician communication at hospital discharge and patients' understanding of the postdischarge treatment plan. Arch Intern Med. 1997 May 12;157(9):1026–1030. [PubMed] [Google Scholar]
  • 43.Reiley P, Iezzoni LI, Phillips R, Davis RB, Tuchin LI, Calkins D. Discharge planning: comparison of patients and nurses' perceptions of patients following hospital discharge. Image J Nurs Sch. 1996;28(2):143–147. doi: 10.1111/j.1547-5069.1996.tb01207.x. [DOI] [PubMed] [Google Scholar]
  • 44.Mohammed K, Nolan MB, Rajjo T, Shah ND, Prokop LJ, Varkey P, Murad MH. Creating a patient-centered health care delivery system: a systematic review of health care quality from the patient perspective. Am J Med Qual. 2014 Jul 31;:1–10. doi: 10.1177/1062860614545124.1062860614545124 [DOI] [PubMed] [Google Scholar]
  • 45.Bakan I, Buyukbese T, Ersahan B. The impact of total quality service (TQS) on healthcare and patient satisfaction: an empirical study of Turkish private and public hospitals. Int J Health Plann Manage. 2014;29(3):292–315. doi: 10.1002/hpm.2169. [DOI] [PubMed] [Google Scholar]
  • 46.Clark PA, Drain M, Gesell SB, Mylod DM, Kaldenberg DO, Hamilton J. Patient perceptions of quality in discharge instruction. Patient Educ Couns. 2005 Oct;59(1):56–68. doi: 10.1016/j.pec.2004.09.010.S0738-3991(04)00314-3 [DOI] [PubMed] [Google Scholar]
  • 47.Harewood GC, Wiersema MJ, de Groen PC. Utility of Web-based assessment of patient satisfaction with endoscopy. Am J Gastroenterol. 2003 May;98(5):1016–1021. doi: 10.1111/j.1572-0241.2003.07400.x.S0002927003001047 [DOI] [PubMed] [Google Scholar]
  • 48.Eysenbach Gunther, Consort- EHEALTHGroup. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. 2011;13(4):e126. doi: 10.2196/jmir.1923. http://www.jmir.org/2011/4/e126/ v13i4e126 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

Analysis of discharge-questionnaire responses of patients with 1-day hospital stays.

Multimedia Appendix 2

Additional information about the discharge questionnaire.

jmir_v17i6e158_app2.pdf (68.5KB, pdf)
Multimedia Appendix 3

Other figures supplementing the main manuscript.

jmir_v17i6e158_app3.pdf (455.5KB, pdf)
Multimedia Appendix 4

CONSORT-EHEALTH checklist V1.6.1 [48].

jmir_v17i6e158_app4.pdf (878.6KB, pdf)

Articles from Journal of Medical Internet Research are provided here courtesy of JMIR Publications Inc.

RESOURCES