Abstract
Background
Up to 50% of adverse events that occur in hospitals are preventable. Language barriers and disabilities that affect communication have been shown to decrease quality of care. We sought to assess whether communication problems are associated with an increased risk of preventable adverse events.
Methods
We randomly selected 20 general hospitals in the province of Quebec with at least 1500 annual admissions. Of the 145 672 admissions to the selected hospitals in 2000/01, we randomly selected and reviewed 2355 charts of patients aged 18 years or older. Reviewers abstracted patient characteristics, including communication problems, and details of hospital admission, and assessed the cause and preventability of identified adverse events. The primary outcome was adverse events.
Results
Of 217 adverse events, 63 (29%) were judged to be preventable, for an overall population rate of 2.7% (95% confidence interval [CI] 2.1%–3.4%). We found that patients with preventable adverse events were significantly more likely than those without such events to have a communication problem (odds ratio [OR] 3.00; 95% CI 1.43–6.27) or a psychiatric disorder (OR 2.35; 95% CI 1.09–5.05). Patients who were admitted urgently were significantly more likely than patients whose admissions were elective to experience an event (OR 1.64, 95% CI 1.07–2.52). Preventable adverse events were mainly due to drug errors (40%) or poor clinical management (32%). We found that patients with communication problems were more likely than patients without these problems to experience multiple preventable adverse events (46% v. 20%; p = 0.05).
Interpretation
Patients with communication problems appeared to be at highest risk for preventable adverse events. Interventions to reduce the risk for these patients need to be developed and evaluated.
Patient safety is a priority in modern health care systems. From 3% to 17% of hospital admissions result in an adverse event,1–8 and almost 50% of these events are considered to be preventable.3,9–12 An adverse event is an unintended injury or complication caused by delivery of clinical care rather than by the patient's condition. The occurrence of adverse events has been well documented; however, identifying modifiable risk factors that contribute to the occurrence of preventable adverse events is critical. Studies of preventable adverse events have focused on many factors, but researchers have only recently begun to evaluate the role of patient characteristics.2,9,12,13 Older patients and those with a greater number of health problems have been shown to be at increased risk for preventable adverse events.10,11 However, previous studies have repeatedly suggested the need to investigate more diverse, modifiable risk factors.3,6,7,10,11,14–16
Language barriers and disabilities that affect communication have been shown to decrease quality of care;16–20 however, their impact on preventable adverse events needs to be investigated. Patients with physical and sensory disabilities, such as deafness and blindness, have been shown to face considerable barriers when communicating with health care professionals.20–24 Communication disorders are estimated to affect 5%–10% of the general population,25 and in one study more than 15% of admissions to university hospitals involved patients with 1 or more disabilities severe enough to prevent almost any form of communication.26 In addition, patients with communication disabilities are already at increased risk for depression and other comorbidities.27–29 Determining whether they are at increased risk for preventable adverse events would permit risk stratification at the time of admission and targeted preventive strategies.
We sought to estimate the extent to which preventable adverse events that occurred in hospital could be predicted by conditions that affect a patient's ability to communicate.
Methods
Study population
All general acute care hospitals in the province of Quebec with a minimum of 1500 admissions per year and an emergency department were eligible to participate in our study if they were situated within 260 km of Montréal, the study coordinating centre (38.3% of hospitals in the province). We classified hospitals as small (< 100 beds), large (≥ 100 beds, nonteaching) and teaching (university-based). We randomly selected a sample of 20 hospitals, which comprised 2 small, 10 large and 8 teaching hospitals (each of the 4 faculties of medicine in Quebec are affiliated with 2 of the teaching hospitals). We sent a letter to the director general of each of the selected hospitals inviting the establishment to participate in the study. When a selected hospital refused to participate, another hospital was randomly selected from the same group. One teaching and 5 large hospitals refused to participate.
We compiled a list of eligible admissions from the Maintenance et exploitation des données pour l'étude de la clientèle hospitalière (Med-Echo) admission and discharge database in each hospital. We considered patients to be eligible for our chart review if they were 18 years of age or older; were admitted to hospital between Apr. 1, 2000, and Mar. 31, 2001; and were admitted to hospital for more than 24 hours or died within 24 hours after admission. We did not include patients whose discharge status was unknown or who were discharged alive within 24 hours after admission. We also excluded patients admitted because of primary obstetric or psychiatric reasons. Medical archivists from each hospital randomly selected charts from eligible admissions for review. If a patient had more than 1 admission during the year, we considered the first admission to be the index or study admission.
We obtained ethics approval for our study from the Université de Montréal Faculty of Medicine Research Ethics Committee and from each of the hospitals participating in the study.
Assessment of adverse events
We used Baker and colleagues'1 definition of an adverse event: an unintended injury or complication caused by the delivery of clinical care rather than by the patient's underlying condition. We captured adverse events under 3 circumstances: those that occurred during the index admission; those that were caused by health care management provided within 12 months before the index admission and were detected during the index admission, regardless of where the care had been given (e.g., a patient with elective hip surgery who is readmitted 15 days after discharge with a surgical wound infection); and those that were caused by health care management and were detected within the 12 months after discharge from the index admission (Figure 1). We were not able to capture adverse events that occurred and were detected before the index admission, that occurred before the index admission but were only detected after discharge from the index admission, or that occurred and were detected after discharge from the index admission. We evaluated only admissions to participating hospitals. If patients were moved to an alternate level of care, we included them in our study as long as they remained in the same hospital.
We collected data through a 2-stage review of hospital charts using methods published in the Canadian Adverse Event Study.1 In the first stage, 1 of 6 trained research nurses abstracted patient data and assessed selected hospital charts against 18 screening criteria for an adverse event (Box 1). In the second stage, 1 of 3 trained physician reviewers assessed each chart that met at least 1 screening criterion and classified the level of disability associated with each injury or complication recorded. The physician reviewer then assessed causation and preventability for each event to determine whether the injury or complication was an adverse event. The physician reviewers assessed causation using a 6-point scale, in which 1 indicated no evidence of health care management as the cause and 6 indicated certain evidence of health care management as the cause. We considered injuries and complications with a rating of 4 or higher (more than likely) to be adverse events. Physician reviewers assessed preventability using a similar 6-point scale; we considered an adverse event with a rating of 4 or higher to be preventable.1
For each adverse event, the physician reviewer assessed the patient's level of physical impairment at the time of discharge attributable to the adverse event. The physician reviewer then noted the department where the adverse event occurred and the primary factor that led to it, recording the event into one of the following mutually exclusive categories: diagnosis, surgery, fracture, anesthesia, medical procedure, drug or fluid, clinical management, system event, or other adverse event. We defined poor clinical management as a therapeutic adverse event (e.g., inappropriate treatment, a delay in treatment, failure to monitor the patient's condition).
We assessed interrater agreement for the first stage of the review at each hospital by reabstracting and blindly reassessing 10% of all charts submitted to the nurse reviewers. For the second stage, the 2 physicians at each site separately reviewed the charts that were positive for at least 1 screening criterion. One of the 2 physicians then finalized the review in conjunction with a senior physician.
Abstraction of patient characteristics
Nurse reviewers collected information on patient communication disorders or problems, psychosocial factors, comorbidities, disabilities, age, sex and admission characteristics before assessing the chart against the criteria indicating a potential adverse event. We used a Charlson Comorbidity Index score to summarize comorbidities.30 The information we recorded about patient communication problems included evidence that the patient experienced difficulty with communication; whether the source of the problem was language, a physical problem or was undetermined; and whether the patient was blind, deaf or had other physical disabilities that were judged to interfere with communication. Psychosocial factors that might also affect communication included the presence of a social distancing problem (e.g., alcoholism, drug abuse, homelessness) or a secondary diagnosis of a psychiatric disorder (e.g., depression, anxiety). We recorded whether the index admission was urgent or elective, and whether the admitting hospital was a small, large or teaching hospital.
Statistical analysis
We calculated population-weighted point estimates and confidence intervals (CIs) for adverse events using the 2-stage review1 described in the section on the assessment of adverse events. We assessed interrater agreement by calculating the kappa score.31 For patients with multiple injuries or complications, we used the most serious one to determine the characteristics of the adverse event. We performed a multiple logistic regression analysis using generalized estimated equations to assess patient predictors for preventable adverse events, adjusting for the clustering of patients admitted to the same hospital.32 We sorted by date of admission and used generalized estimating equations to account for the correlation that may have been introduced into the data for patients admitted on the same day or in the same month.33 We controlled for confounding due to other factors that have been shown to be statistically significant for patients experiencing preventable events (e.g., age, sex, comorbidities, admission characteristics). We used a χ2 test to determine the preventability of adverse events among patients with and without communication problems for different outcomes, including multiple injuries or complications, prolonged hospital stay, hospital readmission and the presence of communication problems at the time of discharge. We also performed the Fisher exact test to determine whether there was a statistically significant association between communication problems and preventable adverse events.
Results
Of the 145 672 eligible admissions in the 20 participating hospitals, we reviewed 2355 charts, which accounted for 98% of our random sample of 2409 admissions (Table 1). We excluded charts if they contained insufficient documentation. A total of 584 charts met at least 1 criterion for a preventable adverse event, and the physician reviewers identified 377 injuries or complications in 292 patients (Figure 2). Physician reviewers considered the injuries or complications of 217 patients to be adverse events, for a population-weighted point estimate of 8.5% (95% CI 7.2%–9.8%). We judged the adverse events experienced by 63 (29%) of these patients to be preventable, for an overall rate of 2.7% (95% CI 2.1%–3.4%). The relation between index admission and the detection of preventable adverse events in these patients is shown in Figure 1.
The kappa score for interrater agreement in the first stage of the review by the research nurses was 0.70 (95% CI 0.62–0.78), which indicated moderately high reliability. Our sensitivity analysis showed no significant change in the results if we moved the cut-off rating for causation and preventability from 4 or higher (more than likely) to 5 or higher (moderate to strong evidence). Therefore, we left the cut-off rating at 4 or higher.
A greater proportion of patients with physical communication problems, psychiatric disorders and comorbidities had preventable adverse events than patients without those challenges. In addition, preventable adverse events occurred more often among women than among men. They also occurred more often among patients 65 years or older than among younger patients. The mean age of the 63 patients who experienced a preventable adverse event was 65.9 (standard deviation [SD] 16.5); the mean age of the 2138 patients with no adverse events was 61.7 (SD 18.0) (Table 2).
The presence of a physical communication problem was significantly associated with an increased risk of experiencing a preventable adverse event (odds ratio [OR] 3.97; p = 0.004) (Table 3). Similarly, the presence of a psychiatric disorder was significantly associated with an increased risk of a preventable adverse event (OR 2.44; p = 0.029) (Table 3). This association held after we adjusted for other patient and admission characteristics (Figure 3 and Table 3). In addition, patients who were admitted to hospital on an urgent basis had a significantly increased risk of experiencing a preventable adverse event compared with patients whose admissions were elective.
We found that 57% (n = 36) of patients who experienced a preventable adverse event received treatment or an intervention with sequelae. The most common sequelae were prolonged hospital stays (35%), readmission to hospital (32%) and discharge with minimal impairment or recovery within 1 month (10%). A small percentage of patients with preventable adverse events experienced moderate impairment with recovery in 1 year (5%), experienced permanent impairment (3%) or died (6%). Multiple preventable adverse events occurred more frequently among patients with a psychiatric disorder or a physical communication problem compared with patients without these factors (46% v. 20%; p = 0.05). A smaller percentage of patients with these 2 factors than without them had a prolonged hospital stay (8% v. 42%; p = 0.02).
We assessed the sources of the most severe adverse events for 57 of 63 patients whose charts contained adequate information. The majority of severe preventable adverse events were drug related (40%) or caused by poor clinical management (32%); 18% were due to anesthesia, surgery or medical procedures. The differences in source (p values 0.46–0.81) and type (p values 0.08–0.29) of preventable adverse events between patients with and those without a physical communication problem or psychiatric disorder were not statistically significant. Among patients with a documented communication problem, the source tended to be physical challenges such as deafness (5 of 7 patients with communication challenges) rather than problems related to spoken language. Of the patients with either a communication problem or psychiatric disorder who experienced a preventable adverse event, 7 of 13 patients spoke neither French nor English. The most common psychiatric disorder was depression (6 of 7 patients); the remaining disorders included anxiety, dementia, personality disorder, panic attacks, schizophrenia and psychosis.
Interpretation
We found that patients with communication problems were 3 times more likely to experience a preventable adverse event than patients without such problems. These events were mainly drug related or caused by poor clinical management. Almost half of the events were associated with some level of disability or multiple hospital admissions, with one-third of the patients who experienced preventable adverse events requiring readmission to hospital. These results emphasize the importance of providing additional resources for these patients to improve patient safety.
Our findings build on those of earlier studies concerning patient communication and quality of health care.21–23 In a large North American survey, Iezzoni and colleagues22 found that participants with any major disability affecting communication were more likely than patients without such disabilities to be dissatisfied with physicians' understanding of their conditions and with the time spent discussing their problems and answering questions. Participants who were deaf or hard of hearing reported that they were very concerned with medication safety and other risks associated with inadequate communication, as well as communication problems during medical procedures.21 The results of a study by Steinberg and colleagues23 involving 54 deaf patients indicated that the minimal level of communication they have with health professionals would not be tolerated by hearing patients. In our study, half of the communication problems recorded were due to deafness, and most of the preventable adverse events were drug related or caused by poor clinical management (e.g., inappropriate treatment, delay in treatment, failure to monitor the patient's status). These types of errors relate to the concerns raised by deaf patients about inadequate communication.
Although the studies involving deaf patients22,23 did not specifically target hospital settings, the issues they raised are supported by findings of a study by Azoulay and colleagues18 about communication between physicians and families of patients in an intensive care unit. The authors found that factors such as foreign country of origin (p = 0.007) and unfamiliarity with the official language (p = 0.03) were associated with poor comprehension of diagnosis, prognosis and treatment: in 33% of cases, patient representatives were from foreign countries, and in 16% of cases they did not speak English or French. Although we did not specifically examine ethnic background as a potential communication barrier, in our study only 17% of the patients with a communication problem spoke 1 of the 2 official languages.
Our study is a retrospective chart review and, as such, has important limitations. First, chart reviews capture documented adverse events; however, they do not capture events that are rectified before any resulting injuries or complications occur. As a result, the rates of preventable adverse events are probably underestimated.34–36 To capture more potential adverse events, we did not require that the adverse event result in hospital readmission, permanent disability or death.15,34
Second, our chart review relied on the judgment of the physician and nurse reviewers, as well as the quality of the original charting. Our study achieved moderately high reliability, with kappa scores that were equivalent or better than those reported in studies using similar methodology.1,3–6 Communication disabilities are estimated to occur in 5%–10% of the general population and in up to 15% of hospital admissions.20,26 Therefore, our finding that 3% of our population had a documented communication barrier indicates that these disabilities may not have been systematically charted.
Third, our results are based on a limited number of preventable adverse events and a limited number of patients with communication problems. Despite the small numbers, we documented a 3-fold increase in risk that was both statistically and clinically significant. Furthermore, the number of preventable adverse events recorded in our study was similar to that found in previous studies of adverse events completed in Canada1,2 and Britain.8 Our analysis adjusted for many of the other potential predictors of preventable adverse events. Therefore, our finding that the risk of a preventable adverse event is 3 times higher among patients with a communication problem than among patients without such problems remains robust and may be conservative.
To improve patient safety, a prospective controlled evaluation of the health care experience of patients with and without communication problems should be conducted. Clinicians and patients have proposed strategies for improving communication and optimizing the flow of information between the patient and the health care team.21,22,26 The impact of these proposed strategies on reducing the number of preventable adverse events and their impact on provision of care should be evaluated from the patient's perspective. Once the impact of interventions on preventable adverse events is assessed, patients with communication challenges can be identified at the time of admission to ensure they receive safe care.20,37 Our study was not designed to provide insight into how or why the presence of communication problems increases the occurrence of preventable adverse events. Therefore, it is important for future research to investigate interpersonal dynamics that may be responsible. This research will become critical as the number of adults with disabilities affecting communication increases as the elderly population increases.
@ See related article page 1573
Supplementary Material
Acknowledgments
Data collection for this study was funded by the Canadian Institute for Health Information, the Canadian Institutes of Health Research and the Ministère de la santé et des services sociaux. Gillian Bartlett is supported by a career award from the Fonds de recherche en santé du Québec. Robyn Tamblyn is a Canadian Institute for Health Information Scientist.
Footnotes
Une version française de ce résumé est disponible à l'adresse www.cmaj.ca/cgi/content/full/178/12/1555/DC1
This article has been peer reviewed.
Contributors: Gillian Bartlett contributed to the study conception and design, the analysis and interpretation of the data, and the drafting and final revision of the manuscript. Régis Blais contributed to the study conception and design, the acquisition and interpretation of the data, the critical revision of the manuscript and the acquisition of funding for the study. Robyn Tamblyn contributed to the study conception and design, the analysis and interpretation of the data, the critical revision of the manuscript and the acquisition of funding for the study. Richard Clermont contributed to the study conception and design, the acquisition of the data, the critical revision of the manuscript and the training of physician and nurse reviewers. Brenda MacGibbon contributed to the statistical analyses and the critical revision of the manuscript. All of the authors approved this version of the manuscript. Gillian Bartlett had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Competing interests: None declared.
Correspondence to: Dr. Gillian Bartlett, 515-517 Pine Ave. W, Montréal, QC H2W 1S4; fax 514 398-4202; gillian.bartlett@mcgill.ca
REFERENCES
- 1.Baker GR, Norton PG, Flintoft V, et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ 2004;170:1678-86. [DOI] [PMC free article] [PubMed]
- 2.Forster AJ, Asmis TR, Clark HD, et al. Ottawa Hospital Patient Safety Study: incidence and timing of adverse events in patients admitted to a Canadian teaching hospital. CMAJ 2004;170:1235-40. [DOI] [PMC free article] [PubMed]
- 3.Davis P, Lay-Yee R, Briant R, et al. Adverse events in New Zealand public hospitals. I: occurrence and impact. N Z Med J 2002;115:U271. [PubMed]
- 4.Thomas EJ, Studdert DM, Burstin HR, et al. Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care 2000;38:261-71. [DOI] [PubMed]
- 5.Wilson R, Runciman WB, Gibberd RW, et al. The quality in Australian Health Care Study. Med J Aust 1995;163:458-71. [DOI] [PubMed]
- 6.Brennan TA, Leape LL, Laird NM, et al. Incidence of adverse events and negligence in hospitalized patients: results of the Harvard Medical Practice Study I. N Engl J Med 1991;324:370-6. [DOI] [PubMed]
- 7.Woods D, Thomas E, Holl J, et al. Adverse events and preventable adverse events in children. Pediatrics 2005;115:155-60. [DOI] [PubMed]
- 8.Vincent C, Neale G, Woloshynowych M. Adverse events in British hospitals: preliminary retrospective record review. BMJ 2001;322:517-9. [DOI] [PMC free article] [PubMed]
- 9.Leape LL, Brennan TA, Laird N, et al. The nature of adverse events in hospitalized patients: results of the Harvard Medical Practice Study II. N Engl J Med 1991;324:377-84. [DOI] [PubMed]
- 10.Davis P, Lay-Yee R, Briant R, et al. Preventable in-hospital medical injury under the “no fault” system in New Zealand. Qual Saf Health Care 2003;12:251-6. [DOI] [PMC free article] [PubMed]
- 11.Thomas EJ, Brennan TA. Incidence and types of preventable adverse events in elderly patients: population based review of medical records. BMJ 2000;320:741-4. [DOI] [PMC free article] [PubMed]
- 12.Leape LL, Lawthers AG, Brennan TA, et al. Preventing medical injury. Qual Rev Bul 1993;144-149. [DOI] [PubMed]
- 13.Petersen LA, Brennan TA, O'Neil AC, et al. Does housestaff discontinuity of care increase the risk for preventable adverse events? Ann Intern Med 1994;121:866-72. [DOI] [PubMed]
- 14.Kable AK, Gibberd RW, Spigelman AD. Adverse events in surgical patients in Australia. Int J Qual Health Care 2002;14:269-76. [DOI] [PubMed]
- 15.Weingart SN, Wilson RM, Gibberd RW, et al. Epidemiology of medical error. BMJ 2000;320:774-7. [DOI] [PMC free article] [PubMed]
- 16.Vincent CA, Coulter A. Patient safety: What about the patient? Qual Saf Health Care 2002;11:76-80. [DOI] [PMC free article] [PubMed]
- 17.Kuzel AJ, Woolf SH, Gilchrist VJ, et al. Patient reports of preventable problems and harms in primary health care. Ann Fam Med 2004;2:333-40. [DOI] [PMC free article] [PubMed]
- 18.Azoulay E, Chevret S, Leleu G, et al. Half the families of intensive care unit patients experience inadequate communication with physicians. Crit Care Med 2000;28:3044-9. [DOI] [PubMed]
- 19.Green CA, Pope CR. Gender, psychosocial factors and the use of medical services: a longitudinal analysis. Soc Sci Med 1999;48:1363-72. [DOI] [PubMed]
- 20.Hoffman JM, Yorkston KM, Shumway-Cook A, et al. Effect of communication disability on satisfaction with health care: a survey of Medicare beneficiaries. Am J Speech Lang Pathol 2005;14:221-8. [DOI] [PubMed]
- 21.Iezzoni LI, O'Day BL, Killeen M, et al. Communicating about health care: observations from persons who are deaf or hard of hearing. Ann Intern Med 2004;140:356-62. [DOI] [PubMed]
- 22.Iezzoni LI, Davis RB, Soukup J, et al. Quality dimensions that most concern people with physical and sensory disabilities. Arch Intern Med 2003;163:2085-92. [DOI] [PubMed]
- 23.Steinberg AG, Sullivan VJ, Loew RC. Cultural and linguistic barriers to mental health service access: the deaf consumer's perspective. Am J Psychiatry 1998;155:982-4. [DOI] [PubMed]
- 24.Dalton DS, Cruickshanks KJ, Klein BEK, et al. The impact of hearing loss on quality of life in older adults. Gerontologist 2003;43:661-8. [DOI] [PubMed]
- 25.Ruben RJ. Redefining the survival of the fittest: communication disorders in the 21st century. Laryngoscope 2000;110:241-5. [DOI] [PubMed]
- 26.Ebert DA, Heckerling PS. Communication disabilities among medical inpatients. N Engl J Med 1998;339:272-3. [DOI] [PubMed]
- 27.Strawbridge WJ, Wallhagen MI, Shema SJ, et al. Negative consequences of hearing impairment in old age: a longitudinal analysis. Gerontologist 2000;40:320-6. [DOI] [PubMed]
- 28.Turner RJ, Noh S. Physical-disability and depression — a longitudinal analysis. J Health Soc Behav 1988;29:23-37. [PubMed]
- 29.Prince MJ, Harwood RH, Blizard RA, et al. Impairment, disability and handicap as risk factors for depression in old age. The Gospel Oak Project. 5. Psychol Med 1997;27:311-21. [DOI] [PubMed]
- 30.Charlson ME, Pompei P, Ales KL, et al. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 1987;40:373-83. [DOI] [PubMed]
- 31.Landis JR, Koch GG. Measurement of observer agreement for categorical data. Biometrics 1977;33:159-74. [PubMed]
- 32.Liang KY, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrics 1986;73:13-22.
- 33.Jennrich RI, Schluchter MD. Unbalanced repeated-measures models with structured covariance matrices. Biometrics 1986;42:805-20. [PubMed]
- 34.Leape LL. Error in medicine. JAMA 1994;272:1851-7. [PubMed]
- 35.Forster AJ, Shojania KG, van Walraven C. Improving patient safety: moving beyond the “hype” of medical errors. CMAJ 2005;173:893-4. [DOI] [PMC free article] [PubMed]
- 36.Brennan TA, Localio AR, Leape LL, et al. Identification of adverse events occurring during hospitalization — a cross-sectional study of litigation, quality assurance, and medical records at 2 teaching hospitals. Ann Intern Med 1990;112:221-6. [DOI] [PubMed]
- 37.Ford JD, Trestman RL, Steinberg K, et al. Prospective association of anxiety, depressive, and addictive disorders with high utilization of primary, specialty and emergency medical care. Soc Sci Med 2004;58:2145-8. [DOI] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.