Abstract
BACKGROUND AND OBJECTIVES:
Hospitalized children with medical complexity (CMC) are at high risk of medical errors. Their families are an underutilized source of hospital safety data. We evaluated safety concerns from families of hospitalized CMC and patient/parent characteristics associated with family safety concerns.
METHODS:
We conducted a 12-month prospective cohort study of English- and Spanish-speaking parents/staff of hospitalized CMC on 5 units caring for complex care patients at a tertiary care children’s hospital. Parents completed safety and experience surveys predischarge. Staff completed surveys during meetings and shifts. Mixed-effects logistic regression with random intercepts controlling for clustering and other patient/parent factors evaluated associations between family safety concerns and patient/parent characteristics.
RESULTS:
A total of 155 parents and 214 staff completed surveys (>89% response rates). 43% (n = 66) had ≥1 hospital safety concerns, totaling 115 concerns (1–6 concerns each). On physician review, 69% of concerns were medical errors and 22% nonsafety-related quality issues. Most parents (68%) reported concerns to staff, particularly bedside nurses. Only 32% of parents recalled being told how to report safety concerns. Higher education (adjusted odds ratio 2.94, 95% confidence interval [1.21–7.14], P = .02) and longer length of stay (3.08 [1.29–7.38], P = .01) were associated with family safety concerns.
CONCLUSIONS:
Although parents of CMC were infrequently advised about how to report safety concerns, they frequently identified medical errors during hospitalization. Hospitals should provide clear mechanisms for families, particularly of CMC and those from disadvantaged backgrounds, to share safety concerns. Actively engaging patients/families in reporting will allow hospitals to develop a more comprehensive, patient-centered view of safety.
Hospitalized children with medical complexity (CMC) have higher rates of medical errors and adverse events (AEs) than other children.1–7 CMC have severe, chronic, multisystem medical conditions, often experiencing functional restrictions and requiring technological assistance.8,9 They account for <1% of United States children but more than one-third of pediatric health care expenditures.9 Children diagnosed with ≥1 complex chronic conditions (CCCs; an International Classification of Diseases, Ninth/Tenth Revision, Clinical Modification [ICD-9/10-CM]-based marker of complexity)10 represented one-tenth of United States pediatric hospital admissions in 2006.11
We previously found families of children with ≥1 CCCs are twice as likely to report errors and AEs during hospitalization.12 Many family-reported errors and AEs were not detected in the medical record.12,13 Families of CMC are an underutilized source of hospital safety data, and dedicated studies of family safety reporting in CMC are lacking.
We, therefore, sought to examine the frequency and types of family safety concerns in hospitalized CMC. We also examined patient/parent characteristics associated with family safety concerns, and parent/staff perceptions and experiences with safety and safety reporting. These findings can assist hospitals in improving safety for CMC, a vulnerable and resource-intensive population.
METHODS
Setting
From April 2018 to April 2019, we conducted a 5-unit prospective cohort study of patients hospitalized on a dedicated complex care service at a tertiary care children’s hospital. The hospital has a formal voluntary incident reporting (VIR) system available only to staff. Families lack a formal safety reporting method other than submitting complaints to Patient Relations, which is infrequently used. The hospital’s institutional review board approved this study.
Study Population
We included all English- and Spanish-speaking parents of hospitalized CMC and staff on the study units. Research assistants screened and recruited eligible parents daily. We excluded parents of international patients and patients in state custody or residential care facilities. Participants provided verbal consent facilitated by an information sheet.
Parent/Staff Surveys
Parents completed a 41-item survey, including select Child Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) items14 and family safety reporting, experience, and safety belief items modified from previous research.12,15 We cognitive validity tested, piloted, and professionally translated surveys into Spanish. Parents also completed the Children’s Hospital Safety Climate Questionnaire,16 Parent-Patient Activation Measure,17 Newest Vital Sign (for health literacy),18 and demographic items.
Staff completed surveys based on previous research15 about perceptions of family safety reporting, safety beliefs/training, experience, select items from the Agency for Healthcare Research and Quality’s Hospital Survey on Patient Safety Culture,19 and demographics. Parents/staff completed surveys on paper or electronically.
Data Collection
We surveyed parents on weekdays 24 to 48 hours before anticipated discharge. Readmitted parents received an abbreviated survey focused on safety reporting items. We surveyed staff during meetings, study lunches, and clinical shifts. We obtained additional patient clinical/demographic information from Pediatric Health Information System20 and a hospital-specific administrative database.
Outcomes
The primary outcome was the proportion of parents/caregivers (hereafter “families”) of CMC with safety concerns. Additional outcomes included the proportion of staff who received family-reported concerns, safety concern frequency/type, “top-box” family/staff safety climate scores, and family/staff safety reporting experience.
Family Safety Concerns
Families were considered to have a safety concern if they answered affirmatively to ≥1 of 6 questions on our safety survey: illness got worse because of medical care, or because something was not done that should have been, nonharmful mistake, “good catch,” concerns not listened to, anything else upsetting or potentially harmful. Parents also provided additional details about their most recent (if >1) safety concern.
We classified concerns on the basis of a modified Bates et al approach21,22 and our previous family safety reporting research.12,13 A trained physician reviewed and classified all family concerns, reviewing medical records if there was insufficient information to classify each. Two physicians (Drs Khan and Landrigan) reviewed a random subset (17%) to check reliability (K = 0.77, 95% confidence interval [CI] 0.53–1.00).
We classified concerns as safety concerns, nonsafety-related quality issues, or medical care concerns deemed neither safety nor quality problems. We subclassified safety concerns as harmful/nonharmful errors and categorized safety and nonsafety-related quality issues by type (eg, communication).
Additional Outcomes
Staff received a family safety report if they answered affirmatively to whether a parent/caregiver of CMC in the past week reported to them a harm, nonharmful error, or safety concern. We also asked staff if families made any “good catches.” For safety experience, we analyzed the proportion of parents answering “yes, somewhat”/“yes, definitely” to the Child HCAHPS item about whether staff informed parents how to report concerns during hospitalization.14 For safety climate, respondents had a top-box safety climate score if they selected the top-most response on 5-point Likert scale questions (eg, 5/5, “Strongly Agree”).
Statistical Analyses
Descriptive statistics were used to analyze the proportion of families with safety concerns and compared patient/parent sociodemographics among parents with versus without concerns. χ2 tests were used to compare parent and staff reporting preferences and safety climate scores.
To identify factors associated with family safety concerns, we dichotomized the sample into patients with ≥1 family safety concerns versus none. We examined bivariate associations between having safety concerns and covariates of interest using χ2/Fisher’s exact tests for categorical variables. For continuous variables, we assessed associations using t tests for means and Wilcoxon Mann-Whitney tests for medians.
We used mixed-effects logistic regression with random intercepts controlling for clustering by participants to examine characteristics associated with families having safety concerns. We adjusted for patient/parent predictors deemed clinically significant a priori, including parent race/ethnicity, language proficiency, education, and health literacy, as well as patient age, number of lifetime admissions, and length of stay (LOS). P values <.05 were considered statistically significant. We used REDCap23 for data collection and management and SAS v9.4 (SAS Institute) for analyses.
RESULTS
Sample Characteristics
Overall, 74% (n = 175) of eligible parents and 77.9% (n = 230) of staff consented to participate (eFig 1). Surveys were completed by 155 parents and 214 staff (>89% response rates). Parents were predominantly White (74%, n = 114), female (81%, n = 123), and with less than a college education (51%, n = 78). Staff were predominantly nurses (59%, n = 122), female (91%, n = 190), and White (77%, n = 161). Mean LOS was 9 days (standard deviation = 13.5). The most common CCC categories were neurologic/neuromuscular (79%, n = 118), gastrointestinal (76%, n = 114), and metabolic (28%, n = 42); 86% (n = 129) were technology-dependent, including 11% (n = 17) who were mechanically ventilated (Table 1).
TABLE 1.
Bivariate Associations Between Parent and Patient Characteristics and Family Safety Concerns
| Overall | No Family Safety Concern (N = 89), n (%) | Family Safety Concern (N = 66), n (%) | P | |
|---|---|---|---|---|
|
| ||||
| Parent characteristics, (N = 155), n (%) | ||||
| Age, y, mean (SD) | 48.5 (11.0) | 47.3 (10.7) | 50.0 (11.3) | .15 |
| Sex | .74 | |||
| Male | 29 (19.1) | 16 (18.2) | 13 (20.3) | |
| Female | 123 (80.9) | 72 (81.8) | 51 (79.7) | |
| Race and ethnicity | .45 | |||
| Asian/Pacific Islander, non-Hispanic | 4 (2.6) | 2 (2.3) | 2 (3) | |
| Black/African American, non-Hispanic | 8 (5.2) | 5 (5.6) | 3 (4.6) | |
| White, non-Hispanic | 114 (73.5) | 62 (69.7) | 52 (78.8) | |
| Other, non-Hispanic | 11 (7.1) | 6 (6.7) | 5 (7.6) | |
| Hispanic | 18 (11.6) | 14 (15.7) | 4 (6.1) | |
| Ability to speak English | .19 | |||
| Very well | 134 (88.2) | 75 (85.2) | 59 (92.2) | |
| Well/not well/not at all | 18 (11.8) | 13 (14.8) | 5 (3.3) | |
| Ability to read English | .40 | |||
| Very well | 138 (90.8) | 78 (88.6) | 60 (93.8) | |
| Well/not well/not at all | 14 (9.2) | 10 (11.4) | 4 (6.3) | |
| Education level | .003 | |||
| Some college or less | 78 (51.0) | 54 (61.4) | 24 (36.9) | |
| Completed college or higher | 75 (49.0) | 34 (38.6) | 41 (63.1) | |
| Household income, dollars | .03 | |||
| <$50 000 | 68 (46.3) | 44 (53) | 24 (37.5) | |
| $50 000 to $100 000 | 36 (24.5) | 22 (26.5) | 14 (21.9) | |
| $100 000 or greater | 43 (29.3) | 17 (20.5) | 26 (40.6) | |
| Health literacy (Newest Vital Sign) | .08 | |||
| Limited literacy | 26 (16.8) | 20 (22.5) | 6 (9.1) | |
| Adequate literacy | 102 (65.8) | 54 (60.7) | 48 (72.7) | |
| Unknown | 27 (17.4) | 15 (16.9) | 12 (18.2) | |
| Parent-Patient Activation Measure linear levels | .20 | |||
| Top-box (Level 4) | 81 (52.3) | 52 (58.4) | 29 (43.9) | |
| Level 1–3 | 50 (32.3) | 25 (28.1) | 25 (37.9) | |
| Missing | 24 (15.5) | 12 (13.5) | 12 (18.2) | |
| Patient characteristics | ||||
| Age, y, mean (SD)a | 13.8 (6.8) | 13.6 (6.5) | 14.1 (7.2) | .63 |
| Sexa | .18 | |||
| Male | 88 (56.8) | 56 (62.9) | 32 (48.5) | |
| Female | 62 (40) | 31 (34.8) | 31 (47) | |
| CCC count | .40 | |||
| 0–1 | 12 (8.0) | 5 (5.8) | 7 (11.1) | |
| 2–3 | 60 (40.0) | 34 (39.1) | 26 (41.3) | |
| ≥4 | 78 (52.0) | 48 (55.2) | 30 (47.6) | |
| Times admitted to hospital in lifetime, mean (SD)a | 19.3 (18.2) | 18.3 (18.5) | 20.8 (17.9) | .39 |
| Years part of complex care service, mean (SD) | 7.5 (6.2) | 7.2 (6.4) | 7.9 (6.0) | .56 |
| Visit characteristicsa | ||||
| Length of stay >5 d | 74 (47.7) | 36 (40.5) | 38 (57.6) | .05 |
| Payer | .55 | |||
| Commercial | 78 (52) | 42 (48.3) | 36 (57.1) | |
| Public | 47 (31.3) | 29 (33.3) | 18 (28.6) | |
| Unknown | 25 (16.7) | 16 (18.4) | 9 (14.3) | |
| Staff characteristics, (N = 214), n (%) | ||||
| Age, y, mean (SD) | 34.4 (9.0) | — | — | — |
| Sex | — | |||
| Male | 18 (8.6) | — | — | |
| Female | 190 (91.4) | — | — | |
| Race and ethnicity | — | |||
| Asian/Pacific Islander, non-Hispanic | 15 (7.2) | — | — | |
| Black/African American, non-Hispanic | 10 (4.8) | — | — | |
| White, non-Hispanic | 161 (77.4) | — | — | |
| Other, non-Hispanic | 8 (3.8) | — | — | |
| Hispanic | 14 (6.7) | — | — | |
| Hospital role | — | |||
| Attending physician | 4 (1.9) | — | — | |
| Clinical assistant | 27 (13.0) | — | — | |
| Nurse | 122 (58.6) | — | — | |
| Nurse practitioner | 5 (2.4) | — | — | |
| Resident physician | 37 (17.8) | — | — | |
| Other | 13 (6.2) | — | — | |
| Time worked in specialty/profession, y | — | |||
| <1 | 12 (5.8) | — | — | |
| 1–5 | 102 (49.0) | — | — | |
| 6–10 | 29 (13.9) | — | — | |
| 11–15 | 25 (12.0) | — | — | |
| 16–20 | 21 (10.1) | — | — | |
| 21 or more | 19 (9.1) | — | — | |
SD, standard deviation; —, not applicable.
Data are collected from Pediatric Health Information System and hospital electronic medical records; all other characteristics were obtained from parent-reported surveys.
Frequency and Types of Family Safety Concerns
Overall, 43% (n = 66) of parents had ≥1 safety concerns during hospitalization. Parents had 115 total concerns (1–6 concerns each). After physician review, 69% (n = 79) of concerns were medical errors and 22% (n = 25) were nonsafety-related quality issues (eg, communication problem) (Fig 1). The remainder (10%, n = 11) were neither safety nor quality-related concerns (eg, valid, differing opinions about the care plan). Among errors, 27% (n = 21) were harmful (ie, preventable AEs) and 73% (n = 58) were nonharmful. The most frequent harmful errors involved medications/intravenous (IV) fluids (n = 8) and equipment (n = 4) (Fig 1). Harmful errors included an inadequately monitored IV that infiltrated, hypoxia from fluid overload, and delayed intussusception diagnosis (Table 2). The most frequent nonharmful errors involved medications/IV fluids (n = 23) and feeds (n = 9). Nonharmful errors included delayed laboratory results, noncompliance with orthotics, and delayed medication administration.
FIGURE 1.

Categorization of safety concerns from families of CMC.
TABLE 2.
Examples of Family Safety Concerns From Families of CMC
| Category | Family Safety Concerns |
|---|---|
|
| |
| Device | “Docs and nurses mistakenly thought her nerve blockers were an epidural and she did not receive the correct amount of pain meds for 12 HOURS after major surgery She was in excruciating pain but only being treated for nausea.” |
| Diagnosis | “A few days after surgery, I advised hospital staff that my son’s abdomen was severely bloated, that he had constipation + asked for a GI to be brought in. It was several days before a GI was called in. There was also dark brown fluids coming out of his g-tube. I felt like the team ignored my concerns. It turned out my son had intussusception.” |
| Environment | “My daughter was left alone with a toy she ATE and almost choked on. Was also the ‘good catch’ made by me.” |
| Equipment | “During hospital stay braces in the orders were not used … gloves, bivalved casts, AFO’s [ankle foot orthotics] … body suite regimes were not complied with.” |
| Fall or fall risk | “Staff forgot to close (zip) the posey bed.” |
| Feeding | “Feed ratios were not correct. Minor but took a few shifts to correct. I (mom) caught this.” |
| Hospital acquired infection | “Many antibiotics led to C diff.” |
| Medication | “Mi hija toma medicamento para las conbulsiones a las 8:00 pm y susedio que una noche la enfermera me notifico que unos de los medicamentos no avia llegado a su hora espera 2 horas 1/2 para que le administraran el medicamento.” |
| [“My daughter takes seizure medication at 8 pm and it happened that one night the nurse notified me that one of the medications had not arrived at the scheduled time so she had to wait 2 1/2 hours for the medication to be given.”] | |
Predictors of Family Safety Concerns
In unadjusted analysis, characteristics associated with family safety concerns were education, income, and LOS (Table 1). In adjusted multivariable analysis, college education or higher (adjusted odds ratio [aOR] 2.94, 95% CI [1.21–7.14], P = .02) and LOS >5 days (aOR 3.08, 95% CI [1.29–7.38], P = .01) were associated with family safety concerns (Table 3).
TABLE 3.
Multivariate Associations Between Parent and Patient Characteristics and Family Safety Concerns
| Characteristic | OR (95% CI) | Adjusted OR (95% CI) | P |
|---|---|---|---|
|
| |||
| Parent | |||
| Race and ethnicity | .59 | ||
| Asian/Pacific Islander, non-Hispanic | 1.19 (0.14–9.96) | 0.95 (0.08–11.88) | |
| Black/African American, non-Hispanic | 0.68 (0.14–3.42) | 0.99 (0.12–8.00) | |
| Other, non-Hispanic | 0.72 (0.15–3.41) | 0.61 (0.09–4.05) | |
| Hispanic | 0.34 (0.10–1.17) | 0.26 (0.05–1.39) | |
| White, non-Hispanic | Ref | Ref | |
| Ability to speak English | .91 | ||
| Very well | 2.05 (0.66–6.33) | 1.08 (0.25–4.71) | |
| Well/not well/not at all | Ref | Ref | |
| Education level | .02 | ||
| Completed college or higher | 2.83 (1.41–5.67) | 2.94 (1.21–7.14) | |
| Some college or less | Ref | Ref | |
| Health literacy (Newest Vital Sign) | .35 | ||
| Adequate literacy | 2.76 (0.97–7.81) | 1.88 (0.48–7.41) | |
| Unknown | 2.32 (0.66–8.15) | 0.88 (0.17–4.66) | |
| Limited literacy | Ref | Ref | |
| Parent-Patient Activation Measure linear levels | .06 | ||
| Top-box (Level 4) | 0.54 (0.25–1.14) | 0.33 (0.13–0.86) | |
| Missing | 1.00 (0.35–2.85) | 0.81 (0.20–3.25) | |
| Levels 1–3 | Ref | Ref | |
| Patient | |||
| Age, y, mean (SD)a | 1.01 (0.96–1.07) | 1.02 (0.97–1.02) | .47 |
| Times admitted to hospital in lifetime, mean (SD)a | 1.01 (0.99–1.03) | 0.99 (0.96–1.09) | .62 |
| Visit | |||
| Length of stay >5 da | .01 | ||
| Yes | 2.25 (1.12–4.53) | 3.08 (1.29–7.38) | |
| No | Ref | Ref | |
OR, odds ratio.
Multivariate model included candidate variables with P <.20.
Data are collected from the Pediatric Health Information System and hospital electronic medical records.
Parent Experience With Safety Reporting
When providing additional details about their safety concerns, 31% (n = 20) of family concerns were “good catches” and 20% (n = 13) mistakes not harming the child. Overall, 68% of parents with safety concerns reported concerns to staff (n = 43), predominantly a bedside nurse (86%, n = 37), doctor (44%, n = 19), or charge nurse (16%, n = 7). Only 2% (n = 1) reported to Patient Relations. Most reported nonanonymously (98%, n = 42), verbally in person (95%, n = 41), and immediately (74%, n = 32). Desired outcomes after reporting were fixing the problem (65%, n = 28) and preventing it from happening to others (33%, n = 14). After parents reported their concern, 21% (n = 9) stated medical care changed and 16% (n = 7) stated someone apologized. Most parents were very/extremely satisfied (62%, n =15) with staff response to reports. For the 32% who did not tell staff, the most common reasons were that it was “not a big deal” (35%, n = 7) and not wanting to be perceived as “difficult” (20%, n = 4). Most parents (68%, n = 89) responded “no” to the Child HCAHPS item asking whether staff had told them how to report concerns about mistakes during hospitalization.
Parent/Staff Safety Beliefs
Overall, 84% (n = 177) of staff versus 70% (n = 109) of parents said it was parents’, doctors’, nurses’, and other hospital staffs’ job together to ensure children receive safe hospital care (P = .001) as opposed to it being only parents’ or specific hospital staffs’ job. Parents and staff had similar responses for most safety climate survey items (Fig 2). However, staff were more likely than parents to agree/strongly agree that there were safety problems in the unit (31% of staff versus 5% of parents, P < .001). Staff were also less likely to agree/strongly agree that patient safety is never sacrificed to get more work done (48% of staff versus 73% of parents, P < .001).
FIGURE 2.

Parent versus staff safety climate.
Staff Experiences of Family Safety Reporting
Complex care staff received 28 family reports total. Overall, 17% (n = 23) of staff received a family-reported harmful error (n = 2), nonharmful error (n = 13), or safety concern (n = 13) over the past week. Medication concerns (36%, n = 10) and family–staff communication problems (18%, n = 5) were most common. Events included omitted seizure medication, a clogged enteral tube, missed chest physiotherapy, and incorrectly documented patient code status.
Staff primarily responded to family concerns by apologizing (67%, n = 16) or telling their supervisor (50%, n = 12). Only 21% (n = 5) filed a VIR in response to family concerns. Patient care changed in 56% (n = 13) of cases. Parents shared concerns with staff during exams/cares/vitals (59%, n = 82), at start of shift (49%, n = 67), or on rounds (41%, n = 56).
Overall, 4% (n = 6) of staff reported parents/caregivers made “good catches” in the past week, including correcting medication routes and missed feeds. Staff responded by thanking families (33%, n = 2) or apologizing (17%, n = 1). None reported filing a VIR in response to parents’ “good catches.”
Only 31% (n = 41) of staff reported usually/always asking families about safety concerns and 55% (n = 114) reported being very/extremely comfortable hearing from parents/caregivers about medical errors/AEs during hospitalization. Few reported receiving formal training about instructing families on sharing safety concerns (26%, n = 53) or responding to family safety concerns (32%, n = 65). Staff preferred families share safety concerns with nurses (91%, n = 191), resident physicians (66%, n = 138), or attending physicians (57%, n = 120); and that families report concerns in person (98.1%. n = 206), through Patient Relations (69%, n = 145), or by e-mail (31%, n = 66).
DISCUSSION
In this prospective cohort multiunit study of parents and staff of CMC, 3 in 7 parents had a safety concern during hospitalization. Nearly 70% were medical errors. Families with less education were less likely to have safety concerns, indicating a potential disparity and an area for improving engagement. Although families frequently had safety concerns during hospitalization, families still rated safety climate items higher than staff. Despite the fact that informing families how to report concerns is a national quality metric, only one-third of families were told by staff how to report mistakes.14 Our findings suggest that families of hospitalized CMC provide valuable and valid safety information and that hospitals have room to improve how they engage families in safety, particularly those with lower education or other barriers.
Our findings are consistent with prior studies, which show that 9% to 49% of patients/families report safety concerns during hospitalization, most of which are classified as medical errors.12,13,24–26 However, our finding that only 32% of parents were told by staff how to report safety concerns during their child’s hospitalization is even lower than published rates for this single-most-poorly rated Child HCAHPS14 item across hospitals.27 Our percentage may be lower because staff may assume families of CMC are familiar with hospital processes and neglect to proactively orient them to hospital safety. As in other studies,12,13,25,28 medications were the most common error type in our study.
CMC are vulnerable to medical errors and AEs due to multiple medications,5,29–31 malfunctioning indwelling medical devices,4 longer LOS,13,28,32–35 frequent readmissions,36–38 and fragmented communication among multiple providers.7,30,39 Families of CMC are vigilant partners40 in safety—critical members of the care team who can help identify mistakes in medical care and hospital safety. Families of CMC often have strong self-management skills, actively coordinating health care to manage chronic conditions.41–43 These skills give them particular expertise about their children’s baseline health status, quality of life, medical care, and potential deviations in care plan or changes in health.44–46 For instance, families of CMC may be particularly attuned to recognizing errors and AEs because they frequently provide specialized medical care (eg, suctioning, enteral feeds) at home and in the hospital.47,48 Because many CMC are nonverbal, their families may be particularly attuned to subtle changes in status. Families of CMC are consequently effective witnesses to gaps in communication and care delivery across providers, specialties, and facilities.46,49 Our study suggests that leveraging family expertise can improve care for patients, individually and collectively. On an individual level, families can notice clinical decompensation and help intercept potential AEs earlier than medical staff. For example, in our study, a family was the first to notice a change in their child’s abdominal exam. While the clinical team initially disregarded the family’s concern, the patient was ultimately diagnosed with intussusception. On a systems level, family input can highlight underrecognized safety vulnerabilities and prioritize quality improvement efforts. For instance, many families in our study reported their child was receiving incorrect home medications, specialized formulas, and durable medical equipment, suggesting these may be particular areas for improvement for hospitalized CMC.
Family safety reporting has value both in real time (to address in-the-moment concerns) and retrospectively (so hospitals can examine and learn from trends to help other patients). In our study, parents verbally expressed concerns to staff, mostly nurses, frequently. However, it is unclear how many family verbal reports to staff were formally documented in VIR considering that staff have competing demands and frequently underutilize VIR,50 particularly for no-harm events. The number of family reports captured in VIR is likely low, given so few staff in our study reported entering a VIR in response to family concerns, particularly for “good catches” or no-harm/low-harm events. However, even no-harm/low-harm events have important safety implications. For instance, correcting a home medication omission before it reaches the patient may not lead to harm, but may represent an underlying systems hazard around medication reconciliation that warrants improvement. No-harm events can also erode trust and hospital experience. Excluding family input compromises hospitals’ ability to comprehensively assess potential safety issues and remedies, relegating hospitals to react to issues after they occur rather than proactively prevent them. Providing patients/families a direct, easy route to share safety concerns allows hospitals to more reliably document, track, and identify otherwise unrecognized12,13,25,26,28,51 safety improvement areas that are important to patients/families. This is particularly important for patients/families who may be less likely to speak up because of educational, language, or other barriers.52–56
Despite families’ willingness to speak up about hospital safety experiences,57–59 hospitals often exclude patients/families from VIR and fail to offer clear mechanisms for family safety reporting.60 Hospitals can involve patients/families in safety reporting by including families in VIR and creating and utilizing dedicated family safety reporting mechanisms (eg, mobile family reporting tools, patient portals, comment boxes, family safety hotlines). They can also include safety reporting questions in patient experience surveys and have a designated staff member solicit family concerns in person.
Soliciting and meaningfully acting on concerns from patients/families requires additional time and resources for hospitals. This investment is worthwhile, however, because it allows hospitals to improve care in unaddressed areas that are meaningful for families, thereby improving safety and experience. Additionally, families are present and willing to help and represent an existing, underutilized resource to aid in improving safety. Partnership with families around safety also gives families agency and allows them to coproduce health care, a key tenet of patient-/familycentered care.61 However, if hospitals lack resources, they could alternatively target high-risk populations, like oncology patients and CMC, for family safety reporting.
Although families in our study frequently had safety concerns during hospitalization, they were less likely than staff to report poor safety climate scores. Families appeared to have a more positive view of safety than staff, perhaps because hospitals are not fully transparent with patients/families about safety risks during hospitalization. The National Academy of Medicine writes in To Err is Human that families are often unaware of patient safety risks62 and suggests better educating patients/families about safety as an important impetus for patient safety improvement. Hospitals will have to find ways to be more transparent about patient safety in a forthright but sensitive manner that does not alarm families.
Our study’s limitations include generalizability. We conducted it on a dedicated service for CMC at a tertiary care children’s hospital with predominantly White mothers present at the bedside. We also excluded international patients and parents speaking languages besides Spanish. Data from parents may have also suffered from recall bias and we may have missed events experienced immediately predischarge. When there was insufficient information to classify family concerns, we reviewed patient charts retrospectively, not prospectively, which is another area for future investigation. Physician-reviewers, not parent-reviewers, ultimately classified events. Future studies might include trained parent-reviewers and evaluate the overlap between physician-reviewer and parent-reviewer interpretations of error. Parent and staff surveys were also not linked by patient, an important area for future study. Additionally, while reporting is important, it is only one step of the life cycle of a safety report. Follow-up with the reporter is another important step.63 Investigating follow-up and changes resulting from family reporting are important areas for future study. Ultimately, the intended goal of family safety reporting is to improve systems and invoke actual change, not report merely for the sake of reporting.64
CONCLUSIONS
Families of hospitalized CMC, particularly more educated families, frequently had safety concerns during their child’s hospitalization. Most concerns represented medical errors. Parents often reported concerns to staff, mainly nurses, despite being infrequently told by staff how to report concerns. However, it is unclear how many concerns are entered by staff into VIR. Hospitals should proactively engage families in safety reporting, particularly those with less education and other barriers, to avoid widening disparities. Better engaging all families will allow hospitals to identify safety vulnerabilities and areas for improvement that are otherwise unrecognized and meaningful to families.
Supplementary Material
WHAT’S KNOWN ON THIS SUBJECT:
Families frequently identify valid, often otherwise unrecognized, medical errors and adverse events. However, hospitals do not actively engage families in safety reporting, and studies of family safety reporting in children with medical complexity are limited.
WHAT THIS STUDY ADDS:
Families of hospitalized children with medical complexity reliably identify medical errors even though hospital staff do not inform them how to report safety concerns. Hospitals should actively solicit family safety input, particularly for children with medical complexity, to achieve a more comprehensive, patient-centered view of safety.
ACKNOWLEDGEMENTS
We thank the patients, families, and caregivers involved in this project, as well as the research assistants, research clinicians, and unit staff.
FUNDING:
Support for this work was provided by a Harvard Medical School Office of Faculty Development Faculty Career Development Fellowship grant (PI Khan) and an Agency for Healthcare Research & Quality grant K08HS025781 (PI Khan). The views expressed herein are those of the authors and do not necessarily represent those of the funding sources.
ABBREVIATIONS
- AE
adverse event
- CCC
complex chronic conditions
- CI
confidence interval
- CMC
children with medical complexity
- HCAHPS
Hospital Consumer Assessment of Healthcare Providers and Systems
- IV
intravenous
- LOS
length of stay
- VIR
voluntary incident reporting/report
Footnotes
CONFLICT OF INTEREST DISCLOSURES: Dr Landrigan has served as a paid consultant to the Midwest Lighting Institute to help study the effect of blue light on health care provider performance and safety. Dr Landrigan has consulted with and holds equity in the I-PASS Institute, which seeks to train institutions in best handoff practices and aid in their implementation. Dr Landrigan has received consulting fees from the Missouri Hospital Association/Executive Speakers Bureau for consulting on I-PASS. In addition, Dr Landrigan has received monetary awards, honoraria, and travel reimbursement from multiple academic and professional organizations for teaching and consulting on sleep deprivation, physician performance, handoffs, and safety, and has served as an expert witness in cases regarding patient safety and sleep deprivation. Dr Baird has done consulting work for the I-PASS Patient Safety Institute. The I-PASS Patient Safety Institute is a company that seeks to train institutions in best handoff practices and aid in their implementation. The authors have indicated they have no financial relationships relevant to this article to disclose.
REFERENCES
- 1.Landrigan CP. The safety of inpatient pediatrics: preventing medical errors and injuries among hospitalized children. Pediatr Clin North Am. 2005;52(4):979–993, vii [DOI] [PubMed] [Google Scholar]
- 2.Sacchetti A, Sacchetti C, Carraccio C, Gerardi M. The potential for errors in children with special health care needs. Acad Emerg Med. 2000;7(11):1330–1333 [DOI] [PubMed] [Google Scholar]
- 3.Ahuja N, Zhao W, Xiang H. Medical errors in US pediatric inpatients with chronic conditions. Pediatrics. 2012;130(4):e786–e793 [DOI] [PubMed] [Google Scholar]
- 4.Nackers A, Ehlenbach M, Kelly MM, Werner N, Warner G, Coller RJ. Encounters from device complications among children with medical complexity. Hosp Pediatr. 2019;9(1):6–15 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Blaine K, Wright J, Pinkham A, et al. Medication order errors at hospital admission among children with medical complexity. J Patient Saf. 2022;18(1):e156–e162 [DOI] [PubMed] [Google Scholar]
- 6.Slonim AD, LaFleur BJ, Ahmed W, Joseph JG. Hospital-reported medical errors in children. Pediatrics. 2003;111(3):617–621 [DOI] [PubMed] [Google Scholar]
- 7.Patel SJ, Landrigan CP. Communication at transitions of care. Pediatr Clin North Am. 2019;66(4):751–773 [DOI] [PubMed] [Google Scholar]
- 8.Cohen E, Kuo DZ, Agrawal R, et al. Children with medical complexity: an emerging population for clinical and research initiatives. Pediatrics. 2011;127(3):529–538 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Cohen E, Berry JG, Camacho X, Anderson G, Wodchis W, Guttmann A. Patterns and costs of health care use of children with medical complexity. Pediatrics. 2012;130(6):e1463–e1470 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Feudtner C, Christakis DA, Connell FA. Pediatric deaths attributable to complex chronic conditions: a population-based study of Washington State, 19801997. Pediatrics. 2000;106(1 Pt 2 Supplement 1):205–209 [PubMed] [Google Scholar]
- 11.Simon TD, Berry J, Feudtner C, et al. Children with complex chronic conditions in inpatient hospital settings in the United States. Pediatrics. 2010; 126(4):647–655 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Khan A, Coffey M, Litterer KP, et al. ; The Patient and Family Centered I-PASS Study Group. Families as partners in hospital error and adverse event surveillance. JAMA Pediatr. 2017;171(4):372–381 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Khan A, Furtak SL, Melvin P, Rogers JE, Schuster MA, Landrigan CP. Parent-reported errors and adverse events in hospitalized children. JAMA Pediatr. 2016;170(4):e154608. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Toomey SL, Zaslavsky AM, Elliott MN, et al. The development of a pediatric in-patient experience of care measure: Child HCAHPS. Pediatrics. 2015;136(2):360–369 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Khan A, Spector ND, Baird JD, et al. Patient safety after implementation of a coproduced family centered communication programme: multicenter before and after intervention study. BMJ. 2018;363:k4764. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Cox E; University of Wisconsin-Madison Department of Pediatrics, Institute for Clinical and Translational Research, and Health Innovation Program. Children’s hospital safety climate questionnaire. Available at: www.hipxchange.org/CHSCQ. Accessed December 28, 2021
- 17.Insignia Health, LLC. Parent patient activation measure (P-PAM) Available at: www.insigniahealth.com/products/pam-survey. Accessed June 19, 2021
- 18.Weiss BD, Mays MZ, Martz W, et al.Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med. 2005;3(6):514–522 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Agency for Healthcare Research and Quality. Hospital survey on patient safety culture. Available at: www.ahrq.gov/sops/surveys/hospital/index.html. Accessed January 25, 2021
- 20.Children’s Hospital Association. Leverage clinical and resource utilization data. Available at: https://www.childrenshospitals.org/programs-and-services/data-analytics-andresearch/pediatric-analytic-solutions/pediatric-health-information-system. Accessed January 29, 2021
- 21.Bates DW, Cullen DJ, Laird N, et al. ; ADE Prevention Study Group. Incidence of adverse drug events and potential adverse drug events. Implications for prevention. JAMA. 1995;274(1):29–34 [PubMed] [Google Scholar]
- 22.Rothschild JM, Landrigan CP, Cronin JW, et al. The critical care safety study: the incidence and nature of adverse events and serious medical errors in intensive care. Crit Care Med. 2005;33(8):1694–1700 [DOI] [PubMed] [Google Scholar]
- 23.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Sahlström M, Partanen P, Turunen H. Safety as experienced by patients themselves: a Finnish survey of the most recent period of care. Res Nurs Health. 2014;37(3):194–203 [DOI] [PubMed] [Google Scholar]
- 25.Daniels JP, Hunc K, Cochrane DD, et al. Identification by families of pediatric adverse events and near misses overlooked by health care providers. CMAJ. 2012;184(1):29–34 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Weingart SN, Pagovich O, Sands DZ, et al. What can hospitalized patients tell us about adverse events? Learning from patient-reported incidents. J Gen Intern Med. 2005;20(9):830–836 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Toomey SL, Elliott MN, Zaslavsky AM, et al. Variation in family experience of pediatric inpatient care as measured by Child HCAHPS. Pediatrics. 2017;139(4):e20163372. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Weissman JS, Schneider EC, Weingart SN, et al. Comparing patient-reported hospital adverse events with medical record review: do patients know something that hospitals do not? Ann Intern Med. 2008;149(2):100–108 [DOI] [PubMed] [Google Scholar]
- 29.Berry JG, Hall M, Neff J, et al. Children with medical complexity and Medicaid: spending and cost savings. Health Aff (Millwood). 2014;33(12):2199–2206 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Huth K, Vandecruys P, Orkin J, Patel H, Canadian Pediatric Society, Community Paediatrics Committee. Medication safety for children with medical complexity. Available at: https://www.cps.ca/en/documents/position/medication-safety-for-children-with-medical-complexity. Accessed January 20, 2021 [DOI] [PMC free article] [PubMed]
- 31.Feinstein JA, Feudtner C, Kempe A. Adverse drug event-related emergency department visits associated with complex chronic conditions. Pediatrics. 2014;133(6):e1575–e1585 [DOI] [PubMed] [Google Scholar]
- 32.Berry JG, Agrawal R, Kuo DZ, et al. Characteristics of hospitalizations for patients who use a structured clinical care program for children with medical complexity. J Pediatr. 2011;159(2):284–290 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Gold JM, Hall M, Shah SS, et al. Longlength of hospital stay in children with medical complexity. J Hosp Med. 2016;11(11):750–756 [DOI] [PubMed] [Google Scholar]
- 34.Cook SC, Yu J, Imming C, Pirollo A, Henderson C, Knezevich L. Impact of enhanced care coordination on emergency department and in-patient hospital utilization and hospital length of stay for children with medical complexity. Pediatrics. 2020;146(1_MeetingAbstract):533–534 [Google Scholar]
- 35.Edwards JD, Houtrow AJ, Vasilevskis EE, et al. Chronic conditions among children admitted to U.S. pediatric intensive care units: their prevalence and impact on risk for mortality and prolonged length of stay. Crit Care Med. 2012;40(7):2196–2203 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Markham JL, Hall M, Gay JC, Bettenhausen JL, Berry JG. Length of stay and cost of pediatric readmissions. Pediatrics. 2018;141(4):e20172934. [DOI] [PubMed] [Google Scholar]
- 37.Bucholz EM, Gay JC, Hall M, Harris M, Berry JG. Timing and causes of common pediatric readmissions. J Pediatr. 2018;200:240–248.e1 [DOI] [PubMed] [Google Scholar]
- 38.Berry JG, Hall DE, Kuo DZ, et al. Hospital utilization and characteristics of patients experiencing recurrent readmissions within children’s hospitals. JAMA. 2011;305(7):682–690 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Stone BL, Boehme S, Mundorff MB, Maloney CG, Srivastava R. Hospital admission medication reconciliation in medically complex children: an observational study. Arch Dis Child. 2010;95(4):250–255 [DOI] [PubMed] [Google Scholar]
- 40.Schwappach DLB. Review: engaging patients as vigilant partners in safety: a systematic review. Med Care Res Rev. 2010;67(2):119–148 [DOI] [PubMed] [Google Scholar]
- 41.Valdez RS, Lunsford C, Bae J, Letzkus LC, Keim-Malpass J. Self-management characterization for families of children with medical complexity and their social networks: Protocol for a qualitative assessment. JMIR Res Protoc. 2020;9(1):e14810. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Henry HKM, Schor EL. Supporting self-management of chronic health problems. Pediatrics. 2015;135(5):789–792 [DOI] [PubMed] [Google Scholar]
- 43.Clark NM, Becker MH, Janz NK, Lorig K, Rakowski W, Anderson L. Self-management of chronic disease by older adults: a review and questions for research. J Aging Health. 1991;3(1):3–27 [Google Scholar]
- 44.National Institute of Nursing Research. The NINR strategic plan: advancing science, improving lives. Available at: https://www.ninr.nih.gov/newsandinformation/newsandnotes/directors-message-strategicplan-2016. Accessed October 25, 2021
- 45.Berry JG. What children with medical complexity, their families, and healthcare providers deserve from an ideal healthcare system. Available at: https://ken.childrenshealthcarecanada.ca/xwiki/wiki/changingyourlens/view/Financial+-+Employment/Berry+-+2015+-+What+Children+with+Medical+Complexity%2C+Their+Families%2C+and+Healthcare+Providers+Deserve+from+an+Ideal+Healthcare+System. Accessed October25, 2021
- 46.Berry JG, Goldmann DA, Mandl KD, et al. Health information management and perceptions of the quality of care for children with tracheotomy: a qualitative study. BMC Health Serv Res. 2011;11(1):117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Heaton J, Noyes J, Sloper P, Shah R. Families’ experiences of caring for technology-dependent children: a temporal perspective. Health Soc Care Community. 2005;13(5):441–450 [DOI] [PubMed] [Google Scholar]
- 48.Caicedo C Families with special needs children: family health, functioning, and care burden. J Am Psychiatr Nurses Assoc. 2014;20(6):398–407 [DOI] [PubMed] [Google Scholar]
- 49.Allshouse C, Comeau M, Rodgers R, Wells N. Families of children with medical complexity: a view from the front lines. Pediatrics. 2018;141(Suppl 3): S195–S201 [DOI] [PubMed] [Google Scholar]
- 50.Classen DC, Resar R, Griffin F, et al. ‘Global trigger tool’ shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff (Millwood). 2011;30(4):581–589 [DOI] [PubMed] [Google Scholar]
- 51.Zhu J, Stuver SO, Epstein AM, Schneider EC, Weissman JS, Weingart SN. Can we rely on patients’ reports of adverse events? Med Care. 2011;49(10):948–955 [DOI] [PubMed] [Google Scholar]
- 52.Luercio M, Quiñones-Pérez B, Ngo T, et al. Communicating with hospitalized families with limited English proficiency: perspectives from providers and Spanish-speaking parents. Poster session presented at: Pediatric Academic Societies (PAS) 2021 Meeting; May 1, 2021; Virtual [Google Scholar]
- 53.Zurca AD, Fisher KR, Flor RJ, et al. Communication with limited English-proficient families in the PICU. Hosp Pediatr. 2017;7(1):9–15 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Betancourt JR, Renfrew MR, Green AR, Lopez L, Wasserman M; Agency for Healthcare Research and Quality. Improving patient safety systems for patients with limited English proficiency: a guide for hospitals. Available at: https://www.ahrq.gov/sites/default/files/publications/files/lepguide.pdf. Accessed December 29, 2021
- 55.Davis RE, Jacklin R, Sevdalis N, Vincent CA. Patient involvement in patient safety: what factors influence patient participation and engagement? Health Expect. 2007;10(3):259–267 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Davis RE, Koutantji M, Vincent CA. How willing are patients to question healthcare staff on issues related to the quality and safety of their health-care? An exploratory study. Qual Saf Health Care. 2008;17(2):90–96 [DOI] [PubMed] [Google Scholar]
- 57.Mohsin-Shaikh S, Garfield S, Franklin BD. Patient involvement in medication safety in hospital: an exploratory study. Int J Clin Pharm. 2014;36(3):657–666 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Martin HM, Navne LE, Lipczak H. Involvement of patients with cancer in patient safety: a qualitative study of current practices, potentials and barriers. BMJ Qual Saf. 2013;22(10):836–842 [DOI] [PubMed] [Google Scholar]
- 59.Davis RE, Sevdalis N, Pinto A, Darzi A, Vincent CA. Patients’ attitudes towards patient involvement in safety interventions: results of two exploratory studies. Health Expect. 2013;16(4):e164–e176 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Khan A, Baird J, Kelly M, et al. Parent, provider, and hospital leader perspectives on family safety reporting in hospitalized children with medical complexity. Poster session presented at: Annual Pediatric Academic Societies Conference; Disseminated on April 30, 2020; Virtual [Google Scholar]
- 61.Batalden M, Batalden P, Margolis P, et al. Coproduction of healthcare service. BMJ Qual Saf. 2016;25(7):509–517 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Institute of Medicine. In: Kohn LT, Corrigan JM, Donaldson MS, eds. To Err Is Human:Building a Safer Health System. US: National Academies Press; 2000 [PubMed] [Google Scholar]
- 63.Noble DJ, Pronovost PJ. Underreporting of patient safety incidents reduces health care’s ability to quantify and accurately measure harm reduction. J Patient Saf. 2010;6(4):247–250 [DOI] [PubMed] [Google Scholar]
- 64.Macrae C The problem with incident reporting. BMJ Qual Saf. 2016;25(2):71–75 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
