Abstract
Background
Nurse engagement is a modifiable element of the work environment and has shown promise as a potential safety intervention.
Purpose
Our study examined the relationship between the level of engagement, staffing, and assessments of patient safety among nurses working in hospital settings.
Methods
A secondary analysis of linked cross-sectional data was conducted using survey data of 26,960 nurses across 599 hospitals in 4 states. Logistic regression models were used to examine the association between nurse engagement, staffing, and nurse assessments of patient safety.
Results
Thirty-two percent of nurses gave their hospital a poor or failing patient safety grade. In 25% of hospitals, nurses fell in the “least” or only “somewhat” engaged categories. A 1-unit increase in engagement lowered the odds of an unfavorable safety grade by 29% (p <.001). Hospitals where nurses reported higher levels of engagement were 19% (p<.001) less likely to report that mistakes were held against them. Nurses in poorly staffed hospitals were 6% more likely to report that important information about patients “fell through the cracks” when transferring patients across units (p<.001).
Conclusions
Interventions to improve nurse engagement and adequate staffing serve as strategies to improve patient safety.
Keywords: nurses, nurse engagement, nurse staffing, patient safety
Nearly 20 years have passed since the release of the Institute of Medicine (IOM) report, To Err is Human: Building a Safer Health System. Although initiatives to reduce patient harm have proliferated over this period, safety concerns persist.1 A major recommendation of the IOM was the promising strategy of transforming nurse work environments to keep patients safe.2 Yet, in large part, patient safety initiatives have focused on specific interventions, such as check lists, care bundles, and improved electronic health records, rather than on simultaneously improving nurse work environments. 3 Thus, after almost 2 decades of substantial investments in patient safety improvement, it is important to reevaluate whether nurse work environments remain important in achieving safer care.
The nurse work environment, defined as characteristics of a practice setting that facilitate or constrain professional nursing practice, has been linked to patient outcomes.4–6 Good nurse work environments are characterized by safe nurse staffing levels, good communication and team work with physicians, competent nurse managers, and support from hospital management to enable nurses to provide effective and efficient patient care.7 Nurses practicing in good work environments are also highly engaged in the governance and decision-making of their institutions.8 Interestingly, few studies have examined the relationship between nurse engagement and patient safety. Our paper explores this relationship.
Nurse engagement and outcomes: An evolving field of study
The concept of engagement has emerged over the past 2 decades from disciplines such as organizational psychology, sociology of complex organizations, and business. Engagement has been defined as worker inclusion in organizational decision-making, inter-professional collaboration, and opportunities for professional development.9–11 In health systems, nurse engagement can involve participation in advisory boards, unit councils, and a range of hospital committees. Wider clinician participation in interdisciplinary and cross-departmental activities is believed to help align institutional priorities and policies with patient care requirements by actively engaging those who have the most contact with patients and families. High levels of nurse engagement have been linked to better workforce outcomes, including lower staff turnover, lower burnout, and higher reports of job satisfaction.12, 13
Studies have more recently begun to investigate whether greater nurse engagement in organizational decision-making is associated with improved patient outcomes. Kutney-Lee and colleagues found that in hospitals with highly engaged nurses, patients reported more favorable ratings of their hospitals.14 Similarly, Pearson and colleagues determined that nurse engagement initiatives were associated with lower pressure ulcer prevalence and improved patient satisfaction.15 While a growing number of studies have linked nurse engagement with patient outcomes,14,16 few have examined the relationship between level of nurse engagement and global assessments of patient safety and patient safety climate.
Understanding whether nurse engagement is associated with patient safety is vital to identifying actionable, affordable, and value-added strategies that hold promise for improving care outcomes. Nurses, because of their close proximity to patients, constitute the surveillance system for early identification of clinical complications and errors of commission or omission. Nurses have direct knowledge of patients and changes in conditions, and are often the first to identify clinical deterioration and mobilize life-saving interventions.6 Yet, the hierarchical management structure of many hospitals may prevent nurses from having a ‘voice’ in important patient safety policies and interventions.10 The 2017 Workforce Engagement Benchmark Report of the Advisory Board, for example, found that 60% of the 76,419 nurses surveyed were disengaged from their workplace, which represents a tremendous amount of expertise not being utilized by these organizations to improve patient care.17 Likewise, Rivera and colleagues surveyed 510 registered nurses (RNs) in a single-institution study and found that only 31% of nurses were actively engaged in the workplace.11 Researchers have identified a number of factors preventing nurse engagement, including heavy patient workloads, inadequate managerial support, and lack of professional autonomy.18–20 Highest levels of engagement have been found among nurses working in administrative roles or among RNs working less than 6 months.21
It is well established that organizational features of nursing such as better staffing ratios are related to improved patient outcomes, including lower mortality, fewer falls, and lower rates of infection.22–24 The purpose of this study was to examine whether nurses’ assessments of patient safety differ under varying levels of nurse engagement and staffing.
METHODS
Our study was informed by Donabedian’s conceptual model of health care quality. We examined the relationship between hospital nursing structure (represented by nurse staffing levels and level of nurse engagement in hospital affairs) and outcomes (indicators of patient safety).25,26
Samples and setting
This was a study of patient safety ratings in 599 representative hospitals in 4 large states (CA, FL, NJ, PA). This study involved a secondary analysis of 2 linked data sources: (1) The 2007 American Hospital Association (AHA) Annual Survey of Hospitals and (2) the 2006–2007 Penn Multi-State Nursing Care and Patient Safety Survey.7 Virtually all hospitals in the 4 states were included in the study, thus eliminating by design non-response bias at the hospital level which is the greatest threat to the study of organizational performance. The 4 states account for close to a quarter of all hospital discharges in the country; the hospitals in these states are similar in characteristics to hospitals nationally. We did not seek hospital permission for their inclusion, as denials would likely eliminate hospitals concerned about patient safety and thus bias our results. Instead, we used a combination of publically available information on hospital characteristics and primary data from nurse informants collected through a survey of nurses at their homes.
Nurses provided us with information about the hospitals where they were employed including the name of the hospital, and in the case of staffing and engagement we aggregated nurses’ responses to their hospitals of employment. Patient safety reports were examined at the nurse level. Our nurse sample was randomly selected from state boards of nursing lists of RNs and yielded responses from 26,960 inpatient staff nurses for a survey response rate of 39%. A survey of non-respondents that achieved a 90% response rate found no non-response bias on the variables of interest in this study.27 Having deleted hospitals with fewer than 10 responses, the average number of nurse respondents per hospital was 47 with a range from 10 to 276.
The AHA dataset provided information on the hospitals including their size, the availability of high technology, measured by the conduct of organ transplants and/or open heart surgery, teaching status, and whether they were located in an urban or rural setting.14 Study inclusion criteria required hospitals to be present in both data sets and have a minimum of 10 inpatient staff nurse respondents. Previous research documented acceptable reliability from nurse-reported measures for a minimum of 10 nurses per hospital.14,28 Nurse survey data were merged with the AHA data using hospital identifiers common to both data sets. A comprehensive description of the survey methodology has been published previously.7 This study was approved by the authors’ University Human Subjects Review Committee.
Measures
The primary variables of interest for this investigation included nurse engagement in hospital affairs, patient-to-nurse staffing ratios, and nurse reports of patient safety. Staffing and engagement served as the independent variables and patient safety grade and 7 indicators of hospital safety climate were dependent variables.
Nurse Engagement
Three questions from the Practice Environment Scale of the Nursing Work Index (PES-NWI), a valid and reliable instrument, included in our nurse survey were used to create a Guttman scale to measure nurse engagement.14,29 Nurses’ responses to these 3 questions indicated 1 of 4 potential levels of engagement. Nurses who reported the opportunity to participate in policy decisions were considered most engaged. Nurses who reported the opportunity to serve on hospital internal governance committees were considered moderately engaged. Nurses who reported the opportunity to serve on nursing committees were considered somewhat engaged. Nurses who disagreed that any of these opportunities were available were considered least engaged. For hospital-level analyses, hospitals were grouped into 4 categories – most, moderately, somewhat, and least engaged – based on the median engagement score of nurses in each hospital.
Staffing
Nurse respondents reported the number of patients and nurses on their unit during their last shift. The staffing ratio was the total number of patients divided by the total number of nurses. Responses were averaged across all the nurses reporting for each hospital.
Patient Safety
Our measures of patient safety were based on the Agency for Healthcare Research and Quality’s (AHRQ) Hospital Survey on Patient Safety Culture. This survey is a 51-item instrument, which is described in detail in a previous publication.30 To reduce respondent burden, our nurse survey included 8 items from the AHRQ survey to gauge nurses’ assessments of safety in their units.30,31 Nurses were first asked to respond to a single global safety item by giving their unit an overall grade on patient safety using a 5-point Likert scale. Responses were dichotomized into favorable (a grade of A/Excellent or B/Good) and unfavorable (a grade of C/Acceptable, D/Poor, or F/Failing). Seven additional safety climate questions asked nurses if mistakes were held against them, if important patient care information was often lost during handoffs, and whether things “fall between the cracks” when transferring patients. Nurses were also asked if they felt free to question authority, if ways to prevent errors were discussed, whether feedback was given about changes put in place based on event reports, and if patient safety is a top priority for hospital management. Respondents were asked to answer using a 5-point scale based on level of patient safety concern (strongly agree, agree, neutral, disagree, and strongly disagree). We then dichotomized responses based on level of agreement (agree and strongly agree) or disagreement (neither, disagree and strongly disagree). Psychometric properties of these items, including factor analysis, reliability testing, and convergent validity assessment were detailed previously.31
Covariates
Characteristics collected from the nurse survey served as control variables during analysis. Prior research suggests that nurses’ ratings of patient safety and quality may be influenced by nurse’s age, the number of years working as a nurse, their sex, and full-time status, and hence are accounted for in our analysis.4 ICU nurse status was accounted for as a control due to differences in staffing between ICUs and medical-surgical units.4 Similarly, characteristics collected from the AHA survey served as control variables. These characteristics included hospital size, urban/rural location, teaching status, technology status, and state.
Data analysis
Hospital and nursing characteristics, including frequency distributions, measures of central tendency, and bivariate correlations, were evaluated. Logistic regression models were then used to determine the association of nurse engagement and nurse staffing on our outcome of unfavorable patient safety ratings and patient safety climate before and after controlling for nurse and hospital characteristics. All analyses were completed using STATA (version 14.2, College Station, Texas). The level of significance was set at p<.05. All tests were 2-tailed, and the analyses also accounted for the clustering of nurses within hospitals.
RESULTS
Characteristics of hospital and nursing sample
Hospitals in the sample were distributed across the 4 study states, with the largest share of hospitals in California (39%). The majority were located in urban regions (91%), and classified as low technology status (57%), non-teaching (52%), and medium (44%) in terms of bed size. Nurse responses were aggregated by institution and characteristics were reported at the hospital level. Approximately 31% of nurses reported caring for an average of 5–6 patients. Thirty-eight percent (n=227) of the hospitals were classified as having the most engaged nurses, 37% (n=223) had moderately engaged nurses, 21% (n=124) had somewhat engaged nurses, and 4 % (n=25) were classified as the least engaged (Supplemental Digital Content, Table). The majority of nurse survey respondents were female (93%) and worked full-time (69%). On average, nurses were approximately 44 years of age, and had 16 years of experience as an RN.
Nurses’ responses to patient safety questions
Thirty-two percent of nurses gave their practice settings an unfavorable patient safety grade (C, D or F). Thirteen percent of nurse respondents agreed or strongly agreed that ways to prevent errors were not discussed, while 16% agreed or strongly agreed that the actions of administrators demonstrated that safety was a top priority. Twenty-seven percent of nurses reported not receiving feedback about changes put in place after an incident report. Thirty-one percent of nurses reported that information about patients was lost during shift change, while 36% agreed or strongly agreed that things fall through the cracks when transferring patients. Thirty-eight percent of nurses reported feeling constrained in their ability to question authority, while 41% believed their mistakes were held against them (Supplemental Digital Content, Figure).
The Table presents the results of logistic regression models that jointly estimated the association of nurse engagement and nurse staffing on the odds of a hospital receiving an unfavorable patient safety grade. After adjusting for hospital and nursing characteristics, each additional patient per nurse was associated with an increase in the odds of a hospital receiving an unfavorable patient safety grade by a factor of 1.06 (95% CI = 1.03–1.10) or an increase of 6%. Likewise, for each unit increase in nurse engagement (e.g. least engaged to somewhat engaged), the odds of a hospital receiving an unfavorable patient safety grade decreased by a factor of .71 (95% CI = .68–.75) or a decrease of 29%.
Similar patterns were found when examining our additional 7 patient safety climate questions (Table). Level of nurse engagement had a significant effect on all 7 safety climate questions, before and after controlling for potential confounding variables. Among the adjusted models, the largest effect of a 1-unit change in engagement status (eg, from moderately to most engaged) was found when nurses were asked about administrative support. In this instance, more engaged nurses 35% less likely to report a failure of administrators to prioritize patient safety (p<.001). More engaged nurses were also more likely to report feedback about changes based on incident reports (26%, p<.001), discuss error prevention strategies (24%, p<.001) and feel free to question authority (21%, p<.001). Furthermore, higher engaged nurses were less likely to report mistakes were held against them (19%, p<.001), important information was lost during shift change (13%, p<.001), or that things fell through the cracks during patient transfer (12%, p<.001).
Table.
Nurse Engagement
|
Nurse Staffing
|
|||
---|---|---|---|---|
OR (95% CI) | p-value | OR (95% CI) | p-value | |
Unfavorable patient safety grade | .71 (.68–.75) | <.001 | 1.06 (1.03–1.10) | <.001 |
| ||||
Ways to prevent errors from occurring are not discussed | .76 (.72–.80) | <.001 | 1.02 (.98–1.06) | .375 |
| ||||
Actions of administrators do not show that patient safety is a top priority | .65 (.61–.69) | <.001 | 1.05 (1.01–1.10) | .023 |
| ||||
We are not given feedback about changes put in place based on incident reports | .74 (.71–77) | <.001 | 1.01 (.97–1.04) | .646 |
| ||||
Important information about patients is lost during shift change | .87 (.83–.91) | <.001 | 1.05 (1.02–1.09) | .002 |
| ||||
Things fall through the cracks when transferring patients | .88 (.85–.92) | <.001 | 1.06 (1.02–1.09) | .001 |
| ||||
Staff do not feel free to question decisions of those in authority | .79 (.76–.82) | <.001 | 1.07 (1.04–1.10) | <.001 |
| ||||
Staff feel mistakes are held against them | .81 (.78–.85) | <.001 | 1.03 (.10–1.07) | .064 |
Abbreviations: OR, odds ratio; CI, confidence interval.
Odds Ratios are from logistic regression models that estimate the net effects of a 1-unit increase in Nurse Staffing (1 additional patient per nurse) or a 1-category shift in Nurse Engagement (eg, from least to somewhat or somewhat to moderate, on engagement) on the odds of unfavorable nurse responses to patient safety questions. All models adjust (or control) for nurse characteristics and hospital characteristics.
After controlling for potential confounders, nurse staffing remained significant for 4 of the 7 safety climate questions. For instance, among the adjusted models, a 1-unit increase in staffing (ie, 1 additional patient per nurse) increased the odds that nurses would not feel free to questions authority by 7% (p<.001). Similarly, a 1-unit increase in staffing was associated with a 5% (p=.002) increase in the odds of nurses reporting that important information about patients was often lost during shift change and a 6% (p<.001) increase in the odds that information fell through the cracks. Finally, a 1-unit increase in staffing was associated wth a 5% (p=.023) increase in the odds of a nurse reporting that administrator actions do not support patient safety as a top priority.
DISCUSSION
Using nurse-and hospital-level data, the effects of nurse engagement and staffing on patient safety assessments were explored. Our results revealed that higher levels of nurse engagement and more favorable nurse-to-patient staffing ratios were consistently associated with positive ratings of patient safety. Our findings of a relationship between nurse staffing and patient safety are consistent with the work of others who have noted increased medical errors and threats to patient safety when staffing is inadequate.6,7 In our sample, nurses consistently reported patient safety concerns, including patient information falling through the cracks when nurses assumed high patient workloads, suggesting that further investments in nurse staffing may increase nurses’ ability to detect patient safety threats and intervene when they occur.
While increased staffing appears to be closely tied to efforts to improve patient safety, doing so may not be immediately feasible for all institutions due to financial constraints. Our findings of a relationship between engagement and reports of patient safety, even after accounting for staffing, suggest that an additional opportunity to improve assessments of patient safety may lie in increasing the opportunities for nurses to engage in decision-making bodies in hospital settings. A number of health care systems have now initiated efforts to increase nurse engagement in patient safety initiatives.
Wadsworth, Felton, and Linus, for example, described their health system’s effort to increase nurse engagement by revising the system’s professional practice model and aligning council goals around a vision of enhanced authentic leadership and shared decision-making.16 This effort is in line with recent initiatives including the IOM report, which advocates for the inclusion of nurses on boards and committees.32 Recommendations from the report prompted the creation of the Nurses on Boards Coalition, which strives for 10,000 nurses on boards by 2020.33 The report is further aligned with the Exemplary Professional Practice domain of the Magnet Recognition Program®, which emphasizes the importance of nurse autonomy, supporting and promoting the organization’s shared governance decision making structure to influence policy and patient care. 14,34,35
Our measurement of engagement involves nurses’ levels of participation in decision-making within healthcare systems. Evidence suggests increasing pathways for nurses to lead and participate in committees, unit-based and hospital-wide councils, and governing boards are an effective way to increase patient safety.10,14 Improving nurse engagement and staffing also has important benefits for the workforce since nurses working in exemplary professional practice environments report less burn out, turn over and intent to leave.14 Our research represents an important addition to the growing body of literature linking investments in nursing as a means to increase safety. Future research might more explicitly examine the relationship between nurse engagement and patient outcomes.
Limitations
Due to the cross sectional nature of our study we are unable to determine causality between our measure of engagement, staffing and assessments of patient safety. Our sample of hospitals only included nurses and hospitals from 4 states. We do not regard this as a major drawback, however, as these are populous states where approximately 20% of all hospitalizations occur.36 Finally, we note that the date of our survey, which was collected in 2006–2007, may raise concerns about the applicability of findings today. Prior analyses of similar data from Pennsylvania hospitals in 1999 and 2006, however, showed that while there were modest changes in nursing characteristics (eg, nurse staffing and nurse work environments) and sizable decreases in adverse patient events over the period, the relationship between nursing and patient outcomes was very similar at both time points.35 Our prior research, in addition to the work of others, supports the persistent relationship between nurse engagement and patient outcomes.14,16
CONCLUSION
This study examined the survey responses of thousands of nurses across hunderds of hospital settings. Our findings suggest an association between level of nurse engagement, nurse staffing, and assessments of patient safety. Future investments in patient safety must promote adequate nursing resources and full engagement of nurses providing direct patient care.
Supplementary Material
Acknowledgments
This research was supported by the National Institute of Nursing Research (R01-NR04513, T32-NR0714, L. Aiken, Principal Investigator).
Footnotes
The authors declare no conflicts of interest.
References
- 1.Donaldson MS, Corrigan JM, Kohn LT. To err is human: Building a safer health system. Vol. 6. National Academies Press; 2000. [PubMed] [Google Scholar]
- 2.Page A. Keeping patients safe: Transforming the work environment of nurses. National Academies Press; 2004. [PubMed] [Google Scholar]
- 3.Hyman D, Neiman J, Rannie M, Allen R, Swietlik M, Balzer A. Innovative use of the electronic health record to support harm reduction efforts. Pediatrics. 2017;139(5) doi: 10.1542/peds.2015-3410. [DOI] [PubMed] [Google Scholar]
- 4.Aiken LH, Clarke SP, Sloane DM, Lake ET, Cheney T. Effects of hospital care environment on patient mortality and nurse outcomes. J Nurs Adm. 2008;39(7–8):S45–S51. doi: 10.1097/NNA.0b013e3181aeb4cf. [DOI] [PubMed] [Google Scholar]
- 5.Lake ET, Hallowell SG, Kutney-Lee A, et al. Higher quality of care and patient safety associated with better NICU work environments. J Nurs Care Qual. 2016;31(1):24–32. doi: 10.1097/NCQ.0000000000000146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.McHugh MD, Rochman MF, Sloane DM, et al. Better nurse staffing and nurse work environments associated with increased survival of in-hospital cardiac arrest patients. Med Care. 2016;54(1):74–80. doi: 10.1097/MLR.0000000000000456. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Aiken LH, Cimiotti JP, Sloane DM, Smith HL, Flynn L, Neff DF. Effects of nurse staffing and nurse education on patient deaths in hospitals with different nurse work environments. Med Care. 2011;49(12):1047–1053. doi: 10.1097/MLR.0b013e3182330b6e. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.García-Sierra R, Fernández-Castro J, Martínez-Zaragoza F. Work engagement in nursing: An integrative review of the literature. J Nurs Manag. 2016;24(2):E101–E111. doi: 10.1111/jonm.12312. [DOI] [PubMed] [Google Scholar]
- 9.Brandis S, Brandis S, Rice J, Rice J, Schleimer S, Schleimer S. Dynamic workplace interactions for improving patient safety climate. J Health Organ Manag. 2017;31(1):38–53. doi: 10.1108/JHOM-09-2016-0185. [DOI] [PubMed] [Google Scholar]
- 10.Prybil LD. Nursing engagement in governing health care organizations: Past, present, and future. J Nurs Care Qual. 2016;31(4):299–303. doi: 10.1097/NCQ.0000000000000182. [DOI] [PubMed] [Google Scholar]
- 11.Rivera RR, Fitzpatrick JJ, Boyle SM. Closing the RN engagement gap: Which drivers of engagement matter? J Nurs Adm. 2011;41(6):265–272. doi: 10.1097/NNA.0b013e31821c476c. [DOI] [PubMed] [Google Scholar]
- 12.Laschinger HKS. Job and career satisfaction and turnover intentions of newly graduated nurses. J Nurs Manag. 2012;20(4):472–484. doi: 10.1111/j.1365-2834.2011.01293.x. [DOI] [PubMed] [Google Scholar]
- 13.Simpson MR. Predictors of work engagement among medical-surgical registered nurses. West J Nurs Res. 2009;31(1):44–65. doi: 10.1177/0193945908319993. [DOI] [PubMed] [Google Scholar]
- 14.Kutney-Lee A, Germack H, Hatfield L, et al. Nurse engagement in shared governance and patient and nurse outcomes. J Nurs Adm. 2016;46(11):605–612. doi: 10.1097/NNA.0000000000000412. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Pearson ML, Needleman J, Beckman R, Han B. Facilitating nurses' engagement in hospital quality improvement: The New Jersey hospital association's implementation of transforming care at the bedside. J Healthc Qual. 2016;38(6):e64–e75. doi: 10.1097/JHQ.0000000000000007. [DOI] [PubMed] [Google Scholar]
- 16.Wadsworth B, Felton F, Linus R. SOARing into strategic planning: Engaging nurses to achieve significant outcomes. Nurs Adm Q. 2016;40(4):299–306. doi: 10.1097/NAQ.0000000000000182. [DOI] [PubMed] [Google Scholar]
- 17.Advisory Board. [Accessed July 20, 2017];Hospital workforce engagement benchmark report. 2013 Advisory Board Web site. http://ns.advisory.com/Employee-Engagement-Initiative-Hospital-2013-Workforce-Engagement-Benchmark-Report. Updated 2013.
- 18.Bamford M, Wong CA, Laschinger H. The influence of authentic leadership and areas of worklife on work engagement of registered nurses. J Nurs Manag. 2013;21(3):529–540. doi: 10.1111/j.1365-2834.2012.01399.x. [DOI] [PubMed] [Google Scholar]
- 19.Freeney YM, Tiernan J. Exploration of the facilitators of and barriers to work engagement in nursing. Int J Nurs Stud. 2009;46(12):1557–1565. doi: 10.1016/j.ijnurstu.2009.05.003. [DOI] [PubMed] [Google Scholar]
- 20.Othman N, Nasurdin AM. Social support and work engagement: A study of Malaysian nurses. J Nurs Manag. 2013;21(8):1083–1090. doi: 10.1111/j.1365-2834.2012.01448.x. [DOI] [PubMed] [Google Scholar]
- 21.Dempsey C, Reilly B, Buhlman N. Improving the patient experience: Real-world strategies for engaging nurses. J Nurs Adm. 2014;44(3):142–151. doi: 10.1097/NNA.0000000000000042. [DOI] [PubMed] [Google Scholar]
- 22.Cimiotti JP, Aiken LH, Sloane DM, Wu ES. Nurse staffing, burnout, and health care–associated infection. Am J Infect Control. 2012;40(6):486–490. doi: 10.1016/j.ajic.2012.02.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.He J, Staggs VS, Bergquist-Beringer S, Dunton N. Nurse staffing and patient outcomes: A longitudinal study on trend and seasonality. BMC Nursing. 2016;15(1):60. doi: 10.1186/s12912-016-0181-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Needleman J, Buerhaus P, Pankratz VS, Leibson CL, Stevens SR, Harris M. Nurse staffing and inpatient hospital mortality. N Engl J Med. 2011;364(11):1037–1045. doi: 10.1056/NEJMsa1001025. [DOI] [PubMed] [Google Scholar]
- 25.Donabedian A. An introduction to quality assurance in health care. Oxford University Press; 2002. [Google Scholar]
- 26.Donabedian A. The quality of care: How can it be assessed? JAMA. 1988;260(12):1743–1748. doi: 10.1001/jama.260.12.1743. [DOI] [PubMed] [Google Scholar]
- 27.Smith HL. Double sample to minimize bias due to non-response in a mail survey. Philadelphia, PA: Population Studies Center, University of Pennsylvania; PSC Working Paper Series, No. 09-05. 2009. [English version of Smith 2008.] [Google Scholar]
- 28.McHugh MD, Stimpfel AW. Nurse reported quality of care: A measure of hospital quality. Res Nurs Health. 2012;35(6):566–575. doi: 10.1002/nur.21503. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Lake ET. Development of the practice environment scale of the nursing work index. Res Nurs Health. 2002;25(3):176–188. doi: 10.1002/nur.10032. [DOI] [PubMed] [Google Scholar]
- 30.Sorra J, Nieva V. hospital survey on patient safety culture (prepared by Westat, Rockville, MD, under contract no. 290-96-0004). AHRQ publication no. 04-0041. Agency for Healthcare Research and Quality; Rockville, MD: 2007. [Google Scholar]
- 31.Olds DM, Aiken LH, Cimiotti JP, Lake ET. Association of nurse work environment and safety climate on patient mortality: A cross-sectional study. Int J Nurs Stud. 2017;74:155–161. doi: 10.1016/j.ijnurstu.2017.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Institute of Medicine (US) The future of nursing: Leading change, advancing health. National Academies Press; Washington, DC: 2011. Committee on the Robert Wood Johnson Foundation Initiative on the Future of Nursing. [PubMed] [Google Scholar]
- 33.Nurses on Boards Coalition. https://www.nursesonboardscoalition.org/about. Updated 2018.
- 34.American Nurse Credentialing Center. 2019 Magnet application manual. American Nurses Credentialing Center; Silver Spring MD: 2019. [Google Scholar]
- 35.Kutney-Lee A, Stimpfel AW, Sloane DM, Cimiotti JP, Quinn LW, Aiken LH. Changes in patient and nurse outcomes associated with Magnet hospital recognition. Med Care. 2015;53(6):550–557. doi: 10.1097/MLR.0000000000000355. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Carthon JM, Lasater KB, Sloane DM, Kutney-Lee A. The quality of hospital work environments and missed nursing care is linked to heart failure readmissions: A cross-sectional study of US hospitals. BMJ Qual Saf. 2015;24(4):255–263. doi: 10.1136/bmjqs-2014-003346. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.