Skip to main content
Quality & Safety in Health Care logoLink to Quality & Safety in Health Care
. 2005 Aug;14(4):273–278. doi: 10.1136/qshc.2005.014316

Safety Climate Survey: reliability of results from a multicenter ICU survey

M Kho 1, J Carbone 1, J Lucas 1, D Cook 1
PMCID: PMC1744055  PMID: 16076792

Abstract

Background: It is important to understand the clinical properties of instruments used to measure patient safety before they are used in the setting of an intensive care unit (ICU).

Methods: The Safety Climate Survey (SCSu), an instrument endorsed by the Institute for Healthcare Improvement, the Safety Culture Scale (SCSc), and the Safety Climate Mean (SCM), a subset of seven items from the SCSu, were administered in four Canadian university affiliated ICUs. All staff including nurses, allied healthcare professionals, non-clinical staff, intensivists, and managers were invited to participate in the cross sectional survey.

Results: The response rate was 74% (313/426). The internal consistency of the SCSu and SCSc was 0.86 and 0.80, respectively, while the SCM performed poorly at 0.51. Because of poor internal consistency, no further analysis of the SCM was therefore performed. Test-retest reliability of the SCSu and SCSc was 0.92. Out of a maximum score of 5, the mean (SD) scores of the SCSu and SCSc were 3.4 (0.6) and 3.4 (0.7), respectively. No differences were noted between the three medical-surgical and one cardiovascular ICU. Managers perceived a significantly more positive safety climate than other staff, as measured by the SCSu and SCSc. These results need to be interpreted cautiously because of the small number of management participants.

Conclusions: Of the three instruments, the SCSu and SCSc appear to be measuring one construct and are sufficiently reliable. Future research should examine the properties of patient safety instruments in other ICUs, including responsiveness to change, to ensure that they are valid outcome measures for patient safety initiatives.

Full Text

The Full Text of this article is available as a PDF (73.2 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Baker G. Ross, Norton Peter G., Flintoft Virginia, Blais Régis, Brown Adalsteinn, Cox Jafna, Etchells Ed, Ghali William A., Hébert Philip, Majumdar Sumit R. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ. 2004 May 25;170(11):1678–1686. doi: 10.1503/cmaj.1040498. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Landis J. R., Koch G. G. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–174. [PubMed] [Google Scholar]
  3. Pronovost P. J., Weast B., Holzmueller C. G., Rosenstein B. J., Kidwell R. P., Haller K. B., Feroli E. R., Sexton J. B., Rubin H. R. Evaluation of the culture of safety: survey of clinicians and managers in an academic medical center. Qual Saf Health Care. 2003 Dec;12(6):405–410. doi: 10.1136/qhc.12.6.405. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Sexton J. B., Thomas E. J., Helmreich R. L. Error, stress, and teamwork in medicine and aviation: cross sectional surveys. BMJ. 2000 Mar 18;320(7237):745–749. doi: 10.1136/bmj.320.7237.745. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Thomas Eric J., Sexton J. Bryan, Helmreich Robert L. Discrepant attitudes about teamwork among critical care nurses and physicians. Crit Care Med. 2003 Mar;31(3):956–959. doi: 10.1097/01.CCM.0000056183.89175.76. [DOI] [PubMed] [Google Scholar]
  6. Walter S. D., Eliasziw M., Donner A. Sample size and optimal designs for reliability studies. Stat Med. 1998 Jan 15;17(1):101–110. doi: 10.1002/(sici)1097-0258(19980115)17:1<101::aid-sim727>3.0.co;2-e. [DOI] [PubMed] [Google Scholar]

Articles from Quality & safety in health care are provided here courtesy of BMJ Publishing Group

RESOURCES