Skip to main content
NCBI home page
Springer Nature - PMC COVID-19 Collection logoLink to Springer Nature - PMC COVID-19 Collection
. 2023 Apr 15:1–10. Online ahead of print. doi: 10.1007/s11684-022-0970-x

Evaluation of ICUs and weight of quality control indicators: an exploratory study based on Chinese ICU quality data from 2015 to 2020

Longxiang Su 1,#, Xudong Ma 2,#, Sifa Gao 2,#, Zhi Yin 3,#, Yujie Chen 1, Wenhu Wang 3, Huaiwu He 1, Wei Du 1, Yaoda Hu 4, Dandan Ma 5, Feng Zhang 5, Wen Zhu 5, Xiaoyang Meng 5, Guoqiang Sun 5, Lian Ma 5, Huizhen Jiang 5, Guangliang Shan 4,✉, Dawei Liu 1,✉, Xiang Zhou 1,5,✉; China-NCCQC
PMCID: PMC10105137  PMID: 37060524

Abstract

This study aimed to explore key quality control factors that affected the prognosis of intensive care unit (ICU) patients in Chinese mainland over six years (2015–2020). The data for this study were from 31 provincial and municipal hospitals (3425 hospital ICUs) and included 2 110 685 ICU patients, for a total of 27 607 376 ICU hospitalization days. We found that 15 initially established quality control indicators were good predictors of patient prognosis, including percentage of ICU patients out of all inpatients (%), percentage of ICU bed occupancy of total inpatient bed occupancy (%), percentage of all ICU inpatients with an APACHE II score ⩾15 (%), three-hour (surviving sepsis campaign) SSC bundle compliance (%), six-hour SSC bundle compliance (%), rate of microbe detection before antibiotics (%), percentage of drug deep venous thrombosis (DVT) prophylaxis (%), percentage of unplanned endotracheal extubations (%), percentage of patients reintubated within 48 hours (%), unplanned transfers to the ICU (%), 48-h ICU readmission rate (%), ventilator associated pneumonia (VAP) (per 1000 ventilator days), catheter related blood stream infection (CRBSI) (per 1000 catheter days), catheter-associated urinary tract infections (CAUTI) (per 1000 catheter days), in-hospital mortality (%). When exploratory factor analysis was applied, the 15 indicators were divided into 6 core elements that varied in weight regarding quality evaluation: nosocomial infection management (21.35%), compliance with the Surviving Sepsis Campaign guidelines (17.97%), ICU resources (17.46%), airway management (15.53%), prevention of deep-vein thrombosis (14.07%), and severity of patient condition (13.61%). Based on the different weights of the core elements associated with the 15 indicators, we developed an integrated quality scoring system defined as F score=21.35%xnosocomial infection management + 17.97%xcompliance with SSC guidelines + 17.46%×ICU resources + 15.53%×airway management + 14.07%×DVT prevention + 13.61%×severity of patient condition. This evidence-based quality scoring system will help in assessing the key elements of quality management and establish a foundation for further optimization of the quality control indicator system.

Keywords: critical care medicine, quality control, evaluation, exploratory factor analysis (EFA) model

Acknowledgments

This study was supported by the National Key R&D Program of China (No. 2020YFC0861000), the CAMS Innovation Fund for Medical Sciences (CIFMS) (No. 2020-I2 M-CoV19-001), the China International Medical Exchange Foundation Special Fund for Young and Middle-aged Medical Research (No. Z-2018-35-1902), 2020 CMB Open Competition Program (No. 20-381), CAMS Endowment Fund (No. 2021-CAMS-JZ004), the Chinese Medical Information and Big Data Association (CHMIA) Special Fund for Emergency Project, and Beijing Municipal Natural Science Foundation (M21019), and the CAMS Endowment Fund (No. 2021-CAMS-JZ004).

Footnotes

Compliance with ethics guidelines

Longxiang Su, Xudong Ma, Sifa Gao, Zhi Yin, Yujie Chen, Wenhu Wang, Huaiwu He, Wei Du, Yaoda Hu, Dandan Ma, Feng Zhang, Wen Zhu, Xiaoyang Meng, Guoqiang Sun, Lian Ma, Huizhen Jiang, Guangliang Shan, Dawei Liu, Xiang Zhou and on behalf of China-NCCQC declare that they have no conflicts of interest. This article does not contain any studies with human or animal subjects.

These authors contributed equally to this work.

Contributor Information

Guangliang Shan, Email: shan@pumc.edu.cn.

Dawei Liu, Email: dwliu98@163.com.

Xiang Zhou, Email: zx_pumc@163.com.

References

  • 1.Garrouste-Orgeas M, Timsit JF, Vesin A, Schwebel C, Arnodo P, Lefrant JY, Souweine B, Tabah A, Charpentier J, Gontier O, Fieux F, Mourvillier B, Troché G, Reignier J, Dumay MF, Azoulay E, Reignier B, Carlet J, Soufir L. Selected medical errors in the intensive care unit: results of the IATROREF study: parts I and II. Am J Respir Crit Care Med. 2010;181(2):134–142. doi: 10.1164/rccm.200812-1820OC. [DOI] [PubMed] [Google Scholar]
  • 2.van der Voort PH, van der Veer SN, de Vos ML. The use of indicators to improve the quality of intensive care: theoretical aspects and experiences from the Dutch intensive care registry. Acta Anaesthesiol Scand. 2012;56(9):1084–1091. doi: 10.1111/j.1399-6576.2012.02687.x. [DOI] [PubMed] [Google Scholar]
  • 3.Rhodes A, Moreno RP, Azoulay E, Capuzzo M, Chiche JD, Eddleston J, Endacott R, Ferdinande P, Flaatten H, Guidet B, Kuhlen R, León-Gil C, Martin Delgado MC, Metnitz PG, Soares M, Sprung CL, Timsit JF, Valentin A. Prospectively defined indicators to improve the safety and quality of care for critically ill patients: a report from the Task Force on Safety and Quality of the European Society of Intensive Care Medicine (ESICM) Intensive Care Med. 2012;38(4):598–605. doi: 10.1007/s00134-011-2462-3. [DOI] [PubMed] [Google Scholar]
  • 4.Ray B, Samaddar DP, Todi SK, Ramakrishnan N, John G, Ramasubban S. Quality indicators for ICU: ISCCM guidelines for ICUs in India. Indian J Crit Care Med. 2009;13(4):173–206. doi: 10.5005/ijccm-13-4-173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Berenholtz SM, Dorman T, Ngo K, Pronovost PJ. Qualitative review of intensive care unit quality indicators. J Crit Care. 2002;17(1):1–12. doi: 10.1053/jcrc.2002.33035. [DOI] [PubMed] [Google Scholar]
  • 6.Flaatten H. The present use of quality indicators in the intensive care unit. Acta Anaesthesiol Scand. 2012;56(9):1078–1083. doi: 10.1111/j.1399-6576.2012.02656.x. [DOI] [PubMed] [Google Scholar]
  • 7.He H, Ma X, Su L, Wang L, Guo Y, Shan G, He HJ, Zhou X, Liu D, Long Y, Zhao Y, Zhang S. Effects of a national quality improvement program on ICUs in China: a controlled pre-post cohort study in 586 hospitals. Crit Care. 2020;24(1):73. doi: 10.1186/s13054-020-2790-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Thompson B. Exploratory and Confirmatory Factor Analysis. Washington, DC: American Psychological Association; 2004. [Google Scholar]
  • 9.Levy MM, Dellinger RP, Townsend SR, Linde-Zwirble WT, Marshall JC, Bion J, Schorr C, Artigas A, Ramsay G, Beale R, Parker MM, Gerlach H, Reinhart K, Silva E, Harvey M, Regan S, Angus DC. The Surviving Sepsis Campaign: results of an international guideline-based performance improvement program targeting severe sepsis. Intensive Care Med. 2010;36(2):222–231. doi: 10.1007/s00134-009-1738-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Wang L, Ma XD, He HW, Su LX, Guo YH, Shan GL, Zhou X, Liu DW, Long Y, China National Critical Care Quality Control Center group Analysis of factors influencing 3- and 6-h compliance with the surviving sepsis campaign guidelines based on medical-quality intensive care unit data from China. Chin Med J (Engl) 2021;134(14):1747–1749. doi: 10.1097/CM9.0000000000001362. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Manoucheri R, Fallahi MJ. Adherence to venous thromboprophylaxis guidelines for medical and surgical inpatients of Teaching Hospitals, Shiraz-Iran. Tanaffos. 2015;14(1):17–26. [PMC free article] [PubMed] [Google Scholar]
  • 12.Parikh KC, Oh D, Sittipunt C, Kalim H, Ullah S, Aggarwal SK, Investigators VA. Venous thromboembolism prophylaxis in medical ICU patients in Asia (VOICE Asia): a multicenter, observational, cross-sectional study. Thromb Res. 2012;129(4):e152–e158. doi: 10.1016/j.thromres.2012.01.012. [DOI] [PubMed] [Google Scholar]
  • 13.Fan Y, Gao F, Wu Y, Zhang J, Zhu M, Xiong L. Does ventilator-associated event surveillance detect ventilator-associated pneumonia in intensive care units? A systematic review and meta-analysis Crit Care. 2016;20(1):338. doi: 10.1186/s13054-016-1506-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Jia L, Yu H, Lu J, Zhang Y, Cai Y, Liu Y, Ma X. Epidemiological characteristics and risk factors for patients with catheter-related bloodstream infections in intensive care unit. Zhonghua Yi Xue Za Zhi. 2015;95(9):654–658. [PubMed] [Google Scholar]
  • 15.Peng D, Li X, Liu P, Luo M, Chen S, Su K, Zhang Z, He Q, Qiu J, Li Y. Epidemiology of pathogens and antimicrobial resistanceof catheter-associated urinary tract infections in intensivecare units: a systematic review and meta-analysis. Am J Infect Control. 2018;46(12):e81–e90. doi: 10.1016/j.ajic.2018.07.012. [DOI] [PubMed] [Google Scholar]
  • 16.Anna B, Costello JWO. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess, Res Eval. 2005;10(1):1–9. [Google Scholar]
  • 17.Altman DG. Practical Statistics for Medical Research. London: Chapman & Hall/CRC; 1991. [Google Scholar]
  • 18.Mardia KVKJ, Bibby JM. Multivariate Analysis. London: Academic Press; 1979. [Google Scholar]
  • 19.Lj C. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334. doi: 10.1007/BF02310555. [DOI] [Google Scholar]
  • 20.Chrusch CA, Martin CM, Project TQIC Quality improvement in critical care: selection and development of quality indicators. Can Respir J. 2016;2016:2516765. doi: 10.1155/2016/2516765. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.de Vos ML, van der Veer SN, Graafmans WC, de Keizer NF, Jager KJ, Westert GP, van der Voort PH. Implementing quality indicators in intensive care units: exploring barriers to and facilitators of behaviour change. Implement Sci. 2010;5(1):52. doi: 10.1186/1748-5908-5-52. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):1743–1748. doi: 10.1001/jama.260.12.1743. [DOI] [PubMed] [Google Scholar]
  • 23.Donabedian A. The role of outcomes in quality assessment and assurance. QRB Qual Rev Bull. 1992;18(11):356–360. doi: 10.1016/S0097-5990(16)30560-7. [DOI] [PubMed] [Google Scholar]
  • 24.Donabedian A. A founder of quality assessment encounters a troubled system firsthand. Interview by Fitzhugh Mullan. Health Aff (Millwood) 2001;20(1):137–141. doi: 10.1377/hlthaff.20.1.137. [DOI] [PubMed] [Google Scholar]
  • 25.Kumpf O, Braun JP, Brinkmann A, Bause H, Bellgardt M, Bloos F, Dubb R, Greim C, Kaltwasser A, Marx G, Riessen R, Spies C, Weimann J, Wöbker G, Muhl E, Waydhas C. Quality indicators in intensive care medicine for Germany—third edition 2017. Ger Med Sci. 2017;15:Doc10. doi: 10.3205/000251. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Valiani S, Rigal R, Stelfox HT, Muscedere J, Martin CM, Dodek P, Lamontagne F, Fowler R, Gheshmy A, Cook DJ, Forster AJ, Hébert PC. An environmental scan of quality indicators in critical care. CMAJ Open. 2017;5(2):E488–E495. doi: 10.9778/cmajo.20150139. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Christiansen CF, Møller MH, Nielsen H, Christensen S. The Danish Intensive Care Database. Clin Epidemiol. 2016;8:525–530. doi: 10.2147/CLEP.S99476. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Frontiers of Medicine are provided here courtesy of Nature Publishing Group

RESOURCES