Skip to main content
Critical Care logoLink to Critical Care
letter
. 2022 Sep 27;26:293. doi: 10.1186/s13054-022-04144-4

External validation of a prediction model for CPAP failure in COVID-19 patients with severe pneumonitis

Victoria Stokes 1,, Kwee Yen Goh 1, Graham Whiting 1, Sebastian Bates 2, Hannah Greenlee 1, Anthony Wilson 1, Alexander J Parker 1
PMCID: PMC9513984  PMID: 36167603

Dear Editor,

Continuous positive airway pressure (CPAP) has been widely used as an intervention to attempt to avoid mechanical ventilation in patients with coronavirus disease 2019 (COVID-19) [1].

Whilst CPAP can be a useful tool, it is recognised that there are a group of patients for whom this treatment is ineffective [2]. Arina et al. demonstrated that critical care admission biomarkers such as CRP and NT-proBNP may identify patients in whom CPAP is likely to fail (resulting in invasive mechanical ventilation (IMV) or death) [3]. We used routinely collected healthcare records of COVID-19 patients treated on the intensive care unit (ICU) at Manchester Royal Infirmary to independently validate their findings. We assessed their model using a sub-cohort treated at the time the model was developed (prior to the introduction of dexamethasone as a routine treatment, 15 June 2020) and also using our entire cohort of patients (1 March 2020 to 31 October 2021) [4]. Supplementary results are available in Additional file 1.

Our entire cohort included 336 patients with confirmed COVID pneumonitis, of whom 215 received at least six hours of CPAP in a 24-h window. 148 (69%) were CPAP failures. For model validation, there were 148 patients with sufficient data of whom 103 (70%) were CPAP failures. In the sub-cohort, there were 32 patients (24 (75%) failures). Additional file 1: Table S1 summarises the patient demographics.

We compared variables measured on ICU admission in CPAP successes and failures and found significant differences in CRP (p = 0.001), troponin T (p = 0.046), D-Dimer (p < 0.001), and age (p < 0.001). There was no significant difference in NT-proBNP (p = 0.190) or highest respiratory rate in the first 24 h of ICU admission (p = 0.417). Figure 1 summarises the difference in biomarkers across the whole cohort, and Additional file 1: Fig. S1 shows the differences in the sub-cohort.

Fig. 1.

Fig. 1

Biomarkers and variables recorded in the COVID population on ICU admission in patients receiving CPAP. NT-proBNP N-terminal pro-B-type natriuretic peptide

In our sub-cohort, the model proposed by Arina had an AUC = 0.839. Calibration was acceptable although we observed a slightly higher failure rate than expected (Additional file 1: Fig. S2). The model performed poorly when extended to our entire cohort (AUC = 0.613). Our results suggest that although there is a simple biomarker-based model to predict CPAP failure in ICU patients in the early stages of the COVID-19 pandemic, it is unlikely to be helpful now. Later models have sought to predict CPAP failure by including variables which describe patients’ work of breathing [5].

Since the beginning of the pandemic, a range of factors have modified the course of the disease including vaccination, drug treatments and improved clinical experience. Disease-modifying agents used to treat COVID-19 deserve particular attention and may partly explain why predictive models based on markers of generalised inflammation now perform poorly. Further work is needed to characterise how predictors of CPAP failure in COVID-19 have changed over time. Understanding which patients now have a higher likelihood of CPAP failure may help focus resources and direct preparedness in planning for CPAP failure in this cohort. Further studies to understand the timing and role for mechanical ventilation in this group may assist in further improvements in the management of these challenging patients.

Supplementary Information

13054_2022_4144_MOESM1_ESM.docx (340.3KB, docx)

Additional file 1. Supplementary figures and tables.

Acknowledgements

The authors are grateful for the support of Mrs Cathie Forrest, ICNARC Data Manager and Dr Andrew Martin at Manchester Royal Infirmary. They would also like to express their thanks to Dr Pietro Arina, Prof Mervyn Singer and the wider University College London Critical Care COVID-19 Research Group.

Author contributions

VS, KG, GW and HG collected data. SB performed statistical analysis and prepared all figures. VS, SB, AW and AP wrote the main manuscript text. VS, SB, AW and AJP reviewed the manuscript. All authors read and approved the final manuscript.

Funding

Not applicable.

Availability of data and materials

Not applicable.

Declarations

Ethical approval consent to participate

Approval received from the Health Research Authority and Health and Care Research Wales (Rec Ref: 21/HRA/3518 and IRAS 300156) on 2 September 2021.

Competing interests

On behalf of all authors, the corresponding author states that there are no competing interests.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Bertaina M, et al. Non-invasive ventilation for SARS-CoV-2 acute respiratory failure: a subanalysis from the HOPE COVID-19 registry. Emerg Med J. 2021;38(5):359–365. doi: 10.1136/EMERMED-2020-210411. [DOI] [PubMed] [Google Scholar]
  • 2.A. Ashish et al., “CPAP management of COVID-19 respiratory failure: A first quantitative analysis from an inpatient service evaluation,” BMJ Open Respir. Res., vol. 7, no. 1, 2020, doi: 10.1136/bmjresp-2020-000692. [DOI] [PMC free article] [PubMed]
  • 3.Arina P, Baso B, Moro V, Patel H, Ambler G. Discriminating between CPAP success and failure in COVID-19 patients with severe respiratory failure. Intensive Care Med. 2021;47:237–239. doi: 10.1007/s00134-020-06304-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Horby P, et al. dexamethasone in hospitalized patients with Covid-19. N Engl J Med. 2021;384(8):693–704. doi: 10.1056/nejmoa2021436. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Liu L, et al. A simple nomogram for predicting failure of non-invasive respiratory strategies in adults with COVID-19: a retrospective multicentre study. Artic Lancet Digit Heal. 2021;3:166–174. doi: 10.1016/S2589-7500(20)30316-2. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

13054_2022_4144_MOESM1_ESM.docx (340.3KB, docx)

Additional file 1. Supplementary figures and tables.

Data Availability Statement

Not applicable.


Articles from Critical Care are provided here courtesy of BMC

RESOURCES