Dear Editor,
In a recent study [1], Dr. Mellado-Artigas investigated the efficacy of early intubation (within eight hours after vasopressor use) in patients with septic shock. After propensity score matching (PSM), they reported that compared to non‑early intubation, early intubation did not improve in-hospital mortality or ICU/hospital length of stay in the matched cohort. We noted that in the non-early intubation group, only 33% (27/78) of these patients finally needed intubation. Therefore, the comparison between early intubation and non-early intubation group is actually the comparison between patients with early intubation and those (67%) who do not need intubation mixed with a small proportion (33%) of patients with non-early intubation. In clinical practice, patients who do not need intubation always tend to have milder conditions and a relatively better prognosis than those who need intubation. Therefore, we speculated that the non-significant comparisons in the current study may have been affected by several factors.
First, the major issue with PSM in the current study is the external validity. A total of 137 patients were included in the early intubation group, 43% (59/137) of whom were excluded from PSM. In Table 1, we note that in the early intubation group, the mortality was significantly higher in patients excluded from PSM than that in those kept in the PSM (41/59 (69%) vs. 35/78 (45%), p = 0.004). On the contrary, in the non-early intubation group, the mortality was significantly lower in patients excluded from PSM than that in those kept in the PSM (85/520 (16.3%) vs. 26/78 (33%), p < 0.001). This means that only mild patients in the early intubation group and severe patients in the non-early intubation group were included in the PSM analysis. Therefore, the exclusion of these patients in PSM may lead to poor sample representation and affect the external validity of these results.
Table 1.
Used for PSM | Excluded from PSM | p | |
---|---|---|---|
Early intubation group | N = 78 | N = 59 | |
Mortality rate* [n (%)] | 35 (45.8%) | 41 (69.0%) | 0.004 |
Non-early intubation group | N = 78 | N = 520 | |
Mortality rate [n (%)] | 26 (33.3%) | 85 (16.3%) | < 0.001 |
P# | 0.140 | < 0.001 |
*The overall mortality rate was extracted from their supplementary Table S2 (mortality by day 60)
#Comparisons between early intubation and non-early intubation groups
Second, a total of 22 variables were included in the PSM analysis. Although most of these selected variables were balanced in the matched cohort, hidden bias [2–4] due to unmeasured confounders likely remains. For instance, severe hypoxemia was one common indication for intubation in clinical practice. Aiming to identify patients with similar oxygenation status, the worst PaO2/FiO2 level should be used for matching in the PSM. However, in the current matched cohort, the mean PaO2/FiO2 was 141 and 153 mmHg in the early intubation and non-early intubation groups, which unlikely reflects the worst oxygenation status. Therefore, some clinical or laboratory indications for intubation may be missing in the PSM analysis. In addition, the balance of several binary variables should not be measured using standardized mean differences (SMD). For instance, although the SMD is small, the accessory muscle use (43/78 (0.55%) vs. 36/78 (0.46%)) is still not well balanced. Sensitivity analysis for unmeasured confounding, such as Rosenbaum bounds (Gamma value) [5] or other models [2], should be reported to quantify the hidden bias.
Acknowledgements
Not applicable.
Author contributions
JQ came up with the question, and YS and HZ were responsible for writing. All authors read and approved the final manuscript.
Funding
None.
Availability of data and materials
Not applicable.
Declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
None.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Mellado-Artigas R, Ferrando C, Martino F, Delbove A, Ferreyro BL, Darreau C, Jacquier S, Brochard L, Lerolle N. Early intubation and patient-centered outcomes in septic shock: a secondary analysis of a prospective multicenter study. Crit Care. 2022;26(1):163. doi: 10.1186/S13054-022-04029-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Li L, Shen C, Wu AC, Li X. Propensity score-based sensitivity analysis method for uncontrolled confounding. Am J Epidemiol. 2011;174(3):345–353. doi: 10.1093/aje/kwr096. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Harder VS, Stuart EA, Anthony JC. Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. Psychol Methods. 2010;15(3):234–249. doi: 10.1037/a0019623. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Recuero-Diaz JL, Royo-Crespo I, Gomez de-Antonio D, Call S, Aguinagalde B, Gomez-Hernandez MT, Hernandez-Ferrandez J, Sanchez-Lorente D, Sesma-Romero J, Rivo E et al: Treatment and intention-to-treat propensity score analysis to evaluate the impact of video-assisted thoracic surgery on 90-day mortality after anatomical resection for lung cancer. Eur J Cardiothorac Surg 2022. [DOI] [PubMed]
- 5.Rosenbaum PR. Observational Studies. 2nd edn. New York: Springer; 2002. Sensitivity to hidden bias. pp. p110–124. [Google Scholar].
- 6.Hernán MA, Robins JM. Using big data to emulate a target trial when a randomized trial is not available. Am J Epidemiol. 2016;183(8):758–764. doi: 10.1093/aje/kwv254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Sklar MC, Yarnell CJ. Always say never: why studies of timing of invasive ventilation should compare “early versus late/never” as opposed to “early versus late”. Am J Respir Crit Care Med. 2021;204(6):737–738. doi: 10.1164/RCCM.202104-0860LE/SUPPL_FILE/DISCLOSURES.PDF. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Desai RJ, Franklin JM. Alternative approaches for confounding adjustment in observational studies using weighting based on the propensity score: A primer for practitioners. BMJ. 2019. 10.1136/bmj.l5657 [DOI] [PubMed]
- 9.Van Der Weele TJ, Ding P. Sensitivity analysis in observational research: introducing the E-value. Ann Intern Med. 2017;167(4):268–274. doi: 10.7326/M16-2607. [DOI] [PubMed] [Google Scholar]