Abstract
Background
In the Handling Oxygenation Targets in the Intensive Care Unit (HOT-ICU) trial, a lower (8 kPa) vs a higher (12 kPa) PaO2 target did not affect mortality amongst critically ill adult patients. We used Bayesian statistics to evaluate any heterogeneity in the effect of oxygenation targets on mortality between different patient groups within the HOT-ICU trial.
Methods
We analysed 90-day all-cause mortality using adjusted Bayesian logistic regression models, and assessed heterogeneous treatment effects according to four selected baseline variables using both hierarchical models of subgroups and models with interactions on the continuous scales. Results are presented as mortality probability (%) and relative risk (RR) with 95% credibility intervals (CrI).
Results
All 2888 patients in the intention-to-treat cohort of the HOT-ICU trial were included. The adjusted 90-day mortality rates were 43.0% (CrI: 38.3–47.8%) and 42.3% (CrI: 37.7–47.1%) in the lower and higher oxygenation groups, respectively (RR 1.02 [CrI: 0.93–1.11]), with 36.5% probability of an RR <1.00. Analyses of heterogeneous treatment effects suggested a dose–response relationship between baseline norepinephrine dose and increased mortality with the lower oxygenation target, with 95% probability of increased mortality associated with the lower oxygenation target as norepinephrine doses increased.
Conclusions
A lower oxygenation target was unlikely to affect overall mortality amongst critically ill adult patients with acute hypoxaemic respiratory failure. However, our results suggest an increasing mortality risk for patients with a lower oxygen target as the baseline norepinephrine dose increases. These findings warrant additional investigation.
Clinical trial registration
Keywords: Bayesian analysis, heterogeneity of treatment effects, intensive care unit, oxygen therapy, respiratory insufficiency
Editor's key points.
-
•
Bayesian statistics can provide a valuable alternative perspective on clinical trial findings, particularly where knowing the most likely treatment effect can alter clinical practice even if this finding is not certain.
-
•
The authors identified important differences in the effect of lower oxygenation targets between patient subgroups, which could be important in the care of critically ill adults.
-
•
The possibility that critically ill patients in haemodynamic shock are more exposed to harm with lower oxygenation targets is important and should be investigated further in ongoing randomised trials.
Patients acutely admitted to the ICU with hypoxaemic respiratory failure are treated with supplemental oxygen. This treatment is believed to be life-saving, but the optimal target for oxygen therapy is not fully established. No firm conclusion on the benefits and harms of a lower vs a higher oxygenation target has been drawn for patients admitted to the ICU, as shown in a recently published systematic review.1 This may be because of limited data, or to a large degree of heterogeneity in published trials.
In the Normal Oxygenation Versus Hyperoxia in the Intensive Care Unit (OXYGEN-ICU) trial, a lower oxygenation strategy resulted in noticeably reduced ICU mortality compared with a higher oxygenation strategy in a mixed cohort of ICU patients (8.6 percentage points difference; 95% confidence interval [CI]: 1.7–15.0%), but the trial was stopped at an unplanned interim analysis after an earthquake.2 The Liberal Oxygenation Versus Conservative Oxygenation in ARDS (LOCO2) trial suggested benefit from a higher oxygenation strategy compared with a lower oxygenation strategy because of a reduced mortality at both 28 days (7.8 percentage points difference; 95% CI: –4.8 to 20.6) and 90 days post-randomisation (14.0 percentage points difference; 95% CI: 0.7–27.2%).3 However, this trial was also stopped early, as an unplanned interim analysis found observations of intestinal ischaemia, an unplanned secondary outcome, in the lower oxygenation group, but not in the higher oxygenation group. The Intensive Care Unit Randomized Trial Comparing Two Approaches to Oxygen Therapy (ICU-ROX) trial found no differences in 28-day ventilator-free days (–0.3 days absolute difference; 95% CI: –2.1 to 1.6 days) or in 90-day mortality (odds ratio [OR] 1.10; 95% CI: 0.84–1.44) between a lower and a higher oxygenation strategy.4 In the Handling Oxygenation Targets in the Intensive Care Unit (HOT-ICU) trial, adult patients with acute hypoxaemic respiratory failure in the ICU were randomised to an arterial partial pressure of oxygen (PaO2) of 8 kPa (lower target) or 12 kPa (higher target) during ICU admission.5 At 90 days, 42.9% of patients in the lower oxygenation group had died and 42.4% in the higher oxygenation group, resulting in an adjusted relative risk (RR) of 1.02 (95% CI: 0.94–1.11) in the primary frequentist analysis. Comparable results were found in the conventional subgroup analyses.5 However, heterogeneous treatment effects may still be present.6, 7, 8
Bayesian statistical methods allow for detailed probabilistic quantifications of effect sizes, and integration of prior knowledge allows for nuanced sensitivity analyses of the intervention effects. Such methods have previously been used in several large-scale trials to complement the conventional frequentist analysis9, 10, 11, 12 or as the primary statistical framework.13, 14, 15 In this prospective Bayesian analysis of the HOT-ICU trial,16 our aim was to provide a probabilistic evaluation of the effects of a lower oxygenation target vs a higher oxygenation target on 90-day all-cause mortality, to assess the probabilities of a number of pre-specified effect sizes, including effects larger than the a priori hypothesised 20% relative reduction in mortality,17,18 and to explore the presence of heterogeneous treatment effects on mortality based on pre-specified baseline variables.
Methods
This secondary Bayesian analysis of the HOT-ICU trial was conducted in accordance with a protocol and statistical analysis plan published before randomisation of the last patient,16 and prepared according to recent recommendations.6,8,19,20 It was guided by the same principles as the Bayesian analysis of heterogeneous treatment effects in the Stress Ulcer Prophylaxis in the Intensive Care Unit (SUP-ICU) trial.12,21 The results are reported according to the Reporting of Bayes Used in clinical STudies (ROBUST) guideline,22 and this paper has been prepared in agreement with the Strengthening the Reporting of Observational Studies in Epidemiology statement.23
HOT-ICU trial
The HOT-ICU trial was an investigator-initiated international, pragmatic, parallel-group, stratified, randomised trial (RCT), which enrolled patients from June 20, 2017 to August 3, 2020. Adult patients (≥18 yr), acutely admitted to the ICU with hypoxaemic respiratory failure, receiving a fraction of inspired oxygen (FiO2) of at least 0.50 in a closed system (invasive or noninvasive mechanical ventilation or mask/helmet CPAP) or at least oxygen 10 L min−1 in an open system, had an arterial line, and were expected to receive supplemental oxygen for at least 24 h in the ICU were included. Patients were randomised 1:1 to the lower oxygenation target or the higher oxygenation target, which was applied during the entire ICU stay, including readmissions, for up to 90 days. Additional details on the HOT-ICU trial, including exclusion criteria, approvals, and variable definitions, are available in the Supplementary Appendix and elsewhere.5,17,18
Outcome measure
The primary outcome measure was 90-day all-cause mortality.
Statistical analysis
All statistical analyses were performed using R version 4.0.4 (R Core Team, R Foundation for Statistical Computing, Vienna, Austria) and Stan24 through the brms R package,25,26 with additional details available in the Supplementary Appendix. We used Bayesian logistic regression models that incorporated prior distributions expressing pre-existing beliefs of effect sizes and their uncertainties in combination with data from the trial at hand. The models combined this to inform posterior distributions of the variables of interest.27 Posterior distributions were summarised using median values and percentile-based 95% credibility intervals (CrI) that may be interpreted as the 95% most probable values, conditional on the priors, models and data.28 The full posterior distributions were presented graphically, supplemented with probabilities of pre-specified and additional effect sizes.16 Results were presented as posterior adjusted risk ratios (RRs) and risk differences (RDs), and adjusted event probabilities in each group (used to calculate RRs and RDs), calculated by setting adjustment variables to their most common value, as specified in the protocol.16 We also present the results on the underlying odds ratio (OR) scale to facilitate comparison with other studies that may have reported on this scale. Relative risk and OR <1, and RD <0 favoured the lower oxygenation target; RR and OR >1, and RD >0 favoured the higher oxygenation target.
Priors
For the primary analysis of the intervention effect, we used weakly informative priors centred on no difference (OR of 1=RR of 1) and including a large range containing all plausible effect sizes (ORs with 95% probability between 0.14 and 7.10). We thus expected the trial data to dominate the posterior probability distributions because of the large sample size of the HOT-ICU trial. Two pre-specified sensitivity analyses were conducted: (i) using evidence-based priors informed by an updated random-effects meta-analysis of previous RCTs, and (ii) using sceptic priors centred on no difference and sceptical of larger effect sizes, as described in the protocol.16 Full details on priors are presented in the Supplementary Appendix and in the protocol.16
Subgroup-based heterogeneity of treatment effect analyses
We assessed the presence of heterogeneous treatment effects using four different subgrouping schemes based on selected baseline variables:
-
(i)
Sequential Organ Failure Assessment (SOFA) score as a marker of organ dysfunction29
-
(ii)
PaO2:FiO2 ratio as a marker of severity of hypoxaemic respiratory failure with additional adjustment for the type of oxygen supplementation system at baseline (closed or open), with closed system being the reference
-
(iii)
Highest continuously infused dose of norepinephrine during the 24 h before randomisation
-
(iv)
Latest plasma lactate concentration before randomisation
Five quintile-based subgroups were created of each variable ensuring that all patients with identical values were in the same groups. We used hierarchical Bayesian logistic regression models with partial pooling adjusted for the stratification variables (chronic obstructive pulmonary disease, haematological malignancy, and site) to calculate subgroup results.26,30 Results were presented using the effect measures outlined previously. Additional information on parameter definitions is available in the Supplementary Appendix and elsewhere.5
Continuous heterogeneity of treatment effect analyses
We assessed the potential interactions of the allocation to the lower oxygenation target with the four baseline characteristics of interest for 90-day all-cause mortality on the continuous scale using Bayesian logistic regression models. All models were adjusted for the stratification variables mentioned previously. Additional adjustment for type of oxygen supplementation system (open or closed) at baseline was performed when assessing PaO2:FiO2 ratio. Results are presented using conditional effects plots with ORs and 95% CrI for interactions, and probabilities for interaction ORs <1 (negative interaction) and >1 (positive interaction). The conditional effects plots illustrate the predicted probabilities of an outcome dependent on the variables of interest (treatment, the baseline variable, and their interaction), with all other variables kept constant at their reference values (adjustment variables set to their most common values).
Missing data and technical model details
We planned a priori to use complete case analysis if missingness for all variables in an analysis was less than 5% and multiple imputation otherwise.16 For all Bayesian models, we used four chains with 5000 warm-up and 5000 post-warm-up draws per chain, yielding 20 000 post-warm-up draws in all. For additional details on handling of missing data and model diagnostics, see the Supplementary Appendix and the protocol.16
Results
We included 2888 of the 2928 patients (98.6%) randomised in the HOT-ICU trial, equivalent to the full intention-to-treat cohort.5 Baseline characteristics of the trial cohort are presented in Table 1. Additional characteristics of all subgroups according to quintiles and stratified according to treatment allocation are presented in Supplementary Tables 1a–4b. Diagnostics for all statistical models were acceptable.
Table 1.
Variable | Lower target, n=1441 | Higher target, n=1447 |
---|---|---|
Median age (IQR, yr) | 70 (61–77) | 70 (60–77) |
Male sex, n (%) | 916 (63.6) | 939 (64.9) |
Type of admission, n (%) | ||
Medical | 1238 (85.9) | 1233 (85.2) |
Elective surgical | 18 (1.3) | 21 (1.5) |
Emergency surgical | 185 (12.8) | 193 (13.3) |
Chronic obstructive pulmonary disease | 277 (19.2) | 285 (19.7) |
Active haematological cancer | 81 (5.6) | 86 (5.9) |
Oxygen supplementation in a closed system, n (%) | 1024 (71.1) | 1038 (71.7) |
Invasive mechanical ventilation, n (%) | 826 (57.3) | 863 (59.6) |
Noninvasive ventilation or CPAP, n (%) | 198 (13.7) | 175 (12.1) |
Oxygen supplementation in an open system, n (%) | 417 (28.9) | 409 (28.3) |
Median PaO2 (IQR, kPa) | 10.3 (8.7–12.6) | 10.3 (8.7–12.3) |
Median FiO2 (IQR) | 0.70 (0.55–0.90) | 0.70 (0.58–0.85) |
Median PaO2:FiO2 ratio (IQR)∗ | ||
In all systems | 15.8 (11.8–21.0) | 15.7 (12.0–20.5) |
In closed systems | 16.5 (12.2–21.7) | 16.5 (12.6–21.4) |
In open systems | 14.1 (10.9–18.4) | 13.9 (10.7–18.0) |
Median lactate concentration (IQR, mM)† | 1.8 (1.1–3.2) | 1.7 (1.1–3.1) |
Any use of vasopressors, n (%) | 793 (55.0) | 785 (54.3) |
Median highest dose of norepinephrine (IQR, μg kg−1 min−1) | 0.20 (0.10–0.40) | 0.21 (0.10–0.40) |
Median SOFA score (IQR)‡ | 8 (5–10) | 8 (5–10) |
Bayesian analysis of 90-day all-cause mortality
The adjusted RR for mortality was 1.02 (95% CrI: 0.93–1.11), with 63.5% probability of an RR >1.00. The probability of an RR <0.80, equivalent to the 20% a priori hypothesised relative mortality reduction,17 or more was <0.01%. We observed similar low probabilities (<2%) of such effect sizes across all subgroups, except for low plasma lactate concentrations (Supplementary Table 6). The full posterior probability distribution for 90-day all-cause mortality is presented in Fig. 1 (RD and OR distributions are presented in Supplementary Fig. 1a and b). Probabilities for mortality along with RRs and RDs for the trial cohort are presented in Table 2 (ORs are available in Supplementary Table 5).
Table 2.
Group | n | Event probability, lower target (%) | Event probability, higher target (%) | RR | RD (%) |
---|---|---|---|---|---|
All patients | 2888 | 43.0 (95% CrI: 38.3–47.8) | 42.3 (95% CrI: 37.7–47.1) | 1.02 (95% CrI: 0.93–1.11) | 0.6 (95% CrI: –3.0 to 4.3) |
SOFA score (baseline)∗ | 2799 | ||||
0–4 | 486 | 32.5 (95% CrI: 26.5–39.1) | 31.7 (95% CrI: 25.8–38.3) | 1.03 (95% CrI: 0.85–1.23) | 0.8 (95% CrI: –5.3 to 6.5) |
5–6 | 501 | 35.5 (95% CrI: 29.3–42.1) | 35.7 (95% CrI: 29.5–42.6) | 1.00 (95% CrI: 0.81–1.16) | 0.0 (95% CrI: –7.2 to 5.3) |
7–7 | 352 | 37.6 (95% CrI: 30.5–45.7) | 33.6 (95% CrI: 26.3–41.0) | 1.10 (95% CrI: 0.94–1.48) | 3.4 (95% CrI: –2.3 to 13.6) |
8–10 | 881 | 42.1 (95% CrI: 36.3–48.0) | 41.4 (95% CrI: 35.8–47.3) | 1.02 (95% CrI: 0.89–1.15) | 0.7 (95% CrI: –4.7 to 5.9) |
11–19 | 579 | 57.2 (95% CrI: 50.7–63.5) | 55.8 (95% CrI: 49.4–62.1) | 1.02 (95% CrI: 0.92–1.15) | 1.4 (95% CrI: –4.6 to 7.7) |
Lactate concentration (baseline, mM) | 2869 | ||||
0.2–0.9 | 501 | 23.1 (95% CrI: 17.5–29.2) | 25.4 (95% CrI: 19.9–32.0) | 0.92 (95% CrI: 0.66–1.14) | –1.9 (95% CrI: –10.0 to 3.1) |
1.0–1.4 | 631 | 38.1 (95% CrI: 32.1–44.6) | 38.0 (95% CrI: 32.0–44.6) | 1.00 (95% CrI: 0.85–1.16) | 0.2 (95% CrI: –6.3 to 5.8) |
1.5–2.1 | 577 | 42.0 (95% CrI: 35.5–49.2) | 38.7 (95% CrI: 32.2–45.3) | 1.08 (95% CrI: 0.93–1.32) | 3.1 (95% CrI: –2.7 to 11.1) |
2.2–3.6 | 576 | 45.0 (95% CrI: 38.8–51.7) | 42.5 (95% CrI: 36.0–49.1) | 1.06 (95% CrI: 0.92–1.25) | 2.3 (95% CrI: –3.5 to 9.6) |
3.7–24.0 | 584 | 61.7 (95% CrI: 55.0–67.9) | 60.8 (95% CrI: 54.2–67.0) | 1.01 (95% CrI: 0.91–1.13) | 0.9 (95% CrI: –5.5 to 7.1) |
Norepinephrine dose (baseline, μg kg−1 min−1) | 2888 | ||||
0.00–0.00 | 1373 | 38.1 (95% CrI: 33.0–43.5) | 38.6 (95% CrI: 33.4–44.0) | 0.99 (95% CrI: 0.87–1.11) | –0.4 (95% CrI: –5.3 to 4.0) |
0.01–0.10 | 366 | 39.8 (95% CrI: 32.5–47.3) | 40.1 (95% CrI: 33.2–47.3) | 1.00 (95% CrI: 0.82–1.17) | –0.1 (95% CrI: –7.8 to 6.3) |
0.11–0.21 | 372 | 39.5 (95% CrI: 32.4–47.0) | 39.5 (95% CrI: 32.6–46.4) | 1.01 (95% CrI: 0.83–1.19) | 0.2 (95% CrI: –7.3 to 6.9) |
0.22–0.39 | 348 | 50.0 (95% CrI: 42.4–57.6) | 47.8 (95% CrI: 40.4–55.5) | 1.04 (95% CrI: 0.91–1.24) | 1.8 (95% CrI: –4.9 to 10.4) |
0.40–2.40 | 429 | 52.4 (95% CrI: 45.3–60.2) | 48.0 (95% CrI: 40.9–55.2) | 1.08 (95% CrI: 0.95–1.33) | 3.9 (95% CrI: –2.5 to 14.0) |
PaO2:FiO2 ratio (baseline, kPa)† | 2876 | ||||
4.5–11.0 | 565 | 46.0 (95% CrI: 39.8–52.4) | 45.3 (95% CrI: 39.6–51.5) | 1.02 (95% CrI: 0.90–1.14) | 0.7 (95% CrI: –4.8 to 5.8) |
11.0–14.1 | 584 | 46.6 (95% CrI: 40.4–53.3) | 45.1 (95% CrI: 39.5–51.1) | 1.03 (95% CrI: 0.92–1.17) | 1.4 (95% CrI: –3.6 to 7.4) |
14.1–17.4 | 574 | 46.6 (95% CrI: 40.5–53.1) | 45.2 (95% CrI: 39.5–51.3) | 1.03 (95% CrI: 0.92–1.16) | 1.3 (95% CrI: –3.7 to 7.0) |
17.4–22.2 | 577 | 41.6 (95% CrI: 34.8–48.3) | 42.4 (95% CrI: 36.1–48.4) | 0.99 (95% CrI: 0.84–1.11) | –0.5 (95% CrI: –7.2 to 4.5) |
22.2–157.6 | 576 | 44.0 (95% CrI: 37.7–50.4) | 43.0 (95% CrI: 36.9–48.8) | 1.02 (95% CrI: 0.91–1.16) | 1.0 (95% CrI: –4.2 to 6.5) |
Subgroup-based heterogeneity of treatment effect analyses
A substantial number of patients did not receive norepinephrine at baseline; these patients were all included in the same subgroup, which is thus larger than the remaining four quartile-based subgroups. The apparent overlap amongst PaO2:FiO2 ratio-based subgroup limits is attributable to rounding (Table 2).
For increasing baseline doses of norepinephrine, we found increasing risk for 90-day all-cause mortality, indicating benefit of the higher oxygenation target: from RR 0.99 (95% CrI: 0.87–1.11) in the lowest dosage group (all 0.00 mM) to RR 1.08 (95% CrI: 0.95–1.33) in the highest dosage group (0.40–2.40 mM). This potential dose–response relationship was not found in any of the other baseline variable subgrouping schemes. Posterior probabilities for mortality and the estimates of RRs and RDs in the four sets of subgroups are presented in Table 2 (ORs are presented in Supplementary Table 5). The posterior probability distribution plots of the RRs for mortality in the subgroups are presented in Fig. 2 (RD and OR distributions are presented in Supplementary Fig. 4a and b). The posterior probabilities for different RRs for all four sets of subgroups are presented in Supplementary Table 6. Comparisons of treatment effects in the subgroups are presented in Supplementary Tables 11–14.
Continuous heterogeneity of treatment effect analyses
We found a 95% probability of a positive interaction between increasing baseline norepinephrine dose and the lower oxygenation target on mortality (i.e. unfavourable effects of a lower oxygenation target with increasing dose of norepinephrine at baseline). For increasing baseline lactate concentrations, the probability of a positive interaction with the lower oxygenation target on mortality was 86% (i.e. potential increased mortality risk of the lower oxygenation target for patients with higher concentrations of lactate). The probabilities of positive interactions (i.e. potential increased mortality risks) between the lower oxygenation target and the remaining baseline variables were 65% for increasing baseline SOFA scores (i.e. higher degree of organ failure) and 76% for decreasing baseline PaO2:FiO2 ratios (i.e. greater severity of respiratory failure). Conditional effect plots showing the estimated interactions between treatment allocation and baseline variables on mortality on the continuous scale are presented in Fig. 3.
Sensitivity analyses
The results of the sensitivity analyses using evidence-based and sceptic priors were largely consistent with the findings of the primary analysis (Supplementary Table 7; Supplementary Figs 2a–3c and 5a–7b).
Missing data
No imputation of missing data was performed, as missingness was <5% for all variables of interest included in any analysis.18 For additional details on missing data, see the Supplementary Appendix and elsewhere.5
Discussion
In this prospective, secondary analysis of treatment effects in the HOT-ICU trial, the risk of death within 90 days for patients treated with a lower oxygenation target was with 95% probability between RR 0.93 and 1.11. Given these data, larger effect sizes are improbable. Our analyses suggested heterogeneous treatment effects when considering the interaction between the lower oxygenation target and baseline norepinephrine dose, suggesting that in patients with higher degrees of shock (measured as higher administered doses of continuously infused norepinephrine), a lower oxygenation strategy may be harmful. This effect was consistent across a series of models. A similar trend was identified in the continuous model assessing plasma lactate concentrations at baseline, but without indications of the same relation in the subgroup-based heterogeneity analyses, and thus with no clear support for a dose–response relationship. Caution must be used when interpreting these findings, as the effect was only suggested in one of the two models. We found no strong suggestions of heterogeneous treatment effects according to SOFA scores or PaO2:FiO2 ratios at baseline.
The results of the Bayesian analysis of the 90-day all-cause mortality in this study are consistent with the primary frequentist analysis of the HOT-ICU trial,5 the ICU-ROX trial,4 and the latest meta-analysis conducted before the publication of the HOT-ICU trial.1 In contrast, the OXYGEN-ICU trial demonstrated benefit from a conservative oxygenation strategy,2 whilst the LOCO2 trial found potential benefit of a more liberal oxygenation strategy.3 However, given the substantially smaller sizes of the OXYGEN-ICU and LOCO2 trials (n=480 and 205, respectively) compared with the HOT-ICU (n=2928) and the ICU-ROX (n=1000) trials, and the fact that both were stopped after unplanned interim analyses, the findings of these trials may be attributable to chance. Also, the inclusion criteria of the trials differ substantially, as the ICU-ROX4 and LOCO23 trials included only invasively mechanically ventilated patients, whereas the OXYGEN-ICU2 and HOT-ICU5 trials included patients on both open and closed oxygen supplementation systems. Additionally, when considering baseline PaO2:FiO2 ratios, patients presented with substantially more severe respiratory failure in the LOCO23 and HOT-ICU5 trials compared with the ICU-ROX4 trial. These aspects may impede direct comparison of the results. Although larger effect sizes for mortality in the broad population of adult patients in the ICU with acute severe hypoxaemic respiratory failure seem improbable, smaller effects may also be of importance. Even a 2% absolute reduction in mortality would result in 2000 lives saved for every 100 000 patients treated with supplemental oxygen. The ongoing MEGA-ROX31 and UK-ROX32 trials are designed to assess absolute risk reductions for mortality of 1.5 and 2.5 percentage points, respectively, comparing a lower vs a higher oxygenation target. Effect sizes of such magnitudes cannot be excluded based on our results.
None of the aforementioned trials2, 3, 4 have considered the presence of heterogeneous treatment effects in a comparable manner to the one presented here. However, in a subgroup of patients with sepsis in the ICU-ROX trial, point estimates of treatment effects indicated harm of a lower oxygenation strategy, although this was not statistically significant.33 Similar was found in the subgroup of patients with shock at baseline in the HOT-ICU trial.5 On the contrary, the OXYGEN-ICU trial found reduced occurrence of shock when using a conservative oxygenation strategy compared with a more liberal oxygenation strategy.2
The strengths and limitations from the HOT-ICU trial are all carried over to this study.5 The most important strengths are the size of the trial, the pragmatic design, high external validity (35 ICUs in seven countries), and the clear separation in the oxygenation parameters between the intervention groups.5 Also, the protocol for this study was published before randomisation of the last patient in the HOT-ICU trial.16 Further, our results were consistent in the sensitivity analyses using different priors, and we evaluated the presence of heterogeneity of treatment effects both in subgroups and on the continuous scale, which may ease interpretation of our finding and serves as a consistency check. The limitations of this study are mainly related to the heterogeneity of treatment effect analyses. We chose the variables of interest based on availability and of the following reasons:16 the SOFA score is independently associated with mortality,34 and assessment of heterogeneity of treatment effects according to the risk of the outcome is recommended.8 Based on clinical rationale, different degrees of hypoxaemic respiratory failure may benefit from different levels of oxygenation; plasma lactate concentration and norepinephrine dose both serve as markers of shock, which, in turn, is associated with increased mortality.35 A dedicated prediction model for mortality would have been preferable, but this was not available. Also, other variables, or combinations of such, could have provided additional information on the potential heterogeneity with different oxygenation targets. As some subgroups may contain few events, this may lead to imprecision. Yet, this effect is to some extent mitigated by shrinkage and partial pooling in the hierarchical models.26,30 As the categorisation of the continuous baseline variables into quintile-based subgroups was data driven, cut-offs did not follow established conventions (e.g. in relation to the PaO2:FiO2 ratio), limiting the generalisability of the results. However, this was chosen to ensure that all subgroups were of adequate and similar sizes. In the analyses on the continuous scale, we assumed a linear relationship (on the log-OR scale) between the variables of interest and mortality, including the interaction term. For the sake of simplicity and to limit the risk of spurious findings and overfitting because of the use of multiple and increasingly flexible models, no other models to predict this relationship were applied. Lastly, secondary analyses and subgroup analyses should always be cautiously interpreted. Despite the analyses being pre-planned and the benefits of the Bayesian methods, the risks of spurious findings are not eliminated. All results from this study should consequently be regarded as hypothesis generating only.
In conclusion, the RR for 90-day all-cause mortality, when comparing a lower oxygenation target with a higher oxygenation target in adult patients in the ICU with acute hypoxaemic respiratory failure, was between 0.93 and 1.11 with 95% probability. Based on this, larger effect sizes are highly improbable. Our findings also suggest potentially important heterogeneity in treatment effects in terms of baseline norepinephrine dose as an index of haemodynamic shock. This increasing probability of death for patients treated with lower oxygenation targets as norepinephrine dose increases requires further investigation.
Authors' contributions
Study conception: AG, TLK, OLS, MHM, AP, BSR
Statistical analysis plan and protocol: all authors
Involved in the Conducting of the Handling Oxygenation Targets in the Intensive Care Unit trial: all authors
Analyses: TLK, AG
Writing of first draft: TLK
Critical revision: all authors
Approval of paper: all authors
Acknowledgements
The authors would like to express their gratitude to all involved in the Handling Oxygenation Targets in the Intensive Care Unit trial: research staff and investigators, clinical staff, patients, and their relatives.
Handling editor: Rupert Pearse
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.bja.2021.09.010.
Declarations of interest
The Department of Intensive Care at Rigshospitalet has received funding for other projects from the Novo Nordisk Foundation, Pfizer, and Fresenius Kabi.
Funding
Innovation Fund Denmark (4108-00011A); Aalborg University Hospital; Regions of Denmark (EMN-2017-00901 and EMN-2019-01055); Obel Family Foundation (25457); Danish Society of Anaesthesiology and Intensive Care Medicine; Intensive Care Symposium Hindsgavl.
Appendix ASupplementary data
The following is the Supplementary data to this article:
Supplementary material is available at British Journal of Anaesthesia online.
References
- 1.Barbateskovic M., Schjørring O.L., Krauss S.R., et al. Higher vs lower oxygenation strategies in acutely ill adults. Chest. 2020;159:154–173. doi: 10.1016/j.chest.2020.07.015. [DOI] [PubMed] [Google Scholar]
- 2.Girardis M., Busani S., Damiani E., et al. Effect of conservative vs conventional oxygen therapy on mortality among patients in an intensive care unit the Oxygen-ICU randomized clinical trial. JAMA. 2016;316:1583–1589. doi: 10.1001/jama.2016.11993. [DOI] [PubMed] [Google Scholar]
- 3.Barrot L., Asfar P., Mauny F., et al. Liberal or conservative oxygen therapy for acute respiratory distress syndrome. N Engl J Med. 2020;382:999. doi: 10.1056/NEJMoa1916431. [DOI] [PubMed] [Google Scholar]
- 4.The ICU-ROX investigators and the Australian and New Zealand Intensive Care Society Clinical Trials Group Conservative oxygen therapy during mechanical ventilation in the ICU. N Engl J Med. 2020;382:989–998. doi: 10.1056/NEJMoa1903297. [DOI] [PubMed] [Google Scholar]
- 5.Schjørring O.L., Klitgaard T.L., Perner A., et al. Lower or higher oxygenation targets for acute hypoxemic respiratory failure. N Engl J Med. 2021;384:1301–1311. doi: 10.1056/NEJMoa2032510. [DOI] [PubMed] [Google Scholar]
- 6.Iwashyna T.J., Burke J.F., Sussman J.B., Prescott H.C., Hayward R.A., Angus D.C. Implications of heterogeneity of treatment effect for reporting and analysis of randomized trials in critical care. Am J Respir Crit Care Med. 2015;192:1045–1051. doi: 10.1164/rccm.201411-2125CP. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Young P.J. Effect of oxygen therapy on mortality in the ICU. N Engl J Med. 2021;384:1361–1363. doi: 10.1056/NEJMe2101538. [DOI] [PubMed] [Google Scholar]
- 8.Kent D.M., Steyerberg E., Van Klaveren D. Personalized evidence based medicine: predictive approaches to heterogeneous treatment effects. BMJ. 2018;363:k4245. doi: 10.1136/bmj.k4245. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Goligher E.C., Tomlinson G., Hajage D., et al. Extracorporeal membrane oxygenation for severe acute respiratory distress syndrome and posterior probability of mortality benefit in a post hoc Bayesian analysis of a randomized clinical trial. JAMA. 2018;320:2251–2259. doi: 10.1001/jama.2018.14276. [DOI] [PubMed] [Google Scholar]
- 10.Zampieri F.G., Costa E.L., Iwashyna T.J., et al. Heterogeneous effects of alveolar recruitment in acute respiratory distress syndrome: a machine learning reanalysis of the Alveolar Recruitment for Acute Respiratory Distress Syndrome trial. Br J Anaesth. 2019;123:88–95. doi: 10.1016/j.bja.2019.02.026. [DOI] [PubMed] [Google Scholar]
- 11.Zampieri F.G., Damiani L.P., Bakker J., et al. Effects of a resuscitation strategy targeting peripheral perfusion status versus serum lactate levels among patients with septic shock. A Bayesian reanalysis of the ANDROMEDA-SHOCK trial. Am J Respir Crit Care Med. 2020;201:423–429. doi: 10.1164/rccm.201905-0968OC. [DOI] [PubMed] [Google Scholar]
- 12.Granholm A., Marker S., Krag M., et al. Heterogeneity of treatment effect of prophylactic pantoprazole in adult ICU patients: a post hoc analysis of the SUP-ICU trial. Intensive Care Med. 2020;46:717–726. doi: 10.1007/s00134-019-05903-8. [DOI] [PubMed] [Google Scholar]
- 13.The REMAP-CAP Investigators Interleukin-6 receptor antagonists in critically ill patients with Covid-19. N Engl J Med. 2021;384:1491–1502. doi: 10.1056/NEJMoa2100433. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.The Writing Committee for the REMAP-CAP Investigators Effect of hydrocortisone on mortality and organ support in patients with severe COVID-19: the REMAP-CAP COVID-19 corticosteroid domain randomized clinical trial. JAMA. 2020;324:1317–1329. doi: 10.1001/jama.2020.17022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Angus D.C., Berry S., Lewis R.J., et al. The REMAP-CAP (randomized embedded multifactorial adaptive platform for community-acquired pneumonia) study rationale and design. Ann Am Thorac Soc. 2020;17:879–891. doi: 10.1513/AnnalsATS.202003-192SD. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Klitgaard T.L., Schjørring O.L., Lange T., et al. Bayesian and heterogeneity of treatment effect analyses of the HOT-ICU trial—a secondary analysis protocol. Acta Anaesthesiol Scand. 2020;9:1376–1381. doi: 10.1111/aas.13669. [DOI] [PubMed] [Google Scholar]
- 17.Schjørring O.L., Perner A., Wetterslev J., et al. Handling Oxygenation Targets in the Intensive Care Unit (HOT-ICU)—protocol for a randomised clinical trial comparing a lower vs a higher oxygenation target in adults with acute hypoxaemic respiratory failure. Acta Anaesthesiol Scand. 2019;63:956–965. doi: 10.1111/aas.13356. [DOI] [PubMed] [Google Scholar]
- 18.Schjørring O.L., Klitgaard T.L., Perner A., et al. The handling oxygenation targets in the intensive care unit (HOT-ICU) trial: detailed statistical analysis plan. Acta Anaesthesiol Scand. 2020;64:847–856. doi: 10.1111/aas.13569. [DOI] [PubMed] [Google Scholar]
- 19.Ferreira D., Barthoulot M., Pottecher J., Torp K.D., Diemunsch P., Meyer N. A consensus checklist to help clinicians interpret clinical trial results analysed by Bayesian methods. Br J Anaesth. 2020;125:208–215. doi: 10.1016/j.bja.2020.04.093. [DOI] [PubMed] [Google Scholar]
- 20.Ferreira D., Barthoulot M., Pottecher J., Torp K.D., Diemunsch P., Meyer N. Theory and practical use of Bayesian methods in interpreting clinical trial data: a narrative review. Br J Anaesth. 2020;125:1–7. doi: 10.1016/j.bja.2020.04.092. [DOI] [PubMed] [Google Scholar]
- 21.Granholm A., Marker S., Krag M., et al. Heterogeneity of treatment effect of stress ulcer prophylaxis in ICU patients: a secondary analysis protocol. Acta Anaesthesiol Scand. 2019;63:1251–1256. doi: 10.1111/aas.13432. [DOI] [PubMed] [Google Scholar]
- 22.Sung L., Hayden J., Greenberg M.L., Koren G., Feldman B.M., Tomlinson G.A. Seven items were identified for inclusion when reporting a Bayesian analysis of a clinical study. J Clin Epidemiol. 2005;58:261–268. doi: 10.1016/j.jclinepi.2004.08.010. [DOI] [PubMed] [Google Scholar]
- 23.von Elm E., Altman D.G., Egger M., Pocock S.J., Gøtzsche P.C., Vandenbroucke J.P. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol. 2008;61:344–349. doi: 10.1016/j.jclinepi.2007.11.008. [DOI] [PubMed] [Google Scholar]
- 24.Carpenter B., Gelman A., Hoffman M.D., et al. Stan: a probabilistic programming language. J Stat Softw. 2017;76:1–31. doi: 10.18637/jss.v076.i01. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Bürkner P.C. brms: an R package for Bayesian multilevel models using Stan. J Stat Softw. 2017;80:1–28. [Google Scholar]
- 26.Bürkner P.C. Advanced Bayesian multilevel modeling with the R package brms. R J. 2018;10:395–411. [Google Scholar]
- 27.Kruschke J. 2nd Edn. Academic Press; Cambridge, MA: 2014. Doing bayesian data analysis—a tutorial with R, JAGS, and stan. [Google Scholar]
- 28.Ryan E.G., Harrison E.M., Pearse R.M., Gates S. Perioperative haemodynamic therapy for major gastrointestinal surgery: the effect of a Bayesian approach to interpreting the findings of a randomised controlled trial. BMJ Open. 2019;9 doi: 10.1136/bmjopen-2018-024256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Vincent J.-L., Moreno R., Takala J., et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intensive Care Med. 1996;22:707–710. doi: 10.1007/BF01709751. [DOI] [PubMed] [Google Scholar]
- 30.McGlothlin A.E., Viele K. Bayesian hierarchical models. JAMA. 2018;320:2365–2366. doi: 10.1001/jama.2018.17977. [DOI] [PubMed] [Google Scholar]
- 31.ANZICS. MEGA-ROX trial (ANZICS reg.no. CTG1920-01) 2021. Available from https://www.anzics.com.au/current-active-endorsed-research/mega-rox/ (accessed April 14 2021).
- 32.Intensive Care National Audit & Research Centre. UK-ROX (ICNARC project number: NIHR130508) 2021. Available from https://www.icnarc.org/Our-Research/Studies/Uk-Rox (accessed April 14 2021).
- 33.Young P., Mackle D., Bellomo R., et al. Conservative oxygen therapy for mechanically ventilated adults with sepsis: a post hoc analysis of data from the intensive care unit randomized trial comparing two approaches to oxygen therapy (ICU-ROX) Intensive Care Med. 2020;46:17–26. doi: 10.1007/s00134-019-05857-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Granholm A., Møller M.H., Krag M., Perner A., Hjortrup P.B. Predictive performance of the Simplified Acute Physiology Score (SAPS) II and the initial Sequential Organ Failure Assessment (SOFA) score in acutely ill intensive care patients: post-hoc analyses of the SUP-ICU inception cohort study. PLoS One. 2016;11 doi: 10.1371/journal.pone.0168948. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Singer M., Deutschman C.S., Seymour C., et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3) JAMA. 2016;315:801–810. doi: 10.1001/jama.2016.0287. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.