Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Jul 16;15(7):e0236014. doi: 10.1371/journal.pone.0236014

Different depths of sedation versus risk of delirium in adult mechanically ventilated patients: A systematic review and meta-analysis

Ling Long 1, Shan Ren 1, Yichun Gong 2, Haotian Zhao 3, Cong He 1, Limin Shen 1, Heling Zhao 1,#, Penglin Ma 1,4,*,#
Editor: Luciane Cruz Lopes5
PMCID: PMC7365415  PMID: 32673352

Abstract

Background

Delirium is multifactorial. This study aimed at determining the association between different depths of sedation and the risk of delirium in adult mechanically ventilated patients.

Methods

A systematic literature retrieval was conducted in databases including Cochrane Central Register of Controlled Trials, PubMed, Embase, Cumulative Index to Nursing and Allied Health Literature for publications available till December 2019 without limitation in study type, and followed by a secondary retrieval for related literature. STATA15.1 and WinBugs 14.3 were used in statistical analyses for different sedation depths as the intervention. The main endpoint was delirium occurrence. Secondary endpoints were agitation-related adverse events and mortality.

Results

We included 18 studies comprising 8001 mechanically ventilated patients. Different sedation depths were not associated with the occurrence of delirium (OR = 1.00, 95%CI: 0.64–1.58, P = 0.993). Among the 18 enrolled studies, this finding was not confounded by the dosage of benzodiazepines (OR = 0.96, 95%CI: 0.79–1.17, P = 0.717) in eight randomized controlled trials(RCTs) or the patients’ disease severity(OR 0.95, 95%CI: 0.79–1.13, P = 0.548) in 10 RCTs. However, contrasting results were found in non-RCTs. The deeper sedation group had a significantly increased risk for death(OR = 1.82, 95% CI: 1.23–2.69, P = 0.003), whereas lighter sedation seemed a potential risk for agitation-related adverse events (OR = 0.61, 95%CI: 0.45–0.84, P = 0.002).

Conclusions

It is inconclusive whether significantly different sedation depths would change the risk of delirium in adult mechanically ventilated patients.

Trial registration number

The study was registered in PROSPERO(http://www.crd.york.ac.uk/PROSPERO/) under registration number CRD42019145276.

Introduction

Delirium is an acute brain dysfunction [1]. Previous studies demonstrated that the incidence of delirium was approximately 10%-30% in hospitalized patients and 80% in critically ill patients under mechanical ventilation (MV) [2,3]. Notably, increasing evidence suggests that delirium was associated with poor outcomes of ICU patients such as ICU readmission and prolonged hospitalization, long-term cognitive impairment and high mortality [2,4].

The mechanism of delirium remains unclear [5]. Risk factors for delirium include illness-related acute pathophysiological abnormalities(e.g., hypotension, acidosis, hypoxia and sepsis) [6], environmental factors (e.g., lighting, alarm sounds, and noise); and iatrogenic harms (e.g., frequent suctions, puncture, immobilization and even use of analgesic and sedative drugs against these stimuli) [79]. Of those, potential and modifiable risk factors were highly interested, for example minimizing sedation and against use of benzodiazepines [10]. Significantly, numerous studies reported that patients receiving deep sedation were more susceptible to post-traumatic stress disorder syndrome, ICU memory disorder and delirium [11,12]. A recent published meta-analysis revealed that delirium frequency was 28.7% in the light sedation group in comparison with 48.5% in the deep sedation group of patients with MV, but odds ratio, 0.50 (0.22–1.16) [13]. It was presumed that limited data from randomized controlled trials (RCT) was inadequately powered to show a significant association while high heterogeneity existed in the enrolled studies. In fact, there were a few published RCTs primarily regarding the effect of sedation depth on delirium occurrence in critically ill patients with MV yet [14,15]. Meanwhile, it was noticed that a significant difference of sedation depths (e.g., lighter vs. deeper) as a component of intervention was involved in the design of some RCTs [1619]. Interestingly, these studies compared clinical outcomes such as the occurrence of delirium, agitation-related adverse events, and mortality. Therefore, we hypothesized that adding additional high quality data extracted from these studies, an updated meta-analysis might provide a more convincible conclusion on the relationship between sedation depth and the occurrence of delirium in critically ill patients under MV.

Methods

A systematic review protocol was prepared in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocol (PRISMA-P) statement. This systematic review was registered in the PROSPERO international prospective register of systematic reviews (CRD42019145276). Ethical approval was vaived for this study.

Study identification

The literature retrieval strategy followed the Cochrane Interventional Systems Review Interventions [20], by which we searched databases, including Cochrane Central Register of Controlled Trials (2019, Issue12), Pubmed (from 1946 to December 31, 2019), Embase (from 1974 to December 31, 2019), and Cumulatve Index to Nursing and Allied Health Literature (from 1937 to December 31, 2019). We also conducted a secondary retrieval for selected literature (S1 File describes the retrieval strategy details). Our search strategy was prepared with the assistance of a medical librarian.

Inclusion criteria

Patients

Adult patients (age >18 years) under MV were eligible. Patients with alcohol withdrawal syndrome, brain injury or speech disorders were excluded because these factors may confound the evaluation of delirium.

Intervention

Depth of sedation. The sedation depth in these studies was evaluated primarily by using sedation score scales [e.g., Richmond Agitation-Sedation Scale (RASS) [21], Riker Sedation-Agitation Scale (SAS) [22], Ramsay Sedation scale [23], and Motor Activity Assessment Scale (MAAS) [24]]. There were no strict limitations on category, dosage, or administration method or rate of the sedative infusion. Studies involving different sedation depths between two groups were eligible, including studies with the sedation depth clearly defined in their methodology, based on which patients were grouped (e.g., deep sedation vs. light sedation); studies without such a definition but that implied statistical difference in sedation depth (P<0.05); and studies using sedation as a component of intervention and showing a difference in sedation depth (P<0.05). In this meta-analysis, the terms of lighter sedation and deeper sedation were predefined as the intervention for classification of two groups in the enrolled studies.

Comparisons

The groups compared were deep sedation versus light sedation, deeper sedation versus lighter sedation, sedation versus no sedation, and routine sedation versus prevent deep sedation.

Outcomes

The main outcome was the occurrence of delirium. The diagnosis of delirium was based primarily on the Confusion Assessment Method for the ICU (CAM-ICU) scale [25] and the Diagnostic and Statistical Manual of Mental Disorders, 4th Edition (DSM-IV) [26]. Secondary outcomes included the incidence of agitation-related adverse events (self-extubation), and mortality.

Document types

Randomized controlled studies, before-after controlled studies, and prospective/retrospective cohort studies were included. Animal experiments, reviews, case reports and studies with incomplete data were excluded.

Study selection and data abstraction

Based on the objective of the study, the required data and information were listed. Two researchers independently reviewed all literature. All documents were initially de-duplicated, and then screened based on the title and content of the abstract. If the eligibility of a literature report was difficult to determine, the full text was retrieved for further screening with the reasons for exclusion, and it was documented in the inclusion/exclusion flow chart. A crosscheck was then conducted. Any discrepancy was settled by discussion or consultation with a third evaluator.

An electronic data sheet was established, based on the requirements of the Cochrane Handbook for Systematic Reviews of Interventions, which includes the general data of the included literature (e.g., author, year, and experimental design method), the enrolled patients’ profiles (e.g., sample size, and severity of disease), intervention characteristics (e.g., depth of sedation), and indicators of outcome (e.g., delirium occurrence, incidence of agitation-related adverse events, and mortality). In instances of incomplete data from the included literature or any doubt existed regarding the data, the study’s author was consulted. Two authors independently extracted the data included in the literature. Differences were resolved by consensus or by consulting a third author.

Study quality assessment

The two authors used the biased risk assessment tool described in the Cochrane Manual to evaluate the risk of the included randomized controlled studies [20]. They used the Newcastle-Ottawa Scale to evaluate the risk of bias assessment for nonrandomized controlled studies [27]. Final decisions regarding differences were determined by discussion or consultation with a third author. In instances of missing data, the original author was contacted to retrieve the data. If the author was out of contact, the research team explored the reasons for the missing data and its possible impact on the results. If a sufficient number of studies (e.g., more than 10 studies) were eligible for inclusion, a funnel chart was used to assess publication bias. If the funnel charts seemed asymmetric, the team discussed possible causes, which was then confirmed by statistical tests.

Data analysis

Statistical softwares STATA15.1 (StataCorp., College Station, TX, USA) and WinBugs14.3 (Imperial College and Medical Research Council, London, UK) were applied to evaluate the efficacy of intervention. For bicategorized data (e.g., delirium occurrence, incidence of agitation-related adverse events, and mortality), we used the odds ratio (OR) and 95% confidence interval (95%CI). We also explored the clinical heterogeneity, based on differences in research design, population profiles, and intervention measures.

We also used STATA15.1 software to analyze clinical heterogeneity and methodological heterogeneity, and to evaluate statistical heterogeneity by calculating Chi2 or I2 statistics. First, heterogeneity among the studies was determined using Chi2, the significance level was P = 0.10. To quantitatively analyze heterogeneity, I2 was used; the significance level was 50%. For P > 0.1 and I2 < 50%, homogeneity could be considered in multiple similar studies, and a fixed-effect model was applied to their meta-analysis. For P < 0.1 and I2 ≥ 50% but with the need for combination, based on the intergroup consistency (determined clinically), random effect models were selected for the meta-analysis [20]. When high heterogeneity was detected among the included studies, a subgroup analysis or Bayesian method exploration was conducted to minimize the impact of the heterogeneity on the results.

Results

Based on the retrieval strategy, 408 literature reports were identified; of these, 130 reports were excluded because of duplication, 158 reports were excluded after reviewing their titles and abstracts, and 105 reports were excluded after reviewing their full text. A second retrieval for the selected literature reports was conducted by reviewing their references and other related literature. We ultimately enrolled 18 studies reporting a correlation between different sedation depths and risk of delirium [1419, 2839], that included 10 RCTs, four before-after controlled trials, two prospective cohort studies, and two retrospective studies (Fig 1). Table 1 presents the general profiles of the studies enrolled. Based on the analysis of potential confounding factors influencing the occurrence of delirium, 13 of 18 studies indicated a significant difference in the dosage of benzodiazepines between deeper and lighter sedation. Moreover, 13 studies similarly reported no statistically significant difference in disease severity of patients between two sedation groups (S1 Table).

Fig 1. Flowchart of the recruited studies.

Fig 1

Table 1. Characteristics of the included studies.

Author/Year Study design ND/NL Age Different BDZ use Different SI Sedation depth Delirium assessment Outcomes Endpoints (primary/secondary)
Pandharipande et al. [17] (2007) RCT 51/52 59/60 Yes No RASS≤-3 CAM-ICU ①②③ 1. Duration of brain organ dysfunction (delirium or coma)
2. Prevalence of brain organ dysfunction (delirium or coma)
3. Mechanical ventilator-free day
RASS≥-2
4. Intensive care unit length of stay
5. Mortality(28-day)
6. Self-extubation
7. Cost of care
Samuelson et al. [14]. (2008) RCT 18/18 66/66 No No MAAS 1 to 2 CAM-ICU 1. ICU length of stay
2. Post-operative complications
3. Re-intubated
MAAS 3 to 4
4. Duration of mechanical ventilation
5. Delirium
Girard et al. [16] (2008) RCT 168/167 64/60 No No RASS -2.5 CAM-ICU ①②③ 1. Time breathing without assistance
2. Length of stay in ICU and hospital
3. Delirium
RASS -1.0
4. Complication (self-extubation)
5. Mortality (28-day and 1-year)
Treggiari et al. [15] (2009) RCT 50/52 60/63 Yes No Ramsay 3 to 4 DSM-IV ①②③ 1. PTSD-related symptoms
2. Mortality (ICU and hospital)
3. Duration of mechanical ventilation
Ramsay 1 to 2 4. Length of stay in ICU and hospital
5. Incidence of organ dysfunction
6. Complication (self-extubation)
Strøm et al. [18] (2010) RCT 58/55 65/67 Yes No Ramsay 3 to 4 DSM-IV ①②③ 1. Mechanical ventilator-free days
2. Length of stay in ICU and hospital
3. Mortality (ICU and hospital)
No sedation
4. Delirium
5. Complication (self-extubation)
Shehabi et al. [28] (2012) Prospective cohort study 171/80 Unclear No Unclear RASS -5 to -3 CAM-ICU ①③ 1. Time to extubation
2. Time to delirium
3. Time to hospital mortality
RASS -2 to 1
4. Mortality(180-day)
van den Boogaard et al. [29] (2012) Prospective cohort study 249/ 1017 Unclear No Unclear RASS-4 to -3 CAM-ICU ①③ 1. Duration of mechanical ventilation
2. Reintubation
RASS≥-2
3. Unplanned tube or catheter removal
4. Length of stay in ICU
5. Mortality(hospital)
Shehabi et al. [19] (2013) RCT 16/21 61/65 Yes No RASS-5 to -3 CAM-ICU ①②③ 1. Number of RASS measurements between –2 and –3 in 48 hour
2. Time to randomization
RASS-2 to 1
3. Dose and duration of rescue sedatives and opioids
Hager et al. [30] (2013) Before-after trial 120/82 48/52 Yes No RASS-5 to -2 CAM-ICU 1. Dose and duration of sedatives
RASS-3 to 0 2.Delirium
Shehabi et al. [31] (2013) RCT 30/30 48/52 Yes No RASS<-2 CAM-ICU ①③ 1. Number of RASS measurements between –2 and –3 in 48 hour
RASS-2 to 1 2. Time to randomization
3. Dose and duration of rescue sedatives and opioids
Nassar et al. [32] (2014) RCT 30/30 51/47 Yes No SAS 2.6 to 3.7 CAM-ICU ①②③ 1. Mechanical ventilator-free days
2. Mortality (ICU and hospital)
SAS 3.4 to 4.0 3. Delirium
4. Nurse workload
5. Self-extubation and psychological distress
Dale et al. [33] (2014) Before-after trial 703/780 48/49 Yes No RASS-1.30 CAM-ICU ①③ 1. duration of mechanical ventilation.
2. delirium
3. Frequency of assessment with the RASS and CAM-ICU instrument
RASS-0.99
4. Benzodiazepine dosing
5. Length of stay in ICU and hospital
6. Mortality(hospital)
Balzer et al. [34] (2015) Retrospective cohort study 513/ 1371 64/68 Yes Yes RASS -5 to -3 CAM-ICU ①③ 1. Mortality (ICU and hospital)
2. Length of stay in ICU and hospital
RASS -2 to 0 3. Time to extubation
4. Delirium
5. Hemodialysis in first 48 hour
Skrupky et al. [35] (2015) Before-after trial 97/102 58/56 Yes No RASS-5 to -3 CAM-ICU ①②③ 1. Level of sedation
2. Delirium
3. Duration of mechanical ventilation
4. Length of stay in ICU and hospital
RASS-2 to 0 5. Mortality
6. Complication (self-extubation)
Stephens et al. [36] (2017) Retrospective cohort study 231/132 Unclear No Unclear RASS-5 to -3 CAM-ICU ①③ 1. Mortality(hospital)
2. Duration of mechanical ventilation
RASS>-2 3. Length of stay in ICU and hospital
Kawazoe et al. [37] (2017) RCT 101/100 69/68 Yes No RASS<-2 CAM-ICU ①③ 1. Mortality(28-day)
2. Ventilator-free days(28-day)
3. Sequential Organ Failure Assessment score (days 1, 2, 4, 6, 8)
RASS-2 to 0
4. Delirium and coma
5. Length of stay in ICU
6.Renal function, nutrition state, and inflammation
Kaplan et al. [38] (2018) Before-after trial 66/66 60/61 Yes Yes RASS<-1 CAM-ICU ①②③ 1. ventilator-free days(28-day)
2. Cumulative sedative requirements
RASS-1 to 1 3. level of sedation
4. Delirium
5. Length of stay in ICU and hospital
De Jonghe et al. [39] (2018) RCT 590/584 67/66 Yes No RASS<-2* CAM-ICU ①②③ 1. Mortality (28-day, 90-day, and 1-year)
2.Time to first spontaneous breathing trial
RASS-2 to 0#
3.Time to successful extubation

ND: number in deeper sedation, NL: number in lighter sedation, BDZ: benzodiazepine (Different BDZ means there was a significant difference in BDZ dosage between two groups), SI: Severity of Illness (Different SI means that the severity of illness was significantly different between two groups no matter what tools were used. MAAS: Motor Activity Assessment Scale, RASS: Richmond Agitation Sedation Scale, SAS: Sedation Agitation Scale. CAM-ICU: Confusion Assessment Method for the Intensive Care Unit, DSM-IV: Diagnostic and Statistical Manual of mental disorders-fourth edition.

* The median level of sedation at randomization (the usual care).

# Estimated with protocol of over-sedation prevention (the goal of intervention).

Endpoints: ①Delirium, ②Agitation-related adverse events, ③Mortality.

Using Cochrane Risk of Bias Tool for randomized controlled studies and the Newcastle-Ottawa Scale for nonrandomized controlled studies indicated a low bias risk in all 18 studies (S2 Table, S1 Fig and Fig 2). A funnel chart for the occurrence of delirium showed a symmetrical distribution of the relative risk ratio of the occurrence of delirium (P = 0.711), which indicated a lower risk of publication bias. No study with a high risk of bias was discovered in the sensitivity analysis (Fig 3 and S2 Fig).

Fig 2. Risk of bias graph.

Fig 2

Fig 3. Funnel plot of insertion success for publication bias detection.

Fig 3

Correlation between sedation depth and delirium occurrence

In the meta-analysis, we included 8001 patients under MV from the 18 studies. The delirium occurrence was not significantly increased in patients under ventilation with deeper sedation, compared with patients with lighter sedation (OR = 1.00, 95%CI:0.64–1.58, P = 0.993; Fig 4). A high interstudy heterogeneity existed (I2 = 93.2%, P<0.001). Non-RCTs was the main reason for the high heterogeneity, based on subgroup analysis (I2 = 96.8%, P<0.001). Cohort studies by Shehabi, van den Boogaard and Balzer showed that deeper sedation increased the delirium risk [28,29,34]. However, three studies [30,33,35] reported an even higher delirium occurrence with lighter sedation. Despite low heterogeneity (I2 = 0.0%, P = 0.771) and high mergeability, the results of 10 RCTs (2221 mechanically ventilated patients in total) still failed to demonstrate sedation depth as a risk factor for delirium in patients under MV (OR = 0.95, 95% CI: 0.79–1.13, P = 0.548; Fig 4).

Fig 4. Odds ratio of different sedation depth affecting occurrence of delirium.

Fig 4

Influence of confounding factors on the correlation between sedation depth and delirium occurrence

Thirteen of the 18 studies in this meta-analysis reported a significant difference in the dosage of benzodiazepine between the lighter and deeper sedation group (P < 0.05). In these 13 studies, the lighter sedation group had a lower dosage of benzodiazepines (S1 Table). Pooled forest plots revealed no significant difference in the delirium risk between different sedation depths among studies showing a significant difference in the dosage of benzodiazepines (OR = 0.77, 95% CI: 0.53–1.11, P = 0.160; Fig 5). Three cohort studies [30,33,35] revealed a higher occurrence of delirium in the lighter sedation group with lower dosage of benzodiazepines than in the deeper sedation group. These findings contrasted those of one study [34], reporting an increased occurrence of delirium in the deeper sedation group because of the increased dosage of benzodiazepines (Fig 5).

Fig 5. Confounding effect of different BZD dosage on results of different sedation depth affecting occurrence of delirium.

Fig 5

BZD = Benzodiazepines.

The pooled forest plots of the 13 studies, which reported no significant difference in disease severity between the two groups, interestingly revealed a significantly higher risk of delirium in the lighter sedation group (OR = 0.68, 95% CI: 0.49–0.94, P = 0.021; Fig 6). Subgroup analysis was further conducted, based on whether a study had an RCT design. All three studies with a non-RCT design showed that light sedation increased the risk of delirium (OR = 0.40, 95% CI: 0.31–0.52, P < 0.001; Fig 6). For remaining 10 RCTs, the meta-analysis failed to show that sedation depth significantly influenced the delirium occurrence in mechanically ventilated patients whoes disease severity did not differ (OR = 0.95, 95%CI: 0.79–1.13, P = 0.548; Fig 6). The risk of delirium significantly increased in parallel with higher dosages of benzodiazepines and greater disease severity in the deeper sedation group than in the lighter sedation group in Balzer's study (S1 Table and Fig 5) [34].

Fig 6. Odds ratio of different sedation depth affecting occurrence of delirium in trials without difference in severity of diseases between the lighter and the deeper sedation groups.

Fig 6

Difference in sedation depth versus agitation-related adverse events and mortality

Nine of the 18 studies reported agitation-related adverse events, and included seven RCTs and two non-RCTs. Their findings (overall I2 = 0%) indicated a significantly higher risk of agitation-related adverse events in mechanically ventilated patients with lighter sedation (OR = 0.61, 95%CI: 0.45–0.84, P = 0.002; Fig 7).

Fig 7. The impact of discrepancy in depth of sedation on frequency of agitation-related adverse events.

Fig 7

Sixteen studies reported hospitalization mortality. Compared to the lighter sedation group, the deeper sedation group had a significantly higher risk of death (OR 1.82, 95% CI: 1.23–2.69, P = 0.003; Fig 8). In the subgroup analysis, nine RCTs and seven non-RCTs consistently indicated that deeper sedation significantly increased the risk of death (Fig 8).

Fig 8. The impact of discrepancy in depth of sedation on mortality.

Fig 8

Results from Bayesian-based meta-analysis

Based on I2 test analysis, heterogeneity was high (67.4% - 96.8%) among 18 studies that were included to confirm the effect of lighter sedation versus deeper sedation on delirium occurrence. The Bayesian method was consequently used for the meta-analysis. Bayesian random effect model showed an OR of 1.00 (95% CI: 0.61–1.62) for overall delirium occurrence, OR of 0.59 (95% CI: 0.35–0.95) for the incidence of agitation-related adverse events, and OR of 1.90 (95% CI: 1.27–2.85) for mortality comparisons, all of which showed the results consistent with those from traditional methods.

Discussion

Unlike the findings of a previous meta-analysis [13], we enrolled more RCT studies that reported a relationship between sedation depth and delirium occurrence (2 studies with 97 mechanically ventilated patients in previous one vs. 10 studies with 2221 mechanically ventilated patients in our study). However, we could not conclude from our meta-analysis that sedation depth altered the delirium risk in patients under MV (OR = 1.00, 95% CI: 0.64–1.58, P = 0.993; Fig 4). Similar to findings in previous studies [40,41], 16 merged analyses showed that deep sedation was a high risk factor for death in mechanically ventilated patients (OR = 1.82, 95% CI: 1.23–2.69, P = 0.003; Fig 8). However, our data suggested that lighter sedation significantly increased the potential risk of agitation-related adverse events in adult mechanically ventilated patients (OR = 0.61, 95%CI: 0.45–0.84, P = 0.002; Fig 7).

An increasing number of studies has examined the association of sedation depth with delirium occurrence in critically ill mechanically ventilated patients recently; however, few studies are RCTs. A systematic review of the literature indicated that light sedation (RASS ≥-2 or Ramsay 1 to 2) versus deep sedation (RASS≤-3 or Ramsay 3 to 4) was compared in only two RCTs that enrolled 37 and 60 mechanically ventilated patients respectively [19,31]. Most data comparing differences in sedation depth and delirium risk were obtained from non-RCT studies (e.g., prospective and retrospective cohort studies) [28,29,34,36]. Unfortunately, the studies’ results were highly varied. We also found that three of eight cohort studies (3401 mechanically ventilated patients in total) showed a high risk of delirium with deeper sedation [28,29,34]. By contrast, another four cohort studies (2245 mechanically ventilated patients in total) suggested that lighter sedation increased the occurrence of delirium [30,33,35,36]. We noticed that a significantly different depth of sedation was documented between the intervention group and control group in some RCTs reporting delirium. However, these RCTs missed to enrolled into the previous meta-analysis because the intervention group versus the control group was not clearly categorized as light vs deep sedation. Therefore, we substituted the terms “lighter sedation” and “deeper sedation” for the terms “light sedation” and “deep sedation” in the literature search strategy. Importantly, it was aimed to emphasize the effect of differences in sedation depth on occurrence of delirium and to avoid the confounding effect of different definitions of light and deep sedation between studies. Successfully, 10 RCTs were enrolled in this meta-analysis. However, RCTs reporting the occurrence of delirium as the primary or secondary outcome had a lower heterogeneity and did not provide conclusive information that sedation depth might alter the delirium risk in mechanically ventilated patients. Therefore, any unilateral emphasis on the results from low-quality studies (e.g., deep or light sedation may increase delirium risk) should be avoided.

Use of benzodiazepines was highly concerned as a risk factor for delirium in mechanically ventilated patients [4244], which might confound the association between sedation depth and risk of delirium. But, controversy remained owing to highly heterogeneous quality of those studies [45]. Our subgroup analysis similarly suggested contrasting findings among non-RCTs (Fig 5). However, the pooled forest plots of eight RCTs demonstrated that differences in the benzodiazepine dosage did not alter the conclusion that sedation depth does not influence the risk of delirium (OR = 0.77, 95% CI: 0.53–1.11, P = 0.160; Fig 5). Another concern regarding a confounding factor was the disease severity. Pandharipande et al. [42] reported that mechanically ventilated patients with a high score on the Acute Physiology and Chronic Health Evaluation II (APACHEII) scale or Sequential Organ Failure Assessment (SOFA) scale had a significantly increased risk of delirium. Thirteen of the 18 studies included in this meta-analysis interestingly reported no significant difference in disease severity between the two groups (Additional S1 File). Results from 10 RCTs (with higher quality) of these 13 studies suggested that the sedation depth did not change the risk of delirium in mechanically ventilated patients. By contrast, pooled forest plots of subgroup analysis from the other three non-RCTs studies showed that light sedation augmented the delirium risk (OR = 0.40, 95% CI: 0.31–0.52, P<0.001). After adjusting for the potential confounders benzodiazepine use and disease severity, our data remained inconclusive regarding for the association between sedation depth and risk of delirium in mechanically ventilated patients. Therefore, further studies are needed.

This meta-analysis also focused on sedation depth in relation to the risk of agitation-related adverse events and mortality in the enrolled studies. Consistent with the meta-analysis by Stephens et al. [13], which was that it focused on the first 48 hours of mechanical ventilation whereas our study includes studies across the course of critical illness. Our findings further convinced that deep sedation was a high risk factor for poor prognosis, based on a bigger sample size from studies with high quality. These results will inevitably strengthen the importance of maintaining light levels of sedation for most of adult ICU patients under MV, as recommended by the updated guidelines [4648]. However, we also found that lightly sedated mechanically ventilated patients might face a significantly high risk of agitation-related adverse events (OR = 0.61, 95% CI: 0.45–0.84, P = 0.002; Fig 7). Therefore, the challenge remains to our sedation practices either avoiding unjustified deep sedation or preventing MV patients from agitation and agitation-related adverse events [39,49,50].

This systematic review had several limitations. First, we enrolled RCTs and non-RCTs. The association between sedation depth and risk of delirium was significant but in opposite directions based on two parts of these non-RCTs. Although a high bias risk was not identified by sensitivity analysis, the quality of these studies might contribute to the controversy results largely. Second, the enrolled studies were inconsistent in assessing sedation depth (e.g., MAAS, RASS, SAS and Ramsay), evaluating severity of disease (e.g., APACHE II, Simplified Acute Physiology Score II, and SOFA), and diagnosing delirium (e.g., CAM-ICU and DSM-IV). However, the tools used the same in the two groups in each study. Notably, we focused on the effect of different sedation depths (i.e. “lighter sedation” vs “deeper sedation” rather than “light sedation” vs “deep sedation”) on the risk of delirium (both assessments were accepted widely) in mechanically ventilated patients. Therefore, the results are reliable. Third, statistical analyses revealed high heterogeneity, which might be related to the two limitations mentioned above. We managed to reduce this bias through subgroup analysis and a Bayesian method. We found that the results of most subgroup analyses seemed similar to those of the general meta-analysis.

Conclusions

In this systematic review of available literature and a meta-analysis, findings were inconclusive that different sedation depth would change the risk of delirium in critically ill patients with MV. An increased risk of death was associated with deeper sedation, whereas lighter sedation might have a risk potential for agitation-related adverse events. Therefore, further researches are needed to optimize sedation strategy for critically ill adult patients receiving MV.

Supporting information

S1 Checklist. PRISMA checklist.

(DOC)

S1 Fig. Newcastle Ottawa scale quality assessment.

ICU: Intensive Care Unit, APACHE II: Acute Physiology and Chronic Health Evaluation II, SAPS II: Simplified Acute Physiology Score II, BMI: Body Mass Index, ED: emergency department.

(TIF)

S2 Fig. Diagram of insertion success for sensitivity analysis.

(TIF)

S1 Table. Benzodiazepine used and patients’ severity of illness in the included studies.

D/L: Deeper/Lighter gourp, BDZ: benzodiazepine (Different BDZ means there was a significant difference in BDZ dosage between two groups), 1: mg/h, 2: mg/d, 3: mg(cumulative dose) 4: mg/kg/h, 5: mg/kg(cumulative dose), 6: %(% of patient midazolam was given), -: means without BZD or data unavailable. a: APACHEⅡ(Acute Physiology and Chronic Health EvaluationⅡ), b: SAPSⅡ (Simplified Acute Physiology ScoreⅡ), C: SOFA (Sequential Organ Failure Assessment)

(DOC)

S2 Table. Cochrane bias assessment of randomized studies.

(DOC)

S1 File. Search strategy.

(DOC)

S2 File. The table of GRADE.

(DOCX)

S3 File. The list of excluded studies.

(DOCX)

Acknowledgments

All authors contributed to the critical review and revision of the manuscript. All authors have seen and approved the final version of the manuscript.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

There are no funding.

References

  • 1.Meagher DJ, Trzepacz PT. Motoric subtypes of delirium. Semin Clin Neuropsychiatry, 2000,5(2):75–85. 10.153/SCNP00500075 [DOI] [PubMed] [Google Scholar]
  • 2.Ely EW, Shintani A, Truman B, et al. Delirium as a predictor of mortality in mechanically ventilated patients in the intensive care unit. JAMA, 2004,291(14):1753–1762. 10.1001/jama.291.14.1753 [DOI] [PubMed] [Google Scholar]
  • 3.Mcpherson JA, Wagner CE, Boehm LM, et al. Delirium in the cardiovascular ICU: exploring modifiable risk factors. Crit Care Med, 2013,41(2):405–413. 10.1097/CCM.0b013e31826ab49b [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Pandharipande PP, Girard TD, Jackson JC, et al. Long-Term Cognitive Impairment after Critical Illness. N Engl J Med, 2013,369(14):1306–1316. 10.1056/NEJMoa1301372 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Reade MC, Finfer S. Sedation and Delirium in the Intensive Care Unit[J]. N Engl J Med, 2014, 370(5):444–454. 10.1056/NEJMra1208705 [DOI] [PubMed] [Google Scholar]
  • 6.Hsieh SJ, Ely EW, Gong MN. Can intensive care unit delirium be prevented and reduced?. Lessons learned and future directions[J]. Ann Am Thorac Soc, 2013, 10(6):648–656. 10.1513/AnnalsATS.201307-232FR [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Rompaey BV, Elseviers MM, Schuurmans MJ, et al. Risk factors for delirium in intensive care patients: a prospective cohort study. Crit Care, 2009, 13(3):R77 10.1186/cc7892 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Zaal IJ, Spruyt CF, Peelen LM, et al. Intensive care unit environment may affect the course of delirium. Intensive Care Med, 2013, 39(3):481–488. 10.1007/s00134-012-2726-6 [DOI] [PubMed] [Google Scholar]
  • 9.Girard TD, Ware LB, Bernard GR, et al. Associations of markers of inflammation and coagulation with delirium during critical illness. Intensive Care Med, 2012, 38(12):1965–1973. 10.1007/s00134-012-2678-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Zaal IJ, Devlin JW, Peelen LM, et al. A Systematic Review of Risk Factors for Delirium in the ICU. Crit Care Med, 2015, 43(1):40–47. 10.1097/CCM.0000000000000625 [DOI] [PubMed] [Google Scholar]
  • 11.Treggiari MM, Romand JA, Yanez ND, et al. Randomized trial of light versus deep sedation on mental health after critical illness. Crit Care Med, 2009, 37(9):2527–2534. 10.1097/CCM.0b013e3181a5689f [DOI] [PubMed] [Google Scholar]
  • 12.Sieber FE, Zakriya KJ, Gottschalk A, et al. Sedation Depth During Spinal Anesthesia and the Development of Postoperative Delirium in Elderly Patients Undergoing Hip Fracture Repair. Mayo Clin Proc, 2010, 85(1):18–26. 10.4065/mcp.2009.0469 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Stephens RJ, Dettmer MR, Roberts BW, et al. Practice Patterns and Outcomes Associated With Early Sedation Depth in Mechanically Ventilated Patients: A Systematic Review and Meta-Analysis*. Crit Care Med, 2018, 46(3):471–479. 10.1097/CCM.0000000000002885 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Samuelson KAM, Lundberg D, Fridlund B. Light vs. heavy sedation during mechanical ventilation after oesophagectomy–a pilot experimental study focusing on memory. Acta Anaesthesiol Scand, 2008, 52(8):1116–1123. 10.1111/j.1399-6576.2008.01702.x [DOI] [PubMed] [Google Scholar]
  • 15.Treggiari MM, Romand JA, Yanez ND, et al. Randomized trial of light versus deep sedation on mental health after critical illness*. Crit Care Med, 2009, 37(9):2527–2534. 10.1097/CCM.0b013e3181a5689f [DOI] [PubMed] [Google Scholar]
  • 16.Girard TD. Efficacy and safety of a paired sedation and ventilator weaning protocol for mechanically ventilated patients in intensive care (Awakening and Breathing Controlled trial): a randomised controlled trial. Lancet, 2008, 371(9607):126–134. 10.1016/S0140-6736(08)60105-1 [DOI] [PubMed] [Google Scholar]
  • 17.Pandharipande PP, Pun BT, Herr DL, et al. Effect of sedation with dexmedetomidine vs lorazepam on acute brain dysfunction in mechanically ventilated patients: the MENDS randomized controlled trial. JAMA, 2007, 298(22):2644–2654. 10.1001/jama.298.22.2644 [DOI] [PubMed] [Google Scholar]
  • 18.Strøm T, Martinussen T, Toft P. A protocol of no sedation for critically ill patients receiving mechanical ventilation: a randomised trial. Lancet, 2010, 375(9713):475–480. 10.1016/S0140-6736(09)62072-9 [DOI] [PubMed] [Google Scholar]
  • 19.Shehabi Y, Bellomo R, Reade MC, et al. Early Goal-Directed Sedation Versus Standard Sedation in Mechanically Ventilated Critically Ill Patients: A Pilot Study*. Crit Care Med, 2013, 41(8):1983–1991. 10.1097/CCM.0b013e31828a437d [DOI] [PubMed] [Google Scholar]
  • 20.Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. [Google Scholar]
  • 21.Ely EW, Truman B, Shintani A, et al. Monitoring Sedation Status Over Time in ICU Patients: Reliability and Validity of the Richmond Agitation-Sedation Scale (RASS). JAMA, 2003, 289(22):2983–2991. 10.1001/jama.289.22.2983 [DOI] [PubMed] [Google Scholar]
  • 22.Riker RR, Picard JT, Fraser GL. Prospective evaluation of the Sedation-Agitation Scale for adult critically ill patients. Crit Care Med, 1999, 27(7):1325–1329. 10.1097/00003246-199907000-00022 [DOI] [PubMed] [Google Scholar]
  • 23.Ramsay MA, Savege TM, Simpson BR, et al. Controlled sedation with alpaxalone-alphadolone. Br Med J, 1974, 2(5920):656–659. 10.1136/bmj.2.5920.656 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Devlin JW, Boleski G, Mlynarek M, et al. Motor activity assessment scale: a valid and reliable sedation scale for use with mechanically ventilated patients in an adult surgical intensive care unit. Crit Care Med, 1999, 27(7):1271–1275. 10.1097/00003246-199907000-00008 [DOI] [PubMed] [Google Scholar]
  • 25.Ely EW, Inouye SK, Bernard GR, et al. Delirium in mechanically ventilated patients: validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU). JAMA, 2001, 286(21):2703–2710. 10.1001/jama.286.21.2703 [DOI] [PubMed] [Google Scholar]
  • 26.American Psychiatric Association. Diagnostic and StatisticalManual of Mental Discorders (DSM-4). 4th Edition Washington, DC: American Psychiatric Publishing, 1994. [Google Scholar]
  • 27.Stang A. Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. Eur J Epidemiol.2010;25(9):603–605. 10.1007/s10654-010-9491-z [DOI] [PubMed] [Google Scholar]
  • 28.Shehabi Y, Bellomo R, Reade MC, et al. Early Intensive Care Sedation Predicts Long-Term Mortality in Ventilated Critically Ill Patients. Am J Respir Crit Care Med, 2012, 186(8):724–731. 10.1164/rccm.201203-0522OC [DOI] [PubMed] [Google Scholar]
  • 29.van den Boogaard M, Schoonhoven L, van der Hoeven JG, et al. Incidence and short-term consequences of delirium in critically ill patients: A prospective observational cohort study. Int J Nurs Stud, 2012, 49(7):775–783. 10.1016/j.ijnurstu.2011.11.016 [DOI] [PubMed] [Google Scholar]
  • 30.Hager DN, Dinglas VD, Subhas S, et al. Reducing Deep Sedation and Delirium in Acute Lung Injury Patients: A Quality Improvement Project*. Crit Care Med, 2013, 41(6):1435–1442. 10.1097/CCM.0b013e31827ca949 [DOI] [PubMed] [Google Scholar]
  • 31.Shehabi Y, Ismail WN, Saman MA, et al. Early goal directed sedation with dexmedetomidine vs standard sedatives, randomized control trial. Crit Care Med, 2013, 41(2):A217. [Google Scholar]
  • 32.Nassar Junior AP, Park M. Daily sedative interruption versus intermittent sedation in mechanically ventilated critically ill patients: a randomized trial. Ann Intensive Care, 2014, 4(1):14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Dale CR, Kannas DA, Fan VS, et al. Improved analgesia, sedation, and delirium protocol associated with decreased duration of delirium and mechanical ventilation. Ann Am Thorac Soc, 2014, 11(3):367–374. 10.1513/AnnalsATS.201306-210OC [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Balzer F, Weib B, Kumpf O, et al. Early deep sedation is associated with decreased in-hospital and two-year follow-up survival. Crit Care, 2015, 19(1):197. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Skrupky LP, Drewry AM, Wessman B, et al. Clinical effectiveness of a sedation protocol minimizing benzodiazepine infusions and favoring early dexmedetomidine: a before-after study. Crit Care, 2015, 19(1):136. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Stephens RJ, Ablordeppey E, Drewry AM, et al. Analgosedation practices and the impact of sedation depth on clinical outcomes among patients requiring mechanical ventilation in the emergency department: a cohort study. Chest, 2017, 152(5):963–971. 10.1016/j.chest.2017.05.041 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Kawazoe Y, Miyamoto K, Morimoto T, et al. Effect of Dexmedetomidine on Mortality and Ventilator-Free Days in Patients Requiring Mechanical Ventilation With Sepsis. JAMA, 2017, 317(13):1321–1328. 10.1001/jama.2017.2088 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Kaplan JB, Eiferman DA, Porter K, et al. Impact of a nursing-driven sedation protocol with criteria for infusion initiation in the surgical intensive care unit. J Crit Care, 2018, 30(50):195–200. [DOI] [PubMed] [Google Scholar]
  • 39.De Jonghe B, Aboab J, Aissaoui N, et al. Impact of oversedation prevention in ventilated critically ill patients: a randomized trial-the AWARE study. Ann Intensive Care, 2018, 8(1):93 10.1186/s13613-018-0425-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Kollef MH, Levy NT, Ahrens TS, et al. The use of continuous i.v. sedation is associated with prolongation of mechanical ventilation. Chest 1998;114(2):541–548. 10.1378/chest.114.2.541 [DOI] [PubMed] [Google Scholar]
  • 41.Tanaka LM, Azevedo LC, Park M, et al. ERICC study investigators. Early sedation and clinical outcomes of mechanically ventilated patients: a prospective multicenter cohort study. Crit Care 2014;18(4):R156 10.1186/cc13995 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Pandharipande P, Shintani A, Peterson J, et al. Lorazepam is an independent risk factor for transitioning to delirium in intensive care unit patients. Anesthesiology 2006;104(1):21–26. 10.1097/00000542-200601000-00005 [DOI] [PubMed] [Google Scholar]
  • 43.Pisani MA, Murphy TE, Araujo KL, et al. Benzodiazepine and opioid use and the duration of intensive care unit delirium in an older population. Crit Care Med 2009;37(1):177–183. 10.1097/CCM.0b013e318192fcf9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Pisani MA, Murphy TE, Araujo KL, et al. Factors associated with persistent delirium after intensive care unit admission in an older medical patient population. J Crit Care 2010;25(3):540.e1–e7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Kok L, Slooter A J, Hillegers M H, et al. Benzodiazepine Use and Neuropsychiatric Outcomes in the ICU. Crit Care Med, 2018, 46(10):1673–1680. 10.1097/CCM.0000000000003300 [DOI] [PubMed] [Google Scholar]
  • 46.Barr J, Fraser GL, Puntillo K, Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit Care Med, 2013;41(1):263–306. 10.1097/CCM.0b013e3182783b72 [DOI] [PubMed] [Google Scholar]
  • 47.Vincent JL, Shehabi Y, Walsh TS, et al. Comfort and patient-centred care without excessive sedation: the eCASH concept. Intensive Care Med, 2016, 42(6):962–971. 10.1007/s00134-016-4297-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Devlin JW, Skrobik Y, Gélinas C, et al. Clinical Practice Guidelines for the Prevention and Management of Pain, Agitation/Sedation, Delirium, Immobility, and Sleep Disruption in Adult Patients in the ICU. Crit Care Med, 2018;46(9):825–873. [DOI] [PubMed] [Google Scholar]
  • 49.Rose L, Fitzgerald E, Cook D, et al. Clinician perspectives on protocols designed to minimize sedation. J Crit Care, 2015;30(2):348–352. 10.1016/j.jcrc.2014.10.021 [DOI] [PubMed] [Google Scholar]
  • 50.Jaber S, Chanques G, Altairac C, et al. A Prospective Study of Agitation in a Medical-Surgical ICU: Incidence, Risk Factors, and Outcomes. CHEST, 2005,128(4):2749–2757. 10.1378/chest.128.4.2749 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Luciane Cruz Lopes

23 Jan 2020

PONE-D-19-33669

Different Depths of Sedation Versus Risk of Delirium in Adult Mechanically Ventilated Patients: A Systematic Review and Meta-Analysis

PLOS ONE

Dear Dr Ma,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Mar 08 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Luciane Cruz Lopes, PhD

Academic Editor

PLOS ONE

Journal Requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that the original search was performed in December 2019. To ensure that your systematic review is up-to-date and comprehensive, we ask that you please update the search period to ensure that the literature search includes studies that have been published within the last 12 months.

3. At this time, we ask that you please move the Newastle-Ottawa scale quality assessment, risk of bias graph and funnel plot provided as additional files in your submission to the manuscript as Figure files.

4. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

5. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate "supporting information" files.

6. Thank you for stating the following financial disclosure:

a) Please provide an amended Funding Statement that declares *all* the funding or sources of support received during this specific study (whether external or internal to your organization) as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now.  

b) Please state what role the funders took in the study.  If any authors received a salary from any of your funders, please state which authors and which funder. If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

7. Thank you for stating the following in your Competing Interests section: 

Please complete your Competing Interests on the online submission form to state any Competing Interests. If you have no competing interests, please state "The authors have declared that no competing interests exist.", as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now

This information should be included in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

Additional Editor Comments:

Dear Authors,

        My assessment is very similar to the two reviewers. I think that paper is described but it needs to add some important analyzes, for example the quality analysis of the body of evidence separately for each outcome (GRADE) as mentioned by one of the reviewers.

   I also didn't see the discussion about sensitivity and heterogeneity analysis.

I also agree with the lack of clarity about the exposure variable definition of depth of sedation with different cut-offs for sedation depths among the included studies.

It would be great if authros could answer point by point suggested by reviewers

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript “Different Depths of Sedation Versus Risk of Delirium in Adult Mechanically Ventilated Patients: A Systematic Review and Meta-Analysis” by Ma and colleagues sought to answer the question whether different sedation depths are associated with higher delirium risk. Based on their findings, they concluded that at present, there is inconclusive evidence whether different sedation depths would change the risk of delirium in adult mechanically ventilated patients. Overall, the manuscript is drafted appropriately, and the authors have looked through the confounding factors that may affect the outcome. I have some comments which are outlined below.

1. I am a little concerned about the exposure variable definition of depth of sedation. As different studies used different cut-offs for sedation depths, sweeping statement based on combining these different exposures may lead us to inconclusive findings as seen in the review. That will be my major concern while trying to conclude depths of sedation as a risk factor for delirium when the exposure depths are not same in the studies. While most studies seem to be using the cut-off of RASS greater than or equal to -3, it is not the same with all the studies. It may be worthwhile to pool studies which are consistent and see if the findings hold.

2. The other major concern I have is regarding the outcome variable which is delirium incidence. How is this defined? In the literature, it has been defined multiple ways and I am not sure how the authors have construed it for their review. This again will result in discrepancy among studies. As there has been debate about how to define incidence versus prevalence especially in ICU settings where patients may have been admitted with delirium, the authors may want to think this over. One suggestion is to keep it general with a term such as delirium occurrence.

3. An interesting finding to note is the absence of a confounding effect of BZD on delirium. This really needs to be highlighted in the discussion. BZD have been thought of as risk factors for delirium, but the authors findings point towards a much-nuanced issue. Are these effects independent of sedation depth or is it a direct effect? The authors need to comment further on this in the discussion.

4. The findings of light sedation increasing delirium risk need to be further elaborated as this seems counter intuitive to current approaches.

5. Based on the mortality findings, in the absence of increasing delirium risk, depth of sedation is independently associated with mortality. Is this cause or could this be due to sicker patients kept deeply sedated. I would suspect that as this finding holds in RCT with randomized approach, the latter is not the case. This will need further discussion in the discussion section. May be an analysis with stratification based on illness severity may help clarify this further.

Reviewer #2: Although the authors did not assess the quality of the evidence set and the strength of the recommendation (GRADE), for each of the results analyzed, I think that the review was very well conducted, that the problem of delusion is the order of the day in intensive care units and, why, the results of the studies may help a lot in making decisions about sedation and analgesia of patients in these units.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 16;15(7):e0236014. doi: 10.1371/journal.pone.0236014.r002

Author response to Decision Letter 0


20 Feb 2020

Thank you for letter and for the reviewer’ comments concerning our manuscript. We have responded all the comments in the file that named by Response to Reviewers.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Luciane Cruz Lopes

18 May 2020

PONE-D-19-33669R1

Different Depths of Sedation Versus Risk of Delirium in Adult Mechanically Ventilated Patients: A Systematic Review and Meta-Analysis

PLOS ONE

Dear Dr Ma,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Jul 02 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Luciane Cruz Lopes, PhD

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

Reviewer #3: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I did not notice any problems in the article, therefore, I recommend that it be published as soon as possible, in view of its timeliness and relevance to the scientific community, especially in the field of medicine.

Reviewer #3: With great interest I read the adapted version of the manuscript. The authors addressed the comments of the previous reviewers adequately which led to significant improvement of the research and the manuscript. The authors did a rigorous meta-analysis and show great adherence to existing standards and protocols in place for such research. Doing so, the research is up to current standards and very suitable for publication in Plos One. And although the manuscript is almost in its final version I do have some concerns reading the research for the first time.

My main concern is the fact that the relationship between sedation (depth) and delirium is very complex and influenced by many factors. The effort of the authors to try to include observational studies in their meta analysis is a great effort but introduces the bias of observational research in their meta analysis. Observational research in ICU research is prone to bias and relies on advanced statistical methods including time-varying variables, competing events, confounding by indication, and addressing immortal time bias. T

For example, there is the challenge that light sedation levels interfere with delirium diagnosis and comparing them with deep sedation give therfore regression to the mean (for example patient scoring RASS-2 is CAM-ICU positive (item 1, 2 and 4 present)).

Or the problem that disease severity and dosage of sedatives are not pure confounding factors as both cause deep sedation (placing them in causal chain of high severity of illness-->deep sedation-->delirium). This causal chain is also seen in the risk of deep sedation and risk of mortaltiy; deep sedation being a proxy for severity of illness and thus not surprisingly being associated with higher mortality.

Or the challenge that only patients in light sedation have the oppurtunity to develop adverse events (immortal time biase..you have to be awake enough to remove the ET).

I feel that the authors do address a lot or these issues by reporting the results separetly for RCTs and observational research but I would appreciate it if the authors emphasize the risk of bias of observational research and thus of the reported overall ORs. For example, the overall ORs on the relationship of mortaltiy and adverse events seem to be driven by the observational research.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 16;15(7):e0236014. doi: 10.1371/journal.pone.0236014.r004

Author response to Decision Letter 1


27 May 2020

Thanks again for your comments. Indeed, the relationship between the depth of sedation and delirium is complex and influenced by many factors. The severity of the disease and the dosage of benzodiazepines are considered to be important factors. Therefore, we conducted a subgroup analysis of these factors and found that differences in the benzodiazepine dosage did not alter the conclusion that sedation depth does not influence the risk of delirium. But the patients with the same severity of the disease have the higher risk of delirium with the lighter sedation(OR = 0.68, 95% CI: 0.49-0.94, P = 0.021) and higher risk of mortality with the deeper sedation(OR = 1.20, 95% CI: 1.03-1.39, P = 0.020). So, the severity of illness seemed to confound this conclusion less likely.

Our systematic review included some observational research, which generated high heterogeneity. In order to reduce the weight of observational research in the overall results, we used a Bayesian method. It is found that the results of most subgroup analyses seemed similar to those of the general meta-analysis. In terms of the risk of mortality and incidence of adverse events, the ORs of the RCTs, observational research and overall research were all on the same side of the forest plots. Nevertheless, we agree with and appreciate the comments of reviewer #3. We have stressed these views in the discussion of the revised manuscript. "Due to the methodological limitations, we should carefully interpret the meta results of observational research. It is evident that the likelihood of diagnosing delirium and developing adverse events is higher in patients sedated with the lighter depth, while the effect of deep sedation on mortality needs to be adjusted with factors such as disease severity. " (shown on page 13, line 330 to 336, marked in red.)

Attachment

Submitted filename: Response to Reviewers(R2).docx

Decision Letter 2

Luciane Cruz Lopes

12 Jun 2020

PONE-D-19-33669R2

Different Depths of Sedation Versus Risk of Delirium in Adult Mechanically Ventilated Patients: A Systematic Review and Meta-Analysis

PLOS ONE

Dear Dr. Ma,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 27 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Luciane Cruz Lopes, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (if provided):

Dear Authors,

Please, could you address the follow topic below?

1) To explain their selection of the study designs for inclusion in the review in method section - Explanation for including both RCTs and NRSI

2) To provide a list of excluded studies and justify the exclusions

3) To report on the sources of funding for the studies included in the review

[Note: HTML markup is below. Please do not edit.]

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 16;15(7):e0236014. doi: 10.1371/journal.pone.0236014.r006

Author response to Decision Letter 2


23 Jun 2020

A1: There is a lack of research published RCTs primarily regarding the effect of sedation depth on delirium occurrence in critically ill patients with MV and more studies on the outcome of delirium are cohort study. Therefore, it is suggested that the inclusion of the cohort study may increase the information of systematic review on the exploration of delirium risk factors, but the lower quality of data is a fact. The RCTs and NRSI must meet the PICO principle. The exclusion criteria have been clarified in the methods section in this paper(marked in blue).

A2 and A3: Thank you for your comments. The list of excluded studies and the sources of funding for the studies included in the review has been uploaded as S3 File and S4 File respectively.

Attachment

Submitted filename: Response to Reveiwers(R3).docx

Decision Letter 3

Luciane Cruz Lopes

29 Jun 2020

Different Depths of Sedation Versus Risk of Delirium in Adult Mechanically Ventilated Patients: A Systematic Review and Meta-Analysis

PONE-D-19-33669R3

Dear Dr. Ma,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Luciane Cruz Lopes, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Dear author,

Could you please, check the quality of the figures and review all tables? It is necessary to improve the quality of the presentation and format. Please, review all references checking if the citation is missing. Thank you.

Reviewers' comments:

Acceptance letter

Luciane Cruz Lopes

1 Jul 2020

PONE-D-19-33669R3

Different Depths of Sedation Versus Risk of Delirium in Adult Mechanically Ventilated Patients: A Systematic Review and Meta-Analysis

Dear Dr. Ma:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Luciane Cruz Lopes

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Checklist. PRISMA checklist.

    (DOC)

    S1 Fig. Newcastle Ottawa scale quality assessment.

    ICU: Intensive Care Unit, APACHE II: Acute Physiology and Chronic Health Evaluation II, SAPS II: Simplified Acute Physiology Score II, BMI: Body Mass Index, ED: emergency department.

    (TIF)

    S2 Fig. Diagram of insertion success for sensitivity analysis.

    (TIF)

    S1 Table. Benzodiazepine used and patients’ severity of illness in the included studies.

    D/L: Deeper/Lighter gourp, BDZ: benzodiazepine (Different BDZ means there was a significant difference in BDZ dosage between two groups), 1: mg/h, 2: mg/d, 3: mg(cumulative dose) 4: mg/kg/h, 5: mg/kg(cumulative dose), 6: %(% of patient midazolam was given), -: means without BZD or data unavailable. a: APACHEⅡ(Acute Physiology and Chronic Health EvaluationⅡ), b: SAPSⅡ (Simplified Acute Physiology ScoreⅡ), C: SOFA (Sequential Organ Failure Assessment)

    (DOC)

    S2 Table. Cochrane bias assessment of randomized studies.

    (DOC)

    S1 File. Search strategy.

    (DOC)

    S2 File. The table of GRADE.

    (DOCX)

    S3 File. The list of excluded studies.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers(R2).docx

    Attachment

    Submitted filename: Response to Reveiwers(R3).docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES