Skip to main content
PLOS One logoLink to PLOS One
. 2023 Sep 19;18(9):e0286385. doi: 10.1371/journal.pone.0286385

Trends in perioperative practices of high-risk surgical patients over a 10-year interval

Brenno Cardoso Gomes 1,2,‡,*, Suzana Margareth Ajeje Lobo 3,#, Luiz Marcelo Sá Malbouisson 1,#, Renato Carneiro de Freitas Chaves 4,#, Thiago Domingos Corrêa 4,#, Cristina Prata Amendola 5,#, João Manoel Silva Júnior 1,4,; on behalf of The BraSIS research group
Editor: Samuele Ceruti6
PMCID: PMC10508595  PMID: 37725600

Abstract

Introduction

In Brazil, data show an important decrease in morbi-mortality of high-risk surgical patients over a 10-year high. The objective of this post-hoc study was to evaluate the mechanism explaining this trend in high-risk surgical patients admitted to Brazilian ICUs in two large Brazilian multicenter cohort studies performed 10 years apart.

Methods

The patients included in the 2 cohorts studies published in 2008 and 2018 were compared after a (1:1) propensity score matching. Patients included were adults who underwent surgeries and admitted to the ICU afterwards.

Results

After matching, 704 patients were analyzed. Compared to the 2018 cohort, 2008 cohort had more postoperative infections (OR 13.4; 95%CI 6.1–29.3) and cardiovascular complications (OR 1.5; 95%CI 1.0–2.2), as well as a lower survival ICU stay (HR = 2.39, 95% CI: 1.36–4.20) and hospital stay (HR = 1.64, 95% CI: 1.03–2.62). In addition, by verifying factors strongly associated with hospital mortality, it was found that the risk of death correlated with higher intraoperative fluid balance (OR = 1.03, 95% CI 1.01–1.06), higher creatinine (OR = 1.31, 95% CI 1.1–1.56), and intraoperative blood transfusion (OR = 2.32, 95% CI 1.35–4.0). By increasing the mean arterial pressure, according to the limits of sample values from 43 mmHg to 118 mmHg, the risk of death decreased (OR = 0.97, 95% CI 0.95–0.98). The 2008 cohort had higher fluid balance, postoperative creatinine, and volume of intraoperative blood transfused and lower mean blood pressure at ICU admission and temperature at the end of surgery.

Conclusion

In this sample of ICUs in Brazil, high-risk surgical patients still have a high rate of complications, but with improvement over a period of 10 years. There were changes in the management of these patients over time.

Background

High-risk surgical patients represent a small and specific group, ranging from to 10% to 12,5% of the overall surgical population, with a high morbimortality [1]. In a report from Pearse et al., the mortality rate in general surgical population was 1,9% in the United Kingdom, while in the high-risk patients was 83.8% [1]. In this high-risk population, postoperative complications lead to death in shorter time courses than in the general surgical patients [2].

Advances in perioperative care practices supported by evidence-based medicine during the last decade were associated with a reduction in postoperative morbimortality worldwide [3]. In Brazil, two studies evaluated the outcomes of high-risk surgical patients with an interval of 10 years [4,5]. It was observed a reduction in surgical mortality in high-risk patients from 20% to 9.6% and in complications from 38% to 29.9%. The first cohort evaluated outcomes of noncardiac surgical patients in 21 Brazilian ICUs (intensive care units), from 18 institutions (eight public hospitals and 10 private hospitals) was collected in 2006 [5]. The second cohort evaluated outcomes of high-risk surgical patients admitted to 29 ICUs during 2017 [4].

In order to understand the mechanisms and determinants associated to the improvement in the high-risk surgical patient’s outcomes during the last decade, we performed a post-hoc comparison of the databases of two large multicenter Brazilian studies. Therefore, the objective of this study was to compare the prognostic trends of high-risk surgical patients admitted to Brazilian ICUs, through the analysis of two large Brazilian multicenter studies separated by an interval of 10 years.

Methods

Study design and participating centers

This post-hoc analysis compared two prospective multicenter cohorts on the epidemiology and clinical outcomes of high-risk surgical patients in Brazil. The first cohort study was conducted from 2006 to 2008 [5], and the second study was conducted from 2017 to 2018 [4]. To facilitate the reading and understanding of the content, throughout most of this paper, we refer to the studies as the 2008 and 2018 cohorts, the years in which the works were finalized. Adult patients (aged ≥ 18 years) undergoing elective or emergency surgery were admitted to the ICU after surgery. This project was approved by the Research Ethics Committee of the School of Medicine—University of São Paulo (FMUSP) and registered in the National System of the Brazil Platform (CAAE)—CAAE: 30690820.1.0000.0068. The research ethics committee waived the application of the consent form, as this is a retrospective study with exclusive analysis of medical records with a database.

Because the criteria for ICU admission in the postoperative period were not standardized between the centers, all patients with indications for postoperative ICU admission were considered high risk surgical patients. Each patient was admitted to hospitals with expertise in the care of that patient profile.

The exclusion criteria of the two studies were very similar and were adjusted in the composite database to maintain sample homogeneity. Therefore, patients undergoing cardiac surgery, obstetric patients, pregnant women, and palliative patients with no prospect of curing their disease were excluded from the two studies.

Patients and variables

The following data were collected: demographic data (age, sex, ethnicity, and body mass index), beside preoperatively we composed classification of physical status (American Society of Anesthesiologists, ASA) and comorbidities (systemic arterial hypertension, heart disease, cancer, diabetes mellitus, smoking, chronic obstructive pulmonary disease, alcoholism, chronic renal failure, unspecified stroke). Furthermore, the worst values of mean arterial pressure (MAP), heart rate, axillary temperature, arterial lactate, hemoglobin, hematocrit, Sequential Organ Failure Assessment (SOFA) score at ICU admission and characteristics of surgeries (emergency or elective, topographic surgery, and time of surgery), occurrence of ICU complications, length of stay in the ICU, length of stay in the hospital, and mortality in the ICU, in the hospital, and within 30 days after discharge were analyzed in study.

All patients were followed up until hospital discharge and 30 days postoperatively, and the following complications were evaluated during their stay in the ICU. The presence of complications was described by the investigators of both studies and recorded in a database.

In addition, intraoperative fluid balance, the use of vasoactive drugs, and the presence of mechanical ventilation at ICU admission were analyzed. The fluid balance was calculated by quantifying the volume administered minus urine output and tube output.

Definition of postoperative complications

Cardiovascular: characterized by the need for vasopressors for more than 1 hour despite adequate volume resuscitation; acute myocardial infarction; arrhythmias; or cardiac arrest.

Respiratory: a relationship between partial pressure of oxygen and fraction of inspired oxygen (PaO2/FiO2) < 200 in patients without previous heart disease; the need for reintubation; or the presence of bronchospasm or pneumothorax.

Neurological: Richmond Agitation and Sedation Scale (RASS) score that acutely fluctuates and agitation as determined by RASS ≥ +2, documented convulsive seizures or stroke.

Coagulation: reduction of platelet counts greater than 30% of the baseline value during the preoperative period, platelet count below 100,000mm3, or acute bleeding above 100 mL/hour associated with a decrease of 3 hematocrit points.

Gastrointestinal: presence of acute abdominal distension, uncontrolled nausea, and vomiting, need for parenteral nutrition, more than three episodes of diarrhea within 24 hours, acute gastrointestinal bleeding, acute liver failure, acute pancreatitis or presence of moderate- to high-output fistulas.

Infection: as the definitions of infection were different in 2008 cohort compared to 2018, we pragmatically chose to unite the classificatory terms for each period and sum the events. Thus, if there was any classifying type of infection in addition to the use of antibiotics and any positive cultures, it was considered a confirmed event, regardless of the severity of the event.

Outcomes

The main objective of this study was to analyze the mortality trends in high-risk surgical patients admitted to Brazilian ICUs in the period from 2008 to 2018. The secondary measures were differences in complication rates, the lengths of stays in the ICU and hospital, the need for mechanical ventilation in the immediate postoperative period, the use of packed red blood cells, differences in the management of fluid replacement in these patients, use of vasoactive drugs in the immediate postoperative period and the hemodynamic parameters at ICU admission.

Data storage

The data were entered into an electronic database, Research Electronic Data Capture–REDCap [6,7], and then analyzed in the Statistical Package for the Social Sciences version 26.0 (SPSS Inc.®; Chicago, IL, USA) and version R v.3.4.1 (R Foundation for Statistical Computing, Vienna, Austria).

Statistical analysis

Categorical variables are presented as absolute and relative frequencies. Quantitative variables were presented as mean and standard deviation or as the median and interquartile range, as appropriate. We used the Kolmogorov–Smirnov test to evaluate the distribution pattern of continuous numerical variables.

Proportions were compared using the chi-squared test, or Fisher’s exact test if the assumptions for the use of chi-squared were violated. Quantitative variables were compared with the T-test or the Mann–Whitney test, as appropriate.

To compare data between the 2008 and 2018 cohorts, since the data of the groups were collected in two different periods in nonrandomized designs, differences in the baseline characteristics of the patients could lead to biased estimates of effects. Thus, to balance the baseline characteristics and reduce bias, we matched patients from the 2008 and 2018 cohorts using a propensity score, defined as the conditional probability of being treated. First, a logistic regression model was created using the group variable (2008 or 2018) as the dependent variable. Other potential confounding factors for morbidity and length of stay were considered in the analyses using propensity score matching (PSM) with a combination of variables: age, SAPS 3 (Simplified Acute Physiology Score 3), ASA, SOFA, time of surgery, type of surgery, comorbidities such as hypertension, diabetes mellitus, smoking, and previous anemia, which were included as predictors, and the tolerance width of the correspondence was established at 0.02 of the logit. These variables were selected in the pairing using a backdoor criterion, which detected the presence of confounding variables. The significant variables in the bivariate analyses and those considered clinically relevant were also subjected to the model. Next, a patient correspondence for each 2018 group was selected from the 2008 group based on the closest logit. This model was constructed based on a sample of patients matched by propensity score at a 1:1 ratio without replacement or repetition. The matching procedure was performed before analyzing the results of this study. The results of the model are expressed as odds ratios (ORs) and their 95% confidence intervals.

Survival analyses were performed using Cox proportional hazards models and Kaplan–Meier curves fitted to the Cox model. The survival time was computed in days. ICU and hospital survival estimates were calculated for the groups using the survival curves and were compared in the Cox risk model.

The association between explanatory variables and outcomes was evaluated with logistic regression models. The variables selected in the bivariate analyses (P < 0.05) and those considered clinically relevant were subjected to multiple logistic regression analysis. We evaluated the collinearity first by examining the dispersion matrix and the Pearson correlation coefficient for continuous variables or the cross-tabulation for categorical variables. We also ran a collinearity with analysis of the variance inflation factor. Variables with substantial collinearity were excluded. The results of the logistic regression analysis are expressed as ORs and 95% CIs. All the significance probabilities (P values) presented are two-tailed. P values < 0.05 were considered statistically significant.

The missing baseline data were treated with linear multiple imputation if it was less than 5%. The missing outcome variables were treated with pairwise deletion, a process in which information is eliminated when there is an absence of essential data for the test.

Results

For this post-hoc analysis, 1905 patients were initially screened from the two cohort databases to be included. The 2008 cohort included 885 surgical patients admitted to 21 Brazilian ICUs and the 2018 cohort included 1020 patients in 29 ICUs, from all regions of the country. Two hundred ninety-eight patients of the 2008 cohort and 116 of the 2018 cohort were excluded from the analysis. The final composed cohort included 1491 patients. After PSM, 704 patients were analyzed (352 patients in each period, 2008 and 2018) (Fig 1).

Fig 1. Descriptive flowchart.

Fig 1

Comparing the ICUs in each cohort, 55.5% were in private hospitals in 2008 while in 2018, 48.3% were in private institutions, making for 44.5% and 51.7% in public hospitals, respectively (P = 0.62). The differences in the regional distribution of the ICUs between the two periods were 4.0% in the North region (P = 0.36), 4.0% in the Northeast region (P = 0.68), 0.0% in the Midwest region (P = 1.00), 6.0% in the Southeast region (P = 0.67), and 2.0% in the South region (P = 0.85) (Fig 2).

Fig 2. Recruitment of patients from both cohorts per Brazilian region.

Fig 2

Political South America. Modified from CIA Factbook: https://www.cia.gov/the-world-factbook/static/57275a9c02995bfd31c79e1fa4887f27/south_america_pol.pdf.

In the combined sample, the age was 61.0 ± 17.4 years, and 51.4% were male. The 2018 cohort had higher SAPS 3 scores values and ASA physical status 3–4, while the 2008 study had higher SOFA scores values, ASA physical status score 2, chronic diseases, especially systemic arterial hypertension, cancer, chronic obstructive pulmonary disease and smoking. After PSM, 352 patients remained in each group, and all their baseline characteristics were well balanced (Table 1).

Table 1. Baseline characteristics of patients, with and without propensity score matching.

Full Cohort Matched Cohort
2018 (n = 904) 2008 (n = 587) P 2018 (n = 352) 2008 (n = 352) P
Male, n (%) 444 (53.8%) 322 (54.9%) 0.70 188 (57.3%) 181 (51.4%) 0.12
Age (year), mean± SD 60.1± 17.7 62.4± 16.8 0.90 61.5±17.3 61.7±17.2 0.90
SAPS 3 score, mean± SD 45.6±15.4 42.4±10.9 < 0.01 42.1±15.1 41.6 ± 10.9 0.63
SOFA score (ICU admission), median (IQR) 2.0 (1.0–5.0) 4.0 (2.0–7.0) < 0.01 3.0 (1.0–5.0) 4.0 (2.0–6.0) 0.09
ASA physical status score, n (%) < 0.01 0.09
2 405 (47.8%) 285 (48.4%) 192 (54.5%) 163 (46.3%)
3 296 (34.9%) 172 (29.3%) 103 (29.3%) 117 (33.2%)
4 61 (7.2%) 39 (6.6%) 12 (3.4%) 20 (5.7%)
Chronic diseases, n (%) 707 (80.3%) 479 (81.6%) 0.55 303 (86.1%) 289 (82.1%) 0.15
Hypertension 396 (44.2%) 340 (60.8%) < 0.01 198 (56.3%) 196 (55.7%) 0.88
Cancer 191 (21.3%) 175 (29.8%) < 0.01 117 (33.2%) 93 (26.4%) 0.05
Diabetes mellitus 188 (21.0%) 120 (22.3%) 0.55 78 (22.2%) 70 (20.0%%) 0.48
Smoking 134 (15.0%) 118 (22.0%) < 0.01 71 (20.2%) 66 (18.8%) 0.63
Coronary artery disease 67 (7.5%) 52 (9.8%) 0.12 40 (11.4%) 37 (10.5%) 0.72
Chronic obstructive pulmonary disease 54 (6.0%) 87 (16.3%) < 0.01 40 (11.4%) 48 (13.6%) 0.36
Non -dialysis chronic kidney disease 48 (5.4) 11 (2.1%) < 0.01 8 (2.3%) 8 (2.3%) 1.00
Alcoholism 46 (5.1%) 39 (7.4%) 0.08 16 (4.5%) 20 (5.7%) 0.50
Stroke 27 (3.0%) 37 (7.0%) < 0.01 17 (4.8%) 19 (5.4%) 0.73
Anemia 15 (1.7%) 67 (11.4%) < 0.01 12 (3.4%) 15 (4.3%) 0.55
Heart failure 15 (1.7%) 14 (2.7%) 0.19 5 (1.4%) 10 (2.9%) 0.19
Other comorbidities 251 (28.0%) 47 (8.0%) < 0.01 43 (12.2%) 40 (11.4%) 0.73
Number of comorbidities, median (IQR) 2.0 (1.0–3.0) 1.5 (1.0–3.0) 0.02 2.0 (1.0–3.0) 2.0 (1.0–3.0) 0.23

NOTES: SAPS 3 (Simplified Acute Physiology Score 3), SOFA (Sequential Organ Failure Assessment), ASA physical status classification: 2–4 (American Society of Anesthesiology), IQR (interquartile range).

The overall mean duration of surgery was 4.5 ± 2.5 hours. Head and neck surgeries, and orthopedic surgeries were more common in the 2018 cohort than in 2008. On the other hand, abdominal and vascular surgeries were more frequent in the 2008 cohort. After PSM, there were no difference in surgical procedures between cohorts.

In the full 2008 cohort, patients received more fluids and blood transfusions. Their serum creatinine and arterial lactate values were higher, while MAP values were lower as well as the use of vasopressors. Similar findings were observed after 1:1 PSM. Interestingly, the urine output at the end of surgery was higher in the 2008 study in all analyses, and the temperature was lower at the end of surgery (Table 2).

Table 2. Intraoperative data from the 2008 and 2018 studies in the full cohorts and after propensity score matching.

Full cohort Matched cohort
2018 (n = 904) 2008 (n = 587) P 2018 (n = 352) 2008 (n = 352) P
Type of surgery, n (%) 0.63 0.07
Elective 613 (69.2%) 413 (70.4%) 255 (72.4%) 276 (78.4%)
Urgency 273 (30.8%) 174 (29.6%) 97 (27.6%) 76 (21.6%)
Surgeries, n (%)
Neurosurgery 186 (20.8%) 6 (1.0%) < 0.01 0(0.0%) 0 (0.0%) ------
Head and neck 39 (4.4%) 12 (2.0%) 0.02 17 (4.8%) 8 (2.3%) 0.07
Thoracic 53 (5.9%) 30 (5.1%) 0.51 22 (6.3%) 26 (7.4%) 0.55
Abdominal 252 (28.1%) 264 (45.0%) < 0.01 138 (39.2%) 138 (39.2%) 1.00
Vascular 74 (8.3%) 101 (17.2%) < 0.01 41 (11.6%) 49 (13.9%) 0.37
Orthopedic 143 (16.0%) 42 (7.2%) < 0.01 31 (8.8%) 31(8.8%) 1.00
Urologic 48 (5.4%) 34 (5.8%) 0.72 28 (8.0%) 21 (6.0%) 0.30
Others 109 (11.1%) 98 (16.7%) < 0.01 31 (21.5%) 76 (22.9%) 0.65
Duration of surgery (min), median (IQR) 240.0
(180.0–360.0)
230.0
(161.2–300.0)
< 0.01 240.
(180.0–360.0)
240.0
(180.0–315.0)
0.33
Fluid administration
Volume of crystalloids (ml), median (IQR) 2400
(1500–3500)
3000
(2000–5125)
< 0.01 2500
(1500–3500)
3000
(2000–5000)
< 0.01
Colloid volume (ml), median (IQR) 500
(200–1000)
500
(500–1000)
< 0.01 500
(200–1000)
500
(500–1000)
0.13
Crystalloids: Colloid volume (ml), median (IQR) 9.5 (3.9–19.25) 7.0 (4.0–12.0) 0.24 9.0 (3.2–13.0) 7.0 (3.0–12.0) 0.06
Total volume (ml), median (IQR) 2500
(1500–3500)
3500
(2000–5500)
< 0.01 2500
(1500–3500)
3000
(2000–5500)
< 0.01
Units of packed red blood cells (IU), median (IQR) 2 (1.0–2.25) 2.0 (2.0–3.0) 0.02 2.0 (1.0–3.0) 2.0 (1.0–3.0) 0.19
Urine output (ml), median (IQR) 1000
(600–1500)
1635
(1100–2300)
< 0.01 900
(500–1400)
1600
(1100–2211)
< 0.01
Water balance (ml), median (IQR) 1900
(1100–3000)
1750
(400–3946)
0.13 1650
(1100–3200)
1975
(400–3901)
0.04
Serum creatinine at the end of surgery (mg/dl), median (IQR) 0.8 (0.6–1.1) 1.0 (0.8–1.4) < 0.01 0.8 (0.6–1.2) 0.9 (0.8–1.2) 0.04
Need for blood transfusion, n (%) 141 (16.1%) 174 (29.6%) < 0.01 80 (22.7%) 100 (28.4%) 0.04
Axillary temperature at the end of surgery (°C), mean±SD 35.8±0.9 35.5±0.8 < 0.01 35.7±0.9 35.5±0.9 0.04
Need for vasopressors, n (%) 157 (18.0%) 94 (16.1%) 0.35 82 (23.3%) 45 (12.8%) < 0.01
MAP (mmHg), mean±SD during the intraoperative period 90.5±18.3 72.6±15.5 < 0.01 89.6±19.4 72.3±15.1 < 0.01
Arterial lactate at the end of surgery (mmol/L), median (IQR) 1.8 (1.2–2.7) 2.2 (1.3–3.6) < 0.01 1.8 (1.2–2.8) 2.1 (1.0–3.4) 0.03

NOTES: Other surgeries (ophthalmology, plastics, gynecology and transplants), IQR (interquartile range), ml (milliliter), mmol (millimoles), L (liter), mg (milligram), dl (deciliter), n (number of events), °C degrees Celsius, mmHg (millimeters of mercury), SD (standard deviation).

When comparing the stays in the full cohorts, the 2008 cohort had higher rates of complications and length of stay ICU and hospital. (Table 3).

Table 3. Comparison of complications and length of stay in the postoperative period.

Full cohort Matched Cohort
2018
(n = 904)
2008
(n = 587)
P 2018
(n = 352)
2008
(n = 352)
P
Total complications, n (%) 265 (29.9%) 225 (38.3%) < 0.01 74 (21.0%) 146 (41.5%) < 0.01
Length of ICU stay (days), median (IQR) 2.0 (1.0–4.0) 2.0 (1.0–5.0) < 0.01 2.0 (1.0–4.0) 2.1 (1.1–4.0) < 0.01
Length of hospital stay (days), median (IQR) 9.5 (5.4–18.6) 10.0 (4.0–21.0) 0.86 9.6 (5.6–19.2) 10 (4.0–20.0) 0.60

NOTES: IQR (interquartile range), ICU (intensive care unit), n (number of events).

After the PSM, infectious was the most different outcome between the cohorts, even taking into account adjustments. Patients from the 2008 period had more postoperative complications when we analyzed the total effect of negative outcomes (OR 1.6, 95% CI 1.4–1.9) (Fig 3).

Fig 3. Effect of negative outcomes in the 2018 and 2008 cohorts, with adjustments of the confounding factors among the baseline characteristics.

Fig 3

There was no difference in the hospital length of stay between the 2018 and 2008 cohorts: 9.6 days (5.6–19.2) vs. 10 days (4–20); P = 0.60, was not significant. After PSM, the ICU length of stay was significantly shorter in the 2018 cohort, as was mortality in the ICU and hospital (Table 3). Thus, the risk ratio for mortality in 2008, with adjustments for previous disease (cancer) was as follows: in the ICU, hazard ratio (HR) = 2.39 (95% CI: 1.36–4.20), and in the hospital, HR = 1.64 (95% CI: 1.03–2.62) for the patients in the 2008 cohort (Fig 4).

Fig 4. ICU and hospital survival curves comparing the 2018 and 2008 cohorts after PSM.

Fig 4

Performing a logistic regression analysis with the full cohort adjusted by the propensity score of the significant variables between the two periods, we noted that the risk of death brought by every 100-ml increase in fluid balance was OR = 1.03 (95% CI 1.01–1.06), and for each 1-point increase in creatinine, the OR was 1.31 (95% CI 1.1–1.56). For patients who received blood transfusion during surgery, the OR was 2.23 (95% CI 1.35–4.0). On the other hand, for each 1-mmHg increase in MAP, according to the limits of sample values from 43 mmHg to 118 mmHg, the risk decreased (OR = 0.96, 95% CI 0.95–0.98). It was not observe an association between hospital mortality and other variables (Table 4).

Table 4. Factors correlated with hospital mortality from among the significant variables in the adjusted comparison of the cohorts (univariate and multivariate analysis).

Univariate Multivariate
OR 95% CI P OR 95% CI P
Chronic diseases:
Cancer 0.690 0.406–1.172 0.169
Temperature at the end of surgery (°C) 0.734 0.571–0.942 0.015 0.838 0.639–1.100 0.204
Intraoperative volume of crystalloids (ml) 1.0001 1.000–1.0001 0.055
Intraoperative fluid balance (per 100 ml) 1.011 1.003–1.019 0.007 1.03 1.01–1.06 0.003
MAP (mmHg) 0.966 0.953–0.981 < 0.001* 0.968 0.952–0.984 < 0.001
Need for vasopressors 5.853 3.600–9.515 < 0.001*
Need for packed red blood cells 3.955 2.483–6.298 < 0.001 2.232 1.350–4.000 0.002
Creatinine (per mg/dl) 1.504 1.282–1.764 < 0.001* 1.314 1.105–1.563 0.002
Urine output (per ml) 0.999 0.9994–1.000 0.053*

NOTES: ml (milliliter), mmol (millimoles), L (liter), mg (milligram), dl (deciliter), n (number of events), °C (degrees Celsius), mmHg (millimeters of mercury), OR (risk ratio), 95% CI (95% confidence interval), OR (risk ratio), P (p value).

*Collinearity between variables.

Discussion

In this post-hoc analysis of two Brazilian multicenter prospective cohort studies, a large group of surgical patients admitted to the ICU in the postoperative period was analyzed. The results indicate that an improvement in intensive care practices in surgical patients have occurred during a 10-year interval.

In the recent cohort of 2018, most favorable outcomes were due to a better fluid and transfusion management, suitable hemodynamic protocols including higher blood pressure levels, earlier use of vasoactive drugs and hence lower lactate levels. Contemporary literature promotes the use of rational and protocol hemodynamic monitoring in the perioperative period, with the aim of reducing the length of stay in the ICU and hospital, reducing the duration of mechanical ventilation and reducing complications [8]. The FEDORA study demonstrated that goal-directed hemodynamic management in surgical patients led to fewer infections, fewer non-cardiogenic pulmonary edema, and a lower incidence of acute kidney injury [8,9].

The patients in the 2008 cohort had more postoperative complications. When the cohorts were balanced, the 2008 cohort had higher infection and cardiovascular complications rates. Furthermore, ICU stay, ICU and hospital mortality were higher, and the overall negative outcome effect was OR = 1.6 (95% CI 1.4–1.9).

When data from both cohorts were analyzed together, some variables were strongly associated with hospital mortality, such as intraoperative blood transfusion, intraoperative MAP, serum creatinine at the end of surgery, and excessive intraoperative fluid balance. However, these factors were different between the balanced 2018 and 2008 cohorts, maybe justifying the outcomes difference.

Greater packed red blood cell transfusion in the intraoperative period was associated with higher mortality, as already seen priorly [1013]. This difference could be due to the lower transfusion trigger in 2018.

Besides, lower MAP in the immediate postoperative period was correlated with higher mortality. A randomized controlled study from 2017 identified that a more individualized management of MAP in the intraoperative period generated fewer organ dysfunctions in the postoperative period [14]. These findings strengthen the actions directed at early hemodynamic management and individualization of clinical measures [14,15]. In this present analysis, we noted that patients in the 2018 cohort received more vasoactive drugs in the perioperative period. This finding might be due to the understanding that the early use of these drugs can more quickly increase the MAP and improve the perfusion [1618]. Vasoactive drugs used to adjust MAP have not been associated with complications [19].

Excessive intraoperative fluid balance was correlated with a higher mortality. Similar findings were observed in several other studies that have also associated higher fluid balance with worse outcomes and have carefully considered fluid management in surgical patients [2022]. Something that caught our attention was that the same volume of synthetic colloid solutions was administered in both cohorts. This clearly demonstrates that the prescriptive practice of colloids in surgical patients has not changed over the years, despite evidence of their negative effects in sepsis patients [23,24].

Nonetheless, high-risk surgery patients are the victims of most perioperative morbidity and mortality [25] and among the reasons for their unfortunate outcomes is inadequate hemodynamic optimization [26], which involves adjustments in blood pressure, cardiac output, blood volume, and cardiac contractility [27]. These adjustments require specialized handling and an adequate level of monitoring, with well-defined protocols and well-defined goals [28]. Fluid administration is generally accepted as a standard for the resuscitation of critically ill patients. However, since excessive fluid administration is associated with higher mortality [29], an individualized assessment of fluid responsiveness is advocated as good practice [30].

Monitoring and maximizing the systolic volume per fluid load during high-risk surgery are associated with a better postoperative outcome [31,32]. This can alert clinicians to blood pressure variations, which aids in proper volume adjustment [33].

As for the metabolic variables, higher creatinine in the immediate postoperative period was associated with mortality. Acute kidney injury (AKI) is a condition that reflects the context of patient severity within the ICU and is associated with worse outcomes and mortality [34]. It is no different in surgical patients, as has been the subject of recent studies that examined the correlation of poor prognosis with higher levels of acute kidney injury [3537]. Although patients in the 2008 cohort had higher urine volume, the diagnosis of acute kidney injury is always determined by the value of creatinine and/or urine output [38].

In addition, hypothermia was statistically different between the cohorts in the univariate analysis, and may have contributed to the poor results of the 2008 patients, like discussed in literature [39].

One subject that we need to address that may have directly improved the outcomes of the 2018 cohort is advances in multidisciplinary care within Brazilian ICUs [40]. There have also been significant advances in our knowledge about perioperative care, with practices becoming increasingly personalized and supported by evidence-based medicine [3]. Protocols and checklists used in surgical patients have greatly improved in recent years while the overall quality of the centers that serve this patient population has also improved [41].

Study limitations and strengths

This study has some shortcomings that should be contextualized. There is no specific protocol that encompasses surgeries performed by the centers involved in the study. There were also no homogenized hemodynamic and transfusion optimization protocols established among all centers. Furthermore, for the fluid balance calculation, it was not considered insensitive losses due to the difficulty in estimating them and the definition of infection was based on the record of the diagnosis of infection in addition to the use of antibiotics and positive cultures, a fact that despite not being a unanimous definition, it was able to homogenize the two study cohorts. In addition, we failed to capture some relevant data that could be included in the analyses, such as postoperative data on ICU care, but this was not the main objective of this study because surgical patients had short ICU stays.

Within the methodological content of our study, we know that the statistical method of PSM has deficiencies, as it can cause patient losses, and inaccurate results, but every care was taken to avoid these possible failures [42]. A rigorous model of PSM were considered in our study to reduce the heterogeneity between the groups and thus generate accurate and trustworthy results. However, the fact that we had minimal differences in the variables between the groups and the support of the main outcomes of the full cohorts after pairing showed that the cohorts were well balanced and therefore our statistical methods are likely to provide reliable results.

Our study had some strengths that we should consider, such as the selection of a large random sample of Brazilian ICUs from all regions of the country. This fact made our sample representative. However, our study model is not robust enough as to be conclusive on the data at the national level, but this model can be used as a comparison for potent future national epidemiological studies with similar objectives in Brazil or other countries, with even larger databases. Finally, this study updates the improvements of care over the years in high-risk surgical patients in Brazil.

Conclusion

From 2008 to 2018, the mortality of high-risk surgical patients in Brazilian ICUs decreased. A lower MAP and higher creatinine in the immediate postoperative period, greater fluid balance and greater need for red blood cell transfusions in the intraoperative period were the significant differences found in the mortality trends between decades. Cardiovascular complications and infections showed a decrease in their incidence.

The most recent findings indicate that care has changed over time, a fact that may have directly impacted the outcomes of surgical patients.

Supporting information

S1 Data

(XLS)

Acknowledgments

The following have made substantial contributions to the study. We would like to thank the important work and support of the BraSIS research group (brasis@googlegroups.com), which carried out data collection and care for patients and their data for research: Murillo Santucci Cesar Assunção (Hospital Israelita Albert Einstein, SP, Brazil); Ary Serpa Neto (Hospital Israelita Albert Einstein, SP, Brazil); Neymar Elias de Oliveira (Hospital de Base—São José do Rio Preto, SP, Brazil); Viviane Cordeiro Veiga (Beneficiência Portuguesa, SP, Brazil); Salomón Soriano Ordinola Rojas (Beneficiência Portuguesa, SP, Brazil); Fabio Eduardo Bosso (Universidade Cidade de São Paulo, SP, Brazil); José Mário Teles (Hospital de Urgências de Goiânia, GO, Brazil); Alexandre Amaral (Hospital de Urgências de Goiânia, GO, Brazil); Bruno Melo Nobrega de Lucena (Hospital das Clinicas de São Paulo, SP, Brazil); Raphael Augusto Gomes de Oliveira (Hospital das Clinicas de São Paulo, SP, Brazil); Luciana Coelho Sanches (Hospital do Câncer de Barretos, SP, Brazil); Antônio Paulo Nassar Junior (Hospital AC Camargo, SP, Brazil); Álvaro Réa-Neto (CEPETI, PR, Brazil); Flávio Geraldo Rezende de Freitas (Hospital SEPACO, SP, Brazil); Antônio Tonete Bafi (Hospital SEPACO, SP, Brazil); Eduardo Souza Pacheco (Hospital SEPACO, SP, Brazil); Fernando José Ramos (Hospital Sírio Libanês, SP, Brazil); Maria Augusta Santos Rahe Pereira (Hospital Santa Casa de Campo Grande, MS, Brazil); Danielle Dourado Magalhães (Hospital Beneficiente São Vicente de Paulo, RS, Brazil); Diogo Oliveira Toledo (Hospital e Maternidade São Luiz do Itaim, SP, Brazil); Fernando Suparregui Dias (Hospital Pompeia, RS, Brazil); Natalia Fioravante Postalli (Hospital Beneficência Portuguesa, SP, Brazil); Ricardo Azevedo Cruz D’Oliveira (Hospital Português da Bahia, BA, Brazil); André Ricardo de Oliveira Estrela (Hospital Português da Bahia, BA, Brazil); Fábio Sartori Schwerz (Associação Beneficente de Campo Grande, MS, Brazil); Giovanna Padoa de Menezes (Associação Beneficente de Campo Grande, MS, Brazil); Ulysses Vasconcellos de Andrade e Silva (Hospital de Câncer de Barretos, SP, Brazil); Thais Kawagoe Alvarisa (Hospital Beneficência Portuguesa, SP, Brazil); André Meregalli (Irmandade da Santa Casa de Misericórdia de Porto Alegre, RS, Brazil); Jorge Amilton Höher (Irmandade da Santa Casa de Misericórdia de Porto Alegre, RS, Brazil); Marciano de Sousa Nobrega (Hospital das Clínicas, Universidade Federal de Goiás, GO, Brazil); Claudio Piras (Vitoria Apart Hospital, ES, Brazil); Stéphanie de Barros Piras (Vitoria Apart Hospital, ES, Brazil); Rodrigo Conti (Vitoria Apart Hospital, ES, Brazil); Paulo Lisboa Bittencourt (Hospital Português da Bahia, BA, Brazil); José Mauro Vieira Júnior (Hospital Sirio Libanês, SP, Brazil); Mirella Cristine de Oliveira (CEPETI, PR, Brazil); Luana Tannous (CEPETI, PR, Brazil); Rafael Alexandre de Oliveira Deucher (CEPETI, PR, Brazil); Henrique Tadashi Katayama (Hospital do Servidor Público Estadual, SP, Brazil); Marcos Henrique Borges Ferreira (Hospital Nossa Senhora de Fátima, MG, Brazil); Wagner Luis Nedel (Hospital Nossa Senhora da Conceição, RS, Brazil); Matheus Golenia dos Passos (Hospital Nossa Senhora da Conceição, RS, Brazil); Luiz Gustavo Marin Hospital (Nossa Senhora da Conceição, RS, Brazil); Cristine Pilati Pileggi Castro (Hospital São Vicente de Paulo, RS, Brazil); Sabrina Frighetto Henrich (Hospital São Vicente de Paulo, RS, Brazil); Bruna Fernanda Camargo Silva Parra (Hospital e Maternidade São Luiz Itaim, SP, Brazil); Luiza Zerman (Hospital Pompeia, RS, Brazil); Fernanda Formolo (Hospital Pompeia—Caxias do Sul, RS, Brazil); Denner Luiz Vilela (Hospital Nossa Senhora de Fátima, MG, Brazil); Guilherme Cincinato de Almeida (Hospital Nossa Senhora de Fátima, MG, Brazil); Wilson de Oliveira Filho (Hospital e Pronto Socorro 28 de Agosto, AM, Brazil); Raoni Machado Coutinho (Hospital e Pronto Socorro 28 de Agosto, AM, Brazil); Michele Cristina Lima de Oliveira (Hospital e Pronto Socorro 28 de Agosto, AM, Brazil); Gilberto Friedman (Irmandade da Santa Casa de Misericórdia de Porto Alegre, RS, Brazil); and Afonso José Celente Soares (Hospital de Força Aérea do Galeão, RJ, Brazil).

The present study was endorsed by the Brazilian Research in Intensive Care Network (AMIBnet).

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Pearse RM, Harrison DA, James P, Watson D, Hinds C, Rhodes A, et al. Identification and characterisation of the high-risk surgical population in the United Kingdom. Critical care (London, England). 2006;10(3):R81. doi: 10.1186/cc4928 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Boehm O, Baumgarten G, Hoeft A. Epidemiology of the high-risk population: perioperative risk and mortality after surgery. Curr Opin Crit Care. 2015;21(4):322–7. doi: 10.1097/MCC.0000000000000221 [DOI] [PubMed] [Google Scholar]
  • 3.Martín Delgado MC, Gordo Vidal F. Perioperative intensive care medicine. Medicina intensiva. 2019;43(7):427–34. [DOI] [PubMed] [Google Scholar]
  • 4.Silva Júnior JM, Chaves RCDF, Corrêa TD, Assunção MSCD, Katayama HT, Bosso FE, et al. Epidemiologia e desfecho dos pacientes de alto risco cirúrgico admitidos em unidades de terapia intensiva no Brasil. Revista Brasileira de Terapia Intensiva. 2020;32:17–27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Lobo SM, Rezende E, Knibel MF, Silva NB, Paramo JA, Nacul F, et al. Epidemiology and outcomes of non-cardiac surgical patients in Brazilian intensive care units. Rev Bras Ter Intensiva. 2008;20(4):376–84. [PubMed] [Google Scholar]
  • 6.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of biomedical informatics. 2009;42(2):377–81. doi: 10.1016/j.jbi.2008.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Harvey LA. REDCap: web-based software for all types of data storage and collection. Spinal cord. 2018;56(7):625. doi: 10.1038/s41393-018-0169-9 [DOI] [PubMed] [Google Scholar]
  • 8.Pinsky MR, Cecconi M, Chew MS, De Backer D, Douglas I, Edwards M, et al. Effective hemodynamic monitoring. Critical care (London, England). 2022;26(1):294. doi: 10.1186/s13054-022-04173-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Calvo-Vecino JM, Ripollés-Melchor J, Mythen MG, Casans-Francés R, Balik A, Artacho JP, et al. Effect of goal-directed haemodynamic therapy on postoperative complications in low-moderate risk surgical patients: a multicentre randomised controlled trial (FEDORA trial). British journal of anaesthesia. 2018;120(4):734–44. doi: 10.1016/j.bja.2017.12.018 [DOI] [PubMed] [Google Scholar]
  • 10.Chen A, Trivedi AN, Jiang L, Vezeridis M, Henderson WG, Wu WC. Hospital Blood Transfusion Patterns During Major Noncardiac Surgery and Surgical Mortality. Medicine. 2015;94(32):e1342. doi: 10.1097/MD.0000000000001342 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Hébert PC, Wells G, Blajchman MA, Marshall J, Martin C, Pagliarello G, et al. A multicenter, randomized, controlled clinical trial of transfusion requirements in critical care. Transfusion Requirements in Critical Care Investigators, Canadian Critical Care Trials Group. The New England journal of medicine. 1999;340(6):409–17. doi: 10.1056/NEJM199902113400601 [DOI] [PubMed] [Google Scholar]
  • 12.Sakr Y, Lobo S, Knuepfer S, Esser E, Bauer M, Settmacher U, et al. Anemia and blood transfusion in a surgical intensive care unit. Critical care (London, England). 2010;14(3):R92–R. doi: 10.1186/cc9026 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Wu WC, Trivedi A, Friedmann PD, Henderson WG, Smith TS, Poses RM, et al. Association between hospital intraoperative blood transfusion practices for surgical blood loss and hospital surgical mortality rates. Annals of surgery. 2012;255(4):708–14. doi: 10.1097/SLA.0b013e31824a55b9 [DOI] [PubMed] [Google Scholar]
  • 14.Futier E, Lefrant JY, Guinot PG, Godet T, Lorne E, Cuvillon P, et al. Effect of Individualized vs Standard Blood Pressure Management Strategies on Postoperative Organ Dysfunction Among High-Risk Patients Undergoing Major Surgery: A Randomized Clinical Trial. Jama. 2017;318(14):1346–57. doi: 10.1001/jama.2017.14172 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Godet T, Grobost R, Futier E. Personalization of arterial pressure in the perioperative period. Current Opinion in Critical Care. 2018;24(6):554–9. doi: 10.1097/MCC.0000000000000548 [DOI] [PubMed] [Google Scholar]
  • 16.Scheeren TWL, Bakker J, De Backer D, Annane D, Asfar P, Boerma EC, et al. Current use of vasopressors in septic shock. Annals of intensive care. 2019;9(1):20. doi: 10.1186/s13613-019-0498-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Husain FA, Martin MJ, Mullenix PS, Steele SR, Elliott DC. Serum lactate and base deficit as predictors of mortality and morbidity. American journal of surgery. 2003;185(5):485–91. doi: 10.1016/s0002-9610(03)00044-8 [DOI] [PubMed] [Google Scholar]
  • 18.Vincent JL, Quintairos ESA, Couto L Jr., Taccone FS. The value of blood lactate kinetics in critically ill patients: a systematic review. Critical care (London, England). 2016;20(1):257. doi: 10.1186/s13054-016-1403-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Belletti A, Castro ML, Silvetti S, Greco T, Biondi-Zoccai G, Pasin L, et al. The Effect of inotropes and vasopressors on mortality: a meta-analysis of randomized clinical trials. British journal of anaesthesia. 2015;115(5):656–75. doi: 10.1093/bja/aev284 [DOI] [PubMed] [Google Scholar]
  • 20.Myles PS, Andrews S, Nicholson J, Lobo DN, Mythen M. Contemporary Approaches to Perioperative IV Fluid Therapy. World journal of surgery. 2017;41(10):2457–63. doi: 10.1007/s00268-017-4055-y [DOI] [PubMed] [Google Scholar]
  • 21.Makaryus R, Miller TE, Gan TJ. Current concepts of fluid management in enhanced recovery pathways. British journal of anaesthesia. 2018;120(2):376–83. doi: 10.1016/j.bja.2017.10.011 [DOI] [PubMed] [Google Scholar]
  • 22.von der Forst M, Weiterer S, Dietrich M, Loos M, Lichtenstern C, Weigand MA, et al. [Perioperative fluid management in major abdominal surgery]. Der Anaesthesist. 2021;70(2):127–43. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Bayer O, Reinhart K, Kohl M, Kabisch B, Marshall J, Sakr Y, et al. Effects of fluid resuscitation with synthetic colloids or crystalloids alone on shock reversal, fluid balance, and patient outcomes in patients with severe sepsis: a prospective sequential analysis. Crit Care Med. 2012;40(9):2543–51. doi: 10.1097/CCM.0b013e318258fee7 [DOI] [PubMed] [Google Scholar]
  • 24.Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Crit Care Med. 2013;41(2):580–637. doi: 10.1097/CCM.0b013e31827e83af [DOI] [PubMed] [Google Scholar]
  • 25.Rhodes A, Moreno RP, Metnitz B, Hochrieser H, Bauer P, Metnitz P. Epidemiology and outcome following post-surgical admission to critical care. Intensive care medicine. 2011;37(9):1466–72. doi: 10.1007/s00134-011-2299-9 [DOI] [PubMed] [Google Scholar]
  • 26.Soni N. British Consensus Guidelines on Intravenous Fluid Therapy for Adult Surgical Patients (GIFTASUP): Cassandra’s view. Anaesthesia. 2009;64(3):235–8. doi: 10.1111/j.1365-2044.2009.05886_1.x [DOI] [PubMed] [Google Scholar]
  • 27.Mythen MG, Swart M, Acheson N, Crawford R, Jones K, Kuper M, et al. Perioperative fluid management: Consensus statement from the enhanced recovery partnership. Perioperative Medicine. 2012;1(1):2. doi: 10.1186/2047-0525-1-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Gattinoni L, Carlesso E. Supporting hemodynamics: what should we target? What treatments should we use? Critical care (London, England). 2013;17 Suppl 1(Suppl 1):S4–S. doi: 10.1186/cc11502 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Silva JM Jr., de Oliveira AM, Nogueira FA, Vianna PM, Pereira Filho MC, Dias LF, et al. The effect of excess fluid balance on the mortality rate of surgical patients: a multicenter prospective study. Critical care (London, England). 2013;17(6):R288. doi: 10.1186/cc13151 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Malbrain M, Van Regenmortel N, Saugel B, De Tavernier B, Van Gaal PJ, Joannes-Boyau O, et al. Principles of fluid management and stewardship in septic shock: it is time to consider the four D’s and the four phases of fluid therapy. Annals of intensive care. 2018;8(1):66. doi: 10.1186/s13613-018-0402-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Lobo SMA, Salgado PF, Castillo VGT, Borim AA, Polachini CA, Palchetti JC, et al. Effects of maximizing oxygen delivery on morbidity and mortality in high-risk surgical patients. Critical Care Medicine. 2000;28(10):3396–404. doi: 10.1097/00003246-200010000-00003 [DOI] [PubMed] [Google Scholar]
  • 32.Piper GL, Kaplan LJ. Fluid and electrolyte management for the surgical patient. The Surgical clinics of North America. 2012;92(2):189–205, vii. doi: 10.1016/j.suc.2012.01.004 [DOI] [PubMed] [Google Scholar]
  • 33.Cecconi M, Corredor C, Arulkumaran N, Abuella G, Ball J, Grounds RM, et al. Clinical review: Goal-directed therapy-what is the evidence in surgical patients? The effect on different risk groups. Critical care (London, England). 2013;17(2):209. doi: 10.1186/cc11823 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Katayama HT, Gomes BC, Lobo SMA, Chaves RCF, Correa TD, Assuncao MSC, et al. The effects of acute kidney injury in a multicenter cohort of high-risk surgical patients. Ren Fail. 2021;43(1):1338–48. doi: 10.1080/0886022X.2021.1977318 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Trongtrakul K, Patumanond J, Kongsayreepong S, Morakul S, Pipanmekaporn T, Akaraborworn O, et al. Acute kidney injury risk prediction score for critically-ill surgical patients. BMC anesthesiology. 2020;20(1):140. doi: 10.1186/s12871-020-01046-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Trongtrakul K, Sawawiboon C, Wang AY, Chitsomkasem A, Limphunudom P, Kurathong S, et al. Acute kidney injury in critically ill surgical patients: Epidemiology, risk factors and outcomes. Nephrology (Carlton, Vic). 2019;24(1):39–46. doi: 10.1111/nep.13192 [DOI] [PubMed] [Google Scholar]
  • 37.Pakula AM, Skinner RA. Acute Kidney Injury in the Critically Ill Patient: A Current Review of the Literature. Journal of intensive care medicine. 2016;31(5):319–24. doi: 10.1177/0885066615575699 [DOI] [PubMed] [Google Scholar]
  • 38.Norbert Lameire JVaAL. Did KDIGO guidelines on acute kidneyinjury improve patient outcome? Intensive care medicine. 2017. [DOI] [PubMed] [Google Scholar]
  • 39.Matika R, Ibrahim M, Patwardhan A. The importance of body temperature: An anesthesiologist’s perspective. Temperature (Austin). 2016;4(1):9–12. doi: 10.1080/23328940.2016.1243509 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Soares M, Bozza FA, Angus DC, Japiassú AM, Viana WN, Costa R, et al. Organizational characteristics, outcomes, and resource use in 78 Brazilian intensive care units: the ORCHESTRA study. Intensive care medicine. 2015;41(12):2149–60. doi: 10.1007/s00134-015-4076-7 [DOI] [PubMed] [Google Scholar]
  • 41.Abbott TEF, Ahmad T, Phull MK, Fowler AJ, Hewson R, Biccard BM, et al. The surgical safety checklist and patient outcomes after surgery: a prospective observational cohort study, systematic review and meta-analysis. British journal of anaesthesia. 2018;120(1):146–55. doi: 10.1016/j.bja.2017.08.002 [DOI] [PubMed] [Google Scholar]
  • 42.King G, Nielsen R. Why Propensity Scores Should Not Be Used for Matching. Political Analysis. 2019;27(4):435–54. [Google Scholar]

Decision Letter 0

Martina Crivellari

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

1 Mar 2023

PONE-D-23-01398Trends in perioperative practices of high-risk surgical patients over a 10-year interval.PLOS ONE

Dear Dr. Gomes,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

ACADEMIC EDITOR:  

  • Thank you for the article. Let me give you a comment. The fact that in 10 years medicine and surgery have improved in terms of prevention, surgical treatments, and therapies is undeniable. This is neither new nor exciting news. Certainly the research is well conducted, the statistical analysis correct, and the result good. Nevertheless it is necessary to correct some parts as requested by the reviewers, expecially reviewer 2

  • No conflicts between the reviews

  • I recommend also a bibliography check. 

Please submit your revised manuscript by Apr 15 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Martina Crivellari

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

3. One of the noted authors is a group or consortium BraSIS research group. In addition to naming the author group, please list the individual authors and affiliations within this group in the acknowledgments section of your manuscript. Please also indicate clearly a lead author for this group along with a contact email address.

4. We note that Figure 2 in your submission contain map image which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

a. You may seek permission from the original copyright holder of Figure 2 to publish the content specifically under the CC BY 4.0 license.  

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an ""Other"" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

b. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Paper well written, with consistent results and conclusions.

Just 2-3 minor revisions:

1. in the fluid balance was drain losses and perspiratio calculated?Please specify and discuss, in case, as limit

2. Just revise some adverbes (such as in the perioperatively, prefer in the perioperative period)

3. Maybe It would help to add a sentence in the discussion section about the net effect of the interest in the hemodynamics in the preoperative period in these 10 years. The concept of monitoring hemodynamic de-arrangements and target the intervention to hemodynamic goals, to personalise fluid and vasopressor therapy with appropriate monitoring, basing on surgical and patient risk, in order to avoid both hypo and hyper fluid resuscitation, and to preserve organ perfusion is strongly emerged in this decade. I think that this is one of the most important component that explain your results, both in terms of MAP and fluid overload. Moreover, also greater urine output in the 2008 period could be justified by the greater amount of fluids given (see quantile ranges), but this this greater amount of fluids has no impact on renal function , as creatinine values between the 2 groups show. This observation further confirms that fluids and MAP should not be considered as separate entities in the preoperative period, but that the best way to protect organ function is a protocolized hemodynamic strategy that considers fluids, MAP and CO as linked variables that all contribute to influence organ perfusion.

Reviewer #2: Dear authors, congratulation for your work.

I didn't find any ethics concerns about your analysis of surgical ICU admitted patients in two different periods.

I have some concerns and suggestions:

In abstract (line 38…) it is not clear if correlation between MAP and survival rate is linear or if an upper limit exists.

Line 40 is unclear, please consider modifying it.

Line 130: can you please explain which definition of infection did you use? I think it is important for us to know it since it is a major difference point between the cohorts (lines 295-299).

Line 263, it is unclear. You found 9.6 days of in-hospital length of stay in 2008 cohort and 10 days in 2018 cohort. Why did you say, in line 262, that in-hospital length of stay was difference? Please consider modifying it.

Regarding factor linked to in hospital mortality, it is not clear how you managed red blood cells transfusions. As you know, both excessive and insufficient transfusions are known death risk factors. Which were the threshold limits to start a red blood cells transfusion? Which was the target to stop transfusions? If you have this information, please add it to manuscript or specify you don’t have it. In line 293 you say that there was a better transfusion management in 2018 cohort, can you explain it, please?

Since you describe the impact of vasoactive drug on survival rates may you add some information about the vasoactive drugs management (thresholds, MAP targets, drugs used…)?

Line 327 It would be wonderful if you add information about crystalloids : colloids volumes ratio.

All the best.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Mariateresa giglio

Reviewer #2: Yes: Gaetano Lombardi

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Sep 19;18(9):e0286385. doi: 10.1371/journal.pone.0286385.r002

Author response to Decision Letter 0


23 Mar 2023

Data, 03/09/2023

Dear editor,

Martina Crivellari.

Academic Editor.

PLOS ONE.

We would like to thank you for the recommendations given for the article. All were of great value to improve our study. We also appreciate the opportunity and the possibility of having our article published in this journal. Below is the summary of the questions and opinions asked by the reviewers and our answers.

Response to Reviewers.

Review Comments to the Author.

Reviewer #1: Paper well written, with consistent results and conclusions.

Just 2-3 minor revisions:

I greatly appreciate the considerations and we add all the suggestions.

1. in the fluid balance was drain losses and perspiration calculated? Please specify and discuss, in case, as limit.

R: Thank you very much for the question. The insensitive losses were not calculated, as the calculation is not homogeneously unanimous as to how it could be exactly estimated. However, we will consider the limitations of the study. On the other hand, the loss of drains was considered.

2. Just revise some adverbes (such as in the perioperatively, prefer in the perioperative period).

R: Yes, thank you. We made the adjustment.

3. Maybe It would help to add a sentence in the discussion section about the net effect of the interest in the hemodynamics in the preoperative period in these 10 years. The concept of monitoring hemodynamic de-arrangements and target the intervention to hemodynamic goals, to personalize fluid and vasopressor therapy with appropriate monitoring, basing on surgical and patient risk, in order to avoid both hypo and hyper fluid resuscitation, and to preserve organ perfusion is strongly emerged in this decade. I think that this is one of the most important component that explain your results, both in terms of MAP and fluid overload. Moreover, also greater urine output in the 2008 period could be justified by the greater amount of fluids given (see quantile ranges), but this this greater amount of fluids has no impact on renal function, as creatinine values between the 2 groups show. This observation further confirms that fluids and MAP should not be considered as separate entities in the preoperative period, but that the best way to protect organ function is a protocolized hemodynamic strategy that considers fluids, MAP and CO as linked variables that all contribute to influence organ perfusion.

R: Excellent aspect put by the reviewer. Yes, we totally agree that the care of these serious patients must be protocoled and supported by refined and individualized hemodynamic goals. We also agree that uncontrolled fluid balance in critically ill patients causes an increase in complications and a worse prognosis, a condition that also occurs in high-risk surgical patients. In the renal aspect, there are several studies that associate a positive fluid balance with no improvement in renal function and even with deterioration of renal function, leading to increased venous pressures and renal congestion. Really better hemodynamic management of this group of patients has been gaining strength in recent years with rich literature (Katayama HT, Gomes BC, Lobo SMA, Chaves RCF, Corrêa TD, Assunção MSC, Serpa Neto A, Malbouisson LMS, Silva-Jr JM; BraSIS study group Investigators. The effects of acute kidney injury in a multicenter cohort of high-risk surgical patients. Ren Fail. 2021 Dec;43(1):1338-1348. doi: 10.1080/0886022X.2021.1977318. PMID: 34579622; PMCID: PMC8477947).

We have added a thread on the subject to the discussion. Thank you very much!

Reviewer #2: Dear authors, congratulation for your work.

I didn't find any ethics concerns about your analysis of surgical ICU admitted patients in two different periods. I have some concerns and suggestions:

Thank you very much for the questions that certainly added a lot to this study.

1. In abstract (line 38…) it is not clear if correlation between MAP and survival rate is linear or if an upper limit exists.

R: By increasing the mean arterial pressure, according to the limits of sample values from 43 mmHg to 118 mmHg, the risk of death decreased.

In this probability graph, it can be seen that as the MAP values increase, the probability of death decreases, however the probability was checked within the inferiority and superiority limits 43 to 118 mmHg. That was added in the abstract.

2. Line 40 is unclear, please consider modifying it.

R: Sorry for our mistake. We fixed the text. Thank you very much.

3. Line 130: can you please explain which definition of infection did you use? I think it is important for us to know it since it is a major difference point between the cohorts (lines 295-299).

R: Important aspect you mentioned. Thanks. As we analyzed formatted databases, historically (from 2008 and 2018), we chose to consider infection in the groups, when the presence of “infection” was documented in the spreadsheets used in the research, together with the use of antibiotics and the presence of any positive cultures. Regardless of whether it is infection, sepsis or septic shock. In this way, we believe to homogenize the diagnosis.

We have briefly commented on this on lines 134-136. But added this as a potential limitation.

4. Line 263, it is unclear. You found 9.6 days of in-hospital length of stay in 2008 cohort and 10 days in 2018 cohort. Why did you say, in line 262, that in-hospital length of stay was difference? Please consider modifying it.

R: We've fixed the phrase in the revised text for better understanding. Thanks.

5. Regarding factor linked to in hospital mortality, it is not clear how you managed red blood cells transfusions. As you know, both excessive and insufficient transfusions are known death risk factors. Which were the threshold limits to start a red blood cells transfusion? Which was the target to stop transfusions? If you have this information, please add it to manuscript or specify you don’t have it. In line 293 you say that there was a better transfusion management in 2018 cohort, can you explain it, please?

R: Thanks for the questions. There were no homogenized protocols for hemodynamic handling, general care and transfusion for patients. Thus, in none of the cohorts, we did not have transfusion targets and cutoff points for red blood cell prescription. On lines 361-363 we comment on this. But to make it clearer, we added in the article, specifically the information about the lack of unique transfusion protocols between the participating centers. In limitation of the study.

Being an observational study that analyzed, among other conditions, care practices in two large multicenter studies, we identified in the multivariate analysis that there was a correlation between transfusion and death. As the groups were paired and balanced, we believe that the fact that we had less transfusion in 2018 and less mortality, the action of prescribing fewer red blood cells was a protective practice. Therefore, we chose to write the comment on line 293.

The idea of our work was to have a general mapping in the two cohorts of the factors that were associated with a worse prognosis and that could have improved over time.

6. Since you describe the impact of vasoactive drug on survival rates may you add some information about the vasoactive drugs management (thresholds, MAP targets, drugs used…)?

R: Thanks for the note. As there was no single, predetermined protocol for hemodynamic monitoring in the centers involved, each location carried out its own intervention plan. Thus, we do not have concrete data on the most used drugs and their doses. Just like the previous question we added limitations.

Line 327 It would be wonderful if you add information about crystalloids: colloids volumes ratio.

R: Crystalloids: Colloid volume (ml), median (IQR)

Full cohort

2018: 9.5 (3.9- 19.25) 2008: 7.0 (4.0- 12.0) P=0.24

Matched Cohort

2018:9.0 (4.0-12.0) 2008:7.0 (3.0- 12.0) P=0.51

It was included in table 2.

Brenno Cardoso Gomes.

Professor at the Department of Integrated Medicine at UFPR, Curitiba-PR, Brazil.

Decision Letter 1

Samuele Ceruti

16 May 2023

Trends in perioperative practices of high-risk surgical patients over a 10-year interval.

PONE-D-23-01398R1

Dear Dr. Gomes,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Samuele Ceruti

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The paper is improved, the authors have answered to all questions. The method are correctly presented.

Reviewer #2: Dear authors congratulations for your work, I think it is a very interesting point of view on evolving care in critical care setting. Your answers solved all my concerns.

Thank you very much.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Gaetano Lombardi

**********

Acceptance letter

Samuele Ceruti

18 May 2023

PONE-D-23-01398R1

Trends in perioperative practices of high-risk surgical patients over a 10-year interval

Dear Dr. Gomes:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Samuele Ceruti

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Data

    (XLS)

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES