Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 May 6;16(5):e0250956. doi: 10.1371/journal.pone.0250956

Covichem: A biochemical severity risk score of COVID-19 upon hospital admission

Marie-Lise Bats 1,2, Benoit Rucheton 3, Tara Fleur 1, Arthur Orieux 4, Clément Chemin 1, Sébastien Rubin 2,5, Brigitte Colombies 1, Arnaud Desclaux 6, Claire Rivoisy 7, Etienne Mériglier 7, Etienne Rivière 8, Alexandre Boyer 4, Didier Gruson 4, Isabelle Pellegrin 9,10, Pascale Trimoulet 11,12, Isabelle Garrigue 11,12, Rana Alkouri 3, Charles Dupin 13,14, François Moreau-Gaudry 1,13, Aurélie Bedel 1,13, Sandrine Dabernat 1,13,*
Editor: Chiara Lazzeri15
PMCID: PMC8101934  PMID: 33956870

Abstract

Clinical and laboratory predictors of COVID-19 severity are now well described and combined to propose mortality or severity scores. However, they all necessitate saturable equipment such as scanners, or procedures difficult to implement such as blood gas measures. To provide an easy and fast COVID-19 severity risk score upon hospital admission, and keeping in mind the above limits, we sought for a scoring system needing limited invasive data such as a simple blood test and co-morbidity assessment by anamnesis. A retrospective study of 303 patients (203 from Bordeaux University hospital and an external independent cohort of 100 patients from Paris Pitié-Salpêtrière hospital) collected clinical and biochemical parameters at admission. Using stepwise model selection by Akaike Information Criterion (AIC), we built the severity score Covichem. Among 26 tested variables, 7: obesity, cardiovascular conditions, plasma sodium, albumin, ferritin, LDH and CK were the independent predictors of severity used in Covichem (accuracy 0.87, AUROC 0.91). Accuracy was 0.92 in the external validation cohort (89% sensitivity and 95% specificity). Covichem score could be useful as a rapid, costless and easy to implement severity assessment tool during acute COVID-19 pandemic waves.

Introduction

About 14% of patients infected by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) need hospitalization and oxygen support and 5% require admission to an intensive care unit [1]. Among the needed tools to fight against COVID-19, the early identification of clinical and laboratory predictors of disease severity retained special attention early on in the immediate evaluation of hospital resources [2, 3]. As in April 2020, blood routine parameters were found to provide important information for the severity of disease since they were significantly different between non-severe and severe types of COVID-19 patients. However only few parameters (CRP, D-Dimer and albumin) showed high consistency between studies [4, 5]. A meta-analysis assessed the value of mortality and severity scores, published in 30 studies [6]. Among them, almost 3 out of 4 assessed mortality risk and half (16/30) the severity risk. Among the reported severity risks, 2 out of 3 (12) are actually non-peer-reviewed studies, shared online by the authors on dedicated platforms. Only 4 peer-reviewed articles report scores associated to severity; among them two scores used blood markers to predict disease severity at hospital admission [7, 8]. Overall, the other available publications are only descriptive of routine biochemical parameters and observed differences were somewhat expected. While albumin was found inversely correlated and lactate dehydrogenase (LDH) and C-reactive protein (CRP) positively correlated with Murray scores documenting the severity of lung injury [9], the combination of these parameters upon hospital admission was not tested as a predictive factor of COVID-19 severity.

In this study, we tested whether a limited number of biochemical parameters values at the time of admission could provide a COVID-19 severity score.

Materials and methods

According to recent recommendations [6], this study adheres to the TRIPOD (transparent reporting of multivariable prediction model for individual prognosis or diagnosis) reporting guideline [10].

Participants and source of data

The retrospective discovery consecutive cohort included patients hospitalized from March 4, to May 7, 2020 in the departments of infectious diseases, internal medicine or intensive care units (ICU) of the University Hospital of Bordeaux, France. According to French law and the French Data Protection Authority, the handling of these data for research purposes was declared to the Data Protection Officer of the University Hospital of Bordeaux and AP-HP (Assistance Publique-Hôpitaux de Paris). The study was approved by the Institutional Review Board and Ethics Committee, which waived the requirement for informed consent (declaration number GP-CE-2020-20).

Participants (n = 222) were enrolled if they had a positive SARS-CoV-2 polymerase chain reaction (from nasopharyngeal swab test) and/or typical computed lung tomography images associated with a high clinical probability of COVID-19, including the usual symptoms, among them: dry cough, fever, chills, fatigue, dyspnea, chest pain, myalgia, diarrhea, anosmia and ageusia [11, 12].

Patients’ demographic data (age, sex, body mass index (BMI)), clinical features (date and COVID-19 symptoms, hospitalization duration, chronic comorbidities), and laboratory parameters were routinely collected during their hospital stay in dedicated electronic health records (DXCare® and Metavision® softwares). Biochemical data on natremia, kaliemia, total proteins, albumin, CRP, alkaline phosphatase (ALP), alanine transaminase (ALT), aspartate aminotransferase (AST), ferritin, creatine kinase (CK) and LDH were reviewed within the first days after admission (average of 1.5 days). According to the 1st exclusion rule related to patient level completeness, patients who had more than 20% missing values were excluded (n = 19 patients). In total, 203 patients were included in the study (S1 Fig).

The retrospective consecutive validation cohort included 100 confirmed COVID-19 patients (45 severe and 55 non-severe), according to the same criteria as above, admitted to Pitié-Salpêtrière hospital in Paris, France, in internal medicine units or ICUs from March 31st to April 4th 2020. Data were collected from Orbis® software. All biochemical results were obtained within the first 24h after hospital admission.

Outcome

The study participants were divided into two groups: severe and non-severe patients. The severity was defined with the following criteria: arterial oxygen saturation (SaO2) less than 90% on room air or need of ≥ 4 L/min oxygen therapy (O2) to obtain a SaO2 ≥ 94% [13]. Patients were considered severe if one of these criteria was present at the admission or occurred during their hospital stay. Patients with acute respiratory distress syndrome at the admission or/and directly admitted to the ICU were also included. All the patients without the cited severe signs were included in the non-severe group.

Severity prediction

Finding significant severity predictors

Correlation analyses evaluated the strength of relationship between two variables, including the severity. Twenty-nine variables were tested: length of hospitalization stay, age, sex, obesity, BMI, hypertension, diabetes, smoking, dyslipidemia, cardiovascular, infectious, inflammatory, respiratory, renal, liver diseases, cancer, viral load E gene and ORF1, natremia, kaliemia, total proteins, albumin, CRP, ferritin, AST, ALT, ALP, CK and LDH. Pearson’s correlation coefficients represented the degree of linear association between COVID-19 severity and each of the 29 variables.

Receiver operating characteristic (ROC) curves measured the predictive value of COVID-19 severity for single clinical or biological variables.

Missing data

According to the 2nd exclusion rule related to variable level completeness, variables with more than 40% missing data were excluded to build the predictive model (e.g. BMI). All the variables were available for 118 patients. Missing values in the population data were imputed using random forests [14].

Model construction and validation

In order to work with an explainable predictive model, a multivariate logistic regression was fitted with 27 variables (excluding hospitalization duration and BMI).

We performed an 80% random split for the training set with the caret R package. The random sampling was done within the 2 levels of severity in an attempt to balance the class distributions within the splits. In total, 40 patients were randomly selected from the total population as test set and the 163 remaining patients were designated as the training set (S1 Fig).

Significant predictors were selected in the training group by performing stepwise model selection by Akaike Information Criterion (AIC).

From the estimates, we computed the effects for each predictor, summed them up and by applying a logistic transformation, we derived a severity score also called Covichem score, with the following logistic equation:

Covichemscore=1/(1+exp-(β0+j=1kβjXj))

β0 is the intercept and βj are the estimates for each predictor Xj. A score > 0.5 was defined by AUROC as the cut-off for severity.

To assess how the prediction will generalize to an independent new data set, the accuracy of the model was estimated by a resampling Leave-One-Out Cross-Validation technique.

Statistical performance for the Covichem score were evaluated in both training and test sets by calculating accuracy, sensitivity, specificity, negative and positive predictive values (NPV and PPV) and area under ROC curve (AUROC).

External validation

We used the Covichem score to predict the severity risk in patients from Pitié-Salpêtrière Hospital (Paris). The accuracy, sensitivity, specificity, NPV and PPV were computed to evaluate the model performance.

Biochemical assays

Biochemical parameters in Bordeaux university hospitals were measured on plasmas collected on Vacutainer® Barricor tubes (Becton Dickinson, Le-Pont-de-Claix, France), using Architect analyzers (Abbott Diagnostics, Rungis, France). The following analytical methods were used: indirect potentiometry for plasma sodium and potassium, colorimetry for total proteins and albumin (bromocresol purple method), enzymatic method for ALP, ALT, AST, LDH and CK, immunoturbidimetry for CRP and immunochemiluminescence for ferritin. Exploration of kidney function was not included in data recovery because published data showed that urea and creatinine remained in normal ranges.

In Pitié-Salpêtrière hospital, plasmas were collected on Vacutainer® PST Lithium Heparinate tubes (Becton Dickinson, Le-Pont-de-Claix, France). Biochemical parameters were measured on Cobas c 8000 module analyzers (Roche Diagnostics, Meylan, France), using the following analytical methods: indirect potentiometry for plasma sodium, enzymatic method for LDH and CK and immunoturbidimetry for albumin (Diagam) and ferritin.

Statistical analysis

Continuous and discrete variables were expressed as median (25th, 75th percentile) and absolute (relative) frequencies of patients, respectively. To compare the differences between severe and non-severe patients, we used Wilcoxon-Mann-Whitney U test for quantitative variables and Chi-squared test for categorical variables. A value of double-sided p < 0.05 was considered statistically significant.

All analyses were performed using R 3.6.3 (R Foundation for Statistical Computing, Vienna, Austria) or GraphPad Prism 5.0 (GraphPad Software, Inc., San Diego, CA, USA). The model development and validation were implemented using caret R package.

Results

Baseline characteristics of the population

Patients hospitalized in Bordeaux university hospital were included from March 4th to April 27th, 2020 (S1 Fig). They came to the hospital for suspicion of SARS-CoV-2 infection. Among the 222 enrolled patients, 203 were eligible, with >80% of the necessary clinical and biochemical available data. Ninety one percent of eligible patients were positive for virus detection by RT-QPCR. The negative group presented common infection symptoms, including dry cough, fever, sore throat and typical lung lesions on the chest CT-scan. COVID-19 was severe for 97 patients (48%, Table 1). Sixty-eight patients (33%) were admitted in the ICU, either directly at the admission or after a median hospital stay of 3 days. Mortality rate was 12% (25/203 patients) and occurred mostly in the group of patients with severe COVID-19 (24/25 patients). The median age was 62 years and sex ratio was 1.11 (M/F), both parameters being associated to disease severity (p = 0.0011 and p = 0.017, respectively, Table 1). Comorbidities associated to severity were obesity, high blood pressure and cardiovascular conditions distinct from high blood pressure (Table 1).

Table 1. Baseline characteristics of the COVID-19 patient cohort.

Variable All, n = 203 Non-severe, n = 106 (52%) Severe, n = 97 (48%) p-value
Demographic
 Age (years) 62 (51, 74) 59 (47.8, 72.3) 67 (58.5, 76) 0.0011
 Male sex, n (%) 107 (53%) 48 (44%) 59 (62%) 0.0176
Chronology of disease
 Onset time (days) 6 (3, 8) 6 (3, 9) 6 (3, 8) 0.7721
 Duration of hospitalization (days) 8.5 (5–19) 6 (2–9) 22 (13–33) <0.001
Cardiovascular risk factors
 Diabetes, n (%) 39 (19%) 16 (15%) 23 (24%) 0.1277
 Dyslipidemia, n (%) 45 (22%) 22 (20%) 23 (24%) 0.6216
 Hypertension, n (%) 81 (40%) 32 (30%) 49 (52%) 0.0022
 Smoking, n (%) 39 (19%) 17 (16%) 22 (23%) 0.2437
 Obesity, n (%) 47 (23%) 13 (12%) 34 (36%) <0.001
 BMI (kg/m2) 27.3 (24.2, 31.8) 26.1 (22.4, 29.1) 29.4 (25.6, 32.9) 0.0012
Others comorbidities
 Cardiovascular disease, n (%) 66 (33%) 23 (21%) 43 (45%) <0.001
 Cancer, n (%) 35 (17%) 18 (17%) 17 (18%) 0.9091
 Infectious disease, n (%) 8 (4%) 6 (6%) 2 (2%) 0.3846
 Inflammatory disease, n (%) 23 (11%) 13 (12%) 10 (11%) 0.9498
 Liver disease, n (%) 6 (3%) 3 (3%) 3 (3%) 1.0000
 Renal disease, n (%) 10 (5%) 4 (4%) 6 (6%) 0.5670
 Respiratory disease, n (%) 44 (22%) 24 (22%) 20 (21%) 1.0000
SARS-CoV-2 viral load
ORF1 (Ct value) 27.5 (23.2, 31.6) 27.9 (22.9, 31.8) 27.3 (23.5, 31.1) 0.7558
E-gene (Ct value) 28.8 (24, 33.8) 29.3 (23.8, 34) 27.9 (24, 32.7) 0.3727
Biochemical parameters
 Natremia, mmol/L 138 (135, 140) 139 (136, 140) 136 (134, 139) 0.0047
 Kaliemia, mmol/L 3.91 (3.63, 4.15) 3.90 (3.67, 4.08) 3.91 (3.57, 4.22) 0.7493
 Total proteins, g/L 72 (67, 76) 73 (68, 77) 71 (66, 75) 0.0090
 Albumin, g/L 28.4 (23.6, 33.3) 32.2 (28, 36.4) 24.6 (19.2, 28.4) <0.001
 CRP, mg/L 83.9 (32.9, 163.3) 57.1 (11, 108.9) 128.7 (65.7, 199.5) <0.001
 ALP, U/L 68 (58, 87) 67 (58, 79) 70 (59, 102) 0.1111
 AST, U/L 41 (30, 58) 36 (29, 46) 50 (35, 70) <0.001
 ALT, U/L 28 (18, 45) 26 (17, 41) 30 (22, 48) 0.0264
 Ferritin, ng/mL 581 (294, 1139) 367 (169, 708) 973 (516, 2155) <0.001
 LDH, U/L 339 (270, 452) 284 (231, 366) 392 (332, 516) <0.001
 CK, U/L 85 (48, 201) 66 (40, 120) 118 (60, 305) <0.001

Onset time corresponds to the days between the onset of symptoms and the admission to hospital. Cardiovascular diseases include coronary artery diseases such as angina and myocardial infarction, heart failure, cardiomyopathy, abnormal heart rhythms, valvular heart disease, aortic aneurysms, heart transplant, peripheral artery disease, thromboembolic disease, venous thrombosis and stroke. Continuous and discrete variables are presented as median (25th, 75th percentile) and number (%) of patients and analyzed using Wilcoxon-Mann-Whitney U test and Chi-squared test, respectively. ALP, Alkaline Phosphatase; ALT, Alanine Aminotransferase; AST, Aspartate Aminotransferase; BMI, Body Mass Index; CK, Creatine Kinase; CRP, C-reactive protein; Ct, Cycle threshold; LDH, Lactate Dehydrogenase.

Median time between disease symptoms and hospitalization was the same in both severe and non-severe COVID-19 patients (Table 1, 6 days). The median hospitalization stay length was almost 4 times longer for the severe group (22 days versus 6 days, Table 1). Interestingly, 83% of non-severe patients stayed less than 10 days whereas 80% of severe patients stayed more than 10 days.

We examined whether differences were seen among the biochemical analytes linked to cytolysis and/or liver function (LDH, ASAT, ALAT, CK, and PAL), inflammation (CRP, ferritin) and standard biochemical analytes (total proteins, albumin, sodium, potassium). Median values (Table 1) and Pearson’s coefficients (S1 Table) were obtained according to severity. A correlogram identified parameters linearly correlated to severity and examined clinical data relevant to severity (Fig 1). Density plots describe the distribution of continuous variables in both groups (S2 Fig). Interestingly, the continuous variables best fitting severity were albumin (a drop of almost 25%, ρ = 0.55), LDH (around 1.5-fold increase, ρ = 0.40), ferritin and CRP (almost 3-fold increase, ρ = 0.38 and 0.34, respectively). The severe group counted 3 times more obese people and 2 times more patients with cardiovascular conditions other than high blood pressure, as compared to the non-severe group.

Fig 1. Correlogram figuring out the relationship between each pair of clinical or biological variables in COVID-19 patients.

Fig 1

Positive correlations are displayed in blue and negative correlations in red. Color intensity and size of the circles are proportional to the correlation coefficients. On the right side of the correlogram, the legend color shows the correlation coefficients and the corresponding colors. ALP, Alkaline Phosphatase, AST, Aspartate Aminotransferase; ALT, Alanine Aminotransferase; BMI, Body Mass Index; CK; Creatine Kinase; CRP, C-reactive protein; LDH, Lactate Dehydrogenase.

Severity risk score

To select the best predictors, we performed stepwise model selection by AIC and built a logistic regression model based on a training data set of 163 patients selected by random split (S1 Fig, S2 Table, materials and methods). Seven predictors were selected: obesity, cardiovascular conditions distinct from high blood pressure, albumin, natremia, ferritin, CK and LDH (Table 2). Individual predictive performance measured by AUROC for four individual predictors (S3 Fig), ranked between 0.62 (natremia) and 0.83 (albumin). Albumin was the best individual predictor, with the following performance calculated with a cut-off of 26.95 g/L: accuracy 0.77 (95% Confidence Interval (CI) 0.70–0.83), sensitivity 0.66, specificity 0.85, PPV and NPV 0.77 and 0.76, respectively (S4 Fig).

Table 2. Results of the stepwise model selection by Akaike Information Criterion (AIC) for model prediction of COVID-19 severity.

Predictors Estimate Standard error z value p value
(Intercept) 14.6509961 8.5549991 1.713 .
Obesity 1.2903766 0.5205244 2.479 *
Cardiovascular disease 1.5237137 0.4843693 3.146 **
Natremia -0.0961755 0.0619030 -1.554 0.120268
Albumin -0.1805453 0.0473210 -3.815 ***
Ferritin 0.0008822 0.0002885 3.058 **
LDH 0.0033067 0.0019564 1.690 .
CK 0.0020180 0.0009898 2.039 *

*** p <0.001,

** p <0.01,

* p <0.05,

p <0.1. CK, Creatine Kinase, LDH, Lactate Dehydrogenase.

To improve prediction performance a Covichem severity scoring was derived from the fitted logistic regression model. The AUROC was 0.91 (Fig 2A), the sensitivity and specificity were 0.85 and 0.88, respectively, which were better performance than albumin alone. The PPV and NPV were 0.85 and 0.88, respectively (Fig 2B). Overall, the prediction accuracy was 0.87 (95% CI 0.80–0.91). Predictor error was estimated with Leave One Out cross validation. The accuracy of 0.83 suggested that the model accuracy was not overly overestimated.

Fig 2. Covichem score performances.

Fig 2

(A) Receiver Operating Characteristic curves for Covichem score and Albumin in predicting COVID-19 severity. The areas under Receiver Operating Characteristic curves (AUROC) are indicated on the graph legend. Confusion matrix and performance for Covichem score in the training (B), test (C) and external validation sets (D). Grey squares correspond to true positive and negative values and spotted grey squares represent false positive and negative values. Predictions were calculated for a cut-off of Covichem score at 0.5. NPV, Negative Predictive Value; PPV, Positive Predictive Value.

A test set of 40 patients (20 severe, S2 Table) reached similar performance with an AUROC of 0.93 and an accuracy of 0.83 (95% CI 0.67–0.93). Sensitivity was 0.80, specificity 0.85, PPV 0.84 and NPV 0.81 (Fig 2C).

Data from an independent cohort of 100 patients hospitalized at Pitié-Salpêtrière hospital (AP-HP, Paris) were collected to evaluate the Covichem severity score (S1 Fig, S2 Table). Performance on the external validation set were comparable to the internal validation set with an accuracy of 0.92 (95% CI 0.85–0.97), sensitivity of 0.89, specificity of 0.95, PPV of 0.93 and NPV of 0.91 (Fig 2D).

Discussion

This study identified 2 clinical and 5 biochemical parameters as valuable predictors to build a COVID-19 severity score at patient’s hospital admission. Overall, the characteristics of our discovery cohort are consistent with previous observations [15]. In particular, and in agreement with recent data [2, 4, 16], plasma albumin was the biochemical marker most strongly affected by COVID-19 severity, which caught our attention. In regular situations, hypoalbuminemia is a well-defined marker of malnutrition [17]. In urgent care, previous studies have shown that hypoalbuminemia at admission was associated with increased mortality in hospital medical emergency admission [18]. Patients below 27.4g/L (total cohort >20000 patients) presented a 30-day mortality of 31.7%. Odds ratios of death were over 3 times greater than in those with normal albumin levels. The predictive power on mortality of low albumin levels in an unselected acutely admitted medical population (5894 adult patients) found an OR of 3.91 when adjusting for CRP, liver disease, renal disease, cancer and rheumatologic disease [19]. Moreover, low albumin levels were observed in patients requiring intensive respiratory or vasopressor support during influenza H1N1 viral infection [20], with a cut-off value of 27g/L. The cut-off value of albumin observed here (26.95 g/L) is fully in agreement with these published data. Similar to our results, sensitivity was 0.79 and specificity 0.86 ([20], 0.66 and 0.85 in our study). Thus, it seems that distinct respiratory viral infections impact non-specific biochemical biomarkers in the same way, suggesting that they share systemic effects. Previous studies found that hypoalbuminemia was predictive for respiratory failure in MERS-CoV [21], and it may be considered that albumin drop is linked to liver failure [22]. However, our patients showed very mild if none liver enzymes increased levels, and considering that SARS-Cov-2 carries the potential to infect endothelial cells through their ACE-2 receptor, we believe possible that serum albumin level drops as a consequence of endotheliitis [23]. This hypothesis is in agreement with the fact that serum albumin is known as a biomarker of vascular permeability [24].

We built the Covichem score with unbiased machine learning modeling. The performance was better than any tested individual clinical or biochemical predictor. Of interest, the score included clinical parameters, the most relevant being obesity and cardiovascular comorbidities, as already described [25]. These latter conditions may worsen the drop in albuminemia observed in the severe disease, since low serum albumin levels are independently linked to several cardiovascular diseases [26]. Of note, high blood pressure, which was presumed of high risk of severity was not selected, in agreement with published data [27]. LDH and CK positively correlated with severity and were included in the score, which is not surprising and in agreement with recent data [28], considering the extended lung and possibly other tissues lesions induced by the infection. Even if we did not observe frank hyponatremia, the inclusion of this parameter in the score relates to low sodium plasma levels in severe infections [29]. Unlike Covichem, a severity score applied to COVID-19 identified CRP as a good predictor [30]. Instead, we found that ferritin was a better predictor. This may relate to the cytokine storm syndrome accompanying severe COVID-19, better reflected by strong hyperferritinemia than increased CRP [31]. Unlike other studies [25, 32] finding that uncontrolled diabetes was of more risk of severity, diabetes was not identified as a predictor in our study, possibly because of the low proportion of patients with this co-morbidity (19%, 39 patients). We did not include in our analysis sub-groups of diabetic patients (controlled and uncontrolled). Finally, a sex ratio difference, males being more prone to severe disease than females, was found, as reported by others [33, 34], but was not selected in the model.

Importantly, Covichem showed very good performance on the independent cohort of patients from Paris, even if the labs used distinct methods of biochemical parameter measurements. The model is simple to set up since it necessitates only 7 variables. Moreover, the model is highly interpretable, since it is linear and the effects of the predictors are reflected by the regression coefficients. Compared to the N/L*CRP*D-dimer product [30], Covichem displayed better sensitivity and similar specificity (70 and 90% versus 86% and 89%). Covichem could be compared to other recently published scores [7, 8]. Gong et al. study is comparable to our work. The cohorts are of equivalent sizes (189 patients for the discovery cohort) and the selected 7 variables included albumin and LDH. However, variables were used in a nomogram, which needs skilled operators [8]. By contrast Covichem can be calculated with an Android© APP (provided upon demand). The COVID-GRAM score is accessible online and needs imaging data or a long list of co-morbidities and clinical features. Our score displaying a slightly best AUC (0.91 versus 0.88), uses 30% less variables (7 versus 10) [35]. Our score could also be proposed for online calculation, but we think that the APP format is better since available anytime anywhere. Finally, the CALL score accuracy for our cohort was 67%, which is less than ours [7].

As stated above, our score presents numerous advantages: it is non-invasive, it does not need clinical exam by a medical doctor or imaging and could be performed by another health professional, it can be determined outside the hospital (online medical interview with lab prescription), it is independent of viral load determination, which can be easily saturable in pandemic conditions. Moreover, the test is cheap, fast (most labs will deliver results in <2h). The markers are available in all the routine labs around the world (no need of very specific markers, with limited access).

We believe that the Covichem score could be easily determined in patients who do not require hospitalization. It would be interesting to see if it detects the patients who are going to need hospitalization, as early as when they visit their general practitioner or when they present the first symptoms. In a pandemic context, such a tool could help family doctors. In line with lack of albumin normalization in COVID-19 patients with no improvement [15], it would be worthwhile to see how the Covichem score value evolves during the hospitalization, and its capacity to predict patient improvement. As we gain longer-term knowledge on post COVID-19 related disorders [36], it would be interesting to test the Covichem at admission as a predictive tool for long-term disease or to measure it distantly from hospital release as a follow-up marker of disease persistence.

We identified limitations of our study. First, we included a low number of patients. This study was conducted during the first wave in France, with a limited epidemic in Bordeaux area. Second, our study is retrospective, and we did not know at first what would be the best predictors and some data were missing. Third, we did not include racial/ethnicities as a variable although it may be a risk factor of severity [37]. This information is not systematically recorded in France, by law. At the technical level, we performed albumin measurement using the bromocresol purple dye, which accurately determines albumin levels in low ranges [24]. This point necessitates attention before using the Covichem score, especially by numerous labs using the bromocresol green dye that overestimates low albumin concentrations. This might be the reason why others have not included albuminemia in their scores. Noteworthy, albumin should be determined with bromocresol purple or by immune-based tests such as nephelemetry or turbidimetry.

Conclusion

This study repositions certain biochemical analytes as relevant biomarkers of disease severity assessment in the COVID-19. This scoring system may help fast clinical decision with a simple blood test and co-morbidity assessment by anamnesis. It does not need deep exploration necessitating saturable equipments such as imaging, or procedures difficult to implement such as blood gas measures, necessitating trained medical gesture and strict pre-analytical conditions. It is implementable anywhere, including developing nations. Although the score needs external validation in multi-ethnic populations, the needed parameters are independent of race or ethnicity, which may presume the validity of the score worldwide.

Supporting information

S1 Fig. Flow chart of participants and distribution of COVID-19 severity in the discovery cohort (A) and in the external validation cohort (B).

(TIF)

S2 Fig. Density plots representation of continuous variables distribution between non severe and severe COVID-19 patients.

ALP, Alkaline Phosphatase, AST, Aspartate Aminotransferase; ALT, Alanine Aminotransferase; BMI, Body Mass Index; CK; Creatine Kinase; CRP, C-reactive protein; LDH, Lactate Dehydrogenase.

(TIF)

S3 Fig. Comparison of Receiver Operating Characteristic curves for clinical and biological variables in predicting COVID-19 severity.

The areas under Receiver Operating Characteristic curves (AUROC) are indicated for each variable on the graph legend. BMI, Body Mass Index; LDH, Lactate Dehydrogenase.

(TIF)

S4 Fig. Confusion matrix and performance of Albumin level in predicting COVID-19 severity.

Grey squares correspond to true positive and true negative values, spotted grey squares represent false positive and false negative values. Predictions were calculated for a cut-off of albumin at 26.95 g/L. NPV, Negative Predictive Value; PPV, Positive Predictive Value.

(TIF)

S1 Table. Pearson’s correlation coefficients for each variable with COVID-19 severity.

ALP, Alkaline Phosphatase; ALT, Alanine Aminotransferase; AST, Aspartate Aminotransferase; BMI, Body Mass Index; CK, Creatine Kinase; CRP, C-reactive protein; LDH, Lactate Dehydrogenase.

(PDF)

S2 Table. Baseline characteristics of the training, test and external validation sets.

Continuous variables are expressed as median (25th, 75th percentile). Discrete variables are presented as absolute (relative) frequencies of patients. ALP, Alkaline Phosphatase; ALT, Alanine Aminotransferase; BMI, Body Mass Index; CK, Creatine Kinase; CRP, C-reactive protein; AST, Aspartate Aminotransferase; Ct, Cycle threshold; LDH, Lactate Dehydrogenase; NA, not available.

(PDF)

S1 File

(XLSX)

Acknowledgments

We thank Pr Dominique Bonnefont-Rousselot for giving us the opportunity to include the parisian cohort in study, Pauline Ratouit and Hedy Nemeur for data and samples collection, Dr Annie Bérard and Pr Marie-Edith Lafon for their critical reading of the manuscript. The authors acknowledge the Bordeaux University Hospital Biobank “CRB- Bordeaux Biothèques Santé”, BB-0033-00094 for technical assistance in managing patient sample storage. We are very grateful to Dr Jérémie Bureau for his methodological support and his strong expertise in statistical analysis.

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.WHO. Clinical management of severe acute respiratory infection when COVID-19 is suspected. [cited 15 May 2020]. http://www.who.int/publications-detail/clinical-management-of-severe-acute-respiratory-infection-when-novel-coronavirus-(ncov)-infection-is-suspected
  • 2.Henry BM, de Oliveira MHS, Benoit S, Plebani M, Lippi G. Hematologic, biochemical and immune biomarker abnormalities associated with severe illness and mortality in coronavirus disease 2019 (COVID-19): a meta-analysis. Clin Chem Lab Med. 2020. 10.1515/cclm-2020-0369 [DOI] [PubMed] [Google Scholar]
  • 3.Tjendra Y, Al Mana AF, Espejo AP, Akgun Y, Millan NC, Gomez-Fernandez C, et al. Predicting Disease Severity and Outcome in COVID-19 Patients: A Review of Multiple Biomarkers. Arch Pathol Lab Med. [cited 2 Sep 2020]. 10.5858/arpa.2020-0471-SA [DOI] [PubMed] [Google Scholar]
  • 4.Rod JE, Oviedo-Trespalacios O, Cortes-Ramirez J. A brief-review of the risk factors for covid-19 severity. Rev Saude Publica. 2020;54: 60. 10.11606/s1518-8787.2020054002481 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Liu K, Fang Y-Y, Deng Y, Liu W, Wang M-F, Ma J-P, et al. Clinical characteristics of novel coronavirus cases in tertiary hospitals in Hubei Province. Chin Med J (Engl). 2020. [cited 18 Apr 2020]. 10.1097/CM9.0000000000000744 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Wynants L, Calster BV, Bonten MMJ, Collins GS, Debray TPA, Vos MD, et al. Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal. BMJ. 2020;369. 10.1136/bmj.m1328 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Ji D, Zhang D, Xu J, Chen Z, Yang T, Zhao P, et al. Prediction for Progression Risk in Patients with COVID-19 Pneumonia: the CALL Score. Clin Infect Dis. 2020. [cited 10 Nov 2020]. 10.1093/cid/ciaa414 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Gong J, Ou J, Qiu X, Jie Y, Chen Y, Yuan L, et al. A Tool for Early Prediction of Severe Coronavirus Disease 2019 (COVID-19): A Multicenter Study Using the Risk Nomogram in Wuhan and Guangdong, China. Clin Infect Dis. 2020;71: 833–840. 10.1093/cid/ciaa443 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Liu Y, Yang Y, Zhang C, Huang F, Wang F, Yuan J, et al. Clinical and biochemical indexes from 2019-nCoV infected patients linked to viral loads and lung injury. Sci China Life Sci. 2020;63: 364–374. 10.1007/s11427-020-1643-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015;350: g7594. 10.1136/bmj.g7594 [DOI] [PubMed] [Google Scholar]
  • 11.Ai T, Yang Z, Hou H, Zhan C, Chen C, Lv W, et al. Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases. Radiology. 2020; 200642. 10.1148/radiol.2020200642 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Coronavirus. [cited 12 May 2020]. https://www.who.int/westernpacific/health-topics/coronavirus
  • 13.Rubin S, Orieux A, Prevel R, Garric A, Bats M-L, Dabernat S, et al. Characterisation of Acute Kidney Injury in Critically Ill Patients with Severe Coronavirus Disease-2019 (COVID-19). Clin Kidney J. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Stekhoven DJ. Using the missForest Package.: 11.
  • 15.Zhang J, Wang X, Jia X, Li J, Hu K, Chen G, et al. Risk factors for disease severity, unimprovement, and mortality in COVID-19 patients in Wuhan, China. Clinical Microbiology and Infection. 2020; S1198743X20302172. 10.1016/j.cmi.2020.04.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Aloisio E, Chibireva M, Serafini L, Pasqualetti S, Falvella FS, Dolci A, et al. A Comprehensive Appraisal of Laboratory Biochemistry Tests as Major Predictors of COVID-19 Severity. Arch Pathol Lab Med. 2020;144: 1457–1464. 10.5858/arpa.2020-0389-SA [DOI] [PubMed] [Google Scholar]
  • 17.Levitt DG, Levitt MD. Human serum albumin homeostasis: a new look at the roles of synthesis, catabolism, renal and gastrointestinal excretion, and the clinical value of serum albumin measurements. Int J Gen Med. 2016;9: 229–255. 10.2147/IJGM.S102819 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Lyons O, Whelan B, Bennett K, O’Riordan D, Silke B. Serum albumin as an outcome predictor in hospital emergency medical admissions. European Journal of Internal Medicine. 2010;21: 17–20. 10.1016/j.ejim.2009.10.010 [DOI] [PubMed] [Google Scholar]
  • 19.Jellinge ME, Henriksen DP, Hallas P, Brabrand M. Hypoalbuminemia is a strong predictor of 30-day all-cause mortality in acutely admitted medical patients: a prospective, observational, cohort study. PLoS ONE. 2014;9: e105983. 10.1371/journal.pone.0105983 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Wi YM, Kim JM, Peck KR. Serum albumin level as a predictor of intensive respiratory or vasopressor support in influenza A (H1N1) virus infection. International Journal of Clinical Practice. 2014;68: 222–229. 10.1111/ijcp.12249 [DOI] [PubMed] [Google Scholar]
  • 21.Saad M, Omrani AS, Baig K, Bahloul A, Elzein F, Matin MA, et al. Clinical aspects and outcomes of 70 patients with Middle East respiratory syndrome coronavirus infection: a single-center experience in Saudi Arabia. Int J Infect Dis. 2014;29: 301–306. 10.1016/j.ijid.2014.09.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Kukla M, Skonieczna-Żydecka K, Kotfis K, Maciejewska D, Łoniewski I, Lara LuisF, et al. COVID-19, MERS and SARS with Concomitant Liver Injury—Systematic Review of the Existing Literature. J Clin Med. 2020;9. 10.3390/jcm9051420 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Varga Z, Flammer AJ, Steiger P, Haberecker M, Andermatt R, Zinkernagel AS, et al. Endothelial cell infection and endotheliitis in COVID-19. The Lancet. 2020;395: 1417–1418. 10.1016/S0140-6736(20)30937-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Margarson MP, Soni N. Serum albumin: touchstone or totem? Anaesthesia. 1998;53: 789–803. 10.1046/j.1365-2044.1998.00438.x [DOI] [PubMed] [Google Scholar]
  • 25.Zheng Z, Peng F, Xu B, Zhao J, Liu H, Peng J, et al. Risk factors of critical & mortal COVID-19 cases: A systematic literature review and meta-analysis. J Infect. 2020;81: e16–e25. 10.1016/j.jinf.2020.04.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Arques S. Human serum albumin in cardiovascular diseases. European Journal of Internal Medicine. 2018;52: 8–12. 10.1016/j.ejim.2018.04.014 [DOI] [PubMed] [Google Scholar]
  • 27.Drager LF, Pio-Abreu A, Lopes RD, Bortolotto LA. Is Hypertension a Real Risk Factor for Poor Prognosis in the COVID-19 Pandemic? Curr Hypertens Rep. 2020;22. 10.1007/s11906-020-01057-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Yan L, Zhang H-T, Goncalves J, Xiao Y, Wang M, Guo Y, et al. An interpretable mortality prediction model for COVID-19 patients. Nature Machine Intelligence. 2020; 1–6. 10.1038/s42256-020-0180-7 [DOI] [Google Scholar]
  • 29.Liamis G, Milionis HJ, Elisaf M. Hyponatremia in patients with infectious diseases. Journal of Infection. 2011;63: 327–335. 10.1016/j.jinf.2011.07.013 [DOI] [PubMed] [Google Scholar]
  • 30.Zhou Y, Yang Z, Guo Y, Geng S, Gao S, Ye S, et al. A New Predictor of Disease Severity in Patients with COVID-19 in Wuhan, China. medRxiv. 2020; 2020.03.24.20042119. 10.1101/2020.03.24.20042119 [DOI] [Google Scholar]
  • 31.Mehta P, McAuley DF, Brown M, Sanchez E, Tattersall RS, Manson JJ. COVID-19: consider cytokine storm syndromes and immunosuppression. The Lancet. 2020;395: 1033–1034. 10.1016/S0140-6736(20)30628-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Singh AK, Khunti K. Assessment of risk, severity, mortality, glycemic control and antidiabetic agents in patients with diabetes and COVID-19: A narrative review. Diabetes Res Clin Pract. 2020;165: 108266. 10.1016/j.diabres.2020.108266 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Wolff D, Nee S, Hickey NS, Marschollek M. Risk factors for Covid-19 severity and fatality: a structured literature review. Infection. 2020; 1–14. 10.1007/s15010-020-01509-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Gebhard C, Regitz-Zagrosek V, Neuhauser HK, Morgan R, Klein SL. Impact of sex and gender on COVID-19 outcomes in Europe. Biol Sex Differ. 2020;11. 10.1186/s13293-020-00304-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Liang W, Liang H, Ou L, Chen B, Chen A, Li C, et al. Development and Validation of a Clinical Risk Score to Predict the Occurrence of Critical Illness in Hospitalized Patients With COVID-19. JAMA Intern Med. 2020;180: 1–9. 10.1001/jamainternmed.2020.2033 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Deng MC. Multi-dimensional COVID-19 short- and long-term outcome prediction algorithm. Expert Review of Precision Medicine and Drug Development. 2020;5: 239–242. 10.1080/23808993.2020.1785286 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Carethers JM. Insights into disparities observed with COVID-19. J Intern Med. 2021;289: 463–473. 10.1111/joim.13199 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Chiara Lazzeri

15 Mar 2021

PONE-D-20-38092

Covichem: a biochemical severity risk score of COVID-19

upon hospital admission

PLOS ONE

Dear Dr. Dabernat,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The paper is quite interesting and well written. However, the conclusions should be re written and focused on results. 

Please submit your revised manuscript by Apr 29 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Chiara Lazzeri

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I think there is academic merit in this work but the contribution of the tool to clinicians or other stakeholders needs to be clearer. The conclusion seemed to focus on something different than what was presented as the aim of the paper.

Introduction

Line 52 -55: It is not clear what “soon after the first phase of COVID-19” refer to, is this first phase in France? what timeline?. Additionally, “few” parameters seem inaccurate when taking into account that Rod et al. 2020 reported 60 risk factors for disease severity using early studies coming from China and Singapore with at least 50% of those been biomarkers that could be tested in blood.

Line 68 – 69: The following sentence was not fully clear to me “Turn-around-time is short to obtain automated biochemical parameters 70 measures (<2h)”.

I would suggest to double check English and the connectors between sentences in the last paragraph of the introduction. The authors seem to follow the convention of writing the aim of the research at the end of the introduction. However, the last sentence sound more like an action/task that belongs to the methods section and it does not appear to me to be written as an aim.

Methods

Line 122-123: It is not fully clear what “referring” to odds ratios means. Additionally, odds ratios are a different mathematical construct than probability ratios (which are commonly called risk ratios under an epidemiological and the quantitative notions of risk). Generally in epidemiology both odds ratios and risk ratios are called measures of association between variables, it might be worthwhile to consider the use the term “measures of association”. This would likely make a value free statement in the results section and leave value judgements about risk for the discussion and the conclusion.

Results

Table 1: There is a risk that the use of odds ratios overestimates relative risks when the rare disease assumption (prevalence less than 10%) is not present. This seems to happen for most comorbidities in Table 1. This could mean that the presented odds estimates might be overestimated. If the interest is risk, why use logistic regression instead of other generalized linear models (e.g. log binomial model) that offer relative risk as the output and not odds ratios?.

Discussion

Line 300 – What machine learning model? I could not find any machine learning model in the methods section.

Should there be a table comparing existing predictors against the proposed model?

I think the discussion should be supplemented with discussions of other papers that are addressing the topic. Eg.

Drager, L. F., Pio-Abreu, A., Lopes, R. D., & Bortolotto, L. A. (2020). Is Hypertension a Real Risk Factor for Poor Prognosis in the COVID-19 Pandemic? Curr Hypertens Rep, 22(6), 43. doi:10.1007/s11906-020-01057-x

Gebhard, C., Regitz-Zagrosek, V., Neuhauser, H. K., Morgan, R., & Klein, S. L. (2020). Impact of sex and gender on COVID-19 outcomes in Europe. Biol Sex Differ, 11(1), 29. doi:10.1186/s13293-020-00304-9

Leung, C. (2020). Risk factors for predicting mortality in elderly patients with COVID-19: A review of clinical data in China. Mechanisms of Ageing and Development, 188, 111255. doi:https://doi.org/10.1016/j.mad.2020.111255

Rod, J. E., Oviedo-Trespalacios, O., & Cortes-Ramirez, J. (2020). A brief-review of the risk factors for covid-19 severity. Rev Saude Publica, 54, 60. doi:10.11606/s1518-8787.2020054002481

Singh, A. K., & Khunti, K. (2020). Assessment of risk, severity, mortality, glycemic control and antidiabetic agents in patients with diabetes and COVID-19: A narrative review. Diabetes Res Clin Pract, 165, 108266. doi:10.1016/j.diabres.2020.108266

Wolff, D., Nee, S., Hickey, N. S., & Marschollek, M. (2020). Risk factors for Covid-19 severity and fatality: a structured literature review. Infection, 1-14. doi:10.1007/s15010-020-01509-1

Zheng, Z., Peng, F., Xu, B., Zhao, J., Liu, H., Peng, J., . . . Tang, W. (2020). Risk factors of critical & mortal COVID-19 cases: A systematic literature review and meta-analysis. J Infect, 81(2), e16-e25. doi:10.1016/j.jinf.2020.04.021

Limitations

There should be a discussion regarding the external validity of the score beyond the used sample sizes in the particular populations that were used to propose and validate. Why should other clinicians in Europe/ developed nations expect similar results?. What about developing nations?.

Conclusions

Lines 359 – 361: Rod et al. 2020 review of early studies coming from china looking at risk factors for a composite index of severe-fatal the COVID-19 disease propose albumin as one of the most consistent risk factors for severe-fatal COVID-19. Based on this information, it is hard to understand how the present paper is “repositioning” albumin as a standard of care of any COVID-19 disease patient admitted to urgent care. Please be more specific what is the contribution that the present paper is adding to the literature in regards albumin levels.

The conclusion needs a lot of work. I found hard to find the logic between the aim being to propose, validate and promote the use of a score by using an app and to conclude that the paper has reposition albumin as an important risk factor (which is not accurate based on the above-mentioned rationale).

What future research directions does the current state of development of this score lead researchers to?.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 May 6;16(5):e0250956. doi: 10.1371/journal.pone.0250956.r002

Author response to Decision Letter 0


9 Apr 2021

We would like to thank the reviewer and the editor for their fair review of our work.

Line 52 -55: It is not clear what “soon after the first phase of COVID-19” refer to, is this first phase in France? what timeline?

We now specify the timeline as being April 2020.

Additionally, “few” parameters seem inaccurate when taking into account that Rod et al. 2020 reported 60 risk factors for disease severity using early studies coming from China and Singapore with at least 50% of those been biomarkers that could be tested in blood.

We agree that several (even now numerous) studies have described risk factors for COVID-19 severity. However, when undertaking the present study, our analysis of the literature, focused to biochemical parameters, showed that only a few were consistently found linked to disease severity and not to other outcomes (such as death ratio, or hospitalization rates). We thank the reviewer for providing the “Rod, J. E., Oviedo-Trespalacios, O., & Cortes-Ramirez, J. (2020). A brief-review of the risk factors for covid-19 severity. Rev Saude Publica, 54, 60. doi:10.11606/s1518-8787.2020054002481” reference, that we now cite, and which summarizes the available data on COVID severity in April 2020. As shown in the Table of this review, CRP, D-Dimer and Albumin show consistency between studies. We changed the introduction of the manuscript accordingly, and cite Rod et al.

Line 68 – 69: The following sentence was not fully clear to me “Turn-around-time is short to obtain automated biochemical parameters 70 measures (<2h)”. I would suggest to double check English and the connectors between sentences in the last paragraph of the introduction. The authors seem to follow the convention of writing the aim of the research at the end of the introduction. However, the last sentence sound more like an action/task that belongs to the methods section and it does not appear to me to be written as an aim.

We agree with the reviewer’s comment, and we now limited the last sentence of the introduction to the aim of the study, which was to identify biochemical parameters useful to establish a COVID-19 severity score.

Line 122-123: It is not fully clear what “referring” to odds ratios means. Additionally, odds ratios are a different mathematical construct than probability ratios (which are commonly called risk ratios under an epidemiological and the quantitative notions of risk). Generally in epidemiology both odds ratios and risk ratios are called measures of association between variables, it might be worthwhile to consider the use the term “measures of association”. This would likely make a value free statement in the results section and leave value judgements about risk for the discussion and the conclusion.

Table 1: There is a risk that the use of odds ratios overestimates relative risks when the rare disease assumption (prevalence less than 10%) is not present. This seems to happen for most comorbidities in Table 1. This could mean that the presented odds estimates might be overestimated. If the interest is risk, why use logistic regression instead of other generalized linear models (e.g. log binomial model) that offer relative risk as the output and not odds ratios?.

The reviewer is right to underline that according to the mathematical calculation of odd ratios, there is a risk of overestimation of the studied effects. We originally provided these data as supplementary data, because odd ratios are commonly provided in such studies. However, we did not determine the score based on these results and propose to withdraw supplemental Table S2 as the part in text referring to this Table and odd ratios.

Line 300 – What machine learning model? I could not find any machine learning model in the methods section.

It is specified in the M&M and in the result sections: we used a stepwise model selection by Akaike Information Criterion.

Should there be a table comparing existing predictors against the proposed model?

We did compare the best single predictors, found by others over the literature, with the proposed score by building ROC and calculating AUROC (Figure S3). There are no published ‘”existing single predictors”. In addition, as mentioned in the discussion we compared our score to the “CALL” score.

I think the discussion should be supplemented with discussions of other papers that are addressing the topic. Eg.

All the mentioned studies are now cited in the discussion.

There should be a discussion regarding the external validity of the score beyond the used sample sizes in the particular populations that were used to propose and validate. Why should other clinicians in Europe/ developed nations expect similar results?. What about developing nations?.

We provide this in the conclusion.

Lines 359 – 361: Rod et al. 2020 review of early studies coming from china looking at risk factors for a composite index of severe-fatal the COVID-19 disease propose albumin as one of the most consistent risk factors for severe-fatal COVID-19. Based on this information, it is hard to understand how the present paper is “repositioning” albumin as a standard of care of any COVID-19 disease patient admitted to urgent care. Please be more specific what is the contribution that the present paper is adding to the literature in regards albumin levels. The conclusion needs a lot of work. I found hard to find the logic between the aim being to propose, validate and promote the use of a score by using an app and to conclude that the paper has reposition albumin as an important risk factor (which is not accurate based on the above-mentioned rationale). What future research directions does the current state of development of this score lead researchers to?

We agree with the reviewer that mentioning albumin at this stage of the manuscript was not appropriate. The sentence regarding albumin is now removed. We just kept the discussion part about albumin in the discussion section.

We thank the reviewer for suggesting to open the study to future directions. We now provide a conclusion in the context of the disease evolution with the new variants.

Attachment

Submitted filename: Point by point reply-PlosOne.docx

Decision Letter 1

Chiara Lazzeri

19 Apr 2021

Covichem: a biochemical severity risk score of COVID-19 upon hospital admission

PONE-D-20-38092R1

Dear Dr. Dabernat,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Chiara Lazzeri

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Chiara Lazzeri

27 Apr 2021

PONE-D-20-38092R1

Covichem: a biochemical severity risk score of COVID-19 upon hospital admission

Dear Dr. Dabernat:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Chiara Lazzeri

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Flow chart of participants and distribution of COVID-19 severity in the discovery cohort (A) and in the external validation cohort (B).

    (TIF)

    S2 Fig. Density plots representation of continuous variables distribution between non severe and severe COVID-19 patients.

    ALP, Alkaline Phosphatase, AST, Aspartate Aminotransferase; ALT, Alanine Aminotransferase; BMI, Body Mass Index; CK; Creatine Kinase; CRP, C-reactive protein; LDH, Lactate Dehydrogenase.

    (TIF)

    S3 Fig. Comparison of Receiver Operating Characteristic curves for clinical and biological variables in predicting COVID-19 severity.

    The areas under Receiver Operating Characteristic curves (AUROC) are indicated for each variable on the graph legend. BMI, Body Mass Index; LDH, Lactate Dehydrogenase.

    (TIF)

    S4 Fig. Confusion matrix and performance of Albumin level in predicting COVID-19 severity.

    Grey squares correspond to true positive and true negative values, spotted grey squares represent false positive and false negative values. Predictions were calculated for a cut-off of albumin at 26.95 g/L. NPV, Negative Predictive Value; PPV, Positive Predictive Value.

    (TIF)

    S1 Table. Pearson’s correlation coefficients for each variable with COVID-19 severity.

    ALP, Alkaline Phosphatase; ALT, Alanine Aminotransferase; AST, Aspartate Aminotransferase; BMI, Body Mass Index; CK, Creatine Kinase; CRP, C-reactive protein; LDH, Lactate Dehydrogenase.

    (PDF)

    S2 Table. Baseline characteristics of the training, test and external validation sets.

    Continuous variables are expressed as median (25th, 75th percentile). Discrete variables are presented as absolute (relative) frequencies of patients. ALP, Alkaline Phosphatase; ALT, Alanine Aminotransferase; BMI, Body Mass Index; CK, Creatine Kinase; CRP, C-reactive protein; AST, Aspartate Aminotransferase; Ct, Cycle threshold; LDH, Lactate Dehydrogenase; NA, not available.

    (PDF)

    S1 File

    (XLSX)

    Attachment

    Submitted filename: Point by point reply-PlosOne.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES