Abstract
The COVID-19 outbreak has brought great challenges to healthcare resources around the world. Patients with COVID-19 exhibit a broad spectrum of clinical characteristics. In this study, the Factor Analysis of Mixed Data (FAMD)-based cluster analysis was applied to demographic information, laboratory indicators at the time of admission, and symptoms presented before admission. Three COVID-19 clusters with distinct clinical features were identified by FAMD-based cluster analysis. The FAMD-based cluster analysis results indicated that the symptoms of COVID-19 were roughly consistent with the laboratory findings of COVID-19 patients. Furthermore, symptoms for mild patients were atypical. Different hospital stay durations and survival differences among the three clusters were also found, and the more severe the clinical characteristics were, the worse the prognosis. Our aims were to describe COVID-19 clusters with different clinical characteristics, and a classifier model according to the results of FAMD-based cluster analysis was constructed to help provide better individualized treatments for numerous COVID-19 patients in the future.
Keywords: COVID-19, cluster analysis, factor analysis of mixed data, symptoms, laboratory findings, support vector machine
Introduction
Over the last year, severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has spread all over the world, and it has been concluded that long-term coexistence of humans and the virus is inevitable in the future (1). As a respiratory tract infection disease, coronavirus disease 2019 (COVID-19) usually presents with common symptoms, such as fever, tiredness, headache, cough, and sore throat (2). However, the clinical presentations and disease severity of COVID-19 patients may vary widely. For example, some individuals are asymptomatic, whereas others may develop to life-threatening acute respiratory failure. Although mainly spread via droplets and aerosols, a few SARS-CoV-2-infected individuals show digestive tract symptoms including diarrhea, abdominal pain, nausea, and vomiting, which could be caused by SARS-CoV-2 infection of the digestive tract system or triggered by therapeutic drugs, liver function injury and mental factors (3–6). In addition to specific symptoms, many publications have revealed that the disease severity and prognosis can be predicted by lymphocytes, D-dimer, C-reactive protein (CRP), and other laboratory indicators (7–10).
Previously, the clinical classifications of COVID-19 were mainly based on clinical indexes and radiological manifestations (11, 12). However, the potential relationship among disease severity, syndromes and laboratory tests was barely considered in those classifications. Therefore, it is necessary and meaningful to consider those relationships comprehensively and identify the subtypes of COVID-19.
Our study aimed to identify the subtypes of COVID-19 by using an unsupervised classifier. Factor analysis of mixed data (FAMD)-based cluster analysis was used to identify COVID-19 subtypes based on clinical symptoms, laboratory tests and demographic characteristics (13). Three COVID-19 subtypes were identified in our study, and the differences among the COVID-19 subtypes would contribute to our understanding of COVID-19 clinical characteristics. Moreover, subtypes with different clinical characteristics in this study showed different prognoses. Given this, a support vector machine (SVM)-based classifier was trained to recognize different COVID-19 subgroups. We believe that this classifier model could assist clinicians in rapidly identifying individuals with more severe and worse prognoses according to their symptoms and laboratory findings.
Materials and Methods
Participants
Inpatient COVID-19 patients from January 21, 2020 to March 9, 2020 were initially recruited, and their medical history and laboratory findings were collected from Tongji Hospital of Tongji Medical College of Huazhong University of Science and Technology. Ethics approval was obtained by the ethics committee of Tongji Hospital of Tongji Medical College of Huazhong University of Science and Technology, and the approval reference number is TJ-IRB20200365. An exemption was granted obtaining written informed consent from the subjects. The present study design is depicted in Figure 1.
Data Extraction
We selected the above mentioned 1,413 COVID-19 patients with positive COVID-19 nucleic acid or antibodies for this study, which were tested either before admission or during admission. Patients with incomplete medical records were excluded, and the remaining individuals' admission records were analyzed and collected by two clinicians independently to determine their age, sex, and symptoms because of the unstructured nature of the medical records. Simultaneously, laboratory data within 48 h after admission, including routine blood tests, blood biochemistry, coagulation function and other laboratory indicators, were also screened. However, laboratory tests performed at the time of patient admission to the hospital are not always the same but depend on the severity of each patient condition. Nevertheless, some tests such as routine blood tests, were analyzed for almost all patients within 48 h, but other tests such as interleukin tests, were performed only for severely ill patients. Consequently, we balanced the selection of patients and laboratory indicators to ensure that as many patients and indicators were included in the study as possible. For this purpose, we examined the missing rate of each laboratory indicator (Supplementary Figures 1, 2). Finally, only tests with more than 90% completeness rates were selected for further analysis, and COVID-19 patient with missing laboratory were also excluded. Symptoms, laboratory indicators, age, sex, were finally collected and analyzed in our study (Tables 1–3). Total hospital days and outcomes were also collected to compare in-hospital survival rate, which was also the endpoint of this study (Table 1).
Table 1.
Characteristics | Median (IQR) | |
---|---|---|
Age (years) | 63.20 (52.00–70.33) | |
Sex | Female | 525 (50.72%) |
Male | 510 (49.28%) | |
Hospitalization days (days) | 21.00 (14.00–31.00) | |
Outcomes | Dead | 61 (5.89%) |
Alive | 974 (94.1%) |
Continuous variables are presented as median (interquartile ranges), while categorical variables as counts and percentages (%).
Table 3.
Symptoms | n = 1,035 (%) |
---|---|
Fever | 797 (77.00%) |
Chills | 196 (18.94%) |
Inappetence | 301 (29.08%) |
Fatigue | 334 (32.27%) |
Myalgia | 171 (16.52%) |
Headache | 79 (7.63%) |
Palpitations | 47 (4.54%) |
Night sweat | 40 (3.86%) |
Dizziness | 50 (4.83%) |
Cough | 774 (74.78%) |
Nasal obstruction or runny nose | 28 (2.70%) |
Sore throat | 63 (6.09%) |
Dyspnea | 361 (34.88%) |
Diarrhea | 245 (23.67%) |
Abdominal pain | 20 (1.93%) |
Nausea | 108 (10.43%) |
Vomiting | 56 (5.41%) |
Categorical variables are presented as counts and percentages (%).
Table 2.
Laboratory tests | Median (IQR) | Reference intervals |
---|---|---|
ALT (U/L) | 23.00 (15.00–40.00) | ≤ 41 |
AST (U/L) | 24.00 (18.00–36.00) | ≤ 40 |
γ-GT (U/L) | 29.00 (18.00–52.00) | 10–71 |
Albumin (g/L) | 36.10 (32.40–39.90) | 35–52 |
Globulin (g/L) | 31.80 (28.50–35.60) | 20–35 |
Total protein (g/L) | 68.30 (64.90–72.00) | 64–83 |
Creatinine (μmol/L) | 68.00 (57.00–83.00) | 59–104 |
Urea (mmol/L) | 4.40 (3.50–5.70) | 3.1–8.0 |
Uric acid (μmol/L) | 262.10 (208.00–324.40) | 202.3–416.5 |
Total cholesterol (mmol/L) | 3.82 (3.23–4.48) | <5.18 |
Blood glucose (mmol/L) | 5.80 (5.11–7.31) | 4.11–6.05 |
LDH (U/L) | 249.00 (200.00–316.00) | 135–225 |
ALP (U/L) | 67.00 (55.00–81.00) | 40–130 |
WBC count (× 109/L) | 5.78 (4.63–7.26) | 3.50–9.50 |
RBC count (× 1012/L) | 4.09 (3.69–4.47) | 4.30–5.80 |
Lymphocyte rate (%) | 22.40 (14.60–30.50) | 20–50 |
Lymphocyte count (× 109/L) | 1.24 (0.85–1.65) | 1.10–3.20 |
Monocyte rate (%) | 8.50 (6.80–10.30) | 3.0–10.0 |
Monocyte count (× 109/L) | 0.49 (0.37–0.64) | 0.10–0.60 |
Neutrophil rate (%) | 66.30 (57.30–75.70) | 40.0–75.0 |
Neutrophil count (× 109/L) | 3.72 (2.74–5.23) | 1.80–6.30 |
Eosinophil rate (%) | 1.00 (0.20–2.00) | 0.4–0.8 |
Eosinophil count (× 109/L) | 0.06 (0.01–0.12) | 0.02–0.52 |
Basophil rate (%) | 0.20 (0.10–0.40) | 0.0–1.0 |
Basophil count (× 109/L) | 0.01 (0.01–0.03) | 0.00–0.10 |
Hematocrit (%) | 36.60 (33.30–39.40) | 40.0–50.0 |
Hemoglobin (g/L) | 126.00 (115.00–136.00) | 130.0–175.0 |
Platelet (× 109/L) | 237.00 (180.00–309.50) | 125.0–350.0 |
D-dimer (μg/ml FEU) | 0.67 (0.34–1.48) | <0.5 |
PTA (%) | 93.00 (86.00–101.00) | 75.0–125.0 |
PT (s) | 13.70 (13.10–14.20) | 11.5–14.5 |
INR | 1.05 (0.99–1.10) | 0.80–1.20 |
CRP (mg/L) | 10.20 (1.90–49.50) | <1 |
eGFR (ml/min/1.73 m2) | 92.60 (78.80–102.50) | >90 |
ALT, alanine transaminase; AST, aspartate transaminase; γ-GT, gamma-glutamyl transferase; LDH, lactic dehydrogenase; ALP, alkaline phosphatase; WBC, white blood cell; RBC, red blood cell; PTA, prothrombin time activity; PT, prothrombin time; INR, international normalized ratio; CRP, C-reactive protein; eGFR, estimated glomerular filtration rate. The reference intervals of laboratory tests were aligned with those used by the laboratory of Tongji Hospital. Continuous variables are presented as median (interquartile ranges).
Identification of COVID-19 Clusters
Both many studies and clinical experience indicate potential links between different laboratory indicators and symptoms among COVID-19 patients. There are also correlations between some laboratory tests, for example, lymphocyte count, and percentage of lymphocytes. Thus, factor analysis of mixed data (FAMD), a principal component method dedicated to analyzing a data set containing both quantitative and qualitative variables, was used to deconstruct the original complex data into fewer relevant factors. FAMD was performed using the R package FactoMineR (https://cran.r-project.org/package=FactoMineR), and the factoextra package (https://cran.r-project.org/package=factoextra) was used to extract the FAMD results. The first 24 dimensions were selected and retained for further cluster analysis, as these explained >80% of the total variance.
Cluster analysis is one of the most popular unsupervised learning methods to identify subgroups sharing similar characteristics, with no predefined information necessary. Agglomerative hierarchical cluster analysis of COVID-19 patients based on the FAMD-transformed matrix was performed according to the Ward criterion, which could minimize the total intracluster variance. Function dist() and function hclust() from the R package base were used for the cluster analysis. The R packages ggtree (https://cran.r-project.org/package=ggtree) and ape (https://cran.r-project.org/package=ape) were used to visualize the cluster analysis result, and the last several steps of cluster analysis were shown as a dendrogram, which was constructed by the R packages ggraph (https://cran.r-project.org/package=ggraph) and tidygraph (https://cran.r-project.org/package=tidygraph) (14–16). The R package NbClust was used to evaluate the range of the number of COVID-19 patients (17).
Difference in Prognosis Among COVID-19 Clusters
Considering significantly different characteristics in different COVID-19 clusters, we assume that they have distinct prognoses. Thus, the prognoses of COVID-19 patients were recorded as the hospitalization days and outcomes. Patient outcomes were followed up until discharge from the hospital or death. Total hospital days were compared, survival analysis was performed using the R package survival (https://cran.r-project.org/package=survival), and Kaplan-Meier survival curves were plotted by the R package survminer (https://cran.r-project.org/package=survminer) (18).
Statistical Analysis
Statistical analyses were conducted in R (R version 3.6.0). Continuous data are expressed as medians (interquartile range), and the rate is expressed as counts (percentages). Normal distribution and homogeneous variance were tested for all data. Normal distribution test was performed by Shapiro–Wilk test via function shapiro.test() in R, and homogeneity of variance test was performed by Bartlett's Test via function bartlett.test() in R. Differences in characteristics between the clusters were assessed using analysis of variance for continuous normally distributed and homogeneous variance values, and the nonparametric Kruskal–Wallis test with Dunn's posttest for continuous nonnormally distributed and/or inhomogeneous variances values using the R package FSA (https://cran.r-project.org/package=FSA). The difference between rates was tested by χ2 test or Fisher's exact test for categorical variables. Survival curves were compared by log-rank analysis. The Benjamini–Hochberg procedure was used for multiple comparison correlation. A p < 0.05 was considered statistically significant. Box plots and radar charts were compiled using the R packages ggpubr (https://cran.r-project.org/package=ggpubr) and fmsb (https://cran.r-project.org/package=fmsb), respectively.
Construction of the Classifier Model to Forecast COVID-19 Clusters
SVM is a popular supervised learning method that constructs hyperplanes in a high-dimensional space to separate training data into different classes and is often used for classification. In our study, an SVM classifier model of COVID-19 clusters were constructed by the R package e1071 (https://cran.r-project.org/package=e1071). Indicators of the COVID-19 patients on admission, including their clinical symptoms and laboratory tests, with statistically significant differences among the three clusters, were chosen as the predictor variables, and the response variable was the FAMD-based clustering results.
All 1,035 patients were randomly divided into 70% training and 30% test datasets. We implemented a grid search and 10-fold cross validation for tuning and validating the prediction model on the training dataset. Then the model with optimal parameters were tested on the test dataset. Kappa statistic was calculated using the R package caret (https://CRAN.R-project.org/package=caret) and used to evaluate the performance of SVM model with different kernel and parameters. A receiver operating characteristic (ROC) curve was constructed, and the ROC areas under the curve (AUCs) were calculated using the R package pROC (https://cran.r-project.org/package=pROC) (19).
To test the performance of model in the case of missing data, all patients were divided into 50% training and 50% missing test dataset. About 1–10% laboratory data in the missing dataset was removed randomly using the R package simFrame (https://cran.r-project.org/package=simFrame) (20), and missing data were imputed by k-nearest neighbor (KNN) method using the R package DMwR2 (https://cran.r-project.org/package=DMwR2). The SVM model was firstly trained on the 50% training dataset and then tested on the 50% missing dataset. Tests were repeated 50 times with the same missing rate.
Results
Demographic, Clinical, and Laboratory Characteristics of 1,035 COVID-19 Patients
A total of 1,413 COVID-19 positive patients were primarily enrolled to the study. The heat map of missing laboratory tests analysis was illustrated in Supplementary Figure 1, and the completeness rates of laboratory tests were illustrated in Supplementary Figure 2. Only the laboratory tests with more than 90% completeness were kept for the next analysis. In addition, to ensure the accuracy of the study, only patients with all more than 90% completeness laboratory tests were retained. After the screening process, 1,035 patients and 34 laboratory indicators remained. Then we collected age, sex, syndromes, and laboratory findings from 1,035 COVID-19 patients. Women made up 50.72%, and the median age of the group was 63.20 (52.00–70.33). The most common clinical symptom was fever (77.00%), followed by cough (74.78%), dyspnea (34.88%), fatigue (32.27%), and inappetence (29.08%). Lactate dehydrogenase (LDH), albumin, blood glucose, red blood cell (RBC) count, lymphocyte count, percentage of lymphocytes, percentage of eosinophils, hemoglobin, hematocrit, estimated glomerular filtration rate (eGFR), CRP, and D-dimer were clearly abnormal in all 1,035 individuals.
FAMD-Based Cluster Analysis
FAMD was applied to the original matrix, which consisted of age, sex, 17 symptoms and 34 laboratory indicators of the 1,035 COVID-19 patients, and 53 dimensions were obtained (Supplementary Table 1). Variances of 53 dimensions decreased gradually, and variances of the top 24 dimensions accounted for more than 80% of the total variance. Thus, the top 24 dimensions were retained for further analysis. Subsequently, unsupervised hierarchical cluster analysis was performed with the matrix made with the top 24 dimensions values of 1,035 individuals. A dendrogram (Figure 2A) showed the last five steps of cluster analysis.
Agglomerative hierarchical cluster analysis had a bottom-up approach, and all subjects were clustered into a single cluster at last, so it had to decide when to stop clustering. If the number of clusters was too small, the clinical features of COVID-19 patients would be more homogeneous, and it could not well-reveal the clinical pattern of COVID-19. Conversely, the COVID-19 patterns represented by multiple clusters were unintelligible and difficult to understand. Therefore, it was crucial to determine how many clusters to use. We first evaluated the range of the number of clusters by the R package NbClust using 26 algorithms. Six, four, and six algorithms supposed that the best cluster numbers were 2, 3, and 4, respectively (Figure 2B), which indicated that the range of best cluster number was 2–4.
Then, we examined the differences in laboratory tests among different clusters under the conditions of dividing them into 2, 3, and 4 clusters separately. All laboratory test values under the conditions of dividing them into 2, 3, and 4 clusters did not meet normal distribution and homogeneity of variance, so the nonparametric Kruskal–Wallis test with Dunn's posttest was used for multiple comparison analysis (Supplementary Tables 2–5). We found that when the individuals were divided into two clusters, it was not hard to observe that almost all indexes of patients in Cluster A were more severe than those in patients of Cluster B (Supplementary Figure 3). When the COVID-19 individuals were divided into four clusters, the levels of CRP, D-dimer, PT, and the percentage of lymphocytes, which have been reported as crucial disease severity indexes, had no differences between Cluster D and the other three clusters (Supplementary Figure 4). In contrast, the above crucial indicators can be distinguished well when divided into three clusters (Figures 3, 4). Thus, it is natural to suppose that the severity of COVID-19 patients in Cluster D had no significant difference, which indicated that this clustering scheme might just be in accordance with the characteristics of the data itself instead of the clinical phenotypes of COVID-19. Accordingly, we thought that dividing into three clusters was the best clustering scheme, and the 1,035 COVID-19 patients were divided into three clusters in the following analysis (Figure 2C).
Demographic, Symptoms, and Laboratory Characteristics in Different COVID-19 Clusters
The demographic characteristics of the three clusters are presented in Table 4. Surprisingly, there was no difference in age or sex among the clusters. The laboratory indicators and syndrome characteristics of the three clusters are shown in Tables 5, 6. Most laboratory findings and syndromes differed among the clusters, and the differences in laboratory indicators and syndromes among the three clusters can be seen intuitively from box plots (Figures 3, 4) and radar charts (Figure 5). Overall, the patients in Cluster A presented with the most severe conditions at the time of admission, and patients in Cluster C were the mildest. In contrast, the conditions of individuals in Cluster B were in between these two.
Table 4.
Characteristics | Cluster A (n = 332) | Cluster B (n = 554) | Cluster C (n = 149) | p-value | |
---|---|---|---|---|---|
Age (years) | 63.28 (51.95– 71.15) | 63.23 (51.62–69.67) | 62.86 (54.18–70.98) | 0.81651 | |
Sex | Female | 165 | 289 | 71 | 0.55872 |
Male | 167 | 265 | 78 | ||
Hospitalization days (days) | 23.00 (14.00–35.25) | 22.00 (14.00–32.00) | 19.00 (11.00–24.00) | <0.00001 | |
Outcomes | Dead | 33 | 25 | 3 | 0.00052 |
Alive | 299 | 529 | 146 |
Continuous variables are presented as median (interquartile ranges), and Kruskal–Wallis test was applied for continuous variables. Categorical variables are expressed as counts and percentages (%), and the χ2 test or Fisher's exact test were applied for categorical variables.
Table 5.
Laboratory tests | Cluster A (n = 332) | Cluster B (n = 554) | Cluster C (n = 149) | p-value |
---|---|---|---|---|
ALT (U/L) | 25.00 (15.00–44.25) | 22.00 (14.00–38.00) | 22.00 (14.00–35.00) | 0.00294 |
AST (U/L) | 28.00 (19.00–41.25) | 24.00 (18.00–34.75) | 21.00 (16.00–28.00) | <0.00001 |
γ-GT (U/L) | 35.00 (19.00–69.00) | 28.00 (18.00–46.00) | 26.00 (17.00–43.00) | 0.00002 |
Albumin (g/L) | 35.05 (31.00–39.40) | 36.20 (32.83–39.78) | 37.50 (34.40–41.30) | 0.00010 |
Globulin (g/L) | 32.60 (28.90–36.30) | 31.90 (28.53–35.65) | 30.00 (27.40–33.30) | 0.00006 |
Total protein (g/L) | 67.90 (64.85–71.73) | 68.70 (64.90–72.30) | 68.50 (64.90–71.50) | 0.44564 |
Creatinine (μmol/L) | 72.00 (58.00–87.25) | 66.00 (56.00–80.00) | 70.00 (58.00–83.00) | 0.00361 |
Urea (mmol/L) | 4.70 (3.50–6.23) | 4.30 (3.40–5.50) | 4.60 (3.80–5.60) | 0.01137 |
Uric acid (μmol/L) | 264.20 (207.53–322.53) | 255.65 (200.95–315.00) | 282.00 (226.70–340.00) | 0.00556 |
Total cholesterol (mmol/L) | 3.77 (3.09–4.31) | 3.82 (3.23–4.50) | 3.94 (3.44–4.65) | 0.00162 |
Blood glucose (mmol/L) | 5.81 (5.22–7.65) | 5.89 (5.14–7.24) | 5.34 (4.88–6.33) | 0.00011 |
LDH (U/L) | 281.00 (207.00–366.25) | 247.00 (201.25–305.75) | 220.00 (183.00–276.00) | <0.00001 |
ALP (U/L) | 69.00 (59.00–89.25) | 65.00 (53.25–78.00) | 67.00 (55.00–79.00) | 0.00017 |
WBC count (× 109/L) | 5.98 (4.77–8.35) | 5.71 (4.49–7.02) | 5.72 (4.83–6.81) | 0.00722 |
RBC count (× 1012/L) | 4.11 (3.64–4.47) | 4.07 (3.70–4.46) | 4.11 (3.73–4.47) | 0.86039 |
Lymphocyte rate (%) | 20.65 (11.48–29.10) | 23.05 (15.20–30.90) | 24.70 (18.70–31.90) | 0.00023 |
Lymphocyte count (× 109/L) | 1.16 (0.73–1.60) | 1.25 (0.87–1.67) | 1.36 (1.03–1.69) | 0.00316 |
Monocyte rate (%) | 8.30 (6.30–10.10) | 8.70 (7.03–10.60) | 8.40 (7.00–10.00) | 0.03766 |
Monocyte count (× 109/L) | 0.49 (0.37–0.65) | 0.48 (0.37–0.64) | 0.50 (0.38–0.60) | 0.80982 |
Neutrophil rate (%) | 68.40 (57.68–80.53) | 65.95 (56.83–74.90) | 63.80 (57.60–71.90) | 0.00332 |
Neutrophil count (× 109/L) | 3.98 (2.80–5.87) | 3.55 (2.65–4.99) | 3.68 (2.90–4.60) | 0.00318 |
Eosinophil rate (%) | 0.90 (0.10–2.00) | 1.10 (0.20–1.90) | 1.20 (0.50–2.40) | 0.03027 |
Eosinophil count (× 109/L) | 0.05 (0.01–0.11) | 0.06 (0.01–0.11) | 0.07 (0.03–0.13) | 0.05311 |
Basophil rate (%) | 0.20 (0.10–0.40) | 0.20 (0.20–0.40) | 0.40 (0.20–0.50) | 0.00175 |
Basophil count (× 109/L) | 0.01 (0.01–0.02) | 0.01 (0.01–0.02) | 0.02 (0.01–0.03) | 0.01233 |
Hematocrit (%) | 36.60 (32.60–39.43) | 36.45 (33.40–39.30) | 36.90 (33.60–39.30) | 0.61877 |
Hemoglobin (g/L) | 126.00 (113.00–136.00) | 125.00 (115.00–136.00) | 127.00 (115.00–137.00) | 0.89523 |
Platelet (× 109/L) | 239.50 (179.00–301.00) | 235.00 (180.25–314.00) | 235.00 (182.00–304.00) | 0.94041 |
D-dimer (μg/ml FEU) | 0.86 (0.37–1.95) | 0.63 (0.33–1.33) | 0.52 (0.29–1.25) | 0.00008 |
PTA (%) | 91.00 (85.00–99.00) | 93.00 (87.00–102.00) | 95.00 (87.00–104.00) | 0.00179 |
PT (s) | 13.80 (13.20–14.40) | 13.60 (13.10–14.10) | 13.50 (13.00–14.10) | 0.00096 |
INR | 1.06 (1.00–1.11) | 1.04 (0.99–1.09) | 1.03 (0.97–1.09) | 0.00133 |
CRP (mg/L) | 18.05 (2.28–68.88) | 10.25 (2.10–45.70) | 4.30 (1.00–16.90) | <0.00001 |
eGFR (ml/min/1.73 m2) | 90.4 (75.45–102.20) | 93.35 (81.83–103.05) | 92.60 (79.20–102.00) | 0.04890 |
ALT, alanine transaminase; AST, aspartate transaminase; γ-GT, gamma-glutamyl transferase; LDH, lactic dehydrogenase; ALP, alkaline phosphatase; WBC, white blood cell; RBC, red blood cell; PTA, prothrombin time activity; PT, prothrombin time; INR, international normalized ratio; CRP, C-reactive protein; eGFR, estimated glomerular filtration rate. Laboratory tests are presented as median (interquartile ranges). Comparisons were performed using the Kruskal–Wallis test.
Table 6.
Symptoms | Cluster A (%) (n = 332) | Cluster B (%) (n = 554) | Cluster C (%) (n = 149) | p-value |
---|---|---|---|---|
Fever | 281 (84.64%) | 418 (75.45%) | 98 (65.77%) | 0.00001 |
Chills | 71 (21.39%) | 108 (19.49%) | 17 (11.40%) | 0.02649 |
Inappetence | 122 (36.75%) | 146 (26.35%) | 33 (22.15%) | 0.00067 |
Fatigue | 147 (44.28%) | 159 (28.70%) | 28 (18.79%) | <0.00001 |
Myalgia | 80 (24.10%) | 81 (14.62%) | 10 (6.71%) | <0.00001 |
Headache | 43 (12.95%) | 34 (6.14%) | 2 (1.34%) | <0.00001 |
Palpitations | 47 (14.16%) | 0 (0.00%) | 0 (0.00%) | <0.00001 |
Night sweat | 39 (11.75%) | 1 (0.18%) | 0 (0.00%) | <0.00001 |
Dizziness | 49 (14.76%) | 1 (0.18%) | 0 (0.00%) | <0.00001 |
Cough | 249 (75.00%) | 521 (94.04%) | 4 (2.68%) | <0.00001 |
Nasal obstruction or runny nose | 28 (8.43%) | 0 (0.00%) | 0 (0.00%) | <0.00001 |
Sore throat | 61 (18.37%) | 2 (0.36%) | 0 (0.00%) | <0.00001 |
Dyspnea | 117 (35.24%) | 208 (37.55%) | 36 (24.16%) | 0.00832 |
Diarrhea | 86 (25.90%) | 140 (25.27%) | 19 (12.75%) | 0.00188 |
Abdominal pain | 20 (6.02%) | 0 (0.00%) | 0 (0.00%) | <0.00001 |
Nausea | 69 (20.78%) | 38 (6.86%) | 1 (0.67%) | <0.00001 |
Vomiting | 53 (15.96%) | 3 (5.42%) | 0 (0.00%) | <0.00001 |
Symptoms are presented as counts and percentages (%). Comparisons were performed using the χ2 test or Fisher's exact test.
A total of 332 patients were included in Cluster A. Almost all laboratory indicators and symptoms were worst in Cluster A. In terms of blood biochemistry tests, patients in Cluster A presented the highest levels of alanine transaminase (ALT), aspartate transaminase (AST), gamma-glutamyl transferase (γ-GT), LDH, alkaline phosphatase (ALP), total cholesterol, blood glucose, and albumin and the lowest level of globin. Additionally, their median eGFR was abnormally low and the level of creatinine was high in Cluster A. In routine blood tests, Cluster A showed higher white blood cell (WBC) counts, neutrophil counts, percentage of neutrophils, and lower levels of lymphocyte counts and percentage of lymphocytes than the other two clusters. Moreover, the levels of eosinophil and basophils were also lowest in Cluster A individuals. Regarding coagulation function, Cluster A patients exhibited higher levels of D-dimer, prothrombin time (PT), and international normalized ratio (INR) and lower levels of prothrombin time activity (PTA). Finally, the highest level of CRP was also observed in Cluster A, and the median CRP was up to 18.05 mg/L.
The frequencies of many systemic and neurological symptoms in Cluster A patients, including fever, chills, fatigue, myalgia, headache, palpitation, night sweat, and dizziness, were highest among the three clusters. For respiratory symptoms and digestive tract symptoms, the frequencies of nasal obstruction or runny nose, sore throat, dyspnea, diarrhea, abdominal pain, nasal obstruction or runny nose, vomiting and anorexia were also at the top level among the three clusters. Although the frequency of cough was the second highest among the clusters, three-quarters of individuals in Cluster A had cough before their hospitalization. Therefore, Cluster A could also be designated as a severe cluster.
Cluster B was the largest cluster in this study, and almost all of their laboratory indicators and frequencies of symptoms seem to be intermediate between Clusters A and C; however, the frequency of cough was an exception. The most prominent symptom in Cluster B was a cough, which was reported in almost all individuals in Cluster B. In addition to a cough, patients in Cluster B showed moderate frequencies of fever, fatigue, myalgia, headache and nausea. The frequencies of chills, dyspnea and diarrhea in Cluster B were as high as those in Cluster A; however, the frequencies of palpitation, night sweat, dizziness, nasal obstruction or runny nose, sore throat, abdominal pain, vomiting, and anorexia in Cluster B were uniformly low relative to those in Cluster C. Notably, the frequencies of palpitation, night sweat, dizziness, nasal obstruction or runny nose, sore throat, abdominal pain, nausea, and vomiting in Clusters B and C were very close to 0%.
Cluster C, with 149 individuals, had the lowest number of COVID-19 patients and the lowest levels of almost all indicators, including CRP and symptoms, among the three clusters. It is worth mentioning that the conditions of individuals in Cluster C were rather mild, not only because of those better indicators but also because of their close to 0% frequencies of palpitations, night sweats, dizziness, nasal obstruction or runny nose, sore throat, abdominal pain, nausea and vomiting, and even coughing. In contrast, the frequencies of fever (65.77%), dyspnea (24.16%), anorexia (22.15%), fatigue (18.79%), diarrhea (12.75%), and chills (11.40%) in Cluster C were relatively high, but they were still not higher than those in Cluster B.
There were statistically significant differences between the two clusters in most laboratory indicators. However, statistically significant differences were observed between two arbitrary clusters only for AST, LDH, albumin, D-dimer and CRP, which implied that only those indicators could well-distinguish the three clusters. Few laboratory indicators, including hemoglobin, hematocrit, platelet count, and monocyte count, did not differ between any two clusters, and those indicators without any differences are not presented in Figures 3, 4.
Clinical Prognosis of Different COVID-19 Clusters
To evaluate outcomes of patients in different clusters, we first compared the length of hospitalization among the three cluster first. We found that the length of hospitalization in Cluster C was lower than that in Clusters A and B (Figure 6A). Subsequently, Kaplan–Meier survival analysis of three clusters classified by FAMD-based hierarchical clustering was performed. The mortalities of the three clusters were 9.94, 4.51, and 2.01%, respectively. Survival rates were statistically assessed by the log-rank test. The results indicated that there were significant differences between Clusters A and B and between Clusters A and C (Figure 6B). As with the length of hospitalization, no difference was observed between Clusters B and C (Figure 6B).
SVM Classifier Model Construction and Parameter Optimization
Using the results of the unsupervised hierarchical clustering, we trained an SVM classifier model to aid clinical judgement. We chose all symptoms and AST, albumin, LDH, lymphocyte count, percentage of lymphocytes, neutrophil count, percentage of eosinophils, eosinophil count, basophil count, D-dimer, PTA, INR, and CRP as predictor variables in the model. Laboratory indicators in the prediction model could well-distinguish three clusters according to the above the nonparametric Kruskal–Wallis test with Dunn's posttest, so they were chosen for the predictor variables.
A grid-search on 10-fold cross validation for parameters was performed to find the best model, and parameters producing the best result were chosen (Supplementary Figure 5). The highest mean total kappa statistic on the training dataset was 0.847, which was predicted by the radial basis function (RBF) kernel (Supplementary Figure 5B). The confusion matrix for the classifier model on the test dataset was shown in Figure 7A, and kappa statistic of the model on the test dataset was 0.848, which suggested that the model was not over-fitted. So the RBF kernel (gamma = 0.01 and cost = 100) was chosen for the final construction of the classifier model. Three ROC curves represented the prediction performances of the three clusters respectively. The AUCs were 0.9704 (95% CI: 0.9483–0.9926), 0.9686 (95% CI: 0.9463–0.9909), and 0.9832 (95% CI: 0.9642–1), respectively (Figures 7B–D). ROC curves and AUCs also indicated the excellent predictive power of FAMD-based cluster analysis results.
Subsequently, we tested the performance of the SVM model in the case of missing data. Mean kappa statistics remained consistently >0.8, and the result indicated that the model could well-cope with up to 10% missing laboratory data imputed by KNN method (Supplementary Figure 6). Data with more than 10% missing rate could not be imputed well by KNN method, so we did not test it with higher missing rate.
There were 17 laboratory tests in the classifier model, which were not hard to get according to reviewing medical records or directly asking patients at their admission. Other thirteen predictor variables were laboratory tests, and six of them (lymphocyte count, percentage of lymphocytes, neutrophil count, eosinophil count, percentage of eosinophils, and basophil count) were belonged to routine blood tests, which is a common and cheap clinical test and easily to get. Additionally, C-reactive protein (CRP), aspartate transaminase (AST), lactic dehydrogenase (LDH), albumin, as well as D-dimer, prothrombin time activity (PTA), and international normalized ratio (INR) were commonly used to evaluate the disease progression. Even though medical institutions could not test part of them, data imputation could well-cope with this point. In short, the model has a broad range of clinical applications, and lots of predictor variables would not restrain it from application. Our classifier model is open-sourced and available at https://github.com/Spider-Rom/Support-Vector-Machine-Based-Classifier-Model-of-COVID-19-patients.
Discussion
Over the past year, a wave of COVID-19 has hit people around the world. In response, a number of correlated studies have been carried out, and our knowledge of COVID-19 has grown rapidly. It has been reported that COVID-19 has a wide spectrum of clinical manifestations, ranging from asymptomatic carrier infection to life-threatening complications (2, 21, 22). The diversity of clinical manifestations of COVID-19 means two different things. On the one hand, the same patient could present mild symptoms shortly after infection, and the clinical manifestations could worsen as the disease progresses. On the other hand, some patients are always in asymptomatic states, but other patients might present with severe conditions. Heterogeneous clinical manifestations of COVID-19 make its diagnosis and a determination of their prognosis challenging. Moreover, a broad spectrum of COVID-19 clinical manifestations and clinical course pose difficulty in the systematic analysis of COVID-19 clinical features. Additionally, it is difficult for clinicians to give comprehensive consideration to the vast amount of information on multiple symptoms and laboratory findings, especially when patients have a less severe condition. Furthermore, the classifications of COVID-19 in past studies were often based on a few key laboratory findings or on whether complications or adverse events happened rather than based on the clinical manifestations, which would be unfavorable to systematic and comprehensive research on COVID-19.
On account of these points, FAMD-based clustering hierarchical analysis, an unsupervised machine learning method, was performed on the clinical information at the time of admission of 1,035 COVID-19 patients. The cluster analysis results in the identification of three distinct clusters: Cluster A, most severe syndromes and laboratory findings, longest hospital stays; Cluster B, intermediate severe syndromes and laboratory findings, equally long length of hospital stay with Cluster A; Cluster C, mildest clinical syndromes and laboratory findings, shortest length of hospital stays among the three clusters. Survival analysis showed that the worst survival of COVID-19 patients in Cluster A. There were no contradictions in the three clusters among laboratory findings, symptoms, and prognosis, which was also consistent with our experience in clinical practice. It is easy to see that Cluster B had the greatest number of individuals, and Cluster C had the smallest number of individuals. However, the proportion of people in each cluster could not well-reflect the proportion of each cluster within all COVID-19 patients and partly because not all infected peoples would visit hospitals.
It is not easy to follow detailed clinical features of each cluster because of too many laboratory findings and symptoms were analyzed. Overall, Cluster A had the most severe symptoms and laboratory findings among the three clusters, so Cluster A should be characterized as the “severe” cluster. Patients in Cluster B had higher levels of CRP, D-dimer, AST, and LDH, indicating more severe clinical phenotypes. However, it is interesting that Clusters B and C had significantly different frequencies of respiratory symptoms and digestive symptoms. There were higher frequencies of respiratory symptom such as cough, in Cluster B than those in Cluster C. In contrast, Cluster C almost had no respiratory symptoms. Patients in Cluster C mainly had systemic and digestive symptoms, including fever, fatigue, diarrhea, and inappetence. Remarkably, the clinical manifestations of COVID-19 patients in Cluster C were not typical due to their low frequencies of fever and cough symptoms, which may increase the difficulty of diagnosis (23).
Taken together, Clusters B and C not only represented different severity of COVID-19, but also represented different clinical disease patterns. That is, the Cluster B could be characterized as the “classical” COVID-19 cluster, and Cluster C could be characterized as the “atypical” COVID-19 cluster.
Different laboratory indicators showed different abilities to identify three clusters. LDH, an intracellular enzyme, is present in almost all human cells, and it is released to the extracellular space due to severe infections. Thus, a high level of LDH is associated with injury to the heart, lung, kidney, and other organs (24). Studies have indicated that elevated LDH levels indicate worse outcomes in COVID-19 patients (25). CRP, a well-known marker of inflammation, reflects systemic inflammation and tissue damage. Increased CRP levels are also associated with worse symptoms and worse organ injury among COVID-19 patients (26, 27). Furthermore, AST and D-dimer reflect the level of liver injury and coagulation dysfunction, respectively. These two indicators are also closely relevant to the severity of COVID-19 patients (9, 28, 29). In our study, differences were present in CRP, AST, LDH, and D-dimer between any two clusters, so these four indicators were better to distinguishing the three clusters. Clinicians should pay more attention to these indicators considering their relationship between the indicators and the disease prognosis. In addition to these four indicators, hemocyte-relevant indicators, such as lymphocytes, neutrophils, eosinophils and basophils, are linked to the severity of COVID-19 (7, 30–32). Differences in hemocyte-relevant indicators were also found among the three clusters in our study, although the ability to identify the three clusters of indicators was not as powerful as LDH and CRP. Nevertheless, abnormal hemocyte-relevant indicators of the COVID-19 patients also deserve attention.
Different frequencies of symptoms among the three clusters were also interesting, but difficult to understand. Some symptoms, such as dyspnea and diarrhea, had lower frequencies only in Cluster C; however, some other symptoms, such as sore throat, nasal obstruction or runny nose, vomiting and chills, had higher frequencies only in Cluster A. Elusive differences mean we have insufficient understanding of the disease. From the point of symptoms alone, Cluster B was closer to Cluster C than Cluster A. Contradictorily, almost all individuals in Cluster B had experienced different degrees of cough symptoms, but coughing in Cluster C was rare. Moreover, patients in Cluster C did not present cough symptoms before they were admitted to the hospital, which may indicate that patients in different clusters exhibited distinct immune response patterns when facing SARS-CoV-2 infection. It is worth noting that the three clusters did not differ in age. Therefore, we speculated that there were differences in aspects of viral loads during infection, patients' basal diseases and immune defense abilities and whether patients rested appropriately after infection. Atypical symptoms mean better outcomes; however, they are also barriers to seeking medical attention because it is difficult for the patients themselves to realize they have a viral infection. Thus, it is necessary to regularly screen high-risk individuals by pathogenic tests.
In our study, Cluster C showed the shortest hospitalization time with a median duration of 19 days. The median hospitalization days of patients in Clusters A and B was increased by 3–4 days, which means that those patients found it more difficult to recover. However, hospitalization days in our study are longer than other studies (33). Even if in Cluster C, COVID-19 patients exhibited 19 days of median length of a hospital stay. That might be associated with insufficient medical resources and inexperienced clinicians during the early COVID-19 epidemic in Wuhan.
Interestingly, there was no statistically significant difference in age or sex among the three clusters. Many studies have identified advanced age as a risk factor for adverse outcomes in COVID-19 patients (34, 35). However, three clusters divided by FAMD-based cluster analysis in our study showed significant differences in laboratory findings, symptoms, and outcomes but no significant difference in age. This might be interpreted as different disease patterns upon hospital admission may depend on the time elapsed from symptoms onset. However, the onset time of most COVID-19 patients in our study was not available. Our study only collected hospitalization days of COVID-19 patients and the time before admission was not included. Thus, it is hard to reveal the relationship between different disease patterns and the time elapsed from symptom onsets. Different lifestyles caused by gender differences may affect COVID-19-related mortality, but no difference was observed in sex among the three clusters (36). This could also be interpreted as minor discrepancy causing weak discriminative power.
We are able to view the clinical characteristics of COVID-19 from a novel perspective with the help of unsupervised learning methods. As previously mentioned, the clinical manifestation of COVID-19 is highly heterogeneous, and it is not appropriate to divide patients into several groups according to a few clinical indexes when exploring clinical characteristics of COVID-19. To obtain comprehensive and meaningful conclusions, we examined the data to ensure that patients enrolled in this study showed different condition severities. FAMD transformation was applied before cluster analysis because FAMD is a dimensionality reduction method similar to principal component analysis (PCA), which is able to handle categorical and continual variables simultaneously. Using FAMD, the dimensionality of the medical information matrix was decreased, and multicollinearity among independent variables, could make cluster analysis more effective (37). Because of the clinical diversity of samples in our study, clusters divided by FAMD-based cluster analysis have important implications for clinical practice. However, the differences among clusters were so complex and elusive that it was difficult to manually annotate the dataset. Given this, we finally constructed an SVM-based classifier model to help with cluster division. Clinicians could easily determine the severity of the illness in COVID-19 patients and propose rough prognoses with the help of the model so that the treatment schemes could be adjusted in a timely manner, especially at the time of disease outbreaks.
However, there were some unavoidable shortcomings of our study. First, some symptoms of COVID-19 patients, such as loss of taste or smell, were not included because they were hardly mentioned in the primary medical records. Second, pulmonary imaging features of COVID-19 patients were also not collected in our study. In addition, some meaningful indexes such as oxygenation index (PaO2/FiO2), blood gas test, and intensive care unit (ICU) length of stay, were not included in the study due to hard data collection. Furthermore, although asymptomatic infected individuals and mild cases individuals were enrolled, the frequencies of moderate and severely ill patients were higher than those in all COVID-19 patients in this single-center study because of selection bias considering that Tongji Hospital is not primary medical institution. Last but not least, the symptoms may not be reliable enough because of unstructured nature of the clinical records, even though we excluded parsimonious and unspecific records before analysis.
In conclusion, FAMD-based cluster analysis, an exploratory unsuspended classification method, was first applied to the clinical information at the time of admission of COVID-19 patients, and three COVID-19 clusters with different symptoms, different laboratory findings and different prognoses were identified. Our study further reveals the relationship among the symptoms, laboratory findings, and prognosis of COVID-19 from a novel perspective. Results from unsupervised hierarchical clustering also have a lot of potential to help clinicians. First, some laboratory indicators such as CRP, LDH, and AST, are crucial indexes to indicate the illness severity. It has been widely reported by other studies and our study also confirmed that. Secondly, our study demonstrated that some symptoms such as fever, dizziness, palpitations, fatigue as well as nausea and vomiting, are also important to indicating the disease severity and prognosis, which has been infrequently explored in other studies. In addition, clinicians were regularly faced with dozens of indexes including laboratory findings and symptoms. Thus, the SVM-based classifier model was constructed to aid clinical assessment, which could help with developing individualized and specific treatments for COVID-19 patients in the background of continuously increasing numbers of infected people. The prediction model can not only be used for newly admitted patients, and it also works with COVID-19 patients who were under medical treatment and need to reassess their conditions.
Conclusions
In our study, COVID-19 patients were divided into three clusters with different clinical characteristics and prognoses using FAMD-based cluster analysis, which was the first attempt at exploratory analysis of the spectrum of COVID-19 clinical characteristics, and the relationship between clinical characteristics and outcomes of COVID-19 patients was revealed from a novel perspective. An SVM-based classifier model was constructed according to the FAMD-based cluster analysis results so that this classification based on a few key laboratory findings and symptoms of COVID-19 patients can be used conveniently in clinical practice.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by the ethics committee of Tongji Hospital of Tongji Medical College of Huazhong University of Science and Technology. Written informed consent from the participants' legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.
Author Contributions
ST, ZC, and LH contributed to conception and design of the study. ZC collected the original clinical data. LH and JY per-processed the data. LH performed the statistical analysis. LH constructed and optimized the SVM model. ZC, JY, YaH, YiH, HW, YW, and ST interpreted the results. LH wrote the first draft of the manuscript. ZC, PS, XB, WL, and KQ revised the manuscript. PS and LH revised the manuscript according to the reviewer's suggestion. ZC and ST dominated and guided the revision of the manuscript. All authors have approved the submitted manuscript.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We are grateful to all COVID-19 patients enrolled in our study, as well as the hardworking and dedicated nurses and doctors in Tongji Hospital. In addition, all healthcare workers and researchers who fight against COVID-19 are gratefully acknowledged.
Footnotes
Funding. This work was supported by the National Natural Science Foundation of China (81874383).
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2021.644724/full#supplementary-material
References
- 1.Furuse Y, Oshitani H. Viruses that can and cannot coexist with humans and the future of SARS-CoV-2. Front Microbiol. (2020) 11:583252. 10.3389/fmicb.2020.583252 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Baj J, Karakuła-Juchnowicz H, Teresiński G, Buszewicz G, Ciesielka M, Sitarz E, et al. COVID-19: specific and non-specific clinical manifestations and symptoms: the current state of knowledge. J Clin Med. (2020) 9:1753. 10.3390/jcm9061753 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Cholankeril G, Podboy A, Aivaliotis VI, Tarlow B, Pham EA, Spencer SP, et al. High prevalence of concurrent gastrointestinal manifestations in patients with severe acute respiratory syndrome coronavirus 2: early experience from California. Gastroenterology. (2020) 159:775–7. 10.1053/j.gastro.2020.04.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Pan L, Mu M, Yang P, Sun Y, Wang R, Yan J, et al. Clinical characteristics of COVID-19 patients with digestive symptoms in Hubei, China: a descriptive, cross-sectional, multicenter study. Am J Gastroenterol. (2020) 115:766–73. 10.14309/ajg.0000000000000620 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Zhang X, Tang C, Tian D, Hou X, Yang Y. Management of digestive disorders and procedures associated with COVID-19. Am J Gastroenterol. (2020) 115:1153–5. 10.14309/ajg.0000000000000728 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Tian Y, Rong L, Nian W, He Y. Review article: gastrointestinal features in COVID-19 and the possibility of faecal transmission. Aliment Pharmacol Ther. (2020) 51:843–51. 10.1111/apt.15731 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Tan L, Wang Q, Zhang D, Ding J, Huang Q, Tang YQ, et al. Lymphopenia predicts disease severity of COVID-19: a descriptive and predictive study. Signal Transduct Target Ther. (2020) 5:33. 10.1038/s41392-020-0159-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Potempa LA, Rajab IM, Hart PC, Bordon J, Fernandez-Botran R. Insights into the use of C-reactive protein as a diagnostic index of disease severity in COVID-19 infections. Am J Trop Med Hyg. (2020) 103:561–3. 10.4269/ajtmh.20-0473 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Yao Y, Cao J, Wang Q, Shi Q, Liu K, Luo Z, et al. D-dimer as a biomarker for disease severity and mortality in COVID-19 patients: a case control study. J Intensive Care. (2020) 8:49. 10.1186/s40560-020-00466-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Long H, Nie L, Xiang X, Li H, Zhang X, Fu X, et al. D-dimer and prothrombin time are the significant indicators of severe COVID-19 and poor prognosis. Biomed Res Int. (2020) 2020:6159720. 10.1155/2020/6159720 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Liao D, Zhou F, Luo L, Xu M, Wang H, Xia J, et al. Haematological characteristics and risk factors in the classification and prognosis evaluation of COVID-19: a retrospective cohort study. Lancet Haematol. (2020) 7:e671–e8. 10.1016/S2352-3026(20)30217-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Öztürk S, Özkaya U, Barstugan M. Classification of Coronavirus (COVID-19) from X-ray and CT images using shrunken features. Int J Imaging Syst Technol. (2020) 31:5–15. 10.1002/ima.22469 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Pagès J. Analyse factorielle de donnees mixtes: principe et exemple d'application. Rev Stat Appl. (2004) 52:93–111. Available online at: https://link.springer.com/article/10.1186/s13570-020-00170-5 [Google Scholar]
- 14.Yu G. Using ggtree to visualize data on tree-like structures. Curr Protoc Bioinf. (2020) 69:e96. 10.1002/cpbi.96 [DOI] [PubMed] [Google Scholar]
- 15.Paradis E, Schliep K. ape 5.0: an environment for modern phylogenetics and evolutionary analyses in R. Bioinformatics. (2019) 35:526–8. 10.1093/bioinformatics/bty633 [DOI] [PubMed] [Google Scholar]
- 16.Csardi G, Nepusz T. The igraph software package for complex network research. Interj Complex Syst. (2006) 1695:1–9. Available online at: https://link.springer.com/article/10.1007/s10764-021-00227-1 [Google Scholar]
- 17.Charrad M, Ghazzali N, Boiteau V, Niknafs A. Nbclust: an R package for determining the relevant number of clusters in a data set. J Stat Softw. (2014) 61:1–36. 10.18637/jss.v061.i06 [DOI] [Google Scholar]
- 18.Lin H, Zelterman D. Modeling survival data: extending the Cox model. Technometrics. (2002) 44:85–6. 10.1198/tech.2002.s656 [DOI] [Google Scholar]
- 19.Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, et al. pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinf. (2011) 12:77. 10.1186/1471-2105-12-77 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Alfons A, Templ M, Filzmoser P. An object-oriented framework for statistical simulation: the R package simFrame. J Stat Softw. (2010) 37:1–36. 10.18637/jss.v037.i03 [DOI] [Google Scholar]
- 21.Yu C, Zhou M, Liu Y, Guo T, Ou C, Yang L, et al. Characteristics of asymptomatic COVID-19 infection and progression: a multicenter, retrospective study. Virulence. (2020) 11:1006–14. 10.1080/21505594.2020.1802194 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Hu Z, Song C, Xu C, Jin G, Chen Y, Xu X, et al. Clinical characteristics of 24 asymptomatic infections with COVID-19 screened among close contacts in Nanjing, China. Sci China Life Sci. (2020) 63:706–11. 10.1007/s11427-020-1661-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Li Z, Yi Y, Luo X, Xiong N, Liu Y, Li S, et al. Development and clinical application of a rapid IgM-IgG combined antibody test for SARS-CoV-2 infection diagnosis. J Med Virol. (2020) 92:1518–24. 10.1002/jmv.25727 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Henry BM, Aggarwal G, Wong J, Benoit S, Vikse J, Plebani M, et al. Lactate dehydrogenase levels predict coronavirus disease 2019 (COVID-19) severity and mortality: a pooled analysis. Am J Emerg Med. (2020) 38:1722–6. 10.1016/j.ajem.2020.05.073 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Wu MY, Yao L, Wang Y, Zhu XY, Wang XF, Tang PJ, et al. Clinical evaluation of potential usefulness of serum lactate dehydrogenase (LDH) in 2019 novel coronavirus (COVID-19) pneumonia. Respir Res. (2020) 21:171. 10.1186/s12931-020-01427-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Ali N. Elevated level of C-reactive protein may be an early marker to predict risk for severity of COVID-19. J Med Virol. (2020) 92:2409–11. 10.1002/jmv.26097 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Tan C, Huang Y, Shi F, Tan K, Ma Q, Chen Y, et al. C-reactive protein correlates with computed tomographic findings and predicts severe COVID-19 early. J Med Virol. (2020) 92:856–62. 10.1002/jmv.25871 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Lei F, Liu YM, Zhou F, Qin JJ, Zhang P, Zhu L, et al. Longitudinal association between markers of liver injury and mortality in COVID-19 in China. Hepatology. (2020) 72:389–98. 10.1002/hep.31301 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Bertolini A, van de Peppel IP, Bodewes F, Moshage H, Fantin A, Farinati F, et al. Abnormal liver function tests in patients with COVID-19: relevance and potential pathogenesis. Hepatology. (2020) 72:1864–72. 10.1002/hep.31480 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Qin C, Zhou L, Hu Z, Zhang S, Yang S, Tao Y, et al. Dysregulation of immune response in patients with coronavirus 2019 (COVID-19) in Wuhan, China. Clin Infect Dis. (2020) 71:762–8. 10.1093/cid/ciaa248 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Xie G, Ding F, Han L, Yin D, Lu H, Zhang M. The role of peripheral blood eosinophil counts in COVID-19 patients. Allergy. (2020) 76:471–82. 10.1111/all.14465 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Tabachnikova A, Chen ST. Roles for eosinophils and basophils in COVID-19? Nat Rev Immunol. (2020) 20:461. 10.1038/s41577-020-0379-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Rees EM, Nightingale ES, Jafari Y, Waterlow NR, Clifford S, Pearson CAB, et al. COVID-19 length of hospital stay: a systematic review and data synthesis. BMC Med. (2020) 18:22. 10.1186/s12916-020-01726-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Palmieri L, Vanacore N, Donfrancesco C, Lo Noce C, Canevelli M, Punzo O, et al. Clinical characteristics of hospitalized individuals dying with COVID-19 by age group in Italy. J Gerontol A Biol Sci Med Sci. (2020) 75:1796–800. 10.1093/gerona/glaa146 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Klaiber P, Wen JH, DeLongis A, Sin NL. The ups and downs of daily life during COVID-19: Age differences in affect, stress, and positive events. J Gerontol B Psychol Sci Soc Sci. (2020) 76:E30–7. 10.1093/geronb/gbaa096 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Wenham C, Smith J, Morgan R. COVID-19: the gendered impacts of the outbreak. Lancet. (2020) 395:846–8. 10.1016/S0140-6736(20)30526-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Ben-Hur A, Guyon I. Detecting stable clusters using principal component analysis. Methods Mol Biol. (2003) 224:159–82. 10.1385/1-59259-364-X:159 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.