Skip to main content
Frontiers in Medicine logoLink to Frontiers in Medicine
. 2022 Mar 16;9:826218. doi: 10.3389/fmed.2022.826218

Relationship Between Endothelial and Angiogenesis Biomarkers Envisage Mortality in a Prospective Cohort of COVID-19 Patients Requiring Respiratory Support

Felipe Maldonado 1,, Diego Morales 2,, Catalina Díaz-Papapietro 1,2,, Catalina Valdés 1, Christian Fernandez 2,, Nicolas Valls 1, Marioli Lazo 3, Carolina Espinoza 4, Roberto González 1, Rodrigo Gutiérrez 1,5, Álvaro Jara 1, Carlos Romero 3,, Oscar Cerda 2,6,, Mónica Cáceres 2,6,7,*,
PMCID: PMC8966493  PMID: 35372407

Abstract

Purpose

Endothelial damage and angiogenesis are fundamental elements of neovascularisation and fibrosis observed in patients with coronavirus disease 2019 (COVID-19). Here, we aimed to evaluate whether early endothelial and angiogenic biomarkers detection predicts mortality and major cardiovascular events in patients with COVID-19 requiring respiratory support.

Methods

Changes in serum syndecan-1, thrombomodulin, and angiogenic factor concentrations were analysed during the first 24 h and 10 days after COVID-19 hospitalisation in patients with high-flow nasal oxygen or mechanical ventilation. Also, we performed an exploratory evaluation of the endothelial migration process induced by COVID-19 in the patients' serum using an endothelial cell culture model.

Results

In 43 patients, mean syndecan-1 concentration was 40.96 ± 106.9 ng/mL with a 33.9% increase (49.96 ± 58.1 ng/mL) at day 10. Both increases were significant compared to healthy controls (Kruskal–Wallis p < 0.0001). We observed an increase in thrombomodulin, Angiopoietin-2, human vascular endothelial growth factor (VEGF), and human hepatocyte growth factor (HGF) concentrations during the first 24 h, with a decrease in human tissue inhibitor of metalloproteinases-2 (TIMP-2) that remained after 10 days. An increase in human Interleukin-8 (IL-8) on the 10th day accompanied by high HGF was also noted. The incidence of myocardial injury and pulmonary thromboembolism was 55.8 and 20%, respectively. The incidence of in-hospital deaths was 16.3%. Biomarkers showed differences in severity of COVID-19. Syndecan-1, human platelet-derived growth factor (PDGF), VEGF, and Ang-2 predicted mortality. A multiple logistic regression model with TIMP-2 and PDGF had positive and negative predictive powers of 80.9 and 70%, respectively, for mortality. None of the biomarkers predicted myocardial injury or pulmonary thromboembolism. A proteome profiler array found changes in concentration in a large number of biomarkers of angiogenesis and chemoattractants. Finally, the serum samples from COVID-19 patients increased cell migration compared to that from healthy individuals.

Conclusion

We observed that early endothelial and angiogenic biomarkers predicted mortality in patients with COVID-19. Chemoattractants from patients with COVID-19 increase the migration of endothelial cells. Trials are needed for confirmation, as this poses a therapeutic target for SARS-CoV-2.

Keywords: angiogenesis, syndecan-1, angiopoietin-2, VEGF, COVID-19

Introduction

Aggressive and rapidly evolving symptoms characterise a subset of patients with coronavirus disease 2019 (COVID-19). Early recognition of evolution is still not possible (13). Long-lasting hospitalisation due to prolonged mechanical ventilation is associated with altered oxygen diffusion in lung capillaries, which may be partly due to an increase in fibrotic areas (4). Angiopoietins are critical players in vessel maturation and mediate the migration, adhesion, and survival of endothelial cells. In conjunction with vascular endothelial growth factor (VEGF), angiopoietins promote neovascularisation (5). Furthermore, neovascularisation and fibrosis are present in the lungs of patients with COVID-19 (6, 7). Endothelial damage and angiogenesis are fundamental elements of this process (811), where intussusceptive and sprouting angiogenesis observed in autopsies reflect rapid vascular activation and proliferation during the disease (7, 12).

Elevation of the endothelial injury biomarkers, syndecan-1 and thrombomodulin (TM) in patients with sepsis is associated with intensive care unit (ICU) mortality (13, 14). In COVID-19, reports of syndecan-1 increase are related to disease severity and have been suggested as an assessment of the clinical course of the patient (15, 16). Soluble TM plasma elevation is also related to increased mortality in patients with COVID-19, as it marks direct endothelial cell damage (17, 18).

Besides injury, endothelial angiogenic activation poses another pathophysiological feature as well as a therapeutic opportunity. It seems to be a rapid phenomenon upon severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) infection, as this feature is observed in lung autopsies from non-surviving patients within 10 days of hospitalisation (7). Increased angiogenic biomarkers are associated with ICU admission and patients' reduced respiratory system compliance (19). Molecules such as VEGF and angiopoietin-2 (Ang-2) are associated with angiogenesis. Hepatocyte growth factor (HGF) stimulates cell migration and branching and acts synergistically with VEGF to promote new blood vessel formation, pericyte migration, and endothelial cell migration. Tissue inhibitor of metalloproteinases-2 (TIMP-2) binds to metalloproteinases (MMPs) and decreases extracellular matrix degradation (20).

Considering the brief instauration of the endothelial and angiogenic processes, we aimed to evaluate whether there is an early increase in endothelial and angiogenic biomarkers and whether early detection of these biomarkers is associated with mortality and major cardiovascular events in patients with COVID-19.

Materials and Methods

We performed a single-centre prospective cohort study of patients with COVID-19 hospitalised at the Hospital Clínico de la Universidad de Chile. The study was approved by the ethics committee of our centre (Ref: OAIC 1161/20), registered online at https://www.clinicaltrials.gov (Ref: NCT04609332), and conducted according to the principles of the Helsinki Declaration under monitoring by the Good Clinical Practice unit of our institution. Written informed consent was obtained from all patients who were able to sign or from a legal representative if they were unable to provide consent. We adhered to the STROBE guidelines for reporting observational studies (21). The study was performed before vaccination campaigns in our country.

We defined changes in syndecan-1 blood concentrations during hospitalisation as the primary outcome. First, serum syndecan-1 concentrations were analysed during the first day of hospitalisation. Second, in the blood samples, we determined the concentrations of TM and a set of angiogenic factors as markers of profound endothelial damage and activation. After 10 days, if the patient remained hospitalised, a second biomarker set measurement was performed in this subgroup of patients. After 6 months of follow-up, mortality and major cardiovascular events were recorded. Finally, using an endothelial cell culture model, we performed an exploratory evaluation of the endothelial migration process in the serum samples of patients with COVID-19.

Participants

We included patients aged 18 years and older with clinically suspected and laboratory reverse transcriptase-polymerase chain reaction (RT-PCR)-confirmed SARS-CoV-2 infection, hospitalised in critical patient care units with the need for high-flow nasal oxygen (HFNO) or mechanical ventilation during the first 24 h after arriving at our centre. The exclusion criteria were symptomatic patients with a negative RT-PCR for SARS-CoV-2 and patients who were treated with anticoagulants for a pre-existing comorbidity. Recruitment was performed between December 2020 and March 2021. For serum endothelial damage and angiogenic biomarkers, 10 mL blood samples were collected during the first 24 h and on the 10th day of hospitalisation. Hospitalisation clinical data were collected, and a telephonic follow-up was performed until the 6th month after hospital admission. As for control group, we included nine blood samples from healthy volunteers who did not present COVID-19 disease. They were recruited from the hospital and research laboratory during the study period. All patients' samples were processed similarly.

Variables

For the primary outcome, increased and differences in syndecan-1 concentrations were analysed during the first 24 h and at the 10th day of hospitalisation. Blood serum concentrations of TM, human Ang-2, human HGF, human Interleukin-8 (IL-8), human platelet-derived growth factor (PDGF), human TIMP-2, and human VEGF were measured. Demographic, clinical, and laboratory data were obtained from the patients' medical charts. Major cardiovascular events were defined as death, the presence of pulmonary thromboembolism, and myocardial injury in patients with high-sensitive cardiac troponin I (Hs-cTn) elevation above 11 ng/L [99th percentile upper reference limit (URL)] (Vitros®, Ortho Clinical Diagnostics, UK) (22). Deaths outside the hospital were obtained from the National Registry of Deaths accessed online (https://www.registrocivil.cl). Surviving patients were contacted within the next 6 months after hospitalisation for clinical follow-up. As a definition of COVID-19, we analysed our cohort according to the National Institutes of Health clinical spectrum (23). We defined severity according to the need for ventilatory support and hospitalisation period as follows: severe, patients requiring HFNO ventilation who did not progress into shock or respiratory failure during the first 10 days of hospitalisation; critical, patients with the need for HFNO or mechanical ventilation due to respiratory failure, shock, or multiorgan dysfunction; and deceased patients.

Laboratory processing and outcome assessors were blinded to the patients. At study termination, the outcome assessor attained the patients' sample codes and performed the final analysis. After blinded assessments, we performed an exploratory analysis of serum from healthy patients and patients with severe COVID-19. Serum samples were used for in vitro endothelial migration assays.

Sample Size

By the time of the study design, we found no previous data on syndecan-1 in patients with COVID-19; therefore, we selected a sample size of 40 patients for convenience of the primary outcome. Nevertheless, considering a normal syndecan-1 value of 31.6 ng/mL, a standard deviation of 15.3 ng/mL, our sample size calculation allowed us to detect a 29.7% change in the mean concentration of syndecan-1, with an alpha of 0.05 and a power of 80% (24, 25). Considering a 10% loss of patients, 44 patients were required for the two-sided test analysis.

Statistical Methods

Categorical variables were summarised as relative frequencies. Continuous variables for primary and secondary outcomes were expressed as the mean and standard deviation (SD) or median and interquartile rank (IQR). Non-paired results were compared using the Mann–Whitney test. For group comparisons, we used the Kruskal–Wallis test with Dunn's multiple comparison test. The Wilcoxon test was used for paired data. Receiver operating characteristic (ROC) curves were generated for all biomarkers. The area under the curve (AUC) was calculated using the Youden index for cut-off values (26, 27). Multiple logistic regression was used with survivors and non-survivors as dichotomised variables as outcomes. We obtained a pseudo R2 (Tjur's R2) and used a Hosmer–Lemeshow goodness-of-fit and log-likelihood ratio test for hypothesis testing. Two-tailed P-values < 0.05, were considered significant for all analyses. Data were analysed using GraphPad Prism software (version 9.0; La Jolla, CA, USA).

Quantification of Biomarkers

All blood samples were collected in a 15 mL centrifugation tube without heparin by an anaesthesiologist and coded before delivering the samples to the processing laboratory. All blood samples were immediately incubated for 1 h at 37°C and centrifuged at 400 g for 10 min. Blood serum was stored in a −80°C freezer for the final analysis (28).

To characterise the endothelial damage, we measured one glycocalyx biomarker (syndecan-1) and one endothelial membrane biomarker (TM). For biomarker levels in blood serum, we used the following enzyme-linked immunosorbent assay (ELISA): DuoSet Human Syndecan-1 (#DY2780; R&D Technologies, MN, USA) using blood samples diluted 20 times and five times, and human TM/BDCA−3 (#DTHBDO; R&D Technologies, MN, USA) using blood samples diluted six times. All measurements were performed in duplicate in one assay. Assays and analyses were performed according to the manufacturer's instructions (25).

To quantify Ang-2, HGF, IL-8, PDGF, TIMP-2, and VEGF, we used Q-PlexTM Human Angiogenesis (#150233HU; Quansys, Cellus, Santiago, Chile). The blood samples were diluted six times. Assays and analyses were performed according to the manufacturer's instructions. Additionally, a Proteome Profiler Human Angiogenesis Array kit (#ARY007, R&D Technologies) was used to identify 55 different angiogenesis proteins in COVID-19 and in the healthy volunteers' blood serum.

Cell Migration

Cell migration was assayed using Transwell chambers (#3422; Costar, Corning Incorporated, ME, USA) with 8.0 μm-pore polycarbonate filters. 10,000 EA. hy926 cells were suspended in serum-free Dulbecco's Modified Eagle Medium (DMEM) without antibiotics and seeded in the upper compartment of the chamber. Ten samples of 10% v/v blood (five in the first 24 h and five on the 10th day of hospitalisation) from five randomly selected patients with COVID-19 and five from healthy individuals were added to the lower compartment of the chamber. Migration was allowed to occur for 24 h. Following the removal of the non-invading cells, the invading cells were fixed and stained with 0.2% crystal violet. Cell migration was evaluated by counting five (× 20) fields per chamber (29).

Results

Forty-three patients were included between December 2020 and March 2021 (Supplementary Figure 1). The median age was 62 years (IQR 53–72); 39.5% were female and 60.5% were male. The mean body mass index was 26.4 kg/m2. The most prevalent comorbidities were hypertension (51%), diabetes (37%), obesity (12%), and dyslipidaemia (12%) (Table 1; Supplementary Table 1). For major cardiovascular events, we found a 44.2% (n = 19) incidence of myocardial injury in patients presenting to the hospital (Hs-cTn above URL), which increased to 55.8% (n = 24) of patients during hospitalisation. The incidence of pulmonary thromboembolism (PTE) was 9.3% (n = 4) in the first computed tomography angiography and increased during hospitalisation to 20% (n = 9) (Table 1). The incidence of in-hospital death was 16.3%. During the 6-month follow-up period, we found no out-of-hospital mortality.

Table 1.

Patients characteristics.

COVID-19 severity
Baseline values Total Severe Critical Non-survivors p-value
Age—years
Median (IQR) 62 (53–72) 55 (38–68) 62 (55–74) 73 (60–74) <0.0001#
Range 55 42 49 17
Sex—n/ total n (%)
Female 18/43 (42) 4/43 (9) 11/43 (26) 3/43 (7) 0.9110
Male 25/43 (58) 7/43 (16) 14/43 (33) 4/43 (9) 0.9110
BMI—mean (SD) 26.4 (8.6) 28.2 (3.7) 25.7 (10.6) 26.9 (2.9)
Comorbidities—n/ total n (%)
Obesity 5/43 (12) 3/43 (7) 1/43 (2) 1/43 (2) 0.0751
Coronary heart disease 4/43 (9) 2/43 (4) 1/43 (2) 1/43 (2) 0.3339
Heart failure 3/43 (7) 1/43 (2) 2/43 (4) 0.1801
Chronic kidney failure 3/43 (7) 3/43 (7) 0.3281
Acute kidney failure
Stroke
Vascular disease
COPD 3/43 (7) 1/43 (2) 1/43 (2) 1/43 (2) 0.5870
Liver disease 1/43 (2) 1/43 (7) 0.0669
Diabetes 16/43 (37) 4/43 (9) 9/43 (21) 3/43 (7) 0.9402
Hypertension 22/43 (51) 5/43 (12) 14/43 (32) 3/43 (7) 0.8619
Smoking 5/43 (12) 1/43 (2) 2/43 (4) 2/43 (4) 0.2920
Dyslipidemia 4/43 (9) 1/43 (2) 3/43 (7) 0.9434
Laboratory—mean (SD)
D-Dimer (ng/mL) 1,558 (1,745) 1,090 (808) 1,844 (2,168) 1,240 (585) 0.4274
C-reactive protein (mg/L) 159 (100) 96 (69) 183 (109) 169 (61) 0.0341*
ProBNP (pg/mL) 749 (914) 256 (252) 875 (1,092) 939 (943) 0.0827
Procalcitonin (ng/mL) 0.27 (0.39) 0.09 (–) 0.45 (0.5) 0.09 (0.05) 0.7000
Myocardial injury—n (within subgroup %)
24 h 19 (44.2) 2 (18) 12 (46.1) 5 (71) 0.1371
Total hospitalisation 24 (55.8) 3 (27) 15 (58) 6 (85) 0.0418&
High-sensitive cardiac troponin I—mean (SD)
24 h (mg/ml) 35.7 (89.8) 6.7 (6.6) 41.7 (108.9) 52.2 (72) 0.0348* 0.0318#
Maximum (mg/ml) 114.5 (341.1) 12.4 (20.9) 149.6 (439.8) 149.5 (119.5) 0.0362* 0.0032#
Thromboembolism—n/ total n (%)
First 24 h 4/43 (9) 0/11 (0) 3/25 (7) 1/7 (14) 0.4684
During hospitalisation 9/43 (20) 1/11 (1) 5/25 (20) 3/7 (43) 0.2489
Arterial blood gases—mean (SD)
pH 7.43 (0.04) 7.43 (0.04) 7.43 (0.05) 7.42 (0.04) 0.6802
pCO2 32.1 (4.3) 32.8 (4.4) 31.9 (4.6) 31.5 (2.9) 0.8469
pO2 82.6 (28.19) 96.63 (35.9) 79.42 (23.0) 72.63 (28.5) 0.2816
BE −2.39 (3.25) −1.98 (3.07) −2.30 (3.40) −3.33 (3.24) 0.6541
HCO3 21.36 (2.99) 21.62 (3.17) 21.50 (3.04) 20.44 (2.79) 0.6171
FiO2 49.5 (2.99) 34.2 (12.80) 55.2 (29.08) 53.7 (29.40) 0.1385
PaFi 221.0 (132.7) 316.4(151.5) 184.6 (102.7) 190.7 (133.2) 0.0265*
Use of vasopressors—n/ total n (%)
First 24 h 4/43 (9) 0/11 (0) 2/25 (8) 2/7 (29) 0.1189
Between 24 h and 10th day 16/43 (44) 0/11 (0) 11/25 (44) 5/7 (71) 0.0052*#
At 10th day 7/43 (16) 0/11 (0) 6/25 (24) 0/7 (0) 0.0812
*

Severe vs. critical patients Kruskal-Wallis.

&

Chi-square.

#

Severe vs. non-survivors Kruskal-Wallis.

Key molecules are involved in endothelial and angiogenic processes (Figure 1A). The endothelial damage in patients with COVID-19 was characterised by a mean syndecan-1 concentration during the first 24 h of hospitalisation (40.96 ± 106.9 ng/mL) and, in the next 10 days, the subgroup of patients that remain hospitalised presented a 33.9% increase in serum concentrations (49.96 ± 58.1 ng/mL). Both increases were significant compared to healthy controls (Kruskal–Wallis p < 0.0001) (Intra-assay Coefficient of Variation of 6.9%). The mean TM level significantly increased from 942 ± 638 ng/mL in the first 24 h to 1,189 ± 608 ng/mL on the 10th day of hospitalisation and was different from that in healthy controls (Kruskal–Wallis p < 0.0001) (Figure 1B).

Figure 1.

Figure 1

Serum levels of endothelial damage and angiogenesis-related proteins. (A) Summary of key molecules involved in angiogenesis and endothelial damage. (B) Graph representing the mean serum of syndecan-1 and thrombomodulin during the first 24 h of hospitalisation (n = 43), after 10 days (n = 28) and in healthy individuals (n = 9). (C) Graph representing the mean serum of angiopoietin-2, TIMP-2. VEGF, PDGF-BB, HGF, and IL-8. Statistical significance (P-values) is obtained using two-sided Kruskal–Wallis with Dunn's multiple comparison test, *P < 0.05; **P < 0.01; ***P < 0.001. ****P < 0.0001.

The angiogenic biomarker profile was characterised by an increase in Ang-2, VEGF, and HGF concentrations during the first 24 h after arriving at the centre. We found a decrease in the MMP inhibitor MMP TIMP-2 concentrations, which remained in the subgroup of hospitalised patients after 10 days. In this subgroup of patients with COVID-19, we also observed higher IL-8 levels on the 10th day accompanied by high HGF values compared to those in healthy controls (Figure 1C).

For biomarkers obtained in the first 24 h, PDGF had an AUC of 0.838 (95% CI 0.69–0.99; p = 0.005) to predict mortality from survivors (cut-off value, 2,118 pg/mL; sensitivity, 71.43%; specificity, 81.08%). VEGF had an AUC of 0.768 (95% CI 0.56–0.98: p = 0.0257) to predict mortality (cut-off value, 266 pg/mL; sensitivity, 71.43%; specificity, 83.78%). On the 10th day of hospitalisation, Ang-2 had an AUC of 0.875 (95% CI 0.73–1.0; p = 0.018) to predict mortality from survivors (cut-off value, 2,388 pg/mL; sensitivity, 100%; specificity, 75%). Interestingly, syndecan-1 had an AUC of 0.94 (95% CI 0.84–1.0; p = 0.005) to predict mortality from survivors (cut-off value of 40.1 ng/mL; sensitivity of 100% and specificity of 81.82%) (Figures 2A,B). Finally, none of the biomarkers predicted myocardial injury or PTE.

Figure 2.

Figure 2

Receiver operating characteristic (ROC) curve for mortality: (A) Endothelial biomarkers (B) Angiogenic biomarkers. ROC curves with area under the curve for mortality.

According to severity definitions, we found that the concentrations of syndecan-1 in the first 24 h were significantly elevated in patients who developed a critical illness or died. TM levels were elevated in patients with severe and critical disease (Figure 3A). Patients who died from COVID-19 also presented with elevated Ang-2 and HGF levels, accompanied by low concentrations of TIMP-2. Critical disease was characterised by an increase in VEGF and HGF and a decrease in TIMP-2 (Figure 3B).

Figure 3.

Figure 3

Serum levels comparison according to coronavirus disease 2019 severity during the first 24 h of hospitalisation. (A) Levels of syndecan-1 and thrombomodulin. (B) Graph representing the mean serum of angiopoietin-2, vascular endothelial growth factor (VEGF), human platelet-derived growth factor (PDGF), human tissue inhibitor of metalloproteinases-2 (TIMP-2), human hepatocyte growth factor (HGF), and human Interleukin-8 (IL-8). Statistical significance (P-values) is obtained using two-sided Kruskal–Wallis test, *P < 0.05; **P < 0.01; ***P < 0.001; ****P < 0.0001. (C) Multivariate model logistic regression receiver operating characteristic curve using TIMP-2 and PDGF for predicting mortality (n = 11 severe, n = 25 critical, n = 7 non-survivors).

Next, we evaluated whether a combination of the biomarkers already shown may outperform the prediction accuracy for in-hospital mortality. We performed a multiple logistic regression model using Ang-2, HGF, IL-8, PDGF, TIMP-2, VEGF, syndecan-1, and TM values obtained within 24 h of the patient arriving at the hospital. A dual combination of VDGF, PDGF, and TIMP-2 improved our model. The combination of TIMP-2 and PDGF as predictors had a positive predictive power of 80.9% and a negative predictive power of 70% for mortality, with an AUC of 0.90 (95% CI 0.816–0.997; p-value < 0.0001; Tjur's R2 of 0.43), Hosmer–Lemeshow p-value of 0.34 and a log-likelihood ratio p-value < 0.0001 (Figure 3C).

To further evaluate the biomarkers, we tested whether patients' serum samples were able to induce changes in endothelial function. To identify biomarkers that could be modulated by SARS-CoV-2, we used a semi-quantitative methodology, a proteome profiler array, using serum from patients with COVID-19 and healthy individuals. We found that Angiopoietin-1 (Ang-1), Ang-2, endostatin, VEGF, TIMP-1, TIMP-4, CXCL4, PDGF-AB/BB, TSP-1, EGF, CXCL16, and CD105 were modulated. Interestingly, Ang-1, Ang-2, VEGF, and CXCL-4 were involved in angiogenesis (Figures 4A,B) (30). Further, we evaluated whether blood serum from patients with COVID-19 and healthy individuals served as chemoattractants to endothelial EA.hy 926 cells by performing a Transwell assay (Figures 4C–E). We observed that blood serum from patients with COVID-19 showed increased cell migration compared to that in healthy blood serum.

Figure 4.

Figure 4

Proteome profiler array and cell migration induced by coronavirus disease 2019 blood serum. (A) Representative image of the angiogenic proteome profiler array using blood serum samples from healthy participants and from those with severe COVID-19. (B) Quantification of pixel mean density of each angiogenesis-related protein. (C) Schematics of Transwell Boyden chamber assay using blood serum samples from COVID-19-infected and healthy participants in the lower compartment as chemoattractants. (D) Representative images of migrated endothelial EA.hy926 cells induced by blood serum samples of COVID-19-infected and healthy participants. (E) Quantification of migrated cells by field (n = 5 healthy individuals, n = 3 severe, n = 1 critical, and n = 1 non-surviving COVID-19 patient) using both samples in first 24 h and on the 10th day of hospitalisation. Statistical significance (P-values) is obtained using Mann–Whitney *P < 0.05.

Discussion

COVID-19 is an aggressive disease. Here, we observed that endothelial injury and angiogenic biomarkers increased upon arrival of patients in need of high-flow nasal oxygen (HFNO) or mechanical ventilation support. An imbalance in the pro-angiogenic profile of endothelial activation is suggested in our migration and angiogenic assays using the serum samples of patients with COVID-19 as a chemotactic agent. Furthermore, an increase in biomarkers was predictive of mortality in our cohort.

The increase in syndecan-1 and TM levels confirmed substantial endothelial damage. As for angiogenesis, the sole elevation of one angiogenic protein has been described as insufficient for promoting endothelial cell survival and in vitro tubulogenesis, and the need for combination increases cell survival, tubulogenesis, and neovascularisation in rat corneas (20). In our cohort, we found an increase in VEGF, HGF in combination with high circulating Ang-2 levels. For PDGF, in deceased patients, we observed a decrease in the concentration in blood samples obtained upon arrival at the hospital. Also, we observed a decrease in TIMP-2 levels in the first 24 h and 10 days of hospitalisation, respectively. TIMP-2 inhibits VEGF-induced angiogenesis (31). Therefore, serum reduction reinforces the imbalance in the angiogenic profile of COVID-19 patients. Finally, IL-8 increase on the 10th day of hospitalisation adds a paracrine angiogenic factor that modulates the endothelial cell response (32, 33).

Using the proteome profiler array approximation, in patients with COVID-19 we confirmed the angiogenic and chemotactic serum profile compared to healthy volunteers of similar ages. Of the 55 molecules analysed, the observed increase in insulin-like growth factor binding proteins (IGFBPs), chemokines such as CXCL16 and Pentraxin-3, and endothelial growth factor (EGF) reaffirms the upregulation of angiogenic factors (3439). There is compelling evidence that there is a need for crosstalk between different factors, as this has been described between HGF and VEGF, enhancing VEGF-driven angiogenesis; therefore, an increase in different molecules was expected (40). Finally, this profile was associated with in vitro endothelial cell migration, suggesting the ability of serum to activate endothelial functions.

SARS-CoV-2 infection through the angiotensin converting enzyme-2 (ACE-2) receptor makes COVID-19 systemic. Endothelial injury is a hallmark of tissue permeability, lung oedema, and organ dysfunction. Endothelial cells control vascular tone and permeability by inducing endothelium-derived relaxation and contractile factors. Upon activation, endothelial cells secrete chemoattractants, cytokines, and adhesion molecules (41). With dysfunction, endothelial cells fail to produce nitric oxide (NO), losing the suppression effect on activated molecule release, a feature observed in patients with COVID-19 (42, 43). Other endothelial functions, such as angiogenesis and cellular migration, have received less attention in the literature. When Ackerman et al. described intussusceptive and sprouting angiogenesis as a novel feature of SARS-CoV-2 infection, compared with autopsies from influenza patients, he showed a vessel proliferation that accompanied a rapid decline in lung function and death (7). This angiogenic progression has been primarily studied in tumours. Circulating VEGF, HGF, and Ang-2 levels have been described in breast cancer, hepatocarcinoma, and melanoma (4446).

There is increasing evidence that endothelial damage is a predictor of outcomes. Smadja et al., in an observational cohort of 40 patients, found that Ang-2 concentration at admission is a relevant factor to predict transfer to ICU with an ROC of AUC 77.2 (80.1% sensitivity and 70% specificity) (19). Vassiliou et al., using endothelial biomarkers in hospitalised patients with COVID-19 admitted to the ICU, found that elevation of sE-selectin, sP-selectin, Ang-2, and sICAM-1 levels were significantly elevated in ICU non-survivors compared to survivors, with a higher mortality probability. In addition, sE-selectin, Ang-2, and sICAM-1 from the generated ROC curves were >0.85, indicating that elevated levels of these markers upon ICU admission could predict mortality in COVID-19 (47). Recently, de Moraes et al. described that angiopoietins, their receptors, and VEGF are associated with severity of COVID-19, suggesting that targeting the Ang/Tie2 and VEGF-A pathways could be valuable strategies to modulate COVID-19 severity (48). This reinforces our findings that endothelial damage is an early phenomenon, relates to hospital admission biomarker concentrations as a predictive tool for mortality, and can be a useful strategy for patient management.

Among the limitations of our study, we find the small number of participants and controls, which may reduce the strength of the statistical analysis. Although some of the biomarkers exhibited good AUC in the ROC curves and could predict disease mortality and severity in SARS-CoV-2, a larger trial is needed to confirm our results. Additionally, the number of samples obtained on day 10 was reduced due to deceased patients. Another limitation is the variation of absolute values between assays in the literature due to the temperature of sample management. Our samples were obtained with different processing methods than other laboratories, were we aimed to maintain normothermia to avoid platelet activation and angiogenic biomarkers release (49). Hence absolute values should be interpreted carefully and compared to studies with similar sample management. In relation to our migratory assay, we did not perform inhibitory experiments, and our findings need to be further investigated.

Finally, endothelial injury and angiogenesis biomarkers have been associated with mortality in patients with sepsis (14, 50). Here, we observed that early endothelial and angiogenic biomarkers increased the prediction of mortality, although they failed to predict myocardial injury and PET. Even though all patients in our cohort received the dexamethasone-recovery protocol (51), serum biomarkers remained altered on the 10th day of hospitalisation. The angiogenic profile associated with the known cytokine storm may be a relevant feature in COVID-19 induced organ dysfunction (52), and differences in sprouting or intussusceptive angiogenic evolution in different sepsis aetiologies may impact outcomes (7). Regarding the endothelial and angiogenic features of COVID-19, many questions still remain regarding their usefulness as biomarkers and the potential role of anti-angiogenic treatments in patients with the disease.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.

Ethics Statement

The studies involving human participants were reviewed and approved by Ethics Committee of Hospital Clínico Universidad de Chile (Ref: OAIC 1161/20). The patients/participants provided their written informed consent to participate in this study. Written informed consent was obtained from all patients who were able to sign or from a legal representative when they were unable to provide consent.

Author Contributions

FM and MC conceived the study, drafted the work, and performed the funding acquisition. FM, DM, CD-P, CV, CF, ML, CE, and MC performed the data collection. Data were analysed by FM, DM, CD-P, CF, NV, RGu, ÁJ, CR, OC, and MC and interpreted by FM, NV, RGo, RGu, ÁJ, CR, OC, and MC. All the authors revised the work, commented on previous versions of the manuscript, approved the version to be published, and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Funding

This work was supported by the Priority Health Problems: COVID-19 Investigation Grant of the Hospital Clínico de la Universidad de Chile, Santiago, Chile (FM), and a grant from the National Fund for Science and Technology (FONDECYT) Grant 1181263 (MC) from the National Agency of Research and Development (ANID). The Millennium Nucleus of Ion Channel-Associated Diseases (MiNICAD) from the Millennium Initiative, ANID funds (OC and MC). FONDECYT 1200917 funds (OC).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2022.826218/full#supplementary-material

Supplementary Figure 1

Strobe diagram.

Supplementary Table 1

Healthy volunteers' characteristics.

References

  • 1.Zhu J, Ji P, Pang J, Zhong Z, Li H, He C, et al. Clinical characteristics of 3062 COVID-19 patients: a meta-analysis. J Med Virol. (2020) 92:1902–14. 10.1002/jmv.25884 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Du Y, Tu L, Zhu P, Mu M, Wang R, Yang P, et al. Clinical features of 85 fatal cases of COVID-19 from Wuhan. A retrospective observational study. Am J Respir Crit Care Med. (2020) 201:1372–9. 10.1164/rccm.202003-0543OC [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Auld SC, Caridi-Scheible M, Blum JM, Robichaux C, Kraft C, Jacob JT, et al. ICU and ventilator mortality among critically ill adults with coronavirus disease 2019*. Crit Care Med. (2020) 48:e799. 10.1097/CCM.0000000000004457 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Guizani I, Fourti N, Zidi W, Feki M, Allal-Elasmi M. SARS-CoV-2 and pathological matrix remodeling mediators. Inflamm Res. (2021) 70:847–58. 10.1007/s00011-021-01487-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Fagiani E, Christofori G. Angiopoietins in angiogenesis. Cancer Lett. (2013) 328:18–26. 10.1016/j.canlet.2012.08.018 [DOI] [PubMed] [Google Scholar]
  • 6.Solomon JJ, Heyman B, Ko JP, Condos R, Lynch DA. CT of postacute lung complications of COVID-19. Radiology. (2021) 301:E383–95. 10.1148/radiol.2021211396 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Ackermann M, Verleden SE, Kuehnel M, Haverich A, Welte T, Laenger F, et al. Pulmonary vascular endothelialitis, thrombosis, and angiogenesis in Covid-19. N Engl J Med. (2020) 383:120–8. 10.1056/NEJMoa2015432 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Keane MP. Angiogenesis and pulmonary fibrosis: feast or famine? Am J Respir Crit Care Med. (2004) 170:207–9. 10.1164/rccm.2405007 [DOI] [PubMed] [Google Scholar]
  • 9.Smadja DM, Mentzer SJ, Fontenay M, Laffan MA, Ackermann M, Helms J, et al. COVID-19 is a systemic vascular hemopathy: insight for mechanistic and clinical aspects. Angiogenesis. (2021) 24:755–88. 10.1007/s10456-021-09805-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Okada H, Yoshida S, Hara A, Ogura S, Tomita H. Vascular endothelial injury exacerbates coronavirus disease 2019: the role of endothelial glycocalyx protection. Microcirculation. (2021) 28:e12654. 10.1111/micc.12654 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Medina-Enríquez MM, Lopez-León S, Carlos-Escalante JA, Aponte-Torres Z, Cuapio A, Wegman-Ostrosky T. ACE2: the molecular doorway to SARS-CoV-2. Cell Biosci. (2020) 10:148. 10.1186/s13578-020-00519-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Teuwen L-A, Geldhof V, Pasut A, Carmeliet P. COVID-19: the vasculature unleashed. Nat Rev Immunol. (2020) 20:389–91. 10.1038/s41577-020-0343-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Suzuki K, Okada H, Sumi K, Tomita H, Kobayashi R, Ishihara T, et al. Serum syndecan-1 reflects organ dysfunction in critically ill patients. Sci Rep. (2021) 11:8864. 10.1038/s41598-021-88303-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Johansen M, Johansson P, Ostrowski S, Bestle M, Hein L, Jensen A, et al. Profound endothelial damage predicts impending organ failure and death in sepsis. Semin Thromb Hemost. (2015) 41:016–025. 10.1055/s-0034-1398377 [DOI] [PubMed] [Google Scholar]
  • 15.Ogawa F, Oi Y, Nakajima K, Matsumura R, Nakagawa T, Miyagawa T, et al. Temporal change in Syndecan-1 as a therapeutic target and a biomarker for the severity classification of COVID-19. Thromb J. (2021) 19:55. 10.1186/s12959-021-00308-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Suzuki K, Okada H, Tomita H, Sumi K, Kakino Y, Yasuda R, et al. Possible involvement of Syndecan-1 in the state of COVID-19 related to endothelial injury. Thromb J. (2021) 19:5. 10.1186/s12959-021-00258-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Goshua G, Pine AB, Meizlish ML, Chang C-H, Zhang H, Bahel P, et al. Endotheliopathy in COVID-19-associated coagulopathy: evidence from a single-centre, cross-sectional study. Lancet Haematol. (2020) 7:e575–82. 10.1016/S2352-3026(20)30216-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Norooznezhad AH, Mansouri K. Endothelial cell dysfunction, coagulation, and angiogenesis in coronavirus disease 2019 (COVID-19). Microvasc Res. (2021) 137:104188. 10.1016/j.mvr.2021.104188 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Smadja DM, Guerin CL, Chocron R, Yatim N, Boussier J, Gendron N, et al. Angiopoietin-2 as a marker of endothelial activation is a good predictor factor for intensive care unit admission of COVID-19 patients. Angiogenesis. (2020) 23:611–20. 10.1007/s10456-020-09730-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Xin X, Yang S, Ingle G, Zlot C, Rangell L, Kowalski J, et al. Hepatocyte growth factor enhances vascular endothelial growth factor-induced angiogenesis in vitro and in vivo. Am J Pathol. (2001) 158:1111–20. 10.1016/S0002-9440(10)64058-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. (2007) 370:1453–7. 10.1016/S0140-6736(07)61602-X [DOI] [PubMed] [Google Scholar]
  • 22.Thygesen K, Alpert JS, Jaffe AS, Chaitman BR, Bax JJ, Morrow DA, et al. Fourth universal definition of myocardial infarction (2018). J Am Coll Cardiol. (2018) 72:2231–64. 10.1016/j.jacc.2018.08.1038 [DOI] [PubMed] [Google Scholar]
  • 23.COVID-19 Treatment Guidelines Panel . Coronavirus Disease 2019 (COVID-19) Treatment Guidelines. National Institutes of Health. Available online at: https://www.covid19treatmentguidelines.nih.gov/ (accessed January 21, 2022).
  • 24.Rahbar E, Cardenas JC, Baimukanova G, Usadi B, Bruhn R, Pati S, et al. Endothelial glycocalyx shedding and vascular permeability in severely injured trauma patients. J Transl Med. (2015) 13:117. 10.1186/s12967-015-0481-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Maldonado F. Effect of sevoflurane and propofol on tourniquet-induced endothelial damage: a pilot randomized controlled trial for knee-ligament surgery. BMC Anesthesiol. (2020) 20:121. 10.1186/s12871-020-01030-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Hajian-Tilaki K. Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation. Caspian J Intern Med. (2013)4:627–35. [PMC free article] [PubMed] [Google Scholar]
  • 27.Bewick V, Cheek L, Ball J. Statistics review 13: receiver operating characteristic curves. Crit Care. (2004) 8:508–12. 10.1186/cc3000 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Saldías MP, Fernández C, Morgan A, Díaz C, Morales D, Jaña F, et al. Aged blood factors decrease cellular responses associated with delayed gingival wound repair. PLoS ONE. (2017) 12:e0184189. 10.1371/journal.pone.0184189 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Fernandez C, Burgos A, Morales D, Rosales-Rojas R, Canelo J, Vergara-Jaque A, et al. TMPRSS11a is a novel age-altered, tissue specific regulator of migration and wound healing. FASEB J. (2021) 35:e21597. 10.1096/fj.202002253RRR [DOI] [PubMed] [Google Scholar]
  • 30.Thomas KA. Angiogenesis. In: Bradshaw RA, Stahl PD, editors. Encyclopedia of Cell Biology. Waltham: Academic Press; (2016). p. 102–16. 10.1016/B978-0-12-394447-4.40019-2 [DOI] [Google Scholar]
  • 31.Seo D-W, Li H, Guedez L, Wingfield PT, Diaz T, Salloum R, et al. TIMP-2 mediated inhibition of angiogenesis: an MMP-independent mechanism. Cell. (2003) 114:171–80. 10.1016/S0092-8674(03)00551-8 [DOI] [PubMed] [Google Scholar]
  • 32.Li A, Varney ML, Valasek J, Godfrey M, Dave BJ, Singh RK. Autocrine role of interleukin-8 in induction of endothelial cell proliferation, survival, migration and MMP-2 production and angiogenesis. Angiogenesis. (2005) 8:63–71. 10.1007/s10456-005-5208-4 [DOI] [PubMed] [Google Scholar]
  • 33.Petzelbauer P, Watson CA, Pfau SE, Pober JS. IL-8 and angiogenesis: evidence that human endothelial cells lack receptors and do not respond to IL-8 in vitro. Cytokine. (1995) 7:267–72. 10.1006/cyto.1995.0031 [DOI] [PubMed] [Google Scholar]
  • 34.Slater T, Haywood NJ, Matthews C, Cheema H, Wheatcroft SB. Insulin-like growth factor binding proteins and angiogenesis: from cancer to cardiovascular disease. Cytokine Growth Factor Rev. (2019) 46:28–35. 10.1016/j.cytogfr.2019.03.005 [DOI] [PubMed] [Google Scholar]
  • 35.Wu X, Zheng W, Jin P, Hu J, Zhou Q. Role of IGFBP1 in the senescence of vascular endothelial cells and severity of aging-related coronary atherosclerosis. Int J Mol Med. (2019) 44:1921–31. 10.3892/ijmm.2019.4338 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Möller B, Rasmussen C, Lindblom B, Olovsson M. Expression of the angiogenic growth factors VEGF, FGF-2, EGF and their receptors in normal human endometrium during the menstrual cycle. Mol Hum Reprod. (2001) 7:65–72. 10.1093/molehr/7.1.65 [DOI] [PubMed] [Google Scholar]
  • 37.Presta M, Foglio E, Churruca Schuind A, Ronca R. Long pentraxin-3 modulates the angiogenic activity of fibroblast growth factor-2. Front Immunol. (2018) 9:2327. 10.3389/fimmu.2018.02327 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Yu X, Zhao R, Lin S, Bai X, Zhang L, Yuan S, et al. CXCL16 induces angiogenesis in autocrine signaling pathway involving hypoxia-inducible factor 1α in human umbilical vein endothelial cells. Oncol Rep. (2016) 35:1557–1565. 10.3892/or.2015.4520 [DOI] [PubMed] [Google Scholar]
  • 39.Karimzadeh P, Faghih Z, Rahmani N, Eghbali F, Razmkhah M. Quantification of angiogenic factors and their clinicopathological associations in breast cancer. Eur Cytokine Netw. (2020) 31:68–75. 10.1684/ecn.2020.0447 [DOI] [PubMed] [Google Scholar]
  • 40.Sulpice E, Ding S, Muscatelli-Groux B, Bergé M, Han ZC, Plouet J, et al. Cross-talk between the VEGF-A and HGF signalling pathways in endothelial cells. Biol Cell. (2009) 101:525–39. 10.1042/BC20080221 [DOI] [PubMed] [Google Scholar]
  • 41.Jin Y, Ji W, Yang H, Chen S, Zhang W, Duan G. Endothelial activation and dysfunction in COVID-19: from basic mechanisms to potential therapeutic approaches. Signal Transduct Target Ther. (2020) 5:293. 10.1038/s41392-020-00454-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Pober JS, Sessa WC. Evolving functions of endothelial cells in inflammation. Nat Rev Immunol. (2007) 7:803–15. 10.1038/nri2171 [DOI] [PubMed] [Google Scholar]
  • 43.Green SJ. Covid-19 accelerates endothelial dysfunction and nitric oxide deficiency. Microbes Infect. (2020) 22:149–50. 10.1016/j.micinf.2020.05.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Takayama H, Miyake Y, Nouso K, Ikeda F, Shiraha H, Takaki A, et al. Serum levels of platelet-derived growth factor-BB and vascular endothelial growth factor as prognostic factors for patients with fulminant hepatic failure. J Gastroenterol Hepatol. (2011) 26:116–21. 10.1111/j.1440-1746.2010.06441.x [DOI] [PubMed] [Google Scholar]
  • 45.Helfrich I, Edler L, Sucker A, Thomas M, Christian S, Schadendorf D, et al. Angiopoietin-2 levels are associated with disease progression in metastatic malignant melanoma. Clin Cancer Res. (2009) 15:1384–92. 10.1158/1078-0432.CCR-08-1615 [DOI] [PubMed] [Google Scholar]
  • 46.Yamagamim H, Moriyama M, Matsumura H, Aoki H, Shimizu T, Saito T, et al. Serum concentrations of human hepatocyte growth factor is a useful indicator for predicting the occurrence of hepatocellular carcinomas in C-viral chronic liver diseases. Cancer. (2002) 95:824–34. 10.1002/cncr.10732 [DOI] [PubMed] [Google Scholar]
  • 47.Vassiliou AG, Keskinidou C, Jahaj E, Gallos P, Dimopoulou I, Kotanidou A, et al. ICU admission levels of endothelial biomarkers as predictors of mortality in critically Ill COVID-19 patients. Cells. (2021) 10:186. 10.3390/cells10010186 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.de Moraes CRP, de Borba Junior IT, de Lima F, Barbosa MS, Huber SC, Palma AC, et al. Circulating levels of Ang/Tie2 and VEGF-a pathway mediators are associated with clinical severity, endothelial barrier disruption and coagulation activation in COVID-19. Blood. (2021) 138:2073. 10.1182/blood-2021-152771 [DOI] [Google Scholar]
  • 49.Maurer-Spurej E, Pfeiler G, Maurer N, Lindner H, Glatter O, Devine DV. Room temperature activates human blood platelets. Lab Invest. (2001) 81:581–92. 10.1038/labinvest.3780267 [DOI] [PubMed] [Google Scholar]
  • 50.Luz Fiusa MM, Costa-Lima C, de Souza GR, Vigorito AC, Penteado Aranha FJ, Lorand-Metze I, et al. A high angiopoietin-2/angiopoietin-1 ratio is associated with a high risk of septic shock in patients with febrile neutropenia. Crit Care. (2013) 17:R169. 10.1186/cc12848 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.RECOVERY Collaborative Group, Horby P, Lim WS, Emberson JR, Mafham M, Bell JL, et al. Dexamethasone in hospitalized patients with Covid-19. N Engl J Med. (2021) 384:693–704. 10.1056/NEJMoa2021436 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Leisman DE, Ronner L, Pinotti R, Taylor MD, Sinha P, Calfee CS, et al. Cytokine elevation in severe and critical COVID-19: a rapid systematic review, meta-analysis, and comparison with other inflammatory syndromes. Lancet Respir Med. (2020) 8:1233–44. 10.1016/S2213-2600(20)30404-5 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Figure 1

Strobe diagram.

Supplementary Table 1

Healthy volunteers' characteristics.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.


Articles from Frontiers in Medicine are provided here courtesy of Frontiers Media SA

RESOURCES