Abstract
Background and aims
To investigate the prognostic value of blood neurofilament light chain protein (NfL) levels in the acute phase of coronavirus disease 2019 (COVID-19).
Methods
We conducted an individual participant data (IPD) meta-analysis after screening on MEDLINE and Scopus to May 23rd 2022. We included studies with hospitalized adult COVID-19 patients without major COVID-19-associated central nervous system (CNS) manifestations and with a measurement of blood NfL in the acute phase as well as data regarding at least one clinical outcome including intensive care unit (ICU) admission, need of mechanical ventilation (MV) and death. We derived the age-adjusted measures NfL Z scores and conducted mixed-effects modelling to test associations between NfL Z scores and other variables, encompassing clinical outcomes. Summary receiver operating characteristic curves (SROCs) were used to calculate the area under the curve (AUC) for blood NfL.
Results
We identified 382 records, of which 7 studies were included with a total of 669 hospitalized COVID-19 cases (mean age 66.2 ± 15.0 years, 68.1% males). Median NfL Z score at admission was elevated compared to the age-corrected reference population (2.37, IQR: 1.13–3.06, referring to 99th percentile in healthy controls). NfL Z scores were significantly associated with disease duration and severity. Higher NfL Z scores were associated with a higher likelihood of ICU admission, need of MV, and death. SROCs revealed AUCs of 0.74, 0.80 and 0.71 for mortality, need of MV and ICU admission, respectively.
Conclusions
Blood NfL levels were elevated in the acute phase of COVID-19 patients without major CNS manifestations and associated with clinical severity and poor outcome. The marker might ameliorate the performance of prognostic multivariable algorithms in COVID-19.
Supplementary Information
The online version contains supplementary material available at 10.1007/s00415-023-11768-1.
Keywords: COVID-19, Biomarker, Prognosis, NfL
Introduction
Since the outbreak of the pandemic in January 2020, the management of coronavirus disease 2019 (COVID-19) has rapidly become a priority in all healthcare organisations worldwide [1–3]. COVID-19 is a systemic disease primarily affecting the respiratory system, although 30% of all infected individuals complain about central and peripheral neurological manifestations [1–3]. In this regard, various pathogenetic pathways may lead to neuronal damage, such as direct viral invasion, cytokines storm, para- or post-infectious autoimmunity, and secondary effects of a severe multi-organ dysfunction [4, 5]. The introduction of ultrasensitive immunoassays has allowed the assessment of blood neuronal and glial biomarkers, as correlates of central nervous system (CNS) involvement, in large and longitudinal cohorts of primary and non-primary neurological diseases, including COVID-19 [6–9]. In particular, neurofilament light chain protein (NfL) has gained significant attention as a marker of neuroaxonal injury, given its ability to accurately track subclinical axonal pathology, monitor disease course, and predict long-term outcomes in different neurological and systemic conditions [7, 9].
Cases with major COVID-19-associated CNS manifestations, such as acute cerebrovascular events, (meningo-) encephalitis and seizures/status epilepticus, showed significantly increased cerebrospinal fluid (CSF) and blood NfL concentrations due to ongoing neuronal damage [10–14]. However, the reported blood NfL increase also in COVID-19 cases with only mild-to-moderate (e.g., anosmia, headache) or without specific neurological symptoms [15, 16] suggested that a subtle neuronal damage might be even more frequent and still underestimated in COVID-19. On the other side, cases with severe COVID-19 showed a sustained NfL elevation at follow-up, possibly reflecting a persistent neuronal injury [17, 18] (Fig. 1). Most interestingly, both prospective and cross-sectional studies have demonstrated an association between NfL and unfavourable clinical outcomes, encompassing death, intensive care unit (ICU) admission, and mechanical ventilation (MV) in hospitalized COVID-19 patients [15, 17–21].
However, NfL median levels varied largely among different cohorts, probably because of heterogeneous inclusion criteria, such as differences in disease duration and severity, and lack of systematic NfL value adjustment according to known influencing factors (e.g., age) [6, 7, 13, 22–24]. In this regard, the usage of the age-adjusted NfL Z score, based on large healthy control cohorts may estimate the deviation from normal NfL concentrations to better assess which NfL changes might be clinically relevant at the individual level [7, 22]. Further, the accuracy of NfL in the outcome prediction varied broadly across studies, limiting the derivation of any sort of standardised thresholds. To overcome these limitations, we conducted an individual participant data (IPD) meta-analysis to test whether the NfL Z score in the acute phase of COVID-19 may aid prognostication in the real-life scenario of hospitalized cases with COVID-19 without major COVID-19 associated CNS manifestations.
Methods
Our IPD meta-analysis protocol followed the Preferred Reporting Items for Systematic Reviews and meta-analysis guidelines for IPD systematic reviews (PRISMA-IPD) [25] and was registered on the PROSPERO registry (CRD42022358924).
Search strategy and selection criteria
Six authors (MF, AA, SAR, LB, RO, MR) systematically searched MEDLINE (PubMed) and Scopus for articles published from databases inception to May 23rd, 2022 addressing the role of biomarkers in predicting the outcomes of interest. An a priori search string was developed with 3-steps Delphi method to include terms for (i) NfL as a biomarker and (ii) COVID-19 as the disease of interest (Supplementary Box 1). Results were restricted to original articles in English, German, or Italian language. A priori criteria for inclusion were: (1) hospitalized individuals, (2) age ≥ 18 years, (3) PCR- or radiologically based COVID-19 diagnosis (Fig. 2, Supplementary Table 1), (4) a measurement of blood NfL during the acute phase and (5) available data regarding at least one outcome among ICU admission, need of MV and death (primary outcome). We excluded cases diagnosed with major COVID-19-associated CNS manifestations [acute cerebrovascular events, (meningo-)encephalitis, seizures or status epilepticus] [2] at the time of blood sampling. We included only studies with sufficient information to calculate the age- adjusted NfL Z score (see below). Study selection was conducted on Rayyan online platform (rayyan.ai). Titles and abstracts were screened independently. Potentially relevant articles were acquired in full text and assessed for eligibility by the same six authors working in pairs. The final selection was shared among all the six authors. Disagreements were resolved by consensus.
Data extraction and processing
We invited authors of the included studies to participate by providing IPD on a standardized collection tool with case definitions (Supplementary Tables 1, 2 and 3). We collected demographic information, comorbidities and COVID-19 severity according to a 4 levels scoring (mild, moderate, severe and critical) adapted from the World Health Organization (WHO) criteria for the clinical management of COVID-19 [26] (Supplementary Table 2); timing (i.e., days from onset to admission and to blood collection), used NfL assay and kit, biological matrix (plasma or serum) and values of NfL, Horowitz index (PaO2/FiO2 ratio) and other laboratory parameters [absolute lymphocyte and neutrophil count, lactate dehydrogenase (LDH), C-reactive protein (CRP), creatinine levels] which have been described as prognostic factors in COVID-19 [27]. Submitted datasets were processed by two investigators (FC, MF) to harmonise data recording across studies in accordance with pre-defined variable types. If a contributor was unable to harmonise data with our format, we allowed to report the original study data; these data were extracted and fully checked by two reviewers (FC, MF) with a standardised approach, then the harmonisation was shared with all investigators.
All studies included in this IPD meta-analysis received ethics approval (see section below). All subjects gave written informed consent to be enrolled in the studies included in this IPD meta-analysis. Contributors ensured local regulatory and data sharing agreement were in place.
Bias assessment
Quality assessment was performed with the Newcastle–Ottawa scale (NOS) [28]. NOS includes assessment of selection of cohort explored, control cohort, length, and adequacy of observation, as well as comparability of control and experimental cohorts. We summarized the assessment as low, moderate, or high according to the overall score achieved by each study.
Statistical analysis
Statistical analyses were carried out with IBM SPSS Statistics V.21 (IBM, Armonk USA), GraphPad Prism V.7 (GraphPad Software, La Jolla, California, USA) and R version 4.2.2 (R Foundation, Vienna, Austria).
As NfL correlates with age [7, 22], NfL age-adjusted Z score were calculated using an available large reference database (n = 4532 samples from control persons) [22]. Generalized Additive Model for Location, Scale and Shape was used to model NfL variations with age and to derive individual NfL Z score, a continuous measure indicating how strongly (in terms of number of standard deviations) the adjusted NfL value deviates from levels in healthy controls. Plasma NfL concentrations were converted into corresponding serum values for Z score calculations according to a published equation [22]. Single Sample Wilcoxon-signed rank test was used to compare the reported NfL Z scores in subjects with COVID-19 to the reported, healthy population average (Z score of 0).
Meta-analysis was conducted using mixed-effects modelling, with centre/study implemented as random effect. Generalized linear mixed-effects models (GLMMs) were applied to test the associations between NfL Z scores (dependent variable), and clinical features or other potential prognostic variables (sex, PaO2/FiO2, hypertension, diabetes, absolute neutrophil and lymphocyte count, creatinine, LDH, CRP) [27]. Additional GLMMs with binary clinical outcomes (ICU admission, need of MV and death) as dependent variables were fitted to explore the association between NfL Z scores and the outcome of interest after correction for relevant covariates. Given the presence of missing data, significant covariates at univariate analyses were included in multivariable models only if reported in at least 50% patients with available outcome data and if obtained for at least 2 centres. For each model, we reported data on estimate coefficient and/or odds ratio (OR), associated 95% confidence intervals (95%CI) as well as p-values.
The lack of a common cut-off among studies precluded the traditional bivariate models for accuracy testing. First, we used a 2-stage random-effects model integrating multiple thresholds within each study to obtain a summary receiver-operating characteristic curve (SROC) from meta-analysis of diagnostic accuracy. Further, we investigated the performance of NfL Z score in the assessment of poor outcome by calculating the area under the curve (AUC) from the ROCs derived from GLMMs. We estimated optimal thresholds through maximized Youden index (sensitivity + specificity− 1) or through Youden Index after weighting specificity at 75, 85, and 95%, defined a-priori as progressive reasonable thresholds for prognostications, and we reported each respective sensitivity. All analyses were considered statistically significant with p < 0.05.
Results
We identified 382 records by database searches. Seven studies reached final stage, providing IPD for 688 hospitalized COVID-19 cases [11, 12, 19–21, 29, 30]. The bias assessment did not reveal substantial selection or reporting bias with all studies being of high quality. A total of 669 participants referred to 7 centres (Oslo n = 26, Drammen n = 20, Milan n = 104, Uppsala n = 19, Brescia n = 332, Basel n = 26, Jacksonville n = 142) met the inclusion criteria and were included in the analysis (Fig. 2, 3, Supplementary Table 4).
Cohort description
Demographic, clinical, and laboratory features of included cohorts are reported in Table 1 and Supplementary Tables 4 and 5. Mean age at blood sampling was 66.2 ± 15.0 years (males n = 442, 68.1%), median disease duration from symptom onset to admission was 7 (IQR: 4–9) days, and from onset to biomarker assessment was 7 (IQR: 2–13) days. Hypertension and diabetes were described in 23.9% and 12.5% of cases with available data, respectively. COVID-19 diagnosis was confirmed by RT-PCR on nasopharyngeal swab in all but 5 cases (99.3%), who had a diagnosis of COVID-19 pneumonia based on typical radiological findings (in the early phase of the pandemic [20]). Included participants were mainly diagnosed with critical disease course (391 out of 431 with available classification, 90.7%), while 13 (3.0%) and 27 (6.3%) had moderate and severe disease, respectively. Elevated CRP and LDH values, a normal absolute neutrophil count, and a low absolute lymphocyte count were typical findings in COVID-19 (Table 1). Compared to the healthy control range (i.e., NfL Z score of 0), median NfL Z scores were higher in the included COVID-19 cases (median: 2.37; interquartile range, IQR: 1.13–3.06 referring to the 99th percentile in healthy controls, p < 0.001) (Supplementary Figs. 1 and 2). Moreover, 336/669 (50.2%) patients had NfL values above the 99th percentile of the corresponding healthy range (median: 99.2, IQR: 87.0–99.9, range: 0.01–100.0). The median hospitalization time was 14 days (IQR: 6—30). During the hospital stay, 74/233 subjects (31.8%) required MV with a median MV duration of 7.5 days (IQR: 3–16). Moreover, 316 out of 609 (51.9%) were admitted to the ICU. Finally, data on survival were available for all participants and death during hospitalization occurred in 180 cases (26.9%). In hospital, death was associated to COVID-19 itself or its related complications in all subjects Fig. 4.
Table 1.
Value | n. cases with available data (%*) | |
---|---|---|
Sex [(female/male) (frequency (%)] | 207 (31.9)/442 (68.1) | 649 (97.0) |
Age (years) [mean (± sd) (range)] | 66.2 (± 15.0) (22.0–99.1) | 669 (100.0) |
NfL (pg/ml) [median (IQR) (range)] | 35.8 (16.8–74.6) (2.9–2233.2) | 669 (100.0) |
NfL Z score [median (IQR) (range)] | 2.37 (1.13–3.06) (−3.72–4.17) | 669 (100.0) |
NfL percentiles [median (IQR) (range)] | 99.1 (87.0–99.9) (0.01–100.0) | 669 (100.0) |
Current disease | ||
Time from onset to admission (days) [median (IQR)] | 7 (4–9) | 241 (36.0) |
Time from onset to blood sampling (days) (disease duration) [median (IQR)] | 7 (2–13) | 399 (59.6) |
COVID-19 severity (moderate/severe/critical) [frequency (%)] | 13 (3.0)/27 (6.3)/391 (90.7) | 431 (64.4) |
Medical history | ||
Diabetes mellitus (yes/no) [frequency (%)] | 47 (12.5)/330 (87.5) | 377 (56.4) |
Hypertension (yes/no) [frequency (%)] | 94 (23.9)/300 (76.1) | 394 (58.9) |
Laboratory parameters | ||
Absolute lymphocyte count (× 109/l) [median (IQR)] | 0.90 (0.56–1.30) | 249 (37.2) |
Absolute neutrophil count (× 109/l) [median (IQR)] | 5.2 (3.5–8.0) | 152 (22.7) |
CRP (mg/l) [median (IQR)] | 75.4 (17.2–145.6) | 302 (45.1) |
LDH (U/l) [median (IQR)] | 338 (260–461) | 211 (31.5) |
Creatinine (mg/dl) [median (IQR)] | 0.83 (0.72–1.04) | 149 (22.3) |
PaO2/FiO2 ratio [median (IQR)] | 227 (109–329) | 141 (21.1) |
Clinical outcomes | ||
Days of hospitalization [median (IQR)] | 14 (6–30) | 469 (70.1) |
ICU admission (yes/no) [frequency (%)] | 316 (51.9)/293 (48.1) | 609 (91.0) |
Mechanical ventilation (yes/no) [frequency (%)] | 74 (31.8)/159 (68.2) | 233 (34.8) |
Days of mechanical ventilation [median (IQR)] | 7.5 (3–16) | 52 (7.8) |
Death (yes/no) [frequency (%)] | 180 (26.9)/489 (73.1) | 669 (100.0) |
*calculated in the whole cohort of 669 participants
Associations between NfL, clinical, and laboratory variables
We found significant associations between NfL Z scores (dependent variable) and most clinical and laboratory variables in univariable analyses (Table 2). NfL Z scores were significantly associated with COVID-19 severity with NfL Z scores approximately 1.4 unit higher in critical vs. moderate cases [estimate: 1.364 (95%CI: 0.686–2.042), p = 0.0001] and correlated with disease duration (time from onset to blood sampling) [estimate: 0.040 (95%CI: 0.024–0.056), p < 0.0001] (Table 2). Moreover, NfL Z scores were 0.3 units higher in participants with a history of hypertension [estimate: 0.347 (95%CI: 0.072–0.623), p = 0.014] and approximately 0.7 units higher in those with diabetes mellitus [estimate: 0.728 (95%CI: 0.380–1.077), p = 0.0001]. Among laboratory parameters, CRP [estimate: 0.002 (95%CI: 0.0006–0.004), p = 0.005], LDH [estimate: 0.001 (95%CI: 0.0003–0.002), p = 0.003], creatinine [estimate: 0.948 (95%CI: 0.613–1.283), p < 0.001], but not absolute lymphocyte and neutrophil counts, were related to NfL Z scores. Low values of PaO2/FiO2 ratio were associated with higher NfL Z scores [estimate: − 0.003 (− 0.004– − 0.001), p = 0.0003].
Table 2.
Univariate GLMM analysis | Estimate (95%CI) | P value | n. cases |
---|---|---|---|
Male Sex | 0.174 (− 0.040 – 0.389) | 0.112 | 649 |
Current disease | |||
Time from onset to admission | − 0.006 (− 0.034 – 0.022) | 0.685 | 241 |
Time from onset to blood sampling (disease duration) | 0.040 (0.024–0.056) | < 0.0001 | 399 |
COVID-19 severity (severe vs. moderate) | 0.715 (− 0.614–2.044) | 0.379 | 431 |
COVID-19 severity (critical vs. moderate) | 1.364 (0.686–2.042) | 0.0001 | |
Medical history | |||
Diabetes mellitus | 0.728 (0.380–1.077) | 0.0001 | 377 |
Hypertension | 0.347 (0.072–0.623) | 0.014 | 394 |
Laboratory parameters | |||
Absolute lymphocyte count | 0.031 (− 0.043–0.104) | 0.462 | 249 |
Absolute neutrophil count | 0.005 (− 0.022–0.031) | 0.736 | 152 |
CRP | 0.002 (0.0006–0.004) | 0.005 | 302 |
LDH | 0.001 (0.0003–0.002) | 0.003 | 211 |
Creatinine | 0.948 (0.613–1.283) | < 0.0001 | 149 |
PaO2/FiO2 ratio | − 0.003 (− 0.004– − 0.001) | 0.0003 | 141 |
Associations between NfL and clinical outcome measures
In the whole cohort, univariate GLMM analyses identified NfL Z score, sex, disease duration (days from symptoms onset to blood sampling), COVID-19 severity, diabetes mellitus, LDH and PaO2/FiO2 ratio as variables associated with ICU admission in COVID-19 cases (Table 3). Given the proportion of missing data, multivariable GLMMs for each outcome included all covariates that tested significant at univariate analyses, were available in at least 50% patients and were obtained for at least 2 centres. In the multivariable analysis, NfL Z score remained a significant independent predictor of ICU admission (Table 3). In detail, each unit increase in NfL Z score was associated with a 2.5-fold increase in the likelihood for ICU admission [OR: 2.50 (95%CI 1.17–5.37), p = 0.018], after correction for sex, COVID-19 severity, presence of diabetes mellitus, and disease duration.
Table 3.
Univariate GLMM analysis | OR (95%CI) | P value | n. cases with available data |
---|---|---|---|
NfL Z score | 1.43 (1.24–1.64) | < 0.0001 | 609 |
Male Sex | 2.26 (1.54–3.32) | < 0.0001 | 589 |
Age | 0.99 (0.98–1.00002) | 0.0504 | 609 |
Current disease | |||
Time from onset to admission | 1.02 (0.96–1.08) | 0.585 | 204 |
Time from onset to blood sampling (disease duration) | 1.10 (1.06–1.14) | < 0.0001 | 362 |
COVID-19 severity (severe vs. moderate) | > 100 (0 – > 1000) | 1.0 | 371 |
COVID-19 severity (critical vs. moderate) | 540.65 (2.63 – > 1000) | 0.0206 | |
Medical history | |||
Diabetes mellitus | 2.39 (1.21–4.71) | 0.012 | 377 |
Hypertension | 0.87 (0.52–1.46) | 0.606 | 394 |
Laboratory parameters | |||
Absolute lymphocyte count | 1.01 (0.80–1.27) | 0.926 | 215 |
Absolute neutrophil count | 1.02 (0.97–1.08) | 0.453 | 152 |
CRP | 1.003 (0.9997–1.006) | 0.079 | 267 |
LDH | 1.004 (1.002–1.006) | 0.0001 | 177 |
Creatinine | 1.95 (0.95–3.99) | 0.069 | 149 |
PaO2/FiO2 ratio | 0.989 (0.984–0.994) | < 0.0001 | 141 |
Multivariable GLMM analysis | OR (95%CI) | P value | n. cases |
---|---|---|---|
NfL Z score | 2.50 (1.17–5.37) | 0.018 | 74 |
Male sex | 2.30 (0.47–11.25) | 0.304 | |
Time from onset to blood sampling | 1.10 (1.03–1.18) | 0.005 | |
COVID-19 severity (critical vs moderate) | 9.76 (0.31–304.67) | 0.194 | |
Diabetes mellitus | 3.69 (0.39–34.89) | 0.254 |
When the need of MV was considered as the outcome, NfL Z score, sex, disease duration, and CRP resulted significant predictors in the univariate GLMM (Table 4). Similarly, in the multivariable GLMM, higher NfL Z score values were significantly associated with the need of MV (Table 4). After accounting for sex and disease duration, we found a 2.6-fold increase [OR: 2.63 (95%CI: 1.79–3.87), p < 0.0001] in the likelihood of need of MV with each unit increase in NfL Z score.
Table 4.
Univariate GLMM analysis | OR (95%CI) | P value | n. cases with available data |
---|---|---|---|
NfL Z score | 2.19 (1.62–2.98) | < 0.0001 | 233 |
Male Sex | 2.74 (1.28–5.86) | 0.0096 | 213 |
Age | 0.982 (0.962–1.003) | 0.090 | 233 |
Current disease | |||
Time from onset to admission | 0.90 (0.66–1.21) | 0.485 | 30 |
Time from onset to blood sampling (disease duration) | 1.09 (1.03–1.15) | 0.0012 | 191 |
COVID-19 severity (severe vs. moderate) | 26.24 (0.95–723.90) | 0.0536 | 99 |
COVID-19 severity (critical vs. moderate) | 11.52 (0.54–245.83) | 0.118 | 99 |
Medical history | |||
Diabetes mellitus | – | – | * |
Hypertension | 0.53 (0.05–6.19) | 0.610 | 36 |
Laboratory parameters | |||
Absolute lymphocyte count | 1.05 (0.87–1.26) | 0.610 | 41 |
Absolute neutrophil count | 1.24 (0.93–1.63) | 0.140 | 59 |
CRP | 1.016 (1.006–1.026) | 0.0009 | 87 |
LDH | – | – | – |
Creatinine | 3.12 (0.85–11.46) | 0.087 | 45 |
PaO2FiO2 ratio | 1.04 (0.97–1.11) | 0.267 | 40 |
Multivariable GLMM analysis | OR (95%CI) | p-value | n. cases |
---|---|---|---|
NfL Z score | 2.63 (1.79–3.87) | < 0.0001 | 187 |
Male sex | 2.55 (0.99–6.60) | 0.053 | |
Time from onset to blood sampling (disease duration) | 1.05 (1.004–1.10) | 0.034 |
*data available only for one centre
Further, NfL Z score, age, days from onset to admission, the presence of diabetes mellitus, absolute lymphocyte count, CRP, LDH, creatinine and PaO2/FiO2 ratio were significantly associated with death at univariate GLMM (Table 5). After accounting for covariates, NfL Z score had still a significant negative association with survival (Table 5). Here, each unit increase in NfL Z score was associated with a 1.7-fold higher likelihood of death, after accounting for age and the presence of diabetes mellitus [OR: 1.70 (95%CI: 1.34–2.15), p < 0.0001].
Table 5.
Univariate GLMM analysis | OR (95%CI) | P value | n. cases with available data |
---|---|---|---|
NfL Z score | 1.92 (1.59–2.33) | < 0.0001 | 669 |
Male Sex | 1.06 (0.71–1.59) | 0.764 | 649 |
Age | 1.04 (1.03–1.06) | < 0.0001 | 669 |
Current disease | |||
Time from onset to admission | 0.88 (0.82–0.96) | 0.002 | 241 |
Time from onset to blood sampling | 0.991 (0.96–1.02) | 0.560 | 399 |
COVID-19 severity (severe vs. moderate) | > 100 (0–> 1000) | 0.993 | 431 |
COVID-19 severity (critical vs. moderate) | > 100 (0–> 1000) | 0.993 | 431 |
Medical history | |||
Diabetes mellitus | 3.30 (1.67–6.53) | 0.0006 | 377 |
Hypertension | 1.51 (0.87–2.62) | 0.14 | 394 |
Laboratory parameters | |||
Absolute lymphocyte count | 0.62 (0.40–0.96) | 0.034 | 249 |
Absolute neutrophil count | 1.005 (0.95–1.07) | 0.876 | 152 |
CRP | 1.005 (1.002–1.008) | 0.0006 | 302 |
LDH | 1.004 (1.002–1.005) | 0.0002 | 211 |
Creatinine | 3.29 (1.45–7.47) | 0.004 | 149 |
PaO2/FiO2 ratio | 0.996 (0.992–0.999) | 0.022 | 141 |
Multivariable GLMM analysis | OR (95%CI) | p-value | n. cases |
---|---|---|---|
NfL Z score | 1.70 (1.34–2.15) | < 0.0001 | 377 |
Age | 1.06 (1.04–1.08) | < 0.0001 | |
Diabetes mellitus | 1.96 (1.001–3.83) | 0.0495 |
ROC curve analyses
SROCs for NfL Z score with mortality as primary outcome are showed in Fig. 3. After setting specificity at 75%, 85% and 95%, the optimal NfL Z score thresholds for death were 2.73 (sensitivity: 0.49, specificity: 0.79), 3.06 (sensitivity: 0.36, specificity: 0.86), and 4.01 (sensitivity: 0.09, specificity: 0.96), respectively. At maximized Youden Index, a cut-off of 1.96 yielded 78% sensitivity and 59% specificity for mortality (AUC: 0.74, 95%CI: 0.60–0.83). SROCs for need of MV (AUC: 0.80, 95%CI: 0.64–0.89) and ICU admission (AUC: 0.71, 95%CI: 0.57–0.80) showed also a fair predictive value of NfL Z score, with sensitivity being low at a priori set specificity boundaries (Supplementary Fig. 3). In the ROC analyses derived from univariate and multivariable GLMMs, the performance of NfL Z score to discriminate participants with poor from those with good outcome was good, yielding an AUC > 0.70 (Supplementary Table 6). The best accuracy was yielded by the multivariate GLMM including NfL Z score, sex, time from onset to blood sampling, COVID-19 severity and diabetes mellitus as variables (AUC: 0.92, 95%CI: 0.86–0.98) in the prediction of ICU admission (Supplementary Table 6).
Discussion
In this IPD meta-analysis, we investigated the prognostic role of blood NfL in a large and comprehensive cohort of 669 hospitalized adult participants with COVID-19 admitted to 7 hospitals worldwide.
We showed that blood NfL values were typically elevated in hospitalized COVID-19 cases even without major COVID-19- associated CNS manifestations. Like previous reports, NfL Z scores correlated significantly with clinical severity as higher values were found in most severe cases [18, 31]. The significant associations between NfL Z score and CRP or Horowitz index (PaO2/FiO2 ratio), an established measure of lung injury severity, may support the complex interplay between hypoxic injury, inflammatory response and other mechanisms that contribute to neuroaxonal damage in COVID-19 [17, 18, 32]. Taking all together, our data suggest that the rise of the biomarker in blood might reflect the degree of a multifactorial neuroaxonal injury, which occurs in the acute phase, even in absence of major CNS manifestations, and, in turn, relates to disease severity.
Most interestingly, we provided here evidence about the strong relationships between higher blood NfL values and higher likelihoods of ICU admission, need of MV, and death in hospitalized COVID-19 cases. Of note, NfL remained significantly associated with unfavourable outcomes, even after adjustment for covariates. However, a very recent and large cohort study from two centres [32] found contradicting results in regard to the association between blood NfL and mortality in hospitalized participants with COVID-19. Nevertheless, Smeele et al. postulated a potential relationship between faster mortality and NfL values assessed at admission but not during disease course. In line with this hypothesis, NfL at admission represented the mainstay of included values in our meta-analysis, explaining, thus, our findings of the strong link between the marker and survival [32].
Nevertheless, at least in differentiating survivors from non-survivors, the accuracy of NfL Z score in isolation was still insufficient to provide meaningful and univocal information with the cut-offs set. Indeed, despite reaching an overall 74% accuracy, the critical issue of low sensitivity at non-absolute thresholds for specificity is sufficient to discourage attempts to promote the single neuronal marker as the main driver of prognosis, particularly given that COVID-19 is a complex and multisystemic disorder. On the other hand, blood NfL might well represent a complementary, rapid and robust test for a multimodal assessment to simplify the early identification of cases at higher risk.
On another issue, our results are in line with recent findings in other critical conditions, such as hypoxic-ischemic encephalopathy after cardiac arrest (CA), sepsis-associated encephalopathy (SAE) and traumatic brain injury (TBI), in whom blood NfL values were significantly associated with disease severity as well as clinical and functional outcome [7, 33–37]. In patients after CA, blood NfL had shown a higher prognostic value compared to that of classical investigations, such as blood markers [neuron-specific enolase (NSE), and S100 calcium-binding protein b (S100b)], head computed tomography (CT) and electro-encephalogram [7, 34]. Similarly, in the context of TBI, the accuracy of NfL in detecting CT or magnetic resonance imaging pathology seemed to outperform that of S100b or tau and to be similar to that of Glial Fibrillary Acidic Protein (GFAP) [37]. Nevertheless, this represents a topic which is still largely unexplored in COVID-19.
Moreover, it might be also of interest to investigate whether repeated measurements with trends over time might further improve the accuracy of blood NfL to predict clinical outcomes. Indeed, Maskevar et al. [29], found a progressive increase in biomarker levels close to the point of death, while such elevation was not observed in subjects who eventually survived. Furthermore, blood NfL should be tested in multicentric cohorts of cases with major COVID-19 associated CNS manifestations, in order to assess the prognostic performance in those subjects.
In addition, our study replicates, in a large cohort of participants, the potential influence of several physiological and pathophysiological factors on blood NfL. The strong correlation between blood NfL and age is well-known in literature, and it is possibly related to ageing and age-related comorbidities [6, 7]. Therefore, the adoption of NfL Z scores instead of raw biomarker concentrations [22] allowed to add robustness to our findings, overcoming the potential lower consistency of unadjusted analyses and consistently shrinking the comparability bias. As previously described [7, 13, 24, 38], the presence of renal dysfunction, hypertension and diabetes mellitus also influenced blood NfL variability in our cohort.
The major strength of our study relies on the generalisation of findings derived from small, heterogeneous and geographically distinct cohorts to the population at large, allowing to overcome a potential single-centre bias. Further, the large proportion of patients with critical disease included in the meta-analysis might highlight the potential of NfL at admission, alongside other prognostic markers, to predict clinical outcome and appropriately escalate treatment strategies to this population at risk. As the main limitation of the study, we acknowledge that many of the variables considered for the analyses, especially laboratory parameters (e.g., creatinine levels, PaO2/FiO2 ratio, etc.), comorbidities and the need of MV as outcome, did not have complete data to perform models including all participants. Further, we cannot exclude that some patients may have suffered from concomitant COVID-19-related peripheral nervous system manifestations which may also increase blood NfL levels (e.g., critical illness polyneuropathy, Guillain-Barré syndrome, etc.) [7, 39]. As additional limitations we have to mention the lack of a comparative analysis of NfL prognostic performance with that of established clinical scales [e.g. sequential organ failure assessment (SOFA), acute physiology and chronic health evaluation II (APACHE II) scores [40], etc.] or other candidate markers in blood or olfactory mucosa (e.g. GFAP, substance P) [8, 41].
In conclusion, the present IPD meta-analysis showed that blood NfL is significantly associated with disease severity and clinical outcomes in COVID-19 cases without major COVID-19 associated CNS manifestations. The assessment of NfL together with other biological and clinical markers of COVID-19 severity may allow to create reliable scores of easy implementation for outcome prognostication in clinical practice.
Supplementary Information
Below is the link to the electronic supplementary material.
Acknowledgements
The authors wish to thank all colleagues who contributed to the data collection.
Author contributions
Conception and design of the study: AA, LB, MR, RO, MF and SAR; literature search, acquisition and analysis of data: AA, LB, MR, RO, MF and SAR; drafting of the manuscript: AA, LB, MR, MF and SAR. Critical revision and final approval of the manuscript: all authors.
Funding
Studies included in this IPD meta-analysis received the following support: NIH/NIDDS Grant no. 3R35NS097273-05S1, Oslo University Hospital, Research Council of Norway Grant no. 312780, Vivaldi Invest A/S owned by Jon Stephenson von Tetzchener, Research Program of NIAD/NIH, Regione Lombardia, Italy (project “Risposta immune in pazienti con COVID-19 e co-morbidità”), IRCCS Ospedale San Raffaele, Italian Ministry of Health and donation by Mrs. Luisella Carrozza Cassani (SDF).
Data availability
The complete dataset used for this IPD will be shared with all qualified researchers upon request to the corresponding authors and after approval from participating centres who provided data.
Declarations
Conflict of interest
AA received 2 research grants from UCSF Weill Institute for Neurosciences and from The German Multiple Sclerosis Society, all unrelated to the work presented in this paper. JK received 4 speaker fees, research support, travel support and/or served on advisory boards of the Swiss 5 MS Society, Swiss National Research Foundation (320030_189140/1), University of Basel, 6 Progressive MS Alliance, Bayer, Biogen, Celgene, Merck, Novartis, Roche and Sanofi, all unrelated to the work presented in this paper. KB has served as a 13 consultant, at advisory boards, or at data monitoring committees for Abcam, Axon, Biogen, 14 JOMDD/Shimadzu. Julius Clinical, Lilly, MagQu, Novartis, Roche Diagnostics, and Siemens 15 Healthineers, and is a co-founder of Brain Biomarker Solutions in Gothenburg AB (BBS), 16 which is a part of the GU Ventures Incubator Program, all unrelated to the work presented in this paper. SS reports personal fees as speaker or advisor from Abbott, Allergan-Abbvie, AstraZeneca, Eli Lilly, Lundbeck, Novartis, NovoNordisk, Pfizer, Teva; 3 research grants from Allergan, Novartis, Uriach, all unrelated to the work presented in this paper. She is President elect of the European Stroke Organisation, second vice president of the European Headache Federation and a member of the Women Initiative for Stroke in Europe. HT reports 8 lectures and travel from Alexion, Bayer, Biogen, Celgene/Bristol-Myers-Squibb, 9 GlaxoSmithKline, Janssen, Genzyme, Merck Serono, Novartis, Roche, Sanofi/Genzyme, 10 Siemens and Teva, and received research support from Chemische Fabrik Karl Bucher 11 GmbH, German Multiple Sclerosis Society (DMSG) and the German Ministry for Education 12 and Research (BMBF), all unrelated to the work presented in this paper. AHA received 2 research grants from Medtronic and Boehringer Ingelheim, honoraria for advice or lecturing from Bayer, BMS, Pfizer, MSD, Boehringer Ingelheim, Abbvie, Teva, Novartis, Roche, Lundbeck and participated on a data safety monitoring for Lundbeck, all unrelated to the work presented in this paper. MO gave scientific advice to Axon, Biogen Idec, Fujirebio and Roche, all unrelated to the work presented in this paper. AMD-R received 3 grants from Norvegian Research Council, EU Horizon 2020, Hesle Sør-øst and participated on a data safety monitoring from EU Horizon 2020, all unrelated to the work presented in this paper. HZ served at scientific advisory boards and/or as a consultant for Abbvie, Acumen, Alector, Alzinova, ALZPath, Annexon, Apellis, Artery Therapeutics, AZTherapies, CogRx, Denali, Eisai, Nervgen, Novo Nordisk, Optoceutics, Passage Bio, Pinteon Therapeutics, Prothena, Red Abbey Labs, reMYND, Roche, Samumed, Siemens Healthineers, Triplet Therapeutics, and Wave, has given lectures in symposia sponsored by Cellectricon, Fujirebio, Alzecure, Biogen, and Roche, and is a co-founder of Brain Biomarker Solutions in Gothenburg AB (BBS), which is a part of the GU Ventures Incubator Program, all unrelated to the work presented in this paper. DM received support for attending meetings and/or travel from Novartis, Biogen, Sanofi and Merck, participated on a scientific advisory board for Merck, consulting fees and payment for presentations from Roche and Novartis, all unrelated to the work presented in this paper. MF received support for attending meetings and/or travel from Biogen, Roche, Novartis, Merck and Sanofi, all unrelated to the work presented in this paper. SAR received support from the Medical Faculty of Martin-Luther-University Halle-Wittenberg (Clinician Scientist-Programm No. CS22/06), unrelated to the work presented in this paper. Other authors report no competing interests.
Ethical approval and consent to participate
This IPD meta-analysis protocol was registered on PROSPERO registry (CRD42022358924). Studies included in this IPD meta-analysis received ethics approval (Swedish Ethical Review Authority 2020–01883, Ethikkommission Nordwest- und Zentralschweiz (EKNZ) No. 2020–0056, Mayo Clinic Institutional Review Board #20–003457, Comitato Etico Provinciale di Brescia: NP 4000–Studio CORONAlab and NP 4408–Studio CORONAlab, IRCCS Ospedale San Raffaele Ethic Committee protocol no. 34/int/2020, South-Eastern Norway Regional Health Authority reference number 106624). All subjects gave written informed consent to be enrolled in the studies included in this IPD meta-analysis. Contributors ensured local regulatory and data sharing agreement were in place.
Footnotes
Ahmed Abdelhak, Lorenzo Barba and Michele Romoli equally contributed to the study.
Matteo Foschi and Samir Abu-Rumeileh shared the study coordination and last authorship.
Contributor Information
Matteo Foschi, Email: mattfos89@gmail.com.
Samir Abu-Rumeileh, Email: samir.aburumeileh@gmail.com.
References
- 1.Pezzini A, Padovani A. Lifting the mask on neurological manifestations of COVID-19. Nature Rev Neurol. 2020;16(11):767. doi: 10.1038/s41582-020-0398-3106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Ellul MA, Benjamin L, Singh B, et al. Neurological associations of COVID-19. Lancet Neurol. 2020;19(9):767. doi: 10.1016/S1474-4422(20)30221-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Jie GW, Ni Z, et al. Clinical characteristics of coronavirus disease 2019 in China. New Engl J Med. 2020;382(18):1708. doi: 10.1056/NEJMoa2002032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Baig AM, Khaleeq A, Ali U, Syeda H. Evidence of the COVID-19 virus targeting the CNS: tissue distribution, host-virus interaction, and proposed neurotropic mechanisms. ACS Chem Neurosci. 2020;11(7):995. doi: 10.1021/acschemneuro.0c00122. [DOI] [PubMed] [Google Scholar]
- 5.Li Y, Bai W, Hashikawa T. The neuroinvasive potential of SARS-CoV2 may play a role in the respiratory failure of COVID-19 patients. J Med Virol. 2020;92(6):552. doi: 10.1002/jmv.25728. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Khalil M, Pirpamer L, Hofer E, et al. Serum neurofilament light levels in normal aging and their association with morphologic brain changes. Nat Commun. 2020 doi: 10.1038/s41467-020-14612-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Abu-Rumeileh S, Abdelhak A, Foschi M, et al. The multifaceted role of neurofilament light chain protein in non-primary neurological diseases. Brain. 2022;9:328. doi: 10.1093/brain/awac328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Abdelhak A, Foschi M, Abu-Rumeileh S, et al. Blood GFAP as an emerging biomarker in brain and spinal cord disorders. Nat Rev Neurol. 2022;18(3):158–172. doi: 10.1038/s41582-021-00616-3. [DOI] [PubMed] [Google Scholar]
- 9.Khalil M, Teunissen CE, Otto M, et al. Neurofilaments as biomarkers in neurological disorders. Nat Revi Neurol. 2018;14(10):577. doi: 10.1038/s41582-018-0058-z. [DOI] [PubMed] [Google Scholar]
- 10.Pilotto A, Masciocchi S, Volonghi I, et al. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) encephalitis is a cytokine release syndrome: evidences from cerebrospinal fluid analyses. Clin Infect Dis. 2021;73(9):e3019–e3026. doi: 10.1093/cid/ciaa1933. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Virhammar J, Nääs A, Fällmar D, et al. Biomarkers for central nervous system injury in cerebrospinal fluid are elevated in COVID-19 and associated with neurological symptoms and disease severity. Eur J Neurol. 2021;28(10):3324–3331. doi: 10.1111/ene.14703. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Fällmar D, Rostami E, Kumlien E, et al. The extent of neuroradiological findings in COVID-19 shows correlation with blood biomarkers, Glasgow coma scale score and days in intensive care. J Neuroradiol. 2022;49(6):421–427. doi: 10.1016/j.neurad.2021.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Hay M, Ryan L, Huentelman M, et al. Serum Neurofilament Light is elevated in COVID-19 Positive Adults in the ICU and is associated with Co-Morbid Cardiovascular Disease, Neurological Complications, and Acuity of Illness. Cardiol Cardio Med. 2021;5(5):551–565. doi: 10.26502/fccm.92920221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Guasp M, Muñoz-Sánchez G, Martínez-Hernández E, et al. CSF Biomarkers in COVID-19 Associated Encephalopathy and Encephalitis Predict Long-Term Outcome. Front Immunol. 2022;13:866153. doi: 10.3389/fimmu.2022.866153. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Mariotto S, Savoldi A, Donadello K, et al. Nervous system: subclinical target of SARS-CoV-2 infection. J Neurol, Neurosurg Psychiat. 2020;91(9):1012. doi: 10.1136/jnnp-2020-323881. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Ameres M, Brandstetter S, Toncheva AA, et al. Association of neuronal injury blood marker neurofilament light chain with mild-to-moderate COVID-19. J Neurol. 2020;267(12):3576. doi: 10.1007/s00415-020-10050-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Kanberg N, Ashton NJ, Andersson LM, et al. Neurochemical evidence of astrocytic and neuronal injury commonly found in COVID-19. Neurology. 2020;95(12):1754. doi: 10.1212/WNL.0000000000010111. [DOI] [PubMed] [Google Scholar]
- 18.Kanberg N, Simrén J, Edén A, et al. Neurochemical signs of astrocytic and neuronal injury in acute COVID-19 normalizes during long-term follow-up. EBioMedicine. 2021 doi: 10.1016/j.ebiom.2021.103512. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Aamodt AH, Høgestøl EA, Popperud TH, et al. Blood neurofilament light concentration at admittance: a potential prognostic marker in COVID-19. J Neurol. 2021;268(10):3574–3583. doi: 10.1007/s00415-021-10517-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.De Lorenzo R, Loré NI, Finardi A, et al. Blood neurofilament light chain and total tau levels at admission predict death in COVID-19 patients. J Neurol. 2021;268(12):4436–4442. doi: 10.1007/s00415-021-10595-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Sutter R, Hert L, De Marchis GM, et al. Serum neurofilament light chain levels in the intensive care unit: comparison between severely ill patients with and without coronavirus disease 2019. Ann Neurol. 2021;89(3):610–616. doi: 10.1002/ana.26004. [DOI] [PubMed] [Google Scholar]
- 22.Benkert P, Meier S, Schaedelin S, et al. Serum neurofilament light chain for individual prognostication of disease activity in people with multiple sclerosis: a retrospective modelling and validation study. Lancet Neurol. 2022;21(3):246–257. doi: 10.1016/S1474-4422(22)00009-6. [DOI] [PubMed] [Google Scholar]
- 23.Harp C, Thanei GA, Jia X, et al. Development of an age-adjusted model for blood neurofilament light chain. Ann Clin Transl Neurol. 2022;9(4):444–453. doi: 10.1002/acn3.51524. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Fitzgerald KC, Sotirchos ES, Smith MD, et al. Contributors to serum NfL levels in people without neurologic disease. Ann Neurol. 2022 doi: 10.1002/ana.26446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Stewart LA, Clarke M, Rovers M, et al. Preferred reporting items for systematic review and meta-analyses of individual participant data: the PRISMA-IPD Statement. JAMA. 2015;313(16):1657–1665. doi: 10.1001/jama.2015.3656. [DOI] [PubMed] [Google Scholar]
- 26.World Health Organization. (2020) Clinical Management of COVID-19: Interim Guidance. World Health Organization; 13–15.
- 27.Izcovich A, Ragusa MA, Tortosa F, et al. Prognostic factors for severity and mortality in patients infected with COVID-19: A systematic review. PLoS ONE. 2020;15(11):0241955. doi: 10.1371/journal.pone.0241955. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Luchini C, Veronese N, Nottegar A, et al. Assessing the quality of studies in meta-research: Review/guidelines on the most important quality assessment tools. Pharm Stat. 2021;20(1):185–195. doi: 10.1002/pst.2068. [DOI] [PubMed] [Google Scholar]
- 29.Masvekar RR, Kosa P, Jin K, et al. Prognostic value of serum/plasma neurofilament light chain for COVID-19-associated mortality. Ann Clin Transl Neurol. 2022;9(5):622–632. doi: 10.1002/acn3.51542. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Prudencio M, Erben Y, Marquez CP, et al. Serum neurofilament light protein correlates with unfavorable clinical outcomes in hospitalized patients with COVID-19. Sci Transl Med. 2021;13(602):7643. doi: 10.1126/scitranslmed.abi7643. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Needham EJ, Ren AL, Digby RJ, et al. Brain injury in COVID-19 is associated with dysregulated innate and adaptive immune responses. Brain. 2022;145(11):4097–4107. doi: 10.1093/brain/awac321. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Smeele PJ, Vermunt L, Blok S, et al. Neurofilament light increases over time in severe COVID-19 and is associated with delirium. Brain Commun. 2022;4(4):195. doi: 10.1093/braincomms/fcac195. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ehler J, Petzold A, Wittstock M, et al. The prognostic value of neurofilament levels in patients with sepsis-associated encephalopathy a prospective, pilot observational study. PLoS ONE. 2019;14(1):0211184. doi: 10.1371/journal.pone.0211184. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Moseby-Knappe M, Mattsson N, Nielsen N, et al. Serum neurofilament light chain for prognosis of outcome after cardiac arrest. JAMA Neurol. 2019;76(1):64–71. doi: 10.1001/jamaneurol.2018.3223. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Zhang Q, Fan W, Sun J, Zhang J, Yin Y. Review of neurofilaments as biomarkers in sepsis-associated encephalopathy. J Inflamm Res. 2023;16:161–168. doi: 10.2147/JIR.S391325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Graham NSN, Zimmerman KA, Moro F, et al. Axonal marker neurofilament light predicts long-term outcomes and progressive neurodegeneration after traumatic brain injury. Sci Transl Med. 2021;13(613):9922. doi: 10.1126/scitranslmed.abg9922. [DOI] [PubMed] [Google Scholar]
- 37.Shahim P, Zetterberg H. Neurochemical markers of traumatic brain injury: relevance to acute diagnostics, disease monitoring, and neuropsychiatric outcome prediction. Biol Psychiatry. 2022;91(5):405–412. doi: 10.1016/j.biopsych.2021.10.010. [DOI] [PubMed] [Google Scholar]
- 38.Polymeris AA, Coslovksy M, Aeschbacher S, et al. Serum neurofilament light in atrial fibrillation: clinical, neuroimaging and cognitive correlates. Brain Commun. 2020;2(2):166. doi: 10.1093/braincomms/fcaa166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Abu-Rumeileh S, Abdelhak A, Foschi M, et al. Guillain-Barré syndrome spectrum associated with COVID-19: an up-to-date systematic review of 73 cases. J Neurol. 2021;268(4):1133–1170. doi: 10.1007/s00415-020-10124-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Beigmohammadi MT, Amoozadeh L, Rezaei Motlagh F, et al. Mortality predictive value of APACHE II and SOFA scores in COVID-19 patients in the intensive care unit. Can Respir J. 2022;28:5129314. doi: 10.1155/2022/5129314. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Schirinzi T, Lattanzi R, Maftei D, Grillo P, et al. Substance P and Prokineticin-2 are overexpressed in olfactory neurons and play differential roles in persons with persistent post-COVID-19 olfactory dysfunction. Brain Behav Immun. 2023;108:302–308. doi: 10.1016/j.bbi.2022.12.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The complete dataset used for this IPD will be shared with all qualified researchers upon request to the corresponding authors and after approval from participating centres who provided data.