Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Jul 27.
Published in final edited form as: NeuroImmune Pharm Ther. 2022 Aug 15;2(2):95–101. doi: 10.1515/nipt-2022-0010

Quantifying the Neuropsychiatric Symptoms in Post-Acute Sequelae of COVID-19 (PASC) using the NIH Toolbox® and PROMIS

Meghann C Ryan 1, Huajun Liang 2, Eleanor Wilson 3, Andrea Levine 4, Shyamasundaran Kottilil 3, Thomas Ernst 2,5, Linda Chang 2,5,6
PMCID: PMC10373798  NIHMSID: NIHMS1872875  PMID: 37502462

Abstract

Objective:

To quantify neuropsychiatric symptoms reported by individuals with Post-Acute Sequelae of COVID-19 (PASC) using the NIH Toolbox® for Assessment of Neurological and Behavioral Function (NIHTB) and Patient-Reported Outcomes Measurement Information System (PROMIS).

Methods:

30 PASC (20 women, 21–63 years) and 27 control (16 women, 25–68 years) participants completed three NIHTB batteries and selected PROMIS tests. Group differences on fully corrected T-scores were evaluated using analysis of covariance and Cohen’s d effect sizes. A linear regression model predicted the effects from time since diagnosis.

Results:

PASC had poorer emotional health and motor function than controls, including poorer locomotion, endurance and dexterity, but normal cognitive function, ~7 months post-infection, compared to controls. PASC participants had a steeper age-related decline on 2-Minute Walk than controls. T-scores on four cognitive and three motor tests improved with longer time since diagnosis.

Conclusion:

NIHTB and PROMIS captured the poorer emotional health and motor function in PASC, including the novel findings of deficits locomotion and dexterity. The normal cognitive performance suggests subclinical effects that may be compensated by neural and cognitive reserves, and manifested subjectively by the negative psychological effects and fatigue. The persistent emotional and psychiatric symptoms necessitate mental health treatment be prioritized.

Introduction

As of July 2022, more than a half-billion persons globally were infected with SARS-CoV-2; between 30–80% of survivors suffer from post-acute sequelae of COVID-19 (PASC), which may persist beyond one year (1). Patients with PASC report neuropsychiatric symptoms such as fatigue, “brain fog”, memory problems, anxiety, and depression (1).

To assess these symptoms, we used the NIH Toolbox® for Assessment of Neurological and Behavioral Function (NIHTB) and the Patient Reported Outcomes Measurement Information System (PROMIS) - two well-validated, computerized tools providing standardized assessments for clinical research (2, 3). This study is the first to use three NIHTB batteries and selected tests from PROMIS to quantify the subjective neuropsychiatric symptoms in both hospitalized and non-hospitalized patients. We hypothesized that participants with PASC would have poorer emotional health, cognitive performance, and motor function compared to healthy controls.

Results

Participant Demographics

The PASC group and controls had similar age, sex-proportion, Index of Social Position (ISP) (4), body mass index (BMI), years of education, race/ethnicity, and past-month alcohol, tobacco, and marijuana use (Table 1, all p>0.07).

Table 1.

Participant Characteristics (Number, Mean± Standard Deviation or range)

PASC, n=30 Controls, n=27 P Value
Men / Women 10 / 20 11 / 16 0.56a
Age (Years, range) 42.7 ± 12.2 (21–63) 43.8 ± 12.2 (25–68) 0.73b
Body Mass Index 31.4 ± 8.8 28.0 ± 7.5 0.12b
Index of Social Position d 30.4 ± 13.8 28.9 ± 14.0 0.69b
Education
Graduate / Undergraduate / Some College / High School 8 / 9 / 8 / 5 13 / 8 / 3 / 3 0.28a
Race/Ethnicity
White / Hispanic / Asian / Black / Biracial 19 / 1 / 0 / 9 / 1 9 / 4 / 2 / 12 / 0 0.07a
History of Substance Use
Past Month Alcohol 24 22 0.95a
Lifetime Alcohol 24 22 0.95a
Past Month Tobacco 1 1 1c
Lifetime Tobacco 10 10 1a
Past Month Marijuana e 4 2 0.67c
Lifetime Marijuana 15 6 0.03 a
Comorbid Risk Factors for COVID-19
Hypertension 6 4 0.26c
Diabetes 4 0 0.11c
Overweight / Obese 9 / 14 6 / 9 0.96a
COPD f 5 0 0.05c

Participants were recruited from the local community using online advertisements (Craigslist, Facebook Long-COVID support groups), flyers, word of mouth, and referrals from healthcare providers and post-COVID clinics. Phone screens were completed for 169 participants. Of those, 61 provided written informed consent and completed the in-person screening visit. Three were no longer eligible after the screening visit and one declined to continue participating. Inclusion criteria: 1) adults between 18–75 years; 2) ability to provide informed consent; 3) documented diagnosis of COVID-19 >6 weeks ago OR no history of COVID-19 with a negative antigen test at the screening visit. Exclusion criteria: 1) any confounding neurological, psychiatric, or medical disorders; 2) any current/past severe substance use disorder (Diagnostic and Statistical Manual of Mental Disorders 5), except for tobacco/cannabis; 3) pregnancy/breast-feeding. All participants underwent a structured medical history, physical/neurological examination, and urine toxicology screening. All provided written informed consent and the protocol was approved by the University of Maryland, Baltimore Institutional Review Board. Demographic data were compared between groups using a Chi-Square test, b T-Test, or c Fisher’s Exact Test-tests as appropriate. d Index of Social Position (ISP) was calculated using the Hollingshead Four Factor Index of Socioeconomic Status (4) e Includes two PASC that used cannabidiol. f Chronic Obstructive Pulmonary Disease

COVID-19 History and PASC Symptoms

The average time since diagnosis was 219±134 days, and 10 participants were hospitalized requiring supplemental oxygen therapy (Table 2). The most frequently reported PASC symptoms were concentration problems (89.7%), fatigue (82.8%), memory problems (79.3%), and depression/anxiety (69.0%).

Table 2.

COVID-19 History (Number, Mean ± Standard Deviation or range).

COVID-19 History PASC
Days since Diagnosis [range] 219 ± 134 [42–484]
Hospitalized / Non-Hospitalized 10 / 20
7-Point Endpoint Scale a
1 / 2 / 3 / 4 / 5 / 6 / 7 0 / 2 / 5 / 3 / 0 / 0 / 20
COVID-19 Treatments
Low-Flow / High-Flow O2 6 / 3
Ventilator / ECMO 2 / 1
Steroid b / Remdesivir 16 / 6
Monoclonal Antibody c 3
Anticoagulant d / Antibiotic e 1 / 5
Current PASC Symptoms %Total [% Mild / % Moderate / % Severe]
Concentration Problems 89.7 [24.1 / 51.7 / 13.8]
Fatigue 82.8 [44.8 / 27.6 / 10.3]
Memory Problems 79.3 [20.7 / 37.9 / 20.7]
Depression or Anxiety 69.0 [13.8 / 31.0 / 24.1]
Confusion 62.1 [6.9 / 13.8 / 41.4]
Sleep Disturbances 62.1 [24.1 / 20.7 / 17.2]
Myalgia 58.6 [6.9 / 31.0 / 20.7]
Headaches 55.2 [13.8 / 34.5 / 6.9]
Dizziness 55.2 [13.8 / 13.8 / 27.6]
Gait Disorder 51.7 [3.4 / 17.2 / 31.0]
Visual Disturbances 48.3 [6.9 / 20.7 / 20.7]
Paresthesia 44.8 [13.8 / 13.8 / 17.2]
Lightheadedness 44.8 [10.3 / 17.2 / 17.2]
Coordination Problems 41.4 [0.0 / 24.1 / 17.2]
Hyposmia 27.6 [3.4 / 10.3 / 13.8]
Dysgeusia 27.6 [6.9 / 6.9 / 13.8]
Urinary Problems 24.1 [3.4 / 3.4 / 17.2]
Postural Instability 13.8 [3.4 / 6.9 / 3.4]
Other Neurological 13.8 [0.0 / 3.4 / 10.3]

All PASC participants provided a detailed COVID-19 history. All but one completed a PASC current symptom severity questionnaire. a Acute COVID-19 severity was measured by the 7-Point Endpoint Scale (15): (1) Death; (2) Hospitalized, requiring invasive mechanical ventilation/ECMO; (3) Hospitalized, requiring non-invasive ventilation/high flow oxygen; (4) Hospitalized, requiring low flow supplemental oxygen; (5) Hospitalized, not requiring supplemental oxygen, requiring ongoing medical care; (6) Hospitalized, not requiring supplemental oxygen, no longer requiring ongoing medical care; (7) Not Hospitalized. b Dexamethasone, Prednisone, Methylprednisolone, or Hydrocortisone c Bamlanivimab or Etesevimab d Elliquis e Azithromycin or Ceftriaxone

NIHTB-Emotional Battery

The PASC group had higher T-scores than controls for negative affect (Cohen’s d=1.00, 95% CI: [0.44, 1.56], p=4.4×10−4) and poorer psychological well-being (d=−1.12, 95% CI: [−0.55, −1.69], p=1.2×10−4) (Figure 1A, Table S1). Within the psychological well-being domain, the PASC participants had lower scores than controls for positive affect (d=−1.04, 95% CI: [−0.48, −1.61], p=2.6×10−4), general life satisfaction (d=−1.10, 95% CI: [−0.53, −1.67], p=1.6×10−4), and meaning and purpose (d=−0.71, 95% CI: [−0.16, −1.26], p=0.01). In the social relationship and stress/self-efficacy domains, PASC participants had higher scores than controls on perceived rejection (d=0.72, 95% CI: [0.17, 1.26], p=0.01) and stress (d=1.09, 95% CI: [0.52, 1.66], p=1.2×10−4) and lower self-efficacy (d=−0.55, 95% CI: [−0.01, −1.09], p=0.05). In the negative affect domain, compared to controls, PASC participants had more fear affect (d=1.05, 95% CI: [0.48 1.61], p=2.7×10−4), fear somatic arousal (d=2.14, 95% CI: [1.47, 2.81], p=1.2×10−10), sadness (d=0.93, 95% CI: [0.37, 1.49], p=0.001), and anger (d=0.99, 95% CI:[0.43, 1.55], p=0.001).

Figure 1. NIHTB and PROMIS captured the poorer emotional and motor health in PASC participants compared to controls.

Figure 1.

All NIHTB assessments were administered in person by trained researchers using an iPad. NIHTB Emotional (NIHTB-EB), Cognitive (NIHTB-CB), and Motor (NIHTB-MB) batteries used the iPad NIH Toolbox App (v.1.23.4300) and PROMIS(3) surveys used REDCap. Domains and selected surveys are in the Supplement. All statistical analyses were performed using R (v.4.1.2). Analysis of covariance (ANCOVA), covaried for age, evaluated group (PASC vs. controls) differences on NIHTB and PROMIS T-Scores (corrected for age, sex, education, race/ethnicity) and Oral Symbol Digit and Auditory Verbal Learning raw scores. Cohen’s d effect sizes with 95% Confidence Intervals were calculated using the package ‘effsize’. For this exploratory study, significance was set at p<0.05.

* p≤0.05, ** p≤0.01, *** p≤0.001

NIHTB-Cognitive Battery

Despite the high prevalence of memory and concentration complaints by those with PASC, they had relatively normal performance on all cognitive tests, including working/episodic memory and attention/executive function, relative to the normative database (Table S1). They also performed similarly to the controls on all seven cognitive domains (Figure 1B, Table S1, all p>0.22).

NIHTB-Motor Battery

In addition, endurance, assessed with the 2-Minute Walk Endurance Test, and locomotive abilities, assessed with the 4-Meter Walk Gait Speed, were lower in the PASC group than the controls (Figure 1C, Table S1, Cohen’s d=−0.98, 95% CI: [−0.41, −1.55], p=4.7×10−4; d=−0.74, 95% CI: [−0.18, −1.29], p=0.01, respectively). The PASC group also had poorer dominant hand dexterity than controls, assessed with the 9-Hole Pegboard Dexterity Test (d=−0.74, 95% CI: [−0.19, −1.29], p=0.01).

PROMIS

The PASC group had significantly higher levels of depression, anxiety, fatigue, and pain measures (including pain interference, pain intensity, pain quality and pain behavior), which yielded poorer global mental and physical health T-scores than controls (Figure 1D, Table S1 all p<1.9×10−4).

Assessment Scores in Relation to Age, Time Since Diagnosis, and Illness Severity

All participants showed age-related decline on the Oral Symbol Digit, Pattern Comparison Processing Speed, and Auditory Verbal Learning assessments (Figure 2A, Figure S1, all p<0.009). However, the PASC group showed steeper age-related decline on the 2-Minute Walk Endurance Test than the controls, primarily due to the lower T-scores in the older participants (Figure 2B, Age*Group p=0.03).

Figure 2. Assessment Scores in Relation to Age and Time Since Diagnosis.

Figure 2.

A linear regression model used time since diagnosis to predict scores. The dark blue line in panels C-F indicates the average control T score for that assessment.

With longer duration since diagnosis of COVID-19, the scores were better on Pattern Comparison Processing Speed, Picture Vocabulary, Oral Reading Recognition, Total, Crystallized, and Fluid Cognition as well as Dominant/Non-Dominant Hand Grip Strength and Pegboard (Figure 2CF, Figure S1, all p<0.04).

The hospitalized and non-hospitalized participants showed no group differences on any of the NIHTB or PROMIS measure (all p>0.1, Table S2)

Discussion

This study is the first to quantify subjective neuropsychiatric PASC symptoms using NIHTB and PROMIS in hospitalized and non-hospitalized COVID-19 participants. Consistent with prior reports (5, 6), the NIHTB-EB captured poorer emotional health in PASC. However, our selected PROMIS measures assessed more domains than previous reports using the tool only in hospitalized patients (7, 8), by demonstrating that psychological effects, including depression and anxiety, are present even in our primarily outpatient participants.

The poorer endurance on the 2-Minute Walk Test in our PASC group is consistent with findings using the 6-minute walk (5) and Short Physical Performance Battery (9) in discharged COVID-19 patients 6 months after discharge. However, our assessment captured abnormalities in a mostly non-hospitalized, younger sample. We provided fully-corrected, standardized T-Scores (corrected for age, sex, race and education) for ease of comparison; and showed a steeper age-related decline than controls, suggesting even poorer endurance in the older participants with PASC. The slower performance on 4-Meter Walk and dominant 9-Hole Pegboard are novel findings suggesting COVID-19 might also impact locomotion and dexterity.

Our PASC participants reported a high prevalence of concentration/memory problems manifested as “brain fog”. However, multiple cognitive domains on the NIHTB-CB showed no cognitive deficits and they performed similarly to the uninfected controls. The cognitive impact of COVID-19 remains controversial in the literature. Our results align with another study that utilized a battery of neuropsychological tests to evaluate a comparable patient population with long COVID symptoms and found normal cognitive performance on the Montreal Cognitive Assessment (MoCA) (10). However, another study using the MoCA reported poorer cognitive performance in a smaller sample (11) and self-reported Quality of Life assessments suggested impairment (6). The NIHTB-CB is well-validated and highly sensitive, capable of detecting even mild cognitive impairment (12). Additionally, the age-related declines in Oral Symbol Digit, Pattern Comparison Processing Speed, and Auditory Verbal Learning scores further validate the sensitivity of the Cognitive Battery by demonstrating known age-related declines in processing speed and immediate recall. Because of the normal cognitive performance on objective batteries despite the neurocognitive complaints, we hypothesize that these PASC participants may have subclinical effects that are compensated by neural and cognitive reserves, and possibly further exacerbated by the negative psychological effects and fatigue. Furthermore, an imbalance between GABAergic and dopaminergic activity in the cortex of COVID-19 survivors may contribute to fatigue and the subsequent subjective cognitive deficits (11). The discrepancy between the subjective complaints and normal objective cognitive measures should be further evaluated using quantitative functional MRI to assess for increased usage of the brain reserves to compensate for the cognitive deficits and edited magnetic resonance spectroscopy to evaluate the brain GABA concentrations.

Consistent with a prior longitudinal study (13), better cognitive scores were associated with more remote COVID-19 diagnoses in the current study. Hence, the normal cognitive performance in participants with PASC might also result from normalization of prior deficits. Motor abilities showed a similar trend. However, similar to another convalescent COVID-19 sample (14), emotional health scores remained poor with time. Together, these results suggest a longer-lasting clinical impact on emotional health than cognition and motor function and necessitate further investigation. For example, evaluation of neurometabolite concentrations using magnetic resonance spectroscopy may determine whether the persistent psychiatric symptoms may be related to neuronal injury due to oxidative stress, and/or neuroinflammation.

This study is limited by its cross-sectional design, and small subsample of hospitalized PASC participants. Furthermore, there exists the possibility of selection bias for the PASC group to include those with more severe symptoms. Knowledge of the PASC diagnosis may have also influenced the subjective reporting. Future studies should include a larger sample size, COVID-19 survivors with and without PASC, and longitudinal follow-up of the COVID-19 participants.

In summary, approximately 7 months after COVID-19, participants showed persistent abnormalities on emotional/physical health, endurance, locomotion, and dexterity, but relatively normal cognitive performance. Lower endurance appeared worse in the elderly with PASC. Although cognitive and motor abilities may improve with time, the long-lasting emotional and psychiatric symptoms necessitate that mental health treatments be prioritized. Lastly, given our novel findings of motor deficits, clinical examinations of COVID-19 survivors should include evaluation of locomotion and dexterity.

Supplementary Material

Supplementary Material

Acknowledgments

We thank our research participants for their participation and Drs. Muhammad Saleh and Camila Teixeira for their assistance in some of the data collection.

Funding:

This work was supported by a grant from the National Institute of Neurological Disorders and Stroke (1R21NS121615-01)

Conflicts of Interest:

Shyamasundaran Kottilil is a member of the Scientific Advisory Board at Merck, Regeneron, Silverback therapeutics, and Zhuhai Yufan Biotechnologies and The Liver Company, and has received grants paid to the institution from Gilead Sciences and Arbutus Pharmaceuticals. All other authors declare no conflict of interest.

Footnotes

Informed consent: Informed consent was obtained from all individuals included in this study.

Ethical approval: Research involving human subjects complied with all relevant national regulations, institutional policies and is in accordance with the tenets of the Helsinki Declaration (as revised in 2013), and has been approved by the authors’ Institutional Review Board (University of Maryland, Baltimore).

References

  • 1.Lopez-Leon S, Wegman-Ostrosky T, Perelman C, Sepulveda R, Rebolledo P, Cuapio A, et al. More Than 50 Long-Term Effects of COVID-19: A Systematic Review and Meta-Analysis. Res Sq. 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Hodes RJ, Insel TR, Landis SC, Research NIHBfN. The NIH toolbox: setting a standard for biomedical research. Neurology. 2013;80(11 Suppl 3):S1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. J Clin Epidemiol. 2010;63(11):1179–94. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Hollingshead AA. Four-factor index of social status. New Haven, CT:. 1975(Yale University.). [Google Scholar]
  • 5.Huang C, Huang L, Wang Y, Li X, Ren L, Gu X, et al. 6-month consequences of COVID-19 in patients discharged from hospital: a cohort study. Lancet. 2021;397(10270):220–32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Tabacof L, Tosto-Mancuso J, Wood J, Cortes M, Kontorovich A, McCarthy D, et al. Post-acute COVID-19 Syndrome Negatively Impacts Physical Function, Cognitive Function, Health-Related Quality of Life, and Participation. Am J Phys Med Rehabil. 2022;101(1):48–52. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Jacobs LG, Gourna Paleoudis E, Lesky-Di Bari D, Nyirenda T, Friedman T, Gupta A, et al. Persistence of symptoms and quality of life at 35 days after hospitalization for COVID-19 infection. PLoS One. 2020;15(12):e0243882. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Ganesh R, Ghosh AK, Nyman MA, Croghan IT, Grach SL, Anstine CV, et al. PROMIS Scales for Assessment of Persistent Post-COVID Symptoms: A Cross Sectional Study. J Prim Care Community Health. 2021;12:21501327211030413. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Baricich A, Borg MB, Cuneo D, Cadario E, Azzolina D, Balbo PE, et al. Midterm functional sequelae and implications in rehabilitation after COVID-19: a cross-sectional study. Eur J Phys Rehabil Med. 2021;57(2):199–207. [DOI] [PubMed] [Google Scholar]
  • 10.Dressing A, Bormann T, Blazhenets G, Schroeter N, Walter LI, Thurow J, et al. Neuropsychological profiles and cerebral glucose metabolism in neurocognitive Long COVID-syndrome. J Nucl Med. 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Ortelli P, Ferrazzoli D, Sebastianelli L, Engl M, Romanello R, Nardone R, et al. Neuropsychological and neurophysiological correlates of fatigue in post-acute patients with neurological manifestations of COVID-19: Insights into a challenging symptom. J Neurol Sci. 2021;420:117271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Hackett K, Krikorian R, Giovannetti T, Melendez-Cabrero J, Rahman A, Caesar EE, et al. Utility of the NIH Toolbox for assessment of prodromal Alzheimer’s disease and dementia. Alzheimers Dement (Amst). 2018;10:764–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Del Brutto OH, Rumbea DA, Recalde BY, Mera RM. Cognitive sequelae of long COVID may not be permanent: A prospective study. Eur J Neurol. 2021. [DOI] [PubMed] [Google Scholar]
  • 14.Mattioli F, Stampatori C, Righetti F, Sala E, Tomasi C, De Palma G. Neurological and cognitive sequelae of Covid-19: a four month follow-up. J Neurol. 2021;268(12):4422–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Desai A, Gyawali B. Endpoints used in phase III randomized controlled trials of treatment options for COVID-19. EClinicalMedicine. 2020;23:100403. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Material

RESOURCES