Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2021 Feb 12;11:3738. doi: 10.1038/s41598-021-83131-1

Neurocognitive status and risk of mortality among people living with human immunodeficiency virus: an 18-year retrospective cohort study

Zaeema Naveed 1, Howard S Fox 2, Christopher S Wichman 3, Morshed Alam 3, Pamela May 2, Christine M Arcari 1, Jane Meza 3, Steven Totusek 2, Lorena Baccaglini 1,
PMCID: PMC7881128  PMID: 33580123

Abstract

HIV-related neurocognitive impairment (NCI) may increase the risk of death. However, a survival disadvantage for patients with NCI has not been well studied in the post-combination antiretroviral therapy (cART) era. Specifically, limited research has been conducted considering the reversible nature and variable progression of the impairment and this area demands further evaluation. We performed multivariable Cox proportional hazards modeling to assess the association between baseline NCI (global T scores) and mortality. A joint modeling approach was then used to model the trajectory of global neurocognitive functioning over time and the association between neurocognitive trajectory and mortality. Among the National NeuroAIDS Tissue Consortium’s (NNTC) HIV-infected participants, we found a strong negative association between NCI and mortality in the older age groups (e.g., at age = 55, HR = 0.79; 95% CI 0.64–0.99). Three neurocognitive sub-domains (abstraction and executive functioning, speed of information processing, and motor) had the strongest negative association with mortality. Joint modelling indicated a 33% lower hazard for every 10-unit increase in global T scores (HR = 0.67; 95% CI 0.56–0.80). The study identified older HIV-infected individuals with NCI as a group needing special attention for the longevity of life. The study has considerable prognostic utility by not only predicting mortality hazard, but also future cognitive status.

Subject terms: Neuroscience, Neurology, Risk factors, Virology, Retrovirus, Viral epidemiology, Diseases, HIV infections

Introduction

Since the outset of the human immunodeficiency virus (HIV) epidemic, HIV-associated neurocognitive disorders (HAND) have been prevalent in infected populations, ranging from subtle neuropsychological impairments to profoundly disabling HIV-associated dementia (HAD)1. The advent of combination antiretroviral therapy (cART) has transformed HIV infection from a deadly acute disease to a chronic tractable condition by effective management of HIV viremia and enhanced immune function2. Yet, despite the widespread use of cART, HIV-associated neurocognitive impairment (NCI) and brain injury persist with a change in phenotype and pattern. There has been a significant decrease in HAD in the cART era. Nevertheless, less severe forms of HAND continue to have a prevalence of 20–50%3,4. The pattern of NCI also differs between the two eras. In the pre-cART era impairment in motor skills, cognitive speed, and verbal fluency were more common, whereas in the cART era memory and executive function impairment are more prominent1,3,5.

HIV enters the brain early in its course by crossing the blood–brain barrier inside migrating monocytes and lymphocytes. Infected monocytes are converted to perivascular macrophages that express neurotoxic molecules leading to increased blood–brain barrier permeability. Neuronal damage and death are ensued both by direct viral proteins interaction and indirect inflammatory response mounted by inflammatory cells against the viral proteins6,7. The brain alterations during early HIV infection have also been validated by neuroimaging8. In the past, subcortical regions of the brain were thought to be primarily infected by HIV, giving rise to subcortical dementia. However, heterogeneous findings from both neuropsychological and neuroimaging studies have now recognized the cognitive impairment to be present across various brain regions and cognitive domains9. The exact mechanism of persistence of milder forms of impairment is not clear; though, two potential explanations may include the lingering consequences of advanced immunosuppression during the early stages of the disease (before initiation of cART) and ongoing viral replication within the brain, even when systemic viral suppression has been achieved10,11.

NCI progression is highly variable, with individuals displaying considerable recovery of cognitive functions, worsening of impairment, static impairment, or a fluctuating course12. Understanding the consequences of HIV associated NCI is vital because even in milder forms, it is associated with lower medication adherence, a decreased ability to perform the daily tasks, poorer quality of life, and difficulty obtaining employment13. Moreover, HIV infected individuals with mild cognitive impairment may have an increased risk of dementia and death14,15. Although HIV related morbidity and mortality have decreased over time, people living with HIV continue to face an increased risk of mortality compared to the non-infected counterparts, even among those with a successful response to cART16,17. There are several well-established predictors of mortality in HIV1820; however, limited research has been conducted to investigate the association between NCI and mortality in HIV infected people. In the pre-cART era, NCI ascertained through a comprehensive battery of neuropsychological tests was found to be an independent risk factor of death15,21,22. A recent cross-sectional study with hospitalized HIV infected patients as the study sample found higher inpatient mortality among those who had been diagnosed with HIV associated NCI compared to those who had not23. Three other studies conducted in the cART era found a positive association between NCI and mortality but were limited to participants with advanced HIV infection or severe cognitive disorders only2426. Banerjee et al. recently reported NCI to be an independent prognostic marker of mortality in an HIV infected cognitive cohort27. The study used the HIV-Dementia scale (HDS) to assess NCI. However, studies have demonstrated inconsistent results pertaining to the ability of HDS to detect subtle types of NCI28,29.

Apart from the limited research on the association between NCI and mortality, all the previous studies have examined cognitive impairment at a single time-point (i.e., baseline). As it is likely that cognitive status changes over time, it is vital to account for this variability in relation to mortality. A survival disadvantage for patients with NCI has not been well studied in the cART era, particularly taking into consideration the reversible nature of the impairment and demands further evaluation. The present study aims to fill the research gap by examining the association between baseline neurocognitive status as well as longitudinal changes in neurocognitive status and mortality in a diverse HIV-infected sample. We hypothesize that NCI and its progression increase the hazard of death in HIV patients either independently or in association with specific patient-related factors.

Methods

Data source and participants

The National NeuroAIDS Tissue Consortium (NNTC) database was used to investigate the association between neurocognitive status and mortality in HIV patients. NNTC is an ongoing, prospective observational study established in 1998 with the primary aim of collecting, storing, and distributing samples of central and peripheral nervous system tissue, cerebrospinal fluid, blood, and other organs collected from HIV positive and negative patients for research purposes30. Adult participants with advanced HIV disease willing to participate in a post-mortem organ donation program were recruited at one of the four participating sites: Texas NeuroAIDS Research Center (University of Texas Medical Branch, Galveston), California NeuroAIDS Tissue Network (University of California, San Diego), National Neurological AIDS Bank (University of California, Los Angeles) and Manhattan HIV Brain Bank (Mount Sinai Medical Center, New York). Participants were volunteers recruited from clinics, hospitals, and local communities into a longitudinal observational study with detailed neurologic and neuropsychological evaluations at 6-, 12- or 24-month intervals depending on the clinical judgment of a participant’s health.

Variables such as demographics, medication history (ARV and others), cerebrospinal fluid, blood, plasma, and urine laboratory testing for HIV specific and ancillary markers, comorbidities and substance use were collected at baseline and during the longitudinal phase31,32.

For the analysis, we included participants enrolled between January 2000 to November 2017, with complete baseline data on the variables of interest, and with at least two follow-up visits (n = 1,325). Seventy-seven participants did not have information available on neurocognitive status at the baseline and were excluded (n = 1,248). Further exclusions were made based on missing baseline information on covariates of interest. The reporting of this observational study has been guided by the STROBE instrument.

Variables

The primary outcome was time to event (death). The primary exposures were neurocognitive status at baseline (for Cox proportional hazards modeling) and repeated measures of neurocognitive status (for joint modeling). Neurocognitive status was assessed through a continuous score (demographically corrected T score) derived from a comprehensive neurocognitive test battery comprising of fourteen test scores. The tests with references are given in Table 1. The battery covers seven cognitive domains, including executive functioning, speed of information processing, attention and working memory, learning, memory, verbal fluency, and motor functioning. Raw scores from individual tests were converted to demographically corrected T scores3 which were than averaged together to generate the global T score. For descriptive analysis, an impaired neurocognitive status was assigned to those with a global T score value of < 4033. The best available normative standards were used, which correct for the effects of age, education, sex, and ethnicity, as appropriate14. Based on prior literature and biological plausibility, other groups of variables included in the study were demographic factors (age, education, gender, race, and ethnicity), HIV related factors (disease severity, duration of HIV infection, antiretroviral (ARV) drug use, CD4 nadir, current CD4 cell count, plasma viral loads and CSF viral loads), comorbidities (anemia, cerebrovascular disease, hypertension, diabetes, hyperlipidemia, viral hepatitis, chronic renal disease, chronic obstructive pulmonary disease, AIDS-defining comorbidity, any CNS comorbidity and a composite measure of any non-AIDS defining comorbidity) and substance use (history of alcohol, opiate, hallucinogen, cannabis and cocaine use). The Composite International Diagnostic Interview (CIDI, v2.1) that is consistent with the diagnostic and statistical manual of mental disorders-4th Edition (DSM-IV), was used to measure substance use.

Table 1.

Neuropsychological test battery used to generate T scores among HIV-infected participants of National NeuroAIDS Tissue Consortium (NNTC).

Cognitive domain Neuropsychological test
Abstraction/executive functioning Trail Making Test, Part B49
Wisconsin Card Sorting Test-64, Perseverative Responses49,50
Speed of information processing Wechsler Adult Intelligence Scale-3rd ed. (WAIS-III) Digit Symbol51
WAIS-III Symbol Search51
Trail Making Test, Part A49
Attention and working memory Paced Auditory Serial Addition Task (PASAT) (first channel only)52
WAIS-III Letter Number Sequencing51
Learning Brief Visuospatial Memory Test-Revised (BVMT-R) Total Recall50,53
Hopkins Verbal Learning Test-Revised (HVLT-R) Total Recall50,54
Memory BVMT-R Delayed Recall50,53
HVLT-R Delayed Recall50,54
Verbal fluency Controlled Oral Word Association Test (COWAT-FAS)49
Motor Grooved Pegboard dominant49
Grooved Pegboard non-dominant49

Statistical analyses

Descriptive statistics were generated for categorical (frequencies and percentages) and continuous variables (means, medians, and standard deviations) to assess the overall demographic and clinical characteristics of the sample. Traditional survival analysis was conducted using Cox proportional hazards regression. Kaplan–Meier analysis was used to compute the overall median survival time and to visualize survival time distributions. Univariable Cox proportional hazards models were employed to explore the association between the covariates (primary exposure and potential confounders) and outcome. Furthermore, univariable analyses using one-way analysis of variance (ANOVA) for continuous variables and Cochran Mantel–Haenszel statistics (with modified ridit scores) for categorical variables were conducted to identify the association between primary covariate (neurocognitive status) and other potential covariates. Only those variables associated with, both with the primary outcome and primary covariate at 2-sided α = 0.2, were entered in the multivariable Cox proportional hazards model for further analysis. One-way interactions between the primary predictor and other covariates were also assessed using the proportional hazards model.

For multivariable Cox proportional hazards modeling, a stepwise approach was used. The initial model included neurocognitive status, age, and the interaction term between them. Other potential confounders were then added to the model, and the change in the estimate for the association between neurocognitive status and outcome was recorded. The variable was considered a confounder if the percent change in the estimate of the reduced model compared to the model with the added variable was more than 5%. Finally, HIV duration was forced into the model. The proportional hazards assumption was assessed using the graphical method (log–log survival curve approach) and goodness of fit test (based on martingale residuals). The same model was fitted for all seven domains as sub-analyses. Crude and adjusted hazard ratios (HR) and 95% confidence intervals (95% CI) were reported as the measures of association for the Cox proportional hazards regression analyses. A sub-analysis of participants with complete data on Beck Depression Inventory-II (BDI-II) scores was conducted to investigate potential confounding effects of depressive symptoms.

A joint modeling approach was then used to model the trajectory of global neurocognitive functioning (global T score) over time and the association between neurocognitive trajectory and mortality at the same time. The temporal evolution of longitudinal T score measurements was estimated using a linear mixed-effects model. To model cognitive trajectories, we employed both linear and quadratic functions to observe if the results differed. Residual diagnostics were conducted to check the linear mixed models’ assumptions. The final joint model used a Weibull baseline hazard function and was adjusted for covariates used in the traditional survival analysis. The analyses were performed using SAS 9.4 (SAS Institute, Inc., Cary, NC, USA) software and R software-3.5.0 (JM package).

Ethical approval

This study was approved by the University of Nebraska Medical Center’s institutional review board (Protocol #282-13-EP). All methods were carried out in accordance with relevant guidelines and regulations. The National NeuroAIDS Tissue Consortium obtained written informed consent for participation, neuro-medical and neuropsychological examinations and for obtaining brain tissue after death for examination and tissue banking. For deceased participants, the decedent's family/legal guardian provided informed consent for tissue donation and release of medical records.

Results

Participants’ characteristics

The original enrolled sample (n = 1,901) had a median age of 45 years (IQR = 39–53), and was 81.1% males, 55.8% whites and 73.2% non-Hispanics. Fifty nine percent of the original sample had a global T score above 40. A total of 877 participants were included in the final analyses (Fig. 1). The median age was 45 years (IQR = 40–53), and most participants were males (79.2%), whites (55.8%) and non-Hispanics/Latinos (72.1%). Sixty percent of participants in the analytic sample had a global T score above 40. The median duration of HIV infection was 12.6 years (IQR = 7.4–17.8). At baseline, 78% of participants were on a highly active antiretroviral therapy (HAART) regimen, 13% were on the non-HAART regimen, and the rest 9% were not using any antiretroviral therapy (ART). The median CD4+ cell count was 203.5 cells/µl (IQR = 75–406) and the median Log10 viral load was 2.6 (IQR = 1.7–4.2). Table 2 shows the baseline characteristics of participants by neurocognitive status. Most males (80.5%), participants on HAART (81.1%), Blacks (42.0%), and non-Hispanics/Latinos (77.4%) were in the neurocognitively unimpaired category. Furthermore, participants in the unimpaired category were marginally older (mean = 47.1 years) with higher education (mean = 12.3 years), higher hemoglobin levels (mean = 13.4 g/dl), higher CD4 count (mean = 301.9 cells/µl), lower blood Log10 viral load (mean = 2.9 copies/ml), longer duration of HIV disease (mean = 13.3 years) and fewer CNS comorbidities (mean = 0.05) compared to those in impaired group. Descriptive statistics for the neurocognitive battery of tests (individual and domain specific T tests) are included in Supplementary Table S1. Participants that died during the follow-up had marginally lower baseline T scores for the domains of abstraction/executive functioning, speed of information processing, verbal fluency and motor and marginally higher T scores for the domains of attention and working memory, learning and working memory compared to those that were censored.

Figure 1.

Figure 1

Flow chart of participation. *Descriptive analysis comparing those with missing data for covariates of interest to those with complete data showed no difference in demographic variables and baseline global T scores. **There is a 12% loss to follow-up.

Table 2.

Participant’s baseline characteristics by neurocognitive status among HIV-infected participants of National NeuroAIDS Tissue Consortium (NNTC).

Variables Global T scoresa p value
Unimpaired  > 40 Impaired  ≤ 40
n (%)b n (%)b
Total 527c (60.1) 350c (39.1)
Gender
Male 424 (80.5) 271 (77.4) 0.2791*
ARV medication use 0.0157*
No current ARV 45 (9.1) 29 (8.9)
Current non-cART 49 (9.8) 59 (18.0)
Current cART 402 (81.1) 239 (73.1)
Race 0.003*
White 266 (51.9) 211 (61.7)
Black 215 (42.0) 98 (28.6)
Other 33 (9.6) 33 (9.6)
Ethnicity  < 0.0001*
Hispanic or Latino 119 (22.6) 126 (36.0)
Not Hispanic or Latino 408 (77.4) 224 (64.0)
Hypertension history 121 (29.9) 62 (25.4) 0.2138*
Diabetes history 46 (11.39) 43 (17.7) 0.0242*
Hyperlipidemia history 100 (24.7) 48 (19.6) 0.1291*
Viral hepatitis history 139 (34.5) 104 (42.8) 0.0340*
End stage liver disease history 9 (2.2) 8 (3.3) 0.4157*
Chronic renal disease history 30 (7.5) 17 (7.0) 0.8252*
Cardiac disease history 40 (9.9) 26 (10.7) 0.7611*
Chronic obstructive pulmonary disease 44 (10.9) 24 (9.8) 0.6563*
Cerebrovascular disease history 33 (8.2) 43 (17.7) 0.0005*
Non-AIDS defining cancers 31 (7.7) 15 (6.2) 0.4622*
Any non-AIDS defining comorbidityd 287 (70.7) 181 (73.9) 0.3811*
Any CNS comorbiditye 29 (5.9) 44 (13.4) 0.0002*
Alcohol use history 224 (61.5) 98 (45.5) 0.0030*
Cannabis use history 151 (41.5) 62 (28.6) 0.0379*
Cocaine use history 198 (54.4) 87 (40.1) 0.0008*
Hallucinogen use history 28 (7.7) 16 (7.4) 0.8883*
Opiate use history 63 (17.3) 42 (19.3) 0.5345*
Sedative use history 38 (10.4) 24 (11.1) 0.8149*
Stimulant use historye 86 (23.6) 39 (17.9) 0.1089*
Mean (SD) Mean (SD)
Age (years) 47.1 (10.7) 46.5 (10.6) 0.5779**
Years of education (years) 12.3 (3.6) 12.2 (3.2) 0.5779**
Beck's Depression Inventory (BDI) total score 13.1 (10.1) 15.4 (10.4) 0.0001**
Hemoglobin (g/dl) 13.4 (1.8) 13.2 (1.9) 0.0395**
CD4 Nadir (cells/µl) 138.7 (213.6) 138.1 (210.0) 0.9744**
CD4 cell count (cells/µl) 301.9 (298.8) 273.1 (273.5) 0.1565**
Plasma viral load (log10 copies/ml) 2.9 (1.3) 3.1 (1.4) 0.0561**
Number of non-AIDS defining comorbiditiesd 1.4 (1.3) 1.6 (1.5) 0.2521**
Number of CNS comorbiditiesf 0.05 (0.2) 0.1 (0.4)  < .0001**
Duration of HIV (years) 13.3 (7.4) 12.7 (7.6) 0.1615**
Number of substances usedg 2.1 (1.7) 1.6 (1.7) 0.0323**

*Cochran Mantel–Haenszel statistics (score = modified ridit). **Analysis of variance.

aScores range between 0 and 100 and higher T scores imply better neurocognitive status.

bColumn percentages.

cSample size may be lower for variables due to missing data.

dIncludes history of hypertension, diabetes, viral hepatitis, end-stage liver disease, hyperlipidemia, chronic renal disease, cardiac disease, chronic obstructive pulmonary disease, and cerebrovascular disease.

eDefined as use of amphetamines, diet pills, ice, khat, methamphetamine, Ritalin, speed and uppers.

fPrimary CNS lymphoma, toxoplasma encephalitis, progressive multifocal leukoencephalopathy, CMV ventriculo-encephalitis, cryptococcal meningitis, histoplasma meningitis, coccidiodes meningitis, tuberculous meningitis, syphilitic meningitis, lymphomatous meningitis, and other specific meningitis.

gIncludes history of alcohol, cannabis, cocaine, hallucinogen, opiate, sedative and stimulant use.

Survival analysis (Kaplan–Meier method and Cox proportional hazards regression)

The participants were followed for up to 18 years. During the study duration, of the 877 participants, 272 (31%) died. The overall median survival time was 13.2 years (Fig. 2). The survival plot (Fig. 3) stratified by neurocognitive status, exhibited lower median survival time (median = 11.8 years) for neurocognitively impaired participants compared to the median survival time (14.1 years) for unimpaired participants. Unadjusted analyses for interaction and identification of potential confounders showed a significant interaction between age and neurocognitive status in association with mortality. Furthermore, 11 variables (current ARV medication use, ethnicity, history of hyperlipidemia, history of cerebrovascular disease, history of cannabis use, history of cocaine use, history of opiate use, serum hemoglobin, CD4 nadir, plasma viral loads and duration of HIV infection) were assessed as potential confounders in a stepwise approach in the adjusted model. The final multivariable Cox proportional hazards model included duration of HIV infection, ethnicity, serum hemoglobin, plasma viral load and an interaction term between neurocognitive status and age (Table 3). The adjusted model revealed a strong negative association between mortality and NCI in the older age groups. For example, among those who were 55 years old, the hazard of dying for those with higher (10 units) global T score was 0.79 times (21% lower) the hazard for those with lower global T score. However, the association was not evident in the younger age groups. Apart from the interaction term, being non-Hispanic/Latino (HR = 1.38, 95% CI 1.02–1.86) and having a higher baseline log10 viral load (HR = 1.27, 95% CI 1.16–1.39) were associated with a higher hazard of dying whereas, a higher baseline serum hemoglobin was associated with a lower hazard of dying (HR = 0.91, 95% CI 0.85–0.97). Domain-specific Cox proportional hazards modeling (Table 4) showed that T scores for abstraction and executive functioning, speed of information processing, and motor domains, had stronger negative associations with mortality compared to the other domains, particularly among older participants. As seen with the global neurocognitive status, the association between individual neurocognitive domain and mortality was not evident among younger participants.

Figure 2.

Figure 2

Kaplan–Meier plot for overall survival. Median survival time = 13.2 years (95% CI 11.4–15.5).

Figure 3.

Figure 3

Kaplan–Meier plot stratified by neurocognitive status. Median survival time impaired (global T score ≤ 40) = 11.8 years (95% CI 9.6–15.5). Median survival time unimpaired (global T score > 40) = 14.1 years (95% CI 9.6). *The upper limit of confidence interval for median survival time in unimpaired group is not estimable because of censored data.

Table 3.

Crude and adjusted hazard ratios (HR) for mortality by selected variables among HIV-infected participants of National NeuroAIDS Tissue Consortium (NNTC; n = 877).

Variable (at baseline) Crude HR (95% CI) Adjusted HR (95% CI) modela
Global T scoreb 0.99 (0.97–1.01) NA
Age (years) 1.01 (0.99–1.02) NA
Gender
Female Ref NA
Male 1.20 (0.90–1.61)
Race
White Ref NA
Black 1.15 (0.89–1.48)
Other 1.02 (0.63–1.66)
Duration of HIV infection (years) 1.02 (1.01–1.03) 1.01 (0.99–1.03)
Ethnicity
Hispanic or Latino Ref Ref
Not Hispanic or Latino 1.41 (1.05–1.88) 1.38 (1.02–1.86)
ARV medication use
No current ARV use Ref NA
Current non-cART 0.52 (0.32–0.86)
Current cART 0.53 (0.37–0.76)
Serum hemoglobin (g/dl) 0.89 (0.83–0.95) 0.91 (0.85–0.97)
Plasma viral load (log10 copies/ml) 1.28 (1.17–1.39) 1.27 (1.16–1.39)
T scores × agec
35 years 1.13 (0.88–1.46) 1.09 (0.85–1.41)
55 years 0.76 (0.61–9.95) 0.79 (0.64–0.99)
75 years 0.51 (0.31–0.85) 0.58 (0.35–0.97)

aEach variable is adjusted for all other variables listed in the column.

bHazard Ratio corresponds to a 10-unit increase in global-t scores.

cInteraction term between global T scores and age. Hazard ratio corresponds to a 10-unit increase in global T scores for a given age.

Table 4.

Neurocognitive domain specific crude and adjusted hazard ratios for mortality by selected variables among HIV-infected participants of National NeuroAIDS Tissue Consortium (NNTC; n = 877).

Variable (at baseline)a Global T score Adjusted HR (95% CI)a Domain specific T score
Adjusted HR (95% CI)a
Abstraction executive functioning Speed of information processing Motor Attention and working memory Learning Memory Verbal fluency
T scoresb NA NA NA NA NA NA NA NA
Age (years) NA NA NA NA NA NA NA NA
Duration of HIV infection (years) 1.01 (0.99–1.03) 1.01 (0.99–1.03) 1.01 (0.99–1.03) 1.01 (0.99–1.03) 1.01 (0.99–1.03) 1.01 (0.99–1.03) 1.01 (0.99–1.03) 1.01 (0.99–1.03)
Ethnicity
Hispanic or Latino Ref Ref Ref Ref Ref Ref Ref Ref
Not Hispanic or Latino 1.38 (1.02–1.86) 1.37 (1.01–1.84) 1.35 (0.99–1.82) 1.33 (0.99–1.79) 1.29 (0.95–1.74) 1.33 (0.99–1.80) 1.29 (0.96–1.74) 1.35 (1.00–1.81)
Serum hemoglobin (g/dl) 0.91 (0.85–0.97) 0.91 (0.85–0.97) 0.91 (0.85–0.97) 0.91 (0.85–0.97) 0.89 (0.84–0.96) 0.90 (0.84–0.96) 0.90 (0.84–0.96) 0.90 (0.85–0.97)
Plasma viral load (log10 copies/ml) 1.27 (1.16–1.39) 1.27 (1.16–1.39) 1.27 (1.16–1.39) 1.28 (1.16–1.40) 1.28 (1.17–1.41) 1.27 (1.16–1.39) 1.27 (1.16–1.39) 1.25 (1.14–1.37)
T scores × agec
35 years 1.09 (0.85–0.41) 1.08 (0.90–1.30) 1.09 (0.90–1.33) 0.98 (0.84–1.14) 0.99 (0.80–1.24) 1.11 (0.89–1.37) 1.16 (0.95–1.41) 0.99 (0.82–1.18)
55 years 0.79 (0.64–0.99) 0.83 (0.71–0.97) 0.84 (0.71–0.98) 0.80 (0.68–0.94) 0.95 (0.79–1.14) 0.93 (0.77–1.12) 1.01 (0.85–1.20) 0.89 (0.77–1.03)
75 years 0.58 (0.35–0.97) 0.64 (0.45–0.93) 0.64 (0.43–0.94) 0.65 (0.45–0.94) 0.91 (0.59–1.40) 0.78 (0.50–1.20) 0.88 (0.59–1.32) 0.81 (0.57–1.14)

aEach variable is adjusted for all other variables listed in the column.

bHazard Ratio correspond to a 10-unit increase in T scores.

cInteraction term between T scores and age. Hazard ratio corresponds to a 10-unit increase in T scores for given age.

A sub-analysis of participants with complete data on Beck Depression Inventory-II (BDI-II) scores showed a similar association between NCI and mortality than without BDI-II in the model. For example, for participants aged 55 years, the adjusted HR was 0.83 (95% CI 0.62–1.12) for the sub-analysis compared to 0.79 (95% CI 0.64–0.99; Table 3) for the model without BDI-II.

Joint modeling (shared random effects model)

The joint analysis estimated the individual-specific random effects of the longitudinal process simultaneously and specified them as covariates of mortality in the survival process. The linear mixed effect model generated an average regression coefficient of 0.033 (SE = 0.003) (not shown) for the time variable suggesting an increase in global T scores over the study period. The linear slope estimate of the global T score was − 0.39 (SE = 0.089), which indicates a negative association with the risk of mortality (Table 5). The adjusted HR of the slope was 0.67 (95% CI 0.56–0.80), indicating that for every 10-unit increase in global T score, the hazard of death decreased by 33%. The baseline covariates included in the final model (duration of HIV infection, plasma viral load, ethnicity, and serum hemoglobin) were same as those in the traditional Cox regression.

Table 5.

Results of multivariable joint modeling of repeated measures (Global T score) and survival data among HIV-infected participants of National NeuroAIDS Tissue Consortium (NNTC).

Predictor β (SE) Adjusted HR (95% CI)a
Intercept − 2.34 (0.71) 0.09 (0.02–0.38)
Global T score slope − 0.39 (0.08) 0.67a (0.56–0.80)
Age (years) 0.01 (0.01) 1.01 (0.99–1.02)
Duration of HIV infection (years) 0.02 (0.01) 1.02 (0.99–1.03)
Ethnicity
Hispanic or Latino Ref Ref
Not Hispanic or Latino 0.41 (0.15) 1.50 (1.11–2.02)
Serum Hemoglobin (g/dl) − 0.10 (0.03) 0.90 (0.84–0.96)
Plasma viral load (log10 copies/ml) 0.22 (0.04) 1.25 (1.14–1.36)

aAdjusted for all other variables in the model.

bHazard Ratio corresponds to a 10-unit increase in global T scores.

Discussion

Despite the availability and use of potent antiretroviral medications, mild to moderate HIV-associated NCI is still prevalent1,3. Apart from being a disabling consequence of HIV infection, NCI has been found to be an independent predictor of mortality in the pre-cART era15. Limited research has been conducted on the association between mortality and NCI in the HAART era, with little consideration given to the substantial variability that the course of NCI over time, in the HIV infected population12,15. The present study aimed to examine the association between baseline neurocognitive status as well as longitudinal changes in neurocognitive status and mortality in a diverse HIV-infected patient sample. Our research adds to this limited body of literature by investigating the link between HIV-associated NCI and mortality among HIV-infected participants.

The results of the crude survival analysis demonstrated no association between neurocognitive status and mortality (HR = 0.99). In adjusted analyses we detected a significant interaction between neurocognitive status and age in relation to mortality. Specifically, among older participants, higher global T scores (i.e., better neurocognitive status) were associated with a lower hazard of death, whereas neurocognitive status was not associated with mortality among younger participants. This finding was independent of plasma viral load, ethnicity, duration of HIV infection, and serum hemoglobin as these variables were adjusted for in the final model. Unlike our study, none of the previous studies have reported an interaction between age and neurocognitive status in relation to mortality. However, studies have observed independent associations between age and mortality and age and neurocognitive status23,34. Specifically, in the pre-cART era, studies had found NCI to be an independent risk factor for mortality15. The association was also found in the cART-era, in a limited number of studies. However, the association was explored either between severe forms of NCI and mortality or only among those with the severe form of HIV infection25,26. Our findings differ from cART-era studies because we did not exclude any participants based on severity.

The most plausible mechanism underlying the interaction between age and neurocognitive status in association to mortality may be the age-related exacerbation of co-morbidities such as metabolic disorders and vascular diseases3537. Since the initiation of cART, the prevalence of vascular and metabolic disorders among HIV infected individuals has increased because of improved life expectancy38; nearly half of people living with HIV in the United States are aged 50 and older. The synergy between age (and, indirectly, age-related comorbidities) and NCI in HIV probably ensues a vicious cycle. Comorbidities adversely affect the neurocognitive status, which may lead to reduced ability to manage activities of daily life, lower medication adherence, and poorer healthcare utilization, thus further progressing comorbidities39,40 Thus age may be acting as a proxy to certain comorbidities.

During domain-specific analyses, we found a stronger negative association between mortality and domain-specific T scores for abstraction and executive functioning, speed of information processing, and motor compared to other domains. The finding is not surprising given the recognition that HIV-related NCI tends to impact frontal-subcortical regions of the brain. To our knowledge, only one other study has conducted an analysis based on subsets of a brief screening instrument that assesses global HIV-related cognitive impairment27. Banerjee et al. used the HIV dementia scale (HDS) as a measure of NCI and assessed psychomotor speed, memory, visual-spatial constructional praxis, and executive inhibitory control in relation to mortality. Among the four subset scores, executive inhibitory control (antisaccade subset) was associated with time to death, which is consistent with frontal-subcortical impairment pattern. Lastly, recent studies have found heightened variability within or between neuropsychological test scores to be associated with higher risk of death41,42. Such variability may also point to dysfunction related to attention and/or executive functions.

Apart from neurocognitive status, we also found that HIV-infected participants of non-Hispanic ethnicity, with higher viral loads, or lower hemoglobin had a higher hazard of mortality. These findings are adjusted for each other as well as for the neurocognitive status and are consistent with the literature. High plasma viral load and low serum hemoglobin are well-established independent risk factors of mortality in the HIV-infected population. Sempa et al. found a higher hazard of death per unit increase in the log10 viral load (HR = 1.63; 95% CI 1.02–2.60)43, and a recent study found that viral load was a stronger predictor of mortality compared to CD4 cell count18. Lower hemoglobin has also been associated with a higher hazard (HR = 1.32, 95% CI 1.12–1.55) of dying in the HIV-infected population44. Multiple studies have found a higher hazard of death among non-Hispanic blacks compared to non-Hispanic whites or overall Hispanics45,46. Our findings are somewhat consistent as 72% of NNTC participants were non-Hispanics, and 46% of the non-Hispanics were blacks.

To account for the variability in the course of NCI over time and its reversible nature in relation to mortality, joint modeling was performed. Joint modeling enables the repeated NCI measurements and survival to be modeled while accounting for interrelationships between the two processes47. We found that a linear change (increase/decrease) in global T scores is an independent predictor of mortality. To our knowledge, this is the first study to examine repeated measures of NCI in relation to mortality in the HIV-infected population. Our results provide useful predictive information of longitudinal measures of NC status on mortality. The model can be used to predict future survival outcomes as well as future neurocognitive status in terms of T scores when the T scores are known up to the current time (dynamic prediction). Clinicians can use this information for timely detection and appropriate mitigation of NCI based on prediction.

The current study has certain limitations. This is a clinic-based study with a volunteer and predominantly male participation that may limit generalizability. This study, however, is one of its kind, conducted at four centers in the US with information available on a wide range of demographic, behavioral, and clinical and laboratory measures. The study did not exclude anyone based on the presence of other contributing central nervous system (CNS) infections; thus, the NCI may, in part, be imparted by them and not exclusively by HIV infection. However, the prevalence of other CNS infections in the study population was low (9%). An additional limitation was that some variables were incompletely described (e.g., unclear type of hepatitis or cerebrovascular disease), or were based on self-reports (e.g., duration of HIV infection). Among the neurocognitive domains, verbal fluency was a single task domain, which may not be ideal. However, we were limited by the variables available for these secondary analyses, and this is consistent with past work by the NNTC group. Loss to follow up (12%) in the study may have underestimated overall mortality. The final Cox proportional hazards model was not adjusted for additional confounders like depressive symptoms due to missing data. Yet, a sub-analysis of participants with complete data on Beck Depression Inventory-II (BDI-II) scores showed a similar association between NCI and mortality then without BDI-II in the model, although the results cannot be directly compared due to sample size differences. We did not investigate cause-specific mortality, as there was no relevant information available. This may have overestimated mortality in association with NCI. Furthermore, we were not able to assess the potential confounding effects of unmeasured variables, such as comorbidity treatments. Joint modeling was conducted under the assumption of a linear form for the global T score trajectories and censoring being independent of the random effects that may lead to model misspecifications. However, we obtained similar results with splines in the model. The positive average regression coefficient (0.033) for the time variable in the longitudinal sub-model within joint modelling might have been related to practice effects and not to an actual increase in global T scores over the study period. Practice effect is typically stronger between the between 1st and 2nd assessments and less evident in subsequent assessments48. Thus, we conducted a sub-analysis excluding the 1st visit. The linear mixed effect model starting at the 2nd visit still generated a positive average regression coefficient (0.022). Lastly, repeated measures were used only for the primary exposure (global T scores), and all other covariates were assessed only at the baseline. Future research may consider including multiple covariates with repeated measures.

Conclusion

Overall, this study provides evidence that neurocognitive status interacts with age in relation to mortality and thus may have considerable prognostic utility for assessing mortality risk, particularly among older HIV-infected population. The current study identified older HIV-infected population as a group needing special attention for the longevity of life. The finding is substantial given that nearly half of people in the United States living with diagnosed HIV are aged 50 and older and that the neurocognitive status is associated with quality of life. The preliminary findings of the domain-specific analysis may suggest abstraction and executive functioning, speed of information processing, and motor domains to be particularly sensitive in relation to the hazard of mortality. The study further provides evidence that the increase in T scores over time is associated with lower mortality. The joint model provides useful predictive information not only about the hazard of mortality but also future cognitive scores. The study findings may be used to develop a predictive tool and thus may be used for patient-specific timely management strategies and future clinical interventions (lifestyle remedies, optimizing disease and comorbidity management and ARV management). The approach is particularly useful in clinical settings as repeated measures on biomarkers are very commonly generated for monitoring of chronic medical conditions. In conclusion, optimal management (treatment/rehabilitation) strategies, particularly based on the dynamic predictions and targeting not only the neurocognitive status but also age-related co-morbidities, may lead to an improved outcome in the HIV-infected population.

Supplementary Information

Supplementary Information (129.7KB, pdf)

Author contributions

Conceptualization and designing of the study were performed by Z.N., H.S.F., L.B., P.M., C.M.A. and S.T. Data was acquired by H.S.F. and S.T. Data analysis was performed by Z.N., L.B., C.S.W., J.M., M.A. and S.T. Manuscript was drafted by Z.N., L.B. and P.M. Review and revision of article was performed by Z.N., H.S.F., L.B., C.S.W., M.A., P.M., C.M.A., J.M. and S.T. All authors have read the manuscript and approved its contents.

Funding

Supported by the National Institutes of Health (NIH) under Award Number U24MH100925. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH or NNTC. Support for the NNTC is provided by the National Institutes of Health (NIH) under Award Numbers U24MH100925 U24MH100928, U24MH100929, U24MH100930, and U24MH100931.

Competing interests

The authors declare no competing interests.

Footnotes

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

The online version contains supplementary material available at 10.1038/s41598-021-83131-1.

References

  • 1.Antinori A, et al. Updated research nosology for HIV-associated neurocognitive disorders. Neurology. 2007;69:1789–1799. doi: 10.1212/01.WNL.0000287431.88658.8b. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.De Cock KM, Jaffe HW, Curran JW. The evolving epidemiology of HIV/AIDS. AIDS. 2012;26:1205–1213. doi: 10.1097/QAD.0b013e328354622a. [DOI] [PubMed] [Google Scholar]
  • 3.Heaton RK, et al. HIV-associated neurocognitive disorders persist in the era of potent antiretroviral therapy: CHARTER Study. Neurology. 2010;75:2087–2096. doi: 10.1212/WNL.0b013e318200d727. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Cysique LA, Brew BJ. Prevalence of non-confounded HIV-associated neurocognitive impairment in the context of plasma HIV RNA suppression. J. Neurovirol. 2011;17:176–183. doi: 10.1007/s13365-011-0021-x. [DOI] [PubMed] [Google Scholar]
  • 5.Mind Exchange Working Group et al. Assessment, diagnosis, and treatment of HIV-associated neurocognitive disorder: A consensus report of the mind exchange program. Clin. Infect. Dis. 2013;56:1004–1017. doi: 10.1093/cid/cis975. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Lindl KA, Marks DR, Kolson DL, Jordan-Sciutto KL. HIV-associated neurocognitive disorder: Pathogenesis and therapeutic opportunities. J. Neuroimmune Pharmacol. 2010;5:294–309. doi: 10.1007/s11481-010-9205-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Albright AV, Soldan SS, González-Scarano F. Pathogenesis of human immunodeficiency virus-induced neurological disease. J. Neurovirol. 2003;9:222–227. doi: 10.1080/13550280390194073. [DOI] [PubMed] [Google Scholar]
  • 8.Lentz MR, et al. Changes in MRS neuronal markers and T cell phenotypes observed during early HIV infection. Neurology. 2009;72:1465–1472. doi: 10.1212/WNL.0b013e3181a2e90a. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Woods SP, et al. Interrater reliability of clinical ratings and neurocognitive diagnoses in HIV. J. Clin. Exp. Neuropsychol. 2004;26:759–778. doi: 10.1080/13803390490509565. [DOI] [PubMed] [Google Scholar]
  • 10.Saylor D, et al. HIV-associated neurocognitive disorder—pathogenesis and prospects for treatment. Nat. Rev. Neurol. 2016;12:234. doi: 10.1038/nrneurol.2016.27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Ances BM, et al. Resting cerebral blood flow: A potential biomarker of the effects of HIV in the brain. Neurology. 2009;73:702–708. doi: 10.1212/WNL.0b013e3181b59a97. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.McArthur JC. HIV dementia: An evolving disease. J. Neuroimmunol. 2004;157:3–10. doi: 10.1016/j.jneuroim.2004.08.042. [DOI] [PubMed] [Google Scholar]
  • 13.Letendre SL, Ellis RJ, Ances BM, McCutchan JA. Neurologic complications of HIV disease and their treatment. Top. HIV. Med. 2010;18:45–55. [PMC free article] [PubMed] [Google Scholar]
  • 14.Heaton RK, et al. HIV-associated neurocognitive disorders before and during the era of combination antiretroviral therapy: Differences in rates, nature, and predictors. J. Neurovirol. 2011;17:3–16. doi: 10.1007/s13365-010-0006-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Ellis RJ, et al. Neurocognitive impairment is an independent risk factor for death in HIV infection. Arch. Neurol. 1997;54:416–424. doi: 10.1001/archneur.1997.00550160054016. [DOI] [PubMed] [Google Scholar]
  • 16.van Sighem A, et al. Mortality in patients with successful initial response to highly active antiretroviral therapy is still higher than in non-HIV-infected individuals. JAIDS. 2005;40:212–218. doi: 10.1097/01.qai.0000165911.97085.d0. [DOI] [PubMed] [Google Scholar]
  • 17.Bhaskaran K, et al. Changes in the risk of death after HIV seroconversion compared with mortality in the general population. JAMA. 2008;300:51–59. doi: 10.1001/jama.300.1.51. [DOI] [PubMed] [Google Scholar]
  • 18.Shoko C, Chikobvu D. A superiority of viral load over CD4 cell count when predicting mortality in HIV patients on therapy. BMC Infect. Dis. 2019;19:169. doi: 10.1186/s12879-019-3781-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Adams JW, et al. Association of cannabis, stimulant, and alcohol use with mortality prognosis among HIV-infected men. AIDS. Behav. 2018;22:1341–1351. doi: 10.1007/s10461-017-1905-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Brothers TD, et al. Predictors of transitions in frailty severity and mortality among people aging with HIV. PLoS One. 2017;12:e0185352. doi: 10.1371/journal.pone.0185352. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Wilkie FL, et al. Mild cognitive impairment and risk of mortality in HIV-1 infection. J. Neuropsychiatry Clin. Neurosci. 1998;10:125–132. doi: 10.1176/jnp.10.2.125. [DOI] [PubMed] [Google Scholar]
  • 22.Mayeux R, et al. Mortality risks in gay men with human immunodeficiency virus infection and cognitive impairment. Neurology. 1993;43:176–182. doi: 10.1212/WNL.43.1_Part_1.176. [DOI] [PubMed] [Google Scholar]
  • 23.Patel S, et al. United States National Trends in mortality, length of stay (LOS) and associated costs of cognitive impairment in HIV population from 2005 to 2014. AIDS Behav. 2018;22:3198–3208. doi: 10.1007/s10461-018-2128-z. [DOI] [PubMed] [Google Scholar]
  • 24.Dore GJ, et al. Marked improvement in survival following AIDS dementia complex in the era of highly active antiretroviral therapy. AIDS. 2003;17:1539–1545. doi: 10.1097/00002030-200307040-00015. [DOI] [PubMed] [Google Scholar]
  • 25.Lescure F, et al. Incidence and impact on mortality of severe neurocognitive disorders in persons with and without HIV infection: A Danish nationwide cohort study. Clin. Infect. Dis. 2011;52:235–243. doi: 10.1093/cid/ciq041. [DOI] [PubMed] [Google Scholar]
  • 26.Sevigny JJ, et al. An evaluation of neurocognitive status and markers of immune activation as predictors of time to death in advanced HIV infection. Arch. Neurol. 2007;64:97–102. doi: 10.1001/archneur.64.1.97. [DOI] [PubMed] [Google Scholar]
  • 27.Banerjee N, McIntosh RC, Ironson G. Impaired neurocognitive performance and mortality in HIV: Assessing the prognostic value of the HIV-dementia scale. AIDS Behav. 2019;23:3482–3492. doi: 10.1007/s10461-019-02423-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Hu X, et al. Diagnostic accuracy of the international HIV dementia scale and HIV dementia scale: A meta-analysis. Exp. Ther. Med. 2012;4:665–668. doi: 10.3892/etm.2012.665. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Bottiggi KA, et al. The HIV Dementia Scale: Predictive power in mild dementia and HAART. J. Neurol. Sci. 2007;260:11–15. doi: 10.1016/j.jns.2006.03.023. [DOI] [PubMed] [Google Scholar]
  • 30.NNTC. National NeuoAIDS Tissue Consortium-About. https://nntc.org/index. Accessed 26 Jan 2020.
  • 31.Morgello S, et al. The National NeuroAIDS Tissue Consortium: A new paradigm in brain banking with an emphasis on infectious disease. Neuropathol. Appl. Neurobiol. 2001;27:326–335. doi: 10.1046/j.0305-1846.2001.00334.x. [DOI] [PubMed] [Google Scholar]
  • 32.Heithoff AJ, et al. The integrated National NeuroAIDS Tissue Consortium database: A rich platform for neuroHIV research. Database. 2019;20:20. doi: 10.1093/database/bay134. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Cassol E, Misra V, Morgello S, Gabuzda D. Applications and limitations of inflammatory biomarkers for studies on neurocognitive impairment in HIV infection. J. Neuroimmune Pharmacol. 2013;8:1087–1097. doi: 10.1007/s11481-013-9512-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Ding Y, et al. Interaction effects between HIV and aging on selective neurocognitive impairment. J. Neuroimmune Pharmacol. 2017;12:661–669. doi: 10.1007/s11481-017-9748-3. [DOI] [PubMed] [Google Scholar]
  • 35.Cohen RA, Seider TR, Navia B. HIV effects on age-associated neurocognitive dysfunction: Premature cognitive aging or neurodegenerative disease? Alzheimers Res. Ther. 2015;7:37. doi: 10.1186/s13195-015-0123-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Currier JS, et al. Epidemiological evidence for cardiovascular disease in HIV-infected patients and relationship to highly active antiretroviral therapy. Circulation. 2008;118:e29–e35. doi: 10.1161/CIRCULATIONAHA.107.189624. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Cruse B, Cysique LA, Markus R, Brew BJ. Cerebrovascular disease in HIV-infected individuals in the era of highly active antiretroviral therapy. J. Neurovirol. 2012;18:264–276. doi: 10.1007/s13365-012-0092-3. [DOI] [PubMed] [Google Scholar]
  • 38.Collaboration ATC. Life expectancy of individuals on combination antiretroviral therapy in high-income countries: A collaborative analysis of 14 cohort studies. Lancet. 2008;372:293–299. doi: 10.1016/S0140-6736(08)61113-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Ettenhofer ML, et al. Aging, neurocognition, and medication adherence in HIV infection. Am. J. Geriatr Psychiatry. 2009;17:281–290. doi: 10.1097/JGP.0b013e31819431bd. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Morgan EE, et al. Neurocognitive impairment is associated with lower health literacy among persons living with HIV infection. AIDS Behav. 2015;19:166–177. doi: 10.1007/s10461-014-0851-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.MacDonald SW, Hultsch DF, Dixon RA. Predicting impending death: Inconsistency in speed is a selective and early marker. Psychol. Aging. 2008;23:595. doi: 10.1037/0882-7974.23.3.595. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Anderson AE, et al. Intraindividual variability in neuropsychological performance predicts cognitive decline and death in HIV. Neuropsychology. 2018;32:966. doi: 10.1037/neu0000482. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Sempa JB, et al. Reevaluating cumulative HIV-1 viral load as a prognostic predictor: Predicting opportunistic infection incidence and mortality in a Ugandan Cohort. Am. J. Epidemiol. 2016;184:67–77. doi: 10.1093/aje/kwv303. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Bisson GP, et al. Risk factors for early mortality on antiretroviral therapy in advanced HIV-infected adults. AIDS. 2017;31:2217–2225. doi: 10.1097/QAD.0000000000001606. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Woldemichael G, Christiansen D, Thomas S, Benbow N. Demographic characteristics and survival with AIDS: Health disparities in Chicago, 1993–2001. Am. J. Public Health. 2009;99:S118–S123. doi: 10.2105/AJPH.2007.124750. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Trepka MJ, et al. Sex and racial/ethnic differences in premature mortality due to HIV: Florida, 2000–2009. Public Health Rep. 2015;130:505–513. doi: 10.1177/003335491513000513. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Lim H, Mondal P, Skinner S. Joint modeling of longitudinal and event time data: Application to HIV study. J. Med. Stat. Inform. 2013;1:1. doi: 10.7243/2053-7662-1-1. [DOI] [Google Scholar]
  • 48.Collie A, Maruff P, Darby DG, McSthephen M. The effects of practice on the cognitive test performance of neurologically normal individuals assessed at brief test-retest intervals. J. Int. Neuropsychol. Soc. 2003;9:419. doi: 10.1017/S1355617703930074. [DOI] [PubMed] [Google Scholar]
  • 49.Heaton R, Miller SW, Taylor MJ, Grant I. Revised Comprehensive Norms for an Expanded Halstead-Reitan Battery: Demographically Adjusted Neuropsychological Norms for African American and Caucasian Adults. Lutz: Psychological Assessment Resources; 2004. [Google Scholar]
  • 50.Norman MA, et al. Demographically corrected norms for African Americans and Caucasians on the Hopkins verbal learning test–revised, brief visuospatial memory test–revised, Stroop color and word test, and Wisconsin card sorting test 64-card version. J. Clin. Exp. Neuropsychol. 2011;33:793–804. doi: 10.1080/13803395.2011.559157. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.David W. Wechsler Adult Intelligence Scale. San Antonio: Psychological Corporation; 1997. [Google Scholar]
  • 52.Diehr MC, et al. The 50 and 100-item short forms of the Paced Auditory Serial Addition Task (PASAT): Demographically corrected norms and comparisons with the full PASAT in normal and clinical samples. J. Clin. Exp. Neuropsychol. 2003;25:571–585. doi: 10.1076/jcen.25.4.571.13876. [DOI] [PubMed] [Google Scholar]
  • 53.Benedict, R. H. Brief Visuospatial Memory Test-Revised (PAR, 1997).
  • 54.Benedict RH, Schretlen D, Groninger L, Brandt J. Hopkins verbal learning test–revised: Normative data and analysis of inter-form and test-retest reliability. Clin. Neuropsychol. 1998;12:43–55. doi: 10.1076/clin.12.1.43.1726. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Information (129.7KB, pdf)

Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES