Skip to main content
Open Forum Infectious Diseases logoLink to Open Forum Infectious Diseases
. 2024 Jun 17;11(7):ofae333. doi: 10.1093/ofid/ofae333

Discrimination of the Veterans Aging Cohort Study Index 2.0 for Predicting Cause-specific Mortality Among Persons With HIV in Europe and North America

Julie Ambia 1,, Suzanne M Ingle 2, Kathleen McGinnis 3, Nikos Pantazis 4, Michael J Silverberg 5, Linda Wittkop 6,7, Katharina Kusejko 8, Heidi Crane 9, Ard van Sighem 10, Mario Sarcletti 11, Alessandro Cozzi-Lepri 12, Pere Domingo 13, Inma Jarrin 14,15, Christoph Wyen 16, Mojgan Hessamfar 17, Lei Zhang 18,19, Matthias Cavassini 20, Juan Berenguer 21, Timothy R Sterling 22, Peter Reiss 23,24,25, Sophie Abgrall 26,27, M John Gill 28, Amy Justice 29,30, Jonathan A C Sterne 31, Adam Trickey 32,2
PMCID: PMC11249920  PMID: 39015347

Abstract

Background

Predicting cause-specific mortality among people with HIV (PWH) could facilitate targeted care to improve survival. We assessed discrimination of the Veterans Aging Cohort Study (VACS) Index 2.0 in predicting cause-specific mortality among PWH on antiretroviral therapy (ART).

Methods

Using Antiretroviral Therapy Cohort Collaboration data for PWH who initiated ART between 2000 and 2018, VACS Index 2.0 scores (higher scores indicate worse prognosis) were calculated around a randomly selected visit date at least 1 year after ART initiation. Missingness in VACS Index 2.0 variables was addressed through multiple imputation. Cox models estimated associations between VACS Index 2.0 and causes of death, with discrimination evaluated using Harrell's C-statistic. Absolute mortality risk was modelled using flexible parametric survival models.

Results

Of 59 741 PWH (mean age: 43 years; 80% male), the mean VACS Index 2.0 at baseline was 41 (range: 0–129). For 2425 deaths over 168 162 person-years follow-up (median: 2.6 years/person), AIDS (n = 455) and non–AIDS-defining cancers (n = 452) were the most common causes. Predicted 5-year mortality for PWH with a mean VACS Index 2.0 score of 38 at baseline was 1% and approximately doubled for every 10-unit increase. The 5-year all-cause mortality C-statistic was .83. Discrimination with the VACS Index 2.0 was highest for deaths resulting from AIDS (0.91), liver-related (0.91), respiratory-related (0.89), non-AIDS infections (0.87), and non–AIDS-defining cancers (0.83), and lowest for suicides/accidental deaths (0.65).

Conclusions

For deaths among PWH, discrimination with the VACS Index 2.0 was highest for deaths with measurable physiological causes and was lowest for suicide/accidental deaths.

Keywords: VACS, C-statistic, prognosis, absolute risk, multiple imputation


For people with HIV on antiretroviral therapy, the Veterans Aging Cohort Study Index 2.0 better predicted AIDS-, liver-, and respiratory-related deaths than suicides/accidental deaths. Predicted 5-year mortality risks for each cause were low, except for people with very high Veterans Aging Cohort Study Index 2.0 scores.

BACKGROUND

Mortality among people with HIV (PWH) has markedly decreased since the introduction of highly active antiretroviral therapy in the mid-1990s [1], driven by substantial declines in AIDS-related mortality [2]. However, mortality rates among PWH on antiretroviral therapy (ART) are still higher than in the general population [3]. Factors contributing to this include higher prevalence of comorbidities and behavioral risk factors such as smoking and substance use [4, 5].

The Veterans Aging Cohort Study (VACS) Index [6] was developed to discriminate all-cause mortality risk in PWH [7], accounting for interactions among organ dysfunctions, such as those in the liver and lungs, HIV, and comorbidities. The VACS Index 2.0 improved on discrimination of the original score through the addition of non–HIV-specific biomarkers (albumin, white blood cells, and body mass index) [8].

The VACS Index 2.0 has been applied to predict the risk of hospitalization [9], all-cause mortality [10], and functional decline [11] among PWH. The VACS Index 2.0 also acts as an indicator of physiologic frailty [12], neurocognitive impairment [13], and can predict the risk of hospitalization, intensive care unit admission, and mortality among PWH that had COVID-19 [14]. However, its utility in predicting cause-specific mortality among PWH has not been evaluated. This could enable the design of targeted interventions and tailored care plans to address risks associated with cause-specific mortality. We assessed the discrimination of VACS Index 2.0 in predicting specific causes of death among PWH and estimated 5-year risks of specific causes of death.

METHODS

Study Setting and Population

Data were from the Antiretroviral Therapy Cohort Collaboration (ART-CC) 2019 dataset, which includes 20 cohorts of adult PWH on ART in Europe and North America [15]. Cohorts were included if a cause of death was assigned to more than 70% of PWH who had died. PWH were included if they started combination ART (consisting of at least 3 ART drugs) from 2000 to 2018, were aged ≥16 years, and had survived for at least 1 year after starting ART.

Coding Causes of Death

A single cause of death for each person who died was assigned using an adapted version of the Coding of Death in HIV protocol (CoDe) protocol [16]. Further details are described elsewhere [17]. In summary, a clinician used cause of death data (either in International Classification of Diseases [ICD]-9 or ICD-10 format, or as free-text) combined with demographic, medical, and laboratory data, to assign a cause of death using the CoDe categorizations. For deaths in ICD-9 or ICD-10 format, a computer algorithm also assigned a cause of death. For deaths in free-text format, a second clinician assigned a cause of death instead of the algorithm. Disagreements between the assigned causes of death were reviewed by a panel of clinicians until consensus was reached.

Deaths were grouped into 10 categories (Supplementary Table 1): AIDS, cardiovascular, respiratory, substance abuse, liver-related, non-AIDS infection, non–AIDS-defining cancers (NADCs), suicide/accidents, unclassifiable, and other deaths. Suicide/accidental deaths were grouped together, due to the common misclassification of suicides as accidents [18]. Hepatocellular carcinoma mortality was included in the liver-related, rather than NADCs category to include deaths related to viral hepatitis as liver related.

Follow-up Time

For consistency with other research, the value of VACS Index 2.0 on a randomly selected visit date occurring at least 1 year after initiation of ART was used, with follow-up starting on that date [10]. This will be our baseline date for the analysis. The first year after ART initiation was excluded because many deaths during this period are due to PWH presenting to care with advanced disease [19]. Follow-up ended at the earliest of death, loss to follow-up, 5 years after baseline, or the cohort-specific administrative censoring date, the latest of which was June 2020.

VACS Index 2.0

The VACS Index 2.0 is a weighted sum of 10 variables: age, traditional HIV indicators (CD4 cell count, HIV RNA), organ system injury indicators (hemoglobin, Fibrosis-4 Index, estimated glomerular filtration rate, albumin, white blood cell count), body mass index, and hepatitis C virus infection. We calculated validated composite biomarkers of liver and renal injury: Fibrosis-4 Index was calculated using aspartate aminotransferase, alanine aminotransferase, platelets, and age; estimated glomerular filtration rate was calculated via the CKD-EPI equation using serum creatinine, sex, and age [20]. Higher values of VACS Index 2.0 are indicative of poorer prognosis for mortality [10]. Laboratory test values were included in the analysis if measured within 365 days before or 7 days after the baseline date.

Statistical Analyses

We derived Kaplan-Meier estimates of 5-year all-cause mortality. Hazard ratios (HR) for all-cause and cause-specific mortality per 10-unit increase in VACS Index 2.0 were estimated using Cox models. When the outcome of interest is cause-specific mortality the other causes of death represent a competing risk, which precludes the outcome of interest and can bias results. Therefore, we compared the Cox model HRs with subdistribution HRs estimated from competing risks regression models. Discrimination of VACS Index 2.0 in predicting cause-specific mortality was assessed using Harrell's C-statistic, which measures the ability of a predictive model to distinguish between individuals who do and do not experience the outcome and varies from 0.5 (no discrimination) to 1.0 (perfect discrimination) [21]. Analyses were additionally stratified into 2 calendar periods of ART initiation: 2000–2009 and 2010–2018. Subgroup analyses were conducted to assess the discrimination of the VACS Index 2.0 between men and women and between people of White and non-White ethnicity (combining non-White ethnicity into 1 category because of a lack of deaths). This division allowed for the examination of any potential differences in the predictive ability of the VACS Index 2.0 over time. However, subdividing the calendar periods further was not possible because of the limited number of deaths occurring after 2010.

To make mortality predictions more relevant to current mortality among PWH on ART, models to predict 5-year cause-specific mortality were restricted to PWH who initiated ART between 2010 and 2018 [22]. We used the Royston-Parmar flexible parametric survival model, which uses restricted cubic splines to flexibly model the baseline log-cumulative hazard [23]. The Bayesian Information Criterion was used to determine the optimal number of interior knots (1–4 knots were assessed) for the baseline spline function using an initial model fitted without any variables. Bayesian Information Criterion [24] was also used to determine the best functional form of the VACS Index 2.0 (Supplementary Figure 1, Supplementary Table 2, and 3).

Missing Data

Univariable and multivariable logistic regression models were used to assess predictors of missingness. Multiple imputation by chained equations was performed with a fully conditional specification [25], incorporating all variables in the analysis model: VACS Index 2.0 components at baseline, calendar year of ART initiation, cohort, VACS Index 2.0 components at ART initiation, cause of death, and the Nelson-Aalen cumulative baseline hazard estimate [26]. Only VACS Index 2.0 components with missing values were imputed using multiple imputation by chained equations. One hundred imputed datasets were created, and Cox regression models were estimated from each. Effect estimates and discrimination statistics were pooled using Rubin's rules [27]. Further information on the multiple imputation process is included in the Appendix. A sensitivity analysis was performed to compare the C-statistic generated from complete cases to that generated from the imputed data. This work was carried out using the computational facilities of the Advanced Computing Research Centre, University of Bristol (http://www.bristol.ac.uk/acrc/). Analyses were conducted using Stata version 17.0 [28].

RESULTS

Twelve ART-CC cohorts were eligible for inclusion based on completeness of cause of death data. 59 741 PWH from these cohorts contributed to analyses with 168 162 person-years of follow-up. The median follow-up time for each person was 2.6 (interquartile range [IQR]: 1.2–5.0) years. The mean age at baseline was 43 years, most (47 842; [80%]) were male, and more than half (31 287 [52.4%]) of those included were men who had acquired HIV through sex with men (Table 1). A total of 52 294 (90.2%) had viral load <100 copies/mL at baseline, whereas 10 679 (17.9%) had AIDS at ART initiation. VACS Index 2.0 scores at baseline ranged from 0 to 129.

Table 1.

Characteristics at Follow-up Start of Included Persons With HIV

2000–2018
n = 59 741 (100.0%)
2000–2009
n = 26 493 (44.3%)
2010–2018
n = 33 248 (55.7%)
Categorical characteristics: n (%)
 Male 47 842 (80.1%) 19 780 (74.7%) 28 062 (84.4%)
 Missing 0 0 0
 Hepatitis C virus (RNA positive) 5193 (8.7%) 3273 (12.4%) 1920 (5.8%)
 Missing 0 0 0
 AIDS at ART initiation 10 679 (17.9%) 6428 (24.3%) 4251 (12.8%)
 Missing 0 0 0
Probable route of HIV acquisition
 Men who have sex with men 31 287 (52.4%) 11 044 (41.7%) 20 243 (60.9%)
 Heterosexual sex 19 745 (33.1%) 10 258 (38.7%) 9487 (28.5%)
 Injecting drug use 5485 (9.2%) 3551 (13.4%) 1934 (5.8%)
 Transfusion, other, or unknown 3224 (5.3%) 1640 (6.2%) 1584 (4.8%)
 Missing 0 0 0
Race/ethnicity
 White 45 666 (76.4%) 19 836 (74.9%) 25 830 (77.7%)
 Black 7787 (13.0%) 4257 (16.1%) 3530 (10.6%)
 Hispanic 3114 (5.2%) 997 (3.8%) 2117 (6.4%)
 Other 2351 (4.0%) 921 (3.4%) 1430 (4.3%)
 Unknown 823 (1.4%) 482 (1.8%) 341 (1.0%)
 Missing 0 0 0
Viral load (copies/mL)
 <100 52 294 (90.2%) 22 317 (85.5%) 29 977 (94.0%)
 101–1000 2271 (3.9%) 1352 (5.2%) 919 (2.9%)
 1001–10 000 1147 (2.0%) 803 (3.1%) 344 (1.1%)
 10 001 2244 (3.9%) 1606 (6.2%) 638 (2.0%)
 Missing 1785 415 1370
Fibrosis-4 index
 <1.45 39 449 (83.2%) 15 618 (78.9%) 39 449 (83.2%)
 1.45–3.25 7069 (14.9%) 3577 (18.1%) 7069 (14.9%)
 >3.25 917 (1.9%) 595 (3.0%) 917 (1.9%)
 Missing 12 306 6703 5603
Continuous characteristics (mean)
 Age in years 43 44 42
 Missing 0 0 0
 Albumin (g/dL) 4.3 4.2 4.3
 Missing 32 875 14 551 18 324
 Hemoglobin (g/dL) 13.7 13.5 13.9
 Missing 7405 4287 3118
 White blood cell (103/µL) 6.3 6.2 6.4
 Missing 16 816 7154 9662
 CD4 count (cells/mm3) 605.2 545.7 655.0
 Missing 20 772 8746 12 026
 Estimated glomerular filtration rate (mL/min/1.73 m²) 137.1 142.5 132.7
 Missing 1773 1063 710
 Body mass index (kg/m3) 24.8 24.8 24.8
 Missing 10 885 4015 6870

Abbreviation: ART, antiretroviral therapy.

More than half (33 248 [55.7%]) of the included PWH started ART between 2010 and 2018. PWH who started follow-up in 2001 had been on ART for a median of 1.2 (IQR: 1.1–1.4) years beforehand, whereas the median prior duration on ART was 3.3 (IQR: 1.7–6.1) years for PWH who started follow-up in 2015. The median CD4 counts at baseline increased from 216 (IQR: 64–359) for those starting follow-up in 2001 to 345 (IQR: 190–504) cells/mm3 for those starting in 2018. Compared to PWH who started ART between 2000 and 2009, a lower proportion of those who initiated ART between 2010 and 2018 had AIDS at the time of initiation (12.8% [4251] versus 24.3% [6428]), viral loads above 1000 copies/mL (3.1% [982] vs 9.3% [2409]), and hepatitis C virus (5.8% [1920] vs 12.4% [3273]). Overall, 9927 (16.6%) PWH had complete records for all laboratory components of the VACS Index 2.0. Missingness ranged from 1773 (3.0%) PWH without creatinine data to 32 875 (55.0%) PWH without albumin data.

All-cause Mortality

Of the 59 741 PWH, 2425 (4.1%) died over 5 years of follow-up. The mean age at death was 51.2 (95% confidence interval [CI], 50.8–51.6) years. The 5-year mortality rate decreased from 64.1/1000 person-years for PWH who started in 2001 to 8.2/1000 person-years for people starting follow-up in 2015. Using imputed data, among PWH who did not subsequently die, the mean VACS Index 2.0 was 41.2 (95% CI, 41.1–41.4) and was 45.4 (95% CI, 45.1–45.6) for PWH who started in 2000–2009, and 38.1 (95% CI, 37.9–38.3) in 2010–2018. Among PWH who subsequently died, the mean VACS Index 2.0 was 68 (95% CI, 67–68) in 2000–2018, 69 (95% CI, 68–70) in 2000–2009, and 63 (95% CI, 62–65) in 2010–2018 (Table 2). The estimated all-cause mortality HR per 10-unit increase in VACS Index 2.0 was 1.84 (95% CI, 1.81–1.87), and the corresponding C-statistic for discrimination was 0.83 (Table 3).

Table 2.

VACS Index 2.0 at Follow-up Start by Cause of Death, Using Multiply Imputed Data

Cause Of Death Year Of ART Start
2000–2018 2000–2009 2010–2018
No. of deaths Mean (95% CI) VACS Index 2.0 No. of deaths Mean (95% CI) VACS Index 2.0 No. of deaths Mean (95% CI) VACS Index 2.0
All-cause 2425 68 (67–68) 1887 69 (68–70) 538 63 (62–65)
AIDS 455 78 (76–80) 363 79 (76–81) 92 74 (69–78)
Liver (including HCC) 148 76 (72–80) 122 77 (73–81) 26 70 (60–80)
Cardiovascular 214 62 (59–65) 166 63 (60–66) 48 58 (53–63)
Respiratory 99 72 (68–75) 75 70 (66–74) 24 76 (66–86)
Non-AIDS infection 141 72 (68–76) 109 73 (69–78) 32 66 (58–74)
Non–AIDS-defining cancers 452 66 (64–68) 351 67 (64–69) 101 65 (61–69)
Other 306 66 (63–69) 256 67 (64–70) 50 61 (55–67)
Substance abuse 97 62 (58–66) 76 62 (57–67) 21 61 (50–73)
Suicide/accident 141 50 (46–54) 98 51 (47–55) 43 48 (42–54)
Unclassifiable 372 63 (61–65) 271 65 (63–68) 101 58 (53–62)

Abbreviations: ART, antiretroviral therapy; CI, confidence interval; HCC, hepatocellular carcinoma; VACS, Veterans Aging Cohort Study.

Table 3.

All-cause and Cause-specific Mortality Hazard Ratios per 10-point Increment of VACS Index 2.0 and Discrimination C-statistic, Using Multiply Imputed Data

Cause of Death 2000–2018 2000–2009 2010–2018
Hazard ratio (95% CI) C-statistic Hazard ratio (95% CI) C-statistic Hazard ratio (95% CI) C-statistic
All-cause 1.84 (1.81–1.87) 0.83 1.77 (1.73–1.80) 0.81 1.97 (1.90–2.05) 0.83
AIDS 2.14 (2.06–2.23) 0.91 2.06 (1.97–2.16) 0.89 2.27 (2.09–2.47) 0.93
Liver (including HCC) 2.13 (1.99–2.29) 0.91 2.08 (1.92–2.25) 0.89 2.26 (1.92–2.66) 0.90
Cardiovascular 1.66 (1.56–1.77) 0.79 1.59 (1.48–1.71) 0.76 1.82 (1.59–2.10) 0.79
Respiratory 2.00 (1.83–2.18) 0.89 1.84 (1.66–2.05) 0.86 2.42 (2.05–2.86) 0.94
Non-AIDS infection 1.98 (1.85–2.13) 0.87 1.93 (1.77–2.09) 0.85 2.04 (1.76–2.35) 0.83
Non–AIDS-defining cancers 1.81 (1.73–1.89) 0.83 1.69 (1.61–1.78) 0.79 2.04 (1.87–2.23) 0.87
Other 1.76 (1.67–1.85) 0.78 1.69 (1.60–1.79) 0.76 1.85 (1.63–2.10) 0.79
Substance abuse 1.70 (1.56–1.87) 0.83 1.60 (1.44–1.77) 0.81 1.92 (1.58–2.34) 0.82
Suicide/accident 1.32 (1.20–1.44) 0.65 1.25 (1.12–1.39) 0.63 1.41 (1.19–1.68) 0.69
Unclassifiable 1.70 (1.62–1.78) 0.77 1.66 (1.57–1.76) 0.77 1.74 (1.58–1.91) 0.75

Abbreviations: CI, confidence interval; HCC, hepatocellular carcinoma; VACS, Veterans Aging Cohort Study.

The predicted 5-year mortality for PWH with a mean VACS Index 2.0 score of 38 at baseline during 2010–2018 was 1.3%. The 5-year observed and predicted risks of dying were similar in PWH who started ART in 2010–2018. However, the absolute risk of dying fitted better for lower scores of the VACS Index 2.0 than for higher values, where there were fewer observations (Figure 1). The predicted risk of all-cause mortality approximately doubled at every 10-unit interval of the VACS Index 2.0 (Table 4).

Figure 1.

Figure 1.

Five-year probability of predicted and observed all-cause mortality.

Table 4.

Five-year Predicted all-cause and Cause-specific Mortality Percentages by VACS Index 2.0 Score, Using Multiply Imputed Data

VACS Index 2.0
10 20 30 40 50 60 70 80 90 100
All-cause 0.2% 0.4% 0.8% 1.6% 3.1% 5.9% 11.1% 20.4% 35.6% 57.2%
AIDS 0.0% 0.0% 0.1% 0.1% 0.3% 0.7% 1.5% 3.4% 7.6% 16.5%
Liver (including HCC) 0.0% 0.0% 0.0% 0.1% 0.1% 0.3% 0.7% 1.4% 3.1% 6.7%
Cardiovascular 0.0% 0.1% 0.1% 0.2% 0.4% 0.6% 1.1% 1.9% 3.3% 5.6%
Respiratory 0.0% 0.0% 0.0% 0.0% 0.1% 0.2% 0.5% 1.2% 2.8% 6.5%
Non-AIDS infection 0.0% 0.0% 0.0% 0.1% 0.2% 0.3% 0.6% 1.3% 2.5% 5.1%
Non–AIDS-defining cancers 0.0% 0.1% 0.2% 0.3% 0.6% 1.2% 2.4% 4.6% 9.0% 17.1%
Other 0.0% 0.0% 0.1% 0.2% 0.3% 0.6% 1.0% 1.9% 3.5% 6.3%
Substance abuse 0.0% 0.0% 0.0% 0.1% 0.2% 0.3% 0.5% 1.0% 1.9% 3.4%
Suicide/accident 0.1% 0.1% 0.2% 0.2% 0.3% 0.4% 0.5% 0.7% 1.0% 1.3%
Unclassifiable 0.1% 0.1% 0.3% 0.4% 0.7% 1.3% 2.2% 3.7% 6.2% 10.4%

Abbreviations: HCC, hepatocellular carcinoma; VACS, Veterans Aging Cohort Study..

Cause-specific Mortality

The 5 most frequent causes of death were AIDS (n = 455), NADCs (n = 452), cardiovascular diseases (n = 214), liver-related diseases (n = 148), and non-AIDS infection (n = 141). Other causes of death were suicide/accident (n = 141), respiratory (n = 99), and substance abuse (n = 97) (Table 2). For PWH who started ART during 2000–2009, the mean VACS Index 2.0 was highest for PWH who subsequently died of AIDS (79 [95% CI, 76–81]), and lowest for suicide/accidental deaths (51 [95% CI, 47–55]). For PWH who started ART during 2010–2018, the mean VACS Index 2.0 was highest for those who subsequently died of respiratory causes (76 [95% CI, 66–86]) and AIDS (74 [95% CI, 69–78]), whereas PWH who subsequently died from suicide/accidents had the lowest mean VACS Index 2.0 (48 [95% CI, 42–54]).

For PWH who started ART between 2000 and 2009, discrimination of the VACS Index 2.0 was highest for AIDS and liver-related deaths (0.89), followed by respiratory-related deaths (0.86), and was lowest for suicides/accidental deaths (0.63) (Table 3). For PWH who started ART from 2010 to 2018, discrimination was highest for deaths from respiratory infections (0.94), AIDS (0.93), liver diseases (0.90), NADCs (0.87), and non-AIDS infections (0.83). Again, suicide/accident-related deaths had the lowest discrimination (0.69). The highest C-statistics corresponded to the highest HRs, for example the highest HR was for AIDS (2.27 [95% CI, 2.09–2.47]) and the lowest was for suicide/accidental deaths (1.25 [95% CI, 1.12–1.39]). Compared to the predicted risk of deaths from NADCs and AIDS, which roughly doubled per 10-unit intervals of the VACS Index 2.0, suicide/accidents deaths only increased slightly as the VACS Index 2.0 increased (Table 4).

Sensitivity Analyses

Most characteristics were similar among PWH with and without complete data, except for cohort (Supplementary Table 4). After adjusting for confounding, PWH who had died were more likely to have missing data than those who did not die, as were those who started ART in 2000–2009 compared with those starting ART in 2010–2018 (Supplementary Table 5). Sensitivity analysis using complete case data was similar to the main results from imputed data, showing that AIDS, liver-, and respiratory-related deaths had the highest discrimination, whereas deaths from suicide/accidents had the lowest discrimination. The mean VACS Index 2.0 at baseline was similar in the complete-case and imputed analysis (Supplementary Table 6). In complete-case analysis (N = 9927), the mean VACS Index 2.0 for people who did not and did die was 39.9 (95% CI, 39.5–40.3) (n = 9490) and 68 (95% CI, 66–70) (n = 437), respectively.

All-cause and cause-specific HRs were similar when using Cox models and competing risk models (Supplementary Table 7). However, the C-statistics differed for substance abuse deaths, 0.74 (95% CI, .65–.84) and 0.89 (95% CI, .84–.94) using Cox models and competing risk models, respectively. This was also the case for suicide/accidental deaths, 0.51 (95% CI, .39–.62) and 0.73 (95% CI, .65–.82), and unclassifiable deaths, 0.81 (95% CI, .74–.87) and 0.89 (95% CI, .84–.93).

In subgroup analysis, the mean VACS Index 2.0 scores and C-statistics were similar in both men and women for all-cause and cause-specific mortality, except for respiratory, non-AIDS infection, and suicide/accident-related deaths (Supplementary Table 8). The mean VACS Index 2.0 score for all-cause mortality was lower in people with White ethnicity than non-White ethnicity. By different causes of death, the C-statistics differed for deaths from liver, respiratory, non-AIDS infection, and substance abuse (Supplementary Table 9).

DISCUSSION

The VACS Index 2.0 demonstrated better predictive 5-year accuracy for deaths attributed to AIDS, liver disease, and respiratory infections than for suicides or accidental deaths. As expected, discrimination was lowest for suicides or accidental deaths, for which the predictors were not included in the calculation of the VACS Index 2.0. The VACS Index 2.0 showed better discrimination of most causes of death among PWH who started ART between 2010 and 2018, compared to those who started ART between 2000 and 2009, particularly for NADC deaths. The 5-year probability of mortality increases nearly twofold with every 10-unit increase of the VACS Index 2.0.

The discrimination of the VACS Index 2.0 in predicting 5-year all-cause mortality in our study, 0.83, was the same as in a previous study by Tate et al [8]. That study also found that the risk of all-cause mortality increased for PWH with higher VACS Index 2.0 scores. Better performance of the VACS Index 2.0 in more recent years (2010–2018) compared to earlier years (1999–2009) was reported in a study of 4 clinical cohorts in North America [10], similar to our results. This could be due to the original calibration and validation of the VACS Index 2.0 taking place during the 2010–2018 period, aligning the model with more current data and trends.

The major strength of this study is the coding of cause-specific mortality among a large collaboration of HIV cohorts across many high-income countries, encompassing diverse demographics and clinical profiles. Use of standardized CoDe protocol methods further strengthens the study's results by improving the accuracy in determining the cause of death among PWH. However, there is a possibility that for some PWH, causes of death were misclassified because of retrospective assignment without complete patient history information. Additionally, there may have been underascertainment of mortality because 6 of 12 ART-CC cohorts were not linked to vital statistics registries. However, these cohorts employed alternative methods to identify deaths among PWH who were lost to follow-up, such as linking with healthcare providers and family members. A substantial proportion (83%) of PWH had missing data on laboratory components of the VACS Index 2.0. This missingness could be attributed to differences in data collection methods across the cohorts, resulting from variations in HIV care protocols. Persons that had died were also more likely to have missing data, perhaps because suboptimal adherence to HIV clinic visits (in which data would have been collected) is associated with increased risk of death [29]. Despite this limitation, results were similar for complete case and imputed analyses. Last, because of computational issues for the combination of multiple imputation and competing risks methods, we were unable to account for competing risks of mortality in the main analyses. However, in complete case analyses, the associations between the VACS Index 2.0 and cause-specific mortality were similar under a standard framework and a competing risks framework.

The high discrimination of the VACS Index 2.0 for all-cause and cause-specific mortality suggests that the model can be useful to predict deaths, particularly those caused by AIDS, and liver disease. This can be attributed to the inclusion of markers associated with these conditions, such as the Fibrosis-4 score for liver disease and CD4 count and viral load for AIDS. However, the VACS Index 2.0 performed less well at discriminating cardiovascular-related deaths. To improve discrimination for this cause, it may be necessary to update the VACS Index 2.0 to include additional biomarkers such as lipid profiles that can serve as indicators of cardiovascular health [30]. Although it is possible that inclusion of mental health components to the VACS Index 2.0 could improve prediction of suicide/accidental death, the VACS Index 2.0 was designed to assess physiological frailty only [12]. The limited predictive capability of the VACS Index 2.0 for suicide serves as a validation of its intended purpose.

Nevertheless, together with clinical judgment, the VACS Index 2.0 can provide information for PWH about the risk of dying from the most common causes. This information is crucial for designing targeted interventions and tailoring care plans to address the specific risks identified by the VACS Index 2.0. For instance, if the index highlights a high risk of NADC death, lifestyle modifications or further monitoring and testing may be recommended. Alternatively, the VACS Index 2.0 can also help identify PWH who are at low risk of dying. By identifying those at low risk, healthcare resources can be directed toward individuals with higher risk profiles, ensuring that interventions and care are focused where they are most needed. The availability of VACS Index 2.0 information can serve as a motivator for PWH to adopt healthier habits and improve adherence to ART.

Supplementary Material

ofae333_Supplementary_Data

Contributor Information

Julie Ambia, Population Health Sciences, University of Bristol, Bristol, UK.

Suzanne M Ingle, Population Health Sciences, University of Bristol, Bristol, UK.

Kathleen McGinnis, VA Connecticut Healthcare System, US Department of Veteran Affairs, West Haven, Connecticut, USA.

Nikos Pantazis, Department of Hygiene, Epidemiology and Medical Statistics, Medical School, National and Kapodistrian University of Athens, Athens, Greece.

Michael J Silverberg, Division of Research, Kaiser Permanente Northern California, Oakland, California, USA.

Linda Wittkop, University of Bordeaux, INSERM, Institut Bergonié, BPH, U1219, CIC-EC 1401, F-33000, Bordeaux, France; INRIA SISTM team, Talence. CHU de Bordeaux, Service d’information médicale, INSERM, Institut Bergonié, CIC-EC 1401, F-33000, Bordeaux, France.

Katharina Kusejko, Division for Infectious Diseases and Hospital Epidemiology, University Hospital Zurich, University of Zurich, Zurich, Switzerland.

Heidi Crane, Division of Infectious Diseases, Department of Medicine, University of Washington, Seattle, Washington, USA.

Ard van Sighem, Stichting HIV Monitoring, Amsterdam, Netherlands.

Mario Sarcletti, Department of Dermatology and Venereology, Medical University of Innsbruck, Innsbruck, Austria.

Alessandro Cozzi-Lepri, Institute for Global Health, University College London, London, UK.

Pere Domingo, Department of Infectious Diseases, Santa Creu i Sant Pau Hospital, Barcelona, Spain.

Inma Jarrin, National Centre of Epidemiology, Carlos III Health Institute, Madrid, Spain; CIBER de Enfermedades Infecciosas, Instituto de Salud Carlos III, Madrid, Spain.

Christoph Wyen, Department I for Internal Medicine, University Hospital of Cologne, Cologne, Germany.

Mojgan Hessamfar, Department of Internal Medicine and Infectious Disease, Bordeaux University Hospital F-33000, Bordeaux, France.

Lei Zhang, Population Health Sciences, University of Bristol, Bristol, UK; School of Public Finance and Management, Yunnan University of Finance and Economics, Kunming, China.

Matthias Cavassini, Infectious Diseases Service, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.

Juan Berenguer, Hospital General Universitario Gregorio Marañón, IiSGM, CIBERINFEC, Madrid, Spain.

Timothy R Sterling, Division of Infectious Diseases, Department of Medicine, Vanderbilt University School of Medicine, Nashville, Tennessee, USA.

Peter Reiss, Stichting HIV Monitoring, Amsterdam, The Netherlands; Amsterdam UMC, University of Amsterdam, Global Health, Amsterdam, The Netherlands; Amsterdam Institute for Global Health and Development, Amsterdam, The Netherlands.

Sophie Abgrall, APHP, Hôpital Béclère, Service de Médecine Interne, Clamart, France; APHP, Université Paris-Saclay, Univ. Paris-Sud, UVSQ, CESP INSERM U1018, Le Kremlin-Bicêtre, France.

M John Gill, Department of Medicine, University of Calgary, South Alberta HIV Clinic, Calgary, Alberta, Canada.

Amy Justice, VA Connecticut Healthcare System, US Department of Veteran Affairs, West Haven, Connecticut, USA; Department of Internal Medicine, Yale University School of Medicine, New Haven, Connecticut, USA.

Jonathan A C Sterne, Population Health Sciences, University of Bristol, Bristol, UK.

Adam Trickey, Population Health Sciences, University of Bristol, Bristol, UK.

Supplementary Data

Supplementary materials are available at Open Forum Infectious Diseases online. Consisting of data provided by the authors to benefit the reader, the posted materials are not copyedited and are the sole responsibility of the authors, so questions or comments should be addressed to the corresponding author.

Notes

Acknowledgments . We thank our funders (US NIAAA) as well as all the patients and the clinical teams associated with the participating cohort studies.

Author Contributions. A.J., A.T., S.I., and J.A.C.S. conceived and designed the study. A.T., L.Z., and S.I. combined, checked, and cleaned the datasets. M.J.G., S.A., J.B., C.W., M.H., and P.R. were involved in the cross-cohort coding of causes of death. J.A. conducted the statistical analyses. J.A. drafted the manuscript. All authors contributed to the interpretation of data and critical revisions of the manuscript for important intellectual content. A.T., S.I., J.A., and J.A.C.S. had full access to all the data in the study. J.A., S.I., A.T., and J.A.C.S. were responsible for the decision to submit for publication.

Data sharing statement. Due to the data sharing agreements between individual cohorts and ART-CC, the data collected for this study cannot be shared. Data are owned by the individual cohorts and those wishing to access these data should contact the individual cohorts.

Patient consent statement. Ethics committees or institutional review boards approved the 12 individual cohorts, each of which used standardized data collection methods and conducted regular follow-up with participants who had consented to be included. Additionally, the ART-CC as a whole received ethics approval from the UK NHS National Research Ethics Service Committee South West—Cornwall & Plymouth (12/SW/0253).

Financial support. The ART-CC is funded by the US National Institute on Alcohol Abuse and Alcoholism (U01-AA026209). Funding for the individual ART-CC cohorts was from Alberta Health, Gilead, ANRS (France REcherche Nord&Sud Sida-hiv Hépatites), the French Ministry of Health, the Austrian Agency for Health and Food Safety (AGES), Stichting HIV Monitoring, the Dutch Ministry of Health, Welfare and Sport through the Centre for Infectious Disease Control of the National Institute for Public Health and the Environment, the TP-HIV by the German Centre for Infection Research (DZIF) (NCT02149004), the Instituto de Salud Carlos III through the Red Temática de Investigación Cooperativa en Sida (RD06/006, RD12/0017/0018, and RD16/0002/0006) as part of the Plan Nacional I + D + i and cofinanced by ISCIII-Subdirección General de Evaluación and the Fondo Europeo de Desarrollo Regional (FEDER), ViiV Healthcare, Preben og Anna Simonsens Fond, ANRS-Maladies infectieuses émergentes, Institut National de la Santé et de la Recherche Médicale (INSERM), BMS, Janssen, MSD, the US National Institute on Alcohol Abuse and Alcoholism (U01-AA026230), the Spanish Ministry of Health, the Swiss National Science Foundation (grant 33CS30_134277), CFAR Network of Integrated Clinical Systems (1R24 AI067039-1, P30-AI-027757), the US Department of Veterans Affairs, the US National Institute on Alcohol Abuse and Alcoholism (U01-AA026224, U01-AA026209, U24-AA020794), the VHA Office of Research and Development, US National Institute of Allergy and Infectious Diseases (Tennessee Center for AIDS Research: P30 AI110527).

All authors have submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Conflicts that the editors consider relevant to the content of the manuscript have been disclosed.

References

  • 1. Palella  FJ  Jr, Delaney  KM, Moorman  AC, et al.  Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. HIV Outpatient Study Investigators. N Engl J Med  1998; 338:853–60. [DOI] [PubMed] [Google Scholar]
  • 2. Trickey  A, McGinnis  K, Gill  MJ, et al.  Longitudinal trends in causes of death among adults with HIV on antiretroviral therapy in Europe and North America from 1996 to 2020: a collaboration of cohort studies. Lancet HIV  2024; 11:e176–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Trickey  A, Sabin  CA, Burkholder  G, et al.  Life expectancy after 2015 of adults with HIV on long-term antiretroviral therapy in Europe and North America: a collaborative analysis of cohort studies. Lancet HIV  2023; 10:e295–307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Althoff  KN, Gebo  KA, Moore  RD, et al.  Contributions of traditional and HIV-related risk factors on non-AIDS-defining cancer, myocardial infarction, and end-stage liver and renal diseases in adults with HIV in the USA and Canada: a collaboration of cohort studies. Lancet HIV  2019; 6:e93–104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Savès  M, Chêne  G, Ducimetière  P, et al.  Risk factors for coronary heart disease in patients treated for human immunodeficiency virus infection compared with the general population. Clin Infect Dis  2003; 37:292–8. [DOI] [PubMed] [Google Scholar]
  • 6. Tate  JP, Justice  AC, Hughes  MD, et al.  An internationally generalizable risk index for mortality after one year of antiretroviral therapy. Aids  2013; 27:563–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Justice  AC, Modur  SP, Tate  JP, et al.  Predictive accuracy of the Veterans Aging Cohort Study index for mortality with HIV infection: a North American cross cohort analysis. J Acquir Immune Defic Syndr  2013; 62:149–63. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Tate  JP, Sterne  JAC, Justice  AC. Albumin, white blood cell count, and body mass index improve discrimination of mortality in HIV-positive individuals. AIDS  2019; 33:903–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Qian  Y, Moore  RD, Coburn  SB, et al.  Association of the VACS Index with hospitalization among people with HIV in the NA-ACCORD. J Acquir Immune Defic Syndr  2022; 89:9–18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. McGinnis  KA, Justice  AC, Moore  RD, et al.  Discrimination and calibration of the Veterans Aging Cohort Study Index 2.0 for predicting mortality among people with human immunodeficiency virus in North America. Clin Infect Dis  2022; 75:297–304. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Hernández-Favela  CG, Hernández-Ruiz  VA, Bello-Chavolla  OY, et al.  Higher Veterans Aging Cohort Study 2.0 Index score predicts functional decline among older adults living with HIV. AIDS Res Hum Retroviruses  2021; 37:878–83. [DOI] [PubMed] [Google Scholar]
  • 12. Justice  AC, Tate  JP. Strengths and limitations of the Veterans Aging Cohort Study Index as a measure of physiologic frailty. AIDS Res Hum Retroviruses  2019; 35(11–12):1023–33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Yan  CY, Cooley  SA, Ances  BM. Veterans Aging Cohort Study Index 2.0 shows improved discrimination of neurocognitive impairment and frailty in people with HIV. J Acquir Immune Defic Syndr  2024;65(2): 190–7. [Google Scholar]
  • 14. Wilcox  DR, Rudmann  EA, Ye  E, et al.  Cognitive concerns are a risk factor for mortality in people with HIV and coronavirus disease 2019. Aids  2023; 37:1565–71. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. May  MT, Ingle  SM, Costagliola  D, et al.  Cohort profile: Antiretroviral Therapy Cohort Collaboration (ART-CC). Int J Epidemiol  2014; 43:691–702. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Kowalska  JD, Friis-Møller  N, Kirk  O, et al.  The Coding Causes of Death in HIV (CoDe) project: initial results and evaluation of methodology. Epidemiology  2011; 22:516–23. [DOI] [PubMed] [Google Scholar]
  • 17. Trickey  A, May  MT, Vehreschild  J, et al.  Cause-specific mortality in HIV-positive patients who survived ten years after starting antiretroviral therapy. PLoS One  2016; 11:e0160460. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Snowdon  J, Choi  NG. Undercounting of suicides: where suicide data lie hidden. Glob Public Health  2020; 15:1894–901. [DOI] [PubMed] [Google Scholar]
  • 19. Trickey  A, van Sighem  A, Stover  J, et al.  Parameter estimates for trends and patterns of excess mortality among persons on antiretroviral therapy in high-income European settings. Aids  2019; 33(Suppl 3):S271–s81. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. National Kidney Foundation . CKD-EPI Creatinine Equation (2021)  2021. Available at: https://www.kidney.org/content/ckd-epi-creatinine-equation-2021.
  • 21. Harrell  FE  Jr, Califf  RM, Pryor  DB, Lee  KL, Rosati  RA. Evaluating the yield of medical tests. JAMA  1982; 247:2543–6. [PubMed] [Google Scholar]
  • 22. Booth  S, Riley  RD, Ensor  J, Lambert  PC, Rutherford  MJ. Temporal recalibration for improving prognostic model development and risk predictions in settings where survival is improving over time. Int J Epidemiol  2020; 49:1316–25. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Royston  P, Parmar  MK. Flexible parametric proportional-hazards and proportional-odds models for censored survival data, with application to prognostic modelling and estimation of treatment effects. Stat Med  2002; 21:2175–97. [DOI] [PubMed] [Google Scholar]
  • 24. Schwarz  G. Estimating the dimension of a model. Annal Stat  1978; 6:461–4. [Google Scholar]
  • 25. van Buuren  S. Multiple imputation of discrete and continuous data by fully conditional specification. Stat Methods Med Res  2007; 16:219–42. [DOI] [PubMed] [Google Scholar]
  • 26. White  IR, Royston  P. Imputing missing covariate values for the Cox model. Stat Med  2009; 28:1982–98. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Rubin  DB. Multiple imputation for nonresponse in surveys. New York: John Wiley & Sons, 2004. [Google Scholar]
  • 28. StataCorp . Stata statistical software: release 17. College Station, TX: StataCorp LLC, 2021. [Google Scholar]
  • 29. Trickey  A, Zhang  L, Rentsch  CT, et al.  Care interruptions and mortality among adults in Europe and North America: a collaborative analysis of cohort studies. AIDS  2024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Office of Prevention Education and Control National Heart Lung and Blood Institute . Current status of blood cholesterol measurement in clinical laboratories in the United States: a report from the Laboratory Standardization Panel of the National Cholesterol Education Program. Clin Che  1988; 34:193–201. [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ofae333_Supplementary_Data

Articles from Open Forum Infectious Diseases are provided here courtesy of Oxford University Press

RESOURCES