Abstract
Aims
We developed a prediction equation for 10-year risk of a combined endpoint (incident coronary heart disease, stroke, heart failure, chronic kidney disease, lower extremity hospitalizations) in persons with diabetes, using demographic and clinical information, and a panel of traditional and nontraditional biomarkers.
Materials and Methods
We included 654 persons in the ARIC Study, a prospective cohort study, with diagnosed diabetes (visit 2, 1990–92). Models included self-reported variables (Model 1), clinical measurements (Model 2), and HbA1c (Model 3). Model 4 tested the addition of 12 blood-based biomarkers. We compared models using prediction and discrimination statistics.
Results
Successive stages of model development improved risk prediction. The C-statistics (95% confidence intervals) of models 1, 2, and 3 were 0.667 (0.64, 0.70), 0.683 (0.65, 0.71), and 0.694 (0.66, 0.72), respectively (P<0.05 for differences). Addition of three traditional and nontraditional biomarkers (beta-2 microglobulin, creatinine-based estimated glomerular filtration rate [eGFR], and cystatin C-based eGFR) to model 3 significantly improved discrimination (C-statistic=0.716, P=0.003) and accuracy of 10-year risk prediction for major complications in persons with diabetes (midpoint percentiles of lowest and highest deciles of predicted risk changed from 18%–68% to 12%–87%).
Conclusions
These biomarkers, particularly those of kidney filtration, may help distinguish between persons at low versus high risk of long-term major complications.
Introduction
Diabetes is a major risk factor for coronary heart disease (CHD), stroke, heart failure, chronic kidney disease (CKD) and end-stage renal disease (ESRD), lower extremity disease, and mortality (1–5). Recent evidence suggests that persons with diabetes may have varying degrees of risk depending on the presence and severity of other risk factors and co-morbidities (6). Understanding this heterogeneity in risk and distinguishing between those persons at very low long-term risk versus those most in need of aggressive cardiovascular risk management could help personalize and improve care for persons with diabetes. Hemoglobin A1c (HbA1c), and other biomarkers not included in traditional cardiovascular risk equations, may improve cardiovascular risk prediction in diabetes (7–10).
There are several challenges in developing an accurate, clinically relevant risk score. Predicting risk of a combined endpoint, particularly combined microvascular and macrovascular events, has not been widely studied (11–13). The clinical utility of a single risk score for multiple endpoints has broad application: convenience and efficiency for the clinician; indicative of overall long-term risk; and a “rule out” approach to guide more conservative treatment decisions. Furthermore, most existing risk scores have used traditional methods, such as Cox regression, to account for loss to follow-up, but have not accounted for competing risks, which can better estimate absolute risks, which is especially important in clinical settings (14,15).
We, thus, aimed to develop a risk prediction equation for 10-year risk of a combined endpoint of major microvascular and macrovascular complications in white and black persons with diabetes, while accounting for the competing risk of death from another cause. We explored pre-determined sets of demographic and clinical information and a panel of biomarkers of hyperglycemia, cardiac function, kidney function, liver function, and inflammation.
Materials and Methods
Study population
The Atherosclerosis Risk in Communities (ARIC) Study is a community-based cohort of 15,792 persons recruited from four field centers in the United States: Forsyth County, North Carolina; Jackson, Mississippi; suburban Minneapolis, Minnesota; and Washington County, Maryland (16). Visits 1 through 5 took place during 1987–89, 1990–92, 1993–95, 1996–98, and 2011–13, respectively. We used visit 2 (1990–1992) as the baseline exam in the present study as this was the first visit with relevant biomarker data available (e.g., HbA1c). Of the 14,348 participants who attended visit 2, there were 1,356 with diagnosed diabetes, defined as self-reported physician diagnosis of diabetes or use of glucose-lowering medication at either visit 1 or 2. After exclusion of participants who were missing baseline covariate data (N=276), were fasting <8 hours (N=172), were neither black nor white (N=2), had prevalent CVD (N=227), had prevalent reduced kidney function (estimated glomerular filtration rate [eGFR] <60 mL/min/1.73 m2) (N=23), or had prevalent lower extremity amputation or peripheral vascular bypass (N=2), there were 654 participants eligible for our main analyses.
Covariates
All covariates were obtained at visit 2, unless otherwise specified. The following variables were assessed during the participant interview: age, sex, education level (visit 1), alcohol consumption, smoking status, and physical activity (visit 1)(17). Antihypertensive, cholesterol-lowering, and glucose-lowering medication use was assessed via self-report and a medication inventory. Recent diabetes was defined as having had diabetes at visit 2 but not at visit 1. Family history of CVD was defined as self-reported parental history of either stroke or CHD. Diastolic and systolic blood pressures were measured and recorded as the mean of the 2nd and 3rd readings. Body mass index (BMI) was calculated as measured weight (in kilograms) divided by measured height (in meters) squared.
Lipids were measured on the Roche Cobas Bio (Roche Diagnostics, Indianapolis, IN)(16); serum glucose (hexokinase method) and creatinine (Jaffe method) on a Coulter DACOS analyzer (Beckman Coulter, Inc., Fullerton, CA, USA); and HbA1c from stored whole blood in 2003–04 and 2007–08 with the Tosoh A1c 2.2 Plus Glycohemoglobin Analyzer and Tosoh G7 Analyzer (Tosoh Bioscience, Inc., South San Francisco, CA, USA), respectively, using a high-performance liquid chromatography method, and was standardized to the Diabetes Control and Complications Trial assay (18). The following biomarkers were measured in 2012–2013 using stored serum samples from visit 2 on the Roche Modular P800 (Roche Diagnostics Corporation, Indianapolis, IN): cystatin C (Gentian immunoassay, Gentian, Moss, Norway); beta-2 microglobulin (B2M) (latex agglutination method); alanine transaminase (ALT), aspartate transaminase (AST), and gamma-glutamyl transpeptidase (GGT) (kinetic rate method); fructosamine (colorimetric method, Roche Diagnostics Corporation, Indianapolis, IN, USA); high-sensitivity C-reactive protein (hs-CRP) (immunoturbidimetric method); and glycated albumin (Asahi Kasei Lucica GA-L, Tokyo, Japan) and 1,5-AG (GlycoMark, New York, NY) (enzymatic methods). Glycated albumin was expressed as a percentage of total albumin: [(glycated albumin concentration in g/dL / serum albumin concentration in g/dL) / 1.14*100] + 2.9. N-terminal probrain natriuretic peptide (NT-proBNP) and high-sensitivity cardiac troponin T (hs-cTnT) were also measured in 2011–13 from stored visit 2 serum (sandwich immunoassay) on a Roche Elecsys autoanalyzer (Roche Diagnostics Corporation, Indianapolis, IN).
Incident Outcomes
We created a combined endpoint for the first occurrence of CHD, stroke, heart failure, CKD, lower extremity amputation, or peripheral vascular bypass, over a maximum of 10 years of follow-up. Outcomes were ascertained via continuous surveillance of hospitalizations and death certificates, annual telephone follow-up with participants or a proxy, and/or linkage to the National Death Index. CHD was adjudicated and defined as the first occurrence of a definite or probable hospitalized myocardial infarction, death due to CHD, or cardiac procedure (19). Stroke was adjudicated and defined as the first occurrence of a definite or probable hospitalized stroke or death due to stroke (20). Heart failure was defined as the first hospitalization listing a heart failure code (based on a 428 International Classification of Diseases, 9th Revision [ICD-9] code or an ICD, 10th Revision [ICD-10] code of 150), or death attributed to heart failure (21). Incident CKD was defined as eGFR<60 mL/min/1.73 m2 and ≥25% decline in eGFR since visit 2, or hospitalization due to kidney disease, kidney transplant or dialysis, or death due to kidney disease (22). Incident lower extremity amputation and peripheral vascular bypass events were identified from ICD-9-CM diagnostic and procedure codes using hospitalization data.
Persons who did not experience a CVD, CKD, or lower extremity event and were still alive 10 years after the date of their visit 2 examination were censored at that time. Persons who died from an event other than those listed above were considered to have experienced the competing risk of death. Persons who were lost to follow-up having not experienced the event of interest and were not known to have died were censored at the time of their last contact.
Statistical analysis
We calculated descriptive statistics for demographic and clinical characteristics inthe study population overall and stratified by event type (any, none, competing).
We used a 3-stage approach to evaluate prediction models for 10-year risk of any ofthe major complications. In stage 1, we created Model 1, which included pre-specified self-reported information (age, sex, race, education, smoking status, alcohol consumption, physical activity, family history of CVD, glucose-lowering medication use, antihypertensive medication use, cholesterol-lowering medication use, and recent onset of diabetes) plus measured BMI, which is often self-reported in other studies or some clinical settings. In stage 2, we created Model 2, which additionally included pre-specified clinical variables (LDL-c, HDL-c, triglycerides, and systolic blood pressure). In stage 3, we created Model 3, which added HbA1c, and Model 4, which additionally tested the inclusion of 12 biomarkers of hyperglycemia (fasting glucose, fructosamine, glycated albumin, 1,5-AG), cardiac damage (hs-cTnT, NT-proBNP), kidney function (serum creatinine, cystatin C, B2M), liver function (AST, ALT, GGT), and inflammation (hs-CRP). We specified the variables for inclusion in models 1 and 2 a priori. Several interactions were additionally tested in Model 2: the interaction of sex with all variables, race with all variables, antihypertensive medication use with systolic blood pressure, and cholesterol-lowering medication use with LDL-c. The following interactions were found statistically significant (P<0.05 using a Wald test) and were additionally included in all relevant models: sex*triglycerides (P=0.02), sex*glucose-lowering medication (oral, insulin, or none) (P=0.01), race*triglycerides (P=0.049), and race*BMI (P=0.03). All continuous variables were centered. We natural log-transformed any variables that were not normally distributed. For biomarkers that had undetectable values, we imputed the values as half of the lower limit of detection (1.5 ng/L for hs-cTnT, 2.5 pg/mL for NT-proBNP, and 2 U/L for ALT). We calculated eGFR using creatinine (eGFR-Cr) and cystatin C (eGFR-CysC) (23), and used the inverse of B2M (1/B2M) in analyses (24), since these measures are better related to renal physiology.
We used a Fine and Gray model (25) for all analyses. We first ran Models 1 and 2, which each included pre-specified variables, and assessed whether Model 2 improved prediction. We then ran Model 3, which included the addition of HbA1c, and tested the improvement in prediction compared to Model 2. Lastly, we evaluated whether the addition of the 12 traditional and nontraditional biomarkers to Model 3 improved prediction. We added each biomarker individually to model 3 and conducted two tests: 1) a Wald test of the coefficient and 2) a comparison of the change in the C-statistic before versus after addition of the biomarker to Model 3. We then selected those biomarkers that had P<0.05 for both tests, and added them to model 3 simultaneously. To determine which biomarkers to keep in the model, we assessed the P-values of each of the biomarkers from the Wald test. We removed the biomarker with the highest P-value if it was above P=0.05, and re-ran the model. We continued this procedure until all biomarkers in the model had P<0.05, at which point we considered this the best and final model (Model 4).
Comparisons between models
We used the following measures of discrimination to assess incremental improvements in prediction between Models 1 and 2, Models 2 and 3, and Models 3 and 4: 1) Harrell’s C-statistic, which accounts for censoring in survival analysis; 2) the overall net reclassification improvement (NRI) (continuous and categorical, split at a 25% predicted risk threshold) to quantify upward and downward reclassification, and the event and nonevent NRI separately, to determine the amount and direction of reclassification separately in people who did and did not experience an event; and 3) the relative integrated discrimination improvement (IDI) to assess the improvement in average sensitivity (26–32). For the NRIs and relative IDI, we reported bias-corrected bootstrapped 95% confidence intervals (CIs).
To assess the calibration of each of the final models, we calculated the observed risk (proportion of persons who experienced the event of interest) within each decile of predicted risk. We plotted the median predicted risk against the observed risk within each decile of predicted risk to visually assess their agreement. We excluded persons who had a competing risk event from this assessment of model calibration.
We conducted several secondary analyses. We applied the models we developed to the same population, but extended the follow-up time to a maximum of 20 years, and compared prediction of the 4 models for 20-year risk. We then developed two separate models for prediction of 10-year risk of macrovascular complications (CVD or lower extremity event) and 10-year risk of CKD; and calculated predictive statistics to compare models 1–4 for each of these outcomes.
Results
Of the 654 persons with diagnosed diabetes followed for a maximum of 10 years, 296 had a major complication: 141 CVD events (9 fatal, 132 non-fatal), 152 CKD events (4 ESRD cases), and 3 lower extremity disease hospitalizations. There were 331 participants who did not experience any event of interest (9 were lost to follow-up) and 27 who died without experiencing any event of interest during follow-up. Compared to persons who did not experience any of the major complications during 10 years of follow-up, those who did were older and had a higher BMI, and a higher proportion were male, had hypercholesterolemia, had hypertension, or were on any glucose-lowering medication (Table 1).
Table 1.
Baseline study population characteristics
Outcome Status Over Follow-up
|
||||
---|---|---|---|---|
Overall (N=654)
|
Alive and did not experience an event (N=331)
|
Experienced an event (N=296)
|
Died without experiencing an event (N=27)
|
|
Mean (SD) or %
|
Mean (SD) or %
|
Mean (SD) or %
|
Mean (SD) or %
|
|
Age, years | 58.1 (5.7) | 57.3 (5.8) | 58.9 (5.4) | 60.3 (6.4) |
Male | 39% | 32% | 46% | 41% |
White | 59% | 59% | 59% | 67% |
Education | ||||
< HS | 32% | 30% | 35% | 22% |
HS or college | 40% | 38% | 44% | 33% |
> college | 28% | 32% | 22% | 44% |
Current smoking | 18% | 18% | 18% | 33% |
Current drinking | 38% | 38% | 37% | 56% |
Physical activity | 2.3 (0.7) | 2.3 (0.7) | 2.2 (0.7) | 2.3 (0.9) |
Family history of CVD* | 57% | 55% | 57% | 74% |
Hypercholesterolemia† | 30% | 25% | 35% | 26% |
Statin use | 3% | 2% | 4% | 7% |
BMI, kg/m2 | 30.7 (5.8) | 30.4 (6.1) | 31.4 (5.3) | 28.2 (6.1) |
Hypertension‡ | 57% | 48% | 67% | 59% |
Glucose-lowering medication | ||||
Insulin | 19% | 17% | 23% | 19% |
Oral only | 48% | 43% | 54% | 48% |
None | 32% | 41% | 23% | 33% |
Recent onset of diabetes | 30% | 32% | 27% | 44% |
Abbreviations: BMI, body mass index; CVD, cardiovascular disease; HS, high school
Family history of CVD defined as self-reported parental history of stroke or CHD
Hypercholesterolemia was defined as total cholesterol ≥240 mg/dL or use of cholesterol-lowering medication.
Hypertension was defined as systolic blood pressure ≥140 mmHg, diastolic blood pressure ≥90 mmHg, or use of antihypertensive medication.
The following three biomarkers were selected and included in Model 4: 1/B2M, eGFR-Cr, and eGFR-CysC. We report the beta coefficients and corresponding subhazard ratios and P-values for each term included in the final models in eTable 1. The baseline 10-year survival (S0(t), where t=10) for Models 1, 2, 3, and 4 were 0.55, 0.65, 0.61, and 0.53, respectively.
Compared to Model 1, the C-statistic was higher for Model 2 (P=0.032) and improved further after the inclusion of HbA1c (P=0.021); and improved again after the inclusion of 1/B2M, eGFR-Cr, and eGFR-CysC in Model 4 (P=0.003) (Table 2). The improvements in the continuous NRI and relative IDI followed patterns similar to those observed for the C-statistic. Both persons who did and did not experience the event of interest were better classified in successive models according to the continuous NRI, and nearly all improvements were statistically significant (Table 2). Improvements in the categorical NRI (using a cut-point of 25%) were driven by correct reclassification of participants who did not experience a major complication (Table 2). Furthermore, all models were well-calibrated (Figure 1).
Table 2.
Predictive statistics of 10-year risk prediction models
Continuous NRI | Categorical NRI (25% predicted risk cut-point) |
|||||||||
---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||
C-statistic (95% CI) |
Difference in C- statistic (95% CI) |
P-value for difference |
Overall NRI (95% CI)* |
Event NRI (95% CI)* |
Non-event NRI (95% CI)* |
Overall NRI (95% CI)* |
Event NRI (95% CI)* |
Non-event NRI (95% CI)* |
Relative IDI (95% CI)* |
|
|
||||||||||
Model 1 (Self- reported) | 0.667 (0.64, 0.70) | -- | -- | -- | -- | -- | -- | |||
Model 2 (+ clinical variables) | 0.683 (0.65, 0.71) | 0.016† (0.00, 0.03) | 0.032† | 0.42† (0.26, 0.56) | 0.18† (0.07, 0.29) | 0.23† (0.13, 0.34) | 0.07† (0.03, 0.12) | -0.02† (−0.04, 0.00) | 0.09† (0.06, 0.14) | 0.28† (0.21, 0.36) |
Model 3 (+ HbA1c) | 0.694 (0.66, 0.72) | 0.011‡ (0.00, 0.02) | 0.021‡ | 0.25‡ (0.11, 0.40) | −0.02‡ (−0.13, 0.10) | 0.27‡ (0.17, 0.37) | 0.02‡ (−0.01, 0.06) | 0.01‡ (−0.01, 0.03) | 0.02‡ (−0.01, 0.05) | 0.08‡ (0.04, 0.11) |
Model 4 (+ additional biomarkers) | 0.716 (0.69, 0.74) | 0.022§ (0.01, 0.04) | 0.003§ | 0.32§ (0.17, 0.47) | 0.14§ (0.04, 0.25) | 0.18§ (0.07, 0.29) | 0.03§ (−0.02, 0.07) | −0.03§ (−0.06, −0.01) | 0.06§ (0.02, 0.09) | 0.15§ (0.09, 0.22) |
Bias-corrected 95% CIs are reported for NRI and IDI,and were obtained usingbootstrap with 1,000replications
vs. Model 1
vs. Model 2
vs. Model 3
Model 1 includes age, sex, race, education, smoking status, alcohol consumption, physical activity, family history of CVD, glucose-lowering medication use, antihypertensive medication use, cholesterol-lowering medication use, recent onset of diabetes, BMI, interaction of sex with glucose-lowering medication use, and interaction of race with BMI.
Model 2 additionally includes LDL-c, HDL-c, triglycerides, systolic blood pressure, interaction of sex with triglycerides, and interaction of race with triglycerides.
Model 3 additionally includes HbA1c.
Model 4 additionally includes 1/B2M, eGFR-Cr, and eGFR-CysC.
Figure 1. Calibration of 10-year combined risk prediction models.
Observed risk (proportion experiencing the event of interest over 10 years among those at risk) vs. deciles of predicted risk (plotted at the midpoint percentile, 5th to 95th, on the X-axis). The 27 persons who experienced the competing risk event were excluded from this analysis, so the denominator is N=627.
In a secondary analysis, we compared prediction of the 4 models for 20-year risk of major complications. There were 383 events of interest and 77 competing risk events (deaths) over a maximum of 20 years of follow-up (eTable 2). Improvements in risk prediction between models were similar to those from the 10-year risk prediction equation (eTable 3).
We developed two additional prediction models for macrovascular and microvascular complications, separately. We observed 180 incident macrovascular events (33 competing events). 1/B2M was included in this final model. The addition of each HbA1c and 1/B2M resulted in statistically significant improvements in prediction of macrovascular events (eTables 4 and 5). There were 184 incident CKD events (69 competing events). The model we developed for 10-year risk prediction of CKD included the addition of 1/B2M and eGFR-creatinine. The addition of HbA1c did not statistically significantly improve prediction of CKD (eTables 6 and 7).
Discussion
We successfully constructed a prediction model for 10-year risk of major complications in middle-aged persons with diabetes in the community-based ARIC Study. Including HbA1c, 1/B2M (a novel biomarker of kidney filtration), and eGFR-Cr and eGFR-CysC (biomarkers of kidney function) significantly improved model performance. The final model that included these biomarkers had overall good discrimination (C-statistic=0.716) and was well-calibrated. Furthermore, this model correctly re-classified a substantial number of persons using a risk threshold of 25%, particularly among those who did not experience a major complication in 10 years. Correct reclassification of persons who did not experience an event during this time period is quite important for identifying those at low long-term risk of multiple major complications.
American Heart Association/American College of Cardiology guidelines recommend that all persons with diabetes between 40 and 75 years of age with LDL-c 70–189 mg/dL be treated with moderate intensity statin therapy for primary prevention of CVD. They also recommend considering higher intensity statin therapy in those at 10-year CVD risk ≥7.5% using the 10-year Pooled Cohort Equation for atherosclerotic CVD (33). Our risk prediction equation for a combined endpoint could help identify middle-aged individuals at lowest risk for multiple major complications who might benefit most from a more conservative treatment approach. Given the notable heterogeneity of risk in persons with diabetes (from roughly 10% to 90% 10-year risk of the combined outcome), we may want to think about the potential over- or under-treatment of risk factors. Identification of high-risk persons in whom aggressive treatment may be most appropriate could be a second step in this process, and could include tailoring therapy based on predicted risk of individual outcomes.
Standard approaches to survival analysis (i.e., Kaplan-Meier method and Cox proportional hazards regression) overestimate cumulative incidence when competing risks are present; in particular it is important to treat death as a competing risk rather than a censoring event. These standard approaches may therefore affect the calibration of the risk prediction model, more so even than the discrimination (14,15). The Fine and Gray method that we used in this analysis may more accurately assess both discrimination and calibration. Accurate determination of absolute risk is vital for clinical prognosis and treatment decisions.
Whereas risk prediction equations developed in persons with diabetes may better predict risk than those developed in the general population (34), many of these have performed poorly when applied to external populations of persons with diabetes (35). For instance, the United Kingdom Prospective Diabetes Study (UKPDS) risk engine, a risk prediction tool for CHD and stroke in persons with newly-diagnosed diabetes (36,37), has been shown to greatly overestimate risk by up to five-fold in external populations (38). The risk score we developed had better discrimination and was better calibrated than many risk scores that have been developed for CVD risk prediction in persons with diabetes (39). Most risk scores have been developed in white European populations (40), which may limit their generalizability. Having to use multiple risk scores to predict risk of diabetes complications is burdensome for practitioners (41,42), whereas a risk prediction tool that comprehensively predicts risk of multiple diabetes complications may be convenient for clinical use. Two recent studies developed risk prediction models for multiple endpoints that included micro- and macrovascular complications, and found that combining these outcomes improved classification of persons into low- and high-risk groups (11,13). Although very few risk scores have included HbA1c (43) in their risk prediction algorithm, even fewer have comprehensively evaluated and compared a panel of traditional and nontraditional biomarkers of hyperglycemia, cardiac damage, kidney filtration, liver function, or inflammation (40). The biomarkers evaluated here were selected because they are markers of physiological damage in the pathway to the clinical endpoints that we included, and have been associated with increased risk of complications in persons with diabetes (10,44–52). Our model extends the findings of a previous ARIC study that developed a risk score for 10-year prediction of a single endpoint of CHD in persons with diabetes. Although HbA1c data were unavailable at the time, they found that adding a panel of novel markers to traditional basic risk factors improved prediction (53).
There are several limitations to note. The baseline for our study was in 1990–1992 and diagnostic and treatment practices for diabetes have changed since then. Compared to current guidelines, diagnostic cut-points were higher in the early to mid-1990s, and persons with diagnosed diabetes may have had more “severe” diabetes than those with diagnosed diabetes today (54). Furthermore, rates of diabetes-related complications, mainly CVD, have decreased in the past twenty years, which could be due to a variety of reasons, including improved care, but also earlier detection of diabetes due to increased screening and lower diagnostic thresholds (55). All of these factors make our analysis conservative with respect to identifying diabetics at low risk for complications. Urine was not collected at this examination, so we were unable to include albuminuria or albumin-creatinine ratio as potential biomarkers, and to determine the importance of these biomarkers in the risk prediction model. Previous studies have shown that albuminuria can significantly improve prediction of cardiovascular disease(9). Retinopathy data were not collected prospectively, and we were therefore unable to include this important complication of diabetes in our analysis. Further, while we were able to distinguish between recently diagnosed diabetes (past 3 years) from longer duration diabetes, we may not have been able to fully adjust for the impact of diabetes duration, since information on age of diagnosis was not collected at the first or second ARIC examinations. Since we restricted analyses to persons with diabetes who had no prevalent micro- or macrovascular disease at baseline, our sample size was rather small, although we were still able to develop risk prediction equations and compare risk prediction statistics with adequate precision. To note, in developing a risk prediction equation using a combined endpoint, the contribution of some predictors may vary for different endpoints. Furthermore, it assumes that the predictors contribute similarly to all outcomes included in the combined endpoint. Indeed, we found that HbA1c improved prediction of macrovascular events but not CKD, whereas eGFR improved prediction of CKD but not macrovascular events. Lastly, the clinical application of the addition of HbA1c to the risk prediction model is readily apparent. We acknowledge that including nontraditional biomarkers that may not be routinely measured in clinical practice in the risk prediction model may have more relevance for research than for clinical practice in the short-term.
Strengths of our study included the rigorous measurement of clinical and biomarker data in a large number of middle-aged persons with diagnosed diabetes in the community at a time when interventions and intensive medical treatment was less frequent. Few, if any, risk prediction models have evaluated such a comprehensive list of traditional and nontraditional variables. In particular, our results extend the current body of knowledge regarding the utility of these nontraditional biomarkers in both clinical and research settings. Long-term active surveillance of ARIC participants enabled us to capture important endpoints over a meaningful period of time.
We demonstrated that the addition of traditional and nontraditional biomarkers to a model that included clinical and demographic information substantially improved the accuracy of a 10-year risk prediction equation for major complications in persons with diabetes. Potential over- or undertreatment of cardiovascular risk factors in persons with diabetes is of current interest, and we reported improved risk reclassification, particularly in persons who did not experience an event. In particular, identifying persons with diabetes at lowest risk for major long-term complications could potentially avoid side effects from over-treatment, emphasize more conservative risk prevention approaches such as diet and lifestyle modification, and improve cost savings. Our research is a first step in focusing efforts on developing a feasible and practical risk score for clinical use in diabetes. Whereas further study of the use of these biomarkers in a clinical setting is necessary, the utility of these biomarkers for use in risk stratification is promising.
Supplementary Material
Acknowledgments
The authors thank the staff and participants of the ARIC study for their important contributions. Reagents for the fructosamine, NT-proBNP, hs-cTnT, B2M, ALT, AST, and GGT assays were donated by Roche Diagnostics. Reagents for the glycated albumin assays were donated by the Asahi Kasei Pharma Corporation. Reagents for the 1,5-AG assays were donated by the GlycoMark Corporation.
Some of the data reported here have been supplied by the United States Renal Data System (USRDS). The interpretation and reporting of these data are the responsibility of the authors and in no way should be seen as an official policy or interpretation of the U.S. government.
FUNDING
C.M. Parrinello is supported by NIH/NHLBI Cardiovascular Epidemiology training grant T32HL007024. This research was supported by NIH/NIDDK grants R01DK089174 and K24DK106414 to E. Selvin. The Atherosclerosis Risk in Communities Study is carried out as a collaborative study supported by National Heart, Lung, and Blood Institute contracts (HHSN268201100005C, HHSN268201100006C, HHSN268201100007C, HHSN268201100008C, HHSN268201100009C, HHSN268201100010C, HHSN268201100011C, and HHSN268201100012C).
Footnotes
This work was presented as an oral presentation at the American Diabetes Association 75th Scientific Sessions in Boston, MA from June 5–9, 2015.
AUTHOR CONTRIBUTIONS
C.M.P. designed the study, analyzed and interpreted the data, and wrote the manuscript. K.M., M.W., L.E.W., and J.C. interpreted the data, and reviewed and edited the manuscript. E.S. designed the study, interpreted the data, and reviewed and edited the manuscript. E.S. is the guarantor of the work and, as such, takes full responsibility for the work as a whole, including the study design, access to data, and the decision to submit and publish the manuscript.
Disclosures: M. Woodward has received research support from Sanofi; J. Coresh has a pending patent for eGFR; and E. Selvin has served on the Advisory Board for Roche Diagnostics.
References
- 1.Standards of medical care in diabetes--2014. Diabetes Care. 2014 Jan;37(Suppl 1):S14–80. doi: 10.2337/dc14-S014. [DOI] [PubMed] [Google Scholar]
- 2.National Kidney Foundation. Am J Kidney Dis. 5. Vol. 60. Elsevier Inc; 2012. Nov, KDOQI Clinical Practice Guideline for Diabetes and CKD: 2012 Update; pp. 850–86. [DOI] [PubMed] [Google Scholar]
- 3.Foster MC, Rawlings AM, Marrett E, Neff D, Willis K, Inker LA, et al. Cardiovascular risk factor burden, treatment, and control among adults with chronic kidney disease in the United States. Am Heart J. 2013 Jul;166(1):150–6. doi: 10.1016/j.ahj.2013.03.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Selvin E, Juraschek SP, Coresh J. Kidney disease in people with diabetes: the expanding epidemic. Am J Kidney Dis. 2012 Mar;59(3):340–2. doi: 10.1053/j.ajkd.2011.11.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Fowler MJ. Microvascular and Macrovascular Complications of Diabetes. Clin Diabetes. 2008 Apr 1;26(2):77–82. [Google Scholar]
- 6.Emerging Risk Factors Collaboration. Di Angelantonio E, Kaptoge S, Wormser D, Willeit P, Butterworth AS, et al. Association of Cardiometabolic Multimorbidity With Mortality. JAMA. 2015;314(1):52–60. doi: 10.1001/jama.2015.7008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Paynter NP, Mazer Na, Pradhan AD, Gaziano JM, Ridker PM, Cook NR. Cardiovascular risk prediction in diabetic men and women using hemoglobin A1c vs diabetes as a high-risk equivalent. Arch Intern Med. 2011 Oct 24;171(19):1712–8. doi: 10.1001/archinternmed.2011.351. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Di Angelantonio E, Gao P, Khan H, Butterworth AS, Wormser D, Kaptoge S, et al. Glycated hemoglobin measurement and prediction of cardiovascular disease. JAMA. 2014;311(12):1225–33. doi: 10.1001/jama.2014.1873. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Matsushita K, Coresh J, Sang Y, Chalmers J, Fox C, Guallar E, et al. Estimated glomerular filtration rate and albuminuria for prediction of cardiovascular outcomes: a collaborative meta-analysis of individual participant data. lancet Diabetes Endocrinol. 2015;3(7):514–25. doi: 10.1016/S2213-8587(15)00040-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Gori M, Gupta DK, Claggett B, Selvin E, Folsom AR, Matsushita K, et al. Natriuretic Peptide and High-Sensitivity Troponin for Cardiovascular Risk Prediction in Diabetes: The Atherosclerosis Risk in Communities (ARIC) Study. Diabetes Care. 2016 Jan;6:1–9. doi: 10.2337/dc15-1760. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Tanaka S, Tanaka S, Iimuro S, Yamashita H, Katayama S, Akanuma Y, et al. Predicting macro- and microvascular complications in type 2 diabetes: the Japan Diabetes Complications Study/the Japanese Elderly Diabetes Intervention Trial risk engine. Diabetes Care. 2013 May;36(5):1193–9. doi: 10.2337/dc12-0958. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Alssema M, Newson RS, Bakker SJL, Stehouwer CDa, Heymans MW, Nijpels G, et al. One risk assessment tool for cardiovascular disease, type 2 diabetes, and chronic kidney disease. Diabetes Care. 2012 Apr;35(4):741–8. doi: 10.2337/dc11-1417. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Woodward M, Hirakawa Y, Kengne A-P, Matthews DR, Zoungas S, Patel A, et al. Prediction of ten-year vascular risk amongst patients with diabetes: the AD- ON risk score. Diabetes Obes Metab. 2015 Dec;11:1–6. doi: 10.1111/dom.12614. [DOI] [PubMed] [Google Scholar]
- 14.Wolbers M, Koller MT, Witteman JCM, Steyerberg EW. Prognostic models with competing risks: methods and application to coronary risk prediction. Epidemiology. 2009 Jul;20(4):555–61. doi: 10.1097/EDE.0b013e3181a39056. [DOI] [PubMed] [Google Scholar]
- 15.Pencina MJ, D’Agostino RB, Larson MG, Massaro JM, Vasan RS. Predicting the 30-year risk of cardiovascular disease: the framingham heart study. Circulation. 2009 Jun 23;119(24):3078–84. doi: 10.1161/CIRCULATIONAHA.108.816694. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.The Atherosclerosis Risk in Communities (ARIC) Study: design and objectives. The ARIC investigators. Am J Epidemiol. 1989 Apr;129(4):687–702. [PubMed] [Google Scholar]
- 17.Baecke JAH, Burema J, Frijters JER. A short questionnaire for the measurement of habitual physical activity in epidemiological studies. Am J Clin Nutr. 1982 Nov;36(5):936–42. doi: 10.1093/ajcn/36.5.936. [DOI] [PubMed] [Google Scholar]
- 18.Selvin E, Coresh J, Zhu H, Folsom A, Steffes MW. Measurement of HbA1c from stored whole blood samples in the Atherosclerosis Risk in Communities study. J Diabetes. 2010 Jun;2(2):118–24. doi: 10.1111/j.1753-0407.2010.00070.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.White AD, Folsom AR, Chambless LE, Sharret AR, Yang K, Conwill D, et al. Community surveillance of coronary heart disease in the Atherosclerosis Risk in Communities (ARIC) Study: methods and initial two years’ experience. J Clin Epidemiol. 1996 Feb;49(2):223–33. doi: 10.1016/0895-4356(95)00041-0. [DOI] [PubMed] [Google Scholar]
- 20.Rosamond WD, Folsom AR, Chambless LE, Wang C-H, McGovern PG, Howard G, et al. Stroke Incidence and Survival Among Middle-Aged Adults : 9-Year Follow-Up of the Atherosclerosis Risk in Communities (ARIC) Cohort. Stroke. 1999 Apr 1;30(4):736–43. doi: 10.1161/01.str.30.4.736. [DOI] [PubMed] [Google Scholar]
- 21.Loehr LR, Rosamond WD, Chang PP, Folsom AR, Chambless LE. Heart failure incidence and survival (from the Atherosclerosis Risk in Communities study) Am J Cardiol. 2008 Apr 1;101(7):1016–22. doi: 10.1016/j.amjcard.2007.11.061. [DOI] [PubMed] [Google Scholar]
- 22.Grams ME, Rebholz CM, McMahon B, Whelton S, Ballew SH, Selvin E, et al. Identification of Incident CKD Stage 3 in Research Studies. Am J Kidney Dis Elsevier Inc. 2014;64(2):214–21. doi: 10.1053/j.ajkd.2014.02.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Inker LA, Schmid CH, Tighiouart H, Eckfeldt JH, Feldman HI, Greene T, et al. Estimating Glomerular Filtration Rate from Serum Creatinine and Cystatin C. New England Journal of Medicine. 2012:20–9. doi: 10.1056/NEJMoa1114248. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Rebholz CM, Grams ME, Matsushita K, Selvin E, Coresh J. Change in Novel Filtration Markers and Risk of ESRD. Am J Kidney Dis. 2015;66(1):47–54. doi: 10.1053/j.ajkd.2014.11.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Fine JP, Gray RJ. A Proportional Hazards Model for the Subdistribution of a Competing Risk. J Am Stat Assoc. 1999;94(446):496–509. [Google Scholar]
- 26.Pencina MJ, D’Agostino RB. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med. 2004 Jul 15;23(13):2109–23. doi: 10.1002/sim.1802. [DOI] [PubMed] [Google Scholar]
- 27.Pencina MJ, D’Agostino RB, Steyerberg EW. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011 Jan 15;30(1):11–21. doi: 10.1002/sim.4085. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Pencina MJ, D’Agostino RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008 Jan 30;27(2):157–72. doi: 10.1002/sim.2929. discussion 207–12. [DOI] [PubMed] [Google Scholar]
- 29.Zheng Y, Parast L, Cai T, Brown M. Evaluating incremental values from new predictors with net reclassification improvement in survival analysis. Lifetime Data Anal. 2013 Jul;19(3):350–70. doi: 10.1007/s10985-012-9239-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Pepe MS, Feng Z, Gu JW. Comments on “Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond” by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929) Stat Med. 2008 Jan 30;27(2):173–81. doi: 10.1002/sim.2991. [DOI] [PubMed] [Google Scholar]
- 31.Pepe MS, Feng Z, Huang Y, Longton G, Prentice R, Thompson IM, et al. Integrating the predictiveness of a marker with its performance as a classifier. Am J Epidemiol. 2008;167(3):362–8. doi: 10.1093/aje/kwm305. 2007/11/06 ed. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Uno H, Cai T, Pencina MJ, D’Agostino RB, Wei LJ. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med. 2011 May 10;30(10):1105–17. doi: 10.1002/sim.4154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Stone NJ, Robinson JG, Lichtenstein AH, Bairey Merz CN, Blum CB, Eckel RH, et al. 2013 ACC/AHA guideline on the treatment of blood cholesterol to reduce atherosclerotic cardiovascular risk in adults: A report of the american college of cardiology/american heart association task force on practice guidelines. Circulation. 2014;129(25 SUPPL 1):1–49. doi: 10.1161/01.cir.0000437738.63853.7a. [DOI] [PubMed] [Google Scholar]
- 34.Echouffo-Tcheugui J-B, Kengne AP. Comparative performance of diabetes-specific and general population-based cardiovascular risk assessment models in people with diabetes mellitus. Diabetes Metab. 2013 Oct;39(5):389–96. doi: 10.1016/j.diabet.2013.07.002. [DOI] [PubMed] [Google Scholar]
- 35.Simmons RK, Coleman RL, Price HC, Holman RR, Khaw K-T, Wareham NJ, et al. Performance of the UK Prospective Diabetes Study Risk Engine and the Framingham Risk Equations in Estimating Cardiovascular Disease in the EPIC- Norfolk Cohort. Diabetes Care. 2009 Apr;32(4):708–13. doi: 10.2337/dc08-1918. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Stevens RJ, Kothari V, Adlera I, Stratton IM. The UKPDS risk engine: a model for the risk of coronary heart disease in Type II diabetes (UKPDS 56) Clin Sci (Lond) 2001 Dec;101(6):671–9. [PubMed] [Google Scholar]
- 37.Kothari V, Stevens RJ, Adler AI, Stratton IM, Manley SE, Neil Ha, et al. UKPDS 60: Risk of Stroke in Type 2 Diabetes Estimated by the UK Prospective Diabetes Study Risk Engine. Stroke. 2002 Jul 1;33(7):1776–81. doi: 10.1161/01.str.0000020091.07144.c7. [DOI] [PubMed] [Google Scholar]
- 38.Bannister CA, Poole CD, Jenkins-Jones S, Morgan CL, Elwyn G, Spasic I, et al. External Validation of the UKPDS Risk Engine in Incident Type 2 Diabetes: A Need for New Type 2 Diabetes-Specific Risk Equations. Diabetes Care. 2014 Feb;37(2):537–45. doi: 10.2337/dc13-1159. [DOI] [PubMed] [Google Scholar]
- 39.van der Leeuw J, van Dieren S, Beulens JWJ, Boeing H, Spijkerman aMW, van der Graaf Y, et al. The validation of cardiovascular risk scores for patients with type 2 diabetes mellitus. Heart. 2014:1–8. doi: 10.1136/heartjnl-2014-306068. [DOI] [PubMed] [Google Scholar]
- 40.Chamnan P, Simmons RK, Sharp SJ, Griffin SJ, Wareham NJ. Cardiovascular risk assessment scores for people with diabetes: a systematic review. Diabetologia. 2009 Oct;52(10):2001–14. doi: 10.1007/s00125-009-1454-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Muller-Riemenschneider F, Holmberg C, Rieckmann N, Kliems H, Rufer V, Muller-Nordhorn J, et al. Barriers to Routine Risk-Score Use for Healthy Primary Care Patients. Arch Intern Med. 2010;170(8):719–24. doi: 10.1001/archinternmed.2010.66. [DOI] [PubMed] [Google Scholar]
- 42.Dhippayom T, Chaiyakunapruk N, Krass I. Diabetes Res Clin Pract. Elsevier Ireland Ltd; 2014. Jan 15, How diabetes risk assessment tools are implemented in practice: A systematic review. [DOI] [PubMed] [Google Scholar]
- 43.Kengne AP. The ADVANCE cardiovascular risk model and current strategies for cardiovascular disease risk evaluation in people with diabetes. Cardiovasc J Afr. 2013;24(9–10):376–81. doi: 10.5830/CVJA-2013-078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Keane WF, Zhang Z, Lyle PA, Cooper ME, de Zeeuw D, Grunfeld J-P, et al. Risk scores for predicting outcomes in patients with type 2 diabetes and nephropathy: the RENAAL study. Clin J Am Soc Nephrol. 2006 Jul;1(4):761–7. doi: 10.2215/CJN.01381005. [DOI] [PubMed] [Google Scholar]
- 45.Desai AS, Toto R, Jarolim P, Uno H, Eckardt K-U, Kewalramani R, et al. Am J Kidney Dis. 5. Vol. 58. Elsevier Inc; 2011. Nov, Association between cardiac biomarkers and the development of ESRD in patients with type 2 diabetes mellitus, anemia, and CKD; pp. 717–28. [DOI] [PubMed] [Google Scholar]
- 46.Krolewski AS, Warram JH, Forsblom C, Smiles AM, Thorn L, Skupien J, et al. Serum concentration of cystatin C and risk of end-stage renal disease in diabetes. Diabetes Care. 2012 Nov;35(11):2311–6. doi: 10.2337/dc11-2220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Elley CR, Robinson T, Moyes SA, Kenealy T, Collins J, Robinson E, et al. Derivation and validation of a renal risk score for people with type 2 diabetes. Diabetes Care. 2013 Oct;36(10):3113–20. doi: 10.2337/dc13-0190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Jardine MJ, Hata J, Woodward M, Perkovic V, Ninomiya T, Arima H, et al. Am J Kidney Dis. 5. Vol. 60. Elsevier Inc; 2012. Nov, Prediction of kidney-related outcomes in patients with type 2 diabetes; pp. 770–8. [DOI] [PubMed] [Google Scholar]
- 49.Kengne AP, Batty GD, Hamer M, Stamatakis E, Czernichow S. Association of C-reactive protein with cardiovascular disease mortality according to diabetes status: pooled analyses of 25,979 participants from four U.K. prospective cohort studies. Diabetes Care. 2012 Feb 30;35(2):396–403. doi: 10.2337/dc11-1588. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Sluik D, Beulens JWJ, Weikert C, van Dieren S, Spijkerman AMW, van der ADL, et al. Gamma-glutamyltransferase, cardiovascular disease and mortality in individuals with diabetes mellitus. Diabetes Metab Res Rev. 2012 Mar;28(3):284–8. doi: 10.1002/dmrr.2261. [DOI] [PubMed] [Google Scholar]
- 51.Price AH, Welsh P, Weir CJ, Feinkohl I, Robertson CM, Morling JR, et al. N-terminal pro-brain natriuretic peptide and risk of cardiovascular events in older patients with type 2 diabetes: the Edinburgh Type 2 Diabetes Study. Diabetologia. 2014 Dec;57(12):2505–12. doi: 10.1007/s00125-014-3375-9. [DOI] [PubMed] [Google Scholar]
- 52.Selvin E, Rawlings A, Lutsey P, Maruthur N, Pankow JS, Steffes M, et al. Association of 1,5-anhydroglucitol with cardiovascular disease and mortality. Diabetes. 2015 doi: 10.2337/db15-0607. published. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Folsom AR, Chambless LE, Duncan BB, Gilbert AC, Pankow JS. Prediction of coronary heart disease in middle-aged adults with diabetes. Diabetes Care. 2003 Oct;26(10):2777–84. doi: 10.2337/diacare.26.10.2777. [DOI] [PubMed] [Google Scholar]
- 54.Report of the expert committee on the diagnosis and classification of diabetes mellitus. Diabetes Care. 2003;26(Suppl 1):S5–20. doi: 10.2337/diacare.26.2007.s5. [DOI] [PubMed] [Google Scholar]
- 55.Gregg EW, Li Y, Wang J, Burrows NR, Ali MK, Rolka D, et al. Changes in diabetes-related complications in the United States, 1990–2010. N Engl J Med. 2014;370(16):1514–23. doi: 10.1056/NEJMoa1310799. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.