Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2016 Oct 13.
Published in final edited form as: J Am Coll Cardiol. 2015 Oct 13;66(15):1643–1653. doi: 10.1016/j.jacc.2015.08.035

Ten-Year Coronary Heart Disease Risk Prediction Using Coronary Artery Calcium and Traditional Risk Factors: Derivation in the Multi-Ethnic Study of Atherosclerosis with Validation in the Heinz Nixdorf Recall Study and the Dallas Heart Study

Robyn L McClelland 1, Neal W Jorgensen 1, Matthew Budoff 2, Michael J Blaha 3, Wendy S Post 3, Richard A Kronmal 1, Diane E Bild 4, Steven Shea 5, Kiang Liu 6, Karol E Watson 7, Aaron R Folsom 8, Amit Khera 9, Colby Ayers 10, Amir-Abbas Mahabadi 11, Nils Lehmann 12, Karl-Heinz Jöckel 12, Susanne Moebus 12, J Jeffrey Carr 13, Raimund Erbel 11, Gregory L Burke 14
PMCID: PMC4603537  NIHMSID: NIHMS717874  PMID: 26449133

Abstract

Background

Several studies have demonstrated the tremendous potential of using coronary artery calcium (CAC) in addition to traditional risk factors for coronary heart disease (CHD) risk prediction. However, to date no risk score incorporating CAC has been developed.

Objectives

Our goal was to derive and validate a novel risk score to estimate 10-year CHD risk using CAC and traditional risk factors.

Methods

Algorithm development was conducted in the Multi-Ethnic Study of Atherosclerosis (MESA), a prospective community-based cohort study of 6814 participants aged 45–84, free of clinical heart disease at baseline and followed for 10 years. MESA is gender balanced and included 39% Non-Hispanic whites, 12% Chinese American, 28% African American, and 22% Hispanic Americans. External validation was conducted in the Heinz Nixdorf Recall Study (HNR) and the Dallas Heart Study (DHS).

Results

Inclusion of CAC in the MESA risk score offered significant improvements in risk prediction (C-statistic 0.80 versus 0.75, p<0.0001). External validation in both HNR and DHS provided evidence of very good discrimination and calibration. Harrell’s C-statistic was 0.779 in HNR, and 0.816 in DHS. Additionally the difference in estimated 10-year risk between events and non-events was approximately 8–9%, indicating excellent discrimination. Mean calibration, or calibration-in-the-large, was excellent for both studies, with average predicted 10-year risk within half a percent of the observed event rate.

Conclusions

An accurate estimate of 10-year CHD risk can be obtained using traditional risk factors and CAC. The MESA risk score, which is available online on the MESA web site for easy use, can be used to aid clinicians in the communication of risk to patients and when determining risk-based treatment strategies.

Keywords: coronary disease, risk prediction, epidemiology, atherosclerosis

Introduction

Coronary artery calcium (CAC) scores derived from routine cardiac-gated non-contrast CT scans are a commonly used method for enhancing clinical cardiovascular risk prediction. Importantly, CAC scores are incremental but not redundant with traditional risk factors, and therefore integration of both sets of information can enhance risk assessment. Indeed, the added value of CAC over and above traditional risk factors for prediction of cardiovascular events has been demonstrated in several studies (111). However, to date, no published risk scores are available to clinicians to incorporate CAC into routine 10-year risk prediction.

The Multi-Ethnic Study of Atherosclerosis (MESA), due to its population-based, multiethnic composition, and availability of 10 years of follow up for incident CHD events, provides a unique opportunity to describe how CAC might be optimally combined with traditional risk factors in risk prediction. In this paper, we describe a novel MESA risk score that can be used to estimate 10-year CHD risk in patients with a CAC measurement. We also provide a score without inclusion of CAC for evaluation of the impact of including CAC in thenovel risk score. We believe the MESA risk score could be immediately used for communication of risk with patients after CAC scoring, guiding risk-based treatment decisions in clinical practice, as well as in designing future research studies that might use CAC to target high risk subpopulations.

Methods

Study Participants

MESA was designed to study the prevalence, risk factors and progression of subclinical cardiovascular disease in a multi-ethnic cohort. A detailed description of the study design and methods has been published previously (12). Briefly, 6814 participants aged 45–84 years who identified themselves as white, African-American, Hispanic, or Chinese were recruited from six U.S. communities from 2000–2002. All participants were free of clinically apparent cardiovascular disease. The research was approved by the IRBs at all participating institutions, and all participants gave informed consent.

Measurement of Coronary Artery Calcium

Coronary artery calcium was measured using ECG gated electron-beam computed tomography at 3 field centers, and multi-detector computed tomography at the other 3 field centers (12,13). Images were analyzed independently at a central reading center, and the amount of CAC was quantified using the Agatston scoring method (14). Re-scan agreement was high using both EBT and MDCT scanners (15). Inter- and intra- observer agreement were also very high (Kappa=0.93 and 0.90 respectively).

Coronary Heart Disease Ascertainment

At intervals of 9–12 months, a telephone interviewer contacted each participant to inquire about interim hospitalizations, cardiovascular outpatient diagnoses and procedures, and deaths. Trained personnel abstracted medical records, and two physicians independently classified the events using predefined criteria. Hospital records were obtained for an estimated 98% of hospitalized cardiovascular events and some medical record-based information was available for 95% of outpatient encounters. All events through December 31, 2011 are included in this report.

Our endpoint consisted of incident hard CHD events: MI, resuscitated cardiac arrest, fatal CHD, and revascularization only if the participant also had prior or concurrent adjudicated angina. MI required either abnormal cardiac biomarkers (2 times upper limits of normal) regardless of pain or ECG findings; evolving Q waves regardless of pain or biomarker findings; or a combination of chest pain, and ST-T evolution or new LBBB, and biomarker levels 1–2 times upper limits of normal. For suspected cardiovascular deaths based on ICD-10 underlying cause of death codes, a committee of MESA physicians classified CHD deaths using the death certificate, available medical records, and for out of hospital deaths, any next of kin interviews or physician questionnaires that could be obtained. CHD death required a documented MI within the previous 28 days, chest pain within 72 hours, or a history of CHD, and required the absence of a known non-cardiac cause of death.

Measurement of Other Covariates

Positive family history referred to a heart attack at any age in a parent, sibling, or child. The age at which the relative experienced the heart attack was not collected at baseline in MESA, precluding consideration of premature family history. Current smoking was defined as answering yes to the question “Have you smoked cigarettes during the last 30 days?” Resting blood pressure was measured three times in the seated position, and the average of the last two measurements was used in analysis. Medication use was determined by questionnaire. Additionally, participants were asked to bring containers for all medications used during the two weeks prior to the visit to the clinic.

Statistical Methods

Model Development

Our list of candidate covariates included the traditional Framingham risk factors: age, sex, HDL cholesterol, total cholesterol, systolic blood pressure (SBP), anti-hypertensive medication use, current smoking, diabetes, and CAC. Additionally we considered family history of heart attack, lipid lowering medication use, body mass index, and race/ethnicity. Interactions considered included: age, sex, race/ethnicity and CAC with all other predictors; anti-hypertensive medications-by-SBP; and lipid lowering medications-by-total cholesterol. For continuous covariates, we explored non-linearity by fitting generalized additive models with 4 degrees of freedom and adjusted for age, sex, and race/ethnicity (16). These models were fit using the “gam” package in Stata (17) .There was evidence of potential non-linearity for age and systolic blood pressure, hence polynomial terms were considered. Although substantial nonlinearity was exhibited for untransformed CAC, the log(CAC+1) transformation, which has been used previously (1), demonstrated no departures from linearity. It is critical to use CAC continuously to preserve all available information in the CAC variable, as has been preferred in prior CAC literature. The identical modeling strategy was used to develop the model which did not include CAC.

Shrinkage/penalization methods were used to avoid overfitting (18). We primarily used the method called Lasso (“least absolute shrinkage and selection operator”) which penalizes the sum of the absolute values of the regression coefficients (19,20). This leads to some coefficients shrinking all the way to zero, and hence simultaneously performs variable selection. A penalized Cox proportional hazards model was used, and this was fit using the “penalized” package in R (21). Shrinkage was done in two stages to allow inclusion of interaction terms only when the corresponding main effects were in the model. The first stage forced in the main effects of interest (unpenalized) and selected (via the Lasso) among the interaction and polynomial terms. The second stage started from the main effects plus selected interaction terms (if any) and then applied a ridge regression penalty. This penalty provides some shrinkage of the coefficients, but does not shrink any of the coefficients to zero. Selection of the tuning parameters at each stage was done via 10-fold cross-validated likelihood.

Proportional hazards for each variable were tested using Schoenfeld residuals in a standard Cox model that forced in all the candidate main effects (22). There were no significant proportional hazards violations for any of the candidate main effects, and the global test was non-significant (p=0.33).

External Validation

The risk scores were validated in two independent longitudinal cohort studies, the Heinz Nixdorf Recall Study and the Dallas Heart Study. The risk score formula was sent to the coordinating centers of these studies, where the validation calculations were performed.

The Heinz Nixdorf Recall Study (HNR) is a single center study that recruited a total of 4814 Caucasians between 45 and 75 years of age from three neighbouring cities in Germany between the years 2000 and 2003. Participants were a random sample derived from mandatory citizen registries. For this comparison of the two study cohorts, we included 3692 members of HNR who were free of clinical cardiovascular disease at baseline and for whom complete covariate and follow-up data was available. Details about the design and recruitment strategy of the HNR have been previously published (23,24). Additionally, prior publications have described the comparability of the HNR and MESA cohorts with respect to CAC measurement, risk factors, and endpoints (25,26). Participants were followed a median of 10.4 years (IQR 9.2 to 11.3). For all primary study end points, hospital and nursing home records, including electrocardiograms, laboratory values, and pathology reports, were collected. For deceased subjects, death certificates were collected and interviews with general practitioners, relatives, and eyewitnesses were undertaken if possible. Medical records were obtained in 100% of all reported end points. An external end point committee blinded for risk factor status and CAC scores reviewed all documents and classified the end points.

The Dallas Heart Study (DHS) is a multi-ethnic, population-based probability sample of Dallas County, Texas. The initial data collection was performed in 2000–2002 and included the collection of detailed socioeconomic, biomarker and imaging data from each participant. Participants in DHS were aged 30–65, however only 1080 aged 45–65 were included in this validation study. Details about the design of the DHS have been previously published (27). The DHS includes Caucasians, African Americans, and Hispanics. Participants were followed a median of 9.3 years (IQR 8.9 to 9.8). The Dallas Heart Study employed a redundant strategy to ascertain clinical events. Deaths events were acquired for all DHS participants through the National Death Index which was complete 12/31/10. Non-fatal events were captured through an annual detailed health survey administered by phone and by a unique data source, the Dallas-Fort Worth Hospital Council Data Initiative database which captures hospital claims data for 77 hospitals in the metroplex area and represents >90% of the healthcare market volume in this region. More than 90% of participants from the CAC cohort were tracked using one or both of these mechanisms.

Performance Metrics

We assessed two aspects of model performance, discrimination and calibration. Discrimination was assessed using Harrell’s C-statistic, the discrimination slope (the absolute difference between the average predicted 10-year probability of an event for those who experienced an event minus the average for those who did not, and the area under the survival ROC (28,18, 29). Calibration was assessed via the calibration slope (calculated as the slope of the linear regression of the event indicator on the predicted probability), and calibration-in-the-large (the difference between the observed event rate and the average predicted 10-year event rate). (18).

Presentation

A computerized version of the risk score will be posted on the MESA website http://www.mesa-nhlbi.org/ for ease of use by clinicians, patients, and researchers. This MESA risk score application requires only input of the traditional risk factors and the CAC score, and is the preferred way to for interested parties to use the risk score.

Results

Participants in MESA were followed for a median of 10.2 years (inter-quartile range 9.7 to 10.7), and 422 CHD events were observed with first events including 68 CHD deaths, 189 non-fatal myocardial infarctions, 149 angina-driven revascularizations, and 15 resuscitated cardiac arrests. A total of 88 participants were excluded from this study, (5 participants found to have a pre-baseline event, 28 without follow-up, and 55 missing covariate data). The remaining sample size was 6726.

Table 1 provides the baseline characteristics of the MESA cohort and the two validation cohorts. All three cohorts are gender balanced. DHS participants are 10 years younger on average than participants in MESA and HNR. HNR is exclusively Caucasian, while DHS includes African Americans and Hispanic Americans similar to MESA. Rates of diabetes are similar across cohorts. MESA includes fewer current smokers than either HNR or DHS. MESA and DHS are similar in terms of lipid levels, blood pressure, and family history. HNR participants have worse lipid profiles and blood pressure levels, but less positive family history. Kaplan Meier 10 year rates of CHD were highest for HNR (7.5%) followed by MESA (6.5%) and finally DHS (5.5%).

Table 1.

Participant Characteristics—MESA, HNR and DHS Studies

MESA
N=6726
HNR
N=3692
DHS
N=1080
Age (years) 62.1 ± 10.2 59.8 ± 7.7 52.7 ± 5.5

Male Gender 3176 (47.2) 1714 (46.4) 466 (43.2)

Race/Ethnicity:
Caucasian 2622 (38.5) 3692 (100) 409 (37.9)
Chinese American 803 (11.8) -- --
African American 1893 (27.8) -- 530 (49.1)
Hispanic American 1496 (22.0) -- 122 (11.3)
Other -- -- 19 (1.8)

Diabetes 859 (12.7) 470 (12.7) 148 (13.7)

Current smoker 887 (13.0) 831 (22.5) 272 (25.2)

Total cholesterol (mg/dl) 194.2 ± 35.7 231.0 ± 38.9 189.3 ± 41.5
HDL cholesterol (mg/dl) 51.0 ± 14.8 58.8 ± 17.0 51.4 ± 14.9
Lipid lowering medications 1100 (16.2) 368 (10.0) 104 (9.6)

Systolic blood pressure (mmHg) 126.6 ± 21.5 132.9 ± 20.6 128.5 ± 19.5
Anti-hypertensive medications 2536 (37.2) 1241 (33.6) 330 (30.6)

Family history of heart attack 3611 (53.7) 2671 (72.3) 436 (40.4)
no 2699 (40.1) 1021 (27.7) 501 (46.4)
Yes 416 (6.2) -- 143 (13.2)
unknown

Coronary Artery Calcium
(Agatston) 3416 (50.1) 1138 (30.8) 361 (33.4)
0 1794 (26.3) 1512 (40.9) 565 (52.3)
1–99 927 (13.6) 659 (17.9) 113 (10.5)
100–399 677 (9.9) 383 (10.4) 41 (3.8)
400+

10-year (Kaplan-Meier) CHD
Rate
6.5% 7.5% 5.5%

Numbers in table are mean ± standard deviation, or n (%). For DHS, the “Other” race/ethnic category includes the following: American Indian/Pacific Islander/Alaskan Native/Asian/East Indian.

Table 2 provides the estimated hazards ratios, coefficients and baseline hazards for a 10-year CHD risk prediction model with CAC and for one without CAC. The table provides the baseline survival function and risk factors coefficients that have been incorporated into the online MESA Risk Score application. No interaction or polynomial terms were retained in the model, nor were BMI or diastolic blood pressure included.

Table 2.

MESA 10 Year CHD Risk Prediction Models

Risk Factors Only Risk Factors and CAC

Variable Hazards
Ratio
Beta
Coefficient
p-value Hazards
Ratio
Beta
Coefficient
p-value
Age (yrs) 1.05 0.0455 <0.0001 1.02 0.0172 .007

Male 2.12 0.7496 <0.0001 1.50 0.4079 <0.001

Race/Ethnicity:
Non-Hispanic White ref 0 -- ref 0 --
Chinese American 0.60 −0.5055 <0.01 0.71 −0.3475 0.07
African-American 0.81 −0.2111 0.066 1.04 0.0353 0.70
Hispanic 0.83 −0.1900 0.11 0.98 −0.0222 0.88

Diabetes 1.68 0.5168 <0.0001 1.48 0.3892 0.002

Current smoker 1.61 0.4732 <0.001 1.45 0.3717 0.005

Total cholesterol 1.01 0.0053 <0.0001 1.00 0.0043 <0.001
(mg/dl) 0.99 −0.0140 <0.001 0.99 −0.0114 0.003
HDL cholesterol 1.28 0.2473 0.003 1.13 0.1206 0.32
(mg/dl)
Lipid lowering meds

Systolic BP (mmHg) 1.01 0.0085 0.0002 1.01 0.0066 0.004
Anti-hypertensive meds 1.40 0.3381 0.0013 1.26 0.2278 0.033

Family hx of heart
attack
1.57 0.4522 <0.0001 1.38 0.3239 <0.001

ln (CAC+1) NA NA NA 1.32 0.2743 <0.0001

Baseline Survival at 10
Years, S(10)
0.99963 0.99833

P-values are based on a standard Cox proportional hazards model. To estimate the 10 year risk of a CHD event for a particular person, multiply the values of the risk factors by the corresponding beta coefficient and sum these quantities up to yield a value (call it A following the notation in Wilson et al [Wilson]). Then calculate B=exp(A). Finally the 10-year risk is given by 1-S(10)B. Alternatively see the online calculator at http://www.mesa-nhlbi.org/.

Figure 1 illustrates the internal discrimination properties of our two models. The area under the survival ROC curve within MESA was 0.81 for the model with CAC indicating excellent discrimination between events and non-events. Comparison with our internally developed risk score without CAC, which has an area under the survival ROC of 0.76, provides evidence of the significant improvement due to inclusion of CAC (p<0.0001). The boxplot in the second panel of Figure 1 shows separation in predicted 10 year risk between events and non-events, and this is also improved by the addition of CAC. The difference between events and non-events was significant for each version of the score (p<0.001 for both). The discrimination slope was 0.086 for the score with CAC. That is, those who experienced events had an average predicted 10 year risk that was 8.6% higher than those who did not. In contrast the discrimination slope was 0.052 for the score without CAC, or an average separation of 5.2% higher predicted risk for those with events.

Figure 1. Discrimination of the MESA CHD Risk Score within the Development Cohort.

Figure 1

The first panel displays the Receiver-Operator Characteristic (ROC) curves for the risk scores with and without CAC applied within the MESA cohort. The second panel displays a boxplot of the predicted 10-year CHD probabilities for each score stratified by event status. The shaded box covers the middle 50% of the data, with a line at the median.

We also evaluated our internal discrimination performance in various subsets of the MESA cohort. The area under the survival ROC was better for non-Caucasians relative to Caucasians (Chinese: 0.85, Black: 0.80, Hispanic: 0.86, Caucasian: 0.79), better for young (under 65: 0.82) than old (>=65 yrs, 0.76), and women (0.81) compared to men (0.79).

External validation in both the HNR and DHS studies is shown in Table 3 and the Central Illustration, and provides evidence for very good to excellent discrimination and calibration for the model including CAC. Harrell’s C-statistic was 0.779 in the HNR study, and 0.816 in the DHS. There was a 7.8–9.5% difference in predicted probability between events and non-events. Observed and predicted risks were close across the range of the score as seen in the Central Illustration, with the exception of some underestimation seen in the highest risk group of DHS. There was no evidence of poor calibration based on the Hosmer-Lemeshow goodness-of-fit statistics (p>0.22 for each cohort). Externally validated calibration slopes were 0.90 for HNR, and 1.19 for DHS (perfect calibration yields a slope of 1.0). Mean calibration, or calibration-in-the-large, was excellent for both studies (−0.50% for HNR, and −0.46% for DHS) indicating that on average predicted risk was within half a percent of the observed event rate. In comparison, the model without CAC also was not as well calibrated in HNR (calibration slope 0.74), and discrimination was substantially worse (C-statistic =0.720, discrimination slope 0.053). In DHS the C-statistic for the model without CAC was very good (C-statistic=0.782) but discrimination slope was only 0.046, and the calibration slope was large at 1.55.

Table 3.

Evaluation of Model Performance

MESA HNR DHS
Sample Size 6726 3692 1080
# CHD events 422 274 58
Model with Risk Factors Only
Harrell’s C-statistic 0.750 0.720 0.782
Discrimination Slope 0.052 0.053 0.046
Calibration Slope 0.834 0.740 1.55
Model with Risk Factors and CAC
Harrell’s C-statistic 0.800 0.779 0.816
Discrimination Slope 0.086 0.095 0.078
Calibration Slope 0.857 0.899 1.19

Central Illustration. MESA CHD Risk Score Using Coronary Artery Calcium: Calibration of the MESA CHD Risk Score.

Central Illustration

The Central Illustration presents the observed versus the predicted event rates. Predicted risks were divided into 10 equal sized bins for MESA and HNR. For DHS, only 5 bins were used due to the smaller sample size.

Figure 2 displays a sample patient case. A 70 year old Hispanic man with mild treated hypertension and no other traditional risk factors would have a 10-year CHD risk of 9.3% before considering CAC data, and 3.1% after a CAC score result of zero.

Figure 2. Online Risk Score Calculator.

Figure 2

A screenshot of the online risk score calculator available at http://www.mesa-nhlbi.org/. Here we see the calculator being used for an older man with fairly favorable risk factor profile but zero CAC. Under a risk score without CAC, 10-year estimated CHD risk is 9.3%, due in large part to their age. Once we factor in that they have no detectable CAC, estimated risk is only 3.1%.

Discussion

CAC is a direct measurement of one component of atherosclerotic plaque in the coronary arteries, and a potent predictor of future CHD events. (111). Risk prediction equations are recommended for clinical use to select the best candidates for preventive therapies such as cholesterol-lowering medications (30). One commonly stated limitation for clinical CAC scoring is the absence of a risk calculator for integrating this information into global cardiovascular risk assessment (31). Here we present a predictive algorithm to integrate CAC measurement with traditional risk factors, and demonstrate that a risk score that includes CAC improves CHD risk prediction compared to single measurements of traditional risk factors alone (32). The use of this equation can be considered as part of the “risk discussion” between a clinician and patient when CAC imaging has been performed (33).

We also show that the algorithm generalizes well to two external populations. These validation cohorts included one large study in Germany (HNR) that follows very similar protocols to MESA and has similar age and risk factor distribution. The second validation cohort, the DHS, is U.S. derived and multi-ethnic, similar to MESA and the U.S. population. Our algorithm includes a term for race/ethnicity, however, consistent with an earlier report from MESA by Detrano et al (1), we did not find that the associations of CAC or other risk factors with CHD events differed by race/ethnicity. Our results are consistent with prior studies demonstrating that CAC improves discrimination of CHD events in the Multi-Ethnic Study of Atherosclerosis (MESA) population and the Heinz Nixdorf Recall Study (2,411).

We evaluated two important aspects of a risk prediction algorithm, discrimination and calibration. Discrimination refers to the ability of the risk score to separate those who ultimately have events from those who do not. The statistics which reflect this are the C-statistic and the discrimination slope. C-statistics for existing risk scores, including the Framingham CHD risk score and the 2013 ACC/AHA risk estimator, evaluated in the MESA data fall in the range 0.65 to 0.75 depending on the subset being investigated (34). Improvement to the 0.78 to 0.81 range as demonstrated in our two external validations represents a substantial gain in terms of this metric. We also note that comparing discrimination with a recalibrated AHA/ACC risk score30 (C-index of 0.71) to a strategy of adding CAC to the AHA/ACC score (C-index 0.78) to our risk score (C-index 0.80) supports the strategy of deriving a new score to incorporate CAC, rather than attempting to simply add CAC onto the existing risk score.

The discrimination slope represents the separation between events and non-events in terms of average predicted risk. Results indicate that those who experience events will have predicted 10 year risk estimates that are on average 8–9% higher than non-events. Importantly, the MESA CHD risk score with CAC offers a substantial improvement in separation. Finally, calibration refers to the agreement between observed and predicted event rates in the population. The HNR validation results indicate excellent calibration and the DHS results indicate very good calibration. This is important, as the AHA/ACC risk score is known to overestimate risk and exhibit poor calibration in MESA (34).

Traditional CHD risk scores are strongly influenced by age, sex and race/ethnicity. Importantly, including CAC in the risk score markedly decreases the impact of these demographic risk factors (Table 2). This is likely explained by the fact that CAC serves to integrate the effect of all measured (and unmeasured) risk factors over the course of an individual’s lifetime up until the point of CAC measurement. This is important in terms of individualization of risk, and avoids scenarios where, for instance, all men over a particular age are deemed high risk based on their chronologic age alone.

We also considered a direct comparison with existing risk scores, however several factors limit our enthusiasm for this comparison. Existing risk scores have been shown to be poorly calibrated and/or have low discrimination in MESA (34) and thus comparison of any new score developed in MESA (even in the absence of CAC) is guaranteed to show improvement. It would be unclear if this improvement is the result of an improved score, the addition of CAC, a problem with the original score, or some combination of these and other factors. In other words, comparing to an existing score would likely overstate the added value due to inclusion of CAC. For this reason we opted to make our comparison with a MESA version of a risk score, developed using the same modeling strategy as the CAC enhanced score—improvements in prediction of CHD events over this score are clearly due to the addition of CAC to the risk scoring paradigm. Our goal here was not to develop a new score with traditional risk factors only, but to provide an appropriate baseline for evaluation of our new score that incorporates CAC.

We included family history since it is a strong independent predictor of risk and is easily obtainable with no additional testing. We opted to include CAC as the sole marker of subclinical disease as it has been shown to offer the largest incremental prediction improvement over traditional risk factors. There may be potential utility in exploring whether other subclinical measures (i.e., ankle-brachial index, carotid plaque, ECG abnormalities) offer further incremental improvement in future MESA Risk Scores modeling stroke or a more inclusive CVD outcome.

Existing risk scores differ in their choice of endpoint. We modeled a CHD endpoint, similar to the Framingham Risk Score as described in the Adult Treatment Panel III (ATP 3) report (35), but dissimilar to other risk scores which also include stroke (30,3637), angina (38,39), and other events such as peripheral vascular disease, transient ischemic attack and heart failure (39). We opted against using a composite CVD endpoint, since each CVD component has different associations with risk factors. In addition, CAC has been shown to be much more strongly associated with CHD events than with cerebrovascular disease (40), and more likely to be used clinically for CHD risk prediction.

The algorithm is a prediction tool and the terms in the model should not be interpreted causally. For example, the term for anti-hypertensive medications denotes an increased risk for those on medications. This reflects the fact that those with treated hypertension tend to be a higher risk population, not that the medications themselves increase their risk. The term captures a combination of the increased risk of this population and the beneficial effect the medication has for those taking it. Similar reasoning holds for the effect of lipid lowering therapy. An additional cautionary note is that the risk estimates will have considerable variability in subsets of participants that are rare in the development data. For instance, participants with very high CAC (>400 or >1000) despite having a “normal” risk factor profile are rare in MESA. For participants with more “typical” risk factor profiles, the accuracy of the risk estimate will be optimized.

The MESA study includes many participants that were taking blood pressure or lipid lowering medication at the baseline examination. A strength of the MESA risk score is that it remains relevant for these commonly encountered patients, many of whom are treated for hypertension and/or hypercholesterolemia at the time of the initial encounter. For example, the risk scores can be used by the physician to motivate patient lifestyle change, encourage adherence to existing therapy, or to guide decisions about treatment intensity. The MESA risk score may be valuable for guiding decisions about the net benefit of daily aspirin therapy in primary prevention (41). When making treatment initiation decisions, the value of lipid lowering or anti-hypertensive medications can simply be entered as “zero”. This allows the risk score to be useful in more situations.

Strengths of this study include the large modern community-based multi-ethnic cohort, and the use of statistical techniques to provide a model that performs well when applied outside of the development cohort. Independent validation of the model in two contemporary cohorts— one international from Germany and one United States based multi-ethnic study—provides evidence of external validity. The age range of MESA was 45–84 years at study baseline, and hence the algorithm is limited to this range. Although MESA is multi-ethnic, there are many race/ethnicities not represented in the study, and the utility of the algorithm in these groups is unknown.

In summary, the MESA CHD risk score is the first available algorithm incorporating CAC with traditional risk factors for 10-year risk prediction. In addition to use in direct clinical encounters, the MESA Risk Score can be used by radiologists and cardiologists when interpreting and reporting CAC scores. Similar to the current practice of reporting CAC percentiles or 'arterial age' to place CAC results into clinical context, scan readers can now calculate and provide a 'post-test' 10-year CHD risk after CAC scanning based on the MESA Risk Score. This updated 10-year risk could be used to help make therapeutic decisions, such as the decision to start statin or aspirin therapy in primary prevention. Future guidelines from the Society of Cardiovascular Computed Tomography might consider recommending this practice in routine CAC score reporting. Additionally, future iterations of U.S and international prevention guidelines may consider use of the MESA Risk Score as an alternative risk score to existing algorithms when CAC score results are available.

Perspectives.

Competency in Patient Care: Detection of coronary artery calcification (CAC) by CT imaging can add to traditional risk factors for prediction of ischemic risk, but no robust and the MESA Risk Score is available to incorporate the CAC score in estimating an individual’s 10-year risk of atherothrombotic events.

Translational Outlook: Prospective studies are needed to validate the MESA Risk Score in independent cohorts, enhance the clinical application of CAC scoring in cardiovascular risk assessment, and inform the integration of this approach in future prevention guidelines.

Acknowledgements

The authors thank the other investigators, the staff, and the participants of the MESA, HNR, and DHS studies for their valuable contributions.

Funding Sources: Analysis and methods development for this project was supported by R01 HL 103729-01A1 from the National Heart, Lung, and Blood Institute. The MESA study was supported by contracts N01-HC-95159, N01-HC-95160, N01-HC-95161, N01-HC-95162, N01-HC-95163, N01-HC-95164, N01-HC-95165, N01-HC-95166, N01-HC-95167, N01-HC-95168 and N01-HC-95169 from the National Heart, Lung, and Blood Institute and by grants UL1-TR-000040, UL1 TR 001079 and UL1-RR-025005 from NCRR.

The HNR study is funded by a contract with the private Heinz Nixdorf Foundation, Essen, Germany and undergoes continuous monitoring by governmental agencies (DLR) lead by the Bundesministerium für Bildung und Forschung (BMBF). This study is also supported by the German Ministry of Education and Science (DFG).

The DHS was funded by the Donald W. Reynolds Foundation, Las Vegas, Nevada, and partially supported by the National Center for Advancing Translational Sciences of the National Institutes of Health under award Number UL1TR001105. Survey instrument development was funded in part by a Patient Care and Outcomes Research Grant from the American Heart Association, Dallas, Texas.

Abbreviations

CAC

coronary artery calcium

CT

computed tomography

MESA

Multi-Ethnic Study of Atherosclerosis

CHD

coronary heart disease

IRB

institutional review board

MI

myocardial infarction

ECG

electrocardiogram

LBBB

left bundle branch block

HDL

high-density lipoprotein

SBP

systolic blood pressure

HNR

Heinz Nixdorf Recall Study

DHS

Dallas Heart Study

FRS

Framingham Risk Score

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Disclosures: We do not have any conflicts of interest to disclose.

REFERENCES

  • 1.Detrano R, Guerci AD, Carr JJ, et al. Coronary Calcium as a Predictor of Coronary Events in Four Racial or Ethnic Groups. N Engl J Med. 2008;358:1336–1345. doi: 10.1056/NEJMoa072100. [DOI] [PubMed] [Google Scholar]
  • 2.Erbel R, Möhlenkamp S, Moebus S, et al. Coronary Risk Stratification, Discrimination, and Reclassification Improvement Based on Quantification of Subclinical Coronary Atherosclerosis: The Heinz Nixdorf Recall Study. J Am Coll Cardiol. 2010;56(17):1397–1406. doi: 10.1016/j.jacc.2010.06.030. [DOI] [PubMed] [Google Scholar]
  • 3.Paixao ARM, Berry JD, Neeland IJ, et al. Coronary Artery Calcification and Family History of Myocardial Infarction in the Dallas Heart Study. JACC Cardiovasc Imaging. 2014;7(7):679–686. doi: 10.1016/j.jcmg.2014.04.004. [DOI] [PubMed] [Google Scholar]
  • 4.Polonsky TS, McClelland RL, Jorgensen NW, et al. Coronary Artery Calcium Score and Risk Classification for Coronary Heart Disease Prediction. JAMA. 2010;303(16):1610–1616. doi: 10.1001/jama.2010.461. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Yeboah J, McClelland RL, Polonsky TS, et al. Comparison of Novel Risk Markers for Improvement in Cardiovascular Risk Assessment in Intermediate Risk Individuals. The Multi-Ethnic Study of Atherosclerosis. JAMA. 2012;308:788–795. doi: 10.1001/jama.2012.9624. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Jain A, McClelland RL, Polak JF, et al. Cardiovascular Imaging for Assessing Cardiovascular Risk in Asymptomatic Men Versus Women: The Multi-Ethnic Study of Atherosclerosis (MESA) Circ Cardiovasc Imaging. 2010;4(1):8–15. doi: 10.1161/CIRCIMAGING.110.959403. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Simon A, Megnien JL, Chironi G. The value of carotid intima-media thickness for predicting cardiovascular risk. Arterioscler Thromb Vasc Biol. 2010;30(2):182–185. doi: 10.1161/ATVBAHA.109.196980. [DOI] [PubMed] [Google Scholar]
  • 8.Peters SA, Bakker M, den Ruijter HM, Bots ML. Added value of CAC in risk stratification for cardiovascular events: a systematic review. Eur J Clin Invest. 2012;42(1):110–116. doi: 10.1111/j.1365-2362.2011.02555.x. [DOI] [PubMed] [Google Scholar]
  • 9.Peters SA, den Ruijter HM, Bots ML, Moons KG. Improvements in risk stratification for the occurrence of cardiovascular disease by imaging subclinical atherosclerosis: a systematic review. Heart. 2012;98(3):177–184. doi: 10.1136/heartjnl-2011-300747. [DOI] [PubMed] [Google Scholar]
  • 10.Möhlenkamp S, Lehmann N, Moebus S, et al. Heinz Nixdorf Recall Study Investigators. Quantification of coronary atherosclerosis and inflammation to predict coronary events and all-cause mortality. J Am Coll Cardiol. 2011;57(13):1455–1464. doi: 10.1016/j.jacc.2010.10.043. [DOI] [PubMed] [Google Scholar]
  • 11.Erbel R, Lehmann N, Möhlenkamp S, et al. Heinz Nixdorf Recall Study Investigators. Subclinical coronary atherosclerosis predicts cardiovascular risk in different stages of hypertension: result of the Heinz Nixdorf Recall Study. Hypertension. 2012;59(1):44–53. doi: 10.1161/HYPERTENSIONAHA.111.180489. [DOI] [PubMed] [Google Scholar]
  • 12.Bild DE, Bluemke DA, Burke GL, et al. Multi-ethnic study of atherosclerosis: objectives and design. Am J Epidemiol. 2002;156:871–881. doi: 10.1093/aje/kwf113. [DOI] [PubMed] [Google Scholar]
  • 13.Carr JJ, Nelson JC, Wong ND, et al. Calcified Coronary Artery Plaque Measurement with Cardiac CT in Population-based Studies: Standardized Protocol of Multi-Ethnic Study of Atherosclerosis (MESA) and Coronary Artery Risk Development in Young Adults (CARDIA) Study. Radiology. 2005;234:35–43. doi: 10.1148/radiol.2341040439. [DOI] [PubMed] [Google Scholar]
  • 14.Agatston AS, Janowitz WR, Hildner FJ, et al. Quantification of coronary artery calcium using ultrafast computed tomography. J Am Coll Cardiol. 1990;15:827–832. doi: 10.1016/0735-1097(90)90282-t. [DOI] [PubMed] [Google Scholar]
  • 15.Detrano RC, Anderson M, Nelson J, et al. Coronary Calcium Measurements: Effect of CT Scanner Type and Calcium Measure on Rescan Reproducibility—MESA Study. Radiology. 2005;236:477–484. doi: 10.1148/radiol.2362040513. [DOI] [PubMed] [Google Scholar]
  • 16.Hastie TJ, Tibshirani R. Generalized additive models. London: Chapman and Hall; 1990. [DOI] [PubMed] [Google Scholar]
  • 17.Royston P, Ambler G. Generalized Additive Models. Stata Technical Bulletin. 1998;42:38–43. [Google Scholar]
  • 18.Steyerberg EW. Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. New York: Springer; 2010. [Google Scholar]
  • 19.Tibshirani R. Regression shrinkage and selection via the lasso. J Royal Statist Soc B. 1996;58(1):267–288. [Google Scholar]
  • 20.Tibshirani R. The LASSO Method for Variable Selection in the Cox Model. Stat Med. 1997;16:385–395. doi: 10.1002/(sici)1097-0258(19970228)16:4<385::aid-sim380>3.0.co;2-3. [DOI] [PubMed] [Google Scholar]
  • 21.Goeman JJ. L1 penalized estimation in the Cox proportional hazards model. Biom J. 2010;52(1):70–84. doi: 10.1002/bimj.200900028. [DOI] [PubMed] [Google Scholar]
  • 22.Schoenfeld D. Partial residuals for the proportional hazards regression model. Biometrika. 1982;69(1):239–241. [Google Scholar]
  • 23.Schmermund A, Möhlenkamp S, Stang A, et al. Assessment of clinically silent atherosclerotic disease and established and novel risk factors for predicting myocardial infarction and cardiac death in healthy middle-aged subjects: Rationale and design of the Heinz Nixdorf RECALL Study. Am Heart J. 2002;144:212–218. doi: 10.1067/mhj.2002.123579. [DOI] [PubMed] [Google Scholar]
  • 24.Stang A, Moebus S, Dragano N, et al. Heinz Nixdorf Recall Study Investigation Group. Baseline recruitment and analyses of nonresponse of the Heinz Nixdorf Recall Study: identifiability of phone numbers as the major determinant of response. Eur J Epidemiol. 2005;20(6):489–496. doi: 10.1007/s10654-005-5529-z. [DOI] [PubMed] [Google Scholar]
  • 25.Erbel R, Delaney JA, Lehmann N, et al. Signs of subclinical coronary atherosclerosis in relation to risk factor distribution in the Multi-Ethnic Study of Atherosclerosis (MESA) and the Heinz Nixdorf Recall Study (HNR) Eur Heart J. 2008;29(22):2782–2791. doi: 10.1093/eurheartj/ehn439. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Budoff MJ, Möhlenkamp S, McClelland R, et al. A comparison of outcomes with coronary artery calcium scanning in unselected populations: the Multi-Ethnic Study of Atherosclerosis (MESA) and Heinz Nixdorf RECALL study (HNR) J Cardiovasc Comput Tomogr. 2013;7(3):182–191. doi: 10.1016/j.jcct.2013.05.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Victor RG, Haley RW, Willett DL, et al. The Dallas Heart Study: a population-based probability sample for the multidisciplinary study of ethnic differences in cardiovascular health. Am J Cardiol. 2004;93(12):1473–1480. doi: 10.1016/j.amjcard.2004.02.058. [DOI] [PubMed] [Google Scholar]
  • 28.Harrell FE, Jr, Califf RM, Pryor DB, et al. Evaluating the yield of medical tests. JAMA. 1982;247(18):2543–2546. [PubMed] [Google Scholar]
  • 29.Heagerty PJ, Lumley T, Pepe MS. Time-dependent ROC Curves for Censored Survival Data and a Diagnostic Marker. Biometrics. 2000;56:337–344. doi: 10.1111/j.0006-341x.2000.00337.x. [DOI] [PubMed] [Google Scholar]
  • 30.Goff DC, Jr, Lloyd-Jones DM, Bennett G, et al. 2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol. 2014;63(25_PA) doi: 10.1016/j.jacc.2013.11.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Anderson C, Vasan RS. Is there a role for coronary artery calcium scoring for management of asymptomatic patients at risk for coronary artery disease?: Clinical risk scores are sufficient to define primary prevention treatment strategies among asymptomatic patients. Circ Cardiovasc Imaging. 2014;7(2):390–397. doi: 10.1161/CIRCIMAGING.113.000470. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Blaha MJ, Silverman MG, Budoff MJ. Is there a role for coronary artery calcium scoring for management of asymptomatic patients at risk for coronary artery disease?: Clinical risk scores are not sufficient to define primary prevention treatment strategies among asymptomatic patients. Circ Cardiovasc Imaging. 2014;7(2):398–408. doi: 10.1161/CIRCIMAGING.113.000341. [DOI] [PubMed] [Google Scholar]
  • 33.Martin SS, Sperling LS, Blaha MJ, et al. Clinician-patient risk discussion for atherosclerotic cardiovascular disease prevention: importance to implementation of the 2013 ACC/AHA Guidelines. J Am Coll Cardiol. 2015;65(13):1361–1368. doi: 10.1016/j.jacc.2015.01.043. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.DeFilippis AP, Young R, Carrubba CJ, et al. An analysis of calibration and discrimination among multiple cardiovascular risk scores in a modern multiethnic cohort. Ann Intern Med. 2015;162(4):266–275. doi: 10.7326/M14-1281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adutls. Executive summary of the third report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) JAMA. 2001;285:2486–2497. doi: 10.1001/jama.285.19.2486. [DOI] [PubMed] [Google Scholar]
  • 36.Ridker PM, Buring JE, Rifai N, Cook NR. Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score. JAMA. 2007;297(6):611–619. doi: 10.1001/jama.297.6.611. [DOI] [PubMed] [Google Scholar]
  • 37.Ridker PM, Paynter NP, Rifai N, et al. C-reactive protein and parental history improve global cardiovascular risk prediction: the Reynolds Risk Score for men. Circulation. 2008;118(22):2243–2251. doi: 10.1161/CIRCULATIONAHA.108.814251. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Wilson PF, D'Agostino RB, Levy D, et al. Prediction of Coronary Heart Disease Using Risk Factor Categories. Circulation. 1998;97:1837–1847. doi: 10.1161/01.cir.97.18.1837. [DOI] [PubMed] [Google Scholar]
  • 39.D'Agostino RB, Sr, Vasan RS, Pencina MJ, et al. General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation. 2008;117(6):743–753. doi: 10.1161/CIRCULATIONAHA.107.699579. [DOI] [PubMed] [Google Scholar]
  • 40.Folsom AR, Kronmal RA, Detrano RC, et al. Coronary Artery Calcification Compared With Carotid Intima-Media Thickness in Prediction of Cardiovascular Disease Incidence: The Multi-Ethnic Study of Atherosclerosis (MESA) Arch Intern Med. 2008;168(12):1333–1339. doi: 10.1001/archinte.168.12.1333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Miedema MD, Duprez DA, Misialek JR, et al. Use of Coronary Artery Calcium Testing to Guide Aspirin Utilization for Primary Prevention: Estimates From the Multi-Ethnic Study of Atherosclerosis. Circ Cardiovasc Qual Outcomes. 2014;7(3):453–460. doi: 10.1161/CIRCOUTCOMES.113.000690. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES