“Never make forecasts. Especially about the future.”
--Samuel Goldwyn
INTRODUCTION
The use of biomarkers to augment traditional cardiovascular risk prediction has attracted considerable attention in the past decade. This interest has been fueled by the realization that traditional risk factors do not identify everyone who will eventually develop cardiovascular disease.1 This has been accompanied by the emergence of potential screening tests such as high-sensitivity C-reactive protein (CRP), single nucleotide polymorphism (SNP) arrays, and coronary calcium scanning.
Nonetheless, whether these biomarkers are ready for routine clinical use, to be measured alongside existing tests such as cholesterol, is controversial. Recently, the U.S. Preventive Services Task Force concluded that “current evidence is insufficient to assess the balance of benefits and harms of using the nontraditional risk factors…”2 This conclusion underscores gaps in the current literature, as well as the inherent challenge of predicting the occurrence of future cardiovascular events in generally healthy adults. Yet, the use of newer screening tests for cardiovascular risk assessment has been endorsed in some quarters. For instance, the state of Texas earlier this year passed legislation mandating the coverage of screening coronary calcium scans in older adults. Further, the FDA recently expanded the labeling of a statin drug, rosuvastatin, to include older individuals with elevated CRP levels in addition to conventional risk factors.
The present article reviews the case for and against the use of newer biomarkers for cardiovascular risk prediction. There are literally hundreds of circulating, genetic and imaging biomarkers that have been proposed or evaluated in the cardiovascular literature. Several comprehensive reviews exist on the topic.3,4 Rather than attempting to provide a systematic overview, the article focuses on a few of the most illustrative biomarkers. Particular emphasis will be given to placing these biomarkers in a pathophysiologic context (what stage of disease is represented?), addressing the utility of a multimarker approach (does it help to combine biomarkers?), and proposing priorities for future research in this area (where do we go from here?).
WHY DO WE NEED BIOMARKERS?
Cardiovascular disease remains the leading cause of death in the United States, a fact that underscores the importance of primary prevention. The success of preventive measures depends in part on the accurate identification of individuals who are at risk for future cardiovascular events (risk prediction). Traditionally, risk prediction has relied on assessment of risk factors such as hypertension, diabetes mellitus, hyperlipidemia, and smoking. Indeed, the approach to risk prediction has changed relatively little since Dr. William Kannel coined the phrase “factors of risk” in 1961 to describe these predisposing conditions.5
Despite the value of traditional risk factors, as many as half of individuals who develop coronary heart disease have only one or none of these risk factors.1,6 Indeed, individuals with few clinical risk factors are the least likely to be targeted for preventive therapies, but as a group they experience the largest number of cardiovascular events. Thus, there is an important need for new ways to improve upon the information obtained from traditional risk assessment, so that preventive measures can be applied to those who are the most likely to experience events.
Efforts to address the problem of identification have largely focused on the use of new measurements, or biomarkers, that could be added to traditional ones such as blood pressure and cholesterol. In 2001, an NIH working group proposed a definition of a biomarker as “a characteristic that is objectively measured and evaluated as an indicator of normal biological processes, pathogenic processes, or pharmacologic responses to a therapeutic intervention.”7 This definition highlights the fact that biomarkers are not limited to blood tests, although that is the context in which the term is most frequently used in the cardiology literature. Thus, a biomarker could include any representation of a biological process, including circulating molecules, genetic markers, cellular markers, results of imaging, or findings on physical examination.
Furthermore, which of these biomarkers is most informative is partly a function of the phase in the disease process (Figure 1). It is now recognized that overt cardiovascular disease is typically preceded by a long period of subclinical cardiovascular disease. For instance, subclinical atherosclerosis can be present for decades prior to a myocardial infarction. Imaging biomarkers detect the presence of subclinical cardiovascular disease, but are of little value for characterizing earlier stages, when subclinical disease is not yet apparent. In contrast, genetic biomarkers provide insight into disease susceptibility, but the information they provide is static, providing no indication whether or not subclinical disease has developed. Circulating biomarkers may be informative either early or late in the disease process, with some biomarkers reflecting activity in biological pathways that precede disease, and other biomarkers triggered by the presence of subclinical cardiovascular disease.
WHEN IS A NEW BIOMARKER USEFUL?
Criteria for evaluating new biomarkers have been proposed by several groups.4,8–10 These proposals share several key elements, in that they emphasize that the biomarker must be relatively easy to measure, add new information on top of traditional risk factors, and have the potential for changing how patients are managed. Additional criteria that have been suggested include cost-effectiveness,4,9,10 safety,4 and replication of the biomarker’s predictive value in different prospective cohorts.9
This issue of whether a biomarker adds new information is more complicated than it seems. A statistically significant (e.g. P<0.05) association between the biomarker and the outcome, even in a multivariable model, is necessary but not sufficient to determine predictive value. Odds ratios or hazards ratios can be statistically significant even if there is a large overlap in the biomarker distributions of those who do and don’t develop disease.11 Thus, for any given value of a biomarker, there could be an appreciable probability that the individual is a member of either group, diminishing the predictive value of the biomarker.
Discrimination
At least 3 criteria other than statistical significance have been proposed in the evaluation of new biomarkers: discrimination, calibration, and reclassification. Discrimination refers to the ability of a test to distinguish those who will get disease from those who will not. It is the basis for the most widely used metric for new screening tests: the c-statistic or area under the receiver-operating-characteristic curve (AUC).12 The AUC incorporates two measures of the accuracy of a screening or diagnostic test, its sensitivity (ability to detect disease when it is present, e.g. true positive rate) and its specificity (ability to exclude disease when it is absent, e.g. true negative rate). Values for the AUC or c-statistic range from 0.5 (uninformative model) to 1.0 (perfect discrimination). In Framingham data, a model for coronary heart disease with age and sex alone has a c-statistic of approximately 0.68.13 The Framingham risk score, which is based on traditional cardiovascular risk factors, yields a c-statistic of approximately 0.75.14 Thus, one approach to evaluating new cardiovascular biomarkers is to assess whether they raise the c-statistic above what is obtainable with the Framingham risk score alone.
Although sensitivity and specificity are traditionally regarded as “intrinsic” attributes of a test, it is well known that estimates of sensitivity and specificity can vary according to the characteristics of the population. This phenomenon, known as “spectrum bias”15 or “spectrum effect,”16 can influence estimates of discrimination. For biomarker studies, spectrum bias is often manifested by divergent estimates of the AUC in high- versus low-risk individuals, or in older versus younger individuals.
Calibration
Another important feature of risk models is their “calibration,” or the agreement between predicted and observed risks across subgroups with varying baseline risk. Predicted risks that are well-calibrated may be particularly useful for clinical management, because treatment decisions often depend on estimates of predicted risk.17 For instance, individuals may not qualify for pharmacologic treatment if their predicted risk of having an event is so low that the cost or side effects of drug therapy are not warranted. However, drug therapy may become more tenable if the predicted risk of events is high. The most commonly reported calibration statistic is the Hosmer-Lemeshow statistic. Models with Hosmer-Lemeshow P-values > 0.05 are considered well-calibrated (non-significant difference between predicted and observed risks).
Calibration can suffer when risk scores are applied to populations different from the one in which the risk score was derived.18 A process known as “recalibration” can be used if the risk score systematically underestimates or overestimates event rates in the new population. This requires access to data on risk factors and outcomes from a cohort that better represents the target population. The relevance of recalibration to clinical guidelines is uncertain, however, because health care providers only have access to the published risk scores and do not have the option of recalibrating risk scores based on patients in their own practice.
Reclassification
A drawback of global measures of calibration such as the Hosmer-Lemeshow statistic is that they give equal weight to all combinations of predicted and observed risk. Most of the difficult treatment decisions apply to individuals in a narrow range of risk (for instance, those who are “intermediate-risk”). Recently, an alternate approach has been proposed to capture the impact of new biomarker tests on clinical decision-making, namely to see if the addition of a new risk marker results in a substantial proportion of individuals being moved (“reclassified”) across a pre-defined treatment threshold.17 The most appropriate setting in which to use reclassification to evaluate risk models is for conditions in which risk strata are clearly defined and closely linked to treatment decisions. For coronary heart disease, risk strata are based on recommendations of the 3rd Adult Treatment Panel (ATP III) of the National Cholesterol Education Program.19 Low-, intermediate-, and high-risk categories are based on having predicted 10-year risks of coronary heart disease < 10%, 10% to <20%, or ≥20%, respectively. It is recommended that individuals in the high-risk category be considered for the same therapies as those with known coronary heart disease, including the use of statins to reduce LDL below 70 mg/dl.
The USPSTF has endorsed reclassification as an important indicator of the clinical value of that test.2,4 The USPSTF recommendations focus specifically on intermediate-risk individuals, based on the premise that high-risk individuals should automatically be targeted for preventive measures (including pharmacologic therapy), whereas low-risk individuals do not need specific intervention. Reclassifying intermediate-risk individuals up (to high-risk) or down (to low-risk) could lead to a clear treatment decision. A similar approach has been advocated by previous consensus conferences.20–22
Table 1 summarizes the strengths and limitations of different criteria for evaluating new biomarkers. As shown, although reclassification is the most clinically intuitive of the criteria, it has limitations as well. Clinical reclassification is most important when the categories correspond to established clinical criteria. Although a predicted risk of 20% in 10 years is the conventional threshold for justifying the use of pharmacologic therapies to achieve very low LDL targets (< 70 mg/dl), this threshold is consensus-based rather than evidence-based. Indeed, one could argue on the basis of recent primary prevention trials that lower thresholds for treatment may be warranted.23 Even when there is agreement about thresholds, not all movements across thresholds lead to clinically-meaningful changes. For instance, movement from low-risk to intermediate-risk, or vice versa, likely results in no change in the treatment decision, and arguably should not be included in the assessment of proportion reclassified.
Table 1.
Metric(s) | Attribute | Description | Advantages | Limitations |
---|---|---|---|---|
Odds ratio (OR), hazards ratio (HR) | Association | Basic measure of strength of statistical association between marker and outcome |
|
|
Likelihood ratio (LR) test, Bayes information criterion (BIC) | Model fit | Assesses improvement in model fit from addition of new variable(s) |
|
|
c-statistic, area under the receiver-operative- characteristic curve (AUC) | Discrimination | Captures the sensitivity and specificity of a marker, across the full range of cutpoints |
|
|
Hosmer-Lemeshow statistic | Calibration | Assesses concordance between predicted and observed event rates in longitudinal data |
|
|
Proportion reclassified | Reclassification | Assesses the proportion of individuals moved between risk categories by addition of new biomarker(s) |
|
|
Net reclassification improvement | Reclassification | Assesses the proportion of individuals reclassified correctly by the addition of new biomarker(s) |
|
|
For references, see text, as well as prior reviews on this topic.10,17,25 The list contains the metrics used most commonly in the biomarker literature. Other metrics that have been described for risk models include the integrated discrimination improvement25 and the reclassification calibration statistic.24
Furthermore, simply quantifying the proportion of individuals reclassified across a given threshold ignores whether that reclassification was correct. One could reclassify 100% of intermediate-risk individuals by using a coin flip to determine who is reclassified up versus down, but such a strategy would yield no net benefit (or could be detrimental). Accordingly, several authors have emphasized the importance of characterizing the accuracy of reclassification, either by comparing observed rates to predicted strata or using more formal measures.17,24,25 As an example of the latter, Pencina and colleagues have proposed a statistic called the net reclassification improvement (NRI).25 The NRI is calculated by splitting the sample into those who develop events and those who do not. In the event group, those who are up-classified by a new biomarker are considered correctly reclassified, whereas those who are down-classified are considered incorrectly reclassified. A similar tally is made for the non-event group. The net number of correct reclassifications (correct minus incorrect, in both groups) yields the NRI. A coin flip would have an NRI of 0% (on average), because it would lead to an equal number of correct and incorrect reclassifications.
The subsequent sections examine the predictive utility of circulating, imaging, and genetic biomarkers for cardiovascular disease. Because the value of biomarker screening is ultimately determined by whether addition of these tests alters patient outcomes, the article concludes with discussion of biomarker-guided therapies and cost-effectiveness.
ARE CIRCULATING BIOMARKERS USEFUL FOR RISK PREDICTION?
Numerous circulating biomarkers have been related to cardiovascular risk.3,4 These biomarkers represent a variety of pathophysiologic pathways that promote atherogenesis or cardiac dysfunction, including inflammation (such as CRP, IL-6, lipoprotein-associated phospholipase A2 [LpPLA2]),26–29 oxidative stress (oxidized LDL, nitrotyrosine),30,31 lipid metabolism (lipoprotein(a)),32 thrombosis (plasminogen-activator-inhibitor-1, D-dimer),13,33 endothelial dysfunction (homocysteine, urinary microalbuminuria),34,35 hemodynamic stress (natriuretic peptides),36 and cardiomyocyte injury (cardiac troponins).37 The best evidence for the majority of these biomarkers is their association with future events. Data addressing how these biomarkers perform in terms of discrimination, calibration, or reclassification are far more limited.
The evidence for CRP
The biomarker for which the largest body of data exists is CRP, an acute-phase reactant of hepatic origin. In 1997, Ridker and colleagues reported the results of a nested case-control study showing that baseline CRP concentrations were strongly associated with future myocardial infarction.26 Since then, multiple epidemiologic reports have been published, all generally supporting an association between CRP concentrations and future cardiovascular risk, although estimates of effect vary.38 A meta-analysis of 22 studies was recently performed by the USPSTF, and showed that CRP concentrations of 3.0 mg/dL or greater were associated with roughly 60% excess risk of incident coronary heart disease (risk ratio 1.60, 95% confidence interval, 1.43 to 1.78).39 Findings were similar when the meta-analysis was restricted to the 10 cohort studies judged to be “good quality” using pre-defined criteria.
Despite the robust statisticial association between CRP and cardiovascular events, evidence from multiple studies indicates that CRP measurements provide only modest improvements in predictive accuracy.40–42 The addition of CRP raises the c-statistic by 0.0 to 0.02 compared with standard risk models, signifying little change in discrimination. Similarly, studies have found either modest43 or absent41,42 improvements in model calibration with the addition of CRP.
The value of CRP with regard to reclassification is uncertain. In the Women’s Health Study, addition of CRP to standard risk models reclassified 20% of intermediate-risk individuals (baseline 10-year predicted risk 6–20%).43 Nearly three-quarters of these individuals were reclassified downwards to low-risk. Thus, only 4% of the intermediate-risk group (less than 0.5% of the overall sample) were reclassified from intermediate-risk to high-risk, the transition most likely to influence management in individuals not already on treatment. Similar results were noted in the Swedish Malmo Diet and Cancer Study using a biomarker score that included CRP.42 Overall, 16% of intermediate-risk participants were reclassified, with three-quarters (13% of the intermediate-risk group) reclassified downwards. Thus, the proportion of intermediate-risk individuals reclassified upwards was only 3%.
The accuracy of reclassification with CRP has been assessed in several studies using the NRI. In the Women’s Health Study, the NRI was of modest magnitude (5.7%).43 In the Framingham Offspring Study, the NRI was 10.9% for coronary heart disease and 5.6% for overall cardiovascular disease.44 On the other hand, the investigators from the Malmo Diet and Cancer Study found the NRI for CRP to be non-significant for both endpoints (NRI < 2%).42
Although it is widely accepted that vascular inflammation plays a role in atherogenesis, there is little evidence that CRP specifically contributes to this process.45 Transgenic animals with overexpression of CRP do not exhibit increased atherosclerosis.46–50 Furthermore, recent population genetic studies utilizing the “Mendelian Randomization” concept have failed to support a direct effect of CRP on cardiovascular risk.51,52 Nonetheless, it is important to emphasize that causality is not a requirement for measuring a biomarker, provided the biomarker adds predictive information that aids clinical management.
Biomarkers not linked to inflammation: the example of BNP
Whereas elevations in CRP may reflect pathogenic processes (inflammation) that give rise to cardiovascular disease, other biomarkers may arise as a consequence of cardiovascular injury or stress.53 One example is B-type natriuretic peptide (BNP), which has been recognized as a sensitive marker of acute heart failure, but only recently appreciated as a predictor of future cardiovascular disease. BNP is a member of a family of peptide hormones, the natriuretic peptides, which have vasodilatory, natriuretic, and anti-hypertrophic properties. BNP is synthesized predominantly by cardiac tissue. Stretch of cardiac myocytes leads to rapid activation of the BNP gene,54 and translation of the gene transcript for BNP produces pre-pro BNP, which is then cleaved to form the 108 amino acid peptide precursor, pro-BNP. Pro-BNP is cleaved into the biologically inactive N-terminal-proBNP (Nt-proBNP) and the biologically active c-terminal fragment (mature BNP).
Circulating Nt-proBNP and BNP are particularly elevated in individuals with established cardiovascular disease. Concentrations in apparently healthy individuals are much lower, but it is now known that variation in BNP within the “normal range” can still have significant prognostic value. In an investigation from the Framingham Offspring Study, BNP levels greater than 20 pg/ml were associated with 60% to 200% increased risks of future cardiovascular events, stroke, heart failure, and all-cause mortality.36 Similar findings have been observed in other prospective cohorts.37,42,55,56 A recent meta-analysis of 40 cohort studies that measured BNP or Nt-proBNP found a summary relative risk of 2.82 (95% confidence interval, 2.40 to 2.33) for incident cardiovascular disease, in those with BNP levels in the top versus bottom tertile.57 Interestingly, BNP (or Nt-proBNP) concentrations predict future coronary disease nearly as well as they do future heart failure.42,57 It is unclear whether this represents low grade increases in cardiac wall stress secondary to subclinical ischemia, or a direct effect of ischemia or vascular disease on natriuretic peptide release.
The predictive accuracy of BNP or Nt-proBNP has been examined in only a few studies, some of which are restricted to high-risk subjects. In the HOPE study, which included predominantly individuals with prior vascular disease, addition of Nt-proBNP to risk models improved discrimination, raising the c-statistic from 0.65 (with traditional risk factors) to 0.69 (with traditional risk factors plus Nt-proBNP).58 In the Heart and Soul study, a secondary prevention cohort, Nt-proBNP raised the c-statistic from 0.73 to 0.80.59 However, in 3 primary prevention cohorts, the addition of Nt-proBNP to cardiovascular risk models led to smaller changes in the c-statistic (ranging from 0.01 to 0.03).37,42,56 In 2 of these studies, reclassification was assessed using the NRI, and found not to be significant for cardiovascular events42 or cardiovascular mortality.37 Spectrum bias could be one explanation for the discrepant findings with Nt-proBNP between high-risk populations and low-risk populations.
Interestingly, in studies that have compared BNP (or Nt-proBNP) with CRP “head-to-head,” BNP has demonstrated consistently stronger associations with vascular events. For instance, in the HOPE study, Nt-proBNP but not CRP was retained in stepwise selection models testing multiple biomarkers, and only Nt-proBNP raised the c-statistic significantly.58 A similar pattern has been observed in primary prevention studies, where BNP (or Nt-proBNP) has outperformed CRP in the prediction of cardiovascular events, coronary events, and cardiovascular mortality.36,37,42,55
Other biomarkers
As noted above, a wide range of other circulating biomarkers has been studied for their ability to predict risk of future cardiovascular events. One of the biomarkers that has generated recent interest is LpPLA2. This enzyme is expressed by inflammatory cells and is carried in the circulation bound to LDL. The action of LpPLA2 on membrane phospholipids leads to the production of pro-inflammatory factors. A recent meta-analysis of 32 prospective studies showed a linear relation between LpPLA2 activity and mass and vascular risk, in individuals with and without baseline cardiovascular disease.60 However, there are few data with regard to the ability of LpPLA2 to improve risk discrimination, calibration, or classification.61
Another inflammatory biomarker that has shown robust associations with cardiovascular risk is IL-6.62,63 Il-6 is a pro-inflammatory cytokine that is responsible for activating downstream molecules including CRP. Notably, the association of IL-6 with future events is not significantly attenuated by adjustment for CRP or fibrinogen.63 As with LpPLA2, there are few data on the ability of IL-6 to improve risk prediction using current metrics.
Interest in the novel lipid biomarker lipoprotein (a) has also increased recently, in part due to Mendelian randomization data suggesting a causal role for this lipoprotein in coronary heart disease.64 Although the majority of observational studies that have assessed the relation of liprotein (a) with cardiovascular events have found a significant association, it is unknown whether measurement of this biomarker improves discrimination, calibration, or classification.32
In summary, existing circulating biomarkers lead to relatively modest enhancements in risk prediction. Where present, the evidence for benefit is restricted largely to their ability to reclassify a proportion of individuals to a higher or lower risk category, rather than any demonstrable effect on discrimination or calibration. Whether these reclassifications are valuable for guiding treatment is discussed in greater detail below.
ARE GENETIC BIOMARKERS USEFUL FOR RISK PREDICTION?
The sequencing of the human genome has fueled an explosion of knowledge regarding the genetic underpinnings of complex diseases such as cardiovascular disease. An active area of discovery has been the identification of common genetic variants (e.g. present in more than a few individuals per 100) that have been reproducibly related to myocardial infarction in large genome wide association (GWA) studies. More than 10 validated genetic variants have been reported to date, and the number continues to grow.65–69
Genetic risk markers are present at birth, and thus can be ascertained well before an individual has developed conventional risk factors for cardiovascular disease (primordial prevention). This possibility brings a new dimension to the potential applications of risk prediction in large populations. Nonetheless, the considerations that are important for assessing circulating biomarkers also apply to genetic markers. Despite the strong, statistically significant associations between genetic variants and myocardial infarction risk, effect sizes are typically small, ranging from 10% to 30% increased risk per copy of the risk allele. These effects would be expected to translate into modest improvements, if any, in risk discrimination or calibration. This impression is supported by an analysis from the Women’s Health Study cohort, examining SNPs at chromosome 9p21 and the risk of cardiovascular disease in 22,129 women.70 Common variants at 9p21 exhibit the strongest and most reproducible associations with cardiovascular disease in GWA studies.65,66,69 However, the addition of 9p21 variants to a conventional risk factor model in the Women’s Health Study did not change the c-statistic or improve calibration. Only 2.7% of women were reclassified, and the NRI was modest (2.7%).
There are ongoing efforts to achieve better performance by combining information from multiple genetic markers (see section on Multiple Biomarkers).71 Nonetheless, the strongest common variant signals have probably already been identified by existing GWA studies. Relative risks per allele for the most recently discovered variants are only about 1.1, in constrast to 1.25–1.30 for variants at chromosome 9p21. Accordingly, while the number of genetic markers is increasing, the incremental gain from each of the markers is decreasing. Alternate approaches exist, such as testing for less common or rare genetic variants that may harbor stronger associations. The relevance of such approaches for widespread screening is uncertain at best, however.
ARE IMAGING BIOMARKERS USEFUL FOR RISK PREDICTION?
Radiologic advances have opened the possibility that non-invasive vascular imaging could be performed in broad populations to identify asymptomatic individuals at particularly high risk for cardiovascular events. In contrast to some circulating biomarkers and all genetic biomarkers, these imaging tests detect existing disease, typically signs of atherosclerosis (see Figure 1). This might have the advantage of improved predictive accuracy, particularly in the short- to medium-term, because individuals with subclinical disease may be closer to having overt clinical events, compared with those who simply have a predisposition for disease. On the other hand, it might be preferable to implement preventive measures prior to the development of even subclinical disease. Furthermore, some atherosclerotic plaques are below the detection limits of current imaging modalities, and the likelihood of plaque rupture is not necessarily correlated with the size of the plaque or likelihood of being detected by imaging tests. The most widely studied imaging tests of subclinical atherosclerosis are coronary calcium scanning and carotid ultrasound. Other modalities such as magnetic resonance imaging may have future promise, but are currently impractical for consideration of widespread testing.
Coronary calcium scores
Coronary calcium may be detected by electron beam computed tomography (EBCT) or multi-detector computed tomography (MDCT). MDCT is a newer technology with high resolution and slighly more radiation exposure, whereas EBCT has the largest body of existing evidence. Both may be used to compute coronary calcium scores (typically, using the method of Agastston72). CT angiography is another non-invasive test based on this technology, but of less direct relevance to screening given the use of intravenous contrast dye.
A number of observational studies have documented strong associations between coronary calcium scores and the risk of incident cardiovascular events. Several comprehensive reviews of this literature have been published.4,73–75 Although many of the earlier studies were based on individuals referred for EBCT or MDCT, and thus susceptible to referral bias, later studies examined largely unselected samples76–78 or population cohorts.79–82 Most reports indicate a relative risk of coronary events of ≥2 for those with any coronary calcium, compared with those with no coronary calcium, and a relative risk >4 for those with coronary calcium scores >100.74,75
The available evidence also suggests that coronary calcium scores may improve risk discrimination. In 6,698 individuals enrolled in the Multi-ethnic Study of Atherosclerosis (MESA), coronary calcium scores were strong predictors of cardiovascular and coronary events, and improved the c-statistic from 0.77 (with traditional risk factors) to 0.81 (traditional risk factors plus coronary calcium score).83 Similarly, in 2,028 asymptomatic individuals in the Rotterdam Study, coronary calcium scores raised the c-statistic for coronary events from 0.72 to 0.76.81
There is also increasing evidence that coronary calcium scores improve risk classification, particularly for intermediate-risk individuals. In MESA, calcium scores reclassified 54% of intermediate-risk individuals, including 16% who were up-classified to high risk.80 The overall NRI was 25%, with an approximately equal proportion of correct up-reclassifications and correct down-reclassifications in the intermediate-risk group. In the Rotterdam Study, 52% of intermediate-risk individuals were reclassified, 22% as high risk, and the overall NRI was 14%.81 Similar findings were obtained from another large, population-based cohort, the Heinz Nixdorf Recall Study, with more than 60% of intermediate-risk individuals reclassified, 27% as high risk.82 The NRI in that study was 22%.
In contrast to other screening biomarkers under consideration, there is the potential for harm from coronary calcium scanning, related to the use of ionizing radiation. With current technologies, the magnitude of radiation exposure is relatively small and decreasing. The radiation from a single coronary calcium scan is approximately equal to the environmental radiation that the average person experiences in one year. Nonetheless, because the adverse effects of radiation exposure are cumulative, expanded use of coronary calcium scanning for screening large populations could have public health consequences that would have to be weighed against the benefits of cardiovascular prevention.84
Carotid Intima-Media Thickness
Another established technology for assessing subclinical atherosclerosis is carotid ultrasound. Clinical studies have focused in particular on carotid intima-media thickness (IMT), the combined thickness of the intimal and medial layers of the carotid artery, which is typically measured at the far wall of the common or internal carotid arteries. Because elevated IMT probably predates atherosclerotic plaque, it can be viewed as an earlier biomarker of subclinical atherosclerosis than coronary calcium.85
Multiple epidemiologic studies have examined the association of carotid IMT with cardiovascular risk (reviewed in 86). Although estimates of effect vary widely, most studies with adequate adjustment for traditional risk factors do suggest an independent association between carotid IMT and cardiovascular events. A meta-analysis of 8 large, prospective studies found that each 0.1 mm increment in carotid IMT was associated with a 10% to 15% increase in the risk of myocardial infarction.87 However, there are few data showing that carotid IMT improves measures of predictive performance. Folsom and colleagues found that carotid IMT led to a minimal increase in the c-statistic for predicting cardiovascular or coronary events in the MESA cohort.83 Whether carotid IMT improves calibration or reclassification is not known.
Presently, the use of carotid IMT is restricted to research settings. It is one of the most commonly ascertained non-invasive measures in cardiovascular epidemiology studies. It has also gained popularity as a surrogate endpoint in randomized trials of new cardiovascular therapies.88,89 Nonetheless, even if clinical studies eventually support the use of IMT for screening selected populations, it is important to recognize that most research studies utilize experienced testing sites and centralized reading centers. It is unclear whether techniques for measuring carotid IMT could be sufficiently standardized between laboratories to allow for widespread clinical screening, particularly when one considers that sub-millimeter differences in IMT separate low-risk and high-risk groups.
Tests of vascular function
Alterations in vascular function may precede anatomic evidence of atherosclerosis, suggesting non-invasive measures of vascular function as potential early biomarkers of disease. One newer tool, vascular tonometry, assesses pathophysiological changes in arterial walls, by providing measures of arterial wall compliance at different sites. Reduced compliance in large arteries reflects structural remodeling in response to elevated pressure, aging, or disease. In smaller arteries, changes in compliance reflect altered vascular smooth muscle function. Aortic pulse wave velocity (PWV) is the best-studied measure of large artery stiffness. A recent meta-analysis of 18 studies showed that high PWV was associated with roughly two-fold risks of cardiovascular events, cardiovascular mortality, and all-cause mortality,90 although there was a tendency toward smaller relative risk estimates in cohorts at low baseline risk. Data from a few studies suggest that PWV may modestly improve discrimination and reclassification.91,92
Another potential biomarker is flow-mediated dilation (FMD) assessed using ultrasound of the brachial artery. Because vasodilation after shear stress is a nitric-oxide dependent-process, FMD provides an index of endothelial function. Reduced FMD is present in individuals with hypertension, hyperlipidemia, and other cardiovascular risk factors. A number of studies have shown that reduced FMD is associated with cardiovascular risk in individuals with varying baseline risk.93–100 Nonetheless, its predictive value in relatively low-risk individuals remains to be established. In a recent report from MESA, FMD did not improve the c-statistic and inappropriately reclassified 23% of individuals who experienced events.98 Furthermore, brachial ultrasound requires significant expertise, and is currently only performed in research settings, making it impractical for use as a screening tool.
Although not technically an imaging test, the ankle-brachial index (ABI) is a simple, non-invasive measure that provides information regarding the presence of peripheral arterial disease. An abnormal ABI could serve as a biomarker of overall cardiovascular risk, because individuals with peripheral arterial disease typically have atherosclerosis in other arterial beds as well. Indeed, meta-analysis of 16 cohort studies showed that an ABI ≤ 0.90 was associated with an approximate doubling of the risk of cardiovascular mortality and major coronary events, even after adjustment for Framingham risk score.101 This meta-analysis suggested that 4% of intermediate-risk men, and 10% of intermediate-risk women could be reclassified by adding ABI to the Framingham risk score. The majority of reclassification in men was from a higher to a lower category, whereas the opposite was true in women, perhaps attributable in part to the far higher proportion of women in lower risk categories in these studies (another example of spectrum bias).
In summary, there are accumulating data on a variety of imaging biomarkers of cardiovascular disease. Thus far, the strongest associations with events have been observed for coronary calcium scores,83 perhaps because coronary calcification reflects more established atherosclerosis, derives from the coronary vasculature, and can be measured reproducibly. The available data also suggest that coronary calcium scores improve risk discrimination and reclassify a proportion of intermediate-risk individuals. Nonetheless, the clinical implications of elevated calcium scores and the risks associated with widespread use of coronary calcium scanning have not been fully elucidated.
WHAT IS THE UTILITY OF COMBINING MULTIPLE BIOMARKERS?
The relatively modest performance of individual biomarkers for risk prediction raises the question whether multiple biomarkers could be combined to improve performance. The “multimarker approach” has been tested in several studies, primarily using circulating biomarkers. There are fewer data incorporating imaging into multimarker algorithms, and also little data regarding the use of circulating, genetic, and/or imaging biomarkers in combination.
Existing evidence
An investigation from the Framingham Heart Study examined 10 biomarkers (9 circulating and 1 urinary) for cardiovascular risk prediction in approximately 3,000 individuals.13 The 2 biomarkers most strongly associated with cardiovascular events were BNP and urinary albumin to creatinine ratio (UACR). The addition of the multiple biomarkers, either BNP and UACR alone or all 10 biomarkers, to traditional risk factors raised the c-statistic by only 0.01. The use of a “multimarker score” in intermediate-risk individuals (defined as a 10-year predicted risk of 6–20%) led to the reclassification of fewer than 3% as high-risk.102 Similar findings were obtained in an analysis of data from the Malmo Diet and Cancer Study.42 In nearly 5,000 individuals, 6 biomarkers were assessed (CRP, BNP, mid-regional proANP, mid-regional pro-adrenomedullin, LpPLA2, and cystatin C). The most predictive biomarkers were BNP and mid-regional pro-adrenomedullin for coronary events, and BNP and CRP for total cardiovascular events (myocardial infarction and stroke). Multimarker scores raised the c-statistic by approximately 0.01. For total cardiovascular events, a total of 7.5% were reclassified by the use of multiple biomarkers together. However, these reclassifications did not improve accuracy (NRI =0%, p=0.99). Among intermediate-risk participants, 16% were reclassified, with 13% down-classified (to low-risk) and only 3% up-classified (to high-risk). Thus, while the NRI in intermediate-risk participants was 7.4%, this result was driven entirely by the down-classification of individuals who did not utimately have events.
A study from another Swedish cohort, the Uppsala Longitudinal Study of Aging Men, reported better results with a multimarker score that included BNP, high-sensitivity troponin I, CRP, and cystatin C.37 In this study, the use of multiple biomarkers improved both discrimination (increase in c-statistic of 0.10) and reclassification (NRI, 26%). However, the study cohort included individuals with prior cardiovascular disease, was restricted to men 75 years of age, and used all-cause mortality as the endpoint. Not surprisingly, traditional risk factors performed relatively poorly in this sample, with a c-statistic of only 0.66 in the base model, allowing greater opportunity for biomarkers to add information. Thus, it is difficult to generalize the findings from this study to broader populations.
Recently, the international MORGAM consortium examined a multimarker panel comprising a similar set of biomarkers (BNP, high-sensitivity troponin I, and CRP).103 They assessed the multimarker score in the Belfast Prospective Epidemiological Study of Myocardial Infarction, finding that it improved the c-statsitic from 0.67 to 0.69, and led to accurate reclassification (NRI, 11%). As with the Uppsala cohort, however, the Belfast study sample was all male and had a restricted age range (50 to 59 years), likely causing an overestimate of biomarker performance relative to traditional risk factors.104,105
The use of imaging in combination with biomarkers was examined in a report from the Cardiovascular Health Study investigators.106 Carotid IMT and plaque by ultrasound and CRP were assessed in approximately 5,020 elderly individuals (mean age 73 years). Interestingly, an elevated CRP predicted cardiovascular events only in individuals with carotid plaque, whereas carotid plaque predicted events irrespective of baseline CRP. The c-statistic was raised by approximately 0.02 with the addition of carotid measures to traditional risk factors, and by less than 0.01 with the addition of CRP. Reclassification was not assessed.
The hypothesis that combining multiple genetic markers can improve risk prediction was tested by investigators from the Malmo Diet and Cancer study.71 A score comprising 9 lipid-associated SNPs was incorporated into risk models, and proved to be significant predictor of cardiovascular events even after adjusting for measured lipid levels. This score did not improve the c-statistic, but was associated with a moderate improvement in classification accuracy (NRI, 6.2%).
Future prospects: how many markers would it take?
Thus, studies that have examined the use of up to 10 biomarkers simultaneously suggest, at best, modest improvements in risk prediction. This observation is a testament to the value of traditional risk factors, as much as it is an indication of the difficulty of predicting future events that are multifactorial in origin and inherently stochastic. Consequently, is it realistic to expect that any set of biomarkers (circulating, imaging, or genetic) can substantially improve risk prediction above and beyond traditional risk scores?
One way to consider this question is shown in Figure 2. The figure depicts the results of a simulation based on adding 1 to 100 hypothetical biomarkers to a traditional risk model (personal communication: M. Pencina, Boston University). Each of the hypothetical biomarkers has a similar magnitude of association with cardiovascular events (the outcome) as a marker such as CRP or BNP. The increment in c-statistic is shown, from a baseline of 0.75 (the approximate value with traditional risk factors alone) to the value with risk factors and biomarkers combined. A key determinant of improvement in the c-statistic is the degree of correlation between biomarkers. With a set of biomarkers that has an average marker-marker correlation of r=0.4 (moderately correlated), more than 50 biomarkers are needed before the c-statistic is increased by 0.05. In contrast, when the average marker-marker correlation is r=0.05 (weakly correlated), fewer than 10 biomarkers are needed to raise the c-statistic by 0.05.
Thus, it is theoretically possible to improve the performance of risk models with a relatively small number of biomarkers, provided the biomarkers are weakly correlated or uncorrelated with each other. This concept is intuitive, but suggests a dilemma. Studies tend to focus on biomarkers derived from the pathways implicated in atherogenesis, such as inflammation or thrombosis. This pathway-based approach is valuable for elucidating biology, but paradoxically, it may be limited when it comes to identifying clinically-useful biomarkers. When a biomarker of a known pathway is already being measured, more biomarkers from that pathway are not likely to yield substantial gains. For instance, because CRP is easy to measure and widely available, there is comparatively little value to characterizing a large number of other cytokines or inflammatory markers, at least for the purpose of risk prediction.
Where does one find “uncorrelated” biomarkers, outside of already-characterized pathways? The opposite of a pathway-based approach is an “unbiased” approach, in which global panels of biomarkers are compared in individuals with and without disease. Such analyses are now possible with newer technologies that are capable of systematically profiling hundreds, or thousands, of molecules in a biological specimen. The application of such technologies (proteomics, metabolomics, expression profiling) for biomarker discovery has been reviewed in more detail elsewhere.107 Studies in this area are still hampered by problems such as multiple testing, confounding, and over-fitting. As a result, there can be a fine line between an “unbiased” biomarker study and a “fishing expedition.” That said, similar issues affected early studies in population genetics. As large-scale, collaborative approaches extend from genetics to other types of biomarker studies, the possiblity of robust and clinically-useful biomarker discoveries is enhanced.
CLINICAL IMPLICATIONS
Effectiveness of biomarker-guided therapies
Ultimately, the most important question for assessing new biomarkers is whether they lead to changes in patient management and improvements in outcome. The gold standard for establishing the effectiveness of biomarker-guided strategies is randomized trials. However, there are few examples of such trials in cardiology, particularly in the primary prevention setting. There are several possibilities for the design of biomarker trials, as depicted in Figures 3A and 3B, and reviewed previously.108–110 In one design, all subjects have measurement of a biomarker, and both biomarker subgroups (those with a “positive” result and those with a “negative” result) undergo randomization to treatment A or treatment B (or placebo) (Figure 3A). If treatment A is an effective therapy, this design permits a test of whether the biomarker stratification identifies those who are more likely to benefit from the therapy (e.g. biomarker-by-treatment interaction). The “negative” biomarker arm is necessary because it is possible that treatment A is effective (e.g. better than treatment B) in both biomarker groups, something that can only be determined by including both groups. This scenario can occur either in the absence of a biomarker-by-treatment interaction (e.g. treatment A is equally effective in both “positive” and “negative” biomarker groups), or in the presence of a biomarker-by-treatment interaction (e.g. treatment A is more effective in the “positive” biomarker group, but still better than treatment B in everyone). Thus, even in the presence of a biomarker-by-treatment interaction, measurement of the biomarker may not be necessary to guide therapy. Although the comparison shown in Figure 3A can be performed post-hoc, by randomizing all subjects and measuring the biomarker later,109 implementing it prospectively ensures balanced treatment within marker groups and reduces the risk of false positives inherent in subgroup analyses.
The study design outlined above is an indirect test of biomarker-guided strategies because it does not actually provide a measure of how often patient management would change or patient outcomes would improve. Also, because the biomarker test is performed in everyone, knowledge of the biomarker result could impact other management decisions or other outcomes of interest.108 A more direct assessment is shown in Figure 3B, and incorporates an earlier step of randomization to biomarker measurement versus no biomarker measurement. This design is frequently used in oncology trials.109
Example: the JUPITER trial
In cardiology, there has been only one large-scale randomized trial involving biomarker-directed therapy in primary prevention, the JUPITER trial. JUPITER enrolled middle-aged to elderly individuals treated with rosuvastatin who had baseline LDL < 130 mg/dl and CRP > 2 mg/dl.2 The incidence of cardiovascular events was reduced 44% by treatment with rosuvastatin compared with placebo.
Although JUPITER was an important trial, it is apparent that it fits neither of the study designs depicted in Figures 3A and 3B. Because there was no randomization to biomarker measurement, JUPITER is closest to the “indirect” approach shown in Figure 3A. However, a key difference is that there was no “negative” or low biomarker subgroup in JUPITER, making it impossible to exclude the possibility that rosuvastatin therapy is beneficial for all older individuals, regardless of baseline CRP. Accordingly, JUPITER cannot be considered either a “biomarker trial” or “CRP trial,” because the utility of CRP screening was not specifically evaluated.
Based on the JUPITER results, can we conclude that CRP screening is either necessary or sufficient to determine which individuals will benefit from statin therapy in primary prevention? Two observations suggest that an elevated CRP is not a necessary criterion. First, based on traditional risk factors alone, the average participant in JUPITER was at intermediate risk, with an average Framingham risk score of 11.6%.111 The mean LDL level was approximately 100 mg/dl. Meta-analyses of data from prior statin trials by the Cholesterol Treatment Trialists suggest that the benefit of statins extends to those with baseline LDLs as low as 80 mg/dl.112 Thus, the results of JUPITER may have been predictable on the basis on prior trials that did not include CRP testing as an entry criterion. Second, in one of the pre-specified subgroup analyses in JUPITER, the efficacy of rosuvastatin was examined separately in those above and below the median CRP level (4.2 mg/L).111,113 Surprisingly, those with higher CRP levels (> 4.2 mg/L) had a lower relative risk reduction from rosuvastatin therapy than those with lower CRP levels (relative risk reduction 29% versus 58% in those with higher versus lower CRP levels, respectively, p for interaction = 0.015). In epidemiologic studies, the relationship between CRP and cardiovascular risk is linear, with no evidence of a threshold at levels observed in the general population. Thus, even though JUPITER excluded those with below-average CRP levels, the absence of a positive treatment-by-biomarker interaction over the range of levels studied suggests that elevated CRP was not an important determinant of relative benefit from rosuvastatin.
There is also no evidence that an elevated CRP is sufficient to identify candidates for statin therapy. In JUPITER, there was no evidence of benefit from rosuvastatin in individuals who met the age and CRP criteria but had no other traditional cardiovascular risk factors.111 For these participants, the relative risk with rosuvastatin was 0.91 (95% confidence interval, 0.56–1.46). Although post-hoc analyses should be interpreted cautiously, the results are consistent with the large body of evidence that underscores the importance of global risk stratification with assessment of traditional risk factors.
More general implications from JUPITER
Do the JUPITER results have any implications for screening with cardiovascular biomarkers in general? The relative risk reduction with rosuvastatin was remarkably consistent across subgroups, except for those at very low-risk as noted above.23 Thus, for most statin candidates, the total number of events prevented is primarily a function of the baseline absolute risk. Accordingly, the number of events prevented in low-risk individuals may not be high enough to warrant the costs or toxicity of therapy, including the potential risk of diabetes, one of the adverse safety signals in JUPITER and other statin trials.114 Even if we assume that true relative risk reductions were constant in all risk groups (44% as in the entire trial), nearly 100 low-risk individuals with a 10-year risk of cardiovascular events of 5% would need to be treated for 5 years to prevent one event. On the other hand, fewer than 25 high-risk individuals (10-year risk 20%) would need to be treated for 5 years to prevent an event. Thus, reclassifying individuals as low- or high-risk could have immediate clinical relevance with regard to identifying candidates for statin therapy, from the standpoint of absolute risk reduction. This is illustrated by the results of a recent post hoc analysis of the JUPITER data, which showed that individuals with higher CRP levels had greater absolute benefit from rosuvastatin (due to their higher baseline risk), even though the relative risk reductions were somewhat lower.115 Thus, by demonstrating the efficacy of statin treatment across a broad range of LDL and risk factor levels, the JUPITER results highlight the value of any test that allows refinement of absolute risk estimation.
Cost-effectiveness
Even if randomized trial data support the clinical effectiveness of a biomarker-guided strategy, it must be determined whether such a strategy can be implemented at a reasonable cost. One of the questions raised after the JUPITER trial was whether the modest reductions in the absolute risk of cardiovascular events justify the costs of widespread CRP testing combined with statin therapy.116 Furthermore, other “costs” should be considered, including the potential harm from long-term statin use, including the risk of diabetes, which might not be fully captured in short-term trials.23,117 Serious consideration of any preventive strategy should include a detailed cost-benefit analysis that integrates multiple inputs: performance characteristics of the screening test (typically from observational studies), effectiveness of the biomarker-guided therapy (randomized trials), incidence of side effects (trials and post-marketing studies), and financial cost (observational and administrative data). Because it is impractical to perform randomized trials for every potential biomarker,118 the results of such cost-benefit analyses (using a range of assumptions for therapeutic effectiveness) could be used to help prioritize among competing biomarkers.
With any biomarker-guided strategy, expensive and/or high-risk interventions make good risk stratification more valuable, as it is important to avoid exposing low-risk individuals to the therapy. Conversely, with inexpensive and safe therapies, risk stratification becomes less valuable. Indeed, because current preventive therapies such as statins or aspirin are generally regarded as well-tolerated, some have questioned the need for any risk-based screening at all, especially in older adults. “Polypill” strategies have been proposed as an alternative to risk-based screening.119 The Indian Polycap Study (TIPS) showed that a combination pill containing aspirin, simvastatin, ramipril, hydrochlorothiazide, and atenolol was well-tolerated in a relatively unselected, middle-aged to elderly population.120 The long-term outcomes of the polypill approach are presently unknown.121 Even if the polypill is shown to improve outcomes with an acceptable safety profile, risk prediction is likely to remain important for risk communication, motivating adherence and lifestyle modification, and selecting candidates for more aggressive (“personalized”) therapies.121,122
CONCLUSION
The dramatic increase in the number of biomarker and imaging studies in the past decade has heightened the debate over whether such novel tests are ready for routine clinical use. This tension is perhaps most evident in the area of primary prevention, where there is a large opportunity to reduce the burden of cardiovascular disease, but with the costs and potential risks inherent in screening large populations. The scientific, political, and regulatory implications of this debate are further evidenced by recent developments surrounding the dissemination of cardiac imaging and the measurement of CRP for targeting statin therapy.
A number of circulating, genetic, and imaging biomarkers are robustly associated with cardiovascular risk. Nonetheless, the evidence that these biomarkers enhance risk prediction for individuals is surprisingly limited (as summarized in Table 2). Even in combination, most biomarkers (with the possible exception of coronary calcium scores) produce minimal improvements in discrimination and calibration. Although some data suggest that biomarkers can reclassify individuals between risk categories, this benefit is largely confined to those at “intermediate risk” of cardiac events. The value of reclassification for altering clinical management in this group remains largely theoretical, as randomized trials have not been performed specifically evaluating this question.
Table 2.
Biomarker | Adds incremental information to traditional risk factors | Result should affect clinical management | ||||
---|---|---|---|---|---|---|
Association with outcomes | Improves discrimination | Improves calibration | Reclassifies a large proportion | Reclassification is accurate | ||
CRP | Yes | No | +/− | +/− | +/− | Unknown |
BNP | Yes | +/−a | No | +/− | +/− | Unknown |
SNPs at 9p21 | Yes | Nob | Nob | Nob | Nob | Unknown |
CAC score | Yes | Yes | Unknown | Yes | Yes | Unknown |
Carotid IMT | Yes | Nob | Unknown | Unknown | Unknown | Unknown |
Pulse wave velocity | Yes | +/−b | Unknown | +/−b | Yesb | Unknown |
Ankle-brachial index | Yes | +/−c | Unknown | +/−c | Unknown | Unknown |
For references, see text. BNP: B-type natriuretic peptide (or N-terminal pro-BNP). CRP: high-sensitivity C-reactive protein. CAC: coronary artery calcium. IMT: intima-media thickness. Modified from May and Wang,53 with permission.
some evidence in high-risk populations.
based on a small number of studies.
some evidence in women.
Despite the limitations of current cardiovascular biomarkers, it is worth recognizing the tremendous progress in the field that has taken place over the past decade, spanning experimental studies, epidemiologic investigations, and clinical trials. Furthermore, the pace of biomarker discoveries is likely to accelerate in coming years, with the maturation of technologies such as proteomics, metabolomics, and transcriptomics. Such approaches may be particularly useful for identifying biomarkers in different pathways from those represented by existing biomarkers. Coupling these advances with a better understanding of which subsets of the population require further risk stratification and the initiation of randomized trials to test these hypotheses could make biomarker-guided prevention an attainable goal.
Acknowledgments
FUNDING SOURCES
Dr. Wang was supported in part by NIH R01-HL-083197, R01-HL-083875, R01-DK-081572, R01-HL098283, and a grant from the American Heart Association.
The author gratefully acknowledges Dr. Michael Pencina, Boston University, for his permission to include the simulation results shown in Figure 2.
Footnotes
DISCLOSURES
Dr. Wang participates in the scientific advisory board of Diasorin, Inc. He is named as a co-inventor on patent applications for the use of metabolite predictors and copeptin in diabetes prediction, and the use of pro-adrenomedullin in risk stratification. He has been a co-author in prior studies that received support for the measurement of biomarkers from Siemens Diagnostics and Brahms.
References
- 1.Khot UN, Khot MB, Bajzer CT, Sapp SK, Ohman EM, Brener SJ, Ellis SG, Lincoff AM, Topol EJ. Prevalence of conventional risk factors in patients with coronary heart disease. JAMA. 2003;290:898–904. doi: 10.1001/jama.290.7.898. [DOI] [PubMed] [Google Scholar]
- 2.Using nontraditional risk factors in coronary heart disease risk assessment: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med. 2009;151:474–482. doi: 10.7326/0003-4819-151-7-200910060-00008. [DOI] [PubMed] [Google Scholar]
- 3.Vasan RS. Biomarkers of cardiovascular disease: molecular basis and practical considerations. Circulation. 2006;113:2335–2362. doi: 10.1161/CIRCULATIONAHA.104.482570. [DOI] [PubMed] [Google Scholar]
- 4.Helfand M, Buckley DI, Freeman M, Fu R, Rogers K, Fleming C, Humphrey LL. Emerging risk factors for coronary heart disease: a summary of systematic reviews conducted for the U.S. Preventive Services Task Force. Ann Intern Med. 2009;151:496–507. doi: 10.7326/0003-4819-151-7-200910060-00010. [DOI] [PubMed] [Google Scholar]
- 5.Kannel WB, Dawber TR, Kagan A, Revotskie N, Stokes JI. Factors of risk in the development of coronary heart disease-- six year follow-up experience; the Framingham Study. Ann Intern Med. 1961;55:33–50. doi: 10.7326/0003-4819-55-1-33. [DOI] [PubMed] [Google Scholar]
- 6.Greenland P, Knoll MD, Stamler J, Neaton JD, Dyer AR, Garside DB, Wilson PW. Major risk factors as antecedents of fatal and nonfatal coronary heart disease events. JAMA. 2003;290:891–897. doi: 10.1001/jama.290.7.891. [DOI] [PubMed] [Google Scholar]
- 7.Biomarkers and surrogate endpoints: preferred definitions and conceptual framework. Clin Pharmacol Ther. 2001;69:89–95. doi: 10.1067/mcp.2001.113989. [DOI] [PubMed] [Google Scholar]
- 8.Morrow DA, de Lemos JA. Benchmarks for the assessment of novel cardiovascular biomarkers. Circulation. 2007;115:949–952. doi: 10.1161/CIRCULATIONAHA.106.683110. [DOI] [PubMed] [Google Scholar]
- 9.Manolio T. Novel risk markers and clinical practice. N Engl J Med. 2003;349:1587–1589. doi: 10.1056/NEJMp038136. [DOI] [PubMed] [Google Scholar]
- 10.Hlatky MA, Greenland P, Arnett DK, Ballantyne CM, Criqui MH, Elkind MSV, Go AS, Harrell FE, Jr, Hong Y, Howard BV, Howard VJ, Hsue PY, Kramer CM, McConnell JP, Normand S-LT, O’Donnell CJ, Smith SC, Jr, Wilson PWF Diseases obotAHAEPoSA, Factors ER, the Stroke Council. Criteria for Evaluation of Novel Markers of Cardiovascular Risk: A Scientific Statement From the American Heart Association. Circulation. 2009;119:2408–2416. doi: 10.1161/CIRCULATIONAHA.109.192278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Ware JH. The limitations of risk factors as prognostic tools. N Engl J Med. 2006;355:2615–2617. doi: 10.1056/NEJMp068249. [DOI] [PubMed] [Google Scholar]
- 12.Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36. doi: 10.1148/radiology.143.1.7063747. [DOI] [PubMed] [Google Scholar]
- 13.Wang TJ, Gona P, Larson MG, Tofler GH, Levy D, Newton-Cheh C, Jacques PF, Rifai N, Selhub J, Robins SJ, Benjamin EJ, D’Agostino RB, Vasan RS. Multiple biomarkers for the prediction of first major cardiovascular events and death. N Engl J Med. 2006;355:2631–2639. doi: 10.1056/NEJMoa055373. [DOI] [PubMed] [Google Scholar]
- 14.Wilson PW, D’Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB. Prediction of coronary heart disease using risk factor categories. Circulation. 1998;97:1837–1847. doi: 10.1161/01.cir.97.18.1837. [DOI] [PubMed] [Google Scholar]
- 15.Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med. 1978;299:926–930. doi: 10.1056/NEJM197810262991705. [DOI] [PubMed] [Google Scholar]
- 16.Mulherin SA, Miller WC. Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med. 2002;137:598–602. doi: 10.7326/0003-4819-137-7-200210010-00011. [DOI] [PubMed] [Google Scholar]
- 17.Cook NR. Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation. 2007;115:928–935. doi: 10.1161/CIRCULATIONAHA.106.672402. [DOI] [PubMed] [Google Scholar]
- 18.D’Agostino RB, Sr, Grundy S, Sullivan LM, Wilson P. Validation of the Framingham coronary heart disease prediction scores: results of a multiple ethnic groups investigation. JAMA. 2001;286:180–187. doi: 10.1001/jama.286.2.180. [DOI] [PubMed] [Google Scholar]
- 19.Executive Summary of The Third Report of The National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation And Treatment of High Blood Cholesterol In Adults (Adult Treatment Panel III) JAMA. 2001;285:2486–2497. doi: 10.1001/jama.285.19.2486. [DOI] [PubMed] [Google Scholar]
- 20.Greenland P, Abrams J, Aurigemma GP, Bond MG, Clark LT, Criqui MH, Crouse JR, III, Friedman L, Fuster V, Herrington DM, Kuller LH, Ridker PM, Roberts WC, Stanford W, Stone N, Swan HJ, Taubert KA, Wexler L. Prevention Conference V: Beyond secondary prevention: identifying the high-risk patient for primary prevention: noninvasive tests of atherosclerotic burden: Writing Group III. Circulation. 2000;101:E16–E22. doi: 10.1161/01.cir.101.1.e16. [DOI] [PubMed] [Google Scholar]
- 21.Greenland P, Smith JSC, Jr, Grundy SM. Improving coronary heart disease risk assessment in asymptomatic people: role of traditional risk factors and noninvasive cardiovascular tests. Circulation. 2001;104:1863–1867. doi: 10.1161/hc4201.097189. [DOI] [PubMed] [Google Scholar]
- 22.Pearson TA, Mensah GA, Alexander RW, Anderson JL, Cannon RO, III, Criqui M, Fadl YY, Fortmann SP, Hong Y, Myers GL, Rifai N, Smith SC, Jr, Taubert K, Tracy RP, Vinicor F. Markers of inflammation and cardiovascular disease: application to clinical and public health practice: A statement for healthcare professionals from the Centers for Disease Control and Prevention and the American Heart Association. Circulation. 2003;107:499–511. doi: 10.1161/01.cir.0000052939.59093.45. [DOI] [PubMed] [Google Scholar]
- 23.Ridker PM, Danielson E, Fonseca FA, Genest J, Gotto AM, Jr, Kastelein JJ, Koenig W, Libby P, Lorenzatti AJ, MacFadyen JG, Nordestgaard BG, Shepherd J, Willerson JT, Glynn RJ. Rosuvastatin to prevent vascular events in men and women with elevated C-reactive protein. N Engl J Med. 2008;359:2195–2207. doi: 10.1056/NEJMoa0807646. [DOI] [PubMed] [Google Scholar]
- 24.Cook NR, Ridker PM. Advances in measuring the effect of individual predictors of cardiovascular risk: the role of reclassification measures. Ann Intern Med. 2009;150:795–802. doi: 10.7326/0003-4819-150-11-200906020-00007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Pencina MJ, D’Agostino RB, Sr, D’Agostino RB, Jr, Vasan RS. Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–172. doi: 10.1002/sim.2929. [DOI] [PubMed] [Google Scholar]
- 26.Ridker PM, Cushman M, Stampfer MJ, Tracy RP, Hennekens CH. Inflammation, aspirin, and the risk of cardiovascular disease in apparently healthy men. N Engl J Med. 1997;336:973–979. doi: 10.1056/NEJM199704033361401. [DOI] [PubMed] [Google Scholar]
- 27.Ridker PM, Hennekens CH, Buring JE, Rifai N. C-reactive protein and other markers of inflammation in the prediction of cardiovascular disease in women. N Engl J Med. 2000;342:836–843. doi: 10.1056/NEJM200003233421202. [DOI] [PubMed] [Google Scholar]
- 28.Persson M, Hedblad B, Nelson JJ, Berglund G. Elevated Lp-PLA2 levels add prognostic information to the metabolic syndrome on incidence of cardiovascular events among middle-aged nondiabetic subjects. Arterioscler Thromb Vasc Biol. 2007;27:1411–1416. doi: 10.1161/ATVBAHA.107.142679. [DOI] [PubMed] [Google Scholar]
- 29.Koenig W, Khuseyinova N, Lowel H, Trischler G, Meisinger C. Lipoprotein-associated phospholipase A2 adds to risk prediction of incident coronary events by C-reactive protein in apparently healthy middle-aged men from the general population: results from the 14-year follow-up of a large cohort from southern Germany. Circulation. 2004;110:1903–1908. doi: 10.1161/01.CIR.0000143377.53389.C8. [DOI] [PubMed] [Google Scholar]
- 30.Meisinger C, Baumert J, Khuseyinova N, Loewel H, Koenig W. Plasma oxidized low-density lipoprotein, a strong predictor for acute coronary heart disease events in apparently healthy, middle-aged men from the general population. Circulation. 2005;112:651–657. doi: 10.1161/CIRCULATIONAHA.104.529297. [DOI] [PubMed] [Google Scholar]
- 31.Shishehbor MH, Aviles RJ, Brennan ML, Fu X, Goormastic M, Pearce GL, Gokce N, Keaney JF, Jr, Penn MS, Sprecher DL, Vita JA, Hazen SL. Association of nitrotyrosine levels with cardiovascular disease and modulation by statin therapy. JAMA. 2003;289:1675–1680. doi: 10.1001/jama.289.13.1675. [DOI] [PubMed] [Google Scholar]
- 32.Danesh J, Collins R, Peto R. Lipoprotein(a) and coronary heart disease. Meta-analysis of prospective studies. Circulation. 2000;102:1082–1085. doi: 10.1161/01.cir.102.10.1082. [DOI] [PubMed] [Google Scholar]
- 33.Danesh J, Whincup P, Walker M, Lennon L, Thomson A, Appleby P, Rumley A, Lowe GD. Fibrin D-dimer and coronary heart disease: prospective study and meta-analysis. Circulation. 2001;103:2323–2327. doi: 10.1161/01.cir.103.19.2323. [DOI] [PubMed] [Google Scholar]
- 34.Wald DS, Law M, Morris JK. Homocysteine and cardiovascular disease: evidence on causality from a meta-analysis. BMJ. 2002;325:1202. doi: 10.1136/bmj.325.7374.1202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Gerstein HC, Mann JF, Yi Q, Zinman B, Dinneen SF, Hoogwerf B, Halle JP, Young J, Rashkow A, Joyce C, Nawaz S, Yusuf S. Albuminuria and risk of cardiovascular events, death, and heart failure in diabetic and nondiabetic individuals. JAMA: The Journal of the American Medical Association. 2001;286:421–426. doi: 10.1001/jama.286.4.421. [DOI] [PubMed] [Google Scholar]
- 36.Wang TJ, Larson MG, Levy D, Benjamin EJ, Leip EP, Omland T, Wolf PA, Vasan RS. Plasma natriuretic peptide levels and the risk of cardiovascular events and death. N Engl J Med. 2004;350:655–663. doi: 10.1056/NEJMoa031994. [DOI] [PubMed] [Google Scholar]
- 37.Zethelius B, Berglund L, Sundstrom J, Ingelsson E, Basu S, Larsson A, Venge P, Arnlov J. Use of multiple biomarkers to improve the prediction of death from cardiovascular causes. N Engl J Med. 2008;358:2107–2116. doi: 10.1056/NEJMoa0707064. [DOI] [PubMed] [Google Scholar]
- 38.Danesh J, Wheeler JG, Hirschfield GM, Eda S, Eiriksdottir G, Rumley A, Lowe GD, Pepys MB, Gudnason V. C-reactive protein and other circulating markers of inflammation in the prediction of coronary heart disease. N Engl J Med. 2004;350:1387–1397. doi: 10.1056/NEJMoa032804. [DOI] [PubMed] [Google Scholar]
- 39.Buckley DI, Fu R, Freeman M, Rogers K, Helfand M. C-reactive protein as a risk factor for coronary heart disease: a systematic review and meta-analyses for the U.S. Preventive Services Task Force. Ann Intern Med. 2009;151:483–495. doi: 10.7326/0003-4819-151-7-200910060-00009. [DOI] [PubMed] [Google Scholar]
- 40.Lloyd-Jones DM, Liu K, Tian L, Greenland P. Narrative review: Assessment of C-reactive protein in risk prediction for cardiovascular disease. Ann Intern Med. 2006;145:35–42. doi: 10.7326/0003-4819-145-1-200607040-00129. [DOI] [PubMed] [Google Scholar]
- 41.Folsom AR, Chambless LE, Ballantyne CM, Coresh J, Heiss G, Wu KK, Boerwinkle E, Mosley TH, Jr, Sorlie P, Diao G, Sharrett AR. An assessment of incremental coronary risk prediction using C-reactive protein and other novel risk markers: the atherosclerosis risk in communities study. Arch Intern Med. 2006;166:1368–1373. doi: 10.1001/archinte.166.13.1368. [DOI] [PubMed] [Google Scholar]
- 42.Melander O, Newton-Cheh C, Almgren P, Hedblad B, Berglund G, Engstrom G, Persson M, Smith JG, Magnusson M, Christensson A, Struck J, Morgenthaler NG, Bergmann A, Pencina MJ, Wang TJ. Novel and conventional biomarkers for prediction of incident cardiovascular events in the community. JAMA. 2009;302:49–57. doi: 10.1001/jama.2009.943. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Cook NR, Buring JE, Ridker PM. The effect of including C-reactive protein in cardiovascular risk prediction models for women. Ann Intern Med. 2006;145:21–29. doi: 10.7326/0003-4819-145-1-200607040-00128. [DOI] [PubMed] [Google Scholar]
- 44.Wilson PWPM, Jacques P, Selhub J, D’Agostino R, O’Donnell CJ. C-reactive Protein and Reclassification of Cardiovascular Risk in the Framingham Heart Study. Circ Cardiovasc Qual Outcomes. 2008;1:92–97. doi: 10.1161/CIRCOUTCOMES.108.831198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Danesh J, Pepys MB. C-reactive protein and coronary disease: is there a causal link? Circulation. 2009;120:2036–2039. doi: 10.1161/CIRCULATIONAHA.109.907212. [DOI] [PubMed] [Google Scholar]
- 46.Koike T, Kitajima S, Yu Y, Nishijima K, Zhang J, Ozaki Y, Morimoto M, Watanabe T, Bhakdi S, Asada Y, Chen YE, Fan J. Human C-reactive protein does not promote atherosclerosis in transgenic rabbits. Circulation. 2009;120:2088–2094. doi: 10.1161/CIRCULATIONAHA.109.872796. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Hirschfield GM, Gallimore JR, Kahan MC, Hutchinson WL, Sabin CA, Benson GM, Dhillon AP, Tennent GA, Pepys MB. Transgenic human C-reactive protein is not proatherogenic in apolipoprotein E-deficient mice. Proc Natl Acad Sci U S A. 2005;102:8309–8314. doi: 10.1073/pnas.0503202102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Trion A, de Maat MP, Jukema JW, van der Laarse A, Maas MC, Offerman EH, Havekes LM, Szalai AJ, Princen HM, Emeis JJ. No effect of C-reactive protein on early atherosclerosis development in apolipoprotein E*3-leiden/human C-reactive protein transgenic mice. Arterioscler Thromb Vasc Biol. 2005;25:1635–1640. doi: 10.1161/01.ATV.0000171992.36710.1e. [DOI] [PubMed] [Google Scholar]
- 49.Tennent GA, Hutchinson WL, Kahan MC, Hirschfield GM, Gallimore JR, Lewin J, Sabin CA, Dhillon AP, Pepys MB. Transgenic human CRP is not pro-atherogenic, pro-atherothrombotic or pro-inflammatory in apoE−/− mice. Atherosclerosis. 2008;196:248–255. doi: 10.1016/j.atherosclerosis.2007.05.010. [DOI] [PubMed] [Google Scholar]
- 50.Kovacs A, Tornvall P, Nilsson R, Tegner J, Hamsten A, Bjorkegren J. Human C-reactive protein slows atherosclerosis development in a mouse model with human-like hypercholesterolemia. Proc Natl Acad Sci U S A. 2007;104:13768–13773. doi: 10.1073/pnas.0706027104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Elliott P, Chambers JC, Zhang W, Clarke R, Hopewell JC, Peden JF, Erdmann J, Braund P, Engert JC, Bennett D, Coin L, Ashby D, Tzoulaki I, Brown IJ, Mt-Isa S, McCarthy MI, Peltonen L, Freimer NB, Farrall M, Ruokonen A, Hamsten A, Lim N, Froguel P, Waterworth DM, Vollenweider P, Waeber G, Jarvelin MR, Mooser V, Scott J, Hall AS, Schunkert H, Anand SS, Collins R, Samani NJ, Watkins H, Kooner JS. Genetic Loci associated with C-reactive protein levels and risk of coronary heart disease. JAMA. 2009;302:37–48. doi: 10.1001/jama.2009.954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Zacho J, Tybjaerg-Hansen A, Jensen JS, Grande P, Sillesen H, Nordestgaard BG. Genetically elevated C-reactive protein and ischemic vascular disease. N Engl J Med. 2008;359:1897–1908. doi: 10.1056/NEJMoa0707402. [DOI] [PubMed] [Google Scholar]
- 53.May A, Wang TJ. Biomarkers for cardiovascular disease: challenges and future directions. Trends Mol Med. 2008;14:261–267. doi: 10.1016/j.molmed.2008.04.003. [DOI] [PubMed] [Google Scholar]
- 54.Hall C. NT-ProBNP: the mechanism behind the marker. J Card Fail. 2005;11:S81–S83. doi: 10.1016/j.cardfail.2005.04.019. [DOI] [PubMed] [Google Scholar]
- 55.Kistorp C, Raymond I, Pedersen F, Gustafsson F, Faber J, Hildebrandt P. N-terminal pro-brain natriuretic peptide, C-reactive protein, and urinary albumin levels as predictors of mortality and cardiovascular events in older adults. JAMA. 2005;293:1609–1616. doi: 10.1001/jama.293.13.1609. [DOI] [PubMed] [Google Scholar]
- 56.Olsen MH, Hansen TW, Christensen MK, Gustafsson F, Rasmussen S, Wachtell K, Ibsen H, Torp-Pedersen C, Hildebrandt PR. N-terminal pro-brain natriuretic peptide, but not high sensitivity C-reactive protein, improves cardiovascular risk prediction in the general population. Eur Heart J. 2007;28:1374–1381. doi: 10.1093/eurheartj/ehl448. [DOI] [PubMed] [Google Scholar]
- 57.Di Angelantonio E, Chowdhury R, Sarwar N, Ray KK, Gobin R, Saleheen D, Thompson A, Gudnason V, Sattar N, Danesh J. B-type natriuretic peptides and cardiovascular risk: systematic review and meta-analysis of 40 prospective studies. Circulation. 2009;120:2177–2187. doi: 10.1161/CIRCULATIONAHA.109.884866. [DOI] [PubMed] [Google Scholar]
- 58.Blankenberg S, McQueen MJ, Smieja M, Pogue J, Balion C, Lonn E, Rupprecht HJ, Bickel C, Tiret L, Cambien F, Gerstein H, Munzel T, Yusuf S. Comparative impact of multiple biomarkers and N-Terminal pro-brain natriuretic peptide in the context of conventional risk factors for the prediction of recurrent cardiovascular events in the Heart Outcomes Prevention Evaluation (HOPE) Study. Circulation. 2006;114:201–208. doi: 10.1161/CIRCULATIONAHA.105.590927. [DOI] [PubMed] [Google Scholar]
- 59.Bibbins-Domingo K, Gupta R, Na B, Wu AH, Schiller NB, Whooley MA. N-terminal fragment of the prohormone brain-type natriuretic peptide (NT-proBNP), cardiovascular events, and mortality in patients with stable coronary heart disease. JAMA. 2007;297:169–176. doi: 10.1001/jama.297.2.169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Thompson A, Gao P, Orfei L, Watson S, Di Angelantonio E, Kaptoge S, Ballantyne C, Cannon CP, Criqui M, Cushman M, Hofman A, Packard C, Thompson SG, Collins R, Danesh J. Lipoprotein-associated phospholipase A(2) and risk of coronary disease, stroke, and mortality: collaborative analysis of 32 prospective studies. Lancet. 2010;375:1536–1544. doi: 10.1016/S0140-6736(10)60319-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Caslake MJ, Packard CJ, Robertson M, Cooney J, Nelson JJ, Ford I, Gaw A, Jukema JW, Macfarlane PW, Stott DJ, Shepherd J. Lipoprotein-associated phospholipase A(2), inflammatory biomarkers, and risk of cardiovascular disease in the Prospective Study of Pravastatin in the Elderly at Risk (PROSPER) Atherosclerosis. 2010;210:28–34. doi: 10.1016/j.atherosclerosis.2009.10.041. [DOI] [PubMed] [Google Scholar]
- 62.Danesh J, Kaptoge S, Mann AG, Sarwar N, Wood A, Angleman SB, Wensley F, Higgins JP, Lennon L, Eiriksdottir G, Rumley A, Whincup PH, Lowe GD, Gudnason V. Long-term interleukin-6 levels and subsequent risk of coronary heart disease: two new prospective studies and a systematic review. PLoS Med. 2008;5:e78. doi: 10.1371/journal.pmed.0050078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Patterson CC, Smith AE, Yarnell JW, Rumley A, Ben-Shlomo Y, Lowe GD. The associations of interleukin-6 (IL-6) and downstream inflammatory markers with risk of cardiovascular disease: the Caerphilly Study. Atherosclerosis. 209:551–557. doi: 10.1016/j.atherosclerosis.2009.09.030. [DOI] [PubMed] [Google Scholar]
- 64.Clarke R, Peden JF, Hopewell JC, Kyriakou T, Goel A, Heath SC, Parish S, Barlera S, Franzosi MG, Rust S, Bennett D, Silveira A, Malarstig A, Green FR, Lathrop M, Gigante B, Leander K, de Faire U, Seedorf U, Hamsten A, Collins R, Watkins H, Farrall M the PROCARDIS Consortium. Genetic Variants Associated with Lp(a) Lipoprotein Level and Coronary Disease. N Engl J Med. 2009;361:2518–2528. doi: 10.1056/NEJMoa0902604. [DOI] [PubMed] [Google Scholar]
- 65.Samani NJ, Erdmann J, Hall AS, Hengstenberg C, Mangino M, Mayer B, Dixon RJ, Meitinger T, Braund P, Wichmann HE, Barrett JH, Konig IR, Stevens SE, Szymczak S, Tregouet DA, Iles MM, Pahlke F, Pollard H, Lieb W, Cambien F, Fischer M, Ouwehand W, Blankenberg S, Balmforth AJ, Baessler A, Ball SG, Strom TM, Braenne I, Gieger C, Deloukas P, Tobin MD, Ziegler A, Thompson JR, Schunkert H. Genomewide association analysis of coronary artery disease. N Engl J Med. 2007;357:443–453. doi: 10.1056/NEJMoa072366. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.McPherson R, Pertsemlidis A, Kavaslar N, Stewart A, Roberts R, Cox DR, Hinds DA, Pennacchio LA, Tybjaerg-Hansen A, Folsom AR, Boerwinkle E, Hobbs HH, Cohen JC. A common allele on chromosome 9 associated with coronary heart disease. Science. 2007;316:1488–1491. doi: 10.1126/science.1142447. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Erdmann J, Grosshennig A, Braund PS, Konig IR, Hengstenberg C, Hall AS, Linsel-Nitschke P, Kathiresan S, Wright B, Tregouet DA, Cambien F, Bruse P, Aherrahrou Z, Wagner AK, Stark K, Schwartz SM, Salomaa V, Elosua R, Melander O, Voight BF, O’Donnell CJ, Peltonen L, Siscovick DS, Altshuler D, Merlini PA, Peyvandi F, Bernardinelli L, Ardissino D, Schillert A, Blankenberg S, Zeller T, Wild P, Schwarz DF, Tiret L, Perret C, Schreiber S, El Mokhtari NE, Schafer A, Marz W, Renner W, Bugert P, Kluter H, Schrezenmeir J, Rubin D, Ball SG, Balmforth AJ, Wichmann HE, Meitinger T, Fischer M, Meisinger C, Baumert J, Peters A, Ouwehand WH, Deloukas P, Thompson JR, Ziegler A, Samani NJ, Schunkert H. New susceptibility locus for coronary artery disease on chromosome 3q22.3. Nat Genet. 2009;41:280–282. doi: 10.1038/ng.307. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Tregouet DA, Konig IR, Erdmann J, Munteanu A, Braund PS, Hall AS, Grosshennig A, Linsel-Nitschke P, Perret C, DeSuremain M, Meitinger T, Wright BJ, Preuss M, Balmforth AJ, Ball SG, Meisinger C, Germain C, Evans A, Arveiler D, Luc G, Ruidavets JB, Morrison C, van der Harst P, Schreiber S, Neureuther K, Schafer A, Bugert P, El Mokhtari NE, Schrezenmeir J, Stark K, Rubin D, Wichmann HE, Hengstenberg C, Ouwehand W, Ziegler A, Tiret L, Thompson JR, Cambien F, Schunkert H, Samani NJ. Genome-wide haplotype association study identifies the SLC22A3-LPAL2-LPA gene cluster as a risk locus for coronary artery disease. Nat Genet. 2009;41:283–285. doi: 10.1038/ng.314. [DOI] [PubMed] [Google Scholar]
- 69.Kathiresan S, Voight BF, Purcell S, Musunuru K, Ardissino D, Mannucci PM, Anand S, Engert JC, Samani NJ, Schunkert H, Erdmann J, Reilly MP, Rader DJ, Morgan T, Spertus JA, Stoll M, Girelli D, McKeown PP, Patterson CC, Siscovick DS, O’Donnell CJ, Elosua R, Peltonen L, Salomaa V, Schwartz SM, Melander O, Altshuler D, Merlini PA, Berzuini C, Bernardinelli L, Peyvandi F, Tubaro M, Celli P, Ferrario M, Fetiveau R, Marziliano N, Casari G, Galli M, Ribichini F, Rossi M, Bernardi F, Zonzin P, Piazza A, Yee J, Friedlander Y, Marrugat J, Lucas G, Subirana I, Sala J, Ramos R, Meigs JB, Williams G, Nathan DM, MacRae CA, Havulinna AS, Berglund G, Hirschhorn JN, Asselta R, Duga S, Spreafico M, Daly MJ, Nemesh J, Korn JM, McCarroll SA, Surti A, Guiducci C, Gianniny L, Mirel D, Parkin M, Burtt N, Gabriel SB, Thompson JR, Braund PS, Wright BJ, Balmforth AJ, Ball SG, Hall AS, Linsel-Nitschke P, Lieb W, Ziegler A, Konig I, Hengstenberg C, Fischer M, Stark K, Grosshennig A, Preuss M, Wichmann HE, Schreiber S, Ouwehand W, Deloukas P, Scholz M, Cambien F, Li M, Chen Z, Wilensky R, Matthai W, Qasim A, Hakonarson HH, Devaney J, Burnett MS, Pichard AD, Kent KM, Satler L, Lindsay JM, Waksman R, Epstein SE, Scheffold T, Berger K, Huge A, Martinelli N, Olivieri O, Corrocher R, McKeown P, Erdmann E, Konig IR, Holm H, Thorleifsson G, Thorsteinsdottir U, Stefansson K, Do R, Xie C, Siscovick D. Genome-wide association of early-onset myocardial infarction with single nucleotide polymorphisms and copy number variants. Nat Genet. 2009;41:334–341. doi: 10.1038/ng.327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Paynter NP, Chasman DI, Buring JE, Shiffman D, Cook NR, Ridker PM. Cardiovascular disease risk prediction with and without knowledge of genetic variation at chromosome 9p21.3. Ann Intern Med. 2009;150:65–72. doi: 10.7326/0003-4819-150-2-200901200-00003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Kathiresan S, Melander O, Anevski D, Guiducci C, Burtt NP, Roos C, Hirschhorn JN, Berglund G, Hedblad B, Groop L, Altshuler DM, Newton-Cheh C, Orho-Melander M. Polymorphisms associated with cholesterol and risk of cardiovascular events. N Engl J Med. 2008;358:1240–1249. doi: 10.1056/NEJMoa0706728. [DOI] [PubMed] [Google Scholar]
- 72.Agatston AS, Janowitz WR, Hildner FJ, Zusmer NR, Viamonte M, Jr, Detrano R. Quantification of coronary artery calcium using ultrafast computed tomography. Journal of the American College of Cardiology. 1990;15:827–832. doi: 10.1016/0735-1097(90)90282-t. [DOI] [PubMed] [Google Scholar]
- 73.Chen J, Krumholz HM. How useful is computed tomography for screening for coronary artery disease? Screening for coronary artery disease with electron-beam computed tomography is not useful. Circulation. 2006;113:125–146. discussion 125–146. [PubMed] [Google Scholar]
- 74.Greenland P, Bonow RO, Brundage BH, Budoff MJ, Eisenberg MJ, Grundy SM, Lauer MS, Post WS, Raggi P, Redberg RF, Rodgers GP, Shaw LJ, Taylor AJ, Weintraub WS. ACCF/AHA 2007 clinical expert consensus document on coronary artery calcium scoring by computed tomography in global cardiovascular risk assessment and in evaluation of patients with chest pain: a report of the American College of Cardiology Foundation Clinical Expert Consensus Task Force (ACCF/AHA Writing Committee to Update the 2000 Expert Consensus Document on Electron Beam Computed Tomography) developed in collaboration with the Society of Atherosclerosis Imaging and Prevention and the Society of Cardiovascular Computed Tomography. J Am Coll Cardiol. 2007;49:378–402. doi: 10.1016/j.jacc.2006.10.001. [DOI] [PubMed] [Google Scholar]
- 75.Pletcher MJ, Tice JA, Pignone M, Browner WS. Using the coronary artery calcium score to predict coronary heart disease events: a systematic review and meta-analysis. Arch Intern Med. 2004;164:1285–1292. doi: 10.1001/archinte.164.12.1285. [DOI] [PubMed] [Google Scholar]
- 76.Taylor AJ, Bindeman J, Feuerstein I, Cao F, Brazaitis M, O’Malley PG. Coronary calcium independently predicts incident premature coronary heart disease over measured cardiovascular risk factors: mean three-year outcomes in the Prospective Army Coronary Calcium (PACC) project. J Am Coll Cardiol. 2005;46:807–814. doi: 10.1016/j.jacc.2005.05.049. [DOI] [PubMed] [Google Scholar]
- 77.Arad Y, Goodman KJ, Roth M, Newstein D, Guerci AD. Coronary calcification, coronary disease risk factors, C-reactive protein, and atherosclerotic cardiovascular disease events: the St. Francis Heart Study. J Am Coll Cardiol. 2005;46:158–165. doi: 10.1016/j.jacc.2005.02.088. [DOI] [PubMed] [Google Scholar]
- 78.Greenland P, LaBree L, Azen SP, Doherty TM, Detrano RC. Coronary Artery Calcium Score Combined With Framingham Score for Risk Prediction in Asymptomatic Individuals. JAMA: The Journal of the American Medical Association. 2004;291:210–215. doi: 10.1001/jama.291.2.210. [DOI] [PubMed] [Google Scholar]
- 79.Vliegenthart R, Oudkerk M, Hofman A, Oei HH, van Dijck W, van Rooij FJ, Witteman JC. Coronary calcification improves cardiovascular risk prediction in the elderly. Circulation. 2005;112:572–577. doi: 10.1161/CIRCULATIONAHA.104.488916. [DOI] [PubMed] [Google Scholar]
- 80.Polonsky TS, McClelland RL, Jorgensen NW, Bild DE, Burke GL, Guerci AD, Greenland P. Coronary artery calcium score and risk classification for coronary heart disease prediction. JAMA. 2010;303:1610–1616. doi: 10.1001/jama.2010.461. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Elias-Smale SE, Proenca RV, Koller MT, Kavousi M, van Rooij FJA, Hunink MG, Steyerberg EW, Hofman A, Oudkerk M, Witteman JCM. Coronary Calcium Score Improves Classification of Coronary Heart Disease Risk in the Elderly: The Rotterdam Study. J Am Coll Cardiol. 2010;56:1407–1414. doi: 10.1016/j.jacc.2010.06.029. [DOI] [PubMed] [Google Scholar]
- 82.Erbel R, Mohlenkamp S, Moebus S, Schmermund A, Lehmann N, Stang A, Dragano N, Gronemeyer D, Seibel R, Kalsch H, Brocker-Preuss M, Mann K, Siegrist J, Jockel K-H Heinz Nixdorf Recall Study Investigative Group. Coronary Risk Stratification, Discrimination, and Reclassification Improvement Based on Quantification of Subclinical Coronary Atherosclerosis: The Heinz Nixdorf Recall Study. J Am Coll Cardiol. 2010;56:1397–1406. doi: 10.1016/j.jacc.2010.06.030. [DOI] [PubMed] [Google Scholar]
- 83.Folsom AR, Kronmal RA, Detrano RC, O’Leary DH, Bild DE, Bluemke DA, Budoff MJ, Liu K, Shea S, Szklo M, Tracy RP, Watson KE, Burke GL. Coronary artery calcification compared with carotid intima-media thickness in the prediction of cardiovascular disease incidence: the Multi-Ethnic Study of Atherosclerosis (MESA) Arch Intern Med. 2008;168:1333–1339. doi: 10.1001/archinte.168.12.1333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Lauer MS. Elements of danger--the case of medical imaging. N Engl J Med. 2009;361:841–843. doi: 10.1056/NEJMp0904735. [DOI] [PubMed] [Google Scholar]
- 85.Sharma K, Blaha MJ, Blumenthal RS, Musunuru K. Clinical and research applications of carotid intima-media thickness. Am J Cardiol. 2009;103:1316–1320. doi: 10.1016/j.amjcard.2009.01.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Simon A, Megnien JL, Chironi G. The Value of Carotid Intima-Media Thickness for Predicting Cardiovascular Risk. Arterioscler Thromb Vasc Biol. 2010;30:182–185. doi: 10.1161/ATVBAHA.109.196980. [DOI] [PubMed] [Google Scholar]
- 87.Lorenz MW, Markus HS, Bots ML, Rosvall M, Sitzer M. Prediction of clinical cardiovascular events with carotid intima-media thickness: a systematic review and meta-analysis. Circulation. 2007;115:459–467. doi: 10.1161/CIRCULATIONAHA.106.628875. [DOI] [PubMed] [Google Scholar]
- 88.Bots ML, Evans GW, Riley WA, Grobbee DE. Carotid intima-media thickness measurements in intervention studies: design options, progression rates, and sample size considerations: a point of view. Stroke. 2003;34:2985–2994. doi: 10.1161/01.STR.0000102044.27905.B5. [DOI] [PubMed] [Google Scholar]
- 89.Taylor AJ, Villines TC, Stanek EJ, Devine PJ, Griffen L, Miller M, Weissman NJ, Turco M. Extended-release niacin or ezetimibe and carotid intima-media thickness. N Engl J Med. 2009;361:2113–2122. doi: 10.1056/NEJMoa0907569. [DOI] [PubMed] [Google Scholar]
- 90.Vlachopoulos C, Aznaouridis K, Stefanadis C. Prediction of cardiovascular events and all-cause mortality with arterial stiffness: a systematic review and meta-analysis. J Am Coll Cardiol. 2010;55:1318–1327. doi: 10.1016/j.jacc.2009.10.061. [DOI] [PubMed] [Google Scholar]
- 91.Mattace-Raso FU, van der Cammen TJ, Hofman A, van Popele NM, Bos ML, Schalekamp MA, Asmar R, Reneman RS, Hoeks AP, Breteler MM, Witteman JC. Arterial stiffness and risk of coronary heart disease and stroke: the Rotterdam Study. Circulation. 2006;113:657–663. doi: 10.1161/CIRCULATIONAHA.105.555235. [DOI] [PubMed] [Google Scholar]
- 92.Mitchell GF, Hwang SJ, Vasan RS, Larson MG, Pencina MJ, Hamburg NM, Vita JA, Levy D, Benjamin EJ. Arterial stiffness and cardiovascular events: the Framingham Heart Study. Circulation. 2010;121:505–511. doi: 10.1161/CIRCULATIONAHA.109.886655. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Gokce N, Keaney JF, Jr, Hunter LM, Watkins MT, Nedeljkovic ZS, Menzoian JO, Vita JA. Predictive value of noninvasively determined endothelial dysfunction for long-term cardiovascular events in patients with peripheral vascular disease. J Am Coll Cardiol. 2003;41:1769–1775. doi: 10.1016/s0735-1097(03)00333-4. [DOI] [PubMed] [Google Scholar]
- 94.Gokce N, Keaney JF, Jr, Hunter LM, Watkins MT, Menzoian JO, Vita JA. Risk stratification for postoperative cardiovascular events via noninvasive assessment of endothelial function: a prospective study. Circulation. 2002;105:1567–1572. doi: 10.1161/01.cir.0000012543.55874.47. [DOI] [PubMed] [Google Scholar]
- 95.Huang AL, Silver AE, Shvenke E, Schopfer DW, Jahangir E, Titas MA, Shpilman A, Menzoian JO, Watkins MT, Raffetto JD, Gibbons G, Woodson J, Shaw PM, Dhadly M, Eberhardt RT, Keaney JF, Jr, Gokce N, Vita JA. Predictive value of reactive hyperemia for cardiovascular events in patients with peripheral arterial disease undergoing vascular surgery. Arterioscler Thromb Vasc Biol. 2007;27:2113–2119. doi: 10.1161/ATVBAHA.107.147322. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Brevetti G, Silvestro A, Schiano V, Chiariello M. Endothelial dysfunction and cardiovascular risk prediction in peripheral arterial disease: additive value of flow-mediated dilation to ankle-brachial pressure index. Circulation. 2003;108:2093–2098. doi: 10.1161/01.CIR.0000095273.92468.D9. [DOI] [PubMed] [Google Scholar]
- 97.Chan SY, Mancini GB, Kuramoto L, Schulzer M, Frohlich J, Ignaszewski A. The prognostic importance of endothelial dysfunction and carotid atheroma burden in patients with coronary artery disease. J Am Coll Cardiol. 2003;42:1037–1043. doi: 10.1016/s0735-1097(03)00927-6. [DOI] [PubMed] [Google Scholar]
- 98.Yeboah J, Folsom AR, Burke GL, Johnson C, Polak JF, Post W, Lima JA, Crouse JR, Herrington DM. Predictive value of brachial flow-mediated dilation for incident cardiovascular events in a population-based study: the multi-ethnic study of atherosclerosis. Circulation. 2009;120:502–509. doi: 10.1161/CIRCULATIONAHA.109.864801. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Yeboah J, Crouse JR, Hsu FC, Burke GL, Herrington DM. Brachial flow-mediated dilation predicts incident cardiovascular events in older adults: the Cardiovascular Health Study. Circulation. 2007;115:2390–2397. doi: 10.1161/CIRCULATIONAHA.106.678276. [DOI] [PubMed] [Google Scholar]
- 100.Modena MG, Bonetti L, Coppi F, Bursi F, Rossi R. Prognostic role of reversible endothelial dysfunction in hypertensive postmenopausal women. J Am Coll Cardiol. 2002;40:505–510. doi: 10.1016/s0735-1097(02)01976-9. [DOI] [PubMed] [Google Scholar]
- 101.Fowkes FG, Murray GD, Butcher I, Heald CL, Lee RJ, Chambless LE, Folsom AR, Hirsch AT, Dramaix M, deBacker G, Wautrecht JC, Kornitzer M, Newman AB, Cushman M, Sutton-Tyrrell K, Lee AJ, Price JF, d’Agostino RB, Murabito JM, Norman PE, Jamrozik K, Curb JD, Masaki KH, Rodriguez BL, Dekker JM, Bouter LM, Heine RJ, Nijpels G, Stehouwer CD, Ferrucci L, McDermott MM, Stoffers HE, Hooi JD, Knottnerus JA, Ogren M, Hedblad B, Witteman JC, Breteler MM, Hunink MG, Hofman A, Criqui MH, Langer RD, Fronek A, Hiatt WR, Hamman R, Resnick HE, Guralnik J. Ankle brachial index combined with Framingham Risk Score to predict cardiovascular events and mortality: a meta-analysis. JAMA. 2008;300:197–208. doi: 10.1001/jama.300.2.197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Wang TJ, Larson MG, Vasan RS. Biomarkers for Prediction of Cardiovascular Events. N Engl J Med. 2007;356:1472–1475. [PubMed] [Google Scholar]
- 103.Blankenberg S, Zeller T, Saarela O, Havulinna AS, Kee F, Tunstall-Pedoe H, Kuulasmaa K, Yarnell J, Schnabel RB, Wild PS, Munzel TF, Lackner KJ, Tiret L, Evans A, Salomaa V. Contribution of 30 biomarkers to 10-year cardiovascular risk estimation in 2 population cohorts: the MONICA, risk, genetics, archiving, and monograph (MORGAM) biomarker project. Circulation. 2010;121:2388–2397. doi: 10.1161/CIRCULATIONAHA.109.901413. [DOI] [PubMed] [Google Scholar]
- 104.Wang TJ. Multiple biomarkers for predicting cardiovascular events: lessons learned. J Am Coll Cardiol. 2010;55:2092–2095. doi: 10.1016/j.jacc.2010.02.019. [DOI] [PubMed] [Google Scholar]
- 105.de Lemos JA, Rohatgi A. Separating the contenders from the pretenders: competitive high-throughput biomarker screening in large population-based studies. Circulation. 2010;121:2381–2383. doi: 10.1161/CIRCULATIONAHA.110.953463. [DOI] [PubMed] [Google Scholar]
- 106.Cao JJ, Arnold AM, Manolio TA, Polak JF, Psaty BM, Hirsch CH, Kuller LH, Cushman M. Association of carotid artery intima-media thickness, plaques, and C-reactive protein with future cardiovascular disease and all-cause mortality: the Cardiovascular Health Study. Circulation. 2007;116:32–38. doi: 10.1161/CIRCULATIONAHA.106.645606. [DOI] [PubMed] [Google Scholar]
- 107.Gerszten RE, Wang TJ. The search for new cardiovascular biomarkers. Nature. 2008;451:949–952. doi: 10.1038/nature06802. [DOI] [PubMed] [Google Scholar]
- 108.Sargent DJ, Conley BA, Allegra C, Collette L. Clinical trial designs for predictive marker validation in cancer treatment trials. J Clin Oncol. 2005;23:2020–2027. doi: 10.1200/JCO.2005.01.112. [DOI] [PubMed] [Google Scholar]
- 109.Hoering A, Leblanc M, Crowley JJ. Randomized phase III clinical trial designs for targeted agents. Clin Cancer Res. 2008;14:4358–4367. doi: 10.1158/1078-0432.CCR-08-0288. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 110.Simon R. The use of genomics in clinical trial design. Clin Cancer Res. 2008;14:5984–5993. doi: 10.1158/1078-0432.CCR-07-4531. [DOI] [PubMed] [Google Scholar]
- 111.Astra-Zeneca . Sponsor’s Briefing Document for Endocrinologic and Metabolic Drugs Advisory Committee. Dec 15, 2009. [Google Scholar]
- 112.Baigent C, Keech A, Kearney PM, Blackwell L, Buck G, Pollicino C, Kirby A, Sourjina T, Peto R, Collins R, Simes R. Efficacy and safety of cholesterol-lowering treatment: prospective meta-analysis of data from 90,056 participants in 14 randomised trials of statins. Lancet. 2005;366:1267–1278. doi: 10.1016/S0140-6736(05)67394-1. [DOI] [PubMed] [Google Scholar]
- 113.Kaul S, Morrissey RP, Diamond GA. By Jove! What is a clinician to make of JUPITER? Arch Intern Med. 2010;170:1073–1077. doi: 10.1001/archinternmed.2010.189. [DOI] [PubMed] [Google Scholar]
- 114.Rajpathak SN, Kumbhani DJ, Crandall J, Barzilai N, Alderman M, Ridker PM. Statin therapy and risk of developing type 2 diabetes: a meta-analysis. Diabetes Care. 2009;32:1924–1929. doi: 10.2337/dc09-0738. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 115.Ridker PM, MacFadyen J, Libby P, Glynn RJ. Relation of baseline high-sensitivity C-reactive protein level to cardiovascular outcomes with rosuvastatin in the Justification for Use of statins in Prevention: an Intervention Trial Evaluating Rosuvastatin (JUPITER) Am J Cardiol. 2010;106:204–209. doi: 10.1016/j.amjcard.2010.03.018. [DOI] [PubMed] [Google Scholar]
- 116.Hlatky MA. Expanding the orbit of primary prevention--moving beyond JUPITER. N Engl J Med. 2008;359:2280–2282. doi: 10.1056/NEJMe0808320. [DOI] [PubMed] [Google Scholar]
- 117.Sattar N, Preiss D, Murray HM, Welsh P, Buckley BM, de Craen AJ, Seshasai SR, McMurray JJ, Freeman DJ, Jukema JW, Macfarlane PW, Packard CJ, Stott DJ, Westendorp RG, Shepherd J, Davis BR, Pressel SL, Marchioli R, Marfisi RM, Maggioni AP, Tavazzi L, Tognoni G, Kjekshus J, Pedersen TR, Cook TJ, Gotto AM, Clearfield MB, Downs JR, Nakamura H, Ohashi Y, Mizuno K, Ray KK, Ford I. Statins and risk of incident diabetes: a collaborative meta-analysis of randomised statin trials. Lancet. 2010;375:735–742. doi: 10.1016/S0140-6736(09)61965-6. [DOI] [PubMed] [Google Scholar]
- 118.Ioannidis JP, Tzoulaki I. What makes a good predictor?: the evidence applied to coronary artery calcium score. JAMA. 2010;303:1646–1647. doi: 10.1001/jama.2010.503. [DOI] [PubMed] [Google Scholar]
- 119.Wald NJ, Law MR. A strategy to reduce cardiovascular disease by more than 80% BMJ. 2003;326:1419. doi: 10.1136/bmj.326.7404.1419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 120.Yusuf S, Pais P, Afzal R, Xavier D, Teo K, Eikelboom J, Sigamani A, Mohan V, Gupta R, Thomas N. Effects of a polypill (Polycap) on risk factors in middle-aged individuals without cardiovascular disease (TIPS): a phase II, double-blind, randomised trial. Lancet. 2009;373:1341–1351. doi: 10.1016/S0140-6736(09)60611-5. [DOI] [PubMed] [Google Scholar]
- 121.Cannon CP. Can the polypill save the world from heart disease? Lancet. 2009;373:1313–1314. doi: 10.1016/S0140-6736(09)60652-8. [DOI] [PubMed] [Google Scholar]
- 122.Lloyd-Jones DM. Cardiovascular risk prediction: basic concepts, current status, and future directions. Circulation. 2010;121:1768–1777. doi: 10.1161/CIRCULATIONAHA.109.849166. [DOI] [PubMed] [Google Scholar]