Abstract
Background:
AF risk estimation using clinical factors with or without genetic information may identify AF screening candidates more accurately than the guideline-based age threshold of ≥65 years.
Methods:
We analyzed four samples across the United States and Europe (derivation: United Kingdom (UK) Biobank; validation: FINRISK, Geisinger MyCode Initiative, and Framingham Heart Study). We estimated AF risk using the Cohorts for Heart and Aging Research in Genomic Epidemiology AF (CHARGE-AF) score and a combination of CHARGE-AF and a 1,168-variant polygenic score (Predict-AF). We compared the utility of age, CHARGE-AF, and Predict-AF for predicting 5-year AF by quantifying discrimination and calibration.
Results:
Among 543,093 individuals, 8,940 developed AF within 5 years. In the validation sets, CHARGE-AF (c-index range 0.720–0.824) and Predict-AF (0.749–0.831) had largely comparable discrimination, both favorable to continuous age (0.675–0.801). Calibration was similar using CHARGE-AF (slope range 0.67–0.87) and Predict-AF (0.65–0.83). Net reclassification improvement (NRI) using Predict-AF versus CHARGE-AF was modest (NRI range 0.024–0.057), but more favorable among individuals aged <65 years (0.062–0.11). Using Predict-AF among 99,530 individuals aged ≥65 across each sample, 70,849 had AF risk <5%, of whom 69,067 (97.5%) did not develop AF, while 28,681 had AF risk ≥5%, of whom 2,264 (7.9%) developed AF. Of 11,379 individuals aged <65 years with AF risk ≥5%, 435 (3.8%) developed AF before age 65, with roughly half (46.9%) meeting anticoagulation criteria.
Conclusions:
AF risk estimation using clinical factors may prioritize individuals for AF screening more precisely than the age threshold endorsed in current guidelines. The additional value of genetic predisposition is modest, but greatest among younger individuals.
Keywords: atrial fibrillation, genetics, precision medicine, risk prediction, stroke, screening
Journal subject terms: atrial fibrillation, epidemiology, genetics, risk factors, stroke
Introduction
Atrial fibrillation (AF) is associated with substantial morbidity including an increased risk of stroke.1 Oral anticoagulation (OAC) has been shown to reduce the incidence of AF-related strokes.2 Since AF can be asymptomatic, routine screening may identify individuals with undiagnosed AF who may benefit from OAC. Certain guidelines, including those from the European Society of Cardiology3 and Cardiac Society of Australia and New Zealand,4 provide a class I recommendation for AF screening among individuals aged ≥65 years. In contrast, the United States Preventive Services Task Force has concluded that evidence is insufficient to recommend for or against screening with electrocardiography.5
Given concerns about false positives and potential downstream adverse consequences of AF screening,6 efficient identification of individuals at greatest risk for AF is warranted. Several clinical risk factors are associated with increased risk of AF,7 and recent data have demonstrated that inherited predisposition to AF is associated with AF beyond clinical risk factors.8,9 In this study, we compared the predictive utility of a risk-guided approach as compared to an age of at least 65 years – the age threshold included in guidelines which support AF screening3,4 – for identifying individuals at risk for incident AF. We examined clinical risk factors alone and in combination with a polygenic risk score (PRS). We leveraged a diverse array of studies from multiple nations comprising prospective population-based cohorts (UK Biobank,10 FINRISK11), a prospective community-based cohort (Framingham Heart Study12), and a healthcare-system based cohort (Geisinger MyCode Community Health Initiative13) – each with comprehensive clinical and genomic data – to contrast prediction approaches and enhance generalizability of the evaluation.
Methods
Detailed methods underlying the current study are described in Supplemental Methods I–III and Supplemental Tables I–II. In compliance with the Declaration of Helsinki, subjects provided informed consent and use of study data was approved by relevant local Institutional Review Boards. Use of UK Biobank data was approved under application 17488. UK Biobank data are publicly available to qualified researchers (https://www.ukbiobank.ac.uk/). The data processing scripts used to perform the main analyses described herein can be found on a persistent GitHub repository (https://github.com/shaankhurshid/predict_af).
Results
Risk score performance for AF and stroke
Across all four cohorts, 543,093 individuals were free of prevalent AF and had complete clinical and genetic data for AF prediction. Patient flow through the UK Biobank derivation cohort is shown in Supplemental Figure I. The mean age ranged 47–59 years and females comprised 52–66%. Patient characteristics are summarized in Supplemental Table III. Characteristics of individuals excluded from the derivation cohort for missing data or prevalent AF are shown in Supplemental Table IV.
At 5 years, 8,940 individuals developed incident AF. Continuous age, CHARGE-AF, and Predict-AF were each associated with 5-year incident AF, although the within-cohort effect size was consistently highest using Predict-AF (Table 1). Discrimination using CHARGE-AF (UK Biobank c-index 0.767, 95% CI 0.762–0.772; validation cohort range 0.720–0.824) and Predict-AF (0.780, 95% CI 0.775–0.785; validation cohort range 0.749–0.831) were substantially greater than continuous age (0.719, 95% CI 0.714–0.724; validation cohort range 0.675–0.801, Table 1 and Figure 1). When compared to CHARGE-AF, Predict-AF consistently exhibited a significant but modest increase in discrimination (UK Biobank increase in c-index 0.013, 95% CI 0.011–0.015; FINRISK 0.029, 95% CI 0.018–0.041; Geisinger 0.007, 95% CI 0.005–0.009; Framingham 0.015, 95% CI 0.009–0.022). Calibration was similar using CHARGE-AF (UK Biobank calibration slope 1.10, 95% CI 1.07–1.13; validation cohort range 0.67–0.87) and Predict-AF (1.00, 95% CI 0.98–1.02; validation cohort range 0.65–0.83), and favorable relative to continuous age (1.00, 95% CI 0.97–1.03; validation cohort range 0.59–0.70, Table 1 and Supplemental Figure II). The distribution of AF risk scores stratified by AF status in the derivation set are depicted in Supplemental Figure III.
Table 1.
Association between AF risk scores and 5-year incident AF
| Metric | UK Biobank | FINRISK | Geisinger | Framingham |
|---|---|---|---|---|
| N events/N total | 7192/473681 | 229/10560 | 1336/55517 | 183/3335 |
| Age | ||||
| Hazard ratio (per 1-SD increase) | 2.56 (2.48–2.64) | 1.82 (1.60–2.08) | 3.43 (3.21–3.65) | 2.86 (2.38–3.45) |
| AIC* | 183324 | 4148 | 27491 | 2799 |
| R2 (95%CI) | 0.028 (0.027–0.030) | 0.024 (0.015–0.034) | 0.073 (0.068–0.078) | 0.075 (0.055–0.095) |
| c-index (95%CI) | 0.719 (0.714–0.724) | 0.675 (0.641–0.710) | 0.801 (0.792–0.811) | 0.750 (0.719–0.783) |
| calibration slope (95%CI) | 1.00 (0.97–1.03)† | 0.69 (0.55–0.84) | 0.70 (0.66–0.73) | 0.59 (0.48–0.69) |
| CHARGE-AF | ||||
| Hazard ratio (per 1-SD increase) | 3.04 (2.96–3.13) | 2.22 (1.94–2.53) | 4.08 (3.76–4.30) | 3.31 (2.73–4.01) |
| AIC* | 180712 | 4087 | 27171 | 2767 |
| R2 (95%CI) | 0.045 (0.043–0.047) | 0.042 (0.029–0.055) | 0.086 (0.079–0.093) | 0.091 (0.069–0.11) |
| c-index (95%CI) | 0.767 (0.762–0.772) | 0.720 (0.689–0.751) | 0.824 (0.813–0.835) | 0.775 (0.744–0.805) |
| calibration slope (95%CI) | 1.10 (1.07–1.13) | 0.87 (0.73–1.01) | 0.80 (0.76–0.83) | 0.67 (0.56–0.78) |
| AF Polygenic Risk Score | ||||
| Hazard ratio (per 1-SD increase) | 1.34 (1.31–1.37) | 1.48 (1.31–1.66) | 1.28 (1.21–1.35) | 1.49 (1.30–1.71) |
| AIC* | 187086 | 4195 | 29081 | 2919 |
| R2 (95%CI) | 0.004 (0.004–0.005) | 0.011 (0.004–0.018) | 0.003 (0.002–0.005) | 0.016 (0.004–0.027) |
| c-index (95%CI) | 0.584 (0.577–0.590) | 0.615 (0.579–0.650) | 0.569 (0.554–0.584) | 0.617 (0.574–0.660) |
| calibration slope (95%CI) | 1.00 (0.93–1.07) | 1.21 (0.84–1.58) | 0.96 (0.76–1.16) | 1.48 (0.97–1.99) |
| Predict-AF | ||||
| Hazard ratio (per 1-SD increase) | 3.21 (3.12–3.30) | 2.46 (2.15–2.80) | 4.19 (3.91–4.48) | 3.68 (3.01–4.49) |
| AIC* | 179857 | 4048 | 270510 | 2740 |
| R2 (95%CI) | 0.050 (0.048–0.053) | 0.053 (0.038–0.068) | 0.091 (0.085–0.097) | 0.10 (0.080–0.13) |
| c-index (95%CI) | 0.780 (0.775–0.785)‡ | 0.749 (0.718–0.781)‡ | 0.831 (0.822–0.840)‡ | 0.790 (0.761–0.819)‡ |
| calibration slope (95%CI) | 1.00 (0.98–1.02)† | 0.83 (0.71–0.95) | 0.73 (0.69–0.76) | 0.65 (0.55–0.75) |
Akaike Information Criterion, a penalized likelihood metric, where lower values indicate improved model fit after adjustment for model complexity
Values after bias correction using bootstrapping: 0.9997 (age), 1.0057 (PRS), 1.00027 (Predict-AF).14
Difference in c-index versus CHARGE-AF: UKBB 0.013 (0.011–0.015); FINRISK 0.029 (0.018–0.041); Geisinger 0.007 (0.005–0.009); Framingham 0.015 (0.009–0.022)
Figure 1.

Discrimination of 5-year incident AF using AF risk scores versus continuous age. Depicted are time-dependent receiver operating characteristic curves for Predict-AF (red), CHARGE-AF (blue) and age (green), each as continuous variables, for 5-year incident AF. Curves higher and to the left demonstrate superior predictive performance. The area under each curve is equivalent to test discrimination. The hashed diagonal line represents a completely uninformative test.
At 5 years, 3,011 individuals developed incident stroke. Continuous age, CHARGE-AF, and Predict-AF were associated with 5-year incident stroke (Supplemental Table V). Discrimination of stroke using CHARGE-AF (UK Biobank c-index 0.704, 95% CI 0.693–0.714; validation cohort range 0.761–0.772) and Predict-AF (0.704, 95% CI 0.693–0.714; validation cohort range 0.752–0.767) were substantially greater than continuous age (0.679, 95% CI 0.668–0.689; validation cohort range 0.742–0.747).
High AF risk versus age ≥65 years
We then compared ≥5% 5-year AF risk versus age ≥65 years as a potential alternative criterion for selecting individuals for AF screening. Using Predict-AF, overall reclassification was favorable in each cohort except for the UK Biobank (UK Biobank net reclassification improvement [NRI] −0.049, 95% CI −0.053 to −0.039; validation cohort range 0.054–0.13, Table 2).
Table 2.
Net reclassification analyses using estimated 5-year AF risk ≥5% versus age ≥65 years
| UK Biobank | FINRISK | Geisinger | Framingham | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CHARGE-AF | CHARGE-AF | CHARGE-AF | CHARGE-AF | |||||||||
| Age | ≥5% risk | <5% risk | Age | ≥5% risk | <5% risk | Age | ≥5% risk | <5% risk | Age | ≥5% risk | <5% risk | |
| AF events | ≥65 | 854 (11.9%) |
2294* (31.9%) |
≥65 | 62 (27.1%) |
19* (8.3%) |
≥ 65 | 665 (49.8%) |
16* (1.2%) |
≥65 | 132 (72.1%) |
4* (2.2%) |
| <65 | 185† (2.6%) |
3859 (53.7%) |
<65 | 19† (8.3%) |
129 (56.3%) |
< 65 | 224† (16.8%) |
431 (32.3%) |
<65 | 20† (10.9%) |
27 (14.8%) |
|
| AF non events | ≥65 | 10325 (2.2%) |
75099† (16.1%) |
≥65 | 1038 (10.0%) |
576† (5.6%) |
≥ 65 | 6603 (12.2%) |
674† (1.2%) |
≥65 | 1099 (34.9%) |
70† (2.2%) |
| <65 | 1767* (0.4%) |
379298 (81.3%) |
<65 | 262* (2.5%) |
8455 (81.8%) |
< 65 | 3691* (6.8%) |
43213 (79.8%) |
<65 | 251* (8.0%) |
1732 (54.9%) |
|
| NRI+ | −29.4% (−30.9 to −27.9) | NRI+ | 0.25% (−5.6–4.1) | NRI+ | 15.6% (14.4–17.5) | NRI+ | 8.8% (3.3–10.3) | |||||
| NRI− | 15.7% (15.6–15.8) | NRI− | 3.0% (2.7–3.9) | NRI− | −5.6% (−5.7 to −5.4) | NRI− | −5.7% (−7.0 to −5.0) | |||||
| NRI | −0.14 (−0.15 to −0.13) | NRI | 0.033 (−0.028–0.080) | NRI | 0.10 (0.086–0.12) |
NRI | 0.030 (−0.021–0.036) | |||||
| UK Biobank | FINRISK | Geisinger | Framingham | |||||||||
| Predict-AF | Predict-AF | Predict-AF | Predict-AF | |||||||||
| Age | ≥5% risk | <5% risk | Age | ≥5% risk | <5% risk | Age | ≥5% risk | <5% risk | Age | ≥5% risk | <5% risk | |
| AF events | ≥ 65 | 1400 (19.5%) |
1748* (24.3%) |
≥65 | 68 (29.7%) |
13* (5.7%) |
≥65 | 665 (49.8%) |
16* (1.2%) |
≥65 | 131 (71.6%) |
5* (2.7%) |
| <65 | 435† (6.0%) |
3609 (50.2%) |
<65 | 29† (12.7%) |
119 (52.0%) |
<65 | 288† (21.6%) |
367 (27.5%) |
<65 | 24† (13.1%) |
23 (12.6%) |
|
| AF non events | ≥65 | 17620 (3.8%) |
67804† (14.5%) |
≥65 | 1030 (10.0%) |
584† (5.7%) |
≥65 | 6694 (12.4%) |
583† (1.1%) |
≥65 | 1073 (34.0%) |
96† (3.0%) |
| <65 | 5118* (1.1%) |
375947 (80.6%) |
<65 | 428* (4.1%) |
8289 (80.2%) |
<65 | 4806* (8.9%) |
42098 (77.7%) |
<65 | 251* (8.0%) |
1732 (54.9%) |
|
| NRI+ | −18.3% (−18.7 to −17.3) | NRI+ | 7.4% (4.9–18.0) | NRI+ | 20.4% (18.9–21.8) | NRI+ | 10.3% (7.9–12.5) | |||||
| NRI− | 13.4% (13.4–13.5) | NRI− | 1.5% (1.3–2.5) | NRI− | −7.8% (−7.9 to −7.6) | NRI− | −4.9% (−6.1 to −4.0) | |||||
| NRI | −0.049 (−0.053 to −0.039) | NRI | 0.089 (0.062–0.20) | NRI | 0.13 (0.11–0.14) | NRI | 0.054 (0.029–0.076) | |||||
Denotes inappropriate reclassification
Denotes appropriate reclassification
NRI=Net reclassification improvement; NRI+=Event reclassification improvement; NRI−=Non-event reclassification improvement
NRI values calculated using the Kaplan-Meier estimator to account for censored survival data15
The predominant benefit of utilizing estimated AF risk was appropriate downclassification of AF non-events in the UK Biobank (non-event reclassification improvement [NRI-] 13.4%, 95% CI 13.4–13.5) and FINRISK (NRI- 1.5%, 95% CI 1.3–2.5), versus appropriate upclassification of AF events in Geisinger (event reclassification improvement [NRI+] 20.4%, 95% CI 18.9–21.8) and Framingham (NRI+ 10.3%, 95% CI 7.9–12.5). Of 99,530 individuals aged ≥65 years, 28,681 had predicted AF risk ≥5% using Predict-AF, of whom 2,264 (7.9%) developed AF. Of 70,849 individuals aged ≥65 years with predicted AF risk <5%, 69,067 (97.5%) did not develop AF (Table 2 and Figure 2). Of the other 1,782 individuals (2.5%) who did develop AF, 1,039 (58.3%) had a guideline-based indication for OAC. Of 11,379 individuals aged <65 with predicted AF risk ≥5%, 435 (3.8%) developed AF before prior to age 65, with roughly half (46.9%) having a guideline-based indication for OAC (Supplemental Figure IV). Among individuals with predicted AF risk ≥5%, the 5-year cumulative risk of AF was similar among those aged <65 years (8.41%, 95% CI 6.91–9.88; validation cohort range 5.65–9.09) versus ≥65 years (7.53%, 95% CI 7.15–7.91; validation cohort range 6.38–11.60). The cumulative risks of AF and stroke stratified by estimated AF risk versus age are shown in Supplemental Tables VI–IX and Supplemental Figures IV–VII.
Figure 2.

Distribution of predicted 5-year AF risk stratified by AF status among individuals aged ≥65 years. Depicted are frequency distributions of estimated 5-year AF risk among individuals with incident AF (top panels) versus without incident AF (bottom panels) for individuals aged ≥65 years (i.e., with an existing indication for AF screening).3,4 Lighter shades depict CHARGE-AF, while darker shades depict Predict-AF. The dotted vertical line shows the 5% risk threshold. In the bottom panels, colored areas depict individuals correctly classified as low risk, in whom deferral of AF screening may be reasonable. In the top panels, colored areas depict individuals correctly classified as high risk, in whom AF screening may be most appropriate. Grayed areas represent individuals misclassified at the 5% risk threshold (i.e., had high predicted AF risk but did not develop incident AF [bottom], or had low predicted AF risk but developed incident AF [top]). Shifting the dotted vertical line along the x-axis illustrates the effect of changing the risk threshold used to identify individuals for AF screening. Values above the 95th percentile of risk may not be depicted for graphical purposes.
A decision curve demonstrated net benefit using a risk- as opposed to age-based approach across the entire spectrum of plausible AF screening costs and benefits (Supplemental Figure VIII), and suggested that use of AF risk across a range of thresholds could result in avoidance of unnecessary AF screenings (Supplemental Figure IX). Results of exploratory analyses assessing the comparative yield of AF screening guided by risk as opposed to age are shown in Supplemental Table X and Supplemental Figure X.
Adding genetic to clinical risk
Improvement in AF discrimination using Predict-AF (UK Biobank c-index 0.761, 95% CI 0.752–0.770; validation cohort range 0.744–0.807) versus CHARGE-AF (0.745, 95% CI 0.736–0.754; validation cohort range 0.704–0.794) was more prominent among individuals aged <65 years (Supplemental Figure XI). Overall, reclassification using Predict-AF versus CHARGE-AF was modest but favorable (NRI 0.089, 95% CI 0.082–0.094; validation cohort range 0.024–0.057). Specifically, Predict-AF appropriately upclassified AF events compared to CHARGE-AF (UK Biobank NRI+ 11.1%, 95% CI 10.5–11.7; validation cohort range 1.6–7.2), but at the cost of some inappropriate upclassification of AF non-events (UK Biobank NRI- −2.3%, 95% CI −2.3 to −2.2; validation cohort range −2.2–0.83, Supplemental Table XI and Supplemental Figure XII). Favorable reclassification was also generally more prominent among individuals aged <65 years (UK Biobank NRI 0.074, 95% CI 0.052–0.10; validation cohort range 0.062–0.11), with greater appropriate upclassification of AF events (UK Biobank NRI+ 8.3%, 95% CI 6.1–11.2; validation cohort range 8.1–11.7), and similar or less inappropriate upclassification of AF non-events (UK Biobank NRI- −0.87%, 95% CI −0.90 to −0.87; validation cohort range −2.4% to −0.028%, Supplemental Table XII).
Secondary analyses
In secondary analyses, results were similar using an age threshold of ≥70 years (Supplemental Table XIII). The association between 5-year AF risk and Predict-AF was modestly stronger in women (Supplemental Table XIV). A score defined as the simple sum of CHARGE-AF and the PRS performed worse than Predict-AF (Supplemental Table XV). Discrimination using AF risk quartiles demonstrated similar performance (Supplemental Table XVI). Results of analyses restricted to individuals of European ancestry were also similar (Supplemental Table XVII). The ability of AF risk to identify individuals at higher risk for AF and stroke persisted when assessed solely among individuals with CHA2DS2-VASc ≥2 (male) or ≥3 (female) at the time of AF diagnosis (Supplemental Table XVIII). Analyses utilizing the optimal diagnostic threshold of AF risk using Youden’s statistic are presented in Supplemental Table XIX.
Discussion
In a half-million individuals across four independent cohorts, we observed that risk models were superior predictors of AF than age. Specifically, low estimated AF risk identified nearly 70,000 individuals aged ≥65 years who did not develop AF but who have a guideline-based indication for AF screening on the basis of age,3,4 whereas high estimated risk identified over 400 individuals developing AF before age 65 years without a conventional indication for screening. The addition of genetic risk to clinical risk resulted in modest improvements in AF discrimination, although more substantive increases were observed among younger individuals. Overall, our results suggest that consideration of individual AF risk may improve selection of AF screening candidates as compared to the current guideline-based age threshold of 65 years.3,4
Our results provide a contemporary benchmark of AF risk prediction performance, and suggest that estimated AF risk is consistently more accurate than age in identifying individuals at high risk for AF and stroke. Specifically, we observe that a decision to pursue AF screening using an age-based threshold alone may result in screening of a large number of individuals at low risk for AF and incorrectly result in failure to screen certain younger individuals at elevated risks of both AF and stroke. Although simple, age-based thresholds may be inefficient and expose low risk individuals above the screening threshold to false positive results, and high-risk individuals below the threshold to risks of stroke. In contrast, a risk-based threshold may offer a tradeoff in which deployment of screening may be more efficient and personalized, but at the expense of increased complexity. To this end, we anticipate that increasing availability of linked electronic health records may offset complexity by facilitating automated AF risk estimates,16,17 and note that use of composite risk scores to guide screening is already performed for conditions such as osteoporosis.18 Practically, our evaluation demonstrates that in some study samples (e.g., UK Biobank, FINRISK), many participants meeting existing indications for AF screening are in fact at very low risk of developing AF. Using estimated AF risk to exclude such individuals may enrich the screening pool for those at highest short-term AF risk, increasing the probability that a positive screen reflects true AF, and reducing unwarranted exposure of low-risk individuals to screening – a key consideration given imperfect test characteristics of current modalities.19 Indeed, even some of the most accurate screening modalities (e.g., 12-lead ECG, surface monitors) exhibit false positive rates of up to 5%,19,20 which may become significant at population scale.6
Our findings demonstrate substantial variability in the distribution of estimated AF risk across populations, suggesting that the optimal AF risk thresholds may vary based on the context of the planned intervention (e.g., screening). Indeed, the dominant pattern of reclassification using estimated AF risk versus age varied by sample. In samples with lower baseline AF risk (e.g., UK Biobank, FINRISK), the prevailing benefit of AF risk estimation was identification of low risk individuals aged ≥65 years in whom screening may be deferred. Conversely, in samples with greater AF-related comorbidity, AF risk estimation primarily facilitated identification of individuals aged <65 years at high risk for AF in whom screening may be considered. As a result, although we empirically defined high risk as 5-year AF probability ≥5%, we do not specifically advocate for a uniform risk threshold. Decision curve analyses suggest that a risk-based approach provides greater benefit than an age-based approach across a wide spectrum of AF risk thresholds. Future work is needed to determine optimal risk thresholds, which should account for patient comorbidities, accuracy of predicted AF risk in the target population, availability of financial and other resources to support screening, and the characteristics of the screening test under consideration.21
Importantly, AF risk can identify individuals younger than 65 years who are at high risk for both AF and stroke, although the relative yield may be limited. Use of Predict-AF identified over 400 individuals who developed AF prior to age 65 years, about half of whom had sufficiently high stroke risk to merit OAC at AF diagnosis. Since current guidelines22 do not recommend population-based AF screening in individuals aged <65 years, use of estimated AF risk may provide an opportunity to identify younger individuals at high AF risk who would otherwise not be screened. Indeed, individuals at high AF risk using Predict-AF had similar short-term AF incidence regardless of whether they were above or below age 65 years. At the same time, although reclassification indices were generally favorable, use of AF risk also resulted in thousands of younger individuals classified as high risk who did not develop AF within five years or prior to age 65. Future work is warranted to determine whether predicted AF risk coupled with a screening strategy having very high specificity can facilitate appropriate AF detection at an acceptable false positive rate among individuals aged <65 years at elevated AF risk.
Our findings suggest that genetic information does not substantively improve AF risk prediction, except potentially among younger individuals. In the current study, adding a 1,100-variant PRS (which performed identically to a 6.7 million-variant LDpred PRS in the UK Biobank) to the CHARGE-AF clinical model resulted in a modest increase in AF discrimination (0.01–0.03). Our findings are consistent with past observations suggesting small improvements in AF risk prediction using genetic scores in smaller samples.8,9 More recently, Mars et al. demonstrated more meaningful net reclassification (0.10) using a 6.2 million-variant LDpred PRS developed using Finnish linkage disequilibrium structure and deployed in the FINRISK population,11 although the improvement in c-index was again small (0.009). Importantly, we did observe greater improvements in discrimination among individuals aged <65 years (0.02–0.04), resulting in event reclassification of 8–12%. Such findings are consistent with previous observations that early-onset AF is particularly heritable.23 Notably, utilization of genetic information to guide screening would require an efficient mechanism for genomic data ascertainment, and a harmonized platform to facilitate integration with clinical risk. Economic analyses are warranted to estimate whether ascertainment and utilization of genetic information among younger individuals at risk for AF may be cost-effective.
Our findings must be interpreted in the context of study design. First, participants were predominantly of European ancestry, which limits generalizability to other populations. Second, although we submit that improved performance for predicting clinically apparent AF would translate to a similar benefit when applied prospectively to improve detection of undiagnosed AF, we acknowledge that the clinical and genetic risk profile of undiagnosed AF is unknown and may differ. Third, although certain guidelines recommend AF screening based on age >65 or ≥65 years, some screening studies have utilized higher age thresholds which we cannot fully evaluate given the age composition of our study.3,4,24 Fourth, given our intent to assess the value of absolute AF risk estimation to guide screening, we utilized the baseline AF rate in each sample when calculating AF probabilities.7 Prospective use of our approach would therefore be best informed by prior knowledge of the average AF risk in the population of interest. Fifth, we utilized a 1,168-variant pruning-and-thresholding PRS12 in all analyses. Although recent PRS methods have suggested greater performance, we note that such analyses generally do not account for the effect of clinical risk factors on the comparison.25–27 Indeed, our PRS had slightly lower discrimination (0.583) as compared to an LDpred PRS comprising 6.7 million variants (0.589), but both scores performed identically when added to CHARGE-AF in the derivation set. Nevertheless, we cannot rule out better performance using additional PRS methods,25,26 or with re-derivation, tuning, or selection of PRS within each population. Sixth, given our intent to assess models stratifying risk of future AF, we excluded individuals with prevalent AF. Since early-onset AF is more likely to be prevalent, and early-onset AF may be particularly heritable, current design may limit our ability to evaluate the impact of inherited predisposition to AF among individuals at risk for AF occurring at very young ages. Seventh, we cannot establish causality or eliminate residual confounding.
In summary, in over a half-million individuals across four independent cohorts, we found AF risk exhibits superior predictive utility as compared to age, assessed either continuously or using the guideline-based threshold of ≥65 years, for identifying individuals likely to develop AF and stroke. Provided that appropriate resources and infrastructure exist, use of estimated AF risk may efficiently prioritize individuals for AF screening by identifying individuals at greatest AF risk and distinguishing individuals at low AF risk who are less likely to benefit.
Supplementary Material
Acknowledgments:
The authors would like to thank study staff and investigators from the UK Biobank, FINRISK, Geisinger, and Framingham. The authors would like to thank individuals participating in each of the four cohorts for their generous contributions.
Funding:
This work was supported by NIH R01HL139731 (Lubitz), 2R01HL092577 (Ellinor, Benjamin, Lunetta), 1R01HL128914 (Ellinor and Benjamin), 1R01HL141434 01A1, 2U54HL120163, R01HL104156 and K24HL105780 (Ellinor); T32HL007208 (Khurshid); NHLBI 75N92019D00031; HHSN268201500001I; and N01-HC-25195 (Framingham Heart Study); American Heart Association (Dallas, Texas) 18SFRN34250007 (Lubitz), 18SFRN34150007 (Trinquart), 18SFRN34110082 (Benjamin), 18SFRN34110082 (Weng), and Established Investigator Award 13EIA14220013 (Ellinor); Robert Wood Johnson Grant 74624 (Benjamin); Doris Duke Charitable Foundation Clinical Scientist Development Award 2014105 (Lubitz); Academy of Finland 331671 (Mars); Fondation Leducq 14CVD01 (Ellinor); Finnish Foundation for Cardiovascular Research (Ripatti); Sigrid Jusélius Foundation (Ripatti); University of Helsinki HiLIFE Fellow grants 2017-2020 (Ripatti); Academy of Finland Center of Excellence in Complex Disease Genetics grant 312062 (Ripatti); Academy of Finland 285380 (Ripatti). Drs. Haggerty and Fornwalt receive research support from Tempus Labs.
Disclosures:
Dr. Lubitz receives research support from Bristol Myers Squibb / Pfizer, Bayer AG, Boehringer Ingelheim, and Fitbit, and has consulted for Bristol Myers Squibb / Pfizer and Bayer AG, and participates in a research collaboration with IBM. Dr. Ellinor receives research support from Bayer AG, and has consulted for Novartis, Quest Diagnostics, Bayer AG and MyoKardia. Starting 2020, Dr. Benjamin is an uncompensated member for MyHeartLab Steering Committee, a PI-initiated (Jeffrey Olgin, MD) study from Samsung to UCSF. Dr. Salomaa has participated in a conference trip sponsored by Novo Nordisk, received an honorarium for participating in an advisory board meeting, and has research collaborations with Bayer AG.
Nonstandard Abbreviations and Acronyms
- AF
atrial fibrillation
- CHARGE-AF
Cohorts for Heart and Aging Research in Genomic Epidemiology atrial fibrillation
- NRI
net reclassification improvement
- NRI+
event reclassification improvement
- NRI−
non-event reclassification improvement
- OAC
oral anticoagulation
- PRS
polygenic risk score
Footnotes
References
- 1.Corley SD, Epstein AE, DiMarco JP, Domanski MJ, Geller N, Greene HL, Josephson RA, Kellen JC, Klein RC, Krahn AD, et al. Relationships between sinus rhythm, treatment, and survival in the Atrial Fibrillation Follow-Up Investigation of Rhythm Management (AFFIRM) Study. Circulation. 2004;109:1509–1513. [DOI] [PubMed] [Google Scholar]
- 2.Stroke Prevention in Atrial Fibrillation Study. Final results. Circulation. 1991;84:527–539. [DOI] [PubMed] [Google Scholar]
- 3.Hindricks G, Potpara T, Dagres N, Arbelo E, Bax JJ, Blomström-Lundqvist C, Boriani G, Castella M, Dan G-A, Dilaveris PE, et al. 2020 ESC Guidelines for the diagnosis and management of atrial fibrillation developed in collaboration with the European Association of Cardio-Thoracic Surgery (EACTS). European Heart Journal. 2020;ehaa612. [DOI] [PubMed] [Google Scholar]
- 4.NHFA CSANZ Atrial Fibrillation Guideline Working Group, Brieger D, Amerena J, Attia J, Bajorek B, Chan KH, Connell C, Freedman B, Ferguson C, Hall T, et al. National Heart Foundation of Australia and the Cardiac Society of Australia and New Zealand: Australian Clinical Guidelines for the Diagnosis and Management of Atrial Fibrillation 2018. Heart Lung Circ. 2018;27:1209–1266. [DOI] [PubMed] [Google Scholar]
- 5.US Preventive Services Task Force, Curry SJ, Krist AH, Owens DK, Barry MJ, Caughey AB, Davidson KW, Doubeni CA, Epling JW, Kemper AR, et al. Screening for Atrial Fibrillation With Electrocardiography: US Preventive Services Task Force Recommendation Statement. JAMA. 2018;320:478–484. [DOI] [PubMed] [Google Scholar]
- 6.Mandrola J, Foy A, Naccarelli G. Screening for Atrial Fibrillation Comes With Many Snags. JAMA Intern Med. 2018;178:1296–1298. [DOI] [PubMed] [Google Scholar]
- 7.Alonso A, Krijthe BP, Aspelund T, Stepas KA, Pencina MJ, Moser CB, Sinner MF, Sotoodehnia N, Fontes JD, Janssens ACJW, et al. Simple risk model predicts incidence of atrial fibrillation in a racially and geographically diverse population: the CHARGE-AF consortium. J Am Heart Assoc. 2013;2:e000102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Lubitz SA, Yin X, Lin HJ, Kolek M, Smith JG, Trompet S, Rienstra M, Rost NS, Teixeira PL, Almgren P, et al. Genetic Risk Prediction of Atrial Fibrillation. Circulation. 2017;135:1311–1320. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Everett BM, Cook NR, Conen D, Chasman DI, Ridker PM, Albert CM. Novel genetic markers improve measures of atrial fibrillation risk prediction. Eur Heart J. 2013;34:2243–2251. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Sudlow C, Gallacher J, Allen N, Beral V, Burton P, Danesh J, Downey P, Elliott P, Green J, Landray M, et al. UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med. 2015;12:e1001779. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Mars N, Koskela JT, Ripatti P, Kiiskinen TTJ, Havulinna AS, Lindbohm JV, Ahola-Olli A, Kurki M, Karjalainen J, Palta P, et al. Polygenic and clinical risk scores and their impact on age at onset and prediction of cardiometabolic diseases and common cancers. Nat Med. 2020;26:549–557. [DOI] [PubMed] [Google Scholar]
- 12.Weng L-C, Preis SR, Hulme OL, Larson MG, Choi SH, Wang B, Trinquart L, McManus DD, Staerk L, Lin H, et al. Genetic Predisposition, Clinical Risk Factor Burden, and Lifetime Risk of Atrial Fibrillation. Circulation. 2018;137:1027–1038. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Carey DJ, Fetterolf SN, Davis FD, Faucett WA, Kirchner HL, Mirshahi U, Murray MF, Smelser DT, Gerhard GS, Ledbetter DH. The Geisinger MyCode community health initiative: an electronic health record-linked biobank for precision medicine research. Genet Med. 2016;18:906–913. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Steyerberg EW, Harrell FE, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001;54:774–781. [DOI] [PubMed] [Google Scholar]
- 15.Pencina MJ, D’Agostino RB, Steyerberg EW. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011;30:11–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Hulme OL, Khurshid S, Weng L-C, Anderson CD, Wang EY, Ashburner JM, Ko D, McManus DD, Benjamin EJ, Ellinor PT, et al. Development and Validation of a Prediction Model for Atrial Fibrillation Using Electronic Health Records. JACC Clin Electrophysiol. 2019;5:1331–1341. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Arruda-Olson AM, Afzal N, Priya Mallipeddi V, Said A, Moussa Pacha H, Moon S, Chaudhry AP, Scott CG, Bailey KR, Rooke TW, et al. Leveraging the Electronic Health Record to Create an Automated Real-Time Prognostic Tool for Peripheral Arterial Disease. J Am Heart Assoc. 2018;7:e009680. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.US Preventive Services Task Force, Curry SJ, Krist AH, Owens DK, Barry MJ, Caughey AB, Davidson KW, Doubeni CA, Epling JW, Kemper AR, et al. Screening for Osteoporosis to Prevent Fractures: US Preventive Services Task Force Recommendation Statement. JAMA. 2018;319:2521. [DOI] [PubMed] [Google Scholar]
- 19.Khurshid S, Healey JS, McIntyre WF, Lubitz SA. Population-Based Screening for Atrial Fibrillation. Circ Res. 2020;127:143–154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Mena LJ, Félix VG, Ochoa A, Ostos R, González E, Aspuru J, Velarde P, Maestre GE. Mobile Personal Health Monitoring for Automated Classification of Electrocardiogram Signals in Elderly. Comput Math Methods Med. 2018;2018:9128054. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Benjamin EJ, Go AS, Desvigne-Nickens P, Anderson CD, Casadei B, Chen LY, Crijns HJGM, Freedman B, Hills MT, Healey JS, et al. Research Priorities in Atrial Fibrillation Screening: A Report From a National Heart, Lung, and Blood Institute Virtual Workshop. Circulation. 2021;143:372–388. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Freedman B AF-SCREEN international collaboration. Eur Heart J. 2016;37:3490–3491. [DOI] [PubMed] [Google Scholar]
- 23.Lubitz SA, Yin X, Fontes JD, Magnani JW, Rienstra M, Pai M, Villalon ML, Vasan RS, Pencina MJ, Levy D, et al. Association between familial atrial fibrillation and risk of new-onset atrial fibrillation. JAMA. 2010;304:2263–2269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Svennberg E, Engdahl J, Al-Khalili F, Friberg L, Frykman V, Rosenqvist M. Mass Screening for Untreated Atrial Fibrillation: The STROKESTOP Study. Circulation. 2015;131:2176–2184. [DOI] [PubMed] [Google Scholar]
- 25.Lloyd-Jones LR, Zeng J, Sidorenko J, Yengo L, Moser G, Kemper KE, Wang H, Zheng Z, Magi R, Esko T, et al. Improved polygenic prediction by Bayesian multiple regression on summary statistics. Nat Commun. 2019;10:5086. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Márquez-Luna C, Gazal S, Loh P-R, Kim SS, Furlotte N, Auton A, 23andMe Research Team, Price AL. LDpred-funct: incorporating functional priors improves polygenic prediction accuracy in UK Biobank and 23andMe data sets [Internet]. Genetics; 2018. [cited 2021 Apr 5]. Available from: http://biorxiv.org/lookup/doi/10.1101/375337 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Khera AV, Chaffin M, Aragam KG, Haas ME, Roselli C, Choi SH, Natarajan P, Lander ES, Lubitz SA, Ellinor PT, et al. Genome-wide polygenic scores for common diseases identify individuals with risk equivalent to monogenic mutations. Nature Genetics. 2018;50:1219–1224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Vilhjálmsson BJ, Yang J, Finucane HK, Gusev A, Lindström S, Ripke S, Genovese G, Loh P-R, Bhatia G, Do R, et al. Modeling Linkage Disequilibrium Increases Accuracy of Polygenic Risk Scores. Am J Hum Genet. 2015;97:576–592. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Christophersen IE, Rienstra M, Roselli C, Yin X, Geelhoed B, Barnard J, Lin H, Arking DE, Smith AV, Albert CM, et al. Large-scale analyses of common and rare variants identify 12 new loci associated with atrial fibrillation. Nat Genet. 2017;49:946–952. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Kotz S, Johnson NL. Breakthroughs in statistics. New York: Springer-Verlag; 1992. [cited 2020 Apr 3]. Available from: http://catalog.hathitrust.org/api/volumes/oclc/24213036.html [Google Scholar]
- 31.Harrell FE. Evaluating the Yield of Medical Tests. JAMA. 1982;247:2543. [PubMed] [Google Scholar]
- 32.Uno H, Cai T, Pencina MJ, D’Agostino RB, Wei LJ. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med. 2011;30:1105–1117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35:1925–1931. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Cox DR. Two further applications of a model for binary regression. Biometrika. 1958;45:562–565. [Google Scholar]
- 35.Goff DC, Lloyd-Jones DM, Bennett G, Coady S, D’Agostino RB, Gibbons R, Greenland P, Lackland DT, Levy D, O’Donnell CJ, et al. 2013 ACC/AHA Guideline on the Assessment of Cardiovascular Risk: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation. 2014;129:S49–S73. [DOI] [PubMed] [Google Scholar]
- 36.Khurshid S, Kartoun U, Ashburner JM, Trinquart L, Philippakis A, Khera AV, Ellinor PT, Ng K, Lubitz SA. Performance of Atrial Fibrillation Risk Prediction Models in Over 4 Million Individuals. Circ Arrhythm Electrophysiol. 2021;14:e008997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Demler OV, Paynter NP, Cook NR. Tests of calibration and goodness-of-fit in the survival setting. Stat Med. 2015;34:1659–1680. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Lip GYH, Nieuwlaat R, Pisters R, Lane DA, Crijns HJGM. Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: the euro heart survey on atrial fibrillation. Chest. 2010;137:263–272. [DOI] [PubMed] [Google Scholar]
- 39.January CT, Wann LS, Calkins H, Field ME, Chen LY, Furie KL, Cigarroa JE, Heidenreich PA, Cleveland JC, Murray KT, et al. 2019 AHA/ACC/HRS Focused Update of the 2014 AHA/ACC/HRS Guideline for the Management of Patients With Atrial Fibrillation: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Rhythm Society. Heart Rhythm. 2019; [Google Scholar]
- 40.Vickers AJ, Elkin EB. Decision Curve Analysis: A Novel Method for Evaluating Prediction Models. Medical Decision Making. 2006;26:565–574. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Pencina MJ, D’ Agostino RB, D’ Agostino RB, Vasan RS. Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Statist Med. 2008;27:157–172. [DOI] [PubMed] [Google Scholar]
- 42.Vickers AJ, van Calster B, Steyerberg EW. A simple, step-by-step guide to interpreting decision curve analysis. Diagn Progn Res. 2019;3:18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Rooney MR, Soliman EZ, Lutsey PL, Norby FL, Loehr LR, Mosley TH, Zhang M, Gottesman RF, Coresh J, Folsom AR, et al. Prevalence and Characteristics of Subclinical Atrial Fibrillation in a Community-Dwelling Elderly Population: The ARIC Study. Circ Arrhythm Electrophysiol. 2019;12:e007390. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Welton NJ, McAleenan A, Thom HH, Davies P, Hollingworth W, Higgins JP, Okoli G, Sterne JA, Feder G, Eaton D, et al. Screening strategies for atrial fibrillation: a systematic review and cost-effectiveness analysis. Health Technol Assess. 2017;21:1–236. [DOI] [PubMed] [Google Scholar]
- 45.Lowres N, Olivier J, Chao T-F, Chen S-A, Chen Y, Diederichsen A, Fitzmaurice DA, Gomez-Doblas JJ, Harbison J, Healey JS, et al. Estimated stroke risk, yield, and number needed to screen for atrial fibrillation detected through single time screening: a multicountry patient-level meta-analysis of 141,220 screened individuals. PLoS Med. 2019;16:e1002903. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3:32–35. [DOI] [PubMed] [Google Scholar]
- 47.R Core Team (2015). R: A language and environment for statistical computing. R Foundation for Statistical Computing; Vienna, Austria. URL https://www.R-project.org/. Accessed 10-10-2019. [Google Scholar]
- 48.Littlejohns TJ, Sudlow C, Allen NE, Collins R. UK Biobank: opportunities for cardiovascular research. Eur Heart J. 2019;40:1158–1166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Khurshid S, Choi SH, Weng L-C, Wang EY, Trinquart L, Benjamin EJ, Ellinor PT, Lubitz SA. Frequency of Cardiac Rhythm Abnormalities in a Half Million Adults. Circ Arrhythm Electrophysiol. 2018;11:e006273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Borodulin K, Tolonen H, Jousilahti P, Jula A, Juolevi A, Koskinen S, Kuulasmaa K, Laatikainen T, Männistö S, Peltonen M, et al. Cohort Profile: The National FINRISK Study. Int J Epidemiol. 2018;47:696–696i. [DOI] [PubMed] [Google Scholar]
- 51.Shah SJ, Katz DH, Selvaraj S, Burke MA, Yancy CW, Gheorghiade M, Bonow RO, Huang C-C, Deo RC. Phenomapping for novel classification of heart failure with preserved ejection fraction. Circulation. 2015;131:269–279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Ho KK, Anderson KM, Kannel WB, Grossman W, Levy D. Survival after the onset of congestive heart failure in Framingham Heart Study subjects. Circulation. 1993;88:107–115. [DOI] [PubMed] [Google Scholar]
- 53.Staerk L, Wang B, Preis SR, Larson MG, Lubitz SA, Ellinor PT, McManus DD, Ko D, Weng L-C, Lunetta KL, et al. Lifetime risk of atrial fibrillation according to optimal, borderline, or elevated levels of risk factors: cohort study based on longitudinal data from the Framingham Heart Study. BMJ. 2018;k1453. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Wolf PA, D’Agostino RB, O’Neal MA, Sytkowski P, Kase CS, Belanger AJ, Kannel WB. Secular trends in stroke incidence and mortality. The Framingham Study. Stroke. 1992;23:1551–1555. [DOI] [PubMed] [Google Scholar]
- 55.Chang CC, Chow CC, Tellier LC, Vattikuti S, Purcell SM, Lee JJ. Second-generation PLINK: rising to the challenge of larger and richer datasets. Gigascience. 2015;4:7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.1000 Genomes Project Consortium, Abecasis GR, Altshuler D, Auton A, Brooks LD, Durbin RM, Gibbs RA, Hurles ME, McVean GA. A map of human genome variation from population-scale sequencing. Nature. 2010;467:1061–1073. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
