Key Points
Question
How frequently are electrocardiograms (ECG) ordered as part of an annual health examination (AHE) and what is the impact of an ECG on downstream cardiac testing?
Findings
In this population-based cohort study of 3 629 859 adult patients who had an AHE, 21.5% had an ECG within 30 days of an AHE. Those who had an ECG were 5 times more likely to have another cardiac test or consultation than those who did not.
Meaning
Electrocardiograms conducted on patients as part of an AHE are common and are associated with more cardiac tests and consultations.
This population-based cohort study examines the frequency of ECGs following an annual health examination with a primary care physician among patients with no known cardiac conditions or risk factors.
Abstract
Importance
Clinical guidelines advise against routine electrocardiograms (ECG) in low-risk, asymptomatic patients, but the frequency and impact of such ECGs are unknown.
Objective
To assess the frequency of ECGs following an annual health examination (AHE) with a primary care physician among patients with no known cardiac conditions or risk factors, to explore factors predictive of receiving an ECG in this clinical scenario, and to compare downstream cardiac testing and clinical outcomes in low-risk patients who did and did not receive an ECG after their AHE.
Design, Setting, and Participants
A population-based retrospective cohort study using administrative health care databases from Ontario, Canada, between 2010/2011 and 2014/2015 to identify low-risk primary care patients and to assess the subsequent outcomes of interest in this time frame. All patients 18 years or older who had no prior cardiac medical history or risk factors who received an AHE.
Exposures
Receipt of an ECG within 30 days of an AHE.
Main Outcomes and Measures
Primary outcome was receipt of downstream cardiac testing or consultation with a cardiologist. Secondary outcomes were death, hospitalization, and revascularization at 12 months.
Results
A total of 3 629 859 adult patients had at least 1 AHE between fiscal years 2010/2011 and 2014/2015. Of these patients, 21.5% had an ECG within 30 days after an AHE. The proportion of patients receiving an ECG after an AHE varied from 1.8% to 76.1% among 679 primary care practices (coefficient of quartile dispersion [CQD], 0.50) and from 1.1% to 94.9% among 8036 primary care physicians (CQD, 0.54). Patients who had an ECG were significantly more likely to receive additional cardiac tests, visits, or procedures than those who did not (odds ratio [OR], 5.14; 95% CI, 5.07-5.21; P < .001). The rates of death (0.19% vs 0.16%), cardiac-related hospitalizations (0.46% vs 0.12%), and coronary revascularizations (0.20% vs 0.04%) were low in both the ECG and non-ECG cohorts.
Conclusions and Relevance
Despite recommendations to the contrary, ECG testing after an AHE is relatively common, with significant variation among primary care physicians. Routine ECG testing seems to increase risk for a subsequent cardiology testing and consultation cascade, even though the overall cardiac event rate in both groups was very low.
Introduction
Low-value care, defined as care where there is a lack of benefit or where the benefits are outweighed by the potential risks, can lead to higher health care costs, patient inconvenience, and in some cases harm to patients. Resting electrocardiography (ECG) in low-risk patients undergoing an annual health examination (AHE) by a primary care physician is an example of low-value care. In 2012, the United States Preventive Services Task Force (USPSTF) recommended against routine ECG screening in low-risk patients because there is inadequate evidence for the added utility of ECG in the diagnosis of coronary disease. The Choosing Wisely campaign, launched in 2012, also saw multiple specialty societies include a recommendation against noninvasive cardiac testing in low-risk or asymptomatic patients in their top 5 lists of low-value tests, treatments, and procedures that physicians and patients should question.
As interest in curbing low-value care increases, accurate estimates of the utilization of low-value care and its costs and impact on patient outcomes are vital. While prior research has estimated the frequency of ECGs in selected low-risk patient groups, population-wide usage of ECGs in low-risk patients and in particular its impact on costs and cardiovascular outcomes is unknown. Understanding the association between low-value cardiac testing and subsequent health care utilization and outcomes is essential in the face of concerns regarding rising cardiovascular testing utilization.
The aim of this study is to quantify the frequency of ECGs ordered after an AHE in low-risk primary care patients with no prior cardiac medical history. In addition, we examined whether such ECGs are associated with subsequent cardiac tests or consultations and/or patient outcomes.
Methods
Study Design and Data Sources
We conducted a retrospective cohort study in Ontario, Canada, using linked population-based administrative health care databases. The data sets were linked using unique encoded identifiers and analyzed at the Institute for Clinical Evaluative Sciences (ICES). Patients were included if they were an Ontario resident with a valid health card number and had at least 1 claim for an annual health examination (AHE) with a primary care physician (ie, a family physician), between April 1, 2010, and March 31, 2015. Index AHE claims were identified via Ontario Health Insurance Plan (OHIP) billing codes for either a periodic health visit (PHV) or an AHE conducted on a healthy adult patient (aged 18 years or older). The general AHE code was replaced by the PHV in 2013. Similar to an AHE with a healthy patient, the newer PHV is defined as a service performed on “healthy patients who have no apparent medical problems. The physician and patient can use the appointment to discuss prevention like screening for cancer and other health issues relevant to the individual patient’s medical history and lifestyle.” Beyond the PHV having differential billing codes for different aged patients, there are no practical differences between the AHE and PHV, and so both were considered interchangeable for this anaylsis. We excluded patients residing in long-term care or with incomplete demographic data. Patients with physician visits, emergency department visits, or hospitalizations suggesting significant cardiovascular disease or cardiovascular risk within 3 years prior to their AHE were deemed high-risk (eg, prior myocardial infarction, hypertension, diabetes) and excluded through application of diagnostic codes from OHIP and International Statistical Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM) codes from the Discharge Abstract Database (DAD). Patients with prior cardiac-related procedures (eg, aortic valve replacement, coronary artery revascularization), hospitalizations, or consultations were also excluded using ICD-10 and Canadian Classification of Health Interventions (CCI) codes. We excluded patients with a history of diabetes and hypertension using the Ontario Diabetes Database and the Ontario Hypertension Database. eAppendix 1 in the Supplement details the full extent of inclusion and exclusion criteria, including data sources and associated codes.
Several data sources were used to define patient- and physician-level characteristics to describe the patient cohort and create multivariable statistical models. Demographic data on patients (ie, age, sex, rurality), were obtained from the Registered Persons Database (RDPB). Quintiles of median neighborhood income were used to approximate patients’ socioeconomic status. Any hospitalizations (except those for cardiac-related reasons) within 3 years prior of the index examination were determined from DAD ICD-10 codes. OHIP and DAD were used to determine patients’ history of cancer, chronic obstructive pulmonary disease (COPD), asthma, dementia, mental illness, and rheumatoid arthritis within 3 years prior to study entry. Whether or not a patient was rostered to a regular primary care physician was determined through cross-referencing Client Agency Program Enrolment (CAPE) tables and OHIP fee codes. Ontario introduced formal rostering in its primary care patient enrolment models in 2001 and during the study period most (70%) Ontarian patients were rostered. Physician-level variables were primarily identified by linking physicians from patients’ OHIP claims with the ICES Physicians Database (IPDB) to determine physician sex, years since graduation, and international medical graduate status. The CAPE tables and OHIP claims were used to classify primary care practice groups (hereby referred to as practices). These practices consisted of 3 or more physicians submitting joint claims to the Ministry of Health and Long Term Care for reimbursement (ie, billing groups). Payment models were noted and any practices consisting of fewer than 3 physicians were excluded for privacy reasons.
Research ethics approval was received from Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada. Patient consent was waived because all data were deidentified.
Low-Value Cardiac Care
The primary outcome was low-value cardiac care, defined as patient receipt of at least 1 ECG within 30 days of a patient’s index AHE. Ontario Health Insurance Plan claims were used to identify any electrocardiography performed on the patient in that timeframe.
Downstream cardiac care was identified using OHIP claims. Receipt of either a consultation with a cardiologist or cardiac surgeon, transthoracic echocardiogram (TTE), stress test, nuclear stress test, and/or cardiac catheterization procedure were measured where claims occurred within 90 days of an eligible AHE.
Cardiac outcomes, including death, cardiac-related hospitalizations, and coronary revascularization procedures were captured within 12 months of the index AHE. Death was identified via the RPBD, whereas the latter events were identified using DAD ICD-10 codes and CCI codes, respectively. Percutaneous coronary interventions (PCI) and coronary artery bypass grafts (CABG) were also identified using OHIP claims data.
Statistical Analysis
Unadjusted 30-day ECG rates were calculated separately at the level of individual regions, practices, and physicians between fiscal years 2010/2011 and 2014/2015. Regions were defined by Ontario’s 14 Local Health Integration Networks (LHINs)—geographically organized administrative regions that plan, integrate, and fund local health care. Variation in ordering rates was assessed at each level by calculating the coefficient of quartile deviation, a potentially more robust alternative to the coefficient of variation. All statistical analyses were performed using SAS statistical software (version 9.4, SAS Institute).
Hierarchical random-intercept multivariable logistic regression models were used to assess the association of patient- and physician-level characteristics with the occurrence of an ECG within 30 days post-AHE. Owing to the physician-level characteristics included in these models, only patients who could be linked to a family physician belonging to an identifiable practice were included. To test the sensitivity of our primary outcome definition, we ran a similar analysis including only patients that had an ECG on the same day as an AHE.
Through inclusion of random intercepts for each practice, it was possible to calculate the median odds ratio (MOR), a measure of the heterogeneity in ordering a post-AHE ECG among practices. If one were to repeatedly sample 2 participants with the same covariates from different practices randomly, then the MOR is the relative odds difference between the participant at higher risk of receiving an ECG and the participant at the lower risk of receiving an ECG in the median case. The MOR always has a value greater than or equal to 1 because it places the patient belonging to the practice with higher odds of ordering an ECG in the numerator. The value is directly comparable to a fixed effects OR, and is based on a between-practice variance estimate that is adjusted for all other factors present in a multilevel model. For example, a MOR of 2.00 suggests, in the median case, 100% higher odds of receiving an ECG at 1 practice vs another. The intracluster correlation coefficient (ICC) was also calculated using the linear threshold method to estimate the proportion of total variance in ECG ordering that can be attributed to between-practice differences.
In addition, hierarchical random-intercept multivariable logistic regression models were used to assess the impact of having postvisit ECG on downstream cardiac care and adverse patient outcomes. For each of these additional models, receipt of an ECG within 30 days post-AHE was the primary exposure of interest and included as a covariate. To account for the possibility that a physician’s propensity to order low-value ECGs may be associated with the propensity to order downstream care we determined each physician’s ECG ordering rate (ie, the proportion of patient AHEs with an ECG ordered within 30 days) and then created a variable that stratified physicians into quintiles based on their individual rates. This factor representing physician ECG ordering quintile was then included in the regression models for both downstream care and outcomes.
Results
ECG Status and Corresponding Characteristics
The study cohort consisted of 3 629 859 adult patients with at least 1 AHE between fiscal years 2010/2011 and 2014/2015 in Ontario (Figure 1). Demographic and clinical data for all eligible patients are presented in Table 1, along with characteristics of their corresponding primary care physicians and practice groups. Overall, 21.5% of adult patients had a potentially low-value ECG within 30 days of their index AHE, 51.7% of ECG claims occurred on the same day as the AHE, and 78.5% of ECG claims were within 7 days of an AHE. Patients who had at least 1 ECG in the defined follow-up period were more likely to be male and were generally older than those who did not have an ECG. The comorbidity burden was low for the entire cohort, though there were some statistically significant differences between groups.
Table 1. Patient- and Physician-Level Characteristics Based on ECG Claim Status 30 Days After Patient’s Index Annual Health Examination, n = 3 629 859.
Characteristica | No. (%) | |
---|---|---|
Without ECG (n = 2 849 676) | With ECG (n = 780 183) | |
Patient level | ||
Age, mean (95% CI), y | 37.27 (37.26-37.29) | 45.62 (45.59-45.65) |
Sex | ||
Female | 1 750 378 (61.4) | 398 494 (51.1) |
Male | 1 099 298 (38.6) | 381 689 (48.9) |
Rurality | ||
Rural | 242 864 (8.5) | 34 195 (4.4) |
Nonrural | 2 606 812 (91.5) | 745 988 (95.6) |
Neighborhood income quintile | ||
1 (Lowest) | 497 985 (17.5) | 135 679 (17.4) |
2 | 536 914 (18.8) | 150 990 (19.4) |
3 | 568 914 (19.9) | 156 657 (20.1) |
4 | 619 139 (21.7) | 169 698 (21.8) |
5 (Highest) | 627 204 (22.0) | 167 159 (21.4) |
Charlson Index, mean (95% CI) | 0 (0-0) | 0.01 (0.01-0.01) |
Hospital admission in past 3 y | 203 998 (7.2) | 36 205 (4.6) |
Cancer | 240 641 (8.4) | 95 037 (12.2) |
COPD | 60 405 (2.1) | 27 564 (3.5) |
Asthma | 357 106 (12.5) | 76 638 (9.8) |
Mental health | 382 551 (13.4) | 104 897 (13.4) |
Dementia | 5462 (0.2) | 2095 (0.3) |
Rheumatologic disease | 71 248 (2.5) | 36 954 (4.7) |
Primary care physicianb | ||
Yes | 2 505 716 (87.9) | 692 605 (88.8) |
No | 343 960 (12.1) | 87 578 (11.2) |
Physician levelc | ||
Sex | ||
Female | 1 018 811 (40.8) | 219 399 (31.8) |
Male | 1 477 054 (59.2) | 470 976 (68.2) |
IMG | 549 343 (22.0) | 188 113 (27.2) |
Years since graduation, mean (95% CI)d | 25.50 (25.49-25.51) | 27.76 (27.74-27.79) |
Primary care practice structure | ||
Fee-for-service | 528 026 (21.2) | 152 988 (22.2) |
Family health group | 912 547 (36.6) | 338 885 (49.1) |
Family health network | 20 577 (0.8) | 2015 (0.3) |
Family health organization | 505 475 (20.3) | 101 282 (14.7) |
Family health team | 426 410 (17.1) | 59 852 (8.7) |
Other | 102 830 (4.1) | 35 353 (5.1) |
Abbreviations: AHE, annual health examination; COPD, chronic obstructive pulmonary disease; ECG, electrocardiograms; IMG, international medical graduate.
For all characteristics (except mental health), P < .001 across groups defined by post-AHE ECG status,
Variable indicates whether patients were rostered to a primary care physician at study entry.
Physician-level variables only available for those patients rostered to a primary care physician with a reported physician number for linkage (n = 3 186 240).
Calculated as the mean number of years since graduation among all physicians at a given practice.
Variation by Region, Practice, and Physician
Regional variation of ECG ordering ranged from a low of 0.7% in the North West LHIN to 24.4% in the Central LHIN (coefficient of quartile deviation [CQD], 0.71) (eAppendix 2.0 in the Supplement). Among 679 practices, the proportion of patients who received an ECG post-AHE ranged from 1.8% to 76.1% (CQD, 0.50) as shown in Figure 2. Substantial variation was also observed across individual primary care physicians (range, 1.1%-94.9%; CQD, 0.54) as shown in eAppendix 2.1 in the Supplement. Among the 8036 primary care physicians included, 7.2% ordered ECGs on more than 50% of their patients following an AHE.
Factors Associated With Ordering an ECG Post-AHE
From the initial study cohort detailed in Figure 1, a total of 2 873 357 adult patients who reported belonging to, and could be linked to, an established practice were eligible for modeling of post-AHE ECG receipt status.
As described in Table 2, older age was associated with increased odds of having an ECG within 30 days after an AHE. Patients living in a rural area were less likely to have an ECG than those living in urban areas. Patients with rheumatological disease and cancer had increased odds of having an ECG. Physician factors associated with ECG ordering were male sex, international medical graduate status, and having practiced for longer than 30 years. The interpractice variation in ECG ordering was significant. The MOR was 2.50, indicating that the odds of a patient having a post-AHE ECG at 1 randomly selected high-ordering practice were 150% greater than a patient with the same characteristics at another randomly selected, low-ordering practice. Aside from patient age, the effect of a patients’ practice membership on receipt of an ECG was stronger than the association observed between the outcome and any other patient- or physician-level factors. The ICC estimate indicates that 21.9% of the total variation in post-AHE ECG use can be attributed to practice-level variation. Based on the sensitivity analysis, all of the characteristics significantly associated with increased odds of having an ECG at 30 days post-AHE were similarly associated with same-day receipt of an ECG (eAppendix 2.2 in the Supplement).
Table 2. Association of Patient- and Physician-Level Characteristics With Having a Potentially Low-Value ECG Within 30 Days After an Annual Health Examination in 2 873 357 Patientsa.
Fixed Effects | Odds Ratio (95% CI)b |
---|---|
Patient characteristics | |
Age group, y | |
45-64 vs 18-44 | 3.46 (3.44-3.48) |
≥65 vs 18-44 | 4.73 (4.67-4.79) |
Male vs female | 1.10 (1.09-1.11) |
Rural | 0.78 (0.77-0.80)c |
Neighborhood income quintile | |
2 vs 1 (Lowest) | 1.07 (1.06-1.08) |
3 vs 1 (Lowest) | 1.11 (1.10-1.12) |
4 vs 1 (Lowest) | 1.14 (1.13-1.15) |
5 vs 1 (Lowest) | 1.12 (1.11-1.13) |
Hospital admission in past 3 years | 1.02 (1.00-1.03) |
Cancer | 1.45 (1.44-1.47) |
COPD | 1.07 (1.05-1.08) |
Asthma | 0.86 (0.85-0.87) |
Mental health | 1.06 (1.05-1.07) |
Dementia | 0.86 (0.81-0.91) |
Rheumatologic disease | 1.27 (1.25-1.29) |
Physician characteristics | |
Male vs female | 1.11 (1.10-1.12) |
IMG | 1.13 (1.12-1.14) |
Years since graduation (mean) | |
21-30 vs 0-20 | 1.04 (1.04-1.05) |
>30 vs 0-20 | 1.15 (1.14-1.16) |
Organizational structure | |
Family health group vs FFS | 1.55 (1.54-1.57) |
Family health network vs FFS | 1.22 (1.06-1.40) |
Family health organization vs FFS | 1.31 (1.28-1.35) |
Family health team vs FFS | 0.99 (0.97-1.02) |
Other vs FFS | 1.64 (1.59-1.70) |
Random effect | |
Practicec | 2.50 (2.40-2.60) |
Abbreviations: COPD, chronic obstructive pulmonary disease; ECG, electrocardiograms; FFS, fee for service.
All reported values based on SAS (version 9.4) PROC GLIMMIX output; model estimation method = RSPL; denominator degrees of freedom estimation method = between and within; covariance structure = standard variance. P < .05 for all variables except family health team vs FFS (P=.71)
All odds ratios presented are adjusted for all other factors in the table.
Median odds ratio reported with 95% CI in parentheses.
Association of Post-AHE ECG With Downstream Cardiac Care
Overall, 5.3% of patients with an AHE had a cardiac-related consultation, test, or procedure within 90 days following their primary care physician AHE. Cardiac care included consultations with a cardiologist or cardiac surgeon (n = 36 085), transthoracic echocardiograms (TTE, n = 83 463), stress tests (n = 42 923), nuclear stress tests (n = 15 651), and cardiac catheterizations (n = 1830).
Table 3 presents the final multivariable models for downstream cardiac care. After adjusting for physician ECG ordering quintile, patients with an ECG within 30 days of an AHE had significantly higher odds of having further cardiac tests or consultations compared with those who did not. There was significant interpractice variation in ordering downstream care (cardiac consultations: MOR, 1.47; ICC, 4.7%; TTEs: MOR, 1.60; ICC, 6.85%), and either form of stress test (stress test: MOR, 1.71; ICC, 8.85%; nuclear stress test: MOR, 1.56; ICC, 6.23%). Cardiac catheterization rate was low (0.29% vs non-ECG 0.03%) and attempts to model resulted in nonconvergence in the statistical software (eAppendix 2.3 in the Supplement). Sensitivity analyses for ECGs conducted on the same day showed a similar association with higher odds of ordering additional cardiac testing within 90 days (eAppendix 2.4 in the Supplement).
Table 3. Patient- and Physician-Level Indicators for a Downstream Cardiac Consultation, Test, or Procedure in 2 352 324 Patients Within 3 Months After an Annual Health Examination Based on a Multilevel Logistic Regression With a Random Intercept for Practice-Level Effects .
Fixed Effects | OR (95% CI)a | |||
---|---|---|---|---|
Cardiac Consultations (n = 36 085) |
TTE (n = 83 463) |
Stress Test (n = 42 923) |
Nuclear Stress Test (n = 15 651) |
|
Patient characteristics | ||||
ECG by AHE after 30 daysb | 5.38 (5.24-5.52)c | 7.09 (6.97-7.22)c | 6.48 (6.33-6.64)c | 4.21 (4.04-4.38)c |
Physician ECG ordering quintile | ||||
2 vs 1 (lowest) | 1.03 (0.99-1.08) | 1.18 (1.14-1.23)c | 1.08 (1.03-1.13)c | 1.01 (0.94-1.09)c |
3 vs 1 (lowest) | 1.00 (0.95-1.04) | 1.28 (1.23-1.33)c | 1.21 (1.15-1.26)c | 1.03 (0.95-1.11) |
4 vs 1 (lowest) | 0.73 (0.70-0.77)c | 1.09 (1.05-1.13)c | 0.91 (0.87-0.96)c | 0.91 (0.85-0.99)c |
5 vs 1 (lowest) | 0.37 (0.35-0.39)c | 0.60 (0.58-0.63)c | 0.53 (0.50-0.55)c | 0.61 (0.57-0.66)c |
Age group, y | ||||
45-64 vs 18-44 | 1.62 (1.58-1.67)c | 1.27 (1.25-1.29)c | 1.81 (1.77-1.85)c | 3.47 (3.33-3.63)c |
≥65 vs 18-44 | 2.77 (2.68-2.87)c | 1.97 (1.92-2.02)c | 1.74 (1.68-1.81)c | 6.25 (5.92-6.59)c |
Male vs female | 1.75 (1.71-1.79)c | 1.23 (1.21-1.25)c | 1.79 (1.75-1.83)c | 1.32 (1.28-1.37)c |
Neighborhood income quintile | ||||
2 vs 1 (Lowest) | 1.02 (0.98-1.05) | 0.91 (0.89-0.93)c | 0.95 (0.92-0.98)c | 0.95 (0.90-1.01) |
3 vs 1 (Lowest) | 1.01 (0.98-1.05) | 0.92 (0.90-0.95)c | 0.97 (0.94-1.01) | 0.94 (0.89-0.99)c |
4 vs 1 (Lowest) | 1.03 (0.99-1.07) | 0.89 (0.87-0.91)c | 0.97 (0.94-1.01) | 0.95 (0.90-1.00) |
5 vs 1 (Lowest) | 1.04 (1.00-1.07) | 0.89 (0.87-0.92)c | 0.96 (0.93-0.99)c | 0.93 (0.88-0.98)c |
Hospital admission last 3 y | 1.48 (1.42-1.54)c | 0.94 (0.91-0.97)c | 0.85 (0.81-0.90)c | 1.02 (0.95-1.10) |
Cancer | 1.75 (1.70-1.80)c | 1.09 (1.07-1.12)c | 1.02 (0.99-1.05) | 1.77 (1.70-1.84)c |
COPD | 1.16 (1.11-1.21)c | 1.04 (1.00-1.07) | 1.03 (0.98-1.08) | 1.25 (1.17-1.33)c |
Asthma | 1.06 (1.02-1.09)c | 0.99 (0.97-1.01) | 0.94 (0.91-0.97)c | 1.00 (0.95-1.06) |
Mental health | 1.23 (1.20-1.27)c | 0.99 (0.97-1.01) | 1.00 (0.97-1.03) | 1.09 (1.04-1.14)c |
Dementia | 1.48 (1.31-1.68)c | 0.98 (0.88-1.11) | 0.89 (0.75-1.06) | 1.00 (0.82-1.23) |
Rheumatologic disease | 1.44 (1.39-1.51)c | 1.03 (1.00-1.06) | 0.97 (0.93-1.02) | 1.21 (1.14-1.28)c |
Rural | 1.02 (0.97-1.07) | 0.98 (0.88-1.10) | 1.00 (0.96-1.05) | 0.87 (0.8-0.94)c |
Physician characteristics | ||||
Sex | ||||
Male | 0.96 (0.94-0.99)c | 1.00 (0.98-1.01) | 0.96 (0.93-0.98)c | 1.09 (1.05-1.13)c |
Female | 1 [Reference] | 1 [Reference] | 1 [Reference] | 1 [Reference] |
IMG | 1.14 (1.11-1.17)c | 1.14 (1.12-1.16)c | 1.11 (1.08-1.14)c | 1.19 (1.15-1.24)c |
Years since graduation (mean), y | ||||
21-30 vs 0-20 | 0.93 (0.90-0.95)c | 0.95 (0.93-0.96)c | 0.87 (0.85-0.90)c | 0.88 (0.85-0.92)c |
>30 vs 0-20 | 0.89 (0.87-0.92)c | 0.88 (0.87-0.90)c | 0.77 (0.75-0.80)c | 0.86 (0.82-0.90)c |
Organizational structure | ||||
Family health group vs FFS | 0.87 (0.83-0.90)c | 0.85 (0.83-0.87)c | 0.82 (0.79-0.85)c | 0.87 (0.82-0.93)c |
Family health network vs FFS | 1.01 (0.74-1.37) | 1.15 (0.89-1.50) | 0.59 (0.41-0.85)c | 0.79 (0.49-1.27) |
Family health organization vs FFS | 0.88 (0.83-0.92)c | 0.83 (0.79-0.86)c | 0.89 (0.84-0.94)c | 0.79 (0.73-0.86)c |
Family health team vs FFS | 0.98 (0.93-1.04) | 0.92 (0.88-0.96)c | 0.98 (0.92-1.05) | 0.82 (0.76-0.90)c |
Other vs FFS | 0.87 (0.78-0.97)c | 0.55 (0.52-0.59)c | 0.87 (0.78-0.97)c | 0.83 (0.70-0.97)c |
Random effects | ||||
Practiced | 1.47 (1.45-1.49)c | 1.60 (1.57-1.63)c | 1.71 (1.68-1.75)c | 1.56 (1.53-1.60)c |
Abbreviations: AHE, annual health examination; COPD, chronic obstructive pulmonary disease; ECG, electrocardiograms; OR, odds ratio; TTE, transthoracic echocardiogram.
All odds ratios presented are adjusted for all other factors in the table. All reported values based on SAS (version 9.4) PROC GLIMMIX output; model estimation method = RSPL; denominator degrees of freedom estimation method = between and within; covariance structure = standard variance.
Indicates patient had an ECG within 30 days after AHE.
P < .05.
Median odds ratio reported with 95% CI in parentheses.
The overall rates of adverse clinical outcomes at 1-year post-AHE were extremely low in both groups. The unadjusted rate of each outcome was higher in the ECG vs the non-ECG group, including death (0.19% vs 0.16%), cardiac-related hospitalizations (0.46% vs 0.12%), and coronary revascularizations (0.20% vs 0.04%) (eAppendix 2.5 in the Supplement). Only the descriptive statistics are presented for these outcomes because their corresponding regression models each failed to converge in the statistical software.
Discussion
In this large, retrospective cohort study, we found that despite recommendations against ECGs in low-risk patients undergoing a routine AHE with a primary care physician, this practice seemed to be common. Importantly, we demonstrated that patients who received an ECG 30 days post-AHE were more than 5 times more likely to also receive another cardiac test, procedure, or consultation with a specialist. These downstream cardiac tests and procedures also demonstrated significant practice variation even after adjustment for patient and physician factors. Finally, both groups of patients exhibited low combined rates of death, cardiac-related hospitalizations, and coronary revascularizations in the ensuing year.
These findings support earlier results that show high rates of potentially low-value ECGs in primary care patients. Previous studies have shown the frequency of ECGs in low-risk patients to be between 9% to 12% in various populations, including both Medicare and commercial payers, with similar degrees of regional variation to this study. Where this study differs is that it includes an entire population from a single-payer, publicly funded system, allowing for a more robust analysis of ordering practices. We also found significant variation in ordering between regions, practices, and even physicians that cannot be explained by patient factors such as comorbidities. This striking ordering variation, which has been noted in both primary care and hospital-based ordering practices in previous work, provides potential opportunities for improvements in ordering practices, particularly among high-ordering physicians, because there were a small number of physicians that ordered ECGs on most of their patients. Most importantly, we demonstrate that ECGs in this low-risk population leads to further downstream cardiac testing and consultations that add to health care costs.
One of the most important findings of this study was the higher rates of further cardiac testing or cardiology consultations in patients who had an ECG. The diagnostic cascade is a described phenomenon where higher rates of noninvasive diagnostic testing lead to higher rates of more invasive diagnostic testing and therapeutic interventions. For example, Shah and colleagues found higher rates of routine stress testing after coronary revascularization lead to higher rates of repeated revascularization with no impact on death or repeated myocardial infarction. To date, however, this finding has not been shown in resting ECG testing, which is most commonly done in primary care offices in patients who often do not have a medical history of cardiac disease. The higher rates of further testing or consultations, like ECG ordering, were independent of patient comorbidities; it is probable that incidentally discovered abnormalities found on ECG precipitated further testing and cardiology consultations.
The low event rates in patients who received and did not receive an ECG as part of an AHE add more evidence to the recommendation against using ECGs as a risk stratification tool. Systematic reviews have found no randomized clinical trials or large prospective cohort studies on the effects of ECGs ordered in low-risk patients vs no ECG on clinical outcomes or costs. Despite this lack of evidence there still remains some debate as to the utility of ECGs as a risk stratification tool. Our findings in a large, population-based cohort study show very low event rates that were less than 1% in both groups, despite higher rates of cardiovascular investigations in the ECG group. This data lends further evidence to the current guidelines recommending against routine ECGs in low-risk patients, which appear to lead to higher health care utilization with questionable clinical benefit.
The results of this study have considerable health care policy implications. First, when selecting overuse metrics for quality improvement initiatives, consideration should be given to the impact on downstream testing and outcomes. Some of the past criticism of the Choosing Wisely recommendations is that they are often of seemingly little consequence, with specialty societies avoiding big-ticket items like surgical procedures, or more advanced diagnostic tests. Our findings suggest that even low-cost procedures, like ECGs in low-risk patients occur with considerable frequency, and importantly can lead to more advanced testing that adds costs with little potential benefit to patients. Second, measurement of low-value care should also attempt to quantify the impact on health outcomes for patients. Finally, quality improvement interventions to reduce low-value care could be designed to more effectively target practices and physicians with high ordering rates to reduce the prevalence of low-value cardiac testing, and the unexplained ordering variation. In particular, prior research has shown that the use of audit and feedback, decision support tools, and education could reduce low-value cardiac testing, and similar types of interventions could be used in some combination to reduce low-value care.
Limitations
The results must be interpreted in the context of several limitations. Administrative databases do not provide important clinical information, such as presence of symptoms or abnormal physical examination findings that are necessary to determine appropriateness of further testing orders. In this instance, we are unable to determine whether a patient had an ECG for screening, or if the patient had symptoms or signs that warranted a diagnostic test. However, usually a visit will not be coded as an AHE if there is a specific cardiac symptom that is the focus of the assessment. It is also possible that some physicians ordered an ECG prior to the AHE that were not captured. We also do not have the results of the ECGs, which would almost certainly have influenced further cardiac investigations. Finally, it is possible that practice or regional factors not identified by available data may play a role in the degree of ordering variation seen, which may be an opportunity for future studies. Despite these limitations, this study provides important new information about the use and impact of low-value cardiac testing in the primary care setting.
Conclusions
In this large, population-based retrospective study, we found 21.5% of low-risk patients received an ECG within 30 days following an AHE, with significant regional-, practice-, and physician-level ordering variation. Moreover, low-risk patients who received an ECG also had a higher likelihood of further cardiac tests, procedures, and cardiologist consultations.
References
- 1.Institute of Medicine Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001. [PubMed] [Google Scholar]
- 2.Wennberg JE, Fisher ES, Skinner JS. Geography and the debate over Medicare reform. Health Aff (Millwood). 2002;(suppl web exclusives):W96-114. [DOI] [PubMed] [Google Scholar]
- 3.Levinson W, Kallewaard M, Bhatia RS, Wolfson D, Shortt S, Kerr EA; Choosing Wisely International Working Group . ‘Choosing Wisely’: a growing international campaign. BMJ Qual Saf. 2015;24(2):167-174. [DOI] [PubMed] [Google Scholar]
- 4.Chou R, Arora B, Dana T, Fu R, Walker M, Humphrey L. Screening asymptomatic adults with resting or exercise electrocardiography: a review of the evidence for the U.S. Preventive Services Task Force. Ann Intern Med. 2011;155(6):375-385. [DOI] [PubMed] [Google Scholar]
- 5.Wolfson D, Santa J, Slass L. Engaging physicians and consumers in conversations about treatment overuse and waste: a short history of the choosing wisely campaign. Acad Med. 2014;89(7):990-995. [DOI] [PubMed] [Google Scholar]
- 6.Bhatia RS, Levinson W, Shortt S, et al. . Measuring the effect of Choosing Wisely: an integrated framework to assess campaign impact on low-value care. BMJ Qual Saf. 2015;24(8):523-531. [DOI] [PubMed] [Google Scholar]
- 7.Colla CH, Sequist TD, Rosenthal MB, Schpero WL, Gottlieb DJ, Morden NE. Use of non-indicated cardiac testing in low-risk patients: Choosing Wisely. BMJ Qual Saf. 2015;24(2):149-153. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Rosenberg A, Agiro A, Gottlieb M, et al. . Early trends among seven recommendations from the Choosing Wisely Campaign. JAMA Intern Med. 2015;175(12):1913-1920. [DOI] [PubMed] [Google Scholar]
- 9.Kale MS, Bishop TF, Federman AD, Keyhani S. Trends in the overuse of ambulatory health care services in the United States. JAMA Intern Med. 2013;173(2):142-148. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Blecker S, Bhatia RS, You JJ, et al. . Temporal trends in the utilization of echocardiography in Ontario, 2001 to 2009. JACC Cardiovasc Imaging. 2013;6(4):515-522. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lucas FL, DeLorenzo MA, Siewers AE, Wennberg DE. Temporal trends in the utilization of diagnostic testing and treatments for cardiovascular disease in the United States, 1993-2001. Circulation. 2006;113(3):374-379. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.The College of Family Physicians of Canada (CFPC) Annual physical examination practices by province/territory in Canada. CFPC; 2013. Nov. http://www.cfpc.ca/CFPC-PT-Annual-Exam. Accessed January 2, 2017.
- 13.Government of Ontario Periodic personal health visit. Government of Ontario; 2013. http://www.health.gov.on.ca/en/pro/programs/phys_services/docs/periodic_health_visit_is_ea_en.pdf. Accessed January 2, 2017.
- 14.Colla CH, Morden NE, Sequist TD, Schpero WL, Rosenthal MB. Choosing wisely: prevalence and correlates of low-value health care services in the United States. J Gen Intern Med. 2015;30(2):221-228. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Schwartz AL, Landon BE, Elshaug AG, Chernew ME, McWilliams JM. Measuring low-value care in Medicare. JAMA Intern Med. 2014;174(7):1067-1076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Statistics Canada Postal Code Conversion File Plus (PCCF+), reference guide. Statistics Canada; 2013. http://data.library.utoronto.ca/datapub/codebooks/cstdli/pccf_health/pccf6a1/82-F0086-XDB-2014v6a-eng.pdf. Accessed December 17, 2016.
- 17.The College of Family Physicians (CFPC) Best advice: Patient rostering in family practice. CFPC; Nov 2012. http://www.patientsmedicalhome.ca/files/uploads/PMH_Best_Advice_Rostering.pdf. Accessed January 21, 2017.
- 18.Kiran T, Kopp A, Moineddin R, Glazier RH. Longitudinal evaluation of physician payment reform and team-based care for chronic disease management and prevention. CMAJ. 2015;187(17):E494-E502. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Glazier RH, Hutchinson B, Kopp A Comparison of family health teams to other primary care models, 2004/05 to 2011/12. Institute for Clinical Evaluative Sciences (ICES); November 2015. https://www.ices.on.ca/Publications/Atlases-and-Reports/2015/Comparison-of-Family-Health-Teams. Accessed April 14, 2017.
- 20.Bonett DG. Confidence interval for a coefficient of quartile variation. Comput Stat Data Anal. 2006;50(11):2953-2957. [Google Scholar]
- 21.Larsen K, Merlo J. Appropriate assessment of neighborhood effects on individual health: integrating random and fixed effects in multilevel logistic regression. Am J Epidemiol. 2005;161(1):81-88. [DOI] [PubMed] [Google Scholar]
- 22.Snijders T A B, Bosker RJ. Multilevel analysis: an introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage; 1999. [Google Scholar]
- 23.Merlo J, Chaix B, Ohlsson H, et al. . A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. J Epidemiol Community Health. 2006;60(4):290-297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Pendrith C, Bhatia M, Ivers NM, et al. . Frequency of and variation in low-value care in primary care: a retrospective cohort study. CMAJ Open. 2017;5(1):E45-E51. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Kirkham KR, Wijeysundera DN, Pendrith C, et al. . Preoperative testing before low-risk surgical procedures. CMAJ. 2015;187(11):E349-E358. doi: 10.1503/cmaj.150174 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Shah BR, McCoy LA, Federspiel JJ, et al. . Use of stress testing and diagnostic catheterization after coronary stenting: association of site-level patterns with patient characteristics and outcomes in 247,052 Medicare beneficiaries. J Am Coll Cardiol. 2013;62(5):439-446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Wennberg DE, Kellett MA, Dickens JD, Malenka DJ, Keilson LM, Keller RB. The association between local diagnostic testing intensity and invasive cardiac procedures. JAMA. 1996;275(15):1161-1164. [PubMed] [Google Scholar]
- 28.Lucas FL, Siewers AE, Malenka DJ, Wennberg DE. Diagnostic-therapeutic cascade revisited: coronary angiography, coronary artery bypass graft surgery, and percutaneous coronary intervention in the modern era. Circulation. 2008;118(25):2797-2802. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Shah BR, Cowper PA, O’Brien SM, et al. . Patterns of cardiac stress testing after revascularization in community practice. J Am Coll Cardiol. 2010;56(16):1328-1334. [DOI] [PubMed] [Google Scholar]
- 30.Ashley EA, Raxwal V, Froelicher V. An evidence-based review of the resting electrocardiogram as a screening technique for heart disease. Prog Cardiovasc Dis. 2001;44(1):55-67. [DOI] [PubMed] [Google Scholar]
- 31.United States Preventative Services Task Force (USPSTF) Coronary heart disease: screening with electrocardiography. USPSTF; 2012. https://www.uspreventiveservicestaskforce.org/Page/Document/UpdateSummaryFinal/coronary-heart-disease-screening-with-electrocardiography. Accessed January 4, 2017.
- 32.Colla CH. Swimming against the current—what might work to reduce low-value care? N Engl J Med. 2014;371(14):1280-1283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Greenland P, Alpert JS, Beller GA, et al. ; American College of Cardiology Foundation/American Heart Asscoiation Tasl Force on Practice Guidelines . 2010 ACCF/AHA guideline for assessment of cardiovascular risk in asymptomatic adults: executive summary: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. Circulation. 2010;122(25):2748-2764. [DOI] [PubMed] [Google Scholar]
- 34.Chaudhuri D, Montgomery A, Gulenchyn K, Mitchell M, Joseph P. Effectiveness of quality improvement interventions at reducing inappropriate cardiac imaging: a systematic review and meta-analysis. Circ Cardiovasc Qual Outcomes. 2016;9(1):7-13. [DOI] [PubMed] [Google Scholar]
- 35.Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and patient outcomes. Cochrane Database Syst Rev. http://www.cochrane.org/CD000259/EPOC_audit-and-feedback-effects-on-professional-practice-and-patient-outcomes. Accessed January 5, 2017. [DOI] [PMC free article] [PubMed]
- 36.Dudzinski DM, Bhatia RS, Mi MY, Isselbacher EM, Picard MH, Weiner RB. Effect of an educational intervention on the rate of rarely appropriate outpatient echocardiograms ordered by attending academic cardiologists: a randomized clinical trial. JAMA Cardiol. 2016;1(7):805-812. [DOI] [PubMed] [Google Scholar]
- 37.Jaglal SB, McIsaac WJ, Hawker G, Jaakkimainen L, Cadarette SM, Chan BT. Patterns of use of the bone mineral density test in Ontario, 1992-1998. CMAJ. 2000;163(9):1139-1143. [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.