Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2013 Mar 27.
Published in final edited form as: Circulation. 2012 Feb 23;125(12):1491–1500. doi: 10.1161/CIRCULATIONAHA.111.066902

Predictors of Long-Term Survival Following Coronary Artery Bypass Grafting Surgery: Results from The Society of Thoracic Surgeons Adult Cardiac Surgery Database (The ASCERT Study)

David M Shahian 1, Sean M O'Brien 2, Shubin Sheng 2, Frederick L Grover 3, John E Mayer 4, Jeffrey P Jacobs 5, Jocelyn M Weiss 6, Elizabeth R DeLong 2, Eric D Peterson 2, William S Weintraub 7, Maria V Grau-Sepulveda 2, Lloyd W Klein 8, Richard E Shaw 9, Kirk Garratt 10, Issam Moussa 11, Cynthia M Shewan 12, George D Dangas 13, Fred H Edwards 14
PMCID: PMC3350815  NIHMSID: NIHMS361852  PMID: 22361330

Abstract

Background

Most survival prediction models for coronary artery bypass grafting surgery (CABG) are limited to in-hospital or 30-day endpoints. We estimate a long-term survival model using data from the Society of Thoracic Surgeons Adult Cardiac Surgery Database and Centers for Medicare and Medicaid Services (CMS).

Methods and Results

The final study cohort included 348,341 isolated CABG patients ≥ 65 years of age, discharged between January 1, 2002 and December 31, 2007 from 917 STS-participating hospitals, randomly divided into training (n = 174,506) and validation (n = 173,835) samples. Through linkage with CMS claims data, we ascertained vital status from date of surgery through December 31, 2008 (1 – 6 year follow-up). Because the proportional hazards assumption was violated, we fit four Cox regression models conditional on being alive at the beginning of the following intervals: 0 –30 days, 31 – 180 days, 181 days – 2 years, > 2 years. Kaplan-Meier estimated mortality was 3.2% at 30 days, 6.4% at 180 days, 8.1% at one-year, and 23.3% at 3 years of follow-up. Harrell's C statistic for predicting overall survival time was 0.732. Some risk factors (e.g., emergency status, shock, reoperation) were strong predictors of short-term outcome but, for early survivors, became non-significant within 2 years. The adverse impact of some other risk factors (e.g., dialysis-dependent renal failure, insulin-dependent diabetes) continued to increase.

Conclusions

Using clinical registry data and longitudinal claims data, we developed a long-term survival prediction model for isolated CABG. This provides valuable information for shared decision-making, comparative effectiveness research, quality improvement, and provider profiling.

Keywords: CABG, registries, risk model, surgery, survival analysis, long-term outcomes

Background

Risk-adjusted mortality after coronary artery bypass grafting surgery (CABG) has been the dominant cardiac surgery outcome metric for more than two decades. Ideally, these rates are based on audited clinical data registries such as those maintained by The Society of Thoracic Surgeons (STS), state and federal government agencies, and regional collaboratives. Clinical registries include important preoperative, intraoperative, and postoperative variables that are typically unavailable in administrative data sources. Analyses of risk-adjusted clinical outcomes data from these registries have been used for a variety of quality assessment and improvement activities as well as clinical research.

Despite their many advantages, clinical registries also have an important limitation. Because of cost and other practical barriers, most clinical data registries collect only in-hospital or 30-day postoperative outcomes, including mortality. Ascertainment of longer-term vital status is especially problematic for referral centers whose patients are often returned to the care of their primary doctors in distant cities or states. As many important events occur after the index hospitalization, this limited long-term follow-up is a significant barrier to the optimal utilization of registry data. Particularly as short-term procedural mortality has decreased, longer-term outcomes are of equal or greater relevance to patients, providers, and other stakeholders.

If robust, long-term follow-up data were available, it would enable investigators to study the association of these outcomes with relevant clinical factors (e.g., patient characteristics and disease severity on admission). Longitudinal data would greatly enhance shared decision-making, individualized patient management strategies, the study of long-term efficacy and safety, and comparative effectiveness research.

The American College of Cardiology Foundation (ACCF), The Society of Thoracic Surgeons. and the Duke Clinical Research Institute are collaborating on a comparative effectiveness study (American College of Cardiology Foundation-The Society of Thoracic Surgeons Collaboration on the Comparative Effectiveness of Revascularization sTrategies, or ASCERT) of CABG and percutaneous coronary interventions (PCI), funded by the National Heart, Lung and Blood Institute of the National Institutes of Health1. The first aim of the ASCERT Study is to develop novel, long-term mortality risk prediction models for CABG and PCI. By linking the STS Adult Cardiac Surgery Database (ACSD) and the Center for Medicare and Medicaid Services (CMS) 100% denominator file2, we developed long-term mortality models that estimate the time-dependent effect of preoperative patient factors on medium and long-term mortality following CABG.

Methods

Institutional Review Board Approval

This analysis has been reviewed and approved by the Duke University Health System IRB under protocol number Pro00019987.

Patients

The study population consisted of isolated CABG patients at STS-participating hospitals, who were discharged between January 1, 2002 and December 31, 2007, and whose clinical data were collected using STS ACSD version 2.41 and 2.52 data specifications3. Data quality in the STS Database has been shown to be high. In audits of STS data from 12 sites in Iowa conducted by the Iowa Foundation for Medical Care in 2001–2002 (corresponding to the earliest data used for the current study), the overall agreement rate for risk predictors was 96%4. External audits of the entire STS National Database currently include 5% of randomly selected participants annually, and the overall agreement rate for 2009 records (over 70 data elements in each) was 96.1%.

Patients younger than 65 years or having a history of coma were excluded, as were patients with missing data on age, sex or status (elective, urgent, emergent, salvage). For patients with multiple operations in the dataset, only the first operation was included. The final study population included 348,341 patients from 917 STS-participating hospitals (Figure 1).

Figure 1.

Figure 1

Eligibility and Exclusion Flowchart

Mortality Ascertainment

Procedural records in the STS Database were linked to CMS inpatient claims and denominator databases2, 5. STS and CMS claims records from 2003–2007 were considered to be a match if they agreed exactly on site, sex, admission date, discharge date, date of birth (if present), and age. For 2002, dates of birth, admission, and discharge were coarsened to protect confidentiality, and thus a more complicated matching criterion was required. Records were considered to be a match if they agreed exactly on site, sex, length of stay, procedure month and year, days from birth to admission (if present), age, and days from admission to surgery. Overall, 86.5% of records were collected during 2003–2007 and matched exactly on all available matching criteria. In a validation study of this methodology using heart failure patients from Duke University5, the estimated false match rate was 0% (0/109) when using the most stringent matching criterion and 1% (1/109) when using a less stringent matching rule.

Vital status and dates of death through December 31, 2008 were obtained by linking CMS claims records to the denominator file on the basis of an encrypted Medicare patient identifier. Follow-up was considered to be administratively censored on December 31, 2008 and was at least 1 year for all patients (median 4 years; maximum 7 years).

Predictor Variables

Predictor variables were summarized as percentages if categorical and as mean, median, standard deviation (STD), and quartiles (25th, 75th) if continuous. Predictors were chosen based on published CABG short-term models6 and clinical experience. Variable definitions are available at www.sts.org. The variable for “Number of Diseased Vessels” in the STS ACSD was designed to reflect the amount of myocardium at risk. Thus, although patients with significant left main coronary disease are specifically identified by a separate dichotomous variable, for the purposes of defining myocardium at risk they are also classified as two diseased vessels.

Development and Validation Samples

Data were randomly divided into a 50% training sample (n = 174,506) to determine the form of the model and estimate regression coefficients, and a 50% validation sample (n = 173,835) to assess model calibration and discrimination.

Statistical Analysis

Form of Model

We estimated survival as a function of patient preoperative characteristics using the Cox proportional hazards model7. The proportional hazards assumption was investigated by plotting and visually inspecting transformed (log-log) survival probabilities vs. time following CABG.To allow for non-proportional hazards, we estimated separate hazard ratio parameters for all model variables for each of the following time intervals: 0 – 30 days, 31 – 180 days, 181 days – 2 years, and > 2 years. Time intervals were chosen after conducting a preliminary analysis which involved fitting Cox models with several relatively narrow categories, then collapsing adjacent categories based on a combination of statistical and non-statistical considerations. The first cutpoint (30-days) was chosen for consistency with many existing short-term CABG mortality models and quality metrics. As the ability to support even the most seriously ill postoperative patients has increased due to modern critical care, some have suggested that our definition of the “early” postoperative period should likewise be lengthened so as not to underestimate early risk8. This was the basis for our relatively narrow second time interval, 31 to 180 days. The remaining intervals were chosen by collapsing adjacent categories for which the hazard ratios appeared most similar, while retaining sufficient events in each to ensure precise estimation of category-specific hazard ratio parameters.

We fit four separate Cox regression models that were conditional on being alive at the beginning of each time interval. Mathematically, this was equivalent to fitting a single Cox model with piecewise-constant, time-dependent hazard ratios for all model variables.

Functional Form of Predictors

Graphical exploratory analyses were used were used to determine the functional form of continuous variables and to decide whether categorical variables with several categories could be collapsed into fewer categories. In a preliminary Cox model using flexible regression splines for continuous variables, plots of the variables age, height and year of surgery revealed an approximately linear association with the log-hazard of mortality, and were modeled as linear. The association between body mass index (BMI) and mortality was determined to be non-monotone (U-shape) and was modeled as a continuous polynomial regression function with linear and quadratic effects. We arbitrarily selected BMI's of 20, 30, 35, and 40 kg / m2 to compare their hazard ratios relative to a “normal” reference BMI of 25 kg / m2. For modeling renal function, patients on dialysis were adequately represented by an indicator variable for dialysis without further adjusting for the patient's last preoperative creatinine level. For patients not on dialysis, the relationship between last preoperative creatinine and mortality was modeled as a straight line with a change of slope at 1.5 mg/dL. Ejection fraction was modeled as linear below 60% and constant above 60%. Finally, aortic stenosis pressure gradient was modeled as linear below 77mmHg and constant above 77mmHg (the 99th percentile).

Interactions

Interactions between predictors were examined by identifying 5 predictors with the highest global chi-square statistics and creating all possible pairwise interactions among them, in each case considering whether these were also clinically plausible. While some interaction terms were statistically significant, they were not felt to be of major practical significance. Measures of model calibration and discrimination were not materially affected by their inclusion (i.e., model fit was not substantially improved), and models without interactions were also considered to be substantially more interpretable and usable. Therefore, we retained only main effects in the final model.

Missing Data

Predictor data were highly complete with most covariates having less than 1% missing data (Supplemental Table 1). Missing values were imputed to the median of continuous variables (after stratifying on relevant variables to enhance prediction of the missing value) and the most common category of binary and polytomous variables. More computationally intensive missing data strategies, such as multiple imputations, were not used for this analysis, as they have been documented to have minimal impact in previous STS risk models9.

Model Assessment

Model performance was assessed in the 50% validation sample. Predicted survival curves were generated by applying estimated regression coefficients from the development sample to covariate data of patients in the validation sample. To assess calibration (fit), model-based predicted survival curves were averaged across patients in the validation sample and compared to non-parametric (Kaplan-Meier, K-M) survival curves. This was done in the overall validation population and in various subgroups. To further assess calibration, patients in the validation sample were ranked into 20 categories based on their estimated risk of dying within 3 years. Average expected and observed (Kaplan-Meier) 3-year survival probabilities were then calculated within each category and plotted.

Discrimination was quantified using two methods. First, discrimination for predicting mortality status as a dichotomous endpoint (alive/dead) was assessed by the area under the receiver operating characteristic (ROC) curve (C-index) for three selected time points: 30 days, 1 year, and 3 years. All patients had at least one year of follow-up and were included in the estimation of discrimination for the 30-day and 1-year time-points. For the 3-year time-point, the 65% of patients with at least 3 years of potential follow-up (i.e., those treated between January 1, 2004 and December 31, 2005) were included. Second, an analogous overall measure of discrimination for predicting survival time as a continuous variable was calculated using Harrell's C-index for censored survival data10. To apply Harrell's method, patients were ranked according to their predicted 3-year mortality risk. We then calculated the proportion of pairs of patients for which the patient with the lower predicted probability of mortality survived longer than the patient with the higher predicted probability, accounting appropriately for censoring.

Final Model

After model development and validation were completed, we re-estimated the final model coefficients based on the complete dataset (development + validation samples). Confidence intervals for hazard ratios were calculated with sandwich standard error estimates to account for within-hospital clustering11.

Results

Supplemental Table 2 compares the characteristics of STS CABG patients who were or were not matched to CMS. For most variables these two groups were quite similar.

Table 1 depicts the characteristics of the final study population of 348,341 patients who underwent isolated CABG. Kaplan-Meier estimated mortality in the overall study cohort (development and validation samples) was 3.2% at 30 days, 6.4% at 180 days, 8.1% at one-year, 11.3% at two years, and 23.3% at 3 years of follow-up. Supplemental Table 3 summarizes the univariable association between each candidate predictor variable and estimated mortality rates at 30-days, 1 year and 3 years.

Table 1.

Characteristics of the Overall Study Population

Characteristics No. Summary Statistics
Total Study Population 348,341 100%
Age (years)
 Median (25th, 75th) 73 (69, 78)
 Mean ± SD 73 ± 6
Female 112,146 32%
White 312,482 90%
Black 14,562 4%
Hispanic 7,871 2%
Weight (kg)
 Median (25th, 75th) 82 (71, 93)
 Mean ± SD 83 ± 17
Height (cm)
 Median (25th, 75th) 172 (163, 178)
 Mean ± SD 170 ± 11
BMI ( kg / m2 )
 Median (25th, 75th) 28 (25, 31)
 Mean ± SD 28 ±5
Current Smoker 45,901 13%
Past Smoker 152,517 44%
Diabetes 124,091 36%
 Non-insulin diabetes 90,743 26%
 Insulin diabetes 33,348 10%
Last creatinine Level (mg/dL)
 Median (25th, 75th) 1 (0.9, 1.3)
 Mean ± SD 1 ± 0.7
Renal Failure 21,754 6%
Dialysis 4,858 1%
Hypertension 285,765 82%
Chronic Lung Disease 73,780 21%
 Mild 39,156 11%
 Moderate 22,406 7%
 Severe 12,218 4%
Immunosuppressive Therapy 7,652 2%
Peripheral Vascular Disease 66,050 19%
Cerebrovascular Disease 63,323 18%
CVA 30,621 9%
 ≤ 2 weeks 922 0.3%
 > 2 weeks 29,699 9%
RIND 301 0.1%
TIA 13,286 4%
Carotid stenosis > 75% 10,006 3%
Prior Carotid Surgery 16,355 5%
Prior CABG 18,725 5%
Prior Valve Surgery 1,316 0.4%
Previous PCI 69,666 20%
PCI within 6 hrs 3,064 0.9%
MI 149,138 43%
 <= 6 hours 4,377 1%
 > 6 hours and < 24 hours 8,260 2%
 1 – 7 days 63,370 18%
 8 – 21 days 12,386 4%
 > 21 days 60,745 17%
NYHA Class 1 43,012 13%
NYHA Class 2 88,788 27%
NYHA Class 3 130,488 39%
NYHA Class 4 72,887 22%
CHF 52,174 15%
 NYHA < class 4 33,027 10%
 NYHA class 4 19,147 6%
Stable Angina 144,701 42%
Unstable Angina 136,897 39%
Cardiogenic Shock 6,224 2%
Arrhythmia 39,363 11%
Atrial fibrillation/Flutter 25,636 7%
Pre-Op Beta Blocker 244,572 70%
Pre-Op Inotrope 6,616 2%
Pre-Op IABP 24,083 7%
1 diseased vessel 11,498 3%
2 diseased vessels 63,736 18%
3 diseased vessels 271,295 78%
Left Main Disease > 50% 109,544 32%
Ejection Fraction (%)
 Median (25th, 75th) 53 (42, 60)
 Mean ± SD 51 ± 13
Aortic Stenosis 7,850 2%
Aortic Insufficiency 15,854 5%
 Mild 12,985 4%
 Moderate 2,628 0.8%
 Severe 241 0.1%
Mitral Insufficiency 47,380 14%
 Mild 35,658 11%
 Moderate 10,541 3%
 Severe 1,181 0.3%
Tricuspid Insufficiency 23,133 7%
 Mild 18,765 6%
 Moderate 3,924 1%
 Severe 444 0.1%
Previous CV Surgeries
 None 323,660 94%
 One previous CV surgery 19,772 6%
 Two or more previous CV surgeries 2,163 0.6%
Status
 Elective 173,608 50%
 Urgent 159,845 46%
 Emergent 14,095 4%
 Emergent Salvage 793 0.2%

BMI: Body mass index; CVA: cerebrovascular accident, or stroke; TIA: transient ischemic attack; RIND: reversible ischemic neurological deficit; PCI: percutaneous coronary intervention; MI: myocardial infarction; NYHA: New York Heart Association; CHF: congestive heart failure; CV: cardiovascular; SD: Standard Deviation

Table 2 shows hazard ratios derived by fitting multivariable Cox regression models to four time intervals (see methods). In multivariable analyses, several distinct, temporal risk factor patterns are evident. For example, higher ejection fraction was protective over all time periods and the magnitude of effect was stable. Conversely, past history of a stroke (CVA), transient ischemic attack (TIA), or reversible ischemic neurological deficit (RIND), moderate or severe chronic lung disease (CLD), or immunosuppressive treatment had a significant negative impact on survival at all endpoints. The magnitude of effect of some important early predictors of risk, including current smoking, insulin-dependent diabetes, and dialysis-dependent renal failure, increased over time suggesting an accumulation of risk from these debilitating chronic behaviors and diseases. On the other hand, the effect of some important early predictors of increased mortality (e.g., emergency status, cardiogenic shock, acute preoperative myocardial infarction [MI], and reoperation) diminished rather quickly and became non-significant for those patients who survived the early postoperative and recovery periods.

Table 2.

Cox Model Hazard Ratios

Risk Factor 0 – 30 days 31 – 180 days 181 days – 2 years 2+ years
Number of deaths 11,062 11,075 10,155 28,164
Hazard Ratio (95% CI)
Age (Increment of 10) 1.77 (1.71, 1.83) 1.97 (1.90, 2.04) 1.79 (1.74, 1.84) 2.00 (1.95, 2.05)
Aortic insufficiency - Moderate/Severe 1.23 (1.04, 1.45) 1.19 (1.01, 1.40) 1.19 (1.03, 1.36) 1.07 (0.94, 1.21)
Aortic Stenosis - Aortic Gradient truncated at 77 mmHg, linear-increment of 10 1.10 (1.05, 1.15) 1.10 (1.06, 1.15) 1.15 (1.11, 1.19) 1.14 (1.11, 1.18)
BMI 20 vs. 25 1.11 (1.08, 1.14) 1.17 (1.14, 1.20) 1.18 (1.16, 1.21) 1.10 (1.08, 1.12)
BMI 30 vs. 25 0.93 (0.91, 0.96) 0.90 (0.88, 0.92) 0.88 (0.87, 0.90) 0.94 (0.92, 0.95)
BMI 35 vs. 25 0.91 (0.87, 0.94) 0.85 (0.82, 0.88) 0.81 (0.79, 0.84) 0.90 (0.88, 0.93)
BMI 40 vs. 25 0.91 (0.86, 0.96) 0.84 (0.79, 0.89) 0.79 (0.75, 0.82) 0.89 (0.86, 0.93)
CHF - NYHA IV 1.28 (1.19, 1.37) 1.47 (1.37, 1.57) 1.43 (1.35, 1.51) 1.26 (1.19, 1.32)
CHF - not NYHA IV 1.25 (1.18, 1.33) 1.48 (1.39, 1.56) 1.42 (1.35, 1.49) 1.38 (1.32, 1.43)
Chronic Lung Disease ≥ Moderate 1.56 (1.48, 1.65) 1.75 (1.66, 1.85) 1.62 (1.55, 1.70) 1.56 (1.50, 1.62)
Creatinine 1.5 vs. 1.0 (non-dialysis patients) 1.38 (1.32, 1.44) 1.46 (1.39, 1.52) 1.29 (1.24, 1.34) 1.24 (1.21, 1.28)
Creatinine 2.0 vs. 1.0 (non-dialysis patients) 1.58 (1.52, 1.65) 1.75 (1.68, 1.82) 1.56 (1.50, 1.62) 1.53 (1.49, 1.58)
Creatinine 2.5 vs. 1.0 (non-dialysis patients) 1.81 (1.71, 1.92) 2.10 (1.99, 2.21) 1.87 (1.79, 1.96) 1.89 (1.81, 1.97)
Current Smoker 1.19 (1.11, 1.27) 1.40 (1.31, 1.50) 1.60 (1.52, 1.69) 1.67 (1.60, 1.74)
CVA/TIA/RIND 1.22 (1.16, 1.29) 1.41 (1.35, 1.49) 1.38 (1.33, 1.44) 1.29 (1.25, 1.33)

Date of Surgery - Per year 0.98 (0.96, 0.99) 0.99 (0.98, 1.01) 0.99 (0.98, 1.00) 0.98 (0.97, 1.00)
Diabetes - Insulin 1.21 (1.15, 1.28) 1.59 (1.50, 1.68) 1.61 (1.53, 1.69) 1.77 (1.71, 1.84)
Diabetes - Noninsulin 0.96 (0.91, 1.00) 1.25 (1.20, 1.31) 1.21 (1.17, 1.26) 1.30 (1.27, 1.34)
Dialysis vs. creatinine= 1.0 2.93 (2.66, 3.24) 4.13 (3.77, 4.53) 4.57 (4.26, 4.91) 4.46 (4.12, 4.82)
EF truncated at 60, increment of 10 0.88 (0.86, 0.90) 0.85 (0.84, 0.87) 0.85 (0.84, 0.86) 0.87 (0.86, 0.88)
Ethnicity - Hispanic 1.09 (0.96, 1.24) 1.06 (0.93, 1.20) 1.11 (1.00, 1.23) 0.99 (0.91, 1.08)
Height by 10 cm 0.94 (0.92, 0.96) 0.98 (0.96, 1.01) 0.98 (0.96, 1.00) 1.02 (1.00, 1.03)
Hypertension 1.04 (0.98, 1.10) 1.02 (0.96, 1.08) 1.05 (1.00, 1.09) 1.04 (1.00, 1.08)
Immunosuppressive treatment 1.46 (1.33, 1.60) 1.75 (1.60, 1.91) 1.60 (1.47, 1.74) 1.44 (1.34, 1.53)
Left Main Disease > 50% 1.01 (0.97, 1.05) 1.05 (1.01, 1.10) 1.12 (1.08, 1.16) 1.06 (1.03, 1.09)
MI < 6 hours 1.53 (1.36, 1.74) 1.18 (1.01, 1.37) 1.22 (1.05, 1.41) 0.94 (0.82, 1.08)
MI 1–21 days 1.36 (1.29, 1.43) 1.20 (1.14, 1.26) 0.99 (0.95, 1.03) 1.04 (1.01, 1.08)
MI 6 to 24 hours 1.61 (1.45, 1.79) 1.16 (1.02, 1.31) 1.10 (0.99, 1.23) 0.92 (0.84, 1.01)
Mitral Insufficiency - Moderate/Severe 1.14 (1.05, 1.24) 1.17 (1.08, 1.27) 1.07 (1.00, 1.15) 1.15 (1.09, 1.22)
Non-invasive study: carotid stenosis >75% 1.17 (1.06, 1.28) 1.08 (0.98, 1.20) 1.08 (0.99, 1.18) 1.15 (1.08, 1.23)
Past Smoker 1.08 (1.03, 1.14) 1.17 (1.12, 1.22) 1.26 (1.22, 1.32) 1.23 (1.19, 1.26)
Percutaneous coronary intervention (PCI) within 6 hours 1.32 (1.16, 1.49) 1.09 (0.91, 1.31) 1.06 (0.88, 1.28) 1.09 (0.95, 1.25)
Peripheral vascular disease 1.33 (1.27, 1.39) 1.40 (1.34, 1.45) 1.37 (1.32, 1.42) 1.30 (1.27, 1.34)
Preoperative atrial fibrillation 1.28 (1.20, 1.36) 1.55 (1.47, 1.63) 1.47 (1.40, 1.54) 1.40 (1.35, 1.46)
Preoperative IABP / Inotropes 1.30 (1.21, 1.39) 1.15 (1.08, 1.23) 1.05 (0.99, 1.11) 0.97 (0.93, 1.02)
Prior Carotid Surgery 1.19 (1.10, 1.28) 1.08 (1.00, 1.17) 1.05 (0.98, 1.11) 1.17 (1.11, 1.23)
Race - Asian 0.98 (0.82, 1.19) 0.90 (0.75, 1.08) 0.93 (0.78, 1.10) 0.85 (0.74, 0.97)
Race - Black 0.94 (0.84, 1.06) 1.18 (1.08, 1.29) 1.22 (1.14, 1.31) 1.07 (1.01, 1.13)
Reoperation - 1 previous operation 1.85 (1.72, 1.99) 1.26 (1.17, 1.36) 1.16 (1.09, 1.23) 1.11 (1.06, 1.16)
Reoperation - 2+ previous operations 2.35 (1.96, 2.82) 1.53 (1.24, 1.89) 1.54 (1.30, 1.82) 1.14 (0.99, 1.30)
Sex - Male 0.70 (0.66, 0.73) 0.75 (0.71, 0.80) 0.98 (0.93, 1.02) 0.95 (0.92, 0.98)
Shock 1.96 (1.78, 2.16) 1.48 (1.32, 1.65) 1.01 (0.90, 1.14) 1.01 (0.91, 1.13)
Status - Emergent (no resuscitation) 1.90 (1.73, 2.09) 1.44 (1.29, 1.61) 1.03 (0.94, 1.14) 0.98 (0.91, 1.06)
Status - Emergent w/ resuscitation or salvage 4.31 (3.75, 4.95) 2.04 (1.66, 2.51) 1.36 (1.09, 1.70) 1.05 (0.83, 1.32)
Status - Urgent 1.17 (1.10, 1.23) 1.16 (1.11, 1.22) 1.04 (1.00, 1.08) 1.01 (0.98, 1.04)
Three Diseased Vessels 1.28 (1.13, 1.44) 1.12 (1.00, 1.26) 0.98 (0.90, 1.08) 1.12 (1.04, 1.21)
Tricuspid insufficiency - Moderate/Severe 1.20 (1.07, 1.35) 1.23 (1.09, 1.39) 1.22 (1.09, 1.36) 1.00 (0.89, 1.11)
Two Diseased Vessels 1.08 (0.95, 1.22) 1.05 (0.93, 1.19) 0.98 (0.89, 1.08) 1.06 (0.98, 1.15)
Unstable Angina - No MI 1.14 (1.08, 1.20) 1.00 (0.95, 1.05) 0.99 (0.95, 1.03) 0.97 (0.94, 1.01)

Our results confirm the so-called “obesity paradox” reported in other short-term analyses12, 13and demonstrate that these effects persist for at least two years postoperatively. Low body mass index (20 kg/m2 vs. 25 kg/m2) predicted higher mortality at all time periods postoperatively, whereas obesity (>25 kg/m2) was associated with decreased risk.

Model discrimination (C-index) in the validation set was 0.762 for predicting 30-day status, 0.764 for predicting one year status, and 0.748 for predicting three-year status. Harrell's C statistic for predicting overall survival time was 0.732. Thirty-day model discrimination differs from that observed in our most recent STS isolated CABG risk models6, most likely because the current model is limited to patients over 65 years of age. Model discrimination at longer time intervals is also lower than that in the early postoperative period. As the time interval from surgery increases, there is correspondingly greater probability that other factors not included in the risk models may impact survival.

Figure 2 depicts the expected and Kaplan-Meier (K-M) observed survival curves for the overall validation cohort. Figure 3 compares observed and expected 3-year mortality risk across 20 categories of predicted risk. Within the typical range of expected mortalities, prediction is highly accurate. From 20 – 40% expected mortality, there is very slight underestimation of mortality risk, and at the highest expected mortality (> 50%) there is slight overestimation. Figure 4 depicts K-M observed and expected survival curves for selected patient subgroups in the validation cohort. The expected (solid) and observed (dashed) lines are nearly superimposable on most of the plots.

Figure 2.

Figure 2

Expected and Kaplan-Meier (K-M) observed survival curves for the validation cohort, with numbers of patients at risk.

Figure 3.

Figure 3

Observed and expected 3-year mortality by categories of expected risk in the validation cohort.

Figure 4.

Figure 4

Kaplan-Meier observed and expected survival curves for selected patient subgroups in the validation cohort.

Discussion

Short-term duration of follow-up has prevented the full potential of clinical data registries from being realized. As average acute hospital length of stay has shortened, procedural-related deaths and complications are correspondingly more likely to occur after patients have been discharged from the hospital. The use of advanced mechanical and pharmacological support has increasingly prolonged the lives of many critically ill postoperative patients, and such patients may be transferred to long-term critical care facilities on ventilators or dialysis. Deaths among such patients may not occur for months after their index hospital discharge, and these delayed postoperative deaths would not be captured in most existing clinical registries8. Short-term follow-up is also a major limitation of comparative effectiveness studies of various treatment strategies, such as CABG or PCI for coronary artery disease. Differences in efficacy of alternative treatments are often not apparent for months or years, much longer than the typical endpoints in most clinical registries. Finally, some preoperative risk factors may have little impact on short-term mortality but are major considerations in the longer term, and vice versa.

Some previous studies have assessed the long-term impact of preoperative risk factors, operative and perioperative care processes, and postoperative complications1428. Our study focuses specifically on the former, and it addresses the major limitations of these earlier studies. Many are from single institutions and their inferences may be confounded by idiosyncratic hospital practice patterns. Most prior studies include only a few hundred to a few thousand patients and lack the power to identify the full spectrum of factors associated with outcomes. Some studies of long-term CABG mortality have been based solely on large administrative databases. This strategy assures adequate sample size and provides valuable information regarding vital status, readmissions, re-interventions, costs, aggregate resource utilization, and outpatient activities. However, administrative databases have a number of well-known deficiencies that limit their usefulness in clinical research, including misclassification of procedures and diagnoses; unavailability of important clinical variables; inability to distinguish co-morbidities from complications (in the absence of Present on Admission indicators); and focus on narrow patient populations2934. There are studies of long-term CABG outcome predictors based on clinical registries, but these are derived from data that are ten to twenty years old and may not reflect current patient severity and surgical practice35, 36.

Our study seeks to overcome the inherent limitations of both clinical and administrative data registries by linking the two together. This approach compensates for their individual deficiencies while harnessing their complementary strengths. The resulting linked data retain the granularity and clinical detail of clinical registries while adding long-term outcomes and cost data available in administrative data sources. These linked data are ideally suited to studies of long-term clinical outcomes, comparative effectiveness, resource utilization, and provider performance for particular types of patients.

Using predicted long-term outcomes tailored to their specific risk profiles, patients may more effectively participate in shared decision-making with their providers. Awareness of both the short-term and long-term risks and benefits (e.g., survival, complications, quality of life) might assist patients in deciding whether or not to proceed with surgery. Furthermore, just as short-term outcomes vary among providers, it is possible that long-term outcomes may also vary, and such information could be useful for all stakeholders.

The long-term CABG mortality model described in this report, based solely on preoperative patient characteristics, is only the first of many applications we envision to exploit the advantages of linked registries. In addition to mortality, it will also be possible to study other long-term endpoints such as readmissions, re-interventions, and cumulative costs and resource use. Other models will estimate the effect of intraoperative decisions, such as use of all-arterial grafting or off-pump procedures, on long-term outcomes. Combined with preoperative variables, such information could help determine what specific procedures or perioperative strategies are most useful for specific types of patients. The addition of early postoperative events (e.g., stroke, or mediastinitis) as predictor variables would permit more effective discussions with such patients regarding their long-term health expectations.

Linkages with CMS and other administrative data sources will also enhance the accuracy of outcomes data used to calculate performance metrics such as the STS CABG composite scores37, 38. For example, ongoing linkages with the Social Security Death Master File or National Death Index would permit continuous input and validation of vital status for patients of all ages, not just the Medicare population39.

Linked clinical and administrative data will facilitate the determination of risk-adjusted, long-term freedom from reoperation and readmission not only for surgical procedures but also for a variety of medical devices, such as cardiac valve prostheses. This ability to capture objective long-term patient status, coupled with extensive clinical data from the perioperative period, will be a marked improvement over existing methods for post-market surveillance.

Linkages to other clinical registries will also be useful, and their combined utility will be further enhanced by linking to administrative data, as demonstrated by the ASCERT comparative effectiveness study1. Furthermore, as payment strategies evolve from a focus on procedures or acute hospitalizations to episodes of care, the ability to link related clinical registries (e.g., cardiology and cardiac surgery) will facilitate the study and implementation of these reimbursement policies. Finally, linkages between clinical and payer registries would provide unique information such as outpatient visits, compliance with medications, and cumulative resource use.

Limitations

There are inherent limitations to any studies that use voluntarily collected data, but these are mitigated by the robust STS audit program described previously.

In order to obtain accurate long-term follow-up, it was necessary to link our data to CMS claims data. Because Medicare claims data are restricted to patients 65 years and older, the generalizability of our findings to younger populations is uncertain.

It was impossible to accurately determine cause of death (e.g., cardiac vs. non-cardiac), and our analyses use all-cause mortality as the endpoint.

Our linkages are based on combinations of indirect identifiers. Previous analyses have demonstrated that non-unique identifiers can be combined to create high-quality links between a clinical registry and an administrative data set, allowing researchers to capitalize on the strengths of both types of data to answer important clinical questions5, 40. Although we believe this strategy yielded highly accurate matches in our study, some errors may have been introduced through this process.

Finally, the more distant from the time of surgery, the more opportunity there is for non-surgery related events to confound the apparent associations between preoperative factors and outcomes.

Conclusions

We linked broadly representative, real-world clinical data from the STS ACSD and vital status from Medicare claims data to construct a robust, long-term CABG survival prediction model. Because of the large study cohort, model performance is excellent.

As the time interval from surgery lengthens, the clinical outcomes of postoperative survivors are less impacted by traditional predictors of early survival, such as emergency status, shock, and reoperation. Conversely, late mortality is increasingly associated with chronic diseases such as insulin-dependent diabetes and dialysis-dependent renal failure, and behaviors such as smoking.

As short-term CABG mortality rates decline, the ability to estimate long-term outcomes for patients with particular risk factors will become increasingly important for shared decision-making, comparative effectiveness research, optimal treatment planning, quality improvement initiatives, and provider profiling.

Supplementary Material

1

Acknowledgments

Funding Sources: The ASCERT Study is supported by Award Number RC2HL101489 from the National Heart, Lung, and Blood Institute. This award has been issued under the American Recovery and Reinvestment Act of 2009 for a two-year period. The funders played no role in the design, interpretation, or decision to publish the analysis presented herein. The content of this article is solely the responsibility of the authors and does not necessarily represent the official views of the National Heart, Lung, And Blood Institute or the National Institutes of Health.

Footnotes

Conflict of Interest Disclosures: Consultancy, expert testimony, grants/grants pending: Dangas, Weintraub. Other: DCRI serves as the data warehouse and analysis center for the STS and ACCF registries (DeLong, Grau-Sepulveda, O'Brien, Peterson, Sheng).

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

  • 1.Klein LW, Edwards FH, DeLong ER, Ritzenthaler L, Dangas GD, Weintraub WS. ASCERT: the American College of Cardiology Foundation--the Society of Thoracic Surgeons Collaboration on the comparative effectiveness of revascularization strategies. JACC Cardiovasc Interv. 2010;3:124–126. doi: 10.1016/j.jcin.2009.11.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Jacobs JP, Edwards FH, Shahian DM, Haan CK, Puskas JD, Morales DL, Gammie JS, Sanchez JA, Brennan JM, O'Brien SM, Dokholyan RS, Hammill BG, Curtis LH, Peterson ED, Badhwar V, George KM, Mayer JE, Jr., Chitwood WR, Jr., Murray GF, Grover FL. Successful linking of the Society of Thoracic Surgeons adult cardiac surgery database to Centers for Medicare and Medicaid Services Medicare data. Ann Thorac Surg. 2010;90:1150–1156. doi: 10.1016/j.athoracsur.2010.05.042. [DOI] [PubMed] [Google Scholar]
  • 3. [accessed Aug 3, 2011]; http://www.sts.org/quality-research-patient-safety/national-database/database-managers/adult-cardiac-surgery-database/d,
  • 4.Welke KF, Ferguson TB, Jr., Coombs LP, Dokholyan RS, Murray CJ, Schrader MA, Peterson ED. Validity of the Society of Thoracic Surgeons National Adult Cardiac Surgery Database. Ann Thorac Surg. 2004;77:1137–1139. doi: 10.1016/j.athoracsur.2003.07.030. [DOI] [PubMed] [Google Scholar]
  • 5.Hammill BG, Hernandez AF, Peterson ED, Fonarow GC, Schulman KA, Curtis LH. Linking inpatient clinical registry data to Medicare claims data using indirect identifiers. Am Heart J. 2009;157:995–1000. doi: 10.1016/j.ahj.2009.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Shahian DM, O'Brien SM, Filardo G, Ferraris VA, Haan CK, Rich JB, Normand SL, Delong ER, Shewan CM, Dokholyan RS, Peterson ED, Edwards FH, Anderson RP. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1--coronary artery bypass grafting surgery. Ann Thorac Surg. 2009;88:S2–22. doi: 10.1016/j.athoracsur.2009.05.053. [DOI] [PubMed] [Google Scholar]
  • 7.Cox DR, Oakes D. Analysis of survival data. Chapman and Hall; London; New York: 1984. [Google Scholar]
  • 8.Osswald BR, Blackstone EH, Tochtermann U, Thomas G, Vahl CF, Hagl S. The meaning of early mortality after CABG. Eur J Cardiothorac Surg. 1999;15:401–407. doi: 10.1016/s1010-7940(99)00029-9. [DOI] [PubMed] [Google Scholar]
  • 9. [accessed March 31, 2011];Single vs multiple imputation in STS risk models. at http://www.duke.edu/~obrie027/STS2008.
  • 10.Harrell FE, Jr., Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating the yield of medical tests. JAMA. 1982;247:2543–2546. [PubMed] [Google Scholar]
  • 11.Lin DY, Wei LJ. The robust inference for the Cox proportional hazards model. Journal of the American Statistical Association. 1989;84:1074–1078. [Google Scholar]
  • 12.Engel AM, McDonough S, Smith JM. Does an obese body mass index affect hospital outcomes after coronary artery bypass graft surgery? Ann Thorac Surg. 2009;88:1793–1800. doi: 10.1016/j.athoracsur.2009.07.077. [DOI] [PubMed] [Google Scholar]
  • 13.Stamou SC, Nussbaum M, Stiegel RM, Reames MK, Skipper ER, Robicsek F, Lobdell KW. Effect of body mass index on outcomes after cardiac surgery: is there an obesity paradox? Ann Thorac Surg. 2011;91:42–47. doi: 10.1016/j.athoracsur.2010.08.047. [DOI] [PubMed] [Google Scholar]
  • 14.Canver CC, Nichols RD, Cooler SD, Heisey DM, Murray EL, Kroncke GM. Influence of increasing age on long-term survival after coronary artery bypass grafting. Ann Thorac Surg. 1996;62:1123–1127. doi: 10.1016/0003-4975(96)00446-8. [DOI] [PubMed] [Google Scholar]
  • 15.Guru V, Fremes SE, Tu JV. Time-related mortality for women after coronary artery bypass graft surgery: A population-based study. J Thorac Cardiovasc Surg. 2004;127:1158–1165. doi: 10.1016/j.jtcvs.2003.12.008. [DOI] [PubMed] [Google Scholar]
  • 16.Filsoufi F, Rahmanian PB, Castillo JG, Chikwe J, Kini AS, Adams DH. Results and Predictors of Early and Late Outcome of Coronary Artery Bypass Grafting in Patients With Severely Depressed Left Ventricular Function. Ann Thorac Surg. 2007;84:808–816. doi: 10.1016/j.athoracsur.2007.04.117. [DOI] [PubMed] [Google Scholar]
  • 17.Barsness GW, Peterson ED, Ohman EM, Nelson CL, DeLong ER, Reves JG, Smith PK, Anderson RD, Jones RH, Mark DB, Califf RM. Relationship between diabetes mellitus and long-term survival after coronary bypass and angioplasty. Circulation. 1997;96:2551–2556. doi: 10.1161/01.cir.96.8.2551. [DOI] [PubMed] [Google Scholar]
  • 18.Dacey LJ, Liu JY, Braxton JH, Weintraub RM, DeSimone J, Charlesworth DC, Lahey SJ, Ross CS, Hernandez F, Jr., Leavitt BJ, O'Connor GT. Long-term survival of dialysis patients after coronary bypass grafting. Ann Thorac Surg. 2002;74:458–462. doi: 10.1016/s0003-4975(02)03768-2. [DOI] [PubMed] [Google Scholar]
  • 19.Birkmeyer JD, Quinton HB, O'Connor NJ, McDaniel MD, Leavitt BJ, Charlesworth DC, Hernandez F, Ricci MA, O'Connor GT. The effect of peripheral vascular disease on long-term mortality after coronary artery bypass surgery. Northern New England Cardiovascular Disease Study Group. Arch Surg. 1996;131:316–321. doi: 10.1001/archsurg.1996.01430150094018. [DOI] [PubMed] [Google Scholar]
  • 20.Hamman BL, Filardo G, Hamilton C, Grayburn PA. Effect of body mass index on risk of long-term mortality following coronary artery bypass grafting. Am J Cardiol. 2006;98:734–738. doi: 10.1016/j.amjcard.2006.04.008. [DOI] [PubMed] [Google Scholar]
  • 21.Loop FD, Lytle BW, Cosgrove DM, Stewart RW, Goormastic M, Williams GW, Golding LA, Gill CC, Taylor PC, Sheldon WC. Influence of the internal-mammary-artery graft on 10-year survival and other cardiac events. N Engl J Med. 1986;314:1–6. doi: 10.1056/NEJM198601023140101. [DOI] [PubMed] [Google Scholar]
  • 22.Koch CG, Li L, Duncan AI, Mihaljevic T, Loop FD, Starr NJ, Blackstone EH. Transfusion in coronary artery bypass grafting is associated with reduced long-term survival. Ann Thorac Surg. 2006;81:1650–1657. doi: 10.1016/j.athoracsur.2005.12.037. [DOI] [PubMed] [Google Scholar]
  • 23.Shroyer AL, Grover FL, Hattler B, Collins JF, McDonald GO, Kozora E, Lucke JC, Baltz JH, Novitzky D. On-pump versus off-pump coronary-artery bypass surgery. N Engl J Med. 2009;361:1827–1837. doi: 10.1056/NEJMoa0902905. [DOI] [PubMed] [Google Scholar]
  • 24.Braxton JH, Marrin CA, McGrath PD, Morton JR, Norotsky M, Charlesworth DC, Lahey SJ, Clough R, Ross CS, Olmstead EM, O'Connor GT. 10-year follow-up of patients with and without mediastinitis. Semin Thorac Cardiovasc Surg. 2004;16:70–76. doi: 10.1053/j.semtcvs.2004.01.006. [DOI] [PubMed] [Google Scholar]
  • 25.Filardo G, Hamilton C, Hebeler RF, Jr., Hamman B, Grayburn P. New-onset postoperative atrial fibrillation after isolated coronary artery bypass graft surgery and long-term survival. Circ Cardiovasc Qual Outcomes. 2009;2:164–169. doi: 10.1161/CIRCOUTCOMES.108.816843. [DOI] [PubMed] [Google Scholar]
  • 26.Dacey LJ, Likosky DS, Leavitt BJ, Lahey SJ, Quinn RD, Hernandez F, Jr., Quinton HB, Desimone JP, Ross CS, O'Connor GT. Perioperative stroke and long-term survival after coronary bypass graft surgery. Ann Thorac Surg. 2005;79:532–536. doi: 10.1016/j.athoracsur.2004.07.027. [DOI] [PubMed] [Google Scholar]
  • 27.Toumpoulis IK, Anagnostopoulos CE, Chamogeorgakis TP, Angouras DC, Kariou MA, Swistel DG, Rokkas CK. Impact of early and delayed stroke on in-hospital and long-term mortality after isolated coronary artery bypass grafting. Am J Cardiol. 2008;102:411–417. doi: 10.1016/j.amjcard.2008.03.077. [DOI] [PubMed] [Google Scholar]
  • 28.Mehta RH, Honeycutt E, Patel UD, Lopes RD, Shaw LK, Glower DD, Harrington RA, Califf RM, Sketch MH., Jr. Impact of recovery of renal function on long-term mortality after coronary artery bypass grafting. Am J Cardiol. 2010;106:1728–1734. doi: 10.1016/j.amjcard.2010.07.045. [DOI] [PubMed] [Google Scholar]
  • 29.Mack MJ, Herbert M, Prince S, Dewey TM, Magee MJ, Edgerton JR. Does reporting of coronary artery bypass grafting from administrative databases accurately reflect actual clinical outcomes? J Thorac Cardiovasc Surg. 2005;129:1309–1317. doi: 10.1016/j.jtcvs.2004.10.036. [DOI] [PubMed] [Google Scholar]
  • 30.Shahian DM, Silverstein T, Lovett AF, Wolf RE, Normand S-L. Comparison of Clinical and Administrative Data Sources for Hospital Coronary Artery Bypass Graft Surgery Report Cards. Circulation. 2007;115:1518–1527. doi: 10.1161/CIRCULATIONAHA.106.633008. [DOI] [PubMed] [Google Scholar]
  • 31.Hannan EL, Racz MJ, Jollis JG, Peterson ED. Using Medicare claims data to assess provider quality for CABG surgery: does it work well enough? Health Serv Res. 1997;31:659–678. [PMC free article] [PubMed] [Google Scholar]
  • 32.Hannan EL, Kilburn H, Jr., Lindsey ML, Lewis R. Clinical versus administrative data bases for CABG surgery. Does it matter? Med Care. 1992;30:892–907. doi: 10.1097/00005650-199210000-00002. [DOI] [PubMed] [Google Scholar]
  • 33.Best WR, Khuri SF, Phelan M, Hur K, Henderson WG, Demakis JG, Daley J. Identifying patient preoperative risk factors and postoperative adverse events in administrative databases: results from the Department of Veterans Affairs National Surgical Quality Improvement Program. J Am Coll Surg. 2002;194:257–266. doi: 10.1016/s1072-7515(01)01183-8. [DOI] [PubMed] [Google Scholar]
  • 34.Iezzoni LI. Risk adjustment for measuring health care outcomes. 3 ed. Health Administration Press; Chicago: 2003. [Google Scholar]
  • 35.Gao D, Grunwald GK, Rumsfeld JS, Schooley L, MacKenzie T, Shroyer AL. Time-varying risk factors for long-term mortality after coronary artery bypass graft surgery. Ann Thorac Surg. 2006;81:793–799. doi: 10.1016/j.athoracsur.2005.08.005. [DOI] [PubMed] [Google Scholar]
  • 36.MacKenzie TA, Malenka DJ, Olmstead EM, Piper WD, Langner C, Ross CS, O'Connor GT. Prediction of survival after coronary revascularization: modeling short-term, mid-term, and long-term survival. Ann Thorac Surg. 2009;87:463–472. doi: 10.1016/j.athoracsur.2008.09.042. [DOI] [PubMed] [Google Scholar]
  • 37.O'Brien SM, Shahian DM, Delong ER, Normand SL, Edwards FH, Ferraris VA, Haan CK, Rich JB, Shewan CM, Dokholyan RS, Anderson RP, Peterson ED. Quality measurement in adult cardiac surgery: part 2--Statistical considerations in composite measure scoring and provider rating. Ann Thorac Surg. 2007;83:S13–S26. doi: 10.1016/j.athoracsur.2007.01.055. [DOI] [PubMed] [Google Scholar]
  • 38.Shahian DM, Edwards FH, Ferraris VA, Haan CK, Rich JB, Normand SL, Delong ER, O'Brien SM, Shewan CM, Dokholyan RS, Peterson ED. Quality measurement in adult cardiac surgery: part 1--Conceptual framework and measure selection. Ann Thorac Surg. 2007;83:S3–12. doi: 10.1016/j.athoracsur.2007.01.053. [DOI] [PubMed] [Google Scholar]
  • 39.Jacobs JP, Haan CK, Edwards FH, Anderson RP, Grover FL, Mayer JE, Jr., Chitwood WR., Jr. The rationale for incorporation of HIPAA compliant unique patient, surgeon, and hospital identifier fields in the STS database. Ann Thorac Surg. 2008;86:695–698. doi: 10.1016/j.athoracsur.2008.04.075. [DOI] [PubMed] [Google Scholar]
  • 40.Pasquali SK, Jacobs JP, Shook GJ, O'Brien SM, Hall M, Jacobs ML, Welke KF, Gaynor JW, Peterson ED, Shah SS, Li JS. Linking clinical registry data with administrative data using indirect identifiers: implementation and validation in the congenital heart surgery population. Am Heart J. 2010;160:1099–1104. doi: 10.1016/j.ahj.2010.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

1

RESOURCES