Abstract
Background
Surgeon experience concerns both families of children with congenital heart disease and medical providers. Relationships between surgeon seniority and patient outcomes are often assumed, yet there are little data.
Methods and Results
This national study used linked data from the American Medical Association Physician Masterfile and the Society of Thoracic Surgeons-Congenital Heart Surgery Database to examine associations between surgeon years since medical school and major morbidity/mortality for children undergoing cardiac surgery. Sensitivity analyses explored the effects of patient characteristics, institutional/surgeon volumes, and various measures of institutional surgeon team experience. In secondary analyses, major morbidity and mortality were examined as separate end-points. We identified 206 congenital heart surgeons from 91 centers performing 62,851 index operations (2010–2014). Median time from school was 25 years (range 9–55). A major morbidity/mortality occurred in 11.5% of cases. In multivariable analyses, the odds of major morbidity/mortality were similar for early-career (<15 years from medical school, ~<40 years old), mid-career (15–24 years, ~40–50 years old), and senior surgeons (25–35 years, ~50–60 years old). The odds of major morbidity/mortality were ~25% higher for operations performed by very senior surgeons (35–55 years from school, ~60–80 years old; n=9,044 cases). Results were driven by differences in morbidity. In extensive sensitivity analyses, these effects remained constant.
Conclusions
In this study of >200 congenital heart surgeons, we found patient outcomes for surgeons with the fewest years of experience to be comparable to those of their mid-career and senior colleagues, within the context of existing referral and support practices. Very senior surgeons had higher risk-adjusted odds of major morbidity/mortality. Contemporary approaches to training, referral, mentoring, surgical planning, and/or other support practices might contribute to the observed outcomes of junior congenital heart surgeons being comparable to those of more experienced colleagues. Understanding and disseminating these practices might benefit the medical community at large.
Keywords: Outcomes research, database, congenital heart disease, surgeon experience
Congenital heart defects affect approximately 1 in 100 children.1 While pediatric cardiologists, cardiothoracic surgeons, nurses, and other healthcare providers work in concert to care for these patients, a transformative component of their care lies in the hands of surgeons. Previous research has demonstrated that there is substantial variation in outcomes between surgeons, even after adjusting for provider volumes,2 yet there are little existing data connecting surgeon-specific factors to patient outcomes.
In adult subspecialties, provider experience (as measured either by age or years since completion of training) has been examined as a predictor of clinical outcomes with varying results.3 Some studies have found better outcomes with an increasing number of years of experience, as might be predicted, with the worst outcomes among the most junior surgeons.4–6 Other studies, in contrast, have described worse outcomes among the oldest providers.7–11 The degree to which experience impacts clinical outcomes in a highly complex and diverse field such as pediatric cardiac surgery is not known.
We conducted a national study to examine the relationship between congenital heart surgeon years of experience and patient outcomes. We hypothesized that, even after adjusting for patient characteristics and institutional volumes, non-linear relationships exist between experience and outcomes.
Methods
Data Source
Data for this study were derived via a linkage of the Society of Thoracic Surgeons-Congenital Heart Surgery Database (STS-CHSD) and the American Medical Association (AMA) Physician Masterfile. The STS-CHSD is the largest congenital heart surgery registry in the world. It includes data on more than 360,000 surgeries conducted at 127 centers in North America. It captures data from approximately 96% of all US centers performing congenital heart surgery, including approximately 98% of all operations.12 Member surgeons submit pre-operative, operative, and outcomes data for all pediatric and congenital heart surgery cases they perform. The Duke Clinical Research Institute serves as the data warehouse and analytic center for all STS National Databases. Data quality is assessed through intrinsic verification of data, as well as formal data audits at approximately 10% of participating institutions each year.12–14 Recent investigation has reported 98% accuracy of data elements when compared to manual review of patient records.15
Surgeon age, years since completion of medical school, and years since terminal training were derived from the AMA Physician Masterfile, a public registry of current and historic data on virtually all physicians training or practicing in the United States. The AMA Masterfile is automatically populated during physician accreditation and tracks physicians from entrance into medical school and through post-graduate training, licensure, and practice (even if they are not members of the AMA) (http://www.ama-assn.org/ama/pub/about-ama/physician-data-resources/physician-masterfile.page). From the AMA Masterfile, we built a Pediatric Cardiothoracic Surgeon (PCS) Masterfile, including training and licensing characteristics for all US pediatric cardiothoracic surgeons. For surgeons graduating from non-US medical schools or training abroad, data were supplemented with self-reported data from The Cardiothoracic Surgery Network Database (http://www.ctsnet.org/surgeons). This PCS Masterfile was linked by National Provider Index (NPI) Number to the STS-CHSD at the Duke Clinical Research Institute and a limited dataset including only coded surgeon and patient identifiers was abstracted.
This study was approved by the STS-CHSD Access and Publications Committee. It was considered by the Duke University Institutional Review Board and the Institutional Review Board at Columbia University Medical Center not to be human subjects research, in accordance with the Common Rule (45 CFR 46.102(f)), as it did not involve private information.
Patient Population
We initially included all index cardiovascular operations in patients <18 years of age undergoing cardiac surgery in the United States, with or without cardiopulmonary bypass, at institutions contributing data to the STS-CHSD (data version 3.0 or 3.22) between 2010 and 2014 (n=86,196 individual admissions at 111 centers). Index operations for which a Society of Thoracic Surgeons-European Association for Cardiothroacic Surgery (STAT) mortality risk score16 was not defined were excluded (2,209 cases), as were cases limited to the surgical closure of patent ductus arteriosus in infants <2.5kg (5,002 cases). The STS-EACTS STAT mortality risk categories are an empirically derived classification system, which groups procedures based on the statistically estimated risk of mortality, with the objective of maximizing within category homogeneity (similarity) and between category discrimination of estimated risk. The categories serve as a stratification variable that can be used to adjust for case mix when analyzing outcomes and comparing institutions or surgeons. Procedures are excluded from assignment to a STAT category if they are not considered to be cardiovascular procedures (with or without cardiopulmonary bypass support) or if they are sufficiently non-specific that statistical estimation of mortality risk would not be meaningful (e.g. “cardiac, other” or “thoracotomy”).. To ensure the most accurate risk adjustment, twenty centers with >10% missing data on key patient characteristics or outcome data were excluded (15,633 cases). Individual index operations missing patient characteristics (n=77) or outcomes data (n=51) were also excluded, as were operations on neonates and infants with weight-for–age Z-scores <−7 or >5 (n=278), to ensure data integrity. The final cohort included 62,851 individual operations occurring at 91 centers.
Surgeon Population
Surgeons were included who contributed ≥6 months’ worth of data to the STS-CHSD (231 surgeons). Surgeons were excluded if they performed <10 cardiovascular procedures per year during the time that they participated in the Database (25 surgeons, 95 cases), as this cohort consisted almost entirely of adult, non-congenital, cardiac surgeons who happened to perform occasional procedures on patients with congenital heart disease.
Data Collection
Data collected from the STS-CHSD included patient demographics, baseline characteristics, preoperative risk factors, operative characteristics, and outcomes. Average annualized surgeon and center case volumes were also recorded. Surgeon and center case volumes were calculated using only index cardiopulmonary bypass or non-cardiopulmonary bypass cardiovascular operations classifiable by the STAT Mortality Risk Categories.
Data collected from the PCS Masterfile included surgeons’ dates of birth, years of medical school graduation, and years of postgraduate trainings.
The primary predictor of interest was surgeon years of experience, derived from the PCS Masterfile and defined as the number of full years since medical school graduation on the date of a patient’s index operation. Surgeon age and years since last postgraduate training were also calculated and assessed.
Outcomes
The primary outcome of interest was major morbidity or mortality, assessed as a composite variable. We decided a priori to use this composite outcome as 1) the incidence was assumed to be higher than that of mortality alone, and 2) it has been suggested that mortality might be less reflective of the work of individual surgeons and more reflective of the efforts of the entire medical team, acknowledging the potential importance of the concept known as “failure to rescue”.17 In secondary analyses, mortality and major morbidity were assessed as separate end points. In keeping with standard STS definitions, mortality was defined as “1) all deaths, regardless of cause, occurring during the hospitalization in which the operation was performed, even if after 30 days (including patients transferred to other acute care facilities); and 2) all deaths, regardless of cause, occurring after discharge from the hospital but before the end of the 30th postoperative day”.18 Major morbidity was defined as one or more of six previously defined major complications, including temporary or permanent renal failure requiring dialysis or temporary hemofiltration, neurologic deficit persisting at discharge, atrioventricular block or arrhythmia requiring a permanent pacemaker, post-operative mechanical circulatory support, phrenic nerve injury, or any unplanned cardiac surgical or catheter-based re-intervention prior to discharge.19
Analysis
Baseline patient, provider, and institutional characteristics were described using standard summary statistics. Surgeon experience (expressed as years since medical graduation) was evaluated as both continuous (linear) and categorical variables. When assessed as a categorical variable, it was analyzed first in four pre-determined groups: <15 years (early career), 15–24 years (mid-career), 25–34 years (senior), and ≥35 years (very senior) since medical school graduation. These roughly corresponded to surgeons <40, 40–50, 50–60, and 60–80 years old or <6, 6–15, 15–25, and >25 years since fellowship. Differences in patient characteristics across surgeon experience categories were compared using chi-square rank based group means score statistics, Wilcoxon rank sum or Kruskal-Wallis, and Cochran-Mantel-Haenszel tests. Surgeon average annualized volume was also plotted as a function of surgeon experience, using a scatter plot and Spearman correlation was used to assess the marginal association.
To assess the relationships between surgeon experience and each of the measured outcomes, logistic mixed effects models were constructed, selecting control variables from the previously established congenital heart surgery risk model and refitting the model after the introduction of the surgeon experience parameters.20 This model adjusts for baseline patient characteristics, including age at surgery, prematurity, weight (among neonates and infants), sex, year of surgery, presence of non-cardiac anatomic abnormalities or syndromes / chromosomal abnormalities, previous cardiothoracic operation, and preoperative mechanical ventilation, circulatory support, persistent shock, renal failure, or the presence of any other preoperative risk factor coded in the STS-CHSD, as well as STAT Mortality Category for the primary operative procedure and is associated with a C-statistic of 0.86 in predicting surgical mortality in the STS-CHSD.20 Surgeon experience was entered into this model first as a continuous variable and then as a categorical one. Surgeon experience was defined as the number of full years since medical school graduation on the date of a patient’s index operation, and thus surgeons were allowed to change age categories over the study period. To these models, two different measures of surgeon team experience were then added; surgeon team experience was assessed first as the average number of years since medical school for all surgeons operating at each center in a given year and then as the number of years since medical school for the most senior surgeon at each center. Both of these measures were assessed as linear variables. Because surgeon and center volumes were highly collinear, and because surgeon volume differed with surgeon experience, these models were tested with and without the inclusion of center volumes. Adjusted results were then calculated and plotted using restricted cubic splines, accounting for the non-linear relationship between surgeon experience and the composite outcome. To further investigate the effects of possible mediation or effect modification by volume, data was also stratified by surgeon volume tertiles, and models were rerun. A volume-experience interaction term was also tested in the models. In additional sensitivity analyses, to test the possibility that our findings were driven by the outcomes of a small number of very high volume surgeons (n=7), we then excluded surgeons performing more than 250 cases per year and reran our analyses again. Next, to explore the effects within the very senior surgeon category, this cohort was further divided on the basis of years of experience (into those surgeons 35–40 years and those >40 years post medical school) and analyses were rerun. Finally, our composite outcome was separated into its component parts and mortality and major morbidity were tested separately. All models included center- and surgeon-level random intercepts.
Analyses were performed using SAS version 9.4 (SAS Institute, Inc. Cary, NC) and R version 3.2.1 (R Foundation for Statistical Computing, Vienna, Austria). P-values <0.05 were considered statistically significant.
Results
We identified 206 surgeons from 91 centers. They performed a total of 62,851 index operations (6,198 by the most junior surgeons and 9,044 by the very senior surgeons). As of the end of the study period (2014), the median surgeon was 51 years old (interquartile range [IQR] 46–59, range 35–80 years old), and was 25 years post medical school graduation (IQR 19–32, range 9–55 years). The median surgeon finished his/her last postgraduate training 9 years after medical school (IQR 8–11). Years since medical school graduation was highly correlated with both age (ρ=0.97, p<0.0001) and years since fellowship (ρ=0.97, p<0.0001). Approximately one quarter of the surgeons in our cohort were the only surgeons operating at their centers and 90% operated at centers with three or fewer surgeons (see Table 1), though only one surgeon with <15 years of experience operated as the sole surgeon at his/her institution. Very senior surgeons operated in similarly sized divisions/departments as their mid-career and senior colleagues. Average surgeon volumes were lowest among the youngest surgeons, peaked among mid-career and senior surgeons, and then tapered among the most senior. No surgeon fewer than 18 years or more than 40 years from medical school performed more than 250 operations per year (see Figure 1 and Table 2).
Table 1.
Number of Surgeons per Center and Median Surgeon Experience by Academic Year
| Academic Year (Number of Centers) |
||||||
|---|---|---|---|---|---|---|
| 2009–2010 (N=70) |
2010–2011 (N=78) |
2011–2012 (N=82) |
2012–2013 (N=85) |
2013–2014 (N=84) |
Overall (N=91) |
|
| Number of Surgeons Per Center | ||||||
| 1 Surgeon | 17 (24.3%) | 20 (25.6%) | 20 (24.4%) | 24 (28.2%) | 21 (25.0%) | 17 (18.7%) |
| 2 Surgeons | 37 (52.9%) | 31 (39.7%) | 37 (45.1%) | 33 (38.8%) | 32 (38.1%) | 28 (30.8%) |
| 3 Surgeons | 11 (15.7%) | 20 (25.6%) | 18 (22.0%) | 19 (22.4%) | 22 (26.2%) | 24 (26.4%) |
| 4 Surgeons | 4 (5.7%) | 4 (5.1%) | 4 (4.9%) | 6 (7.1%) | 6 (7.1%) | 12 (13.2%) |
| 5 Surgeons | 1 (1.4%) | 2 (2.6%) | 2 (2.4%) | 1 (1.2%) | 0 (0.0%) | 4 (4.4%) |
| 6 Surgeons | 0 (0.0%) | 1 (1.3%) | 1 (1.2%) | 2 (2.4%) | 1 (1.2%) | 3 (3.3%) |
| 7 Surgeons | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | 1 (1.2%) | 1 (1.1%) |
| 8 Surgeons | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | 1 (1.2%) | 2 (2.2%) |
| Cumulative Surgeon Experience Per Center* | ||||||
| Median (IQR) | 47.0 (33.0, 67.0) | 45.5 (32.0, 58.0) | 48.0 (33.0, 65.0) | 46.5 (33.0, 67.0) | 46.0 (34.0, 69.0) | 55.0 (39.0, 81.5) |
| Average Surgeon Experience Per Center† | ||||||
| Median (IQR) | 23.0 (20.3, 26.5) | 23.1 (20.0, 27.0) | 23.6 (19.0, 27.0) | 23.8 (20.0, 28.0) | 24.3 (20.9, 28.3) | 22.9 (20.0, 26.3) |
Cumulative surgeon experience refers to the total number of years since medical school graduation of all surgeons operating at each center.
Average surgeon experience refers to the average number of years since medical school graduation of all surgeons operating at each center.
Figure 1.

Surgeon Average Annualized Volume as a Function of Surgeon Experience at Study Completion (2014). Vertical lines represent divisions between surgeon experience quartiles. Horizontal lines represent divisions between surgeon volume tertiles.
Table 2.
Surgeon Experience and Volume Characteristics, 2014
| Surgeon Volume | |||||
|---|---|---|---|---|---|
| Surgeon Experience, 2014* |
< 81.4 | 81.4 – 152 | 152 – 250 | 250+ | Total |
| < 15 years | 8 (3.9%) | 5 (2.4%) | 1 (0.5%) | 0 (0.0%) | 14 (6.8%) |
| 15 – 24 years | 25 (12.1%) | 33 (16.0%) | 28 (13.6%) | 2 (1.0%) | 88 (42.7%) |
| 25 – 34 years | 14 (6.8%) | 21 (10.2%) | 21 (10.2%) | 3 (1.5%) | 59 (28.6%) |
| 35+ years | 22 (10.7%) | 10 (4.9%) | 11 (5.3%) | 2 (1.0%) | 45 (21.8%) |
| Total | 69 (33.5%) | 69 (33.5%) | 61 (29.6%) | 7 (3.4%) | 206 (100.0%) |
Note, surgeon experience was defined as the number of full years since medical school graduation on the date of a patient’s index operation, and thus surgeons were allowed to change age categories over the study period. This table displays their age categories in the last year of the study, 2014.
There were some differences in baseline patient characteristics between surgeon experience quartiles. The most junior surgeons tended to perform fewer STAT Mortality Risk Category 5 cases (the highest risk category; 3.4% vs. 5.4%, p<0.0001), fewer STAT Morbidity Category 5 cases (3.1% vs. 4.2%, p<0.0001), fewer cases on children with preoperative risk factors (when considered as a composite variable) (29.0% vs. 32.4%, p<0.0001), and fewer reoperations (20.9% vs. 28.8%, p<0.0001). Very senior surgeons tended to operate on slightly older children (median age 10 months vs. 7 months, p<0.0001), including fewer neonates and infants (52.6% vs. 60.0%, p<0.0001). Their patients were also slightly less likely to be coded for prematurity (14.9% vs. 16.0%, p<0.0001) and had, on average, a statistically higher (though clinically similar) weight for age Z-score. These very senior surgeons were more likely than their younger counterparts to perform operations on children who had previously undergone congenital heart surgeries (31.9% vs. 27.4%, p<0.0001). There were no clear differences in STAT Morbidity19 or STAT Mortality Risk Categories16 or other preoperative risk factors between the very senior surgeons and their senior or mid-career colleagues. Missing data were rare. For details, see Table 3.
Table 3.
Baseline patient characteristics, preoperative factors, and hospital volumes, stratified by surgeon experience for the surgeon of record.
| Overall N=62,851† |
Surgeon Experience in Years Since Medical School* | p-Value‡ | ||||
|---|---|---|---|---|---|---|
| Early Career <15 years N=6,198 |
Mid-Career 15–24 years N=29,391 |
Senior 25–34 years N=18,218 |
Very Senior 35+ years N=9,044 |
|||
| Age at Surgery (years) | 0.6 (0.1, 3.9) | 0.5 (0.1, 3.8) | 0.5 (0.1, 3.4) | 0.6 (0.1, 4.2) | 0.8 (0.2, 5.1) | <.0001 |
| Age at Surgery (days) | <.0001 | |||||
| <30 | 13,700 (21.8%) | 1,352 (21.8%) | 6,693 (22.8%) | 3,915 (21.5%) | 1,740 (19.2%) | |
| >=30 and <365 | 23,390 (37.2%) | 2,375 (38.3%) | 11,369 (38.7%) | 6,626 (36.4%) | 3,020 (33.4%) | . |
| >=365 | 25,761 (41.0%) | 2,471 (39.9%) | 11,329 (38.5%) | 7,677 (42.1%) | 4,284 (47.4%) | . |
| Sex (Female) | 28,457 (45.3%) | 2,872 (46.3%) | 13,358 (45.4%) | 8,125 (44.6%) | 4,102 (45.4%) | 0.0687 |
| Premature Birth | 9,989 (15.9%) | 1,032 (16.7%) | 4,784 (16.3%) | 2,821 (15.5%) | 1,352 (14.9%) | 0.0001 |
| Weight for Age Z-Score | −1.0 (−2.0, −0.1) | −1.1 (−2.1, −0.1) | −1.1 (−2.1, −0.1) | −1.0 (−2.0, −0.1) | −1.0 (−2.0, −0.0) | <.0001 |
| Any Preoperative Risk Factors | 20,183 (32.1%) | 1,797 (29.0%) | 9,319 (31.7%) | 6,153 (33.8%) | 2,914 (32.2%) | <.0001 |
| Any Non-Cardiac Anatomic Abnormalities | 2,340 (4.2%) | 242 (4.2%) | 1,114 (4.3%) | 658 (4.0%) | 326 (4.2%) | 0.4879 |
| Any Syndrome / Chromosomal Abnormalities | 15,255 (24.3%) | 1,506 (24.3%) | 7,273 (24.7%) | 4,296 (23.6%) | 2,180 (24.1%) | 0.0468 |
| STS-EACTS Mortality Complexity Level | <.0001 | |||||
| 1 | 18,018 (28.7%) | 2,067 (33.3%) | 8,623 (29.3%) | 4,786 (26.3%) | 2,542 (28.1%) | |
| 2 | 18,309 (29.1%) | 1,747 (28.2%) | 8,452 (28.8%) | 5,409 (29.7%) | 2,701 (29.9%) | . |
| 3 | 8,227 (13.1%) | 716 (11.6%) | 3,746 (12.7%) | 2,483 (13.6%) | 1,282 (14.2%) | . |
| 4 | 15,039 (23.9%) | 1,456 (23.5%) | 7,013 (23.9%) | 4,515 (24.8%) | 2,055 (22.7%) | . |
| 5 | 3,258 (5.2%) | 212 (3.4%) | 1,557 (5.3%) | 1,025 (5.6%) | 464 (5.1%) | . |
| STS-EACTS Morbidity Complexity Level | <0.0001 | |||||
| 1 | 21,419 (34.1%) | 2,391 (38.6%) | 10,122 (34.4%) | 5,775 (31.7%) | 3,131 (34.6%) | |
| 2 | 16,478 (26.2%) | 1,598 (25.8%) | 7,591 (25.8%) | 4,859 (26.7%) | 2,430 (26.9%) | |
| 3 | 8,491 (13.5%) | 727 (11.7%) | 3,920 (13.3%) | 2,628 (14.4%) | 1,216 (13.4%) | |
| 4 | 10,820 (17.2%) | 1,036 (16.7%) | 5,134 (17.5%) | 3,215 (17.6%) | 1,435 (15.9%) | |
| 5 | 2,567 (4.1%) | 193 (3.1%) | 1,215 (4.1%) | 757 (4.2%) | 402 (4.4%) | |
| Previous Cardiothoracic Operation(s) | 17,623 (28.0%) | 1,295 (20.9%) | 7,766 (26.4%) | 5,680 (31.2%) | 2,882 (31.9%) | <.0001 |
Data presented as medians and interquartile ranges or number of cases with percentages.
N = The number of index operations performed within each surgeon experience category.
P-values compare patient and hospital characteristics between surgeon experience categories.
Major morbidity or mortality occurred in 11.5% of children (n=7,236); Major morbidity alone occurred in 8.8% (n=5,500) and 3.6% died (n=2,236). In multivariable analyses, when assessed as a continuous, linear, variable, surgeon experience was not associated with any of the measured outcomes. Assessed as a categorical variable, we found that the odds of major morbidity or mortality were similar for early-career, mid-career, and senior surgeons, even after adjusting for patient characteristics, center volumes, and surgeon team experience. The odds of major morbidity or mortality were approximately 25% higher for patients operated on by the very senior surgeons. The magnitude of this effect remained similar before and after adjusting for known confounders, including patient characteristics, center volumes, and surgeon team experience. Stratifying analyses by surgeon volume, the effect of surgeon seniority was seen only in the highest volume stratum (among surgeons performing >152 cases per year). This remained true in sensitivity analyses, after excluding surgeons performing >250 cases annually. For details, see Table 4. The interaction term for volume and experience was not significant. Additional sensitivity analyses tested the hypothesis that the observed associations were importantly influenced by a relatively small number of surgeons with the most years since training (≥40 years since medical school or roughly ≥65 old). Splitting the very senior surgeon cohort to isolate those surgeons ≥40 years post medical school did not meaningfully change our results, and our results remained statistically significant for the group 35–39 years out from medical school (OR 1.24, CI 1.02–1.50, p=0.0282), suggesting that our results were not skewed by a select few surgeons with the most years in practice.
Table 4.
The effects of surgeon experience on major morbidity or mortality.
| OR for Surgeon Experience (95% CI) | ||||
|---|---|---|---|---|
| p value | ||||
| Early Career <15 years |
Mid-Career 15–24 years |
Senior 25–34 years |
Very Senior 35+ years |
|
| Unadjusted | Reference | 1.19 (1.04, 1.36) 0.0125 | 1.15 (0.98, 1.35) 0.0861 | 1.22 (1.01, 1.47) 0.0377* |
| Adjusted for patient characteristics | “ | 1.11 (0.97, 1.27) 0.1325 | 1.04 (0.89, 1.22) 0.5964 | 1.24 (1.03, 1.49) 0.0217* |
| Adjusted for patient characteristics & center volumes | “ | 1.11 (0.97, 1.27) 0.1314 | 1.04 (0.89, 1.22) 0.6412 | 1.24 (1.04, 1.49) 0.0197* |
| Adjusted for patient characteristics, center volumes, & average center surgical experience | “ | 1.11 (0.97, 1.27) 0.1286 | 1.04 (0.89, 1.23) 0.6173 | 1.25 (1.03, 1.51) 0.0219* |
| Adjusted for patient characteristics, center volumes, & maximum center surgical experience | “ | 1.12 (0.98, 1.28) 0.1121 | 1.05 (0.90, 1.24) 0.5265 | 1.27 (1.06, 1.54) 0.0115* |
| Stratified by surgeon volume | ||||
| Low volume (<81.4 cases per year) | “ | 1.16 (0.81, 1.66) 0.4116 | 1.24 (0.85, 1.82) 0.2639 | 1.28 (0.83, 1.98) 0.2622 |
| Medium volume (81.4 – 152 cases / year) | “ | 1.14 (0.92, 1.42) 0.2391 | 1.10 (0.85, 1.42) 0.4897 | 1.11 (0.81, 1.52) 0.5178 |
| High volume (>152 cases / year) | “ | 1.10 (0.90, 1.34) 0.3534 | 1.02 (0.80, 1.30) 0.8651 | 1.35 (1.04, 1.77) 0.0260* |
| Stratified by surgeon volume (excluding surgeons with >250 cases / year) | ||||
| Low volume (<81.4 cases / year) | “ | 1.16 (0.81, 1.66) 0.4217 | 1.24 (0.84, 1.81) 0.2759 | 1.28 (0.83, 1.98) 0.2673 |
| Medium volume (81.4 – 152 cases / year) | “ | 1.14 (0.92, 1.43) 0.2306 | 1.10 (0.85, 1.42) 0.4738 | 1.11 (0.81, 1.53) 0.5081 |
| High volume (152 – 250 cases / year) | “ | 1.09 (0.88, 1.35) 0.4308 | 1.03 (0.80, 1.34) 0.8126 | 1.37 (1.02, 1.84) 0.0338* |
Denotes p-value <0.05.
Surgeon experience was not significantly associated with mortality when assessed as an independent outcome. It was significantly associated with an increased odds of major morbidity for patients operated on by surgeons with the most years of experience (see Table 5).
Table 5.
The effects of surgeon experience on mortality and on major morbidity as separate outcomes.
| Unadjusted | Adjusted | |||
|---|---|---|---|---|
| Model | OR (95% CI) | p value | OR (95% CI) | p value |
| Mortality | ||||
| Surgeon Experience* | ||||
| < 15 years | Reference | Reference | Reference | Reference |
| 15 –24 years | 0.98 (0.80, 1.19) | 0.8008 | 0.88 (0.73, 1.08) | 0.2234 |
| 25–34 years | 1.00 (0.80, 1.25) | 0.9964 | 0.93 (0.74, 1.16) | 0.5041 |
| > 35 years | 0.89 (0.69, 1.16) | 0.3992 | 0.98 (0.76, 1.27) | 0.8935 |
| Major Morbidity | ||||
| Surgeon Experience | ||||
| < 15 years | Reference | Reference | Reference | Reference |
| 15 –24 years | 1.19 (1.02, 1.38) | 0.0249† | 1.10 (0.95, 1.28) | 0.2079 |
| 25–34 years | 1.12 (0.94, 1.34) | 0.2147 | 1.00 (0.84, 1.19) | 0.9997 |
| > 35 years | 1.28 (1.04, 1.58) | 0.0191† | 1.27 (1.03, 1.55) | 0.0218† |
Surgeon Experience is described as years since medical school graduation.
Denotes p-value <0.05.
Discussion
In this study of over 200 congenital heart surgeons from 91 centers, we found patient outcomes for surgeons with the fewest years of experience to be comparable to those of their mid-career and senior colleagues, suggesting that the potential effects of the learning curve for junior surgeons in the field might be mitigated by some combination of existing referral patterns and other processes of care in place within institutions or professional societies. Patients operated on by very senior surgeons (35–55 years from medical school), however, had significantly higher risk-adjusted odds of the composite outcome, major morbidity or mortality (driven by differences in morbidity). The magnitude of these effects remained stable, even after considering patient characteristics, center volumes, and different measures of surgeon team experience. Surgeons with the least experience did tend to operate on lower-risk patients than did their mid-career and senior colleagues. There was no evidence to suggest that very senior surgeons operated on systematically higher-risk patients.
The existing literature on provider experience has been limited to adult subspecialties and results have been mixed.3 In general, studies involving surgical procedures on adult patients have tended to describe provider “learning curves”, with worse outcomes among the most junior practitioners, which gradually improve with time.4–6 Some researchers have also pointed to declines in outcomes among very senior adult providers performing technically complex procedures.7–11 Studies have shown that older physicians are less likely to incorporate new treatments into their practices relative to younger physicians,21, 22 have worse performance on recertification examinations,23, 24 and might, in fact, have diminished manual dexterity, visuospatial abilities, and sustained attention.25–28
Interestingly, in our study we found no differences in outcomes for congenital heart surgeons early in their career as compared to their mid-career or senior colleagues. While we believe that there is a learning curve for congenital heart surgeons, our data suggest either that it occurs very early (such that grouping all surgeons less than six years from terminal training into the same category obscures any perceivable differences in patient outcomes), or that the congenital heart community does an appropriate job of allocating cases and of supporting junior surgeons (or both). Certainly it is true that many junior surgeons have senior or very senior colleagues who discuss operative plans with them and/or scrub in and assist with their more complicated cases, which is not recorded in our database. Many, in fact, operate for several years with very close supervision in what might be characterized as an extended apprenticeship model. Perhaps it is also true that other surgeons, or even cardiologists, take time to work with the junior surgeons, to help them select their cases, and to plan pre- or postoperatively in ways that avert adverse events. This might take place through pre-operative multidisciplinary planning conferences recommended by the Society of Thoracic Surgeons and the Congenital Heart Surgeons’ Society, or through less formal mechanisms.29 While our data do not allow us to investigate these specific mentorship-related factors in detail, they suggest that the current mechanisms of support in place during the early portion of congenital heart surgeons’ careers in the United States, in combination with patterns of surgical referral, are generally adequate to mitigate potential effects of a surgeon learning curve on patient outcomes.
It is notable that we do not see changes in the magnitude of the effects of surgeon experience on outcomes when adjusting for different measures of surgeon team experience, suggesting that junior surgeons in this community are well supported, regardless of the years of experience of the surgeons with whom they work. In considering these findings, it could be that the number of years that ones’ surgical colleagues have been in practice is not an accurate proxy for mentorship in the operating theater. Alternately, it could be that the experience of the entire cardiac care team (not just the surgeons) is critical. These possibilities warrant further investigation.
The decline in patient outcomes among very senior surgeons in our study is similar to the findings of several previous studies in adult subspecialties.7–11 Waljee and colleagues noted this decline to be particularly prominent among surgeons performing the most technically or physically demanding operations—which certainly would include congenital heart surgeons. Contrasting with our study, Waljee et al. found surgical volume to be protective, with a decline in patient outcomes isolated to lower volume very senior surgeons. Their study prompted a call for surgeons to take an all-or-none approach to operating and to terminate rather than to gradually reduce their volumes and to “slowly fade away”.7 The volume-experience interaction we describe—with the poorest outcomes isolated to the highest volume very senior surgeons—suggests that, at least for congenital heart surgeons, volume might not be the solution.
Data for this study are derived from a clinical registry. As such, one has to consider the possibility that the observed differences in patient outcomes might be related to incomplete risk adjustment rather than the true effects of experience. While the mortality risk model we used discriminates at a high level (c-statistic 0.86)20, it does not account for all potential confounders. In addition, this model has only been validated with respect to the mortality end-point, not our composite outcomes. Analyzing our data, we noted that the number of patients undergoing reoperations increased with surgeon seniority and we hypothesized that, perhaps, there were other, unmeasured risk factors that were also increasing. Perhaps, there were subtle differences in cardiac anatomy, ventricular function, number or complexity of preoperative risk factors or extracardiac anomaly types for example, not captured in the registry, that were making the early-career surgeons’ patients lower risk than they appeared and the very senior surgeons’ patients higher risk. This certainly fit with our clinical perception. Were this the case, however, one would assume that there would be other observable patient risk factors that were also decreased for junior surgeons and increased for the most senior. This might be consistent with our data for early-career surgeons who appeared to perform fewer STAT Mortality Category 5 and STAT Morbidity Category 5 procedures. It was not, however, what we found for the most senior surgeons. In fact, differences in observed characteristics across surgeon experience categories appear to indicate that, on average, very senior congenital heart surgeons operate on fewer of the highest risk patients than do their mid career and senior colleagues (See Figure 1). Extensive secondary analyses exploring the effects of unmeasured risk were also performed. None of these analyses support the hypothesis of confounding by unmeasured risk either. The addition of all observable risk factors to our multivariable models changed negligibly the point estimates for the magnitude of the effects of surgeon years of experience on outcomes, indicating that risk adjustment is unlikely to be driving our results.
In interpreting our data, we find it critically important to point out that seniority in this study was arbitrarily set with a cut point at 35 years post medical school. This category incorporates surgeons 35 to 55 years out (~60 to 80 years old). The differences in patient outcomes that we observed do not necessarily begin at exactly 35 years. It is possible that the true tipping point for patient outcomes in this cohort occurs closer to 30, or 40, or even 45 years post medical school. In sensitivity analyses, we divided the very senior surgeon category into surgeons 35–39 and ≥40 years out from medical school. Our results remained statistically significant for the 35–39 year group, suggesting that our results were not driven by a select few surgeons with the most years of experience. Unfortunately, we do not have sufficient power to discriminate further within this age category. Certainly, the precise timing and impact of any age-related effects would also vary between individual surgeons. In addition, our data does not allow us to account for the possibility that high volume very senior surgeons, even when listed as the “surgeon of record”, might allow trainees (or more junior surgeons) to perform larger portions of their cases than do their mid career or senior colleagues. That having been said, Waljee et al. saw persistent effects of surgeon seniority in their cohort, even after controlling for hospital teaching status.7
Our study has a few other notable limitations. It is possible that some of our sub-analyses, such as the analyses of the lower and middle volume very senior surgeons, were underpowered, and that this prevented us from detecting meaningful differences in outcomes in these subgroups. Further, while we controlled for patient age and STAT Mortality Risk Category, there was not sufficient power to explore differences in the magnitude of the effects of surgeon experience on outcomes between age or Risk Categories. And finally, postoperative outcomes are related to a number of factors that might change with surgeon age, including, but not limited to technical proficiency, clinical decision making, interaction with other members of the care team, and processes of care. This data source cannot discern which aspects of surgeon performance improve/decline with age.
Our study has several important implications. First, it is helpful in reassuring families and the pediatric cardiology and cardiothoracic surgery community that, in general, surgeon years of experience are not associated with patient outcomes, or, at least, that, given the current system of support and referrals, junior surgeons are able to achieve outcomes that are not appreciably different from those of more senior surgeons. Second, as surgeons near the extreme end of the spectrum of experience (and thus, age), our data suggest that the performance of some might suffer. The extent of this effect is likely variable and undoubtedly some very senior surgeons continue to function at the highest levels. Nonetheless, our findings suggest that it might be prudent for the surgeons with the most years of experience to closely monitor their outcomes and to critically appraise their skills. Third, as medical boards rethink their approaches to training, continuing medical education, and maintenance of certification, there might be utility in considering the needs of the most senior surgeons, as Waljee’s study previously suggested.7 This having been said, we feel strongly that any blanket policy restricting practice to younger generations would be misplaced, as our clinical impression is that these senior mentors might be the very reason why junior surgeons in the congenital heart community demonstrate such outstanding outcomes. Critical assessment and dissemination of these mentoring, support, and referral practices might benefit the medical community at large. Future studies that examine these practices systematically might help shorten provider learning curves and improve patient outcomes across subspecialties.
Figure 2.

Risk-Adjusted Odds of Major Morbidity or Mortality as a Function of Surgeon Experience. Restricted cubic splines were used to visually display the risk-adjusted odds ratio (OR) of the composite outcome as a function of surgeon years since medical school graduation, including upper and lower 95% confidence intervals (CIs). Vertical lines demarcate surgeon experience categories and a reference value of 10 years since medical school graduation.
What Is Known
There is substantial variation in outcomes between congenital heart surgeons, even after adjusting for provider volumes, yet little data exist connecting other surgeon-specific factors to patient outcomes.
In other surgical fields, both provider “learning curves” and attrition have been described, with worse outcomes among the most junior and the most senior practitioners.
What The Study Adds
Within the context of existing referral and support practices, outcomes for junior congenital heart surgeons are excellent.
As congenital heart surgeons near the tail end of the experience spectrum, the performance of some appears to suffer, irrespective of provider volumes.
Acknowledgments
Sources of Funding: Dr. Anderson receives support for research from the National Center for Advancing Translational Sciences of the NIH (KL2 TR001874) and from The John M. Driscoll Scholar Award, Columbia University Medical Center. Dr. Hill receives support for research from the National Center for Advancing Translational Sciences of the NIH (KL2TR001115), from the Gilead Sciences Cardiovascular Scholars Program, and from Industry for Pediatric Drug Development (www.dcri.duke.edu/research/coi.jsp).
Footnotes
This manuscript was presented at the American Heart Association Scientific Sessions 2016 and was a finalist for the Cardiovascular Disease in the Young Early Career Investigator Award.
Disclosures: None.
References
- 1.Hoffman JI, Kaplan S. The incidence of congenital heart disease. J Am Coll Cardiol. 2002;39:1890–1900. doi: 10.1016/s0735-1097(02)01886-7. [DOI] [PubMed] [Google Scholar]
- 2.Anderson BR, Ciarleglio AJ, Cohen DJ, Lai WW, Neidell M, Hall M, Glied SA, Bacha EA. The norwood operation: Relative effects of surgeon and institutional volumes on outcomes and resource utilization. Cardiol Young. 2016;26:683–692. doi: 10.1017/S1047951115001031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: The relationship between clinical experience and quality of health care. Ann Intern Med. 2005;142:260–273. doi: 10.7326/0003-4819-142-4-200502150-00008. [DOI] [PubMed] [Google Scholar]
- 4.Epstein AJ, Srinivas SK, Nicholson S, Herrin J, Asch DA. Association between physicians' experience after training and maternal obstetrical outcomes: Cohort study. BMJ. 2013;346:f1596. doi: 10.1136/bmj.f1596. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Bridgewater B, Grayson AD, Au J, Hassan R, Dihmis WC, Munsch C, Waterworth P. Improving mortality of coronary surgery over first four years of independent practice: Retrospective examination of prospectively collected data from 15 surgeons. BMJ. 2004;329:421. doi: 10.1136/bmj.38173.577697.55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Huesch MD. Learning by doing, scale effects, or neither? Cardiac surgeons after residency. Health Serv Res. 2009;44:1960–1982. doi: 10.1111/j.1475-6773.2009.01018.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Waljee JF, Greenfield LJ, Dimick JB, Birkmeyer JD. Surgeon age and operative mortality in the united states. Ann Surg. 2006;244:353–362. doi: 10.1097/01.sla.0000234803.11991.6d. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Burns LR, Wholey DR. The effects of patient, hospital, and physician characteristics on length of stay and mortality. Med Care. 1991;29:251–271. doi: 10.1097/00005650-199103000-00007. [DOI] [PubMed] [Google Scholar]
- 9.O'Neill L, Lanska DJ, Hartz A. Surgeon characteristics associated with mortality and morbidity following carotid endarterectomy. Neurology. 2000;55:773–781. doi: 10.1212/wnl.55.6.773. [DOI] [PubMed] [Google Scholar]
- 10.Hartz AJ, Kuhn EM, Pulido J. Prestige of training programs and experience of bypass surgeons as factors in adjusted patient mortality rates. Med Care. 1999;37:93–103. doi: 10.1097/00005650-199901000-00013. [DOI] [PubMed] [Google Scholar]
- 11.Neumayer LA, Gawande AA, Wang J, Giobbie-Hurder A, Itani KM, Fitzgibbons RJ, Jr, Reda D, Jonasson O Investigators CSP. Proficiency of surgeons in inguinal hernia repair: Effect of experience and age. Ann Surg. 2005;242:344–348. doi: 10.1097/01.sla.0000179644.02187.ea. discussion 348–352. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Jacobs ML, Mavroudis C, Jacobs JP, Tchervenkov CI, Pelletier GJ. Report of the 2005 sts congenital heart surgery practice and manpower survey. Ann Thorac Surg. 2006;82:1152–1158. 1159e1151–1155. doi: 10.1016/j.athoracsur.2006.04.022. discussion 1158–1159. [DOI] [PubMed] [Google Scholar]
- 13.Clarke DR, Breen LS, Jacobs ML, Franklin RC, Tobota Z, Maruszewski B, Jacobs JP. Verification of data in congenital cardiac surgery. Cardiol Young. 2008;18(Suppl 2):177–187. doi: 10.1017/S1047951108002862. [DOI] [PubMed] [Google Scholar]
- 14.Society of thoracic surgeons. Society of thoracic surgeons national database. [Accessed december 1, 2013]; doi: 10.1136/heartjnl-2012-303456. http://Www.Sts.Org/sections/stsnationaldatabase/ < http://www.Sts.Org/sections/stsnationaldatabase/>. [DOI] [PubMed]
- 15.Nathan M, Jacobs ML, Gaynor JW, Newburger JW, Dunbar Masterson C, Lambert LM, Hollenbeck-Pringle D, Trachtenberg FL, White O, Anderson BR, Bell MC, Burch PT, Graham EM, Kaltman JR, Kanter KR, Mery CM, Pizarro C, Schamberger MS, Taylor MD, Jacobs JP, Pasquali SK Pediatric Heart Network I. Completeness and accuracy of local clinical registry data for children undergoing heart surgery. Ann Thorac Surg. 2016;103:629–636. doi: 10.1016/j.athoracsur.2016.06.111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.O'Brien SM, Clarke DR, Jacobs JP, Jacobs ML, Lacour-Gayet FG, Pizarro C, Welke KF, Maruszewski B, Tobota Z, Miller WJ, Hamilton L, Peterson ED, Mavroudis C, Edwards FH. An empirically based tool for analyzing mortality associated with congenital heart surgery. J Thorac Cardiovasc Surg. 2009;138:1139–1153. doi: 10.1016/j.jtcvs.2009.03.071. [DOI] [PubMed] [Google Scholar]
- 17.Silber JH, Williams SV, Krakauer H, Schwartz JS. Hospital and patient characteristics associated with death after surgery. A study of adverse occurrence and failure to rescue. Med Care. 1992;30:615–629. doi: 10.1097/00005650-199207000-00004. [DOI] [PubMed] [Google Scholar]
- 18.Jacobs JP, Mayer JE, Mavroudis C, O'Bien SM, Austin EH, Pasquali S, Hill KD, He X, Overman D, St Louis J, Karamlou T, Pizarro C, Hirsch-Romano JC, McDonald D, Han JM, Dokholyan RS, Tchervenkov CI, Lacour-Gayet F, Backer CL, Fraser CD, Tweddell JS, Elliott MJ, Walters HL, Jonas RA, Prager RL, Shahian DM, Jacobs ML. The society of thoracic surgeons congenital heart surgery database: 2016 update on outcomes and quality. Ann Thorac Surg. 2016;101:850–862. doi: 10.1016/j.athoracsur.2016.01.057. [DOI] [PubMed] [Google Scholar]
- 19.Jacobs ML, O'Brien SM, Jacobs JP, Mavroudis C, Lacour-Gayet F, Pasquali SK, Welke K, Pizarro C, Tsai F, Clarke DR. An empirically based tool for analyzing morbidity associated with operations for congenital heart disease. J Thorac Cardiovasc Surg. 2013;145:1046–1057 e1041. doi: 10.1016/j.jtcvs.2012.06.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.O'Brien SM, Jacobs JP, Pasquali SK, Gaynor JW, Karamlou T, Welke KF, Filardo G, Han JM, Kim S, Shahian DM, Jacobs ML. The society of thoracic surgeons congenital heart surgery database mortality risk model: Part 1-statistical methodology. Ann Thorac Surg. 2015;100:1054–1062. doi: 10.1016/j.athoracsur.2015.07.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Stolley PD, Becker MH, Lasagna L, McEvilla JD, Sloane LM. The relationship between physician characteristics and prescribing appropriateness. Med Care. 1972;10:17–28. doi: 10.1097/00005650-197201000-00003. [DOI] [PubMed] [Google Scholar]
- 22.Rhee SO. Factors determining the quality of physician performance in patient care. Med Care. 1976;14:733–750. doi: 10.1097/00005650-197609000-00002. [DOI] [PubMed] [Google Scholar]
- 23.Ramsey PG, Carline JD, Inui TS, Larson EB, LoGerfo JP, Norcini JJ, Wenrich MD. Changes over time in the knowledge base of practicing internists. JAMA. 1991;266:1103–1107. [PubMed] [Google Scholar]
- 24.Cruft GE, Humphreys JW, Jr, Hermann RE, Meskauskas JA. Recertification in surgery, 1980. Arch Surg. 1981;116:1093–1096. doi: 10.1001/archsurg.1981.01380200089020. [DOI] [PubMed] [Google Scholar]
- 25.Jackson GR, Owsley C, Cordle EP, Finley CD. Aging and scotopic sensitivity. Vision Res. 1998;38:3655–3662. doi: 10.1016/s0042-6989(98)00044-3. [DOI] [PubMed] [Google Scholar]
- 26.Jackson GR, Owsley C. Visual dysfunction, neurodegenerative diseases, and aging. Neurol Clin. 2003;21:709–728. doi: 10.1016/s0733-8619(02)00107-x. [DOI] [PubMed] [Google Scholar]
- 27.Mani TM, Bedwell JS, Miller LS. Age-related decrements in performance on a brief continuous performance test. Arch Clin Neuropsychol. 2005;20:575–586. doi: 10.1016/j.acn.2004.12.008. [DOI] [PubMed] [Google Scholar]
- 28.Peisah C, Wilhelm K. The impaired ageing doctor. Intern Med J. 2002;32:457–459. doi: 10.1046/j.1445-5994.2002.00279.x. [DOI] [PubMed] [Google Scholar]
- 29.Jacobs JP, Jacobs ML, Austin EH, 3rd, Mavroudis C, Pasquali SK, Lacour-Gayet FG, Tchervenkov CI, Walters H, 3rd, Bacha EA, Nido PJ, Fraser CD, Gaynor JW, Hirsch JC, Morales DL, Pourmoghadam KK, Tweddell JS, Prager RL, Mayer JE. Quality measures for congenital and pediatric cardiac surgery. World J Pediatr Congenit Heart Surg. 2012;3:32–47. doi: 10.1177/2150135111426732. [DOI] [PMC free article] [PubMed] [Google Scholar]
