Table 2.
Studies assessing educational outcomes
Study | Quality scores | Study design | Resident participants | Measure | Pre-2003 | Post-2003 |
---|---|---|---|---|---|---|
Obstetrics and gynecology | ||||||
Blanchard 200434 | 13.8 | Single site pre-post | 10 Ob/gyn | Many procedures decreased for PGY4sa | ‡ | ‡ |
Bailit 200535 | 13.8 | Single site cross-sectional survey | 28 Ob/gyn residents and graduates | No change in CREOG examination scores | ‡ | ‡ |
Short 200655 | 12.6 | Single site pre-post | 35 Ob/Gyn | Overall cases: no change | ‡ | ‡ |
Surgery | ||||||
Goldstein 200438 | 11.5 | Single site pre-post | General surgery † | PGY5 operative: unchanged | ‡ | ‡ |
Welling 200439 | 12.67 | Prospective cohort | General surgery† | Chief cases/month | ‡ | ‡ |
Night float residents: 7.25 | ||||||
Residents not on night float: 34.75 | ||||||
Bland 200540 | 14.67 | Multi-site pre-post | General surgery† | Total major procedures | 938 | 932 |
Feanny 200542 | 13.33 | Single site pre-post | 13 General surgery | Total emergency abdominal surgeries as primary surgeon | 101 (13) | 110 (33) |
Ferguson 200543 | 13.33 | Single site pre-post | General surgery † | PGY5 operative experience | 339 | 390 |
231 | 246 | |||||
Overall | ||||||
McElearney 200545 | 13.33 | Single site pre-post | General surgery † | PGY5 cases/month | 30.6 (8.5) | 26.1 (9.6) |
Overall cases/month | 23.9 (16.3) | 24.6 (16.1) | ||||
Mendoza 200546 | 13 | Multi-site survey/non-randomized | General surgery † | Chief resident operative volume at universities | ‡ | ‡ |
With rules: 250.5 (13.6) | ||||||
Without: 262.6 (16.1) | ||||||
Spencer 200548 | 9 | Pre-post single | 91 Pediatric surgery | Senior residents (cases/day) | 1.58 (0.42) | 1.84 (0.87) |
Vetto 200549 | 9 | Single site pre-post | 40 General surgery | ABSITE scores increased by 7% post-2003 | ‡ | ‡ |
Zare 200550 | 12 | Multi-site pre-post | 238 General surgery | ABSITE scores | 70 (10.3) | 69.8 (10.2) |
de Virgilio 200652 | 14.67 | Single site pre-post | General surgery † | Operative experience: no change | ‡ | ‡ |
ABSITE score: no change | ||||||
Hutter 200654 | 15 | Single site pre-post | 58 General surgery | Operative experience | 231 | 246 |
ABSITE scores: no change | ||||||
Carlin 200756 | 13.8 | Pre-post single site | 126 General surgery resident-years | Operative cases/resident/year | 278 (100) | 211 (150)a |
Damadi 200757 | 12 | Single site pre-post | 17 General surgery | PGY 5 Operative experience | 255 (19) | 189 (11)a |
Izu 200758 | 9.5 | Single site pre-post | 2 General surgery | Surgeries covered by a resident | 47 (35%) | 49 (45%) |
Pappas 200759 | 13.8 | Single site pre-post | 79 Orthopedic resident-years | Operative experience | 455 | 467 |
Schneider 200761 | 12.5 | Single site pre-post | 66 General surgery | Overall operative experience | 1,112 | 1,277 |
ABSITE scores PGY5 | 78.8 (3.7) | 78 (3.1) | ||||
Weatherby 200762 | 12.6 | Single site pre-post | 8 Orthopedic | Operative experience: | 954 | 759 |
Baskies 200863 | 13.33 | Pre-post single site | 109 Orthopedic surgery | Operative experience | 363 (145) | 410 (164)a |
Durkin 200864 | 13.33 | Single site pre-post study | General surgery † | Operative experience | 1,052 | 1,011 |
ABSITE scores (pre-post): +3.6% correct | ||||||
Kairys 200865 | 14.67 | National pre-post | General surgery † | Total cases as chief or juniorurgeon | 930 | 909a |
Shin 200866 | 12.6 | Single site retrospective pre-post | General surgery † | % Cases covered by PGY 4–5 | 94% | 92% |
% Cases covered overall | 79% | 80% | ||||
Christmas 200968 | 13.33 | Single site pre-post | 22 General surgery | Total chief resident cases | 494 (116) | 333 (116)a |
Froelich 200969 | 13.33 | Single site retrospective pre-post | 97 Orthopedic surgery resident-years | PGY5 operative experience | 424 | 457 |
PGY5 ITE scores | 196 | 197 | ||||
Jagannathan 200970 | 12.5 | Multi-site pre-post | Neurosurgery† | American Board of Neurosurgery Examination (PGY 2–3) | 310 (55) | 259 (48)a |
Privette 200971 | 14.67 | Single site retrospective cohort | 48 general surgery | Operative experience | 985 | 887 |
Sarff 200972 | 8 | Single site pre-post study | 36 General surgery | Operative experience (as surgeon or teaching assistant) | 984 | 1,057 |
Shonka 200973 | 13.8 | Single site retrospective cohort study | Approximately 30 otolaryngology | Total cases as surgeon | 1,515 | 1,533 |
In-training examination scores | 6.55 | 6.53 | ||||
Sneider 200974 | 12.5 | Multi-site cross-sectional survey | General surgery programs† | ABSITE PGY5 | 73.4 (4.4) | 71.3 (3.2) |
American Board of Surgery pass rate | 80.5% (18.7) | 91% (8.3) |
Participants are residents, unless otherwise specified. Outcome measures include standardized examination scores and/or pass rates and operative experience reported as number of cases, unless otherwise specified. For operative experience, we report numbers for overall and final (chief) year of residency
PGY = post-graduate year
aStatistically significant at the p < 0.05 level or less
†Number not provided
‡See Measures column