Abstract
Background
Progressive independence in patient care activities is imperative for residents' readiness for practice and patient safety of those cared for by graduates of residency programs. However, establishing a standardized system of progressive independence is an ongoing challenge in graduate medical education.
Objective
We aggregated trainees' perspectives on progressive independence, developed a model of the ideal state, and suggested actionable improvements.
Methods
A multispecialty, nationally representative group of trainees conducted a structured exercise that (1) described the attributes of an ideal system of graduated responsibility; (2) compared the current system to that ideal; (3) developed benchmarks to reinforce best practices; and (4) identified approaches to motivate programs to adopt best practices.
Results
At the core of an ideal model of graduated responsibility is a well-structured curriculum and assessment of individual learners using educational milestones and patient outcomes. The ideal model also includes robust faculty development and emphasizes faculty mentorship. To address legal and financial restrictions that pose barriers to progressive independent, objective outcome criteria like the milestones could be used to ask payers to alter payment restrictions for work performed by senior trainees, providing financial incentives for programs to encourage appropriate independent practice. Recognition of high-performing programs at the national level could motivate others to adopt best practices.
Conclusions
A multifaceted approach, incorporating robust 2-way feedback about skill level and autonomy between residents and faculty, along with improved faculty development in this area, is needed to optimize residents' attainment of progressive independence. There are incentives to move programs and institutions toward this optimal model.
Editor's Note: The online version (38KB, doc) of this article contains the first draft themes for each of the study questions.
Introduction
Progressive independence and the integration of appropriate graduated responsibility are ongoing challenges in graduate medical education. Twenty years ago, some felt that trainees were given too much independence in the care of patients too early; there is now a growing concern that they are not given sufficient responsibility prior to entering unsupervised practice after graduation. Residents, program directors, and practicing physicians have all voiced concerns about difficulties some recent graduates appear to experience in making the transition to practice. In a survey, 21% of fellowship directors training graduates of general surgery residencies have reported new fellows to arrive unprepared for the operating room.1 The same survey found that 38% of incoming fellows were deficient in the area of patient ownership, 30% were unable to independently perform a laparoscopic cholecystectomy, and 66% were deemed unable to operate unsupervised for 30 minutes of a major procedure.1 In a survey of practicing surgeons, only 40% agreed with the statement: “Graduates of surgery residencies today are prepared in the clinical practice of surgery.”2 Although continued mentorship in both academic and private practice settings can partially compensate for this gap in transition to practice patient safety mandates that this transition be seamless.
There are many reasons why the current system of graduated independence may be failing a sizable portion of trainees. Influences such as duty hour limits, increasing demand for efficiency, greater focus on patient outcomes, and managed care regulations all may contribute to greater involvement of attending physicians at the expense of optional training.3 The public also appears to be uncomfortable with residents practicing independently, despite appropriate supervision. A study showed that 91% of 370 patients undergoing an elective surgical procedure felt an attending surgeon should be present for the entire procedure if a resident was involved.4 However, residents late in their training often view continuous supervision as detrimental to their autonomy and ability to transition to practice.5 It is possible that the concerns about progressive independence may be artificially amplified, due to discord between residents' perceived versus actual ability,6 as well as the lack of clearly defined metrics for assessing readiness for independent practice.7
To better define the issues at stake, the Council of Review Committee Residents (CRCR), a 31-member expert panel of residents and fellows representing all specialties accredited by the Accreditation Council for Graduate Medical Education (ACGME), held a series of structured discussions about progressive responsibility. The aim was to define the ideal system of graduated responsibility and progressive independence from a trainee perspective, and to compare the current system to the ideal to identify areas for improvement. From the results of this exercise, the CRCR members developed consensus recommendations for policy change in this area to inform further deliberations by the ACGME and the medical education community on this critical issue.
Methods
The CRCR is made up of the resident representatives of all ACGME Residency Review Committees, the Institutional Review Committee, and the Clinical Learning Environment Review Committee.
At the CRCR meeting in January 2014, 24 participants (6 members representing hospital-based specialties, 8 members representing medical specialties, and 10 members representing surgical specialties) completed the first stage of the structured discussion. Participants were assigned to 4 groups, and each group was asked to consider 1 of the 4 study questions shown in the table. Ideas were recorded and shared in the small groups, followed by discussion in the full committee. The second stage of the project, the generation of consensus themes, took place at the January 2015 meeting of the CRCR. All participants gave verbal consent for the data to be aggregated for this article.
TABLE.
Study Questions and Consensus Themes
Ideas from the small group exercise were printed on separate strips of paper, divided by study question. The 34 residents and fellows in attendance (the meeting included incoming committee members) were divided into 2 groups. Each group of 17 participants was assigned 2 of the questions from the table. Each participant sorted ideas for each question into themes and reported this set of themes to the group; these themes were recorded as “first draft themes.” Each group then further synthesized the first draft themes into “consensus themes.” In the final stage, consensus themes from the 2 groups were discussed by the full committee, but were not modified further.
Results
Question 1 asked committee members to imagine an ideal system of progressive independence and graduated responsibility. Eighteen first draft themes were identified (provided as online supplemental material) and were subsequently consolidated into 4 consensus themes (table). An ideal system would include an infrastructure and curriculum for progressive responsibility, faculty development, and accountability and mentorship. It would also include ongoing measurement of patient safety and outcomes data that would inform the degree of resident involvement.
Question 2 asked how the current state of training compares to the ideal identified in Question 1. Twenty-two first draft themes emerged (provided as online supplemental material) and were refined into 7 consensus themes (table). This highlighted that the current system differs substantially from the imagined ideal. Critical themes included (1) a perception that trainees receive too much responsibility early in residency and too little later in training; (2) a consensus that there is a lack of feedback between residents and faculty about trainees' skill level and expected independence, which leads to suboptimal decisions about trainee responsibility; and (3) an agreement about a lack of formal faculty training on how to appropriately distribute independence over the period of formal training.
Question 3 asked participants to envision how the educational milestones could be used to measure graduated responsibility, progressive independence, and readiness for independent practice. Six first draft themes (provided as online supplemental material) were consolidated into 5 consensus themes (table). General categories of milestones that were suggested included teaching, leadership, business of medicine (eg, coding, billing), and a need for more robust milestones pertaining to self-evaluation.
Question 4 asked CRCR members to describe incentives that could be used to motivate programs to adopt best practices. Seven first draft themes (provided as online supplemental material) were refined into 4 consensus themes (table). A key finding was that the educational milestones, as objective educational outcomes criteria, could be used to petition payers and legislators to alter billing/payment restrictions regarding work performed by senior trainees. This could provide financial incentives for programs to encourage appropriate transition to independent practice for these senior trainees. We also identified a need for better data metrics to monitor employer and graduate satisfaction with the transition to independent practice. Finally, creating a means of formal recognition for high-performing programs would encourage competition and innovation among programs with regard to systems of graduated responsibility.
Discussion
The fundamental role of a residency program is to develop physicians who can practice medicine independently and safely. Unfortunately, the current system of graduated responsibility and progressive independence appears to fall short of this goal for a sizable portion of learners. Evidence suggests that trainees do not feel adequately prepared to practice independently, and that a significant percentage of physicians in practice believe that residency graduates are not ready to enter practice. It is clear that the current system of graduated responsibility and progressive independence needs to be improved to ensure patient safety as physicians enter independent practice.
The CRCR members felt that the ideal system of graduated responsibility would include a well-structured curriculum focused on stepwise learning, complemented by robust faculty development and active mentorship. Ideally, the milestones would be leveraged to provide concrete markers of demonstrable skills, which would build resident/fellow and staff confidence in the ability of trainees to function autonomously within the bounds of their identified strengths and areas for improvement. Adaptability to the capabilities and needs of the individual trainee is crucial to an individualized learning trajectory and responsibility/independence assigned to each learner over time.
Many factors will need to be considered when constructing the solution to this problem. Public attitudes increasingly demand direct attending physician involvement in patient care, even for senior trainees. One study showed that over 90% of patients expected the attending surgeon to be present for the entire procedure,4 yet surgery residents believe they are given less operative autonomy than their ability warrants.8 Some have suggested that attending physicians decrease trainee responsibility due to a desire to increase efficiency and comply with hospital and patient expectations. Another factor may be a perception that duty hour limits have produced shift-work mentality and decreased ownership of patients in residents.9 There is information indicating that attending physicians significantly restrict the independence of weaker residents, further reducing opportunities for improvement for those who need it most.10 While this is not an inherently wrong approach, unless accompanied by effective remediation, it does not address the underlying problem of inadequate progression of responsibility and autonomy as learners advance in their training.
Finding the optimal balance between appropriate supervision and promoting autonomy is complex. Studies show that residents work above their expected level of ability early in residency, yet below their expected level of ability late in residency.6 Enhanced oversight is not the answer. Instead, an appropriate oversight to allow the learner to function safely at a level that ensures their continued progression throughout training should be the goal.
Efforts have been made to objectively measure resident independence, resulting in the development of the Resident Supervision Index7,11 and the Zwisch scale of operative independence.12 Other initiatives designed to provide opportunities for independence include chief resident clinics and telephone triage systems with formative feedback13–15 These interventions may serve as building blocks for the development and implementation of additional objective measurements of resident ability.
Incentivizing programs to adopt best practices in graduated responsibility will require a multipronged approach. There are many potential solutions; however, substantial legal, administrative, financial, and personal roadblocks exist. Our fourth question was aimed at exploring strategies to motivate institutions and programs to identify and implement the best solutions for their situation and context. Suggestions included legislative efforts, public recognition of high performance, faculty development, and incorporating feedback from recent graduates and employers.
Conclusion
A multispecialty, nationally representative group of residents and fellows conceptualized the components of an ideal system of graduated responsibility and ways in which we can address shortcomings in our current training system to help move toward this ideal. To optimize the process of progressive independence, a multifaceted approach incorporating robust 2-way feedback about skill level and autonomy between residents and faculty, as well as improved faculty development in this area, will be necessary. These themes are merely a starting point that must be supplemented with ideas that originate locally within institutions and programs. This effort is intended to stimulate others to innovate, share best practices, and recognize programs that successfully implement them.
Supplementary Material
Footnotes
Jeanne M. Franzone, MD, is a Resident, Department of Orthopaedic Surgery, Columbia University Medical Center; Benjamin C. Kennedy, MD, is a Resident, Department of Neurological Surgery, Columbia University Medical Center; HelenMari Merritt, DO, is a Resident, Department of Cardiothoracic Surgery, University of Texas Health Science Center; Jessica T. Casey, MD, is a Pediatric Urology Fellow, Department of Urology, Indiana University School of Medicine, Riley Hospital for Children at Indiana University Health; Melissa C. Austin, MD, MBS, is Medical Director, Armed Services Blood Bank Center and Clinical Chemistry, and Associate Program Director, National Capital Consortium Pathology Residency Program, Walter Reed National Military Medical Center; and Timothy J. Daskivich, MD, MSHPM, is Staff Urologic Oncologist, Division of Urology, Department of Surgery, Cedars-Sinai Medical Center
The authors would like to thank Dr. Timothy Brigham for his help in designing the committee exercise. The authors would also like to thank Marsha Miller and Amy Beane for their assistance with the article.
References
- 1.Mattar SG, Alseidi AA, Jones DB, Jeyarajah DR, Swanstrom LL, Aye RW, et al. General surgery residency inadequately prepares trainees for fellowship: results of a survey of fellowship program directors. Ann Surg. 2013;258(3):440–449. doi: 10.1097/SLA.0b013e3182a191ca. [DOI] [PubMed] [Google Scholar]
- 2.Nakayama DK, Taylor SM. SESC. Practice Committee survey: surgical practice in the duty-hour restriction era. Am Surg. 2013;79(7):711–715. [PubMed] [Google Scholar]
- 3.Kennedy TJ, Regehr G, Baker GR, Lingard LA. Progressive independence in clinical training: a tradition worth defending? Acad Med. 2005;80(suppl 10):106–111. doi: 10.1097/00001888-200510001-00028. [DOI] [PubMed] [Google Scholar]
- 4.Berg DB, Engel AM, Saba A, Hatton EK. Differences in public belief and reality in the care of operative patients in a teaching hospital. J Surg Educ. 2011;68(1):10–17. doi: 10.1016/j.jsurg.2010.08.005. quiz 17–18. [DOI] [PubMed] [Google Scholar]
- 5.Collins J, Gruppen LD, Bailey JE, Bokhari SA, Paladin AM, Robbins J, et al. 24/7/365 in-house radiologist coverage: effect on resident education. Acad Radiol. 2014;21(7):842–850. doi: 10.1016/j.acra.2013.10.022. [DOI] [PubMed] [Google Scholar]
- 6.Sterkenburg A, Barach P, Kalkman C, Gielen M, ten Cate O. When do supervising physicians decide to entrust residents with unsupervised tasks? Acad Med. 2010;85(9):1408–1417. doi: 10.1097/ACM.0b013e3181eab0ec. [DOI] [PubMed] [Google Scholar]
- 7.Kashner TM, Byrne JM, Henley SS, Golden RM, Aron DC, Cannon GW, et al. Measuring progressive independence with the resident supervision index: theoretical approach. J Grad Med Educ. 2010;2(1):8–16. doi: 10.4300/JGME-D-09-00083.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Meyerson SL, Teitelbaum EN, George BC, Schuller MC, DaRosa DA, Fryer JP. Defining the autonomy gap: when expectations do not meet reality in the operating room. J Surg Educ. 2014;71(6):e64–e72. doi: 10.1016/j.jsurg.2014.05.002. [DOI] [PubMed] [Google Scholar]
- 9.Teman NR, Gauger PG, Mullan PB, Tarpley JL, Minter RM. Entrustment of general surgery residents in the operating room: factors contributing to provision of resident autonomy. J Am Coll Surg. 2014;219(4):778–787. doi: 10.1016/j.jamcollsurg.2014.04.019. [DOI] [PubMed] [Google Scholar]
- 10.Biondi EA, Varade WS, Garfunkel LC, Lynn JF, Craig MS, Cellini MM, et al. Discordance between resident and faculty perceptions of resident autonomy: can self-determination theory help interpret differences and guide strategies for bridging the divide? Acad Med. 2015;90(4):462–471. doi: 10.1097/ACM.0000000000000522. [DOI] [PubMed] [Google Scholar]
- 11.Byrne JM, Kashner M, Gilman SC, Aron DC, Cannon GW, Chang BK, et al. Measuring the intensity of resident supervision in the department of veterans affairs: the resident supervision index. Acad Med. 2010;85(7):1171–1181. doi: 10.1097/ACM.0b013e3181d5a954. [DOI] [PubMed] [Google Scholar]
- 12.George BC, Teitelbaum EN, Meyerson SL, Schuller MC, DaRosa DA, Petrusa ER, et al. Reliability, validity, and feasibility of the Zwisch scale for the assessment of intraoperative performance. J Surg Educ. 2014;71(6):e90–e96. doi: 10.1016/j.jsurg.2014.06.018. [DOI] [PubMed] [Google Scholar]
- 13.Neaman KC, Hill BC, Ebner B, Ford RD. Plastic surgery chief resident clinics: the current state of affairs. Plast Reconstr Surg. 2010;126(2):626–633. doi: 10.1097/PRS.0b013e3181df648c. [DOI] [PubMed] [Google Scholar]
- 14.Pyle JW, Angobaldo JO, Bryant AK, Marks MW, David LR. Outcomes analysis of a resident cosmetic clinic: safety and feasibility after 7 years. Ann Plast Surg. 2010;64(3):270–274. doi: 10.1097/SAP.0b013e3181afa4e9. [DOI] [PubMed] [Google Scholar]
- 15.Benjamin JT. Pediatric residents' telephone triage experience. Relevant to general pediatric practice? Arch Pediatr Adolesc Med. 1997;151(12):1254–1257. doi: 10.1001/archpedi.1997.02170490080014. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.