The Accreditation Council for Graduate Medical Education (ACGME). requirements for residency education in internal medicine specifically state that the program must advance residents’ knowledge of the basic principles of research, including how research is conducted, evaluated, explained to patients, and applied to patient care.1 Further, residents should participate in scholarly activity and the sponsoring institution and program should allocate adequate educational resources to facilitate resident involvement in scholarly activities.1 The scholarly activity requirement may be satisfied with projects other than research, including journal clubs, presentation at grand rounds, and quality improvement projects. Some programs have developed structured research training experiences that prepare residents to present their research at professional or scientific meetings, write manuscripts in peer reviewed journals, and publish review articles or book chapters.2 Dedicated research activities advance the core competencies and are often highly rated aspects of residency training.3–5 In fact, most residents feel research should be required.6 A recent article suggests that residency program enhancements in patient care, education, community service, and research improve departments of internal medicine and teaching hospitals.7 Finally, research experiences may encourage some residents to consider a career in clinical investigation.8 Despite these potential benefits, implementing a structured research curriculum in a busy residency program remains a logistical challenge.
In a meta-analysis, Hebert and colleagues9 identified four features of successful resident research programs: exposure to and guidance from mentors, training in basic research methods, protected time, and an environment supportive of research. The vast majority of internal medicine programs offer one to two months of protected research time during postgraduate year (PGY) two or three. An informal email survey of the Association of Program Directors in Internal Medicine (APDIM) listserver participants showed that 121 of 143 programs, or 85%, offered at least four weeks for research. However, successful resident research projects require much greater commitment of time, interest, and resources. Pursuit of research interests is often displaced by patient care demands.10 We previously described resident research as a three-year continuum of preparation, investigation, and synthesis phases in which early preparation is critical.11 Delaying bona fide research experiences to PGY-2 and compressing them into a one-month block, along with an often ad hoc search for mentors, limits the resident’s chances for success. Such frustrating research experiences may even deter residents from careers in clinical investigation.
We recently implemented the four-week Academic Internal Medicine Scholarship (AIMS) rotation, which introduces all interns to the process of organized inquiry and research. Each intern designs a feasible, scientifically sound research project to be completed over the course of residency. They learn research methodology, cultivate mentoring relationships, and develop interdisciplinary collaborations. Since 2005, all interns in the categorical internal medicine residency program at University of California, Davis, School of Medicine (UC Davis) have completed this rotation. We describe the early success of this novel research curriculum. This project has been approved by the UC Davis Institutional Review Board (IRB).
Program Description
The UC Davis internal medicine residency is a medium-sized urban university program. Our 87 residents rotate through three inpatient sites (University Hospital, Northern California Veterans Affairs Hospital, and Kaiser Permanente) and two outpatient sites (University Hospital and Sacramento County Clinics). Approximately 60% of residents go on to subspecialty fellowship training.
The AIMS rotation occurs in the second half of the intern year and is intercalated into a four-week ambulatory care block. Although originally conceived as a dedicated research-only experience, integration into an ambulatory rotation emphasizes the interdependence of research and patient care and allows other program requirements to be met during the month. Interns acquire basic research skills through proposal development, oral presentation, and exploration of methods for data collection, collation, and analysis. The rotation consists of facilitated small group research discussions, live and online lectures, and protected time for consultation; interns continue to participate in required residency core didactics and clinics (Figure 1).
The AIMS rotation runs in collaboration with the National Institutes of Health (NIH)-funded Clinical and Translational Science Center (CTSC) at UC Davis Health System. The CTSC education officer (CSH) and the associate program director for research (TLF) coordinate the rotation. Lecturers and mentors include experienced faculty researchers, biomedical informatics experts, clinical research coordinators, biostatisticians, medical librarians, research bioethicists, science and grant writers, librarians, research nurses, and IRB personnel. Beyond lectures and individual consultations, interns meet in weekly small groups with research faculty to discuss challenges and report progress. A rotation website serves as a repository for course material, including prior research proposals and presentations. Interns are encouraged to attend the regularly scheduled CTSC research seminars and workshops. During the final week of each rotation, interns present their research plan at the AIMS research forum. The audience often includes the department chair, - program director, CTSC core directors, research mentor, consulting biostatisticians, and fellow residents. All audience members provide oral and written feedback, which is given to each intern in summary form.
The rotation objectives are similar to other residency research curricula.9,12 Interns learn about research design, biostatistics, human subjects protection, institutional resources, and epidemiology through lectures and individual statistical consultation while developing their proposals. Attitudinal objectives include promoting intellectual curiosity through scholarly investigation of clinical questions and enhancing residents’ appreciation of biomedical research. Skills objectives include proposal development, scientific writing, and presentation skills. Process objectives include exposure to successful researcher role models and IRB members. In terms of the ACGME core competencies,1 the rotation adds to the intern portfolio in practice-based learning, medical knowledge, interpersonal and communication skills, system-based practice, and professionalism (Table 1).
Table 1.
Competency | Accomplished by: |
---|---|
Practice Based Learning | Identification of a topic from clinical experience. Use of quality improvement strategies or chart review to examine local practice. |
Medical Knowledge | Integration of comprehensive background data, specific aims, hypothesis, biostatistics and study design into proposal. |
Interpersonal Skills and Communication | Cooperative and interactive style during small group sessions, clarity of presentation of proposal at research forum, ability to address audience questions and clarity of written proposal. Evaluation by mentor. |
System Based Practice | Integration and use of local resources in proposal. |
Professionalism | Completion of NIH training in protection of human subjects. Timely completion of all rotation requirements. |
Our long-term objectives are to increase residents’ scholarly productivity and promote a culture of scholarship and scientific inquiry within the program. Interns requesting dedicated research time during PGY-2 must submit a revised proposal and obtain written approval from their mentor and the Residency Research Committee (which includes the program director, associate program director for research, department chair, a CTSC leader, and a senior faculty researcher). Residents who meet this requirement may take a four-week research block during the PGY-2 and PGY-3 year. The Department of Medicine budgets $750 for each resident to prepare an abstract and present it at a regional or national scientific meeting. Travel costs are generally shared by the faculty mentor. Other programs fund up to $1,000 per accepted research submission.13
Preliminary outcomes
The success of AIMS can be assessed in several ways. A traditional academic benchmark of productivity is the number of scholarly presentations, awards, manuscripts, and grants. As of January 2009, 74 rotation completers have presented 50 case reports and 15 research abstracts at regional or national professional meetings (Figure 2). In just three years, we have seen an increase in research abstracts and a decline in case reports. Residents have won eight research or case report awards at regional meetings. Successful publication of manuscripts is harder to accomplish during residency, but completers have already published two papers. One resident has received a competitive American Board of Internal Medicine Foundation research grant and two are pursuing federally-funded research fellowships. Our first AIMS class graduated from residency in 2008, so we continue to measure success by tracking presentations at professional society meetings, publications, and rotation specific outcomes. For the long term, the number of residents who ultimately pursue research careers will be tracked. An intermediate outcome is the proportion of interns that complete a hypothesis-driven project. Of the 74 interns who have completed the AIMS rotation, 46 (62%) went on to complete projects during a PGY-2 research block.
Even if they do not ultimately pursue an academic career, residents with research experience or skills may be better informed consumers of the medical literature. Interns’ self-reported knowledge, skills, and attitudes improved in almost all areas, including modest gains in the writing and statistical domains (Table 2).
Table 2.
Knowledge (1–5 scale where 1 is a strongly disagree and 5 is strongly agree) | |||
---|---|---|---|
Beginning of intern year |
End of intern year |
P value* | |
I knew/know of at least one person I could go to with a research proposal idea. | 2.7 | 4.4 | <.01 |
I knew/know how to find a mentor to help with a research program at UC Davis. | 2.5 | 4.1 | <.01 |
I had/have a good grasp of the resources available to me to conduct research at UC Davis. | 2.0 | 3.9 | .06 (NS) |
I knew/know how to contact the IRB. | 1.9 | 3.8 | .04 |
I understood/understand the importance of the IRB in protecting human subjects. | 3.3 | 4.3 | <.01 |
Skills (1–5 scale where 1 is a poor and 5 is excellent) | |||
Grant writing | 1.7 | 2.1 | <.01 |
IRB regulations | 1.9 | 3.1 | <.01 |
Literature searching | 3.1 | 3.8 | <.01 |
Manuscript writing | 2.2 | 2.8 | <.01 |
Research design | 2.3 | 3.2 | <.01 |
Statistical analysis | 2.0 | 2.5 | <.01 |
Attitude (1–5 scale where 1 is a strongly disagree and 5 is strongly agree) | |||
I plan (or planned) to do research during residency | 3.8 | 4.2 | <.01 |
paired T-test to compare the means
Although we do not have other non-clinical rotations with which to compare, interns have rated the overall experience highly (8.5 on a 10-point rating scale), including the adequacy of time allotted to proposal development. Rotation completers have commented positively on the value of completing research proposals and collaborative small group learning, and reported a renewed appreciation for the challenges of research. Numerous residents have also secured resident travel awards from national organizations including the American College of Physicians, America Association for the Study of Liver Diseases, American Society of Hematology, American Academy of Allergy, Asthma and Immunology, and others.
Discussion
We describe a structured a research experience that promotes development of the ACGME core competencies, is well received by residents, and ultimately may encourage more residents to pursue a career in clinical investigation. Resident success is often hampered by key early steps such as formulating a question, finding a mentor, and understanding basic research design and methodology. Early structured support of research allows residents to efficiently accomplish these tasks rather than taking several months or more to complete them on an ad hoc basis. We have previously described three phases of resident research (preparatory, investigatory and synthesis) which may take three years to complete (Figure 3).11 Our AIMS research curriculum allows residents to complete the preparatory phase during internship. Requiring every intern to develop a research proposal has several advantages: 1) interns are better prepared for research electives during the second and third year of residency; 2) residents learn early in their careers how to report scientific findings; and 3) the culture of the training program may be transformed as research becomes an integral part of residency training. Over 60% of our residents begin the investigatory phase during a protected research block in PGY-2 or PGY-3, a much higher proportion than the 20% reported by internal medicine program directors.2 During the research block, residents meet with their mentor, the associate program director for research, CTSC staff (data management and biostatistics support), and medical librarians (reference management tutorials). Residents who take a research block also present their research findings at the annual department Academic Forum, which is attended by community members, faculty, and fellows. Residents then move into the synthesis phase during their PGY-3 year and also dedicate substantial time to writing outside of their research block.
In the three years since the program’s inception, we have observed a culture change that includes an expectation for high-quality scholarship and presentation at local, regional, and national meetings. Pediatrics and anesthesiology residents now participate in the AIMS rotation.
Structured research programs encourage interns to access and interpret the medical literature, practice oral and written scientific communication skills, and participate in a multidisciplinary research team. Successful research adds to the resident’s portfolio and enhances fellowship and future employment opportunities. Interns discover opportunities for research and support for clinician-scientist careers through collaboration, critical components of the NIH investigator road map.14 Training programs gain a population of local resident experts, regional and national exposure, and a scholarly reputation that may enhance resident recruitment.
Developing a resident research program presents a number of challenges.15 Finding curricular time for new programs within an already stretched residency programs is not easy. Collaboration with departments and careful integration into the ambulatory block rotation may ease these concerns. Interns may be resistant to doing research while in the midst of intense clinical training. In 2004, we piloted the rotation with two highly motivated residents during an elective block, allowing us to develop the rotation on a small scale. In the absence of a contemporaneous control group, we cannot definitively conclude that the satisfaction and increased number of projects is due to the AIMS rotation alone. We suspect, however, that the formal curriculum has had a significant impact. Cultivating a cadre of committed enthusiastic faculty and hiring an associate program director for research to mentor the residents are critical for success.16,17 Programs without a CTSC should consider seeking help from other institutions or graduate programs. To promote a culture of scholarship, we have required that all internal medicine interns participate.
The AIMS rotation is a structured research experience for interns that increases the likelihood that residents will complete a hypothesis-driven research project during residency. Regardless of their ultimate career, the experience likely enhances residents’ appreciation for scholarship while contributing to the development of several ACGME competencies.
Perspectives Viewpoints.
The Academic Internal Medicine Scholarship rotation promotes development of the ACGME core competencies, is well received by residents, and ultimately may encourage more residents to pursue a career in clinical investigation.
In the three years since the program’s inception, the culture has changed to include an expectation for high-quality scholarship and presentation at local, regional, and national meetings.
As interns discover opportunities for research and support for clinician-scientist careers through collaboration, training programs gain a population of local resident experts, regional and national exposure, and a scholarly reputation that may enhance resident recruitment.
ACKNOWLEDGEMENTS
The authors wish to thank Janice Cheng for her assistance and input.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Contributor Information
Tonya L. Fancher, Department of Internal Medicine, University of California at Davis Health System.
Mark C. Henderson, Department of Internal Medicine, University of California at Davis Health System.
Christine S. Hotz, Department of Anesthesiology and Pain Management and Education Officer, Clinical Translational and Science Center, University of California at Davis Health System.
Ted Wun, Division of Hematology and Oncology, Department of Internal Medicine and Medical Director, Clinical Translational and Science Center, University of California at Davis Health System.
REFERENCES
- 1.Accreditation Council for Graduate Medical Education. Program Director Guide to Common Program Requirements. [Accessed June 21, 2009]; < http://www.acgme.org/acWebsite/navPages/nav_commonpr.asp>. [Google Scholar]
- 2.Levine RB, Hebert RS, Wright SM. Resident research and scholarly activity in internal medicine residency training programs. J Gen Intern Med. 2005 Feb;20(2):155–159. doi: 10.1111/j.1525-1497.2005.40270.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Hayward RA, Taweel F. Data and the internal medicine houseofficer: alumni's views of the educational value of a residency program's research requirement. J Gen Intern Med. 1993 Mar;8(3):140–142. doi: 10.1007/BF02599759. [DOI] [PubMed] [Google Scholar]
- 4.Kanna B, Deng C, Erickson SN, Valerio JA, Dimitrov V, Soni A. The research rotation: competency-based structured and novel approach to research training of internal medicine residents. BMC Medical Education. 2006;6:52. doi: 10.1186/1472-6920-6-52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Kohlwes RJ, Shunk RL, Avins A, Garber J, Bent S, Shlipak MG. The PRIME curriculum. Clinical research training during residency. J Gen Intern Med. 2006 May;21(5):506–509. doi: 10.1111/j.1525-1497.2006.00438.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Rivera JA, Levine RB, Wright SM. Completing a scholarly project during residency training. Perspectives of residents who have been successful. J Gen Intern Med. 2005 Apr;20(4):366–369. doi: 10.1111/j.1525-1497.2005.04157.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Rahim A, Anderson RA. Strategies for residency programs that improve medicine departments and teaching hospitals. The American Journal of Medicine. 2008 May;121(5):450–455. doi: 10.1016/j.amjmed.2007.12.010. [DOI] [PubMed] [Google Scholar]
- 8.AAMC's Task Force II on Clinical Research. Promoting Translational and Clinical Science: The Critical Role of Medical Schools and Teaching Hospitals (Report of the AAMC's Task Force II on Clinical Research ) 2006 [Google Scholar]
- 9.Hebert RS, Levine RB, Smith CG, Wright SM. A systematic review of resident research curricula. Acad Med. 2003 Jan;78(1):61–68. doi: 10.1097/00001888-200301000-00012. [DOI] [PubMed] [Google Scholar]
- 10.Goldman L, Shea S, Wolf M, Braunwald E. Clinical and research training in parallel: the Internal Medicine Research Residency Track at the Brigham and Women's Hospital. Clinical Research. 1986 Jan;34(1):1–5. [PubMed] [Google Scholar]
- 11.Hamann KL, Fancher TL, Saint S, Henderson MC. Clinical research during internal medicine residency: a practical guide. The American Journal of Medicine. 2006 Mar;119(3):277–283. doi: 10.1016/j.amjmed.2005.12.001. [DOI] [PubMed] [Google Scholar]
- 12.Rana A, Lainoff D, Weber A. 3 for 1:How to meet faculty scholarly activity, resident scholarly activity and PBL competency requirements. In: Center C-CM, editor. Academic Internal Medicine Insight. Volume 6:2. Washington DC: Alliance of Academic Internal Medicine; 2008. pp. 6–7. [Google Scholar]
- 13.Fischer J, Cation L. Impact of a Residency Research Program on Research Activity, Faculty Involvement, and Institutional Cost. Teaching and Learning in Medicine. 2005 Spring;17(2):159–165. doi: 10.1207/s15328015tlm1702_10. [DOI] [PubMed] [Google Scholar]
- 14.National Institutes of Health. NIH Roadmap for Medical Research. [Accessed June 21, 2009]; < http://nihroadmap.nih.gov/initiatives.asp>.
- 15.Alguire PC, Anderson WA, Albrecht RR, Poland GA. Resident research in internal medicine training programs. Annals of Internal Medicine. 1996 Feb 1;124(3):321–328. doi: 10.7326/0003-4819-124-3-199602010-00007. [DOI] [PubMed] [Google Scholar]
- 16.Durning SJ, Cation LJ, Ender PT, Gutierrez-Nunez JJ. A resident research director can improve internal medicine resident research productivity. Teach Learn Med. 2004 Summer;16(3):279–283. doi: 10.1207/s15328015tlm1603_11. [DOI] [PubMed] [Google Scholar]
- 17.Schultz HJ. Research during internal medicine residency training: meeting the challenge of the Residency Review Committee. Annals of Internal Medicine. 1996 Feb 1;124(3):340–342. doi: 10.7326/0003-4819-124-3-199602010-00011. [DOI] [PubMed] [Google Scholar]