Skip to main content
AEM Education and Training logoLink to AEM Education and Training
. 2020 Jun 13;4(3):270–274. doi: 10.1002/aet2.10477

Emergency Medicine Residency Curricular Innovations: Creating a Virtual Emergency Medicine Didactic Conference

Jason Rotoli 1,, Ryan Bodkin 1, Joseph Pereira 1, David Adler 1, Valerie Lou 1, Jessica Moriarty 1, Jennifer Williams 1, Flavia Nobay 1
Editor: Michael Gottlieb
PMCID: PMC7369496  PMID: 32704598

Abstract

Currently, there is a pandemic forcing social distancing and, consequently, traditional in‐person education must shift to a virtual curriculum to protect all parties and continue professional development. Recognizing that not all emergency medicine (EM) content can be taught through a virtual platform, we propose a model for nearly all EM resident didactic conference adaptation to a virtual format to meet the needs of the adult learner while protecting all participants from the current coronavirus pandemic.

NEED FOR INNOVATION

Curricular change is prompted by content evolution, generational learning preferences, technological advances, and environmental factors such as the current pandemic. 1 , 2 , 3 , 4 Current recommendations for social distancing require an urgent shift of nearly all in‐person emergency medicine (EM) didactic conference to a virtual platform while maintaining rigorous standards and engaging faculty and learners. 5 , 6

BACKGROUND

Medical education must continuously evolve to meet the needs of adult learners and have flexibility to be delivered in a variety of settings. 3 , 4 , 7 , 8 Regardless of the environment, an innovative EM curriculum must engage learners and foster professional development while meeting Residency Review Committee/Accreditation Council for Graduate Medical Education (RRC/ACGME) standards. 2 , 9

Critical factors that facilitate curricular changes include understanding the process, recognizing the need for change, and implementing the innovation. 10 , 11 When adapting curricula to a virtual platform, there are additional logistic and academic considerations: educational impact, cost, time, user access and comfort with technology, and the stress of isolation. 7 , 12 , 13 , 14 For many, virtual curricula pose barriers to engagement (waning enthusiasm, difficulty with open communication, diminished peer connection, limited technology accessibility) thus impacting the quality of education. 7 , 12 , 15 , 16 , 17

OBJECTIVE OF INNOVATION

Our goal is to provide a guide for adaptation of nearly all in‐person EM education to an online learning platform that is concordant with ACGME standards, acknowledges the psychosocial impact of decreasing in‐person contact, and fosters continued resident and faculty engagement.

DEVELOPMENT PROCESS

Given that the content for our EM curriculum was already developed, in this section we describe the adaptation process of shifting to a virtual format. With drastic changes in the educational environment, participants may feel overwhelmed regarding the ability to learn or teach. 18 , 19 , 20 To educate participants (residents and faculty) on the upcoming changes, our program implemented the following steps:

  • Developed an asynchronous tutorial for Zoom instruction (including steps to operate the virtual classroom) and made real‐time training available for all participants.

  • Designed an online color‐coded schedule (outlining the expected date/time of upcoming changes) allowing participants to prepare for curricular format and content changes (see Table 1).

  • Adjusted the conference evaluation to gather feedback regarding content and technology alignment.

  • Recognized technology inaccessibility (e.g., computer or Wi‐Fi access) for some users and designated available office space.

  • Conducted a virtual Q&A session for residents and faculty prior to implementation to review the process, communicate expectations, and validate participants’ stress.

Table 1.

Sample Weekly EM Resident Didactic Schedule (University of Rochester, Department of Emergency Medicine)

Time Min Topic Presenter
8:00 8:30 30 Virtual Conference Question & Answer Session* Residency Leadership
8:30 9:00 30 Resident Briefing on Mock Orals* Dr. A
9:00 9:30 30 CORE: Pediatric Upper Gastrointestinal Bleeding* Dr. B
9:30 9:45 15 BREAK
9:45 10:00 15 Update: e‐Oral board exam* Dr. C
10:00 11:00 60 Coaching and Debrief session: Effects of COVID‐19* Dr. D, Department of Psychiatry
11:00 1:00 120 R1 Foundations—Toxicology* EM Faculty Small group
11:00 1:00 120 R2/R3: ORTHO ALIEM https://www.aliem.com/air‐series‐orthopedics‐upper‐extremity/
2:00 5:00 180 Cadaver Lab Room XXX, Dr. E Resident A, B, C, D

R1 = resident year 1; R2 = resident year 2; R3 = resident year 3; ALIEM = Academic Life in Emergency Medicine.

*

Zoom format.

Independent learning.

In person.

Prior to COVID‐19, our weekly conference included up to 5 hours of 15‐, 30‐, or 45‐minute didactics; hands‐on sessions; and small‐group activities. Additionally, we incorporated a procedural curriculum in cadaver lab for one faculty and three to four residents per week after conference. Prior to shifting to a virtual curriculum, it was essential to assess applicability of each of the previously utilized didactic formats to an online platform. We performed a brief literature review of virtual education, Knowles’ continuum of pedagogy and andragogy, Mayer’s 12 principles of multimedia learning, Brookfield’s overview of experiential and self‐directed learning, and the impact of COVID‐19 and social isolation. 2 , 3 , 4 , 5 , 10 , 11 , 12 , 13 , 21 , 22 , 23 , 24 , 25 Based on residency leadership experience in curricular innovation and the literature review, we established a consensus for which didactic formats would be feasible in a virtual format.

THE IMPLEMENTATION PHASE

The curriculum has four didactic formats: 1) faculty‐moderated virtual large group sessions, 2) faculty and chief resident‐moderated virtual small‐group sessions, 3) independent (asynchronous) learning activities, and 4) limited in‐person critical procedure labs. Using the Zoom platform, large‐group sessions consisted of approximately 40 learners and two or more faculty. One faculty member presented EM core content while another moderated questions in the chat function. The moderator also shared relevant articles or multimedia learning materials to augment the presentation. This format also allowed for inclusion of national speakers. Additionally, the large‐group format was used for board review where residents were divided into one of four “virtual teams.” They answered questions through an online response system and individual scores contributed to an annual team total. These sessions encouraged team learning, supported resident and faculty interaction, and fostered a sense of community aimed at simulating an in‐person setting. 16 , 26 The large‐group format was conducive to sharing the rapidly changing COVID‐19 institutional policies. We also included optional debriefings with a mental health professional during conference time. 4

Additionally, the small‐group format offered a more targeted experience with emphasis on team learning, resident interaction, and connection with faculty. 26 Examples included case‐based learning, journal clubs, and one‐on‐one oral board practice with a faculty member. We set up Zoom breakout rooms allowing us to better engage individuals. For example, residency administration created breakout rooms including a chief resident and at least one faculty member with a group of 12 to 15 residents for a challenging ethical case discussion. Using the same breakout room model for oral board practice, residents were paired on a rotating basis with one of six faculty members who conducted six concurrent one‐on‐one cases. During the cases, faculty intermittently shared a screen that displayed relevant information (e.g., labs, imaging). Subsequently, the breakout rooms allowed for private debriefings to emphasize the learner’s strengths and areas for improvement.

Independent learning activities were critical for successful virtual conference implementation as they emphasized flexibility, allowing learners to work at their own pace and focus on knowledge gaps. 27 , 28 The activities consisted of multimodal content that included oversight with dashboards and testing functions allowing leadership to hold residents accountable. 9 , 29 , 30 Examples included Academic Life in EM, Foundations of EM, and Rosh Review Journal Club.

Finally, it was necessary to continue critical procedural education (such as airway management in COVID patients) in person through cadaver lab while emphasizing safety with daily online symptom screening, social distancing, limited size (three to four residents and one faculty), and appropriate PPE.

EVALUATION

This article presents a roadmap for conference adaptation with preliminary feedback that provides a window into the success of our conference adaptations to COVID; however, there was no evaluation of knowledge learned or skills gained through a postintervention evaluation. Through an anonymous REDCap survey, we gathered weekly faculty and resident feedback related to content, delivery, and use of technology. 31 We had a total of 41 residents with varying numbers of faculty each week. Over the first 6 weeks, we had a mean resident response rate of 94.6% (range = 93%–100%). Of the 208 total virtual conference–related comments, 199 of 208 (95.6%) were positive.

In reviewing the preliminary resident and faculty feedback, the following themes emerged:

  • The initial Q&A session was critical to outline the process.

  • Participants appreciated the investment in change and were forgiving of glitches in implementation.

  • The debriefing sessions were helpful to reduce stress.

  • Participants were interested in continuing virtual conference even when social distancing is no longer required.

  • Residents felt that faculty were accessible, invested, and engaged.

REFLECTIVE DISCUSSION

During the implementation process, several lessons regarding technology integration, content adaptation, and faculty development were learned. Regarding technology, aligning conference needs with the functionality and limitations of the virtual platform was imperative. For example, we initially struggled with appropriate screen sharing, mute functionality, and document sharing in a large group setting. Test runs of the chosen platform helped to avoid future technical issues.

With regard to content adaptation, we recognized that all EM education cannot be taught online. Subsequently, it was important to continuously review which content was conducive to online delivery. Also, a variable format was critical to maximize participant engagement without magnifying the cognitive fatigue and disconnect that occurs with online learning. 17 , 27 , 32 Based on feedback, we adjusted the duration of certain didactics (e.g., board review, journal club) as some required more time given the need for audience participation in a virtual setting. Finally, it was crucial to acknowledge the psychosocial impact of virtual learning and current pandemic by providing recurring updated pandemic‐related content and debriefing time within conference.

For faculty development, we recognized early on that all presenters were familiar with Zoom as a meeting tool; however, the vast majority were uncomfortable using Zoom as a teaching tool. Consequently, we created a tutorial and offered real‐time training with a superuser who was available by e‐mail, phone, or video chat (Zoom) to troubleshoot issues.

As a backup plan for unforeseen issues with technology, we created a bank of alternate content. We pooled asynchronous content from FOAMed resources (e.g., Academic Life in EM, Foundations in EM, JETem), provided residents with access to question banks, and recommended other streaming content. Programs with limited personnel/resources for technologic advancement should appoint a single lead to become proficient in the use of online education platforms while using some of the aforementioned resources as a temporary bridge.

Our model is applicable in other institutions that have adequate access to technology and financial/administrative support for virtual platform integration. This model can be used with faculty or senior residents leading the small‐group discussions and case‐based learning. The independent learning content is also easily modifiable and applicable in other settings.

Expanding educational delivery beyond the physical classroom by shifting didactic conference to a virtual platform has diversified the way we teach. Additionally, participants viewed the new format positively. With early program leadership engagement, we developed innovative ways to virtually educate learners while acknowledging participant stress in the face of drastic change. Future investigation is needed to objectively assess the educational impact of a virtual EM conference format.

AEM Education and Training 2020;4:270–274

The authors have no relevant financial information or potential conflicts of interest to disclose.

Author contributions: drafting of the manuscript—JR, RB, JP, VL, JW, JM, and FN; acquisition of the data—JR and JW; analysis and interpretation of the data—JR, JW, and DA; and critical revision of the manuscript for important intellectual content—JR, RB, DA, and FN.

References

  • 1. Desy JR, Reed DA, Wolanskyj AP. Milestones and millennials: a perfect pairing—competency‐based medical education and the learning preferences of Generation Y. Mayo Clin Proc 2017;92:243–50. [DOI] [PubMed] [Google Scholar]
  • 2. Gottlieb M, Landry A, Egan DJ, et al. Rethinking residency conferences in the era of COVID‐19. AEM Educ Train 2020;4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Merriam SB. Andragogy and self‐directed learning: pillars of adult learning theory. New Dir Adult Cont Educ 2001;2001:3–14. [Google Scholar]
  • 4. Merriam SB. Adult learning theory for the twenty‐first century. New Dir Adult Cont Educ 2008;2008:93–8. [Google Scholar]
  • 5. Parmet WE, Sinha MS. Covid‐19—the law and limits of quarantine. N Engl J Med 2020;382:e28. [DOI] [PubMed] [Google Scholar]
  • 6. Chen S, Yang J, Yang W, Wang C, Bärnighausen T. COVID‐19 control in China during mass population movements at New Year. Lancet 2020;395:764–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Wittert GA, Nelson AJ. Medical education: revolution, devolution and evolution in curriculum philosophy and design. Med J Aust 2009;191:35–7. [DOI] [PubMed] [Google Scholar]
  • 8. Shannon S. Adult learning and CME. Lancet 2003;361:266. [DOI] [PubMed] [Google Scholar]
  • 9. ACGME program requirements for graduate medical education in emergency medicine. Chicago, IL: Accreditation Council for Graduate Medical Education, 2013. [Google Scholar]
  • 10. Eckel P, Green M, Hill B, Mallon W. Change III: Taking Charge of Change: A Primer for Colleges and Universities. An Occasional Paper Series of the ACE Project on Leadership and Institutional Transformation. Washington, DC: American Council on Education, 1999. [Google Scholar]
  • 11. de la Harpe B, Thomas I. Curriculum change in universities: conditions that facilitate education for sustainable development. J Educ Sustain Dev 2009;3:75–85. [Google Scholar]
  • 12. Power C, Petrie H, Sakharov V, Swallow D. Virtual Learning Environments: Another Barrier to Blended and e‐Learning. International Conference on Computers for Handicapped Persons; Berlin/Heidelberg; Springer, 2010. p. 519–26. [Google Scholar]
  • 13. Brooks SK, Webster RK, Smith LE, et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet 2020;395:912–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Wang G, Zhang Y, Zhao J, Zhang J, Jiang F. Mitigate the effects of home confinement on children during the COVID‐19 outbreak. Lancet 2020;395:945–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Gannon‐Leary P, Fontainha E. Communities of Practice and virtual learning communities: benefits, barriers and success factors. Barriers and Success Factors eLearning Papers;2007.
  • 16. Rovai AP. Sense of community, perceived cognitive learning, and persistence in asynchronous learning networks. Internet Higher Educ 2002;5:319–32. [Google Scholar]
  • 17. Reese SA. Online learning environments in higher education: connectivism vs. dissociation. Educ inform Technol 2015;20:579–88. [Google Scholar]
  • 18. Verhaeghe R, Vlerick P, Gemmel P, Maele GV, Backer GD. Impact of recurrent changes in the work environment on nurses’ psychological well‐being and sickness absence. J Adv Nurs 2006;56:646–56. [DOI] [PubMed] [Google Scholar]
  • 19. Bordia P, Hunt E, Paulsen N, Tourish D, DiFonzo N. Uncertainty during organizational change: is it all about control? Eur J Work Organiz Psychol 2004;13:345–65. [Google Scholar]
  • 20. Margolis J, Nagel L. Education reform and the role of administrators in mediating teacher stress. Teacher Educ Quart 2006;33:143–59. [Google Scholar]
  • 21. Ahmed H, Allaf M, Elghazaly H. COVID‐19 and medical education. Lancet Infect Dis 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Cao W, Fang Z, Hou G, et al. The psychological impact of the COVID‐19 epidemic on college students in China. Psychiatry Res 2020;287:112934. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Mayer RE. Multimedia Learning. Psychology of Learning and Motivation. Amsterdam: Elsevier Inc., 2002. p. 85–139. [Google Scholar]
  • 24. Knowles MS. Andragogy: adult learning theory in perspective. Commun Coll Rev 1978;5:9–20. [Google Scholar]
  • 25. Brookfield S. Adult learning: an overview. Int Encyclopedia Educ 1995;10:375–80. [Google Scholar]
  • 26. Haidet P, O'Malley KJ, Richards B. An initial experience with “team learning” in medical education. Acad Med 2002;77:40–4. [DOI] [PubMed] [Google Scholar]
  • 27. Hart C. Factors associated with student persistence in an online program of study: a review of the literature. J Interact Online Learn 2012;11:19–42. [Google Scholar]
  • 28. Estes M, Gopal P, Siegelman JN, Bailitz J, Gottlieb M. Individualized interactive instruction: a guide to best practices from the council of emergency medicine residency directors. West J Emerg Med 2019;20:363. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Counselman FL, Borenstein MA, Chisholm CD, et al. The 2013 Model of the Clinical Practice of Emergency Medicine. Acad Emerg Med 2014;21:574–98. [DOI] [PubMed] [Google Scholar]
  • 30. Frequently Asked Questions: Emergency Medicine Review Committee for Emergency Medicine. Chicago: Accreditation Council for Graduate Medical Education, 2015. [Google Scholar]
  • 31. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata‐driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Cercone K. Characteristics of adult learners with implications for online learning design. AACE J 2008;16:137–59. [Google Scholar]

Articles from AEM Education and Training are provided here courtesy of Wiley

RESOURCES