Abstract
Emergency physicians are well‐positioned to take a leadership role in telehealth, particularly in emerging categories such as triage, direct acute unscheduled care, and virtual observation. However, the growth of telehealth has outpaced curricular development in emergency medicine (EM) residency programs. This manuscript presents a model longitudinal telehealth curriculum, developed by the consensus of education experts, including representatives from the telehealth interest groups from EM's two primary specialty societies: the American College of Emergency Physicians and the Society for Academic Emergency Medicine. The curriculum describes overarching goals and components that may serve as a foundation for individual institutions seeking to train future operational and academic leaders in telehealth.
1. INTRODUCTION
The United States is unique among developed nations in its lack of universal healthcare coverage for its citizens. Its hybrid public–private system provides fragmented coverage that leaves millions of Americans (8% of the population) uninsured. 1 Mismatch between clinician supply and patient demand is especially noted for specialty services and for patients in rural areas. 2 These coverage gaps exacerbate healthcare inequities that disproportionately affect certain populations such as patients who are elderly, living in rural areas, and people of color. 1 Telehealth, the use of technology to facilitate a remote medical encounter, holds promise as a way to bridge gaps in coverage for these medically underserved populations, moving the United States toward a healthcare system that provides access to timely, quality care for all people.
Prior to the COVID‐19 pandemic, the adoption and expansion of telehealth faced barriers at the state and federal level due to several issues, including licensure laws that limited patient access to doctors across state lines, lack of coverage and payment parity for virtual versus in‐person visits, restrictions on geographic location and originating site (eg, care from home), restrictions on oversight, and privacy concerns (ie, health insurance portability and accountability act (HIPAA)). 3 The CARES Act 4 added telehealth flexibilities that rapidly accelerated its utilization; however, most residency programs have not kept pace in evolving their curricula to include telehealth‐specific training. 5 , 6 Given the potential of telehealth and this emerging field, it is important for the next generations of emergency physicians to be exposed to, trained in, and become comfortable with telehealth in their future practices.
2. TRIAGE/PRE‐HOSPITAL
Fifty‐seven million people, or 18% of the US population, live in a rural community, and rural residents, on average, are more likely to be older, sicker, and poorer. 7 The closure of rural hospitals prolongs the time to definitive care by increasing emergency medical services (EMS) response and transport times, which contributes to patient morbidity and mortality (M&M). 8 There is an immediate need to support rural patients, especially those who have severely limited access to acute care services.
Prehospital EMS workers have been familiar with telehealth for many years with the regular use of radio and telephone communication used to connect with in‐hospital physicians for direct medical oversight via online medical control. This workflow has been present since the 1970s when the federal government established a limited number of very high frequency (VHF) radio channels for communication between EMS workers in the field and the in‐hospital base station. 9 While historical use has been primarily audio‐only, tremendous potential exists for audiovisual technology to transform the current EMS delivery model. Literature to support video telehealth in EMS is dominated by tele‐stroke and tele‐mental health. Recently, however, there has been growing evidence of the safety and reliability of a video telehealth system outside these immediate domains. 10 Prehospital evaluation using telehealth can also extend to the triage of patients in locations such as urgent care, long‐term care, and correctional facilities.
After emergency department (ED) arrival, tele‐triage has the potential to improve ED throughput metrics by making use of remote emergency medicine (EM) physicians or advanced practice providers to place orders, either from home or within the hospital. This emerging field has grown due to the increased burdens on ED throughput including prolonged wait times, increased admission and boarding times, left without treatment completed, left without treatment, left without being seen (LWBS), and increasing time‐to‐provider. Several studies have demonstrated improved LWBS and time‐to‐provider using tele‐triage, although limited in improving ED visit length. 11 , 12
3. DIRECT ACUTE UNSCHEDULED CARE
Telehealth visits consist of two major categories: provider‐to‐patient and provider‐to‐provider. A subset of provider‐to‐patient care is direct‐to‐consumer (DTC) models, which are most commonly used for acute unscheduled care. This consists of low‐acuity patients, similar to those seen in urgent care. These are often done via two‐way audio/video encounters but may be audio or chat‐based only.
Provider‐to‐provider telehealth entails providing consultation services between practitioners. In‐hospital telehealth for EM has primarily centered on provider‐to‐provider telehealth for remote specialty consultation. The addition of video has expanded consultation opportunities for specialties where visual assessment is critical, including but not limited to pediatrics, dermatology, neurology, orthopedics, and several other surgical specialties. An opportunity for EM includes emergency physician‐to‐emergency physician consultation, for example, remote patient management from a tertiary referral center to a rural hospital for determining risk, creating a plan of care and, if needed, coordinating transfer to a higher level of care. 13 These models have also demonstrated an educational component with improved rates of adherence to sepsis protocols, for example. 14
4. VIRTUAL OBSERVATION
Another emerging field is virtual observation and remote physiologic and therapeutic monitoring. Patients can be sent home to be monitored with devices that capture real‐time health data, send that information to physicians, and set up follow‐up telehealth visits. These programs aim to effectively create observation units at home and several are run by emergency departments. 15 , 16
Despite the growing number of programs and care models, the development of standards, quality guidelines, and medical education remains a gap. Healthcare institutions should develop training that meets the scope of their telehealth offerings in order to ensure quality and provide a consistent patient experience.
5. COMPETENCIES CREATED/DEFINED BY OTHER ORGANIZATIONS
Several sets of telehealth competencies have been put forth by academic telehealth groups. The first comprehensive overview, by Sharma et al. (2016), 17 categorized telehealth competencies into three domains: digital communication and webside manner (familiarity with the platform and optimizing body language and lighting), scope and standards of care (licensing, billing, HIPAA compliance), and the virtual interaction (environmental assessment and virtual physical examination). In 2021, Galpin et al. presented an expert consensus statement 18 that expanded upon the domains of professionalism, ethics, patient safety, and access and equity.
This work served as the basis for “Telehealth Competencies Across the Learning Continuum” by the Association of American Medical Colleges (AAMC) in 2021, 19 a set of competencies specifically directed toward the medical student, resident or young faculty learner. The AAMC set of competencies is particularly well‐suited as a framework for a residency training program, as it partitions the skill acquisition into discrete steps, ranging from the early learner stage (recent medical student graduate) to recent residency graduate, to attending physician 3–5 years in practice.
In 2021, the Accreditation Council for Graduate Medical Education (ACGME) named digital health as an Internal Medicine Milestone. 20 Telehealth has not yet been added to the EM milestones, but has been incorporated into the American Board of Emergency Medicine's 2022 Model of Clinical Practice. 21
Several recent articles have pointed to the lack of a required curriculum or competencies for residency programs and for practicing providers in the use of telehealth. 22 , 23 In response, some specialties have begun to develop curricula for telehealth for their residents. 24 , 25 The Society of Teachers for Family Medicine includes a five‐part online module, with supplemental resources and videos. 26 An internal medicine program from the Medical University of South Carolina implemented a 3‐year longitudinal curriculum consisting of didactics (mixed in‐person and online) and clinical experience (monitoring patients with chronic diseases). Survey outcomes demonstrated increased resident ability to utilize telehealth and identify barriers to effective use. 24 Similarly, an ophthalmology program at Massachusetts Eye and Ear introduced residents to ophthalmic telehealth through didactic lectures, resulting in self‐reported increase in confidence with and knowledge of telehealth. 27
Most have functioned as electives rather than a fully integrated curriculum into EM residency training. More recently, a multispecialty group using a modified Delphi process published a consensus set of 34 telehealth competencies across specialties that mapped to the six ACGME core competencies. 28 Some notable examples include “Demonstrates ability to manage difficult patient situations via telemedicine” mapped to interpersonal and communication skills and “Demonstrate the ability to appropriately identify and help manage emergencies through local protocols, and determine the need for intervention in the telemedicine setting” mapped to patient care. 19 , 28
A structured longitudinal EM curriculum incorporating these competencies into residency, however, has not yet been outlined. This paper presents the consensus of education and telehealth experts, with stakeholders from multiple national EM professional organizations of year‐specific competencies in a PGY 1–3 or PGY 1–4 residency.
6. OVERVIEW OF PROPOSED CURRICULUM
Telehealth section leadership from the American College of Emergency Physicians (ACEP) and telehealth experts from the Society of Academic Emergency Medicine (SAEM) were invited to participate in the creation of a structured longitudinal EM curriculum via expert consensus. The group included education leaders and subject matter experts in telehealth as evidenced by prior leadership roles in telehealth fellowship program development, federal funding in telehealth research, and telehealth book authorship.
This curriculum, approved by the boards of ACEP and SAEM, is framed with goals based on the ACGME core competencies (Table 1) as well as through post‐graduate year‐specific recommendations (Table 2), similar to how an observation medicine curriculum was previously outlined. 29
TABLE 1.
Patient care (PC) The resident should convey digital empathy in their interactions with patients, demonstrating an understanding of the patient's needs and effectively communicating this understanding to patients. The resident should know the limits of telehealth for each complaint and patient and be able to choose the appropriate telehealth tool for a clinical context. The resident should demonstrate appropriate utilization of telehealth systems, including referral to a higher or lateral level of care when appropriate including referral to in‐person care. The resident should be trained to respond to medical emergencies that may occur during the virtual encounter. |
Medical knowledge (MK) The resident should identify patient presentations that are appropriate for a telehealth visit and effectively triage patients presenting for virtual care. Residents should perform telehealth physical examinations, order accessible and appropriate diagnostic tests, and develop treatment plans that can be effectively carried out in the telehealth setting. |
Technical knowledge (TK) The resident should be familiar with the medical system's frequently used telehealth platforms. The resident should have sufficient technical knowledge, so that the patient and resident can effectively conduct an examination, including troubleshooting basic technical challenges (i.e., issues with internet connectivity, sound, and lighting), leverage interpreter services, and utilize remote devices such as virtual stethoscopes. |
Interpersonal communications (IC) The resident should demonstrate proficient communication over telehealth using best practice principles. The resident should be aware of verbal and nonverbal cues (eye contact, posture, hand gestures, tone, and speed of language) that may enhance or diminish the patient care experience. The resident should be able to engage with family members and care partners who may be in a three‐way call encounter. The resident should select the appropriate means and timing of communication with other members of the health care team in the event of transition of care, referral, or implementation of follow‐up plan. |
Practice‐based learning and improvement (PBL) The resident should engage in self‐assessment after telehealth interactions to drive informed practice changes. The resident should demonstrate adjustments to the physical examination and workups that are in line with the best available evidence for telehealth care. The resident should have a basic understanding of the literature that informs tele‐emergency care. Residents should also follow up on a subset of patients to help guide future encounters. |
Professionalism (P) The resident should ensure that the patient visit occurs in a secure and private setting. The resident should display respect for the patient for the duration of the telehealth encounter, through professional dress, minimization of wait time and distractions, and attention to cultural needs. The resident should write orders and complete medical documentation in a timely manner. |
System‐based practice (SBP) The resident will demonstrate proficiency in telehealth utilization across the continuum of services under the emergency medicine umbrella and adapt to advances in the context of the healthcare system. The resident will demonstrate proficiency in the virtual evaluation of patients in the pre‐hospital (Emergency Medical Services), acute care (ED), observation, and post‐acute care follow‐up landscape. The resident will understand how telehealth fits into a larger strategy of reducing the volume of patients at points of in‐person care delivery and optimizing system resources for patient needs. |
TABLE 2.
PGY1 curriculum | PGY2 curriculum | PGY3/PGY4 curriculum |
---|---|---|
Attend introductory didactic lectures on telehealth | Attend didactic lectures on telehealth topics | Review key literature regarding telehealth and related topics |
Review telehealth educational materials/protocols provided by the residency program | Continue to review key telehealth literature | Participate in telehealth morbidity and mortality conferences |
Participate in direct patient care of the telehealth patient | Participate in direct patient care of the telehealth patient | Participate in quality assurance meetings of telehealth |
Review telehealth cases with faculty | Follow up on individual telehealth cases | Participate in chart reviews of telehealth patients |
Follow‐up on individual telehealth cases | Engage in one‐on‐one meetings and case reviews with telehealth faculty | Manage telehealth visits with limited faculty oversight |
Participate in morbidity and mortality reviews of telehealth cases | Further learn and develop the skills needed to successfully manage a telehealth service | Optional: Complete a telehealth‐related research topic, scholarly project, or presentation |
Review telehealth literature (including presenting at a Journal Club) | Participate in peer review audits, return visit audits, and telehealth complaint reviews | Optional: Attend and participate in telehealth section meetings at regional and national specialty meetings |
Explore telehealth interest groups/section websites | Increase participation and exposure to telehealth through websites, and interest groups at regional/national meetings | |
Optional: Begin or continue telehealth‐related research topic, scholarly project, or presentation |
Optimal methods for educating EM residents on telehealth have not been published. Through the 2020 Society for Academic Emergency Medicine's annual consensus conference, experts in EM and telehealth made recommendations on various aspects of telehealth and created a research agenda for telehealth. 30 The consensus regarding formal telehealth education was that it should include both didactics and experiential, longitudinal learning. Additionally, it was noted that the training content should include technical knowledge, as this has been cited as a key barrier to utilization. 31 In designing the telehealth curriculum, we followed the consensus conference recommendations while adding asynchronous learning, a third method included by the authors of the model observation medicine curriculum 29 as well as a quality assurance component.
Lectures are included as a component of our curriculum since they provide a straightforward approach to disseminating knowledge and are a recommended best practice for didactics in EM resident education. 32 Given the breadth of topics encompassing telehealth, we believe implementing didactics via a longitudinal curriculum should solidify fundamental principles while also introducing more complex applications as learners progress in their training and gain more practical experience in telehealth patient encounters.
Furthermore, regular review of telehealth patient encounters in the traditional M&M format has the potential to identify both best practices and unique pitfalls associated with patient care delivery using this technology. The examination of clinical cases in a collective, non‐punitive setting is consistent with the ethos of traditional M&M conferences. These have evolved to become integral to the medical residency curriculum and are recommended as an element of didactics by the Accreditation Council for Graduate Medical Education (ACGME). 33 Telemedicine M&M should maintain fidelity to the best practices established for conventional M&M, including a comprehensive case analysis that focuses on systemic enhancements and provider education, a blend of structured presentations and facilitated discussion, and the fostering of a non‐punitive culture committed to safety and continuous learning. 34 Likewise, journal review is an ACGME accreditation requirement and a standard curricular component of EM residency programs and regular review of original research addressing telehealth‐related topics will further enhance learning.
Longitudinal quality assurance is another key element of the telehealth curriculum, composed of elements such as participation in chart review, case review with faculty, peer review, and patient follow‐up. Retrospective care assessments are a way to identify diagnostic errors and errors in thought processes. Chart audits and feedback can affect resident compliance with standard of care guidelines and improve clinical performance. 35 Not only are chart review and chart audit methodologies important to ensure proper documentation from a clinical perspective, but also from a regulatory compliance, billing, and medico‐legal perspective.
Mirroring the design of the ACGME Emergency Medicine milestones which, in part, were developed to describe progressive expectations, we incorporated increasing responsibility into our telehealth experiential curriculum, for example, PGY 1 and 2 residents should participate in direct telehealth care, while PGY 3 residents should manage telehealth visits with minimal faculty oversight. 36
As is good practice in all clinical medicine, didactic learning should be complemented by experiential learning. While many components of telehealth care mirror those of in‐person care (e.g., obtaining a history and medical decision‐making), others are modified (eg, performing a physical examination, digital empathy, 37 and discussing follow‐up options). Emergency physicians should familiarize themselves with commonly used telehealth platforms, such as those supporting tele‐consult (e.g., telestroke), on‐demand urgent care, and post‐ED discharge follow‐up. They should also be able to evaluate said platforms to be effectively utilized in acute unscheduled care settings. Folded into experiential learning is the ability to aid the patient in troubleshooting technology issues, establish good “webside manner”, and escalation to in‐person care as appropriate. Telehealth documentation may entail unique features such as an assessment of the patient's environment for safety concerns and an assessment of whether the patient is an appropriate telehealth candidate.
Finally, our curriculum includes asynchronous components allowing the resident to gain knowledge of telehealth outside of the traditional group‐based lectures. We included asynchronous learning as its effectiveness in residency education has been demonstrated in the literature and is accepted by the ACGME for up to 20% of a residency's planned didactic experiences. 33 , 38
The type of instruction for telehealth‐based care will vary depending on the type of EM setting it is used in. In triage‐based telehealth uses such as pre‐hospital care and tele‐triage for long‐term acute care facilities, the telehealth interaction typically facilitates decisions about interventions and appropriate level of care for the patient. This may be presented as a didactic, a review of protocols, or case‐based training.
Direct acute unscheduled care has unique interactive features that should be explicitly taught to trainees such as digital empathy, creating a safe and private virtual environment, and understanding of limitations and advantages of a virtual modality. 39 The distinct approach to the telehealth examination can be reviewed in didactics and then executed in simulated practice. 40 , 41 Furthermore, trainees should be formally educated on equity concerns related to telehealth to acknowledge its limitations in some patient populations and address technology barriers. 42 Direct acute unscheduled care should be practiced in a simulated encounter early on in training, then later as supervised clinical training with the attending either directly observing the encounter or receiving a case presentation.
Similarly, out‐of‐ED observation such as post‐ED follow‐up and remote home monitoring can be conducted with direct and indirect attending supervision. A knowledge of the technological tools and testing options available would need to be integrated into a didactic or asynchronous format so that trainees could in turn educate their patients.
7. ASSESSMENT/EVALUATION
While there is not a standardized assessment tool for EM telehealth, previously existing clinical assessment tools may be adapted for the variety of EM telehealth settings that exist. 43 For example, the Objective Structured Clinical Exam is highly structured and objective, with high inter‐rater reliability and correlation to clerkship scores. 44 , 45 , 46 A similar model can be adapted with an additional focus on the use of technology and communication in the virtual setting for medical student learners who may ultimately participate in teletriage or direct acute unscheduled care. In the residency setting, direct observation is the core of entrustment and assessment. 47 Tools should be based on observation of clinical engagement with real patients using telehealth by supervisors who understand and model telehealth competencies in their practice. Noronha et al. proposed specific observation tools for medical students, residents, and faculty based on the AAMC competency domains. These excellent modules should be specifically adapted for the various EM telehealth models to assess trainee performance. In many settings, this may require a specific focus on faculty training in both the clinical skills and assessment of telehealth encounters. 39
Finally, an assessment of communication skills and utilization of technology may be reasonable to obtain from the patient, who is on the receiving end of the telehealth trainee. A systematic review of telehealth survey instruments revealed 12 communication instruments. 48 A quarter focused on technology alone and one‐third examined the quality of human interaction and communication, which can be modified and implemented as a patient‐generated source of assessment data.
8. CONCLUSION
Telehealth is becoming an important part of the practice of EM and residency programs need a structured curriculum to ensure that residents are prepared for this work. As EM has grown as a specialty and incorporated new practice domains such as ultrasound, observation medicine, and disaster medicine, residency programs have adapted their curricula to ensure competency in these new domains. As telehealth joins the ranks of emerging EM competencies, the proposed curriculum can serve as a framework for incorporating telehealth training into existing medical systems and residency training programs.
Oh L, Bhat R, Carr MJ, et al. Telehealth in emergency medicine residency training: A model curriculum. JACEP Open. 2024;5:e13301. 10.1002/emp2.13301
Supervising Editor: Nathan Hoot, MD, PhD.
REFERENCES
- 1. Turner LeeN, Yaraghi N, Lai S, The roadmap to telehealth efficacy: care, health, and digital equities. The Brookings Institution. Accessed August 26, 2022. https://www.brookings.edu/research/the‐roadmap‐to‐telehealth‐efficacy‐care‐health‐and‐digital‐equities/
- 2. Cyr ME, Etchin AG, Guthrie BJ, Benneyan JC, Access to specialty healthcare in urban versus rural US populations: a systematic literature review. BMC Health Serv Res. 2019;19(1):974‐975. doi: 10.1186/s12913-019-4815-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Turner Lee N, Karsten J, Roberts J. Removing regulatory barriers to telehealth. The Brookings Institution. Accessed September 5, 2022. https://www.brookings.edu/research/removing‐regulatory‐barriers‐to‐telehealth‐before‐and‐after‐covid‐19/
- 4.GovInfo. Coronavirus Aid, Relief, and Economic Security Act'' or the ``CARES Act". Accessed July 18, 2023. https://www.govinfo.gov/app/details/PLAW‐116publ136
- 5. Sartori DJ, Hayes RW, Horlick M, Adams JG, Zabar SR. The TeleHealth OSCE: preparing trainees to use telemedicine as a tool for transitions of care. J Grad Med Educ. 2020;12(6):764‐768. doi: 10.4300/JGME-D-20-00039.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Lee MS, Nambudiri V. Integrating telemedicine into training: adding value to graduate medical education through electronic consultations. J Grad Med Educ. 2019;11(3):251‐254. doi: 10.4300/JGME-D-18-00754.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. National Rural Health Association . EMS services in rural America: Challenges and opportunities. Accessed August 6, 2022. https://www.ruralhealthweb.org/NRHA/media/Emerge_NRHA/Advocacy/Policy%20documents/05‐11‐18‐NRHA‐Policy‐EMS.pdf
- 8. Miller KEM, James HJ, Holmes GM, Van Houtven CH. The effect of rural hospital closures on emergency medical service response and transport times. Health Serv Res. 2020;55(2):288‐300. doi: 10.1111/1475-6773.13254 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Cone DC, Brice JH, Delbridge TR, Myers JB. Emergency Medical Services: Clinical Practice and Systems Oversight. 2nd ed. John Wiley & Sons, Inc; 2015. [Google Scholar]
- 10. Vicente V, Johansson A, Ivarsson B, Todorova L, Moller S. The experience of using video support in ambulance care: an interview study with physicians in the role of regional medical support. Healthcare (Basel). 2020;8(2):E106. 10.3390/healthcare8020106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Phend C. Emergency department volume numbers don't tell the whole story: the rising toll of boarding and high‐acuity care. Ann Emerg Med. 2023;82(2):PA15‐PA18. [Google Scholar]
- 12. Joshi AU, Randolph FT, Chang AM, et al. Impact of emergency department tele‐intake on left without being seen and throughput metrics. Acad Emerg Med. 2020;27(2):139‐147. doi: 10.1111/acem.13890 [DOI] [PubMed] [Google Scholar]
- 13. Tsou C, Robinson S, Boyd J, et al. Effectiveness of telehealth in rural and remote emergency departments: systematic review. J Med Internet Res. 2021;23(11):e30632. doi: 10.2196/30632 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Mohr NM, Campbell KD, Swanson MB, Ullrich F, Merchant KA, Ward MM. Provider‐to‐provider telemedicine improves adherence to sepsis bundle care in community emergency departments. J Telemed Telecare. 2021;27(8):518‐526. doi: 10.1177/1357633x19896667 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Cator AD, Weber JS, Lozon MM, Macy ML. Effect of using pediatric emergency department virtual observation on inpatient admissions and lengths of stay. Acad Pediatr. 2014;14(5):510‐516. doi: 10.1016/j.acap.2014.03.010 [DOI] [PubMed] [Google Scholar]
- 16. Hayden EM, Grabowski BG, Kishen EB, Zachrison KS, White BA. The value of an emergency medicine virtual observation unit. Ann Emerg Med. 2024. doi: 10.1016/j.annemergmed.2024.02.001 [DOI] [PubMed] [Google Scholar]
- 17. Sharma R, Nachum S, Davidson KW, Nochomovitz M. It's not just FaceTime: core competencies for the medical virtualist. Int J Emerg Med. 2019;12(1):8. doi: 10.1186/s12245-019-0226-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Galpin K, Sikka N, King SL, Horvath KA, Shipman SA, AAMC Telehealth Advisory Committee . Expert consensus: telehealth skills for health care professionals. Telemed J E Health. 2021;27(7):820‐824. doi: 10.1089/tmj.2020.0420 [DOI] [PubMed] [Google Scholar]
- 19. Association of American Medical Colleges . Telehealth competencies across the learning continuum: AAMC new and emerging areas in medicine series. Accessed August 1, 2024. https://store.aamc.org/downloadable/download/sample/sample_id/412/
- 20. Accreditation Council for Graduate Medical Education (ACGME) . Internal medicine milestones 2.0. 2021. Accessed September 16, 2022. https://www.acgme.org/globalassets/pdfs/milestones/internalmedicinemilestones.pdf
- 21. Beeson MS, Bhat R, Broder JS, et al. The 2022 model of the clinical practice of emergency medicine. J Emerg Med. 2023;64(6):659‐695. doi: 10.1016/j.jemermed.2023.02.016 [DOI] [PubMed] [Google Scholar]
- 22. Pourmand A, Ghassemi M, Sumon K, Amini SB, Hood C, Sikka N. Lack of telemedicine training in academic medicine: are we preparing the next generation? Telemed J E Health. 2021;27(1):62‐67. doi: 10.1089/tmj.2019.0287 [doi] [DOI] [PubMed] [Google Scholar]
- 23. Bashshur RL, Doarn CR, Frenk JM, Kvedar JC, Shannon GW, Woolliscroft JO. Beyond the COVID pandemic, telemedicine, and health care. Telemed J E Health. 2020;26(11):1310‐1313. doi: 10.1089/tmj.2020.0328 [doi] [DOI] [PubMed] [Google Scholar]
- 24. Kirkland EB, DuBose‐Morris R, Duckett A. Telehealth for the internal medicine resident: a 3‐year longitudinal curriculum. J Telemed Telecare. 2021;27(9):599‐605. doi: 10.1177/1357633x19896683 [DOI] [PubMed] [Google Scholar]
- 25. Papanagnou D, Stone D, Chandra S, Watts P, Chang AM, Hollander JE. Integrating telehealth emergency department follow‐up visits into residency training. Cureus. 2018;10(4):e2433. doi: 10.7759/cureus.2433 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Society of Teachers of Family Medicine . Telemedicine curriculum. Accessed August 1, 2024. https://www.stfm.org/telemedicinecurriculum
- 27. Aziz K, Sherif NA, Meshkin RS, Lorch AC, Armstrong GW. Telemedicine curriculum in an ophthalmology residency program. J Acad Ophthalmol. 2022;14(1):e93‐e102. doi: 10.1055/s-0042-1743580 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Hart A, Romney D, Sarin R, et al. Developing telemedicine curriculum competencies for graduate medical education: outcomes of a modified Delphi process. Acad Med. 2022;97(4):577‐585. doi: 10.1097/ACM.0000000000004463 [DOI] [PubMed] [Google Scholar]
- 29. Wheatley M, Baugh C, Osborne A, Clark C, Shayne P, Ross M. A model longitudinal observation medicine curriculum for an emergency medicine residency. Acad Emerg Med. 2016;23(4):482‐492. doi: 10.1111/acem.12909 [DOI] [PubMed] [Google Scholar]
- 30. Hayden EM, Davis C, Clark S, et al. Telehealth in emergency medicine: a consensus conference to map the intersection of telehealth and emergency medicine. Acad Emerg Med. 2021;28(12):1452‐1474. doi: 10.1111/acem.14330 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Scott Kruse C, Karem P, Shifflett K, Vegi L, Ravi K, Brooks M. Evaluating barriers to adopting telemedicine worldwide: a systematic review. J Telemed Telecare. 2018;24(1):4‐12. doi: 10.1177/1357633x16674087 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Wood DB, Jordan J, Cooney R, Goldflam K, Bright L, Gottlieb M. Conference didactic planning and structure: an evidence‐based guide to best practices from the Council of Emergency Medicine Residency Directors. West J Emerg Med. 2020;21(4):999‐1007. doi: 10.5811/westjem.2020.5.46762 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Accreditation Council for Graduate Medical Education . ACGME program requirements for graduate medical education in emergency medicine. Accessed April 29, 2024. https://www.acgme.org/globalassets/pfassets/programrequirements/110_emergencymedicine_2023.pdf
- 34. Beaulieu‐Jones BR, Wilson S, Howard DS, et al. Defining a high‐quality and effective morbidity and mortality conference: a systematic review. JAMA Surg. 2023;158(12):1336‐1343. doi: 10.1001/jamasurg.2023.4672 [DOI] [PubMed] [Google Scholar]
- 35. Proden C, Carravallah L, Taylor DK. Use of medical chart audits in evaluating resident clinical competence: lessons learned from the development and refinement of a study protocol (Implications for use in meeting ACGME evaluation requirements). Qual Assur J. 2002;6(3):175‐180. doi: 10.1002/qaj.190 [DOI] [Google Scholar]
- 36. Beeson MS, Carter WA, Christopher TA, et al. The development of the emergency medicine milestones. Acad Emerg Med. 2013;20(7):724‐729. doi: 10.1111/acem.12157 [DOI] [PubMed] [Google Scholar]
- 37. Sakumoto M, Krug S. Enhancing digital empathy and reimagining the telehealth experience. Telehealth Med Today. 2021;6(4). doi: 10.30953/tmt.v6.304 [DOI] [Google Scholar]
- 38. Estes M, Gopal P, Siegelman JN, Bailitz J, Gottlieb M. Individualized interactive instruction: a guide to best practices from the Council of Emergency Medicine Residency Directors. West J Emerg Med. 2019;20(2):363‐368. doi: 10.5811/westjem.2018.12.40059 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Noronha C, Lo MC, Nikiforova T, et al. Telehealth competencies in medical education: new frontiers in faculty development and learner assessments. J Gen Intern Med. 2022;37(12):3168‐3173. doi: 10.1007/s11606-022-07564-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Shortridge A, Steinheider B, Ciro C, Randall K, Costner‐Lark A, Loving G. Simulating interprofessional geriatric patient care using telehealth: a team‐based learning activity. MedEdPORTAL. 2016;12:10415‐18265.10415. doi: 10.15766/mep_2374-8265.10415 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Benziger CP, Huffman MD, Sweis RN, Stone NJ. The Telehealth Ten: a guide for a patient‐assisted virtual physical examination. Am J Med. 2021;134(1):48‐51. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Nouri S, Khoong E, Lyles C, et al. Addressing equity in telemedicine for chronic disease management during the Covid‐19 pandemic. Accessed September 27, 2022. https://catalyst.nejm.org/doi/full/10.1056/CAT.20.0123
- 43. Gottlieb M, Jordan J, Siegelman JN, Cooney R, Stehman C, Chan TM. Direct observation tools in emergency medicine: a systematic review of the literature. AEM Educ Train. 2020;5(3):e10519. doi: 10.1002/aet2.10519 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Harden RM. What is an OSCE? Med Teach. 1988;10(1):19‐22. doi: 10.3109/01421598809019321 [DOI] [PubMed] [Google Scholar]
- 45. Bullard MJ, Weekes AJ, Cordle RJ, et al. A mixed‐methods comparison of participant and observer learner roles in simulation education. AEM Educ Train. 2018;3(1):20‐32. doi: 10.1002/aet2.10310 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Wallenstein J, Ander D. Objective structured clinical examinations provide valid clinical skills assessment in emergency medicine education. West J Emerg Med. 2015;16(1):121‐126. doi: 10.5811/westjem.2014.11.22440 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Harris P, Bhanji F, Topps M, et al. Evolving concepts of assessment in a competency‐based world. Med Teach. 2017;39(6):603‐608. doi: 10.1080/0142159X.2017.1315071 [DOI] [PubMed] [Google Scholar]
- 48. Weaver MS, Lukowski J, Wichman B, Navaneethan H, Fisher AL, Neumann ML. Human connection and technology connectivity: a systematic review of available telehealth survey instruments. J Pain Symptom Manage. 2021;61(5):1042‐1051.e2. [DOI] [PMC free article] [PubMed] [Google Scholar]