Abstract
In the spring of 2020, the COVID-19 pandemic limited access for many health professions students to clinical settings amid concerns about availability of appropriate personal protective equipment as well as the desire to limit exposure in these high-risk settings. Furthermore, the pandemic led to a need to cancel clinics and inpatient rotations, with a major impact on training for health professions and interprofessional health delivery, the long-term effects of which are currently unknown. While problematic, this also presents an opportunity to reflect on challenges facing the traditional clinical training paradigm in a rapidly changing and complex health care system and develop sustainable, high-quality competency-based educational models that incorporate rapidly progressing technologies. We call for pilot studies to explore specific simulation-based inpatient and outpatient clinical rotations for professional and interprofessional training.
Keywords: Simulation, Interprofessional education, COVID-19, Clinical rotation, Medicine
1. Background
Current models of simulation and extended reality (augmented/virtual/mixed reality) include several effective instructional design features,1 and studies have demonstrated benefits across health professions educational programs.2, 3, 4 These techniques allow for the acquisition of a range of knowledge and skills through deliberate practice, lessen the risk posed to patients and learners, and can increase decision-making and task prioritization abilities.5 Simulated environments support the development and practice of behavioral skills, such as self-confidence and professionalism, that are not readily replicable in traditional clinical settings.6 , 7 Further, in interprofessional training, simulation has increased students' ability to effectively communicate within a team environment,8 while also aiding in students' understanding of their own and others’ role and responsibilities in a clinical environment.9 Simulation and extended reality also provide opportunities to design rare scenarios and practice procedures that health professions students may otherwise not encounter in their education.
Simulation is widely used as an adjunct to teaching in most academic health centers in the country. Similarly, extended reality is increasingly being incorporated into various aspects of health care practice, particularly for perioperative precision planning for complex surgical procedures in organs with relatively rigid structures such as the brain, skull, bones, and pancreas.10, 11, 12, 13, 14, 15 Simulation and extended reality can also provide substantial cost savings in medical care through prevention of medical errors, and a subsequent reduction of hospital acquired infections, malpractice costs, and readmission rates.16, 17, 18
While some health professions, such as nursing, allow up to 50% of student training to be conducted through simulations,19 the role of simulation is inconsistently defined in other professions, such as medicine, with vast differences in the level of incorporation and application of simulation and extended reality observed across institutions.20 As simulation and extended reality technologies become more advanced and widely available, and as clinical education curricula continue to evolve, it is timely to reevaluate how to optimize the incorporation of these innovative methods into specific simulation-based rotations to benefit students, including in interprofessional education. Simulation offers the opportunity to design scenarios with various health professions students to assess and improve teamwork and communication – fundamental skills when students transition to work collaboratively in team-based models of care. Early introduction to the various roles and responsibilities of other health disciplines can improve students’ understanding of their own roles and those of other health professions in interprofessional care; in turn, this can increase application of expertise in team environments and improve patient outcomes.21 , 22
In assessment, simulated rotations would lend themselves well to a range of studies, including randomized, controlled trials, to see how they impact desired competencies identified through a thorough review of educational standards, including those established by the Interprofessional Education Collaborative23 and the Health Professions Accreditors Collaborative.24 Further, the utility of these techniques can be evaluated both quantitatively and qualitatively using a variety of robust outcome measures, including objective structured clinical examinations25 and program evaluations.26
2. Modern limitations on traditional clinical rotations
The heavy reliance on inpatient clinical rotations in academic health centers, during which trainees spend a fixed amount of time in different medical specialties, poses challenges in an era where the number27 and length28 of inpatient stays has been historically reduced across all sectors. As the health care system has evolved, training hours have been reduced and collaborative team-based models of care have been adopted; as such, the traditional model of clinical rotations may not be able to fully address the competency needs of many learners into the future. Training continues to be heavily focused on the inpatient setting, while most care is now provided in outpatient settings. This trend is expected to continue, with inpatient hospital services making up an ever decreasing proportion of health system activity and outpatient, home, and virtual care delivery gaining popularity.29
The traditional inpatient clinical rotations model is also challenged by the increasing specialization of the health professions,30 and the transition of inpatient care to quaternary care practice. Even when core experiences are available for students, with increasingly reduced lengths of hospital stays, it is unlikely that each trainee will be exposed to all stages of evolution and management of specific illnesses. Furthermore, the seasonality of some specific prevalent diseases limits the ability of some trainees to gain exposure, and as a result, a trainee can go through a month or more of a clinical rotation without having exposure to clinical scenarios necessary to establish competency in the subject.
Heightening the aforementioned factors are clinical site shortages. In 2013, of 112 Doctor of Medicine and 31 Doctor of Osteopathic Medicine programs surveyed, 80% (n = 89) and 81% (n = 25) respectively were moderately or very concerned by the number of clinical sites available for students31; as of 2019, the proportion of Doctor of Medicine programs expressing those concerns had increased to 84%.32 Similar concerns were expressed in nursing education. Despite a nationwide nursing shortage, in 2018, of 134 surveyed Bachelor of Science in Nursing programs, 45% reported turning away qualified applicants due to a shortage of clinical placements.33 Most recently, in the spring of 2020, the COVID-19 pandemic limited the access of many students to clinical settings amid concerns about availability of appropriate personal protective equipment as well as the desire to limit exposure in these high-risk settings.34
In addition to concerns about the supply of available clinical sites, a shortage of well-trained and available preceptors has been observed in recent years.31 In the 2019 survey of Doctor of Medicine programs, 86% of institutions expressed concerns about the supply of primary care preceptors, and 71% were concerned with the availability of specialty preceptors.32 Further, in a study of 63 physician assistant programs, 89% of programs reported that a shortage of preceptors was one of the main barriers faced when placing students in clinical rotations.35
Moreover, the traditional model of clinical education creates a siloed environment, with health professions students training exclusively with other members of their field, rather than as members of interprofessional teams.36 This discipline-centric model of learning contributes to poor collaboration and communication among health professions students, and ultimately, gaps in patient care and compromised patient safety.37
The traditional model of clinical rotations also presents challenges to competency assessment. Although direct observation is a key assessment strategy in competency-based education,38 the traditional model of clinical rotations often leaves a student learner alone in a room with the patient to gather an independent history and learn key interactive skills. This approach often does not allow routine direct observation by faculty supervisors, who are caring for increasing numbers of patients while also supervising interns, residents, and fellows. Even when direct observation is feasible, observers are often unable to provide real-time, actionable feedback to learners. Furthermore, patient variability may impact supervisors' abilities to easily compare learners’ clinical skills.
3. Importance of maximizing use of simulation and extended reality
Numerous consequences result from the heavy reliance on traditional inpatient clinical rotations in health professions education, with ramifications for students and health care organizations. Firstly, any persistent shortage of adequate training sites will increasingly impact students' ability to complete sufficient training in a timely manner, fueling competition for sites between health care training programs. In the absence of expanded options to traditional clinical rotations, disruptions, even temporary ones such as the COVID-19 pandemic, accentuate the possibility of students not completing their training in a timely manner.34 Delays for any reason may compound trainees’ debt burden and cause undue stress.
In many specialties, particularly critical care environments, students are limited in their opportunities to participate in clinical decisions. This limits the assessment of students’ competency and critical thinking capabilities. Considering impacts to health care organizations, if students fail to acquire necessary skills during clinical rotations, hiring health care organizations become responsible for retraining students to ensure specific organizational competencies are met; as a result, resources and time must be allocated to educate and train on skills and concepts that should have been previously acquired. Simulation and extended reality, however, allow for standardization of curricula and evaluation. Content can be developed to focus on and assess the necessary knowledge and skills in a standardized way that best prepares students for their profession as well as for working in highly collaborative interprofessional care environments, assuring hiring health care organizations that trainees have met those competencies. Moreover, the ability to construct tailored content through simulation and extended reality technologies addresses gaps in the traditional model related to variability in clinical rotation experiences. With nearly unlimited possibilities and scenarios, simulation and extended reality can offer learning experiences that might otherwise be unavailable to students in traditional rotations (e.g., seasonality of diseases, rarity of case studies).
4. Call to action
We make a case for the increased adoption of simulation and extended reality technologies through specific simulation-based clinical rotations across health professions and interprofessional education programs. High-fidelity simulation (i.e., high-quality reproduction of the clinical situation) in lieu of some traditional clinical experiences has documented success across educational domains. In studies of pharmacy and medical students and residents that compared trainee performance after traditional clinical experiences with trainee performance after simulation use, those who received simulation-based training outperformed those who were trained with more traditional methods.39, 40, 41, 42 Further, when comparing nursing students who had 50% of their traditional clinical hours replaced by high-fidelity simulation to nursing students who exclusively had traditional clinical experiences, no statistically significant differences could be found in comprehensive nursing knowledge assessments, NCLEX® pass rates, or clinical competency as assessed by clinical preceptors and instructors.43
The use of simulation has been widely accepted; however, the COVID-19 pandemic has reinforced the opportunity to embrace rapidly advancing simulation and extended reality technologies in new ways in a time when clinical education evolves to meet the 21st century challenges that face healthcare. Innovative models for clinical education are necessary to address emerging gaps in healthcare training, mitigate clinical training site shortages, and prepare trainees to practice effectively in a complex health system. Expansion of clinical simulation and extended reality can address several of these challenges while enhancing health professions education by providing an environment for integrated learning and competency assessment.
The role of simulation in health professions education should also extend to interprofessional education. As highly-coordinated, patient-centered, team-based models of care increasingly become the healthcare delivery model of choice, students must also acquire teamwork, collaboration, communication, and leadership skills. Simulation can be leveraged to introduce the various roles in multidisciplinary teams early in a student's education in a low-risk environment. Previous studies have found interprofessional simulation experiences can improve students' understanding of their roles in interprofessional care, increase cultural competence, improve interprofessional communication, and promote teamwork.9 , 21 , 22
With documented success and support for using simulation and extended reality in training and competency assessment, we propose exploration of the expansion of these high-fidelity platforms in health professions education, with focused assessment to inform the optimal structure and process of required clinical rotations into the future. A review of competencies across clinical rotations and specialty teaching is necessary to identify which competencies can be met by using these innovative methods. For optimal incorporation of simulation into curricula, this will demand the close integration of simulation trainers and managers into health education leadership. When assessing competencies, evaluation and restructuring will provide greater alignment of training methods to competency needs. Simulation-based approaches can also play a key role in standardizing curricula for students, both on a professions-specific level (e.g., with simulations designed for and mapped to competencies) as well as for the broader interprofessional healthcare team (e.g., behavioral skills, professionalism, interpersonal communications). As appropriate, there should be greater investment in platforms that produce life-like competency-based training.
5. Outcome measures for the use of simulation and extended reality
To evaluate any competency-based training provided with simulations or extended reality, the goals and anticipated impact will need to be measurable in a quantifiable manner.
-
1.
Additional high-quality studies are required to understand the incremental value of enhanced simulation and extended reality in interprofessional education, particularly with respect to optimal deployment in the clinical curriculum. These may include randomized controlled trials to compare the competencies gained from use of simulation with regular clinical rotations.44 Moreover, studies are needed to understand the economic and broader health care impact of simulation-based rotations; for example, how simulation-specific rotations impact competition for clinical training sites, preceptorship payments, satisfaction of hiring agencies, etc.
-
2.
Studies should span the Kirkpatrick levels of competency (Level 1, acceptability of simulation training; Level 2, knowledge acquired; Level 3, what happens to performance or behavior with patients; and when feasible, Level 4, patient outcomes).45 , 46
-
3.
Performance can be evaluated in a variety of ways, including objective structured clinical examinations or through surveying program directors, employees, and institutional and regional performance measures. Such evaluation was completed when comparing simulation based training to traditional training in nurses, with use of comprehensive nursing knowledge assessments, NCLEX® pass rates, and evaluations from clinical preceptors and instructors.43
-
4.
Evidence of simulation and extended reality modules' capability to meet local, regional and statewide patient care needs and to improve system performance should be reported. Likewise, measurement of investment of financial and human resources is needed.
-
5.
To continually demonstrate the value of the innovative model to payors and investors, ongoing communication and evidence of sustainability will be necessary. Such evidence may include mandated participation in interprofessional simulation activities across disciplines47 , 48 and documented support from institutional and broader community leadership.48
6Conclusions
Numerous benefits of simulation and extended reality have been recognized within health professions education and, albeit to a lesser extent, interprofessional education. The question becomes how to balance the opportunities and challenges across all training modalities to meet rapidly evolving practice needs. By aiding in skill acquisition and competency development, the expansion of simulation and extended reality can provide critically needed learning opportunities and enhance interprofessional education across health professions. It is time for health professions programs to determine which components of the currently mandated standard clinical rotations could be augmented by carefully constructed simulation and extended reality rotations, and to study the impact.
Funding/support
None.
Other disclosures
None.
Ethical approval
Not applicable.
Disclaimers
None.
Previous presentations
None.
Acknowledgments
None.
References
- 1.Cook D.A., Hamstra S.J., Brydges R., et al. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach. 2013;35(1):e867–e898. doi: 10.3109/0142159X.2012.714886. [DOI] [PubMed] [Google Scholar]
- 2.Griswold S., Fralliccardi A., Boulet J., et al. Simulation-based education to ensure provider competency within the health care system. Acad Emerg Med. 2018;25(2):168–176. doi: 10.1111/acem.13322. [DOI] [PubMed] [Google Scholar]
- 3.Kane-Gill S.L., Smithburger P.L. Transitioning knowledge gained from simulation to pharmacy practice. Am J Pharmaceut Educ. 2011;75(10) doi: 10.5688/ajpe7510210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Roberts E., Kaak V., Rolley J. Simulation to replace clinical hours in nursing: a meta-narrative review. Clin Simul Nurs. 2019;37:5–13. doi: 10.1016/j.ecns.2019.07.003. [DOI] [Google Scholar]
- 5.Al-Elq A.H. Simulation-based medical teaching and learning. J Fam Community Med. 2010;17(1):35–40. doi: 10.4103/1319-1683.68787. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Alanazi A., Nicholson N., Thomas S. Use of simulation training to improve knowledge, skills, and confidence among healthcare students: a systematic review. Internet J Allied Health Sci Pract. 2017;15(3) [Google Scholar]
- 7.Halamek L.P. Simulation-based training: opportunities for the acquisition of unique skills. Virtual Mentor VM. 2006;8(2):84–87. doi: 10.1001/virtualmentor.2006.8.2.medu1-0602. [DOI] [PubMed] [Google Scholar]
- 8.O'Shea M.-C., Reeves N.E., Bialocerkowski A., Cardell E. Using simulation-based learning to provide interprofessional education in diabetes to nutrition and dietetics and exercise physiology students through telehealth. Adv Simul. 2019;4(suppl 1) doi: 10.1186/s41077-019-0116-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Costello M., Huddleston J., Atinaja-Faller J., et al. Simulation as an effective strategy for interprofessional education. Clin Simul Nurs. 2017;13(12):624–627. doi: 10.1016/j.ecns.2017.07.008. [DOI] [Google Scholar]
- 10.Kersten-Oertel M., Gerard I., Drouin S., et al. Augmented reality in neurovascular surgery: feasibility and first uses in the operating room. Int J Comput Assist Radiol Surg. 2015;10(11):1823–1836. doi: 10.1007/s11548-015-1163-8. [DOI] [PubMed] [Google Scholar]
- 11.Mert A., Buehler K., Sutherland G.R., et al. Brain tumor surgery with 3-dimensional surface navigation. Neurosurgery. 2012;71(2 Suppl Operative):ons286–294. doi: 10.1227/NEU.0b013e31826a8a75. discussion ons294-295. [DOI] [PubMed] [Google Scholar]
- 12.Besharati Tabrizi L., Mahvash M. Augmented reality-guided neurosurgery: accuracy and intraoperative application of an image projection technique. J Neurosurg. 2015;123(1):206–211. doi: 10.3171/2014.9.JNS141001. [DOI] [PubMed] [Google Scholar]
- 13.Zhu M., Chai G., Zhang Y., Ma X., Gan J. Registration strategy using occlusal splint based on augmented reality for mandibular angle oblique split osteotomy. J Craniofac Surg. 2011;22(5):1806–1809. doi: 10.1097/SCS.0b013e31822e8064. [DOI] [PubMed] [Google Scholar]
- 14.Nikou C., Digioia A.M., Blackwell M., Jaramaz B., Kanade T. Augmented reality imaging technology for orthopaedic surgery. Operat Tech Orthop. 2000;10(1):82–86. doi: 10.1016/S1048-6666(00)80047-6. [DOI] [Google Scholar]
- 15.Katić D., Spengler P., Bodenstedt S., et al. A system for context-aware intraoperative augmented reality in dental implant surgery. Int J Comput Assist Radiol Surg. 2015;10(1):101–108. doi: 10.1007/s11548-014-1005-0. [DOI] [PubMed] [Google Scholar]
- 16.Asche C.V., Kim M., Brown A., et al. Communicating value in simulation: cost–benefit analysis and return on investment. Acad Emerg Med. 2018;25(2):230–237. doi: 10.1111/acem.13327. [DOI] [PubMed] [Google Scholar]
- 17.Lutgendorf M.A., Spalding C., Drake E., Spence D., Heaton J.O., Morocco K.V. Multidisciplinary in situ simulation-based training as a postpartum hemorrhage quality improvement project. Mil Med. 2017;182(3):e1762–e1766. doi: 10.7205/MILMED-D-16-00030. [DOI] [PubMed] [Google Scholar]
- 18.Ruesseler M., Weinlich M., Müller M.P., Byhahn C., Marzi I., Walcher F. Simulation training improves ability to manage medical emergencies. Emerg Med J. 2010;27(10):734–738. doi: 10.1136/emj.2009.074518. [DOI] [PubMed] [Google Scholar]
- 19.Alexander M, Durham C, Goldman N, et al. NCSBN Simulation Guidelines for Prelicensure Nursing Education Programs. National Council of State Boards of Nursing; :1-11.
- 20.Huang G.C., Sacks H., DeVita M., et al. Characteristics of simulation activities at North American medical schools and teaching hospitals: an AAMC-SSH-ASPE-AACN collaboration. Simul Healthc J Soc Simul Healthc. 2012;7(6):329–333. doi: 10.1097/SIH.0b013e318262007e. [DOI] [PubMed] [Google Scholar]
- 21.Xavier N., Brown M.R. StatPearls. 2020. Interprofessional education in a simulation setting.http://www.ncbi.nlm.nih.gov/books/NBK557471/ StatPearls Publishing. [PubMed] [Google Scholar]
- 22.Iverson L., Bredenkamp N., Carrico C., et al. Development and assessment of an interprofessional education simulation to promote collaborative learning and practice. J Nurs Educ. 2018;57(7):426–429. doi: 10.3928/01484834-20180618-08. [DOI] [PubMed] [Google Scholar]
- 23.Interprofessional Education Collaborative IPEC core competencies. Interprofessional Education Collaborative. https://www.ipecollaborative.org/ipec-core-competencies
- 24.Health Professions Accreditors Collaborative Guidance on developing quality interprofessional education for the health professions. 2019. https://healthprofessionsaccreditors.org/wp-content/uploads/2019/02/HPACGuidance02-01-19.pdf Published online.
- 25.Alinier G., Hunt B., Gordon R., Harwood C. Effectiveness of intermediate-fidelity simulation training technology in undergraduate nursing education. J Adv Nurs. 2006;54(3):359–369. doi: 10.1111/j.1365-2648.2006.03810.x. [DOI] [PubMed] [Google Scholar]
- 26.MacKenzie D., Creaser G., Sponagle K., et al. Best practice interprofessional stroke care collaboration and simulation: the student perspective. J Interprof Care. 2017;31(6):793–796. doi: 10.1080/13561820.2017.1356272. [DOI] [PubMed] [Google Scholar]
- 27.McDermott K., Elixhauser A., Sun R. Agency for Healthcare Research and Quality; June 2017. Trends in Hospital Inpatient Stays in the United States, 2005-2014.https://www.hcup-us.ahrq.gov/reports/statbriefs/sb225-Inpatient-US-Stays-Trends.jsp Published. [Google Scholar]
- 28.National Center for Health Statistics Table 82: hospital admissions, average length of stay, outpatient visits, and outpatient surgery, by type of ownership and size of hospital: United States, selected years 1975–2014. 2016. https://www.cdc.gov/nchs/data/hus/2016/082.pdf Published online.
- 29.Burrill S., Gerhardt W., Arora A. Deloitte Center for Health Solutions; 2020. Hospital Revenue Trends: Outpatient, Home, Virtual, and Other Care Settings Are Becoming More Common. 1-16. [Google Scholar]
- 30.Ricketts T.C., Fraher E.P. Reconfiguring health workforce policy so that education, training, and actual delivery of care are closely connected. Health Aff. 2013;32(11):1874–1880. doi: 10.1377/hlthaff.2013.0531. [DOI] [PubMed] [Google Scholar]
- 31.American Association of Colleges of Nursing, American Association of Colleges of Osteopathic Medicine, Physician Assistant Education Association, Association of American Medical Colleges Recruiting and maintaining U.S. Clinical training sites: joint Report of the 2013 multi-discipline clerkship/clinical training site survey. https://www.aamc.org/system/files/2019-07/recruitingandmaintainingclinicaltrainingsites.pdf
- 32.Association of American Medical Colleges AAMC medical school enrollment survey: 2019 results. 2020. https://store.aamc.org/downloadable/download/sample/sample_id/355/
- 33.National League for Nursing Biennial survey of schools of nursing: academic year 2017-2018. National League for Nursing. http://www.nln.org/newsroom/nursing-education-statistics/biennial-survey-of-schools-of-nursing-academic-year-2017-2018
- 34.Miller D.G., Pierson L., Doernberg S. The role of medical students during the COVID-19 pandemic. Ann Intern Med. 2020;173(2):145–146. doi: 10.7326/M20-1281. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Herrick A., Pearl J.M. Rotation shortages in physician assistant education. J Am Acad PAs. 2015;28(11):1. doi: 10.1097/01.JAA.0000471290.25856.86. [DOI] [Google Scholar]
- 36.Olenick M., Allen L.R., Smego R.A. Interprofessional education: a concept analysis. Adv Med Educ Pract. 2010;1:75–84. doi: 10.2147/AMEP.S13207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Palaganas J.C., Epps C., Raemer D.B. A history of simulation-enhanced interprofessional education. J Interprof Care. 2014;28(2):110–115. doi: 10.3109/13561820.2013.869198. [DOI] [PubMed] [Google Scholar]
- 38.Kogan J.R., Hatala R., Hauer K.E., Holmboe E. Guidelines: the do's, don’ts and don't knows of direct observation of clinical skills in medical education. Perspect Med Educ. 2017;6(5):286–305. doi: 10.1007/s40037-017-0376-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Hallikainen J., Väisänen O., Randell T., Tarkkila P., Rosenberg P.H., Niemi-Murola L. Teaching anaesthesia induction to medical students: comparison between full-scale simulation and supervised teaching in the operating theatre. Eur J Anaesthesiol. 2009;26(2):101–104. doi: 10.1097/EJA.0b013e32831a6a76. [DOI] [PubMed] [Google Scholar]
- 40.Dayal A.K., Fisher N., Magrane D., Goffman D., Bernstein P.S., Katz N.T. Simulation training improves medical students' learning experiences when performing real vaginal deliveries. Simulat Healthc J Soc Med Simulat. 2009;4(3):155–159. doi: 10.1097/SIH.0b013e3181b3e4ab. [DOI] [PubMed] [Google Scholar]
- 41.Palter V.N., Grantcharov T.P. Individualized deliberate practice on a virtual reality simulator improves technical performance of surgical novices in the operating room: a randomized controlled trial. Ann Surg. 2014;259(3):443–448. doi: 10.1097/SLA.0000000000000254. [DOI] [PubMed] [Google Scholar]
- 42.Basheti I.A. The effect of using simulation for training pharmacy students on correct device technique. Am J Pharmaceut Educ. 2014;78(10) doi: 10.5688/ajpe7810177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Hayden J.K., Smiley R.A., Alexander M., K-E S., Jeffries P.R. The NCSBN National Simulation Study: a longitudinal, randomized, controlled study replacing clinical hours with simulation in prelicensure nursing education. J Nurs Regul. 2014;5(2):S3–S40. [Google Scholar]
- 44.Chakravarthy B., ter Haar E., Bhat S.S., McCoy C.E., Denmark T.K., Lotfipour S. Simulation in medical school education: review for emergency medicine. West J Emerg Med. 2011;12(4):461–466. doi: 10.5811/westjem.2010.10.1909. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Kirkpatrick D., Kirkpatrick J. Berrett-Koehler Publishers; 2006. Evaluating Training Programs: The Four Levels. [Google Scholar]
- 46.Sharma B., Boet S., Bould D., et al. Kirkpatrick evaluation of interprofessional simulation-based education for peroperative crisis resource management. J Am Coll Surg. 2011;213(3, Supplement):S129. doi: 10.1016/j.jamcollsurg.2011.06.309. [DOI] [Google Scholar]
- 47.Lucas C., Power T., Kennedy D.S., et al. Conceptualisation and development of the RIPE-N model (reflective interprofessional education-network model) to enhance interprofessional collaboration across multiple health professions. Reflective Pract. 2020;21(5):712–730. doi: 10.1080/14623943.2020.1784866. [DOI] [Google Scholar]
- 48.Black E.W., Davidson H.A., Paradise Black N.M. In: Comprehensive Healthcare Simulation: InterProfessional Team Training And Simulation. Paige J.T., Sonesh S.C., Garbee D.D., Bonanno L.S., editors. Springer International Publishing; 2020. Establishing a sustainable, integrated pre-professional interprofessional simulation program; pp. 89–103. Comprehensive Healthcare Simulation. [DOI] [Google Scholar]
