Abstract
Purpose
High-fidelity simulation offers invaluable educational benefits in medical education. It provides the opportunity to develop critical communication and crisis resource management skills, but depends upon a high level of resources including technical equipment, a simulated environment, and instructors with expertise in simulation. This study aimed to develop an educational model that provided some of the benefits of simulation but with increased educational efficiency.
Methods
The intervention was implemented at a specialty continuing medical education conference. This study combined video scenarios, role-playing, team-based learning strategies, and audience response systems to create Video-Assisted Simulation with Audience Response (VASAR). Post-session questionnaire data was compared between traditional high-fidelity simulation and VASAR. Data was also compared to questionnaire responses from separate experiences with high-fidelity simulation.
Results
The study included 70 participants. The data suggest that participants found VASAR to be useful (96%) and realistic (92%). Both video and audience response systems were felt to be valuable (96% and 92%). Participants indicated the workshop would help them practice more safely (80%). In comparison of VASAR with traditional high-fidelity simulation, there were no statistical differences for usefulness of the course (p=0.53), feedback from debriefers (p=0.14), or recommending the course to colleagues (p=0.48).
Conclusion
This study suggests that Video-Assisted Simulation with Audience Response can provide an interactive simulated clinical experience which participants find useful to clinical practice, and that VASAR can provide a tool for future strategies in medical education.
Keywords: simulation learning, high-fidelity simulation, medical education, video, audience response system
Plain Language Summary
Traditional high‑fidelity simulation provides many educational benefits but requires heavy resources and instructor expertise. Video-Assisted Simulation with Audience Response (VASAR) utilizes videos, role-playing, team-based learning strategies, and audience response systems to provide some of the benefits of simulation, but with increased educational efficiency. Participants found VASAR to be interactive, to simulate real-life settings, and to provide useful feedback through debriefing. There were no statistically significant differences noted between VASAR and traditional simulation in this study. VASAR can provide a useful model for remote and distributed medical education with a scalable audience that can be used for the medical education of the future.
Introduction
Simulation technologies provide one of the highest levels of learning and skill acquisition in medical education. High-fidelity simulation allows medical students and residents to gain clinical management skills in a safe, realistic environment through a lifelike and repeatable experience.1,2 These models include technical trainers for procedural skills and surgical techniques.3–5 Similar to the airline industry, crisis resource management strategies promote the development of clinical decision making and communication during high-stress medical scenarios.6–8 These educational benefits are valuable not only for early medical trainees, but also for established physicians – especially in the management of rare or emergent clinical settings, such as airway management skills.9–11
However, despite the undeniable benefits of simulation, it remains an educational strategy that requires a heavy amount of resources and expertise.12 Fletcher and Wind discuss in their article costs of simulation including facilities, equipment and materials, personnel, other program inputs, and client inputs. Task trainers may require expensive mannequins and tools for the trainee to develop their skills. High-fidelity simulation requires not only expensive medical-type equipment and a simulation centre to run scenarios, but also instructor expertise in controlling medical equipment, acting as confederates in the scenario, and providing feedback in debriefing sessions.12–14 Thus, the aim of this study was to evaluate some of the benefits of simulation using a potentially more resource-efficient and scalable educational model. This study used a combination of multiple educational strategies. Video scenarios allowed for the deeper learning of multi-media learning theory compared to didactic learning. Role-playing facilitates the decision-making process of the simulation fidelity continuum. Team-based learning helps participants learn both from their small groups as well as the larger group as a whole. Audience response systems allow for real-time participant interaction that is scalable to large group learning. Our research question was to assess if a less resource intense and scalable teaching strategy could still provide some of the benefits of high-fidelity simulation. To the authors’ knowledge, this study is the first in the medical literature to report on an educational model using the strategies of Video-Assisted Simulation with Audience response.
Materials and Methods
Our simulation education group ran annual simulation sessions at an annual medical conference. Initial courses were offered using traditional high-fidelity simulation models. These sessions, however, required heavy use of resources including costly simulation and medical equipment and a simulation facility in which to hold the course. We also required faculty with experience in simulation and debriefing, as well as other support staff to run the simulation equipment and act as confederates/actors during the simulation experiences. As this model became increasingly challenging to run each year, we aimed to devise an educational model that was less resource-intense and more educationally efficient. Our group used its experience with audience responses systems, team-based learning strategies, and medical education videos to design VASAR: Video-Assisted Simulation with Audience Response.9,15–19
Attendees of the Canadian Society of Otolaryngology – Head and Neck Surgery Annual General Meeting (CSO-HNS AGM) were invited to participate in the simulation sessions. The data for the study were collected over three years, including one high-fidelity simulation course (HFS) and two sessions of Video-Assisted Simulation with Audience Response (VASAR). This comparison involved non-randomised, non-equivalent cohorts drawn from different conference years. Recruitment was done for all participants of the conference sessions. Response rates were 100% of the high-fidelity simulation session and estimated 60–65% of the VASAR sessions. Ethics approval was granted by the Health Research Ethics Board.
The high-fidelity simulation course included course faculty with a diverse international team of practicing Otolaryngologists, Emergency Medicine and Anesthesiology physicians, nurses, residents, and students. The course was held in a technologically equipped simulation centre. Over 15 instructors and support staff were involved to train 19 participants. The simulations used adult and infant high-fidelity mannequins that could replicate basic life functions. Participants would run through an airway management scenario with simulation and content experts present, programmers operating the mannequins from a mirrored control room, and confederates/actors to enrich the simulated environment. Debriefing sessions were held afterwards, led by otolaryngologists with experience in simulation.
The VASAR sessions were led by 2–4 people from our simulation group. These sessions were run in a standard lecture hall with a standard projector and screen. The sessions were approved for Continuing Medical Education (CME) credits. The Tophat audience response system (www.tophat.com) provided audience interactivity through the simple use of texting on their mobile phones. Each time we used the audience response system, we displayed a slide with the phone number for texting and method for participants to text their responses. In our sessions, 2–4 instructors ran sessions for 50–80 participants. These sessions were focused on acute airway management, with segments of an educational video from the creative commons. The session proceeded with a background pre-session slide to prepare the audience for interactivity, asking them to assemble in groups of 2–4 people, and with information on CME credits. We then followed with session-readiness activities for participants to practice using the audience response system (ARS) and to assign themselves the role of either surgeon or anesthesiologist for role-playing in the upcoming scenario. To practice, we had participants introduce themselves to their small groups, choose a team name, and then text us their team name using the audience response system. We prepared the audience by informing them of the following simulation cycle procedures: short video, 2 minutes of role-play, 2 minutes of discussion within small groups, then use the audience response system to text their group response. The participants would then watch a short 5-minute video of an operating room scenario, followed by 2 minutes of role-play in their group to pretend what they would do as surgeon or as anesthesiologist. After stopping the role-play, participants had 2 minutes to discuss within their small groups what they felt should have been done next in the scenario. They then texted their group-decided responses using the ARS, but review of the responses and discussion was withheld until the very end of the session. The simulation cycle of short video, 2 minutes of role-play, 2 minutes of discussion in small groups, and texting of responses was then repeated one more time. Following the simulation cycles, the simulation experience was completed and we proceed with debriefing. The debriefers reviewed what happened during the scenario, then used the ARS to review what the participants felt should have been done in that setting. Participants were then given the opportunity for further feedback on the case and on the educational session. Please refer to Figure 1 for an overview of the session.
Figure 1.

Video-Assisted Simulation with Audience Response (VASAR): Procedures and Methods.
Following both the high-fidelity simulation course and VASAR session, participants were given the opportunity to consent and complete a questionnaire for the study. As this is a new teaching modality, the survey was developed by the research group. A power calculation with alpha of 0.5 and power of 80% noted sample size of 12 for HFS group and 24 for the VASAR group. Statistical analysis was performed including ANOVA and independent samples t-tests. The study compiles with the Declaration of Helsinki.
Results
During the study, 19 of 19 participants from the high-fidelity simulation (HFS) course and 51 of an estimated 80 participants from VASAR conference sessions responded to the questionnaire. Forty-two percent of the HFS group and 46% of the VASAR group had previous experience in simulation. The questionnaire employed a 5-point Likert scale from 1-Strongly Disagree to 5-Strongly Agree.
The VASAR data suggest that participants found the session to be useful (96% of respondents) and realistic (92%). Both the use of Video and Audience response systems were felt to be valuable to the session (96%, 92%) and feedback from both faculty debriefers and fellow participants were felt to be useful and non-judgemental (98%, 98%) (Figure 2). Participants reported that they overall would behave similarly in a real-life situation (78%) and that the workshop would help them practice more safely (80%) (Figure 3). Respondents felt an increased confidence for encountering similar situations in practice (80%) and would recommend the course to colleagues (94%).
Figure 2.

VASAR Interactivity and debriefing. 5-point Likert scale.
Figure 3.

VASAR Program Evaluation. 5-point Likert scale.
Survey items were compared when available from both HFS and VASAR surveys. In comparison between the VASAR data and the high-fidelity simulation data, there were no statistical differences between responses regarding the usefulness of feedback from debriefers (4.79 vs 4.53, p=0.14, 95% CI: −0.08, 0.60) or of feedback from participants (4.63 vs 4.51, p=0.51, 95% CI: −0.24, 0.48) (Figure 4). The data also demonstrated no significant difference between participants finding the course useful (4.67 HFS vs 4.55 VASAR, p=0.53, 95% CI: −0.25, 0.49), or recommending the course to colleagues (4.63 vs 4.49, p=0.48, 95% CI: −0.26, 0.54).
Figure 4.

VASAR vs Traditional high-fidelity simulation. 5-point Likert scale.
Open-ended response on VASAR indicated that participants overall felt the session to be interactive (13 mentions) and valuable (19 mentions). Comments include: “very good learning experience”, “Great! Will do this again. Residents should attend!”, and “FUN + USEFUL”. Negative comments were rare, with only a few participants having difficulty with the instructions or wanting a more didactic style lecture or feeling the scenario was not realistic. The overwhelming response from the data, however, is that participants were pleasantly surprised by the level of interaction and simulation possible from the session, with responses indicating the participants were surprised by “the amount of audience participation/candid responses”, “the emotional involvement while watching the video”, and noted it to be “surprisingly nerve wracking”. One participant’s comment that “Video was very high quality and realistic. Interactive texting was smooth and effective. Program organizers were well prepared” seemed to effectively summarize the overall positive response to Video-Assisted Simulation with Audience Response.
Discussion
The study findings indicate that Video-Assisted Simulation with Audience Response can be an effective model for medical education by combining the use of video scenarios, role-playing, team-based learning, and audience response systems. Participants overall found VASAR to be engaging and interactive, with similarity to real-life medical management and an impact on future practice.
However, VASAR cannot replace the full benefits of high-fidelity simulation. The tactile aspect of using medical equipment, realistic environment of a simulation centre, and full crisis resource management concepts used in HFS are not reproducible through VASAR.20–22 However, this study suggests that VASAR can employ some of the benefits from HFS, including role-playing, team communication and decision making, and some level of a simulated clinical experience. Additionally, VASAR requires much fewer resources. At its core, VASAR can be carried out with one instructor, a video scenario, and a pen and paper for each small group to record responses that can be collected and later shared with the large whole group. Audience response systems requiring technology are not required for VASAR, but more easily allows the session to be scalable to larger groups of 100s or even 1000s of participants, and with a potential future benefit: the opportunity for real-time distributed remote VASAR sessions.23–26 VASAR strategies have been employed during a 1-hour grand-rounds session, where a single instructor used their computer from home to interact with participants online. Video scenarios were shown online, participants interacted with each other using small group or “think-pair-share” strategies, and then reported their decision using the Tophat mobile audience response system.27–29 Responses were collected in real-time online by the instructor and used as a focal point for large group discussions. Feedback to this session was also overwhelmingly positive, with interaction between participants in different hospitals and different cities. This suggests a potential future application of the VASAR framework on a larger scale, with formal data that can be collected in future research.
The scalability of VASAR is such that a session could potentially be run with participants in different countries all over the world. This could be examined in future studies. During the writing of this paper, medical education and the world were struggling with the COVID-19 pandemic. Much of medical education and education in general has moved towards increasingly online strategies.30–32 VASAR provides the ability for interactive and simulation education even during challenging academic and societal circumstances.
To the authors’ knowledge, this study is the first in the medical literature to report on an educational model using the strategies of Video-Assisted Simulation with Audience Response. As an initial report on VASAR, there are of course limitations. The empirical findings of this study suggest some benefit of VASAR for medical education, but broader educational implications could be explored through further investigation. VASAR cannot replicate the non-verbal communication and real-time team dynamics of HFS. Future research could include a randomized controlled trial of VASAR vs HFS, or examine longer term educational impacts of VASAR on clinical practice. Additional studies could include larger sample sizes, equivalent comparison groups, validation of questionnaire items, evaluation of behavioural transfer, knowledge retention, clinic performance, and resource utilization. Educational efficiency could be formally assessed with specific analysis of course cost and resource utilization. However, the data indicate the early response to the VASAR model is overall very positive and could provide a framework for medical education in the future.
Conclusion
The study findings suggest that Video-Assisted Simulation with Audience Response can provide an interactive simulated clinical experience which participants find useful to clinical practice. VASAR has the potential to be more educationally efficient with much less resources required compared to traditional high-fidelity simulation. The combination of video scenarios, team-based learning, and audience response systems has the potential to allow for VASAR to be scalable to large numbers of participants and to be distributed in real-time across different institutions and cities all over the world. Future larger, controlled studies could further determine the education benefits and potential applications of VASAR. As our models for teaching and learning evolve at all levels of academia, VASAR may help provide a framework for future strategies to be used in medical education.
Ethics Approval and Informed Consent
The Health Research Ethics Board (University of Manitoba) approved the study with the ID Number H2015:144. All authors demonstrate that they have adhered to the accepted ethical standards of a research study and that all study is conducted with integrity, fidelity, and honesty. All participants provided informed consent prior to participation. The study complies with the Declaration of Helsinki.
Disclosure
The authors report no conflicts of interest in this work.
References
- 1.Motola I, Devine LA, Chung HS, Sullivan JE, Issenberg SB. Simulation in healthcare education: a best evidence practical guide. AMEE Guide No. 82. Med Teach. 2013;35(10):e1511–8. doi: 10.3109/0142159X.2013.818632 [DOI] [PubMed] [Google Scholar]
- 2.Sakakushev BE, Marinov BI, Stefanova PP, Kostianev SS, Georgiou EK. Striving for better medical education: the simulation approach. Folia Med. 2017;59(2):123–131. doi: 10.1515/folmed-2017-0039 [DOI] [PubMed] [Google Scholar]
- 3.Amin MR, Friedmann DR. Simulation-based training in advanced airway skills in an otolaryngology residency program. Laryngoscope. 2013;123(3):629–634. doi: 10.1002/lary.23855 [DOI] [PubMed] [Google Scholar]
- 4.Agarwal A, Marks N, Wessel V, et al. Improving knowledge, technical skills, and confidence among pediatric health care providers in the management of chronic tracheostomy using a simulation model. Pediatr Pulmonol. 2016;51(7):696–704. doi: 10.1002/ppul.23355 [DOI] [PubMed] [Google Scholar]
- 5.Scott GM, Roth K, Rotenberg B, Sommer DD, Sowerby L, Fung K. Evaluation of a novel high-fidelity epistaxis task trainer. Laryngoscope. 2016;126. doi: 10.1002/lary.25652 [DOI] [PubMed] [Google Scholar]
- 6.Macedonia CR, Gherman RB, Satin AJ. Simulation laboratories for training in obstetrics and gynecology. Obstet Gynecol. 2003;102(2):388–392. doi: 10.1016/s0029-7844(03)00483-6 [DOI] [PubMed] [Google Scholar]
- 7.Volk MS. Improving team performance through simulation-based learning. Otolaryngol Clin North Am. 2017;50(5):967–987. doi: 10.1016/j.otc.2017.05.008 [DOI] [PubMed] [Google Scholar]
- 8.Hohmann E, Brand JC, Rossi MJ, Lubowitz JH. Proficiency-based training using simulator-based tools could be validated for certification of surgical procedural proficiency. Arthrosc J Arthrosc Relat Surg off Publ Arthrosc Assoc N Am Int Arthrosc Assoc. 2019;35(12):3167–3170. doi: 10.1016/j.arthro.2019.09.020 [DOI] [PubMed] [Google Scholar]
- 9.Sommerfeld C, Scott G, Fung K, et al. Using simulation technology to improve patient safety in airway management by practicing otolaryngologists. Stud Health Technol Inform. 2019;257:393–398. [PubMed] [Google Scholar]
- 10.Tavares W. Roads less traveled: understanding the “why” in simulation as an integrated continuing professional development activity. Adv Simul Lond Engl. 2019;4:24. doi: 10.1186/s41077-019-0111-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Leung JS, Brar M, Eltorki M, et al. Development of an in situ simulation-based continuing professional development curriculum in pediatric emergency medicine. Adv Simul Lond Engl. 2020;5:12. doi: 10.1186/s41077-020-00129-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Fletcher JD, Wind AP. Cost considerations in using simulations for medical training. Mil Med. 2013;178(10 Suppl):37–46. doi: 10.7205/MILMED-D-13-00258 [DOI] [PubMed] [Google Scholar]
- 13.Zendejas B, Wang AT, Brydges R, Hamstra SJ, Cook DA. Cost: the missing outcome in simulation-based medical education research: a systematic review. Surgery. 2013;153(2):160–176. doi: 10.1016/j.surg.2012.06.025 [DOI] [PubMed] [Google Scholar]
- 14.Nousiainen MT, McQueen SA, Ferguson P, et al. Simulation for teaching orthopaedic residents in a competency-based curriculum: do the benefits justify the increased costs? Clin Orthop. 2016;474(4):935–944. doi: 10.1007/s11999-015-4512-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Chin C, Roth K, Rotenberg BW, Fung K. Emergencies in otolaryngology-head and neck surgery bootcamp: a novel Canadian experience. Laryngoscope. 2014;124(10):2275–2280. doi: 10.1002/lary.24754 [DOI] [PubMed] [Google Scholar]
- 16.Fung K. Otolaryngology--head and neck surgery in undergraduate medical education: advances and innovations. Laryngoscope. 2015;125 Suppl 2:S1-14. doi: 10.1002/lary.24875 [DOI] [PubMed] [Google Scholar]
- 17.Fanous A, Rappaport J, Young M, Park YS, Manoukian J, Nguyen LHP. A longitudinal simulation-based ethical-legal curriculum for otolaryngology residents. Laryngoscope. 2017;127(11):2501–2509. doi: 10.1002/lary.26551 [DOI] [PubMed] [Google Scholar]
- 18.Nhan C, Young M, Bank I, et al. Interdisciplinary crisis resource management training: how do otolaryngology residents compare? A survey study. OTO Open. 2018;2(2):2473974X18770409. doi: 10.1177/2473974X18770409 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Nguyen LHP, Bank I, Fisher R, Mascarella M, Young M. Managing the airway catastrophe: longitudinal simulation-based curriculum to teach airway management. J Otolaryngol. 2019;48(1):10. doi: 10.1186/s40463-019-0332-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Ziv A, Wolpe PR, Small SD, Glick S. Simulation-based medical education: an ethical imperative. Acad Med J Assoc Am Med Coll. 2003;78(8):783–788. doi: 10.1097/00001888-200308000-00006 [DOI] [PubMed] [Google Scholar]
- 21.Okuda Y, Bryson EO, DeMaria S, et al. The utility of simulation in medical education: what is the evidence? Mt Sinai J Med N Y. 2009;76(4):330–343. doi: 10.1002/msj.20127 [DOI] [PubMed] [Google Scholar]
- 22.Rider A, Schertzer K. Quality Improvement in Medical Simulation. In: StatPearls. StatPearls Publishing; 2020. [PubMed] [Google Scholar]
- 23.Thomas CM, Monturo C, Conroy K. Experiences of faculty and students using an audience response system in the classroom. Comput Inform Nurs CIN. 2011;29(7):396–400. doi: 10.1097/NCN.0b013e3181fc405b [DOI] [PubMed] [Google Scholar]
- 24.Gooi A, Gousseau M, Nelko S, Janzen B. Using a web-based audience response system in medical school. Med Educ. 2014;48(11):1128. doi: 10.1111/medu.12586 [DOI] [PubMed] [Google Scholar]
- 25.Atlantis E, Cheema BS. Effect of audience response system technology on learning outcomes in health students and professionals: an updated systematic review. Int J Evid Based Healthc. 2015;13(1):3–8. doi: 10.1097/XEB.0000000000000035 [DOI] [PubMed] [Google Scholar]
- 26.Gousseau M, Sommerfeld C, Gooi A. Tips for using mobile audience response systems in medical education. Adv Med Educat Pract. 2016:647–52. doi: 10.2147/AMEP.S96320 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Lom B. Classroom activities: simple strategies to incorporate student-centered activities within undergraduate science lectures. J Undergrad Neurosci Educ JUNE Publ FUN Fac Undergrad Neurosci. 2012;11(1):A64–71. [PMC free article] [PubMed] [Google Scholar]
- 28.Carpenter PB, Poliak A, Wang L, Ownby AR, Hsieh P. Improved performance in and preference for using think-pair-share in a flipped classroom. Med Educ. 2020;54(5):449–450. doi: 10.1111/medu.14085 [DOI] [PubMed] [Google Scholar]
- 29.Ganatra S, Doblanko T, Rasmussen K, et al. Perceived effectiveness and applicability of think-pair-share including storytelling (TPS-S) to enhance clinical learning. Teach Learn Med. 2020:1–12. doi: 10.1080/10401334.2020.1811094 [DOI] [PubMed] [Google Scholar]
- 30.Ahmed H, Allaf M, Elghazaly H. COVID-19 and medical education. Lancet Infect Dis. 2020;20(7):777–778. doi: 10.1016/S1473-3099(20)30226-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Ferrel MN, Ryan JJ. The impact of COVID-19 on medical education. Cureus. 2020;12(3):e7492. doi: 10.7759/cureus.7492 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Rose S. Medical student education in the time of COVID-19. Jama. 2020;323(21):2131–2132. doi: 10.1001/jama.2020.5227 [DOI] [PubMed] [Google Scholar]
