Skip to main content
The Journal of Education in Perioperative Medicine : JEPM logoLink to The Journal of Education in Perioperative Medicine : JEPM
. 2022 Apr 1;24(2):E687. doi: 10.46374/volxxiv_issue2_mitchell

Defining and Addressing Anesthesiology Needs in Simulation-based Medical Education

Michael J Chen 1, Aditee Ambardekar 4, Susan M Martinelli 5, Lauren K Buhl 1, Daniel P Walsh 1, Lior Levy 1, Cindy Ku 6, Lindsay A Rubenstein 1, Sara Neves 2, John D Mitchell 3,
PMCID: PMC9426263  PMID: 36051401

Abstract

Background:

This study’s primary aim was to determine how training programs use simulation-based medical education (SBME), because SBME is linked to superior clinical performance.

Methods:

An anonymous 10-question survey was distributed to anesthesiology residency program directors across the United States. The survey aimed to assess where and how SBME takes place, which resources are available, frequency of and barriers to its use, and perceived utility of a dedicated departmental education laboratory.

Results:

The survey response rate was 30.4% (45/148). SBME typically occurred at shared on-campus laboratories, with residents typically participating in SBME 1 to 4 times per year. Frequently practiced skills included airway management, trauma scenarios, nontechnical skills, and ultrasound techniques (all ≥ 77.8%). Frequently cited logistical barriers to simulation laboratory use included COVID-19 precautions (75.6%), scheduling (57.8%), and lack of trainers (48.9%). Several respondents also acknowledged financial barriers. Most respondents believed a dedicated departmental education laboratory would be a useful or very useful resource (77.8%).

Conclusion:

SBME is a widely incorporated activity but may be impeded by barriers that our survey helped identify. Barriers can be addressed by departmental education laboratories. We discuss how such laboratories increase capabilities to support structured SBME events and how costs can be offset. Other academic departments may also benefit from establishing such laboratories.

Keywords: Simulation, education, anesthesia, residency, survey, milestones

Introduction

Multiple articles have linked simulation-based medical education (SBME) with improved clinical outcomes113 such as improved self-confidence,13 reduced time to achieve proficiency,4 reduced errors,5 and improved patient safety outcomes.67 SBME is also naturally suited for scaffolding, whereby educators taper off support as learners advance through zones of proximal development and gradually acquire proficiency.1416

With the myriad of benefits associated with SBME, having the infrastructure to appropriately accommodate SBME is vital to educating residents. Having accessible simulation and skills training spaces also facilitates opportunities to practice just-in-time (JIT) simulation training to address procedural skill decay, with several studies showing the value of JIT simulation training in health care. A 2015 systematic review of JIT simulation training for clinicians found it led to improved provider performance.17 A randomized controlled trial published by Branzetti et al18 in 2017 showed that a JIT simulation-training intervention for board-certified physicians performing transvenous pacemaker placement led to significant improvements in various aspects of procedure performance during simulated patient events. These include procedure preparation, achieving capture, troubleshooting for failed captures, postprocedure tasks, and reduction of critical omissions.18 Having a readily available space for JIT simulation training can also be a great boon for trainees in the process of acquiring proficiency and self-confidence: A cross-sectional survey study published by Thomas et al19 in 2016 found that their inclusion of an in situ JIT training room in their pediatric emergency department led to improvements in trainees’ confidence and procedural skills. Furthermore, supervising providers reported they were less inclined to intervene during a trainee’s procedure if the JIT room had been used.19

Despite SBME’s advantages, logistical and financial issues may hamper its incorporation into curricula.20 Whereas institutions may have access to simulation centers, costs and human resources to host high-fidelity centers mean they are typically shared by multiple departments, and they may be located off campus.20,21 This can result in limited SBME opportunities due to inadequate scheduling availability and difficulties traveling to off-campus locations, as well as lack of supplies needed for specialty-specific tasks such as epidural placement. Simulation centers are often designed for full-body physiologic simulations and therefore may not be suited for training specialty-specific procedural skills such as epidural placement and advanced airway rescue. Should faculty or trainees be unable to attend simulations, it may be difficult to reschedule in a timely manner. Faculty may also fear the financial consequences of diverting time to spend on SBME.20

A departmental education laboratory, which is a space dedicated to a specific department’s educational efforts, can be one solution to these issues because it can serve as a dedicated location in proximity to service sites, its unshared nature prevents scheduling conflicts with other departments, and it can host specialty-specific task-training equipment. Beth Israel Deaconess Medical Center (BIDMC)’s Department of Anesthesia, Critical Care, and Pain Medicine created the Anesthesia Education Laboratory (AEL) to serve as a combination skills laboratory, lecture hall, and education research hub. Supplemental Figure 1 shows a photograph of the AEL, Supplemental Figure 2 depicts the AEL’s initial concept image, and Supplemental Figure 3 illustrates the AEL’s current layout.

The AEL is supported by a dedicated laboratory manager and a rotation of senior residents completing a 1-month simulation education elective, and there is ample space for didactics, open laboratories, and procedure skill-competency checkoffs. It houses various mannequins and procedural trainers to facilitate practice of airway management; fiberoptic techniques; ultrasound image acquisition; intravenous and arterial access; and regional anesthesia. The AEL is also used to practice nontechnical skills via simulation, such as leading codes, communicating with agitated patients, and addressing difficult interactions with perioperative staff.

Although BIDMC has used the AEL extensively to incorporate SBME into its anesthesiology education efforts, we were uncertain of how other programs used SBME. To better understand the status of and potential barriers to SBME in the United States, a national needs assessment survey was undertaken. Although preexisting surveys have assessed SBME utilization,2022 to our knowledge only 1 published findings regarding SBME use among anesthesiologists21 since the 2020 changes to Accreditation Council for Graduate Medical Education (ACGME) milestones, which emphasize competency-based training and objective performance measures.23 Because the aforementioned study focused on pediatric anesthesia fellowship programs,21 there is a knowledge gap in assessing anesthesiology residency programs’ SBME utilization. The survey’s goals were to (1) identify settings where SBME took place; (2) identify available and desired resources for SBME; (3) identify barriers to SBME; and (4) establish whether a departmental education laboratory such as BIDMC’s AEL was perceived as useful for other institutions.

Methods

The study was approved by BIDMC’s institutional review board as exempt protocol No. 2020P001137 (Needs Assessment of Anesthesia Residency Programs Simulation-Based Training) with a waiver for documentation of informed consent. BIDMC’s REDCap electronic data capture tools were used to create and distribute anonymous surveys to program directors of anesthesiology residency programs.24 The recipient list was generated from publicly available information on existing United States anesthesiology residency program leadership on the Fellowship and Residency Electronic Interactive Database.25 After reviewing existing literature, the survey was designed by a practicing anesthesiologist educator experienced in simulation and task trainers for education (J.D.M.) and an experienced education laboratory manager (M.J.C.). No preexisting surveys were used as specific templates. We made our survey relatively simple to improve response rates by reducing the survey’s potential burden.

As detailed in Table 1, the final survey consisted of 8 questions assessing where and how SBME took place, resource availability, frequency of use, and barriers to use; and 2 questions assessing perceived utility of and desired resources for a departmental education laboratory. Survey reminders were sent twice (once weekly) after initial distribution on December 7, 2020, followed by targeted emails to 9 recipients over approximately 3 weeks (April 22 to May 7, 2021). Targeted recipients included anesthesiology program directors that the senior author (J.D.M.) had interacted with in the past and therefore believed them to be receptive to a targeted email request to complete the survey, as well as directors who had recently assumed positions from preceding directors we initially sent surveys to but who did not complete the survey themselves. However, we are unable to link any single respondent with their set of survey responses due to setting up our RedCAP survey. Data are reported as frequencies and/or percentages of responses.

Results

Survey Response Rate

Contact information for program directors was obtained for 148 of 161 listed United States anesthesiology residency program directors. Not all programs listed contact information for their directors, and some listings were outdated with the listed director having left the institution and/or stepped down from their position. Several listed contacts who stepped down from their position informed us of their successors, who we then forwarded invitations to and included within our count of contact information for 148 of 161 program directors. Survey response rate was 30.4% (45/148). Full survey results are described in Table 1; a copy of the survey is in Supplemental File 1.

Frequency of Training

Most programs stated residents experienced simulation 1 to 4 times per year (64.4%), with the second highest reported frequency being approximately once a month (22.2%). All but 1 disclosed that residents had ≥ 60% participation rate with scheduled SBME events (97.8%), with most noting ≥ 80% participation rates (80%). The remaining program stated their participation rate as 20% to 39%.

Locations of Training

SBME occurred across various locations, as depicted in Figure 1. Most programs reported an “on-campus central simulation laboratory shared with other departments” as 1 of their simulation training locations (84.4%); furthermore, most programs noted such places were where SBME primarily occurred (64.4%). Of note, all 6 respondents who noted their primary SBME location was at a dedicated space designed exclusively for their anesthesia department reported an estimated 80% to 100% resident participation rate category—as did the 5 respondents who reported off-campus simulation laboratories as their primary SBME locations. Also, 14 of the 16 respondents who reported having a dedicated space exclusive to their anesthesia department reported 80% to 100% resident participation (the other 2 had 1 reporting 20%–39% and 1 at 60%–79%).

Figure 1.

Figure 1.

Primary simulation space for programs. The pie chart in Figure 1 depicts the distribution of respondents’ answers for question 5 of our survey (n = 45): “In which location does the majority of simulation-based training take place at your program?” Respondents were only able to select 1 answer. Other responses to this question consisted of 1 of each of the following responses: an off campus, affiliated, shared lab; empty operating rooms; and a central shared laboratory that is on campus for the medical school but off campus for the center’s department.

Types of Training

Programs reported a broad range of skills and activities practiced at their primary center for SBME, as depicted in Figure 2.

Figure 2.

Figure 2.

Skills and activities at primary simulation spaces. The bar chart in Figure 2 depicts the distribution of respondents’ answers for question 6 of our survey (n = 45): “Which skills are practiced/which activities occur in the place you listed above [i.e., at the primary simulation space],” in descending order by percentage of respondents who selected each skill. This question allowed respondents to select multiple options simultaneously, as applicable; thus, percentages for the answers total to over 100%. Other responses to question 6 consisted of 1 of each of the following responses: introduction to pediatrics rotation; clinical scenarios, OSCE [Objective Structured Clinical Examination] preparations, and cadaver lab; specific anesthesia complications; point-of-care ultrasound; and crisis resource management. One respondent did not provide details for their selection of other for this question.

Resources for Training in the Primary Center

Mannequins, dedicated task trainers, and ultrasound/echocardiography simulators were frequently noted among resources available at programs’ primary SBME centers (100%, 84.4%, and 77.8% respectively). In contrast, virtual reality (VR) and augmented reality (AR) software availability and three-dimensional (3D) printing capability were rarely noted as available resources (24.4% and 13.3%, respectively). Dedicated staff to manage the space was reported in 77.8% of centers. Full responses for this question are depicted in Figure 3.

Figure 3.

Figure 3.

Resources at primary simulation spaces. The bar chart in Figure 3 depicts the distribution of respondents’ answers for question 7 of our survey (n = 45): “What resources are available at the primary center for simulation-based training,” in descending order by percentage of respondents who selected each resource. This question allowed respondents to select multiple options simultaneously, as applicable; thus, percentages for the answers total to over 100%. Other responses to question 7 consisted of 1 of each of the following responses: video and standardized patients.

Barriers to Training

Top reported SBME barriers were COVID-19 precautions (75.6%), scheduling difficulties with participants (57.8%), and lack of trainers/staff availability to facilitate training (48.9%). Costs for supplies, inadequate equipment, costs for renting laboratories, inadequate space, and travel difficulties were each reported as barriers by fewer than 30% of programs. Full responses for this question are depicted in Figure 4.

Figure 4.

Figure 4.

Barriers to simulation. The bar chart in Figure 4 depicts the distribution of respondents’ answers for question 8 of our survey (n = 45): “What kinds of barriers exist that prevent/hamper the use of simulation-based training at your center, if any,” in descending order by percentage of respondents who selected each resource. This question allowed respondents to select multiple options simultaneously, as applicable, or select N/A - I am not aware of any such barriers; thus, percentages for the answers total to over 100%. Other responses to question 8 consisted of 1 of each of the following responses: faculty time availability, time away from clinical duties, and clinical schedule and clinical work demands.

Education Laboratory Concept

When asked whether a dedicated education laboratory space would be a useful resource, 77.8% of respondents indicated it would be useful or very useful, with most (62.2%) indicating it would be very useful. Two programs indicated it would be not very useful (4.4%), and 2 programs indicated a dedicated space would be not useful (4.4%). The resources most frequently selected as desirable for a department-based education laboratory were airway management mannequins/trainers, fiberoptic bronchoscopes, ultrasound/echocardiography simulators, ultrasound machines, and airway management equipment (75.6%–82.2%). Several respondents marked VR/AR and dedicated staff to manage the space as useful resources (60.0% each), whereas few respondents selected 3D printing capabilities as a useful resource (26.7%). Respondents could select multiple resources for the aforementioned survey item.

Discussion

Our survey’s goals were to identify where SBME takes place for anesthesiology residency programs, identify available and desired resources for SBME, barriers to SBME, and perceptions of a dedicated education laboratory like ours. From our 45 respondents, we gathered that SBME is widely incorporated, though typically only 1 to 4 times per year, in institutional or shared simulation centers; prominent barriers included COVID-19 precautions, scheduling difficulties, and a lack of trainer availability; task trainers for airway management and ultrasound/echocardiography simulators were among the most prominently used and desired SBME resources; and most programs would value a dedicated education laboratory. As our specialty moves toward competency based-training, it is increasingly important to provide learners with opportunities to improve skills with greater frequency and flexibility. Although COVID-19 restrictions and scheduling issues were cited as the top barriers to SBME, these barriers can be addressed by using dedicated education laboratories for smaller-sized, more frequent training sessions at times amenable to schedules.

A notable finding was that the vast majority of respondents reported an estimated 80% to 100% resident participation rate in scheduled simulation training events (n = 36; 80%). It could be that certain factors are associated with resident participation rates at or near 100%, such as presence of dedicated departmental SBME spaces or particular resource availabilities. Conversely, certain barriers may be what keep programs from reaching 100% or near-100% participation rates. In addition, the fact that all 5 respondents who reported dedicated SBME spaces as their primary SBME space also reported 80% to 100% participation rates might be a signal of a correlation between departmental education laboratories and increased resident participation in scheduled SBME, but we can by no means assert this supposition with our limited sample size.

A meta-analysis of instructional approaches in procedural training found studies involving simulation and competency-based approaches were effective forms of training, and noted that “All procedures, whether simple or complex, involve a stepwise progression of technical steps for which knowledge of anatomy, familiarity with equipment and fluency of movement are equally important.”16 Having readily available spaces such as departmental education laboratories facilitates stepwise progression in learners and allows reliable opportunities for JIT training prior to starting specialty rotations. This approach has proven useful to our residency program at BIDMC and led to more frequent and consistent SBME.

The AEL at BIDMC was developed to address SBME barriers we experienced. Although the AEL was not created specifically to address COVID-19 precautions, it being a fairly large space with ample room to maintain social distancing and the ability to host several small group sessions with relative ease due to having full control over scheduling proved to be a great boon during the COVID-19 pandemic. For example, during our intern course’s ultrasound training we were able to block off an entire day for interns to cycle through stations set up in the AEL for simulator practice with faculty, independent simulator practice, and live-model practice/testing sessions. This allowed for keeping a low number of people in the room simultaneously while affording each trainee ample time for focused one-on-one time with staff; independent learning; and reducing the number of faculty and live models that a larger simultaneous training event would necessitate. Similarly, greater ease of scheduling SBME and impromptu JIT training in the AEL over a shared space helped accommodate the busy schedules of faculty and residents.

Survey respondents perceived the AEL’s concept favorably. Only 4 indicated a departmental education laboratory such as BIDMC’s would be not very useful/not useful to their department (8.8%). Two of those respondents appeared to have no issues integrating SBME into their program, given that they reported having robust, regularly scheduled SBME and abundant resources at their primary simulation centers; their only reported barriers to SBME were a lack of trainers/staff availability to facilitate training and COVID-19 Precautions. In contrast, we surmise the other 2 programs do not actively incorporate SBME into their programs, because 1 reported only 20%–39% resident participation and the other reported only using simulation for “crisis resource management.”

Some of our findings mirror those of Savoldelli and colleagues’ 2005 survey20 of a single institution with 2 simulation centers. Notably, both surveys indicated nontechnical skills are frequently practiced via SBME and identified scheduling difficulties as a SBME barrier.20 In contrast, Savoldelli and colleagues’ survey is notable for having only 25% of respondents classifying “teaching technical skills (e.g., airways, chest tubes, etc.)” as a high-priority course; whereas in our survey, procedural skills such as airway management and ultrasound imagining were frequently reported as activities (93.3% and 80%, respectively).20 This may be reflective of increased SBME, or perhaps the evolution of technology and clinical practice over these past 15 years. Likewise, findings from our survey matched that of Ambardekar and colleagues’ 2018 national survey of ACGME-accredited pediatric anesthesiology fellowship programs.21 Both surveys noted that programs typically implemented SBME 1 to 4 times per year in on-campus or hospital-based simulation centers and frequently identified scheduling as a barrier.21 Ambardekar and colleagues’21 survey notably reported that 87% of respondents believed standardized simulation curricula should be developed for voluntary use within all pediatric anesthesiology fellowship programs. The revelation of high interest in standardized simulation curricula by the Ambardekar et al21 survey may coincide with our survey’s revelation that most anesthesia residency programs consider dedicated education laboratories as useful or very useful resources, because dedicated education laboratories could improve access and facilitate implementation of standardized simulation curricula.

Justifying the cost of establishing a departmental skills laboratory may be challenging for programs. However, costs for BIDMC’s AEL were substantially reduced via support from engineering and anesthesia technicians in providing phased-out equipment and expired supplies, respectively. Although dedicated staff to support the education laboratory represents an expense and only 60% of programs reported interest in this for a departmental education laboratory, we believe it adds significant value. Laboratory managers can aid in procuring expired supplies and maintaining equipment to reduce annual expenditure. They can also create low-cost alternative task trainers including gel block phantoms, intravenous trainers, and 3D models to reduce supply costs.2628 Laboratory managers can also help coordinate administrative and research efforts, reducing burdens and costs in these areas. Departments seeking laboratory managers can create a part-time position if they do not expect a need to staff laboratories throughout workweeks or have budgetary concerns; furthermore, creating such positions presents growth opportunities for existing departmental staff.

Having a space with flexible scheduling and a laboratory manager who can provide research support has helped markedly expand our efforts in teaching and assessing technical skills using hand motion metrics, video assessments, VR skills training, and 3D modeling.2931 Prior to the AEL’s inception, it was logistically challenging to book small group sessions to accomplish these intensive training and research programs. An example of this is our skills checkoff program, where residents are required to complete relevant technical skills checkoffs prior to starting subspecialty rotations on cardiac, vascular, and thoracic surgery. Prior to the AEL, participation was poor (averaging < 30%) and checkoffs occurred in a shared, central simulation center. However, since the AEL’s inception, participation has improved to 100%. Furthermore, the AEL avoids costs associated with booking time in shared laboratories, as well as personnel costs to have their simulation staff present. Anecdotally, our faculty and trainees have expressed appreciation in the AEL’s ability to support essentially on-demand, ad hoc opportunities to practice skills.

There are several limitations to this study. We did not use a validated survey tool nor did we model this survey after any preexisting surveys on SBME, because we wished to use questions specific to our study’s goals of assessing SBME issues and wished to do so in a timely manner to assess how COVID-19 affected SBME efforts. In addition, the survey response rate was low, with only 45 responses out of 148 potential respondents. This may be due to the dissemination coinciding with the COVID-19 pandemic and/or the end of the calendar year, given that prior research into why physicians may not respond to surveys identified a major reason as receiving too many survey requests and a lack of time to complete them.32 Furthermore, to comply with our institutional review board’s requirements for recruitment emails, we used standardized language to ensure certain aspects of the study were noted in detail, such as the protocol number and full title; to communicate that participation was optional and voluntary; and to list whom to contact with questions about rights in participating with research. This resulted in the generalized survey invite that was 4 paragraphs long. Although our response rate was low at 30.4%, such a rate was still in line with previously published surveys.33

We acknowledge our respondent pool was likely biased toward program directors with greater interests in simulation and/or who were more concerned about barriers to implementing SBME; the fact that we included 9 targeted recipients likely to respond to a personal request to complete the survey and/or who recently succeeded their position as program director likely exacerbates these potential biases as well. Whereas respondents could provide custom answers to questions by selecting other, this survey did not accommodate follow-up assessments due to its anonymous nature. Whereas repeated survey methods such as a Delphi method may have elicited in-depth information on how residency programs use and view SBME, it would have added concerns of respondent dropout over repeated rounds of questioning, in addition to preexisting concerns about achieving adequate response rate.

Conclusion

Our survey of anesthesiology residency program directors hailing from all US census regions shows SBME is a widely used tool in anesthesiology residency programs. Most respondents believed a department education laboratory would be valuable for facilitating SBME. The establishment of our AEL led to increased capabilities to support structured SBME events more frequently and in smaller groups, so as to align better with deliberate practice, mastery-based learning principles and to remain compliant with class size limitations during the COVID-19 pandemic. We therefore believe that other academic departments would also benefit from establishing dedicated departmental SBME spaces.

Acknowledgments

We thank Mary Jane Cahill, MBA, C-TAGME, and Vanessa Wong, BS, for helping coordinate training sessions for our residency program at the AEL, as well as Stephanie Jones, MD, and Cindy Ku, MD, for paving the way for the establishment of BIDMC’s AEL.

Supplemental Online Material

Supplemental Figure 1.

Supplemental Figure 1.

Anesthesia Education Laboratory photograph. The photograph shows the Anesthesia Education Laboratory (AEL) at Beth Israel Deaconess Medical Center (BIDMC). The photograph was taken by the entrance to the AEL.

Supplemental Figure 2.

Supplemental Figure 2.

Anesthesia Education Laboratory concept image. The figure is the actual concept image of the Anesthesia Education Laboratory (AEL) at Beth Israel Deaconess Medical Center from the planning phase for establishing this space. Note that only the areas in the center of this figure represent the AEL (including the huddle room depicted on the bottom left corner) and that the cabinets depicted toward the upper right were ultimately omitted to accommodate computer screens.

Supplemental Figure 3.

Supplemental Figure 3.

Anesthesia Education Laboratory blueprint. The blueprint of the Anesthesia Education Laboratory (AEL) at Beth Israel Deaconess Medical Center is not drawn to scale. The dimensions of the entire space are 18 ft 6 in × 29 ft (540 sq ft), whereas the huddle room depicted in the top left is 8 ft 3 in × 8 ft 9 in. A photograph of the AEL can be seen in Supplemental Figure 1; concept art for the AEL can be seen in Supplemental Figure 2.

Table 1.

Survey Results

Questiona Responsesb
1) Geographic area
  • Northeast US (eg, Massachusetts, New York, Pennsylvania): 15 (33.3%)

  • South US (eg, Texas, North/South Carolina, Florida): 13 (31.1%)

  • Midwest US (eg, Michigan, Wisconsin, Illinois): 9 (20.0%)

  • West US (eg, California, Oregon, Colorado, Hawaii): 7 (15.6%)

2) Frequency of scheduled simulation education for residents
  • 1 to 4 times per year (ie, annually/quarterly): 28 (62.2%)

  • Approximately once a month: 10 (22.2%)

  • 2 to 4 times per month (ie, every other week/weekly): 3 (6.7%)

  • Otherc: 4 (8.9%)

3) Estimated participation rate of residents and scheduled simulations
  • 80%–100%: 36 (80%)

  • 60%–79%: 8 (17.8%)

  • 40%–59%: 0 (0%)

  • 20%–39%: 1 (2.2%)

  • 0%–19%: 0 (0%)

4) Locations of simulation-based training (check all that apply)d
  • On-campus central simulation laboratory shared with other departments: 38 (84.4%)

  • Off-campus simulation laboratory that is not directly affiliated with your organization: 9 (20.0%)

  • Dedicated space designed exclusively for anesthesia department: 16 (35.6%)

  • Anesthesia departments break rooms/lounges: 8 (17.8%)

  • Conference rooms/auditoriums (shared spaces): 11 (24.4%)

  • Othere: 13 (28.9%)

5) Primary simulation-based training location (choose one)
  • On-campus central simulation laboratory shared with other departments: 29 (64.4%)

  • Off-campus simulation laboratory which is not directly affiliated with your organization: 5 (11.1%)

  • Dedicated space designed exclusively for anesthesia department: 6 (13.3%)

  • Conference rooms/auditoriums (shared spaces): 2 (4.4%)

  • Otherf: 3 (6.7%)

6) Simulation skills and activities practiced at primary location (check all that apply)d
  • Airway management skills (eg, direct laryngoscopy, supraglottic airway placement): 42 (93.3%)

  • Trauma/case scenarios: 39 (86.7%)

  • Nontechnical skills training (eg, communication, leadership skills): 37 (82.2%)

  • Ultrasound imaging: 36 (80.0%)

  • transesophageal echocardiography (TEE): 32 (71.1%)

  • Fiberoptic skills: 30 (66.7%)

  • Spinal/epidural placement: 28 (62.2%)

  • Arterial line placement: 23 (51.1%)

  • IV placement: 26 (57.8%)

  • Advanced cardiovascular life support (ACLS) training: 26 (57.8%)

  • Regional anesthesia: 21 (46.7%)

  • Didactics: 16 (35.6%)

  • Research studies: 9 (20.0%)

  • Otherg: 6 (16.7%)

7) Resources at primary simulation location (check all that apply)d
  • Mannequins: 45 (100%)

  • Dedicated task trainers (eg, ultrasound-compatible phantoms): 38 (84.4%)

  • Ultrasound/echocardiography simulators: 35 (77.8%)

  • Dedicated staff to manage the space: 35 (77.8%)

  • Virtual reality/augmented reality software programs: 11 (24.4%)

  • Three-dimensional (3D) printing models: 6 (13.3%)

  • Otherh: 2 (4.4%)

Table 1.

Survey Results

Questiona Responsesb
8) Barriers to simulation (check all that apply, or not applicable [N/A])d
  • COVID-19 precautions: 34 (75.6%)

  • Scheduling difficulties with participants: 26 (57.8%)

  • Lack of trainers/staff availability to facilitate training: 22 (48.9%)

  • Booking availabilities with the simulation laboratory: 19 (42.2%)

  • Financial costs for supplies: 13 (28.9%)

  • Inadequate equipment for desired training: 10 (22.2%)

  • Costs for renting simulation laboratory: 9 (20.0%)

  • Not enough space to accommodate teaching groups: 9 (20.0%)

  • Difficulty traveling to simulation site(s): 5 (11.1%)

  • N/A, I am not aware of any such barriers: 1 (2.2%)

  • Otheri: 3 (6.7%)

9) Utility of a departmental education laboratory as described
  • 5, very useful: 28 (62.2%)

  • 4: 7 (15.6%)

  • 3: 6 (13.3%)

  • 2: 2 (4.4%)

  • 1, not very useful: 2 (4.4%)

10) Desired resources for a departmental education laboratory (check all that apply, or N/A)d
  • Fiberoptic scope (or equivalent simulator): 37 (82.2%)

  • Ultrasound/echocardiography simulator: 36 (80.0%)

  • Ultrasound machine: 35 (77.8%)

  • Airway management mannequins/trainers: 34 (75.6%)

  • Regional anesthesia trainers: 31 (68.9%)

  • Virtual reality/augmented reality simulators: 27 (60.0%)

  • Staff dedicated to managing the space: 27 (60.0%)

  • 3D printer: 12 (26.7%)

  • N/A, I do not believe such a center is necessary for our department at this time: 2 (4.4%)

  • Otherj: 1 (2.2%)

a

Abbreviations for the question’s core concept are listed in this table; the full text of each question can be seen in Supplemental File 1.

b

Responses are reported in the following format: Answer selected, number of responses (percentage of respondents who selected answer).

c

Other responses to question 2 consisted of 1 of each of the following responses: “quarterly beginning in June of intern year,” “6–8 times a year,” “five labs in 12 months,” and “6 1 ½ hour sessions during internship, 50 hours during [clinical anesthesia] orientation, intermittent manikin, [point-of-care ultrasound] and [transesophageal echocardiography] throughout residency.”

d

These questions allowed respondents to select multiple options simultaneously, as applicable; thus, percentages for those questions total to over 100%. Otherwise, respondents could only select 1 of the available options.

e

Other responses to question 4 consisted of in situ at actual clinical locations/operating rooms (n = 8); central simulation laboratory for course staff and virtual participation for learners (n = 1); an off-campus, affiliated center shared between departments (n = 2); cadaver laboratory (n = 1); and virtual simulation training (n = 1).

f

Other responses to question 5 consisted of 1 of each of the following responses: an off-campus, affiliated, shared lab; empty operating rooms; and a central shared laboratory that is on campus for the medical school, but off campus for the center’s department.

g

Other responses to question 6 consisted of 1 of each of the following responses: introduction to pediatrics rotation; clinical scenarios, OSCE (Objective Structured Clinical Examination) preparations, and cadaver lab; specific anesthesia complications; point-of-care ultrasound; and crisis resource management. One respondent did not provide details for their selection of other for this question.

h

Other responses to question 7 consisted of 1 of each of the following responses: “video” and “standardized patients.”

i

Other responses to question 8 consisted of 1 of each of the following responses: “faculty time/availability,” “time away from clinical duties,” and “clinical schedule and clinical work demands.”

j

Other response to question 10 consisted of 1 respondent who wrote “Neuraxial.”

Funding Statement

Financial disclosures: None

Footnotes

Conflicts of interest:

None

References

  • 1.Bloch SA, Bloch AJ. Simulation training based on observation with minimal participation improves paediatric emergency medicine knowledge, skills and confidence [published online October 17, 2013] Emerg Med J . 2015;32(3):195–202. doi: 10.1136/emermed-2013-202995. [DOI] [PubMed] [Google Scholar]
  • 2.Goolsby CA, Goodwin TL, Vest RM. Hybrid simulation improves medical student procedural confidence during EM clerkship. Mil Med . 2014;179(11):1223–27. doi: 10.7205/MILMED-D-14-00072. [DOI] [PubMed] [Google Scholar]
  • 3.Barsuk JH, McGaghie WC, Cohen ER, et al. Use of simulation-based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit. J Hosp Med . 2009;4(7):397–403. doi: 10.1002/jhm.468. [DOI] [PubMed] [Google Scholar]
  • 4.Orzech N, Palter VN, Reznick RK, et al. A comparison of 2 ex vivo training curricula for advanced laparoscopic skills: a randomized controlled trial. Ann Surg . 2012;255(5):833–9. doi: 10.1097/SLA.0b013e31824aca09. [DOI] [PubMed] [Google Scholar]
  • 5.Seymour NE, Gallagher AG, Roman SA, et al. Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg . 2002;236(4):458–64. doi: 10.1097/00000658-200210000-00008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Barsuk JH, Cohen ER, Feinglass J, McGaghie WC, Wayne DB. Use of simulation-based education to reduce catheter-related bloodstream infections. Arch Intern Med . 2009;169(15):1420–23. doi: 10.1001/archinternmed.2009.215. [DOI] [PubMed] [Google Scholar]
  • 7.Lewis KA, Ricks TN, Rowin A, et al. Does simulation training for acute care nurses improve patient safety outcomes? A systematic review to inform evidence-based practice. Worldviews Evid Based Nurs . 2019;16(5):389–96. doi: 10.1111/wvn.12396. [DOI] [PubMed] [Google Scholar]
  • 8.McGaghie WC, Issenberg SB, Cohen ER, et al. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med . 2011;86(6):706–11. doi: 10.1097/ACM.0b013e318217e119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Kononowicz AA, Woodham LA, Edelbring S, et al. Virtual patient simulations in health professions education: systematic review and meta-analysis by the digital health education collaboration. J Med Internet Res . 2019;21(7):e14676. doi: 10.2196/14676. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Waterman BR, Martin KD, Cameron KL, et al. Simulation training improves surgical proficiency and safety during diagnostic shoulder arthroscopy performed by residents. Orthopedics . 2016;39(3):e479–85. doi: 10.3928/01477447-20160427-02. [DOI] [PubMed] [Google Scholar]
  • 11.Cohen ER, Feinglass J, Barsuk JH, et al. Cost savings from reduced catheter-related bloodstream infection after simulation-based education for residents in a medical intensive care unit. Simul Healthc . 2010;5(2):98–102. doi: 10.1097/SIH.0b013e3181bc8304. [DOI] [PubMed] [Google Scholar]
  • 12.Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA . 2011;306(9):978–88. doi: 10.1001/jama.2011.1234. [DOI] [PubMed] [Google Scholar]
  • 13.Huang GC, McSparron JI, Balk EM, et al. Procedural instruction in invasive bedside procedures: a systematic review and meta-analysis of effective teaching approaches. BMJ Qual Saf . 2016;25(4):281–94. doi: 10.1136/bmjqs-2014-003518. [DOI] [PubMed] [Google Scholar]
  • 14.Vygotskiĭ L. Interaction between learning and development. In: Cole M, editor. Mind in Society: The Development of Higher Psychological Processes . Harvard University Press; Cambridge, MA: 1978. pp. 79–91. Harvard University Press. [Google Scholar]
  • 15.Wood D, Bruner J, Ross G. The role of tutoring in problem solving. J Child Psychol Psychiatry . 1976;17(2):89–100. doi: 10.1111/j.1469-7610.1976.tb00381.x. [DOI] [PubMed] [Google Scholar]
  • 16.Kelly RR, McCrackin MA, Russell DL, et al. Teaching surgical model development in research by using situated learning and instructional scaffolding. J Am Assoc Lab Anim Sci . 2019;58(3):321–8. doi: 10.30802/AALAS-JAALAS-18-000090. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Braga MS, Tyler MD, Rhoads JM, et al. Effect of just-in-time simulation training on provider performance and patient outcomes for clinical procedures: a systematic review. BMJ Simul Technol Enhanc Learn . 2015;1(3):94–102. doi: 10.1136/bmjstel-2015-000058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Branzetti JB, Adedipe AA, Gittinger MJ, et al. Randomised controlled trial to assess the effect of a just-in-time training on procedural performance: a proof-of-concept study to address procedural skill decay. BMJ Qual Saf . 2017;26(11):881–91. doi: 10.1136/bmjqs-2017-006656. [DOI] [PubMed] [Google Scholar]
  • 19.Thomas AA, Uspal NG, Oron AP, Klein EJ. Perceptions on the impact of a just-in-time room on trainees and supervising physicians in a pediatric emergency department. J Grad Med Educ . 2016;8(5):754–8. doi: 10.4300/JGME-D-15-00730.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Savoldelli GL, Naik VN, Hamstra SJ, Morgan PJ. Barriers to use of simulation-based education. Can J Anaesth . 2005;52(9):944–50. doi: 10.1007/BF03022056. [DOI] [PubMed] [Google Scholar]
  • 21.Ambardekar AP, Newell A, Blassius K, et al. Medical simulation utilization among pediatric anesthesiology fellowship programs. Paediatr Anaesth . 2020;30(7):823–32. doi: 10.1111/pan.13895. [DOI] [PubMed] [Google Scholar]
  • 22.Rochlen LR, Housey M, Gannon I, et al. a survey of simulation utilization in anesthesiology residency programs in the United States. A A Case Rep . 2016;6(11):335–42. doi: 10.1213/XAA.0000000000000304. [DOI] [PubMed] [Google Scholar]
  • 23.Ambardekar AP, Walker KK, McKenzie-Brown AM, et al. The anesthesiology milestones 2.0: an improved competency-based assessment for residency training. Anesth Analg . 2021;133(2):353–61. doi: 10.1213/ANE.0000000000005499. [DOI] [PubMed] [Google Scholar]
  • 24.Harris PA, Taylor R, Thielke R, et al. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform . 2009;42(2):377–81. doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.The AMA Residency and Fellowship Database (FREIDA) https://freida.ama-assn.org/ Accessed July 8, 2021.
  • 26.Nachshon A, Mitchell JD, Mueller A, et al. Expert evaluation of a chicken tissue-based model for teaching ultrasound-guided central venous catheter insertion. J Educ Perioper Med . 2017;19(1):E503. [PMC free article] [PubMed] [Google Scholar]
  • 27.Naraghi L, Lin J, Odashima K, et al. Ultrasound-guided regional anesthesia simulation: use of meat glue in inexpensive and realistic nerve block models. BMC Med Educ . 2019;19(1):145. doi: 10.1186/s12909-019-1591-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Pedersen TH, Gysin J, Wegmann A, et al. A randomised, controlled trial evaluating a low cost, 3D-printed bronchoscopy simulator. Anaesthesia . 2017;72(8):1005–9. doi: 10.1111/anae.13951. [DOI] [PubMed] [Google Scholar]
  • 29.Ryason A, Petrusa ER, Kruger U, et al. Development of an endotracheal intubation formative assessment tool. J Educ Perioper Med . 2020;22(1):E635. [PMC free article] [PubMed] [Google Scholar]
  • 30.Ma H, Ruan X, Wong VT, et al. Identifying the gap between novices and experts in fiberoptic scope control. J Educ Perioper Med . 2021;23(1):E655. doi: 10.46374/volxxiii_issue1_haoboma. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Fatima H, Kuppalli S, Baribeau V, et al. Comprehensive Ultrasound Course for Special Operations Combat and Tactical Medics. J Spec Oper Med. 2021;21(4):54–61. doi: 10.55460/R270-3KAL. [DOI] [PubMed] [Google Scholar]
  • 32.Cunningham CT, Quan H, Hemmelgarn B, et al. Exploring physician specialist response rates to web-based surveys. BMC Med Res Methodol . 2015;15(1):32. doi: 10.1186/s12874-015-0016-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Story DA, Tait AR. Survey research. Anesthesiology . 2019;130(2):192–202. doi: 10.1097/ALN.0000000000002436. [DOI] [PubMed] [Google Scholar]

Articles from The Journal of Education in Perioperative Medicine : JEPM are provided here courtesy of Society for Education in Anesthesia

RESOURCES