Abstract
The debriefing is an essential component of simulation-based training for healthcare professionals, but learning this complex skill can be challenging for simulation faculty. There are multiple competing priorities for a debriefer’s attention that can contribute to a high mental workload, which may adversely affect debriefer performance and consequently learner outcomes. In this paper, we conceptualize the debriefer as a learner of debriefing skills and we discuss Cognitive Load Theory to categorize the many potential mental loads that can affect the faculty debriefer as learner. We then discuss mitigation strategies that can be considered by faculty development programmes to enhance professional development of debriefing staff.
Introduction
The adoption of simulation in healthcare has been fuelled by studies demonstrating enhanced participant knowledge, performance and, in some cases, a positive impact on patient outcomes [1, 2]. The debriefing that takes place following the clinical scenario has been shown to be a critical component in the learning process [3], but debriefing is a complex, dynamic skill that requires practice to achieve proficiency. Facilitators are challenged to perform multiple tasks in a short time frame such as observe participant behaviours, meaningfully structure the debriefing to encourage reflective discussion, and provide open, honest feedback while fostering a safe learning environment [4–9]. The complex cognitive processing places a significant demand on facilitators’ working memory [10] which is important because working memory has a finite capacity to process information. When the “bandwidth” available for processing novel information is exceeded, then performance can suffer and subsequently learning may be impacted. From the authors’ collective experience in faculty development for simulation debriefing both locally and internationally, we describe strategies that we have found helpful for teaching debriefers how to manage the high mental workload to improve the quality of their debriefings. To provide a theoretical basis for this discussion, we have framed these practices with the principles of Cognitive Load Theory (CLT).
CLT is an empirically derived theory that contends that learning can only occur if there is adequate room in working memory for processing of new information so that it can be stored in long-term memory. We argue that most facilitators are learners themselves [8, 11] and their ability to acquire the skills required for an effective debriefing will be impaired if the demands on working memory are too great. We believe that facilitators will be best positioned to develop and learn from their debriefing experiences if conditions for learning are appropriate (i.e. if there is adequate working memory bandwidth for that learning to occur). Although the importance of considering the cognitive load of learners in simulation has been described in the literature [12–15], the cognitive load of facilitators during debriefing has not been specifically discussed. In this paper, we apply the concepts of CLT to the complex task of debriefing and then propose some mitigation strategies that can be considered to reduce facilitator cognitive load and optimize opportunities for faculty development.
Cognitive Load Theory
Cognitive Load Theory is a theory about how we learn, derived from our current understanding about limits of human cognition [16]. The framework has been applied to medical education in a variety of contexts and can be very useful for unpacking the complexity of learning tasks for the purpose of optimizing instructional design [17–20]. CLT contends that in order to learn something novel, the learner must attend to, manipulate and understand the information in a conceptualized “area” of the brain known as “working memory”. It is now well established that working memory is limited in both capacity and duration and if those limits are exceeded then learning is not guaranteed. While recognizing the limits of working memory, the CLT framework emphasizes that learning only occurs through the incorporation of new knowledge into complex schemata that can be accessed as single “chunks” of knowledge, in which case they will no longer impose any real load on working memory.
CLT describes three potential types of working memory loads, namely intrinsic, extraneous and germane [16] (see Fig. 1). Intrinsic load is due to the difficulty of the task, which is an interaction between expertise of the learner and complexity of information elements. When a learner comes across a new problem to be solved, the learner will often engage in inefficient problem solving techniques such as “means-end analysis” in which the learner thinks of all of the potential solutions to the problem and compares their possible utility to the problem at hand. But if a problem has been previously worked out, then the solution can be selected from long-term memory without much cognitive effort. Intrinsic load is therefore highly dependent on prior experience and the complexity of the problem (defined as the number of elements that need to be compared at once). Extraneous load is described as the mental processes that are imposed by poor instructional design and are not relevant for learning [21–24]. Some have described this as anything in the learning environment (i.e. noise) that distracts from the actual learning point. For example, several empiric studies have shown that when instructional materials are presented in a “split-attention” format (e.g. medical diagrams with explanatory text outside of the figure instead of embedded within) then the high cognitive demand of integrating the multiple sources of information can impair learning [18, 25]. The split attention effect is just one of many “effects” described by CLT that address the way in which information is presented to learners. In the context of simulation, it is helpful to consider the overall learning objectives of the scenario in deciding whether or not the presentation format is truly “extraneous”. For example, presenting information to a learner from more than one source (traditionally considered to be split-attention) might be desirable if having a learner integrate information from multiple sources (e.g. the parent, the patient and the electronic medical record) is relevant to clinical practice. However, for a junior learner where the objective is to diagnose pneumonia from the clinical signs and symptoms, searching in different places for this information would add cognitive effort that may not be directly relevant to the learning objective. It is important to recognize that the concept of extraneous load was originally described in relation to very simple learning environments such as solving math problems or learning about electrical circuits from a diagram [24]. The large number of empirical investigations supporting the “split attention effect” [26] suggests that this is likely relevant to other learning environments; however, its application to highly dynamic learning environments such as simulation or facilitation requires more study.
The concept of germane load was introduced to CLT in the mid-1990s when experimentalists found that introducing intentional variability to practice sessions actually improved learning despite an increase in overall cognitive load [12, 27]. Schnotz further conceptualized germane load as “those cognitive activities in working memory that aim at intentional learning, beyond that of simple task performance”[28]. Examples included a conscious search for patterns in learning materials, meta-cognitive processing to monitor learning, restructuring of a problem representation to improve the ability to solve a problem and mindful construction of cognitive schemata. Expertise is attained through the incorporation of new knowledge into these complex schemata.
More recently, some researchers propose that germane load is really a subgroup of intrinsic load since changing the nature of a task to encourage deeper processing (such as encouraging students to compare and contrast, or self-questioning techniques) is essentially changing the intrinsic difficulty of the task (i.e. the intrinsic load) [29]. This is an area of ongoing controversy and certainly this simplified classification of CLT may aid those who are trying to improve measurement and reconcile the paradoxical claim that some loads can actually be “good” for learning [30]. For the purposes of this paper, we find the notion of germane processing, that part of the task that encourages schema construction, to be a helpful category as we consider strategies that might improve learning by faculty debriefers.
Cognitive loads of debriefing
Debriefing is a complex task and if the mental workload of the debriefing exceeds the cognitive capacity of the facilitator then performance can suffer. Becoming an expert facilitator requires time and practice; thus, it behooves us to ask: is there any cognitive room left for learning? When we consider the facilitator in simulation training as a “learner” themselves, excessive cognitive load during debriefing can impact their growth as emerging experts in debriefing. How can we support our debriefers in this complex environment so that they can still learn during debriefing activities? In the following section, we explore the potential loads that facilitators may have to manage during a debriefing.
Many tasks need to be carried out by the facilitator during a single simulation session, and these begin prior to the actual debriefing. During the pre-briefing, the facilitator needs to set the ground rules and objectives for simulation, take steps towards establishing a safe container for learning, establish the “fiction contract”, and identify potential threats to a successful debriefing [4]. Throughout the scenario, the student performance is being observed and compared to the expected or target behaviours for the learner group. Additional tasks are often assigned to facilitators, including managing technology (e.g. operating the mannequin, displaying audio-visuals) or playing an acting role within the scenario itself. Finally, the scenario concludes and the facilitator has a short time to formulate a plan for the debriefing. Below we will discuss some of the intrinsic, extraneous and germane loads that facilitators may encounter during the debriefing phase of simulation training (see Table 1). We have categorized these multiple working memory loads for the reader based on our experiences of “typical” scenarios; however, it is possible that a potential “load” that we have categorized under one category might also contribute load of another category. For example, co-debriefing is a strategy that is often used to reduce the cognitive load of a solitary debriefer by sharing the tasks of debriefing and especially providing back-up in the case of a particularly challenging clinical discussion or difficult learner dynamics. However, we have seen many situations in which a second debriefer can actually cause increased cognitive work to the primary debriefer if their respective roles have not been well defined or if they do not share a common mental model for the debriefing structure. Thus, this table is not meant to be exhaustive but provides common examples that we use in our faculty development programmes.
Table 1.
Drivers of load | Mitigation strategies | |
---|---|---|
Intrinsic load: Related to task difficulty and debriefer expertise |
Quantity of information: • Number of learners • Number of learning objectives • Various learner types/professions |
Match debriefer expertise to size of groups and number of professions Use of whiteboard or flip chart for noting topics of discussion Share decision making with learners Co-debriefing to share cognitive load |
Emotional state of learners | Prebriefing to establish a “safe container” for learning | |
Insufficient time for debriefing | Schedule adequate time Do not allow the scenario to run longer than scheduled |
|
Debriefer clinical expertise | Provide debriefers with detailed notes about clinical content Consider inviting a content expert (co-debriefing) |
|
Debriefer experience | Debriefing scripts for novice debriefers can help structure debriefing Debriefing assessment tools can function as “pre-learning” around expected facilitation skills |
|
Extraneous load: Imposed by poor instructional design and not relevant for learning |
Scenario realism needs to be addressed | Establish fiction contract prior to the simulation |
Debriefing going off topic | Debriefing framework can help organize debriefing for both the debriefer and for the learner Use previewing statements to introduce next topic of discussion |
|
Physical space: • Comfort • Ambient noise • Interruptions |
Arrive early to set up debriefing space Seating arrangement for optimal eye contact Limit interruptions, coming and going of learners or observers |
|
Performance anxiety | Co-debriefing for back-up Establish a safe container for facilitators |
|
Difficult learner dynamic | Co-debriefer can monitor members of the group for distress /participation Facilitators can learn schemata for common learner dynamics (e.g. how to engage the quiet learner) |
|
Video review | Co-debriefer can be tasked to run video Strategic and selective use of video |
|
Co-debriefing • Interruptions • Competing priorities |
Facilitator pre-brief to set expectations/roles/goals Co-debriefers utilize strategies such as open negotiation and permissible interruptions |
|
Evaluation of learners | Only add concomitant learner evaluation for very experienced facilitators | |
Germane load: Conscious, effortful attempts to learn from the debriefing experience |
Reflection in action: • Are all learners engaged? • Are all of the objectives covered? |
Do not be afraid to pause to make a mental or physical note of a successful strategy used or pitfall to avoid |
Reflection on action: • Review of learner feedback • Make notes for future debriefing structure, content or approach |
Peer to peer coaching in a safe learning environment Obtain debriefing feedback from learners Make use of published tools for assessing debriefing Provide protected time for reflection to occur |
Intrinsic load of debriefing
Once learners are finished with the scenario, the facilitator is typically expected to carry out the following tasks, all of which are components of the intrinsic load: (1) recall what happened in the scenario and review the case with the learners; (2) prioritize topics for discussion; (3) formulate questions that will encourage active participation of all learners; (4) listen to learner responses to gage and manage emotions (5) categorize responses to develop an efficient learning plan to address essential objectives and any emerging learner concerns; (6) ensure that teaching is effective and clear, and that performance gaps are closed; (7) manage learner emotions and cognitive load (8) ensure learner psychological safety, (9) manage own emotions and (10) manage own preconceived notions (i.e. frames) about the learners and their actions. The degree of intrinsic load imparted by these tasks will vary depending on several factors, including the expertise and knowledge of the facilitator, the degree of engagement of the learners, and the nature of the performance.
Extraneous loads of debriefing
Extraneous loads are those working memory resources required for task completion that do not enhance learning. Because running a simulation and the associated debriefing can be highly dynamic and unpredictable, it can be especially challenging to proactively manage all potential extraneous loads:
Facilitator role: While it is tempting for facilitators to perform “just a few” extra tasks in addition to debriefing (e.g. navigating video replay, keeping track of time), one needs to remember that these activities require mental effort that is extraneous to learning the skills of debriefing.
Co-facilitation: Co-debriefing with a colleague can be a useful strategy to reduce the intrinsic load on the primary facilitator by sharing tasks, but it can paradoxically add significant extraneous load [31]. If the second facilitator holds a different mental model for how the debriefing will run, then the primary facilitator ends up with the added mental task of redirecting the discussion, or potentially managing interruptions triggered by the secondary facilitators. Additionally, negotiating the way forward with their co-debriefer in a professional, respectful way without squandering valuable time can be challenging. These additional loads on working memory are particularly prominent when co-debriefers have not had a chance to discuss their facilitation strategy prior to the debriefing.
Learners: Another source of extraneous load can be from learners, who may focus on other aspects of the simulation apart from the intended debriefing goals. For example, complaints about the simulation scenario design or realism are not uncommon. Addressing these learner concerns is paramount to maintaining rapport and trust [32]; however, it can also consume valuable facilitator mental resources especially when a facilitator might feel somewhat defensive about the scenario that they just facilitated. Other learner behaviours that can add workload to the debriefing include conversations that are tangential to the intended purpose of the discussion, or overly emotional learners. Facilitators can then have their own emotional reactions (including performance anxiety) related to managing learner reactions that will add to the cognitive demands of debriefing.
Germane load during debriefing
During any debriefing, the facilitator will experience some things that go well and some that do not go as well. For example, a novice facilitator might notice that they have difficulty keeping the discussion on track. Recalling, in the moment, that the preceding reaction phase did not include all participants, the facilitator can consider that this might be contributing to the students’ ongoing interruptions of each other. The facilitator realizes that ensuring a complete reaction phase in which all learners have a chance to “vent” their reactions can reduce the likelihood of such tangential discussions in future. Thus, they learn from experience during the debriefing through in-action reflection [33, 34], and the mental effort required to do so is classified as germane load. Similarly, a facilitator might be having difficulty getting students to reveal their perspectives on a case so they try a new way of phrasing a question and notice that this yields fruitful discussion; then, they make a mental note to add it to their repertoire for future discussions. Such reflection-in-action is a powerful way for improving performance in the moment, but also for future performance and growth.
Alternatively, the facilitator who recognizes a debriefing challenge might make a mental note to seek feedback from a peer or an expert after the session [35]. The cognitive effort required to commit to finding solutions later is also a type of germane processing, but in this case, the majority of the mental effort can be delayed to a later time when there will likely be more cognitive room available for meaningful learning (i.e. reflection-on-action). To optimize these opportunities for improving their debriefing skills, facilitators should look to employ strategies to mitigate the intrinsic and extraneous loads during debriefing.
Mitigation of cognitive load during debriefing
Managing intrinsic load
One proactive strategy to reduce intrinsic load during debriefing is to match the debriefing difficulty to the skill level of the facilitator. Ideally, a programme can anticipate challenging debriefings and allocate them to more experienced facilitators [36]. The facilitator can also proactively minimize debriefing difficulty by ensuring that the number and content of objectives for the scenario are well aligned with learner experience and profession [22]. Task complexity of the debriefing also increases when the scope of the clinical content being covered is outside the expertise of the facilitator. Ideally, clinical content should be reviewed in detail prior to the session to ensure that the facilitator has easy access to clinical schemata in long term memory [21, 37]. Alternatively, the potential intrinsic load of difficult medical content can be reduced by inviting a subject matter expert to attend the debriefing, or by providing supplemental handouts to learners.
Sharing clinical learning and decision-making with the learners can potentially reduce intrinsic load. Often times, there are learners with clinical expertise that is equal to or greater than that of the debriefer. Encouraging learners to share their knowledge about the subject can reduce workload on the debriefer while encouraging a more learner-centered type of discussion. Learner-centered debriefing strategies, like the plus-delta method, allow learners to choose topics that they find most relevant for reflection [38, 39] and can thereby reduce the burden on the facilitator to decide the course of the conversation [40]. Of course, allowing learners too much leeway may lead to off-topic discussions which can further challenge the facilitator; so the implementation of strategies to mitigate load also require practice.
One strategy that is often used to support new faculty in their debriefing task is the provision of a framework to guide the debriefing [6, 7, 9, 41, 42]. Choosing a single strategy will reduce the mental workload of having to decide on the “flow” of conversation during the debriefing. Such frameworks have been adapted into cognitive aids for use by novice debriefers during debriefing [43, 44]. After practice with a particular framework, the approach can be automated and stored in long-term memory (as a single schemata) for the debriefing conversation [43]. Training of faculty on the use of such aids to the point of some automation is essential so that the burden of the aid does not actually add to mental workload [45, 46].
Managing extraneous load
Strategies to anticipate and reduce extraneous cognitive load should also be proactively considered. Dealing with defensive or argumentative learners can pose a significant and often preventable workload on the facilitator. Prior to the debrief, the facilitator should take steps towards creating a “safe container” for learning, where expectations and logistics are communicated, the fiction contract is explained and psychological safety is established [4]. If learners are not feeling threatened by the discussion about their good or poor performance, they will be more engaged in learning from experience rather than defending their practice. Distractions such as phone calls and participants/observers entering or exiting during the debriefing are other more obvious, preventable extraneous loads that should be proactively addressed.
Facilitator emotions can impose extraneous workload that may affect cognitive processing and hinder effective learning from the debriefing [47, 48]. Feeling overwhelmed by the many debriefing tasks or having a weak understanding of the content of the case are examples of situations that can create anxiety. By sharing the debriefing with a co-facilitator, the risk of being overwhelmed is potentially diminished by having “back-up” support. Co-debriefing offers the benefits of pooled expertise, shared monitoring of many learners in the room, and a “lifeline” in the event of difficulties [31]. However, co-debriefing may also itself pose an extraneous load as discussed above. Strategies for effective co-debriefing that may reduce extraneous workload are conducting a facilitator pre-briefing, using non-verbal communication, previewing, and huddling with your co-debriefer to review facilitation performance after the debriefing is over [31].
Optimizing germane load
The CLT framework emphasizes that learning really only occurs when essential schemata are constructed or elaborated in long-term memory; there must be adequate cognitive room for germane processing or learning will not occur. If we successfully mitigate debriefer mental workload as discussed above, we can then consider strategies to encourage germane processing about debriefing. Debriefers must be motivated to engage in germane processing [49] and accordingly, faculty development requires a supportive culture in which it is clear that self-reflection, peer coaching and expert feedback are valued. The process of self-reflection can be promoted by encouraging debriefers to review debriefing assessment tools (e.g. Debriefing Assessment for Simulation in Healthcare [DASH] or Objective Structured Assessment of Debriefing [OSAD]) and/or debriefing checklists prior to or after the debriefing [50–52]. Peer coaching and/or expert debriefing of the debriefer can also be framed by these assessment tools (e.g. DASH Rater Version)[53] to highlight desirable debriefing behaviours and to support the development of schemata to improve future performance.
Limitations and future directions
While there is substantial evidence supporting the application of CLT to many disciplines, there is little data regarding best practices to manage cognitive load of faculty debriefers. In our experiences teaching debriefing courses, we have encountered many educators who feel that debriefing is overwhelming and difficult to learn in spite of our best efforts at faculty development. We believe that specific discussion of the various potential loads on the facilitator and associated mitigation strategies helps our faculty to manage the debriefing to optimize educational outcomes for learners and hopefully also for themselves. The suggestions that are made here are based on our collective experience, and we acknowledge the lack of empirical evidence to support these claims. While this is a limitation of this paper, the proposed strategies are intuitive, easy to implement, and highly unlikely to cause any harm. Future studies framed by a CLT theory would be helpful to determine which strategies are actually most important for improving faculty learning about debriefing and moreover educational outcomes for the learners of those faculty (Table 2).
Table 2.
How do intrinsic, extraneous and germane load of debriefers vary during the phases of debriefing? How does this change with debriefing practice? | |
What activities during the debriefing increase the cognitive load of debriefers? | |
What strategies are most effective at reducing the intrinsic and extraneous loads of debriefers? | |
Does the use of debriefing assessment tools (before or after debriefing) increase extraneous load or optimize germane load? |
We encourage simulation programmes to discuss CLT with their facilitators because this is increasingly recognized to have important implications for scenario design and learner outcomes. However, facilitators should also be encouraged to consider their own mental workload during debriefing, and how this might impact their ability to climb the learning curve of debriefing skills. They should strategize to mitigate their own cognitive load to optimize conditions for learning this challenging skill, to the ultimate benefit of their own simulation learners.
Acknowledgments
Funding
Not applicable.
Availability of data and materials
Not applicable.
Abbreviation
- CLT
Cognitive load theory
Authors’ contributions
KF made a substantial contribution to the conception and design and was involved in drafting the manuscript and critical revisions thereof. MM made a substantial contribution to the conception and design and was involved in drafting the manuscript and critical revisions thereof. JH was involved in drafting the manuscript and critical revisions of intellectual content. KB was involved in drafting the manuscript and critical revisions of intellectual content. VG was involved in drafting the manuscript and critical revisions of intellectual content. AC made a substantial contribution to the conception and design and was involved in drafting the manuscript and critical revisions thereof. All authors read and approved the final manuscript
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Kristin L. Fraser, Phone: 403-943-8864, Email: kfraser@ucalgary.ca
Michael J. Meguerdichian, Email: mmegue01@gmail.com
Jolene T. Haws, Email: jthaws@ucalgary.ca
Vincent J. Grant, Email: vincent.grant@albertahealthservices.ca
Komal Bajaj, Email: komal.bajaj@gmail.com.
Adam Cheng, Email: chenger@me.com.
References
- 1.Zendejas B, Brydges R, Wang AT, Cook DA. Patient outcomes in simulation-based medical education: a systematic review. Journal of general internal medicine. 2013;28(8):1078–1089. doi: 10.1007/s11606-012-2264-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA. 2011;306(9):978–988. doi: 10.1001/jama.2011.1234. [DOI] [PubMed] [Google Scholar]
- 3.Savoldelli GL, Naik VN, Park J, Joo HS, Chow R, Hamstra SJ. Value of debriefing during simulated crisis management: oral versusvideo-assisted oral feedback. The Journal of the American Society of Anesthesiologists. 2006;105(2):279–285. doi: 10.1097/00000542-200608000-00010. [DOI] [PubMed] [Google Scholar]
- 4.Rudolph JW, Raemer DB, Simon R. Establishing a safe container for learning in simulation: the role of the presimulation briefing. Simulation in Healthcare. 2014;9(6):339–349. doi: 10.1097/SIH.0000000000000047. [DOI] [PubMed] [Google Scholar]
- 5.Rudolph JW, Simon R, Dufresne RL, Raemer DB. There’s no such thing as “nonjudgmental” debriefing: a theory and method for debriefing with good judgment. Simul Healthc. 2006;1(1):49–55. doi: 10.1097/01266021-200600110-00006. [DOI] [PubMed] [Google Scholar]
- 6.Rudolph JW, Simon R, Rivard P, Dufresne RL, Raemer DB. Debriefing with good judgment: combining rigorous feedback with genuine inquiry. Anesthesiology Clinics. 2007;25(2):361–376. doi: 10.1016/j.anclin.2007.03.007. [DOI] [PubMed] [Google Scholar]
- 7.Sawyer T, Eppich W, Brett-Fleegler M, Grant V, Cheng A. More than one way to debrief: a critical review of healthcare simulation debriefing methods. Simulation in Healthcare. 2016;11(3):209–217. doi: 10.1097/SIH.0000000000000148. [DOI] [PubMed] [Google Scholar]
- 8.Cheng A, Grant V, Dieckmann P, Arora S, Robinson T, Eppich W. Faculty Development for simulation programs five issues for the future of debriefing training. Simulation in Healthcare-Journal of the Society for Simulation in Healthcare. 2015;10(4):217–222. doi: 10.1097/SIH.0000000000000090. [DOI] [PubMed] [Google Scholar]
- 9.Eppich W, Cheng A. Promoting excellence and reflective learning in simulation (PEARLS): development and rationale for a blended approach to health care simulation debriefing. Simulation in Healthcare. 2015;10(2):106–115. doi: 10.1097/SIH.0000000000000072. [DOI] [PubMed] [Google Scholar]
- 10.Newlin-Canzone ET, Scerbo MW, Gliva-McConvey G, Wallace AM. The cognitive demands of standardized patients: understanding limitations in attention and working memory with the decoding of nonverbal behavior during improvisations. Simulation in Healthcare. 2013;8(4):207–214. doi: 10.1097/SIH.0b013e31828b419e. [DOI] [PubMed] [Google Scholar]
- 11.Peterson DT, Watts PI, Epps CA, White ML. Simulation faculty development: a tiered approach. Simul Healthc. 2017;12(4):254–259. doi: 10.1097/SIH.0000000000000225. [DOI] [PubMed] [Google Scholar]
- 12.Fraser KL, Ayres P, Sweller J. Cognitive load theory for the design of medical simulations. Simulation in Healthcare. 2015;10(5):295–307. doi: 10.1097/SIH.0000000000000097. [DOI] [PubMed] [Google Scholar]
- 13.Naismith LM, Cheung JJ, Ringsted C, Cavalcanti RB. Limitations of subjective cognitive load measures in simulation-based procedural training. Medical education. 2015;49(8):805–814. doi: 10.1111/medu.12732. [DOI] [PubMed] [Google Scholar]
- 14.Haji FA, Cheung JJ, Woods N, Regehr G, Ribaupierre S, Dubrowski A. Thrive or overload? The effect of task complexity on novices’ simulation-based learning. Medical education. 2016;50(9):955–968. doi: 10.1111/medu.13086. [DOI] [PubMed] [Google Scholar]
- 15.Haji FA, Rojas D, Childs R, Ribaupierre S, Dubrowski A. Measuring cognitive load: performance, mental effort and simulation task complexity. Medical education. 2015;49(8):815–827. doi: 10.1111/medu.12773. [DOI] [PubMed] [Google Scholar]
- 16.Sweller J, Ayres P, Kalyuga S. Cognitive load theory. New York: Springer; 2011. [Google Scholar]
- 17.Meguerdichian M, Walker K, Bajaj K. Working memory is limited: improving knowledge transfer by optimizing simulation through cognitive load theory. BMJ Simulation and Technology Enhanced Learning. 2016;2(4):131–138. doi: 10.1136/bmjstel-2015-000098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Van Merrienboer JJG, Sweller J. Cognitive load theory in health professional education: design principles and strategies. Medical Education. 2010;44(44):85–93. doi: 10.1111/j.1365-2923.2009.03498.x. [DOI] [PubMed] [Google Scholar]
- 19.Young JQ, Wachter RM, Ten Cate O, O’sullivan PS, Irby DM. Advancing the next generation of handover research and practice with cognitive load theory. BMJ Qual Saf. 2016;25(2):66–70. doi: 10.1136/bmjqs-2015-004181. [DOI] [PubMed] [Google Scholar]
- 20.Qiao YQ, Shen J, Liang X, Ding S, Chen FY, Shao L, et al. Using cognitive theory to facilitate medical education. BMC medical education. 2014;14(1):79. doi: 10.1186/1472-6920-14-79. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Sweller J, Van Merrienboer JJG, Paas FGWC. Cognitive architecture and instructional design. Educational psychology review. 1998;10(3):251–296. [Google Scholar]
- 22.Paas F, Renkl A, Sweller J. Cognitive load theory: instructional implications of the interaction between information structures and cognitive architecture. Instructional science. 2004;32(1–2):1–8. [Google Scholar]
- 23.Reedy GB. Using cognitive load theory to inform simulation design and practice. Clinical Simulation in Nursing. 2015;11(8):355–360. [Google Scholar]
- 24.Sweller J. Cognitive load during problem solving: effects on learning. Cognitive science. 1988;12(2):257–285. [Google Scholar]
- 25.Herrlich M, Tavakol P, Black D, Wenig D, Rieder C, Malaka R, et al. Instrument-mounted displays for reducing cognitive load during surgical navigation. International journal of computer assisted radiology and surgery. 2017;12(9):1599–1605. doi: 10.1007/s11548-017-1540-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Chandler P, Sweller J. The split-attention effect as a factor in the design of instruction. British Journal of Educational Psychology. 1992;62(2):233–246. [Google Scholar]
- 27.Paas FG, Van Merriënboer JJ. Variability of worked examples and transfer of geometrical problem-solving skills: a cognitive-load approach. Journal of educational psychology. 1994;86(1):122. [Google Scholar]
- 28.Schnotz W, Kürschner C. A reconsideration of cognitive load theory. Educational psychology review. 2007;19(4):469–508. [Google Scholar]
- 29.Kalyuga S. Cognitive load theory: how many types of load does it really need? Educational Psychology Review. 2011;23(1):1–19. [Google Scholar]
- 30.Klepsch M, Schmitz F, Seufert T. Development and Validation of Two Instruments Measuring Intrinsic, Extraneous, and Germane Cognitive Load. Frontiers in Psychology. 2017;8(1997). [DOI] [PMC free article] [PubMed]
- 31.Cheng A, Palaganas J, Eppich W, Rudolph J, Robinson T, Grant V. Co-debriefing for simulation-based education a primer for facilitators. Simulation in Healthcare-Journal of the Society for Simulation in Healthcare. 2015;10(2):69–75. doi: 10.1097/SIH.0000000000000077. [DOI] [PubMed] [Google Scholar]
- 32.Loo ME, Krishnasamy C, Lim WS. Considering face, rights, and goals: a critical review of rapport management in facilitator-guided simulation debriefing approaches. Simulation in Healthcare. 2018;13(1):52–60. doi: 10.1097/SIH.0000000000000258. [DOI] [PubMed] [Google Scholar]
- 33.Schön D. The reflective practitioner. 1983. [Google Scholar]
- 34.Cheng A, LaDonna K, Cristancho S, Ng S. Navigating difficult conversations: the role of self-monitoring and reflection-in-action. Medical education. 2017;51(12):1220–1231. doi: 10.1111/medu.13448. [DOI] [PubMed] [Google Scholar]
- 35.Cheng A, Grant V, Huffman J, Burgess G, Szyld D, Robinson T, et al. Coaching the Debriefer: peer coaching to improve debriefing quality in simulation programs. Simul Healthc. 2017;12(5):319–25. [DOI] [PubMed]
- 36.Eppich W, Cheng A. Competency-based simulation education: should competency standards apply for simulation educators? BMJ Simulation and Technology Enhanced Learning. 2015;1(1):3–4. doi: 10.1136/bmjstel-2014-000013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Cooper G, Sweller J. Effects of schema acquisition and rule automation on mathematical problem-solving transfer. Journal of educational psychology. 1987;79(4):347. [Google Scholar]
- 38.Fanning RM, Gaba DM. The role of debriefing in simulation-based learning. Sim Healthc. 2007;2(2):115–125. doi: 10.1097/SIH.0b013e3180315539. [DOI] [PubMed] [Google Scholar]
- 39.Mullan PC, Wuestner E, Kerr TD, Christopher DP, Patel B. Implementation of an in situ qualitative debriefing tool for resuscitations. Resuscitation. 2013;84(7):946–951. doi: 10.1016/j.resuscitation.2012.12.005. [DOI] [PubMed] [Google Scholar]
- 40.Cheng A, Morse KJ, Rudolph J, Arab AA, Runnacles J, Eppich W. Learner-centered debriefing for health care simulation education: lessons for faculty development. Simul Healthc. 2016;11(1):32–40. doi: 10.1097/SIH.0000000000000136. [DOI] [PubMed] [Google Scholar]
- 41.Jaye P, Thomas L, Reedy G. ‘The Diamond’: a structure for simulation debrief. The clinical teacher. 2015;12(3):171–175. doi: 10.1111/tct.12300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Kolbe M, Weiss M, Grote G, Knauth A, Dambach M, Spahn DR, et al. TeamGAINS: a tool for structured debriefings for simulation-based team trainings. BMJ Qual Saf. 2013;22(7):541–553. [DOI] [PubMed]
- 43.Bajaj K, Meguerdichian M, Thoma B, Huang S, Eppich W, Cheng A. The PEARLS Healthcare Debriefing Tool. Academic Medicine. 2018;93(2):336. doi: 10.1097/ACM.0000000000002035. [DOI] [PubMed] [Google Scholar]
- 44.Cheng A, Hunt EA, Donoghue A, Nelson-McMillan K, Nishisaki A, Leflore J, et al. Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter randomized trial. JAMA Pediatr. 2013;167(6):528–536. doi: 10.1001/jamapediatrics.2013.1389. [DOI] [PubMed] [Google Scholar]
- 45.Clebone A, Burian BK, Watkins SC, Gálvez JA, Lockman JL, Heitmiller ES. The development and implementation of cognitive aids for critical events in pediatric anesthesia: the Society for Pediatric Anesthesia Critical Events Checklists. Anesthesia & Analgesia. 2017;124(3):900–907. doi: 10.1213/ANE.0000000000001746. [DOI] [PubMed] [Google Scholar]
- 46.Goldhaber-Fiebert SN, Howard SK. Implementing emergency manuals: can cognitive aids help translate best practices for patient care during acute events? Anesthesia & Analgesia. 2013;117(5):1149–1161. doi: 10.1213/ANE.0b013e318298867a. [DOI] [PubMed] [Google Scholar]
- 47.Sorg BA, Whitney P. The effect of trait anxiety and situational stress on working memory capacity. Journal of Research in Personality. 1992;26(3):235–241. [Google Scholar]
- 48.Edwards MS, Moore P, Champion JC, Edwards EJ. Effects of trait anxiety and situational stress on attentional shifting are buffered by working memory capacity. Anxiety, Stress, & Coping. 2015;28(1):1–16. doi: 10.1080/10615806.2014.911846. [DOI] [PubMed] [Google Scholar]
- 49.Paas F, Tuovinen JE, Van Merrienboer JJ, Darabi AA. A motivational perspective on the relation between mental effort and performance: optimizing learner involvement in instruction. Educational Technology Research and Development. 2005;53(3):25–34. [Google Scholar]
- 50.Brett-Fleegler M, Rudolph J, Eppich W, Monuteaux M, Fleegler E, Cheng A, et al. Debriefing assessment for simulation in healthcare: development and psychometric properties. Sim Healthc. 2012;7(5):288–294. doi: 10.1097/SIH.0b013e3182620228. [DOI] [PubMed] [Google Scholar]
- 51.Runnacles J, Thomas L, Sevdalis N, Kneebone R, Arora S. Development of a tool to improve performance debriefing and learning: the paediatric Objective Structured Assessment of Debriefing (OSAD) tool. Postgraduate medical journal. 2014;90(1069):613–621. doi: 10.1136/postgradmedj-2012-131676. [DOI] [PubMed] [Google Scholar]
- 52.Arora S, Ahmed M, Paige J, Nestel D, Runnacles J, Hull L, et al. Objective structured assessment of debriefing: bringing science to the art of debriefing in surgery. Annals of surgery. 2012;256(6):982–988. doi: 10.1097/SLA.0b013e3182610c91. [DOI] [PubMed] [Google Scholar]
- 53.Jeffries PR, Dreifuerst KT, Kardong-Edgren S, Hayden J. Faculty development when initiating simulation programs: lessons learned from the national simulation study. Journal of Nursing Regulation. 2015;5(4):17–23. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.