Abstract
Study aim
To summarize the current state of knowledge of deliberate practice and mastery learning (DP and/or ML) as teaching methods for resuscitation education.
Methods
A scoping review of PubMed, Scopus, and Embase was conducted through March 1, 2021. Studies examining the effect of the incorporation of either deliberate practice and/or mastery learning during resuscitation education were eligible for inclusion. Included studies were dichotomized into studies comparing deliberate practice and/or mastery learning to other training methods (randomized controlled trials) and studies examining before and after impact of deliberate practice and/or mastery learning alone (observational studies). Studies and findings were tabulated and summarized using the scoping review methodology published by Arksey and O’Malley.
Results
63 published studies were screened; sixteen studies met all inclusion criteria (4 randomized controlled trials and 12 observational studies). One randomized controlled trial and eleven observational studies demonstrated improvement in skill and/or knowledge following educational interventions using deliberate practice and/or mastery learning. Significant variability between studies with regard to research designs, learner groups, comparators, and outcomes of interest made quantitative summarization of findings difficult.
Conclusions
The incorporation of deliberate practice and/or mastery learning in resuscitation education may be associated with improved educational outcomes and less skill decay than other educational methods. Current literature on DP and ML suffers from a lack of consistency in research methodology, subjects, and outcomes. Future research should employ uniform definitions for deliberate practice and mastery learning, follow research design that isolates its effect, and examine generalizable and translatable outcomes.
Abbreviations: DP, deliberate practice; ML, mastery learning; ALS, advanced life support; BLS, basic life support; RCT, randomized controlled trial; ACLS, advanced cardiac life support; PALS, pediatric advanced life support; NRP, neonatal resuscitation program; CPR, cardiopulmonary resuscitation; AED, automated external defibrillator
Keywords: Life support education; Cardiopulmonary resuscitation; Deliberate practice, mastery learning
Introduction
Resuscitation education aims to provide the knowledge and skills required to effectively manage critically ill patients suffering from life-threatening conditions. Recent systematic reviews of published studies have demonstrated an association between healthcare provider participation in life support courses and improved survival for adults with cardiac arrest.1, 2 At the same time, current instructional design results in inconsistent educational outcomes, with many providers experiencing poor knowledge and skill retention in as little as 3 months following course completion.3, 4 Identifying educational strategies that will maximize sustained learning gains in resuscitation education is required to enhance provider performance and patient outcomes.
Deliberate practice and mastery learning are instructional design features supported by a growing body of evidence.3, 5, 6 Deliberate practice is a training approach where learners are given: (1) a discrete goal to achieve, (2) immediate feedback on their performance, and (3) ample time for repetition to improve performance.7 Mastery learning is defined as the use of deliberate practice training coupled with learner assessment that uses a set of criteria to define a specific passing standard that implies mastery of the tasks being learned.8 Educational offerings designed according to the principles of deliberate practice and/or mastery learning offer substantial learning gains across a broad range of clinical content areas.5, 6 A summary of evidence supporting the use of deliberate practice and mastery learning in resuscitation training is lacking. Given the high-stakes nature of basic life support (BLS) and advanced life support (ALS), more work is needed to describe the potential impact of incorporating deliberate practice and/or mastery learning into resuscitation courses. The magnitude of expected benefit can then be weighed against of the time and resource considerations likely to follow course design with increasingly intentional incorporation of these features.
In this study, we aimed to conduct a scoping review of literature describing the impact of deliberate practice and/or mastery learning on educational outcomes in life support training, including skill performance at course conclusion, skill retention, performance during actual resuscitations, and patient outcomes.
Methods
This review was planned, conducted and reported using the scoping review strategy as described by Arksey and O’Malley.9 The review was conducted as part of the American Heart Association (AHA) evidence synthesis and review process for the Education chapter of the 2020 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care.3
Research question
We sought to identify evidence addressing the following research question: amongst students or healthcare providers taking basic or advanced life support training, does the use of deliberate practice and/or mastery learning improve skill performance at course conclusion, improve skill retention beyond course conclusion, performance in actual resuscitations, or patient outcomes?
Study eligibility
Studies were eligible for inclusion if (1) the study involved the use of either deliberate practice (DL), mastery learning (ML), or both, as determined by the definitions shown above, and (2) examined training in neonatal, pediatric, or adult life support. In an effort to be comprehensive with the review, studies could involve a comparison of DL and/or MP to another teaching method or examine pre- and post- performance from a DL and/or MP-based educational intervention. Outcomes of interest included skill or knowledge, as measured by any reproducible method (e.g. task performance, time to task performance, scores on checklists or other assessment instruments, etc.). Because the original AHA review was done as an update of previous recommendations, articles published prior to 2012 were excluded.
Identification and selection of relevant studies
We searched PubMed, Scopus, and EMBASE with a last search date of December 1, 2019. In an effort to maximize evidence quality, and in anticipation of a high degree of heterogeneity among published studies, a search of ‘grey’ literature was not included. The overall search strategy was adapted and expanded from the search strategy used to summarize evidence on deliberate practice and mastery learning for the recently published American Heart Association Scientific Statement on Resuscitation Education.4 The complete search strategy is included in the Appendix. Hand searches of the bibliographies of eligible studies were conducted for additional potential references.
The titles and abstracts of identified studies were screened by two reviewers (KN, AD). Complete articles identified by both authors were reviewed for inclusion based on the above criteria. In the case of disagreement about eligibility of studies, discussions were conducted to achieve consensus. Following the initial review, an additional post hoc exclusion criterion was added: specifically, studies in which DP and/or ML was reported as a part of a grouped or bundled intervention, but for which the isolated effect of DP and/or ML could not be determined, were excluded.
Data extraction (Table 1)
Table 1.
Articles included in final review.
| Author(s) and publication year | Study location | Intervention type and comparator | Intervention duration | Study populations | Study aims | Methodology | Outcome measures | Important results |
|---|---|---|---|---|---|---|---|---|
| Boet et al., 20171 | Canada | ML-based BLS course vs. traditional time-based course | 4 month test-retest interval | Non-healthcare undergraduate university students | Compare layperson skill acquisition and retention between instructional strategies | Quasi-RCT (randomization by course date) | Total score achieved on the AHA Heartsaver CPR AED Skills Sheet checklist | No difference in 4-month BLS skill scores regardless of instructional strategy |
| Braun et al., 20152 | United States | Pre- and post-test, single simulation-based mastery learning (SBML) session (1–2 h) | 2, 4, or 6 month retest interval | Residents from four pediatric residency programs | Assess retention of SBML resuscitation performance | Multicenter, prospective randomized design | Specially designed scoring matrices used on standardized pediatric simulation scenarios | Linear decline in percent of residents maintaining mastery level performance at 2, 4, and 6 months |
| Cordero et al., 20133 | United States | Pre- and post-test following single 2 -h DP session | 1 month test-retest interval | Pediatric residents | Assess effects of DP on procedural skills and team performance during simulated neonatal resuscitation | Observational | Observer-rated skills proficiency, skill timeliness, and team behaviors using standardized checklist | A short (1−2 h) DP session can result in short-term improvements in neonatal resuscitation skills and team behaviors. |
| Devine et al., 20154 | Canada | Direct self-regulated learning (DSLR) vs. instructor-regulated learning (IRL) using a SBML model |
5 month retention test interval | PGY1 internal medical residents | Compare educational and cost effectiveness |
Randomized controlled equivalence trial | Observer-rated resuscitation skills performance using standardized checklist | Although DSLR was more cost effective by about $80 per resident, skill retention at 5 months was not different between DSLR and IRL |
| Diederich et al., 20195 | United States | “Drill”-style vs. “Scrimmage”-style training | 75-min test-retest interval | PGY-1 residents from 19 specialties | Compare effects of DP of component skills to repetitious practice of entire cardiac arrest scenarios on task work and teamwork during resuscitation events | RCT | Observer-rated resuscitation task work and teamwork performance Accelerometer used for CPR quality measures |
Both drill-style and scrimmage-style training demonstrated similar improvements in component resuscitation skills. |
| Hunt et al., 20176 | United States | Traditional BLS training vs. contextualized BLS training modified with Rapid Cycle Deliberate Practice (RCDP) | NA | First-year medical students | Compare BLS performance in simulated adult in-hospital cardiac arrests | Educational quality assurance evaluation with randomized block assignment | Chest compression fraction (CCF) | Traditional BLS training contextualized to the in-hospital environment and modified with RCDP significantly improved CCF and time to initiate compressions. |
| Hunt et al., 20147 | United States | Traditional pediatric resuscitation training vs. Rapid Cycle Deliberate Practice focusing on the first-five minutes (RCDP-FFM) | Cohorts separated by 2 years | PGY-1 and PGY-3 pediatric residents | Compare BLS and ALS resuscitation quality markers in simulated pediatric in-hospital cardiac arrest | Historical control | Time interval between the onset of pediatric ventricular fibrillation and first shock delivery | Pediatric resuscitation training incorporating RCDP significantly reduced the time interval between the onset of VF and first shock delivery |
| Jeffers et al., 20168 | United States | Pre- and post-test following single 1-h DP session | 4-month post intervention | PGY-1 pediatric residents | Assess effects of DP and simulation-based training on defibrillation skills | Prospective observational | Observer-rated resuscitation skills performance using standardized checklist | Simulation-based training incorporating DP significantly increased the proportion of students who achieved defibrillation skills competency |
| Keilman et al 20219 | United States | Pre- and post- single RCDP session | NA | Pediatric emergency medicine attendings | Assess impact of training session on clinical process metrics during first 5 min of medical resuscitations | Observational | Time to task completion (patient transfer, primary assessment, summary statement) | All three tasks completed in a significantly increased proportion of resuscitations post intervention |
| Knipe et al, 202010 | United States | DP training during simulated cardiac arrests administered during 6 of 13 weeks of a semester long curriculum | 10 weeks | Senior nursing students | Assess effects of repeated weekly to biweekly training sessions over the course of a semester | Observational | Scoring instrument evaluating BLS tasks | Repeated sessions over the course of the semester resulted in significant score improvement in week 13 as compared to week 4 |
| Lemke et al., 201911 | United States | Traditional simulation training with advocacy-inquiry debriefing vs. Rapid Cycle Deliberate Practice (RCDP) training | 3-month pre- post-test interval | PEM fellows, nurses, and respiratory therapists | Assess the effects of RCDP training on team performance | RCT | Team performance changes as measured by the Simulation Team Assessment Tool (STAT) | RCDP training did not significantly improve resuscitation team performance compared to traditional simulation training. |
| Madou et al., 201912 | Belgium | Mastery learning (ML) vs. Self-Directed Learning (SDL) and face-to-face vs on-line (4 conditions) | NA | Baccalaureate students in teacher education program | Evaluate the effects of ML and SDL during two phases of BLS training (face-to-face and on-line) | RCT | Composite BLS score composed of • objective CPR variables measured by an instrumented manikin • subjective CPR performance assessed by two trained observers |
There were no significant between group differences in objective CPR variables, subjective CPR performance, or composite BLS scores. |
| Magee et al., 201813 | United States | Rapid cycle deliberate practice (RCDP) vs. traditional simulation debriefing (SD) (45-min teaching sessions) | 4-month post intervention | Pediatric interns | Evaluate the effects of RCDP and SD on NR performance | RCT | Performance measured with Megacode Assessment Form (MCAF) | Compared to SD, training using RCDP resulted in significant immediate improvement in MCAF scores. However, this improvement was not sustained at the 4-month retest scenario. |
| Reed et al., 201614 | United States | Pre- and post-test following single SBML training session | Skill retention test 1–9 months post intervention | Fourth-year medical students | Evaluate the effects of SBML training on six core EM procedural skills | Prospective observational | Institutionally-developed mastery checklist | Compared to pre-testing, SBML resulted in significant improvement in the percentage of students who achieved MPS at post-test. Ninety-eight percent of the student met MPS on their first attempt during retention testing. |
| Surapa Raju et al, 202015 | United States | 1. Pre- and post-test following single RCDP session 2. At 9 months, second RCDP session added for one group (compared with no additional RCDP) |
6, 9, and 12 months | Pediatric interns | Evaluate the effect of training on PALS performance | Observational | Published instrument for PALS scoring | Scores were signficiantly improved post-initial RCDP session and at 6, 9, and 12 months post session; there was no difference in 12 month performance between groups with or without additional RCDP session at 9 months |
| Yan, 202016 | United States | RCDP curriculum for primary and secondary survey 1. Before and after imnplementation (C = historical controls) 2. residents without RCDP training (C=’concurrent’ controls |
NA | Surgical interns | Evaluating the effect of a RCDP curriculum on primary and secondary survey performance | Observational with historical controls | Published instrument for completion and timeliness of primary and secondary survey | Primary survey: significant improvement between historical controls and study group, no difference between study group and concurrent controls Secondary survey: significant improvement between study group and both control groups |
Abbreviations: BLS – basic life support; CCF – chest compression fraction; DP – deliberate practice; DSLR – direct self-regulated learning; EM – emergency medicine; IRL – instructor-regulated learning; MCAF – Megacode Assessment Form; ML – mastery learning; MPS – minimum passing standards; NA – not applicable; NR – neonatal resuscitation; PEM – pediatric emergency medicine; PGY – post-graduate year; RCDP – rapid cycle deliberate practice; RCDP-FFM – rapid cycle deliberate practice focusing on the first-five minutes; RCT – randomized controlled trial; SBML – simulation-based mastery learning; SD – simulation debriefing; SDL – self-directed Learning; STAT – simulation team assessment tool.
Data from included studies were tabulated using a ‘descriptive-analytical’ method9 to ensure that studies were described in such a way that variations in design, subjects, interventions and outcomes of interest, and limitations could be uniformly interpreted across a varied range of study types. Essential data fields included in the summary of studies included: author and publication year, intervention type (and comparator if applicable), duration of intervention, subject populations (i.e. learner groups), study aims, study method, outcomes of interest, and basic results.
Data analysis
Studies were dichotomized thematically with the following methodology: studies where subjects were randomly assigned to DP and/or ML as the solitary intervention of interest compared with another educational technique were classified as ‘randomized controlled trials (RCTs)’. Studies using other methodologies (e.g. nonrandomized design, before-and-after assessment without a comparator group, etc.) were classified as ‘observational studies’. In keeping with scoping review methodology, given the considerable variability in the study elements described above, study findings were summarized descriptively without quantitative synthesis.
Results
The Fig. 1 demonstrates the PRISMA flow diagram for the review. The initial scoping review identified 63 potentially relevant articles. Twenty articles were initially excluded due to exclusion by date of publication or lack of relevance. 43 articles underwent abstract review; 27 studies were subsequently eliminated. The remaining 16 articles underwent full review.
Fig. 1.
PRISMA Diagram.
Study characteristics
The study designs and participant characteristics of included studies are summarized in the Table. Four of the 16 articles were RCTs10, 11, 12, 13 and the remaining twelve articles were observational in nature.14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 One study originated in Belgium and the remaining 14 studies originated in North America, two in Canada and 12 in the United States. The curricula used in the studies was diverse; four studies involved a basic life support curriculum,12, 14, 18, 22 four involved pediatric advanced life support curriculum,11, 19, 20, 23 two involved a neonatal resuscitation curriculum,13, 16 one involved a BLS Curriculum with teamwork measures,10 one involved a combination of PALS and NRP curriculum,15 one adult ACLS curriculum,17 one involved adult advanced resuscitation skills,21 one involved primary and secondary survey performance in trauma patients,24 and one involved leader verbalization and team prompts during the first five minutes of medical resuscitations.25 In total, there were 1018 participants composed of bystanders (undergraduate university students with no healthcare training) and in-hospital health care providers (respiratory therapists, nurses, medical students, interns and residents from 19 specialties, pediatric emergency medicine fellows, and pediatric emergency medicine faculty). For repeated measures studies, test-retest intervals ranged from 75 min to 12 months.10, 26 One study measured skill performance in actual resuscitations24; no published study used patient outcomes and the outcome of interest.
Specific study characteristics and results are summarized in the Table. Study methodology involved both DP and ML in eight studies,11, 12, 13, 14, 15, 18, 19, 21 DP alone in seven,10, 16, 20, 22, 23, 24, 25 and ML alone in one study.17 Seven of the sixteen studies compared DP and/or ML with traditional training10, 11, 12, 13, 14, 18, 19; eight studies compared pre- and post-training performance using a DP and/or ML-based intervention15, 16, 20, 21, 22, 23, 24, 25; one study compared results from DP and/or ML administered via self-directed versus instructor-led delivery.17
Study results: overall
Overall, 12 of the 16 studies demonstrated improved skill performance or learning scores in simulated resuscitation events associated with DP and/or ML.10, 13, 15, 16,18, 19, 20, 21, 22, 23, 24, 25 The remaining four studies did not find a difference in learner outcomes.11, 12, 14, 17 Of the 12 positive studies, four examined performance in a simulated adult resuscitation10, 18, 21, 22 six in a simulated pediatric resuscitation,13, 15, 16, 19,20, 23 one in actual trauma resuscitations,24 and one in actual medical resuscitations.25 Nine studies enrolled residents as subjects10, 13, 15, 16,18, 19, 20, 23, 24; two enrolled medical students18, 21; two enrolled non-healthcare students12, 14; one enrolled nursing students22; one enrolled teams of pediatric EM fellows, nurses and therapists,11 and one enrolled pediatric EM faculty.25 Outcome measures were instrument or checklist-based in 13 studies; one study used time to defibrillation19; one used chest compression fraction18; and one used time to three specific initial tasks (patient transfer, primary assessment, and summary assessment)25 as the main outcomes of interest.
Randomized trial results
Results from the four RCTs were equivocal. One RCT demonstrated improved performance parameters and quicker critical intervention delivery for learners taught with DPML when compared to traditional training.13 The remaining three RCTs found no difference in outcomes between learners taught with DP and control groups taught using traditional course design, including one study with bystanders as subjects.10, 11, 12 In the one positive RCT, performance advantages associated with deliberate practice were no longer present four months after training.13
Observational trial results
The observational studies reflected more positively on DP and ML. In a simulated resuscitation environment, nine of the eleven observational studies found a positive association between DP and/or ML and improved educational outcomes.15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25
Two observational studies involved measurement of clinical performance during actual patient events. Yan et al. published a prospective review of video recorded trauma resuscitations and used a scoring instrument to quantify primary and secondary survey performance by residents, comparing those who had received a DP-based curriculum with both historical and concurrent controls who had not received the same curriculum. DP-trained residents scored higher during primary surveys than historical controls and higher than both control groups during secondary surveys.24 Keilman et al. published a before-and-after assessment of the effect of a single DP-based training session for team leaders on time to completion of three critical tasks as determined from video recorded pediatric medical resuscitations; all three critical tasks were completed in a significantly higher proportion of clinical events post-intervention.25
Skill decay
Six study designs included skill decay measurement using a reassessment at a remote time interval ranging from 2 to 9 months.14, 15, 17, 20,21, 23 Five of those studies could not demonstrate significant differences in resuscitation skills performance up to nine months after training.14, 17, 20, 21,23 One study found significant improvement in resuscitation skills performance following a single mastery learning session, although 60% of the students did not maintain that skill performance level for six months.15
Discussion
In this scoping review, we identified twelve studies examining the impact of DP and/or ML in resuscitation education. Among the significant findings were that a majority of studies (1 of 4 RCTs, 6 of 8 observational studies) showed a favorable impact of DP and/or ML as determined by subsequent skill performance in simulated patient settings. Four of six studies examining skill decay found that learner skill did not significantly deteriorate over a six month period following the DP and/or ML training session(s). One study found that recurring costs for life support education using DP and/or ML are less than those for traditional training due to a decreased need for instructor involvement. Finally, one study demonstrated improved performance during actual clinical care of trauma patients following completion of a DP-based curriculum.
In 1993, Ericsson defined deliberate practice as an “alternative framework. . . on the basis of the amount of deliberate activities aimed at improving performance.27 Published literature in medicine, education, and other fields have shown examples where investigations use methodology called ‘deliberate practice’ which, on closer examination, may not meet this definition; for example, the accumulation of a greater number of hours of didactic learning over time, while likely beneficial, lacks the repetitive, performance-level based goal of DP when properly applied.28, 29 For the present review, articles were screened carefully to attempt to ensure that the described methodology met the appropriate definitions for DP; many articles were excluded from consideration based on methodology that failed to exhibit the appropriate goals, immediate formative feedback, and repetition associated with DP. Moving forward, uniformity of criteria for DP, as applied in resuscitation training, is an essential goal in education research.
The definition of mastery learning is based in “identifying superior, reproducible behavior for representative tasks in the associated domain”.30 Implicit in this definition is the existence of a critical threshold of skill or knowledge that, once achieved, connotes that the learner has ‘mastered’ the construct being measured. In resuscitation science, many of the fundamental concepts taught in life support education may be difficult to distill down to a single gold standard measure of ‘mastery’. As an example, CPR quality is a virtually ubiquitous concept in life support education. However, the relevant learning objectives may not necessarily be identical across different learner groups. For laypeople, it may be more important to recognize cardiac arrest and to have sufficient readiness to perform bystander CPR and use an AED31; for hospital-level healthcare providers, optimizing compression fraction, compression depth and rate, and simultaneously incorporating rhythm identification, manual defibrillation, and medication administration are standard expectations.32, 33 Depending on the clinical setting, even such basic concepts as compression depth may be more optimally guided by patient physiology (e.g. arterial pressure waveform, exhaled carbon dioxide) than by resuscitation guidelines for depth alone.34, 35, 36 Acknowledging that ‘one size doesn’t fit all’ in this regard, educators need to account for appropriate clinical contexts in defining criteria for ‘mastery’ with these differences in mind.
Considering these varied concepts as a whole should elucidate the challenges in incorporating DP and/or ML into life support education. McGaghie’s definition of mastery learning dictates that the end product of such education should yield learners with little to no difference in their high level of performance, irrespective of their starting point or the amount of time required for this to be achieved.8 As shown by the breadth of subject across the studies in this review, life support education exists in forms that target learners from very different backgrounds who would be expected to perform life support tasks in widely varied contexts (at home, in a public place, prehospital, emergency department, intensive care unit, etc.). As always, identifying learners’ needs is a prerequisite to effectively setting goals for mastery learning for all groups.
In two of the RCTs which did not demonstrate a significant difference between DP and traditional case-based training, the ‘control’ group underwent repetitions of full simulated cases from beginning to end, with feedback and debriefing at the conclusion of the cases.10, 11 For both of these trials, the ‘intervention’ arm consisted of repeated simulations with more frequent interruptions for formative and/or corrective feedback, plus time allotted to repeat tasks with the benefit of those ‘doses’ of feedback. Before-and-after differences in performance were better in both groups for both of the RCTs. Thus, even though the improvement in performance did not differ by condition, both studies provide evidence that repetitive practice paired with feedback yields positive educational outcomes. The equivocal results of these trials may represent the need for future studies to more closely examine what frequency and/or timing of feedback during repetitive practice leads to optimal results; evidence along these lines will permit the best means of leveraging DP in instructional design.
Consistent with recently published AHA guidelines, this review suggests that integrating DP and/or ML instructional design features may enhance current courses by improving educational outcomes.3 Importantly, incorporating DP and/or ML would require restructuring of programs to allow sufficient time for repetitive practice and proper assessment, along with the identification of assessment metrics/outcomes which were psychometrically robust with regard to validity. Additionally, DP and/or ML design features have implications for faculty development, as many instructors are insufficiently familiar with these concepts. This in turn has implications with regard to training instructors and raters in proper conduct of DP teaching and the correct application of ML standards for completing a given set of objectives.
Our study has several limitations. While this review highlights the published data of the impact of DP and/or ML in a variety of settings, it also illustrates many of the inherent challenges in summarizing data from educational literature. Studies varied in terms of their inclusion criteria for subjects, including laypeople, medical students, residents, and (in one study) subspecialty fellows; no study examined performance by more senior clinicians. Outcomes of interest also varied, with most studies examining skill performance immediately after training; even within this group, however, outcome measures varied, including time to completion of tasks (e.g. time to start compressions), objective metrics such as chest compression fraction, and performance on skill checklists. Only four studies examined skill decay, and none of those studies measured skill at time points later than six months (when typical retraining for life support courses occurs every two years). As is often the case with educational literature, drawing generalizable conclusions from this body of literature is difficult.
Among the studies included in this review, there was significant inconsistency in the definition of DP and/or ML, with some studies describing the intervention of interest with insufficient detail to determine with certainty that true DP/ML technique was being applied. The interventions of interest, study populations and their backgrounds, comparators against which interventions were studied (where applicable), and the educational outcomes were very heterogeneous, making the use of true meta-analytic analysis difficult. There is a need for clear definitions and consensus research guidelines to improve consistency and reduce heterogeneity in studies examining the effect of DP/ML as well as other specific educational phenomena.
Finally, as is the case with all resuscitation education research, linking a particular educational strategy such as DP and/or ML to improved patient outcomes remains elusive. The recently published American Heart Association 2020 Guidelines for Education specifically cited several published references that have directly examined the connection between educational endeavors and/or adjuncts such as simulation-enhanced education, debriefing, and telephone CPR instruction to patient outcomes.37, 38, 39, 40, 41 We found only two studies associating DP-based training to clinical care delivery; no studies demonstrated a relationship to patient outcomes.
Conclusions
Deliberate practice and mastery learning have been recommended as educational techniques to yield improved and more durable skill and knowledge during life support education. In this scoping review, we identified 16 studies which yielded mixed results, although a greater number of studies demonstrated a positive association between the use of deliberate practice and/or mastery learning and improved educational outcomes. Research using deliberate practice and/or mastery learning is hampered by inconsistent study design, varying operational definitions, and disparate comparators, subject groups, and outcomes. Further research should seek to strengthen experimental methodology with regard to the impact of deliberate practice and/or mastery learning, with an eye towards uniform definitions, homogenous study design, and more readily interpretable results as to the effect of deliberate practice and/or mastery learning on educational outcomes.
Declarations of interest
None.
CRediT authorship contribution statement
Aaron Donoghue: Conceptualization, Methodology, Validation, Formal analysis, Investigation, Writing - review & editing, Supervision. Kenneth Navarro: Methodology, Validation, Formal analysis, Investigation, Writing - review & editing, Visualization. Emily Diederich: Methodology, Validation, Formal analysis, Investigation, Writing - review & editing. Marc Auerbach: Methodology, Validation, Formal analysis, Investigation, Writing - review & editing. Adam Cheng: Conceptualization, Methodology, Validation, Formal analysis, Investigation, Writing - review & editing, Supervision.
Acknowledgements
The authors want to acknowledge David J. Magid, MD, MPH; Farhan Bhanji, MD, MEd; Blair L. Bigham, MD, MSc; Audrey L. Blewer, PhD, MPH; Katie N. Dainty, MSc, PhD; Yiqun Lin, MD, MHSc, PhD; Marion Leary, RN, MSN, MPH; Melissa Mahgoub, PhD; and Mary E. Mancini, RN, PhD for their contribution and feedback to the research strategy used in the above review as a part of the Education chapter of the 2020 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care.
Footnotes
Supplementary material related to this article can be found, in the online version, at doi:https://doi.org/10.1016/j.resplu.2021.100137.
Appendix A. Supplementary data
The following is Supplementary data to this article:
References
- 1.Greif R., Bhanji F., Bigham B.L. Education, Implementation, and Teams: 2020 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. Resuscitation. 2020;156:A188–A239. doi: 10.1016/j.resuscitation.2020.09.014. [DOI] [PubMed] [Google Scholar]
- 2.Lockey A., Lin Y., Cheng A. Impact of adult advanced cardiac life support course participation on patient outcomes-a systematic review and meta-analysis. Resuscitation. 2018;129:48–54. doi: 10.1016/j.resuscitation.2018.05.034. [DOI] [PubMed] [Google Scholar]
- 3.Cheng A., Magid D.J., Auerbach M. Part 6: Resuscitation Education Science: 2020 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2020;142:S551–S579. doi: 10.1161/CIR.0000000000000903. [DOI] [PubMed] [Google Scholar]
- 4.Cheng A., Nadkarni V.M., Mancini M.B. Resuscitation Education Science: Educational Strategies to Improve Outcomes From Cardiac Arrest: A Scientific Statement From the American Heart Association. Circulation. 2018;138:e82–e122. doi: 10.1161/CIR.0000000000000583. [DOI] [PubMed] [Google Scholar]
- 5.Cook D.A., Brydges R., Zendejas B., Hamstra S.J., Hatala R. Mastery learning for health professionals using technology-enhanced simulation: a systematic review and meta-analysis. Acad Med. 2013;88:1178–1186. doi: 10.1097/ACM.0b013e31829a365d. [DOI] [PubMed] [Google Scholar]
- 6.McGaghie W.C., Issenberg S.B., Cohen E.R., Barsuk J.H., Wayne D.B. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med. 2011;86:706–711. doi: 10.1097/ACM.0b013e318217e119. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Ericsson K.A. Deliberate practice and acquisition of expert performance: a general overview. Acad Emergency Med. 2008;15:988–994. doi: 10.1111/j.1553-2712.2008.00227.x. [DOI] [PubMed] [Google Scholar]
- 8.McGaghie W.C. When I say … mastery learning. Med Educ. 2015;49:558–559. doi: 10.1111/medu.12679. [DOI] [PubMed] [Google Scholar]
- 9.Arksey H., O’Malley L. Scoping Studies: Towards a Methodological Framework. In J Soc Res Methodol. 2005;8:19–32. [Google Scholar]
- 10.Diederich E., Lineberry M., Blomquist M. Balancing deliberate practice and reflection: a randomized comparison trial of instructional designs for simulation-based training in cardiopulmonary resuscitation skills. Simul Healthc. 2019;14:175–181. doi: 10.1097/SIH.0000000000000375. [DOI] [PubMed] [Google Scholar]
- 11.Lemke D.S., Fielder E.K., Hsu D.C., Doughty C.B. Improved team performance during pediatric resuscitations after rapid cycle deliberate practice compared with traditional debriefing: a pilot study. Pediatr Emerg Care. 2019;35:480–486. doi: 10.1097/PEC.0000000000000940. [DOI] [PubMed] [Google Scholar]
- 12.Madou T., Iserbyt P. Mastery versus self-directed blended learning in basic life support: a randomised controlled trial. Acta Cardiol. 2019:1–7. doi: 10.1080/00015385.2019.1677374. [DOI] [PubMed] [Google Scholar]
- 13.Magee M.J., Farkouh-Karoleski C., Rosen T.S. Improvement of immediate performance in neonatal resuscitation through rapid cycle deliberate practice training. J Grad Med Educ. 2018;10:192–197. doi: 10.4300/JGME-D-17-00467.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Boet S., Bould M.D., Pigford A.A. Retention of basic life support in laypeople: mastery learning vs. time-based education. Prehosp Emerg Care. 2017;21:362–377. doi: 10.1080/10903127.2016.1258096. [DOI] [PubMed] [Google Scholar]
- 15.Braun L., Sawyer T., Smith K. Retention of pediatric resuscitation performance after a simulation-based mastery learning session: a multicenter randomized trial. Pediatr Crit Care Med. 2015;16:131–138. doi: 10.1097/PCC.0000000000000315. [DOI] [PubMed] [Google Scholar]
- 16.Cordero L., Hart B.J., Hardin R., Mahan J.D., Nankervis C.A. Deliberate practice improves pediatric residents’ skills and team behaviors during simulated neonatal resuscitation. Clin Pediatr (Phila) 2013;52:747–752. doi: 10.1177/0009922813488646. [DOI] [PubMed] [Google Scholar]
- 17.Devine L.A., Donkers J., Brydges R., Perelman V., Cavalcanti R.B., Issenberg S.B. An equivalence trial comparing instructor-regulated with directed self-regulated mastery learning of advanced cardiac life support skills. Simul Healthc. 2015;10:202–209. doi: 10.1097/SIH.0000000000000095. [DOI] [PubMed] [Google Scholar]
- 18.Hunt E.A., Duval-Arnould J.M., Chime N.O. Integration of in-hospital cardiac arrest contextual curriculum into a basic life support course: a randomized, controlled simulation study. Resuscitation. 2017;114:127–132. doi: 10.1016/j.resuscitation.2017.03.014. [DOI] [PubMed] [Google Scholar]
- 19.Hunt E.A., Duval-Arnould J.M., Nelson-McMillan K.L. Pediatric resident resuscitation skills improve after “Rapid Cycle Deliberate Practice” training. Resuscitation. 2014;85:945–951. doi: 10.1016/j.resuscitation.2014.02.025. [DOI] [PubMed] [Google Scholar]
- 20.Jeffers J., Eppich W., Trainor J., Mobley B., Adler M. Development and evaluation of a learning intervention targeting first-year resident defibrillation skills. Pediatr Emerg Care. 2016;32:210–216. doi: 10.1097/PEC.0000000000000765. [DOI] [PubMed] [Google Scholar]
- 21.Reed T., Pirotte M., McHugh M. Simulation-based mastery learning improves medical student performance and retention of core clinical skills. Simul Healthc. 2016;11:173–180. doi: 10.1097/SIH.0000000000000154. [DOI] [PubMed] [Google Scholar]
- 22.Knipe G., Fox S., Donatello R. Deliberate practice in simulation: evaluation of repetitive code training on nursing students’ BLS team skills. Clinl Simulation Nurs. 2020;48:8–14. [Google Scholar]
- 23.Surapa Raju S., Tofil N.M., Gaither S.L. The impact of a 9-month booster training using rapid cycle deliberate practice on pediatric resident PALS skills. Simul Healthc. 2020 doi: 10.1097/SIH.0000000000000538. published ahead of print. [DOI] [PubMed] [Google Scholar]
- 24.Yan D.H., Slidell M.B., McQueen A. Rapid cycle deliberate practice simulation curriculum improves pediatric trauma performance: a prospective cohort study. Simul Healthc. 2020 doi: 10.1097/SIH.0000000000000524. published ahead of print. [DOI] [PubMed] [Google Scholar]
- 25.Keilman A., Reid J., Thomas A. Enhancing paediatric resuscitation team performance: targeted simulation-based team leader training. BMJ Simul Technol Enhanc Learn. 2021;7:44–46. doi: 10.1136/bmjstel-2019-000578. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Roha Y.S., Lima E.J., Issenberg S.B. Effects of an integrated simulation-based resuscitation skills training with clinical practicum on mastery learning and self-efficacy in nursing students. Collegian. 2016;23:53–59. doi: 10.1016/j.colegn.2014.10.002. [DOI] [PubMed] [Google Scholar]
- 27.Ericsson K.A., Krampe R.T., Heizmann S. Can we create gifted people? Ciba Found Symp. 1993;178:222–231. doi: 10.1002/9780470514498.ch14. discussion 232-249. [DOI] [PubMed] [Google Scholar]
- 28.Ericsson K.A., Harwell K.W. Deliberate practice and proposed limits on the effects of practice on the acquisition of expert performance: why the original definition matters and recommendations for future research. Front Psychol. 2019;10:2396. doi: 10.3389/fpsyg.2019.02396. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Macnamara B.N., Hambrick D.Z., Oswald F.L. Deliberate practice and performance in music, games, sports, education, and professions: a meta-analysis. Psychol Sci. 2014;25:1608–1618. doi: 10.1177/0956797614535810. [DOI] [PubMed] [Google Scholar]
- 30.Ericsson K.A. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79:S70–81. doi: 10.1097/00001888-200410001-00022. [DOI] [PubMed] [Google Scholar]
- 31.Kleinman M.E., Brennan E.E., Goldberger Z.D. Part 5: adult basic life support and cardiopulmonary resuscitation quality: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2015;132:S414–435. doi: 10.1161/CIR.0000000000000259. [DOI] [PubMed] [Google Scholar]
- 32.de Caen A.R., Kleinman M.E., Chameides L. Part 10: paediatric basic and advanced life support: 2010 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science with Treatment Recommendations. Resuscitation. 2010;81:e213–259. doi: 10.1016/j.resuscitation.2010.08.028. [DOI] [PubMed] [Google Scholar]
- 33.Link M.S., Berkow L.C., Kudenchuk P.J. Part 7: adult advanced cardiovascular life support: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2015;132:S444–464. doi: 10.1161/CIR.0000000000000261. [DOI] [PubMed] [Google Scholar]
- 34.Hamrick J.T., Hamrick J.L., Bhalala U. End-tidal CO2-guided chest compression delivery improves survival in a neonatal asphyxial cardiac arrest model. Pediatr Crit Care Med. 2017;18:e575–e584. doi: 10.1097/PCC.0000000000001299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Pantazopoulos C., Xanthos T., Pantazopoulos I., Papalois A., Kouskouni E., Iacovidou N. A review of carbon dioxide monitoring during adult cardiopulmonary resuscitation. Heart Lung Circ. 2015;24:1053–1061. doi: 10.1016/j.hlc.2015.05.013. [DOI] [PubMed] [Google Scholar]
- 36.Sutton R.M., Friess S.H., Maltese M.R. Hemodynamic-directed cardiopulmonary resuscitation during in-hospital cardiac arrest. Resuscitation. 2014;85:983–986. doi: 10.1016/j.resuscitation.2014.04.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Bobrow B.J., Spaite D.W., Vadeboncoeur T.F. Implementation of a regional telephone cardiopulmonary resuscitation program and outcomes after out-of-hospital cardiac arrest. JAMA Cardiol. 2016;1:294–302. doi: 10.1001/jamacardio.2016.0251. [DOI] [PubMed] [Google Scholar]
- 38.Edelson D.P., Litzinger B., Arora V. Improving in-hospital cardiac arrest process and outcomes with performance debriefing. Arch Intern Med. 2008;168:1063–1069. doi: 10.1001/archinte.168.10.1063. [DOI] [PubMed] [Google Scholar]
- 39.Morrison L.J., Brooks S.C., Dainty K.N. Improving use of targeted temperature management after out-of-hospital cardiac arrest: a stepped wedge cluster randomized controlled trial. Crit Care Med. 2015;43:954–964. doi: 10.1097/CCM.0000000000000864. [DOI] [PubMed] [Google Scholar]
- 40.Wayne D.B., Didwania A., Feinglass J., Fudala M.J., Barsuk J.H., McGaghie W.C. Simulation-based education improves quality of care during cardiac arrest team responses at an academic teaching hospital: a case-control study. Chest. 2008;133:56–61. doi: 10.1378/chest.07-0131. [DOI] [PubMed] [Google Scholar]
- 41.Wolfe H., Zebuhr C., Topjian A.A. Interdisciplinary ICU cardiac arrest debriefing improves survival outcomes. Crit Care Med. 2014;42:1688–1695. doi: 10.1097/CCM.0000000000000327. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

