Abstract
Background: Interpersonal and communication skills are essential for physicians practicing in critical care settings. Accordingly, demonstration of these skills has been a core competency of the Accreditation Council for Graduate Medical Education since 2014. However, current practices regarding communication skills training in adult and pediatric critical care fellowships are not well described.
Objective: To describe the current state of communication curricula and training methods in adult and pediatric critical care training programs as demonstrated by the published literature.
Methods: We performed a systematic review of the published literature using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist. Three authors reviewed a comprehensive set of databases and independently selected articles on the basis of a predefined set of inclusion and exclusion criteria. Data were independently extracted from the selected articles.
Results: The 23 publications meeting inclusion criteria fell into the following study classifications: intervention (n = 15), cross-sectional survey (n = 5), and instrument validation (n = 3). Most interventional studies assessed short-term and self-reported outcomes (e.g., learner attitudes and perspectives) only. Fifteen of 22 publications represented pediatric subspecialty programs.
Conclusion: Opportunities exist to evaluate the influence of communication training programs on important outcomes, including measured learner behavior and patient and family outcomes, and the durability of skill retention.
Keywords: communication, medical education, fellowship, training, critical care
Communication skills are necessary for physicians to provide high-quality care and have been associated with improved satisfaction and clinical outcomes of patients and family members (1–9). In adult and pediatric critical care settings, physician communication skills are important to facilitation of family meetings, delivery of bad news, clinical consultations, and multi- and interdisciplinary care planning.
Given the importance of communication in clinical practice, the Accreditation Council for Graduate Medical Education (ACGME) has required fellowship programs to track and report learner development of “core competency” skills in communication since 2014 (10), with specific milestones including leadership of multidisciplinary care teams, facilitating family meetings, and communicating with patients (11).
Despite the essential nature of these skills, few studies have described communication training methodology in adult, pediatric, and neonatal critical care fellowship programs. Thus, we aimed to describe the landscape of structured communication training across subspecialty fellowships in adult and pediatric critical care medicine by conducting and reporting a systematic review of the literature.
Methods
We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist (12) to report the methods of this review. The published literature was searched for communication training of fellows in graduate medical education using strategies created by a medical librarian (M.D.). The search strategies used a combination of standardized terms and keywords, including (but not limited to) “fellowships,” “fellows,” “communication,” “delivering bad news,” “education,” “training,” and “ACGME competency surveys.” Strategies were implemented in Ovid MEDLINE 1946–, Embase 1947–, Scopus 1960–, Academic Search Complete 1975–, Communications Abstracts 1977–, ERIC (ProQuest) 1966–, Cochrane Central Register of Controlled Trials, Cochrane Database of Systematic Reviews, MedEdPortal, and clinicaltrials.gov. All searches were completed in November 2018.
Results were exported to EndNote (Clarivate Analytics) for a total of 3,572 results (Figure 1). The automatic duplicate finder in EndNote was used, and 1,283 duplicates were assumed to be accurately identified; 37 duplicates were further identified by a medical librarian, for a total of 2,252 unique citations. An updated search was run in Ovid MEDLINE, Scopus, and Embase in February 2020 to include articles from MedEdPortal. In this search, 23 new citations were found; after removal of 10 duplicates, a total of 13 additional citations were evaluated. Full search strategies are provided in the data supplement.
Figure 1.
Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) inclusion diagram.
Two reviewers (M.P.M. and H.P.) used Rayyan software (13) to screen article titles and abstracts on the basis of inclusion/exclusion criteria (Table 1). Citations involving the population of fellows in critical care medicine in both adult and pediatric settings were included. Citations involving skills training and education in communication were included. Studies conducted outside the United States were excluded. Publication types were restricted to peer-reviewed publications and excluded review articles.
Table 1.
Eligibility criteria
| Criterion | Inclusion | Exclusion |
|---|---|---|
| Language | English | Not English |
| Location | United States | Not United States |
| Type of article | Peer-reviewed journal article | Conference paper, abstract, not peer reviewed |
| Type of study | Quantitative (e.g., controlled studies or before–after studies); qualitative (e.g., surveys or interviews) | Reviews, commentaries (e.g., letters or editorials) |
| Focus of study | Communication training, as reported by authors | Communication training mentioned but not focus |
| Population | Adult and pediatric fellows in pulmonary and/or critical care subspecialties | Not fellow related (e.g., only residents, students, or faculty) |
Screening identified 43 articles for full-text review. A member of the study team (J.T.) manually searched these articles’ reference lists and identified 12 additional citations for full-text review. Of 54 full texts reviewed, 20 were conference abstracts, 2 were not performed in the United States, 6 did not have critical care fellows, and 4 did not specify whether any fellows were included. After these exclusions, a total of 23 articles met inclusion criteria.
Results
Study Populations
The review included 23 articles published from years 1999 to 2018 (Table 2), of which 8 involved fellows in adult medicine (7 in pulmonary and critical care and 1 in surgical critical care) and 15 involved pediatric fellows (10 included neonatology fellows and 7 included pediatric critical care medicine fellows, with 3 including fellows from both pediatric critical care and neonatology programs). Nine articles included nonfellow participants (four included attendings, three included nurse practitioners, and three included residents). In total, 777 fellow participants were represented in the analysis; it was not possible to determine whether any trainees were represented more than once.
Table 2.
Study characteristics and results
| Authors | Participants | N | Design | Intervention | Completion (%) | Outcomes Measured | Study Results | Limitations |
|---|---|---|---|---|---|---|---|---|
| Arnold and colleagues, 2015 (27) | Adult pulmonary and critical care medicine fellows |
|
Pre–post survey of self-rated communication skills | 3-d communication skill workshop: 1) didactics with role playing, 2) simulation with standardized patients, and 3) informal practice | 95 | Self-assessed training and preparedness to communicate in family decisions |
|
|
| Bateman and colleagues, 2016 (20) | Pediatric critical care fellows |
|
Postsimulation semistructured interview | High-fidelity simulation | 100 | Descriptive themes based on interviews |
|
|
| Bays and colleagues, 2014 (28) | Adult pulmonary and critical care medicine fellows |
|
Pre–post skills assessment | Codetalk communication workshop with standardized patient simulation | 52* | Observed specific communication skills (i.e., SPIKES or NURSE) in standardized patient encounter |
|
|
| Boss and colleagues, 2009 (17) | Pediatric neonatology fellows |
|
Web-based national survey | None | 72 | Self-assessed training and preparedness to communicate in family decisions |
|
|
| Boss and colleagues, 2012 (21) | Pediatric neonatology fellows |
|
Postsimulation semistructured interview and survey | Standardized patient simulation | 50* | Descriptive themes based on interviews and qualitative inquiry |
|
|
| Boss and colleagues, 2013 (32) | Pediatric neonatology fellows |
|
Pre–post survey | 3-d communication skill course: 1) didactics with role playing, 2) simulation with standardized patients, and 3) informal practice | 100 | Self-assessed preparedness and competence in communication skills |
|
|
| Brock and colleagues, 2017 (23) | Pediatric critical care medicine fellows and NICU fellows |
|
Quasi-experimental pre–post: simulation vs. didactics | 3 simulations and a videotaped panel | 100 | Pediatric Palliative Care Questionnaire, modified Kalamazoo Communication Assessment Tool, palliative care consultation rates |
|
|
| Brown and colleagues, 2018 (19) | Adult pulmonary and critical care medicine fellows |
|
Randomized controlled trial | Codetalk communication workshop with standardized patient simulation | 45 | Self-assessed competence discussing palliative care with patients |
|
|
| Calhoun and colleagues, 2009 (38) | Pediatric critical care medicine fellows and NICU fellows |
|
Instrument validation | None | 100 | Interrater reliability Instrument validity Gap analysis |
|
|
| Gustin and colleagues, 2016 (39) | Adult pulmonary and critical care medicine fellows |
|
Instrument validation | Simulated family meeting | 100 | Interrater reliability Instrument validity |
|
|
| Harris and colleagues, 2015 (36) | Pediatric neonatology fellows |
|
Pre–post survey of curriculum effectiveness | 3-h lectures plus weekly multidisciplinary rounds | Unclear | Self-assessed comfort and familiarity |
|
|
| Hope and colleagues, 2015 (29) | Adult pulmonary and critical care medicine fellows |
|
Development of formal communication skills curriculum: simulation and didactics | Family meeting simulations plus didactic lectures and case discussions | 90 | Self-assessed comfort Faculty-measured communication quality in simulations |
|
|
| Johnson and colleagues, 2017 (30) | Pediatric critical care medicine fellows |
|
Pre–post survey | 3-d communication skills course: 1) didactics with role playing, 2) simulation with standardized patients, and 3) informal practice | 100 | Self-assessed training and preparedness to communicate in family decisions |
|
|
| Kersun and colleagues, 2009 (14) | Pediatric critical care medicine fellows |
|
Online survey (national) | None | 50* | Recollection/perceptions of training experiences |
|
|
| Lechner and colleagues, 2016 (22) | Pediatric neonatology fellows |
|
Pre–post survey | Simulated family meetings + didactic curriculum | 89 | Self-assessed preparedness and competence in communication skills |
|
|
| McCallister and colleagues, 2015 (31) | Adult pulmonary and critical care medicine fellows |
|
Quasi-experimental pre–post: novel curriculum vs. historical control | Workshop + simulated family meetings + didactic curriculum | 100 |
|
|
|
| Orgel and colleagues, 2010 (18) | Pediatric critical care medicine fellows and neonatology fellows |
|
Online survey (single center) | None | 80* | Self-assessed preparedness, competence, and knowledge in communication skills. |
|
|
| Janice-Woods Reed and Sharma, 2016 (26) | Pediatric neonatology fellows | Not specified | Description of curriculum and pre–post survey | Simulation | Not reported | Self-reported comfort | • Average self-reported comfort improved from 5.8 to 7.5 on 10-point Likert scale |
|
| Sawyer and colleagues, 2017 (24) | Pediatric neonatology fellows |
|
Pre–post survey | Workshop with simulated family meeting | 83* | Self-assessed competence with antenatal counseling | • 90% perceived improved counseling quality at 3 mo* |
|
| Schmitz and colleagues, 2008 (37) | Adult surgical critical care fellows |
|
OSCE validation | None | 100 |
|
|
|
| Turner and colleagues, 2013 (15) | Pediatric critical care medicine program directors |
|
Online survey (national) | None | 67 | Self-reported modalities used to teach ACGME requirements |
|
|
| Turner and colleagues, 2015 (16) | Pediatric critical care medicine fellows |
|
Online survey (national) | None | 47 | Self-reported engagement in ACGME/ABP requirements for communication teaching |
|
|
| Vaidya and colleagues, 1999 (25) | Pediatric critical care medicine fellows |
|
Self-controlled crossover study | Role playing standardized patients | 100 |
|
• Improvement in overall communication performance and in each communication category (P < 0.01) |
|
Definition of abbreviations: ABP = American Board of Pediatrics; ACGME = American College of Graduate Medical Education; FMBSC = Family Meeting Behavioral Skills Checklist; ICC = intraclass correlation; NA = not applicable; NICU = neonatal ICU; NP = nurse practitioner; NURSE = name emotion, understand emotion, respect the patient, support using powerful words, explore emotion; OSCE = objective structured clinical examination; PCCM = pulmonary and critical care medicine; PICU = pediatric ICU; SEGUE = set the stage, elicit information, give information, understand the patient’s perspective, end the encounter; SPIKES = six-step protocol to deliver bad news (set up, assess perception, obtain invitation, give knowledge, emotions and empathy, summarize strategy).
Not possible to differentiate fellow results from those of other participants.
Not possible to differentiate PCCM fellow results from those of other fellows.
Cross-Sectional Survey Studies
We identified five cross-sectional survey studies in the literature review, all of which related to pediatric fellowship trainees. Three studies described the modalities used to describe communication training during fellowship. A survey of pediatric critical care and hematology-oncology fellowship graduates found that observing senior physicians (100%), direct observation with feedback (78%), reading (56%), and lectures (46%) were the most common teaching methods used, with role playing (20%), workshops (16%), and simulation (13%) used less frequently (14). Another study surveyed pediatric critical care fellowship program directors, similarly finding that faculty role modeling, direct observation with feedback, and didactics were the most common modalities used to teach communication (15). However, this study also found that 75% of the required elements of communication evaluated were not specifically taught by all programs. Finally, one survey of pediatric critical care fellows reported perceived deficiencies in all areas of communication education, including not being taught how to communicate as a member of a nonclinical group (24%), across socioeconomic and cultural backgrounds (19%), or in consultation outside the intensive care unit (17%) (16).
Two studies explored perceptions of communication training. One survey of neonatology fellows found that 94% of fellows were “sometimes” or “always” responsible for leading family meetings, but only 40% of fellows recalled attending physician presence at these meetings and feedback to fellows (17). In addition, 14% of respondents reported never receiving feedback from any attending physician after any family meeting. Finally, a survey of pediatric residents, fellows, and attending physicians at an academic hospital reported that trainees believed they were insufficiently knowledgeable to deliver bad news independently (18). This study also elicited barriers to effective education from respondents, which included time constraints, lack of educational emphasis, lack of positive modeling, and limited awareness of existing resources.
Interventional Studies
Fifteen studies in this review directly examined interventions to improve communication skills. One was a randomized controlled trial (19) comparing a multisession workshop with no intervention, and the remaining studies had pre–post designs. Seven studies evaluated training experiences based on simulation and/or standardized patient/family encounters (20–26). An additional seven studies described multicomponent workshops or curricula, many of which involved combinations of didactic lectures, role playing, and simulation (19, 26–32). Notably, five (19, 27, 29–31) of these seven studies involved workshops based on training objectives and content from the VitalTalk program (33), a well-known communication training program for clinicians that has been adapted to specialties, including oncology (34) and nephrology (35) as well as critical care (27).
All of these studies reported at least one improved outcome in the intervention group. Outcomes reported were heterogeneous and included both self-reported outcomes (10 studies reported self-reported comfort, competence, or preparedness [19, 22, 24–27, 29–32, 36]) and demonstrations of behavior change (five studies reported scored simulation encounters, with some overlap [23, 25, 28, 29, 31]). Interventions were reported as well received in essentially all studies.
Only 3 of the 14 studies evaluated whether communication training interventions impacted long-term outcomes. One study found that a 3-day communication skills course led to a high self-report of participants using workshop skills at 1 month (32). After a similar multiday training course, another study found that perceived comfort with difficult communication was high, both immediately after the course and at 1 month (27). Finally, another group found that short-term gains in objectively measured communication skills measured on the day of the course were not present 3 months later by the same format (23).
Instrument and Process Validation Studies
Three studies evaluated the validity and reliability of tools and processes that may be used to assess the communication skills of critical care fellows during simulated patient encounters. One study found that observed structured clinical encounter ratings of communication-focused vignettes were reliable across groups and adequately discriminative (37). Another study reported the development and testing of a multirater assessment paired with a gap analysis for evaluating pediatric critical care trainees’ communication skills; this group described strong utility and feasibility of this process (38). Another group described the creation and validation of the Family Meeting Behavioral Skills Checklist and compared it with the existing SEGUE Framework (set the stage, elicit information, give information, understand the patient’s perspective, end the encounter) (39, 40). The Family Meeting Behavioral Skills Checklist had strong consistency and better reliability than the SEGUE.
Barriers to Communication Training
Most studies describing interventions commented on barriers to training fellows in communication skills. The most commonly described barriers included time constraints, resource limitations (in particular, active simulation centers), and faculty with relevant training and expertise (Table 3).
Table 3.
Barriers to training fellows in communication skills
| Authors | Barrier |
|---|---|
| Boss and colleagues, 2009 (17) | Needs active simulation center |
| Calhoun and colleagues, 2009 (38) | Needs active simulation center |
| Harris and colleagues, 2015 (36) | Lack of dedicated palliative care language |
| Poor attendance by on-service physicians | |
| Hope and colleagues, 2015 (29) | Need dedicated faculty |
| Lechner and colleagues, 2016 (22) | Lack of emotional support from clinical mentors |
| Time constraints | |
| Trainee’s fear of the process | |
| Orgel and colleagues, 2010 (18) | Time constraints |
| Lack of role models | |
| Lack of educational emphasis | |
| Limited awareness of existing resources | |
| Administrative interest | |
| Janice-Woods Reed and Sharma, 2016 (26) | Time constraints |
| Schmitz and colleagues, 2008 (37) | Needs active simulation center |
| Vaidya and colleagues, 1999 (25) | Cost |
Discussion
Our review identified 23 published studies regarding the training of adult and pediatric critical care medicine fellows in communication skills. The majority (63%) of studies described interventions that included simulation with trainee self-perception of acquired skills as an endpoint. A minority (22%) of studies used instruments designed to objectively quantify trainee acquisition of skills. This finding is particularly notable, given the importance of these skills for critical care physicians in clinical practice and the existence of ACGME core competency and milestone requirements for training programs in these fields. It is also worth noting that there are almost twice the number of studies of the pediatric training programs as there are of adult programs, despite a smaller footprint of pediatric programs and trainees nationally.
Perhaps most surprisingly, no cross-sectional assessment of adult critical care medicine fellowship training practices in communication skills exists. Such an examination would be an important opportunity to characterize how programs currently train and evaluate fellows in this area and to align them with existing training milestone and core competency standards. Moreover, given the need for high-quality communication skills in most fields, a clear understanding of effective and sustainable programs to teach durable communication skills would likely be desirable for interprofessional educators of many backgrounds. Finally, although we constrained our search to publications specific to critical care training programs, there are many examples of existing communication skills curricula within other medical specialties (e.g., palliative medicine certificates) that might have applications for critical care training programs.
Gaps Identified
Many of the included studies provided, overall, low levels of evidence for the interventions they described. All were small, and many were conducted in a single center, which may limit their generalizability. Furthermore, most measured self-reported perceptions rather than objective skills, which may increase bias, limit interpretation of results, and restrict generalization to objective performance. Only one study described the effects of an educational intervention on clinical performance, and most focused on low-level learning objectives at the first Kirkpatrick level (41). Thus, one gap identified is the need for more objective outcomes about measured learner behavior, ideally including patient and family outcomes.
Most studies did not assess the durability (retention over time) of their intervention’s impact on communication skills. For example, several studies described the use of similar multicomponent, multiday workshops. In addition, although the standardization and scalability of these programs may be a strength, none of the studies reported data on sustainability (ability to provide continued support) of these interventions over time. Thus, evaluation of the durability of learned skills over time as well as the sustainability of communication training in these programs is an important gap in the studies in this review.
Last, three studies used validated rating tools to objectively rate a trainee’s acquisition of communication skills. These tools offer a more robust method of assessment that can be useful in assessing competency in an objective and longitudinal manner. However, it is unlikely that the use of these tools is widespread or standardized across training programs. Thus, another gap is the lack of broader national consensus on the necessary tools to measure competency among programs and the core communication skills required to deem a fellow competent.
Strengths and Weaknesses
Our review has multiple strengths. First, to our knowledge, this is the first systematic review on the important topic of communication skills training for either adult or pediatric critical care fellows. In addition, we adhered to PRISMA guidelines and used rigorous methodology to identify and screen articles, including our search strategy and the use of snowballing to identify additional articles. Finally, we used a novel software program to facilitate abstract screening and ultimate determinations related to article inclusion or exclusion.
Our findings should also be interpreted in light of our review’s limitations. First, because of the small number of studies identified, we were unable to consolidate results for quantitative evaluation. The small number of studies we found may also reflect publication bias. Second, to maximize the number of articles to be evaluated, we chose a broad scope for our review within critical care subspecialties: We did not specify the domain of communication being studied (e.g., clinician–patient, clinician–clinician, or clinician–interdisciplinary), nor did we restrict our review to only adult or pediatric trainees. Although this broad scope may limit consistency among included works (i.e., we evaluated instrument validation studies, cross-sectional surveys, and interventional studies), it does offer the advantageous perspective of multiple specialties. Given the similarities in critical care practice, regardless of patient age (e.g., multidisciplinary rounds, the need to consult with clinicians across the spectrum of disciplines, and the need to conduct delicate conversations involving prognosis and bad news), results from one critical care subspecialty may very well apply to others. Finally, our review was unable to ascertain details of relevant communication skills training not reported in the included studies; for example, multidisciplinary teamwork curricula such as TeamSTEPPS (Team Strategies and Tools to Enhance Performance and Patient Safety) (42) may be part of some hospitals’ or training programs’ culture and may not be studied as specific educational interventions in communication training.
In conclusion, the majority of communication skills training programs for critical care fellows described in the literature are simulation-based interventions that demonstrated improvements in learner confidence and short-term skill acquisition. There is no existing data on what specific skills are important to achieve competency or how to maintain and grow those skills over time. There is a need to better describe the current state of communication skills training in graduate medical education to define which outcomes are important and what specific skills need to be taught to meet those outcomes. We conclude that important next steps in this area may involve evaluating objective performance of communication skills, adapting and evaluating well-developed programs from other fields (e.g., VitalTalk), characterizing and addressing important barriers to the implementation of effective communication skills training curricula, and linking these curricula to important patient- and family-centered outcomes.
Supplementary Material
Footnotes
Supported by National Institutes of Health/National Heart, Lung, and Blood Institute grant T32 HL007317 (P.G.L.).
Author Contributions: M.P.M. and P.G.L. contributed to the conception and design of the study, the acquisition and analysis of data, and the drafting of the manuscript. H.P. contributed to the design of the study and the acquisition and analysis of data. J.T. contributed to the acquisition and analysis of data. M.D. contributed to the acquisition of data. J.C., R.M.S., T.C.S., J.O’T., A.S., and J.W.M. contributed to the design of the study and the analysis of data. M.M.L. and W.G.C. contributed to the conception and design of the study and the analysis of data. All of the authors contributed to the interpretation of the data and revision of the manuscript.
This article has a data supplement, which is accessible from this issue’s table of contents at www.atsjournals.org.
Author disclosures are available with the text of this article at www.atsjournals.org.
References
- 1.Vermeir P, Vandijck D, Degroote S, Peleman R, Verhaeghe R, Mortier E, et al. Communication in healthcare: a narrative review of the literature and practical recommendations. Int J Clin Pract. 2015;69:1257–1267. doi: 10.1111/ijcp.12686. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Boissy A, Windover AK, Bokar D, Karafa M, Neuendorf K, Frankel RM, et al. Communication skills training for physicians improves patient satisfaction. J Gen Intern Med. 2016;31:755–761. doi: 10.1007/s11606-016-3597-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kuroki LM, Zhao Q, Jeffe DB, Powell MA, Hagemann AR, Thaker PH, et al. Disclosing a diagnosis of cancer: considerations specific to gynecologic oncology patients. Obstet Gynecol. 2013;122:1033–1039. doi: 10.1097/AOG.0b013e3182a9bf42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Wright AA, Zhang B, Ray A, Mack JW, Trice E, Balboni T, et al. Associations between end-of-life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment. JAMA. 2008;300:1665–1673. doi: 10.1001/jama.300.14.1665. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Tierney WM, Dexter PR, Gramelspacher GP, Perkins AJ, Zhou XH, Wolinsky FD. The effect of discussions about advance directives on patients’ satisfaction with primary care. J Gen Intern Med. 2001;16:32–40. doi: 10.1111/j.1525-1497.2001.00215.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.McDonagh JR, Elliott TB, Engelberg RA, Treece PD, Shannon SE, Rubenfeld GD, et al. Family satisfaction with family conferences about end-of-life care in the intensive care unit: increased proportion of family speech is associated with increased satisfaction. Crit Care Med. 2004;32:1484–1488. doi: 10.1097/01.ccm.0000127262.16690.65. [DOI] [PubMed] [Google Scholar]
- 7.Steinhauser KE, Alexander SC, Byock IR, George LK, Olsen MK, Tulsky JA. Do preparation and life completion discussions improve functioning and quality of life in seriously ill patients? Pilot randomized control trial. J Palliat Med. 2008;11:1234–1240. doi: 10.1089/jpm.2008.0078. [DOI] [PubMed] [Google Scholar]
- 8.Dayton E, Henriksen K. Communication failure: basic components, contributing factors, and the call for structure. Jt Comm J Qual Patient Saf. 2007;33:34–47. doi: 10.1016/s1553-7250(07)33005-5. [DOI] [PubMed] [Google Scholar]
- 9.Levetown M American Academy of Pediatrics Committee on Bioethics. Communicating with children and families: from everyday interactions to skill in conveying distressing information. Pediatrics. 2008;121:e1441–e1460. doi: 10.1542/peds.2008-0565. [DOI] [PubMed] [Google Scholar]
- 10.Accreditation Council for Graduate Medical Education; American Board of Internal Medicine. The internal medicine subspecialty milestones project. 2015 Jul [accessed 2019 Jul 1]. Avaliable from: http://www.acgme.org/Portals/0/PDFs/Milestones/InternalMedicineSubspecialtyMilestones.pdf.
- 11.Fessler HE, Addrizzo-Harris D, Beck JM, Buckley JD, Pastores SM, Piquette CA, et al. Entrustable professional activities and curricular milestones for fellowship training in pulmonary and critical care medicine: report of a multisociety working group. Chest. 2014;146:813–834. doi: 10.1378/chest.14-0710. [DOI] [PubMed] [Google Scholar]
- 12.Moher D, Liberati A, Tetzlaff J, Altman DG PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097. doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5:210. doi: 10.1186/s13643-016-0384-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Kersun L, Gyi L, Morrison WE. Training in difficult conversations: a national survey of pediatric hematology-oncology and pediatric critical care physicians. J Palliat Med. 2009;12:525–530. doi: 10.1089/jpm.2008.0251. [DOI] [PubMed] [Google Scholar]
- 15.Turner DA, Mink RB, Lee KJ, Winkler MK, Ross SL, Hornik CP, et al. Education in Pediatric Intensive Care (EPIC) Investigators. Are pediatric critical care medicine fellowships teaching and evaluating communication and professionalism? Pediatr Crit Care Med. 2013;14:454–461. doi: 10.1097/PCC.0b013e31828a746c. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Turner DA, Fleming GM, Winkler M, Lee KJ, Hamilton MF, Hornik CP, et al. Education in Pediatric Intensive Care Investigators. Professionalism and communication education in pediatric critical care medicine: the learner perspective. Acad Pediatr. 2015;15:380–385. doi: 10.1016/j.acap.2015.02.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Boss RD, Hutton N, Donohue PK, Arnold RM. Neonatologist training to guide family decision making for critically ill infants. Arch Pediatr Adolesc Med. 2009;163:783–788. doi: 10.1001/archpediatrics.2009.155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Orgel E, McCarter R, Jacobs S. A failing medical educational model: a self-assessment by physicians at all levels of training of ability and comfort to deliver bad news. J Palliat Med. 2010;13:677–683. doi: 10.1089/jpm.2009.0338. [DOI] [PubMed] [Google Scholar]
- 19.Brown CE, Back AL, Ford DW, Kross EK, Downey L, Shannon SE, et al. Self-assessment scores improve after simulation-based palliative care communication skill workshops. Am J Hosp Palliat Care. 2018;35:45–51. doi: 10.1177/1049909116681972. [DOI] [PubMed] [Google Scholar]
- 20.Bateman LB, Tofil NM, White ML, Dure LS, Clair JM, Needham BL. Physician communication in pediatric end-of-life care: a simulation study. Am J Hosp Palliat Care. 2016;33:935–941. doi: 10.1177/1049909115595022. [DOI] [PubMed] [Google Scholar]
- 21.Boss RD, Donohue PK, Roter DL, Larson SM, Arnold RM. “This is a decision you have to make”: using simulation to study prenatal counseling. Simul Healthc. 2012;7:207–212. doi: 10.1097/SIH.0b013e318256666a. [DOI] [PubMed] [Google Scholar]
- 22.Lechner BE, Shields R, Tucker R, Bender GJ. Seeking the best training model for difficult conversations in neonatology. J Perinat Med. 2016;44:461–467. doi: 10.1515/jpm-2015-0110. [DOI] [PubMed] [Google Scholar]
- 23.Brock KE, Cohen HJ, Sourkes BM, Good JJ, Halamek LP. Training pediatric fellows in palliative care: a pilot comparison of simulation training and didactic education. J Palliat Med. 2017;20:1074–1084. doi: 10.1089/jpm.2016.0556. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Sawyer T, Fu B, Gray M, Umoren R. Medical improvisation training to enhance the antenatal counseling skills of neonatologists and neonatal fellows: a pilot study. J Matern Fetal Neonatal Med. 2017;30:1865–1869. doi: 10.1080/14767058.2016.1228059. [DOI] [PubMed] [Google Scholar]
- 25.Vaidya VU, Greenberg LW, Patel KM, Strauss LH, Pollack MM. Teaching physicians how to break bad news: a 1-day workshop using standardized parents. Arch Pediatr Adolesc Med. 1999;153:419–422. doi: 10.1001/archpedi.153.4.419. [DOI] [PubMed] [Google Scholar]
- 26.Janice-Woods Reed D, Sharma J. Delivering difficult news and improving family communication: simulation for neonatal-perinatal fellows. MedEdPORTAL. 2016;12:10467. doi: 10.15766/mep_2374-8265.10467. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Arnold RM, Back AL, Barnato AE, Prendergast TJ, Emlet LL, Karpov I, et al. The critical care communication project: improving fellows’ communication skills. J Crit Care. 2015;30:250–254. doi: 10.1016/j.jcrc.2014.11.016. [DOI] [PubMed] [Google Scholar]
- 28.Bays AM, Engelberg RA, Back AL, Ford DW, Downey L, Shannon SE, et al. Interprofessional communication skills training for serious illness: evaluation of a small-group, simulated patient intervention. J Palliat Med. 2014;17:159–166. doi: 10.1089/jpm.2013.0318. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Hope AA, Hsieh SJ, Howes JM, Keene AB, Fausto JA, Pinto PA, et al. Let’s talk critical: development and evaluation of a communication skills training program for critical care fellows. Ann Am Thorac Soc. 2015;12:505–511. doi: 10.1513/AnnalsATS.201501-040OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Johnson EM, Hamilton MF, Watson RS, Claxton R, Barnett M, Thompson AE, et al. An intensive, simulation-based communication course for pediatric critical care medicine fellows. Pediatr Crit Care Med. 2017;18:e348–e355. doi: 10.1097/PCC.0000000000001241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.McCallister JW, Gustin JL, Wells-Di Gregorio S, Way DP, Mastronarde JG. Communication skills training curriculum for pulmonary and critical care fellows. Ann Am Thorac Soc. 2015;12:520–525. doi: 10.1513/AnnalsATS.201501-039OC. [DOI] [PubMed] [Google Scholar]
- 32.Boss RD, Urban A, Barnett MD, Arnold RM. Neonatal Critical Care Communication (NC3): training NICU physicians and nurse practitioners. J Perinatol. 2013;33:642–646. doi: 10.1038/jp.2013.22. [DOI] [PubMed] [Google Scholar]
- 33.Back A, Arnold R, Edwards K, Tulsky J. VitalTalk. [accessed 2019 Oct 23]. Available from: https://www.vitaltalk.org/
- 34.Fryer-Edwards K, Arnold RM, Baile W, Tulsky JA, Petracca F, Back A. Reflective teaching practices: an approach to teaching communication skills in a small-group setting. Acad Med. 2006;81:638–644. doi: 10.1097/01.ACM.0000232414.43142.45. [DOI] [PubMed] [Google Scholar]
- 35.Schell JO, Cohen RA, Green JA, Rubio D, Childers JW, Claxton R, et al. NephroTalk: evaluation of a palliative care communication curriculum for nephrology fellows. J Pain Symptom Manage. 2018;56:767–773, e2. doi: 10.1016/j.jpainsymman.2018.08.002. [DOI] [PubMed] [Google Scholar]
- 36.Harris LL, Placencia FX, Arnold JL, Minard CG, Harris TB, Haidet PM. A structured end-of-life curriculum for neonatal-perinatal postdoctoral fellows. Am J Hosp Palliat Care. 2015;32:253–261. doi: 10.1177/1049909114523825. [DOI] [PubMed] [Google Scholar]
- 37.Schmitz CC, Chipman JG, Luxenberg MG, Beilman GJ. Professionalism and communication in the intensive care unit: reliability and validity of a simulated family conference. Simul Healthc. 2008;3:224–238. doi: 10.1097/SIH.0b013e31817e6149. [DOI] [PubMed] [Google Scholar]
- 38.Calhoun AW, Rider EA, Meyer EC, Lamiani G, Truog RD. Assessment of communication skills and self-appraisal in the simulated environment: feasibility of multirater feedback with gap analysis. Simul Healthc. 2009;4:22–29. doi: 10.1097/SIH.0b013e318184377a. [DOI] [PubMed] [Google Scholar]
- 39.Gustin JL, Way DP, Wells-Di Gregorio S, McCallister JW. Validation of the family meeting behavioral skills checklist: an instrument to assess fellows’ communication skills. Ann Am Thorac Soc. 2016;13:1388–1393. doi: 10.1513/AnnalsATS.201601-021OC. [DOI] [PubMed] [Google Scholar]
- 40.Skillings JL, Porcerelli JH, Markova T. Contextualizing SEGUE: evaluating residents’ communication skills within the framework of a structured medical interview. J Grad Med Educ. 2010;2:102–107. doi: 10.4300/JGME-D-09-00030.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Kirkpatrick DL, Kirkpatrick JD.Evaluating training programs: the four levels, 3rd ed. San Francisco, CA: Berrett-Koehler Publishers; 2006 [Google Scholar]
- 42.King HB, Battles J, Baker DP, Alonso A, Salas E, Webster J, et al. TeamSTEPPS: team strategies and tools to enhance performance and patient safety Henriksen K, Battles JB, Keyes MA, Grady ML.editors. Advances in patient safety: new directions and alternative approaches (Vol. 3: performance and tools). Rockville, MD: Agency for Healthcare Research and Quality; 2008 [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

