Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Apr 1.
Published in final edited form as: Semin Perinatol. 2021 Nov 9;46(3):151529. doi: 10.1016/j.semperi.2021.151529

Decision Making at Extreme Prematurity: Innovation in Clinician Education

Anne Sullivan 1,2,3, Christy L Cummings 1,2,3
PMCID: PMC9064892  NIHMSID: NIHMS1759886  PMID: 34839937

Abstract

Decision-making at extreme prematurity remains ethically and practically challenging and can result in parental and clinician distress. It is vital that clinicians learn the necessary skills integral to counseling and decision-making with families in these situations. A pedagogical approach to teaching counseling should incorporate adult learning theory, emphasize multidisciplinary team in-situ simulation that links to counseling clinicians’ daily practice, and includes critical reflection, debriefing, and program assessment. Multiple educational strategies that train clinicians in advanced communication and decision-making offer promising results to optimize antenatal counseling and shared decision-making for families facing possible delivery at extreme prematurity. Continued process evaluation and innovation in these educational domains are needed while also assessing the effect on patient-centered outcomes.

Introduction

Decision-making at extreme prematurity remains ethically and practically challenging and can result in both parental and clinician distress.1 When delivery is anticipated, clinicians in obstetrics, maternal-fetal medicine, and neonatology must counsel families amidst prognostic uncertainty in rapidly evolving and emotional situations. Clinicians must establish trust with a family they may have never met, elicit family preferences and values, and deliver complex medical information in a way a family can understand in order to arrive at an informed, shared decision that aligns with their goals. Sometimes a decision is needed urgently, sometimes there is time to process potential options, and sometimes parents are not offered a decision at all as the decision has been made without them. The complexity of decision-making at extreme prematurity stems from the existence of multiple ethically permissible options, wide ranges of possible infant outcomes, significant uncertainty in prognosis, and institutional variation in practices2. The dilemma of whether to provide or withhold life-sustaining treatment is among the most emotionally complex and morally stressful decisions in perinatology.

Currently, there is significant variation in counseling practices across institutions and a deficiency in education for counseling clinicians.2,3 Physicians tend to emphasize cognitive information and statistics when counseling and often fail to elicit or address parental values or fully explain management options, including comfort care.46 In addition, values that pregnant persons find most important during decision making for delivery room resuscitation for high-risk newborns include religious faith, spirituality, hope, and a personal connection to their physician. Yet, these preferences often differ from what physicians identify as most important, resulting in a barrier to effective communication.4,6,7 Given these findings, clinicians must learn the skills integral to collaborating with families during decision-making.

What Makes Good Counseling and Shared Decision Making?

Specific skills and ethical approaches are required for effective counseling and decision-making at extreme prematurity. Clinicians performing antenatal counseling must engage with families in conversation to determine their preferred level of involvement, illuminate their values and clarify the amount and type of support needed, in order to participate in a shared decision. Navigating the emotionality of the situation, acknowledging the uncertainty, and identifying and offsetting the power differential between a physician and a patient/family are all components required to support shared decision-making.8,9 Perinatologists and neonatologists who demonstrate compassion and convey warmth are more likely to create a trusting environment to share such crucial yet sensitive information and ultimately result in optimal decision making.8

Recently, there has been a shift in the focus of counseling clinicians from providing information to parents to empower them to make an informed decision to helping parents clarify their own values through careful listening, questioning, and communicating.10 Families emphasize the importance of physicians helping them articulate these goals and values, including understanding the role their religious and spiritual beliefs may have in making decisions for their infant.4 Individualizing the antenatal consult to the specific needs and preferences of the family is paramount to the success of a good counseling session11, as parents may differ in the amount and type of information desired and their preferred role and involvement in the decisional responsibility.12 While these decision-making preferences vary significantly among parents, physicians are typically poor at identifying which decision-making style parents prefer.13,14 As such, clinicians need to develop advanced communication skills that help families clarify their own values and decision-making preferences.

Bias and Message Framing May Influence Counseling and Decision-Making

The process of counseling and subsequent decision-making is often dependent on the information transferred from physicians to parents. Differences in clinicians’ values, life experiences, religious and/or political views, and region of practice are inherently tied to their counseling approach and recommendations and may reflect implicit biases.15,16 Such unconscious biases may be based on a patient’s race, education, insurance status, or age and may impact counseling approaches.17,18 Message framing in the context of perinatal counseling in which mortality versus survival percentages are presented may reflect biases of the medical provider and influence parental decision-making.19 There also may be important differences in the perspectives and values of pregnant persons of different races and ethnicities facing the threat of extremely premature delivery.20 Given potentially divergent counseling practices and patient/family preferences, educational programs surrounding periviable decision-making should emphasize cultural competence and humility, bias mitigation techniques, and individualized shared decision-making for optimal counseling.

The Prevailing Educational Paradigm is Inadequate

Despite the challenges inherent in counseling and decision-making at extreme prematurity and the need for effective and empathetic communication from physicians, there is little formal training for clinicians in this domain. Training is not routinely integrated into curricula, assessment is seldom conducted, let alone reported, and a consistent ethical framework is lacking.21 Neonatologists and obstetricians alike are not commonly trained in how to best guide decision-making jointly and collaborate with parents in highly stressful and emotional situations.2 Furthermore, the art of helping families articulate and construct their personal values and preferences is rarely taught.22

Teaching communication and counseling skills, such as empathy, active listening, and shared decision-making, however, is challenging in practice. In medical school, students are taught mainly to adhere to a script, followed by practice on standardized patients, but they are seldom prepared for the microethics of everyday conversation and consultation.23 They are exposed to the hidden curriculum of day-to-day practice during clinical rotations and the current culture of medicine that emphasizes perfection, outcome over process, and hierarchy resulting in dehumanization and decline in empathy.24,25 During neonatal and obstetric fellowships, many trainees learn skills in prenatal counseling through observation of attending physicians and then ultimately by conducting the sessions themselves, learning through trial and error, often unobserved and without the opportunity for feedback. While there is some value in the experiential learning in this approach, this unstructured training does not ensure the moral instruction needed to counteract the effects of the hidden curriculum24 nor does it incorporate the supervision and feedback that are essential to improving trainee skills.8 These experiences should be supplemented with formal targeted training programs to enhance communication skills in order to lead to documented improvements in the sense of preparation, communication, and relational skills, and confidence26,27, as well as parent-reported outcomes, such as satisfaction, knowledge, and perceptions.

Educational Theory and Pedagogy

A pedagogical approach to teaching counseling should incorporate adult learning theory, based on the principles of self-directive and experiential learning, although the best methods for this type of training have yet to be identified.28,29 A variety of educational strategies may be incorporated into a program to teach clinicians how to engage in ethical decision-making while counseling at extreme prematurity, described in Table 1. The main conceptual framework used for experiential learning is Kolb’s experiential learning cycle. Effective learning occurs when a person progresses through a cycle of four stages: 1) concrete experience, 2) observation and reflection on that experience, 3) assimilation of these reflections into abstract conceptualization, followed by 4) active experimentation.2830 Kolb’s learning cycle is the main conceptual framework used for experiential learning in simulation programs.30 Importantly, to allow for the active experimentation phase, learners must have the opportunity to return to the scenario after debriefing to trial what they have learned.30

Table 1.

Educational frameworks relevant to perinatal counseling education.21,25,29,30,32,35

Educational Framework Educational Method Application to Perinatal Counseling Education
Kolb’s Experiential Learning Cycle Knowledge created through transformation of experience Simulation/Role Play/Virtual reality simulators: Simulated event + Debriefing
Schon’s “reflection-in-action” and “reflection-on-action” Critical reflection to challenge conceptual framework and principles Debriefing Bias training
Relational Learning Learning and development of professional competence through human connection Interdisciplinary workshop with simulated emotionally challenging scenarios
Epstein and Hundert Professional competence assessment Development of program goals and outcome measures
Kirkpatrick Effectiveness assessment Assessment for observable change in communication skills of providers

Building on the reflective stage in Kolb’s cycle, Schon’s theory of reflection-in-action involves questioning one’s own conceptual framework to understand how personal beliefs, attitudes, and values may be impacting one’s practice.30 Such critical reflection may be utilized in the form of debriefing a simulated or real-life clinical encounter in order to challenge existing frameworks, biases, and principles.

One educational approach within the experiential learning framework that incorporates ethical principles and the interdisciplinary learning environment has been called relational learning. Relational learning has been described as learning in the context of how healthcare professionals interact with each other and patients/families and the professional development that occurs through the connection to the ethical and social norms of such relationships.24,25 A relational learning model has demonstrated that effective learning generates not only from direct participation in conversations but also from the opportunity to observe others and collaborate in experiential learning with interdisciplinary colleagues.24,26,31

Identifying and tracking competencies, including knowledge and performance, is vital for lifelong learning and improvement for both trainees and faculty. To assess professional competence, Epstein and Hundert’s framework for supporting and assessing professional competence emphasizes communicative competence, patient-physician relationships, integration of knowledge and skills, and self-reflection, building on current assessment formats for physicians that solely test core knowledge and skills.32 This approach to clinical competence has been increasingly recognized by professional bodies such as the Accreditation Council for Graduate Medical Education32,33 and has been applied to competency in relational learning programs.24 As applied to antenatal counseling at extreme prematurity and adapted from milestones relevant to ethics and professionalism from the ACGME, Table 2 describes ethical and relational skills needed for competency in such conversations that should be emphasized in the pedagogical design and assessment tools of any program.24,34

Table 2.

Ethical proficiencies mapped to ACGME milestones relevant to any educational program.24,33,34

Ethical Proficiency Relevant ACGME Competencies/ Milestones
Establishment of trust
  • Trustworthiness that makes colleagues feel secure when one is responsible for the care of patients (PROF2)

  • Has open communication facilitating trust in the patient-physician interaction (SBP2)

Ability to engage in shared decision making and sharing of the moral burden of decision-making
  • Develops goals and makes decisions jointly with the patient/family (SBP2)

  • Remains flexible and committed to engagement with patient/family throughout with patient’s illness (PROF4)

Capacity for empathy and compassion
  • Has excellent emotional intelligence about human behavior (PROF1)

Acknowledgment and tolerance of uncertainty and vulnerability
  • Transparent expression of uncertainty and limits of knowledge (PROF2)

  • The capacity to accept that ambiguity is part of clinical medicine and to recognize the need for and to utilize appropriate resources in dealing with uncertainty (PROF4)

Maintenance of professional integrity
  • Recognizes that he or she is a role model in all actions and behaviors at all times (PC4)

  • Serves as a role model for others in interdisciplinary work and is an excellent team leader (SBP4)

  • Others look to this person as a model of professional conduct (PROF1)

Capacity for reflective self-awareness and bias recognition
  • Has insight into one’s own assumptions and values that allow one to filter them out and focus on the patient/family values in a bidirectional conversation (PC3)

  • Routinely reflects both in action and on action (PC4)

  • Has excellent insight into self, and uses this information to promote and engage in professional behavior as well as to prevent lapses in others and self (PROF1)

Sense of self-efficacy to engage in challenging conversations
  • Is sought out as a role model for difficult conversations and mediator of disagreement (ICS1)

ICS= interpersonal and communication skills; PC= patient care; PROF= professionalism; SBP= systems-based practice.

Assessing the effectiveness of any educational intervention is paramount to ensuring observable change in participants and measuring impact. Kirkpatrick’s model is one of the most utilized methods of evaluation that consists of four levels of assessment: 1) Reaction (what was the learner’s response to the training?), 2) Learning (what did they learn as a result of the curriculum?), 3) Behavior (what is changing about the learner’s behavior as a result of this training?) and 4) Results (how is this curriculum impacting the learners, patients and/or institutions on a broader scale?).35 When looking at the effectiveness of communication skills training, many studies primarily explore levels 1 and 2; however, levels 3 and 4 remain paramount to identify an observable change in clinicians’ behavior in their daily practice.

Incorporating these frameworks provides a starting point for a curriculum or educational program for counseling at extreme prematurity. Such a program should emphasize multidisciplinary team in-situ simulation that is linked to the daily practice of counseling providers, with built-in critical reflection, debriefing, and program assessment. All together, this will provide a valuable and effective learning experience in addressing the ethical challenges in decision-making at extreme prematurity.

Current Educational Models and Innovation

While multiple methods of communication training for medical trainees have been described in the literature, the category is broad, and the evidence remains limited in effectiveness and endpoints.21 Studies have shown these skills can be taught effectively, although little has been published in neonatology, and even fewer explicitly focusing on clinician education surrounding decision-making at extreme prematurity. Current educational methods that involve communication and decision-making training that may apply to counseling providers are described here and summarized in Table 3. The optimal approach to teaching such skills will likely vary based on learner preferences and facility resources. Continued research into the efficacy of different models is necessary.

Table 3.

Current innovative educational methods for communication training

Source Educational Strategy Targeted Group Topic Conclusions/Findings Innovation
Lee et al. 201536 1-Hour Online module 3rd-year medical students Cultural competency + communication strategies Module improved cross-cultural communication skills Module paired with clinically oriented assignment and evaluation
Boss et al. 201339 3-day retreat with didactic session and role play Neonatal Fellows and Nurse Practitioners (NPs) Neonatal Critical Care Communication (NC3) Increased clinicians’ self-perceived competence in communication Fellow-nurse practitioner collaboration
Meyer et al. 201126 6-hour workshops Physicians, Nurses, Social Workers, Psychologists, Chaplains, and Medical Interpreters Program to Enhance Relational Communication (PERCS) Improvements in self-perceived competence and preparation for difficult conversations Multidisciplinary involvement, relational learning framework
Parham et al. 201940 7 independent workshops with module pre-work Neonatal fellows Critical care communication Increased fellows’ self-perceived preparedness in selected core competencies in communication Family members as faculty and educators
Boss et al. 201241 Single simulation with debriefing Attending physicians and fellows Decision-making during a prenatal consult Simulation reproduced the decisional context of prenatal counseling Use of simulation to study decision-making at extreme prematurity
Bowen et al. 202027 4.5-hour simulation-based workshop NPs Difficult conversations Increase in use of communication skills and perceived empathy scores Randomized trial, targeted towards NPs
Motz et al. 201848 Virtual standardized patient simulator Neonatal physicians and NPs Emotional recognition and empathy High level of emotion recognition in virtual simulator Simulated prenatal consultations using virtual standardized patients
Kukora et al. 202051 3-hour workshop Medical students, pediatric subspecialty fellows, NPs, and attendings Bad news disclosure Enhanced self-efficacy in bad news communication Improv-based exercise

Online Modules

Online modules provide interactive content with the benefit of flexibility, allowing for asynchronous learning, lower long-term cost, and potential for broad dissemination. Online modules allow for the virtual delivery of high-quality educational content to a large audience, even nationally or globally, and bridge the gap for institutions that lack the time and/or resources to achieve a high-quality curriculum. Online modules that are interactive and incorporate learner participation and skills evaluations have been shown to be effective in changing clinician behavior.36 Finally, online learning can be enhanced with in-person education, when feasible, through a subsequent facilitated session in a “flipped classroom” approach, in order to amplify the online experience and solidify skills. At this time, there is only one specific online module dedicated to teaching clinicians skills in counseling at prematurity, while others addressing advanced communication skills are limited by the lack of interdisciplinary approach.37

Role Play and Simulation

Simulation is a well-recognized method for experiential learning and has been shown to reliably elicit authentic physician behaviors.38 Simulation may also minimize the burden to vulnerable groups of patients, which may be particularly useful for trainees or inexperienced learners. A robust body of research confirms that role-play and simulation improve clinician confidence and preparation to engage in complex conversations with patients and families, both immediately and over time.26,27,39 Successful communication skills simulation training and role-plays allow trainees to safely practice a range of communication skills with real-time feedback from “parents” (who may be standardized patients, actors, or trained volunteers) and from faculty. Training specific to the NICU that simulates counseling by individual clinicians and by interdisciplinary neonatal teams has been successful in demonstrating improvements in self-efficacy.26,39 Another novel approach uses trained family members of former patients as educators and standardized patient participants in a simulation-based curriculum surrounding difficult conversations in the NICU.40 The only study, to our knowledge, that used simulation to improve counseling and decision making at extreme prematurity demonstrated it was able to realistically reproduce the decisional conflicts found in prenatal counseling.41 Many of these training programs occur as intensive courses over 1–3 days, and/or episodically over months (Table 3), with adult learning theory favoring booster training or spaced repetition after the initial course to maintain competency.42

Virtual Patient and Virtual Reality Simulators

While simulation and standardized patient encounters have documented benefits, their use may be limited by accessibility and cost. Virtual patient simulators are evolving technologies that may represent an innovative method to enhance clinical communication skills with the advantage of flexibility to permit asynchronous learning while maintaining a similar emotional and behavioral response of the participant compared to standardized patient encounters.4347 One pilot study demonstrated the feasibility and potential utility of an emotionally expressive virtual perinatal counseling simulator in yielding valuable data on neonatology providers’ communication skills, including emotion recognition and empathy.48 Increasingly, medical professionals are gaining comfort with virtual reality training through required certification courses such as the Neonatal Resuscitation Program (NRP) through added virtual reality training to their platform.49 These technologies could be adapted for training clinicians in counseling at extreme prematurity through deliberate practice of communication skills and the potential to receive objective real-time feedback.

Medical Improvisation

Another innovative approach to teaching medical communication skills involves medical improvisation. Using improvisational theater techniques, clinicians are trained to quickly develop relationships, prepare for unpredictability, and learn to recognize and respond in the moment to changing circumstances.50,51 This approach is grounded in experiential learning and emphasizes many skills utilized in both improv and medical communication training, including adaptability, listening, empathy, and cooperation.50 Based on these methods, a few professional education programs demonstrated that medical improvisation training can help foster the communication skills that neonatologists need to empathetically communicate and connect with parents facing extremely premature delivery in rapidly shifting scenarios.3,50,51

Future Innovation and Research is Needed

While many of the educational strategies discussed offer promising results to train clinicians in skills needed to provide antenatal counseling and shared decision making, continued innovation is necessary.

Bias in Counseling

It is well established that clinician attitudes and biases may alter decision making and that framing and implicit biases may impact parental decisions during prenatal counseling.19,52 What is not known, is how to best teach clinicians the skills to recognize and balance their own preferences with parental authority. The possibility that physicians’ conscious preferences or unconscious biases may influence decision-making during periviable counseling has significant ethical implications, and future educational strategies and research must investigate how best to mitigate these biases during counseling.

Interdisciplinary & Interprofessional Counseling

In addition, despite recommendations from the American Academy of Pediatrics (AAP) and American College of Obstetrics and Gynecology (ACOG) that recommend joint specialty counseling, this is a rare occurrence in practice.1,53 Prenatal counseling by Maternal Fetal Medicine (MFM) and neonatology are often asynchronous, which can result in conflicting messages to families.2,54,55 Despite these recommendations and potential for poor communication, educational interventions to date have focused on single-specialty clinicians, ignoring the communication and collaboration required by MFM and Neonatology for optimal counseling at extreme prematurity.2 Future educational interventions should aim to unite MFM and Neonatology, and other healthcare professions, including social work, chaplaincy, and nursing into an interdisciplinary, interprofessional program to provide cohesive, personalized counseling at extreme prematurity for families. Combining this with a relational learning approach, clinicians should have the opportunity to observe and collaborate with their interdisciplinary colleagues for effective learning.24,26,31

Knowledge & Behavioral Assessment

There is also a need to develop and validate well-designed assessment tools to track competencies, both knowledge and performance, for trainees and faculty alike, and guide meaningful feedback on clinician communication, decision-making, and other ethical competencies described in Table 2.56,57 While there is a growing body of literature on communicative assessment tools, these tools are limited by relying solely on a single encounter and may be impacted by the role of bias in assessment.56,58 There remains a need to determine objective and evidence-based assessment strategies, particularly in ways that can assess shifts in clinician’s behavior in the long run.

Process Assessment & Patient-Centered Outcomes

Finally, there is little connection between research, teaching, and implementation of these teaching methodologies in practice to benefit patients and families, in other words, the impact of these strategies on patient-centered outcomes. Frameworks used for teaching and assessing counseling skills need to be studied to determine reliability and validity, to gauge their feasibility in clinical practice, and to ensure systematic and lasting implementation of the effects.21,59 Rather than acquiring a predefined skill set, future training programs need to view the transfer of skills as continuous in both the learner and the environment.59 This type of change is challenging as institutions may have “ethical cultures” that may reflect provider biases, influences of certain populations, or an interaction of many factors that may influence how easily or difficult a new behavior may be adopted.60 Studies that assess the impact of the educational interventions, using Kirkpatrick’s assessment levels 3 and 4, such as family understanding and perceptions of counseling and other patient-centered outcomes, will be crucial going forward to gauge ultimate efficacy.35

Conclusions

Counseling and decision-making with families facing possible delivery at the limits of viability involve complex ethical dilemmas, and the process can be emotionally exhausting and morally distressful for families and clinicians alike. Clinicians facilitating such decisions must possess the advanced communication and counseling skills needed to optimally assist families with these decisions. Educational programs dedicated to teaching these crucial competencies should incorporate adult learning theory and educational frameworks, rely on evidence-based methods, and assess for integration into clinical practice and the impact on patient-centered outcomes. There remains a great deal of research needed to accomplish this but with the engagement of perinatal healthcare clinicians across disciplines in such education and innovation, we can take the next step towards making a meaningful difference for our patients and families.

Funding Source:

Dr. Cummings is supported by a grant from the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) of the National Institutes of Health under award number R01HD094794 (CC PI). Dr. Sullivan is grateful for support from the NICHD of the National Institutes of Health under award number T32HD098061. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Disclosures:

C. Cummings is grateful for support by the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) of the National Institutes of Health under award number R01HD094794 (CC PI). A. Sullivan is grateful for support from the NICHD of the National Institutes of Health under award number T32HD098061. The authors report no other proprietary or commercial interest in any product mentioned or concept discussed in this article.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

  • 1.Raju TNK, Mercer BM, Burchfield DJ, Joseph GF. Periviable birth: Executive summary of a Joint Workshop by the Eunice Kennedy Shriver National Institute of Child Health and Human Development, Society for Maternal-Fetal Medicine, American Academy of Pediatrics, and American College of Obstetricians and. J Perinatol. 2014;34(5):333–342. doi: 10.1038/jp.2014.70 [DOI] [PubMed] [Google Scholar]
  • 2.Arzuaga BH, Cummings CL. Practices and education surrounding anticipated periviable deliveries among neonatal-perinatal medicine and maternal-fetal medicine fellowship programs. J Perinatol. 2016;36(9):699–703. doi: 10.1038/jp.2016.68 [DOI] [PubMed] [Google Scholar]
  • 3.Stokes TA, Watson KL, Boss RD. Teaching antenatal counseling skills to neonatal providers. Semin Perinatol. 2014;38(1):47–51. doi: 10.1053/j.semperi.2013.07.008 [DOI] [PubMed] [Google Scholar]
  • 4.Boss RD, Hutton N, Sulpar LJ, West AM, Donohue PK. Values Parents Apply to Decision-Making Regarding Delivery Room Resuscitation for High-Risk Newborns. Pediatrics. 2008;122(3):583–589. doi: 10.1542/peds.2007-1972 [DOI] [PubMed] [Google Scholar]
  • 5.Kukora SK, Boss RD. Values-based shared decision-making in the antenatal period. Semin Fetal Neonatal Med. 2018;23(1):17–24. doi: 10.1016/j.siny.2017.09.003 [DOI] [PubMed] [Google Scholar]
  • 6.Bastek TK, Richardson DK, Zupancic JAF, Burns JP. Prenatal consultation practices at the border of viability: A regional survey. Pediatrics. 2005;116(2):407–413. doi: 10.1542/peds.2004-1427 [DOI] [PubMed] [Google Scholar]
  • 7.Payot A, Gendron S, Lefebvre F, Doucet H. Deciding to resuscitate extremely premature babies: How do parents and neonatologists engage in the decision? Soc Sci Med. 2007;64(7):1487–1500. doi: 10.1016/j.socscimed.2006.11.016 [DOI] [PubMed] [Google Scholar]
  • 8.Stokes TA, Kukora SK, Boss RD. Caring for Families at the Limits of Viability: The Education of Dr Green. Clin Perinatol. 2017;44(2):447–459. doi: 10.1016/j.clp.2017.01.007 [DOI] [PubMed] [Google Scholar]
  • 9.Haward MF, Janvier A. An introduction to behavioural decision-making theories for paediatricians. Acta Paediatr Int J Paediatr. 2015;104(4):340–345. doi: 10.1111/apa.12948 [DOI] [PubMed] [Google Scholar]
  • 10.Lantos JD. Ethical Problems in Decision Making in the Neonatal ICU. Longo DL, ed. N Engl J Med. 2018;379(19):1851–1860. doi: 10.1056/NEJMra1801063 [DOI] [PubMed] [Google Scholar]
  • 11.Haward MF, Gaucher N, Payot A, Robson K, Janvier A. Personalized Decision Making: Practical Recommendations for Antenatal Counseling for Fragile Neonates. Clin Perinatol. 2017;44(2):429–445. doi: 10.1016/j.clp.2017.01.006 [DOI] [PubMed] [Google Scholar]
  • 12.Sullivan A, Cummings C. Historical Perspectives: Shared Decision Making in the NICU. Neoreviews. 2020. doi: 10.1542/neo.21-4-e217 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Zupancic JAF. Characterising doctor-parent communication in counselling for impending preterm delivery. Arch Dis Child - Fetal Neonatal Ed. 2002;87(2):113F–117. doi: 10.1136/fn.87.2.f113 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Guillén Ú, Mackley A, Laventhal N, et al. Evaluating the Use of a Decision Aid for Parents Facing Extremely Premature Delivery: A Randomized Trial. J Pediatr. 2019;209:52–60.e1. doi: 10.1016/j.jpeds.2019.02.023 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.McKenzie F, Robinson BK, Tucker Edmonds B. Do maternal characteristics influence maternal-fetal medicine physicians’ willingness to intervene when managing periviable deliveries? J Perinatol. 2016. doi: 10.1038/jp.2016.15 [DOI] [PubMed] [Google Scholar]
  • 16.Lemyre B, Moore G. Counselling and management for anticipated extremely preterm birth. Paediatr Child Heal. 2017. doi: 10.1093/pch/pxx058 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Kunkel MD, Downs SM, Edmonds BT. Influence of Maternal Factors in Neonatologists’ Counseling for Periviable Pregnancies. Am J Perinatol. 2017. doi: 10.1055/s-0037-1598247 [DOI] [PubMed] [Google Scholar]
  • 18.Edmonds BT, McKenzie F, Fadel WF, et al. Using simulation to assess the influence of race and insurer on shared decision making in periviable counseling. Simul Healthc. 2014. doi: 10.1097/SIH.0000000000000049 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Haward MF, Murphy RO, Lorenz JM. Message framing and perinatal decisions. Pediatrics. 2008;122(1):109–118. doi: 10.1542/peds.2007-0620 [DOI] [PubMed] [Google Scholar]
  • 20.Tucker Edmonds B, Hoffman SM, Laitano T, Jeffries E, Jager S, Kavanaugh K. Diverse perspectives on death, disability, and quality of life: an exploratory study of racial differences in periviable decision-making. J Perinatol. 2021;41:396–403. doi: 10.1038/s41372-020-0739-5 [DOI] [PubMed] [Google Scholar]
  • 21.Deveugele M Communication training: Skills and beyond. Patient Educ Couns. 2015;98(10):1287–1291. doi: 10.1016/j.pec.2015.08.011 [DOI] [PubMed] [Google Scholar]
  • 22.Boss RD, Hutton N, Donohue PK, Arnold RM. Neonatologist Training to Guide Family Decision Making for Critically Ill Infants. Arch Pediatr Adolesc Med. 2009;163(9):783. doi: 10.1001/archpediatrics.2009.155 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Truog RD, Brown SD, Browning D, et al. Microethics: The ethics of everyday clinical practice. Hastings Cent Rep. 2015;45(1):11–17. doi: 10.1002/hast.413 [DOI] [PubMed] [Google Scholar]
  • 24.Browning DM, Meyer EC, Truog RD, Solomon MZ. Difficult conversations in health care: Cultivating relational learning to address the hidden curriculum. Acad Med. 2007;82(9):905–913. doi: 10.1097/ACM.0b013e31812f77b9 [DOI] [PubMed] [Google Scholar]
  • 25.Browning DM, Solomon MZ. Relational Learning in Pediatric Palliative Care: Transformative Education and the Culture of Medicine. Child Adolesc Psychiatr Clin N Am. 2006;15(3):795–815. doi: 10.1016/j.chc.2006.03.002 [DOI] [PubMed] [Google Scholar]
  • 26.Meyer EC, Brodsky D, Hansen AR, Lamiani G, Sellers DE, Browning DM. An interdisciplinary, family-focused approach to relational learning in neonatal intensive care. J Perinatol. 2011;31(3):212–219. doi: 10.1038/jp.2010.109 [DOI] [PubMed] [Google Scholar]
  • 27.Bowen R, Lally KM, Pingitore FR, Tucker R, McGowan EC, Lechner BE. A simulation based difficult conversations intervention for neonatal intensive care unit nurse practitioners: A randomized controlled trial. PLoS One. 2020;15(3):1–12. doi: 10.1371/journal.pone.0229895 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Kelly C David Kolb, the theory of experiential learning and ESL. Internet TESL J. 1997. [Google Scholar]
  • 29.Kolb DA, Boyatzis RE, Mainemelis C. Experiential learning theory: Previous research and new directions. In: Perspectives on Thinking, Learning, and Cognitive Styles.; 2014. doi: 10.4324/9781410605986-9 [DOI] [Google Scholar]
  • 30.Stocker M, Burmester M, Allen M. Optimisation of simulated team training through the application of learning theories: A debate for a conceptual framework. BMC Med Educ. 2014;14(1):1–9. doi: 10.1186/1472-6920-14-69 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Lamiani G, Meyer EC, Browning DM, Brodsky D, Todres ID. Analysis of enacted difficult conversations in neonatal intensive care. J Perinatol. 2009;29(4):310–316. doi: 10.1038/jp.2008.228 [DOI] [PubMed] [Google Scholar]
  • 32.Epstein RM, Hundert EM. Defining and assessing professional competence. J Am Med Assoc. 2002;287(2):226–235. doi: 10.1001/jama.287.2.226 [DOI] [PubMed] [Google Scholar]
  • 33.The Pediatrics Subspecialty Milestone Project. The Accreditation Council for Graduate Medical Education and the American Board of Pediatrics. https://acgme.org/Portals/0/PDFs/Milestones/PediatricsSubspecialtyMilestones.pdf. Accessed March 22, 2021.
  • 34.Cummings CL. Teaching and assessing ethics in the newborn ICU. Semin Perinatol. 2016;40(4):261–269. doi: 10.1053/j.semperi.2015.12.016 [DOI] [PubMed] [Google Scholar]
  • 35.Kirkpatrick D, Kirkpatrick J. Implementing the Four Levels : A Practical Guide for Effective Evaluation of Training Programs. 1st ed. San Francisco: Berrett-Koehler Publishers; 2007. [Google Scholar]
  • 36.Lee AL, Mader EM, Morley CP. Teaching cross-cultural communication skills online: A multi-method evaluation. Fam Med. 2015;47(4):302–308. [PubMed] [Google Scholar]
  • 37.Cummings C, Geis G. Ethics and Professionalism in Neonatology Year 1: Delivery Room Consultation at the Limits of Viability - Relational Competance and Shared Decisions. OpenPediatrics. http://www.openpediatrics.org. Published 2017. Accessed May 23, 2021. [Google Scholar]
  • 38.Zabar S, Ark T, Gillespie C, et al. Can unannounced standardized patients assess professionalism and communication skills in the Emergency Department? Acad Emerg Med. 2009. doi: 10.1111/j.1553-2712.2009.00510.x [DOI] [PubMed] [Google Scholar]
  • 39.Boss RD, Urban A, Barnett MD, Arnold RM. Neonatal Critical Care Communication (NC3): Training NICU physicians and nurse practitioners. J Perinatol. 2013;33(8):642–646. doi: 10.1038/jp.2013.22 [DOI] [PubMed] [Google Scholar]
  • 40.Parham D, Reed D, Olicker A, et al. Families as educators: a family-centered approach to teaching communication skills to neonatology fellows. J Perinatol. 2019;39(10):1392–1398. doi: 10.1038/s41372-019-0441-7 [DOI] [PubMed] [Google Scholar]
  • 41.Boss RD, Donohue PK, Roter DL, Larson SM, Arnold RM. This is a decision you have to make : Using simulation to study prenatal counseling. Simul Healthc. 2012;7(4):207–212. doi: 10.1097/SIH.0b013e318256666a [DOI] [PubMed] [Google Scholar]
  • 42.Sullivan A, Elshenawy S, Ades A, Sawyer T. Acquiring and Maintaining Technical Skills Using Simulation: Initial, Maintenance, Booster, and Refresher Training. Cureus. 2019;11(9):1–8. doi: 10.7759/cureus.5729 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Consorti F, Mancuso R, Nocioni M, Piccolo A. Efficacy of virtual patients in medical education: A meta-analysis of randomized studies. Comput Educ. 2012. doi: 10.1016/j.compedu.2012.04.017 [DOI] [Google Scholar]
  • 44.Real FJ, DeBlasio D, Beck AF, et al. A Virtual Reality Curriculum for Pediatric Residents Decreases Rates of Influenza Vaccine Refusal. Acad Pediatr. 2017. doi: 10.1016/j.acap.2017.01.010 [DOI] [PubMed] [Google Scholar]
  • 45.O’Rourke SR, Branford KR, Brooks TL, Ives LT, Nagendran A, Compton SN. The Emotional and Behavioral Impact of Delivering Bad News to Virtual versus Real Standardized Patients: A Pilot Study. Teach Learn Med. 2020. doi: 10.1080/10401334.2019.1652180 [DOI] [PubMed] [Google Scholar]
  • 46.Andrade AD, Bagri A, Zaw K, Roos BA, Ruiz JG. Avatar-mediated training in the delivery of bad news in a virtual world. J Palliat Med. 2010. doi: 10.1089/jpm.2010.0108 [DOI] [PubMed] [Google Scholar]
  • 47.Hamilton G, Ortega R, Hochstetler V, Pierson K, Lin P, Lowes S. Teaching communication skills to hospice teams: Comparing the effectiveness of a communication skills laboratory with in-person, second life, and phone role-playing. Am J Hosp Palliat Med. 2014;31(6):611–618. doi: 10.1177/1049909113504481 [DOI] [PubMed] [Google Scholar]
  • 48.Motz P, Gray M, Sawyer T, et al. Virtual antenatal encounter and standardized simulation assessment (VANESSA): Pilot study. J Med Internet Res. 2018;20(5):1–9. doi: 10.2196/games.9611 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Sawyer T, Umoren RA, Gray MM. Neonatal resuscitation: Advances in training and practice. Adv Med Educ Pract. 2017;8:11–19. doi: 10.2147/AMEP.S109099 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Watson K Perspective: Serious play: Teaching medical skills with improvisational theater techniques. Acad Med. 2011;86(10):1260–1265. doi: 10.1097/ACM.0b013e31822cf858 [DOI] [PubMed] [Google Scholar]
  • 51.Kukora SK, Batell B, Umoren R, et al. Hilariously Bad News: Medical Improv as a Novel Approach to Teach Communication Skills for Bad News Disclosure. Acad Pediatr. 2020;20(6):879–881. doi: 10.1016/j.acap.2020.05.003 [DOI] [PubMed] [Google Scholar]
  • 52.Shapiro N, Wachtel EV., Bailey SM, Espiritu MM. Implicit Physician Biases in Periviability Counseling. J Pediatr. 2018. doi: 10.1016/j.jpeds.2018.01.070 [DOI] [PubMed] [Google Scholar]
  • 53.Reed R, Grossman T, Askin G, Gerber LM, Kasdorf E. Joint periviability counseling between neonatology and obstetrics is a rare occurrence. J Perinatol. 2020;40(12):1789–1796. doi: 10.1038/s41372-020-00796-8 [DOI] [PubMed] [Google Scholar]
  • 54.Tucker Edmonds B, Mckenzie F, Panoch JE, Barnato AE, Frankel RM. Comparing obstetricians’ and neonatologists’ approaches to periviable counseling. J Perinatol. 2015;35(5):344–348. doi: 10.1038/jp.2014.213 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Guinsburg R, Branco De Almeida MF, Dos Santos Rodrigues Sadeck L, et al. Proactive management of extreme prematurity: Disagreement between obstetricians and neonatologists. J Perinatol. 2012;32(12):913–919. doi: 10.1038/jp.2012.28 [DOI] [PubMed] [Google Scholar]
  • 56.Daboval T, Ward N, Schoenherr JR, et al. Testing a communication assessment tool for ethically sensitive scenarios: Protocol of a validation study. JMIR Res Protoc. 2019;8(5). doi: 10.2196/12039 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Cummings CL, Geis GM, Feldman HA, Berson ER, Kesselheim JC. Assessing Ethics Knowledge: Development of a Test of Ethics Knowledge in Neonatology. J Pediatr. 2018;199:57–64. doi: 10.1016/j.jpeds.2018.04.004 [DOI] [PubMed] [Google Scholar]
  • 58.Calhoun AW, Rider EA, Meyer EC, Lamiani G, Truog RD. Assessment of communication skills and self-appraisal in the simulated environment: Feasibility of multirater feedback with gap analysis. Simul Healthc. 2009;4(1):22–29. doi: 10.1097/SIH.0b013e318184377a [DOI] [PubMed] [Google Scholar]
  • 59.Van Den Eertwegh V, van Dulmen S, van Dalen J, Scherpbier AJJA, van der Vleuten CPM. Learning in context: Identifying gaps in research on the transfer of medical communication skills to the clinical workplace. Patient Educ Couns. 2013;90(2):184–192. doi: 10.1016/j.pec.2012.06.008 [DOI] [PubMed] [Google Scholar]
  • 60.Hellmann J, Knighton R, Lee SK, et al. Neonatal deaths: Prospective exploration of the causes and process of end-of-life decisions. Arch Dis Child Fetal Neonatal Ed. 2016. doi: 10.1136/archdischild-2015-308425 [DOI] [PubMed] [Google Scholar]

RESOURCES