Abstract
Introduction
Under five mortality rates (UFMR) remain high for children in low- and middle-income countries (LMICs) in the developing world. Education for practitioners in these environments is a key factor to improve outcomes that will address United Nations Sustainable Development Goals 3 and 10 (good health and well being and reduced inequalities). In order to appropriately contextualize a curriculum using simulation, it is necessary to first conduct a needs assessment of the target learner population. The World Health Organization (WHO) has published a tool to assess capacity for emergency and surgical care in LMICs that is adaptable to this goal.
Materials and methods
The WHO Tool for Situational Analysis to Assess Emergency and Essential Surgical Care was modified to assess pediatric resuscitation capacity in clinical settings in two LMICs: Uganda and Myanmar. Modifications included assessment of self-identified learning needs, current practices, and perceived epidemiology of disease burden in each clinical setting, in addition to assessment of pediatric resuscitation capacity in regard to infrastructure, procedures, equipment, and supplies. The modified tool was administered to 94 respondents from the two settings who were target learners of a proposed simulation-based curriculum in pediatric and neonatal resuscitation.
Results
Infectious diseases (respiratory illnesses and diarrheal disease) were cited as the most common causes of pediatric deaths in both countries. Self-identified learning needs included knowledge and skill development in pediatric airway/breathing topics, as well as general resuscitation topics such as CPR and fluid resuscitation in shock. Equipment and supply availability varied substantially between settings, and critical shortages were identified in each setting. Current practices and procedures were often limited by equipment availability or infrastructural considerations.
Discussion and conclusion
Epidemiology of disease burden reported by respondents was relatively consistent with WHO country-specific UFMR statistics in each setting. Results of the needs assessment survey were subsequently used to refine goals and objectives for the simulation curriculum and to ensure delivery of pragmatic educational content with recommendations that were contextualized for local capacity and resource availability. Effective use of the tool in two different settings increases its potential generalizability.
Keywords: pediatric resuscitation, simulation-based training, limited-resource settings, pediatric critical care, needs assessment, neonatal resuscitation, developing countries, PIPES tool
Introduction
Globally, 5.6 million children under the age of 5 years died in 2016 (1). Since 1990, early childhood mortality has decreased substantially around the world, from 98 to 41 of every 1,000 live births. However, this rate remains much higher than the United Nations Sustainable Development Goal target of 25/1,000, and significant progress is needed to achieve this objective (2, 3). For the past two decades, it has been recognized that a multitude of factors contribute to potentially preventable child deaths in low- and middle-income countries (LMICs) (4). One thing that has not changed among these factors is the lack of high quality and contextually appropriate educational curricula to teach provision of care to critically ill children in these settings.
The World Health Organization (WHO) has developed the integrated management of childhood illness (IMCI) strategy and the emergency triage assessment and treatment (ETAT) guidelines for use in resource-limited settings (5, 6). Despite the demonstrated feasibility and success of some of these initiatives in LMICs (7), adherence to these guidelines by medical providers is highly variable (8, 9). Provider education has been shown to improve quality of care, but even among trained providers, performance remains suboptimal, suggesting the need for additional educational reinforcement (10).
For this reason, effective resuscitation education programs are needed in LMICs. Some training programs have been designed specifically for use in resource-limited settings, such as the Helping Babies Breathe (HBB) and Helping Mothers Survive (HMS) Bleeding after Birth initiatives (11–16). However, other resuscitation courses, such as the American Heart Association (AHA) Pediatric Advanced Life Support (PALS) and Pediatric Emergency Assessment Recognition and Stabilization (PEARS), have not been fully adapted for use in resource-limited settings. This has led many investigators to undertake these adaptations on an individual basis, often without a clear process to guide their efforts (17). However, “contextualized training,” defined as “local adaptation of training, utilizing existing and sustainable resources for both care and training,” has been associated with increases in provider confidence and short-term knowledge retention (18).
Contextualization of training requires rigorous understanding of the target learners and local clinical environment. In the curriculum development process, this understanding is gained through a needs assessment, which allows educators to ensure that curricula are appropriate and relevant to the target learner group (19). Needs assessment is particularly critical in international education, where epidemiology, resource availability, and practice standards vary widely (20). While several needs assessment surveys addressing critical care capacity have been described in the literature (21–25), there is presently no validated and comprehensive tool that is specific to pediatric resuscitation education in LMICs.
The WHO developed a tool in 2008 to measure surgical capacity (the Tool for Situational Analysis to Assess Emergency and Essential Surgical Care) (26), which has been validated and used in more than 10 LMICs (27–37). It was subsequently modified to develop a survey for specific facilities based on personnel, infrastructure, procedures, equipment, and supplies (PIPES) (38). PIPES has been used with further modifications to assess pediatric surgical capacity in 37 hospitals in West Africa (PediPIPES) (39).
In order to garner information needed to develop an appropriately contextualized pediatric resuscitation curriculum for use in two LMIC settings, we adapted the PIPES and PediPIPES to construct a novel needs assessment tool. Our immediate goal in developing this new tool was to evaluate local pediatric emergency care capacity, resources, and practices (PIPES), as well as perceived causes of pediatric morbidity and mortality, and self-assessed educational needs of target learners. Our ultimate goal, however, was to identify curricular adaptations needed to ensure relevance, feasibility, and appropriateness of educational content to the target setting in which pediatric resuscitation education is to be conducted. This process enabled us to implement fully contextualized curricula in two very different international venues.
Materials and Methods
Tool Development
The original PIPES tool has 105 data items divided into five sections and functions as a scoring tool to compare the surgical capacity of different health-care facilities by calculating the PIPES Index (26, 38). The index can be calculated by tallying the total scores obtained in the survey. The Personnel section queries the total number of key practitioners (e.g., surgeons). The infrastructure, procedures, equipment and supplies sections have a binary response system of either “Always Available” versus “Not Always Available” or “Done” versus “Not Done.”
We modified the PIPES tool in order to assess the pediatric medical resuscitation capacity of health-care facilities in resource-limited settings. As our tool was to be used for contextualization of a curriculum as opposed to rating facility capacity, we omitted the scoring component of the tool and replaced it with qualitative open-ended questions in order to garner more details about the hospital environments. We omitted items that were specific to surgical capacity and added items relevant to pediatric medical resuscitation. We also replaced the binary response system with a three-option response system (i.e., always available, usually available or seldom/never available) in order to account for potential variability in the availability of resources at different sites. Finally, we omitted the “Personnel” section, as this was specific to measuring overall hospital operational capacity and was less relevant for the curriculum development process.
In order to ensure that our curriculum addressed clinical topics of importance to our learners, we added a Section “Epidemiology.” In this section, we queried the most common causes of potentially preventable death among children in the local practice setting. We also queried survey respondents to elucidate their perceived learning needs and prior pediatric resuscitation training and experience. We also added a Section “Current Practices/Skills,” which used a five-point Likert scale to measure the confidence of survey respondents in managing emergency clinical scenarios and performing emergency procedures (see Appendix S1 in Supplementary Material for final iteration of tool used in the study—the PIPES Tool for Assessment of Pediatric Resuscitation Capacity in LMIC).
Tool Implementation
Study Settings
We implemented our needs assessment tool at two locations: Yangon Children’s Hospital (YCH) in Yangon, Myanmar and Makerere University College of Health Sciences (MUCHS) in Kampala, Uganda. The study proposal was reviewed by the Institutional Review Board (IRB) of Johns Hopkins University School of Medicine and was considered to be exempt. In addition, local site approval to conduct the study was obtained from the ethics board and/or training committee leadership at both YCH and MUCHS. The two study sites were selected for convenience reasons, due to existing institutional partnerships.
Study Participants
At YCH in Myanmar, intended study participants consisted of first, second, and third year postgraduate trainees in Pediatrics, as well as a group of general practitioners pursuing a 1-year Diploma in Child Health course. At MUCHS, intended study participants consisted of second and third year postgraduate trainees in Pediatrics.
Data Collection
The needs assessment survey was administered to all participants immediately prior to the start of a resuscitation course. The paper-based survey was administered in person at both sites.
Data Analysis and Use of Results
Results were analyzed using simple descriptive statistics in Microsoft Excel. Results were used to make modifications to the planned curriculum as needed in order to appropriately contextualize the content in each setting. Of note, the investigators completed multiple phone meetings with local stakeholders as well as in-person visits to both sites prior to administration of the survey. This process allowed development of the majority of the curriculum in advance of the needs assessment survey. Survey results were then used in an iterative fashion to “fine-tune” and modify the curriculum at subsequent sites in order to optimize feasibility of recommendations and relevance to the local clinical context.
Results
A total of 94 participants completed the pre-course needs assessment survey, 62 in Myanmar and 32 in Uganda (100% response rate). Age range of respondents was 25–40 years. 74% of respondents were in their second or third postgraduate year of pediatric specialty training. Further results are presented below by category.
Infrastructure
At both sites, most infrastructure items were described as being “always” or “usually” available by the majority of respondents. The one exception was ventilators at the Uganda site, which were described as “seldom/never” available by 88%. Compared to Uganda, respondents in Myanmar reported more variability in availability of electricity. The vast majority at both sites reported they “always” or “usually” had access to specialized services including blood bank, intensive care, and medical records. While no respondents described oxygen as “seldom/never” available, it is notable that only 50% in Uganda and 77% in Myanmar described it as “always” available. Access to diagnostic testing was limited at both sites. X-ray was the most commonly available imaging modality, cited as “always available” by 44% in Uganda and 61% in Myanmar. Laboratory services and advanced imaging were described as “usually” or “seldom” available by a majority at both sites. Ventilators were much more available in Myanmar compared to Uganda (see Figure 1).
Procedures
Peripheral intravenous access was the only procedure described as being performed “routinely” at both sites. In Uganda, 70% of respondents reported that intraosseous access was performed “routinely,” compared to Myanmar where 83% indicated that this procedure was performed “rarely.” Over half of respondents at both sites described administering epinephrine “routinely.” In Myanmar, a similar number reported “routinely” administering vasopressor infusions, while this proportion was much smaller in Uganda. At both sites, a sizeable minority of respondents described use of atropine and antiarrhythmics as routine. Chest tube placement was the most commonly performed invasive procedure, with a majority at both sites describing it as routine. Intubation was much more common in Myanmar than in Uganda, with 40% of respondents indicating that they perform this procedure “routinely” in Myanmar compared to only 3% in Uganda. Central venous access, arterial line placement and electrical therapies for the heart were rare in both settings (see Figure 2).
Equipment
Most respondents at both sites reported that noninvasive respiratory support equipment was “always” or “usually” available, including oxygen delivery devices, bag-valve-mask ventilation devices, and continuous positive airway pressure systems. Diagnostic equipment like pulse oximeters, blood pressure cuffs, electrocardiogram machines, and glucometers were much more readily available in Myanmar than Uganda, where access to these items was extremely limited. Respondents from both sites reported limited access to cardiac monitors, with only 19% in Uganda and 37% in Myanmar reporting them as “always available.” Respondents in Myanmar reported better availability of advanced airway adjuncts compared to those in Uganda, although access to these items was suboptimal in both settings. Both sites reported very limited availability of quality CPR equipment like backboards and stepstools (see Figure 3).
Supplies
All respondents at both sites indicated that basic supplies like syringes, gloves, and intravenous catheters were “always” or “usually” available. While this was also true for intravenous fluids, a significant proportion at each site (34% in Uganda and 15% in Myanmar) indicated that this essential supply is not always available. Similarly, infant suction bulbs were not uniformly available at either site. Both sites reported a lack of access to intraosseous needles, with 66% in Uganda and 27% in Myanmar reporting that these are “seldom/never” available. Higher-level procedural equipment was relatively unavailable in both settings, with endotracheal tubes more readily available than invasive vascular access devices and chest tubes (see Figure 4).
Epidemiology
Infectious diseases were listed as the predominant cause of preventable death in children at both the Myanmar and Uganda sites (see Figure 5). Specifically, respiratory infections occupied the top position at both sites, and gastrointestinal diseases were also common. Differences in local epidemiology were seen between the two sites, as malaria was frequently cited as a major cause of preventable death in Uganda but was rarely noted in Myanmar. Sepsis, on the other hand, was frequently cited in Myanmar but not in Uganda.
Self-Identified Learning Needs
At the Myanmar site, the three most commonly cited learning needs were in the categories of airway/breathing management (28% of respondents), circulation/fluid resuscitation (22%), and cardiac arrest management (16%). Within each of these categories, the most frequently cited learning needs were intubation (54%), intraosseous needle (IO) placement (65%), and defibrillation/cardioversion (38%). At the Uganda site, the three most commonly cited learning needs were in the categories of general resuscitation principles (27%), cardiac arrest management (22%), and circulation/fluid resuscitation (19%). Within each of these categories, the most frequently cited learning needs were basic neonatal/pediatric resuscitation topics (65%), defibrillation/cardioversion (33%), and central venous cannulation (17%).
Pediatric Resuscitation Experience
At the Uganda site, 87.5% of participants stated that they had prior formal training in pediatric resuscitation, 75% of whom stated that the course involved either simulation or hands-on skills practice. At the Myanmar site, only 63% of participants stated that they had prior training, only 50% of whom reported simulation or hands-on skills practice as part of this training. 97% of participants in Uganda indicated that they managed critically ill children either “daily” or “regularly,” compared to only 48% in Myanmar (see Table 1).
Table 1.
Myanmar, % respondents | Uganda, % respondents | |
---|---|---|
Daily (4 or more times per week) | 8 | 75 |
Regularly (1–2 times per week) | 40 | 22 |
Occasionally (1–2 times per month) | 40 | 0 |
Rarely (1–2 times per year) | 3 | 0 |
No response | 9 | 3 |
Current Practices/Skills
The clinical scenarios that participants reported the greatest confidence in managing were similar at both sites: respiratory distress and shock. The clinical scenarios that the participants were “least confident” managing were also similar: cardiac arrest and pneumothorax. See Table 2 for detailed results. Participants in Uganda reported higher confidence overall compared to those in Myanmar.
Table 2.
Uganda, mean Likert Score (SD) | Myanmar, mean Likert Score (SD) | |
---|---|---|
Bradycardia | 3.7 (0.9) | 3.4 (1.2) |
Cardiac arrest | 3.2 (1.0) | 2.3 (1.2) |
Decreased level of consciousness | 4.2 (0.8) | 3.4 (1.0) |
Hypoxia | 4.0 (0.7) | 3.6 (0.9) |
Respiratory distress | 4.3 (0.7) | 3.6 (0.9) |
Seizures | 4.4 (0.6) | 3.7 (1.0) |
Shock | 4.3 (0.6) | 3.8 (0.9) |
Tachycardia | 3.6 (1.0) | 3.4 (1.2) |
Likert scale consisted of numeric options ranging from 1 to 5:1 = “Not at all confident” 3 = “Somewhat confident” and 5 = “Very confident.”
The procedures that the participants reported highest confidence in performing were the same at both sites, with differences only in rank order: airway assessment, breathing assessment, circulation assessment, and IV placement. The procedures that the participants were least confident performing also had some similarities between the sites. Participants at both sites were not confident performing central line placement, defibrillation/cardioversion, and intubation. See Table 3 for detailed results.
Table 3.
Uganda, mean (SD) | Myanmar, mean (SD) | |
---|---|---|
Airway assessment | 4.2 (0.7) | 4.0 (0.9) |
Breathing assessment | 4.3 (0.7) | 4.0 (0.9) |
BVM ventilation | 4.0 (0.8) | 3.8 (0.9) |
Central line placement | 1.9 (1.3) | 1.3 (0.8) |
Circulation assessment | 4.3 (0.8) | 4.0 (0.9) |
CPR | 3.9 (0.7) | 3.7 (0.9) |
Defibrillation/cardioversion | 1.4 (0.7) | 1.4 (0.8) |
EKG or cardiac rhythm interpretation | 2.1 (1.1) | 2.9 (0.8) |
Intraosseous line placement | 4.2 (1.0) | 2.4 (1.3) |
Intubation | 2.1 (1.1) | 2.1 (1.0) |
IV placement | 4.6 (0.6) | 3.9 (1.0) |
Likert scale consisted of numeric options ranging from 1 to 5:1 = “Not at all confident” 3 = “Somewhat confident” and 5 = “Very confident.”
Discussion
Our modified PIPES tool was administered to a group of physician learners in Myanmar and Uganda as part of a needs assessment process for the design and implementation of a contextualized curriculum in pediatric resuscitation using simulation-based pedagogy. We were able to achieve a 100% response rate to the needs assessment survey, which was achievable due to in-person administration of the survey immediately prior to the start of the course. As the purpose of collecting these data was to inform the curriculum development process, we reviewed the results with the goal of optimally contextualizing our training program to each setting. While it would be impossible to exhaustively describe every curricular adaptation made in each setting, Table 4 offers several key examples of how these data were used to optimize applicability of our educational content for the target learner groups.
Table 4.
Finding | Action |
---|---|
Absence of ventilators and laryngoscopes in Uganda | Focused on effective noninvasive ventilation and omitted advanced airway skills from curriculum at this site |
Limited access to cardiac monitors at both sites | Emphasized frequent clinical reassessment to determine response to treatment and trajectory of condition |
Variable access to diagnostic support tools, including pulse oximetry, blood pressure cuffs, glucometers, and laboratory services (particularly in Uganda) | Emphasized established clinical criteria for empiric administration of oxygen, IV fluid, glucose, and blood products (major focus of training in Uganda) |
Rare performance of cardioversion or defibrillation at either site (related to lack of defibrillators) | Despite participants’ self-identified learning needs, chose to omit these skills from curriculum at both sites |
Lack of availability of intraosseous needles at both sites | Addressed improvization of equipment for intraosseous access when needed |
Relatively lower confidence in intraosseous needle placement in Myanmar | Spent additional time on this skill at this site |
Relatively lower confidence in CPR performance at both sites | Allotted significant time to this skill at both sites, and incorporated CPR quality feedback tools to optimize learner performance |
Frequent mortality associated with malaria in Uganda | Added entire module about life-threatening complications of malaria for this site |
Frequent use of epinephrine at both sites | Emphasized alternate appropriate treatments, particularly respiratory support for bradycardia, and volume expansion for shock |
In applying our results from the needs assessment to refine the curriculum, we took into account a prior systematic review of resuscitation training in developing countries, which demonstrated that important educational outcomes are inconsistently defined and that training courses are often modified to available training resources, rather than to the needs and resources of the local health-care setting and patients (40). Training that is not tailored to local needs perpetuates a “common misconception that emergency medical care is inherently expensive and requires high-technology interventions as opposed to simple and effective strategies” (41). This needs assessment was an effort to facilitate essential contextualization of the curriculum in both settings. The process by which the needs assessment was used to tailor simulation scenarios and skills stations to the local settings and resource availability was analogous to the process used in similar studies in Africa that utilized a shorter assessment tool known as the facilities readiness assessment (18). The modified tool used in our study allowed for a more extensive evaluation of the local health-care resources specifically applicable to pediatric resuscitation and proved effective in understanding the local landscape of our target learners in both Uganda and Myanmar. Below, we highlight notable findings from the results and how they compare with what is already known in the literature.
Epidemiology—Local Disease Burden
The epidemiology section of the survey allowed us to determine if the national morbidity and mortality statistics provided by the WHO were reflected in the local pediatric population served by our target learners. In Myanmar, the majority of the causes of under five mortality rates (UFMR) listed in WHO national statistics were mentioned by survey respondents, although the ranking of diseases differed somewhat. One of the major differences was that in the 2013 WHO statistics, neonatal sepsis was listed as the seventh leading cause of death in Myanmar, whereas in our survey, it was the second most common response for preventable causes of mortality (see Figure 6). In Uganda, many of the causes of death listed in the WHO national statistics were also mentioned by the survey respondents, with rankings also differing somewhat (see Figure 7). Some important causes of death listed by WHO were not mentioned by survey respondents, including prematurity, HIV/AIDS, and injuries. Of note, our survey asked for causes of preventable death. Our Ugandan learners, working in a severely resource-constrained environment, may encounter these causes of death routinely, but simply not perceive them as preventable. Our curriculum ultimately incorporated both locally identified and WHO-cited causes of pediatric mortality. Our educational team felt strongly that it was important to design simulation scenarios targeting causes of UFMR identified through an emic or local perspective in order to enhance face validity of the curriculum with target learners.
Pediatric Resuscitation Training and Prior Clinical Exposure
The majority of participants at both local sites had some form of prior pediatric resuscitation training. Interestingly, this is in contrast with many other studies that have reported on baseline knowledge prior to training courses (40), perhaps because our survey was conducted at facilities that had formal residency training programs in pediatrics. Prior exposure to hands-on skills practice and/or simulation was more variable and differed between the two sites. In Myanmar, only one-third of participants had prior simulation-based resuscitation training, despite the fact that they resuscitate children on a fairly regular basis.
The percentage of survey participants who indicated that they managed critically ill children on a daily basis was significantly higher in Uganda compared to Myanmar, and this was reflected in the higher confidence scores reported by Ugandan participants. Participants at both sites reported frequent exposure to critically ill children, reinforcing the importance of formal training and frequent refreshers in pediatric and neonatal resuscitation skills for both cohorts of clinicians.
Self-Identified Learning Needs
Airway management was listed as a learning need for a significant percentage of participants in both the Uganda and Myanmar cohorts. This is not surprising given that respiratory illnesses and respiratory failure were the most frequently listed causes of preventable death at both sites. The self-identified learning needs of airway and cardiac arrest management were reflected in the low mean confidence scores for these scenarios at both sites, as well as for related skills such as intubation and defibrillation/cardioversion. However, it was noted in the PIPES survey that the necessary equipment and supplies for these procedures were often not available, raising the question of whether these skills are truly contextually relevant, but also likely leading to minimal practical use of these skills and, hence, lower confidence scores.
Although this study was conducted in resource-limited settings, the major learning needs we identified were consistent with self-identified knowledge gaps in a recent large scale survey of over 700 emergency medical care providers for children in rural settings in the United States, where resource limitations are often also present (42). These gaps included pediatric airway management and procedural skills in neonatal resuscitation and intraosseous access. This concordance with the literature even in a developed setting highlights the importance of addressing specific educational needs for health-care providers to care for neonatal and pediatric populations.
Impact on Curriculum Design
The sections of the needs assessment survey that had the greatest impact on the curriculum instructional design were the local epidemiology, followed by the available equipment and infrastructure in each setting. These data allowed us to focus the curriculum in each location on high-yield material that was relevant to the learners and the population they serve. For example, in Uganda, one learning station focused on management of malaria according to local guidelines. In Myanmar, this was not needed, but a learning station did focus on resuscitation in dengue shock, a common cause of morbidity and mortality in the Southeast Asian region (see Table 4 for examples).
Participants’ self-identified learning needs were also taken into account, but coverage of these topics emphasized techniques and procedures that could be performed with available equipment based on the PIPES survey. For example, due to the lack of defibrillators, central venous catheters, arterial line catheters, and the inconsistent availability of ventilators at both sites, the procedural skills of defibrillation/cardioversion, central line placement, arterial line placement, and intubation/advanced airway management were de-emphasized. Greater emphasis was placed on clinical assessment skills, effective noninvasive airway management (e.g., high quality BVM ventilation), and management of shock using available local equipment.
In order to ensure relevance and feasibility, we taught procedures using locally available equipment. For example, emergency intraosseous (IO) access was taught using bone marrow needles or other large-bore devices rather than with the commercially available IO needles used in the United States. When certain equipment was not available in the local setting, the educational team worked with the local team to design workable alternatives. When equipment for certain procedures is not available, it is also essential for trainers to understand if and how clinicians improvize in order to perform these procedures. For example, our respondents reported very limited access to chest tubes, yet a majority indicated that chest tube placement is a “routinely” performed procedure. Had chest tube placement been an objective of our curriculum, it would have been essential to explore how clinicians perform this procedure in the absence of purpose-specific equipment and to incorporate locally available supplies and techniques in the teaching of this skill.
When designing simulation scenarios, we took care to mimic resource constraints in the actual clinical environment and to require learners to address these issues in their management. For example, glucometers were scarce in Uganda, while they were more readily available in Myanmar. In our hypoglycemia scenarios, we provided a finger-stick glucose reading for participants in Myanmar, but required participants in Uganda to rely on clinical assessment to determine the need for glucose administration. Similarly, the 10% dextrose (D10) solutions used for hypoglycemia in young children are not commercially available in Uganda, necessitating that clinicians mix their own solutions using sterile water and higher concentration dextrose. In order to ensure mastery of this skill, our hypoglycemia simulation included mixing of D10 from locally available products as a critical action. Subtle alterations such as these ensured contextual relevance of our scenarios and reinforced essential skills required of health-care providers in their actual clinical settings.
Overall, the data acquired through our survey allowed for the curriculum to be tailored to local needs and resources to increase its feasibility, applicability, and impact. This practice is consistent with recommendations in the literature to appropriately calibrate and contextualize resuscitation courses from developed countries in order to ensure feasibility in resource-limited settings, thereby strengthening the chain of survival from within the local health-care system (17, 20, 41).
Limitations and Next Steps
The needs assessment survey in this study was implemented at only two sites in East Africa and Southeast Asia, and therefore its generalizability may be limited to sites with similar learning needs and epidemiology. Furthermore, our participants were subspecialty trainees based at referral centers, so our tool may be less applicable for first-line providers and facilities. Although the needs assessment is based on a WHO tool that has been validated in multiple resource-limited settings, our modified tool has not yet undergone validity testing. This will be a goal of future studies. In addition to tool validation, our next steps will include the further revision of existing simulation-based curricula in pediatric resuscitation to be more appropriately contextualized to local epidemiology, learning needs, and available resources.
Conclusion
The WHO Tool for Situational Analysis to Assess Emergency and Essential Surgical Care and the PIPES tools were successfully adapted to assess pediatric resuscitation capacity and learning needs in two different clinical settings. The implementation of the tool in two different countries in Asia and Africa helps to improve its generalizability for LMIC settings in the developing world. Results from the needs assessment at each site provided the basis for design of a pragmatic and appropriately contextualized curriculum in neonatal and pediatric resuscitation at each site, as well as a process for iterative revision of the curriculum for subsequent courses. These results informed curriculum development and instructional design, enabling the team to address self-identified learning needs, while emphasizing high-yield procedural skills that were of practical value, given the local resource limitations. The results also improved engagement of local stakeholders and participants in the curriculum, as they perceived that they had input into successive iterations of the curriculum through their responses to the needs assessment survey. The approach of partnering with local educational stakeholders in the curriculum design process through a formal needs assessment is consistent with recommendations by the Lancet Commission in 2010 in their publication Health professionals for a new century: transforming education to strengthen health systems in an interdependent world (43). These recommendations include reformation of local competencies through global flows of knowledge and cultivation of ownership through local clinician leadership in shaping educational processes. This concept provided a foundation for the ultimate design of our curriculum based on our needs assessment survey. Future studies will focus on validation of the PIPES tool in its modified form and dissemination of the tool to other resource-limited settings, in addition to implementation and evaluation of subsequent curricular interventions.
Ethics Statement
This study was carried out in accordance with the recommendations of the Johns Hopkins University School of Medicine Institutional Review Board (JHUSOM IRB). The study protocol was determined to be exempt research by the JHUSOM IRB under the DHHS regulations (i.e., research conducted in established or commonly accepted educational settings, involving normal educational practices, such as (i) research on regular and special education instructional strategies or (ii) research on the effectiveness of or the comparison among instructional techniques, curricula, or classroom management methods). In addition, local site approval and consent for conduct of the study in Uganda and Myanmar were obtained from the Head of the Department of Paediatrics and the Director of Training and Education at Children’s Hospital of Yangon, Myanmar, as well as from the ethics board of Mulago Hospital and Makerere University College of Health Science in Kampala, Uganda.
Author Contributions
NS, AC, JR, and JJ conceived of the needs assessment survey, implemented the survey in each setting, performed data analysis, and contributed to the writing of the manuscript. TM, YK, and SG assisted in implementation of the survey at each site and assisted in data collection. LC assisted in data analysis and writing of the manuscript. All authors approved the final version of the manuscript.
Conflict of Interest Statement
The authors declare that the submitted work was carried out without any personal, professional or financial relationships that could be construed as a conflict of interest.
Acknowledgments
The authors would like to acknowledge the contributions of the faculty at Makerere University College of Health Sciences and Yangon Children’s Hospital for their aid in facilitating needs assessment survey distribution and in the implementation of the resuscitation courses in each institution. We would also like to express thanks to the postgraduate residents, physicians, and students at both institutions for their participation in the study and to Drs. Megan Hosein, Juin Yee Kong, Kee Thai, Lim Ju Lyn, Phang Chen Rong, and Nawin Thevar for their assistance in teaching and data collection in Uganda and Myanmar. We would also like to acknowledge Drs. Deogratias Munube and Robert Opika Opoka for their roles in course coordination in Uganda. Finally, we would like to acknowledge both the Laerdal Foundation for Acute Medicine and the Johns Hopkins University School of Medicine Institute for Excellence in Education for the grant funding to complete the study.
Footnotes
Funding. The work was funded in part by a grant from the Laerdal Foundation for Acute Medicine and by an educational grant from the Johns Hopkins University School of Medicine Institute for Excellence in Education.
Supplementary Material
The Supplementary Material for this article can be found online at http://www.frontiersin.org/articles/10.3389/fped.2018.00037/full#supplementary-material.
References
- 1.World Health Organization. Global Health Observatory Data Repository under Five Mortality Trends. (2018). Available from: http://www.who.int/gho/child_health/mortality/mortality_under_five_text/en/ [Google Scholar]
- 2.Gaffey MF, Das JK, Bhutta ZA. Millennium development goals 4 and 5: past and future progress. Semin Fetal Neonatal Med (2015) 20:285–92. 10.1016/j.siny.2015.07.001 [DOI] [PubMed] [Google Scholar]
- 3.Buse K, Hawkes S. Health in the sustainable development goals: ready for a paradigm shift. Global Health (2015) 11:13. 10.1186/s12992-015-0098-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Murray CJL, Lopez AD. The Global Burden of Disease: A Comprehensive Assessment of Mortality and Disability from Diseases Injuries, and Risk Factors in 1990 and Projected to 2020. Geneva: World Health Organization; (1996). [Google Scholar]
- 5.Integrated Management of Childhood Illness (IMCI) Guidelines. (2017). Available from: http://whqlibdoc.who.int/publications/2005/9241546441.pdf
- 6.Emergency Triage Assessment and Treatment (ETAT) Guidelines. (2017). Available from: http://whqlibdoc.who.int/publications/2005/9241546875_eng.pdf
- 7.Molyneux E, Ahmad S, Robertson A. Improved triage and emergency care for children reduces inpatient mortality in a resource-constrained setting. Bull World Health Organ (2006) 84:314–9. 10.2471/BLT.04.019505 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Kelly JM, Osamba B, Garg RM, Hamel MJ, Lewis JJ, Rowe SY, et al. Community health worker performance in the management of multiple childhood illnesses: siaya district, Kenya, 1997–2001. Am J Public Health (2001) 91:1617–24. 10.2105/AJPH.91.10.1617 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Rowe AK, Onikpo F, Lama M, Cokou F, Deming MS. Management of childhood illness at health facilities in Benin: problems and their causes. Am J Public Health (2001) 91:1625–35. 10.2105/AJPH.91.10.1625 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Nguyen DT, Leung KK, McIntyre L, Ghali WA, Sauve R. Does integrated management of childhood illness (IMCI) training improve the skills of health workers? A systematic review and meta-analysis. PLoS One (2013) 8:e66030. 10.1371/journal.pone.0066030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Singhal N, Lockyer J, Fidler H, Keenan W, Little G, Bucher S, et al. Helping babies breathe: global neonatal resuscitation program development and formative educational evaluation. Resuscitation (2012) 83(1):90–6. 10.1016/j.resuscitation.2011.07.010 [DOI] [PubMed] [Google Scholar]
- 12.Goudar SS, Somannavar MS, Clark R, Lockyer JM, Revankar AP, Fidler HM, et al. Stillbirth and newborn mortality in India after helping babies breathe training. Pediatrics (2013) 131(2):e344–52. 10.1542/peds.2012-2112 [DOI] [PubMed] [Google Scholar]
- 13.Msemo G, Massawe A, Mmbando D, Rusibamayila N, Manji K, Kidanto HL, et al. Newborn mortality and fresh stillbirth rates in Tanzania after helping babies breathe training. Pediatrics (2013) 131(2):e353–60. 10.1542/peds.2012-1795 [DOI] [PubMed] [Google Scholar]
- 14.Hoban R, Bucher S, Neuman I, Chen M, Tesfaye N, Spector JM. ’Helping babies breathe’ training in sub-Saharan Africa: educational impact and learner impressions. J Trop Pediatr (2013) 59(3):180–6. 10.1093/tropej/fms077 [DOI] [PubMed] [Google Scholar]
- 15.Musafili A, Essén B, Baribwira C, Rukundo A, Persson LÅ. Evaluating helping babies breathe: training for healthcare workers at hospitals in Rwanda. Acta Paediatr (2013) 102(1):e34–8. 10.1111/apa.12034 [DOI] [PubMed] [Google Scholar]
- 16.Evans CL, Johnson P, Bazant E, Bhatnagar N, Zgambo J, Khamis AR. Competency-based training “helping mothers survive: bleeding after birth” for providers from central and remote facilities in three countries. Int J Gynaecol Obstet (2014) 126(3):286–90. 10.1016/j.ijgo.2014.02.021 [DOI] [PubMed] [Google Scholar]
- 17.Meaney PA, Topjian AA, Chandler HK, Botha M, Soar J, Berg RA, et al. Resuscitation training in developing countries: importance of a stable program of formation of instructors. Resuscitation (2011) 82(6):780–1. 10.1016/j.resuscitation.2010.12.027 [DOI] [PubMed] [Google Scholar]
- 18.Wright SW, Steenhoff AP, Elci O, Wolf HA, Ralston M, Kgosieselee T, et al. Impact of contextualized pediatric resuscitation training on pediatric healthcare providers in Botswana. Resuscitation (2015) 88:57–62. 10.1016/j.resuscitation.2014.12.007 [DOI] [PubMed] [Google Scholar]
- 19.Hughes MT. Targeted needs assessment. 3rd ed In: Kern DE, Thomas PA, Hughes MT, editors. Curriculum Development for Medical Education: A Six Step Approach. Baltimore, Maryland: Johns Hopkins University Press; (2016):29–49. [Google Scholar]
- 20.Ralston ME, Day LT, Slusher TM, Musa NL, Doss HS. Global paediatric advanced life support: improving child survival in limited-resource settings. Lancet (2013) 381:256–65. 10.1016/S0140-6736(12)61191-X [DOI] [PubMed] [Google Scholar]
- 21.Vukoja M, Riviello E, Gavrilovic S, Adhikari NK, Kashyap R, Bhagwanjee S, et al. A survey on critical care resources and practices in low- and middle-income countries. Glob Heart (2014) 9:337–42.e1–5. 10.1016/j.gheart.2014.08.002 [DOI] [PubMed] [Google Scholar]
- 22.Baker T, Lugazia E, Eriksen J, Mwafongo V, Irestedt L, Konrad D. Emergency and critical care services in Tanzania: a survey of ten hospitals. BMC Health Serv Res (2013) 13:140. 10.1186/1472-6963-13-140 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Hsia RY, Mbembati NA, Macfarlane S, Kruk ME. Access to emergency and surgical care in sub-Saharan Africa: the infrastructure gap. Health Policy Plan (2012) 27:234–44. 10.1093/heapol/czr023 [DOI] [PubMed] [Google Scholar]
- 24.Notrica MR, Evans FM, Knowlton LM, Kelly McQueen KA. Rwandan surgical and anesthesia infrastructure: a survey of district hospitals. World J Surg (2011) 35:1770–80. 10.1007/s00268-011-1125-4 [DOI] [PubMed] [Google Scholar]
- 25.Chirdan LB, Ameh EA, Abantanga FA, Sidler D, Elhalaby EA. Challenges of training and delivery of pediatric surgical services in Africa. J Pediatr Surg (2010) 45:610–8. 10.1016/j.jpedsurg.2009.11.007 [DOI] [PubMed] [Google Scholar]
- 26.Tool for Situational Analysis to Assess Emergency and Essential Surgical Care. (2017). Available from: http://www.who.int/surgery/publications/QuickSitAnalysisEESCsurvey.pdf [DOI] [PMC free article] [PubMed]
- 27.Kushner AL, Cherian MN, Noel L, Spiegel DA, Groth S, Etienne C. Addressing the millennium development goals from a surgical perspective: essential surgery and anesthesia in 8 low- and middle-income countries. Arch Surg (2010) 145(2):154–9. 10.1001/archsurg.2009.263 [DOI] [PubMed] [Google Scholar]
- 28.Kingham TP, Kamara TB, Cherian MN, Gosselin RA, Simkins M, Meissner C, et al. Quantifying surgical capacity in Sierra Leone: a guide for improving surgical care. Arch Surg (2009) 144:122–7. 10.1001/archsurg.2008.540 [DOI] [PubMed] [Google Scholar]
- 29.Contini S, Taqdeer A, Cherian M, Shokohmand AS, Gosselin R, Graaff P, et al. Emergency and essential surgical services in Afghanistan: still a missing challenge. World J Surg (2010) 34:473–9. 10.1007/s00268-010-0406-7 [DOI] [PubMed] [Google Scholar]
- 30.Iddriss A, Shivute N, Bickler S, Cole-Ceesay R, Jargo B, Abdullah F, et al. Emergency, anaesthetic and essential surgical capacity in the Gambia. Bull World Health Organ (2011) 89:565–72. 10.2471/BLT.11.086892 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Choo S, Perry H, Hesse AA, Abantanga F, Sory E, Osen H, et al. Assessment of capacity for surgery, obstetrics and anaesthesia in 17 Ghanaian hospitals using a WHO assessment tool. Trop Med Int Health (2010) 15:1109–15. 10.1111/j.1365-3156.2010.02589.x [DOI] [PubMed] [Google Scholar]
- 32.Sherman L, Clement PT, Cherian MN, Ndayimirije N, Noel L, Dahn B, et al. Implementing Liberia’s poverty reduction strategy: an assessment of emergency and essential surgical care. Arch Surg (2011) 146:35–9. 10.1001/archsurg.2010.285 [DOI] [PubMed] [Google Scholar]
- 33.Spiegel DA, Choo S, Cherian M, Orgoi S, Kehrer B, Price RR, et al. Quantifying surgical and anesthetic availability at primary health facilities in Mongolia. World J Surg (2011) 35:272–9. 10.1007/s00268-010-0904-7 [DOI] [PubMed] [Google Scholar]
- 34.Natuzzi ES, Kushner A, Jagilly R, Pickacha D, Agiomea K, Hou L, et al. Surgical care in the Solomon Islands: a road map for universal surgical care delivery. World J Surg (2011) 35:1183–93. 10.1007/s00268-011-1097-4 [DOI] [PubMed] [Google Scholar]
- 35.Taira BR, Cherian MN, Yakandawala H, Kesavan R, Samarage SM, DeSilva M. Survey of emergency and surgical capacity in the conflict-affected regions of Sri Lanka. World J Surg (2010) 34:428–32. 10.1007/s00268-009-0254-5 [DOI] [PubMed] [Google Scholar]
- 36.Petroze RT, Nzayisenga A, Rusanganwa V, Ntakiyiruta G, Calland JF. Comprehensive national analysis of emergency and essential surgical capacity in Rwanda. Br J Surg (2012) 99:436–43. 10.1002/bjs.7816 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Osen H, Chang D, Choo S, Perry H, Hesse A, Abantanga F, et al. Validation of the World Health Organization tool for situational analysis to assess emergency and essential surgical care at district hospitals in Ghana. World J Surg (2011) 35:500–4. 10.1007/s00268-010-0918-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Groen RS, Kamara TB, Dixon-Cole R, Kwon S, Kingham TP, Kushner AL. A tool and index to assess surgical capacity in low income countries: an initial implementation in Sierra Leone. World J Surg (2012) 36:1970–7. 10.1007/s00268-012-1591-3 [DOI] [PubMed] [Google Scholar]
- 39.Okoye MT, Ameh EA, Kushner AL, Nwomeh BC. A pilot survey of pediatric surgical capacity in West Africa. World J Surg (2015) 39:669–76. 10.1007/s00268-014-2868-5 [DOI] [PubMed] [Google Scholar]
- 40.Meaney PA, Topjian AA, Chandler HK, Botha M, Soar J, Berg RA, et al. Resuscitation training in developing countries: a systematic review. Resuscitation (2010) 81(11):1462–72. 10.1016/j.resuscitation.2010.06.024 [DOI] [PubMed] [Google Scholar]
- 41.Kobusingye OC, Hyder AA, Bishai D, Joshipura M, Hicks ER, Mock C. Emergency medical services. 2nd ed In: Jamison D, Bank W, editors. Disease Control Priorities in Developing Countries. (Chap. 68), (2006). p. 1261–79. Available from: http://ingentaconnect.com [Google Scholar]
- 42.Hansen M, Meckler G, Dickinson C, Dickenson K, Jui J, Lambert W, et al. Children’s safety initiative: a national assessment of educational needs among emergency medical services providers. Prehosp Emerg Care (2015) 19(2):287–91. 10.3109/10903127.2014.959223 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet (2010) 376(9756):1923–58. 10.1016/S0140-6736(10)61854-5 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.