Skip to main content
Gates Open Research logoLink to Gates Open Research
. 2022 Jun 13;6:70. [Version 1] doi: 10.12688/gatesopenres.13490.1

Simulation and nurse-mentoring in a statewide nurse mentoring program in Bihar, India: diagnosis of postpartum hemorrhage and intrapartum asphyxia

Rakesh Ghosh 1,a, Susanna Cohen 2, Hilary Spindler 1, Divya Vincent 3, Mona Sterling 1, Aritra Das 4, Aboli Gore 5, Tanmay Mahapatra 4, Dilys Walker 1,6
PMCID: PMC10616110  PMID: 37915730

Abstract

Background: Mentoring programs that include simulation, bedside mentoring, and didactic components are becoming increasingly popular to improve quality. These programs are designed with little evidence to inform the optimal composition of mentoring activities that would yield the greatest impact on provider skills and patient outcomes. We examined the association of number of maternal and neonatal emergency simulations performed with the diagnosis of postpartum hemorrhage (PPH) and intrapartum asphyxia in real patients.

Methods: We used a prospective cohort and births were compared between- and within-facility over time. Setting included 320 public facilities in the state of Bihar, India May 2015 – 2017. The participants were deliveries and livebirths. The interventions carried out were mobile nurse-mentoring program with simulations, teamwork and communication activities, didactic teaching, demonstrations of clinical procedures and bedside mentoring including conducting deliveries. Nurse mentor pairs visited each facility for one week, covering four facilities over a four-week period, for seven to nine consecutive months. The outcome measures were diagnosis of PPH and intrapartum asphyxia.

Results:Relative to the bottom one-third facilities that performed the fewest maternal simulations, facilities in the middle one-third group diagnosed 26% (incidence rate ratio [IRR] = 1.26, 95% confidence interval [CI]: 1.00, 1.59) more cases of PPH in real patients. Similarly, facilities in the middle one-third group, diagnosed 25% (IRR = 1.25, 95% CI: 1.04, 1.50) more cases of intrapartum asphyxia relative to the bottom third group that did the fewest neonatal simulations. Facilities in the top one-third group (i.e., performed the most simulations) did not have a significant difference in diagnosis of both outcomes, relative to the bottom one-third group.

Results:Relative to the bottom one-third facilities that performed the fewest maternal simulations, facilities in the middle one-third group diagnosed 26% (incidence rate ratio [IRR] = 1.26, 95% confidence interval [CI]: 1.00, 1.59) more cases of PPH in real patients. Similarly, facilities in the middle one-third group, diagnosed 25% (IRR = 1.25, 95% CI: 1.04, 1.50) more cases of intrapartum asphyxia relative to the bottom third group that did the fewest neonatal simulations. Facilities in the top one-third group (i.e., performed the most simulations) did not have a significant difference in diagnosis of both outcomes, relative to the bottom one-third group.

Conclusions: Findings suggest a complex relationship between performing simulations and opportunities for direct practice with patients, and there may be an optimal balance in performing the two that would maximize diagnosis of PPH and intrapartum asphyxia.

Keywords: Mentorship, birth asphyxia, non-vigorous infant, maternal health, neonatal health, low- and middle-income countries

Introduction

Capacity building of frontline health workers continues to be a priority for improving the quality of maternal and newborn care, particularly in low-resource settings 14 . Many of these programs combine simulations with bedside mentoring, didactic sessions, and demonstrations of clinical procedures. Studies from both high- and low-resource settings not only show that simulation-based training of healthcare providers can contribute to the acquisition and retention of clinical skills, but also improve patient outcomes 510 . Simulation training in low-resource settings takes a variety of forms (from one-off trainings to low-dose, high-frequency courses as well as center-based to near-situ and in-situ approaches). Established programs like Helping Mothers Survive (HMS) Bleeding After Birth have reported a link between skills and drills and decreased incidence of postpartum hemorrhage (PPH) induced complications 9, 11 . Likewise, the Helping Babies Breathe (HBB) simulation program has shown increased adherence to neonatal resuscitation algorithms including stimulation and suctioning of the depressed neonate 3 . Evidence show that simulation-based training contributes to improvement in clinical behaviors (including the performance of bag-mask ventilation), but a decay over time has also been observed 12 . Thus, there is a need to understand what type of and how much simulation training leads to optimum use of evidence based practices (EBPs) thereby improving patient care and outcomes 13 . A large scale nurse-mentoring program with integrated simulation, implemented in the eastern Indian state of Bihar, presented a unique opportunity to investigate this research question.

With a population of over 100 million, of which about 80% is rural, Bihar is one of the impoverished places in South Asia 14, 15 . Despite improvements, the state is amongst the worst performing in India with maternal and child health indicators languishing below national averages 16 . In 2016, the maternal mortality ratio in the state was 165 per 100,000 livebirths and the infant mortality rate was 38 per 1000 livebirths 16 . Two leading causes of maternal and infant mortality are PPH and intrapartum asphyxia, respectively 17, 18 .

To improve the quality of obstetric and newborn care, in 2011, CARE-India, a non-governmental organization, collaborated with the state Government of Bihar and implemented a range of initiatives through a pilot program in eight districts of Bihar. Inspired by the success of the pilot initiative 19 , it was expanded to all 38 districts of the state as a nurse-mentoring program called AMANAT or ‘Apatkaleen Matritva evam Navjat Tatparta’ (meaning readiness for emergency obstetrical and neonatal care). The overarching goal of the AMANAT program was to reduce maternal and neonatal mortality, by improving quality of delivery and newborn care through didactic lessons, bedside mentoring, simulation, and teamwork and communication (T&C) activities. This was done through in-situ, on-the-job mentoring of labor and delivery (L&D) care providers using low tech, high-fidelity materials.

In two previous publications, we have reported: (1) increase in uptake of EBPs in normal non-complicated deliveries, and (2) overall improvement in diagnosis and management of PPH and intrapartum asphyxia in complicated deliveries, in the AMANAT program 20, 21 . In this investigation, we examined the association of the number of maternal and neonatal emergency simulations conducted in the training program with diagnosis of PPH and intrapartum asphyxia in real patients. This analysis focuses on simulation, which is one specific component of the complete AMANAT intervention program. We used the SQUIRE 2.0 guidelines from the EQUATOR Network to report this quality improvement study 22 .

Methods

Ethics statement

The study was approved by the Institutional Committee for Ethics and Review of Health Management Research Office of the Indian Institute of Health Management Research in Jaipur, India and the Committee for Human Research at the University of California San Francisco. Study ID# 14-15446.

Study intervention and personnel

The AMANAT program was implemented in four phases in 320 Basic Emergency Obstetric and Neonatal Care (BEmONC) facilities between May 2015 and January 2017. Each phase covered 80 facilities, which were chosen based on facility readiness to implement the program. Since the inception of the AMANAT nurse-mentoring program, PRONTO International has worked with CARE-India to integrate simulation and team-training into the AMANAT curriculum, tailored to address local contextual needs.

During the AMANAT program, 120 mentors (with Bachelor's degree) were trained in simulation facilitation and debriefing best-practices 23 . They received two trainings, simulation facilitation and advanced simulation facilitation training that were roughly four months apart. After the first training, a pair of mentors visited one facility per week covering four assigned facilities in about a month. The nurse-mentor pairs repeated their visits every month to their assigned facilities. In other words, a facility received one week of mentoring per month for seven to nine consecutive months. The AMANAT mentors trained the L&D team in the facilities where each team comprises of one to two nurses with or without any other birth attendant. Physicians or specialists are rarely available. The nurses are either Auxiliary Nurse Midwives with a 2-year training on multipurpose community health or General Nurses with a 3-year training in general nursing and midwifery. The details of the AMANAT program and PRONTO’s simulation and team-training have been elaborated elsewhere and are briefly described below 20, 21, 24 .

Embedded in the AMANAT program was PRONTO’s curriculum that included simulations to promote the use of EBPs, improve T&C, and to increase awareness around person-centered maternity care among L&D staff. To improve T&C between providers, PRONTO’s curriculum includes TeamSTEPPS™ 25 concepts within its simulation exercises resulting in a curriculum, which allowed nurses to practice both technical and non-technical skills in a simulated scenario that replicates a real emergency. Mentor pairs facilitated simulations and debriefs, both of which were video recorded 26 . In addition to simulation and T&C activities, mentors were encouraged to guide and supervise clinical care of patients in real time from admission to discharge, hereafter referred to as bedside mentoring. Finally, there were regular knowledge reviews (case-based learning) and routine didactic sessions with demonstrations on topics such as the partograph, active management of third stage of labor, infection control, fetal heart rate monitoring, basic resuscitation, golden minute for an asphyxiated newborn, and kangaroo mother care. More contextual information is presented in the Extended data 27, 28 .

Data sources

For this analysis we used data from two separate sources that are designed, collected and managed by CARE’s Concurrent Measurement and Learning team: (1) the Facility Information System (FIS), a web-based routine monitoring system used to record data on live deliveries and training activities during the weeks of mentoring; and (2) the direct observation of deliveries (DOD) before and after implementation of the AMANAT intervention. A third source, maintained by UCSF/PRONTO, recorded the number of simulations performed, which was used to validate the FIS based simulation counts. Data on select delivery practices were collected on all deliveries, daily, by mentors using observations and registers during their visits to the facilities and subsequently entered into the FIS. For the DOD, clinically trained project personnel visited each facility for a week to observe real deliveries occurring between 9 AM and 5 PM, approximately. The DOD provided comprehensive information on specific EBPs for individual deliveries both before and after the intervention periods. Data for this analysis was obtained from the FIS because it provided sufficient sample size to power the investigation on rare complications. The DOD data was used to generate facility level practice scores to adjust the final models, as described elsewhere 21 .

Clinical outcomes

The two clinical complications investigated in this analysis were diagnosis of maternal PPH and intrapartum (or birth) asphyxia of the newborn as defined by the World Health Organization 29, 30 . PPH was defined as blood loss associated with obstetric labor or childbirth of more than 500ml for a vaginal delivery. Intrapartum (or birth) asphyxia was defined as failure by the neonate to initiate or sustain breathing at birth.

Statistical analysis

We used two metrices to quantify the association between performance of simulations and diagnosis of complications. The first metric was total counts of maternal or neonatal complication simulations that were conducted in the entire mentoring period in a facility. The facilities were ranked based on the number of simulations performed and grouped into three roughly equal categories (tertiles): bottom-third, middle-third and top-third. The second metric was the ratios of the count of simulations to the count of other activities (T&C, demonstrations of various clinical skills, bedside mentoring and didactic lessons), performed in the facilities. Therefore, we had four ratios – (1) simulations : T&C, (2) simulations : demonstrations, (3) simulations : bedside mentoring and (4) simulations : didactic lessons. Like the first metric, each of these ratios were categorized into three ordered groups (tertiles). For example, a facility in the top-third sim: didactic ratio group spent more time doing simulations relative to didactic sessions than a facility in the bottom-third group (reference group). The four ratios were estimated separately for maternal complication simulations and neonatal complication simulations. We examined both continuous form and categories of simulations. A small percentage (~1%) of the facilities had high values of these ratios, meaning the number of simulations performed were much higher compared to the other activities. To minimize the outlier effect and to avoid imposing linearity in the relationship, we generated tertiles from the continuous ratios, using 33 rd and 66 th percentiles as cut-offs. Programmatically, results in categories are more meaningful to implementors as it will provide a specific number (midpoint of the range) or range of simulations associated with maximum improvement. In contrast, analysis using a linear continuous form (of simulation counts) will not provide a maximum limit, which aside from being infeasible will imply more simulations is better. This might not always be the case as it may take away time from other important activities, including conducting mentored real deliveries.

The analytical strategy used for this analysis is similar to the one previously reported 20 . Births and complications between the start and end date of each mentoring week for each facility were aggregated. Thus, one row of observation represented one week in one facility. We used negative binomial models appropriate for the count of complications. To account for excessive zeros, i.e., no complications in a facility in a week, we utilized the zero-inflated negative binomial model and reported the incidence rate ratios (IRRs) with 95% confidence intervals (CIs). The IRRs compared the middle-third group of facilities with the bottom-third group and the top-third with the bottom-third, for both metrices. For readers interested in statistical details, we have rationalized the choice of models in the supplement and in a previous publication 20 . Deliveries were clustered in both time and space, so we used the sandwich variance estimator, which provides appropriate standard errors after accounting for non-independence of observations 31 .

The final models were adjusted for weeks of nurse-mentoring, days per week of nurse-mentoring, total number of births per week, number of T&C activities performed, phase of the AMANAT program, availability of physicians, facility level practice scores and proportion of mentee-sessions attended. Mentee-sessions attended were defined as follows: if facility A had 10 mentees and week 1 of mentoring had 40 total sessions, there will be a maximum of 400 mentee-sessions in that facility(A)-week(1). Of these, if 8 mentees were present for all 40 sessions, 9 th mentee was present for 30 sessions, and 10 th mentee was present for 10 sessions only, this would equate to 90% mentee-sessions attendance [(320+30+10)/400] for that facility(A)-week(1).

Facility level practice scores were generated from the DOD data using a set of 11 intrapartum and 12 newborn care indicators, explained in a prior publication 21 . Individual indicators were assigned a score of 1 if they were performed as recommended; otherwise, a 0 was assigned. Individual delivery scores were rescaled to range between 0 and 100, where 0 refers to none and 100 refers to all EBPs being performed appropriately for the delivery. The indicator-specific scores were aggregated to obtain a delivery score and scores for all deliveries in a facility were averaged to obtain a facility level practice score.

Significance was examined at the 5% (two-tailed) level. As the categories of simulations were ordered, we performed a chi-squared linear test of trend to examine increasing or decreasing trend in the associations 32 . Analysis was done using STATA 16.1. Patients or public were not involved in the design, conduct, or reporting or dissemination plans of the research.

Results

In total, there were 55,938 live deliveries that occurred in the 320 facilities during the weeks of mentoring, of which PPH was identified in 1291 (2%) and intrapartum asphyxia in 1631 (3%) cases 27 . During the mentoring period, the median (IQR: interquartile range) number of maternal and neonatal complication simulations performed per facility were 18 (12 – 24) and 9 (6 – 12), respectively. In the same period, the median number of T&C activities performed per facility was 5 (3 – 11). Median (IQR) ratios of maternal complication simulations equaled: Sim: T&C activities, 0.17 (0.10 – 0.26); Sim: demonstrations, 0.46 (0.25 – 0.89); Sim: bedside mentoring, 0.10 (0.04 – 0.21); and Sim: didactic lessons, 0.21 (0.12 – 0.38). The median (IQR) ratios of neonatal complication simulations equaled: Sim: T&C activities, 0.08 (0.05 – 0.13); Sim: demonstrations, 0.24 (0.13 – 0.46); Sim: bedside mentoring, 0.05 (0.02 – 0.10); and Sim: didactic sessions, 0.11 (0.06 – 0.19).

Postpartum hemorrhage

Relative to the bottom-third facilities that did fewest (~9) maternal complication simulations, facilities in the middle one-third group (~19) diagnosed 26% (IRR = 1.26, 95% CI: 1.00, 1.59) more cases of PPH in real deliveries, while the top one-third (~31 sims) did not show increased diagnosis ( Figure 1). This association between maternal complication simulation and PPH diagnosis increased to 1.33 (95% CI: 1.04, 1.70) after co-adjustment for T&C activities, demonstration sessions, bedside mentoring and didactic sessions. Analysis using the ratio metric of the number of maternal complication simulations to the number of T&C activities shows facilities in tertile 2 diagnosed 24% (IRR = 1.24, 95% CI: 1.00, 1.54) more PPH cases, compared to the facilities in tertile 1 (those that performed fewest maternal complication simulations relative to T&C activities) ( Figure 1). Facilities in tertile 2, spent about twice as much time performing simulations relative to T&C activities, then the facilities in tertile 1. In contrast, performing more simulations relative to bedside mentoring, decreased diagnosis of PPH because facilities in tertile 3 diagnosed 25% (IRR = 0.75, 95% CI: 0.56, 1.00) fewer PPH cases, compared to facilities in tertile 1 ( Figure 1). Facilities in tertile 3 did about 5 maternal complication simulations for every 10 live deliveries, whereas facilities in tertile 1 did about 2 simulations for every 10 live deliveries. The elevated but non-significant point estimates generally suggest that performing maternal complication simulations relative to didactic lessons may increase PPH diagnosis.

Figure 1. Adjusted1 incidence rate ratios for the diagnosis of postpartum hemorrhage with simulation counts or ratios of simulations performed relative to other activities in the AMANAT nurse-mentoring program in Bihar, India (2015 – 2017).

Figure 1.

1 Adjusted for weeks of nurse-mentoring, days per week of nurse-mentoring, total number of births per week, phase of program, availability of physicians, proportion of mentee-sessions attended, facility level practice. 2 3 5 These associations represent the added benefit of doing a simulation relative to doing a teamwork activity. Likewise, for a demonstration activity or a didactic session. 4 The decreased association for the ratio, simulation: bedside mentoring, shows that a proper mix of the two is more beneficial than just performing simulation. Note: The solid dots represent the associations, and the vertical bars represent the upper and the lower confidence intervals.

Intrapartum asphyxia

For intrapartum asphyxia, facilities in the middle one-third group (did about 9 neonatal complication simulations), diagnosed 25% (IRR = 1.25, 95% CI: 1.04, 1.50) more cases relative to the bottom-third facilities (~4) that conducted fewest neonatal simulations ( Figure 2), which changed to 1.22 (95% CI: 1.01, 1.47) after co-adjustment with counts of T&C activities, demonstration sessions, bedside mentoring and didactic sessions. Facilities that did the highest (~ 16) number of neonatal simulations showed no improvement in diagnosis, with no linear trend across groups ( Figure 2). Results also suggest that performing neonatal complication simulations relative to T&C activities increase diagnosis of intrapartum asphyxia ( Figure 2). Facilities in tertile 2, with a moderate number of neonatal complication simulations performed relative to T&C activities, diagnosed 28% (IRR = 1.28, 95% CI: 1.09, 1.50) more cases of intrapartum asphyxia, compared to the facilities in tertile 1 ( Figure 2). Facilities in tertile 2, spent more than twice as much time performing simulations than T&C activities, then the facilities in tertile 1. The elevated but non-significant point estimates suggest performing neonatal complication simulations relative to demonstrations activities may also increase diagnosis of intrapartum asphyxia. In contrast, performing more neonatal complication simulations relative to bedside mentoring, decreased diagnosis of intrapartum asphyxia. For example, facilities in tertile 3 diagnosed 28% (IRR = 0.72, 95% CI: 0.59, 0.89) less intrapartum asphyxia cases, compared to the facilities in tertile 1, with a significant linear decreasing trend ( Figure 2). Facilities in tertile 3 did about 1 neonatal complication simulation for every 5 live deliveries, whereas facilities in tertile 1 did about 1 simulation for every 50 live deliveries.

Figure 2. Adjusted1 incidence rate ratios for the diagnosis of intrapartum asphyxia with simulation counts or ratios of simulations performed relative to other activities in the AMANAT nurse-mentoring program in Bihar, India (2015 – 2017).

Figure 2.

1 Adjusted for weeks of nurse-mentoring, days per week of nurse-mentoring, total number of births per week, phase of program, availability of physicians, proportion of mentee-sessions attended, facility level practice. 2 3 5 These associations represent the added benefit of doing a simulation relative to doing a teamwork activity. Likewise, for a demonstration activity or a didactic session. 4 The decreased association for the ratio, simulation: bedside mentoring, shows that a proper mix of the two is more beneficial than just performing simulation. Note: The solid dots represent the associations, and the vertical bars represent the upper and the lower confidence intervals.

There was no linear relationship between any of the metrices and both outcomes. The full models are presented in supplementary Tables 1 and 2 and the numerical estimates for Figure 1 and Figure 2 are presented in supplementary Tables 3 and 4 (see Extended data 27, 28 ).

Discussion

The results suggest a positive association between performance of maternal complication simulations and diagnosis of PPH as well as between performance of neonatal complication simulations and diagnosis of intrapartum asphyxia. However, diagnosis increased with performance of simulations up to a certain point, beyond which it did not appear to increase diagnosis, as evidenced by no linear association and no association for tertile 1. In fact, time spent in simulation relative to other activities is likely important in diagnosing these complications. For example, we found that performing maternal and neonatal complication simulations is relatively more beneficial than performing T&C activities. However, bedside mentoring also appears to be important and an optimal balance between performing simulated deliveries and bedside mentoring is likely to be most effective in teaching diagnosis of complications. Thus, there appears to be a complex relationship between performing simulations and opportunities for hands-on practice with real patients. Striking a right balance that is appropriate for the setting is key to providing quality care.

Facilities that performed the highest number of simulations did not achieve statistically significant improvement in diagnosis compared to those that did the fewest. This could be because the fidelity of simulations or the following debriefs may have been compromised due to the volume. However, previous reports do not support this explanation, in general; whether the same is true in the high simulation facilities, cannot be unequivocally said 33, 34 . Alternatively, performing too many simulations could be a diversion from other activities including bedside mentoring, which as results suggest is important to clinical learning.

There is no study to our knowledge to which these results can be directly compared because of the unique setting in which simulation is integrated (not stand-alone) into a comprehensive nurse mentoring intervention. A systematic review reported insufficient evidence to suggest that simulation training improves neonatal resuscitation 3 . However, other reports from HBB simulation training reported improved clinical performance of stimulation, suction, and bag-mask ventilation; and demonstrated positive impact on fresh stillbirth and mortality on the first day of life 1, 2, 10, 35 . Evidence on retention of knowledge and skills after simulation training is mixed 2, 36 . A cluster randomized trial conducted in Kenya and Uganda demonstrated the PRONTO intervention was effective in reducing intrapartum stillbirth and early neonatal mortality in preterm gestations 37 . In Mexico, a modular stand-alone PRONTO training was able to reduce cesarean sections and neonatal mortality 38 and in Guatemala, the intervention increased the use of EBPs 39 . A previous AMANAT program based study analyzed direct observation of live deliveries and demonstrated an association between performance of simulations and increased use of EBPs in non-complicated births 21 .

These findings are of interest to the global simulation community that continues to design and implement the right mix of capacity strengthening strategies to improve quality of delivery and newborn care. The study brings scientific evidence from a large-scale initiative with variability in the dose of program components and their potential impact. Consequently, this lends limited external validity to similar facilities in low-resource settings that possess comparable levels of readiness, infrastructure and staff. The longitudinal nature of the investigation, the large sample size and the use of causal inference methods give some confidence that these results are less likely to be biased. Associations with simulations were relatively robust to adjustments for T&C activities, demonstration sessions, bedside mentoring and didactic sessions, when all were included in the same model. Nevertheless, the possibility of residual confounding from unmeasured factors cannot be ruled out. Evidence of validity of PPH and intrapartum asphyxia diagnosis in this study is empirically demonstrated by the associations observed with established risk factors. For example, PPH was associated with obstructed or prolonged labor (1.36, 95% CI: 1.08, 1.73) and anemia (1.43, 95% CI: 1.22, 1.68), while intrapartum asphyxia was associated with multiple births (1.20, 95% CI: 1.06, 1.36), cord prolapse (1.38, 95% CI: 1.02, 1.87), breech presentation (1.35, 95% CI: 1.19, 1.54) and anemia (1.19, 95% CI: 1.09, 1.30).

Limitations

There are several limitations, important among which was the absence of a control group. We cannot state if similar changes concurrently happened in facilities where the AMANAT intervention was not implemented. We could not investigate other complications such as hypertensive disorders of pregnancy, infections etc. since we did not have sufficient data. The global incidence of PPH is thought to be around 6% and that of intrapartum asphyxia is around 5–10% 40, 41 . Thus, the two outcomes in this study were under-reported. According to the principle of regression dilution bias, if under-reporting of outcomes are non-differential in relation to the number of simulations performed, the statistical significance will be affected and not the point estimate 42 . The under-reporting could be differential but there is no way to make that assessment. The actual change in diagnosis could have been due to a host of contextual factors not accounted for in the models. For example, when the monsoons arrive after summer, some districts (equivalent of a US county) in the state get flooded. Mentors in the affected places accordingly adjusted the curriculum. Facility preparedness and change in district or state level leadership, which depended on political dispensation, also affected the implementation of the program. Teasing out specific change that is due to simulation or other factors is difficult given the integrated and vast nature of the AMANAT program. Finally, several statistical tests were performed at the 5% significance level, giving rise to the possibility of some results to be statistically significant by chance. We did not adjust for multiple comparison because we were pursuing a well laid out a-priori hypothesis and not randomly searching for significant associations.

Conclusions

The study provides rare evidence on the effectiveness and dosage of simulation from a rural and impoverished area in South Asia. We found that a moderate number of in-situ simulations tailored to address the local needs, balanced with real-time bedside mentoring may be the formula suited to improving the diagnosis of PPH and intrapartum asphyxia in livebirths.

Data availability

Underlying data

Dryad: Data for ‘Simulation and nurse-mentoring in a statewide nurse mentoring program in Bihar, India: diagnosis of postpartum hemorrhage and intrapartum asphyxia’. https://doi.org/10.7272/Q6VQ30X9 27 .

This project contains the following underlying data:

  • -

    FIS_births_complication_counts_long_wk1&7.dta

Extended data

Zenodo: Simulation and nurse-mentoring in a statewide nurse mentoring program in Bihar, India: diagnosis of postpartum hemorrhage and intrapartum asphyxia. https://doi.org/10.5281/zenodo.6584800 28 .

This project contains the following extended data:

  • -

    Online_supplement_01062021.docx (Supplementary methods and Tables 1–4)

Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).

Acknowledgements

The authors would like to thank the Database Management System development team of CARE India and the staff members of the PRONTO office in Patna, India. We also thank all of the mentors, mentees, facility in charge, Regional Clinical Capacity Building Specialists for their tireless efforts in implementing the AMANAT program throughout the state of Bihar as well as the CMAI management. Additionally, we are thankful to the CARE India team for their active support and engagement in integrating simulation and team training into the AMANAT program. Finally, we would like to thank the AMANAT mentors who worked tirelessly and the birthing women in Bihar for their participation in this program.

Funding Statement

This work was supported by the Bill and Melinda Gates Foundation [OPP1112431]. The funding body had no role in study design, data collection, analysis, interpretation, manuscript writing, or the decision to submit the manuscript for publication.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 1; peer review: 2 approved, 1 approved with reservations]

References

  • 1. Ashish K, Wrammert J, Clark RB, et al. : Reducing perinatal mortality in Nepal using helping babies breathe. Pediatrics. 2016;137(6):e20150117. 10.1542/peds.2015-0117 [DOI] [PubMed] [Google Scholar]
  • 2. Bang A, Patel A, Bellad R, et al. : Helping Babies Breathe (HBB) training: What happens to knowledge and skills over time? BMC Pregnancy Childbirth. 2016;16(1):364. 10.1186/s12884-016-1141-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Rakshasbhuvankar AA, Patole SK: Benefits of simulation based training for neonatal resuscitation education: a systematic review. Resuscitation. 2014;85(10):1320–23. 10.1016/j.resuscitation.2014.07.005 [DOI] [PubMed] [Google Scholar]
  • 4. Anderson FW, Johnson TR: Capacity building in Obstetrics and Gynaecology through academic partnerships to improve global women's health beyond 2015. BJOG. 2015;122(2):170–73. 10.1111/1471-0528.13176 [DOI] [PubMed] [Google Scholar]
  • 5. Nathan LM, Patauli D, Nsabimana D, et al. : Retention of skills 2 years after completion of a postpartum hemorrhage simulation training program in rural Rwanda. Int J Gynaecol Obstet. 2016;134(3):350–53. 10.1016/j.ijgo.2016.01.021 [DOI] [PubMed] [Google Scholar]
  • 6. Egenberg S, Øian P, Eggebø TM, et al. : Changes in self‐efficacy, collective efficacy and patient outcome following interprofessional simulation training on postpartum haemorrhage. J Clin Nurs. 2017;26(19–20):3174–87. 10.1111/jocn.13666 [DOI] [PubMed] [Google Scholar]
  • 7. Andreatta P, Gans-Larty F, Debpuur D, et al. : Evaluation of simulation-based training on the ability of birth attendants to correctly perform bimanual compression as obstetric first aid. Int J Nurs Stud. 2011;48(10):1275–80. 10.1016/j.ijnurstu.2011.03.001 [DOI] [PubMed] [Google Scholar]
  • 8. Nelissen E, Ersdal H, Mduma E, et al. : Helping Mothers Survive Bleeding After Birth: retention of knowledge, skills, and confidence nine months after obstetric simulation-based training. BMC Pregnancy Childbirth. 2015;15:190. 10.1186/s12884-015-0612-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Nelissen E, Ersdal H, Mduma E, et al. : Clinical performance and patient outcome after simulation-based training in prevention and management of postpartum haemorrhage: an educational intervention study in a low-resource setting. BMC Pregnancy Childbirth. 2017;17(1):301. 10.1186/s12884-017-1481-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Mduma E, Ersdal H, Svensen E, et al. : Frequent brief on-site simulation training and reduction in 24-h neonatal mortality--an educational intervention study. Resuscitation. 2015;93:1–7. 10.1016/j.resuscitation.2015.04.019 [DOI] [PubMed] [Google Scholar]
  • 11. Lutgendorf MA, Spalding C, Drake E, et al. : Multidisciplinary in situ simulation-based training as a postpartum hemorrhage quality improvement project. Mil Med. 2017;182(3):e1762–e66. 10.7205/MILMED-D-16-00030 [DOI] [PubMed] [Google Scholar]
  • 12. Walker D, Cohen S, Fritz J, et al. : Team training in obstetric and neonatal emergencies using highly realistic simulation in Mexico: impact on process indicators. BMC Pregnancy Childbirth. 2014;14:367. 10.1186/s12884-014-0367-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Shukla N, Perez P, Tiwari MK, et al. : Modelling and simulation in health care systems. International Journal of Systems Science: Operations & Logistics. Taylor & Francis,2017;4(1):1–3. 10.1080/00207721.2016.1222772 [DOI] [Google Scholar]
  • 14. Census of India: Provisional Populations Totals.Patna, Bihar: Office of the Director of Census Operations. Bihar, Patna,2011. [Google Scholar]
  • 15. Alkire S, Maria ES: India Country Briefing.Oxford Poverty & Human Development Initiative (OPHI) Multidimensional Poverty Index Country Briefing Series.: University of Oxford,2010. [Google Scholar]
  • 16. NITI (National Institution for Transforming India) Aayog, Government of India: Handbook of State Statistics.New Delhi: Government of India,;2018; accessed 03/25/2019. Reference Source [Google Scholar]
  • 17. Kassebaum NJ, Barber RM, Bhutta ZA, et al. : Global, regional, and national levels of maternal mortality, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1775–812. 10.1016/S0140-6736(16)31470-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Liu L, Oza S, Hogan D, et al. : Global, regional, and national causes of under-5 mortality in 2000-15: an updated systematic analysis with implications for the sustainable development goals. Lancet. 2016;388(10063):3027–35. 10.1016/S0140-6736(16)31593-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Das A, Nawal D, Singh MK, et al. : Impact of a nursing skill-improvement intervention on newborn-specific delivery practices: an experience from Bihar, India. Birth. 2016;43(4):328–35. 10.1111/birt.12239 [DOI] [PubMed] [Google Scholar]
  • 20. Ghosh R, Spindler H, Morgan MC, et al. : Diagnosis and management of postpartum hemorrhage and intrapartum asphyxia in a quality improvement initiative using nurse-mentoring and simulation in Bihar, India. PLoS One. 2019;14(7):e0216654. 10.1371/journal.pone.0216654 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Ghosh R, Spindler H, Dyer J, et al. : Simulation and team training embedded nurse mentoring programme and improvement in intrapartum and newborn care in a low-resource setting in bihar, India. J Glob Health. 2020;10(2):021010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Davidoff F, Batalden P, Stevens D, et al. : Publication guidelines for quality improvement studies in health care: evolution of the SQUIRE project. BMJ. 2009;338:a3152. 10.1136/bmj.a3152 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. INACSL Standards Committee: INACSL standards of best practice: Simulation SM debriefing. Clin Simul Nurs. 2016;12(S):S21–S25. 10.1016/j.ecns.2016.09.008 [DOI] [Google Scholar]
  • 24. Vail B, Morgan MC, Spindler H, et al. : The Power of Practice: Simulation Training Improving the Quality of Neonatal Resuscitation Skills in Bihar, India. BMC Pediatr. 2018;18(1):291. 10.1186/s12887-018-1254-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Stead K, Kumar S, Schultz TJ, et al. : Teams communicating through STEPPS. Med J Aust. 2009;190(S11):S128–S32. 10.5694/j.1326-5377.2009.tb02619.x [DOI] [PubMed] [Google Scholar]
  • 26. Dyer J, Spindler H, Christmas A, et al. : Video monitoring a simulation-based quality improvement program in Bihar, India. Clin Simul Nurs. 2018;17:19–27. 10.1016/j.ecns.2017.11.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Ghosh R, Cohen S, Spindler H, et al. : Data_to_Share.[Dataset] Harvard Dataverse. 2022. 10.7272/Q6VQ30X9 [DOI] [Google Scholar]
  • 28. Ghosh R: Simulation and nurse-mentoring in a statewide nurse mentoring program in Bihar, India: diagnosis of postpartum hemorrhage and intrapartum asphyxia. Zenodo. [Data]. 2022. 10.5281/zenodo.6584800 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. World Health Organization: Basic newborn resuscitation: a practical guide.World Health Organization,1998. Reference Source [Google Scholar]
  • 30. World Health Organization: WHO recommendations for the prevention and treatment of postpartum haemorrhage. Geneva: World Health Organisation, 2014,2012. [PubMed] [Google Scholar]
  • 31. Kong M, Xu S, Levy SM, et al. : GEE type inference for clustered zero-inflated negative binomial regression with application to dental caries. Comput Stat Data Anal. 2015;85:54–66. 10.1016/j.csda.2014.11.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Swinscow T: The Chi squared tests.BMJ Publishing Group;1997; accessed 07/21/2019. Reference Source [Google Scholar]
  • 33. Vail B, Spindler H, Morgan MC, et al. : Care of the mother-infant dyad: a novel approach to conducting and evaluating neonatal resuscitation simulation training in Bihar, India. BMC Pregnancy Childbirth. 2017;17(1):252. 10.1186/s12884-017-1434-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Raney JH, Morgan MC, Christmas A, et al. : Simulation-enhanced nurse mentoring to improve preeclampsia and eclampsia care: an education intervention study in Bihar, India. BMC Pregnancy Childbirth. 2019;19(1):41. 10.1186/s12884-019-2186-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Dol J, Campbell-Yeo M, Murphy GT, et al. : The impact of the Helping Babies Survive program on neonatal outcomes and health provider skills: a systematic review. JBI Database System Rev Implement Rep. 2018;16(3):701–37. 10.11124/JBISRIR-2017-003535 [DOI] [PubMed] [Google Scholar]
  • 36. Tabangin ME, Josyula S, Taylor KK, et al. : Resuscitation skills after Helping Babies Breathe training: a comparison of varying practice frequency and impact on retention of skills in different types of providers. Int Health. 2018;10(3):163–71. 10.1093/inthealth/ihy017 [DOI] [PubMed] [Google Scholar]
  • 37. Walker D, Otieno P, Butrick E, et al. : Effect of a quality improvement package for intrapartum and immediate newborn care on fresh stillbirth and neonatal mortality among preterm and low-birthweight babies in Kenya and Uganda: a cluster-randomised facility-based trial. Lancet Glob Health. 2020;8(8):e1061–70. 10.1016/S2214-109X(20)30232-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Walker DM, Cohen SR, Fritz J, et al. : Impact evaluation of PRONTO Mexico: a simulation-based program in obstetric and neonatal emergencies and team training. Simul Healthc. 2016;11(1):1–9. 10.1097/SIH.0000000000000106 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Walton A, Kestler E, Dettinger JC, et al. : Impact of a low-technology simulation-based obstetric and newborn care training scheme on non-emergency delivery practices in Guatemala. Int J Gynaecol Obstet. 2016;132(3):359–64. 10.1016/j.ijgo.2015.08.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Carroli G, Cuesta C, Abalos E, et al. : Epidemiology of postpartum haemorrhage: a systematic review. Best Pract Res Clin Obstet Gynaecol. 2008;22(6):999–1012. 10.1016/j.bpobgyn.2008.08.004 [DOI] [PubMed] [Google Scholar]
  • 41. Lee AC, Cousens S, Wall SN, et al. : Neonatal resuscitation and immediate newborn assessment and stimulation for the prevention of neonatal deaths: a systematic review, meta-analysis and Delphi estimation of mortality effect. BMC Public Health. 2011;11 Suppl 3(Suppl 3):S12. 10.1186/1471-2458-11-S3-S12 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Hutcheon JA, Chiolero A, Hanley JA: Random measurement error and regression dilution bias. BMJ. 2010;340:c2289. 10.1136/bmj.c2289 [DOI] [PubMed] [Google Scholar]
Gates Open Res. 2023 Oct 30. doi: 10.21956/gatesopenres.14752.r35041

Reviewer response for version 1

Antoinette du Preez 1

This is a very good article and it is well written. My only comments or questions are as follows:

  1. Why is the APGAR score not included?

  2. I wonder was the age profile link on a demographic basis?

  3. How many of these asphixia babies received breastfeeding?

Well done.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

I cannot comment. A qualified statistician is required.

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Midwifery lecturer at the North-West University (Potchefstroom) South Africa an Advanced midwife.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Gates Open Res. 2023 Oct 23. doi: 10.21956/gatesopenres.14752.r35252

Reviewer response for version 1

Babar Hasan 1

This article tried to look at the real-world effectiveness of one component of a nursing mentorship program (AMANAT: a combination of simulation, team work and communication activities, didactic teaching and bed side mentoring) in effecting the ability of a nurse in diagnosing post-partum hemorrhage and birth asphyxia. The authors demonstrated that the correlation between quantity of exposure to emergency situation simulation and desired outcome is complex and may not be truly linear. A combination of the right number of simulation along with bedside mentoring may lead to better training.

General comments:

Overall this is a very well written and thought out study. The methodology and analysis is sound. I have a couple of observations which if answered will be helpful to further add to the robustness of the study:

  1. How was the individual competency of the mentors assessed? Mentoring (especially bedside mentoring) is an art and variability in individual mentorship skills can have an influence on how individual mentees learn and perform (even if it is simulation-based teaching).

  2. Was there continuous professional development of mentors? If yes, how often?

  3. Was DOD used to assess mentors competency too? If yes, can the authors provide some details on that?

  4. How was the quality of simulation teaching assessed for each mentor? If yes, how was it controlled for as a confounder?

  5. Was any attempt made in doing inter-observer variability/agreement between FIR and DOD assessments?

  6. Seems like overall the median simulation to other activities ratio is quite low (overall simulations sessions were low), do the authors think that they have missed the ‘true’ simulation number threshold due to such low number of simulation sessions overall?

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

Congenital heart disease, quality improvement, human centred mentorship, employee engagement, Artificial intelligence

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Gates Open Res. 2022 Nov 8. doi: 10.21956/gatesopenres.14752.r32703

Reviewer response for version 1

Krishnamurthy Jayanna 1

The authors have made a good attempt at using data from multiple sources to arrive at how the interventions have impacted clinical care. Role of simulations and how they complement traditional training systems in improving quality of care is relevant today in LMIC that are striving hard to fast track MNCH-related SDGs.

However, the results do not show any particular pattern. This could be due to two reasons: 1) there is no linear relationship between the simulations and quality, more so in primary health care centers in LMIC where there are many other factors that may influence the results. 2) Secondly, is it to do with the methodology and statistical analyses used in the study? A methodological and a statistical expert may be better positioned to comment on this.

The results aren't conclusive and hence do not add significantly to existing knowledge base related to interventions to improve QoC. However the conclusions in the main paper seem more definitive and conclusive, when compared to how they appear in the abstract. The latter seems more aligned with the evidence from this study. The conclusions in the main paper should be revisited to reflect the actual findings from the study.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

I cannot comment. A qualified statistician is required.

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Partly

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Maternal and Neonatal Health, Quality of Care, Health Systems Strengthening, Implementation Science and Implementation Research

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    Underlying data

    Dryad: Data for ‘Simulation and nurse-mentoring in a statewide nurse mentoring program in Bihar, India: diagnosis of postpartum hemorrhage and intrapartum asphyxia’. https://doi.org/10.7272/Q6VQ30X9 27 .

    This project contains the following underlying data:

    • -

      FIS_births_complication_counts_long_wk1&7.dta

    Extended data

    Zenodo: Simulation and nurse-mentoring in a statewide nurse mentoring program in Bihar, India: diagnosis of postpartum hemorrhage and intrapartum asphyxia. https://doi.org/10.5281/zenodo.6584800 28 .

    This project contains the following extended data:

    • -

      Online_supplement_01062021.docx (Supplementary methods and Tables 1–4)

    Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).


    Articles from Gates Open Research are provided here courtesy of Bill & Melinda Gates Foundation

    RESOURCES