See related article by Varghese.
We read with interest the paper by Varghese et al.1 regarding the limited effectiveness of a skills and drills intervention to improve emergency obstetric and newborn care and the accompanying editorial by Ricca.2
Ricca discussed some possible reasons as to why the intervention had limited effect when it came to improved diagnosis and management of maternal and newborn complications, including systems weaknesses, provider motivation and behavior, and barriers to teamwork in the workplace.
We would like to draw attention to a further possible reason for the limited effectiveness in translating the training into demonstrable improvements in clinical care. While there were statistically significant improvements in both knowledge and skills, as assessed by pre- and post-intervention knowledge and skills assessments, it may be that these improvements, albeit of significance, still did not cross a threshold of the improvement necessary to make a real difference in clinical practice. It could be argued, for example, that a score of 56% in understanding how to recognize and act in an obstetric emergency is simply still not enough.
We would, therefore, suggest that prior to implementing any further such intervention, both the content and mode of delivery of the training intervention be re-explored with a view to gaining an understanding as to why it was that participants' scores did not reach a higher level. Then appropriate changes can be implemented in the training in order to achieve a greater demonstrable level of knowledge and skills improvement, which may be more likely to have an impact on clinical practice.
In our experience in the multi-country Making It Happen program,3 setting up skills training rooms4,5 and training of health care facility-based mentors and supervisors were successful approaches in bringing about change in behavior and practice after training.
As a final point, evaluating the effectiveness of training programs is the last step of an effective training program design but in order to improve the strength of the results, attention must be paid to more robust designs beyond pre- and post-training assessments. Having a matched comparison group with outcome indictors linked to the training intervention will minimize bias associated with the results. The stepped wedge research design6 allows all clusters to receive the intervention at various times while being part of the control group at some point. This design is better suited for when it is known that an intervention has benefits, and therefore it is unethical to withhold the intervention from other groups.
Competing Interests: None declared.
Cite this article as: Allott HA, Smith H, Kana T, Mdegela M, Bar-Zeev S, Ameh C. Possible reasons for limited effectiveness of a skills and drills intervention to improve emergency obstetric and newborn care. Glob Health Sci Pract. 2017;5(1):175-176. https://doi.org/10.9745/GHSP-D-17-00055
REFERENCES
- 1. Varghese B, Krishnamurthy J, Correia B, et al. Limited effectiveness of a skills and drills intervention to improve emergency obstetric and newborn care in Karnataka, India: a proof-of-concept study. Glob Health Sci Pract. 2016; 4(4):582–593. 10.9745/GHSP-D-16-00143. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Ricca J. Limits of “skills and drills” interventions to improving obstetric and newborn emergency response: what more do we need to learn? Glob Health Sci Pract. 2016; 4(4):518–521. 10.9745/GHSP-D-16-00372. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Ameh CA, van den Broek N. Making It Happen: training health-care providers in emergency obstetric and newborn care. Best Pract Res Clin Obstet Gynaecol. 2015; 29(8):1077–1091. 10.1016/j.bpobgyn.2015.03.019. [DOI] [PubMed] [Google Scholar]
- 4. Utz B, Kana T, van den Broek N. Practical aspects of setting up obstetrics skills laboratories–a literature review and proposed model. Midwifery. 2015; 31(4):400–408. 10.1016/j.midw.2014.11.010. [DOI] [PubMed] [Google Scholar]
- 5. Raven J, Utz B, Roberts D, van den Broek N. The ‘Making it Happen' programme in India and Bangladesh. BJOG. 2011; 118 suppl 2:100–103. 10.1111/j.1471-0528.2011.03119.x. [DOI] [PubMed] [Google Scholar]
- 6. Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis and reporting. BMJ. 2015; 350:h391. 10.1136/bmj.h391. [DOI] [PubMed] [Google Scholar]