Abstract
Background
Global strategies recommend a continuum of care for maternal health to improve outcomes and access to care in low and middle income countries (LMICs). South Africa has already set priority interventions along the continuum of care for maternal health, and mandated their implementation at the district health level. However, the approach for monitoring access to this continuum of care has not yet been defined. This review assessed measurement approaches in continuum of care for maternal health among LMICs and their implications for the South African context.
Methods
We conducted a critical interpretive synthesis of quantitative and qualitative research sourced from Academic Search Complete (EBSCO), MEDLINE (Pubmed), Cambridge Journals Online, Credo Reference and Science Direct. We selected 20 out of 118 articles into the analysis, following a rigorous quality appraisal and relevance assessment. The outcomes of the synthesis were new constructs for the measurement of continuum of care for maternal health, derived from the existing knowledge gaps.
Results
We learned that coverage was the main approach for measuring and monitoring the continuum of care for maternal health in LMICs. The measure of effective coverage was also used to integrate quality into coverage of care. Like coverage, there was no uniform definition of effective coverage, and we observed gaps in the measurement of multiple dimensions of quality. From the evidence, we derived a new construct called adequacy that incorporated timeliness of care, coverage, and the complex nature of quality. We described the implications of adequacy to the measurement of the continuum of care for maternal health in South Africa.
Conclusions
Critical interpretive synthesis allowed new understandings of measurement of the continuum of care for maternal health in South Africa. The new construct of adequacy can be the basis of a new measure of access to the continuum of care for maternal health. Although adequacy conceptualizes a more holistic approach, more research is needed to derive its indicators and metrics using South African data sources.
Electronic supplementary material
The online version of this article (10.1186/s12913-018-3278-4) contains supplementary material, which is available to authorized users.
Keywords: Continuum of care, Maternal health, Critical interpretive synthesis, Maternal health services, Low and middle income countries, South Africa
Background
One of the health and well-being targets of the Sustainable Development Goals is to reduce the global maternal mortality ratio to less than 70 deaths per 100,000 live births [1]. Health service delivery strategies such as the continuum of care are touted as important components of strong health systems, needed to prevent and reduce maternal morbidity and mortality [2–4]. The continuum of care ensures that services are provided in an integrated manner to reduce duplication of effort and save costs [3]. It is defined as,
“…access to care provided by families and communities, by outpatient and outreach services, and by clinical services throughout the lifecycle, including adolescence, pregnancy, childbirth, the postnatal period, and childhood. Saving lives depends on high coverage and quality of integrated service-delivery packages throughout the continuum, with functional linkages between levels of care in the health system and between service-delivery packages, so that the care provided at each time and place contributes to the effectiveness of all the linked packages.” ([3], p1359)
The continuum of care framework for maternal and child health in low and middle income countries is illustrated in Fig. 1. This framework illustrates the health service interventions to be provided throughout the lifecycle, as well as the social dimensions of care.
Fig. 1.
Continuum of care for maternal and child health in low and middle income countries (Adapted from [3])
In South Africa, the continuum of care is expected to lower the maternal mortality ratio from the current estimated 140 deaths per 100,000 live births in 2013 [5], to less than 100 deaths per 100,000 live births by 2019 [6]. The Department of Health in South Africa has outlined its own maternal (and child health) continuum of care framework which is similar to the Kerber framework (Fig. 2) [7]. The framework adds care at the specialist/regional hospital levels, and isolates social determinants of health as “intersectoral factors”. In addition, the National Strategic Plan for Maternal, New-born, Child and Women’s Health and Nutrition 2012–2016 of the department has set out priority interventions for up to six days post-delivery [8]. However, there were still gaps in defining pre-pregnancy, post-natal and community support interventions in the strategic plan, despite the existing frameworks elsewhere [9, 10].
Fig. 2.
The continuum of care for maternal and child health framework as adapted to the South African health system [7]
An effective continuum of care is expected to have a positive impact on maternal (and child) health outcomes [2, 3, 11]. It is important, therefore, to use the established frameworks to measure and monitor progress in improving women’s access to the continuum care. Progress in implementing a continuum of care can be measured and monitored at the district level, as this is the “heart” of efforts to improve maternal and new-born services in South Africa and other LMICs [12]. The district encompasses the family/community, outpatient primary centres and maternity units, and the district hospital on the continuum of care for maternal health (Fig. 2). It is the focus of primary health care re-engineering efforts in South Africa, which aim to increase access to good quality care at the district level [2, 11, 13]. However, there is no defined measurement approach to assess how well districts are performing in providing an effective continuum of care.
Researchers and policymakers use a variety of ways to measure and monitor access to the continuum of care for maternal and child health. These are in the form of various indicators that allow public health decision makers to track performance over time and across geographical areas. There is a lack of research for continuum of care measurement approaches in the South African context. This study was a systematic review of literature to explore the maternal continuum of care measurement strategies in public health research and practice among LMICs. The aim was to characterize how maternal continuum of care access was conceptualized and measured; and to describe the implications for a measurement approach in the South African health system. This measurement approach will guide and contribute to monitoring efforts and future research related to the performance of the district health system and evaluation of maternal health outcomes.
Methods
Study design
We conducted a critical interpretive synthesis to systematically select studies, synthesize the findings and critically assess the evidence [14]. Critical interpretive synthesis (CIS) is a review of both qualitative and quantitative studies, and the outcome is a qualitative synthesis of the evidence. The main outcomes of a critical interpretive synthesis are new constructs based on the evidence, and used to further the understanding of phenomena under study. CIS also uses an iterative, dynamic process to refine the review question and further develop the emerging constructs. We thus used a systematic process to first review the evidence and formulate constructs, and an additional literature review to explore their meaning and application in a specific context. The study selection, review and evidence synthesis was conducted in the period November 2016 – June 2017.
Sampling and study selection
We conducted a search of peer reviewed articles, published or translated to English, on Academic Search Complete (EBSCO), MEDLINE (Pubmed), Cambridge Journals Online, Credo Reference and Science Direct. The initial review question was: What indicators, methods, conceptual models and theories are used in the measurement of maternal health service delivery (including quality) and continuum of care in LMICs including South Africa? The following key words were used as prompts: continuum of care measurement, continuum of care model, continuum of care index, composite health measure, health service access measurement, adequacy of care measure, quality of health care measures, maternal health care quality, maternal health care coverage, maternal health care measure, care coverage measure, coverage of care models, and quality of care models. Additional studies were also searched from the bibliographies of the studies selected by the key words [15]. We searched more literature during the analysis phase to validate the emerging constructs.
The process of systematic selection of literature is presented in Fig. 3. There were 556 articles selected after a search and review of titles and abstracts from the literature databases. We then assessed these articles according to the inclusion and exclusion criteria outlined in Table 1.
Fig. 3.
The process of selecting literature into the review
Table 1.
Main inclusion and exclusion criteria for studies selected in the review
| Main Criteria | Specific Criteria |
|---|---|
| Inclusion: | |
| Scope | Focus on: i) maternal continuum of care, or ii) adequacy of maternal healthcare service, or iii) the incorporation of quality into maternal continuum of care implementation or measurement, or iv) quality of care for maternal health within a continuum of care context |
| Population | Studies are focused on women of reproductive age Studies can also include perinatal population (maternal and neonatal health if they are relevant in scope |
| Setting | Observational studies: Low and middle income countries Theoretical studies: relevance to scope Setting may include community care if discussed in terms of continuum of care or integration into the health system Studies may be based in health systems, both health system and community care context, community care or population care (where relevant in scope) |
| Outcome Variables | The study is focused on continuum of care in maternal health, and other conceptual and theoretical approaches in reproductive health and maternal, neonatal, and child health is relevant. Non-maternal health indicators and models of continuum of care are outside the scope of this study |
| Time Period | No publication date limit |
| Language | Articles originally written in English, or an English translation from the original language if available |
| Exclusion: | |
| Study design | Opinion pieces/commentaries/letters to editors within inclusion scope |
| Scope | General maternal health service access and utilization literature outside of inclusion scope |
Criteria guidelines based on [56]
The criteria included assessment of scope, population, outcomes of interest, and healthcare and country settings. We retained 118 articles after applying the inclusion and exclusion criteria. We then conducted a second relevance appraisal using a refined review question, more specific to continuum of care measurement and excluding other measures of health service delivery. This kind of iteration is characteristic of critical interpretive synthesis [14]. We used PICO (Population, Intervention, Comparator and Outcome) guidelines to re-define the review question [16]: “How is the continuum of care (including quality thereof) to improve maternal health measured, for women of child-bearing age, in LMICs?” Using the PICO guided question, a total of 20 studies were selected for quality appraisal and data extraction.
Quality appraisal
We appraised the 20 selected studies in terms of methodological rigour, using a checklist that was based on both qualitative and quantitative research guidelines [17–20]. The studies were assessed on general areas of findings, design and sampling, analysis, reporting and interpretation, and ethics. In addition, we assessed qualitative studies on reflexivity and neutrality, and quantitative studies on risk of bias (Additional file 1). Qualitative and quantitative studies were scored out of 12 points each, and mixed methods studies out of 13. The 20 studies assessed scored between 7 and 11 out of 12 for traditional designs, and 10–11 out of 13 for the mixed methods: Scoring over 50%, all studies were thus included in the data analysis and synthesis.
Data extraction and synthesis
There were 4 qualitative, 4 mixed methods and 12 quantitative studies included in the review. We extracted data onto a form that summarized the methods and design, key themes/indicators/models related to continuum of care measurement, interpretations and recommendations by authors, and our interpretations as investigators [21, 22]. This form is attached as Additional file 2. The forms were then uploaded to ATLAS.ti 8.0, a qualitative analysis software, for data coding and synthesis [23]. The critical interpretive synthesis relies on techniques similar to meta-ethnography in qualitative studies, in this case applied to mixed method evidence [14]. The evidence from the 20 articles is aggregated in Additional file 3 and includes methodology, metrics and indicators, and general findings. We focus our findings on the interpretation of this evidence and describe the main constructs of coverage, effective coverage and quality. We then formulated a new, synthetic construct of adequacy of maternal continuum of care as a result of evidence synthesis and critical reflection. Synthetic constructs provide the higher level explanation or clarity of a phenomenon that doesn’t currently exist in the evidence [14]. We used the synthetic and other constructs to make an argument about the evidence implications to the South African context.
Results
The basis of our synthesis is the evidence summarized in Additional file 3, and it informs our interpretations of the metrics and methods used to measure the continuum of care for maternal health. Since the continuum of care framework was developed [3], researchers have described country specific frameworks and defined indicators for coverage and quality. The number of coverage indicators differs across studies, but consistently includes the “triad” - antenatal care visits, skilled birth attendance and post natal care check-ups [24–31]. Other indicators are related to reproductive health, newborn and child health, as well as the intersectoral factors/social determinants of health along the continuum [25–27, 29, 32–34]. Researchers have also developed varied indicators and indices to monitor quality of care along the continuum [24, 35–38]. These indicators focus mainly on content of care or performance of signal functions across continuum interventions. Lavender et al. (2016) provides a general review of quality frameworks and suggests that other aspects of quality are also important; these include women’s experiences of care and organizational factors such as staffing and resources [38]. The non-medical indicators of quality along the continuum were explored in only 2 studies in our review [35, 36]. Studies relied on different data sources to measure coverage and quality along the continuum, including Demographic and Health Surveys, routine health information systems and other household and facility data (Additional file 3). Many studies in this review used mathematical and statistical modelling methods to develop metrics related to the continuum of care, estimate trends and assess relationships [28, 29, 34, 35, 37, 39].
Composite coverage metrics
Composite coverage metrics are used to monitor women’s access to available maternal health services on the continuum [34, 39]. Coverage estimates are often measured per intervention, while composite metrics reflect a combination of indicators across different continuum packages. The composite coverage metrics found in this review include the Composite Coverage Index [39], Co-Coverage Index [39], and the Coverage Gap Index [34]. Each index consists of a set of indicators representing interventions along the continuum. While possessing different sets of indicators, the indices are nonetheless applied to similar monitoring goals for public health research and practice. For example, Wehrmeister et al. (2016) found the Co-Coverage Index and the Composite Coverage Index to be correlated with each other and used to monitor Reproductive, Maternal, Neonatal and Child Health in similar health care settings [39]. Although they include some maternal health indicators, both of these indices were associated only with neonatal and child health outcomes [39]. The Coverage Gap Index also included many indicators of child health related to immunizations and treatment of childhood illnesses [34].
Composite quality metrics
In order to measure quality of care along the continuum, researchers sometimes used effective coverage as a metric [24, 35, 40]. Effective coverage measures the coverage of interventions delivered with high quality. It is similar to the idea of “quality contacts”, which are often lower in coverage than overall contact/ visitations [24]. Effective coverage can be assessed with not just performance of signal medical functions but can include “non-medical” aspects of quality as well [35]. Effective coverage can be measured for each stage of the maternal lifecycle [24] or for whole facilities [35]. The concept is thus applied differently by researchers, using different indicators in different study settings.
The Quality Index is similar to effective coverage measurement in that it is concerned with indicators of content of care, all aggregated into a single metric [37]. The index was developed using demographic and health survey indicators across antenatal, perinatal and post-natal care. The non-medical aspects of quality included in the metric were related to health provider-client communication about delivery preparedness. The authors recommended inclusion of more indicators of care and communication across the wider continuum of care.
The adequacy of continuum of care for maternal health
Our review revealed gaps in the measurement of the continuum of care for maternal health in terms of i) composite metrics that include both coverage and quality, ii) composite metrics that include more maternal health components, and iii) multi-dimensional quality measurement. In order to address these gaps, we used the evidence in the review to explore a more holistic measure of the continuum of care for maternal health, termed adequacy. Adequacy will address more maternal health indicators, the integration of quality measures, and the intersectoral factors across the continuum.
As an iterative process, CIS allowed us more qualitative review of literature to explore the meaning of the emerging construct of adequacy [14, 41]. Adequacy has been applied to evaluation of antenatal care programs [42–45]; assessment of human and health system resources [6, 46] and overall performance [47]; assessment of dimensions of care [12]; and evaluation of impact of interventions [48, 49]. Adequacy is often expressed as a count or combination of interventions that produce positive effects on maternal health and related outcomes. From our continuum of care perspective therefore, adequacy would reflect the collective threshold of interventions needed to produce positive maternal health outcomes. This collective can be measured via metrics that comprise indicators across packages of care and calculated by statistical methods.
Other authors have measured adequacy within a single package of care and investigated how it affects utilization of services along the continuum [29]. In that study, adequacy was a latent construct consisting of indicators of effective coverage similar to those discussed earlier. Our concept of adequate continuum of care for maternal health focuses on the collective performance of indicators across packages of care. The Kerber framework and its adaptations are useful for guiding the types of interventions to be provided along the continuum of care for maternal health [3, 7]; whereas an adequacy framework can help lay out a measurement approach for monitoring integrated service provision at district levels. Although indicators of adequacy will depend on a thorough assessment of data sources at district levels, the evidence in this review can provide us with a tentative definition of the approach as:
Measurement of timely access to evidence based interventions encompassed by the continuum of care service provision framework for maternal and child health, through a positive experience of care and within a supportive structural context that ensures good quality of care (i.e. competent human resources, actionable information systems, functional referral systems and essential physical resources).
Adequacy is thus a patient-centred measure, even though in practice many of the indicators are measured from the supply side.
Discussion
This critical interpretive synthesis revealed that coverage, effective coverage and quality were the main measurements made on the continuum of care for maternal health. Coverage is a measure of access to healthcare among those who need it, as opposed to mere availability of services [3, 50]. It can be calculated for specific interventions or packages along the continuum of care [26, 27, 30, 33]. Composite metrics or indices of coverage cover a combination of interventions across packages [34, 39]. The composite indices found in this study were reflective of newborn and child health outcomes, while overall indicators varied across studies. This makes them unsuitable for measurement of coverage along the continuum of care for maternal health.
The studies in this review measured quality through a detailed assessment of sets of often numerous indicators [36, 40], or through composite metrics such as effective coverage and the Quality Index [35, 37]. These quality metrics focused on content of care and, to a lesser extent, its “context”. Context of quality of care is defined by organizational factors and patient experience of care [38]. There are frameworks such as the WHO Quality of Care Framework for Maternal and Newborn Health [38, 51] which capture these factors in terms of physical and human resources, referral and information systems, and physical infrastructure. Our definition of an adequate continuum of care for maternal health incorporates the measurement of coverage and the multidimensional quality of care to influence health outcomes.
Besides coverage and quality, an integrated measure of continuum of care adequacy will include the social determinants of health largely missing from existing measures. The concept of timeliness is also crucial to the definition of adequacy of care delivered [29, 42]. The adequacy of continuum of care for maternal health can be measured at the health district level in South Africa, as it encompasses all of the framework interventions needed to improve maternal health outcomes [2, 7, 13]. Horizontal metrics of adequacy at each level of care can help measure performance at that level and support localized decision making. Diagonal metrics that include all levels from family/community to the district level can reflect overall health district performance. These applications of adequacy would be consistent with how current metrics are measured and applied, and will shed more light on maternal health at subnational level.
Studies in this review depended on various data sources to identify or derive indicators for coverage and/or quality along the maternal continuum of care. These data sources included household surveys, community health surveillance, and routine health information system data. In the South African context, adequacy can be measured through triangulation of all these different data sources. Data source interpolation has been recommended as one strategy to improve data sufficiency: for instance, data from population surveys can be supplemented with routine health information system to provide more accurate estimations of coverage and include a wider range of indicators [24, 50]. Examples of these data sources in South Africa are the District Health Information System [52, 53]; Demographic and Health Survey and intersectoral factor data from the national statistics body, Statistics South Africa [54]. Health and socio-demographic surveillance systems such as Agincourt Health and Demographic Surveillance System are also vital sources of data on the life course, which help evaluate coverage and impact of both health and social interventions [55]. These are theoretical applications however, as a detailed assessment of South African health information systems is needed to derive indicators and model the adequacy metrics. The focus of the review was the conceptual backgrounds, indicators and metrics used to measure the continuum of care, and thus we don’t delve into broader aspects of monitoring related to policy and implementation.
Conclusion
Current measurement approaches for the maternal health continuum of care are neither integrated enough nor immediately applicable to the South African context. Their applicability is limited by variability among the metrics, lack of comprehensiveness and the association with child rather than maternal health outcomes among others. Critical interpretive synthesis helped us synthesize the evidence on these approaches and propose a useful way forward. We conceptualized adequacy as an integrated measure of quality, coverage and the social determinants of health/intersectoral factors. This integrated approach will address some of the challenges observed in the current measures, and is focused on maternal health. We discussed the potential configuration of adequacy metrics based on the findings of the synthesis. However, more research is needed to derive indicators from the proposed data sources and formulate metrics using the appropriate methods.
Additional files
The quality assessment criteria for studies selected into the review. The scoring guide for each study in the review based on essential criteria and key indicators/questions for each study design. (DOCX 18 kb)
Tool used to extract data from the articles selected in the critical interpretive synthesis. Includes aims of the study, theoretical framework, data analysis approach, key indicators, and main findings among others. (DOCX 19 kb)
Summary of main findings, methodology and metrics/indicators identified among all the articles reviewed. Summary for the 20 articles selected into the review. (DOCX 50 kb)
Acknowledgements
We would like to thank and acknowledge our colleagues at the University of the Western Cape School of Public Health for their inputs during a workshop of the manuscript.
Funding
Mamothena Carol Mothupi is supported by the South African Research Chair’s Initiative of the Department of Science and Technology and National Research Foundation of South Africa (Grant No 82769), which also paid for the open access publication fees. Any opinion, finding and conclusion or recommendation expressed in this material is that of the author and the NRF does not accept any liability in this regard.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- ANC
Ante Natal Care
- CIS
Critical Interpretive Synthesis
- COC
Continuum of Care
- DHIS
District Health Information System
- DHS
Demographic and Health Survey
- EmOC
Emergency Obstetric Care
- IMPAC
Integrated Management of Pregnancy and Childbirth
- LMIC
Low and Middle Income Country
- LQAS
Lot Quality Assurance Sampling
- MCH
Maternal and Child Health
- MNCH
Maternal Newborn and Child Health
- PMNCH
Partnership for Maternal, Newborn and Child Health
- PNC
Post Natal Care
- RMNCH
Reproductive, Maternal, Neonatal, and Child Health
- SBA
Skilled Birth Attendance
- WHO
World Health Organization
Authors’ contributions
MCM contributed to study conception and design, data collection, analysis and interpretation of data. She drafted and revised the manuscript and approved the final version. LK contributed to study conception and design, data collection and validation, interpretation of data, critical input and revision of manuscript, and approval of final version. HT contributed to interpretation of data, critical input and revision of manuscript, and approved the final version.
Ethics approval and consent to participate
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Footnotes
Electronic supplementary material
The online version of this article (10.1186/s12913-018-3278-4) contains supplementary material, which is available to authorized users.
Contributor Information
Mamothena Carol Mothupi, Email: mamothena@gmail.com, Email: 3617094@myuwc.ac.za.
Lucia Knight, Email: lknight@uwc.ac.za.
Hanani Tabana, Email: htabana@uwc.ac.za.
References
- 1.UN-DESA, “Sustainable Development Goal 3: Ensure healthy lives and promote well-being for all at all ages,” Sustainable Development Knowledge Platform, 2017. [Online]. Available: https://sustainabledevelopment.un.org/sdg3. [Accessed: 17 May 2017].
- 2.Bamford L. “Maternal, Newborn and Child Health,” in South African Health Review, A. Padarath and R. English, Eds. Health Systems Trust, 2012, pp. 49–66.
- 3.Kerber KJ, de Graft-Johnson JE, Bhutta ZA, Okong P, Starrs A, Lawn JE. Continuum of care for maternal, newborn, and child health: from slogan to service delivery. Lancet. 2007;370(9595):1358–1369. doi: 10.1016/S0140-6736(07)61578-5. [DOI] [PubMed] [Google Scholar]
- 4.The Partnership For Maternal Newborn & Child Health . Opportunities for Africa ‘s Newborns: Practical data, policy and programmatic support for newborn care in Africa. 2010. [Google Scholar]
- 5.World Health Organization, “Trends in Maternal Mortality: 1990-2013. Estimates by WHO,UNICEF, UNFPA, The World Bank and the United Nations Population Division,” Geneva, 2014.
- 6.Department of Health South Africa. Strategic Plan Department of Health 2014/15 - 2018/19.: Department of Health, Pretoria, Republic Of South Africa; 2014.
- 7.Department of Health South Africa, Save the children, MRC South Africa, University of Pretoria, and UNICEF . Every death counts: saving the lives of mothers, babies and children in south Africa. 2008. [Google Scholar]
- 8.Department of Health South Africa . Strategic plan for maternal, newborn, child and women ’ s health ( MNCWH ) and nutrition in south Africa: 2012–2016. 2012. [Google Scholar]
- 9.Chola L, Pillay Y, Barron P, Tugendhaft A, Kerber K, Hofman K. Cost and impact of scaling up interventions to save lives of mothers and children: taking South Africa closer to MDGs 4 and 5. Glob Health Action. 2015;8:27265. doi: 10.3402/gha.v8.27265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Chopra M, et al. Achieving the health millennium development goals for South Africa: challenges and priorities. Lancet. 2009;374(9694):1023–1031. doi: 10.1016/S0140-6736(09)61122-3. [DOI] [PubMed] [Google Scholar]
- 11.Chopra M, Daviaud E, Pattinson R, Fonn S, Lawn JE. Saving the lives of South Africa’s mothers, babies, and children: can the health system deliver? Lancet. 2009;374(9692):835–846. doi: 10.1016/S0140-6736(09)61123-5. [DOI] [PubMed] [Google Scholar]
- 12.World Health Organization. The world health report 2005: make every mother and child count. Geneva; 2005.
- 13.Kautzky K, Tollman SM. A perspective on primary health care in South Africa. South African Heal Rev. 2008;2008:17–30. [Google Scholar]
- 14.Dixon-Woods M, et al. Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006;6(1):35. doi: 10.1186/1471-2288-6-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Syst Rev. 2012;1(1):28. doi: 10.1186/2046-4053-1-28. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Schünemann H, Brozek J, Guyatt G, Oxman A. The GRADE Handbook, October 20. 2013. Framing the healthcare question. [Google Scholar]
- 17.Lewin S, et al. Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual) PLoS Med. 2015;12(10):1–19. doi: 10.1371/journal.pmed.1001895. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.The Cochrane Collaboration, “GRADE approach to evaluating the quality of evidence: a pathway | Cochrane Training,” Training.chocrane.org, 2017. [Online]. Available: http://gdt.guidelinedevelopment.org/app/handbook/handbook.html#h.9rdbelsnu4iy. [Accessed: 9 June 2018].
- 19.D. Walsh, M. A. Rm, D. Senior, and S. Downe, “Appraising the quality of qualitative research,” pp 108–119, 2006. [DOI] [PubMed]
- 20.Spencer L, Ritchie J, Lewis J, Dillon L. Quality in qualitative evaluation: a framework for assessing research evidence. United Kingdom; 2003.
- 21.S. A. Munro, S. A. Lewin, H. J. Smith, M. E. Engel, A. Fretheim, and J Volmink, “Patient Adherence to Tuberculosis Treatment : A Systematic Review of Qualitative Research,” vol 4, no. 7, 2007. [DOI] [PMC free article] [PubMed]
- 22.Noyes J, Lewin S. Chapter 5: extracting qualitative evidence. In: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C, editors. Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions., version 1: Cochrane Collaboration Qualitative Methods Group; 2010.[Online] Available at http://methods.cochrane.org/qi/supplemental-handbook-guidance. [Accessed 9 June 2018].
- 23.ATLAS.ti Scientific Software Development GmbH, “ATLAS.ti 8 Windows.” ATLAS.ti Scientific Software Development GmbH, 2016..
- 24.Marchant T, et al. Adding content to contacts: measurement of high quality contacts for maternal and newborn health in Ethiopia, north East Nigeria, and Uttar Pradesh, India. PLoS One. 2015;10(5):1–20. doi: 10.1371/journal.pone.0126840. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Abegunde D, Orobaton N, Sadauki H, Bassi A. Countdown to 2015 : Tracking Maternal and Child Health Intervention Targets Using Lot Quality Assurance Sampling in Bauchi State. 2015. pp. 1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Abegunde D, et al. Monitoring maternal, newborn, and child health interventions using lot quality assurance sampling in Sokoto state of northern Nigeria. 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Singh K, Story WT, Moran AC. Assessing the continuum of care pathway for maternal health in South Asia and sub-Saharan Africa. Matern Child Health J. 2016;20(2):281–289. doi: 10.1007/s10995-015-1827-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Akinyemi JO, Afolabi RF, Awolude OA. Patterns and determinants of dropout from maternity care continuum in Nigeria. BMC Pregnancy Childbirth. 2016;16(1):282. doi: 10.1186/s12884-016-1083-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Owili PO, Adoyo Muga M, Chou Y-J, Elsa Hsu Y-H, Huang N, Chien L-Y. Associations in the continuum of care for maternal, newborn and child health: a population-based study of 12 sub-Saharan Africa countries. BMC Public Health. 2016;16:1–15. doi: 10.1186/s12889-016-3075-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Wang W, Hong R. Levels and determinants of continuum of care for maternal and newborn health in Cambodia- evidence from a population-based survey. 2015. pp. 1–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Yeji F, et al. Continuum of Care in a Maternal, newborn and child health program in Ghana: low completion rate and multiple obstacle factors. PLoS One. 2015;10(12):1–24. doi: 10.1371/journal.pone.0142849. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.K. Ashish et al., “State of maternal, newborn and child health programmes in Nepal : what may a continuum of care model mean for more effective and efficient service delivery?,” J Nepal Heal Res Counc March 2015, 2011;9(19):92–100. [PubMed]
- 33.Roberts DA, et al. Benchmarking health system performance across regions in Uganda : a systematic analysis of levels and trends in key maternal and child health interventions, 1990 – 2011. BMC Med. 2015;13(285):1–17. doi: 10.1186/s12916-015-0518-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Rai RK, Kumar C, Singh PK. District level coverage gap in maternal, newborn and child health care services in India. J Epidemiol Glob Health. 2012;2(4):221–224. doi: 10.1016/j.jegh.2012.12.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Nesbitt RC, et al. Quality along the Continuum : a health facility assessment of intrapartum and postnatal Care in Ghana. PLoS One. 2013;8(11):1–11. doi: 10.1371/journal.pone.0081089. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Wilunda C, Putoto G, Riva DD, Manenti F. Assessing coverage, equity and quality gaps in maternal and neonatal Care in sub- Saharan Africa : an integrated approach. PLoS One. 2015;10(5):1–16. doi: 10.1371/journal.pone.0127827. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Dettrick Z, Gouda HN, Hodge A, Jimenez-Soto E. Measuring quality of maternal and newborn care in developing countries using demographic and health surveys. PLoS One. 2016;11(6):1–21. doi: 10.1371/journal.pone.0157110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Lavender DT. Improving quality of care during labour and childbirth and in the immediate postnatal period. Best Pract Res Clin Obstet Gynaecol. 2016;36:57–67. doi: 10.1016/j.bpobgyn.2016.05.011. [DOI] [PubMed] [Google Scholar]
- 39.Wehrmeister FC, Restrepo-mendez M, Franca VA, Victora G. Summary indices for monitoring universal coverage in maternal and child health care. Bull World Health Organ. 2016;94(November):903–912. doi: 10.2471/BLT.16.173138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Flenady V, et al. eRegistries : indicators for the WHO essential interventions for reproductive, maternal newborn and child health. BMC Pregnancy Childbirth. 2016;16(293):1–15. doi: 10.1186/s12884-016-1049-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009;9:59. doi: 10.1186/1471-2288-9-59. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Heredia-pi I, Servan-mori E, Darney BG, Reyes-morales H, Lozano R. Measuring the adequacy of antenatal health care : a national cross-sectional study in Mexico. Bull World Health Organ. 2016;94(December 2015):452–461. doi: 10.2471/BLT.15.168302. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Kotelchuck M. An evaluation of the Kessner adequacy of prenatal care index and a proposed adequacy of prenatal care utilization index. Am J Public Health. 1994;84(9):1414–1420. doi: 10.2105/AJPH.84.9.1414. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Hodgins S, D’Agostino A. The quality–coverage gap in antenatal care: toward better measurement of effective coverage. Glob Heal Sci Pract. 2014;2(2):173–181. doi: 10.9745/GHSP-D-13-00176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Villar J, et al. WHO antenatal care randomised trial for the evaluation of a new model of routine antenatal care. Lancet. 2001;357(9268):1551–1564. doi: 10.1016/S0140-6736(00)04722-X. [DOI] [PubMed] [Google Scholar]
- 46.Srivastava A, Avan BI, Rajbangshi P, Bhattacharyya S. Determinants of women’s satisfaction with maternal health care: a review of literature from developing countries. BMC Pregnancy Childbirth. 2015;15(1):97. doi: 10.1186/s12884-015-0525-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Ross JA, Campbell OMR, Bulatao R. The maternal and neonatal Programme effort index ( MNPI ) Trop Med Int Heal. 2001;6(10):787–798. doi: 10.1046/j.1365-3156.2001.00787.x. [DOI] [PubMed] [Google Scholar]
- 48.Habicht JP, Victora CG, Vaughan JP. Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. Int J Epidemiol. 1999;28(1):10–18. doi: 10.1093/ije/28.1.10. [DOI] [PubMed] [Google Scholar]
- 49.Burchett HE, Mayhew SH. Maternal mortality in low-income countries: what interventions have been evaluated and how should the evidence base be developed further? Int J Gynaecol Obstet. 2009;105(1):78–81. doi: 10.1016/j.ijgo.2008.12.022. [DOI] [PubMed] [Google Scholar]
- 50.Bryce J, Arnold F, Blanc A, Hancioglu A, Newby H, Requejo J. Measuring coverage in MNCH : new findings, new strategies, and recommendations for action. PLoS Med. 2013;10(5):e1001423. [DOI] [PMC free article] [PubMed]
- 51.Tunçalp Ӧ, et al. Quality of care for pregnant women and newborns-the WHO vision. BJOG An Int J Obstet Gynaecol. 2015;122(8):1045–1049. doi: 10.1111/1471-0528.13451. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Herbst K, Burn A, Nzimande N. “Public Health Data Sources,” in South African Health Review 2002, Ijumba P, Ntuili A, and Barron P, Eds. Durban, 2002, pp. 373–388.
- 53.R. Burger, S. Ranchod, L. Rossouw, and A. Smith, “Strengthening the measurement of quality of care,” in South African Health Review 2016, A. Paradath, J. King, E. Mackie, and J. Casciola, Eds. Durban: Health Systems Trust, 2016, p. 191.
- 54.StatsSA, “Statistics South Africa,” 2017. [Online]. Available: http://www.statssa.gov.za/?page_id=595. [Accessed: May 2017].
- 55.Kahn K, et al. Profile: Agincourt health and socio-demographic surveillance system. Int J Epidemiol. 2012;41(4):988–1001. doi: 10.1093/ije/dys115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Meline T. Selecting studies for systematic review: inclusion and exclusion criteria. Contemp Issues Commun Sci Disord. 2006;33:21–27. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
The quality assessment criteria for studies selected into the review. The scoring guide for each study in the review based on essential criteria and key indicators/questions for each study design. (DOCX 18 kb)
Tool used to extract data from the articles selected in the critical interpretive synthesis. Includes aims of the study, theoretical framework, data analysis approach, key indicators, and main findings among others. (DOCX 19 kb)
Summary of main findings, methodology and metrics/indicators identified among all the articles reviewed. Summary for the 20 articles selected into the review. (DOCX 50 kb)
Data Availability Statement
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.