Skip to main content
PLOS Global Public Health logoLink to PLOS Global Public Health
. 2024 Mar 12;4(3):e0002888. doi: 10.1371/journal.pgph.0002888

Evaluation of a novel approach to community health care delivery in Ifanadiana District, Madagascar

Bénédicte Razafinjato 1, Luc Rakotonirina 1, Laura F Cordier 1, Anna Rasoarivao 1, Mamy Andrianomenjanahary 1, Lanto Marovavy 1, Feno Hanitriniaina 1, Isaïe Jules Andriamiandra 2, Alishya Mayfield 3, Daniel Palazuelos 3,4,5, Giovanna Cowley 1, Andriamanolohaja Ramarson 1, Felana Ihantamalala 1,3, Rado J L Rakotonanahary 1,3, Ann C Miller 1,3, Andres Garchitorena 1,6, Meg G McCarty 1, Matthew H Bonds 1,3, Karen E Finnegan 1,3,*
Editor: Abraham D Flaxman7
PMCID: PMC10931426  PMID: 38470906

Abstract

Despite widespread adoption of community health (CH) systems, there are evidence gaps to support global best practice in remote settings where access to health care is limited and community health workers (CHWs) may be the only available providers. The nongovernmental health organization Pivot partnered with the Ministry of Public Health (MoPH) to pilot a new enhanced community health (ECH) model in rural Madagascar, where one CHW provided care at a stationary CH site while additional CHWs provided care via proactive household visits. The program included professionalization of the CHW workforce (i.e., targeted recruitment, extended training, financial compensation) and twice monthly supervision of CHWs. For the first eighteen months of implementation (October 2019-March 2021), we compared utilization and proxy measures of quality of care in the intervention commune (local administrative unit) and five comparison communes with strengthened community health programs under a different model. This allowed for a quasi-experimental study design of the impact of ECH on health outcomes using routinely collected programmatic data. Despite the substantial support provided to other CHWs, the results show statistically significant improvements in nearly every indicator. Sick child visits increased by more than 269.0% in the intervention following ECH implementation. Average per capita monthly under-five visits were 0.25 in the intervention commune and 0.19 in the comparison communes (p<0.01). In the intervention commune, 40.3% of visits were completed at the household via proactive care. CHWs completed all steps of the iCCM protocol in 85.4% of observed visits in the intervention commune (vs 57.7% in the comparison communes, p-value<0.01). This evaluation demonstrates that ECH can improve care access and the quality of service delivery in a rural health district. Further research is needed to assess the generalizability of results and the feasibility of national scale-up as the MoPH continues to define the national community health program.

Introduction

More than half of the world’s population lacks access to essential health services [1]. This is especially true for low-income rural communities in Sub-Saharan Africa, where use of primary care health services decreases exponentially with geographic distance [2,3]. The growing movement for universal health coverage (UHC) has been bolstered by a corresponding movement toward strengthened, professionalized community health workers (CHWs) who help address challenges with health care accessibility [4]. However, there is variability in the design, management, and implementation of CHW programs across countries, and often limited evidence on best practice to inform guidelines [5]. There is limited rigorous evidence of best practices for CHW recruitment, length of training and training modalities, supervision, CHW: population ratios, and data collection and use [59].

In Madagascar, a country with substantial geographic and financial barriers to care, community health workers (CHWs) provide community-based primary care services [10]. Ministry of Public Health (MoPH) policy requires that there be two CHWs in every fokontany (smallest administrative level comprising of one or several villages, ranging from 400 to 4,500 people) who are elected by their community. CHW tasks include the delivery of integrated community case management (iCCM) for children under-five, malnutrition screening, and community health education. There is no formal education requirement for CHWs, and job-related training varies depending on government and partner support. CHWs often engage in other formal work and are not required to be available to provide healthcare on an established schedule. Under national policy, CHWs do not receive a salary. Instead, they sell medications for a small profit, and thus generate income through a social marketing mechanism. Per national policy, CHWs are supervised through monthly meetings at a health center by the head of the health center if the facility has funds available to support CHW travel for supervision. Effectiveness of Madagascar’s CH program has two kinds of challenges: limitations that result from the design of existing policy; and limitations in the implementation of the system based on that policy (i.e. fidelity). Together, the challenges are reflected in inadequate resources, limited supervision, medication stock outs, variable training, and limited data on service provision.

In 2014, the nongovernmental organization (NGO) Pivot began a partnership with the Government of Madagascar to establish a model health district through integrated health system strengthening at all levels of the local public health system in Ifanadiana District. Initial interventions focused on primary health care centers and a district hospital [11]. This has been associated with improvements in the majority of maternal and child health indicators, but with unclear signals on infant and under-five mortality [12]. One explanation for apparent modest effects on mortality is inequity in health care access due to geographic barriers. For example, children living further than 5km from strengthened health facilities accessed care less than once per year even after substantial health system strengthening efforts [3]. Since 2016, Pivot has collaborated with the MoPH to strengthen the community health program with additional training, direct supervision, modest compensation, and support with infrastructure, equipment, and supplies. However, challenges related to recruitment, patient access, and supervision were identified. As a result, in 2019, the MoPH and Pivot initiated a redesigned enhanced community health (ECH) program guided by global best practices on CHW optimization regarding recruitment, compensation, supervision, and training [13]. This program included proactive case-finding through monthly household visits combined with ongoing provision of care at fixed community health sites. We evaluate the impact of this ECH model compared to the existing strengthened program (through Pivot support) using routinely collected program data during the first year of implementation.

Methods

Ifanadiana is a rural district located in the southeast of Madagascar with a population of 182,000, nearly 33,000 of whom are children under five. The district is composed of 15 communes and 195 fokontany. In 2014, the baseline of a population-representative household survey found under-five mortality was 145 per 1,000 live-births [14]. The follow-up 2018 study found prevalence of 9.1% of diarrhea, 20.1% of fever, and 16.1% of cough and difficulty breathing [in the two weeks preceding the survey) among children under-five in the district [15] (S1 Table).

In 2016, Pivot began supporting the community health program in select communes of Ifanadiana District. In 2019, guided by the principles put forth by the World Health Organization and the CHW Assessment and Improvement Matrix (AIM) Framework [5,13], Pivot proposed an ECH pilot in the Ranomafana commune of Ifanadiana District, where CHWs had been underperforming relative to other communes (Table 1). Ranomafana commune consists of eight fokontany, with an estimated population of 11,960, including 2,150 children. ECH is part of a strategy to achieve UHC through expanded access to high quality services [13]. In partnership with the MoPH, ECH focused on 1) professionalization of CHWs; 2) improved care delivery through a two-pronged approach; and 3) reinforcement of the health management information system (HMIS).

Table 1. Summary of community health intervention for intervention area, control area, and the rest of the country under Madagascar’s national program with key differences of ECH bolded.

  Madagascar national program Comparison communes:
Pivot support of national program
Intervention commune:
Enhanced community health pilot
Staffing • 2 CHWs per fokontany • 2 CHWs per fokontany 3–5 CHWs per fokontany depending on geographic spread and population
CHW recruitment strategy and selection criteria • Elected by community
• Literate
• Predominantly male
• Elected by community
• Literate
• Predominantly male
• Jointly recruited by NGO and community
• Literate
Gender parity
Training • Inconsistently trained in iCCM and family planning, depending on partner and MoPH support • Consistently trained in iCCM and family planning, community malnutrition, tuberculosis screening Trained in new protocols for proactive doorstep care, includes iCCM and family planning, community malnutrition, tuberculosis screening
Supervision • Monthly group supervision at health center, depending on resources • Monthly group supervision at health center
• Quarterly community-based supervision
Monthly group supervision at health center
Monthly community-based supervision
Compensation • Per diems for training and supervision
• Profit through sale of medication
• Per diems for training and supervision
• Stipend equal to profit for medication sale (CHWs do not sell medications)
Salary equivalent to Madagascar’s minimum wage
Workflow • Work from fixed location (often their home)
• Availability variable
• Work from fixed community health posts
• Availability variable
Visit every household once per month
• Community health post remains open
CHWs work full-time
Data collection • Varies • Complete iCCM form, register, and monthly activity report Complete iCCM form, adapted register that record household visits, and monthly activity report
User Fees • Free consultation, fee for medicine • No fees to patients • No fees to patients

As Table 1 indicates, key components of the strategy to professionalize CHWs included targeted recruitment, compensation, increased supervision, and additional training. The number of CHWs in each fokontany were increased based on population density. Newly recruited CHWs were active in the community, full-time residents, physically capable of traveling from house to house, and had a gender balance with the goal of achieving parity across the CHW cohort. The total number of CHWs across the 8 fokontany of the intervention commune increased from 16 to 28 (3–5 per fokontany), an average of one CHW per 427 people. CHWs received a monthly salary equivalent to Madagascar’s minimum wage and were formally evaluated every 6 months (delayed in 2020 due to COVID-19), which included a review of productivity and quality of care. In this pilot program, CHWs could be terminated if they were not performing adequately, in contrast to the national program where termination of elected CHW was determined by local political leaders.

Pivot created a new cadre of community health supervisors to support the implementation of the ECH program. Community health supervisors are health care workers with a degree in nursing or midwifery, and with experience in community health. Supervision included two activities per month: 1) community-based supervision in which the CHW and supervisor met one-on-one, where the supervisor provided feedback on observed sick child visits; and 2) health center-based group supervision which included discussion of activities, review of data, and training on new tools or methods. During community-based visits, supervisors also provided community health education and care for sick children >5 years old, whose care was not part of the iCCM protocol or national policy.

Improved care delivery included a redesign of service delivery and workflow. The two-pronged approached in ECH commune required CHWs to provide care both at the CH site and through proactive household visits. One CHW in each fokontany was stationed at the CH site while other CHWs traveled to a circuit of homes. The redesign of care delivery was intended to overcome geographic barriers (e.g. distance, time, cost) which prevent patients from seeking care from CHWs, and to formalize the relationship between CHWs and the households, while also maintaining a functional CH site [1618]. During household vsits, the CHWs actively sought out sick children and followed up on children previously diagnosed with malaria, diarrhea, pneumonia, or malnutrition. CHWs followed up with sick children three days after diagnosis of any illness to determine if symptoms had resolved and, for severe cases where referral was required, CHWs visited the next day to ensure that the sick child had visited the health center.

To strengthen the CH HMIS system, program managers oversaw development and use of new data collection and management tools. During field-based visits, supervisors reviewed data collection processes and completion of forms to ensure that CHWs were collecting high quality data on their activities. At monthly health-center based supervisions, CHWs reviewed and submitted monthly aggregate activity reports.

The impact of the program was evaluated using the data that were routinely collected as part of the program. Data were extracted on the number of children seen at CH sites and via proactive home visits from monthly CHW activity reports to measure CHW utilization by children under-five; a visit was defined as a new or follow-up clinical encounter for sick child care. Information on adherence to the iCCM protocol, a proxy measure for quality of care, came from this same monthly report. The monthly report includes measures of iCCM protocol adherence for all CHW visits: correct treatment of diarrhea (child with diagnosis of simple diarrhea provided with ORS), respiratory infection (child with diagnosis of suspected pneumonia treated with amoxicillin), malaria (child with malaria diagnosed by rapid diagnostic test treated with ACT), and speed of fever treatment (child with fever seen by CHW within 24 hours of fever onset). There was also data obtained on CHW adherence to the iCCM protocol from the observation checklist completed by CHW supervisors during field-based direct supervision visits. Using data from the observation checklist, we calculated a summary measure of quality of care, correct care, which is defined as how many of the total steps of the iCCM protocol the CHW completed correctly based on the child’s diagnosis; this includes assessment, disease classification, treatment, and counseling of the caregiver. Correct care was only calculated following the initiation of ECH as a revised supervision tool was introduced as part of the CH program redesign.

A quasi-experimental study design was used to determine the impact of ECH. We compared outcomes in the intervention area before and after the implementation of ECH with outcomes from five other communes in Ifanadiana. These other communes were supported by Pivot and the MoPH as defined in Table 1 as part of a broader health system strengthening partnership. A summary of health system readiness and disease burden in the intervention and comparison communes can be found in Supplemental Information. It was not possible to compare the intervention area to the national model because data from CHWs registries were not reliably maintained and reported.

Program cost data were extracted from the financial program records of the NGO which oversaw implementation. All financial expenditure data were recorded in QuickBooks.

The ECH pilot began in October 2019. Utilization and program delivery were assessed in the intervention and comparison communes before and after the start of the intervention. A two-sample t-test was used to compare continuous outcomes and a chi-squared test for categorical outcomes. We estimated the difference-in-differences in monthly consultations with children under-five using a linear regression. We compared correct care using a t-test. Data analysis was completed in R version 3.5.2.

This study was approved by the Secretary General of the Ministry of Public Health of Madagascar and was determined to be not human subjects research by Harvard Medical School’s Institutional Review Board because it is based on aggregated, routinely collected data.

Results

Although the ECH intervention commune had low performance prior to the intervention, after the intervention, it significantly outperformed the strengthened comparison communes in nearly every CHW performance metric. During the eighteen-month study period, CHWs in the intervention commune completed 9,652 visits with children under-five, representing a 269.0% increase in consultations from the eighteen months prior. Mean monthly consultations for children under-five increased significantly more for the ECH intervention area than for the comparison area (DID estimate 149.85 [95% confidence interval 49.3, 250.4], p-value <0.01) (S1 Text). Average monthly per-capita utilization in the ECH area was 0.25, which corresponds to 2.9 visits per capita per year (Fig 1). Average monthly per capita utilization was 0.19 in the comparison group for the same eighteen-month intervention period. Per capita utilization increased over time across all eight fokontany in the intervention commune (Fig 2).

Fig 1.

Fig 1

Average monthly per capita utilization by children under-five of CHWs by intervention group from January 2016 to March 2020 (left). A comparison of correct care (right), measured through direct observation of the CHW during an iCCM, in the intervention commune (black) and comparison communes receiving enhanced standard of care (blue) from October 2019 to March 2020.

Fig 2. Per capita community health utilization by fokontany in the intervention commune in October 2018-March 2019 (red) and October 2019-March 2020 (blue).

Fig 2

The district of Ifanadiana is in the inset with the intervention commune in red. The base map layer comes from https://data.humdata.org/dataset/cod-ab-mdg.

In the intervention commune, 40.3% of CHW consultations were proactive at the household (Fig 3); on average, 85.9% of households were visited at least once every month. CHWs in the intervention commune evaluated 6,762 cases of fever (70.1% of visits), 1,153 cases of diarrhea (11.9% of visits), 4,789 cases of pneumonia (49.6% of visits), and 1,407 cases of cough or cold (14.6%) during the eighteen-month period (some children were diagnosed with more than one illness during their visit). In the comparison communes, CHWs completed a total of 33,942 consultations with children under-five during the study period. Of these visits, 83.1% were for fever, 10.1% for diarrhea, 47.0% with pneumonia, and 11.7% with cough or cold.

Fig 3. CHW visits by location in the intervention commune during the implementation of ECH.

Fig 3

Household visits are in (blue) and CH site visits are in (orange).

Correct care, as measured through supervisor observation, increased from 32.0% in October 2019 to 98.3% in March 2021 in the intervention commune. Over the eighteen-month study period, in 85.4% of observed visits, CHWs provided care which was consistent with all aspects of the iCCM protocol in the intervention commune; in the comparison communes, CHWs demonstrated complete protocol adherence in 57.7% of observed visits (p-value of difference <0.01) (Table 2). Likewise, CHWs in the intervention commune demonstrated better evaluation of danger signs (97.6% vs 91.2% in comparison area, p-value<0.01), correct treatment of illness (98.1% vs 92.6%, p-value<0.01), and counseling of caregiver on treatment and disease management (89.4% vs 73.2%, p-value<0.01). CHWs in intervention and comparison communes demonstrated similarly high rates of correct diagnosis of illness. All measures of quality improved sharply in the intervention area in the first three months of the study period and remained high. By the end of the first six months of implementing enhanced care, the quality of iCCM care provided by newly recruited CHWs was equal to that of existing CHWs who had already been working in community health (S2 Table).

Table 2. Quality of care of iCCM provided by CHWs during observed visits from October 2019-March 2020.

Intervention commune Comparison communes p-value
Number of clinical encounters observed 636 2166
Children correctly cared for according to iCCM protocol
85.4% 57.7% <0.01
Correct evaluation of danger signs 97.6% 91.2% <0.01
Correct diagnosis of illness 99.4% 97.9% 0.10
Correct treatment of illness 98.1% 92.6% <0.01
Caregiver counseled 89.4% 73.2% <0.01
Child correctly referred to health center 94.1% 80.8% 0.01

Disease-specific quality of care measures varied over time (Fig 4). During the eighteen-month study period, the intervention commune provided higher rates of treatment of malaria (intervention = 79.3%, comparison = 57.1%, p-value = 0.04), pneumonia (intervention = 65.0%, comparison = 56.3%, p-value = 0.14), and diarrhea (intervention = 88.3%, comparison = 69.3%, p-value<0.001). Only 10.3% of fever cases were seen within 24 hours of symptom onset in the intervention commune, compared to 12.9% in the comparison communes during the study period.

Fig 4.

Fig 4

Disease-specific quality of care measures from iCCM patient visits for malaria treatment with ACT (top left), speed of fever treatment (top right), diarrhea treatment with ORS (bottom left), and pneumonia treatment with amoxicillin (bottom right) comparing the intervention commune (black) with the average of the quality measure from the five comparison communes (blue).

Supervisors completed 376 supervision visits in the intervention area and directly observed 636 sick child visits to document quality of care and provide feedback. Nearly all (94.7%) of CHWs were supervised twice per month for 14 of 18 months during the study period; supervision was suspended April-June 2020 due to concerns about COVID-19 and in November 2020. In the comparison communes, supervisors completed 1,176 community supervision visits. On average, 66.5% of CHWs in comparison communes received community-based supervision per month.

Data quality

In both intervention and comparison communes, the monthly CHW activity report was submitted on time and without missing data. Over the study period, the concordance rate between the iCCM form (used to record detailed data during the patient visit), the iCCM register (a line listing summary of each patient visit), and the monthly report (an aggregate summary of the activity of all CHWs in a commune) was 90.8% in the intervention commune and 89.5% in comparison areas. Higher rates of concordance indicate data which is consistent across sources.

Program costs

The estimated cost of the ECH model is $4.45 per capita for the first year of implementation, compared to $2.32 per capita for the care model in the comparison communes. ECH model costs include startup costs of training and equipping new CHWs (e.g. medical supplies, equipment for traveling on foot through hilly, wet terrain) and salary support. This cost excludes mobile technology development and implementation, which took place in the second year of the project at the end of this study period.

Discussion

Here, we evaluated the performance of an enhanced community health program. Due to lack of data availability, this performance is not compared to the national standard of care, which is substantially under-resourced and supported. Instead, it is compared to communes with strengthened CHWs that, while locally elected and operating from a designated location in accordance with national policies, receive technical and financial support from an NGO for supervision and training, as well as modest compensation which ensures consultations are free of charge. The ECH model includes both proactive home visits and health post-based care by professionalized CHWs and was implemented in rural Madagascar. The program demonstrated improvements in every measure of service delivery and quality of care over time and in comparison to other communes that had more modestly strengthened community health systems. Evaluation of the program provides lessons for national stakeholders and program managers on the impact of program re-redesign and reveals important considerations for scale-up.

Over the eighteen-month study period, almost half of visits completed by CHWs in the intervention commune were proactive household visits. The increase in per capita utilization during the intervention period provides clear evidence that the two-pronged approach to care increased access. This is further supported by the increase in per capita utilization in fokontany which are farthest from the health center. Both areas of intervention had high rates of referral, but the data do not indicate if the referrals were completed. This information is important as CHWs refer patients for higher levels of care when danger signs are present or when they are unable to treat the illness.

The enhanced community health program introduced fully professionalized CHWs to the community health system. Initially, the program required intensive program management and placed high performance expectations on CHWs and supervisors. To ensure that CHWs were supervised twice per month, supervisors from other communes were called to the intervention area to provide community-based supervision. Although this was effective in meeting supervision targets and improving quality of care, sustaining such intensive intervention is a key challenge; indeed, supervision rates were challenging to maintain during the COVID-19 surge and under other program pressures. Supervision often requires supervisors to travel for multiple days on foot to reach CHWs in remote communities. Under national guidelines, supervision of CHWs is the responsibility of health center managers. The development of a cadre of CHW supervisors is one innovation of the ECH model that helped address the time limitations of health center staff who are needed for direct provision of clinical care. The World Health Organization names supportive supervision as an important component of CH programs and research highlights the importance of supervision in establishing effective high quality care, although evidence on the impact of supervision on quality of care is mixed [7,19]. Although the development of a cadre of dedicated supervisors was important for the launch of ECH, for long term implementation and scale up, Pivot has proposed training high-performing CHWs to serve as peer mentors and perform many of the functions of supervisors.

Community health workers included in the ECH intervention demonstrated improvements in utilization and quality of care. It is not possible to isolate effects of any single element of the program on outcomes. It is possible that these changes were influenced by increasing familiarity with protocols over time and not program changes. Additionally, as supervision included support on record-keeping and data submission, it is possible that changes over time are a reflection of better reporting by CHWs. Supervision included support for reporting in both ECH and comparison communes.

The estimated costs of ECH model–roughly double that of the comparison commnunes—are consistent with those found in other settings [20]. When studying Madagascar’s national community health program, Brunie et al found that CHWs reported high levels of satisfaction with their work, but also high levels of financial uncertainty and most relied on subsistence farming for their livelihoods [21]. Under the ECH model in Ranomafana, CHWs received a financial incentive equivalent to Madagascar’s minimum wage (approximately $70 USD) per month, which helped alleviate these financial concerns. Sustainability and harmonization are key factors when considering CHW salary as part of iCCM programs in low resource countries [22]. This evaluation provides evidence of the feasibility of providing remuneration as part of program management although more research is necessary for national scale-up.

There are pressing questions about how CHW programs should be designed and implemented. Relevant global evidence is mixed and often weak [19]. Using data collected as part of MoPH reporting and program documentation, our evaluation of enhanced community health in a rural commune in Madagascar can contribute to global evidence on the optimal design of community programs. Moreover, this experience can provide actionable lessons for Madagascar’s national community health program on program design to align with global best practice on community health program principles and contribute to the country’s objectives around universal health coverage.

Supporting information

S1 Table. Health system readiness and disease burden in intervention and comparison communes.

(XLSX)

pgph.0002888.s001.xlsx (9.7KB, xlsx)
S2 Table. Comparison of newly hired and existing CHWs.

(XLSX)

S1 Text. Interrupted time series analysis.

(DOCX)

pgph.0002888.s003.docx (13.9KB, docx)

Acknowledgments

We would like to thank the health system professionals who helped with the conception, implementation and realization of community health activities: Dr Jafeta Andriantahina (Director of Basic Health Care), the health center staff in Ranomafana, the district health team, the Ministry of Health, the supervisors, and especially the CHWs, supervisors, and communities of Ifanadiana District.

Data Availability

Data availability complies with guidelines as established through the publication and the data sharing agreement between Pivot and the Madagascar Ministry of Public Health. GIS data from Ifanadiana District are publicly available on OpenStreetMap (https://www.openstreetmap.org); the map base layer can be found at: https://data.humdata.org/dataset/cod-ab-mdg?. Health system data may be shared upon request by contacting science@pivotworks.org.

Funding Statement

This work was supported through funding from Pivot to KEF, and from CRI Foundation, MJS Foundation, and Wagner Foundation, and the Herrnstein Family Foundation to Pivot. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.World Health Organization, International Bank for Reconstruction and Development. Tracking Universal Health Coverage: 2017 Global Monitoring Report 2017.
  • 2.GBD 2016 SDG Collaborators. Measuring progress and projecting attainment on the basis of past trends of the health-related Sustainable Development Goals in 188 countries: an analysis from the Global Burden of Disease Study 2016. Lancet. 2017;390(10100):1423–59. doi: 10.1016/S0140-6736(17)32336-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Garchitorena A, Ihantamalala FA, Revillion C, Cordier LF, Randriamihaja M, Razafinjato B, et al. Geographic barriers to achieving universal health coverage: evidence from rural Madagascar. Health Policy Plan. 2021;36(10):1659–70. doi: 10.1093/heapol/czab087 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Tulenko K, Mogedal S, Afzal MM, Frymus D, Oshin A, Pate M, et al. Community health workers for universal health-care coverage: from fragmentation to synergy. Bull World Health Organ. 2013;91(11):847–52. doi: 10.2471/BLT.13.118745 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.World Health Organization. WHO Guidelines on Health Policy and System Support to Optimize Community Health Worker Programmes. Geneva2018. [PubMed]
  • 6.Cometto G, Ford N, Pfaffman-Zambruni J, Akl EA, Lehmann U, McPake B, et al. Health policy and system support to optimise community health worker programmes: an abridged WHO guideline. Lancet Glob Health. 2018;6(12):e1397–e404. doi: 10.1016/S2214-109X(18)30482-0 [DOI] [PubMed] [Google Scholar]
  • 7.Hill Z, Dumbaugh M, Benton L, Kallander K, Strachan D, ten Asbroek A, et al. Supervising community health workers in low-income countries—a review of impact and implementation issues. Glob Health Action. 2014;7:24085. doi: 10.3402/gha.v7.24085 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Luckow PW, Kenny A, White E, Ballard M, Dorr L, Erlandson K, et al. Implementation research on community health workers’ provision of maternal and child health services in rural Liberia. Bull World Health Organ. 2017;95(2):113–20. doi: 10.2471/BLT.16.175513 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Musoke D, Ssemugabo C, Ndejjo R, Atusingwize E, Mukama T, Gibson L. Strengthening the community health worker programme for health improvement through enhancing training, supervision and motivation in Wakiso district, Uganda. BMC Res Notes. 2019;12(1):812. doi: 10.1186/s13104-019-4851-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Perry HB, editor. Health for the People: National Community Health Worker Programs from Afghanistan to Zimbabwe. 2020. [Google Scholar]
  • 11.Cordier LF, Kalaris K, Rakotonanahary RJL, Rakotonirina L, Haruna J, Mayfield A, et al. Networks of Care in Rural Madagascar for Achieving Universal Health Coverage in Ifanadiana District. Health Syst Reform. 2020;6(2):e1841437. doi: 10.1080/23288604.2020.1841437 [DOI] [PubMed] [Google Scholar]
  • 12.Garchitorena A, Miller AC, Cordier LF, Randriamanambintsoa M, Razanadrakato HR, Randriamihaja M, et al. District-level health system strengthening for universal health coverage: evidence from a longitudinal cohort study in rural Madagascar, 2014–2018. BMJ Glob Health. 2020;5(12). doi: 10.1136/bmjgh-2020-003647 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Ballard M, Bonds MH, Buri J, Foth J, Fiori K, Holeman I, et al. CHW AIM: Updated Program Functionality Matrix for Optimizing Community Health Programs 2018. [Google Scholar]
  • 14.Miller AC, Garchitorena A, Rabeza V, Randriamanambintsoa M, Rahaniraka Razanadrakato HT, Cordier L, et al. Cohort Profile: Ifanadiana Health Outcomes and Prosperity longitudinal Evaluation (IHOPE). Int J Epidemiol. 2018;47(5):1394–5e. doi: 10.1093/ije/dyy099 [DOI] [PubMed] [Google Scholar]
  • 15.National Institute of Statistics (INSTAT). Enquete sur le Reinforcement des Systemes de Sante, District Ifanadiana 2018. [Google Scholar]
  • 16.Ihantamalala FA, Herbreteau V, Revillion C, Randriamihaja M, Commins J, Andreambeloson T, et al. Improving geographical accessibility modeling for operational use by local health actors. Int J Health Geogr. 2020;19(1):27. doi: 10.1186/s12942-020-00220-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Garchitorena A, Miller AC, Cordier LF, Ramananjato R, Rabeza VR, Murray M, et al. In Madagascar, Use Of Health Care Services Increased When Fees Were Removed: Lessons For Universal Health Coverage. Health Aff (Millwood). 2017;36(8):1443–51. doi: 10.1377/hlthaff.2016.1419 [DOI] [PubMed] [Google Scholar]
  • 18.Evans MV, Andreambeloson T, Randriamihaja M, Ihantamalala F, Cordier L, Cowley G, et al. Geographic barriers to care persist at the community healthcare level: Evidence from rural Madagascar. PLOS Glob Public Health. 2022;2(12):e0001028. doi: 10.1371/journal.pgph.0001028 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Whidden C, Thwing J, Gutman J, Wohl E, Leyrat C, Kayentao K, et al. Proactive case detection of common childhood illnesses by community health workers: a systematic review. BMJ Glob Health. 2019;4(6):e001799. doi: 10.1136/bmjgh-2019-001799 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Nepal P, Schwarz R, Citrin D, Thapa A, Acharya B, Acharya Y, et al. Costing Analysis of a Pilot Community Health Worker Program in Rural Nepal. Glob Health Sci Pract. 2020;8(2):239–55. doi: 10.9745/GHSP-D-19-00393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Brunie A, Mercer S, Chen M, Andrianantoandro T. Expanding Understanding of Community Health Worker Programs: A Cross-Sectional Survey on the Work, Satisfaction, and Livelihoods of CHWs in Madagascar. Inquiry. 2018;55:46958018798493. doi: 10.1177/0046958018798493 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Chilundo BG, Cliff JL, Mariano AR, Rodriguez DC, George A. Relaunch of the official community health worker programme in Mozambique: is there a sustainable basis for iCCM policy? Health Policy Plan. 2015;30 Suppl 2(Suppl 2):ii54–ii64. doi: 10.1093/heapol/czv036 [DOI] [PMC free article] [PubMed] [Google Scholar]
PLOS Glob Public Health. doi: 10.1371/journal.pgph.0002888.r001

Decision Letter 0

Abraham D Flaxman

13 Apr 2023

PGPH-D-22-01753

Evaluation of a novel approach to community health care delivery in Ifanadiana District, Madagascar

PLOS Global Public Health

Dear Dr. Finnegan,

Thank you for submitting your manuscript to PLOS Global Public Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Global Public Health’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by May 13 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at globalpubhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pgph/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Abraham D. Flaxman, Ph.D.

Academic Editor

PLOS Global Public Health

Journal Requirements:

1. Please amend your detailed online Financial Disclosure statement. This is published with the article. It must therefore be completed in full sentences and contain the exact wording you wish to be published.

a) Please clarify all sources of funding (financial or material support) for your study. List the grants (with grant number) or organizations (with url) that supported your study, including funding received from your institution. 

b) State the initials, alongside each funding source, of each author to receive each grant.

c) State what role the funders took in the study. If the funders had no role in your study, please state: “The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

d) If any authors received a salary from any of your funders, please state which authors and which funders.

2. Please declare all competing interests beginning with the statement "I have read the journal's policy and the authors of this manuscript have the following competing interests:"

3. Please provide a complete Data Availability Statement in the submission form, ensuring you include all necessary access information or a reason for why you are unable to make your data freely accessible. If your research concerns only data provided within your submission, please write "All data are in the manuscript and/or supporting information files" as your Data Availability Statement.

4. Some material included in your submission may be copyrighted. According to PLOS’s copyright policy, authors who use figures or other material (e.g., graphics, clipart, maps) from another author or copyright holder must demonstrate or obtain permission to publish this material under the Creative Commons Attribution 4.0 International (CC BY 4.0) License used by PLOS journals. Please closely review the details of PLOS’s copyright requirements here: PLOS Licenses and Copyright. If you need to request permissions from a copyright holder, you may use PLOS's Copyright Content Permission form.

Please respond directly to this email or email the journal office and provide any known details concerning your material's license terms and permissions required for reuse, even if you have not yet obtained copyright permissions or are unsure of your material's copyright compatibility. 

Potential Copyright Issues:

Figure 2: please (a) provide a direct link to the base layer of the map (i.e., the country or region border shape) and ensure this is also included in the figure legend; and (b) provide a link to the terms of use / license information for the base layer image or shapefile. We cannot publish proprietary or copyrighted maps (e.g. Google Maps, Mapquest) and the terms of use for your map base layer must be compatible with our CC-BY 4.0 license. 

Note: if you created the map in a software program like R or ArcGIS, please locate and indicate the source of the basemap shapefile onto which data has been plotted.

If your map was obtained from a copyrighted source please amend the figure so that the base map used is from an openly available source. Alternatively, please provide explicit written permission from the copyright holder granting you the right to publish the material under our CC-BY 4.0 license.

Please note that the following CC BY licenses are compatible with PLOS license: CC BY 4.0, CC BY 2.0 and CC BY 3.0, meanwhile such licenses as CC BY-ND 3.0 and others are not compatible due to additional restrictions. 

If you are unsure whether you can use a map or not, please do reach out and we will be able to help you. The following websites are good examples of where you can source open access or public domain maps: 

* U.S. Geological Survey (USGS) - All maps are in the public domain. (http://www.usgs.gov

* PlaniGlobe - All maps are published under a Creative Commons license so please cite “PlaniGlobe, http://www.planiglobe.com, CC BY 2.0” in the image credit after the caption. (http://www.planiglobe.com/?lang=enl) 

* Natural Earth - All maps are public domain. (http://www.naturalearthdata.com/about/terms-of-use/)

5. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

Here are my thoughts on a few additional changes that I think would enhance the impact of this work for future readers:

In Table 1, is there a way to highlight the key differences between the columns for each row?

The costing evidence is valuable enough that I would propose you move it from the discussion to the results section (and potentially add some description of the approach to gathering this data to the methods section). You could potentially also present it in an additional table in the results section, to make sure busy readers notice it. Of course, your discussion of the implication of these costs is still appropriate to include in your discussion!

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does this manuscript meet PLOS Global Public Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Global Public Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Overall, the study provides a clear summary of a quasi-experimental study that evaluated the impact of a new enhanced community health (ECH) model on the utilization and quality of integrated community case management in a rural health district in Madagascar. The use of specific indicators, such as sick child visits and per capita monthly under-five visits, helps to demonstrate the effectiveness of the ECH model.

One limitation of the study is that the quasi-experimental design cannot establish causality, and other factors besides the ECH model may have contributed to the observed improvements in utilization and quality of care. I think the study can be strengthened by additional examination such as performing an interrupted time series analysis with control to rule out alternative explanations for observed changes in the dependent variable over time instead of only conducting t-test and chi-squared test.

The study acknowledges the need for further research to assess the generalizability of the results and the feasibility of national scale-up, which is a critical step in the implementation of effective community health programs. In general, the study provides a useful summary of a study that provides evidence for the potential benefits of the ECH model in improving access to care and quality of service delivery in remote settings where access to health care is limited.

Other suggestions or questions:

1. The findings can be enhanced by quantifying the effects of intervention through a difference-in-difference analysis.

2. It would be helpful to conduct an equivalent regression analysis to produce uncertainty estimates on the results. E.g., line 34.

3. Figure 1 shows that the health utilization of both intervention and comparison group has increased after the intervention was implemented, is there any explanation for that? Using an interrupted time series design with a control group could increase the validity of the study results.

4. It would be helpful to discuss other possible factors that might have contributed to the performance of the intervention group to increase.

5. Is it possible that the recruitment of more skillful CHWs from the comparison commune to the intervention commune, due to higher compensation, have caused the differences in outcomes between the two groups?

6. Discussing and justifying why the control groups are comparable to the intervention group would be helpful.

7. Table 1 presents various health interventions evaluated in the program. To inform policy recommendations, it would be beneficial to discuss the individual contributions of each intervention. For instance, which intervention might have had a greater impact compared to others?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLOS Glob Public Health. doi: 10.1371/journal.pgph.0002888.r003

Decision Letter 1

Abraham D Flaxman

18 Jan 2024

Evaluation of a novel approach to community health care delivery in Ifanadiana District, Madagascar

PGPH-D-22-01753R1

Dear Finnegan,

We are pleased to inform you that your manuscript 'Evaluation of a novel approach to community health care delivery in Ifanadiana District, Madagascar' has been provisionally accepted for publication in PLOS Global Public Health.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they'll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact globalpubhealth@plos.org.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Global Public Health.

Best regards,

Abraham D. Flaxman, Ph.D.

Academic Editor

PLOS Global Public Health

***********************************************************

Reviewer Comments (if any, and for reference):

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Does this manuscript meet PLOS Global Public Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Global Public Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Health system readiness and disease burden in intervention and comparison communes.

    (XLSX)

    pgph.0002888.s001.xlsx (9.7KB, xlsx)
    S2 Table. Comparison of newly hired and existing CHWs.

    (XLSX)

    S1 Text. Interrupted time series analysis.

    (DOCX)

    pgph.0002888.s003.docx (13.9KB, docx)
    Attachment

    Submitted filename: ECH evaluation_response to reviewers.docx

    pgph.0002888.s004.docx (16.6KB, docx)

    Data Availability Statement

    Data availability complies with guidelines as established through the publication and the data sharing agreement between Pivot and the Madagascar Ministry of Public Health. GIS data from Ifanadiana District are publicly available on OpenStreetMap (https://www.openstreetmap.org); the map base layer can be found at: https://data.humdata.org/dataset/cod-ab-mdg?. Health system data may be shared upon request by contacting science@pivotworks.org.


    Articles from PLOS Global Public Health are provided here courtesy of PLOS

    RESOURCES