Table 1.
The Project monitoring and evaluation system: topic, indicators, data sources, data collectors, frequency of data collection, and data record
| Topic | Indicators | Data source(s) | Data collector(s) | Date of collection/frequency | Location of data |
|---|---|---|---|---|---|
| Outputs of Project activities |
Number of mothers of under-2 children reached by Care Group Approach Number of Community Health Committees established and trained Number of Level-1 and Level-2 Promoters, Care Group Volunteers and comadronas trained Number of Care Groups and Self-Help Groups formed Number of women participating in Self-Help Groups Number of children participating in Positive Deviance/Hearth workshops Number of women delivering in health facilities Number of household visitations for child growth monitoring and vitamin A supplementation Number of children treated for diarrhea and pneumonia Number of children vaccinated Number of children supplemented with vitamin A Number of children receiving growth monitoring |
Logs (actas) of Project activities Attendance records of Care Groups, Self-Help Groups, Círculos, and Positive Deviance/Hearth workshops Community Registers Logs of home visitations |
Level-1 and Level-2 Promoters | Monthly (ongoing) | Microsoft Excel database of Project M&E system |
| Child nutritional status |
Weight-for-age Z scores Height-for-age Z scores Weight-for-height Z scores |
KPC surveys Anthropometric censuses (“barridos”) Regular child growth monitoring visits to households |
Contracted interviewers supervised by Project staff (Jan 2012 and June 2015) Level-2 Promoters (Sept 2012) Level-1 and Level-2 Promoters |
Jan 2012 (both Areas) Sept 2012 (Area A only) June 2015 (both Areas) Every 3 to 6 months 2012–2014 Monthly (ongoing) |
EPI INFO and Excel data bases |
| Vital events (newly identified pregnancies, births, stillbirths, and deaths) |
Neonatal mortality rate 1–11-month mortality rate 12–59-month mortality rate Maternal mortality ratio Stillbirth rate |
Self-Help Group and Care Group meetings; routine home visits | Care Group Volunteers, Level-1 and Level-2 Promoters, Care Group Supervisors | Monthly (ongoing) | Vital Events Registers and Community Registers |
| Causes of mortality and contributing factors |
Causes of death Barriers to seeking and obtaining medical care Place of death Place of delivery (for maternal and neonatal deaths) Timing of neonatal deaths (1st 24 h, 1st week, 2nd-4th weeks) |
Verbal autopsies | Institutional Facilitators | Monthly (ongoing) | Verbal autopsy reports and Vital Events Registers |
| Coverage of antenatal care interventions |
Antenatal care utilization Immunization coverage (tetanus) Iron/folate consumption during pregnancy Knowledge of at least 2 danger signs during pregnancy |
KPC surveys | Contracted interviewers supervised by Project staff |
Jan 2012 and June 2015 |
EPI INFO and Excel data bases |
| Coverage of delivery care interventions |
Knowledge of at least 2 danger signs during labor/delivery Presence of an emergency transport system for pregnancy and/or newborn complications Delivery by a skilled health worker Delivery at a health facility |
KPC surveys | Contracted interviewers supervised by Project staff |
Jan 2012 and June 2015 |
EPI INFO and Excel data bases |
| Coverage of postpartum care interventions |
Knowledge of at least 2 postpartum danger signs Postpartum visit within 48 h after birth |
KPC surveys | Contracted interviewers supervised by Project staff |
Jan 2012 and June 2015 |
EPI INFO and Excel data bases |
| Coverage of newborn care interventions |
Knowledge of at least 2 danger signs in neonates Essential newborn care provided (cleaning of umbilical cord, immediate breastfeeding, and thermal care) |
KPC surveys | Contracted interviewers supervised by Project staff |
Jan 2012 and June 2015 |
EPI INFO and Excel data bases |
| Coverage of birth spacing and family planning interventions |
Knowledge of at least 2 risks associated with a pregnancy interval of < 24 months Current use of modern contraceptives among non-pregnant women Birth interval > 24 months between two previous deliveries |
KPC surveys | Contracted interviewers supervised by Project staff |
Jan 2012 and June 2015 |
EPI INFO and Excel data bases |
| Coverage of child feeding interventions |
Exclusive breastfeeding (children 0- < 6 months of age) in previous 24 h Proper infant and young child feeding (children 6- < 24 months of age) Vitamin A supplementation (children 2- < 24 months of age) in previous 6 months |
KPC surveys | Contracted interviewers supervised by Project staff | Jan 2012 and June 2015 | EPI INFO and Excel data bases |
| Coverage of childhood pneumonia interventions |
Children with cough and rapid/difficult breathing in the previous 2 weeks Appropriate care-seeking for child with symptoms of pneumonia |
KPC surveys | Contracted interviewers supervised by Project staff | Jan 2012 and June 2015 | EPI INFO and Excel data bases |
| Coverage of childhood diarrhea interventions |
Children with diarrhea episode in the previous 2 weeks Use of oral rehydration solution (including a recommended home fluid) during a diarrheal episode Use of zinc during a diarrheal episode Increased fluid intake during a diarrheal episode Increase food intake following a diarrheal episode |
KPC surveys | Contracted interviewers supervised by Project staff | Jan 2012 and June 2015 | EPI INFO and Excel data bases |
| Coverage of childhood immunization interventions |
Measles immunization among children 12- < 24 months Complete vaccination coverage among children 12- < 24 months (BCG, PENTA 1–3, polio 1–3, measles) |
KPC surveys | Contracted interviewers supervised by Project staff | Jan 2012 and June 2015 | EPI INFO and Excel data bases |
| Coverage of WASH (water, sanitation and hygiene) interventions |
Regular point-of-use water treatment Safe water storage Safe disposal of child’s feces following most recent defecation Appropriate hand-washing station in the home (with soap, water, and water container) Appropriate handwashing (at 4 critical moments) |
KPC surveys | Contracted interviewers supervised by Project staff | Jan 2012 and June 2015 | EPI INFO and Excel data bases |
| Birthing Center activities |
Number of services provided Number and types of birth complications that arose and their management |
Birthing Center clinical records | Birthing Center supervisory and auxiliary nurses | Monthly | Excel database for Birthing Center services |
| Extension of Coverage Program (PEC) outputs | Same output and outcome indicators as for the Project | Extension of Coverage Program (PEC) data collection forms from national health management information system | PEC ambulatory nurses and facilitators | Monthly | National Health Management Information System and Sistema de Información Gerencial de Salud (SIGSA) |
| Women’s and community empowerment and social capital indicators |
Women’s decision-making autonomy concerning place of delivery, child treatment for pneumonia, and use of family planning Women’s control of family money for purchase of food and healthcare for children Community execution of projects to benefit community well-being Number of communities with an emergency transport system for women in labor or for ill children Women’s participation in Care Groups Women’s participation in community meetings |
KPC surveys | Contracted interviewers supervised by Project staff | Jan 2012 and June 2015 | EPI INFO and Excel data bases |
| Demographic characteristics of comadronas | Age, gender, level of education, literacy, number of years as comadrona, how trained, number of deliveries attended | Census of comadronas | Level-2 Promoters supervised by graduate student intern | July 2013 | Excel data file |
| Effectiveness of CBIO+ Approach | Opinions, observations and recommendations of Project field staff and MSPAS staff | FGDs, group interviews, key-informant interviews, and structured questionnaires with Project field staff, and MSPAS staff |
Curamericas Global staff Graduate student interns Level-2 Promoters |
Aug 2013 May–June 2015 |
Transcriptions of recordings, completed questionnaires and Excel/Word analysis tables |
| Integration of comadronas into Birthing Centers | Opinions, observations, and recommendations of comadronas regarding their participation with the Birthing Centers | Key-informant interviews |
Level-2 Promoters Graduate student interns Birthing Center staff |
Aug 2013 June 2015 |
Transcriptions of recordings and Excel/Word analysis tables |
| Empowerment of women by Project and by Care Group Approach |
Opinions, observations and recommendations of women, husbands, community health committees, mothers-in-law Opinions, observations and recommendations of women participating in Care Group approach |
FGDs with husbands, community health committee, mothers-in-law FGDs with Care Group Volunteers and women participants in Self-Help Groups Key-informant interviews with Level-1 Promoters |
Level-2 Promoters (January 2014) Contracted interviewers (May 2015) |
Jan 2014 (women’s empowerment as a result of the Project) May 2015 (empowerment as a result of the Care Group Approach) |
Transcriptions of recordings and Excel/Word analysis tables |
| Birthing Center clinical quality of care |
Outcomes of complications managed by the Birthing Centers Opinions, observations and recommendations of Birthing Center staff and Curamericas/ Guatemala Project Director with respect to management of perinatal complications |
Birthing Center clinical records Structured written questionnaire FGDs with staff Key-informant interview (with Project Director) |
Curamericas Global staff Graduate student interns |
Dec 2016 |
Excel spreadsheets; Completed questionnaires; Transcriptions of FGDs and key- informant interviews and Excel/Word analysis tables |
“Birthing Center” refers to Community Birthing Centers (Casas Maternas Rurales); FGD Focus group discussion; DALY Disability-adjusted life year