Table 4.

Data Analysis - Evaluation Questions [19]

Evaluation objective	Evaluation questions
1. To assess Intervention design	Content: ▪ What were the components of the intervention? ▪ Did the intervention’s components have the potential to achieve its objectives? ▪ What were the assumptions underlying the intervention’s design? Process: ▪ What was the process used to design the intervention? ▪ Was the intervention’s design revised after implementation began? If so, how and why?
2. To assess Intervention implementation	State level: ▪ What activities were done to secure state-level permission/support? District level: ▪ What activities were done to build awareness and support among key officials in the relevant government departments? ▪ What activities were done to set up a district-level inter-departmental coordination committee/group? ▪ What activities were done to support the development of an inter-departmental district action plan? ▪ What activities were done to build awareness and support among nongovernment organizations and media persons operating in the district? Block level: ▪ What activities were done to build awareness and support among key officials in the relevant government departments? ▪ How was this done through existing systems Village level: ▪ What activities were done to build awareness and support among gram panchayat elected officials?
3. To assess Intervention monitoring	▪ Did the intervention contain a plan to monitor implementation? ▪ Was the monitoring system adequate to track activity implementation and to use information to adjust implementation if needed? ▪ Was implementation monitored? If so, how was this done? ▪ How were the data used? ▪ Did the data contribute to changes in the way in which implementation was done?
4. To assess Intervention outputs	State level: ▪ Whose support was obtained and what level of support was obtained? District/Block level: ▪ Which key gatekeeper officials were reached? ▪ What is the effect of being reached by MAMTA on these officials? ▪ Was a district/block inter-departmental committee set up? If so, is it functional? ▪ Was a district/block action plan developed? If so, what are the contents of the plan and what factors affected the development of the plan? ▪ Is the plan being implemented and what factors affected /affect its implementation? ▪ Is there more concerted action by individual departments? Is there better communication and better synergy between departments? ▪ What was the effect of MAMTA’s outreach with representatives of nongovernment organizations and media persons? Village level: ▪ Were the two key elected officials (Pradhan and Mukhiya) reached? ▪ What is the effect of this on their awareness, motivation and agency – at the individual and collective levels? ▪ Were the ‘marker’ front-line functionaries in the three sectors (Aangan Wadi Workers - AWW, Auxiliary Nurse Midwives - ANM, Accredited Social Health Activists - ASHA, and teachers) reached? ▪ What is the effect of this on their awareness, motivation and agency – at the individual and collective levels?