Table 3.

Applying the OECD Evaluation criteria to WMF’s Passport to Health Initiative

OECD Evaluation Criteria	Analysis and Questions for WMF	Additional WMF Considerations
Relevance Is the intervention doing the right thing?50	How relevant is the intervention to local goals? Have the potential beneficiaries’ needs and priorities been identified? How relevant is the intervention to global goals, such as SDGs? Has the intervention been accepted by target populations?	Disease prevention and health promotion are key in improving health outcomes in low-income areas in order to reduce health inequalities. Program will target remote areas that have little to no access to health resources. The program is in line with SDG – health inequalities. Regional health care professionals and Local elders have been consulted about the community’s health needs and what they would want from the program
Coherence How well does the intervention fit?50	Is there compatibility with other interventions within the region? Ease of adaptation to external factors and unforeseen events?	Envisioned synergy with WMF mobile health clinic. Baseline infrastructure for Health Education program already previously established with WMF HIV/AIDS Education Program. WMF has been recognized by local government and Malawi Ministry of Health as key to the provision of healthcare to remote and vulnerable populations WMF local/regional goals are closely aligned with global SDG goals.
Effectiveness Is the intervention achieving its objectives?50	Have the objectives been well defined in order to measure effectiveness? Have intended results/outcomes been achieved? Have unintended effects (positive and negative) been identified? Has continued implementation of intervention been justified?	Determining whether objectives have been met will require robust data collection throughout the evaluation process. This will allow for ease of adaptation when deemed necessary in order to achieve the desired outcomes. Interim results should be analyzed and made available for beneficiary and stakeholder to ensure transparency
Efficiency How well are resources being used?50	Is the intervention conducted in a timely and economic/resource efficient way? What are the resources including funds, local expertise, natural resources, time, etc. Have more efficient (and effective) methods been identified through alternative interventions?	A solid infrastructure has already been established in target regions. This will ensure that effective utilization of pre-existing resources, and costs will be monitored and reviewed to ensure most cost effective and sustainable processes are adopted. Pre-existing knowledge of local resources will enable WMF to incorporate these resources into project maintenance. Limit reliance on external and non-sustainable resources.
Impact What difference does the intervention make?50	Has there been adequate interaction and engagement with the WMF Health Education and Top-To-Toe wellbeing screen? To what extent has the intervention generated or is expected to generate significant positive or negative, intended or unintended effects? Have any holistic and enduring changes in systems or norms been achieved? Has the intervention created a change that really matters to local people? What are the observed effects/outputs in comparison to the desired effects?	Anticipated short-term impact trends include early recognition or disease and reduce morbidity due to opportunistic screening via the “Top-To-Toe” well-being examination (ie, the intervention will cause a significant change in the lives of the intended beneficiaries). Anticipated medium-term and long-term trends include uptake of health promotion and disease prevention messages, with long term reduced morbidity and mortality rates, as well as reduced prevalence of common disease and illnesses (ie, the intervention will create enduring changes in norms and systems). Main outcome measures will include rates of mortality and morbidity. Additional outcome measures will include medication use, need for follow- up or admission to hospital, hygiene behaviours pre-health education program. Comparison of outcome measures, such as mortality and morbidity data, with regional/global data held in data banks. Keeping health records and data banks will allow pattern recognition and trends which could potentially dictate subsequent interventions and areas still in need of action. Outcomes to be disseminated to local officials and Malawi Ministry of Health, as well as stakeholders and beneficiaries.
Sustainability Will the benefits last?50	To what extent will the net benefits of the intervention likely to continue? Are there any factors that might inhibit sustainability such as resources and financing? Is there an exit plan in place?	WMF considers that the key to successful sustainability is empowering locals with the knowledge and skills to ensure long-term continuation of health promotion and disease prevention. WMF is transparent with all expenditure and resource allocation, and regularly reviews budgets and costs to ensure the most viable distribution for long-term sustainability.

Note: Data from OECD 2021.⁵⁰