Assessment criteria Choose one of yes, no, or unclear

Pre‐assessment question. Is the source material based on, or does it include, empirical data (i.e. information collected through measurement or observation)? If yes, than also include the assessment questions highlighted in grey, below.

Pre‐assessment question. Please select the type of source material to which the assessment tool will be applied. Choose from the following: Description of a programme, or intervention, or policy, or reform (e.g. a health, or welfare, or environmental programme, or intervention) Description of the implementation of a programme, or intervention, or policy, or reform Description of a policy process or an aspect of this process Commentary on a programme, or intervention, or policy, or reform (e.g. a health systems or development sector policy or reform) Other (please describe):

Is there a clearly stated aim, objective, or purpose for the source material? Apply to all source materials. Consider the following: Does the source material state its aim, objective, or purpose clearly? If the aim, objective, or purpose is not stated clearly by the authors, can it be derived from the material?

Is there a clear description of the source of the information reported (transparency)? Apply to all source materials. Consider: Are the sources (key informants, own experience, research study, etc.) described? Where applicable, is there a clear description of who collected the information?

Is there a clear description of the programme, or intervention, or policy, or reform on which the source material focuses? Apply to all source materials that describe an intervention, or programme, or policy. Consider: Are the rationale, goals, or objectives of the programme, or intervention, or policy, or reform described? Is the content of the programme, or intervention, or policy described, including all of the important facets or elements? Are the stakeholders or groups involved in delivering the programme, or intervention, or policy described, including their characteristics, background, skills or expertise, training, and responsibilities? Is the target(s) of the programme, or intervention, or policy described? Are the methods used to implement the programme, or intervention, or policy, including the mode of delivery (e.g. face‐to‐face, via the internet) and any relevant training, described? Are any materials used in the programme or intervention described? Does the source material describe clearly any infrastructure and resources required for the programme, or intervention, or policy? Does the source material describe when the programme, or intervention, or policy was started, when it finished, its intensity, and whether there were any changes to the programme, or intervention, or policy, over time? Does the source material describe any mechanisms used to ensure that the programme, or intervention, or policy, or reform was implemented as intended (e.g. supervision and support of personnel, training, implementation checks, incentives)?

Is there a clear description of the context(s) to which the information described in the source material relates? Apply to all source materials. Consider: Does the source material describe where the programme took place (e.g. country name(s), specific locations, urban or rural environments)? Does the source material describe clearly the context for the material, including (where relevant): The setting (country, service, community) to which the description relates; The system (e.g. health or welfare system), including the system level (e.g. frontline level); The historical, sociocultural, socioeconomic, or ethical context; The political, legal, governance, policy, or practice context (or combination), including relevant key events or policy initiatives? Does the source material clearly describe the stakeholders to which the description relates, including (where relevant): The target population(s) or group(s) for the programme, or intervention, or policy; Implementing organization(s) for the programme, or intervention, or policy; Any other partners and stakeholders? Does the source material clearly describe how the different stakeholders were involved in the programme, or intervention, or policy, or reform?

Is the information accurate? Apply to source materials that include little or no empirical data. Consider: Is there a clear description of whatever is the focus of the source material? Does the information presented appear to be reasonably complete? Does the source material describe any efforts to ensure that the information presented is complete and reliable?

Is the information accurate (empirical studies only)? Only source materials that include empirical data. Consider: Does the source material have clearly stated methods, including (where relevant) the type of empirical study conducted and when the programme, or intervention, or policy was evaluated? Was the basis for selected cases, or people, or clusters appropriate for the purpose of the study? Were the methods and tools for data collection appropriate for the purpose of the study? Were the data collectors appropriately trained and supported in their tasks? When were the data collected, and was the time span of the study long enough to address the core issues fairly? Was the quality of the data collected monitored and was the quality shown to be adequate? Is the method of analysis reported clearly? Is the method of analysis appropriate for the purpose of the study? Is there a clear description of the outcome(s) measured? Is the outcome measure reliable? Were these outcomes measured appropriately? Do these outcomes provide a reasonable assessment of the issue being considered? Are the linkages between the data that were reported and any inferences made transparent?

Is the evidence representative? (with respect to population of interest, sampling frame, etc.) Apply to all source materials. Consider: If the evidence is drawn from a sample of the population of interest, is there a clear description of how the sampling was conducted? Was the sampling approach appropriate (where applicable)? If generalisations were made to wider population(s) or setting(s), is there a rationale for doing so and a description of how this was done?

Are any limitations of the information, the methods, or both discussed in the source material? Apply to all source materials.

Is evidence provided to support any findings or conclusions made? Apply to all source materials. Consider: Are the findings or conclusions (where applicable) supported by evidence? Are the findings or conclusions reasonable, in relation to the evidence presented?

Are relevant rights and ethics considerations described (empirical studies only)? Apply only to source materials that include empirical data. Consider whether: The source material discusses relevant rights and ethics considerations; The source material indicates whether ethics approval was sought and obtained; The source material reports how consent to provide data or information was obtained.

Are any interests declared and any potential conflicts of interest noted? Apply to all source materials. Consider whether: The source material indicates if any of the authors are affiliated with the organisation or entity whose programme, or intervention, or policy is described; The source of funding for developing the material is reported; The source material indicates if any of the authors are affiliated with the organisation or entity that has funded the programme or policy described; Any potential conflicts of interest are described; The author indicates how any potential conflicts of interest were addressed.

Overall assessment: please choose one of: No or few limitations (when the answer to most questions in the tool is yes) Minor limitations (when the answer to most questions in the tool is yes or unclear) Significant or major limitations (significant or major limitations should be chosen when the answer to one or more questions in the tool is no)

Explanation of overall assessment Note: minor modifications were made to this tool since it was used for this study.