Table 2.

Emerald cross-country indicators for capacity-building of mental health service users and caregivers

Cross-country indicators		Evaluation method	Stakeholder group
Process	% of participants starting short course training who completed the full training	Emerald country team records	All
	% of workshop participants who were women and located outside of the capital city	Emerald country team records	All
	Number of workshops run per Emerald LMIC	Emerald country team records	All
	% of participants satisfied with the course	Interviewer-administered satisfaction questionnaire	Service users and caregivers
		Self-completed, semi-structured satisfaction questionnaire	Planners and researchers
	% of workshop participants who were employed in public institutions	Emerald country team records	Researchers
Output	Increase in understanding of service user involvement in workshop participants	Interviewer-administered, pre-post questionnaire developed for Emerald	Service users and caregivers
	Increase in understanding of mental health systems, planning and chronic care models	Self-completed, multi-choice questionnaire developed for Emerald	Planners
	Improvement in attitudes in workshop participants	World Psychiatric Association Stigma Toolkit Attitudes questionnaire (Stuart & Arboleda-Florez, 2001)	Planners
	Number of meetings between policy-makers/planners and the Emerald team post-training	Emerald country team recording of number and nature of meetings	Planners
	Improvement of knowledge in short course participants	Pre-post knowledge tests for each of the short courses	Researchers
	Number (%) of Emerald Ph.D. students graduating within 4 years of registration	Emerald country team records	Researchers
Outcome	Number of workshops run per Emerald LAMIC without external assistance	Emerald country team records	All
	Number of workshops run by service users	Emerald country team records	Service users and caregivers
	Change in unmet needs for capacity-building in mental health systems	Repeat needs assessment amongst key informants	Planners
	Number of applicants per course/number of places available	Emerald country team records	Researchers
	Change in unmet needs at the organisational level for capacity-building in mental health systems research	Baseline and follow-up needs assessment and situation analysis	Researchers
	% of all Emerald publications where Emerald fellow (Ph.D. or MSc) is first author	Searches of Pubmed and Google Scholar	Researchers
	% of all Emerald publications where LMIC partner is first author	Searches of Pubmed and Google Scholar	Researchers
	Number of health system-related publications by short course participants	Searches of Pubmed and Google Scholar	Researchers
	Number of Emerald-linked Ph.D. and mid-level researchers applying for grants	Self-report, online questionnaires	Researchers
	Number of Emerald-linked researchers engaged in mental health research by end of project	Self-report, online questionnaires (Ph.D. and mid-level researchers) Follow-up self-report form for short course participants (12 months post-course)	Researchers
	Number of health systems/implementation science/service user involvement projects undertaken by short course trainees by end of Emerald	Self-report, online questionnaires (Ph.D. and mid-level researchers) Follow-up self-report form for short course participants (12 months post-course)	Researchers
	Number of health system-related conference presentations by short course participants and Ph.D. students	Follow-up self-report form for short course participants (12 months post-course)	Researchers