Criterion	Medical professionals	Patients	Health authorities	Industry	Overall agreement percentage (median)
Number of responses	10	10	10	10	40
Category 1 – Health outcomes and benefits of intervention
Health benefits	100%	90%	100%	100%	100%
Efficacy/effectiveness	100%	70%	100%	90%	95%
Life-saving	80%	90%	70%	70%	75%
Safety	80%	70%	80%	90%	80%
Patient-reported outcomes	70%	40%	40%	50%	45%
Quality of care	70%	50%	70%	50%	60%
Category 2 – Type of health benefit
Population effect (prevention)	90%	70%	90%	80%	85%
Individual effect (medical service)	80%	90%	80%	70%	80%
Category 3 – Impact of the disease targeted by intervention
Disease severity	60%	30%	90%	30%	45%
Disease determinants	30%	10%	20%	30%	25%
Disease burden	90%	60%	70%	100%	80%
Epidemiology	70%	30%	60%	70%	65%
Category 4 – Therapeutic context of intervention
Treatment alternatives	80%	80%	80%	100%	80%
Need	70%	80%	80%	100%	80%
Clinical guidelines and practices	90%	70%	70%	60%	70%
Pre-existing use	60%	20%	20%	70%	40%
Category 5 – Economic impact of intervention
Cost	80%	40%	60%	70%	65%
Budget impact	90%	40%	70%	100%	80%
Broad financial impact	60%	40%	50%	70%	55%
Poverty reduction	60%	60%	30%	10%	45%
Cost-effectiveness	100%	40%	80%	70%	75%
Value	50%	20%	20%	20%	20%
Efficiency and opportunity costs	10%	10%	20%	10%	10%
Resources	50%	40%	60%	10%	45%
Insurance premiums	60%	10%	30%	20%	25%
Category 6 – Quality and uncertainty of evidence
Evidence available	60%	50%	40%	10%	45%
Strength of evidence	100%	70%	80%	100%	90%
Relevance of evidence	80%	50%	70%	40%	60%
Evidence characteristics	50%	40%	60%	30%	45%
Research ethics	80%	50%	30%	50%	50%
Evidence requirements	70%	60%	40%	40%	50%
Category 7 – Implementation complexity of intervention
Legislation	60%	60%	60%	30%	60%
Organizational requirements and capacity to implement	50%	50%	30%	30%	40%
Skills	80%	60%	50%	40%	55%
Flexibility of intervention	70%	50%	30%	20%	40%
Characteristics of implementation	60%	50%	50%	50%	50%
Appropriate use	60%	60%	30%	20%	45%
Barriers and acceptability	70%	20%	20%	20%	20%
Integration and system efficiencies	50%	60%	70%	40%	55%
Sustainability	80%	60%	70%	40%	65%
Category 8 – Priorities, fairness and ethics
Population priorities	60%	20%	40%	50%	45%
Access	70%	70%	90%	60%	70%
Vulnerable and needy population	80%	50%	80%	70%	75%
Equity, fairness and justice	30%	50%	50%	40%	45%
Utility	80%	20%	30%	20%	25%
Solidarity	50%	60%	20%	40%	45%
Ethics and moral aspects	60%	40%	50%	30%	45%
Category 9 – Overall context
Mission and mandate of health system	30%	20%	10%	30%	25%
Overall priorities	80%	60%	40%	50%	55%
Financial constraints	40%	20%	60%	20%	30%
Incentives	20%	10%	20%	0%	15%
Political aspects	20%	20%	20%	0%	20%
Historical aspects	30%	10%	10%	0%	10%
Cultural aspects	40%	40%	0%	10%	25%
Innovation	80%	50%	40%	60%	55%
Partnership and leadership	40%	60%	20%	20%	30%
Citizen involvement	50%	40%	60%	20%	45%
Stakeholder interests and pressures	50%	10%	30%	0%	20%