Table 2.
The Health Information-Impact Index: 29 criteria to monitor the knowledge translation capacity of national health information systems
| HI-Impact framework | Number | Evaluation criteria (Adapted from) | % agreement |
|---|---|---|---|
| Domains | |||
| HI Evidence Quality | Q1 | Data meet high standards of reliability, transparency and completeness9,22 |
100% Ref: selected by 60/98 participants |
| Q2 | National health statistics are representative of the general population and subgroups9 | 95.0% | |
| Q3 | The official health statistics report is published annually12 | 91.7% | |
| Q4 | Data are stratified by clinically relevant subgroups (sex, age, socioeconomic status), and major geographical or administrative region as appropriate9 | 88.3% | |
| Q5 | The legislative framework supports the collection, processing and production of health informationa | 86.7% | |
| Q6 | Data within a dataset are comparable over time9 | 83.3% | |
| Q7 | Country data in international databases are complete/all health and health system indicators requested by international data systems and agencies are provided (OECD, Eurostat, WHO)9 | 71.7% | |
| Q8 | Country publishes summary reports including information on a minimum set of core indicators12 | 68.3% | |
| HIS Responsiveness | R1 | Access to public health data and evidence is not hindered by price and/or administrative burden9 |
100% Ref : 60/86 participants |
| R2 | Health information products are timely and available in routine (9,15) | 98.3% | |
| R3 | (Public) health data are available for secondary analysisa | 93.3% | |
| R4 | Health information products comply with the FAIR data principles (findable, accessible, interoperable, re-usable)9 | 85.0% | |
| R5 | Researchers and decision-makers have access to microdataa | 85.0% | |
| R6 | Health information is widely disseminated using several communication channels9 | 68.3% | |
| R7 | Health information products provide actionable recommendations for decision makinga | 66.7% | |
| Stakeholder Engagement | SE1 | Health information is used in the planning and policy process at all levels (national, regional, districts)12 |
100% Ref: 62/83 participants |
| SE2 | National, regional or local decisions are informed by public health data and evidencea,16 | 93.5% | |
| SE3 | Health information is used to set resource allocation at all levels (national, regional, districts)12 | 82.3% | |
| SE4 | Health information is used by care providers for health service delivery management, continuous monitoring and periodic evaluation12 | 74.2% | |
| SE5 | Population-based data are included in the development of clinical guidelines9 | 74.2% | |
| SE6 | Health information is used at health administrative offices for local health service delivery management, continuous monitoring and periodic evaluation12 | 72.6% | |
| SE7 | Evidence is commissioned for reducing inequalities in health or healthcare9 | 67.7% | |
| Knowledge Integration | KI1 | Government publishes an explicit plan for Health in all Policies (HiaP)b |
100% Ref: 67/82 participants |
| KI2 | Public health agencies, ministries of health and research, regularly engage with other ministries and sectors9 | 97.0% | |
| KI3 | Health literacy is promoteda | 86.6% | |
| KI4 | Health promotion initiatives are implemented in diverse settings (i.e. the workplace, schools, prisons and universities)a | 86.6% | |
| KI5 | Health information and evidence is demonstrably used to impact on the social determinants of healtha | 85.1% | |
| KI6 | Annual health reports are used to inform the allocation of resources in the health system and in other sectorsa | 76.1% | |
| KI7 | Health and well-being messages are broadly disseminated in the media (including social media)9 | 71.6% | |
| Additional comments | ADD1 | Please provide any additional comments you might have on the uptake of evidence in policy development and practice |
Note: Health information products include official publications with data on population health status, the determinants of health, and service use. In this table, the % level of agreement was adjusted using the highest rated criteria in each domain as reference.
a
Criteria suggested by the HI-Impact Index Delphi panel in Round 1.
b
From the Migrant Integration Policy Index http://www.mipex.eu/methodology.