Skip to main content
. 2021 Mar 31;14(1):1901390. doi: 10.1080/16549716.2021.1901390
Specific aims
  • To foster critical thinking regarding data quality, including validation and triangulation of data across sources

  • To increase interdisciplinary discussions on how to reduce the presence of bias in key health metrics that are reported and used for planning and policy formation

  • To incubate and promote the retention of an internal team of experts who will drive improvements in the generation, management, and use of data within the Ethiopian health system.

  • To generate improved and more robust measurements on an agreed set of routine health information management indicators.


Recruitment of participants
Participation was competitive. The opportunity was circulated throughout directorates at MOH, EPHI and EPSA that directly handle routine health information and employ analysts. The application included a short data analysis and interpretation test accompanied by questions on candidates’ experience and motivation for participating. The number of participants was capped at 40, and quotes were set at 20 from MOH and 10 each from EPHI and EPSA, with 50% male/female distribution.
Oversight and Staffing
ORCA management team included a principal investigator, contracted by LSHTM and administrator and IT-lead contracted by WHO. Academic staff included ‘coaches’, who were experienced researchers and PhD:s. A Technical Advisory Group (TAG) ensured alignment with MOH strategy and consisted of directors from the 3 government agencies and ORCA leadership and was chaired by an MOH directorate head. The TAG was tasked with monitoring ORCA progress, suggesting modifications and liaising between ORCA and relevant MOH bodies.
Financial and Material incentives
The programme budgeted included a grant (USD 10,000) and personal laptop for each individual participant as an incentive to apply to the ORCA project and contribute free time to its deliverables. To reduce attrition of staff during the programme, the grant was paid in 4 instalments based on deliverables. There was a further budget to finance fieldwork costs during the mini-studies conducted by each small group.
Thematic Group Work
Selection of six thematic areas that formed the basis of small working groups to which all participants were allocated for the remainder of the programme: Maternal Health, Neonatal Survival, Child Nutrition, Immunization, Malaria and Tuberculosis. Groups were organised to ensure diversity by discipline, agency and directorate, as well as to have a genderbalanced composition. Groups worked together throughout organised workshops and between them during their own time.
Residential training workshop
A combination of 3- and 5-day training workshops were organised outside of Addis Ababa to facilitate group interaction and reduce office-related distractions. Workshops provided intensive training and practicals covering: R-software, study protocol design, qualitative methods and analysis, writing up mixed method studies for dissemination.
Research Proposal
Each thematic group developed a research proposal for submission to the EPHI Institutional Review Board for ethical approval. Two objectives were adapted for each group as follows:
a) to analyse regional and national existing data using the concepts of outliers, international consistency, consistency between related indicators and external consistency between data sources.
b) to analyse facility level data and use, applying quantitative and qualitative methods to explore reasons for data quality issues at regional and district levels.
Data Collection and Analysis
All groups planned and conducted field studies conducted over 6–11 days with a shorter pilot phase during a feasibility visit. Each group gathered district level quantitative and qualitative data. For the first study objective teams conducted shared analysis. For the second objective groups analysed data based on tailored plans identified during protocol development.
Coaching and Mentorship
Each group was assigned an academic team member for fortnightly supervisory meetings to discuss progress during the applied work, accompanied by regular email support. Other LSHTM mentors participated in training workshops to deliver key skill-building components (e.g. qualitative analysis, writing support).