Skip to main content
BMJ Open logoLink to BMJ Open
. 2020 Oct 7;10(10):e039237. doi: 10.1136/bmjopen-2020-039237

Strengthening integration of chronic care in Africa: protocol for the qualitative process evaluation of integrated HIV, diabetes and hypertension care in a cluster randomised controlled trial in Tanzania and Uganda

Marie-Claire Van Hout 1,, Max Bachmann 2, Jeffrey V Lazarus 3, Elizabeth Henry Shayo 4, Dominic Bukenya 5, Camila A Picchio 3, Moffat Nyirenda 5, Sayoki Godfrey Mfinanga 4, Josephine Birungi 5, Joseph Okebe 6, Shabbar Jaffar 6
PMCID: PMC7542920  PMID: 33033029

Abstract

Introduction

In sub-Saharan Africa, the burden of non-communicable diseases (NCDs), particularly diabetes mellitus (DM) and hypertension, has increased rapidly in recent years, although HIV infection remains a leading cause of death among young-middle-aged adults. Health service coverage for NCDs remains very low in contrast to HIV, despite the increasing prevalence of comorbidity of NCDs with HIV. There is an urgent need to expand healthcare capacity to provide integrated services to address these chronic conditions.

Methods and analysis

This protocol describes procedures for a qualitative process evaluation of INTE-AFRICA, a cluster randomised trial comparing integrated health service provision for HIV infection, DM and hypertension, to the current stand-alone vertical care. Interviews, focus group discussions and observations of consultations and other care processes in two clinics (in Tanzania, Uganda) will be used to explore the experiences of stakeholders. These stakeholders will include health service users, policy-makers, healthcare providers, community leaders and members, researchers, non-governmental and international organisations. The exploration will be carried out during the implementation of the project, alongside an understanding of the impact of broader structural and contextual factors.

Ethics and dissemination

Ethical approval was granted by the Liverpool School of Tropical Medicine (UK), the National Institute of Medical Research (Tanzania) and TASO Research Ethics Committee (Uganda) in 2020. The evaluation will provide the opportunity to document the implementation of integration over several timepoints (6, 12 and 18 months) and refine integrated service provision prior to scale up. This synergistic approach to evaluate, understand and respond will support service integration and inform monitoring, policy and practice development efforts to involve and educate communities in Tanzania and Uganda. It will create a model of care and a platform of good practices and lessons learnt for other countries implementing integrated and decentralised community health services.

Trial registration number

ISRCTN43896688; Pre-results.

Keywords: hypertension, diabetes & endocrinology, international health services, organisation of health services


Strengths and limitations of this study.

  • The INTE-AFRICA trial will implement integration of HIV/non-communicable diseases (NCD) services in Tanzania and Uganda in response to an urgent need to respond to increased burden of NCDs, and expand capacity of healthcare systems to manage comorbidity.

  • The INTE-AFRICA trial is based on a partnership between African and European researchers, working closely with policy-makers and other stakeholders.

  • The process evaluation of INTE-AFRICA employs qualitative and observational methods at two facilities to explore and document stakeholder experiences of integration of services, alongside an understanding of the impact of broader structural and contextual factors.

  • The process evaluation works in tandem with quantitative evaluation of clinical efficacy and cost-effectiveness of the INTE-AFRICA trial.

  • Limitations of the process evaluation may centre on patient drop-out, characteristics of the two selected sites, selection, information and social desirability bias and other external mitigating factors.

Background

Non-communicable diseases (NCDs) have risen rapidly in Africa, alongside a continuing high burden of HIV infection. In sub-Saharan Africa (SSA), HIV/AIDS remains a major cause of morbidity and mortality among young-middle-aged adults, but the region is also experiencing a rapidly rising burden of NCDs (particularly diabetes mellitus (DM) and hypertension), giving rise to a dual HIV-NCD epidemic.1–3 While lifestyle changes associated with urbanisation and globalisation (such as eating habits and lack of physical exercise) underpin the ongoing demographic and epidemiological transition towards increasing NCDs, these changes also affect chronic conditions (such as HIV).1–3 The number of people in regular HIV care is rising,4 alongside the rate of NCDs in the SSA region, with hypertension representing the single largest risk factor for death, and DM which has seen a massive increase in prevalence in a short period of time.2 5–7 Patient populations in SSA are increasingly demonstrating younger age of onset of NCDs, with comorbidity of NCDs with HIV, and the impact of NCDs is particularly severe in populations affected by poverty.3 8–11

Since 2003, significant global investment and development partner engagement has facilitated the establishment of HIV screening and treatment programmes as the first large-scale chronic disease initiatives in Africa. Health services for HIV are stand-alone and vertically delivered. They have also been combined with decentralisation and task shifting, which has enabled primary health centres to treat large numbers of patients. Non-clinically qualified health workers play a major role in supporting patients on HIV treatment, with almost 70% of people living with HIV-infection in regular care. In contrast, health service coverage for NCDs remains very low.2 12 Coordinated national NCD control and care programmes are relatively new with significant gaps in funding and operational evidence for programme implementation.11 13 For example, only about 5%–10% of persons with DM are thought to be in regular diabetes care, and the figure is likely to be similar for persons with hypertension.2 8 11 Furthermore, those in care experience insufficient health service provision for the diagnosis and management of DM and hypertension (medicines supply is patchy).2 12 14–17 HIV populations at risk of developing NCDs, and presenting with co/multimorbidities could potentially impact on the gains from the achieved scale-up of HIV care services.18

Hence, there is an urgent need to expand the capacity of healthcare systems in the SSA region to provide services for NCDs, either alongside or integrated, with HIV.19 As chronic conditions, DM, hypertension and HIV-infection require lifelong care. Key challenges to chronic care in SSA are linkage and retention in care, access and medicines adherence.20 21 As such, the infrastructure and lessons learnt from the HIV chronic disease model can serve as important resources for the expansion of NCD prevention, care and treatment. HIV chronic care management pathways, resources and infrastructure can be leveraged to integrate with newly developing NCD services, ultimately to strengthen the platform for NCD services and improve health outcomes for people with NCDs.22–24 Health systems have developed the experience managing HIV as a chronic disease, including linking and retaining patients in care and supporting treatment adherence in drugs, diagnostics procurement and other key health systems indicators.21 25–27 Integration can reduce duplication and fragmentation, streamline services by treat those with co/multimorbidities and potentially offer patient benefits relating to time and cost (figure 1). It could, however, also threaten service capacity by resulting in increased service demand and loss of clinical focus on one disease.

Figure 1.

Figure 1

Potential benefits of integrating diabetes, hypertension and HIV services for (A) DM and hypertension control, and (B) HIV control. DM, diabetes mellitus.

Despite the increase in academic and clinical interest in HIV/NCD integration in SSA,9 26 28–33 little evidence about integration in terms of both scope and generalisability exists. Extant evidence is limited to small scale feasibility studies in largely different contexts,34–40 despite suggesting that integrated care is an efficient use of resources compared with the standard of care and beneficial for patients’ NCD and HIV clinical outcomes.28 30 32 There is a lack of large scale or randomised and/or controlled evaluations and context-specific clinical, cost-effectiveness and process outcomes data constrains policy-making and development of integrated care models, which could strengthen health systems when tailored to the distinct needs of each specific SSA country.19 21 37 Such evidence is paramount to inform policy, government resource prioritisation and to develop integrated care models which strengthen health systems best suited to the needs of that specific SSA country. The INTE-AFRICA trial is conducted to respond to the insufficient existing evidence to substantiate the benefits and sustainability of integrated care as well as the implementation of such programmes in the SSA setting. We present here the qualitative process evaluation protocol designed to evaluate INTE-AFRICA, a European Commission Horizon 2020 funded implementation research project (protocol number 19–100) operating in Tanzania and Uganda.

The INTE-AFRICA trial

INTE-AFRICA aims to implement and assess the effectiveness of the integration of HIV, DM and hypertension services at the point of service delivery covering many health facilities where common approaches to clinical decision making, drug procurement and human resource management occur. The project will generate the research evidence needed by health services in Africa, to scale up and sustain chronic disease management and services in an integrated manner. We are also interested in observing changes in dynamics pertaining to stigma and discrimination associated with HIV.41

INTE-AFRICA team specifically chose Tanzania and Uganda as they are low-income countries and their public and private health facilities are strongly committed to providing services for NCD. However, their health systems struggle to scale up provision for diabetes and hypertension in the face of competing health demands, including HIV-infection (table 1). Tanzania and Uganda also share relevant characteristics with other countries in SSA. As such, the process evaluation has the potential to enhance the generalisability of integrated care to other similar settings by providing understanding of the determinants and mechanisms of the implementation process.

Table 1.

key data on the country settings

Inline graphicTanzania Uganda
Income level Low Low
Population size 58 m(2018) 35 m(2016)
Estimated prevalence of hypertension from STEPS survey 26% 26%
Estimated prevalence of diabetes from STEPS survey15* 5%–10% 2%–5%
Estimated prevalence of HIV-infection 5.1% (2017) 6.2% (2017)
Doctors density/100 000 population 3 (2014) 0.8 (2005)

*Diabetes estimate varies according to age and gender. Data are of variable quality but reference 11 shows that the overall median diabetes prevalence in 12 countries in Africa is 5%.

Our programme is underpinned by a participatory, multiactor approach which supports dialogue and knowledge exchange, fosters mutual understanding and provides input in policy agendas around diagnosis and treatment of DM, hypertension and HIV in an integrated clinic. The INTE-AFRICA conceptual framework is illustrated in figure 2.

Figure 2.

Figure 2

INTE-AFRICA conceptual model.

INTE-AFRICA will test integrated health services at primary care centres for HIV-infection, diabetes and hypertension, by providing a ‘one-stop’ integrated care clinic for these conditions (the intervention). We will conduct a pragmatic parallel arm cluster randomised trial: 32 largely urban health facilities offering primary care services in the two countries will be randomised, with 16 facilities allocated to deliver the intervention immediately (intervention arm), and 16 facilities to continue with usual care (control arm). At each selected facility, cohorts of approximately 220 patients; 110 HIV infected and 110 NCD patients, will be enrolled to evaluate the primary research outcomes.

The primary care facilities will initiate and stabilise patients on treatment, manage complications (including referral to higher facilities) and conduct clinical and laboratory monitoring of patients for all three conditions. Specific characteristics of integrated care in each ‘one stop integrated care clinic are: concurrent management of HIV, hypertension and DM in the same facility; management of patients with HIV, hypertension and DM by the same clinician or team of clinicians (nurses, counsellors other staff); integrated training of clinicians; single waiting area and queue; integrated health education about all three conditions; one pharmacy with a single drug dispensing point; similar testing and cross-testing, for diagnosis and monitoring with the requisition of laboratory tests in the same place; and similar format of paper medical records for each condition kept in the same patient folder.

Patients who decline to participate in the research and trial participants in control arm clinics will continue to receive standard vertical healthcare delivery. Inclusion criteria for participation are: being over 18 years old; having confirmed HIV infection, DM or hypertension; living within the catchment population of the health facility; likely to remain in the catchment population for 6 months and willing to provide written informed consent. Very ill patients requiring in-patient care will be excluded. The research team will observe participants during clinic visits with additional reviews at 6 and 12 months. Further details are provided in the full INTE-AFRICA trial protocol.

Qualitative process evaluation of the INTE AFRICA trial

The aim of the process evaluation of INTE-AFRICA is to explore the experiences, attitudes and practices of a wide variety of stakeholders during the process of programme implementation and to develop an understanding of the impact of broader structural and contextual factors on the implementation process of service integration. Process evaluations typically evaluate how and whether interventions are delivered as intended and whether such implementation is congruent with the theory underpinning the intervention.25 42–44 Updated Medical Research Council guidance for evaluation of complex health interventions has recently recognised the value of process evaluation within trials stating, ‘it can be used to assess fidelity and quality of implementation, clarify causal mechanisms and identify contextual factors associated with variation in outcomes.’25 Hence, the process evaluation in INTE-AFRICA is particularly focused on context, description of the intervention and its causal assumptions, implementation, mechanisms of impact and outcomes.25 Further we evaluate the extent to which resources and activities supporting the intervention function to deliver intended outputs, with subsequent improvements in outcomes.

A central focus lies in identifying contextually relevant strategies for successful implementation of service integration, and practical difficulties in adoption, delivery and maintenance to inform wider implementation.45 We recognise that outcomes (eg, knowledge gained) of INTE-AFRICA are dependent on understanding cultures and contexts of the stakeholders (ie, patients, healthcare providers, policy-makers, community leaders/members, non-governmental organisations (NGO), international organisations and clinical researchers) involved and those surrounding service design and delivery as well as care seeking practices.

The role of social and behavioural science approaches to understanding individual experience, and the role of such contextual dynamics is central to this process evaluation. It aims to enhance understanding of issues related to the NCD and HIV agendas and service delivery approaches from all perspectives and stakeholders along the integration process. INTE-AFRICA will use a broad social behavioural approach to support community engagement in research in Tanzania and Uganda, going beyond clinical trial recruitment and retention to improve NCD/HIV literacy. Behavioural and social science research strategies46 will allow NCD and HIV-related research to place the needs and perspectives of people living with NCD and/or HIV at the centre of the progression of clinical studies, such as INTE-AFRICA, and investigate participant motivations and decision-making processes related to preferences for or participation in different types of integrated and decentralised services.

Theoretical framework: Bronfenbrenner’s ecological model of behaviour

Process evaluation design, like healthcare interventions, requires a theoretical framework to structure the qualitative and observational evaluation across sites. The chosen theoretical framework is Bronfenbrenner’s ecological model of behaviour47 48 used to conceptualise integrated care as events that disrupt complex social systems49 operating across multiple contextual levels. We are interested in better understanding the importance of context, which becomes especially relevant when comparing Tanzania and Uganda. For example, healthcare coverage and charging dynamics between countries and between HIV as opposed to NCD care differs. In Tanzania, while HIV services and drugs for HIV are free, patients are required to pay a direct user fee (unless elderly or very poor) or use their health insurance to pay for NCD drugs. Currently, there is a strategy to progress to single health insurance to support universal health coverage in Tanzania. In Uganda, HIV services are also free to all (public and private not for profit health facilities) and HIV drugs are always in stock. However, in Uganda while NCD services are free in public facilities, stockouts of laboratory reagents and NCD drugs are frequent, and patients have to pay a direct user fee to access them. There is also no national insurance scheme in Uganda, only private insurance which is relatively expensive and optional.

Using the Bronfenbrenner theoretical framework, contextual factors are evaluated at the macro (universal vs partial coverage; free primary healthcare and drugs, affordability and users fees; fiscal policy, financial aspects at government level, funding barriers for chronic care management and barriers to government scale-up of service integration); meso (HIV/NCD drug ordering, drug delivery systems and continuity of supply, healthcare provider education and employment, community understanding and perspectives on multimorbidity) and micro (clinic and pharmacy level management, resources, patient/service user experience) levels (figure 3). These contextual factors, likely to influence implementation of integration and their effects, will be investigated to capture variation in adoption, delivery and maintenance outcomes as well as responses to the intervention. This will affect both reach and fidelity, which are hypothesised to be important factors in outcome differences.

Figure 3.

Figure 3

Potential contextual influences on INTE-AFRICA programme implementation cascade. CD, chronic disease; NCD, non-communicable diseases; NGO, non-governmental organisation; PEPFAR, President’s Emergency Plan for AIDS Relief.

To situate INTE-AFRICA within the Bronfenbrenner theoretical framework, we will develop a logic model. This model will set out contextual determinants of HIV and NCD care management in SSA and assess how integrated care components function to address these determinants to improve outcomes in the management and support of patients (table 2).

Table 2.

Logic model of programme inputs, processes and outcomes

Intervention inputs Changes in care processes Outcomes
Negotiation with national, district and local government health departments, NGOs and funders Agreement about and support for service model, including reorganisation of clinics and staff
Commitment to ensure drug supply
  • Reorganisation of clinics and staff to implement the model

  • An effective, quality and sustainable funded drug supply chain

Negotiating lower drug prices
Supporting and monitoring drug ordering in each clinic
Providing buffer drug supplies to each clinic
Drugs always in stock
  • Increased diagnosis of comorbid conditions

  • Increased retention and adherence

  • Increased viral suppression, better control of blood pressure and blood glucose

  • Less AIDS, cardiovascular disease and diabetes complications

  • Lower patients costs (travel and absence from work)

  • Less health service duplication and costs (health service costs might increase if more patients are diagnosed and are more adherent)

  • Increase patient satisfaction

  • Increased clinician satisfaction; less burn-out and absenteeism

  • Reduce missed opportunities for improving care and health outcomes

Engagement with and support for clinicians and managers in each clinic Clinicians and managers enable and support integration and find solutions to emerging problems
Provision of integrated service in each clinic (alongside and additional to existing services) Trial participants attend integrated service
Avoid multiple visits for patients with multimorbidity
Training clinicians about integrated clinical management Better diagnosis and treatment including attention to comorbid conditions
Community engagement Identify and enlist community organisations and resources to help with health education, tracing defaulters or patients who have difficulty attending clinic
Providing standardised stationery for integrated medical records; training clinicians to use it Increased awareness by clinicians and patients about disease severity, comorbidity, adherence and control in individual patients
Improving monitoring and evaluation based on clinics registers and medical records Regular data analysis and feedback to staff Quality assurance and continuous improvement in the quality of care
Identifying effective health education Improve health education at clinics Healthier lifestyles
Increased adherence

NGO, non-governmental organisation.

Methods

Study setting

This will be a cohort study taking place in one ‘one-stop’ integrated care clinic per country. In Tanzania, the selected site is Temeke Regional Referral Hospital in Dar Es Salaam, a public tertiary health facility, with 465 staff, and serving a population of over 1 million. In Uganda, the selected site is the Kasangati Health Centre IV, Kasangati, a public district health facility located in the Wakiso District serving a population of over 2 million. Both provide a range of services to the community (primary care, HIV/AIDs, NCDs, surgical, maternal and child health, health education, dental and pharmacy).

Study design

This protocol describes procedures for a qualitative process evaluation of the INTE-AFRICA pragmatic parallel arm cluster randomised trial comparing integrated health service provision for HIV-infection, DM and hypertension with the current standard vertical care delivery model. The process evaluation works in tandem with the collection of selected clinical outcomes (eg, clinical efficacy of different treatments) and health economic data (eg, costs and benefits of different approaches) to estimate the potential benefits to patients and health services at clinic and country level (protocol reported elsewhere).

Patient and public involvement

Patient and public involvement (PPI) throughout a programme of research enhances research quality and relevance by providing different perspectives and a sense of ownership. This protocol will adhere to the same principles, and will allow the voice of ‘service users and those affected to be heard, and utilised. Key stakeholders such as patients as service users and their families will be fully involved in guiding the research, acting as research participants, and in implementation of change in health service delivery and integrated care planning. All aspects of the process evaluation are underpinned by participatory action health research and its success and usefulness will be grounded in PPI, participation and engagement in the form of patient/professional identification of research priorities, collaborations and partnerships, expert steering, community participation around health needs and optimal integrated services, awareness raising activities, development of print materials, toolkits and training for healthcare professionals.

It will use three qualitative research techniques: in-depth interviews with stakeholders (patients, healthcare provider, policy-maker, NGO/international organisation, and clinical researcher); focus group discussions (FGD) with community leaders and community members; and clinic-based observations in one site per country. This design permits an assessment of the fidelity of INTE-AFRICA’s implementation, a detailed description of the processes, relationships, and contexts involved in the delivery of integrated care, and the identification of factors attributing to the failure or success of the programme. It thus addresses the black box problem in interpreting trial results by improving understanding of the mechanisms that connect particular intervention components to particular outcomes.50 The chosen approach will enhance social construction and acceptability of chosen decentralised integrated approaches, link outcomes to policy and advocacy and impact sustainability of HIV, DM and hypertension chronic disease service integration in two low and middle income countries. It provides the opportunity to document and refine INTE-AFRICA activities prior to a larger pragmatic trial or scale-up by Tanzanian and Ugandan governments. These synergistic approaches to evaluate, understand and respond will support integration, support affordability, address barriers to government scale up and funding barriers for chronic care, inform surveillance, policy and practice development and improve efforts to involve and educate communities in Tanzania and Uganda. It will create a model and a platform of best practices and lessons learnt for other countries implementing integrated and decentralised community health services for HIV and chronic disease. The process evaluation methods for each objective are described in table 3, including how each method maps onto the three different contextual levels.

Table 3.

Process evaluation design and data collection framework

Post-Integration. Data Collection at each Site* 6 months 12 months 18 months Contextual level
Observations of consultations, different processes and clinic flow at clinic levels and in non-clinical areas. 1 week 1 week 1 week Microcontext (facility and neighbourhoods)
In-depth phenomenological interviews with patients/service users 25 25 25 Micro context (facility and neighbourhoods)
In-depth phenomenological interviews with healthcare providers at the clinic (hospital overall in charge, hospital pharmacist, the medical officers in-charge of the integrated clinic, trained clinicians managing HIV, diabetes and hypertension patients, pharmacist, laboratory technician, counsellors or nurses providing health education and counselling and nurses in the registration desk who are also responsible in taking vital signs) 10 10 10 Mesocontext (national to regional/city)
Micro context (facility and neighbourhoods)
Semistructured interviews with Ministerial policy-makers and provincial/regional/district level clinical/health senior management (Director for NCD, HIV and curative services). 5 5 Macrocontext (Global)
Meso context (national to regional/city)
Semistructured interviews with NGO and international organisations (eg, WHO Country office, UNAIDS, PEPFAR, CDC) 5 5 Macrocontext (Global)
Meso context (national to regional/city)
Focus group discussions (FGD) with community leaders (8–12 participants) 1 1 1 Microcontext (facility and neighbourhoods)
FGD gender specific with community members (8–12participants) 2 2 2 Microcontext (facility and neighbourhoods)
In-depth phenomenological interviews with clinical researchers 4 Microcontext (facility and neighbourhoods)
Meso context (national to regional/city)

*The * refers to ‘Numbers indicated per country’.

CDC, Centers for Disease Control and Prevention; NGO, non-governmental organisation; PEPFAR, President’s Emergency Plan for AIDS Relief; UNAIDS, Joint United Nations Programme on HIV/AIDS.

Study population and recruitment

wenty-five patients and 10 healthcare providers in Temeke Regional Referral Hospital in Dar Es Salaam, Tanzania and Kasangati Health Centre IV, Kasangati, Uganda will be purposely selected and invited; at 6, 12 and 18 months after the start of the trial, to reflect retrospectively on their experience of integration. Healthcare providers include the hospital/health centre overall in charge and pharmacist, and the ‘one-stop medical officers in-charge, trained clinicians managing HIV, diabetes and hypertension patients, pharmacist, laboratory technician, counsellors or nurses providing health education and counselling, and nurses in the registration desk who are also responsible in taking vital signs from patients. We will also collect qualitative data from interviews with Ministerial policy-makers and provincial/regional/district level clinical/health senior management (directors for NCD, HIV and curative services); NGO and international organisations (eg, WHO Country office, Joint United Nations Programme on HIV/AIDS (UNAIDS), President’s Emergency Plan for AIDS Relief (PEPFAR), Centers for Disease Control and Prevention (CDC)) and clinical researchers; and conduct FGD with community leaders and community members. These numbers are expected to reach saturation (ie, the point that further information does not provide any additional variation in observed themes). We may replace participants, for example patients if there is significant loss to follow-up or refusal for repeated interviews. For instance, if a participant drops out at 12 months, we still have their 6-month experience documented, and we can replace with a new participant, invited to reflect on their 12-month retrospective experience. Where possible we will gender match interviewers with participants (particularly patients). Participants (patients, healthcare providers and others) will not be directly compensated bur rather they will be compensated for incurred transport costs to attend the interview/FGD, and provided with refreshments during the interview/FGD.

The following recruitment procedures will take place at each ‘one-stop integrated care clinic:

  • Observations will be made in the integrated clinic in consultation with the hospital/health centre and ‘one-stop clinic in-charges.

  • Recruitment of patients will be supported by clinic nurses who will identify and approach selected participants who have a minimum of 6 months experience of integration, and will be asked to consent to partake in an in-depth interview on the day they attend the clinic. INTE-AFRICA researchers will purposively sample women and men of different ages and explore any age/gender and condition ((HIV/hypertensive/DM/multi/comorbid) related differences.

  • Healthcare providers at the integrated clinic will be approached to participate in an in-depth interview on the day the INTE-AFRICA team are scheduled to attend.

  • Ministerial policy-makers and provincial/regional/district level clinical/health senior management will be identified and requested to participate in a semistructured interview (face to face, online using Zoom or telephone).

  • NGO and international organisations will be identified and requested to participate in a semistructured interview (face to face or telephone).

  • Community leaders will be identified in the clinic catchment areas by virtue of their position while community members will be identified in consultation with the community leaders and invited to participate in the FGDs.

  • Clinical researchers will be invited to participate in an in depth interview at the 24-month end point.

Data collection

We will use the Empirical Phenomenological Psychological (EPP) five-step method,51 which combines psychological, interpretative and idiographic components, to collect data. The data will garner an understanding of the complex social processes, of social, aged, gendered and culturally/community specific meanings and broaden the incremental understanding of the distinct lived experience of policy-makers, patients, healthcare providers, researchers and communities. We will balance the description of phenomena with the interpretation of insights and are cognisant of participant experiential phenomena and authors’ interpretation of associated meanings. It will yield an in-depth sociocultural understanding of patient-reported/participant-reported outcomes, their motivations, preferences, beliefs, expectations, identities, hopes and views on conditions, related stigma and of decision-making processes. This will provide better understanding of stakeholder and community positioning during integration. This understanding will inform policy and practice, ensure effective patient/service user education, position service users and their families to understand these conditions and interpret study outcomes and facilitate future HIV and chronic disease clinical studies.

Both descriptive patient-level data and rich sociobehavioural qualitative/observational data will be collected by a team of trained researchers in Tanzania and Uganda. Data collection will entail exploring the experiences, attitudes and practices of a wide variety of stakeholders during the process of INTE-AFRICA programme implementation and will develop an understanding of the impact of broader structural and contextual factors on the implementation process.10 45We will collect data on social behavioural and cultural aspects impacting implementation (eg, individual and community health risks, protective behaviours and health responses) within the broader social and political frameworks (government resources and barriers to sustaining integration), the practicalities of accessing, providing and sustaining integrated services (eg, staff time, resources, equity of access, supply chain dynamics and pharmacy components pertaining to drug types, drug/reagent availability and costs for integrated patients, catchment area/populations, quality of care, waiting room dynamics, record keeping and retention across multi/comorbidities, training gaps); and process indicators (eg, perceived stigma, acceptability of vertical vs integrated service designs, lay knowledge and awareness, the dynamics of public vs private sector integration (where relevant to the participant), and bottlenecks to accessing services). We will also describe implementation of the intervention in terms of fidelity to the intended model of care, adaptations to the intervention during implementation, and dose and reach of intervention components actually delivered and received (such as numbers and proportions of eligible staff who received integrated care training, numbers of proportions of patient participants who received all or most of their care from integrated services, and frequency of drug stock-outs). The latter data will be complemented by routinely collected quantitative data such as training attendance and medical records. We will document changes in healthcare provider roles, attitudes and patient relationships.

Interviews with patients/service users, healthcare provider and policy-maker/senior manager will include specific questions about their experience and management of individuals with multimorbid HIV, hypertension and/or diabetes. These include their perceptions of INTE-AFRICA; impacts of INTE-AFRICA on the provision of integrated HIV/AIDS care and NCD care, and relationships with NGO and international organisations; changes in health provider roles, attitudes and patient relationships; impacts of the INTE-AFRICA implementation context on trial and health economic cost outcomes; impacts of the INTE-AFRICA intervention on an integrated health systems approach to care (medicine supplies, record keeping, service user education, clinical care pathways, data management, staff training); and barriers to and facilitators of change and future sustainability of integrated care provision. We will assume a more pragmatic approach when garnering perspectives from higher level stakeholders involved in health policy and practice generation, and NGO and international organisations (eg, WHO country offices, UNAIDS, PEPFAR, CDC) providing peripheral supports and guidance. We are especially interested in better understanding the complexities around government scale up and resource allocation for chronic care (eg, decentralisation, financial planning, identification of potential funding sources at ministry levels, subsidised NCD drugs and by international donors (CDC, PEPFAR, UNAIDS) (table 3).

Data analysis and synthesis

The analysis of qualitative data will be iterative, moving between data collection and analysis to test emerging theories. Field notes of observations will be analysed thematically to provide a description of the process and content involved in adapting and delivering the intervention. Audio recordings of interviews and FGDs will be transcribed verbatim by competent and experienced social scientists, with a subsample transcribed using conversation analytic conventions. Translation from local languages (eg, Swahili, Luganda) into English will be performed for easy sharing with the study partners. Translation will occur using a back-translation method for consistency. An electronic data management package (eg, NVivo) will be used to manage the qualitative data analysis at the respective country levels. The analysis of the observational data will require knowledge obtained from health professional interviews at different levels to compare how reported experience, and different accounts of patient and professional perspectives relate to actual implementation of INTE-AFRICA scenarios: (1) when DM and hypertension services are integrated with HIV-infection services and (2) comparing countries. Care will be taken to identify and follow up deviant cases which do not fit into emerging theories. Reliability and validity of the analysis is optimised through iterative data collection, the use of a multi-method design incorporating interviews, FGD and observations and the ongoing discussion of findings within the research team for scrutiny and feedback.52 53

The chosen phenomenological approach (EPP) to collecting and analysing data, usually used in psychological research, reveals the structures of subjective experience and meaning of a lived phenomenon (in first person point of view). It follows to some extent Husserl’s principle of active efforts to bracket out the researchers’ theoretical preunderstanding in the first steps of a text analysis.51 The ‘bracketing, however, does not exclude an empathetic, psychological focus in the analysis on the experiences of the researched phenomenon as it is lived by the informant and what it means is to her or him. In the context of INTE-AFRICA, researchers in both countries will strive to get an empathetic understanding of the text, and hence do not apply their professional prior knowledge about integration. The analysis of the observational data will also require knowledge from health professional interviews to compare how reported experience relates to actual implementation of integration at the clinic level.

We will conduct a stepwise EPP analysis in five steps. First, the text will be read several times to get a good grasp of how the informant spoke about the researched phenomenon of integration. In this step, theoretical reflection will be withheld. Second, the whole text will be divided into meaning units of a whole paragraph or a single word. Third, the informant’s personal language will be transformed, unit by unit, to the researchers’ language. The researchers will discuss the transcription unit by unit. When different interpretations occur, the researchers will return to the interview text and discuss in a free, imaginative process until agreement can be reached through negotiated consensus. Fourth, the text will be screened in a search for comprehensive themes. The text will be interpreted with connection to the researchers’ theoretical knowledge in an interchange between the original data, the transformed units and the researchers’ theoretical preunderstanding about integration. The meaning units will be assorted into appropriate themes and thus constitute a general structure of the phenomenon of integrated care. Fifth, this essential structure will penetrate all the revealed themes and thus the meaning of the researched phenomenon of integrated care to the informant.

Credibility and transferability

The process evaluation protocol adheres to recommendations intended to facilitate the standardisation of process evaluation design and reporting.43 It provides a unique opportunity to document implementation and collaboratively refine integrated care in two SSA countries. This makes possible the synthesis of results of similar studies elsewhere in the SSA region in future. In order to ensure credibility, while we use different methods of data collection (qualitative/observational), and operate concurrently with clinical outcomes data and health economics analysis, we will also add a further layer of triangulation of sources in terms of perspectives across stakeholders and across conditions (HIV/hypertension/DM/multi/comorbidity) when raising the abstraction level. Triangulation of sociobehavioural qualitative and observational data during analysis will occur in order to understand how different types of evidence enhance the overall interpretation of how INTE-AFRICA was implemented, and what the additional health economic and clinical data are, drawing case comparisons across clinics and across countries, and developing possible explanations for implementation variation. The data, when combined and triangulated across these multi stakeholder perspectives, will provide a thick description’, of how the intervention was delivered, maintained and experienced by stakeholders.10 45 It will also offer explanations for observed variation over time and between countries, and detailed insight into the interaction between different contextual features and components of integration of NCD or HIV/NCD services. It will also facilitate triangulation of information across stakeholders, clinics and countries. This approach will help to support transferability to other settings, by identifying factors which are plausibly and/or consistently related to successful or unsuccessful delivery of intervention components. We recognise the potential for selection and information bias as limitations of the trial itself, and mitigate by using a random sampling approach, defining characteristics in a cohort, using a standardised approach to collecting data with continual assessment of information bias, and ensuring that research personnel are unaware of participant disease status. We will address social desirability in the process evaluation by only providing brief information at the outset of the evaluation in order to avoid priming, using an interview schedule approved by a panel of INTE-AFRICA experts in terms of sensitivity, conducting qualitative research using skilled interviewers with limited power relationship between interviewer and participant, conducting the interviews in a safe and secure setting where the participant feels comfortable, briefing them that there is no right and wrong answer, and finally by encouraging them to use anecdotes and experiential evidence to support their views.

Emerging theories and the relationship of the data to the conceptual literature underpinning the intervention will be discussed and refined at INTE-AFRICA research team meetings throughout the project. We envisage utilising the public understanding of science theory54 to unpack how patients and their communities in Tanzania and Uganda understand and use different knowledge on HIV and NCDs in their lives. This could be facilitated by understanding how they create meaning from scientific findings relating to NCDs and HIV and if, how, and to what degree they incorporate these findings into their everyday lives. This theory has the capacity to shift public attitudes by connecting and communicating the development of innovative scientific concepts in the medical field (in this instance integration of HIV/NCD services in Tanzania and Uganda) to the non-scientific public, and thereby enhance education, training cascade, health policy and practice, and ultimately public understanding of multimorbidities and sustainable routes to care. Further, it will create a platform for the sharing of lessons learnt, best practices and context adaptation of the final integrated model of care in other African countries (clinical care policies and practice, staff cascade of training, service user education and community awareness raising).

Ethical considerations

Ethical approval for the evaluation has been granted by the research ethics committees of the Liverpool School of Tropical Medicine (UK), the National Institute of Medical Research (Tanzania) and TASO Research Ethics Committee (Uganda). The key ethical principles of voluntary and informed participation, confidentiality and safety of participants will be used in all researcher and participant interactions. Written consent for interviews and observations will be obtained from all participants. All participants will be provided with written information about the research, this will be explained verbally, and informed that their participation is voluntary and that they may withdraw from participation at any time. Safety and confidentiality of all data will be ensured by: (1) encrypting all transcriptions with a password-protected code; (2) storing all data in a secure, encrypted database accessible only to authorised persons on the research team; (3) delinking all personal information of participants from the data collected and stored. Each participant will have a unique identification number.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @JVLazarus

Contributors: All authors contributed to the conceptualisation of the research and contributed to writing the manuscript. M-CVH, MB, JVL, SJ, EHS, DB, CP and JO designed the process evaluation protocol. SJ, MN, SGM and JB led the development of the INTE-AFRICA trial. M-CVH drafted the manuscript and all co-authors edited and commented on subsequent drafts. All authors approved the final draft for submission. All authors agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Funding: The INTE-AFRICA project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 825 698. JVL is supported by a Spanish Ministry of Science, Innovation and Universities Miguel Servet grant (Instituto de Salud Carlos III/ESF, European Union (CP18/00074)) and further acknowledges support to IS Global from the Spanish Ministry of Science, Innovation and Universities through the 'Centro de Excelencia Severo Ochoa 2019–2023' Programme (CEX2018-000806-S), and from the Government of Catalonia through the CERCA Programme.

Competing interests: None declared.

Patient and public involvement: Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.

Patient consent for publication: Not required.

Provenance and peer review: Not commissioned; externally peer reviewed.

References

  • 1.Adeloye D, Basquill C. Estimating the prevalence and awareness rates of hypertension in Africa: a systematic analysis. PLoS One 2014;9:e104300. 10.1371/journal.pone.0104300 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Atun R, Davies JI, Gale EAM, et al. Diabetes in sub-Saharan Africa: from clinical care to health policy. Lancet Diabetes Endocrinol 2017;5:622–67. 10.1016/S2213-8587(17)30181-X [DOI] [PubMed] [Google Scholar]
  • 3.Remais JV, Zeng G, Li G, et al. Convergence of non-communicable and infectious diseases in low- and middle-income countries. Int J Epidemiol 2013;42:221–7. 10.1093/ije/dys135 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Ford N, Ball A, Baggaley R, et al. The who public health approach to HIV treatment and care: looking back and looking ahead. Lancet Infect Dis 2018;18:e76–86. 10.1016/S1473-3099(17)30482-6 [DOI] [PubMed] [Google Scholar]
  • 5.GBD 2015 Risk Factors Collaborators Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990-2015: a systematic analysis for the global burden of disease study 2015. Lancet 2016;388:1659–724. 10.1016/S0140-6736(16)31679-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Guwatudde D, Nankya-Mutyoba J, Kalyesubula R, et al. The burden of hypertension in sub-Saharan Africa: a four-country cross sectional study. BMC Public Health 2015;15:1211. 10.1186/s12889-015-2546-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Lim SS, Vos T, Flaxman AD, et al. A comparative risk assessment of burden of disease and injury attributable to 67 risk factors and risk factor clusters in 21 regions, 1990-2010: a systematic analysis for the global burden of disease study 2010. Lancet 2012;380:2224–60. 10.1016/S0140-6736(12)61766-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Addo J, Smeeth L, Leon DA. Hypertension in sub-saharan Africa: a systematic review. Hypertension 2007;50:1012–8. 10.1161/HYPERTENSIONAHA.107.093336 [DOI] [PubMed] [Google Scholar]
  • 9.Chang AY, Gómez-Olivé FX, Manne-Goehler J, et al. Multimorbidity and care for hypertension, diabetes and HIV among older adults in rural South Africa. Bull World Health Organ 2019;97:10–23. 10.2471/BLT.18.217000 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.George S, McGrath N, Oni T. The association between a detectable HIV viral load and non-communicable diseases comorbidity in HIV positive adults on antiretroviral therapy in Western Cape, South Africa. BMC Infect Dis 2019;19:348. 10.1186/s12879-019-3956-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Jaffar S, Gill G. The crisis of diabetes in sub-saharan Africa. Lancet Diabetes Endocrinol 2017;5:574–5. 10.1016/S2213-8587(17)30219-X [DOI] [PubMed] [Google Scholar]
  • 12.Jaffar S. Diabetes and other non-communicable diseases in Africa: a potential disaster in the waiting. Lancet Diabetes Endocrinol 2016;4:875–7. 10.1016/S2213-8587(16)30216-9 [DOI] [PubMed] [Google Scholar]
  • 13.Lupafya PC, Mwagomba BLM, Hosig K, et al. Implementation of policies and strategies for control of noncommunicable diseases in Malawi: challenges and opportunities. Health Educ Behav 2016;43:64S–9. 10.1177/1090198115614313 [DOI] [PubMed] [Google Scholar]
  • 14.Katende D, Mutungi G, Baisley K, et al. Readiness of Ugandan health services for the management of outpatients with chronic diseases. Trop Med Int Health 2015;20:1385–95. 10.1111/tmi.12560 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Manne-Goehler J, Atun R, Stokes A, et al. Diabetes diagnosis and care in sub-Saharan Africa: pooled analysis of individual data from 12 countries. Lancet Diabetes Endocrinol 2016;4:903–12. 10.1016/S2213-8587(16)30181-4 [DOI] [PubMed] [Google Scholar]
  • 16.Peck R, Mghamba J, Vanobberghen F, et al. Preparedness of Tanzanian health facilities for outpatient primary care of hypertension and diabetes: a cross-sectional survey. Lancet Glob Health 2014;2:e285–92. 10.1016/S2214-109X(14)70033-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Price AJ, Crampin AC, Amberbir A, et al. Prevalence of obesity, hypertension, and diabetes, and cascade of care in sub-Saharan Africa: a cross-sectional, population-based study in rural and urban Malawi. Lancet Diabetes Endocrinol 2018;6:208–22. 10.1016/S2213-8587(17)30432-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Patel P, Rose CE, Collins PY, et al. Noncommunicable diseases among HIV-infected persons in low-income and middle-income countries: a systematic review and meta-analysis. AIDS 2018;32 Suppl 1:S5–20. 10.1097/QAD.0000000000001888 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Haregu TN, Setswe G, Elliott J, et al. Integration of HIV/AIDS and noncommunicable diseases in developing countries: rationale, policies and models. Int J Healthc 2015;1:21–7. 10.5430/ijh.v1n1p21 [DOI] [Google Scholar]
  • 20.Husain NE, Noor SK, Elmadhoun WM, et al. Diabetes, metabolic syndrome and dyslipidemia in people living with HIV in Africa: re-emerging challenges not to be forgotten. Hiv Aids 2017;9:193–202. 10.2147/HIV.S137974 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Juma K, Reid M, Roy M, et al. From HIV prevention to non-communicable disease health promotion efforts in sub-Saharan Africa: a narrative review. AIDS 2018;32 Suppl 1:S63–73. 10.1097/QAD.0000000000001879 [DOI] [PubMed] [Google Scholar]
  • 22.Haldane V, Legido-Quigley H, Chuah FLH, et al. Integrating cardiovascular diseases, hypertension, and diabetes with HIV services: a systematic review. AIDS Care 2018;30:103–15. 10.1080/09540121.2017.1344350 [DOI] [PubMed] [Google Scholar]
  • 23.Rabkin M, Melaku Z, Bruce K, et al. Strengthening health systems for chronic care: leveraging HIV programs to support diabetes services in Ethiopia and Swaziland. J Trop Med 2012;2012:1–6. 10.1155/2012/137460 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Some D, Edwards JK, Reid T, et al. Task shifting the management of non-communicable diseases to nurses in Kibera, Kenya: does it work? PLoS One 2016;11:e0145634. 10.1371/journal.pone.0145634 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new medical Research Council guidance. BMJ 2008;337:a1655. 10.1136/bmj.a1655 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Iwelunmor J, Ezechi O, Obiezu-Umeh C, et al. Capabilities, opportunities and motivations for integrating evidence-based strategy for hypertension control into HIV clinics in Southwest Nigeria. PLoS One 2019;14:e0217703. 10.1371/journal.pone.0217703 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Rachlis B, Naanyu V, Wachira J, et al. Identifying common barriers and facilitators to linkage and retention in chronic disease care in western Kenya. BMC Public Health 2016;16:16–741. 10.1186/s12889-016-3462-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Ameh S, Klipstein-Grobusch K, Musenge E, et al. Effectiveness of an integrated approach to HIV and hypertension care in rural South Africa: controlled interrupted time-series analysis. J Acquir Immune Defic Syndr 2017;75:472–9. 10.1097/QAI.0000000000001437 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Anand TN, Joseph LM, Geetha AV, et al. Task sharing with Non-physician health-care workers for management of blood pressure in low-income and middle-income countries: a systematic review and meta-analysis. Lancet Glob Health 2019;7:e761–71. 10.1016/S2214-109X(19)30077-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Divala OH, Amberbir A, Ismail Z, et al. The burden of hypertension, diabetes mellitus, and cardiovascular risk factors among adult Malawians in HIV care: consequences for integrated services. BMC Public Health 2016;16:1243. 10.1186/s12889-016-3916-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Edwards JK, Bygrave H, Van den Bergh R, et al. HIV with non-communicable diseases in primary care in Kibera, Nairobi, Kenya: characteristics and outcomes 2010-2013. Trans R Soc Trop Med Hyg 2015;109:440–6. 10.1093/trstmh/trv038 [DOI] [PubMed] [Google Scholar]
  • 32.Golovaty I, Sharma M, Van Heerden A, et al. Cost of integrating noncommunicable disease screening into home-based HIV testing and counseling in South Africa. J Acquir Immune Defic Syndr 2018;78:522–6. 10.1097/QAI.0000000000001713 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Kwarisiima D, Atukunda M, Owaraganise A, et al. Hypertension control in integrated HIV and chronic disease clinics in Uganda in the search study. BMC Public Health 2019;19:511. 10.1186/s12889-019-6838-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Fairall LR, Folb N, Timmerman V, et al. Educational outreach with an integrated clinical tool for nurse-led non-communicable chronic disease management in primary care in South Africa: a pragmatic cluster randomised controlled trial. PLoS Med 2016;13:e1002178. 10.1371/journal.pmed.1002178 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Mahomed OH, Asmall S. Development and implementation of an integrated chronic disease model in South Africa: lessons in the management of change through improving the quality of clinical practice. Int J Integr Care 2015;15:e038. 10.5334/ijic.1454 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Matanje Mwagomba BL, Ameh S, Bongomin P, et al. Opportunities and challenges for evidence-informed HIV-noncommunicable disease integrated care policies and programs: lessons from Malawi, South Africa, Swaziland and Kenya. AIDS 2018;32 Suppl 1:S21–32. 10.1097/QAD.0000000000001885 [DOI] [PubMed] [Google Scholar]
  • 37.Nuche-Berenguer B, Kupfer LE. Readiness of sub-Saharan Africa healthcare systems for the new pandemic, diabetes: a systematic review. J Diabetes Res 2018;2018:9262395. 10.1155/2018/9262395 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Pfaff C, Scott V, Hoffman R, et al. You can treat my HIV - but can you treat my blood pressure? Availability of integrated HIV and non-communicable disease care in northern Malawi. Afr J Prim Health Care Fam Med 2017;9:e1–8. 10.4102/phcfm.v9i1.1151 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Pfaff C, Singano V, Akello H, et al. Early experiences integrating hypertension and diabetes screening and treatment in a human immunodeficiency virus clinic in Malawi. Int Health 2018;10:495–501. 10.1093/inthealth/ihy049 [DOI] [PubMed] [Google Scholar]
  • 40.Rawat A, Uebel K, Moore D, et al. Integrated HIV-Care into primary health care clinics and the influence on diabetes and hypertension care: an interrupted time series analysis in free state, South Africa over 4 years. J Acquir Immune Defic Syndr 2018;77:476–83. 10.1097/QAI.0000000000001633 [DOI] [PubMed] [Google Scholar]
  • 41.Jaffar S, Amuron B, Foster S, et al. Rates of virological failure in patients treated in a home-based versus a facility-based HIV-care model in Jinja, Southeast Uganda: a cluster-randomised equivalence trial. Lancet 2009;374:2080–9. 10.1016/S0140-6736(09)61674-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Georgeu D, Colvin CJ, Lewin S, et al. Implementing nurse-initiated and managed antiretroviral treatment (NIMART) in South Africa: a qualitative process evaluation of the stretch trial. Implement Sci 2012;7:66. 10.1186/1748-5908-7-66 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Moore G, Audrey S, Barker M, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health 2014;68:101–2. 10.1136/jech-2013-202869 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Linnan L, Steckler A. Process evaluation for public health interventions and research. An overview : Steckler A, Linnan L, Process evaluation for public health interventions and research. 1 edn San Francisco: Josset-Bass, 2002: 1–23. [Google Scholar]
  • 45.Murdoch J, Curran R, Bachmann M, et al. Strengthening the quality of paediatric primary care: protocol for the process evaluation of a health systems intervention in South Africa. BMJ Glob Health 2018;3:e000945. 10.1136/bmjgh-2018-000945 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Kippax S. Effective HIV prevention: the indispensable role of social science. J Int AIDS Soc 2012;15:17357. 10.7448/IAS.15.2.17357 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Bronfenbrenner U. Toward an experimental ecology of human development. Am Psychol 1977;32:513–31. 10.1037/0003-066X.32.7.513 [DOI] [Google Scholar]
  • 48.Bronfenbrenner U. The ecology of human development: experiments by nature and design. Cambridge, MA: Harvard University Press, 1979. [Google Scholar]
  • 49.Hawe P, Shiell A, Riley T. Theorising interventions as events in systems. Am J Community Psychol 2009;43:267–76. 10.1007/s10464-009-9229-9 [DOI] [PubMed] [Google Scholar]
  • 50.Grimshaw JM, Zwarenstein M, Tetroe JM, et al. Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada. Implement Sci 2007;2:38. 10.1186/1748-5908-2-38 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Karlsson G. Psychological qualitative research from a phenomenological perspective. Almqvist & Wiksell International, 1993. [Google Scholar]
  • 52.Marshall C, Rossman GB. Designing qualitative research. 4 edn Thousands Oaks, Calif: Sage Publications, 2006. [Google Scholar]
  • 53.Patton MQ. Qualitative research and evaluation methods. Thousand Oaks, Calif: Sage Publications, 2002. [Google Scholar]
  • 54.Brossard D. A critical appraisal of models of public understanding of science: using practice to inform theory, 2010: 11–39. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES