Skip to main content
Cambridge Prisms: Global Mental Health logoLink to Cambridge Prisms: Global Mental Health
. 2024 Jan 8;11:e6. doi: 10.1017/gmh.2023.93

Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda

Catharina van der Boor 1,, Lena S Andersen 2, Alessandro Massazza 1, Wietse A Tol 2,3, Dalili Taban 4, Bayard Roberts 1, Joshua Ssebunnya 5, Eugene Kinyanda 5, Carl May 1, Abhijit Nadkarni 6,9, Daniela Fuhr 1,7,8
PMCID: PMC10808976  PMID: 38283880

Abstract

In conflict-affected settings, prevalence of alcohol use disorders (AUDs) can be high. However, limited practical information exists on AUD management in low-income settings. Using a theory of change (ToC) approach, we aimed to identify pathways influencing the implementation and maintenance of a new transdiagnostic psychological intervention (“CHANGE”), targeting both psychological distress and AUDs in humanitarian settings. Three half-day workshops in Uganda engaged 41 stakeholders to develop a ToC map. ToC is a participatory program theory approach aiming to create a visual representation of how and why an intervention leads to specific outcomes. Additionally, five semi-structured interviews were conducted to explore experiences of stakeholders that participated in the ToC workshops. Two necessary pathways influencing the implementation and maintenance of CHANGE were identified: policy impact, and mental health service delivery. Barriers identified included policy gaps, limited recognition of social determinants and the need for integrated follow-up care. Interviewed participants valued ToC’s participatory approach and expressed concerns about its adaptability in continuously changing contexts (e.g., humanitarian settings). Our study underscores ToC’s value in delineating context-specific outcomes and identifies areas requiring further attention. It emphasizes the importance of early planning and stakeholder engagement for sustainable implementation of psychological interventions in humanitarian settings.

Keywords: theory of change, brief psychological interventions, alcohol use disorders, mental health, conflict-affected populations

Impact statement

By using theory of change (ToC), we use a participatory approach to understand different pathways that can shape the implementation and maintenance of a new psychological intervention named “CHANGE” in a humanitarian setting in Uganda. The CHANGE intervention is designed to address both psychological distress and alcohol use disorders in conflict affected populations. The findings of this study reveal that there are two pathways that are important for the implementation of CHANGE in this context: policy impact, and mental health service delivery. We reflect on the utility of using a ToC methodology in this context and identify areas that require further attention.

Background

Over the last 10 years, the number of forcibly displaced populations resulting from armed conflict, persecution and/or violence has grown by more than 50% (UNHCR, 2021). In 2021 alone, 23 countries faced high or medium intensity conflicts (World Bank, 2022), which have far-reaching social, economic and health impacts (Milián et al., 2022; World Bank, 2022).

Armed conflict can impact mental health both directly, for example, by exposing people to traumatic events, and indirectly, for example, by worsening known social determinants of mental health (i.e., impoverishment, poor access to healthcare, loss of social networks) (Lo et al., 2017a). In these contexts, alcohol use disorders (AUDs) may provide unhealthy ways to cope with chronic stressors, other psychological consequences of conflict exposure, and can further compound risk factors (Weaver and Roberts, 2010; Ezard, 2012; Lo et al., 2017a).

Literature on AUDs demonstrates an increased risk for mental health disorders (Grant et al., 2004; Lo et al., 2017a), noncommunicable diseases (Hammer et al., 2018; Nadkarni et al., 2023a), gender-based violence (Shiva et al., 2021) and wider social and economic risks (Hammer et al., 2018). People with AUDs often experience barriers to treatment which can reduce health seeking behavior and underutilization of services (Probst et al., 2015; Mellinger et al., 2018; McCrady et al., 2020).

Addressing AUDs in humanitarian settings is included in international humanitarian response guidelines (IASC, 2007; Sphere, 2018). However, there remains limited evidence to guide the management of AUDs among conflict-affected people in low-income settings (Roberts and Ezard, 2015; Kane and Greene, 2018; Fuhr et al., 2021). The CHANGE consortium aims to address this evidence gap, through the development and implementation of a new psychological intervention (“CHANGE”) addressing both AUDs and psychological distress among conflict-affected men (https://www.lshtm.ac.uk /change; Fuhr et al., 2021). The CHANGE intervention is informed by Problem Management Plus (PM+) (Dawson et al., 2015). PM+ is a transdiagnostic (i.e., noncondition specific) intervention developed by the WHO, that improves symptoms of depression, anxiety and psychological distress (Schäfer et al., 2023). A transdiagnostic approach can be useful as most people present with comorbidity, while simultaneously making it more feasible to deliver in resource-poor settings (Dawson et al., 2015). PM+ includes strategies based on cognitive behavioral therapy, including problem solving, stress management, behavioral activation and access to social support. Global evidence has demonstrated the efficacy of PM+ at reducing psychological distress in low and middle-income settings (Schäfer et al., 2023). However, PM+ does not include strategies for AUDs which is a major but neglected issue among conflict-affected populations (Roberts et al., 2011; Kane and Greene, 2018). The CHANGE intervention seeks to address this gap, by including strategies into PM+ that can target AUDs (such as personal feedback, goal setting and planning change, cognitive behavioral skills such as drink refusal, and relapse management). CHANGE is delivered by lay health workers and is composed of six individual face-to-face sessions (Fuhr et al., 2021; Nadkarni et al., 2023b). The effectiveness of CHANGE is currently being evaluated through a randomized controlled trial with South Sudanese refugee men in Rhino camp settlement, northern Uganda.

When developing complex interventions, it is recommended to investigate how context may influence intervention outcomes and implementation (Craig et al., 2008; De Silva et al., 2014).

Theory of change (ToC) is a participatory planning process focused on how a project can achieve long-term outcomes through a logical sequence of intermediate outcomes (Vogel, 2012). It enables systematic identification of knowledge gaps in context and can provide a comprehensive set of indicators to evaluate the stages of causal pathways through which complex interventions may achieve impact (De Silva et al., 2014). It is visually represented in a ToC map, which shows the ways in which an intervention is anticipated to produce its effects within the constraints of the specific environment in which it is put into practice (De Silva et al., 2014).

The aim of this study was to use ToC to summarize pathways to the implementation and maintenance of the CHANGE intervention for refugees in the context of a refugee settlement in northern Uganda. It was also developed to investigate barriers and facilitators toward implementation and explore strategies that may overcome certain barriers. The specific objectives of this study were to (a) explore context-specific intermediate and long-term outcomes necessary for sustainable implementation of CHANGE, including policy and health service considerations; (b) identify barriers and facilitators underlying each outcome and (c) reflect on the conduct of the ToC process through stakeholder interviews. To the best of our knowledge, this article is the first to report on the use of ToC to shed light on pathways for a public health intervention for AUDs among refugees.

Methods

Study setting

Data collection occurred between June 2021 and February 2022 in Kampala, Arua and Rhino camp settlement in Uganda. An estimated 136,900 refugees currently live in Rhino camp settlement in impoverished conditions (UNHCR, 2019c). Arua is the largest urban area near the settlement, where many humanitarian agencies operating in the settlement have their offices. Kampala, Arua and Rhino camp settlement were chosen to have a varied sample of experienced stakeholders working with refugees.

Uganda’s Ministry of Health has included mental health care into its general health provision, outlined in the national Health Sector Integrated Refugee Response Plan (Uganda Ministry of Health, 2019). However, there is only one mention of the need to prevent and control noncommunicable diseases including substance use disorder, with no further detail or guidelines on how this can be achieved. Those living in the settlement have the right to access free healthcare through 13 primary care posts distributed across the settlement (UNHCR, 2019a, 2019b). However, according to a needs and resource assessment conducted in Rhino camp in 2016, accessibility to general healthcare was limited, and there were very limited mental health and psychosocial support services (MHPSS) available (Adaku et al., 2016). As such, despite efforts, there are still gaps in responding to the MHPSS needs of refugee communities, including poorly equipped health centers, and shortages of healthcare workers and medication (Baingana and Patrick, 2011; Rokhideh, 2017; Kane and Greene, 2018). The United Nations High Commissioner for Refugees (UNHCR) has highlighted the need for scalable community-led interventions to bridge the needs gap (Kaltenbacher, 2019).

Participatory theory of change workshops

Theory of change

Three half-day face-to-face workshops gathered information for the development of a ToC map. ToC is often developed using a backward mapping process, starting with the long-term outcomes and then mapping the required process of change. Achieving long-term outcomes depends on meeting a series of intermediate outcomes. Rationales justify these intermediate outcomes, and explain how specific interventions (activities) will contribute to their achievement. Assumptions (i.e., barriers/facilitators) required for the ToC are also recorded. Ultimately, ToC allows for multiple causal pathways, interventions and feedback loops to achieve specific outcomes, while also acknowledging the role of context for implementation (Vogel, 2012; Breuer et al., 2015).

Participants and recruitment

Stakeholders involved with refugee services and/or with MHPSS programming with South Sudanese refugees in Uganda were recruited. The final sample included national stakeholders working for the government (N = 3), national and international NGO workers (N = 14) and other community health and social care workers (N = 24). Workshop 1 was conducted in Kampala (N = 15), workshop 2 in Arua (N = 13) and workshop 3 in Rhino camp settlement (N = 12) (see Table 1 for an overview). All participants provided informed consent.

Table 1.

Description of ToC participants

ToC attended Gender Job title
Arua M Community services officer
F Registered mental health officer at NGO
M MEAL Coordinator at NGO
F Assistant chief administrative officer for the local government
F Clinical Psychologist at NGO
F Psychiatric Nurse at NGO
M Health Tutor at local nursing school
F Lecturer at local university
M Clinical Officer
M Consultant
F Registered Mental Health Nurse
M Psychiatric clinical officer at regional hospital
M Psychologist at NGO
Rhino refugee settlement M Refugee block leader within one of the villages of Rhino camp settlement, reports to the Refugee Welfare Council
M In charge of the resources for the local health center
F Secretary general for persons with special needs
M Refugee opinion leader, involved in important decisions concerning refugee wellbeing
M Refugee Leader who works in the Refugee Welfare Council to ensure wellbeing within the community
F Refugee Women Representative, responsible for matters concerning refugee women in the village
M Refugee Welfare Council chairperson, oversees wellbeing and provides leadership including making decisions on matters concerning refugees
M Refugee Religious leader, provides spiritual guidance and counseling
M Refugee Pastor, provides spiritual guidance and counseling
F Refugee welfare council chairperson, oversees wellbeing and provides leadership including making decisions on matters concerning refugees
M Church Leader, provides spiritual guidance and counseling
M Refugee secretary general, responsible for person with special needs
M Refugee Church leader, provides spiritual guidance and counseling
Kampala M Project coordinator for NGO
M Consultant at national hospital
F MHPSS supervisor at NGO
F Acting associate commissioner mental health
M Senior consultant psychiatrist at national hospital
M Head of department of mental health at national university
F Clinical Psychologist
F Mental health team leader at NGO
M Clinical specialist at NGO
M Country Director at NGO
F Program associate
M Program Director at NGO
F Program officer
M M&E Coordinator at NGO
M Psychiatry Doctor

Procedure of workshops

The ToC study was carried out during the formative research phase, that is, prior to the feasibility and effectiveness trials of the CHANGE intervention. In Kampala, the ToC workshop was facilitated by a Ugandan clinical psychologist and researcher with experience of ToC. In Arua and the Rhino camp settlement, they were facilitated by the CHANGE project coordinator, who had received previous training. Workshops were in English and audio recorded. At the start of the workshops, participants were given an overview of the main components of ToC, and discussions were then held around each of these main components. Post-it notes were used to iteratively develop the ToC map. Participants of the workshops led the discussions and were guided by two facilitators. Once the three workshops had taken place, researchers LSA and DF compared the different components that had emerged in each of the three workshops and drafted one final ToC map that reflected the views of the three groups. Audio recordings were used to check missing information and details when necessary. After creating the draft map, 16 participants provided written feedback on the draft map via email, which was reviewed and included in the final ToC map.

Semi-structured interviews

The workshops were followed by individual semi-structured interviews with a subset (n = 5) of stakeholders who participated in the ToC workshops. The interview aim was to explore the experience of workshop participation, and views on the strengths and limitations of ToC. Participants were purposefully sampled based on time and availability.

Procedures for interviews

Semi-structured interviews took place via zoom with researcher AM. The topic guide covered the following domains: defining ToC in their own words, perceived purpose of ToC, role of facilitator, participant interactions, differing views and strengths and limitations (see additional files). Following the first interview, the topic guide was edited and remained unchanged for the rest of the data collection. Interviews lasted between 30 min and 1 h. All interviews were in English, audio recorded and transcribed verbatim.

Thematic analysis was used (Braun and Clarke, 2022). As the data were transcribed, recurring themes were noted that informed the preliminary coding framework. A largely inductive coding approach was used by identifying codes that were most frequently represented in the dataset. The preliminary coding framework was discussed among the core members of the team and then finalized. All data were coded and analyzed in NVivo 12.

Results

ToC for the CHANGE intervention

Figure 1 presents the ToC map. Two distinct causal pathways were identified that could facilitate implementation of the CHANGE intervention at different levels of the health system: (a) Policy pathway, and (b) Mental health service delivery pathway. Eight interventions (interventions 1–8) and 12 assumptions (assumptions A–L) were identified by stakeholders (Figure 1).

Figure 1.

Figure 1.

Theory of change map.

Pathways to improved health and wellbeing

The two pathways (Policy impact, and Mental health service delivery) that lead to the overall impact, that is, improved health and wellbeing, are associated with four long-term outcomes: (a) a reduction in AUDs and associated mental health disorders in refugee communities; (b) improved social and economic productivity; (c) improved family stability and functioning and (d) reduction in perpetration of gender-based violence resulting from AUDs (Figure 1). The two pathways are described below.

Policy impact pathway

The first pathway to support the maintenance of the CHANGE intervention is policy-focused. Assuming the intervention’s effectiveness, there is a need for policies to be in place that continue to prioritize and promote the mental health and wellbeing of refugee populations. To achieve this, political leaders must demonstrate a commitment to prioritizing mental health care (assumption I). Supportive environments can aid help seeking, and promote mental health, among others. An early intermediate outcome of such supportive policies is the availability of political leadership that is sensitized to the need to address AUDs in refugee populations both at a national and local level, which can facilitate the development and implementation of a mental health plan targeting AUDs in refugee populations.

Workshop discussions extensively covered the reciprocal relationship between AUDs and social determinants of health (e.g., employment). Stakeholders recognized that treating AUDs alone would not suffice to improve mental health and wellbeing. Political leaders must recognize this reciprocal relationship (assumption J). Stakeholders noted the negative impact of high unemployment levels within refugee populations in Uganda and highlighted the need for clients with AUDs to be supported to earn an income. Three key interventions were proposed (a) establishing associations to promote income generating activities, that is, training households in small business set up and/or providing small cash grants (intervention 6); (b) introducing cash-for-work programs, that is, building infrastructure, garbage collection (intervention 7) and (c) recognizing farming as a viable business for refugees (intervention 8). These depend on the assumption that those who recover from mental health disorders and/or AUDs, and receive vocational or skill-based trainings, can then actively participate in various programs and activities (assumption H).

Moreover, attention is required for the relationship between AUDs and social determinants within both national mental health and refugee response plans. This involved recognizing crucial social determinants, like unemployment or housing status, that can increase the risk of AUDs. This, in turn, demands the allocation of resources and funding. Resources should be channeled toward enhancing the mental health plan to include strategies addressing substance misuse (assumption K), contingent on political will and priorities. Funding should also be directed toward the development and maintenance of interventions, including the three key interventions outlined above, and task-sharing interventions like CHANGE, that can address specific community challenges such as mental health disorders and AUDs (assumption L).

Mental health service delivery

The second pathway relates to mental health service delivery, including the identification of individuals with AUDs and the delivery of targeted community-based interventions. An early intermediate outcome of this service delivery is growing awareness within the community regarding AUDs which can promote support and sensitize community members toward the harmful effects of alcohol.

To bolster this awareness and sensitization surrounding AUDs and available treatments, involving Refugee Welfare Councils and incorporating messaging on AUDs within community-based religious settings (intervention 1) may be essential. Furthermore, this awareness may facilitate the identification of refugees who would benefit from support. It was further speculated that the identification of individuals with AUDs and support in accessing care hinges on a peaceful and stable environment (assumption A). Additionally, it was emphasized that community health workers need training in screening and identification of people with AUDs, and in the selection of appropriate referral pathways (intervention 2). This assumes the existence of suitable and identifiable referral pathways (assumption C), and that refugees with AUDs are willing to seek help (intervention 1). The ability to seek help may also be contingent on the absence of infectious disease outbreaks in the community (assumption B).

Those who seek help and are screened and identified as having severe alcohol dependence and/or are at risk of suicide should be referred for specialized treatment, where available. Those with less severe AUDs can receive interventions from lay workers in community settings. Community workers with a healthcare background (i.e., social workers and counselors) should be trained to administer these interventions (i.e., CHANGE). While training local workers may improve case management within the health system (intervention 3), it is dependent on the availability of human resources (assumption E).

Once the CHANGE intervention has been completed, refugees can receive follow-up care in the community. This may include vocational skills training (intervention 4) and establishing support groups to foster social support and aid ongoing recovery and/or symptom reduction (intervention 5). There was recognition that for follow-up care to be successful, individuals’ support networks (e.g., family members and others) must also contribute to the process by encouraging engagement (assumption F). Additionally, there needs to be availability of human and non-human resources to provide vocational trainings, and other discussed programs and activities (assumption G).

Experiences with ToC

Five workshop participants were interviewed, of which four were male and one was female. Three worked for an international NGO, one was a clinical officer in Rhino camp settlement, and one was a psychiatric nurse in the Arua regional hospital. Various themes were discussed, which are summarized below under three headings: (a) ToC definition and implementation, (b) advantages and disadvantages of ToC and (c) areas of future improvement.

ToC definition and implementation

When asked to provide a definition for ToC, and what it was about, participants provided heterogeneous responses (see Table 2). A common focus was on the determination of a causal pathway whereby the ToC worked as a way of mapping outcomes necessary for a certain impact to take place, “what needs to be done in order to achieve that impact.” One participant described ToCs as a way of giving direction, and another as that of ensuring that the intervention “flows logically.” The ToC notion of “backward mapping” (i.e., starting from impact and going backward to the earliest outcome that must be realized) was perceived as particularly useful for this.

A theory of change, is, I would call it, a process of… evolving, a process of developing an idea from, the end to the beginning, […] let me give an example, here, you are going, you have a journey to make and this journey from UK to Uganda, […] it’s like you reverse, […] what steps do I need to take before I board in Uganda, what activities should I do before I arrive in Uganda, what objective do I have to achieve, so like you are going in reverse in a theory of change (Hospital psychiatric nurse, Arua).

Respondents highlighted the value of having different types of knowledge and experiences represented. For example, some mentioned the importance of avoiding mixing participants with very different types of status (e.g., mixing refugees with policy makers) out of fear that some may feel inhibited from speaking out. Not everyone agreed with this, and one participant highlighted how it would be important to always have the direct end-users (e.g., refugees with AUDs) to ground the perspective of the group.

We wanted the people to speak their mind, objectively, free, without fear of being underlook, you can imagine bringing a refugee all the way from the settlement and sitting in Kampala, in a five star hotel and being with the ministry people definitely he will underlook at his or her opinion in that setting, so we decided to ensure that have an environment which is fair to each of the stakeholder (Project coordinator at NGO, Arua).

The inclusion of the right participants and expertise was perceived as essential to reflect the reality on the ground.

I think one of the, one of the strengths is that, the, the ToC map that was produced is an outcome of critical reflection of people who are, who have been involved in the field who have sort of know the needs of the refugees in terms of mental health and psychosocial support, I feel that the ToC reflects what the real needs are and what can be done to address those needs (Community services officer at international NGO, Arua).

Two participants described that while the ultimate outcome of the ToC in the three workshops in Uganda was similar, that is, improved wellbeing for refugees, the pathways through which this outcome was reached differed across groups depending on the type of expertise and knowledge people brought.

The ToC notes for Rhino [refugee leaders as participants] you find that people, they talk more of interventions, individual interventions but it seems to have that gap of knowledge where to begin and where to get services, but if you look at Arua and Kampala [more policy makers and service providers involved] they look at putting the policies in place (Project coordinator at NGO, Arua).

The interaction between participants was described as overwhelmingly positive “the relationship was marvelous, people were friendly to each other, they were willing to learn.” Where opinions differed, consensus was reached through discussion.

Table 2.

Definitions of ToC construct according to different participants

Definition of ToCs for participants
“Ehm… in my own words a ToC is a participatory, ehm, method where, ehm, all key stakeholders are involved in designing and the implementation and the subsequent running of an intervention to achieve specifically long-term, a specific impact… which clearly explains the causal pathways where this kind of, ‘if you do this, it leads to this, if you do this to this, this to this,’ which takes you to the final impact of the intervention…” (Project coordinator at NGO, Arua)
“I would say a ToC is, ehm, about understanding the impacts of an intervention, for example, if you are doing something what do you [?], the impact of this to be on the beneficiaries, the direct beneficiaries and the larger community, and, also what you need to do in order to achieve, in order to realize that impact on the beneficiaries and the larger community” (Community services officer at NGO, Arua)
“A theory of change is a like, in my own words, is the journey that one follows ehm… to achieve a goal, so you are setting out to move on a long journey, but you need to know what hurdles, what easy things that you can get on the way to reach your destination” (Clinical psychologist at NGO, Kampala)
“A theory of change, ehm… is, I would call it, a process of… ehm… evolving, a process of developing an idea from, ehm, the end to the beginning” (Hospital psychiatric nurse, Arua)

Advantages and disadvantages of ToC

The ToC as a method was perceived to have multiple advantages. Clear advantages included empowerment, the visual and participatory nature of the workshops and a sense of ownership.

The room was filled with excitement, “oh these guys want us to develop our own intervention, this is so amazing!”, and they had great remarks at the end of that, “if all interventions which many partners want to address problems in the community are done the way we did then”, they say “they will have a lasting solution to their problems” (Project coordinator at NGO, Arua).

The main issue discussed was the ToC terminology, often perceived as confusing with participants reporting struggling to effectively differentiate between constructs (e.g., assumptions, interventions). Understanding the different components was described as “tedious” and time consuming, and potentially problematic if constructs were not well understood.

The one in Rhino camp, was also based on experience of the refugees but I think it was a little bit challenging for them because some of these concepts appeared to be hard, [facilitator] help them to you know explain some of these things because it was the first time someone was coming across words like impacts or intermediate outcomes, objectives, outcomes, so… […] based on the low level of education of the refugees, of course mentioning impact that will be a very strange word to them and then they will ask “what do you mean by impact”? (Community services officer at NGO, Arua).

Participants also questioned the flexibility of ToC maps in volatile situations such as settings affected by armed conflict.

In an event where the situation on the ground changes, I mean the context in which the intervention was designed changes, I am trying to see whether, if the interventions do not achieve the intended purpose which was ideally planned, I don’t know how that can fit in it, whether it has room for adjustments… (Project coordinator at NGO, Arua).

Areas of future improvement

Participants mentioned it may have been helpful to have wider representation of certain stakeholders (e.g., primary healthcare workers, refugees with AUDs). To address the ambiguity around the ToC terminology, some participants suggested having appropriate simplifications, explanations of constructs and background materials before the meeting (e.g., material on the study and ToCs).

I think… one thing that, ehm, could be done differently to improve future ToCs is, […] describing in advance the ToC to the workshop participants so that they come into the workshop with an idea of how it will look (Hospital psychiatric nurse, Arua).

Discussion

To the best of our knowledge, this article is the first to report on the use of ToC to support the planning of the sustainable implementation of a public health intervention to address AUDs among refugees. The findings in the current article highlight the utility of ToC to define and map context-specific outcomes across different implementation pathways and identify areas that require attention. Two necessary pathways were identified that will influence the implementation and maintenance of CHANGE in Uganda: a policy impact pathway and a mental health service delivery pathway. Both highlight the need for early planning and engagement of key stakeholders to set the stage for implementation. The results of this study will help inform our subsequent work that focuses on examining the scalability of the CHANGE intervention through the health system and other humanitarian sectors.

Policy impact pathway

The findings highlight steps required for the sustainable implementation of programs like CHANGE. First, within the policy impact pathway, it is necessary to establish government health policies that consider AUDs among refugees and acknowledge the role of social determinants (i.e., livelihoods, housing) on the development and persistence of AUDs. While Uganda’s national alcohol control policy (Government of Uganda, 2019) recognizes the harmful impacts of alcohol, it falls short in acknowledging the role of social determinants on AUD development. Addressing these policy gaps is imperative for the long-term implementation and integration of interventions like CHANGE into community healthcare.

Second, the bidirectional relationship between specific dimensions of poverty and common mental health disorders and AUDs needs addressing. Research consistently demonstrates elevated risks for developing common mental health disorders and AUDs among individuals with limited access to material resources (Marmot et al., 2008; De Silva et al., 2011; Nadkarni et al., 2013; Allen et al., 2014; Lo et al., 2017b; Kibicho and Campbell, 2019). A previous study in Uganda with refugees showed high prevalence of post-traumatic stress, major depressive, generalized anxiety and substance use disorders, all linked to unmet basic needs (Bapolisi et al., 2020). Conversely, interventions addressing social determinants, for example, income-generating programs, can act as protective factors against initial AUD development (Amosu et al., 2016; Aaraj et al., 2021; Naseh et al., 2021), while potentially preventing relapse posttreatment. Failing to recognize the impact of social determinants on mental health and AUDs will impede efforts in prevention, recovery and symptom reduction, especially in resource-poor settings. For CHANGE, collaboration with other sectors addressing social determinants of health is necessary.

Third, relevant policies and national mental health plans need to be funded, implemented and closely monitored in the community. This includes integrating mental health services into community and primary healthcare settings to bridge existing treatment gaps (Jordans et al., 2019). Uganda’s Ministry of Health has included mental health into general healthcare provisions, as outlined in the Uganda’s Health Sector Integrated Refugee Response Plan of 2019 and the UNHCR’ Public Health Strategic Plan for Uganda (Government of Uganda and UNHCR, 2022). The Refugee Response Plan states as a key priority the reinforcement of MHPSS services and infrastructure. However, limited progress has been made on this front leaving a big gap between the number of people who need this support and those who receive it. In 2019, it was reported that only 29% of refugees identified as needing MHPSS received it (Government of Uganda and UNHCR, 2022). The current primary healthcare facilities available to refugees are overstretched and underfunded, and data are missing on the number of health facilities in settlements that have a mental health focal point (Government of Uganda and UNHCR, 2022). Task-shifting mental health treatment delivery to non-specialist providers, as recommended by the World Health Organization (WHO 2007), could enhance access to care, particularly through interventions by lay healthcare workers within the community. The 2019 national alcohol policy, issued by the Ministry of Health, also underscores the need for a coordinated approach to reduce harmful alcohol use (Ministry of Health, 2019); however, the existing policy gap in addressing the social determinants of alcohol use, especially for vulnerable populations like refugees, persists.

Mental health service delivery

Stakeholders emphasized the critical role of mental health service delivery in implementing and maintaining CHANGE. However, participants currently perceive there to be high levels of mental health stigma, which acts as a barrier to mental health care delivery. As such, delivering mental health care is dependent on community sensitization efforts of mental health and AUDs, enabling individuals to recognize the need for support, be informed about available resources, and reduce stigma. Nalwadda and colleagues previously assessed AUD prevalence among men in rural Uganda, along with levels of internalized stigma and attitudes toward seeking help (Nalwadda et al., 2018). Nearly half of those with AUDs reported that alcohol had “ruined their lives,” yet none of the affected men had received treatment, and 55.5% believed AUDs to be untreatable. In another study on stakeholder perspectives in Uganda, mental health stigma was identified as a widespread issue, rooted in negative local beliefs. These included notions that people with mental health disorders are possessed by spirits, facing consequences for their actions, or that detoxification has serious side effects including intellectual disabilities (Ssebunnya et al., 2009). Such beliefs hinder the willingness and ability to seek help, potentially worsening existing mental health disorders, including AUDs, and perpetuating poverty cycles.

The current findings indicate that there is a perceived lack of awareness among stakeholders around tackling AUD in Rhino camp settlement. A prior study highlighted similar findings and that reducing stigma toward people with AUDs may facilitate the successful implementation of AUD interventions in conflict-affected populations (Greene et al., 2018). Participants in the current study proposed community-level resources to enhance awareness for AUDs, and available services to facilitate help-seeking. Several interventions, including educational initiatives, awareness campaigns and stigma reduction programs may prove helpful. This could include training community-based health workers in task-sharing interventions to support access to care. Importantly, support should extend beyond treatment completion, necessitating community-based follow-up care to aid reintegration and sustained wellbeing. Workshop participants highlighted the need for integrating psychosocial interventions into existing clinic-based treatment programs and creating opportunities for follow-up care to aid recovery and symptom reduction in the community.

Workshop participants called for the prioritization of further research on the impact of social determinants on mental health and AUDs in Rhino camp settlement. This knowledge can then be used to devise strategies to promote mental health and recovery within this context. For CHANGE, these findings highlight the importance of working with local community leaders to understand how these determinants may impact on AUD interventions and work together to promote the potential long-term benefits if the CHANGE intervention is proven to be effective. The benefits of using ToC workshops to develop a logical plan for scaling up mental health programs, contextualizing the programs and getting stakeholder buy-in has previously been highlighted in other resource-poor settings (Breuer et al., 2014; Fuhr et al., 2020; Babatunde et al., 2022). For the current project, the ToC map will need to be reviewed and adapted as further findings emerge on the implementation and scalability of CHANGE.

Experiences of ToC

Beyond the ToC map, the current study explored participants’ reflections on taking part in the workshops, through individual interviews. Participants recognized the benefits of the participatory nature of the workshops, specifically the sense of ownership over ideas. Participants did voice concerns over the flexibility of the final ToC map, as its validity may be challenged in settings where drastic changes can occur, such as humanitarian and/or conflict settings. One study (Breuer et al., 2014) previously described how to adapt the ToC methodology in order to ensure that it remains a useful method to use in shifting conditions (i.e., conflict-affected contexts). They suggested exploring “living ToCs” which can facilitate responsive programming throughout a program’s life cycle. Living ToCs can include conducting regular program evaluations that allow for robust conclusions to be made on the impact of the program, which can then be fed back into the ToC and consequently lead to the adjustment of programing and desired outcomes.

Strengths and limitations

The current research has facilitated the understanding of how the CHANGE intervention can impact change within Uganda’s humanitarian context using a participatory approach. The decisions on how to implement and maintain the intervention need to be driven by local knowledge on operational dynamics, divergent interests, inconsistent funding and the need for safe access to those who can benefit from the intervention (Puri et al., 2015).

These workshops have enabled us to articulate clear outcomes and have helped draw lessons from the stakeholders’ experience of working within the health sector both at a national and local level. The current article is the first article to use ToC for an AUD and mental health intervention in Uganda (and indeed with forcibly displaced persons globally).

This research had several limitations. First, the ToC map is based on the implementation of the CHANGE intervention in humanitarian settings in Uganda; however, the effectiveness of the CHANGE intervention still needs to be assessed. Second, stakeholders with lived experience (i.e., refugees) were only included in the ToC workshops when they held positions of responsibility within the settlement, meaning some insights regarding the on-the ground realities of the most vulnerable in the settlement may have been missed. Participants of the ToC highlighted challenges surrounding the ambiguity of ToC terminology. This challenge with ToC methodology has previously been highlighted (Stein and Valters, 2012) and suggests potential issues on how specific terms are understood. The ambiguity may change the way in which ToC is approached, and how the map is designed. Suggestions were made by participants in the current study to improve this by providing better simplifications of the constructs, and for these to be made available prior to the ToC workshops. Finally, while the individual interviews helped reflect on the use of ToC workshops in this context, having only five respondents was a further limitation to the findings.

Conclusion

This study uses ToC to identify pathways influencing the implementation and maintenance of interventions addressing psychological distress and AUDs in a Ugandan humanitarian setting. Two pivotal pathways emerged: policy impact and mental health service delivery. The pathways, outcomes, interventions and assumptions outlined herein hold practical relevance for policy, research and practice. The participatory approach, involving multiple workshops and qualitative interviews, enhanced stakeholder ownership and commitment. It is important to note that the resulting ToC map is adaptable, pending assessment of intervention effectiveness, cost-effectiveness and reach. This study pioneers the use of ToC in planning sustainable interventions for AUDs among forcibly displaced persons in Uganda.

Acknowledgments

The authors express their gratitude to the participants who took part in this research study.

Open peer review

To view the open peer review materials for this article, please visit http://doi.org/10.1017/gmh.2023.93.

Data availability statement

Participants of this study did not agree for their data to be shared publicly, therefore supporting data are not available.

Author contribution

D.F. conceived and led the study as principal investigator. W.A.T. and E.K., as site-specific principal investigators, contributed to conception, study design and research activity. L.S.A. and A.M. led the ToC and qualitative analyses and played a significant role in article writing. D.T., the project coordinator, contributed to the research activity and provided written input. B.R., C.M. and A.N. as co-investigators made substantial contributions to the conceptualization, study design and writing. J.S. led the ToC workshops and provided written input. C.B., the research fellow, contributed to analysis, interpretation of findings and led the writing.

Financial support

This study has been funded by the National Institute for Health Research (NIHR) (using the UK’s Official Development Assistance [ODA] Funding) and Wellcome (grant reference number 219468/Z/19/Z) under the NIHR-Wellcome Partnership for Global Health Research (Ref: HSRP496). The views expressed are those of the authors and not necessarily those of Wellcome, the NIHR or the Department of Health and Social Care.

Competing interest

The authors declare that they have no competing interests.

Ethics statement

This study has received ethical approval from the London School of Hygiene and Tropical Medicine Ethics Committee (Ref: 22729) and MildMay Uganda Research Ethics Committee (Ref: 0212-2020). All participants have provided written consent to participate, and for the publication of anonymized results in scientific journals.

References

  1. Aaraj E, Haddad P, Khalife S, Fawaz M and Van Hout MC (2021) Understanding and Responding to Substance Use and Abuse in the Palestinian Refugee Camps in Lebanon Prior to and During COVID-19 Times | SpringerLink. Available at https://link.springer.com/article/10.1007/s11469-021-00714-9 (accessed 11 May 2023). [DOI] [PMC free article] [PubMed]
  2. Adaku A, Okello J, Lowry B, Kane JC, Alderman S, Musisi S and Tol WA (2016) Mental health and psychosocial support for south Sudanese refugees in northern Uganda: A needs and resource assessment. Conflict and Health 10(1), 1–10. 10.1186/s13031-016-0085-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Allen J, Balfour R, Bell R and Marmot M (2014) Social determinants of mental health. International Review of Psychiatry 26(4), 392–407. [DOI] [PubMed] [Google Scholar]
  4. Amosu SM, Onifade PO and Adamson TA (2016) Psychoactive substance use and general mental health among refugees in a Nigerian camp. Journal of Substance Use 21(3), 230. https://www.tandfonline.com/doi/abs/10.3109/14659891.2013.820800. [Google Scholar]
  5. Babatunde GB, van Rensburg AJ, Bhana A and Petersen I (2022) Identifying multilevel and multisectoral strategies to develop a theory of change for improving child and adolescent mental health services in a case-study district in South Africa. Child and Adolescent Psychiatry and Mental Health 16(1), 45. 10.1186/s13034-022-00484-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Baingana F and Patrick OM (2011) Scaling up of Mental Health and Trauma Support among War Affected Communities in northern Uganda: Lessons learned. Available at https://psychotraumanet.org/sites/default/files/documents/int_195.pdf.
  7. Bapolisi AM, Song SJ, Kesande C, Rukundo GZ and Ashaba S (2020) Post-traumatic stress disorder, psychiatric comorbidities and associated factors among refugees in Nakivale camp in southwestern Uganda. BMC Psychiatry 20(1), 1–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Braun V and Clarke V (2022) Conceptual and design thinking for thematic analysis. Qualitative Psychology 9(1), 3. [Google Scholar]
  9. Breuer E, De Silva MJ, Fekadu A, … Lund C (2014) Using workshops to develop theories of change in five low and middle income countries: Lessons from the programme for improving mental health care (PRIME). International Journal of Mental Health Systems 8(1), 15. 10.1186/1752-4458-8-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Breuer E, Lee L, Mary DS and Lund C (2015) Using Theory of Change to Design and Evaluate Public Health Interventions: A Systematic Review. Available at https://link.springer.com/article/10.1186/s13012-016-0422-6 (accessed 18 November 2022). [DOI] [PMC free article] [PubMed]
  11. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I and Petticrew M (2008) Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ 337, a1655. 10.1136/bmj.a1655. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Dawson KS, Bryant RA, Harper M, … van Ommeren M (2015) Problem management plus (PM+): A WHO transdiagnostic psychological intervention for common mental health problems. World Psychiatry 14(3), 354–357. 10.1002/wps.20255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. De Silva MJ, Breuer E, Lee L, … Patel V (2014) Theory of change: A theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials 15(1), 267. 10.1186/1745-6215-15-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. De Silva, Samarasinghe D and Hanwella R (2011) Association between concurrent alcohol and tobacco use and poverty. Drug and Alcohol Review 30(1), 69–73. [DOI] [PubMed] [Google Scholar]
  15. Ezard N (2012) Substance use among populations displaced by conflict: A literature review. Disasters 36(3), 533–557. 10.1111/j.1467-7717.2011.01261.x. [DOI] [PubMed] [Google Scholar]
  16. Fuhr DC, Acarturk C, Sijbrandij M, … Roberts B (2020) Planning the scale up of brief psychological interventions using theory of change. BMC Health Services Research 20(1), 801. 10.1186/s12913-020-05677-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Fuhr DC, Bogdanov S, Tol WA, Nadkarni A and Roberts B (2021) Problem management plus and alcohol (PM+a): A new intervention to address alcohol misuse and psychological distress among conflict-affected populations. Intervention 19(1), 141. 10.4103/INTV.INTV_27_20. [DOI] [Google Scholar]
  18. Government of Uganda (2019) National Alcohol Control Policy. Available at https://www.health.go.ug/cause/national-alcohol-control-policy/.
  19. Government of Uganda and UNHCR (2022) Uganda: 2022–2025 Refugee Response Plan. Available at https://reporting.unhcr.org/uganda-2022-2025-refugee-response-plan (accessed 28 November 2023).
  20. Grant BF, Stinson FS, Dawson DA, … Kaplan K (2004) Prevalence and co-occurrence of substance use disorders and independentmood and anxiety disorders: Results from the national epidemiologic survey on alcohol and relatedconditions. Archives of General Psychiatry 61(8), 807–816. [DOI] [PubMed] [Google Scholar]
  21. Greene MC, Kane JC, Khoshnood K, Ventevogel P and Tol WA (2018) Challenges and opportunities for implementation of substance misuse interventions in conflict-affected populations. Harm Reduction Journal 15(1), 1–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Hammer JH, Parent MC and Spiker DA (2018) Global status report on alcohol and health 2018. Global Status Report on Alcohol 65(1), 74–85. [Google Scholar]
  23. IASC, I-AS (2007) IASC Guidelines on Mental Health and Psychosocial Support in Emergency Settings. Geneva, Switzerland: IASC 2006. Available at https://cir.nii.ac.jp/crid/1572261550682945792.
  24. Jordans MJD, Luitel NP, Kohrt BA, … Lund C (2019) Community-, facility-, and individual-level outcomes of a district mental healthcare plan in a low-resource setting in Nepal: A population-based evaluation. PLoS Medicine 16(2), e1002748. 10.1371/journal.pmed.1002748. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Kaltenbacher S (2019) UNHCR Uganda: Mental Health and Psychosocial Support Strategy (2019–2021) – Uganda. Available at https://reliefweb.int/report/uganda/unhcr-uganda-mental-health-and-psychosocial-support-strategy-2019-2021 (accessed 11 May 2023).
  26. Kane J and Greene C (2018) Addressing Alcohol and Substance Use Disorders among Refugees: A Desk Review of Intervention Approaches. Available at https://www.unhcr.org/protection/health/5c064a8d4/addressing-alcohol-substance-use-disorders-among-refugees-desk-review-intervention.html (accessed 1 November 2022).
  27. Kane JC and Greene MC (2018) Addressing Alcohol and Substance Use Disorders among Refugees: A Desk Review of Intervention Approaches. Geneva: United Nations High Commissioner for Refugees. [Google Scholar]
  28. Kibicho J and Campbell JK (2019) Community perspectives of second-generation alcohol misuse and HIV risk in rural Kenya: A gendered syndemic lens. Global Public Health 14(12), 1733–1743. [DOI] [PubMed] [Google Scholar]
  29. Lo J, Patel P, Shultz JM, Ezard N and Roberts B (2017a) A systematic review on harmful alcohol use among civilian populations affected by armed conflict in low-and middle-income countries. Substance Use & Misuse 52(11), 1494–1510. [DOI] [PubMed] [Google Scholar]
  30. Lo J, Preeti P, Shultz J and Roberts B (2017b) A systematic review on harmful alcohol use among civilian populations affected by armed conflict in low- and middle-income countries: Substance Use & Misuse 52(11), 1494. https://www.tandfonline.com/doi/abs/10.1080/10826084.2017.1289411. [DOI] [PubMed] [Google Scholar]
  31. Marmot M, Friel S, Bell R, Houweling TA and Taylor S (2008) Closing the gap in a generation: Health equity through action on the social determinants of health. The Lancet 372(9650), 1661–1669. [DOI] [PubMed] [Google Scholar]
  32. McCrady BS, Epstein EE and Fokas KF (2020) Treatment interventions for women with alcohol use disorder. Alcohol Research: Current Reviews 40(2), 08. 10.35946/arcr.v40.2.08. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Mellinger JL, Scott Winder G, DeJonckheere M, … Blow FC (2018) Misconceptions, preferences and barriers to alcohol use disorder treatment in alcohol-related cirrhosis. Journal of Substance Abuse Treatment 91, 20–27. 10.1016/j.jsat.2018.05.003. [DOI] [PubMed] [Google Scholar]
  34. Milián IN, Royo Aspa JM, Urgell García J, Urrutia Arestizábal P, Villellas Ariño A and Villellas Ariño M (2022) Alert! Report on Conflicts, Human Rights and Peacebuilding – Escola de Cultura de Pau. Available at https://escolapau.uab.cat/en/publications/alert-report-on-conflicts-human-rights-and-peacebuilding-2/.
  35. Ministry of Health (2019) National Alcohol Control Policy - Ministry of Health | Government of Uganda. Available at https://www.health.go.ug/cause/national-alcohol-control-policy/ (accessed 25 July 2023).
  36. Nadkarni A, Bhatia U, Shaik I, … Madan V (2023a) Comorbidity of alcohol use disorders and non-communicable diseases in low-and middle-income countries. Journal of Substance Use, 1–9. [Google Scholar]
  37. Nadkarni A, Dabholkar H, McCambridge J, … Patel V (2013) The explanatory models and coping strategies for alcohol use disorders: An exploratory qualitative study from India. Asian Journal of Psychiatry 6(6), 521–527. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Nadkarni A, Massazza A, Guda R, … Fuhr D (2023b) Common strategies in empirically supported psychological interventions for alcohol use disorders: A meta-review. Drug and Alcohol Review 42(1), 94–104. 10.1111/dar.13550. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Nalwadda O, Rathod SD, Nakku J, Lund C, Prince M and Kigozi F (2018) Alcohol use in a rural district in Uganda: Findings from community-based and facility-based cross-sectional studies. International Journal of Mental Health Systems 12, 1–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Naseh M, Wagner EF, Abtahi Z, Potocky M and Zahedi L (2021) Prevalence of and risk factors for substance use among afghan refugees in Iran: An exploratory study. Journal of Ethnicity in Substance Abuse 20(1), 34–59. 10.1080/15332640.2019.1571976. [DOI] [PubMed] [Google Scholar]
  41. Probst C, Manthey J, Martinez A and Rehm J (2015) Alcohol use disorder severity and reported reasons not to seek treatment: A cross-sectional study in European primary care practices. Substance Abuse Treatment, Prevention, and Policy 10(1), 32. 10.1186/s13011-015-0028-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Puri J, Aladysheva A, Iversen V, Ghorpade Y and Brück T (2015) What methods may be used in impact evaluations of humanitarian assistance?
  43. Roberts B and Ezard N (2015) Why are we not doing more for alcohol use disorder among conflict-affected populations? Addiction (Abingdon, England) 110(6), 889–890. 10.1111/add.12869. [DOI] [PubMed] [Google Scholar]
  44. Roberts B, Felix Ocaka K, Browne J, Oyok T and Sondorp E (2011) Alcohol disorder amongst forcibly displaced persons in northern Uganda. Addictive Behaviors 36(8), 870–873. 10.1016/j.addbeh.2011.03.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Rokhideh M (2017) Peacebuilding and psychosocial intervention: The critical need to address everyday post conflict experiences in northern Uganda. Intervention 15, 1. 10.1097/WTF.0000000000000161. [DOI] [Google Scholar]
  46. Schäfer SK, Thomas LM, Lindner S and Lieb K (2023) World Health Organization’s low-intensity psychosocial interventions: A systematic review and meta-analysis of the effects of problem management plus and step-by-step. World Psychiatry: Official Journal of the World Psychiatric Association (WPA) 22(3), 449–462. 10.1002/wps.21129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Shiva L, Shukla L and Chandra PS (2021) Alcohol use and gender-based violence. Current Addiction Reports 8, 71–80. [Google Scholar]
  48. Sphere (Ed.) (2018) The Sphere Handbook: Humanitarian Charter and Minimum Standards in Humanitarian Response, 4th Edn. Geneva, Switzerland: Sphere Association. [Google Scholar]
  49. Ssebunnya J, Kigozi F, Lund C, Kizza D and Okello E (2009) Stakeholder perceptions of mental health stigma and poverty in Uganda. BMC International Health and Human Rights 9(1), 1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Stein D and Valters C (2012) Understanding theory of change in international development.
  51. Uganda Ministry of Health (2019) Health Sector Integrated Refugee Response Plan 2019–2024. Available at https://globalcompactrefugees.org/sites/default/files/2019-12/Uganda-%20Health%20sector%20integrated%20refugee%20response%20plan%2C%202019-2024_0.pdf (accessed 11 May 2023).
  52. UNHCR (2019a) Imvepi Settlement HLP Factsheet 2019. Available at https://data.unhcr.org/en/documents/details/71910 (accessed 2 May 2023).
  53. UNHCR (2019b) Rhino Camp Settlement HLP Factsheet 2019. Available at https://data.unhcr.org/en/documents/details/71926 (accessed 2 May 2023).
  54. UNHCR (2019c) UNHCR Regional Update - South Sudan Situation May 2019. Available at https://data.unhcr.org/en/documents/details/70085 (accessed 11 May 2023).
  55. UNHCR (2021) Global Trends Report 2021. Available at https://www.unhcr.org/media/40152 (accessed 5 May 2023).
  56. Vogel I (2012) Review of the Use of ‘Theory of Change’ in International Development, 86.
  57. Weaver H and Roberts B (2010) Drinking and displacement: A systematic review of the influence of forced displacement on harmful alcohol use. Substance Use & Misuse 45(13), 2340–2355. 10.3109/10826081003793920. [DOI] [PubMed] [Google Scholar]
  58. World Bank (2022) Remarks by World Bank Group President David Malpass at Fragility Forum 2022: Development and Peace in Uncertain Times. Available at https://www.worldbank.org/en/news/speech/2022/03/07/remarks-by-world-bank-group-president-david-malpass-at-fragility-forum-2022-development-and-peace-in-uncertain-times (accessed 18 November 2022).
Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr1

Author comment: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR1

Catharina Francina van der Boor 1

Dear Prof. Chibanda and Prof. Bass,

We wish to submit an original article titled ‘Using Theory of Change to Plan for the Implementation of a Psychological Intervention Addressing Alcohol Use Disorder and Psychological Distress in Uganda’. We confirm that this work is original and has not been published elsewhere, nor is it currently under consideration for publication elsewhere.

When developing complex interventions, it is recommended to investigate how context may influence intervention outcomes and implementation. In our paper we use a Theory of Change to identify pathways that influence the implementation and maintenance of a new transdiagnostic intervention (‘CHANGE’) aimed at addressing psychological distress and alcohol misuse in Uganda. We describe three workshops we conducted in Uganda to develop a Theory of Change map for psychological interventions in this context, and carried out semi structured interviews that were done with stakeholders to explore their experiences of participating in these workshops. Through the workshops, we were able to identify two pivotal pathways in the final Theory of Change map – a policy impact pathway and a mental health service delivery pathway. We consider the pathways, outcomes, interventions, and assumptions identified in this paper to be valuable for policy, research, and practice in the field of global mental health. As such, we believe that this is in line with the scope of this journal and would be very grateful for your consideration of this manuscript.

Yours sincerely,

Dr. Catharina Van der Boor

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr2

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR2

Reviewed by: Claire van der Westhuizen1

The paper was interesting to read and describes a useful process which can inform others involved in adapting, testing and implementing complex interventions. Congrats to the authors on conducting and reporting this process.

Overall points

At first the paper seems to address psychological distress as well as AUDs, but as I read further, there were fewer and fewer mentions of the psychological distress component. Further, PM+ does not include alcohol use, except as an unhelpful coping strategy. What evidence-based intervention components were included to target alcohol use? Can you comment on this?

Also, much of the literature on brief interventions for alcohol use focuses on indicated prevention. Do you use diagnostic criteria to assess eligibility for the intervention? Or do you use a screening tool such as the ASSIST?

Has the ToC map been used to guide implementation? Is it being used for monitoring (are indicators being used)? Has it been adapted since the start of the project?

Minor points

1. Terminology: Different terms are used to refer to mental health conditions: mental disorders, mental health disorders. It would be a good idea to stick to one.

2. Line 53: “Kane” not capitalized in citation.

3. Line 274: “five start hotel” – this looks like a typo?

4. Line 392: in-text citation appears in 2 different formats

Impact statement

1. Lines 2-3: does the current study shed “light on the pressing issue of alcohol use disorders”, or the steps that stakeholders decided would lead them to the desired impact? The scope of the study seems to be overstated.

Background

1. The first paragraph is quite long; it would be good to break it up somewhat.

2. The topic sentence of the paragraph starting in line 66 does not seem to link well to the paragraph ideas. I’m assuming the paragraph is trying to say that ToC takes context into account. It sounds like the intervention has already been developed. What is the main reason for using ToC for this project? It would be good to highlight the known usefulness of ToC for this purpose. The De Silva paper mentions a range of uses but I suggest that you contextualise for your project; this would be easier for the reader to follow.

3. Line 76-77: “The aim of this study was to use ToC to summarize pathways that influence the planning for the implementation and maintenance of CHANGE for refugees in Uganda.” The words “that influence the planning” seem to be superfluous and are confusing. Do you mean to say that: “The aim of this study was to use ToC to summarize pathways to the implementation and maintenance of CHANGE for refugees in Uganda”?

4. Could you mention briefly why and how PM+ was chosen and adapted for CHANGE in Uganda? Has PM+ been tested in Uganda?

5. Can you also mention the intervention components for PM+ (eg problem solving and behavioural activation) and the alcohol use component?

Methodology

Setting

1. Line 96: I suggest rephrasing since “substance misuse” is not a non-communicable disease, but a health risk behaviour associated with various NCDs, including substance use disorders.

2. The rationale for the inclusion of Arua and the Rhino settlement is clear. For Kampala, is this because cases may be referred to Kampala, and senior Ministry of Health officials are based in Kampala?

3. It would be good to describe the current health services available in the Rhino settlement and any other psychosocial-related resources.

Participants

1. Can you clarify some of the titles used for participants? (block leader, women representative, refugee leader etc) It would be good to know if these people were refugees living in the camp or not. The limitations section suggests that refuges were not involved?

2. How were the subset of participants chosen for the semi-structured interviews?

Results

1. Much of the discussion focused on AUDs and not psychological distress. What was the reason for this? Psychological distress did not feature at all.

2. Lines 186-188: could you give ideas of the types of activities suggested for interventions 6 and 7?

Discussion & conclusion

1. Policy impact: the need for action and complementary policies across the government departments could have been discussed (regarding social determinants). Has there been any initiatives for health involving various departments? The COVID-19 pandemic spurred such action in many countries. (Ministries of Health began working with other ministries.) Is alcohol/substance use seen as a health issue or is the main role player here another government department?

2. Paragraph starting line 380: what relevant national mental health policies and plans are there in Uganda? It would be good to highlight local plans, knowledge and mechanisms in place to do this and also where the gaps lie (very broadly). You could also comment on the presence/absence of adequate substance use policy.

3. Lines 402 and 403: the study did not conduct a community survey. These lines seem to overstate the scope of the study.

4. Lines 389-415: These paragraphs could do with some restructuring. The discussion brings stigma in and then diverts to other statements around awareness and back to stigma. Lack of knowledge can be seen as part of stigma but the argument is a bit difficult to follow.

5. Interventions and stigma reduction interventions are mentioned but no sources are cited. Please review.

6. Lines 416-418: shift the focus of these lines to the recommendations by workshop participants that social determinants of mental health need to be prioritized. This statement in its current form seems to go beyond the scope of the study findings.

7. The rest of the paragraph can also be revised. The participants appreciated the collaborative effort which highlights the utility of ToC for mapping implementation. Yes, there is potential for sustainability and scale up if the process is repeated or the ToC is reviewed, but you don’t yet have any findings here since this is planning for implementation of a study. You can cite ToC success in health system strengthening and scale up phases elsewhere (see the work of Inge Petersen and colleagues – not just in PRIME).

8. You state that the process “enhanced stakeholder ownership and commitment” I would include the word “perceived” since surely this remains to be seen as the project unfolds?

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr3

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR3

Reviewed by: Erica Breuer1

Using Theory of Change to Plan for the Implementation of a Psychological Intervention Addressing Alcohol Use Disorder and Psychological Distress in Uganda

14 November 2023

Thank you for the opportunity to review this paper. This paper reports on a participatory Theory of Change development process for AUD in conflict affected settings in Uganda. It reports the results of the Theory of Change (i.e. the map and describes the components) but also reflects on the process. They also report on five semi structured interviews with participants of the workshops.

Overall, this is a nice paper. I congratulate the authors on the nuance they have achieved in the results section by weaving together the assumptions and outcomes. I also commend the authors for including interviews of participants. The findings have resonated with my own experience running ToC workshops on the complexity of the ToC jargon.

I suggest some minor revisions

- Theory of Change purists will call Theory of Change an “approach” rather than a method because it relies on multiple methods for evaluation. I would also differentiate throughout that you used participatory Theory of Change workshops (rather than using a “Theory of Change” as there is no one universal approach to developing Theories of Change). ToC does not have to be participatory (although I think it should be!)

- In light of the above, in the methods could you be more specific about how your developed the ToC (rather than the ideal ToC components). I have found a table is often helpful for this. I am assuming that your ToC development did not only happen in the workshops but that there were multiple iterations after the workshops as well. It would be good to understand how this was done and how the information gained in the workshop was developed into a ToC. Some of this is covered in “procedure” so it may be worth consolidating this section with the “ToC workshops” section. Also, how were the audio recordings used. Were they transcribed or only used to check missing information?

- Prevalence is technically not a “rate” as there is no time component (unlike incidence which has a time component)

- The inclusion of stakeholder interviews is a really welcome addition to the ToC literature (very little is known about the experiences of stakeholders), however, a larger sample size would have produced more robust results.

- Pg 4,line 53 – Kane needs a capital letter

- Overall, I would have liked to understand how evidence was used to inform/modify/support the ToC map. At the moment, it’s really just the rationale.

ToC map

- Overall the ToC map is perhaps a little more like a process map than a theory of change. For example, it would be important to think about what changes as a result of the CHANGE intervention rather than just reporting that it had been offered.

- The outcome “Community is made …” could be reworded as “community is aware and….”

- The outcome “unemployment is addressed” could be rephrased as “Clients with alcohol problems are supported to find work/earn income”

- The interventions should be before the outcomes they produce, e.g. intervention 1 should come before the first outcome

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr4

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR4

Reviewed by: Anonymous

GENERAL COMMENTS

This paper describes the process and outcome of using a Theory of Change (TOC) to identify pathways influencing implementation and maintenance of the CHANGE intervention (an expanded version of PM+, which includes AUD management). In addition to sharing the primary outcome, a TOC map with two pathways - policy impact and mental health service delivery, the authors reflect on the utility of the TOC methodology and analyze findings from stakeholder interviews.

Theories of change are often developed for interventions or programs to guide the evaluation process. The concept of using a TOC to think about implementation and maintenance pathways prior to the full testing of an intervention is in line with “best practices” in scaling up as it seeks the early involvement and buy in of stakeholders in program design and helps to anticipate opportunities and barriers to implementation.

The TOC map does a good job of describing the contextual conditions necessary for sustained implementation and impact of the CHANGE intervention. One of the key strengths of the map is its visual simplicity. Often Theory of Change maps are overcomplicated, and their underlying messages become lost. This map strikes a good balance. Likewise, I appreciate the inclusion of the rational boxes/explanations, as it serves to ground the map in an existing evidence base.

SPECIFIC COMMENTS

I suggest the following minor modifications and clarifications:

1. The hyperlink to the CHANGE project is useful, but it would be helpful to include additional information about the intervention in the body of the article, including when the intervention is being implemented and tested, and by whom, as well as how this TOC intersects with the intervention evaluation work. Essentially, I would have appreciated understanding where the creation of this TOC fits within the larger picture of intervention development, testing, implementation etc. Perhaps a call out box, if the publisher permits it.

2. Please number or label the pink/orange boxes in the intermediate outcomes section. This will make discussing, reviewing and commenting on them much easier.

3. Please clarify which of the pink/orange boxes lie within the scope of the CHANGE intervention and which are outside of it (e.g. by circling or delineating the relevant boxes). For example, I’m not clear if assessment of clients with AUD is something that happens as part of the CHANGE intervention, or if CHANGE only refers to the enhanced PM+ treatment delivery in the next box.

4. Related to the comment above, it’s not clear what (or whom) the ceiling of accountability line refers to? Is everything to the right of the line assumed to be directly influenced by the CHANGE intervention? Or does this line simply differentiate the outcomes that will be monitored from those that will not? If so, who will be doing the monitoring?

5. Is the horizontal blue box at the bottom of the TOC an outcome or an assumption? If it’s an assumption, why is it not listed with the others on page 34?

6. It would be helpful if the authors outline their vision for using this TOC map moving forward (e.g. how will it be used within the life of the intervention, who might this be shared with, will it be treated as a living document etc).

7. Theories of Change for interventions are typically accompanied by indicators of the expected outcomes, which are then tracked over time as part of the evaluation process. I appreciate that this TOC is intended to provide a map of potential pathways to implementation and/or sustainability of the CHANGE intervention and thus such indicators may not be appropriate. However, I feel that the practical utility of this map lies in its potential as a tool for assessing the real-world viability of these pathways and identifying gaps/opportunities that could compromise/enhance the implementation and sustainability of the CHANGE intervention. Both program implementors and prospective funders interested in investing in the sustained implementation of the CHANGE intervention will want to understand the extent to which the contextual conditions required to support implementation currently exist or need to be created, and who could be engaged to do so. In other words, what are the chances of each “supporting” intervention and assumption actually being met? To this end, I encourage the authors to add detail to both the intervention and assumption boxes on page 34 that provides further information about the current implementation conditions (or at least how these will be assessed in future). For example:

Intervention: Train community health workers to screen for and identify AUDs in the refugee community and to select appropriate referral pathways (based on levels of severity and other associated problems).

Descriptive information: Do any such training programs already exist? What guidelines could be used? Are there currently any referral pathways? What are they and to where? Who is involved?

Intervention: Provide refugees in recovery from AUDs with vocational skills training

Descriptive Information: Do any vocational training programs currently exist in Rhino? Which agencies provide them/ could provide them (INGO, government)? Who needs to be engaged to make this happen?

Assumption: Mental health services are accessible to refugees.

Descriptive information: What accessible mental health services currently exist? Who provides them? Who uses them?

Assumption: Health care workers including social workers, community health care workers, and counsellors are available to provide services locally.

Descriptive information: How many of these workers are currently present in the camp or surrounding area? Who employs them (government, INGO)? What type of training have they received?

Assumption: Mental health plan supports the implementation of CHANGE.

Descriptive information: Is a mental health plan in place, at what level of gov? What opportunities exist to modify it in support of CHANGE? Who are the gatekeepers/key influencers?

8. The interviews about the Theory of Change process are an important addition to the paper, and capture both commonly held critiques about the process such as its complexity, inclusion issues (who should be involved in the process) and utility in a changing context. The final section does a good job of discussing the limitations of this process, but it could be beneficial if the authors reflect on why they did not engage a potential service user as part of the TOC process.

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr5

Recommendation: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR5

Editor: Claire Greene1

No accompanying comment.

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr6

Decision: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR6

Editor: Dixon Chibanda1

No accompanying comment.

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr7

Author comment: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR7

Catharina Francina van der Boor 1

Dear editor,

We kindly thank you and the reviewers for the helpful comments on the manuscript. We have addressed each of the comments provided.

Best wishes,

Catharina Van der Boor

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr8

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR8

Reviewed by: Anonymous

The revised manuscript does a good job of addressing reviewer comments and queries. The additional details regarding TOC process, origins of CHANGE intervention, mental health policy and access conditions in Uganda, and the proposed usage of the TOC within the context of intervention development are particularly helpful. The manuscript is a beneficial contribution to the existing literature.

Please note two suggested minor edits to the final text:

Line 18 – change 5 to “five”

Line 150 – delete the additional space between “the” and “draft”

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr9

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR9

Reviewed by: Claire van der Westhuizen1

Thank you for addressing the points in detail and responding to my comments. One further comment: the sampling method for the interviews appears to be convenience sampling as the participants were not selected based on any particular characteristic, but rather on their availability. Congrats on your paper and valuable addition to the literature!

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr10

Recommendation: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR10

Editor: Claire Greene1

No accompanying comment.

Glob Ment Health (Camb). doi: 10.1017/gmh.2023.93.pr11

Decision: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR11

Editor: Dixon Chibanda1

No accompanying comment.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    Participants of this study did not agree for their data to be shared publicly, therefore supporting data are not available.


    Articles from Cambridge Prisms: Global Mental Health are provided here courtesy of Cambridge University Press

    RESOURCES