Abstract
There is increasing evidence supporting the effectiveness of psychological interventions in low- and middle-income countries. However, primary care providers (PCPs) may prefer treating patients with medication. A secondary exploratory analysis of a pilot cluster randomized controlled trial was conducted to evaluate psychological vs. pharmacological treatment preferences among PCPs. Thirty-four health facilities, including 205 PCPs, participated in the study, with PCPs in 17 facilities assigned to a standard version of the mental health Gap Action Programme (mhGAP) training delivered by mental health specialists. PCPs in the other 17 facilities received mhGAP instruction delivered by specialists and people with lived experience of mental illness (PWLE), using a training strategy entitled Reducing Stigma among HealthcAre ProvidErs (RESHAPE). Pre- and post- intervention attitudes were measured through quantitative and qualitative tools. Qualitative interviews with 49 participants revealed that PCPs in both arms endorsed counseling’s benefits and collaboration within the health system to provide counseling. In the RESHAPE arm, PCPs were more likely to increase endorsement of statements such as “depression improves without medication” (F = 9.83, p < 0.001), “not all people with depression must be treated with antidepressants” (χ2 = 17.62, p < 0.001), and “providing counseling to people who have alcohol abuse problems is effective” (χ2 = 26.20, p < 0.001). These mixed-method secondary findings from a pilot trial suggest that in-person participation of PWLE in training PCPs may not only reduce stigma but also increase PCPs’ support of psychological interventions. This requires further investigation in a full-scale trial.
Keywords: attitudes, depression, developing countries, mental health, primary care, psychological treatments, stigma, training
1. Introduction
When addressing the global treatment gap for those suffering from mental, neurological, and substance use disorders, it is important to ensure that primary care providers (PCPs) utilize evidence-based treatments [1]. Psychological interventions are evidence-based treatments that can be effectively delivered by people who are not mental health specialists, including providers in primary care and community care in low-resource settings [2]. Training initiatives such as the World Health Organization (WHO) mental health Gap Action Programme-Intervention Guide (mhGAP-IG) encourage the use of both psychological and pharmacological treatments in primary care settings [3]. However, given that PCPs and patients in low- and middle-income countries (LMICs) are accustomed to medications as the standard treatments for non-psychiatric conditions, there is a risk that they favor the adoption of psychiatric medication to the neglect of psychotherapies [4]. For example, among Nigerian primary care physicians trained in mental health care, 88% endorsed that psychotherapy tended to be unsuccessful among patients with depression, and 85% endorsed that psychotherapy should be left to specialists [5]. In the same study, 85% supported prescribing anti-depressant medication by non-psychiatric health workers such as PCPs. This preference for medication may also come from expectations to see large numbers of patients in a limited time, which makes it challenging to integrate time-intensive psychological treatments into primary care [6]. Ethnographic accounts in South Asia and Sub-Saharan Africa also reveal a preference for pharmacological treatment by PCPs and patients, as well as by many mental health specialists [7,8,9]. Concerns have previously been raised in other settings that the mhGAP-IG curriculum may reinforce these biases in favor of pharmacological treatment and further contribute to the medicalization of care for mental illnesses [4].
Despite psychotropic medication being the default treatment in primary care settings in LMICs, there are a number of reasons for trying to ensure the availability and implementation of psychological interventions. Psychological interventions are as effective as medications for treatment of common mental disorders, such as depression [10]. Psychological therapies used in combination with medications lead to better outcomes than medication alone [11]. Moreover, LMIC settings are vulnerable to shortages of medications, especially psychotropic drugs, which makes sole reliance on pharmacological medications untenable. In Tanzania and India, psychotropic medications are on essential drug lists established by the WHO, but there are inadequate supplies in primary care facilities due to delays in procurement and lack of dispensing, which causes medications to expire [12,13]. In Nepal, a comprehensive array of up-to-date, safe, and effective psychotropic medications was only recently added to the essential drug list by the government, but the supply chain is not yet reliable [14]. The COVID-19 pandemic has further disrupted psychiatric medication supply chains in LMICs including Nepal, while the increased use of mobile technology has widened the opportunities for psychological interventions [15].
Research from high-income countries (HICs) suggests that when patients are familiar with psychological treatments, they are more likely to select these over medication when available [16]. A review of patients’ preferences based on 34 studies conducted in HICs demonstrated that 75% of patients preferred solely psychological treatments, and this preference was stronger among ethnic minorities, specifically in African Americans, Asian/Pacific Islanders, and Hispanic Americans in comparison to non-Hispanic white participants [16]. Overall, the current literature suggests that when patients are aware of psychological treatments, they prefer these, especially for conditions of mild to moderate severity. In LMICs, this requires that PCPs educate their patients about the availability and benefit of psychological treatments. Moreover, the availability of both psychological and pharmacological treatment is consistent with the Integrative Mental Health (IMH) paradigm. IMH aims to reconcile the biological, psychological, sociological, and spiritual models that play a role in mental health care, thus promoting the use of evidence-based psychological treatments alongside pharmacotherapies [17]. The IMH paradigm focuses on treating someone as a whole person, exploring causal factors and promoting education and empowerment of patients [17]. In global mental health, and in Nepal in particular, an integrative framework is needed to balance psychological, pharmacological, and non-allopathic care such as traditional healing [18,19,20,21].
The goal of this study was to evaluate the impact of mhGAP-IG training on treatment preferences among PCPs in a low-resource setting. We evaluated two strategies to implementing mhGAP-IG training for PCPs to determine if the endorsement of psychological treatments would potentially vary based on how training was delivered. Using a pilot cluster randomized controlled trial (RCT) design, we assigned primary care facilities to either standard mhGAP-IG training delivered by mental health specialists or an experimental arm in which mhGAP-IG training was delivered by mental health specialists supplemented with components of the training delivered by people with lived experience of mental illness (PWLE) and aspirational figures, who are PCPs that have taken on mental healthcare delivery [22]. This experimental training strategy is entitled Reducing Stigma among HealthcAre ProvidErs (RESHAPE). We hypothesized that the RESHAPE version of mhGAP-IG would contribute to greater endorsement of psychological treatment because of the empathy and humanistic perspective fostered through social contact with PWLE [23,24,25,26]. The pilot findings suggest that RESHAPE improves both attitudes towards patients with mental illness and accuracy of mental illness diagnoses [27]. In the current analysis, we conduct a secondary exploration of the trial data and use a mixed methods approach to evaluate quantitative differences in treatment attitudes of PCPs across arms. We also explore qualitative themes related to treatment preferences of the PCPs participating in the training.
2. Materials and Methods
2.1. Training Strategies for Primary Care Providers: Standard mhGAP vs. RESHAPE
This study was conducted within the context of the Programme for Improving Mental health carE (PRIME), which was an initiative to develop mental health services in primary care and community settings in LMICs using evidence-supported pharmacological and psychological treatment protocols including mhGAP-IG [28]. PRIME research was conducted in five countries, including in Nepal, where it was implemented through Transcultural Psychosocial Organization (TPO) Nepal, a non-governmental organization, in Chitwan district in the southern region of the country [29].
Mental health services were integrated within the primary health care system in Chitwan based on a district mental healthcare plan [30]. The plan relies upon psychiatrists and experienced psychosocial counselors as trainers and supervisors, with the majority of care delivered by government PCPs in accordance with mhGAP-IG and support from community health volunteers and community psychosocial counselors [30]. PCPs include health assistants, medical officers, and auxiliary health workers, who are termed prescribers due to their authority in the primary health facility to prescribe medicines. Another class of primary care staff comprises auxiliary nurse midwives and staff nurses, who are classified as non-prescribers because they do not have prescribing authority. This classification illustrates the salience of medication as a defining feature for categorizing primary care staff.
Mental health services were delivered by government health workers trained and supervised by TPO Nepal. Prescribers were trained in a 10-day curriculum roughly divided between basic psychosocial skills and mhGAP content for four disorders (depression, psychosis, alcohol use disorder, and epilepsy). Non-prescribers were trained for 5 days on basic psychosocial support skills, and a subset of these non-prescribers received additional training in manualized psychological interventions for depression and alcohol use disorder (behavioral activation and motivational enhancement therapy, respectively), which had been modified for delivery by people who are not psychiatrists or psychologists in South Asia [31]. For both prescribers and non-prescribers, the standard training was conducted solely by mental health specialists: psychiatrists for mhGAP material and experienced psychosocial counselors for the psychosocial components and manualized psychological interventions.
An alternative training strategy was developed (RESHAPE), in which training was facilitated not only by mental health specialists but also by PWLE and aspirational figures. In RESHAPE, a participatory photography method (PhotoVoice) was used to help PWLE develop recovery narratives that they presented during the training accompanied by photographs they had taken [32,33]. In addition, PCPs who had previously received training on mental health services and who had regularly integrated mental health treatment for their patients were recruited to provide narratives of their experiences. They were termed ‘aspirational figures’ because of the hope that other PCP trainees would aspire to similar commitment to mental health service delivery. A full description of the RESHAPE training curriculum has been published previously [24]. Table 1 presents the contents of the 10-day training for prescribers and 5-day training for non-prescribers, as well as the elements that constitute RESHAPE [27].
Table 1.
Day 1 a | Day 2 a | Day 3 a | Day 4 a | Day 5 | |
Morning session | Introduction to training Objectives |
* Aspirational figure testimonial, and common myths Introduction to psychosocial problems, causes and symptoms |
* In-person PWLE recovery stories with Q&A Communication skills |
Psychosocial skills training | Introduction to psychiatric diagnoses and mhGAP-IG |
Afternoon session | Intro to mental health and psychosocial concept Pre-tests |
Introduction to psychosocial support | Communication skills | Psychosocial skills training * Reducing Stigma |
mhGAP curriculum |
Day 6 | Day 7 | Day 8 | Day 9 | Day 10 a | |
Morning session | Psychiatric history taking skills Epilepsy assessment, diagnosis |
Depression and suicide assessment and diagnosis | Psychosis and bipolar assessment and diagnosis | Alcohol and drug use disorder assessment diagnosis and management * In-person PWLE recovery story with Q&A |
Documentation and supervision |
Afternoon session |
* In-person PWLE recovery story with Q&A Clinical patient evaluation |
* In-person PWLE recovery story with Q&A Clinical patient evaluation |
* In-person PWLE recovery story with Q&A Clinical patient evaluation |
* Challenges and barriers: collaborative problem solving | Post-test |
Abbreviations: mhGAP-IG, mental health Gap Action Programme-Implementation Guide; PWLE, people with lived experience of mental illness; Q&A, question and answer session; a Non-prescriber content was for Days 1–4 and Day 10 (total 5) and was conducted separately from prescribers. * Specific to RESHAPE training.
Thirty-four health facilities in Chitwan were eligible for participation in the study. The primary care facilities comprised the unit of clustering. Facilities were randomly assigned to either the standard mhGAP training or the RESHAPE adaptation of mhGAP training. All PCPs at a given facility received the training relevant to the arm of randomization, i.e., all prescribers and non-prescribers at a facility were in the same arm (standard mhGAP or RESHAPE). This minimized the risk of contamination across arms. Full details of the cluster design are in the study protocol [22] and details of cluster retention are available in the pilot primary outcome publication [27].
2.2. Data Collection and Analysis
2.2.1. Qualitative Data
Semi-structured qualitative interviews were conducted 6 months post-training. Qualitative interview participants were purposively recruited. The sample included a subset of PCPs in mhGAP training, PWLE involved as co-facilitators, and caregivers of PWLE of the training. Caregivers attended the PhotoVoice training with PWLE. Having caregiver engagement in training has been linked to more support and greater participation in training for PWLE [32]. The interview content focused on participants’ reflections on the training and their current practices at the health post in regard to treatment for mental illnesses. Interviews were conducted in Nepali and lasted approximately 90 min and were conducted in the same training location each time. Interviews were first transcribed in Nepali and then translated into English. Data analysis followed a thematic approach and was completed using NVivo 11 [34]. A codebook was developed with each code having its own unique definition and inclusion/exclusion criteria [35]. Three members of the data analysis team (AB, CL, and DG) coded the interviews. Before starting the coding, these three raters completed an inter-rater reliability (IRR) process. They independently coded transcripts, discussed reasons for coding disagreements, and adjusted code definitions and coding strategies to improve agreement. IRR among the three coders reached 0.79 before formal coding was initiated. In total, the data analysis team went through twenty percent of the total transcripts to develop codes until meaning saturation and agreement amongst coders was reached (i.e., reviewing additional transcripts until in the diversity of code meanings was covered [36]). Final coding was completed on all interviews. The first author developed summaries of codes relevant to this manuscript, including attitudes toward psychological treatment and medication, and conducted structured comparisons to identify differences in perceptions and experiences by type of training (standard mhGAP vs. RESHAPE).
2.2.2. Quantitative Data
The health workers participating in mhGAP training in both arms completed assessments of knowledge and attitudes pre-training and at multiple follow-up points as part of a larger suite of quantitative assessments [22]. Here, we focus on specific questions from the Depression Attitudes Questionnaire (DAQ) [37] and the mhGAP Knowledge Assessment adapted for PRIME [38]. The DAQ comprises twenty statements that measure a practitioner’s attitudes towards depression. Specifically, these attitudes can be grouped into four themes: unease with interaction with depressed patients, belief that depressive symptoms are inevitable, acknowledgement and understanding that depression is a clinical disorder, and treatment of depression. The DAQ can be reported as individual item results or as subscale totals [39,40]. For the purpose of these analyses, a subset of these questions allowed us to evaluate attitudes related to this analysis’ objective of attitudes toward psychological vs. pharmacological treatments. Disorder-specific questions about counselling were only asked about depression and alcohol use disorder because these were the two conditions for which a manualized psychological intervention was included. ANOVAs with post-hoc tests were used to compare pre/post scores in continuous outcomes of interest, and chi-squared tests were used to compare changes in the frequency of correct answers or positive attitudes between the first assessment period (pre-training) and a subsequent follow-up (16 months post-training).
3. Results
3.1. Qualitative Results
3.1.1. Participants and Overview of Themes
For the qualitative interviews, 45 people participated: 3 non-prescribers and 8 prescribers from standard mhGAP training; and 7 non-prescribers and 11 prescribers from RESHAPE training. In addition, 9 PWLE and 7 of their caregivers participated in the qualitative interviews. No aspirational figures participated.
3.1.2. Attitudes toward Medications and Psychological Treatments Prior to Training
In the qualitative interviews conducted 6 months post-training, participants retrospectively reported that pre-training, they had focused on pharmacological treatment methods for mental illnesses. When asked how to treat patients with mental illness, participants described prescribing a variety of medications. Many expressed the sentiment that medications are a way to quickly get patients back to the functioning levels that they had before their mental health problems started. This would then help them be integrated into the community again:
“When confronted with people who would complain of their mental health problems, we would try to bring awareness by explaining that mental health problems can be treated in a hospital with medication and such. We told the patients that they would be able to get back to their day-to-day activities just like they were before they had mental health problems.”
—#15, RESHAPE prescriber, Male.
Findings also reflected the stigma that exists towards people with mental illness, as well as those who treat them. A RESHAPE prescriber expressed, “I used to be scared of clients with mental health issues. I used to think that maybe they will hit me. I had no idea how to deal with such clients” (#16, male). Other prescribers and non-prescribers expressed similar views and experiences, most commonly not wanting to talk to a patient with mental illness for a long period of time and fear of violent behavior from the patient.
PCPs said that medications somewhat overcame this stigma because the act of prescribing medications for mental illness was consistent with care for physical illnesses. Thus, patients with mental illnesses were not singled out by getting a different form of care. Moreover, because the medications were delivered by PCPs—as opposed to psychiatrists—health workers thought that patients would not feel as stigmatized:
“If a doctor prescribes those medicines, they stigmatize them as a ‘mad man’s doctor’ (Nepali: paagal ko daktar). But they don’t say that to us because we have also dealt with patients with tuberculosis, leprosy, and malaria. We deal with all these patients here and give medications for all these problems, and along with these, we have also started giving medicines for mental illness, and it’s been much easier for us.”
—#18, RESHAPE prescriber, Male.
From the perspective of patients interviewed, taking psychiatric medications is stigmatizing, but taking medications is easier to hide than seeking other types of treatment. For example, a patient could furtively take the medication without family members knowing about it. Prior to the training, family members also had a preference for medication because they could surreptitiously give it to the patient (e.g., mixed in their food) without the patient’s consent or knowledge. In our study, prior to the training, one PWLE with depression was unaware that she was on psychiatric medications because her family would erase the name of the drug on the package before giving it to her. This finding points to the notion that psychotropic medications are not free from stigma. The stigmatization of psychiatric medication was raised by multiple PCPs:
“Mental health stigma should be reduced. High class people don’t want others to know that they are mentally ill. They simply say that they have been cursed by some supernatural power. When they get cured by traditional healers, they feel as if god has cured them. But, if they take medicines from a health post, people look down upon them and say they had a mental disease and needed medicines to be cured. When we give them these medicines, they think that they are cured by medicines for crazy people.”
—#49, RESHAPE prescriber, Male.
A few providers said that before the training, they believed that mental illnesses were untreatable. Additionally, some health workers acknowledged that they held some stigma towards people with mental illnesses and reported that they dealt with this by quickly getting the patient out of the clinic by writing them a prescription. Hurriedly writing a prescription reduces the time the clinician spends with the patient, and the patient will typically leave satisfied by having a medication.
PCPs also often focused on treating physical symptoms rather than psychological ones. A RESHAPE prescriber described:
“Firstly, clients with mental issues used to come to us with physical problems such as headaches or fatigue or similar body issues. If a client came in with a headache, we simply prescribed cetamol (acetaminophen) and let them be on their way. We did not dig deeper into their problem.”
—#16, RESHAPE, prescriber, Female.
In some cases, the PCPs reported that prior to training, they typically gave out non-psychiatric medication even if psychiatric symptoms were identified:
“Sometimes the patients need psychiatric medicine, but they [health care workers] give out other medicines because these kinds of [physical] complaints also came from the clients. As I said earlier, the major learning I received is that now I can identify mental diseases like anxiety or depression, which earlier I would ignore just by giving some headache medicines.”
—#14, RESHAPE prescriber, Male.
3.1.3. Attitudes toward Medications and Psychological Treatment after Training
When asked how the mental health training changed their attitudes, the PCPs described a number of issues. From the qualitative interviews, the knowledge gained in training was associated with more confidence in their ability to diagnose and treat mental health disorders:
“Interviewer: Now, after the training, what aspects of mental health services are you confident in providing?”
“Respondent: After taking the mental health service help, if a client comes, I can differentiate between depression, psychosis, epilepsy, and alcohol withdrawal. Likewise, I can follow up with counseling. They say that for those with mental health issues, counseling can help solve half of their problems.”
—#16, RESHAPE prescriber, Female.
The fact that the training was offered to both prescribers and non-prescribers fostered cooperation between the two groups, and almost all participants expressed that it helped streamline the new focus in treatment methods. For example, a RESHAPE prescriber explained:
“Both prescribers and non-prescribers are playing good roles. After we see a patient, we send the patient to the non-prescriber for counseling… When the patient comes for follow up visits, we can decide whether the patient needs medicines or only counseling. First, we send them for counseling, and after counseling only, we decide whether the medicines are required or not.”
—#18, RESHAPE, prescriber, Male.
Within the psychosocial training components, mental health and illness were framed with the local psychological concept of the heart-mind (Nepali: man, ), which is the organ of memory and emotion. Psychological distress in the heart-mind is seen as commonplace, thus not highly stigmatized. By further understanding this term, participants came to recognize the necessity of talking to patients with mental illnesses by listening to their stories so that the healthcare worker can get to the root of the patient’s problem, as reported by both prescribers and non-prescribers:
“Before, when such patients with problems related to heart-mind used to come, we used to refer them directly, but now we look after the patients. We prescribe medicine to them, and we also provide them counseling so it has been very easy”
—#12 RESHAPE prescriber, Male.
“In the case of heart-mind problems, I think counseling is very helpful. However, as cases differ, the use of medicine might also be required. I feel that the counseling is really important as through psychosocial counseling, we can reach the heart-mind of that person and know things, which might in turn be helpful in curing them”
—#1, RESHAPE non-prescriber, Female.
The RESHAPE component of training was woven into the psychosocial and mhGAP components. Participants described that the addition of PWLEs as co-facilitators in the training humanized people with mental health disorders for them. Being able to hear the stories from PWLEs, see pictures of their day-to-day lives, and openly interact with them allowed the participants to have a tangible recovery story to refer back to and think about. The in-person PWLE recovery testimonials mentioned counseling as something that helped their recovery, which may have added to the PCPs’ changed perception that counseling is a valid way to treat mental illness. Counseling and listening were mentioned in a positive manner by trainee participants from both study arms:
“We had no idea about the counseling before. We used to ask them a few questions and then referred them to doctors or give them suggestion to meet them. But now, we try to understand their problems. Counseling is also as important as medication. If both the counseling and medication is provided to the patient, then it will help them to recover soon. There will be changes in their lives.”
—#34. RESHAPE prescriber.
In addition to PWLEs, the RESHAPE training included aspirational figures as co-facilitators. These aspirational figures were previously trained healthcare workers who successfully treated people living with mental illness. These figures were selected by supervisors as good role models for current trainees.
“I: What benefits do you think there were because of [aspirational figures’] involvement in the training?”
“R: I mentioned about it before too. It helped us in part of counseling too. When we listened to what the health workers said, it made us feel that we can help [people with mental illness] for their treatment in our health post too. We can help them achieve the life they had before having this illness. It motivated us.”
—#2, RESHAPE non-prescriber, Female.
3.1.4. Structural Factors
Participants mentioned structural challenges in implementing mental health services. The three main structural factors that affected provision of mental health services were supply of medications at the health facility, lack of human resources, and inadequate infrastructure. Through the PRIME program, medications have been made free, yet they were not always in stock at the health facility. Providers mentioned that this was an issue they encountered at all time points and said that there were times when they knew they should give a certain medication to a patient, but it was unavailable at their health facility.
Table 2 shows how PCPs endorsed subthemes related to attitudes before and after training, presented in order of descending frequency. In regards to retrospective reflections on pre-training attitudes, stigma was the most endorsed subtheme; in reports of post-training attitudes, support for counseling was the most commonly endorsed subtheme. There were no identified differences between the training arms or between non-prescribers and prescribers. Figure 1 illustrates the changes from pre- to post-training attitudes, the possible mechanisms of change, and the relationship to underlying structural factors.
Table 2.
Theme | Sub-Theme * | Description |
---|---|---|
PCPs’ reported attitudes prior to mental health training | (1) Stigma towards MH medications | Stigma exists towards those who take and those who prescribe medications for mental illnesses |
(2) Focus on physical symptoms and treatment of those | PCPs focused on treating somatic symptoms rather than the underlying psychological ones and thus prescribed medications to treat the physical symptoms | |
(3) Easy, cheap, and quick mode of treatment | Medications are perceived by healthcare workers to be easy to prescribe and a cost-effective method of treatment | |
(4) Medications are the quick way back to normal | Perception that medications equate to a quick and easy way to get a MH patient back to doing daily activities | |
PCP’s reported learning after training | (1) Endorsement of counseling | Healthcare workers became aware of the technique of counseling and endorsed the efficacy of counseling as a treatment for MH patients |
(2) Listen and spend time with patients to understand their problems | Participants expressed the necessity to listen to patients to understand the root of the symptoms that brought he/she to the health post | |
(3) Increased knowledge of mental illness | Through the training, PCPs expressed that their knowledge about MH disorders relevant to their geographic area had increased | |
(4) Increased cooperation between prescribers and non-prescribers streamlined services | With the training, there has been an increase in the cooperation between the prescribers and non-prescribers helping serve the patients better. Non-prescribers perform counseling and can spend time with patients, then prescribers provide prescriptions. | |
Attributions for changes in knowledge and attitudes | (1) Psychosocial content | Techniques for how to interact with people with MH disorders |
(2) mhGAP content | General knowledge of mental health disorders | |
(3) RESHAPE content | Addition of in-person PWLEs’ testimonials |
* Subthemes are presented in order of descending frequency in qualitative data. Abbreviations: MH, mental health; mhGAP, mental health Gap Action Programme; PCP, primary care provider; PWLE, people with lived experience of mental illness; RESHAPE, Reducing Stigma among HealthcAre ProvidErs.
3.2. Quantitative Results
A total of 205 PCPs took part in the quantitative assessments: 110 prescribers and 95 non-prescribers. Demographic details of participants at baseline are provided in Table 3.
Table 3.
Baseline Demographics | N (%) |
---|---|
Gender | |
Female | 96 (46.8%) |
Male | 109 (53.2%) |
Age | |
21–29 years | 74 (36.1%) |
30–39 years | 56 (27.3%) |
40–49 years | 52 (25.4%) |
50+ years | 23 (11.2%) |
Caste/Ethnicity | |
High caste groups | 144 (70.2%) |
Lower caste groups and ethnic minorities | 61 (29.8%) |
Type of primary care provider | |
Non-prescriber A | 95 (46.3%) |
Prescriber B | 110 (53.7%) |
Years working in healthcare services C | |
<1 year | 10 (4.9%) |
1–5 years | 62 (30.2%) |
6–10 years | 25 (12.2%) |
>10 years | 107 (52.2%) |
A Primary care provider without prescribing rights, e.g., auxiliary nurse midwife. B Primary care provider with prescribing rights, e.g., health assistant. C Missing data on one participant.
ANOVA testing was used to compare changes over time in attitudes towards depression. Among standard mhGAP trainees, there were significant differences between baseline and the 16 month follow-up on three out of four Depression Attitudes Questionnaire (DAQ) questions: standard mhGAP DAQ #1 “Depression can improve without medication” (F = 8.68, p < 0.001); DAQ #12 “Antidepressants work in primary care” (F = 1.87, p = 0.049)); and DAQ #13 “Psychotherapy is deliverable by non-specialists” (F = 4.78, p = 0.003), see Figure 2 and Supplemental Table S1. However, there was no significant difference found on DAQ #11 “Depression is treatable by primary care workers” (F = 2.17, p = 0.092). For the RESHAPE study arm, we found significant increased endorsement across all four questions: DAQ #1 (F = 9.83, p < 0.001), DAQ #11 (F = 4.40, p = 0.005), DAQ #12 (F = 9.04, p < 0.001), and DAQ #13 (F = 11.64, p < 0.001).
Chi-squared analyses were used to compare changes in frequency of endorsement of mhGAP knowledge items from pre-training to 16 month follow-up. The item “Antidepressants should only be given after psychosocial treatment” did not show statistically significant changes for either standard mhGAP (χ2 = 2.48, p = 0.480), (χ2 = 5.49, p = 0.139) or RESHAPE trainees (χ2 = 3.33, p = 0.344), (χ2 = 1.37, p = 0.714), see Figure 3 and Supplemental Table S2. However, endorsement of “Providing counseling to people who have alcohol problems is effective” increased significantly for both standard mhGAP (χ2 = 10.01, p = 0.019) and RESHAPE trainees (χ2 = 26.201, p < 0.001). Among standard mhGAP trainees, “All people with depression should be treated by antidepressants” did not show statistically significant changes (χ2 = 7.04, p = 0.071), but it did for RESHAPE trainees (χ2 = 17.62, p < 0.001).
4. Discussion
In qualitative interviews six-months after mental health training, PCPs described a shift in their perceptions about pharmacological and psychological treatments for mental illnesses. These shifts were described by non-prescribers and prescribers in both study arms. When reflecting on their attitudes and behaviors before the training, PCPs in both arms stated they were more willing and likely to treat people with mental illnesses using medications. Many of the stigmatizing attitudes that characterized PCP attitudes prior to training are comparable to perspectives of PCPs around the world, as recently demonstrated in qualitative research in seven countries representing both HIC and LMIC settings, with the latter including Lebanon, Tunisia, India, and Nepal [41].
After the training, there was increased support for and endorsement of the effectiveness of counseling as a treatment for mental illnesses. Additionally, both prescribers and non-prescribers expressed that they felt more comfortable talking to mental health patients and asking questions about symptoms of mental illnesses. For non-prescribers, they felt empowered by gaining knowledge to directly help patients with mental illnesses rather than only referring such patients to prescribers as they had done in the past. For evidence-based psychological treatments to be successful in LMIC settings, it is necessary to have buy-in from all levels of healthcare providers, along with recognizing the value of the treatment [42]. Thus, it is a positive sign that the non-prescribers have found the role of counseling patients with mental illnesses as one they can fulfill. However, in other LMIC settings, some psychosocial counselors have not felt comfortable presenting psychological treatments and have often reframed them in a biomedical and psychiatric lens [43].
There was not a clear difference between standard mhGAP trainees (who received mhGAP and psychosocial training components) and RESHAPE trainees (who received an additional stigma-reduction component involving PWLEs and aspirational figures) in regard to their qualitative endorsement of counseling based on interviews held 6 months post-training. This may be because of the training modality included 5 days of psychosocial support training alongside 5 days of mhGAP. There may have been additional benefit from the training arm in which PWLEs provided recovery stories and co-facilitated sections of the training. Specifically, recovery stories showed that counseling is a viable treatment option. Another qualitative analysis attached to the RESHAPE study corroborates the benefit of PWLEs’ recovery stories as a method to reduce stigma [44]. The same study points out the need to reduce self-stigma and the lack of PWLE involvement within governmental initiatives.
There were differences between training arms in quantitative assessments of stigma towards people with mental illness, as well as questions asking if mental illness can be treated without medications in a primary care setting. Specifically, RESHAPE participants showed a significant increase in endorsing that depression is treatable by primary care workers and that depression does not need to always be treated with antidepressants. Similar attitudinal and knowledge shifts in relation to the psychosocial context of depression have been found in Nigeria [5]. In Tunisia, similar shifts were seen in primary care physicians being more comfortable engaging with potential mental health patients, along with an increased knowledge of alternative treatments beyond pharmacology for mental illnesses [9].
It is just as important to consider how PWLEs think about perspectives of mental health treatments for mental illness. In our study, both PWLEs and PCPs sometimes felt that it was less stigmatizing to take psychotropic medications than engage in counseling. This sentiment is echoed in HICs as well: in the United States, it was found that stigma affected the acceptability of treatment modalities for depression among Hispanic and African American populations, with herbal remedies being the least stigmatizing compared to prescription medication or counseling [45]. In Nepal, other research has suggested that people experiencing mental illness are more likely to pursue traditional healing as the first line of care, which may be due to less stigma with traditional healers and also the lack of a formal distinction between physical and psychological distress when seeing these healers [7,18,19,20,21,46].
There may also be hesitation from PWLEs to seek counseling until a trustworthy bond is made with the counselor [47]. However, in prior studies of counseling in Nepal, 91% of patients were satisfied with the counseling services offered, and 73% felt that it effectively addressed most of their needs [47]. Other components of the PRIME study in Nepal demonstrated that referral to a community psychosocial counselor has the added benefit for depression, compared to treatment predominantly entailing medication from PCPs [31]. In-person testimonials from PWLEs in RESHAPE may encourage PCPs to listen to and spend more time with their patients to build rapport. Notably, the personal testimonials appear to only be effective in changing attitudes across different types of mental illnesses when performed in-person; in an RCT performed in Nepal with video-taped testimonials from PWLEs, there were mixed results, with stigma worsening for video testimonials of people living with psychosis [48].
Structural barriers such as lack of counseling rooms (alluding to the fact that confidentiality may not be assured), staff turnover leading to difficulty in maintaining trustworthy bonds, and work burden of PCPs may hinder PWLE and health workers’ attitudes towards psychological treatments. Therefore, efforts are also needed to mitigate structural stigma [49].
One of the potential challenges in promoting psychological mental health services is how these become mapped onto existing health system cadres. For example, in Nepal, there is the existing division of prescribers and non-prescribers in primary care. Because of time availability for service delivery, it was found to be more feasible to train non-prescribers in the manualized psychological interventions. Although we piloted training prescribers on motivational enhancement therapy, they did not have adequate time to participate in training and to deliver the therapy in routine care. Therefore, by the fact that non-prescribers have a lower level of training and status in the health system, only having non-prescribers performing manualized psychological interventions may implicitly send a message that these are lower forms of care compared to medication. However, a positive outcome of the qualitative findings in the current study was that both prescribers and non-prescribers described more collaboration as a result of the training. This was one of the key themes raised by many of the PCPs, which suggests that the training encourages a collaborative approach to psychological services including encouragement for counselling from prescribers. Another positive factor is that WHO has developed brief training in foundational skills and associated competency evaluations that can be used with health workers and others even if they do not complete full manualized intervention training [50,51].
There are a number of limitations to our study. We do not know if the attitudinal shifts described in interviews and surveys are borne out in PCPs’ behavior. We are unable to pinpoint exactly what element of the training is the most impactful in making this shift in attitudes. Because interviews were all completed following the training, it may be hard for the participants to remember exact aspects of the training or articulate how those aspects affected their attitudes and behaviors. The scales also used to measure these changes were not all adapted for our setting. Interviews were all conducted by TPO Nepal staff members, so some of the answers may be biased by presumed social desirability of endorsing psychological services. Another limitation was the lack of qualitative information from aspirational figures, which would have been helpful to gain their perspective on what influenced PCPs’ attitudes toward psychological care. Questions about counseling and attitudes were only asked about depression and alcohol use disorder, due to psychological interventions only being taught for depression and alcohol use disorder. Ideally a prospective study would capture both attitudes and changes in clinical behaviors over time. A prospective study would also have allowed for observations of the type of treatment used for mental health patients to be analyzed. Further studies can incorporate counseling and attitude questions for other mental illnesses.
Subsequent steps in the research area will be to explore how attitudes are associated with observer evaluations of clinical skills [52,53]. We must also examine how providers use medications and counseling techniques post-training in primary care settings for mental health services. It would be of interest to formally study what the patients’ preferences are between pharmacological and psychological treatments in LMIC settings.
5. Conclusions
These findings suggest that including psychological treatment knowledge and skills and integrating stigma-reduction components into the mhGAP training package may be useful in encouraging psychological interventions in primary care settings. Encouraging social contact of PWLEs with primary care health workers and providing in-person testimonials on recovery experiences by PWLEs may help reduce stigma and increase the uptake of psychological services. In addition, training and supervision approaches are needed that highlight the effectiveness of psychological support integrated into pharmacological programs. Our findings suggest that collaboration with PWLEs and aspirational figures’ advocacy for psychological treatments increase the likelihood that primary care health workers recommend psychological treatments. This should be combined with assuring appropriate structural conditions, such as confidential spaces for psychological treatment, in all primary care facilities. Taken together, these efforts could increase the likelihood of primary care health workers endorsing and facilitating delivery of psychological services to patients even in low-resource settings.
Acknowledgments
We thank the TPO Nepal team, Manoj Dhakal, Anup Adhikari, Suraj Koirala, Kamal Gautam, Mark Jordans, and Adesewa Adelekun and gratefully acknowledge the support of the Nepal Health Research Council.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph19042149/s1, Table S1: Comparison of Depression Attitudes Questionnaire (DAQ) results between standard mhGAP training and RESHAPE; Table S2: Comparison of mhGAP attitudes questions between mhGAP training and RESHAPE.
Author Contributions
Conceptualization, A.B. and B.A.K.; methodology, A.B., B.N.K. and B.A.K.; formal analysis, A.B., D.G., B.N.K., C.L.C. and B.A.K.; investigation, S.R.; data curation, A.B., D.G. and S.R.; writing—original draft preparation, A.B. and B.A.K.; writing—review and editing, D.G., S.R., B.N.K., C.L.C., K.J.S., C.L. and N.P.L.; visualization, A.B. and B.A.K.; supervision, K.J.S., C.L. and N.P.L.; project administration, S.R., N.P.L. and B.A.K.; funding acquisition, K.J.S. and B.A.K. All authors have read and agreed to the published version of the manuscript.
Funding
RESHAPE is supported by the National Institute of Mental Health (K01MH104310, Principal Investigator: B. Kohrt). Anvita Bhardwaj was supported by training grant T32MH103210 from the National Institute of Mental Health. Bonnie Kaiser was supported by the National Institute of Mental Health of the National Institutes of Health under award number F32 MH113288. This document is an output from the PRIME Research Programme Consortium, funded by the UK Department of International Development (DFID) for the benefit of low- and middle-income countries.
Institutional Review Board Statement
The study was granted ethical approval by Duke University (Pro00055042), the Nepal Health Research Council (110/2014 and 133/2016), and George Washington University (051725). Trial registration: ClinicalTrials.gov identifier, NCT02793271.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study. All participants completed a signed consent form in Nepali.
Data Availability Statement
Data are available from the authors upon reasonable request.
Conflicts of Interest
The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Patel V., Chisholm D., Parikh R., Charlson F.J., Degenhardt L., Dua T., Ferrari A.J., Hyman S., Laxminarayan R., Levin C., et al. Addressing the burden of mental, neurological, and substance use disorders: Key messages from Disease Control Priorities, 3rd edition. Lancet. 2016;387:1672–1685. doi: 10.1016/S0140-6736(15)00390-6. [DOI] [PubMed] [Google Scholar]
- 2.Singla D.R., Kohrt B.A., Murray L.K., Anand A., Chorpita B.F., Patel V. Psychological treatments for the world: Lessons from low-and middle-income countries. Annu. Rev. Clin. Psychol. 2017;13:149–181. doi: 10.1146/annurev-clinpsy-032816-045217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.World Health Organization . mhGAP Training Manuals: For the mhGAP Intervention Guide for Mental, Neurological and Substance Use Disorders in Non-Specialized Health Settings–Version 2.0 (for Field Testing) World Health Organization (WHO/MSD/MER/17.6); Geneva, Switzerland: 2017. p. 656. [Google Scholar]
- 4.Ventevogel P. Integration of mental health into primary healthcare in low-income countries: Avoiding medicalization. Int. Rev. Psychiatry. 2014;26:669–679. doi: 10.3109/09540261.2014.966067. [DOI] [PubMed] [Google Scholar]
- 5.Ola B., Crabb J., Adewuya A., Olugbile F., Abosede O.A. The state of readiness of Lagos State Primary Health Care Physicians to embrace the care of depression in Nigeria. Community Ment. Health J. 2014;50:239–244. doi: 10.1007/s10597-013-9648-9. [DOI] [PubMed] [Google Scholar]
- 6.Adewuya A.O., Adewumi T., Ola B., Abosede O., Oyeneyin A., Fasawe A., Idris O. Primary health care workers’ knowledge and attitudes towards depression and its management in the MeHPric-P project, Lagos, Nigeria. Gen. Hosp. Psychiatry. 2017;47:1–6. doi: 10.1016/j.genhosppsych.2017.04.002. [DOI] [PubMed] [Google Scholar]
- 7.Kohrt B.A., Harper I. Navigating diagnoses: Understanding mind-body relations, mental health, and stigma in Nepal. Cult. Med. Psychiatry. 2008;32:462–491. doi: 10.1007/s11013-008-9110-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Ecks S. Eating Drugs: Psychopharmaceutical Pluralism in India. NYU Press; New York, NY, USA: 2013. [Google Scholar]
- 9.Spagnolo J., Champagne F., Leduc N., Melki W., Piat M., Laporta M., Bram N., Guesmi I., Charfi F. “We find what we look for, and we look for what we know”: Factors interacting with a mental health training program to influence its expected outcomes in Tunisia. BMC Public Health. 2018;18:1398. doi: 10.1186/s12889-018-6261-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Cuijpers P., Gentili C. Psychological treatments are as effective as pharmacotherapies in the treatment of adult depression: A summary from Randomized Clinical Trials and neuroscience evidence. Res. Psychother. Psychopathol. Process Outcome. 2017;20:273. doi: 10.4081/ripppo.2017.273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Kamenov K., Twomey C., Cabello M., Prina A.M., Ayuso-Mateos J.L. The efficacy of psychotherapy, pharmacotherapy and their combination on functioning and quality of life in depression: A meta-analysis. Psychol. Med. 2017;47:414–425. doi: 10.1017/S0033291716002774. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Iseselo M.K., Ambikile J.S. Medication challenges for patients with severe mental illness: Experience and views of patients, caregivers and mental health care workers in Dar es Salaam, Tanzania. Int. J. Ment. Health Syst. 2017;11:17. doi: 10.1186/s13033-017-0126-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Padmanathan P., Singh M., Mannarath S.C., Omar M., Raja S. A rapid appraisal of access to and utilisation of psychotropic medicines in Bihar, India. Int. J. Ment. Health Syst. 2014;8:29. doi: 10.1186/1752-4458-8-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Upadhaya N., Jordans M.J., Gurung D., Pokhrel R., Adhikari R.P., Komproe I.H. Psychotropic drugs in Nepal: Perceptions on use and supply chain management. Glob. Health. 2018;14:10. doi: 10.1186/s12992-018-0322-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Kola L., Kohrt B.A., Hanlon C., Naslund J.A., Sikander S., Balaji M., Benjet C., Cheung E.Y.L., Eaton J., Gonsalves P., et al. COVID-19 mental health impact and responses in low-income and middle-income countries: Reimagining global mental health. Lancet Psychiatry. 2021;8:535–550. doi: 10.1016/S2215-0366(21)00025-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.McHugh R.K., Whitton S.W., Peckham A.D., Welge J.A., Otto M.W. Patient preference for psychological vs. pharmacological treatment of psychiatric disorders: A meta-analytic review. J. Clin. Psychiatry. 2013;74:595. doi: 10.4088/JCP.12r07757. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Lake J., Helgason C., Sarris J. Integrative Mental Health (IMH): Paradigm, research, and clinical practice. Explore. 2012;8:50–57. doi: 10.1016/j.explore.2011.10.001. [DOI] [PubMed] [Google Scholar]
- 18.Pham T.V., Kaiser B.N., Koirala R., Maharjan S.M., Upadhaya N., Franz L., Kohrt B.A. Traditional Healers and Mental Health in Nepal: A Scoping Review. Cult. Med. Psychiatry. 2021;45:97–140. doi: 10.1007/s11013-020-09676-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Pham T.V., Koirala R., Kohrt B.A. Satisfaction in the Soul: Common Factors Theory Applied to Traditional Healers in Rural Nepal. Ethos. 2020;48:93–128. doi: 10.1111/etho.12263. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Pham T.V., Koirala R., Kohrt B.A. Traditional and biomedical care pathways for mental well-being in rural Nepal. Int. J. Ment. Health Syst. 2021;15:4. doi: 10.1186/s13033-020-00433-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Pham T.V., Koirala R., Wainberg M.L., Kohrt B.A. Reassessing the Mental Health Treatment Gap: What Happens if We Include the Impact of Traditional Healing on Mental Illness? Community Ment. Health J. 2021;57:777–791. doi: 10.1007/s10597-020-00705-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Kohrt B.A., Jordans M.J.D., Turner E.L., Sikkema K.J., Luitel N.P., Rai S., Singla D.R., Lamichhane J., Lund C., Patel V. Reducing stigma among healthcare providers to improve mental health services (RESHAPE): Protocol for a pilot cluster randomized controlled trial of a stigma reduction intervention for training primary healthcare workers in Nepal. Pilot Feasibility Stud. 2018;4:36. doi: 10.1186/s40814-018-0234-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Kohrt B.A. Social Neuroscience in Global Mental Health: Case Study on Stigma Reduction in Nepal. In: Kirmayer L.J., Worthman C.M., Kitayama S., Lemelson R., Cummings C.A., editors. Culture, Mind, and Brain: Emerging Concepts, Models, and Applications. Cambridge University Press; Cambridge, UK: 2020. pp. 440–451. [Google Scholar]
- 24.Kohrt B.A., Turner E.L., Rai S., Bhardwaj A., Sikkema K.J., Adelekun A., Dhakal M., Luitel N.P., Lund C., Patel V., et al. Reducing mental illness stigma in healthcare settings: Proof of concept for a social contact intervention to address what matters most for primary care providers. Soc. Sci. Med. 2020;250:112852. doi: 10.1016/j.socscimed.2020.112852. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Kohrt B.A., Ottman K., Panter-Brick C., Konner M., Patel V. Why we heal: The evolution of psychological healing and implications for global mental health. Clin. Psychol. Rev. 2020;82:101920. doi: 10.1016/j.cpr.2020.101920. [DOI] [PubMed] [Google Scholar]
- 26.Griffith J.L., Kohrt B.A. Managing Stigma Effectively: What Social Psychology and Social Neuroscience Can Teach Us. Acad. Psychiatry. 2016;40:339–347. doi: 10.1007/s40596-015-0391-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Kohrt B.A., Jordans M.J.D., Turner E.L., Rai S., Gurung D., Dhakal M., Bhardwaj A., Lamichhane J., Singla D.R., Lund C., et al. Collaboration with people with lived experience of mental illness to reduce stigma and improve primary care services in Nepal: A pilot cluster randomized clinical trial. JAMA Netw. Open. 2021;4:e2131475. doi: 10.1001/jamanetworkopen.2021.31475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Lund C., Tomlinson M., De Silva M., Fekadu A., Shidhaye R., Jordans M., Petersen I., Bhana A., Kigozi F., Prince M., et al. PRIME: A programme to reduce the treatment gap for mental disorders in five low- and middle-income countries. PLoS Med. 2012;9:e1001359. doi: 10.1371/journal.pmed.1001359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Jordans M.J.D., Luitel N.P., Kohrt B.A., Rathod S.D., Garman E.C., De Silva M., Komproe I.H., Patel V., Lund C. Community-, facility-, and individual-level outcomes of a district mental healthcare plan in a low-resource setting in Nepal: A population-based evaluation. PLoS Med. 2019;16:e1002748. doi: 10.1371/journal.pmed.1002748. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Jordans M.J., Luitel N.P., Pokhrel P., Patel V. Development and pilot testing of a mental healthcare plan in Nepal. Br. J. Psychiatry. 2016;208((Suppl. S56)):s21–s28. doi: 10.1192/bjp.bp.114.153718. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Jordans M.J., Luitel N.P., Garman E., Kohrt B.A., Rathod S.D., Shrestha P., Komproe I.H., Lund C., Patel V. Effectiveness of psychological treatments for depression and alcohol use disorder delivered by community-based counsellors: Two pragmatic randomised controlled trials within primary healthcare in Nepal. Br. J. Psychiatry. 2019;215:485–493. doi: 10.1192/bjp.2018.300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Rai S., Gurung D., Kaiser B.N., Sikkema K.J., Dhakal M., Bhardwaj A., Tergesen C., Kohrt B.A. A service user co-facilitated intervention to reduce mental illness stigma among primary healthcare workers: Utilizing perspectives of family members and caregivers. Fam. Syst. Health. 2018;36:198–209. doi: 10.1037/fsh0000338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Kaiser B.N., Varma S., Carpenter-Song E., Sareff R., Rai S., Kohrt B.A. Eliciting recovery narratives in global mental health: Benefits and potential harms in service user participation. Psychiatr. Rehabil. J. 2020;43:111–120. doi: 10.1037/prj0000384. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.QSR International . NVIVO Qualitative Data Analysis Software. 10th ed. QSR International Pty Ltd.; Doncaster, Australia: 2012. [Google Scholar]
- 35.MacQueen K.M., McLellan E., Kay K., Milstein B. Codebook development for team-based qualitative analysis. Cam J. 1998;10:31–36. doi: 10.1177/1525822X980100020301. [DOI] [Google Scholar]
- 36.Hennink M.M., Kaiser B.N., Marconi V.C. Code Saturation Versus Meaning Saturation. Qual. Health Res. 2017;27:591–608. doi: 10.1177/1049732316665344. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Botega N., Mann A., Blizard R., Wilkinson G. General practitioners and depression—First use of the Depression Attitude Questionnaire. Int. J. Methods Psychiatr. Res. 1992;2:169–180. [Google Scholar]
- 38.Lempp H., Abayneh S., Gurung D., Kola L., Abdulmalik J., Evans-Lacko S., Semrau M., Alem A., Thornicroft G., Hanlon C. Service user and caregiver involvement in mental health system strengthening in low-and middle-income countries: A cross-country qualitative study. Epidemiol. Psychiatr. Sci. 2018;27:29–39. doi: 10.1017/S2045796017000634. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Haddad M., Menchetti M., McKeown E., Tylee A., Mann A. The development and psychometric properties of a measure of clinicians’ attitudes to depression: The revised Depression Attitude Questionnaire (R-DAQ) BMC Psychiatry. 2015;15:7. doi: 10.1186/s12888-014-0381-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.James B.O., Jenkins R., Lawani A.O., Omoaregba J.O. Depression in primary care: The knowledge, attitudes and practice of general practitioners in Benin City, Nigeria. S. Afr. Fam. Pract. 2012;54:55–60. doi: 10.1080/20786204.2012.10874176. [DOI] [Google Scholar]
- 41.Koschorke M., Oexle N., Ouali U., Cherian A.V., Deepika V., Mendon G.B., Gurung D., Kondratova L., Muller M., Lanfredi M., et al. Perspectives of healthcare providers, service users, and family members about mental illness stigma in primary care settings: A multi-site qualitative study of seven countries in Africa, Asia, and Europe. PLoS ONE. 2021;16:e0258729. doi: 10.1371/journal.pone.0258729. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Patel V., Chowdhary N., Rahman A., Verdeli H. Improving access to psychological treatments: Lessons from developing countries. Behav. Res. Ther. 2011;49:523–528. doi: 10.1016/j.brat.2011.06.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Varma S. Where There are only Doctors: Counselors as Psychiatrists in Indian-Administered Kashmir. Ethos. 2012;40:517–535. doi: 10.1111/j.1548-1352.2012.01274.x. [DOI] [Google Scholar]
- 44.Gurung D., Upadhyaya N., Magar J., Giri N.P., Hanlon C., Jordans M.J. Service user and care giver involvement in mental health system strengthening in Nepal: A qualitative study on barriers and facilitating factors. Int. J. Ment. Health Syst. 2017;11:30. doi: 10.1186/s13033-017-0139-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Givens J.L., Katz I.R., Bellamy S., Holmes W.C. Stigma and the acceptability of depression treatments among African Americans and whites. J. Gen. Intern. Med. 2007;22:1292–1297. doi: 10.1007/s11606-007-0276-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Kohrt B.A., Hruschka D.J. Nepali concepts of psychological trauma: The role of idioms of distress, ethnopsychology and ethnophysiology in alleviating suffering and preventing stigma. Cult. Med. Psychiatry. 2010;34:322–352. doi: 10.1007/s11013-010-9170-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Jordans M.J., Keen A.S., Pradhan H., Tol W.A. Psychosocial counselling in Nepal: Perspectives of counsellors and beneficiaries. Int. J. Adv. Couns. 2007;29:57–68. doi: 10.1007/s10447-006-9028-z. [DOI] [Google Scholar]
- 48.Tergesen C.L., Gurung D., Dhungana S., Risal A., Basel P., Tamrakar D., Amatya A., Park L.P., Kohrt B.A. Impact of Service User Video Presentations on Explicit and Implicit Stigma toward Mental Illness among Medical Students in Nepal: A Randomized Controlled Trial. Int. J. Environ. Res. Public Health. 2021;18:2143. doi: 10.3390/ijerph18042143. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Gurung D., Poudyal A., Wang Y.L., Neupane M., Bhattarai K., Wahid S.S., Aryal S., Heim E., Gronholm P., Thornicroft G., et al. Stigma against mental health disorders in Nepal conceptualised with a ‘what matters most’ framework: A scoping review. Epidemiol. Psychiatr. Sci. 2022;31:e11. doi: 10.1017/S2045796021000809. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Kohrt B.A., Schafer A., Willhoite A., van’t Hof E., Pedersen G.A., Watts S., Ottman K., Carswell K., van Ommeren M. Ensuring Quality in Psychological Support (WHO EQUIP): Developing a competent global workforce. World Psychiatry. 2020;19:115–116. doi: 10.1002/wps.20704. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Watts S., Hall J., Pedersen G.A., Ottman K., Carswell K., Van’t Hof E., Kohrt B.A., Schafer A. The WHO EQUIP Foundational Helping Skills Trainer’s Curriculum. World Psychiatry. 2021;20:449–450. doi: 10.1002/wps.20880. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Kohrt B.A., Jordans M.J., Rai S., Shrestha P., Luitel N.P., Ramaiya M.K., Singla D.R., Patel V. Therapist competence in global mental health: Development of the ENhancing Assessment of Common Therapeutic factors (ENACT) rating scale. Behav. Res. Ther. 2015;69:11–21. doi: 10.1016/j.brat.2015.03.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Kohrt B.A., Mutamba B.B., Luitel N.P., Gwaikolo W., Onyango Mangen P., Nakku J., Rose K., Cooper J., Jordans M.J.D., Baingana F. How competent are non-specialists trained to integrate mental health services in primary care? Global health perspectives from Uganda, Liberia, and Nepal. Int. Rev. Psychiatry. 2018;30:182–198. doi: 10.1080/09540261.2019.1566116. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Data are available from the authors upon reasonable request.