Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Aug 11;17(8):e0272066. doi: 10.1371/journal.pone.0272066

Stakeholder perspectives on a patient-centred intervention (DIALOG+) for adolescents with common mental disorders in Colombia: A qualitative study

Carlos Gómez-Restrepo 1, Arturo Marroquín-Rivera 2, María Gabriela Calvo-Valderrama 2, Laura Ospina-Pinillos 3, Diliniya Stanislaus Sureshkumar 4, Victoria Jane Bird 4,*
Editor: Dylan A Mordaunt5
PMCID: PMC9371287  PMID: 35951610

Abstract

Background

Patient and stakeholders’ involvement in the development of mental health interventions is a central part of the research process as end-user’s input can improve the design of patient-centered interventions. This is particularly important when developing interventions directed towards improving the mental health of children and adolescents. The rising prevalence of mental health disorders in this population requires special attention and the development of interventions that include them as active participants is crucial.

Objective

Our aim is to explore the perspectives and opinions of adolescents, parents, educators/youth workers, and clinicians regarding the appeal and usability of an existing patient-centered digital intervention (DIALOG+), which aims to improve quality of life.

Methods

As part of a broader study aiming to adapt and test DIALOG+, we conducted Online Focus Groups (OFGs) with adults and adolescents in two cities in Colombia. The existing DIALOG+ intervention was introduced to participants, followed by a structured discussion regarding the opinions and views of stakeholders. A framework approach was used to identify the main themes followed by content analysis to aid adaptation.

Results

We conducted 10 OFGs with a total of 45 participants. A positive feature highlighted by all groups was the innovation of including a digital intervention in a traditional medical visit. Additionally, participants considered that the active role that adolescents have when using the intervention empowers them. Barriers identified included concerns from clinicians related to the time required during consultations and confusion with terminology. Furthermore, additional domains that are particularly relevant for the adolescent population were suggested.

Conclusions

Data obtained suggest that overall, the DIALOG+ intervention and supporting app are seen as innovative and appealing to adolescents as well as adult stakeholders. However, concerns raised about the availability of time to apply the intervention, the app interface and the language and terminology require modification.

Introduction

Mental health disorders are one of the leading causes of burden of disease worldwide and their prevalence is rising. In 2016, it was estimated that they affected more than 1 billion people and were responsible for 19% of all years lived with disability [1]. More concerning, is their impact on the youth; globally, it is estimated that approximately 10–20% of children and adolescents are affected by mental health disorders [2, 3]. This may be due to the intrinsic vulnerability of children and adolescents to mental health problems resulting from key biological, psychological and social changes that affect individuals during this period [4]. Despite their prevalence, the mental health needs of children and adolescents are often overlooked, particularly in Low and Middle-Income Countries (LMICs) [2].

Colombia is an upper middle-income country with a history of armed conflicts, forced internal displacement and violence that has significantly impacted the lives of its population [5]. Consequently, some attempts have been made to give special attention to the mental health needs of Colombian adolescents in recent years [6, 7], however the impact of this endeavor is poorly studied. According to the National Mental Health Survey (ENSM-2015) the prevalence of any mental health disorders in adolescents between 12 and 17 years old was 7.2%, with anxiety and affective disorders being the most frequent [8].

To help address the considerable impact of mental health disorders, different interventions have been developed which aim to improve a range of health outcomes. Patient involvement in the development of interventions has gradually gained importance in research and in clinical practice [9], especially due to evidence suggesting that patient-centered interventions may improve quality of life and enhance adherence to treatments [10, 11]. Although, most studies involve adult individuals, some studies suggest that patient-centered interventions in youth populations -allowing active involvement in the decisions of their health care- improve symptoms and provide greater overall satisfaction too [12, 13]. Shared decision-making may increase adolescent engagement because with this approach, the patient and clinician work together as a team and trust is improved [14]. Additionally, the use of technology can make interventions that are aimed at young people more appealing due to greater access and more engaging and interactive content. Furthermore, the use of certain mental health intervention applications (or apps) has been positively received by adolescents, carers and clinicians in some settings [15].

The aim of this study is to explore the views of adolescents, parents, teachers, and clinicians regarding an existing patient-centered digital intervention called DIALOG+, as well as our experience involving young people as an active part of our research. DIALOG+ is a patient-centered intervention mediated by an app that focuses on structuring communication between clinicians and patients, offering a solution-focused approach [10, 16, 17]. The use of this intervention has evidence of effectiveness in adults in the United Kingdom, where improved Subjective Quality of Life scores, psychopathological symptoms and social outcomes were evidenced at follow up [16, 18]. Some of the strengths that the DIALOG+ intervention offers, in addition to a straight forward interface, is the structured nature that it gives to a routine consultation as well as the focus that it gives to the patients self-reported needs. This, added to the positive experience with adult populations, makes it a strong intervention to test with a different patient group like adolescents and in a different context like Colombia.

The intervention assesses 11 key life topics or domains, eight life-related (mental health, physical health, job situation, accommodation, leisure activities, partner and family, friendships, personal safety) and three treatment-related, (medications, practical help, and meetings with mental health professionals). The clinician asks the patient to rate their satisfaction in each of these domains on a scale of 1 to 7, where 1 is ‘completely unsatisfied’ and 7 ‘completely satisfied’. Domains and their descriptions can be found in S1 Table in S1 File [18]. After each question, the patient is asked if they require any additional support in that particular area of their life. This gives the clinician valuable information on the priorities and/or preferences of the patient. Following a review of the 11 items, up to three are then jointly selected by the patient and clinician. A 4-step approach, based on the principles of solution-focused therapy is used to address the patient’s concerns and agree on further actions. with a four-step approach based on brief solution focused therapy used to address the patients concerns. The process allows the clinician to give tailored assignments that target specific domains that are in need of improvement, which are then discussed in future consultations.

This paper focuses on the initial impressions of the DIALOG+ intervention, as a new intervention to improve adolescent mental health in this context. Specifically, it will indicate which aspects of the intervention do and do not appeal to adolescent users and other stakeholders. Investigating stakeholders’ views on the initial appeal and acceptability of the intervention will assist with adaptation and implementation.

Methods

This qualitative study was conducted within the context of a larger project called “Building Resilience in Adolescence -improving quality of life for adolescents with mental health problems in Colombia” (BRiCs) which aims to improve outcomes for adolescents with depression and/or anxiety in Colombia. The project was a collaborative research project between Queen Mary University of London, UK and the Pontificia Universidad Javeriana (PUJ) in Bogotá.

In order to adapt this intervention to the Colombian adolescent population and their context, we conducted Online Focus Groups (OFGs). This allowed us to obtain the perspectives of users, key stakeholders and gatekeepers (parents/guardians, youth workers and educators) regarding the appeal and usability of the intervention.

The OFGs were conducted between June and November of 2020 and were initially planned to take place as traditional face-to-face focus groups. However, the sudden surge of the COVID-19 pandemic caused a state of emergency in Colombia in March 2020 and subsequent lockdown and physical distancing measures were imposed. In order to continue the research, an ethics amendment was requested to change the Focus Group (FG) methodology from face-to-face to synchronous OFGs through a videoconferencing platform (Microsoft teams®). Changes to the research protocol were approved by the Institutional Review Board (IRB) of both academic institutions and clinical settings (Protocol FM-CIE-0084-20).

Participants

Participants were recruited through a convenience sampling method from two clinical settings in Colombia: Bogotá (Colombia’s capital city) and Duitama (Intermediate city).

The inclusion criteria for adolescents were: i) aged between 13 and 16 years of age, ii) current or previous self-reported symptoms of depression and/or anxiety, iii) a willingness to share their experience in an OFG and iv) capacity to provide informed assent. Parents or guardians were included, if they provided care to an adolescent aged between 13 and 16 years-old with current or previous self-reported anxiety and/or depression and had the capacity to provide informed consent for their child to participate in the study. Finally, clinicians, educators, and youth workers were i) required to have experience working with adolescents experiencing depression and/or anxiety ii) be aged 18 years old or over. Once participants agreed to take part in the study, a sociodemographic questionnaire was sent to their e-mails and they were asked to complete it and send it to the study coordinator before the OFG session. The groups had between 3 to 7 participants and were scheduled for a duration of 120 minutes. Participants were reimbursed for their time with a $40.000 COP (approx. 12 USD) voucher.

Procedure

Before any data collection began, written signed informed consent was obtained. This included an electronic signature, as it was not possible to obtain ink signatures due to the COVID-19 pandemic. Where individuals were under 18, written informed assent from participants and their parents/guardians was obtained. Researchers made sure that participants understood that they could withdraw at any given moment of research without any consequences as well as ensuring the anonymity and security of data obtained. Once consent was obtained, the study coordinator sent two invitations for two different meetings. The first meeting included a trial run to check the participant’s internet connection and to confirm that all the participants were able to join the OFG and use the videoconferencing software without difficulties. Additionally, during this first trial meeting the coordinator explained further details of the project and solved logistic and participation queries. The second invitation was for the OFG session. For both invitations the time, date and agenda were included.

The sessions were facilitated by two of the teams’ principal investigators (psychiatrists and researchers LOP and CGR) and an anthropologist, all with extensive experience conducting FGs. Throughout the sessions, facilitators were aware of maintaining a moderate speech speed and avoided the use of technical or confusing terminology in order to propitiate familiarity and encourage participation.

The sessions included the following steps: 1) an introduction of the facilitator and of each participant with an explanation of the dynamics of the OFG 2) Verifying understanding of the informed consent 3) Introduction and description of the DIALOG+ intervention 4) Sharing the DIALOG+ app with participants, explaining its features and its aim 5) a structured discussion about the intervention and its content, clarity, usefulness, design and overall thoughts using a topic guide 5) a final summary. A general topic guide can be found in S1 File.

In general, after the introduction of DIALOG+, participants were asked their thoughts on their general impression of the app, including its appeal. This was followed by the main concerns relating to the mental health and wellbeing of adolescents, the relevance of the intervention domains for the adolescent population, the barriers and positive aspects of the app in a medical consultation and the design and layout. Questions on each session were designed to prompt both positive and negative feedback and if needed, further questions were asked in order to obtain additional details on a given opinion. Further details of our experience conducting OFGs is not in the scope of this paper and is discussed elsewhere [19].

Data collection and analysis

Participants were asked to complete a sociodemographic questionnaire, which included data on gender, age, and educational level for all the participants, prior diagnosis of anxiety and/or depression for the adolescents and years of work experience for the teachers and clinicians. Afterwards, the OFGs were transcribed verbatim and a framework approach was used to identify the main themes affecting the application design, usefulness and functionality. Content analysis was made following the guidelines of Braun and Clark [20]. Thus, a pairwise coding phase was made and afterwards a joint report was written by a social worker and an anthropologist with long experience in qualitative research.

Results

We conducted 10 OFGs with a total of 45 participants. Throughout all of the OFGs, the majority of participants (77% n = 35/45) were female. Details on the sociodemographic characteristics of participants can be seen in Table 1.

Table 1. Sociodemographic characteristics of participants.

Characteristic Adolescents
n = 13
Clinicians
n = 14
Guardians/Parents
n = 6
Educators/Youth workers
n = 12
Gender
Male 5 (38%) 2 (14%) 0 (0%) 3 (25%)
Female 8 (62%) 12 (86%) 6 (100%) 9 (75%)
Age 16 (15, 17) 38 (35, 40) 48 (43, 52) 38 (32, 43)
Work experience (years) - 10 (8, 14) - 14 (5, 18)
Work experience with adolescents (years) - 4.5 (3.0, 9.8) - 10.0 (7.2, 15.2)
Educational level
Primary school education (grades 1–5) 0 (0%) 0 (0%) 1 (17%) 0 (0%)
Middle school education (grades 6–9) 8 (62%) 0 (0%) 1 (17%) 0 (0%)
High-school education (grades 10–11) 5 (38%) 0 (0%) 2 (33%) 0 (0%)
College education 0 (0%) 3 (21%) 2 (33%) 5 (42%)
Specialization 0 (0%) 10 (71%) 0 (0%) 4 (33%)
Master/PhD 0 (0%) 1 (8%) 0 (0%) 3 (25%)
Mental health training
No - 9 (64%) - 6 (50%)
Yes - 5 (36%) - 6 (50%)
Mental health symptoms
Both 4 (31%) - - -
Anxiety 4 (31%) - - -
Depression 1 (7%) - - -
Neither 4 (31%) - - -

Count (percentage) for categorical variables and median (Interquartile range) for numeric variables.

A total of 13 adolescents participated, the mean age of this group was 16 years old and the majority were enrolled in middle school at the time. Mental health problems, in particular anxiety and depression, were investigated in the adolescent population. The majority of participants reported having experienced mental health disorders: 4 reported having both disorders, 4 reported having only anxiety and 4 having neither. Depression without anxiety was only reported by one participant.

Information was collected on the time (in years) of working with adolescents for clinicians and educators/youth workers. Educators/youth workers had more experience (MED = 10, IQR = 7.2, 15.2), working with adolescents than clinicians. Clinicians had the highest educational level.

The parents/guardian’s group had the highest mean age and the lowest educational level, with only 2 participants with college education.

In order to assess the initial impressions of the intervention, we divided participants views into positive features or appeal (strengths and benefits of DIALOG+) and potential barriers. In the latter, the views of participants on four different categories (privacy and patient-physician relationship, time and connectivity, interface and terminology and additional categories) are shared.

Positive features

Innovation and empowerment

Considering that the use of digital interventions such as DIALOG+ is not common in the Colombian context, we found that the implementation of new technologies in a medical setting was seen as innovative. The incorporation of an app was particularly engaging for our target population.

I also feel it is useful and it is very different, like, the use of an application like this during a consultation can be very innovative.”

(Adolescent Bogotá)

All groups agreed that the app allows the discussion of topics that can often be overlooked during a traditional medical consultation. Interaction between patients and clinicians often focuses on physical conditions and exploration of particular aspects of mental health can be neglected. The structured nature of the app was perceived as useful in order to explore these aspects in a direct and detailed manner. Clinicians highlighted that in addition to the order and structure that the intervention might add to the consultation, it may allow them to identify and address specific problems.

I thought it was very complete, very interesting, yes, well, generally they never ask you, like the problems you may have or how you are…”

(Adolescent Duitama)

“(…) Sometimes during a consultation, we don’t have the time to delve into more specific questions about their mental health and we focus on the clinical part of their health, but any individual, particularly a young person has to be evaluated in all aspects…”

(Clinician Duitama)

Feelings and emotions can be difficult to identify and verbalize, particularly for adolescents [21]. The approach with key life topics that are explored in the intervention was considered by adolescents as a helpful tool in order to recognize and communicate emotions and difficult situations that they may be going through.

“(…) it can let you recognize the things that you are feeling, because sometimes you have them there, but you don’t know what is happening and you can’t talk about them and they keep happening but you don’t identify them…”

(Adolescent Bogotá)

It was considered that the recognition of emotions and deciding over which domains they require additional support, gives adolescents autonomy and allows them to play an active role during their therapeutic process.

From the psychologic perspective, it is very interesting to see this tool because it will help [you] identify punctual issues (…) it gives the teenager an opportunity of being active in the consultation by expressing what they feel and what they want to improve

(clinician Duitama)

“[..] I think it is an attractive alternative, besides it encourages them because I think that through each consultation, they can see in what they have improved […] I think it motivates them, it is striking and can give them concise incentives, normally young people like to challenge themselves.”

Parent/guardian Bogotá

App navigation

In terms of the app interface, all participants agreed that the navigation of the app was easy and intuitive. Moving between screens to rate the different domains and tasks assigned was considered straight-forward. Additionally, the rating scale was perceived as uncomplicated and clear. Participants agreed that these characteristics of navigation should be maintained because they make the app accessible and direct.

I think that navigating the app is easy and it is simple enough for someone who is not very familiar with technology—like me- to understand.”

(Teacher Duitama)

Barriers

Privacy and patient-physician relationship

Both, adolescents and clinicians expressed a concern around privacy during the consultations, as the presence of parents or guardians could prevent adolescents from discussing certain sensitive issues that they might not want their parent/guardian to know about. This was considered important since mental health issues are sensitive and patients need to be comfortable in order to discuss them openly.

Teachers mentioned that this situation may be more of a concern for older teenagers and highlighted that even if parents attend their medical consultations, if the adolescent requests it parents can wait in the waiting room.

Furthermore, adolescents highlighted the importance of building trust with their clinician in order to share sensitive information about their mental health openly and willingly. Most agreed that the discussion of these topics alone enhances trust in the patient-physician relationship, but this process requires time.

Another aspect mentioned, was that the way the intervention is used can change the hierarchical nature of the patient-physician interaction. Some adolescents suggested that they would feel more comfortable using the app by themselves and not having the physician ask the questions, or suggested that the clinician sat beside them and not in front of them while answering the questions.

The consultation might be initially uncomfortable, I don’t know, well, I think, I have never used anything similar but doing this type of activity requires building some trust and I think the app allows that. (…) I would have many questions and the doctor has to be there to answer them but maybe not having him directly looking because that can put a lot of pressure on the patient, but having him close…”

(Adolescent Bogotá)

Time and connectivity

For clinicians a main concern was time. Since standard consultation time in Colombia is around 20 minutes, they considered that it would be insufficient and could become an impeding factor to correctly apply the intervention during a routine session.

Furthermore, technical issues like availability of devices (tablets, smartphones or computers) and a stable internet connection in health centers, particularly rural settings, were mentioned as major barriers for the broad application of the intervention.

Interface

Participants across every OFGs agreed that increasing the interactivity of the app would make it more suitable for the adolescent population as they described it as dull and serious. Suggestions such as allowing personalization of the app according to the age of the participant, including vibrant colors and adding images for each key life topic were given.

I think that the graphic interface, like the aesthetics, are a bit dull (…) I think in a way It doesn’t make you feel comfortable, to put it someway I think it is kind of cold, distant (…).”

(Adolescent Duitama)

Clinicians considered that incorporating reminders or incentives with an image or animation when a task was completed could be appropriate.

Terminology and changes to current categories

The language and terminology of the app were considered confusing in certain key life topics particularly for adolescents.

The topic “practical help” was confusing for participants with the majority not knowing what it aimed to ask. The Spanish translation for the category “personal safety” was interpreted as personal confidence, instead of the risk of harm they perceive.

Additionally, educators felt that the use of the term “tasks” or “homework” for the actions included for areas where the adolescent indicated they would like more support, was negative and may demotivate young people. Instead, they suggested for it to be changed to a friendlier term like “goals”.

Finally, the “mental health” category was considered too wide. Instead, adolescents felt it would be good to have more direct questions asked on this subject to help them give an accurate answer.

Perhaps if the questions were more direct in the mental health [category], for example if you are asked “how are you feeling? Have you felt anxious? Concretely (…) then it would be easier to answer in the numerical scale, because mental health can go from addictions, to how I woke up feeling in the morning. So, if questions were more direct, they would be easier to answer

(Adolescent Bogotá)

Since DIALOG+ intervention was developed for use in the adult population, we expected to include additional categories or modify already existing ones in order to make it more appropriate for our target population. With this in mind, the following modifications were suggested:

Initially, since adolescence is a period where the exploration of sexuality and romantic love begins, all participants agreed that separating the category partner/family into two different ones would be ideal. Therefore, the category “partner” would include the discussion of this sensitive topic. Since older adolescents are more likely to have familiarity with this stage, adolescents suggested adding a N/A (not-applicable) answer to the numeric scale. This was considered important not only for categories that may not apply to younger adolescents but in order to give them an option if the adolescent is uncomfortable providing an answer to any particular question.

Throughout the focus groups participants agreed that “job situation” should be changed to “school/academic situation” given that this would be more appropriate for our target population. This subject is viewed as a key aspect in the life of adolescents and that it should be focused on school life in general, such as, academic subjects (grades, teachers), peer relationships and extracurricular activities.

This category should be based on the social aspect, the grades aspect (…) well, because I believe that this two are very influential in the emotions of us adolescents (…).”

(Adolescent Bogotá)

However, participants considered that “job situation” should be maintained as a key topic in the intervention. The latter, as well as the topic “housing” were viewed as aspects related to the economic situation of parents or caretakers, and clinicians and guardians highlighted the large impact that these two categories have in the life and stability of any adolescent.

I think that they [adolescents] are very perceptive to the situation of their family, even if it seems that they are not listening, they are very aware of what is discussed at their homes. Like, for example the lack of a job, items that can`t be afforded (…) I think that even though it is something they don’t express much, they perceive it very well.”

(Clinician Duitama)

Two categories -practical help and medications- were viewed as important to maintain, particularly for adolescents who may have a chronic condition or disability. However, clinicians and parents/guardians suggested grouping them under a category of “professional accompaniment”.

Additional categories

Adding five additional key life topics targeted particularly to the adolescent population was suggested by educators, clinicians and guardians. The first one was a “body image” category, where the adolescent’s self-perception and the impacts of body image and beauty standards of society in their life can be discussed.

The second one was “life project” where adolescents can discuss what their future achievements and goals are. It was established that this one should be aimed particularly at older adolescents and clinicians emphasized how the prospect of a career and life after school are stressful elements that impact the mental health of this population.

An additional category where the clinician can explore the adolescent`s experiences with psychoactive drugs was suggested. However, it was pointed out that discussion of this matter on an initial consultation can make the adolescent apprehensive, particularly if a parent/guardian is in attendance.

We are currently seeing that adolescents are having contact with different substances at an earlier age more frequently: marihuana, cigar, liquor (…) we see ten- or eleven-year-old kids that have already had contact with these substances. The consumption of these substances has been normalized.”

(Teacher Duitama)

“(…) I don’t agree with adding this category because it is not a subject that you can easily discuss on a first visit with an adolescent. I mean, if a kid is consuming and you ask him bluntly, he will say that he doesn’t consume, he will get annoyed and won’t come back (…) It could generate barriers, I think it is better that this comes up during the process with the adolescent

(Teacher Bogotá)

A category that focuses on religion and spirituality was discussed by clinicians, since they considered that the way adolescents relate to these aspects could in some cases be a protective factor.

Finally, it was suggested that a topic where the use of social networks, video games and internet can be directly assessed could be beneficial. Given that these technological tools have shaped the way we socialize it was considered as an influential factor for adolescents.

Discussion

The feedback obtained with the OFGs suggest that overall, the intervention and app are seen as acceptable, innovative and have appeal to adolescents as well as adult stakeholders. However, concerns were raised about the availability of time to apply the intervention during a standard consultation, the app interface and the language and terminology used. Additionally, new categories that were considered important to adolescents, such as, school environment and academic performance were suggested.

In line with international organizations, such as, the World Health Organization (WHO) and previous research, this study demonstrates the importance of engaging end-users in the adaptation and development of digital mental health interventions [22]. Overall, the implementation of a patient-centered digital intervention was well received by adolescents, clinicians and stakeholders alike, which is consistent with findings from other studies [2326]. The incorporation of technology during consultation is particularly appealing to young people who are more likely to be familiar with digital devices and the internet in general [27].

Consistent with the most recent Lancet Commission digital technologies [28], this paper supports the importance of digital health in increasing the access to evidence-based interventions specially in a LMIC setting. In order to make digital interventions widely available in these contexts, it is important to test the use of tools that are already available in different settings and for different age groups. Additionally, in order to make digital interventions relevant a participative process is needed where end users could express their ideas, needs and requirements [26].

The structured nature of DIALOG+ was considered useful by adolescents because it gave them an opportunity to recognize emotions and feelings in an easier way. Also, clinicians felt that they could identify problems in a direct manner with the benefit of knowing the main concerns and priorities of their patients. A key element that is mentioned in the literature regarding technology-mediated interventions in general, is their ability to empower patients by giving them an active role in their mental health, which also makes them more likely to engage in the process [2931]. Participants considered that DIALOG+ also offered this empowering characteristic because it allows them to express their feelings and what they want to improve.

As expected, however, there are several aspects of the DIALOG+ app and intervention that can be improved and tailored to be more suitable for the adolescent population.

Firstly, the app was considered slightly cold and serious. In order to increase user friendliness and engagement on any app, an appropriate interface and use of language are crucial [9, 21]. Participants suggested modifications that would increase interactivity, such as adding images or symbols to each key life topic, personalization of the app according to age and making it more vibrant and colourful. All of these have been commonly used in other mental health apps [32].

Regarding terminology and language used, participants suggested different modifications. These were considered necessary to clarify the life domains and to avoid misunderstandings. A brief description of what each category is aiming to ask, could be added as a “pop-up” to minimize confusion as suggested by some clinicians. Specifically, we consider that the Spanish translation of “personal safety” could be modified to “environmental safety” (seguridad en el entorno) since most participants were confused by its meaning. This modification makes the objective of the category clearer, both for the clinician and the adolescent. Similarly, all participants were especially confused by the category “Practical help”. The latter aims to inquire about the resources available to support the patient (government aids, requirement of wheelchair/equipment or any other assistances) [18], but in Colombia these are scarce which makes the category confusing. Therefore, we consider that a modification to “external aids” (ayudas externas) could be helpful.

A specific modification discussed by adolescents in our OFGs, was to include a “not-applicable” response to the 1 to 7 grading scale system. This was considered important for categories that may not apply to some adolescents due to their age and for categories where the adolescent does not wish to provide an answer. According to them, a clear option that allows the adolescent to avoid answering any category or question is crucial to recognize their autonomy [14, 29]. Adolescents also underscored the central role of clinicians in making them feel at ease sharing their experiences without feeling judged or lectured. Thus, the confidence in the use of the intervention as well as the clinician’s ability to convey trust and comfort is vital.

To apply the DIALOG+ intervention in an efficient but thorough manner, clinicians must be familiar with the app so that they feel at ease using it. However, even if clinicians agreed on the importance of thoroughly knowing the app and all its functions, the time availability to apply the intervention was considered a major barrier for uptake. In the Colombian context medical visits are usually limited to 20 minutes, this was considered insufficient to perform a traditional consult and the DIALOG+ intervention. The discussion of sensitive topics related to mental health is time consuming and addressing them in a fast-paced manner would be counterproductive, particularly for adolescent populations, where the aim is to create trust and improve health outcomes.

The addition and modification of the existing domains may be relevant to adapt the DIALOG+ intervention to the needs of Colombian adolescents. Two main modifications stood out, 1) dividing the “partner/family” domain into two separate ones and, 2) including a school and academic life domain. Both were considered essential by all participants since they relate to key aspects that are particular to the mental health of adolescents. The first one was considered given that adolescence is generally the initial period of sexual exploration and it has been reported that the discussion of sexuality between physicians and adolescents is generally insufficient or lacking [33].

Despite the consensus that for adolescents the domains “Job situation” and “Housing” were strongly related to their parents or guardian’s socio-economic status, most of the participants considered that these aspects frequently affect the well-being of any adolescent and thus should remain on the app. It is important to notice that these two domains may have gained relevance after the onset of the COVID-19 pandemic, because of the impact on household income in general and how it has increased poverty and inequality in Colombia [34].

Since pharmacological treatment is seldom used for adolescents with depression and/or anxiety and limited to severe cases where psychosocial interventions were unsuccessful [35], treatment-related categories such as, “practical help” and “medication” would predominantly apply to adolescents with chronic diseases or physical disabilities. We believe that these categories are important to keep, to promote inclusion of a marginalized group, even if these conditions are not highly prevalent during adolescence [36]. These two categories could be grouped under a category of “professional accompaniment” as suggested by participants.

Other aspects of adolescent life were suggested as individual domains. However, some of them can be examined on the already existing domains. For example, the discussion on career projects or future plans that older adolescents experience could be addressed under the domain that includes their academic or school life. Also, aspects regarding the “body image” category and beauty standards, could be included under the “physical health” domain, where questions on body image and self-perception are asked. Finally, the use of social networks and internet as well as the use of substances could be explored when the “friendships” domain is evaluated.

Ultimately, the data obtained provided valuable insight into the areas of DIALOG+ that are susceptible to modification in order to correctly adapt this intervention to the context of Colombian adolescents. Perhaps in the long run the DIALOG intervention could become routinely used in the clinical practice as part of the mental health evaluation of the Colombian youth in order to improve their outcomes, and our experience may facilitate its adaptation into other LMIC countries.

Barriers to the implementation of this type of interventions have to be taken into account since these are often shared by LMIC such as a lack of digital literacy, limited connectivity and access to technology, and availability of time during a consultation in order to properly apply this intervention.

Limitations

Performing OFG due to the physical distancing required by the COVID-19 pandemic meant that participants not only had to have access to a digital device, but also have a high enough level of computer literacy with a stable internet connection. These characteristics are not predominant in a LMIC like Colombia. Additionally, OFGs were performed with participants from two urban areas of Colombia. Therefore, these findings may not be representative of adolescents, clinicians and stakeholders from rural settings.

Conclusions

Overall, the use of a technology-based intervention was perceived in a positive manner by all participants, and they considered that it might enhance the relationship between physicians and adolescents in the context of primary health care in Colombia. Modifications of language in order to clarify the objective of the intervention and to assess the adolescent’s reality in a more accurate way should be considered. Additionally, making the interface more interactive can make the intervention more approachable and less intimidating to the adolescent. The limitations of time during consultations are a major issue that have to be taken into account as well as the parent or guardian presence during the session.

Supporting information

S1 File

(DOCX)

Data Availability

Data cannot be shared publicly because of confidentiality issues as the raw data are verbatim transcripts, as per the requirements of comíté de Investigaciones y Ética Institucional, Facultad de Medicina, Pontificia Universidad Javeriana. Data are available on request from the chair of the International Steering Committee (Professor Domenico Giacco) to researchers who meet the criteria for access to confidential data. As the dataset relates to interviews transcribed verbatim anyone wishing to access the original qualitative dataset, is required to contact the International Steering Committee chair (domenico.giacco@warwick.ac.uk). A formal written request outlining the nature of the project is required. Permission to utilise the data would then be sought from the other members of the study’s independent advisory board, who provide oversight on all ethical issues relating to the study and liaise directly with the relevant ethical committees.

Funding Statement

All authors are supported by the Medical Research Council (grant number: MR/S023674/1) Building resilience in adolescence - improving quality of life for adolescents with mental health problems in Colombia (BRiCs study). https://mrc.ukri.org/ The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Rehm J, Shield KD. Global Burden of Disease and the Impact of Mental and Addictive Disorders. Curr Psychiatry Rep Current Psychiatry Reports; 2019;21(2):1–7. doi: 10.1007/s11920-019-0997-0 [DOI] [PubMed] [Google Scholar]
  • 2.Kieling C, Baker-Henningham H, Belfer M, Conti G, Ertem I, Omigbodun O, et al. Child and adolescent mental health worldwide: Evidence for action. Lancet [Internet] Elsevier Ltd; 2011;378(9801):1515–1525. doi: 10.1016/S0140-6736(11)60827-1 [DOI] [PubMed] [Google Scholar]
  • 3.Grist R, Croker A, Denne M, Stallard P. Technology Delivered Interventions for Depression and Anxiety in Children and Adolescents: A Systematic Review and Meta-analysis. Clin Child Fam Psychol Rev [Internet] Springer US; 2019;22(2):147–171. doi: 10.1007/s10567-018-0271-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Bilsen J. Suicide and Youth: Risk Factors. Front Psychiatry 2018;9(October):1–5. doi: 10.3389/fpsyt.2018.00540 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Guerrero R. Is Colombia a violent country? Colomb medica (Cali, Colomb) 2017;48(2):101. [PMC free article] [PubMed] [Google Scholar]
  • 6.MinSalud. Dimensión convivencia social y salud mental. Plan decenal Salud Pública 2012–2021 [Internet] 2013;3. https://www.minsalud.gov.co/plandecenal/Paginas/home2013.aspx%5Cnhttps://www.minsalud.gov.co/plandecenal/Paginas/dimension-convivencia-social.aspx
  • 7.Marroquín Rivera A, Rincón Rodríguez CJ, Padilla-Munõz A, Gómez-Restrepo C. Mental health in adolescents displaced by the armed conflict: Findings from the Colombian national mental health survey. Child Adolesc Psychiatry Ment Health [Internet] BioMed Central; 2020;14(1):1–8. doi: 10.1186/s13034-020-00327-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Gómez-Restrepo C, Bohórquez A, Tamayo Martínez N, Rondón M, Bautista N, Rengifo H, et al. Trastornos depresivos y de ansiedad y factores asociados en la población de adolescentes colombianos, Encuesta Nacional de Salud Mental 2015. Rev Colomb Psiquiatr [Internet] Asociación Colombiana de Psiquiatría; 2016;45(S 1):50–57. doi: 10.1016/j.rcp.2016.09.009 [DOI] [PubMed] [Google Scholar]
  • 9.Edridge C, Edbrooke-Childs J, Martin K, Delane L, Averill P, Feltham A, et al. Power Up: Patient and public involvement in developing a shared decision-making app for mental health. J Heal Des 2018;3(1):63–74. doi: 10.21853/jhd.2018.40 [DOI] [Google Scholar]
  • 10.Priebe S, Kelley L, Omer S, Golden E, Walsh S, Khanom H, et al. The Effectiveness of a Patient-Centred Assessment with a Solution-Focused Approach (DIALOG+) for Patients with Psychosis: A Pragmatic Cluster-Randomised Controlled Trial in Community Care. Psychother Psychosom 2015;84(5):304–313. doi: 10.1159/000430991 [DOI] [PubMed] [Google Scholar]
  • 11.Lindhiem O, Bennett C, Dana R, Silk J. Mobile Technology Boosts the Effectiveness of Psychotherapy and Behavioral Interventions: A Meta-analysis. Behav Mo 2015;39(6):785–804. doi: 10.1177/0145445515595198 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Richardson L, McCauley E, Katon W. Collaborative care for adolescent depression: a pilot study. Gen Hosp Psychiatry [Internet] Elsevier Inc.; 2009;31(1):36–45. doi: 10.1016/j.genhosppsych.2008.09.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Abrines-Jaume N, Midgley N, Hopkins K, Hoffman J, Martin K, Law D, et al. A qualitative analysis of implementing shared decision making in Child and Adolescent Mental Health Services in the United Kingdom: Stages and facilitators. Clin Child Psychol Psychiatry 2016;21(1):19–31. doi: 10.1177/1359104514547596 [DOI] [PubMed] [Google Scholar]
  • 14.Bjønness S, Grønnestad T, Storm M. I’m not a diagnosis: Adolescents’ perspectives on user participation and shared decision-making in mental healthcare. Scand J Child Adolesc Psychiatry Psychol 2020;8:139–148. doi: 10.21307/sjcapp-2020-014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Simons L, Valentine AZ, Falconer CJ, Groom M, Daley D, Craven MP, et al. Developing mhealth remote monitoring technology for attention deficit hyperactivity disorder: A qualitative study eliciting user priorities and needs. JMIR mHealth uHealth 2016;4(1). doi: 10.2196/mhealth.5009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Priebe S, Golden E, Kingdon D, Omer S, Walsh S, Katevas K, et al. Effective patient–clinician interaction to improve treatment outcomes for patients with psychosis: a mixed-methods design. Program Grants Appl Res 2017;5(6):1–160. doi: 10.3310/pgfar05060 [DOI] [PubMed] [Google Scholar]
  • 17.Priebe S, Kelley L, Golden E, McCrone P, Kingdon D, Rutterford C, et al. Effectiveness of structured patient-clinician communication with a solution focused approach (DIALOG+) in community treatment of patients with psychosis—a cluster randomised controlled trial. BMC Psychiatry 2013;13:1–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Stefan Priebe, Eoin Golden, Kleomenis Katevas, Pat Healey R, McCabe. Implementation of an effective and cost-effective intervention for patients with psychotic disorders in low and middle income countries in South Eastern Europe | IMPULSE Project. 2019;1–35. https://cordis.europa.eu/project/id/779334
  • 19.Calvo-valderrama MG, Marroquín-rivera A, Burn E, Bird V, Gómez-restrepo C. Online synchronous Focus Groups and research continuity during the COVID-19 pandemic. JMIR Prepr [Internet] 2021; https://preprints.jmir.org/preprint/30293 [DOI] [PMC free article] [PubMed]
  • 20.Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3(2):77–101. doi: 10.1191/1478088706qp063oa [DOI] [Google Scholar]
  • 21.Garrido S, Cheers D, Boydell K, Nguyen QV, Schubert E, Dunne L, et al. Young people’s response to six smartphone apps for anxiety and depression: Focus group study. JMIR Ment Heal 2019;6(10). doi: 10.2196/14385 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Novillo-Ortiz D. Framework for the Implementation of a Telemedicine Service [Internet]. Pan Am Organ World Heal Organ. 2016. http://iris.paho.org/xmlui/bitstream/handle/123456789/28414/9789275119037_eng.pdf?sequence=5ISBN:9789275319031
  • 23.Montague AE, Varcin KJ, Simmons MB, Parker AG. Putting Technology Into Youth Mental Health Practice: Young People’s Perspectives. SAGE Open 2015;5(2). [Google Scholar]
  • 24.Holtz BE, Murray KM, Hershey DD, Dunneback JK, Cotten SR, Holmstrom AJ, et al. Developing a patient-centered mhealth app: A tool for adolescents with type 1 diabetes and their parents. JMIR mHealth uHealth 2017;5(4):1–11. doi: 10.2196/mhealth.6654 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Grist R, Porter J, Stallard P. Mental health mobile apps for preadolescents and adolescents: A systematic review. J Med Internet Res 2017;19(5). doi: 10.2196/jmir.7332 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Ospina-Pinillos L, Davenport TA, Navarro-Mancilla AA, Cheng VWS, Alarcón ACC, Rangel AM, et al. Involving end users in adapting a Spanish version of a web-based mental health clinic for young people in Colombia: Exploratory study using participatory design methodologies. JMIR Ment Heal 2020;7(2). doi: 10.2196/15914 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Kenny R, Dooley B, Fitzgerald A. Feasibility of “CopeSmart”: A Telemental Health App for Adolescents. JMIR Ment Heal 2015;2(3):e22. doi: 10.2196/mental.4370 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Patel V, Saxena S, Lund C, Thornicroft G, Baingana F, Bolton P, et al. The Lancet Commission on global mental health and sustainable development. Lancet 2018;392(10157):1553–1598. doi: 10.1016/S0140-6736(18)31612-X [DOI] [PubMed] [Google Scholar]
  • 29.Wisdom JP, Clarke GN, Green CA. What teens want: Barriers to seeking care for depression. Adm Policy Ment Heal Ment Heal Serv Res 2006;33(2):133–145. doi: 10.1007/s10488-006-0036-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Kennard BD, Goldstein T, Foxwell AA, McMakin DL, Wolfe K, Biernesser C, et al. As safe as possible (ASAP): A brief app-supported inpatient intervention to prevent postdischarge suicidal behavior in Hospitalized, Suicidal Adolescents. Am J Psychiatry 2018;175(9):864–872. doi: 10.1176/appi.ajp.2018.17101151 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Hollis C, Falconer CJ, Martin JL, Whittington C, Stockton S, Glazebrook C, et al. Annual Research Review: Digital health interventions for children and young people with mental health problems–a systematic and meta-review. J Child Psychol Psychiatry Allied Discip 2017;58(4):474–503. doi: 10.1111/jcpp.12663 [DOI] [PubMed] [Google Scholar]
  • 32.Edbrooke-Childs J, Edridge C, Averill P, Delane L, Hollis C, Craven MP, et al. A feasibility trial of power up: Smartphone app to support patient activation and shared decision making for mental health in young people. JMIR mHealth uHealth 2019;7(6):1–15. doi: 10.2196/11677 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Stewart A, Fortenberry D, Pollak K, Bravender T. Sexuality Talk During Adolescent Health Maintenance Visits Stewart. JAMA Pediatr 2014;168(2):163–169. doi: 10.1001/jamapediatrics.2013.4338 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Corredor F, Ríos P, Rodríguez D. The effect of COVID-19 and emergency policies on Colombian households ‘ income. Doc Trab Univ Extern Colomb 2021;(67). [Google Scholar]
  • 35.Vitiello B, Ordóñez AE. Pharmacological treatment of children and adolescents with depression. Expert Opin Pharmacother [Internet] Taylor & Francis; 2016;17(17):2273–2279. doi: 10.1080/14656566.2016.1244530 [DOI] [PubMed] [Google Scholar]
  • 36.Yeo Michele S S. ABC of adolescence: Chronic Illness and Disability. BMJ 2005;330:721–723. doi: 10.1136/bmj.330.7493.721 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Dylan A Mordaunt

25 Apr 2022

PONE-D-22-04627Stakeholder perspectives on a patient-centred intervention (DIALOG+) for improving the mental health of adolescents in Colombia: a qualitative studyPLOS ONE

Dear Dr. Bird,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. My comments are detailed below.

Please submit your revised manuscript by Jun 09 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Dylan A Mordaunt

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Acknowledgments Section of your manuscript:

“This work is supported by the Medical Research Council (grant number: MR/S023674/1) Building resilience in adolescence - improving quality of life for adolescents with mental health problems in Colombia (BRiCs study).”

We note that you have provided additional information within the Acknowledgements Section that is not currently declared in your Funding Statement. Please note that funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

“All authors are supported by the Medical Research Council (grant number: MR/S023674/1) Building resilience in adolescence - improving quality of life for adolescents with mental health problems in Colombia (BRiCs study).

https://mrc.ukri.org/

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

4. We note you have included a table to which you do not refer in the text of your manuscript. Please ensure that you refer to Table 1 in your text; if accepted, production will need this reference to link the reader to the Table.

5. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Thank you for your submission. We have received input from two reviewers. The authors should address all comments by both reviewers. Reviewer 1 has recommended rejection on the basis of a small sample size and lack of statistical analysis. My take on the methods (methodology and epistemology are not described) is that the method is primarily focused on coding to saturation, resulting extraction of themes and using exceprts to illustrate those themes. Synthesis of this data is therefore narrative on the background of the coding. There are quantitative methods that could be applied (e.g. word counts, bag of words, text mining etc) but my take is that this wouldn't be warranted and the question of resulting validity may sit best in the post-publication sphere given the criteria for publication for PLoS One. Ultimately I think the authors should address this their response as to what the epistemology, methodology and rationale for not including statistical analyses are. It's a useful assertion by the reviewer and the authors may add impact to their clinical and policymaker audience by addressing this area of methods.

With specific regards to the criteria for publication:

1. The study presents the results of original research.

2. Results reported have not been published elsewhere.

3. Experiments, statistics, and other analyses are performed to a reasonable technical standard- the main area that needs to be addressed in resubmission is this, as described by both reviewers and expanded on by myself.

4. Conclusions are presented in an appropriate fashion and are supported by the data.

5. The article is presented in an intelligible fashion and is written in standard English.

6. The research meets all applicable standards for the ethics of experimentation and research integrity.

7. The authors should consider whether the article type fits with an Equator checklist such as SRQR or COREQ (qualitative research checklists) and if so, check adherence to these checklists and attach the resulting file as a supplementary file. IF ethics allows, the authors should also consider attaching the transcripts and coding, or even an attachment that includes some of the quotes/data they decided not to include in their text given the value that this may add and that the PLoS format allows for this.

I look forward to receiving your resubmission.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: No

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a survey tested DIALOG+ on online focus groups with adults and adolescents (13-16 yo) with current or past depression or anxiety. Although both shared decision-making and internet-based approach are important and timely, the study has substantial concerns.

First, the participants are heterogeneous and the sample size is small.

As the authors wrote, this is a narrative study without any statistical approach. Thus, the sample size is not calculated. However, the sample sizes for each group (n=6~14) are too small to conclude anything. Besides, they have a current or past history of depression or anxiety. Some of them are currently medicated and others are not. This is a too heterogeneous dataset to be published.

Second, this study relies on self-report on anxiety or depression. And the authors conducted only a narrative approach. Where is objectivity? Which piece of information supports the author's conclusions??

Third, as the authors mentioned, this is a qualitative study. There are some possible ways to statistically analyze this kind of dataset. For example, if you structured the OFGs, you can conduct text mining. Why did the authors eschew statistical analyses?

Reviewer #2: I find the paper relevant and adds value to the technology mediated mental health interventions. The authors’ attempt to use multi-stakeholder approach to understand the feasibility, acceptability and suitability of the DIALOG+ interventions in Colombia is appreciated, because given the stigma towards mental illness and the limited availability of mental health services in LMICs, such technology based interventions are crucial. The study team has used appropriate technique to analyze the data.

Below are my comments to strengthen the paper:

• The title of the paper needs modification, as the intervention is focused on treating common mental disorders and not on promoting mental health of adolescents. I would suggest the topic can be reworded as “Stakeholder perspectives on a patient-centered intervention (DIALOG+) for adolescents with common mental disorders in Colombia: a qualitative study”.

• The reason for choosing DIALOG+ interventions is not clearly spelt out in the paper. Highlighting its strengths over other technology enabled interventions would make rationale stronger.

• In the methodology section, whether parental consent was obtained to include adolescents in the study is not reported.

• It is important to mention the language used in conducting OFGs, and the process of translation and transcription.

• Under positive features in the results section, the first sub-theme is innovation and empowerment. In what way DIALOG+ intervention empowers adolescents is not clearly explained with required quotes from participants. This change then need to reflect in the discussion section from line no. 401 to 404.

• I am not sure if it is good idea to include self-esteem domain under physical health category, as explained in lines 470 & 471.

• I notice two important observations that are crucial, one, connectivity and network issues for the technology to run effectively, a major concern in LMICs, particularly in Colombia. Two, clinicians spending more time (more than 20 minutes) in DIALOG+ interventions. I am wondering if any of the stakeholders gave any insights of tackling these two challenges.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Aug 11;17(8):e0272066. doi: 10.1371/journal.pone.0272066.r002

Author response to Decision Letter 0


28 Jun 2022

Journal general requirements:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming.

We have ensured that our manuscript meets PLOS ONE's style requirements.

2. We note that you have provided additional information within the Acknowledgements Section that is not currently declared in your Funding Statement. Please note that funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement

We have removed the acknowledgements section which contained funding information. Our Funding Statement should read as follows:

“All authors are supported by the Medical Research Council (grant number: MR/S023674/1) Building resilience in adolescence - improving quality of life for adolescents with mental health problems in Colombia (BRiCs study).https://mrc.ukri.org/

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail.

The study’s minimal data set in this case relates to qualitative interviews that were transcribed verbatim, with the original recordings destroyed as per the ethical requirements in each country. It is not possible due to ethical restrictions to make the transcripts available as although the transcripts are anonymised, they may contain potentially identifiable data within the text, which would enable known participants to be identified. We instead have provided quotations to support each of the themes within the analysis. We have stated that “Anyone wishing to access the original qualitative dataset, is required to contact the Colombia PI of the project. A formal written request, outlining the nature of the project is required. Permission to utilise the data would then be sought from the study’s independent advisory board, who provide oversight on all ethical issues relating to the study and liaise directly with the relevant ethical committees.”

4. We note you have included a table to which you do not refer in the text of your manuscript. Please ensure that you refer to Table 1 in your text; if accepted, production will need this reference to link the reader to the Table.

This has been modified, this table is now table 1 of supplemental information “S1 table 1” (Line 95)

5. Please review your reference list to ensure that it is complete and correct.

No changes were made to our reference list.

Response to reviewer 1:

This is a survey tested DIALOG+ on online focus groups with adults and adolescents (13-16 yo) with current or past depression or anxiety. Although both shared decision-making and internet-based approach are important and timely, the study has substantial concerns.

First, the participants are heterogeneous and the sample size is small.

As the authors wrote, this is a narrative study without any statistical approach. Thus, the sample size is not calculated. However, the sample sizes for each group (n=6~14) are too small to conclude anything. Besides, they have a current or past history of depression or anxiety. Some of them are currently medicated and others are not. This is a too heterogeneous dataset to be published.

Second, this study relies on self-report on anxiety or depression. And the authors conducted only a narrative approach. Where is objectivity? Which piece of information supports the author's conclusions??

Third, as the authors mentioned, this is a qualitative study. There are some possible ways to statistically analyse this kind of dataset. For example, if you structured the OFGs, you can conduct text mining. Why did the authors eschew statistical analyses?

Response

We thank you for your constructive comments regarding the qualitative methodology employed within the study and have addressed the three points raised in our response below.

Our results and conclusions are based on the data obtained through online focus groups as well as on the thematic analysis performed on the wealth of data obtained. This analysis is one of the most common forms of analysis in qualitative research. As explained under the data collection and analysis section, every focus group session was audio recorded and transcribed verbatim. Information was analysed and a framework approach was used following six phase guidelines by Braun and Clarke. The main focus was on pairwise coding to saturation, after analysing the different codes and major categories obtained, emerging themes were defined. Afterwards, a joint report with this obtained information, was written by a social worker and an anthropologist, members of the research team, with long experience in qualitative research. This document along with the transcriptions support our conclusions and excerpts of the transcriptions were used in order to illustrate the emerging themes.

The samples included are appropriate to the methodology, where the numbers per focus group are required to be small enough to allow everyone to express their opinions, but large enough to create a group dynamic. It was not the aim of the paper to compare different groups of individuals, for which we agree a more homogenous sample, and/or quantitative statistics would be required. Rather it was our aim to explore and understand the experience of individuals with anxiety and depression who typically present within healthcare services.

We consider that the narrative synthesis of the data obtained with the thematic analysis, did not call for additional quantitative methods like text-mining because. It was unlikely that these additional methods would provide new or different information than the one we obtained.

-----------------

Response to reviewer 2:

We thank you for the review of our paper and your feedback. We have answered each of your points below.

Reviewer 2:

General comments

I find the paper relevant and adds value to the technology mediated mental health interventions. The authors’ attempt to use multi-stakeholder approach to understand the feasibility, acceptability and suitability of the DIALOG+ interventions in Colombia is appreciated, because given the stigma towards mental illness and the limited availability of mental health services in LMICs, such technology-based interventions are crucial. The study team has used appropriate technique to analyse the data.

Below are my comments to strengthen the paper:

1. The title of the paper needs modification, as the intervention is focused on treating common mental disorders and not on promoting mental health of adolescents. I would suggest the topic can be reworded as “Stakeholder perspectives on a patient-centred intervention (DIALOG+) for adolescents with common mental disorders in Colombia: a qualitative study”.

Response No. 1

We thank you for your suggestion, indeed the DIALOG+ intervention aims to improve the mental health of adolescents by giving a patient-centred approach and structuring the clinician-patient relationship. Considering this, we have modified the title as suggested describing more accurately the scope of our paper.

2. The reason for choosing DIALOG+ interventions is not clearly spelt out in the paper. Highlighting its strengths over other technology enabled interventions would make rationale stronger

Response No. 2

We have now included some of the strengths that the DIALOG+ intervention offers, like its interface, the focus on the patients self-reported needs, the structure it gives to a routine clinical consultation as well as a brief description of the positive evidence that it has with adult populations. This can be found in lines 82-89.

3. In the methodology section, whether parental consent was obtained to include adolescents in the study is not reported.

Response No. 3

We apologize for the lack of clarity on this regard; Further explanation on the consent process can now be found under the “procedure” subheading of the methodology section (Lines 142-146). It can be read that informed consent was obtained by parents/guardians as well as assent from adolescents before any data collection began. We have also included that anonymity and the possibility of withdrawal at any given time was explained by researchers since the beginning.

4. It is important to mention the language used in conducting OFGs, and the process of translation and transcription.

Response No. 4

We have included a brief description on the use of language by facilitators in Lines 154-156. It is explained that the use of language aimed to encourage participation. Additionally, in order to give deeper insight to the facilitation of the focus groups, the topic guide followed on each focus group is included as supporting information file 1.

The process of transcription is described under data collection and analysis.

5. Under positive features in the results section, the first sub-theme is innovation and empowerment. In what way DIALOG+ intervention empowers adolescents is not clearly explained with required quotes from participants. This change then needs to reflect in the discussion section from line no. 401 to 404.

Response No. 5

We have included a clinician quote where it was perceived that the intervention gives the teenagers an active role because it allows them to freely express their feelings and what they wish to improve (Line 234-236), and a quote by a parent/guardian where the intervention was perceived as encouraging (Line 238-241). Additionally, the previous quote (line 228-230) by an adolescent also highlights that the intervention allows recognition of emotions, related to a feeling of autonomy. The discussion section from line no. 395-397 reflects this addition.

6. I am not sure if it is good idea to include self-esteem domain under physical health category, as explained in lines 470 & 471.

Response No. 6

Participants considered that aspects like body image, societal beauty standards and self-perception could be included in the intervention. We considered that interrogations related to this aspect could be supplementary to those asked in the physical health domain. This domain inquiries about diet and physical activities and linked to these, questions regarding body image and self-perception could be asked. This sub-category was renamed to “body-image”.

7. I notice two important observations that are crucial, one, connectivity and network issues for the technology to run effectively, a major concern in LMICs, particularly in Colombia. Two, clinicians spending more time (more than 20 minutes) in DIALOG+ interventions. I am wondering if any of the stakeholders gave any insights of tackling these two challenges.

Response No. 7

No specific insight on strategies to tackle these two challenges were proposed by stakeholders. These were identified as potential issues, however no spontaneous insight on possible solutions was obtained. These problems clearly require particular attention during the implementation phase and possible solutions require special measures since these are major issues that are faced in the Colombian context.

We thank you again for your time and consideration.

Decision Letter 1

Dylan A Mordaunt

13 Jul 2022

Stakeholder perspectives on a patient-centred intervention (DIALOG+) for adolescents with common mental disorders in Colombia: a qualitative study

PONE-D-22-04627R1

Dear Dr. Bird,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Dylan A Mordaunt, MD, MPH, FRACP

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Thank you for your resubmission. This now meets the criteria for publication. There are some uses of the present particible in places where past particible should be used, these doesn't change the meaning of the text and is so minor that it would often be missed. I would double-check these in the copy-editing stage.

Reviewers' comments:

Acceptance letter

Dylan A Mordaunt

3 Aug 2022

PONE-D-22-04627R1

Stakeholder perspectives on a patient-centred intervention (DIALOG+) for adolescents with common mental disorders in Colombia: a qualitative study

Dear Dr. Bird:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Associate Professor Dylan A Mordaunt

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (DOCX)

    Data Availability Statement

    Data cannot be shared publicly because of confidentiality issues as the raw data are verbatim transcripts, as per the requirements of comíté de Investigaciones y Ética Institucional, Facultad de Medicina, Pontificia Universidad Javeriana. Data are available on request from the chair of the International Steering Committee (Professor Domenico Giacco) to researchers who meet the criteria for access to confidential data. As the dataset relates to interviews transcribed verbatim anyone wishing to access the original qualitative dataset, is required to contact the International Steering Committee chair (domenico.giacco@warwick.ac.uk). A formal written request outlining the nature of the project is required. Permission to utilise the data would then be sought from the other members of the study’s independent advisory board, who provide oversight on all ethical issues relating to the study and liaise directly with the relevant ethical committees.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES