Skip to main content
PMC home page
Journal of Medical Internet Research logoLink to Journal of Medical Internet Research
. 2013 Dec 5;15(12):e271. doi: 10.2196/jmir.2826

Initial Design of Culturally Informed Behavioral Intervention Technologies: Developing an mHealth Intervention for Young Sexual Minority Men With Generalized Anxiety Disorder and Major Depression

Michelle Nicole Burns 1,✉, Enid Montague 2, David C Mohr 1
Editor: Gerhard Andersson
Reviewed by: Christopher Martell, Jan Bergström
PMCID: PMC3869054  PMID: 24311444

Abstract

Background

To our knowledge, there is no well-articulated process for the design of culturally informed behavioral intervention technologies.

Objective

This paper describes the early stages of such a process, illustrated by the methodology for the ongoing development of a behavioral intervention technology targeting generalized anxiety disorder and major depression among young sexual minority men.

Methods

We integrated instructional design for Internet behavioral intervention technologies with greater detail on information sources that can identify user needs in understudied populations, as well as advances in the understanding of technology-specific behavioral intervention technology dimensions that may need to be culturally tailored.

Results

General psychological theory describing how to effect change in the clinical target is first integrated with theory describing potentially malleable factors that help explain the clinical problem within the population. Additional information sources are then used to (1) evaluate the theory, (2) identify population-specific factors that may affect users’ ability to relate to and benefit from the behavioral intervention technology, and (3) establish specific skills, attitudes, knowledge, etc, required to change malleable factors posited in the theory. User needs result from synthesis of this information. Product requirements are then generated through application of the user needs to specific behavioral intervention technology dimensions (eg, technology platform). We provide examples of considerations relevant to each stage of this process and how they were applied.

Conclusions

This process can guide the initial design of other culturally informed behavioral intervention technologies. This first attempt to create a systematic design process can spur development of guidelines for design of behavioral intervention technologies aimed to reduce health disparities.

Keywords: mobile health, eHealth, cultural competency, minority health, male homosexuality, male adolescents, young adult, anxiety, depression

Introduction

Behavioral intervention technologies are patient-facing information and communication technologies (eg, websites, virtual reality, text messages) designed to improve physical and mental health by targeting behaviors and cognitions [1]. Although behavioral intervention technologies may have the potential to improve access to behavioral health care for underserved populations, we know of no well-articulated process for culturally informed behavioral intervention technology design. We describe the early stages of such a process, using the methodology that is currently being used for the initial design of a behavioral intervention technology targeting generalized anxiety disorder (GAD) and major depressive disorder (MDD) in young sexual minority men.

At the outset, we decided this intervention would be technology-based due to barriers to traditional care. Although barriers to mental health services affect youth in general [2], sexual minority youth face additional barriers such as reluctance to disclose to providers their sexual orientation and related issues [3,4]. Further, many psychologists are not trained to meet their needs [5]. Many young sexual minority men (22%) are uninsured, and 12% indicate they have nowhere to present for health care or information [6].

Methods

As there were no validated psychological intervention models for anxiety or depression in sexual minority youth [7], we required a systematic design approach. The instructional design (ID) process for Internet behavioral intervention technologies [8] informed our thinking regarding identification of the users and usage contexts, and establishment of learning needs and goals. However, the ID process for Internet behavioral intervention technologies did not detail sources of information that can help to understand the users. Such information is particularly critical when the target population is understudied, and we addressed this in our process. We also endeavored to more broadly establish user needs, which include learning needs but also address other population-specific needs.

Thus, our behavioral intervention technology design process outlines sources of information to better understand the user and their cultural context. This information is used to generate user needs, which are then translated into product requirements. Requirements are organized using advances in the understanding of behavioral intervention technologies dimensions (ie, technology platform, functionality, content, and user interface) that may require cultural tailoring [9].

This paper focuses on the question of how to arrive at an initial conception of a behavioral intervention technology. While evaluation of the perceived usefulness, usability, and feasibility should occur throughout the design process [8], evaluation methods are beyond the scope of this paper. We suggest readers consult user-centered design [10] to choose evaluative methodologies for each phase of their design process. Each step of our initial design process is displayed in Figure 1, and an example is described in Table 1.

Figure 1.

Figure 1

Open in a new tab

Process for the initial design of a behavioral intervention technology targeting generalized anxiety disorder and major depression among male sexual minority youth (rectangle=internal processes; trapezoid=process resulting in the input of information).

Table 1.

Example of how a piece of information gathered about the users is used to specify a user need, which is then translated into a product requirement.

Information gathered about the users User need Product requirement
Minority sexual orientation is a relatively concealable, stigmatized characteristic that can pose safety risks if revealed to others. Private access to the intervention. A study-provided mobile phone will offer private access to the intervention, which will also be password-protected.
Open in a new tab

Results

Step 1: Gather Information About Users

Overview

We first defined characteristics of our users: (1) males who are attracted to other males, (2) aged 17-20, and (3) experiencing GAD and/or MDD. Although sexual orientation refers to multiple facets of sexuality including attraction, behavior, and identity (eg, self-identification as “gay”, etc), there is some evidence that attraction, unlike behavior and identity, is considered by adolescents to be critical in terms of defining one’s sexual orientation [11]. Thus, attraction to other males was the only defining characteristic in terms of the target population’s sexual orientation.

We next gathered information regarding ways that each of the defining user characteristics may influence behavioral intervention technology design, preferring any available information relating to their intersection. Our objectives were to establish (1) user needs relating to the “gap” between optimal behaviors, thoughts, and feelings versus current behaviors, thoughts, and feelings in this population, (2) knowledge, skills, attitudes, etc, needed to enable users to close this gap [8], and (3) user needs regarding behavioral intervention technology feasibility and acceptability.

We will now describe types of information that can be gathered to help answer these questions. We suggest first selecting theory, as theory helps establish the other types of required information. We next recommend consulting previous research to evaluate the evidence supporting the theory and identify user characteristics that could influence the way users relate to and engage with behavioral intervention technologies. A review of other previous research may also be necessary depending on the theory, and we will describe an example.

Other sources of information can augment theory and research findings. Consultation with content experts can be a rich source of clinical data throughout the information gathering and subsequent stages of this design process. In addition, secondary analysis of existing data and collection of new data from users are being employed to fill in gaps of the research literature.

Theory

ID for Internet behavioral intervention technologies suggests using theory to guide understanding of user needs; in our case, we required general theory describing how to bring about affective change [8]. We also needed to expand the conceptualization of theory to include population-specific theory. As young sexual minority men are at increased risk for anxiety and depressive symptoms [12,13], we required theory elucidating potentially malleable factors that explain this disparity.

General Theory of Affective Change

Internet interventions based on principles of cognitive behavioral therapy (CBT) for anxiety, depression, and stress have demonstrated efficacy when supported by brief provider contact [14]. Literature is growing that supports cognitive behavioral Internet interventions for adolescents with depressive and anxiety disorders [15]. Thus, the cognitive behavioral model was used as a framework for affective change. Due to high depression and anxiety comorbidity, shared mechanisms have been identified and used to create unified CBT protocols for adults and youth [16,17]. Unified cognitive behavioral theory describes putative maladaptive thoughts and behaviors common to individuals with depression and anxiety (ie, overestimation of the probability and consequences of negative outcomes, avoidant emotion regulation strategies) and thoughts and behaviors that are optimal in promoting affective change (ie, realistic cognitive appraisals and adaptive emotion regulation strategies) [16]. Thus, unified cognitive behavioral theory has outlined the differences, or “gaps”, between existing versus optimal thoughts and behaviors, as well as skills that can be taught to help users close these gaps. The cognitive behavioral model also has implications for the contexts in which users should interact with the intervention, as it requires that patients apply their learning during problematic situations encountered in daily life.

Theory of Mental Health Disparities Among the Users
Overview

Ample evidence supports the minority stress model, which implicates stressors generated by stigmatizing social contexts (eg, discrimination, victimization) in mental health disparities among sexual minority people [3,18,19]. Unlike some other stigmatized identities, sexual orientation may be concealable, and such concealment is also conceptualized as a form of minority stress [18]. However, disclosure of sexual orientation can also be a source of minority stress, as disclosure can place youth at risk for victimization [20,21].

The psychological mediation framework [22] extended the minority stress model by proposing pathways between stigmatizing events and mental health. Many of these pathways (eg, appraisals of social support, rumination) are malleable according to unified CBT protocols, as they involve maladaptive cognitive appraisals and emotion regulation. Thus, we integrated unified CBT with the most clearly compatible aspects of the psychological mediation framework (see Figure 2) to derive a population-specific model of affective change to guide the behavioral intervention technology design.

Figure 2.

Figure 2

Open in a new tab

The population-specific theory of affective change used to guide the design of a behavioral intervention technology targeting generalized anxiety disorder and major depression among male sexual minority youth.

Previous Research

We searched previous literature for evidence regarding the population-specific model of affective change. Prospective and experimental evidence suggests that emotion dysregulation does mediate the relationship between stigma-related events and psychological distress [22]. Regarding cognitive appraisals in our population-specific model of affective change, discrimination, victimization, and concealment may negatively influence cognitive appraisals of social support and thus increase depression and anxiety [22,23]. In partial support of this idea, lower perceived social support has been found to predict depression among gay youth [24]. The evidence for the population-specific model of affective change was limited, however, as most research with sexual minority people is cross-sectional [25], obscuring the ways minority stress processes interrupt healthy development [26]. Also, as very large samples are required to recruit representative sexual minority samples, convenience samples are often used that overrepresent white individuals and those who identify as gay [27,28].

As cognitive behavioral principles are designed for use in distressing situations, we also used previous research to identify contexts in which our users would likely encounter minority stress. Unlike many other stigmatized characteristics, families are unlikely to share the youth’s sexual orientation and may be hostile toward it [29]. Sexual minority youth are also more likely than heterosexual youth to be victimized at school and skip school due to safety concerns [3]. Adolescent males attracted to both males and females report lower academic achievement than their male heterosexual peers [30], and this may be due to hostile school climates [31]. Young sexual minority men can also lose friendships over their sexual orientation [32]. Thus, sexual minority youth can experience stigma-related events in the context of family, school, and friendships, all of which are key domains in the lives of many young people.

Previous research regarding acceptability and feasibility considerations was then examined. One of the first steps to developing a culturally inclusive design was gaining better understanding of how users may conceptualize their sexual identity. Little work has been done to develop design requirements for sexual minority people, so we began with examining the language young men use to describe their sexual orientation. In contrast to labels such as “gay” or “bisexual”, many adolescents appear to better understand their sexual orientation in terms of the sex(es) to whom they are sexually attracted [33]; indeed, some youth reject sexual orientation labels entirely [34]. For others, a wide variety of terms are used (eg, “pansexual”).

Finally, we sought research on the implications of user characteristics that are not related to sexual orientation for behavioral intervention technology feasibility and acceptability. First, a key developmental task of adolescence for both sexual minority and majority youth is to increase autonomy [3,35]. Second, metacognitive skills can be impaired by depression [36]. Third, due to mood-congruent recall [37], it may be difficult for users to remember how to implement new skills when they feel depressed or anxious.

Secondary Analyses of Existing Data

When designing behavioral intervention technologies for an understudied population, researchers may expect limitations in the literature regarding evidence for their model of population-specific change. Consequently, we are conducting a secondary analysis of data from an ongoing longitudinal cohort study of 451 racially diverse sexual minority men aged 16-20 (first reported by Mustanski et al [38]), recruited in Chicago using a sampling method that facilitated enrollment of young men unaffiliated with the gay and bisexual community. Respondent driven sampling [39] was used and modified to allow a higher percentage of initial recruits (ie, “seeds”), who were located through community outreach, school organizations, flyers posted in community locations frequented by LGB youth, and geosocial network applications (ie, Grindr and Jack’d). The seeds were then compensated for recruiting up to 3 other young sexual minority men into the study. New recruits, in turn, could also earn monetary incentives by recruiting up to 3 of their peers into the study.

Participants were given measures of minority stress, cognitive appraisals, and anxiety/depressive symptoms every 6 months. Ongoing, unpublished analyses are thus far highlighting the importance of appraisals of family support in predicting anxiety/depressive symptoms 6 months later. Although the inclusionary definition of sexual orientation differed in this longitudinal study from our defined target population, the analyses provided some support for the pathway between cognitive appraisals and anxiety/depression in our population-specific model of affective change. Had there been published trials of behavioral interventions for anxiety or depression with this population, we would have also requested to analyze such data to ascertain whether our model of affective change mapped onto mechanisms of action.

Consultation With Content Experts

To work toward culturally informed implementation of evidence-based principles, content experts should review the researchers’ understanding of gathered information. We have begun discussions with mental health professionals at a community organization serving sexual minority youth regarding our population-specific model of affective change, preliminary results of our secondary analysis, and their implications for intervention strategy. Further, the research team includes a psychologist and a physician with expertise on the health of male sexual minority youth, an adolescent psychologist with expertise in CBT for anxiety and depression, an expert in behavioral intervention technology development (DCM), and a software engineer. This team only begins to speak to the need to define “content experts” broadly, due to the multidisciplinary nature of behavioral intervention technology design.

New Data Collected From the Target Population

Information gathered thus far suggests the tentative learning goals are to increase perceived family support or help youth source positive social support from other individuals, and foster adaptive emotion regulation strategies. However, as young sexual minority men are understudied, the knowledge, skills, behaviors, and attitudes needed to meet these learning goals are unclear. A few qualitative studies have been conducted with samples that were not characterized on the basis of mental health, indicating sexual minority youth use a variety of strategies and resources to cope with minority stress (eg, [40]). However, it is difficult to evaluate the adaptive potential of these strategies without specifically examining youth who experience minority stressors without becoming distressed.

Accordingly, we have designed qualitative interviews to conduct with a subset of young sexual minority men participating in the aforementioned longitudinal study; we are inviting participants who have repeatedly (ie, at their two most recent assessments) evidenced nonclinical anxiety and depression symptom scores, despite repeatedly experiencing discrimination, to participate in the qualitative interviews. By understanding adaptation among youth who are resilient to minority stress, we will begin to understand how, specifically, male sexual minority youth can remain emotionally regulated and protect their perceptions of family support in the face of minority stress.

Step 2: Specify User Needs

Due to the potentially concealable nature of sexual orientation, and the fact that its disclosure could result in discrimination or victimization, the paramount user need is private access to the behavioral intervention technology.

As stated previously, the behavioral intervention technology also needs to help youth improve appraisals of family support, or build or strengthen other social supports, and replace maladaptive with adaptive emotion regulation strategies. Subsumed user needs (eg, the skills, knowledge, and attitudes required to fulfill these broader learning needs) remain unknown, as we have not yet conducted the qualitative interviews regarding resilience to minority stress. Resources are often too limited to gather all desired information sources prior to applying for funding. Other researchers may also find it necessary to partially specify user needs and translate them into product requirements to create a thoughtful proposal and seek such funding. We thus conceptualize the information gathering phase as continuing to occur during the other phases of our process, enabling refinement of user needs and product requirements as new information becomes available.

The behavioral intervention technology must address minority stress driving higher rates of anxiety and depressive symptoms among the target population, and this is more likely if therapies actively engage youth in these stigmatizing social contexts [41]. As sexual minority youth may face stigma in their family, school, and social life, and CBT relies on use of new behaviors and ways of thinking during distressing situations, users need the ability to access the behavioral intervention technology during as much as of their daily life as possible. Users who report distress also need prompts to remind and guide them to use cognitive behavioral skills in the moment.

Due to educational disruptions or depression, some users may need the behavioral intervention technology to accommodate lower levels of literacy and metacognitive skills, respectively. Given their developmental stage, users also need the behavioral intervention technology to convey respect and support for their growing need for autonomy. Finally, the language of the behavioral intervention technology needs to be compatible with users’ understanding of their sexual orientation.

Step 3: Translate User Needs Into Product Requirements

Overview

Within this phase, we have subsumed the recently published model of specific features of patient-facing behavioral intervention technologies that require cultural consideration, which comprise (1) technology platform, (2) functionality, (3) content, and (4) user interface [9]. We now describe several examples of how user needs inform each of these four areas.

Technology Platform

A mobile phone platform meets the need for ubiquitous technology resulting from the varying contexts in which minority stress takes place and the corresponding need for application of cognitive behavioral skills in the face of minority stress. Also, a purely Web-based intervention may not meet the user need for private access to the behavioral intervention technology. Youth may not have a point of access to the Web that is not monitored by others. Thus, for the duration of the intervention, users will be provided with a mobile phone to allow private access to the behavioral intervention technology. The behavioral intervention technology will also be password-protected to protect the youth’s data if the phone is lost or stolen.

Functionality

The extent and nature of interactivity, amount of user control, sequencing of information, and rate of delivery [42] should be selected based on user needs [8]. To reduce the metacognitive skill required, we are using short, scaffolded didactic information and frequent interactive experiences with corrective feedback [42]. Accordingly, each day the application will provide users with either a small chunk of information or a brief, interactive skills practice with clear linkage to previous material. Further, the mobile phone application will prompt users several times daily to report on their mood. The behavioral intervention technology will guide users reporting distress through tools that will scaffold them in enacting behaviors that are adaptive given their current discrete emotion(s) and intensity. For example, youth reporting moderate guilt will be routed to tools that target guilt by restructuring maladaptive cognitive appraisals, such as by focusing on how to learn from a mistake. In contrast, youth experiencing intense guilt would first be walked through distress tolerance exercises [43,44], such as focusing on the sensations of one’s feet touching the ground. Another example of feedback is that the phone application will offer visualization tools to show users how their emotions relate to their behaviors and contexts. For example, youth can see a graph showing their average level of sadness in each location in which they have reported their mood.

The intervention “functionality” also includes human coaching, which is commonly used to increase adherence to Internet behavioral intervention technologies [45]. As mentioned, the behavioral intervention technology depends on feedback [42], and there are some tasks (eg, completing a thought record) that may be too complex for the mobile phone application to provide meaningful feedback. The behavioral intervention technology will enable coaches to view users’ work, such that coaches can provide feedback for more complex tasks. In keeping with the goal for the behavioral intervention technology to foster frequent but short interactive experiences, coaching contacts will include a brief telephone call (5-10 minutes) and email each week. A coaching protocol (“TeleCoach”) [46] based in part on motivational interviewing [47] will be used to maintain engagement in treatment despite avoidance behaviors that may arise due to anxiety and depressive symptoms. Coaches will be clinicians with expertise in motivational interviewing.

Content

The need for autonomy among youth indicates that a collaborative, empowering tone is appropriate for the content. For example, the intervention will first involve personal goal-setting that will be used to frame the other intervention components. Also, the behavioral intervention technology content around loss of family support will stress the youth’s emerging independence and ability to obtain social support from other sources (eg, the idea of building a “family of choice” [3]).

Consistent with the many domains in which sexual minority youth can encounter minority stress, the content will also address minority stress occurring in a variety of contexts. Skills such as cognitive restructuring, problem solving, and finding alternatives to avoidant emotion regulation strategies are taught in part through the use of examples. Such examples include a young man encountering bullying at school, a youth who has lost a good friend after he disclosed his sexual orientation, and a young man trying to problem solve regarding how and when to disclose his sexual orientation to his parents. Examples will be enhanced by incorporation of young sexual minority men’s narratives collected during the qualitative interviews regarding resilience to minority stress.

User Interface

Users will be able to obtain the same information from audio voiceovers, illustrations, and videos as contained in the text, to accommodate possible educational disruptions due to school victimization [8]. The terminology used to describe sexual orientation will also be inclusive (eg, “attracted to men” versus “gay” or “bisexual”). When discussing sexual identification, a spectrum of possible sexual orientation labels will be acknowledged.

Discussion

Principal Results

Design of behavioral intervention technologies for underserved populations can be guided by general psychological theory describing how to effect change in the clinical target, integrated with theory describing potentially malleable factors that help explain incidence of the clinical problem among the population. Previous research, analysis of existing data, consultation with content experts from multiple disciplines, and collection of new data can then be used to (1) evaluate the guiding theory, (2) identify group-specific factors that are not learning needs, but may affect users’ ability to relate to and benefit from the behavioral intervention technology, and (3) establish specific skills, attitudes, knowledge, and behaviors required to change malleable factors posited in the theory. User needs result from synthesis of this information. Generation of product requirements is then guided by application of the user needs to choice of technology platform, functionality, content, and user interface.

Limitations

Future work should extend this process model by articulating methods to evaluate each of its stages, as well as incorporating cultural intersectionality, the idea that multiple identities (eg, Latino, bisexual, male) are not additive and cannot be fully understood in isolation [48].

Conclusions

This early design process is readily understandable to clinical scientists and thus can be translated to serve interventionists targeting other populations or clinical targets, as well as those interested in creating a model for the entire design process of culturally informed behavioral intervention technologies. The process of gathering information and defining user needs is also applicable to the development of interventions that do not involve technology. The model could also assist clinicians in culturally tailoring their interventions for patients from underserved populations, as well as to spur further discussions of guidelines and standards in the development of behavioral intervention technologies aimed to reduce health disparities.

Acknowledgments

This study was funded by National Institute of Mental Health, grant No. K08 MH094441 to Michelle Burns, PhD.

Abbreviations

CBT

cognitive behavioral therapy

GAD

generalized anxiety disorder

ID

instructional design

MDD

major depressive disorder

Footnotes

Conflicts of Interest: None declared.

References

  • 1.Burns MN, Mohr DC. eHealth and behavioral intervention technologies. In: Gellman MD, Turner JR, editors. Encyclopedia of Behavioral Medicine. New York: Springer-Verlag; 2013. pp. 659–664. [Google Scholar]
  • 2.National Research Council . Adolescent health services: missing opportunities. Washington, DC: National Academies Press; 2009. [PubMed] [Google Scholar]
  • 3.Institute of Medicine; Board on the Health of Select Populations; Committee on LGBT Health Issues and Research Gaps and Opportunities . The Health of Lesbian, Gay, Bisexual, and Transgender (LGBT) People: Building a Foundation for Better Understanding. Washington, D.C: National Academies Press; 2011. [PubMed] [Google Scholar]
  • 4.Coker TR, Austin SB, Schuster MA. The health and health care of lesbian, gay, and bisexual adolescents. Annu Rev Public Health. 2010;31:457–77. doi: 10.1146/annurev.publhealth.012809.103636. [DOI] [PubMed] [Google Scholar]
  • 5.Lyons HZ, Bieschke KJ, Dendy AK, Worthington RL, Georgemiller R. Psychologists' competence to treat lesbian, gay and bisexual clients: state of the field and strategies for improvement. Prof Psychol-Res Pr. 2010 Oct;41(5):424–434. [Google Scholar]
  • 6.Kipke MD, Kubicek K, Weiss G, Wong C, Lopez D, Iverson E, Ford W. The health and health behaviors of young men who have sex with men. J Adolesc Health. 2007 Apr;40(4):342–50. doi: 10.1016/j.jadohealth.2006.10.019. http://europepmc.org/abstract/MED/17367727. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Cochran SD. Emerging issues in research on lesbians' and gay men's mental health: does sexual orientation really matter? American Psychologist. 2001;56(11):931–947. doi: 10.1037/0003-066x.56.11.931. [DOI] [PubMed] [Google Scholar]
  • 8.Hilgart MM, Ritterband LM, Thorndike FP, Kinzie MB. Using instructional design process to improve design and development of Internet interventions. J Med Internet Res. 2012 Jun;14(3):e89. doi: 10.2196/jmir.1890. http://www.jmir.org/2012/3/e89/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Valdez R, Gibbons MC, Siegel ER, Kukafka R, Brennan PF. Designing consumer health IT to enhance usability among different racial and ethnic groups within the United States. Health Technol. 2012;2(4):225–233. [Google Scholar]
  • 10.Maguire M. Methods to support human-centred design. Int J Hum-Comput St. 2001 Oct;55(4):587–634. [Google Scholar]
  • 11.Friedman MS, Silvestre AJ, Gold MA, Markovic N, Savin-Williams RC, Huggins J, Sell RL. Adolescents define sexual orientation and suggest ways to measure it. J Adolesc. 2004 Jun;27(3):303–17. doi: 10.1016/j.adolescence.2004.03.006. [DOI] [PubMed] [Google Scholar]
  • 12.Almeida J, Johnson RM, Corliss HL, Molnar BE, Azrael D. Emotional distress among LGBT youth: the influence of perceived discrimination based on sexual orientation. J Youth Adolesc. 2009 Aug;38(7):1001–14. doi: 10.1007/s10964-009-9397-9. http://europepmc.org/abstract/MED/19636742. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Pachankis JE, Goldfried MR. Social anxiety in young gay men. J Anxiety Disord. 2006;20(8):996–1015. doi: 10.1016/j.janxdis.2006.01.001. [DOI] [PubMed] [Google Scholar]
  • 14.Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007 Mar;37(3):319–28. doi: 10.1017/S0033291706008944. [DOI] [PubMed] [Google Scholar]
  • 15.Richardson T, Stallard P, Velleman S. Computerised cognitive behavioural therapy for the prevention and treatment of depression and anxiety in children and adolescents: a systematic review. Clin Child Fam Psychol Rev. 2010 Sep;13(3):275–90. doi: 10.1007/s10567-010-0069-9. [DOI] [PubMed] [Google Scholar]
  • 16.Barlow DH, Allen LS, Choate ML. Toward a unified treatment for emotional disorders. Behav Ther. 2004;35(2):205–230. doi: 10.1016/j.beth.2016.11.005. [DOI] [PubMed] [Google Scholar]
  • 17.Ehrenreich JT, Goldstein CM, Wright LR, Barlow DH. Development of a unified protocol for the treatment of emotional disorders in youth. Child Fam Behav Ther. 2009 Jan;31(1):20–37. doi: 10.1080/07317100802701228. http://europepmc.org/abstract/MED/19617930. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Meyer IH. Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: conceptual issues and research evidence. Psychol Bull. 2003 Sep;129(5):674–97. doi: 10.1037/0033-2909.129.5.674. http://europepmc.org/abstract/MED/12956539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Meyer IH. Minority stress and mental health in gay men. J Health Soc Behav. 1995 Mar;36(1):38–56. [PubMed] [Google Scholar]
  • 20.D'Augelli AR, Hershberger SL, Pilkington NW. Lesbian, gay, and bisexual youth and their families: disclosure of sexual orientation and its consequences. Am J Orthopsychiatry. 1998 Jul;68(3):361–71; discussion 372. doi: 10.1037/h0080345. [DOI] [PubMed] [Google Scholar]
  • 21.D'Augelli AR, Grossman AH, Starks MT. Parents' awareness of lesbian, gay, and bisexual youths' sexual orientation. J Marriage Fam. 2005 May;67(2):474–482. [Google Scholar]
  • 22.Hatzenbuehler ML. How does sexual minority stigma "get under the skin"? A psychological mediation framework. Psychol Bull. 2009 Sep;135(5):707–30. doi: 10.1037/a0016441. http://europepmc.org/abstract/MED/19702379. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Pachankis JE. The psychological implications of concealing a stigma: a cognitive-affective-behavioral model. Psychol Bull. 2007 Mar;133(2):328–45. doi: 10.1037/0033-2909.133.2.328. [DOI] [PubMed] [Google Scholar]
  • 24.Vincke J, van Heeringen K. Confidant support and the mental wellbeing of lesbian and gay young adults: a longitudinal analysis. J Community & Appl Soc Psychol. 2002;12:181–193. [Google Scholar]
  • 25.Rosario M, Schrimshaw EW, Hunter J. A model of sexual risk behaviors among young gay and bisexual men: longitudinal associations of mental health, substance abuse, sexual abuse, and the coming-out process. AIDS Educ Prev. 2006 Oct;18(5):444–60. doi: 10.1521/aeap.2006.18.5.444. http://europepmc.org/abstract/MED/17067255. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Rosario M, Rotherarn-Borus MJ, Reid H. Gay-related stress and its correlates among gay and bisexual male adolescents of predominantly Black and Hispanic background. J Community Psychol. 1996;24(2):136–159. [Google Scholar]
  • 27.Bowen A. Internet sexuality research with rural men who have sex with men: can we recruit and retain them? J Sex Res. 2005 Nov;42(4):317–23. doi: 10.1080/00224490509552287. [DOI] [PubMed] [Google Scholar]
  • 28.Szymanski DM, Gupta A. Examining the relationship between multiple internalized oppressions and African American lesbian, gay, bisexual, and questioning persons' self-esteem and psychological distress. J Couns Psychol. 2009;56(1):110–118. [Google Scholar]
  • 29.Corrigan PW, Larson JE, Hautamaki J, Matthews A, Kuwabara S, Rafacz J, Walton J, Wassel A, O'Shaughnessy J. What lessons do coming out as gay men or lesbians have for people stigmatized by mental illness? Community Ment Health J. 2009 Oct;45(5):366–74. doi: 10.1007/s10597-009-9187-6. [DOI] [PubMed] [Google Scholar]
  • 30.Russell ST, Seif H, Truong NL. School outcomes of sexual minority youth in the United States: evidence from a national study. J Adolesc. 2001 Feb;24(1):111–27. doi: 10.1006/jado.2000.0365. [DOI] [PubMed] [Google Scholar]
  • 31.Murdock TB, Bolch MB. Risk and protective factors for poor school adjustment in lesbian, gay, and bisexual (lgb) high school youth: variable and person-centered analyses. Psychol Schools. 2005 Feb;42(2):159–172. [Google Scholar]
  • 32.Pilkington NW, D'Augelli AR. Victimization of lesbian, gay, and bisexual youth in community settings. J Community Psychol. 1995;23(1):34–56. doi: 10.1002/1520-6629(199501)199523:199501<199534::AID-JCOP2290230105>2290230103.2290230100.CO;2290230102-N. [DOI] [Google Scholar]
  • 33.Saewyc EM, Bauer GR, Skay CL, Bearinger LH, Resnick MD, Reis E, Murphy A. Measuring sexual orientation in adolescent health surveys: evaluation of eight school-based surveys. J Adolesc Health. 2004 Oct;35(4):345.e1–15. doi: 10.1016/j.jadohealth.2004.06.002. [DOI] [PubMed] [Google Scholar]
  • 34.Glover JA, Galliher RV, Lamere TG. Identity development and exploration among sexual minority adolescents: examination of a multidimensional model. J Homosex. 2009;56(1):77–101. doi: 10.1080/00918360802551555. [DOI] [PubMed] [Google Scholar]
  • 35.Havighurst RJ. Developmental Tasks and Education. 2nd ed. New York: Longmans, Green; 1952. [Google Scholar]
  • 36.Slife BD, Weaver CA. Depression, cognitive skill, and metacognitive skill in problem solving. Cognition & Emotion. 1992 Jan;6(1):1–22. doi: 10.1080/02699939208411055. [DOI] [Google Scholar]
  • 37.Eich E, Macaulay D. Are real moods required to reveal mood-congruent and mood-dependent memory? Psychol Sci. 2000 May;11(3):244–8. doi: 10.1111/1467-9280.00249. [DOI] [PubMed] [Google Scholar]
  • 38.Mustanski B, Johnson AK, Garofalo R, Ryan D, Birkett M. Perceived likelihood of using HIV pre-exposure prophylaxis medications among young men who have sex with men. AIDS Behav. 2013 Jul;17(6):2173–9. doi: 10.1007/s10461-012-0359-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Heckathorn DD. Respondent-driven sampling: A new approach to the study of hidden populations. Social Problems. 1997 May;44(2):174–199. doi: 10.2307/3096941. [DOI] [Google Scholar]
  • 40.Scourfield J, Roen K, McDermott L. Lesbian, gay, bisexual and transgender young people's experiences of distress: resilience, ambivalence and self-destructive behaviour. Health Soc Care Community. 2008 May;16(3):329–36. doi: 10.1111/j.1365-2524.2008.00769.x. [DOI] [PubMed] [Google Scholar]
  • 41.Patrick K, Intille SS, Zabinski MF. An ecological framework for cancer communication: implications for research. J Med Internet Res. 2005 Jul 1;7(3):e23. doi: 10.2196/jmir.7.3.e23. http://www.jmir.org/2005/3/e23/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Clark RC. Four architectures of instruction. Performance Improvement. 2000 Nov;39(10):31–38. doi: 10.1002/pfi.4140391011. [DOI] [Google Scholar]
  • 43.Najavits L. Seeking Safety: A Treatment Manual for PTSD and Substance Abuse. New York: The Guilford Press; 2002. [Google Scholar]
  • 44.Linehan M. Skills training manual for treating borderline personality disorder. New York: Guilford Press; 1993. [Google Scholar]
  • 45.Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res. 2011;13(1):e30. doi: 10.2196/jmir.1602. http://www.jmir.org/2011/1/e30/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Mohr DC, Duffecy J, Jin L, Ludman EJ, Lewis A, Begale M, McCarthy M. Multimodal e-mental health treatment for depression: a feasibility trial. J Med Internet Res. 2010;12(5):e48. doi: 10.2196/jmir.1370. http://www.jmir.org/2010/5/e48/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Miller WR, Rollnick S. Motivational Interviewing, Second Edition: Preparing People for Change. New York: The Guilford Press; 2002. [Google Scholar]
  • 48.Hankivsky O. Women's health, men's health, and gender and health: implications of intersectionality. Soc Sci Med. 2012 Jun;74(11):1712–20. doi: 10.1016/j.socscimed.2011.11.029. [DOI] [PubMed] [Google Scholar]

Articles from Journal of Medical Internet Research are provided here courtesy of JMIR Publications Inc.

RESOURCES