Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2016 Oct 1.
Published in final edited form as: J Consult Clin Psychol. 2015 Jul 6;83(5):875–889. doi: 10.1037/ccp0000037

LGB-Affirmative Cognitive-Behavioral Therapy for Young Adult Gay and Bisexual Men: A Randomized Controlled Trial of a Transdiagnostic Minority Stress Approach

John E Pachankis 1, Mark L Hatzenbuehler 2, H Jonathon Rendina 3, Steven A Safren 4, Jeffrey T Parsons 3,5
PMCID: PMC4573250  NIHMSID: NIHMS698590  PMID: 26147563

Abstract

Objectives

We tested the preliminary efficacy of a transdiagnostic cognitive behavioral treatment adapted to improve depression, anxiety, and co-occurring health risks (i.e., alcohol use, sexual compulsivity, condomless sex) among young adult gay and bisexual men. Treatment adaptations focused on reducing minority stress processes that underlie sexual orientation-related mental health disparities.

Method

Young gay and bisexual men (n=63; M age=25.94) were randomized to immediate treatment or a three-month waitlist. At baseline, 3-month, and 6-month assessments, participants completed self-reports of mental health and minority stress and an interview of past-90-day risk behavior.

Results

Compared to waitlist, treatment significantly reduced depressive symptoms (b=−2.43, 95% CI: −4.90, 0.35, p<0.001), alcohol use problems (b =−3.79, 95% CI: −5.94, −1.64, p<0.001), sexual compulsivity (b =−5.09, 95% CI: −8.78, −1.40, p<0.001), and past-90-day condomless sex with casual partners (b =−1.09, 95% CI: −1.80, −0.37, p<0.001), and improved condom use self-efficacy (b =10.08, 95% CI: 3.86, 16.30, p<0.001). The treatment yielded moderate and marginally significant greater improvements than waitlist in anxiety symptoms (b =−2.14, 95% CI: −4.61, 0.34, p=0.09) and past-90-day heavy drinking (b =−0.32, 95% CI: −0.71, 0.07, p=0.09). Effects were generally maintained at follow-up. Minority stress processes showed small improvements in the expected direction.

Conclusion

This study demonstrated preliminary support for the first intervention adapted to address gay and bisexual men’s co-occurring health problems at their source in minority stress. If found to be efficacious compared to standard evidence-based treatments, the treatment will possess substantial potential for helping clinicians translate LGB-affirmative treatment guidelines into evidence-based practice.

Public Health Significance

Sexual orientation-related disparities in depression and anxiety co-occur with alcohol use, sexual compulsivity, and risky sexual behavior to form a syndemic health threat surrounding young gay and bisexual men. Clear and consistent evidence suggests that a major source of this syndemic is minority stress—the stress associated with stigma-related social disadvantage that compounds general life stress. This study represents the first test of an adapted cognitive behavioral intervention designed to alleviate minority stress among young gay and bisexual men to improve the co-occurring health conditions facing this population.

Keywords: minority stress, stigma, LGB-affirmative, intervention, cognitive behavioral therapy (CBT)


From an early age, gay and bisexual men are significantly more likely to experience various forms of clinically significant distress such as major depressive disorder and several anxiety disorders compared to heterosexual men (Fergusson, Horwood, & Beautrais, 1999; Fergusson, Horwood, Ridder, & Beautrais, 2005; Saewyc, 2011). These mental health disparities combine with several health-risk behaviors, including alcohol use, sexual compulsivity, and condomless anal sex, to pose a synergistic threat, or syndemic, surrounding gay and bisexual men’s health (Mustanski, Garofalo, Herrick, & Donenberg, 2007; Parsons, Rendina, Moody, Ventuneac, & Grov, in press; Safren, Reisner, Herrick, Mimiaga, & Stall, 2010; Stall et al. 2003). Studies using diverse methodologies consistently locate the source of sexual orientation-related mental health disparities in gay and bisexual men’s disproportionate exposure to minority stress—the stress associated with stigma-related social disadvantage that compounds general life stress (Mays & Cochran, 2001; Hatzenbuehler, McLaughlin, Keyes, & Hasin, 2010; Meyer, Schwartz, & Frost, 2008). Minority stress emerges from stigmatizing societal structures—termed structural stigma (Hatzenbuehler, 2014)—that deny sexual minority individuals (i.e., those who identify as gay, bisexual, or lesbian or engage in same-sex sexual behavior) the same rights and opportunities afforded heterosexuals. Structural stigma, in turn, justifies discrimination within families, religious communities, schools, workplaces, and everyday social interactions, elevating the stress, and therefore the mental health burden, experienced by sexual minorities across development.

Minority stress theory posits that societal stigma compromises gay and bisexual men’s health through several psychosocial stress processes (Meyer, 2003). Some of these processes are specific to being gay or bisexual, such as internalized homophobia (Newcomb & Mustanski, 2010), stigma-based rejection sensitivity (Pachankis, Goldfried, & Ramrattan, 2008), and sexual orientation concealment (Pachankis, 2007; Pachankis et al., 2008). These cognitive, affective, and behavioral minority stress processes are associated with mental health problems and several health risk-behaviors, such as alcohol use, sexual compulsivity, and condomless anal sex (Feinstein, Goldfried, & Davila, 2012; Newcomb & Mustanski, 2011; Pachankis, Hatzenbuehler, & Starks, 2014; Pachankis, Rendina, Restar, Ventuneac, & Parsons, 2015). Yet other cognitive, affective, and behavioral processes disrupted by gay and bisexual men’s stigma exposure are not specific to being gay or bisexual, and serve as universal risk factors for mental health problems (Hatzenbuehler, 2009). For example, sexual minorities report more hopelessness, rumination, and social isolation compared to heterosexuals, even from an early age, which accounts for sexual minorities’ elevated reports of mental health problems and associated health-risk behaviors across development (Hatzenbuehler, McLaughlin, & Nolen-Hoeksema, 2008; Hatzenbuehler, Nolen-Hoeksema, & Dovido, 2009; Safren & Heimberg, 1999).

Because these minority stress processes and associated universal risk factors are theoretically modifiable, testing the efficacy of a treatment that addresses them represents a promising direction for improving gay and bisexual men’s mental health and reducing syndemic health risks (Hatzenbuehler, 2009). While professional guidelines exist for LGB-affirmative clinical practice with sexual minority individuals (American Psychological Association, 2012), the field currently lacks evidence for translating this guidance into practice (Cochran, 2001). This represents a notable gap given that gay and bisexual men are more likely to utilize mental health services compared to heterosexual men (Cochran, Sullivan, & Mays, 2003). The effectiveness of existing mental health interventions as applied to sexual minorities and the potential for these interventions to be adapted to specifically address the cognitive, affective, and behavioral stress processes experienced by gay and bisexual men remain to be determined.

Cognitive behavior therapy (CBT) is well suited to improving cognitive, affective, and behavioral minority stress processes for several reasons (Balsam, Martell, & Safren, 2006; Pachankis, 2014). First, CBT locates present maladaptive behaviors in the context of their developmental function and current environmental contingencies, such as seeing depression and health-risk behaviors as learned responses for coping with minority stress. Second, CBT empowers clients to cope with adverse environmental circumstances such as minority stress by promoting coping self-efficacy. Third, CBT encourages the development of adaptive cognitive, affective, and behavioral stress responses, such as those emerging from minority stress and driving gay and bisexual men’s adverse health. Fourth, CBT targets the universal risk factors disproportionately affecting sexual minorities. Therefore, encouraging adaptive reactions to stigma, such as locating the source of one’s mental health problems in minority stress, drawing on personal resilience as a gay or bisexual man, and learning strategies for reducing maladaptive minority stress reactions such as internalized homophobia or rejection sensitivity have been argued to naturally lend themselves to a CBT approach (Pachankis, 2014; in press). Despite several successful case studies of LGB-affirmative CBT applied to gay and bisexual men’s mental health (Kaysen, Lostutter, & Goines, 2005; Safren & Rogers, 2001; Walsh & Hope, 2010), the efficacy of these approaches for reducing minority stress among gay and bisexual men has not yet been examined.

Mental health interventions require cultural adaptation when distinct psychosocial processes function to disadvantage a particular population or when that population experiences barriers to reaping full benefit from existing interventions (National Advisory Mental Health Council’s Workgroup, 2010). For example, adapting empirically supported interventions, such as CBT, for ethnic minorities often produces enhanced outcomes (Griner & Smith, 2006). The present study tests the efficacy of the first CBT adaptation to improve young gay and bisexual men’s mental health and related psychosocial health through improving the cognitive, affective, and behavioral processes through which minority stress operates to compromise health. The adapted intervention targets both minority stress processes (i.e., rejection sensitivity, internalized homophobia, concealment) and universal risk factors (i.e., hopelessness, rumination, social isolation, unassertiveness) shared across gay and bisexual men’s syndemic health conditions. The intervention platform, the Unified Protocol for the Transdiagnostic Treatment of Emotional Disorders (Unified Protocol; Barlow et al., 2010), is transdiagnostic in that its components are suitable for addressing any maladaptive behavioral patterns driven by these processes, including mental health and associated health-risk behaviors. As described in detail elsewhere (Pachankis, 2014), guidance for adapting the Unified Protocol to address minority stress was garnered from expert mental health care providers with extensive experience treating gay and bisexual men and from depressed and anxious gay and bisexual men who were experiencing co-occurring syndemic health risks.

The present study examines the potential efficacy of this CBT approach adapted for young adult gay and bisexual men’s minority stress experiences in reducing mental health and associated health-risk behaviors. Young adulthood represents a developmental period in which behavioral patterns are formed and identity-related stress is particularly likely to impair health (Arnett, 2000; Pachankis, Hatzenbuehler, & Starks, 2014). Interventions to help young gay and bisexual men navigate the stress and challenges specific to their young adulthood experiences can shape lifelong healthy trajectories, halt the onset and persistence of mental health and substance use disorders, and avert co-occurring risk of HIV infection (Safren, Reisner, Herrick, Mimiaga, & Stall, 2010). Yet, no intervention has been tested for efficacy for improving young gay and bisexual men’s mental health, despite the fact that this population represents one of the most prominent risk groups for depression, anxiety, substance use problems, and HIV infection (Fergusson et al., 1999; 2005; Garofalo et al., 1998; Saewyc, 2011).

Given the early stages of mental health intervention adaptation for sexual minorities, we employed a waitlist controlled trial to determine the adapted intervention’s preliminary efficacy and promise for future testing against existing interventions. Examined outcomes included the psychosocial syndemic conditions that disproportionately burden young gay and bisexual men’s health, including depression, anxiety, alcohol use, sexual compulsivity, and beliefs about and engagement in condomless anal sex. We focus the treatment on young adult gay and bisexual men given that sexual orientation-related mental health disparities begin relatively early in development (e.g., Fergusson, Horwood, & Beautrais, 1999). We also examined the ability of the intervention to reduce cognitive, affective, and behavioral minority stress processes as well as universal processes shown or hypothesized to be elevated among gay and bisexual men, as mechanisms through which the adapted minority stress treatment might operate.

Method

Participants

In 2013 and 2014, we recruited participants through advertisements posted to social and sexual networking websites and mobile applications (e.g., Facebook, sex party listservs, a popular mobile sex-seeking app), college counseling centers, and community-based organizations serving the LGBT community. All participants completed a brief screening questionnaire over the phone to confirm eligibility, which was defined as: (1) being born male and currently identifying as a man; (2) gay or bisexual identity; (3) aged 18 to 35; (4) English fluency; (5) residing in the New York City area; (6) being HIV-negative; (7) engaging in HIV risk behavior (i.e., at least one instance of condomless anal sex with a casual male partner or with an HIV-positive or status-unknown main male partner); (8) experiencing symptoms of depression and/or anxiety in the past 90 days; and (9) not currently receiving regular mental health services (i.e., not more than once a month). Past-90-day depression and anxiety were assessed using the four-item Brief Symptom Inventory – Screening scale (Lang, Norman, Means-Christensen, & Stein, 2009) adapted from the Brief Symptom Inventory (Derogatis, 2001). Participants responded to each of the four items (i.e., “nervousness or shakiness inside,” “feeling tense of keyed up,” “feeling blue,” “feelings of worthlessness”) using a five-point scale from 0 (not at all) to 4 (extremely). A minimum cutoff of 2.5 on either the depression or anxiety scale was chosen as an inclusion criterion for this study (Lang et al., 2009).

Figure 1 describes the sample size throughout all study phases, including exclusion, ineligibility, and refusal of screened participants. The final analytic sample comprised 63 sexual minority men. 73.09% completed 3-month assessments; 81.15% completed 6-month assessments. As can be seen in Table 1, the sample was diverse with regards to racial/ethnic background, employment status, and educational attainment. In contrast, a large majority was gay/queer-identified and single at baseline. Average age was approximately 26 years.

Figure 1.

Figure 1

Theoretical model and principles of ESTEEM. Adapted from “A Transdiagnostic Minority Stress Treatment Approach for Gay and Bisexual Men’s Syndemic Health Conditions,” by J. E. Pachankis, in press, Archives of Sexual Behavior.

Table 1.

Demographic variables

Immediate Intervention
Waitlist Control
Condition comparisons
n = 32 n = 31



Variable n % n %
Age, years t = 0.47 ns
Mean 26.19 25.69
SD 4.26 4.28
Race
 American Indian or Alaskan Native 0 0.0 1 3.2 Χ2=5.56 ns
 Asian 0 0.0 3 9.7
 Black/African American 6 18.8 4 12.9
 Pacific Islander 1 3.1 1 3.2
 White 16 50.0 17 54.8
 Other/mixed 9 31.3 5 32.3
Hispanic/Latino Χ2=0.03 ns
 Yes 12 37.5 11 35.5
 No 20 62.5 20 64.5
Sexual orientation Χ2=2.06 ns
 Gay/queer 31 96.9 27 87.1
 Bisexual 1 3.1 4 12.9
Education Χ2=3.88 ns
 High school, GED, or less 2 6.3 6 19.4
 Some college or Associates degree 14 59.4 10 41.9
 Currently in college 5 15.6 3 9.4
 4-year college degree 9 28.1 8 25.8
 Graduate school 2 6.3 4 12.9
Income Χ2=6.92 ns
 Less than $20,000/year 17 53.1 14 45.2
 $20,000 to $49,999/year 10 31.3 14 45.2
 More than $50,000/year 5 15.6 3 9.7
Employment status Χ2=5.43 ns
 Full time 9 28.1 16 51.6
 Part time 12 37.5 8 25.8
 On disability 0 0.0 1 3.2
 Student (unemployed) 6 18.8 4 12.9
 Unemployed 5 15.6 2 6.5
Relationship status Χ2=0.08 ns
 Single 26 81.2 26 83.9
 In a relationship 6 18.8 5 16.1

Procedure

Telephone screening

Upon reviewing a physical or online study advertisement, interested individuals contacted the research office to complete an eligibility screening by phone. During the call, a research assistant assessed consent for phone screening; described the study, including a description of the treatment and two conditions; and asked questions to assess eligibility. Eligible participants were sent an online link containing at-home baseline measures and scheduled for an in-office appointment to complete the remaining baseline measures and to be randomized to condition. A research assistant ensured that each participant completed at-home baseline measures before arriving to the office.

Experimental design

Upon completing the in-office portion of the baseline assessment and confirming eligibility, participants were randomized to either immediate treatment or waitlist. Randomization was stratified according to race/ethnicity, such that equal numbers of white and non-white participants were assigned to each condition, as well as to anxiety/depression, such that equal numbers of individuals who met criteria for depression only, anxiety only, or both were assigned to each condition. Participants assigned to receive immediate treatment completed their first session immediately following their in-office baseline assessment. Waitlist participants received one phone call or email per month to remind them of their upcoming appointment. Treatment and wait-list occurred over the course of three months. Participants completed assessments at baseline, three months, and six months; demographic questions were only assessed at baseline. To ease participant burden, at each assessment point participants completed approximately half of the survey measures at home by computer and the other half of survey measures in the study office by computer. After completing all surveys, they completed the timeline follow-back interview with a trained interviewer. Immediate treatment participants received treatment between the baseline and 3-month assessment. Waitlist participants received treatment between the 3-month and 6-month assessment. Thus, for immediate treatment participants, these assessments are referred to as immediate pre-treatment, post-treatment, and 3-month follow-up; for waitlist participants, these assessments are referred to as 3-month pre-treatment, immediate pre-treatment, and post-treatment, respectively.

Intervention

ESTEEM (Effective Skills to Empower Effective Men) is a 10-session intervention based on the Unified Protocol for the Transdiagnostic Treatment of Emotional Disorders (Barlow et al., 2010), an individually-delivered cognitive behavioral treatment with efficacy for reducing stress-sensitive mental health disorders (e.g., depression, anxiety) by enhancing emotion regulation abilities; reducing maladaptive cognitive, affective, and behavioral avoidance patterns; and improving motivation and self-efficacy for enacting behavior change (Ellard, Fairholme, Boisseau, Farchione, & Barlow, 2010; Farchione et al., 2012). The Unified Protocol promotes these changes through modules that focus on motivation enhancement, interoceptive and situational exposure, cognitive restructuring, mindfulness, and self-monitoring techniques grounded in established cognitive and behavioral theories and techniques of behavior change across psychosocial problems and disorders. In an extensive adaptation process described in detail elsewhere (Pachankis, 2014), we adapted the Unified Protocol specifically to enhance gay and bisexual men’s stigma coping by reducing minority stress processes. For example, modules were adapted to help participants identify minority stress experiences; track cognitive, affective, and behavioral reactions to minority stress, with a focus on avoidance reactions, including substance use and condomless anal sex; attribute distress to minority stress rather than to personal failure; and assertiveness training for coping with minority stress in safe situations. Adaptations were infused throughout the Unified Protocol Therapist Workbook (Barlow et al., 2010); this adaptation served as the therapist manual for each session. Module content is described briefly below and in detail elsewhere (Pachankis, 2014).

Session 1 focused on discussing primary mental, behavioral, and sexual health issues; building motivation to address those issues; and reviewing participants’ unique strengths as gay or bisexual men. Session 2 reviewed the impact of minority stress on health, specific manifestations of minority stress, and current coping strategies. Session 3 raised awareness of the emotional impact of early and ongoing forms of minority stress. Session 4 raised awareness of the behavioral impact of minority stress and taught mindful, present-focused reactions to minority stress. Session 5 raised awareness of the cognitive impact of minority stress and posed cognitive restructuring activities. Session 6 engaged participants in a review of the impact of emotions on mental, behavioral, and sexual health and personal emotion avoidance tendencies driven by minority stress. Session 7 focused on the impact of minority stress on behavioral avoidance with a focus on creating an emotional and behavioral avoidance hierarchy. Session 8 engaged participants in behavioral experiments in which previously avoided experiences were gradually confronted. Session 9 continued the graduated behavioral experiments with a focus on assertiveness training as a skill for coping with minority stress. Session 10 reviewed new cognitive, affective, and behavioral coping strategies and their application to future minority stress experiences (Pachankis, 2014). Therapists assigned homework between-session homework after sessions to promote skill generalization.

Three advanced clinical psychology doctoral students delivered the intervention. One therapist identified as a lesbian, one as a gay man, and one as a heterosexual woman.

Treatment supervision and fidelity

The first author, a clinical psychologist, supervised the delivery of the intervention over one year in weekly group and individual meetings. All sessions were video-recorded for supervision; the first author reviewed 23.5% (n = 84) of all sessions, coded them using a treatment fidelity checklist created for this study, and reviewed the checklist results as well as qualitative feedback with each therapist. Fidelity checklists were specific to each session and contained between five and seven items per session. For instance, for Session 1, fidelity items stated, “Explain rationale behind ESTEEM, including introducing concept of minority stress and its relationship to anxiety and depression” and “Initiate discussion with participant about pros and cons of changing” rated on a scale from 0 (“not covered at all”) to 2 (“covered thoroughly”). Average fidelity rating (84.6%) for the 84 reviewed sessions indicated that therapists adhered to the session content specified in the treatment manual. However, this likely represents a conservative estimate since sessions were not reviewed randomly; therapists typically suggested their most challenging sessions for supervisory review.

Session attendance

Of the 54 randomized participants who completed at least one ESTEEM session, 24 (44.4%) completed all 10 sessions, 35 (64.8%) completed at least half of the sessions, and 15 (27.8%) completed only one session. We utilized an intent-to-treat approach by including all eligible randomized cases (n = 63).

Primary Outcome Measures

Alcohol Use Disorders Identification (AUDIT; Saunders, Aasland, Babor, de la Fuente, & Grant, 1993)

The AUDIT is a 10-item screening inventory used to identify hazardous drinking across settings and populations. Item responses (e.g., 0 [never] to 4 [daily or almost daily]) are scored from 0 to 4 with qualitative anchors depending on the item (e.g., “How often during the last year have you had a feeling of guilt or remorse after drinking?”). A cutoff value of 8 balances sensitivity and specificity to identify harmful alcohol use. Validity data come from prospective prediction of alcohol use impairment (e.g., Conigrave, Saunders, & Reznik, 1995). In the present study, the scale demonstrated strong inter-item consistency (α = 0.85).

Center for Epidemiological Studies Depression Scale (CESD; Radloff et al., 1977)

The CESD consists of 20 items that ask individuals to rate how often they have experienced symptoms of depression (e.g., “had trouble keeping my mind on what I was doing,” “felt depressed,” “talked less than usual”) in the past week along a four-point scale from 1 (rarely or none of the time [less than 1 day]) to 4 (most or all of the time [5–7 days]). The CES-D contains a sensitive and specific clinical cutoff (i.e., 16 or greater) to identify individuals at risk for major depression (Lewinsohn, Seeley, Roberts, & Allen, 1997). Reliability of the CESD was strong in the present study (α = 0.86).

Overall Depression Severity & Impairment Scale (ODSIS; Bentley, Gallagher, Carl, & Barlow, 2014)

The ODSIS contains five items that assess past-week depressive symptom severity and impairment and possesses strong utility for monitoring treatment response. Response options range from 0 to 4; qualitative response anchors are specific to each question. For example, responses to the item “In the past week, how much has depression interfered with your social life and relationships?” range from 0 (None: My depression doesn’t affect my relationships) to 4 (Extreme: My depression has completely disrupted my social activities. All of my relationships have suffered or ended. My family life is extremely strained). The ODSIS distinguishes between individuals with and without a mood disorder and is appropriate for assessing depressive symptom severity in those with clinical and subclinical levels of depression. A cutoff score of 8 maximizes sensitivity against specificity and correctly classified 82% of outpatients as with or without a mood disorder in a recent validation study (Bentley et al., 2014). Inter-item reliability was high in the present study (α = 0.88).

Overall Anxiety Severity & Impairment Scale (OASIS; Norman, Cissell, Means-Christensen, & Stein, 2006)

The OASIS is a 5-item scale that assesses severity and impairment associated with any anxiety disorder over the past week among clinical and nonclinical samples. An example item is: “In the past week, when you have felt anxious, how intense or severe was your anxiety?” with response option 0 (Little or none: Anxiety was absent or barely noticeable), to 4 (Extreme: Anxiety was overwhelming. It was impossible to relax at all. Physical symptoms were unbearable). A cutoff score of 8 maximizes sensitivity against specificity and correctly classified 87% of outpatients as with or without an anxiety disorder (Campbell-Sills et al., 2009). Inter-item reliability was α = 0.76 in the present study.

Sexual Compulsivity Scale (SCS; Kalichman & Rompa, 2001)

The SCS contains 10 items (e.g., “my desires to have sex have disrupted my daily life”), rated from 1 (not at all like me) to 4 (very much like me). Item responses are summed to derive an overall score (range 10–40). The SCS has high reliability and validity across multiple studies (Hook, Hook, Davis, Worthington, & Penberthy, 2010) and demonstrated strong internal consistency here (α = 0.89). A score of 24 or higher is frequently used to distinguish problematic sexual compulsivity (e.g., Grov, Parsons, & Bimbi, 2010; Ventuneac, Rendina, Grov, Mustanski, & Parsons, 2015).

Safer Sex Self-Efficacy Questionnaire (SSSE; Rendina, 2014)

The 13-item SSSE assesses self-efficacy for condom use in various situations (e.g., “When you really need affection,” “When your partner says he/she does not want to use a condom”) in response to the prompt, “How confident are you that you could avoid having anal sex without a condom?” using a scale ranging from 1 (not at all tempted) to 5 (extremely tempted). The SSSE predicts condomless anal intercourse among men who have sex with men (MSM; Rendina, 2014). In the present study, the SSSE demonstrated strong internal consistency (α = 0.94).

90-day Time Line Follow Back (TLFB; Sobell & Sobell, 1992)

Past 90-day condomless anal sex and alcohol use were assessed with the TLFB. In the TLFB, a trained interviewer reviews a past-90-day calendar and life events (e.g., parties, vacations) with each participant to assess participants’ engagement in risk behavior during that time. The TLFB demonstrates strong reliability and validity, including agreement with real-time interviews and collateral reports of alcohol use (Carney, Tennen, Affleck, del Boca, & Kranzler, 1998) and sex risk (Carey, Carey, Maisto, Gordon, & Weinhardt, 2001). Each day was coded for heavy alcohol use (5+ drinks during that day), sexual partner type (main, casual), and condom use.

Measures of Minority Stress Processes

Measure of Gay-Related Stress (MOGS; Lewis, Derlega, Griffin, & Krowinski, 2003)

The MOGS contains 56 stressors related to being gay (e.g., “lack of support from family members due to my sexual orientation,” “lack of security at work because I am gay”), which participants rated in terms of the negative and positive impact each stressor had if it occurred in the past 12 months along a scale ranging from −3 (extremely negative) to 3 (extremely positive). Since few participants reported that the events had a positive impact on them, a mean of the absolute value of only the negatively rated items was used. The negative impact of gay-related stress predicts depressive symptoms over-and-above general life stress (Lewis et al., 2003). Internal consistency was not calculated since not all stressors applied to all participants.

Gay-related Rejection Sensitivity Scale (GRS; Pachankis et al., 2008)

The GRS assesses the degree to which gay and bisexual men would be anxious about being rejected in each of 14 vignettes because of their sexual orientation, from 1 (very unconcerned) to 6 (very concerned), and the degree to which they would expect such rejection from 1 (very unlikely) to 6 (very likely). An example vignette is: “A 3-year old child of a distant relative is crawling on your lap. His mom comes to take him away.” For each vignette, participants’ responses to the anxiety scale are multiplied by their expectation scale score and an average of the 14 resulting scores is taken. Previous uses of this scale have yielded associations with depression, social anxiety, substance use, and sexual compulsivity (Feinstein, Goldfried, & Davila, 2012; Pachankis et al., 2015). Internal consistency was α = 0.91 in the present study.

Internalized Homophobia Scale (IHP; Martin and Dean, 1992)

The IHP assesses how troubled gay and bisexual men are about their sexual identities over the past year. Participants rate nine items (e.g., “You felt it best to avoid personal or social involvement with other people who are LGB”) using a scale from 1 (never) to 4 (often). The IHP is associated with general mental and sexual health problems in a sample of adult gay men (Meyer, 1995). Inter-item consistency (α) was 0.90 in the present study.

Sexual Orientation Concealment Scale (SOCS; Meyer, Rossano, Ellis, & Bradford, 2002)

Participants indicated the degree to which they were “out of the closet” to five domains of people: family; gay, lesbian, and bisexual friends; straight friends; co-workers; and health care providers, using a scale from 1 (out to all) to 4 (out to none). The SOCS has shown significant positive associations with internalized homophobia and negative associations with gay community connectedness (Frost & Meyer, 2009). Internal consistency was α = 0.74..

Measures of Universal Risk Factors

Ruminative Responses Scale (Treynor, Gonzalez, and Nolen-Hoeksema, 2003)

Rumination was assessed with this 22-item scale assessesing characteristic ways of responding to depressed mood (e.g., “Go someplace alone to think about your feelings”), including inward-looking problem solving and passive brooding, using a 4-point Likert-type scale from 1 (never) to 5 (always). In this study, the scale demonstrated strong inter-item consistency (α = 0.90).

Difficulties of Emotion Regulation Scale (DERS; Gratz & Roemer, 2004)

The DERS contains 36 items assessing problems regulating emotions across six domains: nonacceptance of emotional responses (e.g., “When I’m upset, I become embarrassed for feeling that way”), difficulties engaging in goal-directed behavior (e.g., “When I’m upset, I have difficulty focusing on other things”), impulse control difficulties (e.g., “I experience my emotions as overwhelming and out of control”), lack of emotion awareness (e.g., “I am attentive to my feelings”; reverse-coded), limited access to emotion regulation strategies (e.g., “When I’m upset, I believe that I will remain that way for a long time”), and lack of emotion clarity (e.g., “I have no idea how I am feeling”). Participants indicate how much each statement applies to them from 1 (almost never [0–10%]) to 5 (almost always [91–100%]). We utilized the full-scale score, calculated as the mean response across the 36 items (α = 0.93), which has been associated with self-regulation of negative moods, experiential avoidance, self-injurious behaviors, anxiety and depression, and sexual compulsivity (Gratz & Roemer, 2004; Pachankis et al., 2015).

Multidimensional Scale of Perceived Social Support (MSPSS; Zimet et al., 1990)

The MSPSS is a 12-item measure of the amount of perceived support from three sources: family (e.g., “I get the emotional help and support I need from my family”), friends (e.g., “I can talk about my problems with my friends”), and significant other (e.g., “There is a special person who is around when I am in need”), on a scale ranging from 1 (very strongly disagree) to 7 (very strongly agree). Inter-item consistency was high in the present study (α = 0.90).

Rathus Assertiveness Schedule (RAS; Rathus, 1973)

The RAS is a 30-item self-report measure of assertive behavior (e.g., “I am open and frank about my feelings”) rated from 1 (very uncharacteristic of me) to 6 (very characteristic of me). The item “I often don’t know what to say to attractive persons of the opposite sex” was replaced with “I often don’t know what to say to attractive persons of the same sex” (α = 0.87).

Analytic plan

To test intervention efficacy, we utilized an intent-to-treat approach by including all eligible randomized cases (n = 63). We first used t-tests and chi-square tests to examine demographic differences between the immediate treatment and waitlist control conditions (Table 1). As there were no significant demographic differences between conditions, we did not enter covariates into efficacy analyses. We used linear mixed models with maximum likelihood estimation to test condition, time, and condition × time interaction effects for all continuous outcomes (i.e., minority stress processes, universal psychosocial risk factors, mental health and health-risk behavior) and generalized linear mixed models with negative binomial distributions and maximum likelihood estimation to test these effects for all count outcomes (i.e., past-90-day number of condomless anal sex acts with casual partners, past-90-day number of heavy drinking days). Compound symmetry was used to model the covariance structure within participants.

In the first set of analyses, we examined the effect of immediate ESTEEM (n = 32) compared to 3-month wait (n = 31) by examining interactions between condition (treatment = 1, waitlist = 0) and time with data points limited to baseline assessment (= 0) and 3-month assessment (= 1) for both conditions. Therefore, we compared the effect of receiving ESTEEM versus waiting over three months. Effect sizes were calculated as d = 2t/√ (df) using the t statistic of the interaction. In a second set of analyses, we examined clinical significance of the changes by comparing the effect of condition, time, and their interaction in generalized linear mixed models predicting the odds of meeting clinical cutoffs on those measures for which cutoffs were available (i.e., CESD, ODSIS, OASIS, AUDIT, Sexual Compulsivity Scale) from baseline to 3-month assessment (i.e., from immediate pre-treatment to post-treatment for immediate treatment participants; from 3-month pre-treatment to immediate pre-treatment for waitlist participants). We converted odds ratios to proportions to provide more meaningful results. In the third set of analyses, we pooled data from both conditions in order to compare change across all participants (n = 63) from immediate pre-treatment (= 0) to post-treatment (= 1) (i.e., baseline to 3-month for immediate participants and 3-month to 6-month for waitlist participants). Pooled analyses take advantage of the fact that all participants ultimately received the intervention and are comparable to pre-post intervention comparisons in uncontrolled trials with the exception that the half of the participants in a waitlist controlled trial experienced the effects of waiting before receiving the intervention. Pooled analyses are particularly useful in waitlist controlled trials when the number of participants in each condition is relatively small. Finally, we limited analyses to 3-month (= 0) (i.e., post-intervention) and 6-month (= 1) (i.e., three months post-intervention) follow-up assessments within the immediate intervention condition to determine maintenance or change in the effects of the intervention over time. Namely, we examined the significance of the reduction in outcomes across these two periods for the immediate intervention condition, the only condition to complete follow-up assessments. For all analyses, we first examined intervention effects on primary mental and behavioral health outcomes and then examined effects on minority stress and universal processes.

Results

Primary Mental and Behavioral Health Outcomes

Condition comparisons

Limiting analyses to baseline and 3-month assessments to examine primary outcomes, we found significant condition × time interactions, suggesting improvements in alcohol use problems (d = 1.03), depressive symptoms as measured with the ODSIS (d = 0.55), sexual compulsivity (d = 0.76), condom use self-efficacy (d = 0.93), and past-90-days condomless anal sex with casual partners (d = 0.59), and marginally significant improvements in anxiety (d = 0.47) and past-90-day heavy drinking day (d = 0.32) (Table 2). However, no significant condition × time effects were found for depressive symptoms as measured with the CESD. Overall, effect sizes for primary outcomes were medium-to-large (mean d = 0.63) and in the expected direction.

Table 2.

Condition and time comparisons for primary mental and behavioral health outcomes

Immediate Intervention
Waitlist Control
Condition × Time a
Pooled Data b
Pre vs. Post
n = 32 n = 31 n = 63







Variable Mean SE Mean SE Est. 95%CI Mean SE Est. 95% CI
CESD −4.74 −11.18, 1.70 −6.56*** −9.93, −3.19
 3-month pre-treatment -- -- 25.90 1.85
 Immediate pre-treatment 27.69 1.83 23.19 2.14 14.40 1.76
 Post-treatment 19.83 2.05 18.41 2.03 9.5 3.1
 3-month follow-up 15.86 1.99 -- --
ODSIS −2.43* −4.90, 0.35 −3.06*** −4.36, −1.75
 3-month pre-treatment -- -- 8.10 0.77
 Immediate pre-treatment 8.16 0.76 7.08 0.88 7.56 0.60
 Post-treatment 4.43 0.85 4.70 0.84 4.51 0.62
 3-month follow-up 4.52 0.83 -- --
OASIS −2.14ŧ −4.61, 0.34 −3.04*** −4.39, −1.69
 3-month pre-treatment -- -- 8.07 0.67
 Immediate pre-treatment 8.03 0.66 6.89 0.78 7.52 0.53
 Post-treatment 4.69 0.75 4.35 0.74 4.48 0.56
 3-month follow-up 4.31 0.73 -- --
AUDIT −3.79** −5.94, −1.64 −3.09*** −4.00, −2.18
 3-month pre-treatment -- -- 10.39 1.03
 Immediate pre-treatment 11.34 1.01 10.59 1.10 10.97 0.78
 Post-treatment 7.48 1.07 8.45 1.07 7.88 0.79
 3-month follow-up 6.92 1.05 -- --
Sexual Compulsivity −5.09** −8.78, −1.40 −4.40*** −6.34, −2.46
 3-month pre-treatment -- -- 20.84 1.27
 Immediate pre-treatment 23.47 1.25 19.86 1.41 21.91 0.96
 Post-treatment 16.88 1.36 17.97 1.36 17.51 0.99
 3-month follow-up 18.54 1.33 -- --
Condom Use Self-efficacy 10.08** 3.86, 16.30 7.64** 3.26, 12.03,
 3-month pre-treatment -- -- 40.32 2.32
 Immediate pre-treatment 33.72 2.29 44.07 2.65 38.00 1.81
 Post-treatment 47.77 2.55 44.07 2.53 45.64 1.89
 3-month follow-up 46.81 2.48 -- --
# Days of Heavy Drinking (90 Day) −0.32ŧ −0.71, 0.07 −0.17ŧ −0.36, 0.29
 3-month pre-treatment -- -- 14.26 2.43
 Immediate pre-treatment 16.66 2.39 15.30 2.63 16.24 1.93
 Post-treatment 12.81 2.55 14.88 2.56 13.86 1.97
 3-month follow-up 12.01 2.51 -- --
# Condomless Anal Sex −1.09** −1.80, −.0.37 −0.65* −1.22, −0.09
Acts with Casual Partners (90 Day)
 3-month pre-treatment -- -- 5.84 1.24
 Immediate pre-treatment 4.53 1.22 7.38 1.43 5.90 1.03
 Post-treatment 1.80 1.43 3.74 1.38 3.07 1.11
 3-month follow-up 1.82 1.35 -- --
ŧ

p ≤ .10,

*

p ≤ .05,

**

p ≤ .01,

***

p ≤ .001

a

Condition × time effects compare immediate pre-treatment and post-treatment measures for the immediate intervention group against 3-month pre-treatment and immediate pre-treatment measures for the waitlist control group.

b

Pooled data compares immediate pre-treatment against post-treatment scores for all participants.

CESD=Center for Epidemiologic Studies Depression Scale; OASIS=Overall Anxiety Severity and Impairment Scale; ODSIS=Overall Depression Severity and Impairment Scale; AUDIT= Alcohol Use Disorders Identification Test

Clinical significance

To examine clinical significance, we modeled the reduction in the proportion of participants meeting or exceeding established clinical cutoffs from baseline to 3-month assessment on relevant outcomes. Significant condition × time interactions revealed stronger decreases in the proportion of immediate versus waitlist participants who continued to exceed the cutoff at three months on the CESD (90.6% to 49.2% for immediate, 77.4% to 72.4% for waitlist, p = 0.01), AUDIT (65.6% to 34.5% for immediate, 58.5% to 67.6% for waitlist, p = 0.004), and Sexual Compulsivity Scale (50.0% to 22.3% for immediate, 32.2% to 36.5% for waitlist, p = 0.04). No significant interaction effect was found for the ODSIS or OASIS.

Pooled analyses

Given our small sample size and limited power to find significant interaction effects, we examined simple linear pre-post treatment effects across all outcomes using data from all participants across both conditions. In these pooled analyses limited to immediate pre-treatment and immediate post-treatment assessments (Table 2), we found that participants experienced significant reductions in all primary outcomes from immediate pre-treatment to post-treatment, with the exception of past-90-day heavy drinking days, which was marginally statistically significant. Effect sizes were generally large (mean d = 1.10).

Follow-up assessment

For immediate treatment participants, the 6-month assessment served as a 3-month post-treatment follow-up allowing us to assess the persistence of or change in effects over time. As can be seen when comparing post-treatment and follow-up scores for the immediate condition in Tables 2 through 4, treatment effects were generally maintained at follow-up, as there were few significant differences between post-treatment and follow-up. However, sexual compulsivity significantly increased by an estimated 2.11 points (95% CI = 0.32, 3.90; p < 0.05), but this increase was below pre-treatment or clinical levels.

Table 4.

Condition and time comparisons for universal cognitive, affective, and behavioral processes

Immediate Intervention
Waitlist Control
Condition × Time a
Pooled Data b
Pre vs. Post
n = 32 n = 31 n = 63







Variable Mean SE Mean SE Est. 95%CI Mean SE Est. 95%CI
Rumination −4.04 −11.19, 3.09 −5.41** −9.25, −1.56
 3-month pre-treatment -- -- 57.71 2.49
 Immediate pre-treatment 65.75 2.39 53.50 2.72 60.60 2.00
 Post-treatment 56.95 2.62 52.70 2.61 55.20 2.06
 3-month follow-up 50.15 2.56 -- --
Emotion Dysregulation 3.06 −9.12, 15.25 −6.79ŧ −13.73, 0.16
 3-month pre-treatment -- -- 101.26 4.24
 Immediate pre-treatment 103.31 4.17 85.20 4.83 94.99 3.25
 Post-treatment 90.45 4.65 85.74 4.61 88.20 3.38
 3-month follow-up 88.76 4.52 -- --
Social Support 0.37 −0.12, 0.86 0.37** 0.12, 0.62
 3-month pre-treatment -- -- 4.56 0.25
 Immediate pre-treatment 4.14 0.24 4.81 0.27 4.44 0.19
 Post-treatment 4.74 0.26 4.84 0.26 4.81 0.19
 3-month follow-up 4.88 0.25 -- --
Assertiveness 2.40 −7.35, 12.14 7.48** 1.98, 12.98
 3-month pre-treatment -- -- −0.90 5.04
 Immediate pre-treatment −1.63 4.96 5.22 5.46 1.43 3.73
 Post-treatment 6.58 5.30 11.30 5.31 8.91 3.81
 3-month follow-up 11.32 5.21 -- --
ŧ

p ≤ .10,

*

p ≤ .05,

**

p ≤ .01,

***

p ≤ .001

a

Condition × time effects compare immediate pre-treatment and post-treatment measures for the immediate intervention group against 3-month pre-treatment and immediate pre-treatment measures for the waitlist control group.

b

Pooled data compares immediate pre-treatment against post-treatment scores for all participants.

Minority Stress and Universal Processes

No significant condition × time interaction effects were found for cognitive, affective, and behavioral minority stress processes or for universal processes (Tables 3 and 4), suggesting that receiving treatment did not have a differential impact on these processes compared to waitlist. All effect sizes for comparative reductions in minority stress and universal processes were small (mean d = 0.26) and in the expected direction. However, pooled analyses showed that all participants experienced reductions in all minority stress processes and universal processes from immediate pre-treatment to post-treatment with each of these reductions being statistically significant except for sexual orientation concealment. Pre-post intervention effect sizes for minority stress processes (mean d = 0.81) and universal processes (mean d = 0.76) were generally large. As can be seen when comparing post-treatment and follow-up scores for the immediate condition in Tables 2 through 4, treatment effects were generally maintained at follow-up, with rumination scores continuing to significantly decrease from post-treatment by and estimated 6.44 points (95% CI: 1.47, 11.41; p < 0.05).

Table 3.

Group and time comparisons for minority stress processes

Immediate Intervention
Waitlist Control
Condition × Time a
Pooled Data b
Pre vs. Post
n = 32 n = 31 n = 63







Variable Mean SE Mean SE Est. 95%CI Mean SE Est. 95%CI
Gay-Related Stress −0.17 −0.42, 0.08 −0.18** −0.29, −0.06
 3-month pre-treatment -- -- 1.71 0.09
 Immediate pre-treatment 1.72 0.09 1.65 0.10 1.69 0.07
 Post-treatment 1.52 0.10 1.55 0.10 1.51 0.07
 3-month follow-up 1.68 0.10 -- --
Rejection Sensitivity −1.80 −5.84, 2.24 −5.25*** −6.98, −3.52
 3-month pre-treatment -- -- 17.59 1.43
 Immediate pre-treatment 16.22 1.40 13.18 1.58 15.03 1.08
 Post-treatment 9.97 1.53 9.37 1.52 9.78 1.10
 3-month follow-up 10.07 1.49 -- --
Internalized Homophobia 0.09 −0.23, 0.41 −0.18* −0.35, −0.01
 3-month pre-treatment -- -- 1.84 0.12
 Immediate pre-treatment 1.74 0.12 1.56 0.13 1.62 0.08
 Post-treatment 1.55 0.13 1.45 0.13 1.45 0.09
 3-month follow-up 1.58 0.12 -- --
Concealment 0.16 −0.09, −0.42 −0.09 −0.20, 0.03
 3-month pre-treatment -- -- 1.72 0.11
 Immediate pre-treatment 1.53 0.11 1.47 0.12 1.48 0.08
 Post-treatment 1.43 0.12 1.39 0.12 1.40 0.08
 3-month follow-up 1.43 0.11 -- --
ŧ

p ≤.10,

*

p ≤ .05,

**

p ≤ .01,

***

p ≤ .001

a

Condition × time effects compare immediate pre-treatment and post-treatment measures for the immediate intervention group against 3-month pre-treatment and immediate pre-treatment measures for the waitlist control group.

b

Pooled data compares immediate pre-treatment against post-treatment scores for all participants.

Discussion

Compared to a waitlist condition, participation in ESTEEM significantly reduced depressive symptoms, alcohol use problems, sexual compulsivity, and condomless anal sex with casual partners, and improved condom use self-efficacy. Further, depressive symptoms, alcohol use, and sexual compulsivity showed clinically significant improvement using established clinical cutoffs. ESTEEM yielded marginally significantly greater improvements than waitlist in anxiety symptoms and past-90-day heavy drinking. A relatively brief psychological treatment such as ESTEEM, capable of simultaneously addressing young gay and bisexual men’s interrelated health threats, represents a promising public health tool given the life course persistence and emotional and financial cost of male sexual orientation health disparities as well as the societal consequences of stigma more generally (Hatzenbuehler, Phelan, & Link, 2013).

Several strengths of ESTEEM include its evidence-based cognitive behavioral platform, adaptations based on empirically supported components of minority stress theory and close consultation with mental health providers and community members, and its LGB-affirmative stance that promotes personal agency and resilience (Pachankis, 2014). Practical strengths include being based on a transdiagnostic platform (Barlow et al., 2010), which circumvents the need for training providers in multiple treatment packages, and providing a set of modules that target underlying risk factors, which have generalized effects across symptom presentations.

While ESTEEM improved most of the primary outcomes under investigation, compared to waitlist it did not significantly reduce the cognitive, affective, or behavioral minority stress processes or universal mental health risk factors through which ESTEEM was hypothesized to work. However, treatment effects for all minority stress processes and universal risk factors were in the expected direction, and pooled comparisons showed significant pre-post treatment improvement for all minority stress and universal processes except concealment and emotion dysregulation. Effect sizes uncovered in this preliminary study suggest that statistically significant effects would be found for all outcomes, minority stress process, and universal risk factors, except internalized homophobia, emotion dysregulation, and assertiveness, in a replicated study with approximately twice as many participants. In sum, while this initial test shows preliminary efficacy for significantly and meaningfully improving young gay and bisexual men’s syndemic health conditions, larger sample sizes would be needed to detect significant changes in the minority stress and universal processes that are hypothesized to underlie these conditions (Hatzenbuehler, 2009; Meyer, 2003).

The effects of ESTEEM on mental, behavioral, and sexual health can be understood in comparison to the effects found in other waitlist controlled trials of CBT interventions. For example, the effect of ESTEEM on depression is very similar to the average effect found across other waitlist controlled trials of CBT (Hofmann & Smits, 2008), but smaller than the effect found in the waitlist controlled trial of the non-adapted Unified Protocol. Whereas the Unified Protocol trial enrolled only participants with a clinical diagnosis, the present trial selected participants based on symptomatology; thus, effect sizes in tests of the Unified Protocol would be expected to be larger. The effect of ESTEEM on anxiety is somewhat lower than those found across other waitlist controlled trials of CBT interventions (Hofmann & Smits, 2008), although similar to the effects found in a waitlist controlled trial of the non-adapted Unified Protocol (Farchione et al., 2012). The effect of ESTEEM on reduction in alcohol use and alcohol use problems exceeds the average effect found across waitlist controlled trials of motivational interviewing (Burke, Arkowitz, & Menchola, 2003) and CBT (Magill & Ray, 2009). Finally, the effect of ESTEEM on reductions in condomless anal sex is very closely in line with the average effects found HIV risk reduction behavioral interventions (Herbst et al., 2005). Thus, overall, the effects of ESTEEM are comparable to those found in waitlist controlled trials of other CBT interventions, while a particular benefit of ESTEEM compared to standard CBT interventions is its ability to impact the full spectrum of these outcomes simultaneously.

Study results must also be interpreted in light of several experimental design limitations. A waitlist design controls for natural improvement over time, treatment expectancies, and reactive measurement effects, but cannot answer whether the tested treatment possesses more promise than another active treatment. Future tests of ESTEEM should employ a stronger comparison group than the waitlist condition used here. Currently, the question of whether standard cognitive behavioral approaches work similarly across sexual orientation groups remains to be answered (Cochran, 2001; Safren, 2005). Comparing ESTEEM to a non-adapted form of cognitive behavioral therapy, such as the non-adapted Unified Protocol, would establish whether minority stress additions improve treatment outcomes over existing treatments. Further, comparing ESTEEM with briefer, more portable stigma coping interventions, such as expressive writing (e.g., Pachankis & Goldfried, 2010), would determine the time- and cost-effectiveness of the treatment. Comparing ESTEEM to supportive counseling or other common forms of treatment would verify the benefit of ESTEEM’s evidence-based approach against standard care. While our 6-month retention rate is comparable to that of other behavioral health trials with this population (e.g., Parsons, Lelutiu-Weinberger, Botsko, & Golub, 2014), our session completion rate was lower than that found in tests of the non-adapted Unified Protocol among treatment-seeking adults in clinical settings (e.g., Farchione et al., 2012). Future tests of ESTEEM conducted among treatment-seeking samples in clinical settings might find an increased session completion rate. Given that our intent-to-treat analyses examined intervention effects across all randomized participants, including those who did not complete the treatment, our results may underestimate the effect of the intervention for those who receive its entirety. While participants completed survey measures by private computer and were randomized to condition only after completion of the baseline assessment, interviewers who administered the timeline follow-back during subsequent assessment appointments were not blind to study condition. Although interviewers were not formally made aware of study hypotheses and although all survey measures would be unaffected given that they were completed on private computer, future trials should employ blind reviewers at all assessment points. Finally, given that the present study employed only one fidelity rater, future studies ought to employ at least two raters to provide independent, reliable assessments of fidelity to intervention materials.

As effects of the non-adapted Unified Protocol on anxiety and depression have been shown to persist for at least 18 months post-treatment (Bullis, Fortune, Farchione, & Barlow, 2014), future tests of ESTEEM should include more frequent follow-up assessments over a longer period of time. Greater statistical power and more follow-up periods would also allow future researchers to determine whether changes in minority stress and universal processes account for changes in outcomes as predicted by minority stress theory (Meyer, 2003; Hatzenbuehler, 2009). Uncovering such treatment mechanisms would suggest the most promising psychosocial processes to target in future treatment approaches. Finally, examining the efficacy of ESTEEM as specifically adapted to other diverse sexual orientation groups, including lesbian and bisexual women and transgender individuals, seeking treatment in diverse settings (e.g., community clinics) and communities (e.g., rural), would extend the promise of this intervention to the full spectrum of sexuality and gender diversity affected by minority stress processes (Lehavot & Simoni, 2011; Operario, Yang, Reisner, Iwamoto, & Nemoto, 2014).

While several aspects of our assessment approach represent strengths, including use of an interviewer-based timeline follow-back assessment of risk behavior, our outcome measures were limited to non-diagnostic self-report scales. A potential explanation for the relatively weak effects found for minority stress processes and universal risk factors compared to the more robust effects found for primary outcome measures may be due to the fact that our self-report measures of the former constructs often assessed these processes as general or past-year traits and tendencies, rather than as modifiable cognitive, affective, or behavioral patterns across the 3-month span of our assessment periods. Additionally, some of the minority stress measurements, such as sexual orientation concealment and internalized homophobia, may have suffered from range restriction given the fact that the young gay and bisexual men in this study were relatively open and comfortable with their sexual orientation, living in an urban center, and mostly recruited through gay-specific venues. While we selected participants who were experiencing mental health problems and sexual risk behaviors, we did not select participants who were necessarily experiencing minority stress. Alternately, it is possible that modifying minority stress processes requires more intensive intervention efforts, more time to manifest, and/or concomitant reductions in the societal conditions (e.g., discriminatory laws, policies, community attitudes) that drive minority stress at the structural level and have been shown to interfere with the health benefit of behavioral interventions delivered to other stigmatized groups (Reid, Dovidio, Ballester, & Johnson, 2014). Future tests of ESTEEM might measure minority stress mediators as a momentary or daily fluctuating phenomenon (e.g., Eldahan, Pachankis, Rendina, Ventuneac, Grov, & Parsons, 2015), as physiological reactivity in response to an acute stressor (e.g., Dickerson & Kemeny, 2004), or as a combination of physiological reactivity contingent on structural drivers of minority stress (e.g., Hatzenbuehler & McLaughlin, 2014).

The maximum number of sessions in this study was 10, whereas other tests of the Unified Protocol typically allow substantially more (e.g., 18; Farchione et al., 2012). While we initially believed that 10 sessions would optimize the balance between instilling key skills against constrained provider resources, it is possible that allowing additional sessions would yield even stronger effects. The results found here suggest that an increased number of sessions might ultimately prove cost effective given the substantial range of mental and behavioral outcomes impacted in this preliminary trial. In fact, most brief interventions for gay and bisexual men are designed to target only one problem and typically only show effects specific to those problems (e.g., Parsons, Lelutiu-Weinberger, Botsko, & Golub, 2014). Examining whether the transdiagnostic approach of ESTEEM might synergistically enhance effects across outcomes to offset the greater cost of more sessions would represent an important future test. Given the ability of homework to enhance the effect of CBT interventions (Kazantis, Deane, & Ronan, 2006) and the importance of homework to ESTEEM, future tests of ESTEEM should track the amount of homework completed as a potential treatment moderator.

ESTEEM rests on the premise that minority stress processes hamper young gay and bisexual men’s mental and physical health and that minority stress coping represents a set of cognitive, affective, and behavior skills that can be learned in an LGB-affirmative therapy context (Eubanks-Carter, Burckell, & Goldfried, 2005; Pachankis & Goldfried, 2004). Structural forms of sexual minority stigma have rapidly improved in recent years in the U.S., and in some cases globally (Pew Research Center, 2013); continuing to reduce structural stigma to eliminate sexual orientation health disparities represents an essential public health goal. However, according to minority stress theory, until structural stigma is completely eradicated, gay and bisexual men will continue to disproportionately experience mental health problems and associated psychosocial conditions relative to heterosexuals. Therefore, interventions that promote health through teaching stigma coping represent an equally important use of public health resources. Indeed, one means of promoting structural change may be to empower marginalized individuals to establish that change (Cook, Purdie-Vaughns, Meyer, & Busch, 2014). The study presented here suggests that ESTEEM represents a promising means of empowering young gay and bisexual men to navigate stigma and of empowering the mental health treatment community to provide evidence-based, LGB-affirmative clinical services.

Figure 2.

Figure 2

Flow diagram of participants’ progress through the study phases.

Acknowledgments

This project was supported by a research grant from the National Institute of Mental Health (R34-MH096607; John E. Pachankis, Principal Investigator). H. Jonathon Rendina’s contribution to this project was supported, in part, by a grant from the National Institute on Drug Abuse (K01 DA039030). Steven A. Safren’s contribution was supported by a grant from the National Institute of Mental Health (K24 MH094214). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

The authors would like to acknowledge the contributions of the ESTEEM research team: Evie Arroyo, Aliza Boim, Demetria Cain, Michael Castro, Chris Cruz, Sitaji Gurung, Ethan Fusaris, Ruben Jimenez, Douglas Keeler, Alexa Michl, Brett Millar, Chloe Mirzayi, Theresa Navalta, Luis Nobrega, Brian Salfas, Martez Smith, Laurie Spacek, Rachel Proujansky, Anita Viswanath, Jonathan Warren, Thomas Whitfield.

Footnotes

The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

References

  1. American Psychological Association. Guidelines for psychological practice with lesbian, gay, and bisexual clients. Washington, DC: American Psychological Association; 2012. [DOI] [PubMed] [Google Scholar]
  2. Arnett JJ. Emerging adulthood: A theory of development from the late teens through the twenties. American Psychologist. 2000;55(5):469–480. doi: 10.1037/0003-066X.55.5.469. [DOI] [PubMed] [Google Scholar]
  3. Balsam KF, Martell CR, Safren SA. Affirmative cognitive-behavioral therapy with lesbian, gay, and bisexual people. In: Hays PA, Iwamasa GY, editors. Culturally responsive cognitive-behavioral therapy: Assessment, practice, and supervision. Washington, DC: American Psychological Association; 2006. pp. 223–243. [DOI] [Google Scholar]
  4. Barlow DH, Farchione TJ, Fairholme CP, Ellard KK, Boisseau CL, Allen LB, May JTE. Unified protocol for transdiagnostic treatment of emotional disorders: Therapist guide. Oxford University Press; 2010. [Google Scholar]
  5. Bullis JR, Fortune MR, Farchione TJ, Barlow DH. A preliminary investigation of the long-term outcome of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders. Comprehensive Psychiatry. 2014;55(8):1920–1927. doi: 10.1016/j.comppsych.2014.07.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Burke BL, Arkowitz H, Menchola M. The efficacy of motivational interviewing: a meta-analysis of controlled clinical trials. Journal of Consulting and Clinical Psychology. 2003;71(5):843–861. doi: 10.1037/0022-006X.71.5.843. [DOI] [PubMed] [Google Scholar]
  7. Campbell-Sills L, Norman SB, Craske MG, Sullivan G, Lang AJ, Chavira DA, Stein MB. Validation of a brief measure of anxiety-related severity and impairment: the Overall Anxiety Severity and Impairment Scale (OASIS) Journal of Affective Disorders. 2009;112(1):92–101. doi: 10.1016/j.jad.2008.03.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Carey MP, Carey KB, Maisto SA, Gordon CM, Weinhardt LS. Assessing sexual risk behaviour with the Timeline Followback (TLFB) approach: continued development and psychometric evaluation with psychiatric outpatients. International Journal of STD & AIDS. 2001;12(6):365–375. doi: 10.1258/0956462011923309. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Carney MA, Tennen H, Affleck G, del Boca FK, Kranzler HR. levels and patterns of alcohol consumption using timeline follow-back, daily diaries and real-time. Journal of Studies on Alcohol and Drugs. 1998;59(4):447–454. doi: 10.15288/jsa.1998.59.447. [DOI] [PubMed] [Google Scholar]
  10. Cochran SD. Emerging issues in research on lesbians’ and gay men’s mental health: Does sexual orientation really matter? American Psychologist. 2001;56(11):931–947. doi: 10.1037/0003-066X.56.11.931. [DOI] [PubMed] [Google Scholar]
  11. Cochran SD, Mays VM. Burden of psychiatric morbidity among lesbian, gay, and bisexual individuals in the California Quality of Life Survey. Journal of Abnormal Psychology. 2009;118(3):647–658. doi: 10.1037/a0016501. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Cochran SD, Sullivan JG, Mays VM. Prevalence of mental disorders, psychological distress, and mental health services use among lesbian, gay, and bisexual adults in the United States. Journal of Consulting and Clinical Psychology. 2003;71(1):53–61. doi: 10.1037/0022-006X.71.1.53. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Cook JE, Purdie-Vaughns V, Meyer IH, Busch JT. Intervening within and across levels: A multilevel approach to stigma and public health. Social Science & Medicine. 2014;103:101–109. doi: 10.1016/j.socscimed.2013.09.023. [DOI] [PubMed] [Google Scholar]
  14. Dickerson SS, Kemeny ME. Acute stressors and cortisol responses: a theoretical integration and synthesis of laboratory research. Psychological Bulletin. 2004;130(3):355–391. doi: 10.1037/0033-2909.130.3.355. [DOI] [PubMed] [Google Scholar]
  15. Eldahan AI, Pachankis JE, Rendina JR, Parsons JT. Unpublished manuscript. Yale School of Public Health. Yale University; New Haven, CT: 2015. Daily minority stress experiences and affect among gay and bisexual men: A 30-day diary study. [Google Scholar]
  16. Ellard KK, Fairholme CP, Boisseau CL, Farchione TJ, Barlow DH. Unified protocol for the transdiagnostic treatment of emotional disorders: Protocol development and initial outcome data. Cognitive and Behavioral Practice. 2010;17(1):88–101. doi: 10.1016/j.cbpra.2009.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Eubanks-Carter C, Burckell LA, Goldfried MR. Enhancing therapeutic effectiveness with lesbian, gay, and bisexual clients. Clinical Psychology: Science and Practice. 2005;12(1):1–18. doi: 10.1093/clipsy.bpi001. [DOI] [Google Scholar]
  18. Farchione TJ, Fairholme CP, Ellard KK, Boisseau CL, Thompson-Hollands J, Carl JR, Barlow DH. Unified protocol for transdiagnostic treatment of emotional disorders: A randomized controlled trial. Behavior Therapy. 2012;43(3):666–678. doi: 10.1016/j.beth.2012.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Feinstein BA, Goldfried MR, Davila J. The relationship between experiences of discrimination and mental health among lesbians and gay men: An examination of internalized homonegativity and rejection sensitivity as potential mechanisms. Journal of Consulting and Clinical Psychology. 2012;80(5):917–927. doi: 10.1037/a0029425. [DOI] [PubMed] [Google Scholar]
  20. Fergusson DM, Horwood LJ, Beautrais AL. Is sexual orientation related to mental health problems and suicidality in young people? Archives of General Psychiatry. 1999;56(10):876–880. doi: 10.1001/archpsyc.56.10.876. [DOI] [PubMed] [Google Scholar]
  21. Fergusson DM, Horwood L, Ridder EM, Beautrais AL. Sexual orientation and mental health in a birth cohort of young adults. Psychological Medicine. 2005;35(07):971–981. doi: 10.1017/S0033291704004222. [DOI] [PubMed] [Google Scholar]
  22. Frost DM, Meyer IH. Internalized homophobia and relationship quality among lesbians, gay men, and bisexuals. Journal of Counseling Psychology. 2009;56(1):97–109. doi: 10.1037/a0012844. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Gilman SE, Cochran SD, Mays VM, Ostrow D, Kessler RC. Risk of psychiatric disorders among individuals reporting same-sex sexual partners in the National Comorbidity Survey. American Journal of Public Health. 2001;91:933–939. doi: 10.1037/a0016441. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment. 2004;26(1):41–54. doi: 10.1007/s10862-008-9102-4. [DOI] [Google Scholar]
  25. Griner D, Smith TB. Culturally adapted mental health intervention: A meta- analytic review. Psychotherapy: Theory, Research, Practice, Training. 2006;43(4):531–548. doi: 10.1037/0033-3204.43.4.531. [DOI] [PubMed] [Google Scholar]
  26. Grov C, Parsons JT, Bimbi DS. Sexual compulsivity and sexual risk in gay and bisexual men. Archives of Sexual Behavior. 2010;39(4):940–949. doi: 10.1007/s10508-009-9483-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Hatzenbuehler ML. How does sexual minority stigma “get under the skin”? A psychological mediation framework. Psychological Bulletin. 2009;135(5):707–730. doi: 10.1037/a0016441. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Hatzenbuehler ML, McLaughlin KA. Structural stigma and hypothalamic– pituitary–adrenocortical axis reactivity in lesbian, gay, and bisexual young adults. Annals of Behavioral Medicine. 2014;47(1):39–47. doi: 10.1007/s12160-013-9556-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Hatzenbuehler ML, McLaughlin KA, Keyes KM, Hasin DS. The impact of institutional discrimination on psychiatric disorders in lesbian, gay, and bisexual populations: a prospective study. American Journal of Public Health. 2010;100(3):452–459. doi: 10.2105/AJPH.2009.168815. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Hatzenbuehler ML, McLaughlin KA, Nolen-Hoeksema S. Emotion regulation and internalizing symptoms in a longitudinal study of sexual minority and heterosexual adolescents. Journal of Child Psychology and Psychiatry. 2008;49(12):1270–1278. doi: 10.1111/j.1469-7610.2008.01924.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Hatzenbuehler ML, Nolen-Hoeksema S, Dovidio J. How does stigma “get under the skin”? The mediating role of emotion regulation. Psychological Science. 2009;20(10):1282–1289. doi: 10.1111/j.1467-9280.2009.02441.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Hatzenbuehler ML, Phelan JC, Link BG. Stigma as a fundamental cause of population health inequalities. American Journal of Public Health. 2013;103(5):813–821. doi: 10.2105/AJPH.2012.301069. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Herbst JH, Sherba RT, Crepaz N, DeLuca JB, Zohrabyan L, Stall RD HIV/AIDS Prevention Research Synthesis Team. A meta-analytic review of HIV behavioral interventions for reducing sexual risk behavior of men who have sex with men. Journal of Acquired Immune Deficiency Syndromes. 2005;39(2):228–241. [PubMed] [Google Scholar]
  34. Hofmann SG, Smits JA. Cognitive-behavioral therapy for adult anxiety disorders: A meta-analysis of randomized placebo-controlled trials. The Journal of Clinical Psychiatry. 2008;69(4):621–632. doi: 10.4088/JCP.v69n0415. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Hook JN, Hook JP, Davis DE, Worthington EL, Jr, Penberthy JK. Measuring sexual addiction and compulsivity: A critical review of instruments. Journal of Sex & Marital Therapy. 2010;36(3):227–260. doi: 10.1080/00926231003719673. [DOI] [PubMed] [Google Scholar]
  36. Kalichman SC, Rompa D. The sexual compulsivity scale: Further development and use with HIV-positive persons. Journal of Personality Assessment. 2001;76(3):379–395. doi: 10.1207/S15327752JPA7603_02. [DOI] [PubMed] [Google Scholar]
  37. Kaysen D, Lostutter TW, Goines MA. Cognitive processing therapy for acute stress disorder resulting from an anti-gay assault. Cognitive and Behavioral Practice. 2005;12(3):278–289. doi: 10.1016/S1077-7229(05)80050-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Kazantzis N, Deane FP, Ronan KR. Homework assignments in cognitive and behavioral therapy: A Meta-Analysis. Clinical Psychology: Science and Practice. 2000;7(2):189–202. doi: 10.1093/clipsy.7.2.189. [DOI] [Google Scholar]
  39. Lang AJ, Norman SB, Means-Christensen A, Stein MB. Abbreviated brief symptom inventory for use as an anxiety and depression screening instrument in primary care. Depression and Anxiety. 2009;26(6):537–543. doi: 10.1002/da.20471. [DOI] [PubMed] [Google Scholar]
  40. Lehavot K, Simoni JM. The impact of minority stress on mental health and substance use among sexual minority women. Journal of Consulting and Clinical Psychology. 2011;79(2):159–170. doi: 10.1037/a0022839. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Lewinsohn PM, Seeley JR, Roberts RE, Allen NB. Center for Epidemiologic Studies Depression Scale (CES-D) as a screening instrument for depression among community-residing older adults. Psychology and Aging. 1997;12(2):277–287. doi: 10.1037/0882-7974.12.2.277. [DOI] [PubMed] [Google Scholar]
  42. Lewis RJ, Derlega VJ, Griffin JL, Krowinski AC. Stressors for gay men and lesbians: Life stress, gay-related stress, stigma consciousness, and depressive symptoms. Journal of Social and Clinical Psychology. 2003;22(6):716–729. doi: 10.1521/jscp.22.6.716.22932. [DOI] [Google Scholar]
  43. Magill M, Ray LA. Cognitive-behavioral treatment with adult alcohol and illicit drug users: a meta-analysis of randomized controlled trials. Journal of Studies on Alcohol and Drugs. 2009;70(4):516–527. doi: 10.15288/jsad.2009.70.516. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Martin JL, Dean L. Unpublished manuscript. Columbia University, Mailman School of Public Health; 1992. Summary of measures: Mental health effects of AIDS on at- risk homosexual men. [Google Scholar]
  45. Mays VM, Cochran SD. Mental health correlates of perceived discrimination among lesbian, gay, and bisexual adults in the United States. American Journal of Public Health. 2001;91(11):1869–1876. doi: 10.2105/AJPH.91.11.1869. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Meyer IH. Minority stress and mental health in gay men. Journal of Health and Social Behavior. 1995:38–56. [PubMed] [Google Scholar]
  47. Meyer IH. Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: conceptual issues and research evidence. Psychological Bulletin. 2003;129(5):674–697. doi: 10.1037/0033-2909.129.5.674. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Meyer IH, Rossano L, Ellis JM, Bradford J. A brief telephone interview to identify lesbian and bisexual women in random digit dialing sampling. Journal of Sex Research. 2002;39(2):139–144. doi: 10.1080/00224490209552133. [DOI] [PubMed] [Google Scholar]
  49. Meyer IH, Schwartz S, Frost DM. Social patterning of stress and coping: Does disadvantaged social statuses confer more stress and fewer coping resources? Social Science & Medicine. 2008;67(3):368–379. doi: 10.1016/j.socscimed.2008.03.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Mustanski B, Garofalo R, Herrick A, Donenberg G. Psychosocial health problems increase risk for HIV among urban young men who have sex with men: preliminary evidence of a syndemic in need of attention. Annals of Behavioral Medicine. 2007;34(1):37–45. doi: 10.1007/BF02879919. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. National Advisory Mental Health Council’s Workgroup. From discovery to cure: Accelerating the development of new and personalized interventions for mental illness. Bethesda, MD: Department of Health and Human Services; 2010. [Google Scholar]
  52. Newcomb ME, Mustanski B. Internalized homophobia and internalizing mental health problems: A meta-analytic review. Clinical Psychology Review. 2010;30(8):1019–1029. doi: 10.1016/j.cpr.2010.07.003. [DOI] [PubMed] [Google Scholar]
  53. Newcomb ME, Mustanski B. Moderators of the relationship between internalized homophobia and risky sexual behavior in men who have sex with men: a meta-analysis. Archives of Sexual Behavior. 2011;40(1):189–199. doi: 10.1007/s10508-009-9573-8. [DOI] [PubMed] [Google Scholar]
  54. Norman SB, Hami Cissell S, Means-Christensen AJ, Stein MB. Development and validation of an overall anxiety severity and impairment scale (OASIS) Depression and Anxiety. 2006;23(4):245–249. doi: 10.1002/da.20182. [DOI] [PubMed] [Google Scholar]
  55. Operario D, Yang MF, Reisner SL, Iwamoto M, Nemoto T. Stigma and the syndemic of HIV-related health risk behaviors in a diverse sample of transgender women. Journal of Community Psychology. 2014;42(5):544–557. [Google Scholar]
  56. Pachankis JE. The psychological implications of concealing a stigma: A cognitive- affective-behavioral model. Psychological Bulletin. 2007;133:328–345. doi: 10.1037/0033-2909.133.2.328. [DOI] [PubMed] [Google Scholar]
  57. Pachankis JE. Uncovering clinical principles and techniques to address minority stress, mental health, and related health risks among gay and bisexual men. Clinical Psychology: Science and Practice. 2014;21:313–330. doi: 10.1111/cpsp.12078. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Pachankis JE. A transdiagnostic minority stress treatment approach for gay and bisexual men’s syndemic health conditions. Archives of Sexual Behavior. doi: 10.1007/s10508-015-0480-x. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Pachankis JE, Goldfried MR. Expressive writing for gay-related stress: Psychosocial benefits and mechanisms underlying improvement. Journal of Consulting and Clinical Psychology. 2010;78:98–110. doi: 10.1037/a0017580. [DOI] [PubMed] [Google Scholar]
  60. Pachankis JE, Hatzenbuehler ML, Starks TJ. The influence of structural stigma and rejection sensitivity on young sexual minority men’s daily tobacco and alcohol use. Social Science & Medicine. 2014;103:67–75. doi: 10.1016/j.socscimed.2013.10.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Pachankis JE, Goldfried MR. Clinical issues in working with lesbian, gay, and bisexual clients. Psychotherapy. 2004;41:227–246. doi: 10.1037/2329-0382.1.S.45. [DOI] [Google Scholar]
  62. Pachankis JE, Goldfried MR, Ramrattan M. Extension of the rejection sensitivity construct to the interpersonal functioning of gay men. Journal of Consulting and Clinical Psychology. 2008;76:306–317. doi: 10.1037/0022-006X.76.2.306. [DOI] [PubMed] [Google Scholar]
  63. Pachankis JE, Rendina HJ, Restar A, Ventuneac A, Parsons JT. A minority stress—emotion regulation model of sexual compulsivity among highly sexually active gay and bisexual men. Health Psychology. 2015 doi: 10.1037/hea0000180. [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Parsons JT, Lelutiu-Weinberger C, Botsko M, Golub SA. A randomized controlled trial utilizing motivational interviewing to reduce HIV risk and drug use in young gay and bisexual men. Journal of Consulting and Clinical Psychology. 2014;82(1):9–18. doi: 10.1037/a0035311. [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Parsons JT, Rendina HJ, Moody RL, Ventuneac A, Grov C. Syndemic production and sexual compulsivity/hypersexuality in highly sexually active gay and bisexual men: Further evidence for a three group conceptualization. Archives of Sexual Behavior. doi: 10.1007/s10508-015-0574-5. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Pew Research Center. Gay marriage and homosexuality. 2013 Retrieved from: www.pewresearch.org/topics/gay-marriage-and-homosexuality/
  67. Radloff LS. The CES-D scale a self-report depression scale for research in the general population. Applied psychological measurement. 1977;1(3):385–401. doi: 10.1177/014662167700100306. [DOI] [Google Scholar]
  68. Rathus SA. A 30-item schedule for assessing assertive behavior. Behavior therapy. 1973;4(3):398–406. doi: 10.1016/S0005-7894(73)80120-0. [DOI] [Google Scholar]
  69. Reid AE, Dovidio JF, Ballester E, Johnson BT. HIV prevention interventions to reduce sexual risk for African Americans: The influence of community-level stigma and psychological processes. Social Science & Medicine. 2014;103:118–125. doi: 10.1016/j.socscimed.2013.06.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Rendina HJ. Unpublished manuscript. Department of Psychology. The Graduate Center of the City University of New York; 2014. Hot And Bothered: The role of arousal and rejection sensitivity in dual process sexual decision making for gay and bisexual men. [Google Scholar]
  71. Saewyc EM. Research on adolescent sexual orientation: Development, health disparities, stigma, and resilience. Journal of Research on Adolescence. 2011;21(1):256–272. doi: 10.1111/j.1532-7795.2010.00727.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  72. Safren SA. Affirmative, evidence-based, and ethically sound psychotherapy with lesbian, gay, and bisexual clients. Clinical Psychology: Science and Practice. 2005;12(1):29–32. doi: 10.1093/clipsy.bpi003. [DOI] [Google Scholar]
  73. Safren SA, Heimberg RG. Depression, hopelessness, suicidality, and related factors in sexual minority and heterosexual adolescents. Journal of Consulting and Clinical Psychology. 1999;67(6):859–866. doi: 10.1037/0022-006X.67.6.859. [DOI] [PubMed] [Google Scholar]
  74. Safren SA, Reisner SL, Herrick A, Mimiaga MJ, Stall R. Mental health and HIV risk in men who have sex with men. Journal of Acquired Immune Deficiency Syndromes (1999) 2010;55(Suppl 2):S74. doi: 10.1097/QAI.0b013e3181fbc939. [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. Safren SA, Rogers T. Cognitive–behavioral therapy with gay, lesbian, and bisexual clients. Journal of Clinical Psychology. 2001;57(5):629–643. doi: 10.1002/jclp.1033. [DOI] [PubMed] [Google Scholar]
  76. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption-II. Addiction. 1993;88(6):791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x. [DOI] [PubMed] [Google Scholar]
  77. Sobell LC, Sobell MB. Timeline Follow–back: A technique for assessing self– reported alcohol consumption. In: Litten RZ, Allen JP, editors. Measuring Alcohol Consumption: Psychosocial and Biological Methods. Totowa, NJ: Humana Press; 1992. [Google Scholar]
  78. Stall R, Mills TC, Williamson J, Hart T, Greenwood G, Paul J, Catania JA. Association of co-occurring psychosocial health problems and increased vulnerability to HIV/AIDS among urban men who have sex with men. American Journal of Public Health. 2003;93(6):939–942. doi: 10.2105/AJPH.93.6.939. [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Treynor W, Gonzalez R, Nolen-Hoeksema S. Rumination reconsidered: A psychometric analysis. Cognitive Therapy and Research. 2003;27(3):247–259. doi: 10.1023/A:1023910315561. [DOI] [Google Scholar]
  80. Ventuneac A, Rendina HJ, Grov C, Mustanski B, Parsons JT. An item response theory analysis of the sexual compulsivity scale and its correspondence with the hypersexual disorder screening inventory among a sample of highly sexually active gay and bisexual men. The Journal of Sexual Medicine. 2015 doi: 10.1111/jsm.12783. [DOI] [PMC free article] [PubMed] [Google Scholar]
  81. Walsh K, Hope DA. LGB-affirmative cognitive behavioral treatment for social anxiety: A case study applying evidence-based practice principles. Cognitive and Behavioral Practice. 2010;17(1):56–65. doi: 10.1016/j.cbpra.2009.04.007. [DOI] [Google Scholar]
  82. Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. Journal of Personality Assessment. 1990;55(3–4):610–617. doi: 10.1080/00223891.1990.9674095. [DOI] [PubMed] [Google Scholar]

RESOURCES