Skip to main content
BMJ Open logoLink to BMJ Open
. 2019 Oct 22;9(10):e031099. doi: 10.1136/bmjopen-2019-031099

Resilience Against Depression Disparities (RADD): a protocol for a randomised comparative effectiveness trial for depression among predominantly low-income, racial/ethnic, sexual and gender minorities

Sylvanna Maria Vargas 1,2,3,, Ashley Wennerstrom 4,5, Nancy Alfaro 2, Thomas Belin 2,6, Krystal Griffith 2, Catherine Haywood 7,8, Felica Jones 9, Mitchell R Lunn 10,11, Diana Meyers 12, Jeanne Miranda 2,13, Juno Obedin-Maliver 10,11, Miranda Pollock 14, Cathy D Sherbourne 15, Benjamin F Springgate 14, Olivia K Sugarman 14,16,17, Emily Rey 18,19, Clarence Williams 9, Pluscedia Williams 9,20, Bowen Chung 2,15,21,22
PMCID: PMC6830623  PMID: 31641001

Abstract

Introduction

Depression is the leading cause of adult disability and common among sexual and gender minority (SGM) adults. The current study builds on findings showing the effectiveness of depression quality improvement (QI) and delivery of cognitive behavioural therapy (CBT) skills provided by community health workers in reducing depression. Depression QI approaches across healthcare and social/community services in safety-net settings have shown improvements in mental wellness, mental health quality of life and depression over 12 months. Further, a randomised study showed improved depression among low-income racial/ethnic minorities enrolled in a CBT-informed resiliency class (Building Resilience and Increasing Community Hope (B-RICH)). The current protocol describes a comparativeness effectiveness study to evaluate whether predominantly low-income, SGM racial/ethnic minority adults randomised to a CBT-informed resiliency class have improvements in depressive symptoms over and above community-engaged QI resources and training only.

Methods and analysis

The study approached three clusters of four to five programs serving predominantly SGM and racial/ethnic minority communities in the USA: two clusters in Los Angeles, California, and one in New Orleans, Louisiana. Clusters are comprised of one primary care, one mental health and two to three community agencies (eg, faith-based, social services/support, advocacy). All programs received depression QI training. The current study employed a community-partnered participatory research model to adapt the CBT-informed resiliency class, B-RICH+, to SGM communities. Study participants were screened and recruited in person from participating programs, and will complete baseline, 6- and 12-month survey follow-ups. Participants were depressed adults (8-item Patient Health Questionnaire ≥10; ≥18 years of age) who provided contact information. Enrolled participants were individually randomised to B-RICH+ or depression QI alone. Primary outcomes are depressive symptoms; secondary outcomes are mental health quality of life, mental wellness and physical health quality of life. Data collection for this study is ongoing.

Ethics and dissemination

The current study was approved by the UCLA Institutional Review Board. Study findings will be disseminated through scientific publications and community conferences.

Trial registration number

https://clinicaltrials.gov/ct2/show/NCT02986126

Keywords: depression and mood disorders, community partnered research, LGBTQ, SGM, racial/ ethnic minorities


Strengths and limitations of this study.

  • This study is among the first to examine a model to reduce depression disparities and meet treatment needs among predominantly low-income, racial/ethnic, sexual and gender minorities, an understudied population.

  • We did not gather service use data from healthcare agencies but rely instead on self-report data of such use.

  • Per our community-partnered discussions, we did not include any identity-based exclusion criteria, which allowed us to recruit participants who identified their sexual, gender and racial/ethnic minority status across a broad spectrum.

Introduction

Depressive symptoms and disorders are among the most common health conditions with a lifetime prevalence of 15% to 20% in adults.1 Depression is a leading cause of morbidity and is associated with increased healthcare costs.2 3 In the USA, depressive symptoms have similar prevalence across racial/ethnic groups, with slightly lower rates among African Americans than Euro-Americans,4–8 however, symptoms may be more severe among depressed African Americans.7 Sexual and gender minority (SGM) adults have higher rates of depressive symptoms and disorder than those who identify as heterosexual or cisgender.9–14 A meta-analysis of research spanning four decades showed that sexual minority (SM) adults were two times as likely as heterosexual people to experience lifetime or past-year depression.15 Existing evidence suggests transgender persons experience higher rates of depression than the general cisgender population.9 Eliminating health disparities by race/ethnicity, sexual orientation and gender identity are national priorities in the USA.9 16 17

Few studies have examined depression rates among racial/ethnic minority SGM people, with some, but not all, suggesting greater rates of depression than racial/ethnic minority heterosexuals.9 For example, one nationally representative study in the USA found higher rates of depression among Asian and Latinx SM respondents, compared with those who were heterosexual.11 In contrast, a study of SM adults in New York City showed higher rates of psychiatric disorders among Latinx and Euro-American adults in comparison to African Americans.18 Heterogeneity of depression prevalence rates among racial/ethnic and sexual minority adults may be due to variations in how sexual minority status is ascertained (eg, sexual behaviour or self-reported identity).9 Little is known about the depression of racial/ethnic minority transgender people, although a few studies suggest rates may be increased in comparison to cisgender racial/ethnic minorities.19 20 More research is needed to understand how depression affects racial/ethnic and sexual and gender minorities.

Even less is known about the depression care or outcomes of SGM racial/ethnic minority adults.9 Lesbian, gay, bisexual, transgender and queer (LGBTQ) adults are more likely than heterosexual or cisgender persons to seek mental health services.9 A few studies have found similar patterns among racial/ethnic minority SMs in comparison to heterosexuals,21 and some differences between SM racial/ethnic minorities and Euro-Americans.22 However, many adults with depression only receive treatment in primary care, where depression is common.2 3 23 Yet, in primary care, up to 50% of adult patients with depression may not be identified.24 Of those whose depression is identified, half, particularly racial/ethnic minorities, may not receive guideline-concordant treatment.16 25 26 Racial/ethnic minority patients receive lower quality care and show worse outcomes for depression than Euro-Americans.8 27–30 While limited research has examined quality of care received by SGM people, some studies show that perceived quality and utilisation of care is affected by providers’ knowledge about LGBTQ issues.9

To improve quality in depression treatment delivery, numerous studies have developed collaborative care models that integrate mental health treatment within primary care settings.31 32 As part of this effort, quality improvement (QI) programmes provide training on evidence-based interventions to healthcare providers.32–36 QI programmes are traditionally developed and disseminated by healthcare experts as part of primary care integration efforts to train providers in mental health practices.34–36 In over 79 randomised controlled trials, depression QI programmes reduced depression among diverse settings and patients.32 33 Even though QI programmes may reduce racial/ethnic outcome disparities in adults, residual symptoms and quality of life limitations may persist over time.37 38 Furthermore, limited availability of primary care limits the implementation of evidence-based, depression QI programmes in under-resourced communities.16 32 39 These problems are exacerbated by an array of factors contributing to mental health disparities among low-income SGM and racial/ethnic minority communities, including stigma, variable service availability, quality and coordination,9 16 26 31 40–42 and distrust in healthcare services and research due to the legacy of research abuses and unequal treatment.43–45

In general, limited evidence exists on the effect of depression interventions on outcomes for HIV-negative SGM people, particularly those who are also racial/ethnic minorities in low-resourced communities.9 13 14 46 47 However, structured psychotherapies — such as cognitive behavioural therapy (CBT)48 — are evidence-based treatments for improving depression outcomes and are effective among low-income, racial/ethnic minorities.34–36 49 50 A recent randomised-controlled trial similarly showed the effect of community and academic partnerships through developing a 7-session community health worker-led psychoeducation class (Building Resilience and Increasing Community Hope (B-RICH)), which was more effective than case management alone in reducing depression among racial/ethnic minorities (Chung et al, B-RICH). Similarly, prior work that extends depression QI training and implementation support to healthcare and community-based organisations (eg, faith-based, social services, senior centres) demonstrated that planning together with such agencies improves outcomes such as mental health-related quality of life and mental well-being over and above technical support alone in racial/ethnic low-income communities up to 3 years.34–36 51 52 This work points to the important role of working with patients and trusted community organisations to determine how and where to provide access to mental healthcare with trusted community organisations. Although a number of evidence-based approaches have been shown to improve depression outcomes more generally, few studies have focused on SGM racial/ethnic minorities.

Current study

Building on over 10 years of collaborative work in addressing mental health in Louisiana and California in the USA, our team employed a community-partnered participatory research (CPPR) approach53 to develop the SGM-focused Resilience Against Depression Disparities (RADD) study in New Orleans and Los Angeles. Using CPPR principles such as equal power, two-way knowledge exchange and shared resources, we engaged a wide variety of community and academic partners to shape the design, framing, scope, research questions, proposed measures and materials for this study.

As we created our study, partners emphasised that low-income, SGM racial/ethnic minorities likely faced higher rates of depression due to stigma, social exclusion, increased risk for interpersonal violence and added burden in seeking depression care. They also explained that in racial/ethnic minority, under-resourced communities, many SGM adults approach ‘coming out’ or disclosure of SGM status to non-trusted organisations with caution, since this might increase SGM patients’ risk of discrimination. This therefore signalled the importance of conducting depression treatment within trusted spaces and organisations. Further, as described below, our research and intervention development were sensitive to potential adverse consequences of unintended disclosure of SGM status.

Given the substantial evidence in the literature about approaches to improve depression outcomes even for racial/ethnic minorities, our partners felt that any randomised studies with a ‘usual care’ or waitlist condition for depression would be unethical despite the limited information about treatments for SGM racial/ethnic minorities. Finally, our community partners indicated that resilience-focused — rather than disease-focused — interventions may help address existing barriers to care. Therefore, the current study developed B-RICH+, a resiliency-oriented, CBT psychoeducational intervention tailored to SGM individuals. Based on our discussions with study partners, we developed the following objective: to evaluate the added value of SGM-tailored B-RICH+ over and above SGM-tailored depression QI resources and training on improving adult patients’ depressive symptoms and mental health quality of life, mental wellness and physical health quality of life.

Method

Study design

RADD is an individual-level, randomised comparative effectiveness study. Our trial assesses the effects of two interventions on depressive symptoms and participant engagement in service use, including speciality mental health services, primary care, substance abuse treatment programme, social services agencies and community-based and faith-based services where participants report receiving support. The two interventions compare: (1) B-RICH+, a depression CBT-based psychoeducation group; and (2) Resource for Services (RS), an evidence-based, program-level, SGM-tailored depression QI providing resources and training to enrolled healthcare and community agencies. All organisations from which participants were sampled were provided the opportunity to receive RS, with half of individual participants randomised to receive B-RICH+. Our study is registered under ClinicalTrials.gov (https://clinicaltrials.gov/ct2/show/NCT02986126) and will take place from August 2016 to March 2020.

Figure 1 provides an overview of the study. Participants were screened in person at community agencies and clinics, and then called on the telephone to complete baseline, 6- and 12-month follow-up surveys. Telephone surveys during baseline and follow-ups will be collected by the RAND Survey Research Group. Randomisation was determined based on a combination of demographics, site location and language during baseline interview. Participants were informed about their randomisation arm over the telephone at the end of their baseline interview. Participants who were randomised to B-RICH+ were contacted by the community health worker leading the resiliency class. To the extent possible, classes were held at times and locations convenient for the participants. Participants were informed that their participation in the RADD study was not contingent on their participating in the classes.

Figure 1.

Figure 1

Study overview illustrating recruitment, study enrolment and randomisation, data collection waves and study outcomes. B-RICH+, Building Resilience and Increasing Community Hope+; LGBTQ, lesbian, gay, bisexual, transgender and queer; PHQ-8, 8-item Patient Health Questionnaire.

Patient and public involvement

The RADD study employs a CPPR model. Community advocates, researchers, patients, providers and other stakeholders are collaborating throughout all phases of the research process53–56 including development of the research question, adapting the study and intervention materials to SGM communities and ongoing discussions about data collection and reducing participant burden, study data analysis and dissemination of findings. Our community partners belonged to the same diverse communities as did our study participants. Our community partners explained that although New Orleans and Los Angeles may be more SGM-friendly than other cities in the USA more generally, acceptance of SGM did not extend to specific neighbourhoods, where some people may fear ‘coming out’. Therefore, per community partners’ recommendations, we avoided unintended disclosure of our participants’ SGM status by using some study materials that did not indicate the SGM focus. For example, our study name focused on depression disparities but did not describe the population to avoid unintentionally outing a participant over the phone. Similarly, our contact materials (eg, postcards, letters, emails) did not reference SGM groups. However, community partners also stressed the importance of affirming sexual orientation and gender identity. Therefore, we included rainbow themes throughout our study materials (eg, pamphlets, handouts) to make them SGM-friendly and affirming.

The research is being conducted by the Community and Patient Powered Research Network (CPPRN) in Los Angeles and New Orleans. The CPPRN is part of the Patient-Centered Outcomes Research Institute’s network of Patient-Powered Research Network and Clinical Data Research Networks collectively known as PCORnet.

Interventions

Cultural adaptation process

We adapted both study interventions through meetings with individuals who represented the target community. We maintained the active core ingredients in depression treatments and developed relevant examples and changes to make the treatments more relevant to the community.57 Specific adaptations are provided below under each intervention description.

RS is an evidence-based depression QI toolkit developed for primary care,56 58 but adapted for health- and community-based programme clusters36 47 59–61 with tailoring for SGM individuals. RS provides support training to staff in participating agencies: licensed providers in clinical assessment, medication management and CBT; all staff in team management and non-clinical staff (eg, case managers) in addressing patient safety, screening, behavioural management skills (eg, behavioural activation, brief problem-solving) to enable education coordination and referral for depressed patients. As part of our cultural adaptation process, we added a training on SGM sensitivity, including education about sexual orientation and gender identity and issues that SGM persons face in seeking healthcare and other services. RS is offered as 12 webinars (three each on team management, medication management, psychotherapy and case management) with primary care on-site training.34–36

B-RICH+ is a 7-session psychoeducational intervention delivered by community health workers who belong to the SGM racial/ethnic minority community. The class is a manualised, CBT-informed intervention that teaches people skills to improve their mood and address depression symptoms. Community partners identified priorities for coping support and resources, and they adapted content from an existing CBT-based manual to support resiliency. We adapted examples and issues that were relevant to SGM persons, such as finding affirming social support and cognitive restructuring around how to cope with discrimination. Each session is 90 to 120 min, and classes can be delivered in both English and Spanish. This class does not provide therapy, but rather is designed to build skills for improving mood and enhancing resiliency in the face of stress. Classes are supplemented with optional automated mobile text reminders about basic concepts and follow-up for care (eg, appointment reminders). Text messages are delivered by an electronic platform known as CHORUS,62 the content of which was created through a series of participatory workshops with community stakeholders and designed to provide basic and quick tips for coping support and resources. Community partners identified priorities for coping support and resources, and they adapted content from an existing CBT-based manual to support resiliency.

Participants

We enrolled a randomised sample comprised of English-speaking and Spanish-speaking adults (≥18 years) who screened positive for depression on an 8-item Patient Health Questionnaire ((PHQ-8)≥10).63 Given that prior research and our community partners mentioned that SGM racial/ethnic minorities may not identify as LGBTQ,9 we did not create any inclusion/exclusion criteria around self-reported identity. Instead, we opted to recruit participants from organisations in Los Angeles and New Orleans that serve high proportions of SGM individuals, including federally qualified health centres (primary care, mental health and substance abuse centres), community-based agencies (faith-based, homeless-serving and those providing social services) and other community-trusted locations (LGBTQ-friendly bars, gyms). Of 1825 people screened, 465 met study eligibility criteria, 385 enrolled and 256 completed a set of baseline measures. We are conducting 6 month (estimated n=242, based on rate of attrition from past studies) and 12 month (estimated n=224) follow-ups via telephone. Participants who did not speak English or Spanish or were too impaired to complete screening were excluded.

Informed consent

Persons who agreed to be screened for eligibility were provided informed consent via an electronic platform, CHORUS, which allows for capture of an electronic signature on an electronic tablet. Participants were given a paper copy of the consent form. Those who met the eligibility criteria after completing the PHQ-8 screener were invited to enrol in the study. Enrolment included signing an additional electronic consent form that gave permission for survey staff to call at baseline, 6 and 12 month follow-up. Enrolment entailed providing contact information so that participants can be contacted later for baseline and follow-up surveys. Participants were informed that they can refuse to participate in any study component and may leave questions unanswered and remain in the study, with no consequences. To protect confidentiality, the current study obtained a Certificate of Confidentiality from the National Institute of Health, allowing the study to refuse to disclose research information to any civil, criminal, administrative, legislative or other preceding, except as required by law.

Data sources

Patient data are obtained from the study screener completed in person at service sites, as well as baseline, 6 and 12 month follow-up telephone survey interviews that are independent of visits for services. All participant data will be captured on secure computer systems. All data will be de-identified by assigning participants an identification number in order to protect confidentiality.

Primary outcome

Our primary outcome is change in depressive symptoms as measured by the PHQ-864 score at 6- and 12-months after baseline survey completion and randomisation.

Secondary outcomes

Secondary outcomes measured at 6 and 12 months post-intervention include mental health-related quality of life, as measured by the mental composite score (MCS) ≤40 from the 12-item short-form health survey (SF-12)64 65, a 3-item measure of mental wellness from the 36-item short-form health survey66 67 (eg, feeling calm or peaceful, having energy and being happy over the last 4 weeks) and physical health quality of life using the 12-item physical composite score from the SF-12.64 65

Additional study measures

Telephone baseline and follow-up survey data include depression, anxiety and bipolar disorder status assessed using the Computerised Adaptive Test-Mental Health (CAT-MH) tool.68 CAT-MH produces continuous symptom severity scores in the past 2 weeks by adapting the number of survey items based on participant response. Participants endorsing suicidality during this survey will be immediately contacted by a study clinician on call. Once a participant is identified by the CAT-MH of being at high risk for suicide, an automatic message will be automated to ultimately page a study clinician, and the participant’s survey will continue over the phone. The study clinician will contact the survey centre to receive the participant’s information. The study clinician will then call the participant within 30 min of being paged, once the participant has ended the phone survey. The clinician will conduct a risk assessment and provide a referral to care from a list of clinics in Los Angeles and New Orleans and the phone number for the US National Suicide Hotline. In cases of imminent danger, the study clinician will advise the participant to visit the nearest emergency room or the provider may call 911. Similarly, if a participant reports homocidality or cases of child or elderly abuse, a study clinician will be notified and contact the participant to conduct a risk assessment and make any necessary reporting as required by law.

Phone surveys also include indicators of history of hospitalisation and service use,34 35 medication,69 sexual behaviour,70 HIV testing status,71 post-traumatic stress,72 alcohol problems,73 substance abuse,74 chronic physical conditions,65 life difficulties,42 resilience,75 social support,76 employment status, work missed, perceived discrimination,77 internalised homophobia78 79 and ‘outness’ (ie, level of comfort and disclosure to others regarding sexual orientation and gender identity).80 All study measures are summarised in table 1. Measures were selected and developed in conjunction with community partners, who advised many of the topics assessed (eg, discrimination, outness, internalised homophobia) are important stressors relevant to depression in the community.

Table 1.

Overview of study measures

Domain assesse Reference Survey measure Number of items per measure Screener Baseline 6 month follow-up 12 month follow-up
Age Age 1 X
Level of education Education 1 X
Income Income 4 X
Marital status Marital status 1
Language Language 1 X
Housing Housing 1 X
Employment Employment 13 X X X X
Number of children living in household Number of children (<18) living in household 1 X
Sexual orientation 9 Sexual orientation 1 X
Sexual behaviour 71 Sexual behaviour 1 X
Sex assigned at birth 9 Sex assigned on birth certificate 1 X
Gender identity 9 Current gender identity Gender identity 1 X
Race/ethnicity Current racial/ethnic identity 1 X
Insured status Insurance status 1 X X X
Depressive disorders 69 CAT-MH (depression module with DSM-5 specifier) Max of 94 questions; module was adaptive X X X
Bipolar disorder 69 CAT-MH (mania module) Max of 11 questions; module was adaptive X
Generalised anxiety disorder 69 CAT-MH (anxiety module) Max 13 questions; module was adaptive X
Suicidality 69 CAT-MH (suicide module) Max of 3 questions; module was adaptive X X X
Psychosis 34 Single item inquiring about schizophrenia diagnosis 1 X X
PTSD 73 PTSD checklist for DSM-5 4 X X
Chronic medical conditions 66 MOS 36 18 X
HIV testing status 72 HIV testing status 8 X X
Stressful life events 42 Stressful life events 15 X X X
Social support 77 Social support 10 X X X
Everyday discrimination scale 78 Discrimination 16 X X
Internalised homonegativity 79 80 Internalised homophobia 6 X X
Outness Scale 81 Outness to social circle 18 X X
Use of alcohol/drugs 74 75 Alcohol/drug use 14 X X
General hospital services 34 35 General health services 13 X X X
Mental health services Mental health services 7 X X X
Substance abuse services Substance abuse services 6 X X X
Social & community-based services for depression/mental health Community-based services 7 X X X
Psychotropic medication 70 Medications 25 X X X
Depressive symptoms (8-item patient health questionnaire score) 64 Depression symptoms 8 X X X X
Mental wellness 67 68 MHI-5, MOS 36 4 X X X
Mental health 66 67 SF-12 -functioning
(MCS-12 mental health composite score &
PCS-12 physical health composite score)
15 X X X

CAT-MH, Computerised Adaptive Test-Mental Health; MCS, mental composite score; MHI, Mental Health Inventory; MOS, Medical Outcomes Study; PCS, physical composite score; PTSD, post-traumatic stress disorder; SF-12, 12-item short-form health survey.

Data safety and monitoring

A Data Safety and Monitoring Board (DSMB) comprised of a member of the community, a statistician and a behavioural health services researcher was formed, to provide external, independent oversight of the study. As an external, independent oversight board, DSMB members will monitor the study feasibility, data integrity and safety and ensure that monitoring is timely and effective. The DSMB will meet every other month on 1 hour conference calls and webinars from month 6 through month 30 of the proposed demonstration. All members of the DSMB have no conflicts of interests and are independent from the study funding agency.

Statistical analysis

We will use an intent-to-treat analysis in two steps. First, we will examine intervention effect at 6 months, comparing outcomes for B-RICH+ and RS versus RS only. We will fit linear regression models for continuous variables (PHQ-8) with intervention status as the independent variable, logistic regression models for binary outcomes (secondary outcome: MCS-12 ≤40) and Poisson (or negative binomial) for number of service use visits using 6 and 12 month data separately controlling for patient baseline measures for the same outcome, area (Los Angeles or New Orleans) and type of service use (health or community programme). Second, we will examine B-RICH+ effects relative to RS over 12 months. In models which include all time periods, we will account for repeated measurements within patients. We will treat time as a categorical variable and examine fixed effects for time, intervention condition and their interaction with regression adjustment for baseline and covariates. These models will allow us to examine the intervention effects at each time point, to evaluate effectiveness and sustainability, to measure the difference in effects between two follow-ups and to calculate average effects over time. We will use SAS MIXED for linear regressions, GLIMMIX for logistic regressions and Poisson regressions for repeated measures.81 We will perform sensitivity analyses with time as a continuous variable (ie, data collection time points) in mixed models.

Missing data

The main sources of missing data are item-level or participant-level non-response. By using telephone surveys assisted by computer programming to collect survey data, we minimise item non-response. We will do logical imputation for items and a hot-deck multiple imputation technique using a predictive mean matching method for item non-response,82 83 combining results from multiply imputed data using SAS PROC MIANALYZE to account for uncertainty in imputed values.83 Multiple logistic regressions will be used to evaluate baseline characteristics of participants that may differentiate dropouts from completers. To assess the extent to which attrition could bias results, we will employ techniques such as pattern mixture models as alternatives to imputation84–87 under ignorable models (ie, assuming items are missed randomly).83 88 89 In prior work, we incorporated weighting adjustments to represent units in the population that are not enrolled,90 and have used an approximate Bayesian bootstrap,91 stratifying on propensity scores that capture probability of response, to represent units in the sample where data are not available at all time points. Overall analyses will reflect weighting and multiple imputation for unit non-response. We will conduct sensitivity analyses reflecting uncertainty associated with predictions within models and in the choice of models, and will report sources of missing data at item-unit and participant-unit levels in reports and discuss potential impact of missing data on interpretation of findings.

Weights

We will create weights to account for the sampling design and to control for potential non-response bias.92 For example, for the 6 month follow-up survey, we will construct attrition weights by fitting logistic regression models to predict follow-up status from baseline predictors including socio-demographic and clinical variables stratified by the two intervention arms. The fitted logistic regression models will be used to derive the predicted probability for each individual respondent to remain in follow-up. The reciprocal of the predicted probability will be then used as the 6 month attrition weight for each participant. Similar methods will be used for 12 month analyses.

Multiple comparisons

We will consider Bonferroni and related methods incorporating bounds on the probability of a single false finding of significance. We will consider the false discovery rate comparing observed significance with expected order statistics from a uniform distribution.

Discussion

Little is known about how to address the depression that low-income SGM racial/ethnic-minorities face. Our study is among the first to use an randomised controlled trial to test whether a community health worker-led psychoeducational, resilience-focused intervention can improve depression among sexual, gender and racial/ethnic minorities in comparison to a culturally-adapted QI training. The study has several areas of potential significance. First, this study will provide important data to address a key scientific gap on how to improve depression outcomes for predominantly racial/ethnic SGM adults, especially for HIV-negative SGM groups. These data may inform how medical homes, community-based agencies and social service providers can implement evidence-based depression QI approaches and psychoeducation delivered by community health workers. Furthermore, this study may provide insight into how healthcare providers can best address mental health quality and outcome disparities with patient and community input. Ultimately, patient and stakeholder engagement through partnered research may accelerate science and translation of findings into practice.

Limitations

Although Los Angeles and New Orleans are comparatively SGM-friendly cities, this is not true for all their communities. Given that differences exist in how SGM racial/ethnic minorities identify, we targeted recruitment from sites that were considered relatively ’safe-spaces’ for SGM persons. Our study likely includes a subset of SGM racial/ethnic minorities, who do not necessarily generalise to other communities. Given the long history of community-partnered research in our team, it is possible our study findings may not generalise to other communities without similar partnerships. Furthermore, our study relies on self-report measures, which are subjective. For example, we asked participants about their service utilisation, but did not rely on chart or claims data from healthcare agencies. However, prior studies have shown that self-reported health service utilisation is valid.93 94

Ethics and dissemination

Louisiana State University and RAND have deferred approval to UCLA’s IRB. Analysis of study data, scientific presentations and peer-reviewed manuscripts will all be done in partnership with community and client partners. In addition to scientific publications, as part of our project grant requirements, we will promote dissemination to stakeholders through community conferences, which will take place in Los Angeles and New Orleans throughout the study. We will convene a partnered dissemination workgroup to develop strategies to disseminate research study findings to the local communities. These dissemination efforts may include online materials, email distribution lists, church meetings, printed storybooks, mailings to networks of community partners, presentations in community venues (eg, movie theatres, neighbourhood association meetings, booths at community fairs), social media and/or special features in newspapers/on radio.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @ObedinMaliver

Contributors: Contributorship: All authors listed below (1) made substantial contributions to the design of the study, collection of data and/or analyses of the data, (2) drafted or critically revised this manuscript for important intellectual content, (3) reviewed and approved the final draft before submission and (4) agreed to be accountable for all aspects of the study and manuscript. Following CPPR model of shared power, authors for this manuscript include academic researchers and community advisors. Specific contributions for points (1) and (2) are listed below: SMV: (1) design of the study and analyses of data, (2) drafted and critically revised manuscript; AW: (1) design of the study and analyses of data, (2) drafted and critically revised manuscript; NA: (1) design of the study and collection of data, (2) critically revised manuscript; TB: (1) analyses of data, (2) critically revised manuscript; KG: (1) design of the study and collection of data, (2) critically revised manuscript; CH: (1) design of the study, (2) critically revised manuscript; FJ: (1) design of the study, (2) critically revised manuscript; MRL: (1) design of the study, (2) critically revised manuscript; DM: (1) design of the study, (2) critically revised manuscript; JM: (1) design of the study, (2) critically revised manuscript; JOM: (1) design of the study, (2) critically revised manuscript; MP: (1) design of the study, collection of data and analyses of data, (2) critically revised manuscript; CDS: (1) design of the study, (2) critically revised manuscript; BFS: (1) design of the study, (2) critically revised manuscript; OKS: (1) design of the study, (2) critically revised manuscript; ER: (1) analyses of data, (2) critically revised manuscript; CW: (1) design of the study, (2) critically revised manuscript; PW: (1) design of the study, (2) critically revised manuscript; BC: (1) design of the study and analyses of data, (2) drafted and critically revised manuscript, (3) reviewed and approved the final draft before submission, (4) agreed to be accountable for all aspects of the study and the manuscript.

Funding: This study was supported by the Patient-Centered Outcomes Research Institute (PCORI, www.pcori.org), grant number: PPRND-1507-32173. SMV was supported through a Ford Foundation Predoctoral Fellowship. MRL and JOM were partially supported through a PCORI Award (PPRN-1501-26848) to MRL. JOM was also partially supported by a grant from the National Institute of Diabetes, Digestive and Kidney Disorders (1K12DK111028). JM was partly supported through a Substance Abuse and Mental Health Services Administration grant (SM080041-01) and a National Institute of Mental Health grant (P30MH058107-21). BC was also supported by the UCLA Clinical and Translational Science Institute/ National Center for Advancing Translational Sciences grant (UL1TR001881). The statements in this article are solely the responsibility of the authors and do not necessarily represent the views of PCORI, its Board of Governors or Methodology Committee.

Competing interests: None declared.

Patient consent for publication: Not required.

Ethics approval: The current study was approved by the UCLA Institutional Review Board.

Provenance and peer review: Not commissioned; externally peer reviewed.

References

  • 1. Kessler RC, Chiu WT, Demler O, et al. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National comorbidity survey replication. Arch Gen Psychiatry 2005;62:617–27. 10.1001/archpsyc.62.6.617 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Simon G, Ormel J, VonKorff M, et al. Health care costs associated with depressive and anxiety disorders in primary care. Am J Psychiatry 1995;152:352–7. 10.1176/ajp.152.3.352 [DOI] [PubMed] [Google Scholar]
  • 3. Unützer J, Patrick DL, Simon G, et al. Depressive symptoms and the cost of health services in HMO patients aged 65 years and older. A 4-year prospective study. JAMA 1997;277:1618–23. 10.1001/jama.1997.03540440052032 [DOI] [PubMed] [Google Scholar]
  • 4. Abe-Kim J, Takeuchi DT, Hong S, et al. Use of mental health-related services among immigrant and US-born Asian Americans: results from the National Latino and Asian American study. Am J Public Health 2007;97:91–8. 10.2105/AJPH.2006.098541 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Alegria M, Takeuchi D, Canino G, et al. Considering context, place and culture: the National Latino and Asian American study. Int J Methods Psychiatr Res 2004;13:208–20. 10.1002/mpr.178 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Takeuchi DT, Alegría M, Jackson JS, et al. Immigration and mental health: diverse findings in Asian, black, and Latino populations. Am J Public Health 2007;97:11–12. 10.2105/AJPH.2006.103911 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Williams DR, González HM, Neighbors H, et al. Prevalence and distribution of major depressive disorder in African Americans, Caribbean blacks, and non-Hispanic whites: results from the National survey of American life. Arch Gen Psychiatry 2007;64:305–15. 10.1001/archpsyc.64.3.305 [DOI] [PubMed] [Google Scholar]
  • 8. González HM, Vega WA, Williams DR, et al. Depression care in the United States: too little for too few. Arch Gen Psychiatry 2010;67:37–46. 10.1001/archgenpsychiatry.2009.168 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Institute of Medicine The Health of Lesbian, Gay, Bisexual, and Transgender People: Building a Foundation for Better Understanding. Washington, D.C.: National Academies Press, 2011. [PubMed] [Google Scholar]
  • 10. Bostwick WB, Boyd CJ, Hughes TL, et al. Dimensions of sexual orientation and the prevalence of mood and anxiety disorders in the United States. Am J Public Health 2010;100:468–75. 10.2105/AJPH.2008.152942 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Cochran SD, Mays VM, Alegria M, et al. Mental health and substance use disorders among Latino and Asian American lesbian, gay, and bisexual adults. J Consult Clin Psychol 2007;75:785–94. 10.1037/0022-006X.75.5.785 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Operario D, Gamarel KE, Grin BM, et al. Sexual minority health disparities in adult men and women in the United States: National health and nutrition examination survey, 2001–2010. Am J Public Health 2015;105:e27–34. 10.2105/AJPH.2015.302762 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Strutz KL, Herring AH, Halpern CT. Health disparities among young adult sexual minorities in the U.S. Am J Prev Med 2015;48:76–88. 10.1016/j.amepre.2014.07.038 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Herek GM, Garnets LD. Sexual orientation and mental health. Annu Rev Clin Psychol 2007;3:353–75. 10.1146/annurev.clinpsy.3.022806.091510 [DOI] [PubMed] [Google Scholar]
  • 15. King M, Semlyen J, Tai SS, et al. A systematic review of mental disorder, suicide, and deliberate self harm in lesbian, gay and bisexual people. BMC Psychiatry 2008;8:70 10.1186/1471-244X-8-70 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. U.S. Department of Health and Human Services Mental Health: Culture, Race, andEthnicity - A Supplement To Mental Health: A Report of the Surgeon General. Rockville: USDHHS, 2001. [Google Scholar]
  • 17. U.S. Department of Health and Human Services Advancing LGBTQT Health & Well-Being: 2014 Report, 2014. Available: http://www.hhs.gov/programs/topic-sites/LGBTQt/index.html [Accessed October 9, 2015].
  • 18. Meyer IH, Dietrich J, Schwartz S. Lifetime prevalence of mental disorders and suicide attempts in diverse lesbian, gay, and bisexual populations. Am J Public Health 2008;98:1004–6. 10.2105/AJPH.2006.096826 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Lytle MC, Blosnich JR, Kamen C. The association of multiple identities with Self-Directed violence and depression among transgender individuals. Suicide Life Threat Behav 2016;46:535–44. 10.1111/sltb.12234 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Bauermeister JA, Goldenberg T, Connochie D, et al. Psychosocial disparities among racial/ethnic minority transgender young adults and young men who have sex with men living in Detroit. Transgend Health 2016;1:279–90. 10.1089/trgh.2016.0027 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Matthews AK, Hughes TL. Mental health service use by African American women: exploration of subpopulation differences. Cultur Divers Ethnic Minor Psychol 2001;7:75–87. 10.1037/1099-9809.7.1.75 [DOI] [PubMed] [Google Scholar]
  • 22. Macapagal K, Bhatia R, Greene GJ. Differences in healthcare access, use, and experiences within a community sample of racially diverse lesbian, gay, bisexual, transgender, and questioning emerging adults. LGBT Health 2016;3:434–42. 10.1089/lgbt.2015.0124 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Unützer J, Katon W, Williams JW, et al. Improving primary care for depression in late life: the design of a multicenter randomized trial. Med Care 2001;39:785–99. 10.1097/00005650-200108000-00005 [DOI] [PubMed] [Google Scholar]
  • 24. Mitchell AJ, Vaze A, Rao S. Clinical diagnosis of depression in primary care: a meta-analysis. Lancet 2009;374:609–19. 10.1016/S0140-6736(09)60879-5 [DOI] [PubMed] [Google Scholar]
  • 25. Wells KB. Caring for depression in primary care: defining and illustrating the policy context. J Clin Psychiatry 1997;58 Suppl 1:24–7. [PubMed] [Google Scholar]
  • 26. Institute of Medicine Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care. Washington, D.C.: National Academies Press, 2003. [PubMed] [Google Scholar]
  • 27. Wang PS, Berglund P, Kessler RC. Recent care of common mental disorders in the United States. J Gen Intern Med 2000;15:284–92. 10.1046/j.1525-1497.2000.9908044.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Miranda J, McGuire TG, Williams DR, et al. Mental health in the context of health disparities. Am J Psychiatry 2008;165:1102–8. 10.1176/appi.ajp.2008.08030333 [DOI] [PubMed] [Google Scholar]
  • 29. Kessler RC, Heeringa S, Lakoma MD, et al. Individual and societal effects of mental disorders on earnings in the United States: results from the National comorbidity survey replication. Am J Psychiatry 2008;165:703 10.1176/appi.ajp.2008.08010126 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. González HM, Tarraf W, Whitfield KE, et al. The epidemiology of major depression and ethnicity in the United States. J Psychiatr Res 2010;44:1043–51. 10.1016/j.jpsychires.2010.03.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. SAMHSA-HRSA Behavioral Health Homes for People with Mental Health & Substance Use Conditions: The Core Clinical Features. Wasington: Center for Integrated Health Solutions, 2012. [Google Scholar]
  • 32. Archer J, Bower P, Gilbody S, et al. Collaborative care for depression and anxiety problems. Cochrane Database Syst Rev 2012;10 10.1002/14651858.CD006525.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Gilbody S, Bower P, Fletcher J, et al. Collaborative care for depression: a cumulative meta-analysis and review of longer-term outcomes. Arch Intern Med 2006;166:2314 10.1001/archinte.166.21.2314 [DOI] [PubMed] [Google Scholar]
  • 34. Wells KB, Jones L, Chung B, et al. Community-partnered cluster-randomized comparative effectiveness trial of community engagement and planning or resources for services to address depression disparities. J Gen Intern Med 2013;28:1268–78. 10.1007/s11606-013-2484-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Chung B, Ong M, Ettner SL, et al. 12-Month outcomes of community engagement versus technical assistance to implement depression collaborative care: a partnered, cluster, randomized, comparative effectiveness trial. Ann Intern Med 2014;161:S23–34. 10.7326/M13-3011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Chung B, Ngo VK, Ong MK, et al. Participation in training for depression care quality improvement: a randomized trial of community engagement or technical support. Psychiatr Serv 2015;66:831–9. 10.1176/appi.ps.201400099 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Plough A, Fielding JE, Chandra A, et al. Building community disaster resilience: perspectives from a large urban County department of public health. Am J Public Health 2013;103:1190–7. 10.2105/AJPH.2013.301268 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Areán PA, Ayalon L, Hunkeler E, et al. Improving depression care for older, minority patients in primary care. Med Care 2005;43:381–90. 10.1097/01.mlr.0000156852.09920.b1 [DOI] [PubMed] [Google Scholar]
  • 39. U.S. Department of Health and Human Services Hhs action plan to reduce racial and ethnic disparities: a nation free of disparities in health and health care. Washington, D.C: U.S. Department of Health and Human Services, 2011. [Google Scholar]
  • 40. U.S. Department of Health and Human Services New Freedom Commission on MentalHealth: Achieving the Promise: Transforming Mental Health in America. Final report. Rockville: USDHHS: SMA-03—3832, 2003. [Google Scholar]
  • 41. Institute of Medicine Adaptation to Mental Health and Addictive Disorders: Improving the Quality of Health Care for Mental and Substance-Use Conditions. Washington, D.C: National Academies Press, 2006. [Google Scholar]
  • 42. Roeloffs C, Sherbourne C, Unützer J, et al. Stigma and depression among primary care patients. Gen Hosp Psychiatry 2003;25:311–5. 10.1016/S0163-8343(03)00066-5 [DOI] [PubMed] [Google Scholar]
  • 43. Gamble VN. Under the shadow of tuskegee: African Americans and health care. Am J Public Health 1997;87:1773–8. 10.2105/AJPH.87.11.1773 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Corbie-Smith G, Research AKRJ. Research and Ethics: A Legacy of Distrust. 2nd Edition San Francisco: Josey-Bass Publishers, 2001. [Google Scholar]
  • 45. Brotman S, Ryan B, Cormier R. The health and social service needs of gay and lesbian elders and their families in Canada. Gerontologist 2003;43:192–202. 10.1093/geront/43.2.192 [DOI] [PubMed] [Google Scholar]
  • 46. Rozbroj T, Lyons A, Pitts M, et al. Assessing the applicability of e-therapies for depression, anxiety, and other mood disorders among lesbians and gay men: analysis of 24 web- and mobile phone-based self-help interventions. J Med Internet Res 2014;16:e166 10.2196/jmir.3529 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Pachankis JE, Hatzenbuehler ML, Rendina HJ, et al. LGB-affirmative cognitive-behavioral therapy for young adult gay and bisexual men: a randomized controlled trial of a transdiagnostic minority stress approach. J Consult Clin Psychol 2015;83:875–89. 10.1037/ccp0000037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Miranda J, Azocar F, Organista KC, et al. Treatment of depression among impoverished primary care patients from ethnic minority groups. Psychiatr Serv 2003;54:219–25. 10.1176/appi.ps.54.2.219 [DOI] [PubMed] [Google Scholar]
  • 49. Miranda J, Chung JY, Green BL, et al. Treating depression in predominantly low-income young minority women: a randomized controlled trial. JAMA 2003;290:57–65. 10.1001/jama.290.1.57 [DOI] [PubMed] [Google Scholar]
  • 50. Miranda J, Green BL, Krupnick JL, et al. One-Year outcomes of a randomized clinical trial treating depression in low-income minority women. J Consult Clin Psychol 2006;74:99–111. 10.1037/0022-006X.74.1.99 [DOI] [PubMed] [Google Scholar]
  • 51. Arevian AC, Jones F, Tang L, et al. Depression remission from community coalitions versus individual program support for services: findings from community partners in care, Los Angeles, California, 2010-2016. Am J Public Health 2019;109:S205–13. 10.2105/AJPH.2019.305082 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. Wells KB, Tang L, Miranda J, et al. The effects of quality improvement for depression in primary care at nine years: results from a randomized, controlled group-level trial. Health Serv Res 2008;43:1952–74. 10.1111/j.1475-6773.2008.00871.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53. Jones L, Wells K. Strategies for academic and clinician engagement in community-participatory partnered research. JAMA 2007;297:407–10. 10.1001/jama.297.4.407 [DOI] [PubMed] [Google Scholar]
  • 54. Jones L, Wells K, Norris K, et al. The vision, Valley, and victory of community engagement. Ethn Dis 2009;19. [PMC free article] [PubMed] [Google Scholar]
  • 55. Wells K, Jones L. "Research" in community-partnered, participatory research. JAMA 2009;302:320–1. 10.1001/jama.2009.1033 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. Springgate B, Jones C, Allen C, et al. A community-based participatory assessment of health care needs in post-Katrina new Orleans 2007.
  • 57. Miranda J, Nakamura R, Bernal G. Including ethnic minorities in mental health intervention research: a practical approach to a long-standing problem. Cult Med Psychiatry 2003;27:467–86. 10.1023/B:MEDI.0000005484.26741.79 [DOI] [PubMed] [Google Scholar]
  • 58. Meyers D, Allen III CE, Dunn D, et al. Community perspectives on post-Katrina mental health recovery in New Orleans. Ethn Dis 2011;21. [PMC free article] [PubMed] [Google Scholar]
  • 59. Wennerstrom A, Vannoy SD, Allen C. Community-Based participatory development of a community health worker mental health outreach role to extend collaborative care in post-Katrina new Orleans. Ethn Dis 2011;21. [PMC free article] [PubMed] [Google Scholar]
  • 60. Chung B, Jones L, Dixon EL, et al. Using a community partnered participatory research approach to implement a randomized controlled trial: planning community partners in care. J Health Care Poor Underserved 2010;21:780–95. 10.1353/hpu.0.0345 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Springgate BF, Wennerstrom A, Meyers D, et al. Building community resilience through mental health infrastructure and training in post-Katrina new Orleans. Ethn Dis 2011;21. [PMC free article] [PubMed] [Google Scholar]
  • 62. Arevian AC, O'Hora J, Jones F, et al. Participatory technology development to enhance community resilience. Ethn Dis 2018;28:493–502. 10.18865/ed.28.S2.493 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63. Kroenke K, Strine TW, Spitzer RL, et al. The PHQ-8 as a measure of current depression in the general population. J Affect Disord 2009;114:163–73. 10.1016/j.jad.2008.06.026 [DOI] [PubMed] [Google Scholar]
  • 64. Ware J, Kosinski M, Keller SD. A 12-Item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care 1996;34:220–33. 10.1097/00005650-199603000-00003 [DOI] [PubMed] [Google Scholar]
  • 65. Ware JE, Kosinski M, Turner-Bowker DM, et al. How to score version 2 of the SF-12 health survey (with a supplement documenting version 1). QualityMetric Incorporated 2002. [Google Scholar]
  • 66. Ware JE, Sherbourne CD. The mos 36-item short-form health survey (SF-36). I. conceptual framework and item selection. Med Care 1992;30:473–83. [PubMed] [Google Scholar]
  • 67. Berwick DM, Murphy JM, Goldman PA, et al. Performance of a five-item mental health screening test. Med Care 1991;29:169–76. 10.1097/00005650-199102000-00008 [DOI] [PubMed] [Google Scholar]
  • 68. Gibbons RD, Weiss DJ, Pilkonis PA, et al. Development of the CAT-ANX: a computerized adaptive test for anxiety. Am J Psychiatry 2014;171:187–94. 10.1176/appi.ajp.2013.13020178 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69. Schoenbaum M, Unützer J, Sherbourne C, et al. Cost-Effectiveness of practice-initiated quality improvement for depression. JAMA 2001;286:1325–30. 10.1001/jama.286.11.1325 [DOI] [PubMed] [Google Scholar]
  • 70. Centers for Disease Control and Prevention National HIV Behavioral Surveillance (NHBS) MSM Survey [Measurement instrument]. 2016.
  • 71. Wilson EC, Garofalo R, Harris RD, et al. Adolescent medicine trials network for HIV/AIDS interventions. (2009). transgender female youth and sex work: HIV risk and a comparison of life factors related to engagement in sex work. AIDS and Behavior 2009;13:902–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72. Weathers FW, Litz BT, Keane TM, et al. The PTSD checklist for DSM-5 (PCL-5). National center for PTSD 2013.
  • 73. Bush K, Kivlahan DR, McDonell MB, et al. The audit alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. ambulatory care quality improvement project (ACQUIP). alcohol use disorders identification test. Arch Intern Med 1998;158:1789–95. 10.1001/archinte.158.16.1789 [DOI] [PubMed] [Google Scholar]
  • 74. Bohn MJ, Babor T, Kranzler HR. Validity of the drug abuse screening test (DAST-10) in inpatient substance abusers. Problems of Drug Dependence 1991;119:233–5. [Google Scholar]
  • 75. Wagnild GM, Young HM. Development and psychometric evaluation of the resilience scale. Journal of Nursing Measurement 1993. [PubMed] [Google Scholar]
  • 76. Sherbourne CD, Edelen MO, Zhou A, et al. How a therapy-based quality improvement intervention for depression affected life events and psychological well-being over time: a 9-year longitudinal analysis. Med Care 2008;46. [DOI] [PubMed] [Google Scholar]
  • 77. Williams DR, Yu Y, Jackson JS, et al. “Racial Differences in Physical and Mental Health: Socioeconomic Status, Stress, and Discrimination.”. Journal of Health Psychology 1997;2:335–51. [DOI] [PubMed] [Google Scholar]
  • 78. Herek GM, Gillis JR, Cogan JC. Internalized stigma among sexual minority adults: insights from a social psychological perspective. Journal of Counseling Psychology 2009;56:32. [Google Scholar]
  • 79. Lunn MR, Lubensky M, Hunt C, et al. A digital health research platform for community engagement, recruitment, and retention of sexual and gender minority adults in a national longitudinal cohort study – the pride study. Journal of the American Medical Informatics Association, 00(0) 2019:1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80. Miranda J, Storms M. Psychological adjustment of lesbians and gay men. Journal of Counseling & Development 1989;68:41–5. [Google Scholar]
  • 81. Littell RC, Milliken G, Stroup W, et al. Sas system for mixed models. Cary, NC: SAS Institute Inc, 1996. [Google Scholar]
  • 82. Little RJA. Missing-data adjustments in large surveys. Journal of Business & Economic Statistics 1988;6:287–96. [Google Scholar]
  • 83. Rubin DB. Inference and missing data. Biometrika 1976;63:581–92. [Google Scholar]
  • 84. Diggle P, Kenward MG. Informative drop-out in longitudinal data analysis. Applied Statistics 1994;43:49–93. [Google Scholar]
  • 85. Little RJA. Pattern-mixture models for multivariate incomplete data. Journal of the American Statistical Association 1993;88:125–34. [Google Scholar]
  • 86. Hedeker D, Gibbons RD. Application of random-effects pattern-mixture models for missing data in longitudinal studies. Psychol Methods 1997;2:64–78. 10.1037/1082-989X.2.1.64 [DOI] [Google Scholar]
  • 87. Rosenbaum P. Observational studies. New York: Spinger-Verlag, 1995. [Google Scholar]
  • 88. Rubin D. Multiple imputation for nonresponse in surveys. Hoboken, NJ: John Wiley & Sons, 1987. [Google Scholar]
  • 89. Little RJA, Rubin DB. Statistical analysis with missing data. vol 4. New York: Wiley, 1987. [Google Scholar]
  • 90. McCaffrey DF, Duan N, Morton SC. Propagation of nonresponse weights for censoring in multi-phase screening in complex sample designs. Health Services and Outcomes Research Methodology 2000;1:213–31. 10.1023/A:1011471725335 [DOI] [Google Scholar]
  • 91. Lavori PW, Dawson R, Shera D. A multiple imputation strategy for clinical trials with truncation of patient data. Stat Med 1995;14:1913–25. 10.1002/sim.4780141707 [DOI] [PubMed] [Google Scholar]
  • 92. Korn EL, Graubard BI. Analysis of health surveys. Hoboken, New Jersey: Wiley-Interscience, 1999. [Google Scholar]
  • 93. Tisnado DM, Adams JL, Liu H, et al. What is the concordance between the medical record and patient self-report as data sources for ambulatory care? Med Care 2006;44:132–40. 10.1097/01.mlr.0000196952.15921.bf [DOI] [PubMed] [Google Scholar]
  • 94. Rozario PA, Morrow-Howell N, Proctor E. Comparing the Congruency of self-report and provider records of depressed elders' service use by provider type. Med Care 2004;42:952–9. 10.1097/00005650-200410000-00003 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES