Abstract
Background
Schools are critical venues for supporting LGBTQ+ youth well-being. Implementing LGBTQ-supportive practices can decrease experiences of stigmatization, discrimination, and victimization that lead to adverse mental health outcomes like anxiety, depression, and suicidality. However, schools are also subject to a wide range of outer-context pressures that may influence their priorities and implementation of LGBTQ-supportive practices. We assessed the role of emergent outer-context determinants in the context of a 5-year cluster randomized controlled trial to study the implementation of LGBTQ-supportive evidence-informed practices (EIPs) in New Mexico high schools.
Method
Using an iterative coding approach, we analyzed qualitative data from annual interviews with school professionals involved in EIP implementation efforts.
Results
The analysis yielded three categories of outer-context determinants that created challenges and opportunities for implementation: (a) social barriers related to heterocentrism, cisgenderism, and religious conservatism; (b) local, state, and national policy and political discourse; and (c) crisis events.
Conclusions
By exploring the implications of outer-context determinants for the uptake of LGBTQ-supportive practices, we demonstrate that these elements are dynamic—not simply reducible to barriers or facilitators—and that assessing outer-context determinants shaping implementation environments is crucial for addressing LGBTQ health equity.
Keywords: adolescent health, health equity, implementation science, school health, sexual and gender minority health
Plain Language Summary
High schools are critical to supporting youth who identify as lesbian, gay, bisexual, transgender, and queer or of other diverse sexualities and gender identities (LGBTQ+). The use of supportive practices in schools can help reduce experiences of stigmatization, discrimination, and victimization that lead to negative mental health outcomes like anxiety, depression, and suicidality. However, schools’ ability to implement new practices is heavily influenced by forces stemming from their surrounding communities and broader society. These outer-context factors and their impact on implementation are generally understudied compared to factors considered to be squarely a part of schools. This article examines the role of outer-context factors, such as structurally-based social barriers, policy and political discourse, and crisis events, on the implementation of six evidence-informed practices (EIPs) intended to make schools safer and more supportive of LGBTQ+ youth. We find that while stigma, politics, and crises can undermine efforts within schools to improve their support and services, these same factors sometimes create opportunities, including renewed interest or urgency for addressing student needs. This article encourages implementation science researchers and practitioners to think through and plan for the ways that outer-context factors impact schools and other institutional settings, including using adaptable implementation frameworks and multilevel implementation strategies.
Introduction
Schools are critical to supporting the well-being of youth who identify as lesbian, gay, bisexual, transgender, and queer or of other diverse sexualities and gender identities (LGBTQ+; Ancheta et al., 2021). Implementing LGBTQ-supportive interventions in school settings can reduce experiences of stigmatization, discrimination, and victimization that lead to adverse mental health outcomes like anxiety, depression, and suicidality (Johns et al., 2019; Kaczkowski et al., 2022). However, local-, state-, and national-level factors impact internal priorities, limiting schools’ capacity to implement practices focused on the health of stigmatized populations, referring to people who have experienced labeling, stereotyping, discrimination, and status loss due to social beliefs and practices (Link & Phelan, 2001; National Academies of Sciences et al., 2020).
Implementation science leverages social-ecological perspectives to attend to levels of influence impacting the implementation of new practices. For example, the Exploration, Preparation, Implementation, Sustainment (EPIS) Framework conceptualizes these levels as inner and outer contexts (Aarons et al., 2011). The inner context of schools consists of school policies and practices; leadership; staffing; resources; and student and staff demographics, attitudes, beliefs, and behaviors. The outer context encompasses sociocultural norms and values; laws and regulations; and the broader educational system. Bridging factors facilitate interplay between outer and inner contexts, often represented as interorganizational relationships, memoranda of understanding, and contracts (Lengnick-Hall et al., 2021). For schools, families can also be bridging factors (Lengnick-Hall et al., 2021; Shattuck et al., 2022).
Outer-context factors are understudied in implementation science relative to inner-context factors (Bruns et al., 2019; Escoffery et al., 2023; Lui et al., 2021; Moullin et al., 2019). Recent work highlights challenges in distinguishing the influences of outer- and inner-context factors (Warner et al., 2021). Previous work on outer-context factors mostly emphasizes relatively static or slow-to-change fiscal, policy, and other service environment factors (Lui et al., 2021; McHugh et al., 2020). A systematic review of determinants influencing the sustainment of school-based interventions found that school staff prioritized inner-context factors as highly relevant for innovations, and the most commonly considered outer-context factors are socio-political and funding environments, and leadership support (Shoesmith et al., 2021). Research on such factors, however, almost exclusively centers on specific health behavior interventions targeting physical activity, obesity prevention, mental health, substance use, sexual health, and violence (Cassar et al., 2019; Herlitz et al., 2020), rather than structural interventions to improve the well-being of stigmatized populations.
Systematically examining the influence of outer-context factors on implementing interventions to enhance LGBTQ+ student well-being can inform future actions to promote long-term returns on efforts to reduce health inequities for stigmatized student populations in schools. Thus, we ask: How do outer-context determinants affect the implementation of LGBTQ-supportive practices in schools? We believe the answer to this question has implications for other school-based innovations, particularly for students with stigmatized identities.
Current Study and Context
We examine the implementation of six EIPs for supporting LGBTQ+ students in high schools in New Mexico, USA. While evidence-based practices (EBPs) foreground the explicit use of evidence, EIPs draw on both research evidence and professional expertise (Kumah et al., 2022). The six focal EIPs include creating safe spaces (Hatzenbuehler et al., 2014), staff professional development (Greytak et al., 2013), inclusive health education curricula (Baams et al., 2017), prohibiting LGBTQ-related bullying (Hatzenbuehler & Keyes, 2013), and providing access to LGBTQ-affirmative health, social, and psychological services (Brener et al., 2017; Ethier et al., 2018; Johns et al., 2019; Painter et al., 2018; Table 1). These LGBTQ-supportive practices are increasingly prevalent in over half of states (Shattuck et al., 2022), including in New Mexico, which has increased from 5% of schools implementing all six EIPs in 2010 to nearly 21% in 2018 (Brener et al., 2011, 2019). However, despite the benefits of these six EIPs, such as improved academic and health outcomes and feelings of school belonging, not all schools fully implement them (Kaczkowski et al., 2022). Challenges include a lack of resources (e.g., staffing), socially conservative community pressure, beliefs that current services are adequate or LGBTQ+ students do not need specialized support, and homophobic and transphobic bias (Gower et al., 2018; Green et al., 2018; Ioverno & Russell, 2021; Johns et al., 2019; Kaczkowski et al., 2022; Kull et al., 2016; Poteat et al., 2013; Saewyc et al., 2014; Shattuck et al., 2020; Shattuck et al., 2022; Shattuck et al., 2022). Much work still must be done to ensure all schools implement EIPs effectively, including addressing factors limiting implementation.
Table 1.
Description of School-Based LGBTQ-Supportive Practices
|
The current qualitative analysis is part of a larger five-year cluster randomized controlled trial leveraging EPIS and the Dynamic Adaptation Process (Aarons et al., 2012) to support schools implementing the EIPs, called "Reducing LGBTQ+ Adolescent Suicide (RLAS)". The Dynamic Adaptation Process operationalizes the four EPIS phases, moving sites through reviewing data and solutions, assembling an implementation resource team (IRT), making context-specific adaptations, action planning, and implementing and sustaining innovations. Forty-two schools were randomized into implementation and delayed implementation conditions. Implementation condition schools assembled IRTs of school health professionals, teachers, administrators, and other community members to carry out the EIPs with three years of implementation support (e.g., coaching). Delayed implementation condition schools received 1 year of implementation support at the study's close. Details on the study design are published elsewhere (Willging et al., 2016).
This study occurred in New Mexico, a state ranking 46th in median household income (U.S. Census Bureau, 2022a), with the third-largest percentage of residents below the poverty level (18.4%; U.S. Census Bureau, 2022b). Approximately 62% of students are Hispanic, 23% are White, and 10% are American Indian or Alaskan Native (New Mexico Public Education Department, 2023). The state has historically been supportive of LGBTQ+ people, including defining LGBTQ+ people as a protected class and banning insurance exclusions for transgender people (Human Rights Campaign, 2022). Although LGBTQ+ youth comprise approximately 15% of the high school-aged population, they face significant health disparities common for LGBTQ+ people across the nation, including higher rates of suicide, depression, self-injury, substance use, and riskier sexual behaviors (New Mexico Department of Health, 2019).
This analysis builds on our previous work to identify and address initial implementation barriers for RLAS (Willging et al., 2016; Green et al., 2018). During the preparation phase, readiness assessments revealed determinants that school staff anticipated impacting implementation (Green et al., 2018). Outer-context factors included sociopolitical and community environments, which also implicate resource availability. Inner-context factors included school policies and practices, staff knowledge of LGBTQ+ experiences, training deficits, neutrality discourses (i.e., stated desires to treat everyone the same), student attitudes and support, nonformalized safe spaces, and other pragmatic considerations.
Consistent with other school-based implementation research, school staff initially concerned themselves most with inner-context factors (Shoesmith et al., 2021). Yet, underlying structural and cultural factors traditionally conceptualized as part of the outer context influenced inner-context factors. For example, neutral discourses were often used to excuse schools from addressing LGBTQ+ experiences, while foregrounding desires to support “all students” (Kuhlelemeir et al., 2021). However, this category of “all students” is based on assumptions of heterosexuality (opposite-sex attraction) and cisgender identity (gender identity that conforms with the sex assigned at birth; see Appendix A for additional definitions; Shattuck et al., 2022). In practice, these assumptions lead to noninclusive bullying policies or the absence of gender-neutral restrooms. While these aspects may not appear overtly biased, they are grounded in the same erasure of LGBTQ+ identity as efforts like recent “Don’t Say Gay” bills that actively prohibit discussion of LGBTQ+ experiences in public schools. Whether intentional or not, ignoring the existence and needs of LGBTQ+ students contributes to lasting psychological implications and the reinforcement of health inequities (Shattuck et al., 2022; Stephens, 2022). Implementation science sometimes has difficulty articulating these subtle ties between larger structural and cultural forces to the inner context.
Extending from this previous work, we seek to examine the influence of outer-context factors on attempts to implement the six focal EIPs. What were the major outer-context factors influencing implementation efforts?
Materials and Method
The present analysis draws data from semi-structured qualitative individual and small group interviews conducted over five years at 11 urban and eight rural schools in the implementation condition. We excluded schools in the delayed condition from this analysis because they did not participate in an implementation process until the trial's final year, thus impeding our ability to describe interactions between outer-context factors and implementation efforts. In all, we undertook 208 individual and 62 small-group interviews between Fall 2016 and Spring 2021. These interviews comprised all the qualitative data for implementation sites, including readiness assessment data. The Pacific Institute for Research and Evaluation Institutional Review Board approved this study, and written informed consent was obtained from all participants.
The study team includes researchers of diverse sexual orientations, gender identities, and racial and ethnic backgrounds. This article's authors are majority queer-identified and include three sociocultural anthropologists and one pediatrician. Subscribing to a constructivist perspective and using grounded theory approaches, all authors acknowledge the role of multiple, overlapping, and competing perspectives of reality and value personal knowledge and experience in research processes (Charmaz, 2014).
We maintained auditable processes for practicing reflexivity throughout data collection, analysis, and confirmation of findings including biweekly periodic reflections—short structured conversations between coaches and two to three rotating members of the research team to discuss implementation progress (Finley et al., 2018)—and regular biweekly internal team meetings. Both types of interactions afforded time to discuss shifts in the social landscape, responses to participant accounts, and emergent patterns. Through these discussions and consultation with our Community Academic Partnership (CAP) consisting of local, state, and national school and adolescent health experts, we developed a list of potentially impactful factors that incorporated major social, political, and economic events.
Three researchers, including the first and third authors, used NVivo (QSR International, 2018) qualitative analysis software to apply an iterative analytic process. We first used open-coding techniques bounded by sensitizing concepts from EPIS. Open coding involves reading through qualitative data to locate categories of interest (Emerson et al., 2011). We drew sensitizing concepts—ideas attuning researchers to particular areas of inquiry—from the outer-context constructs highlighted in EPIS, such as state-level policy, thus narrowing open coding to center on outer-context factors (Patton, 2014). This process more fully identified emergent outer-context factors, adding to the list generated by the study team and CAP. We then used the 60 items on the larger list as search terms to identify transcript text. Examples of search terms included COVID-19, mask, social distance, politics, religion, resources, lockdown, and racism (see Appendix B for all search terms). Focused coding—a more fine-grained process of coding helpful for identifying interconnections among categories—investigated the presence, context, and impact of the outer-context factors identified through the open-coding process (Emerson et al., 2011).
We coded data across EPIS phases to assess whether patterns of outer-context factors were identifiable among and between schools and in what order particular phenomena occurred. Year 1 (2016/2017 academic year) was identified as the preparation phase and years 2–4 (2017/2018–2019/2020) as the implementation phase. Year 5 (2020/2021) represented a transition toward EIP sustainment.
Researchers sought feedback from implementation coaches and the CAP, as both parties possessed extensive knowledge of site-specific, local, state, and national phenomena. Triangulation of interview data across multiple participant types and ongoing coach and CAP consultations help assure the credibility and trustworthiness of the findings (Halladay et al., 2017; Patton, 2014).
Results
Outer-context determinants fell into three main categories: structurally-based social barriers, policy and political discourse, and crisis events. Table 2 reviews major events within each category.
Table 2.
Outer-Context Events Referenced During Data Collection
| EPIS Phase | Date | Description | Locality |
|---|---|---|---|
| Exploration/Preparation (2016–2017) | 5/16/2016 | An updated nondiscrimination policy for students based on gender identity and expression is adopted in New Mexico's largest school district | NM |
| 6/12/2016 | The Pulse nightclub shooting in Orlando, Florida leaves 49 dead | US | |
| 6/30/2016 | The Obama administration ends the ban on transgender military service members | US | |
| 11/8/2016 | Donald Trump is elected U.S. President | US | |
| 1/20/2017 | Donald Trump is inaugurated as U.S. President | US | |
| 1/21/2017 | Half a million people protest for gender equality in the Women's March on Washington, DC | US | |
| 4/7/2017 | The State of New Mexico prohibits youth conversion therapy and its advertisement in the 2017 Conversion Therapy Ban Act | NM | |
| 7/26/2017 | The Trump administration reinstates the ban on transgender military service members | US | |
| 8/12/2017 | The Unite the Right Rally in Charlottesville, Virginia takes place. A vehicle driven into a group of counter-protestors leaves one dead and 19 injured. President Trump does not fully condemn White nationalist actions. | US | |
| Implementation (2017–2020) | 10/1/2017 | A mass shooting in Las Vegas, Nevada leaves 59 dead and over 500 injured | US |
| 10/31/2017 | A terrorist attack in New York City leaves 26 dead and 19 injured | US | |
| 11/5/2017 | A shooting at a church in Sutherland Springs, Texas leaves 26 dead and 19 injured | US | |
| 12/17/2017 | A shooting at a local high school leaves two students and the shooter dead | NM | |
| 2/14/2018 | A shooting at Stoneman Douglas High School in Parkland, Florida, leaves 17 dead and 17 injured | US | |
| 3/24/2018 | Tens of thousands of people protest nationwide for stricter gun control in the March for Our Lives | US | |
| 10/7/2018 | Conservative Brett Kavanaugh is confirmed to Supreme Court | US | |
| 10/11/2018 | A shooting at a Pittsburgh, Pennsylvania synagogue leaves 11 dead and six injured | US | |
| 11/9/2018 | A shooting in a California bar leaves 13 dead, including the shooter, and 15 injured | US | |
| 2/14/2019 | A shooting threat at a local high school results in evacuation, but no injuries | NM | |
| 3/28/2019 | The New Mexico Vital Records Modernization Act establishes a process for correcting sex designations on birth certificates, removes the surgery requirement, and allows for an “X” gender marker | NM | |
| 3/28/2019 | The New Mexico Gender Neutral Bathroom Signs Act requires all single-occupancy restrooms in a public place to have gender-neutral signage | NM | |
| 4/3/2019 | The New Mexico Safe Schools for All Students Act outlines specific requirements for the adoption of a comprehensive bullying prevention policy | NM | |
| 4/12/2019 | A local school district holds an LGBTQ+ educational event for community, counselors, social workers, and parents | NM | |
| 8/3/2019 | A shooting at a Walmart in El Paso, Texas, leaves 23 dead and 23 injured | US | |
| 10/2/2019 | A series of student suicides in New Mexico sparks student advocacy at a local school district board meeting | NM | |
| 12/18/2019 | President Trump is impeached by House of Representatives | US | |
| 2/19/2020 | A student suicide reinvigorates community advocacy at a local school district board meeting, resulting in trainings for community members and school staff | NM | |
| 3/11/2020 | The first COVID-19 cases in New Mexico are confirmed and a public health emergency is declared | NM | |
| 3/12/2020 | Mass gatherings of over 100 people in one space are prohibited throughout New Mexico | NM | |
| 3/13/2020 | New Mexico public schools close between March 16 and April 6 | NM | |
| 3/26/2020 | New Mexico public schools are slated to remain closed until the end of the 2019–2020 school year | NM | |
| 4/14/2020 | The State of New Mexico launches “New Mexico Connect,” a behavioral health support smartphone application | NM | |
| 5/25/2020 | The death of George Floyd sparks protests against racism, inequality, and police brutality across the nation and world | US | |
| Sustainment (2020–2021) | 6/23/2020 | The New Mexico Public Education Department plans to start 2020–2021 school year, both virtually and in-person | NM |
| 7/23/2020 | New Mexico schools shift to fully remote learning until at least September 8 due to changing pandemic conditions | NM | |
| 8/26/2020 | A letter from the American Civil Liberties Union outlines legal justification behind why it is illegal to disclose a student's gender identity or sexual orientation, including to parents or school administrators | US | |
| 11/7/2020 | Joseph Biden is elected U.S. President | US | |
| 12/11/2020 | The Pfizer-BioNTech COVID-19 vaccine receives emergency use authorization | US | |
| 1/6/2021 | Armed protestors storm the U.S. Capitol | US | |
| 1/13/2021 | President Trump is impeached a second time | US | |
| 1/20/2021 | Joseph Biden is inaugurated as U.S. President | US | |
| 1/20/2021 | A federal executive order preventing and combating discrimination on the basis of gender identity or sexual orientation is issued | US | |
| 1/25/2021 | The Biden administration repeals the ban on transgender military service members | US | |
| 1/2021-4/2021 | Schools across New Mexico begin hybrid learning based on local COVID-19 conditions | NM | |
| 2/22/2021 | A local school district adopts a policy allowing students to use their preferred names | NM | |
| 3/8/2021 | The New Mexico Public Education Department announces that schools will return to full in-person learning by April 5 (a little under one month) | NM | |
| 3/29/2021 | Rachel Levine, Assistant Secretary for Health, becomes the first openly transgender government official to hold an office that requires U.S. Senate confirmation | US | |
| 3/29/2021 | A local high school organizes a gender-neutral prom and homecoming court at the request of students | NM | |
| 4/5/2021 | Deadline for returning to in-person schooling | NM | |
| 4/18/2021 | A local school district considers a ban on transgender athletes | NM | |
| 5/19/2021 | A local school district board passes a resolution to support transgender students | NM | |
| 6/22/2021 | The American Civil Liberties Union issues a letter against bans on transgender athletes and the local school district ultimately does not discuss or adopt such a ban | NM | |
| 8/14/2021 | A shooting at a local middle school leaves one student dead and the shooter in custody | NM | |
| 8/16/2021 | Students in local high schools protest dress code as unfair to female students | NM | |
| 8/27/2021 | A local school district updates student suicide protocols to include clearer guidelines for staff professional development and prevention programming. | NM | |
| 9/22/2021 | A local high school is sued for discrimination toward same-sex couples | NM |
Structurally-based social barriers
Heterosexism and cisgenderism's influence on schools and communities was evident from the study's start. Participants in the first year pointed out how LGBTQ+ people do not fit well within local, socially constructed gender hierarchies. Beliefs that heterosexuality is “normal” and there are only two acceptable genders dominated discussions, with some participants accepting such beliefs at face value and others challenging them. These attitudes influenced openness to implement the EIPs in rural and urban areas. In both settings, participants invoked neutrality discourses of “we treat everyone the same” to signify they do not discriminate, and nor do their schools. These beliefs held sway and reduced motivation among some school professionals to support the EIPs. Interviews also uncovered a pervasive lack of education among school professionals, contributing to LGBTQ+ students’ invisibility and low awareness of needs. However, over time, participants sought resources to address knowledge gaps.
Many IRT members struggled to reconcile their religious identities with their efforts to improve support for LGBTQ+ students. A counselor and a teacher at a smaller rural school reflected on the toll of being associated with LGBTQ-supportive programming.
Participant 1: I just wanted to throw this out there because this is why I was leery of joining whenever (name) started the program, is because I’m a Christian, so I was worried about …. I’m sorry. I get really emotional … how people in the community or even certain family members would view me. The way I see it, as (name) said, we’re advocates for students. Whenever we walk in that door, we are here for them. Sorry. I feel like that would have been a barrier that I had to face. I’m okay with that. It's okay. I’m proud to be a Christian representing this group.
Participant 2: … I also am a Christian. I’ll be honest, during the professional development meeting, I kind of was, I had my sister. She's a librarian here. Whenever they asked the team [IRT] to stand up, I stood up. I kind of glanced, her body language was kind of …. I just felt like she was kind of like, “Why are you a part of that team?” It made me feel uncomfortable and it made me question.
This tearful exchange exemplified the social realities of participants that deterred their colleagues from getting involved in changing school climates to better support LGBTQ+ students.
During the early implementation phase, school administrators and IRT members described feelings of ambivalence, pessimism, and fear of “backlash,” and shared examples in which their efforts to implement the practices met community opposition. An administrator at a small urban school shared a sarcastic comment by a parent expressing disagreement with efforts to be affirming of LGBTQ+ students: “We have calls and complaints about anything perceived as LGBTQ+ supportive. What I heard is a person called and said, ‘Why don’t you put out the Rainbow Flag instead of the American Flag.’” Throughout RLAS, we observed ongoing engagement with coaches and technical experts, staff training on LGBTQ+ experiences, and the development of implementation leaders committed to the EIPs, knowledgeable and willing to troubleshoot barriers. These factors were crucial in overcoming apprehension about change within the larger community.
Policy and Political Discourse
Policy and political discourse at multiple levels affected school climates and implementation.
National Political Discourse. When asked about the national climate, participants linked political leaders’ publicly documented “inappropriate” behavior, the lack of accountability in social media, and perceived increases in student and staff incivility. When asked about LGBTQ+ students feeling “less safe” and a reported rise in bullying and harassment in their school, a teacher at a large urban school explained,
A lot of our students now have more inappropriate behaviors because they see it …. Our President does that type [of] thing …. We were taught, ‘If you don’t have anything nice to say, don’t say anything at all.’ That went out the door … because everybody can [say], ‘Well that's my opinion, and I can say what I want, I don’t care if it hurts everybody….’ I think that has a lot to do with our government and our social media.
This explanation exemplified similar statements participants made throughout the implementation phase into the sustainment phase.
State Policy and Legislation. State policy affected EIP implementation. Before RLASstarted, the governor of New Mexico gutted the state's behavioral health system in 2013 through a policy closing the major agencies specializing in services for young people and their families (Willging et al., 2015; Willging & Trott, 2017). The aftermath of this policy change posed challenges for the EIP focused on facilitating access to affirming off-campus social and psychological service providers. For all years of data collection, participants referenced the shutdown's ongoing damage, which exacerbated health resource scarcity, particularly in rural communities. An administrator at a small rural school highlighted the valuable role their school-based health center played in supporting students, but indicated a lack of other easily accessible resources elsewhere: “The nearest hospital to us is about 45 min away and there's probably more resources in that area than here.” One way IRTs dealt with this situation was to collaborate with our coaches to bring LGBTQ+ training to the few local providers, including in federally qualified health centers forced to pick up the slack.
The sociopolitical context shifted under the next gubernatorial administration. Affirmative legislation was passed banning conversion therapy (Conversion Therapy Ban, 2017), making it easier for gender-diverse people to correct sex designations on birth certificates (Vital Records Modernization Act, 2019), and requiring that all public single-stall restrooms be gender-neutral (Gender-Free Bathroom Signs Act, 2019). An antibullying law inclusive of LGBTQ+ identity was also passed (Safe Schools for All Students Act, 2019). Additionally, the governor issued an executive order for collecting LGBTQ+ identity data by all state agencies (Executive Order for Sexual Orientation and Gender Identity Data Collection, 2021) to advance health equity.
Several IRTs sought to enact training on and dissemination of these new policies, drawing from them to scaffold EIP implementation in schools. Some participants saw local and state-level action as critical to protecting LGBTQ+ youth, but insufficient depending on national politics. A Genders and Sexualities Alliance (GSA; clubs where LGBTQ+ students and their allies can access social support) sponsor at an urban school explained that despite supportive schools and state government, students and staff still felt uneasy about the safety of LGBTQ+ students: “Well, they (kids) feel threatened at the national level. They feel like they don’t really understand, and you know, truthfully, I don’t either. It's harder than just, ‘Hey, yeah, but will the national conservative movement undo some of our state protections?’”
Conservatism in School Decision-Making. In all schools, decision-making power was consolidated at the top of district hierarchies and often intersected with political ideologies of conservatism, which affected school communities. One teacher recounted discussing with students how this hierarchy operates:
Who are the important people in the school? The students. And then the teachers and then the principals and then the super and then the board. Okay? Let's change our ranking criteria now to decision-making. Who makes all the decisions? The board, the super, the principal, the teachers, the students.
A counselor described how the lack of decision-making authority invested in educators hampered integrating LGBTQ+ concerns into health education curricula at a large urban high school. Noting how limited her school's health education was, she explained, “So, the idea of like, ‘Oh, make your sex ed inclusive.’ I’m like, ‘What sex ed?’ Because this is a very conservative district….”
For participants, political conservatism translated into the powerful discourse of “academics is what we are here for.” For example, many rural schools hired staff from nearby Texas, characterized as a conservative bastion. Texan staff were thusly viewed as more conservative, “old school,” and less concerned with social-emotional learning. Speaking of an administrator's lack of support for LGBTQ+ programing, an administrator at a rural school explained:
I feel some barriers there. This is a (person) that comes out from Texas. Things are viewed a little differently in Texas than in New Mexico. Of course, we’re in a school. Academics is what we’re here for. But if you socially and emotionally are not there, you’re not going to get through school.
In smaller towns, kinship relations maintained the influence of people ascribing to such ideologies in positions of power. One school nurse observed, “It's a political town. Everybody is tied to somebody's uncle on the school board.” These connections led to hesitance in making decisions that upset the status quo within schools, leading to fear of disciplining some students for anti-LGBTQ+ behaviors because of the potential for familial conflict.
Crisis Events
Over the study's course (2016–2021), major crisis events shifted schools’ priorities in ways necessary for student safety and well-being, but sometimes undermined implementation efforts. School staff often conceptualized the EIPs as peripheral to more immediate needs. These events included increased gun violence, student suicides, and the COVID-19 pandemic.
Gun Violence. Especially between 2016 and 2018, school safety emerged as a chief concern for staff professional development and student programming in the wake of multiple high-profile mass shootings, including at Florida's Pulse nightclub (June 2016) and Stoneman Douglas High School (February 2018), and at New Mexico's Aztec High School (December 2017). The student-led national “March for Our Lives” protests (March 2018) advocated for stricter gun control. In this heated atmosphere, participants reported that active shooter drills and training “overshadowed” all other school safety and well-being programing. Echoing statements from others, a nurse explained, “Safety is a real concern right now. We're doing lots of training. Just like our state conference is focusing on active shooter (drills). Can you believe that? I never would've thought that ten years ago.”
Student Suicidality. Student suicides, while unfortunate and devastating, often renewed participants’ commitment to providing suicide prevention training for staff, making administrators more open to scheduling time for those efforts. In one school, a student suicide prompted its IRT to request designated time during a mandatory staff meeting for evidence-based suicide prevention training. In another school, multiple suicides led students to demand at a school board meeting that district leadership does more to prevent further deaths. This effort led to an increased commitment to support student mental health, which aided EIP implementation. In a third school, the death of a prominent student athlete sparked similar actions to address student suicidality.
COVID-19 Pandemic. With the pandemic arriving in New Mexico in March 2020, public schools suspended all in-person learning for several weeks, transitioning to virtual learning, without a full return to in-person learning until April 2021. That dramatic shift disrupted schools’ academic functions and social and health services provision. Participants struggled to perform their regular work, let alone implement new practices in their now-virtual schools.
However, IRTs were prompted to undertake efforts to provide school-based support due to growing fears about student mental health, isolation at home, dangers facing LGBTQ+ youth (e.g., violent homes, identity concealment, maladaptive coping), and loss of family and community members. IRTs creatively pondered how to make safe spaces available to students, including hosting virtual GSAs with varying success ranging from those with committed and engaged students to some IRTs holding open virtual meeting times regardless of attendance.
Participants navigated communication challenges during the pandemic, utilizing electronic connectivity to support LGBTQ+ students. Some strategies included incorporating mental health hotlines and other mental health resources into school websites and virtual learning platforms; using email and instant messages; adding LGBTQ-affirming symbols to email signatures and video backgrounds; and holding virtual “drop-in” hours. Several participants enhanced resource lists with information on LGBTQ+ affirmative health providers; notable because most IRTs had limited success in previously creating and disseminating such lists. The pandemic prompted new interest in relaying information to students not physically present in a school and without the usual access to information gatekeepers like school nurses, counselors, or social workers.
Discussion
Our examination of outer-context factors impacting the implementation of six school-based LGBTQ-supportive EIPs yielded three broad categories: structurally-based social barriers, policy and political discourse, and crisis events. While outer-context factors are not simply reducible to barriers and facilitators, this analysis demonstrates it is crucial to consider the outer context in implementation because (a) changes in the outer context directly influence inner-context factors; (b) these influences do not always manifest through formalized bridging factors (e.g., contracts), thus making their influence difficult to recognize; and (c) changes in the outer context can impact the focal health problem of interventions. Our study illustrates this third phenomenon (e.g., the growing behavioral health crisis during the pandemic) exacerbating or ameliorating negative health outcomes. Therefore, tracking outer-context changes when implementing new practices to improve health is critical for successful implementation, especially when practices are aimed at improving health equity for stigmatized populations.
Outer-Context Influence on Inner-Context Dynamics
This study shows that cultural and structural forces, often considered external to organizations, affect inner-context factors such as motivation for change (Shattuck et al., 2022). Heteronormative ideas about gender and sexuality, prevalent in schools and communities, inhibit supportive action (Hatzenbuehler, 2011, 2014; Hatzenbuehler et al., 2013; Kuhlemeier et al., 2021). Participants shared fears about publicly acknowledging their LGBTQ+ allyship. The strong grip that heteronormative views about gender and sexuality, frequently communicated through religious terms, had on members of conservative communities made allyship new, strange, alienating, and demotivating for some school staff (Green et al., 2018). It is important to note that even given the racial, ethnic, and cultural diversity of New Mexico, these views were common across all communities. Although not emphasized by our participants, other research contrastingly describes how cultural and religious traditions and kin networks in these communities can influence LGBTQ+ health positively through strong social connections and pragmatic support (Willging et al., 2006).
Policy and political discourse emerged as a second set of outer-context factors impacting implementation. The policy environment is often recognized as modifiable, leading scholars to focus on policy-level interventions and implementation strategies (Bruns et al., 2019; Crable et al., 2022; Harris et al., 2012). When considering policy, we must attune ourselves to both obvious policy arenas, like school policy, and related areas, like broader health policy, that can impact innovations. For example, state policy tremendously influenced EIPs concerning healthcare access. Notably, past gubernatorial actions dismantled the behavioral health system in New Mexico, an already medically underserved state (Willging et al., 2015; Willging & Trott, 2017). Although IRTs wanted to facilitate access to LGBTQ-supportive providers, inadequate service availability attributable to these actions hampered efforts. While school policy influenced school-facilitated access, such as defining who could make referrals and to which organizations, larger-order state health policy shaped whether referrals resulted in care. However, it is rarely realistic to expect school-based professionals to enact state policy change, thus requiring intervention in the outer context.
School policies regarding bullying and harassment directly result from state policy. Before this passage of the Safe Schools for All Students Act, for instance, it was at school districts’ discretion to address sexual orientation or gender identity in discrimination, bullying, and harassment policies. LGBTQ+ inclusive policies and training on those policies can increase staff self-efficacy and increase the likelihood of intervention (Waasdorp et al., 2021). At the same time, state-level commitments to addressing LGBTQ+ well-being may bolster willingness within schools to undertake supportive action.
Outer-context factors, such as national political discourse, impacted schools’ inner contexts by influencing student and staff behaviors, attitudes, and beliefs. Researchers have established a relationship between the political polarization of the country and increased prevalence of bullying and harassment among students and specifically toward LGBTQ+ youth (Huang & Cornell, 2019). National politics also influence staff members’ attitudes and behaviors regarding gender and sexuality and their willingness to intervene in homophobic and transphobic bullying (Hobaica et al., 2021).
Findings regarding crisis events illustrate how outer-context conditions and priorities can dramatically affect schools. For example, while the implementation of active shooter drills in schools did not necessarily change how schools functioned, the threat of immediate harm provided the rationale for deprioritizing and addressing marginalized students’ needs. In contrast, the pandemic fundamentally changed schools’ inner contexts. Remote and hybrid learning, safety protocols, and uncertainty regarding in-person learning made it challenging to attend to students’ needs. However, some schools assigned to the implementation condition were able to maintain and implement changes to support LGBTQ+ students despite the additional challenges. Increased attention to LGBTQ+ student needs stemming from crises in the outer context drove these shifts. The heightened sense of urgency that the challenging pandemic and student suicides brought likely bolstered school-based efforts to implement EIPs.
Bridging factors
In EPIS, outer and inner contexts interact via bridging factors (Moullin et al., 2019) organized into three broad categories of relational ties (e.g., partnerships between organizations), formal arrangements (e.g., contracts), and processes (e.g., data sharing; Lengnick-Hall et al., 2021, 2020). However, our findings illustrate that while some bridging factors are obvious, like those conceptualized in previous work (e.g., policies), outer contexts can influence inner contexts in more subtle ways. Outer-context structural-based barriers like heterocentrism and cisgenderism influence inner contexts through families or other close community ties (Shattuck et al., 2022). The national political discourse can influence individual-level behaviors, attitudes, and beliefs that shape the inner context. The relationship between outer- and inner-context variables is observable within the dynamics of the inner context (e.g., not wanting to be a part of an IRT or increasing incivility among students), but the connection with outer-context forces comes into view through long-term qualitative data collection. To fully appreciate and intervene in the influence of the outer context on the inner context, researchers must systematically and thoughtfully attend to the linkages across both and through what mechanism(s) that influence operates, recognizing that bridging factors will not always take the form of concrete or measurable factors, such as a contract or shared process. Bridging factors may be abstract and ideological but potent in how they affect implementation processes (Shattuck et al., 2022).
Outer Context and the Causes and Solutions of Health Disparities
Outer contexts exert a demonstrable influence on facilitators and barriers in the inner context (Escoffery et al., 2023; Nilsen & Bernhardsson, 2019), either through direct overt action or more subtle connections. They are also important factors in producing health outcomes. When supporting equity-oriented interventions, researchers and implementers must consider the wider landscape of social determinants of health the outer context generates. For example, protections at the school, state, and national levels intersect to improve health outcomes for LGBTQ+ populations, including reduced suicidality, substance use, and experiences of bullying and violence (Gorse, 2022; Kaczkowski et al., 2022; Saewyc et al., 2020; Watson et al., 2021). For RLAS, national and state legislation colored the background within which school staff worked. Unsupportive policies or outspoken political opponents of LGBTQ+ equality can undermine health outcomes for LGBTQ+ youth. Participants connected students’ negative experiences in schools with the influence of national political polarization. They acknowledged students’ interpretations of anti-LGBTQ+ policies as threatening their safety and acceptance. While still to be shown in New Mexico-specific data, shifts in national and state leadership and supportive policies, such as passing a conversion therapy ban, reflect measures to make communities safer for LGBTQ+ people. Furthermore, efforts involving sexual orientation and gender identity data collection are expected to impact LGBTQ+ youth health positively. In fact, in January of 2023, the Biden-Harris administration released the first-ever federal evidence agenda on LGBTQ+ equity that included collecting and strategically using sexual orientation and gender identity data as a key component (National Science and Technology Council, 2023).
The pandemic is a prime example of how outer-context factors can impact the implementation of health equity interventions and the target health problem. The pandemic dramatically changed how schools provided students with educational, health, and social support. At the same time, the disconnection from those supports, isolation of students at home, and potentially unsafe and unsupportive home environments fueled fears about increased mental and behavioral health challenges for youth, particularly for LGBTQ+ youth (Chadi et al., 2022; Fish et al., 2020; Henderson et al., 2020; Meherali et al., 2021; Nearchou et al., 2020; Ormiston & Williams, 2022; O'Shea et al., 2021). Within the context of the pandemic, outer-context factors (e.g., public health crisis measures, home environments, rural community settings) shifted the public health problem of LGBTQ+ youth suicide while at the same time posing new implementation barriers. This example accentuates the importance of the outer context for both the production of health disparities and the efforts attempting to address those disparities.
Limitations
Our analysis has two main limitations. First, the study was conducted in a single state with schools that self-selected to implement support for LGBTQ+ populations. The limited geographic scope and the possible selection bias toward LGBTQ+-affirming schools may have influenced the results. Second, we are unable to compare our findings to what happens in similar sites implementing EIPs in the absence of these outer-context factors.
Conclusion
Our analysis highlights the shifting dynamics of outer contexts and their subtle and overt connection to inner-context factors. Outer contexts can change as much and as rapidly as inner contexts. Implementing new practices is a recursive process, requiring concern for systemic, larger-order processes when designing implementation. Many implementation models, including EPIS and the Consolidated Framework for Implementation Research, draw our attention to the outer context and call for revisiting prior activities like assessments to adjust to changing conditions (Aarons et al., 2011; Damschroder et al., 2022; Domlyn et al., 2021). This iterative process must continually reevaluate the outer context and its impact on inner-context implementation. Research must account for how changes in the outer context influence health disparities and, accordingly, how we measure intervention outcomes and thus proceed with implementation, adaptations to EIPs and other innovations, and handle tailoring to meet the new context.
Longitudinal qualitative data collection allows for assessing, countering, and leveraging outer-context factors. Our data collection approach demonstrates the value of sustained engagement with implementation sites over time and the attention paid by researchers and coaches to emergent contextual factors. Sites pivoted and adapted to changing circumstances because robust data collection enabled implementation guidance to pivot and adapt.
The outer context's influence on health equity necessitates crafting implementation strategies that extend beyond the inner context. If the outer context imposes constraints on implementation (as is the case for stigmatized populations), we must design interventions and implementations to buffer or overturn the potentially disruptive impact of the outer context.
Supplemental Material
Supplemental material, sj-docx-1-irp-10.1177_26334895241249417 for Outer-context determinants on the implementation of school-based interventions for LGBTQ+ adolescents by Daniel Shattuck, Cathleen E. Willging, Jeffery Peterson and Mary M. Ramos in Implementation Research and Practice
Supplemental material, sj-docx-2-irp-10.1177_26334895241249417 for Outer-context determinants on the implementation of school-based interventions for LGBTQ+ adolescents by Daniel Shattuck, Cathleen E. Willging, Jeffery Peterson and Mary M. Ramos in Implementation Research and Practice
Acknowledgments
We thank Sonnie Davies, Evelyn Byrd, and Bonnie Richard for their valuable contributions to data collection, particularly compiling the outer-context events, and for help formatting this article. We would also like to thank the members of our Community Academic Partnership and all of our participating schools for their commitment to SGM health equity.
Footnotes
Data Availability Statement: Data are available upon reasonable request to the principal investigators (CW and MR).
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD83399) funded this research.
Supplemental Material: Supplemental material for this article is available online.
References
- Aarons G. A., Ehrhart M. G., Farahnak L. R., Sklar M. (2014). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35, 255–274. 10.1146/annurev-publhealth-032013-182447 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aarons G. A., Green A. E., Palinkas L. A., Self-Brown S., Whitaker D. J., Lutzker J. R., Silovsky J. F., Hecht D. B., Chaffin M. J. (2012). Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implementation Science, 7(1), 32. 10.1186/1748-5908-7-32 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aarons G. A., Hurlburt M., Horwitz S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health, 38(1), 4–23. 10.1007/s10488-010-0327-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ancheta A. J., Bruzzese J.-M., Hughes T. L. (2021). The impact of positive school climate on suicidality and mental health among LGBTQ adolescents: A systematic review. The Journal of School Nursing, 37(2), 75–86. 10.1177/1059840520970847 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baams L., Dubas J. S., van Aken M. A. (2017). Comprehensive sexuality education as a longitudinal predictor of LGBTQ name-calling and perceived willingness to intervene in school. Journal of Youth and Adolescence, 46(5), 931–942. 10.1007/s10964-017-0638-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brener N. D., Demissie Z., Foti K., McManus T., Shanklin S. L., Hawkins J., Kann L. (2011). School Health Profiles 2010: Characteristics of Health Programs Among Secondary Schools in Selected U.S. Sites. Centers for Disease Control and Prevention. https://www.cdc.gov/healthyyouth/data/profiles/pdf/2010/profiles_report.pdf
- Brener N. D., Demissie Z., McManus T., Shanklin S. L., Queen B., Kann L. (2017). School health profiles 2016: State results. Centers for Disease Control and Prevention. https://www.cdc.gov/healthyyouth/data/profiles/pdf/2016/2016_profiles_report.pdf
- Brener N. D., Smith-Grant J., McManus T., Shanklin S. L., Underwood J. M. (2019). School health profiles 2018: Characteristics of health programs among secondary schools. Centers for Disease Control and Prevention. https://www.cdc.gov/healthyyouth/data/profiles/pdf/2018/CDC-Profiles-2018.pdf
- Bruns E. J., Parker E. M., Hensley S., Pullmann M. D., Benjamin P. H., Lyon A. R., Hoagwood K. E. (2019). The role of the outer setting in implementation: Associations between state demographic, fiscal, and policy factors and use of evidence-based treatments in mental healthcare. Implementation Science, 14(1), 96. 10.1186/s13012-019-0944-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cassar S., Salmon J., Timperio A., Naylor P.-J., van Nassau F., Contardo Ayala A. M., Koorts H. (2019). Adoption, implementation and sustainability of school-based physical activity and sedentary behaviour interventions in real-world settings: A systematic review. The International Journal of Behavioral Nutrition and Physical Activity, 16(1), 120. 10.1186/s12966-019-0876-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chadi N., Ryan N. C., Geoffroy M.-C. (2022). COVID-19 and the impacts on youth mental health: Emerging evidence from longitudinal studies. Canadian Journal of Public Health, 113(1), 44–52. 10.17269/s41997-021-00567-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Charmaz K. (2014). Constructing grounded theory. Sage. [Google Scholar]
- Crable E. L., Lengnick-Hall R., Stadnick N. A., Moullin J. C., Aarons G. A. (2022). Where is “policy” in dissemination and implementation science? Recommendations to advance theories, models, and frameworks: EPIS as a case example. Implementation Science, 17(1), 80. 10.1186/s13012-022-01256-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Damschroder L. J., Reardon C. M., Widerquist M. A. O., Lowery J. (2022). The updated consolidated framework for implementation research based on user feedback. Implementation Science, 17(1), 75. 10.1186/s13012-022-01245-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Domlyn A. M., Scott V., Livet M., Lamont A., Watson A., Kenworthy T., Talford M., Yannayon M., Wandersman A. (2021). R = MC(2) readiness building process: A practical approach to support implementation in local, state, and national settings. Journal of Community Psychology, 49(5), 1228–1248. 10.1002/jcop.22531 [DOI] [PubMed] [Google Scholar]
- Emerson R. M., Fretz R. I., Shaw L. L. (2011). Writing ethnographic fieldnotes. University of Chicago Press. [Google Scholar]
- Escoffery C., Sekar S., Allen C. G., Madrigal L., Haardoerfer R., Mertens A. (2023). A scoping review of outer context constructs in dissemination and implementation science theories, models, and frameworks. Translational Behavioral Medicine, 13(5), 327–337. doi: 10.1093/tbm/ibac115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ethier K. A., Harper C. R., Dittus P. J. (2018). School environment is related to lower health and safety risks among sexual minority middle and high school students. Journal of Adolescent Health, 62(2), 143–148. 10.1016/j.jadohealth.2017.08.024 [DOI] [PubMed] [Google Scholar]
- Finley E. P., Huynh A. K., Farmer M. M., Bean-Mayberry B., Moin T., Oishi S. M., Moreau J. L., Dyer K. E., Lanham H. J., Leykum L., Hamilton A. B. (2018). Periodic reflections: A method of guided discussions for documenting implementation phenomena. BMC Medical Research Methodology, 18(1), 153. 10.1186/s12874-018-0610-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fish J. N., McInroy L. B., Paceley M. S., Williams N. D., Henderson S., Levine D. S., Edsall R. N. (2020). I'm kinda stuck at home with unsupportive parents right now”: LGBTQ youths’ experiences with COVID-19 and the importance of online support. The Journal of Adolescent Health, 67(3), 450–452. 10.1016/j.jadohealth.2020.06.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gorse M. (2022). Risk and protective factors to LGBTQ+ youth suicide: A review of the literature. Child and Adolescent Social Work Journal, 39(1), 17–28. 10.1007/s10560-020-00710-3 [DOI] [Google Scholar]
- Gower A. L., Forster M., Gloppen K., Johnson A. Z., Eisenberg M. E., Connett J. E., Borowsky I. W. (2018). School practices to foster LGBT-supportive climate: Associations with adolescent bullying involvement. Prevention Science, 19, 813–821. 10.1007/s11121-017-0847-4 [DOI] [PubMed] [Google Scholar]
- Green Amy E, Willging Cathleen E., Ramos Mary M, Shattuck Daniel, Gunderson Lara. (2018). Factors Impacting Implementation of Evidence-Based Strategies to Create Safe and Supportive Schools for Sexual and Gender Minority Students. Journal of Adolescent Health, 63(5), 643–648. 10.1016/j.jadohealth.2018.06.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Green Amy E, Willging Cathleen E., Ramos Mary M, Shattuck Daniel, Gunderson Lara. (2018). Factors Impacting Implementation of Evidence-Based Strategies to Create Safe and Supportive Schools for Sexual and Gender Minority Students. Journal of Adolescent Health, 63(5), 643–648. 10.1016/j.jadohealth.2018.06.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Green Amy E, Willging Cathleen E., Ramos Mary M, Shattuck Daniel, Gunderson Lara. (2018). Factors Impacting Implementation of Evidence-Based Strategies to Create Safe and Supportive Schools for Sexual and Gender Minority Students. Journal of Adolescent Health, 63(5), 643–648. 10.1016/j.jadohealth.2018.06.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Green Amy E, Willging Cathleen E., Ramos Mary M, Shattuck Daniel, Gunderson Lara. (2018). Factors Impacting Implementation of Evidence-Based Strategies to Create Safe and Supportive Schools for Sexual and Gender Minority Students. Journal of Adolescent Health, 63(5), 643–648. 10.1016/j.jadohealth.2018.06.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greytak E. A., Kosciw J. G., Boesen M. J. (2013). Educating the educator: Creating supportive school personnel through professional development. Journal of School Violence, 12(1), 80–97. 10.1080/15388220.2012.731586 [DOI] [Google Scholar]
- Halladay J. R., Donahue K. E., Sleath B., Reuland D., Black A., Mitchell C. M., Breland C. E., Coyne-Beasley T., Mottus K., Watson S. N., Lewis V., Wynn M., Corbie-Smith G. (2017). Community advisory boards guiding engaged research efforts within a clinical translational sciences award: Key contextual factors explored. Progress in Community Health Partnerships: Research, Education, and Action, 11(4), 367–377. 10.1353/cpr.2017.0044 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harris J. R., Cheadle A., Hannon P. A., Forehand M., Lichiello P., Mahoney E., Snyder S., Yarrow J. (2012). A framework for disseminating evidence-based health promotion practices. Preventing Chronic Disease, 9, E22. 10.5888/pcd9.120126 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hatzenbuehler M. L. (2011). The social environment and suicide attempts in lesbian, gay, and bisexual youth. Pediatrics, 127(5), 896–903. 10.1542/peds.2010-3020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hatzenbuehler M. L. (2014). Structural stigma and the health of lesbian, gay, and bisexual populations. Current Directions in Psychological Science, 23(2), 127–132. 10.1177/0963721414523775 [DOI] [Google Scholar]
- Hatzenbuehler M. L., Birkett M., Van Wagenen A., Meyer I. H. (2014). Protective school climates and reduced risk for suicide ideation in sexual minority youths. American Journal of Public Health, 104(2), 279–286. 10.2105/AJPH.2013.301508 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hatzenbuehler M. L., Keyes K. M. (2013). Inclusive anti-bullying policies and reduced risk of suicide attempts in lesbian and gay youth. Journal of Adolescent Health, 53(Suppl 1), S21–S26. 10.1016/j.jadohealth.2012.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hatzenbuehler M. L., Phelan J. C., Link B. G. (2013). Stigma as a fundamental cause of population health inequalities. American Journal of Public Health, 103(5), 813–821. 10.2105/AJPH.2012.301069 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Henderson M. D., Schmus C. J., McDonald C. C., Irving S. Y. (2020). The COVID-19 pandemic and the impact on child mental health: A socio-ecological perspective. Pediatric Nursing, 46(6), 267–290. [Google Scholar]
- Herlitz L., MacIntyre H., Osborn T., Bonell C. (2020). The sustainability of public health interventions in schools: A systematic review. Implementation Science, 15(1), 4. 10.1186/s13012-019-0961-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hobaica S., Kwon P., Reiter S. R., Aguilar-Bonnette A., Scott W. D., Wessel A., Strand P. S. (2021). Bullying in schools and LGBTQ+ youth mental health: Relations with voting for Trump. Analyses of Social Issues and Public Policy, 21(1), 960–979. 10.1111/asap.12258 [DOI] [Google Scholar]
- Huang F. L., Cornell D. G. (2019). School teasing and bullying after the presidential election. Educational Researcher, 48(2), 69–83. 10.3102/0013189X18820291 [DOI] [Google Scholar]
- Human Rights Campaign. (2022). Working toward innovative equality 2021 State Equality Index: State scorecards - New Mexico. Retrieved April 14, 2023 from https://www.hrc.org/resources/state-scorecards/new-mexico-4
- Ioverno S., Russell S. T. (2021). Homophobic bullying in positive and negative school climates: The moderating role of gender sexuality alliances. Journal of Youth and Adolescence, 50(2), 353–366. 10.1007/s10964-020-01297-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johns M. M., Poteat V. P., Horn S. S., Kosciw J. (2019). Strengthening our schools to promote resilience and health among LGBTQ youth: Emerging evidence and research priorities from the state of LGBTQ youth health and wellbeing symposium. LGBT Health, 6(4), 146–155. 10.1089/lgbt.2018.0109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaczkowski W., Li J., Cooper A. C., Robin L. (2022). Examining the relationship between LGBTQ-supportive school health policies and practices and psychosocial health outcomes of lesbian, gay, bisexual, and heterosexual students. LGBT Health, 9(1), 43–53. 10.1089/lgbt.2021.0133 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kuhlemeier Alena, Goodkind Jessica R, Willging Cathleen E. (2021). Production and maintenance of the institutional in/visibility of sexual and gender minority students in schools. American Journal of Orthopsychiatry, 91(4), 558–568. 10.1037/ort0000556 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kull R. M., Greytak E. A., Kosciw J. G., Villenas C. (2016). Effectiveness of school district antibullying policies in improving LGBT youths’ school climate. Psychology of Sexual Orientation and Gender Diversity, 3(4), 407–415. https://doi.org/10.1037/sgd0000196. [Google Scholar]
- Kumah E. A., McSherry R., Bettany-Saltikov J., van Schaik P., Hamilton S., Hogg J., Whittaker V. (2022). Evidence-informed practice versus evidence-based practice educational interventions for improving knowledge, attitudes, understanding, and behavior toward the application of evidence into practice: A comprehensive systematic review of UG student. Campbell Systematic Reviews, 18(2), Article e1233. 10.1002/cl2.1233 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lengnick-Hall R., Stadnick N. A., Dickson K. S., Moullin J. C., Aarons G. A. (2021). Forms and functions of bridging factors: Specifying the dynamic links between outer and inner contexts during implementation and sustainment. Implementation Science, 16(1), 34. 10.1186/s13012-021-01099-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lengnick-Hall R., Willging C., Hurlburt M., Fenwick K., Aarons G. A. (2020). Contracting as a bridging factor linking outer and inner contexts during EBP implementation and sustainment: A prospective study across multiple U.S. public sector service systems. Implementation Science, 15(1), 43. 10.1186/s13012-020-00999-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Link B. G., Phelan J. C. (2001). Conceptualizing stigma. Annual Review of Sociology, 27, 363–385. 10.1146/annurev.soc.27.1.363 . [DOI] [Google Scholar]
- Lui J. H. L., Brookman-Frazee L., Lind T., Le K., Roesch S., Aarons G. A., Innes-Gomberg D., Pesanti K., Lau A. S. (2021). Outer-context determinants in the sustainment phase of a reimbursement-driven implementation of evidence-based practices in children’s mental health services. Implementation Science, 16(1), 82. 10.1186/s13012-021-01149-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McHugh S., Dorsey C. N., Mettert K., Purtle J., Bruns E., Lewis C. C. (2020). Measures of outer setting constructs for implementation research: A systematic review and analysis of psychometric quality. Implementation Research and Practice, 1, 10.1177/2633489520940022 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meherali S., Punjani N., Louie-Poon S., Abdul Rahim K., Das J. K., Salam R. A., Lassi Z. S. (2021). Mental health of children and adolescents amidst COVID-19 and past pandemics: A rapid systematic review. International Journal of Environmental Research & Public Health, 18(7), Article 3432. 10.3390/ijerph18073432 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moullin J. C., Dickson K. S., Stadnick N. A., Rabin B., Aarons G. A. (2019). Systematic review of the exploration, preparation, implementation, sustainment (EPIS) framework. Implementation Science, 14(1), 1. 10.1186/s13012-018-0842-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- National Academies of Sciences, Engineering, & Medicine. (2020). Understanding the well-being of LGBTQI+ populations. The National Academies Press. [PubMed] [Google Scholar]
- National Science and Technology Council. (2023). Federal evidence agenda on LGBTQI+ equity. Executive Office of the President of the United States. Retrieved 31 Jan 2023 from https://www.whitehouse.gov/wp-content/uploads/2023/01/Federal-Evidence-Agenda-on-LGBTQI-Equity.pdf
- Nearchou F., Flinn C., Niland R., Subramaniam S. S., Hennessy E. (2020). Exploring the impact of COVID-19 on mental health outcomes in children and adolescents: A systematic review. International Journal of Environmental Research & Public Health, 17(22), 8479. 10.3390/ijerph17228479. [DOI] [PMC free article] [PubMed] [Google Scholar]
- New Mexico Department of Health. (2019). New Mexico Youth Risk & Resiliency Survey: High school survey results county reports: Grades 9-12. New Mexico Department of Health, New Mexico Public Education Department, and University of New Mexico Prevention Research Center. Retrieved 5 October 2022 from https://www.youthrisk.org/pdf/countyreports/YRRS-2019-HS-countyreport-bernalillo.pdf
- New Mexico Public Education Department. (2023). New Mexico Education at a Glance. Retrieved March 14 from https://newmexicoschools.com/state/999999
- Nilsen P., Bernhardsson S. (2019). Context matters in implementation science: A scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC Health Services Research, 19(1), 189. 10.1186/s12913-019-4015-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ormiston C. K., Williams F. (2022). LGBTQ youth mental health during COVID-19: Unmet needs in public health and policy. Lancet, 399(10324), 501–503. 10.1016/S0140-6736(21)02872-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- O’Shea E. R., Phillips K. E., O’Shea K. N., Roney L. N. (2021). Preparing for the impact of COVID-19 on the mental health of youth. Nasn School Nurse (Print), 37(2), 64–69. 10.1177/1942602X211052626 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Painter K. R., Scannapieco M., Blau G., Andre A., Kohn K. (2018). Improving the mental health outcomes of LGBTQ youth and young adults: A longitudinal study. Journal of Social Service Research, 44(2), 223–235. 10.1080/01488376.2018.1441097 [DOI] [Google Scholar]
- Patton M. Q. (2014). Qualitative research & evaluation methods: Integrating theory and practice. Sage publications. [Google Scholar]
- Poteat V. P., Sinclair K. O., DiGiovanni C. D., Koenig B. W., Russell S. T. (2013). Gay–straight alliances are associated with student health: A multischool comparison of LGBTQ and heterosexual youth. Journal of Research on Adolescence, 23(2), 319–330. 10.1111/j.1532-7795.2012.00832.x [DOI] [Google Scholar]
- QSR International. (2018). NVivo qualitative data analysis software (Version 12) [Computer Software].
- Saewyc E. M., Konishi C., Rose H. A., Homma Y. (2014). School-based strategies to reduce suicidal ideation, suicide attempts, and discrimination among sexual minority and heterosexual adolescents in western Canada. International Journal of Child, Youth & Family Studies, 5(1), 89–112. 10.18357/ijcyfs.saewyce.512014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saewyc E. M., Li G., Gower A. L., Watson R. J., Erickson D., Corliss H. L., Eisenberg M. E. (2020). The link between LGBTQ-supportive communities, progressive political climate, and suicidality among sexual minority adolescents in Canada. Preventive Medicine, 139, 106191. 10.1016/j.ypmed.2020.106191 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shattuck D., Rasberry C. N., Willging C. E., Ramos M. M. (2022). Positive trends in school-based practices to support LGBTQ youth in the United States between 2010 and 2018. Journal of Adolescent Health, 70(5), 810–816. 10.1016/j.jadohealth.2021.11.027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shattuck Daniel, Hall Janie Lee, Green Amy, Greenberg Cynthia, Peñaloza Linda, Ramos Mary, Willging Cathleen. (2020). Recruitment of Schools for Intervention Research to Reduce Health Disparities for Sexual and Gender Minority Students. The Journal of School Nursing, 36(4), 258–264. 10.1177/1059840518820103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shattuck Daniel, Richard Bonnie O, Jaramillo Elise Trott, Byrd Evelyn, Willging Cathleen E. (2022). Power and resistance in schools: Implementing institutional change to promote health equity for sexual and gender minority youth. Frontiers in Health Services, 2. 10.3389/frhs.2022.920790 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shattuck Daniel, Richard Bonnie O, Jaramillo Elise Trott, Byrd Evelyn, Willging Cathleen E. (2022). Power and resistance in schools: Implementing institutional change to promote health equity for sexual and gender minority youth. Frontiers in Health Services, 2. 10.3389/frhs.2022.920790 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shattuck Daniel, Richard Bonnie O, Jaramillo Elise Trott, Byrd Evelyn, Willging Cathleen E. (2022). Power and resistance in schools: Implementing institutional change to promote health equity for sexual and gender minority youth. Frontiers in Health Services, 2. 10.3389/frhs.2022.920790 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shattuck Daniel, Richard Bonnie O, Jaramillo Elise Trott, Byrd Evelyn, Willging Cathleen E. (2022). Power and resistance in schools: Implementing institutional change to promote health equity for sexual and gender minority youth. Frontiers in Health Services, 2. 10.3389/frhs.2022.920790 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shattuck Daniel, Richard Bonnie O, Jaramillo Elise Trott, Byrd Evelyn, Willging Cathleen E. (2022). Power and resistance in schools: Implementing institutional change to promote health equity for sexual and gender minority youth. Frontiers in Health Services, 2. 10.3389/frhs.2022.920790 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shattuck Daniel, Richard Bonnie O, Jaramillo Elise Trott, Byrd Evelyn, Willging Cathleen E. (2022). Power and resistance in schools: Implementing institutional change to promote health equity for sexual and gender minority youth. Frontiers in Health Services, 2. 10.3389/frhs.2022.920790 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shattuck Daniel, Richard Bonnie O, Jaramillo Elise Trott, Byrd Evelyn, Willging Cathleen E. (2022). Power and resistance in schools: Implementing institutional change to promote health equity for sexual and gender minority youth. Frontiers in Health Services, 2. 10.3389/frhs.2022.920790 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shoesmith A., Hall A., Wolfenden L., Shelton R. C., Powell B. J., Brown H., McCrabb S., Sutherland R., Yoong S., Lane C., Booth D., Nathan N. (2021). Barriers and facilitators influencing the sustainment of health behaviour interventions in schools and childcare services: A systematic review. Implementation Science, 16(1), 62. 10.1186/s13012-021-01134-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stephens S. (2022). Why “Don’t Say Gay” Bills Hurt More than Children. https://nebhe.org/journal/why-the-dont-say-gay-bill-hurts-more-than-children/
- U.S. Census Bureau. (2022a). American Community Survey 1-Year Ranking Tables: Median household income (in 2021 inflation-adjusted dollars). Retrieved April 14, 2023 from https://www.census.gov/acs/www/data/data-tables-and-tools/ranking-tables/
- U.S. Census Bureau. (2022b). American Community Survey 1-Year Ranking Tables: Percent of people below poverty level in the past 12 months (for whom poverty status is determined). Retrieved April 14, 2023 from https://www.census.gov/acs/www/data/data-tables-and-tools/ranking-tables/
- Waasdorp T. E., Fu R., Perepezko A. L., Bradshaw C. P. (2021). The role of bullying-related policies: Understanding how school staff respond to bullying situations. The European Journal of Developmental Psychology, 18(6), 880–895. 10.1080/17405629.2021.1889503 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Warner G., Kervin E., Pesut B., Urquhart R., Duggleby W., Hill T. (2021). How do inner and outer settings affect implementation of a community-based innovation for older adults with a serious illness: A qualitative study. BMC Health Services Research, 21(1), 42. 10.1186/s12913-020-06031-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watson R. J., Fish J. N., Denary W., Caba A., Cunningham C., Eaton L. A. (2021). LGBTQ state policies: A lever for reducing SGM youth substance use and bullying. Drug and Alcohol Dependence, 221, Article 108659. 10.1016/j.drugalcdep.2021.108659 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Willging Cathleen E, Green Amy E., Ramos Mary M. (2016). Implementing school nursing strategies to reduce LGBTQ adolescent suicide: a randomized cluster trial study protocol. Implementation Science, 11(1). 10.1186/s13012-016-0507-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Willging Cathleen E, Green Amy E., Ramos Mary M. (2016). Implementing school nursing strategies to reduce LGBTQ adolescent suicide: a randomized cluster trial study protocol. Implementation Science, 11(1). 10.1186/s13012-016-0507-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Willging Cathleen E, Green Amy E., Ramos Mary M. (2016). Implementing school nursing strategies to reduce LGBTQ adolescent suicide: a randomized cluster trial study protocol. Implementation Science, 11(1). 10.1186/s13012-016-0507-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Willging C. E., Lamphere L., Rylko-Bauer B. (2015). The transformation of behavioral healthcare in New Mexico. Administration and Policy in Mental Health and Mental Health Services Research, 42(3), 343–355. 10.1007/s10488-014-0574-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Willging C. E., Salvador M., Kano M. (2006). Pragmatic help seeking: How sexual and gender minority groups access mental health care in a rural state. Psychiatric Services, 57(6), 871–874. 10.1176/ps.2006.57.6.871 [DOI] [PubMed] [Google Scholar]
- Willging C. E., Trott E. M. (2017). Outsourcing responsibility: State stewardship of behavioral health care services. In J. M. Mulligan & H. Castañeda (Eds.), Unequal coverage: The experience of health care reform in the United States (pp. 231–253). NYU Press. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplemental material, sj-docx-1-irp-10.1177_26334895241249417 for Outer-context determinants on the implementation of school-based interventions for LGBTQ+ adolescents by Daniel Shattuck, Cathleen E. Willging, Jeffery Peterson and Mary M. Ramos in Implementation Research and Practice
Supplemental material, sj-docx-2-irp-10.1177_26334895241249417 for Outer-context determinants on the implementation of school-based interventions for LGBTQ+ adolescents by Daniel Shattuck, Cathleen E. Willging, Jeffery Peterson and Mary M. Ramos in Implementation Research and Practice
