Abstract
The purpose of this article is to present a study that can serve as a model of program evaluation for school personnel that can be used to improve services and demonstrate program efficacy to key stakeholders. The study presented in this article evaluated the impact of a brief, bystander bullying program (“stealing the show,” “turning it over,” “accompanying others,” and “coaching compassion,” [STAC]) on depressive symptoms and passive suicidal ideation among middle school students in a rural, low-income community (N = 130). This topic was selected as there is limited research examining the efficacy of bystander programs on improving mental health outcomes for students trained to intervene. Results of the study indicated students trained in the STAC program reported reductions in depressive symptoms and passive suicidal ideation at a 6-week follow-up compared with an increase in symptoms reported by students in the control group. We discuss these findings and the use of program evaluation by school personnel to support prevention programming.
Keywords: bullying, bystander, STAC, depression and suicidal ideation, rural, low-income schools
Program evaluation data are essential for determining the effectiveness of school-based prevention programs (American School Counseling Association, 2019). Although conducting multisite randomized controlled trials is the “gold-standard” in research (Abel & Koch, 1999), school-specific program evaluation data provide information that can be used to improve services, demonstrate program efficacy to key stakeholders, and legitimize prevention programs (Dimmitt, 2009, 2010). Without school-specific program evaluation data, schools have limited information to guide decisions about continued program implementation or discontinuation (Llosa & Slayton, 2009). Documentation of improved emotional outcomes for students participating in prevention programs provides evidence to support the continuation of these programs in the schools. However, it is generally not practical for school personnel to conduct multisite randomized controlled studies or even conduct studies with one additional school serving as a comparison or control school. The purpose of this article is to present an evaluation of a school-based prevention program that can serve as a model for school personnel to evaluate the efficacy of a prevention program within their own school. Specifically, we present an evaluation testing the efficacy of a brief, bystander bullying preventive intervention on reducing depressive symptoms and suicidal ideation. The study was conducted within one school in which students were randomly assigned to either the intervention or control group. We provide information on bullying and students who witness bullying to provide the context for this study. Next, we discuss comprehensive school-wide interventions, identify barriers to implementation, and describe the “stealing the show,” “turning it over,” “accompanying others,” and “coaching compassion” (STAC) program that we evaluate in the current study. We then present the study methodology and results, followed by a discussion of our findings and how school personnel can use program evaluation data to support prevention programs.
The Problem of Bullying
Bullying is a significant public health issue in the United States, with prevalence data indicating 26.7% of middle school students report being targets of bullying (U.S. Department of Education, National Center for Education Statistics, 2019). National statistics also identify important socioeconomic factors related to bullying behavior. Students in rural areas report higher rates of bullying victimization than those in urban areas, and students in households with the lowest income levels report the highest rates of bullying victimization across income categories (U.S. Department of Education, National Center for Education Statistics, 2019). Furthermore, a growing body of research suggests that rural youth are at higher risk of bullying victimization than urban youth (Dulmus et al., 2004; Leadbeater et al., 2013; Smokowski et al., 2013). Students in rural areas are also 3% to 5% more likely to report bullying their peers relative to students in urban areas (Nansel et al., 2001). In addition, students in households with the lowest income levels report the highest rates of consequences associated with bullying victimization, including negative effects on school work, relationships, feelings about oneself, and physical health (U.S. Department of Education, National Center for Education Statistics, 2019). Furthermore, among middle school students attending schools in low-income, rural communities, bullying victimization is associated with mental health risks such as depression, anxiety (Evans et al., 2014; Smokowski et al., 2013), and decreased self-esteem and future optimism (Evans et al., 2014).
Witnessing Bullying as a Bystander and Depression Symptoms and Suicidal Ideation
The effects of bullying extend beyond targets of bullying, with 70.6% of students reporting witnessing bullying as a bystander (Bradshaw et al., 2007). The majority of research on bullying, however, focuses on the mental health risks associated with being a target of bullying, even though a significantly greater number of students report witnessing bullying as bystanders (Rivers et al., 2009). Overall, the literature on negative outcomes for student bystanders suggests that bystanders are at elevated risk of depressive symptoms. Specifically, witnessing bullying is associated with depression (Rivers et al., 2009), sadness (Janson et al., 2009), helplessness (Janson et al., 2009; Rivers & Noret, 2013), isolation, and guilt (Hutchinson, 2012). Research also indicates that witnessing bullying is associated with potential suicidal ideation (i.e., thoughts of ending one’s life; Rivers & Noret, 2013). Among students in rural, low-income communities, research indicates that witnessing bullying as a bystander is also associated with symptoms of depression (Midgett & Doumas, 2019a). Furthermore, the relationship between being a bystander and depression is significant even when controlling for the effects of being a target or perpetrator of bullying (Midgett & Doumas, 2019; Rivers et al., 2009). Thus, examining the efficacy of bystander bullying training on reducing symptoms of depression and suicidal ideation among students participating in these programs is an important area for further investigation. This is particularly true for middle school students in rural, low-income communities as research indicates income is inversely associated with depression among children (Tracy et al., 2008), and rural community youth suicide rates are nearly double that of rates in urban areas (Fontanella et al., 2015).
Bystander Roles
Peers play an important role in the perpetuation or prevention of bullying (Espelage et al., 2012). When students witness bullying, they can respond by acting as an “assistant” (i.e., joining in with the perpetrators), “reinforcer” (i.e., providing positive feedback to the perpetrator), “outsider” (i.e., disengaging and either leaving the situation or observing from a distance), or “defender” (i.e., intervening on behalf of targets; Salmivalli et al., 1996). Research, however, indicates only 20% to 30% of students intervene in bullying situations, with 20% to 30% of students supporting or encouraging bullying through their actions, and 30% to 50% doing nothing (Salmivalli & Voeten, 2004). How bystanders respond to bullying is also related to symptoms of depression. Specifically, bystanders who “defend” students report higher levels of depression than students who do not intervene (Lambe et al., 2017; Wu et al., 2016). One explanation for why “defenders” experience more depression is that “defenders” take an active role in bullying, thereby becoming more involved in the traumatic event than those who remain passive (Lambe et al., 2017). In addition, students who intervene in bullying situations may use maladaptive defending behaviors (e.g., physical or verbal aggression; Lambe et al., 2017), which may further involve the bystander in the bullying situation. In contrast, when students are taught appropriate defending behaviors, they experience increases in self-esteem (Midgett, Doumas, & Trull, 2017) and reductions in depression (Midgett & Doumas, 2019b) and internalizing symptoms (Doumas et al., 2019). These studies point to the importance of not only encouraging students to intervene when they witness bullying but also providing students with “defending” skills so that they may intervene in an appropriate manner.
School-Based Bullying Prevention Programs
Research indicates comprehensive, school-based programs are effective at decreasing bullying (Ttofi & Farrington, 2011). Many of these programs, however, do not focus on training bystanders to intervene (Gaffney et al., 2019). Furthermore, the majority of studies examining comprehensive, school-wide programs that do include a bystander component focus on the reduction of bullying rather than program impact on students trained in the program (Janson et al., 2009). In addition, the majority of bullying research has been conducted with urban samples and may not generalize to youth in rural communities (Smokowski et al., 2013). Urban–rural differences may affect bullying prevalence rates, as well as the effectiveness of prevention strategies (Kowalski et al., 2017). Furthermore, schools in rural, low-income communities may face educational and social disparities that pose obstacles to implementing comprehensive bullying programs (Peguero, 2012). Comprehensive, school-wide programs require significant resources that pose barriers to implementation including additional demands on teachers, limited access to training, lack of funding, and little or no mental health professionals at the school (Reinke et al., 2011). Relative to urban schools, rural schools face additional challenges for accessing and implementing prevention programs including a lower tax base to fund programs, training costs inflated by transportation needs, frequent staff turnover and school closures, staff overload and burnout, and lack of program advocates and local expertise in bullying prevention (Leadbeater et al., 2013). Therefore, it is important to identify effective bystander bullying programs that reduce barriers for implementation for middle schools in rural, low-income communities.
The STAC Program
The STAC program (Midgett et al., 2015; https://www.boisestate.edu/education-counselored/stac/) is a brief, bystander bullying preventive intervention that teaches students to intervene as “defenders” when they witness bullying. The program includes a didactic component to teach students about bullying, associated negative consequences, bystander roles, and strategies to intervene when students witness bullying. The training also includes role-plays for students to practice utilizing the four STAC strategies. The training is followed by two, 15-minute booster sessions that were developed to reinforce learning and enhance skill acquisition. The 90-minute program was developed as a brief, bystander bullying program for schools, reducing implementation barriers for schools that do not have the resources to adopt comprehensive, school-wide bullying programs. The program was also designed not only to decrease bullying behavior through peer intervention but also to improve the socioemotional adjustment of bystanders. Specifically, providing bystanders with effective strategies they can use to intervene in bullying situations as “defenders” may reduce depressive symptoms, including suicidal ideation, by reducing feelings of helplessness and guilt.
The STAC program is based on social learning principles including modeling and self-efficacy. According to social learning theory, individuals model the behavior of others that (a) they perceive as influential, (b) they see are rewarded for their behavior, and (c) are similar to them (Bandura, 1977). When bystanders intentionally or unintentionally act as “reinforcers” or “assistants,” they reinforce the perpetrator (Salmivalli et al., 2011). However, a single student of high status, or a group of students, acting as “defenders” can shift attention and power away from the perpetrator (Salmivalli et al., 2011), discontinuing the reinforcement, modeling prosocial behavior, and providing social support for targets. Furthermore, observing peers successfully intervene in bullying situations increases the likelihood that student bystanders will intervene in future situations. Self-efficacy influences the decisionmaking process, the ability to act in the face of difficulty, and the amount of emotional distress experienced while completing a difficult task (Bandura, 2012). Self-efficacy is developed and strengthened through social modeling and mastery experiences that provide opportunities to overcome challenges.
Researchers have examined the impact of the STAC program on both bullying behavior and mental health risks and protective factors among bystanders. Research indicates the STAC program is effective in reducing bullying perpetration (Midgett, Doumas, Trull, & Johnson, 2017, Midgett et al., 2018) and victimization (Midgett et al., 2018) when delivered as a school-wide prevention program. Results from a series of randomized controlled trials also support the efficacy of the STAC program in reducing internalizing symptoms (Doumas et al., 2019) and depression (Midgett & Doumas, 2019b), as well as increasing self-esteem (Midgett, Doumas, & Trull, 2017) and sense of school belonging (Midgett & Doumas, 2019b) among student leaders trained to intervene as “defenders.” Although these findings provide support for the STAC program, STAC was developed and evaluated in schools in urban, affluent communities, and results may not generalize to students in schools in rural, low-income communities.
To address this gap, Midgett et al. (2020) adapted the STAC program to be appropriate for a broader range of students, including students in rural, low-income communities. Adaptations included broadening examples of bullying to include those experienced by students in rural, low-income communities, as well as modifying role-plays to integrate the types of bullying experiences reported by students in these communities. Preliminary research on the adapted program indicates that students attending middle schools in rural, low-income communities report high levels of program acceptability (Midgett et al., 2020), increases in knowledge and confidence to intervene in bullying situations, and using the STAC strategies to intervene in bullying behavior post-training (Moran et al., 2020). Furthermore, research on the school-wide implementation of the STAC program indicates middle school students in a low-income, semirural community reported decreases in bullying victimization from baseline to a 6-week follow-up (Moran et al., in press). These results provide support for the effectiveness of the STAC program for middle school students in rural, low-income communities. However, to date, the impact of the STAC program on negative emotional consequences among student trained as “defenders” has not been examined in this population.
The Current Study
The purpose of this article is twofold: (a) to provide an example of a program evaluation to school personnel and (b) to extend the literature by evaluating the impact of the STAC program on reducing depressive symptoms and passive suicidal ideation among middle school students in a rural, low-income community. Because most schools do not have access to a control school for a randomized controlled study, program evaluations are often conducted using a single group, pre–post study design. However, it is possible to conduct a randomized controlled study within one school by randomly assigning students to an intervention or control group. In this study, students (N = 360) were randomly selected for participation and randomly assigned to an intervention or assessment-only control group. Our study hypotheses were as follows:
Hypothesis 1: Relative to students in the control group, students in the intervention group would report greater reductions in depressive symptoms.
Hypothesis 2: Relative to students in the control group, students in the intervention group would report greater reductions in passive suicidal ideation from baseline data collection to a 6-week follow-up assessment.
Method
Participants
Participants were recruited from one public middle school in a rural, low-income community in the Northwest. We randomly selected 360 students using a stratified proportionate sampling procedure (see Figure 1 for the participant flow diagram). Sample characteristics by study condition are provided in Table 1. Overall, 87.7% (n = 114) of the 130 participants completed both the baseline and 6-week follow-up assessments. Results of chi-square analyses and an independent sample t test indicated no differences between the groups on gender, χ2(1) = 0.01, p = .99, ethnicity, χ2(5) = 8.67, p = .12, or age, t(128) = −0.26, p = .79. In addition, there was no difference in the rate of attrition across the two groups, χ2(1) = 0.07, p = .79.
Figure 1.

Participation flow diagram.
Table 1.
Sample Characteristics by Study Group.
| Control group | Intervention group | Total sample | |
|---|---|---|---|
| Characteristics | (n = 61) | (n = 69) | (N = 130) |
| Age in years, M (SD) | 12.52 (1.04) | 12.49 (0.96) | 12.50 (1.00) |
| Gender | |||
| Male (%) | 42.6 | 42.6 | 42.6 |
| Female (%) | 57.4 | 57.4 | 57.4 |
| Race/ethnicity | |||
| White (%) | 67.2 | 52.2 | 59.2 |
| Hispanic (%) | 31.2 | 42.0 | 36.9 |
| Asian American (%) | 0.0 | 1.4 | 0.8 |
| African American (%) | 0.0 | 1.4 | 0.8 |
| Pacific Islander (%) | 1.6 | 1.4 | 1.5 |
| Other (%) | 0.0 | 1.6 | 0.8 |
Measures
Demographic variables.
Participants completed a brief demographic questionnaire with questions about age, gender, grade, and race/ethnicity.
Depressive symptoms.
Depressive symptoms were measured using the Depression Scale of the Behavior Assessment System for Children–Third Edition (BASC-3) Self-Report of Personality–Adolescent (SRP-A; C. R. Reynolds & Kamphaus, 2015). The Depression Scale is comprised of 12 items measuring symptoms of depression, including feelings of unhappiness, sadness, and stress that may result in an inability to carry out everyday activities or may bring on thoughts of suicide (C. R. Reynolds & Kamphaus, 2015). Five items are rated on a dichotomous scale, 0 (true) or 2 (false). Example items include the following: “I don’t seem to do anything right,” “I just don’t care anymore,” and “I used to be happier.” Seven items are rated on a 4-point Likert-type scale ranging from 0 (never) to 3 (almost always). Examples include the following: “I feel depressed,” “Nothing about me is right,” and “I feel like I have no friends.” We obtained a total scale score through the BASC-3 SRP-A hand-scoring worksheet (C. R. Reynolds & Kamphaus, 2015). The BASC-3 SRP-A Depression Scale has reliability coefficient alphas ranging in the .80s for males and females, and evidence of construct validity with correlations ranging from .51 to .93 between the Depression Scale and other established measures including the Depression Scale of the Behavior Assessment System for Children–Second Edition (BASC-2) SRP-A, Achenbach System of Empirically Based Assessment (ASEBA), and the Beck Youth Inventories II (BYI; C. R. Reynolds & Kamphaus, 2015). For this sample, Cronbach’s alpha was .92.
Passive suicidal ideation.
Passive suicidal ideation was measured using one item of the Depression Scale of the BASC-3 SRP-A (C. R. Reynolds & Kamphaus, 2015). The item “I feel life isn’t worth living” is rated on a 4-point Likert-type scale ranging from 0 (never) to 3 (almost always). This item has been used to assess passive suicidal ideation (e.g., Paykel Suicide Items; Paykel et al., 1974) and has been shown to discriminate between middle school students with high and low suicidal ideation (Vander Stoep et al., 2009). Use of one item from the BASC-3 SRP-A Depression Scale also parallels research examining suicidal ideation among bystanders using a single item from the Brief Symptom Inventory (BSI) Depression Scale (Derogatis & Spencer, 1994) to measure potential suicidal ideation (Rivers & Noret, 2013).
Procedures
The research team worked with the school counselor to implement research procedures. The team randomly selected students (N = 360) to participate in the study using a stratified sampling procedure. Parents/guardians of selected students were sent a prenotification letter, a letter with an informed consent form and project-addressed stamped envelope, and a reminder letter in both English and Spanish to their permanent home address. Parents/ guardians were asked to return the consent form in a project-addressed stamped envelope if they agree to their child’s participation. In addition, students received a hand-delivered consent form to take home. Students with a signed parental/guardian informed consent form were randomly assigned to the intervention group or control group using a computer-generated random numbers table. Student’s written assent was collected prior to baseline data collection.
All participants completed baseline and 6-week follow-up assessments during class time. Students in the control group returned to their classrooms immediately following the baseline data collection. After completing the baseline survey, the students in the intervention group completed a 90-minute training program conducted by graduate students in a master’s counseling program. Students in the intervention group also participated in two, biweekly 15-minute small-group booster sessions with counseling graduate students. The researchers provided all participants with a “pizza party” after conducting the 6-week follow-up assessment. The school district and the university institutional review board approved all study procedures.
The STAC Program
The STAC program (Midgett et al., 2015; https://www.boisestate.edu/education-counselored/stac/) is comprised of a 90-minute training and two, 15-minute booster sessions. The program includes a didactic component to teach students about bullying, associated negative consequences, bystander roles, and the four STAC strategies students can use to intervene when witnessing bullying. The didactic component is followed by an experiential component including role-plays so students can practice using the strategies. The training is followed by two 15-minute booster sessions that are intended to reinforce students’ use of the strategies and brainstorm ways to become more effective “defenders.”
Didactic component.
The didactic component of the training includes an icebreaker exercise, an audiovisual presentation, and hands-on activities to engage students in the learning process. The didactic component is designed to teach students about (a) the complex nature of bullying; (b) different types of bullying with a focus on spreading rumors, physical bullying, and name calling; (c) characteristics of students who bully, including the likelihood they have been bullied themselves; (d) reasons students bully including physical appearance and language; (e) negative associated consequences of bullying for students who are targets, perpetrate bullying, and are bystanders; (f) bystander roles and the importance of acting as a “defender”; and (g) the STAC strategies used for intervening in bullying situations. The four STAC strategies are described below.
“Stealing the show.”
“Stealing the show” involves using humor or distraction to turn students’ attention away from the bullying situation. Trainers teach bystanders to interrupt a bullying situation to displace the peer audience’s attention away from the target and from the bullying situation so that other students do not join in or reinforce the bully.
“Turning it over.”
“Turning it over” involves informing an adult about the situation and asking for help. During the training, students identify safe adults at school who they perceive can be of help to them. Students are taught to always “turn it over” in the case of physical bullying, cyberbullying, or if they are unsure as to how to intervene. In addition, trainers discuss the importance of immediate documentation of social media posts that are intended to humiliate or hurt students. Students are taught how to document evidence of cyberbullying to report it to school authorities such as the school counselor, vice principal, or principal.
“Accompanying others.”
“Accompanying others” involves the bystander reaching out to the student who was targeted to communicate that what happened is not acceptable, that the student who was targeted is not alone at school, and that the student bystander cares about them. Trainers teach students to approach a peer after they were targeted inviting them to spend time together. “Defenders” learn they can ask peers who were targeted if they would like to talk about what happened or they can implement this strategy indirectly by spending time with the student who was targeted communicating empathy and support.
“Coaching compassion.”
“Coaching compassion” involves gently confronting the student who bullies after a bullying incident to indicate that this type of behavior is unacceptable. In addition, the bystander encourages the perpetrator to consider what it would feel like to be the target in the situation, thereby raising awareness and fostering empathy toward the target. Trainers teach bystanders to only implement “coaching compassion” when they have an established relationship with the perpetrator, if the student who bullied is in a lower grade, and/or if bystanders believe they will be perceived as having higher status than the perpetrator.
Role-plays.
Trainers divide students into small groups of six students to practice the STAC strategies. Role-plays include hypothetical bullying situations that students may encounter in rural, low-income communities. Example scenarios include the following:
In the hallway, you overhear some girls talking about another girl’s clothes and hair. You hear them make fun of the girl telling her things like, “Can’t you afford a brush? Nice clothes” with a sarcastic and mean tone. The girl looks pretty upset and does not say anything back.
For the past few weeks you have noticed a group of boys who stand in the middle of the hallway and yell in another boy’s ear as he walks by. You also see that group of students slam his locker closed when he is trying to get things for class.
You are hanging out with some friends after school waiting for the bus, looking through Facebook. One girl decided to friend request another girl from school that she does not like, and then posted mean comments on the girl’s pictures. This is not the first time you have seen this girl do something like this.
Post-training booster sessions.
Two biweekly, 15-minute booster sessions occur after the training. During these meetings, students discuss the types of bullying they observed, which strategies they used, and the effectiveness of these strategies. Trainers answer questions and facilitate brainstorming more effective ways to implement the STAC strategies, how to use more than one strategy to intervene, and, when appropriate, to work as a team to intervene during or after a bullying incident.
Fidelity
Graduate assistants who implemented the STAC program watched a training video and conducted a practice presentation to obtain feedback from the principal investigator (PI). The PI was present at each training where the graduate students delivered the STAC program to middle school students. The PI rated program delivery on a dichotomous scale, yes or no, to evaluate whether presenters accurately taught the definition and types of bullying, the STAC strategies, and whether they deviated from training materials. The PI also assessed whether student trainers conducted all role-plays in the training. Both presenters were scored as adhering to the training materials at 100%.
Analytic Strategy
Prior to analysis, we examined the outcome variable for outliers and normality. Successful randomization was assessed with t tests and chi-square tests examining baseline measures. We used general linear model (GLM) repeated measures analysis of variance (ANOVA) to examine the intervention effects across time. The two fixed effects were time (baseline; 6-week follow-up) and group (intervention, control). We also controlled for sex as we found sex differences in baseline scores for the outcome variables. We calculated effect size using partial eta square (η2), with .01 considered small, .06 medium, and .14 large (Cohen, 1969; Richardson, 2011). We considered analyses significant at p < .05. All analyses were conducted in SPSS version 24.0.
Results
Preliminary Analyses
Means and standard deviations for outcome variables by group at baseline and at follow-up are reported in Table 2. The outcome variables were examined for skew and kurtosis at baseline and follow-up assessments. We did not identify any outliers and all variables were within the normal range. We also examined differences on depressive symptoms and passive suicidal ideation, as well as demographic variables between the two study conditions at baseline to confirm successful randomization. Analyses revealed no group differences in depressive symptoms, t(128) = 0.70, p = .49, suicidal ideation, t(128) = 1.73, p = .09, gender, χ2(1) = 0.04, p = .84, ethnicity, χ2(1) = 2.18, p = .14, or age, t(128) = −0.26, p = .79.
Table 2.
Descriptive Statistics and Statistical Contrasts for Outcomes.
| Control (n = 51) |
Intervention (n = 60) |
Time × Group | ||||
|---|---|---|---|---|---|---|
| Outcomes | M (SD) | M (SD) | WL | F(1, 110) | p | ηρ2 |
| Depressive symptoms | .95 | 6.05* | .02 | .05 | ||
| Baseline | 5.57 (6.40) | 6.47 (8.24) | ||||
| 6-week follow-up | 6.69 (8.60) | 5.10 (7.88) | ||||
| Passive suicidal ideation | .95 | 5.62** | .01 | .06 | ||
| Baseline | 0.56 (0.97) | 0.31 (0.51) | ||||
| 6-week follow-up | 0.29 (0.70) | 0.37 (0.75) | ||||
Note. WL = Wilks’ lambda.
p < .05.
p < .01.
Outcome Analysis
As seen in Table 2, for depressive symptoms, results of the GLM repeated measures ANOVA revealed a significant time × group interaction effect (p < 02, ηρ2 = .05). Students in the intervention group reported a significant reduction in depressive symptoms compared with an increase in depressive symptoms reported by students in the control group. Similarly, for passive suicidal ideation, we found a significant time × group interaction effect (p < .01, ηρ2 = .06). Students in the intervention group reported a significant reduction in passive suicidal ideation compared with an increase in passive suicidal ideation reported by students in the control group.
Discussion
The purpose of this article was to present a model for program evaluations for school personnel. The study described in this article examined the efficacy of a brief, bystander bullying preventive intervention on reducing depressive symptoms and passive suicidal ideation among students in a middle school in a rural, low-income community. This study may provide a useful framework for school personnel who are interested in evaluating prevention programing at their school. Findings from the current study indicate that students who participated in the STAC program reported a significant reduction in depressive symptoms and passive suicidal ideation relative to students in a control group. Consistent with prior research (Doumas et al., 2019; Midgett & Doumas, 2019b), the effect sizes for both depression (ηρ2 = .05) and suicidal ideation (ηρ2 = .06) were in the medium range. The current findings parallel research indicating that providing students with skills to intervene as “defenders” can reduce depressive symptoms among students in urban, affluent communities (Doumas et al., 2019; Midgett & Doumas, 2019b). This study extends the literature by replicating these findings with middle school students in a rural, low-income community and extending the outcomes to include passive suicidal ideation. Results also suggest that although students in the intervention group reported reductions in depressive symptoms and passive suicidal ideation, those in the control group reported an increase in both outcome variables. Thus, findings suggest that the STAC program may serve as a buffer against the natural progression in depressive symptoms and passive suicidal ideation observed in the control group.
One explanation for these findings is that bystanders who “defend” targets of bullying report higher levels of depressive symptoms than bystanders who do not intervene potentially due to the use of maladaptive skills (Lambe et al., 2017). Thus, in the absence of bystander training, students may continue to use maladaptive strategies to intervene, leading to an increase in depressive symptoms. In contrast, providing skills training and opportunities to practice intervention strategies when witnessing bullying may provide students with appropriate “defender” skills, thereby decreasing depressive symptoms and passive suicidal ideation. Being a bystander is associated with feelings of helplessness (Janson et al., 2009; Rivers & Noret, 2013) and guilt (Hutchinson, 2012), which may be alleviated by successfully intervening in bullying situations. Furthermore, among bystanders, helplessness is predictive of potential suicidal ideation (Rivers & Noret, 2013). Thus, it is possible that equipping students with appropriate intervention strategies may have decreased feelings of helplessness, thereby reducing both depressive symptoms and passive suicidal ideation.
Limitations and Directions for Future Research
Although this study adds to the literature on bystander bullying preventive interventions, there are limitations. First, generalizability is limited due to a relatively small sample recruited from one middle school in the Northwest. Next, the duration of follow-up in this study (i.e., 6 weeks) was relatively short. Future research with longer follow-up periods is recommended to evaluate whether or not gains are maintained over the academic year and whether or not additional boosters are needed. Moreover, we used a single item to measure passive suicidal ideation. Although the item we used assesses passive suicidal ideation (Paykel et al., 1974) and has been shown to discriminate between low and high levels of suicidal ideation (Vander Stoep et al., 2009), using a multiple-item scale would improve the reliability and validity of the measure in future research. For example, both the Scale for Suicidal Ideation (Beck et al., 1979) and the Suicidal Ideation Questionnaire (W. M. Reynolds, 1988) have been extensively used to measure suicidal ideation among adolescents and have excellent psychometric properties.
In addition, although we designed this study as a randomized controlled study, we used an assessment-only group for the comparison condition. Thus, it is possible that factors other than program content may have affected study outcomes. For example, students in the intervention group received attention from the trainers during the 90-minute training and the two 15-minute booster sessions. The training was designed to foster relationships and connections, as well as elicit students’ sense of agency to act, which may have contributed to the changes in outcomes reported in this study. Although use of assessment-only control groups is common in school-based bullying intervention research (Chalamandaris & Piette, 2015), using an active comparison group for the control condition will enhance future research.
Furthermore, because students were randomized within a single school, we cannot discount the possibility of contamination effects. Contamination occurs when the control group receives some or all of the intervention either passively or actively (Cook & Campbell, 1979). Specifically, it is possible that students in the intervention group shared information from the intervention with students in the control group or that students in the control group learned strategies from observing students in the intervention group act as “defenders.” In addition, students in both the intervention and control groups share teachers and peers, potentially creating further diffusion between the experiences of students in the intervention and control groups. Although we found statistically significant intervention effects in this study, it is possible our effect sizes were attenuated due to contamination effects. We also note that although contamination is generally considered a negative outcome from a research perspective, within real-world settings, contamination can be considered as positive as the benefits of the program are transferred to individuals who did not receive the program directly (Doyle & Hickey, 2013).
Finally, examining the process by which the program affected depressive symptoms and passive suicidal ideation was beyond the scope of this study. Future research should include possible mediators of intervention effects including changes in helplessness and self-efficacy that may lead to a reduction in depressive symptoms and improved mental health outcomes. Furthermore, through qualitative interviews, researchers could learn more about students’ experiences being trained in the program and acting as “defenders” to help inform program development.
Implications
Findings from the current study have meaningful implications for school personnel. First, although school mental health professionals may know that bullying is associated with negative consequences for both targets and perpetrators of bullying, they may not be aware of the impact that bullying has on students who witness bullying. The majority of students witness bullying at school (Bradshaw et al., 2007) and witnessing bullying is associated with symptoms of depression (Midgett & Doumas, 2019a; Rivers et al., 2009) and suicidal ideation (Rivers & Noret, 2013). Furthermore, using maladaptive defending behaviors when intervening in bullying situations is associated with depression (Lambe et al., 2017; Wu et al., 2016). Thus, teaching bystanders appropriate “defender” skills is an important goal for school mental health professionals. Results of this study provide preliminary evidence for the positive impact of the STAC program on depressive symptoms and passive suicidal ideation.
Second, although school-wide, comprehensive programs are commonly used in bullying prevention (Ttofi & Farrington, 2011), these types of programs can be difficult to implement because of the significant resources they require both in terms of time and cost (Menard & Grotpeter, 2014). This is particularly true for schools in rural and low-income communities (Leadbeater et al., 2013). In addition, many comprehensive programs do not focus on bystander training that equips students to act as “defenders” (Gaffney et al., 2019). As such, having the option to implement a brief, bystander bullying program could serve as a practical alternative to a comprehensive, school-wide program. When reviewing antibullying programs for adoption, school personnel may want to consider a brief, bystander bullying program that can both reduce bullying behavior and serve as a buffer against negative outcomes associated with witnessing bullying. This is particularly important for schools in rural, low-income communities as the highest rates of bullying are reported by students in rural areas and across the lowest income categories (U.S. Department of Education, National Center for Education Statistics, 2019). Furthermore, students in rural communities are at significantly higher risk of suicide than those in urban communities (Fontanella et al., 2015), and low-income status is positively associated with depression (Tracy et al., 2008).
Third, because the majority of students report witnessing bullying at school (Bradshaw et al., 2007), implementing the STAC program as a schoolwide prevention program may be a useful approach to engage students as part of the solution to the problem of bullying and the negative associated consequences. School mental health professionals could collaborate with teachers to implement the program. For example, the initial STAC training could be implemented within the context of classroom lessons. School mental health professionals could then conduct booster sessions to provide students with support and accountability for utilizing the strategies. As school mental health professionals conduct booster sessions, they can be informed from a student perspective regarding the most common types of bullying students experience while helping students feel empowered to act as “defender.” High levels of school personnel attunement to students’ social world is associated with a greater peer willingness to defend targets of bullying (Norwalk et al., 2016). Adult involvement in a meaningful way also communicates to students that school personnel are invested in addressing the problem of bullying at school. When students perceive adults at school as supportive, students are more likely to ask for help with bullying (Eliot et al., 2010).
Finally, the study presented in this article serves as a model for school personnel who are interested in conducting program evaluation research. School personnel can work together to establish what programs to implement based on the needs of the school and then design an evaluation in which students are randomly assigned to receive the prevention program or be in the control group. Methodology should include a pre–post design, similar to the one presented in this study, to control for differences in the intervention and control groups prior to implementing the program. Although randomization into groups theoretically controls for these differences, samples may not be large enough to ensure successful randomization of participant characteristics. Because school personnel may not have staff who are trained in conducting statistical analyses or have access to statistical software, it may be beneficial to collaborate with local university faculty who are interested in school-based program evaluation. Alternatively, descriptive statistics can be run in programs such as Microsoft Excel and can be used to demonstrate changes across time between intervention and control groups.
Conclusion
This article presented an evaluation of a school-based bystander bullying preventive intervention that can serve as a model for school personnel. Findings from this study demonstrate the positive impact of the STAC program on depressive symptoms and passive suicidal ideation among students attending a middle school in a rural, low-income community. Results suggest the STAC program has the potential to improve the emotional wellbeing of students. Using the current study as a model, school personnel can design program evaluations to inform decisions regarding prevention programming at their school.
Acknowledgments
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Research reported in this article was supported by the National Institute of General Medical Sciences of the National Institutes of Health under Award Number 1U54GM104944. Additional indirect support is provided by P20GM103408 and P20GM109095, and National Science Foundation Grants 0619793 and 0923535. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Biographies
Author Biographies
Aida Midgett is chair and professor of the Department of Counselor Education at Boise State University. Her research interests include the development and evaluation of a brief, bystander bullying prevention for K 12 students.
Diana M. Doumas is distinguished professor of Counselor Education and director for the Institute for the Study of Behavioral Health and Addiction. She is a licensed professional counselor and licensed psychologist. She specializes in empirically based interventions and cognitive-behavioral therapy. Her research interests include bullying prevention for K 12 students and substance abuse prevention and intervention, with a focus on online interventions.
Claudia Peralta is professor in the Department Literacy, Language and Culture. Her research interests focus on multilingual education, literacy and multiliteracy, multicultural education and social justice. She has published several articles in international journals on critical issues in multilingual education, specifically on the relations between home, community and school. Her current work focuses on the preparation of teachers working with rural multilingual students and their families.
Laura Bond is an assistant research professor in the Biomolecular Research Center, where she provides biostatistics and bioinformatics consultation and support. She is the supported biostatistician under the university’s Mountain West ClinicalTranslational Research Infrastructure Network and the Bioinformatics Coordinator for Boise State University under Idaho IDeA Network of Biomedical Research Excellence (INBRE).
Brian Flay is a research professor in the College of Education at Boise State University, professor emeritus in School of Social and Behavioral Health Sciences Oregon State University, and a distinguished professor emeritus, Psychology and Public Health University of Illinois at Chicago. He has research expertise in developing and testing the efficacy of health prevention and promotion programs using school-based randomized controlled trials. He has made significant contributions in the areas of research methods, theory, and influencing multiple behaviors and academic achievement among youth.
Footnotes
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
References
- Abel U, & Koch A (1999). The role of randomization in clinical studies: Myths and beliefs. Journal of Clinical Epidemiology, 52, 487–497. 10.1016/s0895-4356(99)00041-4 [DOI] [PubMed] [Google Scholar]
- American School Counselor Association. (2019). The ASCA national model: A framework for school counseling programs (4th ed.).
- Bandura A (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191–215. 10.1037/0033-295X.84.2.191 [DOI] [PubMed] [Google Scholar]
- Bandura A (2012). On the functional properties of perceived self-efficacy revisited. Journal of Management, 38, 89–44. 10.1177/0149206311410606 [DOI] [Google Scholar]
- Beck AT, Kovacs M, & Weissman A (1979). Assessment of suicidal intention: The Scale for Suicide Ideation. Journal of Consulting and Clinical Psychology, 47, 343–352. 10.1037/0022-006x.47.2.343 [DOI] [PubMed] [Google Scholar]
- Bradshaw CP, Sawyer AL, & O’Brennan LM (2007). Bullying and peer victimization at school: Perceptual differences between students and school staff. School Psychology Review, 36, 361–382. [Google Scholar]
- Chalamandaris AG, & Piette D (2015). School-based anti-bullying interventions: Systematic review of the methodology to assess their effectiveness. Aggression and Violent Behavior, 24, 131–174. 10.1016/j.avb.2015.04.004 [DOI] [Google Scholar]
- Cohen J (1969). Statistical power analysis for the behavioral sciences. Academic Press. [Google Scholar]
- Cook TD, & Campbell DT (1979). Quasi-experimentation: Design and analysis issues for field settings. Houghton Mifflin. [Google Scholar]
- Derogatis LR, & Spencer PM (1994). The Brief Symptom Inventory (BSI): Administration, scoring, and procedure manual. National Computer Systems, Inc. [Google Scholar]
- Dimmitt C (2009). Why evaluation matters: Determining effective school counseling practices. Professional School Counseling, 12, 395–399. 10.1177/2156759X0901200605 [DOI] [Google Scholar]
- Dimmitt C (2010). Evaluation in school counseling: Current practices and future possibilities. Counseling Outcome Research and Evaluation, 1, 44–56. 10.1177/2150137810361306 [DOI] [Google Scholar]
- Doumas DM, Midgett A, & Watts AD (2019). A pilot evaluation of the social validity of a bullying bystander program adapted for high school students. Psychology in the Schools, 56, 1101–1116. 10.1002/pits.22249 [DOI] [Google Scholar]
- Doyle O, & Hickey C (2013). The challenges of contamination in evaluations of childhood interventions. Evaluation, 19, 183–194. 10.1177/1356389013482610 [DOI] [Google Scholar]
- Dulmus CN, Theriot MT, Sowers KM, & Blackburn JA (2004). Student reports of peer bullying victimization in a rural school. Stress, Trauma, and Crisis, 7, 1–16. 10.1080/15434610490281093 [DOI] [Google Scholar]
- Eliot M, Cornell D, Gregory A, & Fan X (2010). Supportive school climate and student willingness to seek help for bullying and threats of violence. Journal of School Psychology, 48, 533–553. 10.1016/j.jsp.2010.07.001 [DOI] [PubMed] [Google Scholar]
- Espelage DL, Green HD, & Polanin J (2012). Willingness to intervene in bullying episodes among middle school students: Individual and peer group influences. The Journal of Early Adolescence, 32, 776–801. 10.1177/0272431611423017 [DOI] [Google Scholar]
- Evans CB, Smokowski PR, & Cotter KL (2014). Cumulative bullying victimization: An investigation of the dose-response relationship between victimization and the associated mental health outcomes, social supports, and school experiences of rural adolescents. Children and Youth Services Review, 44, 256–264. 10.1016/j.childyouth.2014.06.021 [DOI] [Google Scholar]
- Fontanella CA, Hiance-Steelesmith DL, Phillips GS, Bridge JA, Lester N, Sweeney HA, & Campo JV (2015). Widening rural-urban disparities in youth suicides, United States, 1996–2010. JAMA Pediatrics, 169, 466–473. 10.1001/jamapediatrics.2014.3561 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gaffney H, Ttofi M, & Farrington D (2019). Evaluating the effectiveness of school-bullying prevention programs: An updated meta-analytical review. Aggression and Violent Behavior, 45, 111–133. 10.1016/j.avb.2018.07.001 [DOI] [Google Scholar]
- Hutchinson M (2012). Exploring the impact of bullying on young bystanders. Educational Psychology in Practice, 28, 425–442. 10.1080/02667363.2012.727785 [DOI] [Google Scholar]
- Janson GR, Carney JV, Hazler RJ, & Oh I (2009). Bystander’s reactions to witnessing repetitive abuse experiences. Journal of Counseling & Development, 87, 319–326. 10.1002/j.1556-6678.2009.tb00113.x [DOI] [Google Scholar]
- Kowalski R, Giumetti GW, & Limber SP (2017). Bullying and cyberbullying among rural youth. In Michael KD & Jameson JP (Eds.), Handbook of rural school mental health (pp. 231–245). Springer. 10.1007/978-3-319-64735-7_15 [DOI] [Google Scholar]
- Lambe LJ, Hudson CC, Craig WM, & Pepler DJ (2017). Does defending come with a cost? Examining the psychosocial correlates of defending behaviour among bystanders of bullying in a Canadian sample. Child Abuse & Neglect, 65, 112–123. 10.1016/j.chiabu.2017.01.012 [DOI] [PubMed] [Google Scholar]
- Leadbeater BJ, Sukhawathanakul P, Smith A, Thompson RSY, Gladstone EJ, & Sklar N (2013). Bullying and victimization in rural schools: Risks, reasons, and responses. Journal of Rural and Community Development, 8, 31–47. http://journals.brandonu.ca/jrcd/index [Google Scholar]
- Llosa L, & Slayton J (2009). Using program evaluation to inform and improve the education of young English language learners in U.S. schools. Language Teaching Research, 13, 35–54. 10.1177/1362168808095522 [DOI] [Google Scholar]
- Menard S, & Grotpeter JK (2014). Evaluation of bully-proofing your school as an elementary school antibullying intervention. Journal of School Violence, 13, 188–209. 10.1080/15388220.2013.840641 [DOI] [Google Scholar]
- Midgett A, & Doumas DM (2019a). Witnessing bullying at school: The association between being a bystander and anxiety and depressive symptoms. School Mental Health, 11, 454–463. 10.1007/s12310-019-09312-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Midgett A, & Doumas DM (2019b). The impact of a brief bullying bystander intervention on depressive symptoms. Journal of Counseling & Development, 97, 270–280. 10.1002/jcad.12267 [DOI] [Google Scholar]
- Midgett A, Doumas DM, & Johnston A (2018). Establishing school counselors as leaders in bullying curriculum delivery: Evaluation of a brief, school-wide bystander intervention. Professional School Counseling, 21, 1–9. 10.1177/2156759X18778781 [DOI] [Google Scholar]
- Midgett A, Doumas DM, Moran M, & Gallo L (2020). Evaluation of a brief, school-based bystander bullying intervention: A pilot study conducted at an ethnically-blended, low-income school. Journal of Educational and Psychological Research, 2, 52–60. https://opastonline.com/wp-content/uploads/2020/04/evaluation-of-a-brief-school-based-bystander-bullying-intervention-a-pilot-study-conducted-at-an-ethnically-blended-low-income-school-jepr-20-1.pdf [DOI] [PMC free article] [PubMed] [Google Scholar]
- Midgett A, Doumas DM, Sears D, Lunquist A, & Hausheer R (2015). A bystander bullying psychoeducation program with middle school students: A preliminary report. The Professional Counselor, 5, 486–500. 10.15241/am.5.4.486 [DOI] [Google Scholar]
- Midgett A, Doumas DM, & Trull R (2017). Evaluation of a brief, school-based bullying bystander intervention for elementary school students. Professional School Counseling, 20, 172–183. 10.5330/1096-2409-20.1.172 [DOI] [Google Scholar]
- Midgett A, Doumas DM, Trull R, & Johnson J (2017). Training students who occasionally bully to be peer advocates: Can a brief bystander intervention decrease bullying behavior? Journal of Child and Adolescent Counseling, 3, 1–13. 10.1080/23727810.2016.1277116 [DOI] [Google Scholar]
- Moran M, Midgett A, Doumas DM, Porchia S, & Moody S (2020). A mixed method evaluation of a culturally adapted, brief, bullying bystander intervention for middle school students. Journal of Children and Adolescent Counseling, 5, 221–238. 10.1080/23727810.2019.1669372 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moran M, Midgett A, & Doumas DM (in press). Evaluation of a brief, bystander bullying intervention (STAC) for ethnically-blended middle schools in lowincome communities. Professional School Counseling.
- Nansel TR, Overpeck M, Pilla RS, Ruan WJ, Simons-Morton B, & Scheidt P (2001). Bullying behaviors among U.S. youth: Prevalence and association with psychosocial adjustment. Journal of the American Medical Association, 285, 2094–2100. 10.1001/jama.285.16.2094 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Norwalk KE, Hamm JV, Farmer TW, & Barnes KL (2016). Improving the school context of early adolescence through teacher attunement to victimization: Effects on school belonging. The Journal of Early Adolescence, 36, 989–1009. 10.1177/0272431615590230 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paykel ES, Myers JK, Lindenthal JJ, & Tanner J (1974). Suicidal feelings in the general population: A prevalence study. The British Journal of Psychiatry, 124, 460–469. 10.1192/bjp.124.5.460 [DOI] [PubMed] [Google Scholar]
- Peguero AA (2012). Schools, bullying, and inequality: Intersecting factors and complexities with the stratification of youth victimization at school. Sociology Compass, 6, 402–412. 10.1111/j.1751-9020.2012.00459.x [DOI] [Google Scholar]
- Reinke WM, Stormont M, Herman KC, Puri R, & Goel N (2011). Supporting children’s mental health in schools: Teacher perceptions of needs, roles, and barriers. School Psychology Quarterly, 26, 1–13. 10.1037/a0022714 [DOI] [Google Scholar]
- Reynolds CR, & Kamphaus RW (2015). Behavior Assessment System for Children—Third edition (BASC-3). Pearson. [Google Scholar]
- Reynolds WM (1988). Suicidal Ideation Questionnaire. Psychological Assessment Resources. [Google Scholar]
- Richardson JTE (2011). Eta squared and partial eta squared as measures of effect size in educational research. Educational Research Review, 6, 135–147. 10.1016/j.edurev.2010.12.001 [DOI] [Google Scholar]
- Rivers I, & Noret N (2013). Potential suicide ideation and its association with observing bullying at school. Journal of Adolescent Health, 53, 32–36. 10.1016/j.jadohealth.2012.1 [DOI] [PubMed] [Google Scholar]
- Rivers I, Poteat VP, Noret N, & Ashurst N (2009). Observing bullying at school: The mental health implications of witness status. School Psychology Quarterly, 24, 211–223. 10.1037/a0018164 [DOI] [Google Scholar]
- Salmivalli C, Lagerspet K, Björkqvist K, Österman K, & Kaukiainen A (1996). Bullying as a group process: Participant roles and their relations to social sta tus within the group. Aggressive Behavior, 22, 1–15. [DOI] [Google Scholar]
- Salmivalli C, & Voeten M (2004). Connections between attitudes, group norms, and behaviour in bullying situations. International Journal of Behavioral Development, 28, 246–258. 10.1080/01650250344000488 [DOI] [Google Scholar]
- Salmivalli C, Voeten M, & Poskiparta E (2011). Bystanders matter: Associations between reinforcing, defending, and the frequency of bullying behavior in classrooms. Journal of Clinical Child & Adolescent Psychology, 40, 668–676. 10.1080/15374416.2011.597090 [DOI] [PubMed] [Google Scholar]
- Smokowski PR, Cotter KL, Robertson C, & Guo S (2013). Demographic, psychological, and school environment correlates of bullying victimization and school hassles in rural youth. Journal of Criminology, 2013, 137583. 10.1155/2013/137583 [DOI] [Google Scholar]
- Tracy M, Zimmerman FJ, Galea S, McCauley E, & Vander Stoep A (2008). What explains the relation between family poverty and childhood depressive symptoms? Journal of Psychiatric Research, 42, 1163–1175. 10.1016/j.jpsychires.2008.01.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ttofi MM, & Farrington DP (2011). Effectiveness of school-based programs to reduce bullying: A systematic and meta-analytic review. Journal of Experimental Criminology, 7, 27–56. 10.1007/s11292-010-9109-1 [DOI] [Google Scholar]
- U.S. Department of Education, National Center for Education Statistics. (2019). Student reports of bullying: Results from the 2017 school crime supplement to the national crime victimization survey (NCES 2017-015). https://nces.ed.gov/pubs2019/2019054.pdf
- Vander Stoep A, McCauley E, Flynn C, & Stone A (2009). Thoughts of death and suicide in early adolescence. Suicide and Life-Threatening Behavior, 39, 599–613. 10.1521/suli.2009.39.6.599 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wu WC, Luu S, & Luh DL (2016). Defending behaviors, bullying roles, and their associations with mental health in junior high school students: A population-based study. BMC Public Health, 16, Article 1066. 10.1186/s12889-016-3721-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
