Abstract
As approximately one third of peer-victimized children evidence heightened aggression (Schwartz, Proctor, & Chien, 2001), it is imperative to identify the circumstances under which victimization and aggression co-develop. The current study explored two potential moderators of victimization-aggression linkages: a) attentional bias toward cues signaling threat and b) attentional bais toward cues communicating interpersonal support. Seventy-two 5th and 6th grade children (34 boys; Mage =11.67) were eye tracked while watching video clips of bullying. Each scene included a bully, victim, reinforcer, and defender. Children’s victimization was measured using peer, parent, and teacher reports. Aggression was measured using peer-reports of overt and relational aggression and teacher-reports of aggression. Victimization was associated with greater aggression at high levels of attention to the bully. Victimization was also associated with greater aggression at low attention to the defender for boys, but at high attention to the defender for girls. Attention to the victim was negatively correlated with aggression regardless of victimization history. Thus, attentional biases to social cues integral to the bullying context differentiate whether victimization is linked to aggression, necessitating future research on the development of these biases and concurrent trajectories of socio-behavioral development.
Keywords: Aggression, peer victimization, visual attention, bullying, eye tracking
Peer victimization, the experience of being repeatedly the target of agemates’ aggression, harassment, and social isolation, has been implicated in the development of numerous mental health and behavioral problems (Reijntjes, Kamphuis, Prinzie, Boelen, Van der Schoot, & Telch, 2011; Reijntjes, Kamphuis, Prinzie, & Telch, 2010), not the least of which are externalizing difficulties and aggression (Hanish & Guerra, 2002; Ladd & Troop-Gordon, 2003; Reijntjes et al., 2011). Affecting approximately 10–30% of children and adolescents (Leadbeater, & Hoglund, 2009), peer victimization is a substantial health risk, warranting systemic efforts to curb bullying and increase peer support for victims (Hertz, Donato, & Wright, 2013; Yaeger, Fong, Lee, & Espelage, 2015). However, the nature and extent of maladjustment subsequent to peer victimization varies substantially across children. To maximize efforts to curb psychopathology resulting from victimization, it is necessary, therefore, to identify those factors that curb or exacerbate victimization-adjustment linkages. Selective attention to social cues may be one such factor. Effective deployment of attention has been identified as a critical component of emotion regulation (Ayduk, Mendoza-Denton, Mischel, & Downey, 2000; Todd, Cunningham, Anderson, & Thompson, 2012), and maladaptive deployment of attention is theorized to be a transdiagnostic risk factor for the development of psychopathology (Racer & Dishion, 2012). Accordingly, the current study examines whether attentional biases to cues of threat or support moderate associations between peer victimization and aggression.
Peer Victimization and Aggression
Although the majority of victimized children are generally passive and submissive, peer victimization has been linked to high levels of aggressive behavior. Researchers have found that approximately 0.4% to 28.6% of victimized children are aggressive to peers (Schwartz, Proctor, & Chien, 2001) Victims who are aggressive have a hard time regulating their emotions, resulting in greater emotional responses to stressful peer conflicts, including hostile and retaliatory behaviors. Furthermore, the co-occurrence of peer victimization and aggression likely reflects a series of reciprocal associations that emerge over the course of development (Hodges & Perry, 1999; Leadbeater & Hoglund, 2009; Reijntjes et al., 2011). That is, while it is the case that aggressive behavior can elicit harassment from peers (Reijntjes et al., 2011), repeated exposure to peer victimization is a risk factor for the development of aggressive behavior and other externalizing difficulties (Hanish & Guerra, 2002).
Longitudinal associations between victimization and aggression have been demonstrated in a number of studies (Ladd & Troop-Gordon, 2003; Troop-Gordon & Ladd, 2005; Snyder et al., 2003; Leadbeater & Hoglund, 2009; Goldbaum, Craig, Pepler, & Connolly, 2007; Hanish & Guerra, 2002; Rudolph, Troop-Gordon, Hessel & Schmidt, 2011; van Lier, et al., 2012; Reijntjes et al., 2011). For example, Hanish and Guerra (2002) found that being victimized at 1st, 2nd, and 4th grade is predictive of externalizing behaviors two years later. Similar findings were reported by Rudolph et al. (2011) who found that victimization in the 2nd grade and increasing victimization between 2nd and 5th grade predicts heightened overt and relational aggression in 5th grade. Moreover, a meta-analysis of 14 longitudinal studies revealed a significant predictive link between peer victimization and later externalizing behaviors (Reijntjes et al., 2011).
Although the association between peer victimization and later aggression is consistently found in the literature, the magnitude of this association is moderate. These correlational findings, along with evidence that only a subset of victims are aggressive (Schwartz et al. 2001), have motivated investigators to identify those factors that moderate the link between peer victimization and aggression, including interpersonal factors (e.g., friends’ aggressive behavior; Hodges, Boivin, Vitaro, & Bukowski, 1999; Lemarche, Brendgen, Boivin, Vitaro, Dionne, & Perusse, 2007) and differences in physiological responses to stress (e.g., cortisol reactivity to stress; Rudolph, Troop-Gordon, & Granger, 2010). The current study adds to this literature by examining the moderating effect of attentional biases to social cues.
Aggression and Attention to Social Cues
Social cognitive theories of aggression and psychopathology point to biases in attention to interpersonal cues as integral to the development of externalizing disorders (Crick & Dodge, 1994; Olson, Sameroff, Kerr, Lopez, & Wellman, 2005; Racer & Dishion, 2012). In complex social interactions with multiple, dynamic cues, attention allocation is crucial to event interpretation (Crick & Dodge, 1994), emotion regulation (Thayer & Lane, 2000), and behavioral reactivity (Racer & Dishion, 2012). Within potentially threatening social interactions, flexible and adaptive attention allocation allows for the identification of cues that elicit a benign interpretation of the situation and for retained focus on cues that aid emotion regulation and inhibit aggressive reactions (see work by Horsley, de Castro, & Van der Schoot, 2010; Troop-Gordon, Gordon, Vogel-Ciernia, Ewing Lee, & Visconti, in press, regarding related research on attention to scenes of ambiguous provocation). In contrast, attention problems and biases may result in excesssive orientation to aggressogenic cues and, in turn, a heightend sense of threat, dysregulated anger, and aggressive responding. Thus, for children repeatedly exposed to interpersonal threat, attentional biases may play a salient determining factor as to the likelihood and nature of co-occurring psychopathology.
Links between aggressive behavior and clinical diagnoses of attentional disorders (King & Waschbush, 2010), and teacher-reports of attentional difficulties (Bjørnebekk & Howard, 2012; Dodge, Lochman, Harnish, Bates, & Pettit, 1997; Wilson, Petaja, Mancil, 2011) are well-documented. Furthermore, accumulating evidence indicates that aggression is associated with heightened attention to unambiguous cues communicating hostility. For example, Gouze (1987) found that preschool boys who were rated as physically and verbally aggressive were more easily distracted by aggressive cartoons and less likely to orient their attention away from aggressive scenes than nonaggressive boys. Using an emotional Stroop task, Van Honk, Tuiten, de Haan, van den Hout, and Stam (2001) found that, among college-age students, those who are high in trait anger have more difficulty inhibiting attention to angry faces than those low in trait anger. In a study of children and adolescents, Lonigan and Vasey (2009) found that those low in effortful control and high in negative affectivity, show greater attention to words indicating threat (e.g., “murder”) than those high in effortful control, low in negative affectivity, or both.
In contrast, attention to cues signaling distress may work to minimize aggressive behavior (Perry & Perry, 1974; Van Baardewijk, Stegge, Bushman, & Vermeiren, 2009). When given the opportunity to behave aggressively against a peer, college students engage in less aggression when victims display pain cues (Baron, 1971, 1974). Similarly, Nathanson and Cantor (2000) found that children evidence elevated aggressiveness immediately after viewing violent cartoons, but that this elevation is mitigated if children are coached to attend to the cartoon victim and the cartoon victim’s emotions. In a related line of research, aggression has been associated with low attention to distress cues among those high in psychopathic traits (Kimonis, Frick, Fazekas, & Loney, 2006). Thus, heightened attention to hostility and depressed attention to others’ distress may be risk factors for the development of aggressive behaviors.
Children vary, however, as to their exposure to aggression and other forms of interpersonal stress. Attentional biases, therefore, may not serve as a risk factor in isolation, but rather may exacerbate, or minimize, psychopathology resulting from repeated exposure to stressful environments (e.g., victimization from peers). Consistent with this premise, Racer and Dishion (2012) propose that poor attentional deployment is a transdiagnostic risk factor that interacts with interpersonal stress in the development of psychopathology. Supporting this theory, deficits in attention have been found to moderate the relation between associating with deviant peers and adolescents’ antisocial behavior (Dishion & Connell, 2006; Gardner, Dishion, & Connell, 2008). We similarly posit that the extent to which peer victimization is associated with aggression may depend on allocation of attention to social cues. Of particular importance is likely to be attention to cues present in bullying contexts, due to the perceived threat such situations pose for peer victimized youth. Specifically, we anticipate that the link between peer victimization and aggression is heightened when children attend to cues signaling hostility and is dampened when children attend to cues signaling distress or protection from harm.
Social Cues within Bullying Contexts
For victimized children, situations of bullying may represent a highly relevant and salient context that threatens one’s safety and emotional well-being. Within the bullying context, the bully is likely the most salient social cue due, in part, to the threat the bully represents to others. However, bullying rarely happens in isolation of the larger peer group (O’Connell, Pepler, & Craig, 1999; Salmivalli, Kaukiainen, Kaistaniemi, & Lagerspetz, 1999). Rather there are often onlookers who take on a variety of observable roles (Salmivalli, Lagerspetz, Björkqvist, & Österman, 1996) and, therefore, provide varying social cues. In addition to the bully and the victim, there are often reinforcers, peers who encourage the bully by laughing at the aggressive behavior or otherwise indicating that the bully’s behavior is acceptable. Also often present are defenders who show support and empathy for the victim, and who potentially explicitly stand up to the bully on the victim’s behalf.
Differential attention to these actors may have substantial implications for how bullying situations are interpreted and which facets of the peer context are salient to the observer. Attention to bullies and reinforcers would likely lead to the conclusion that the observed peer context is highly hostile and threatening, extenuating the co-occurrence of peer victimization and aggression. Attention to the victim should make salient the distress caused by the bullying, diminishing the link between victimization and aggression. Less clear is how observers would interpret the actions of defenders in a bullying situation. However, because defenders signal support for the victim, attention to defenders it is expected to minimize interpretations that the witnessed peer context is highly threatening, diminishing risk for aggression.
The Current Study
Based on Racer and Dishion’s (2012) conceptualization of attentional processes as moderators of the risk interpersonal stress has on adjustment, the current study examined whether attentional biases to social cues present in scenes of bullying moderates victimization-aggression linkages. Early adolescents (i.e., 5th- and 6th-graders) were eye tracked while watching child actors depict scenes of aggression. In each scene, a bully aggressed against a victim while two peers were present, a reinforcer who encouraged and laughed with the bully during the hostile encounter, and a defender who looked sympathetically at the victim and disapprovingly at the bully. Early adolescents were chosen to participate in this study, as bullying has been found to increase during this period (Nansel, Overpeck, Pilla, Ruan, Simons-Morton, & Scheidt, 2001; Pellegrini & Long, 2002).
The available data allowed us to test the robustness of our findings across multiple informants and across overt and relational aggression. Specifically, we included in our analyses three different measures of aggression, including peer-reports of overt (e.g., physical, verbal) and relational (e.g., spreading rumors, excluding others) aggression and teacher-reports of aggression, and measures of peer victimization from three informants – peers, teachers, and parents. Thus, analyses were first conducted to determine whether attention to bullying roles moderates the association between peer victimization and the three measures of aggression. Follow-up analyses tested whether the findings held when the three peer victimization scores were used separately to predict a composite aggression score.
Also examined were sex differences in the proposed relations. Although the research is mixed as to whether victimization is more predictive of aggression and externalizing problems for boys than for girls (Rudolph, Troop-Gordon, Monti, & Miernicki, 2014), boys are overrepresented when aggressive subgroups of victims are identified (Veenstra, Lindenberg, Oldehinkel, Winter, Verhulst, & Ormel, 2005; Hanish & Guerra, 2004; Schwartz, 2000). Thus, it is possible that boys are more sensitive to attentional cues that support or inhibit aggressive responding than girls. Differences may also arise due to gender-specific patterns of aggression – boys tend to use both overt and relational aggression; girls engage primarily in relational aggression (Card, Stucky, Sawalani, & Little, 2008). Thus, it is possible that moderation of the victimization-overt aggression association will be specific to boys. Accordingly, moderation by gender was also taken into account. Furthermore, as biases in attention to social cues may reflect broader attentional difficulties, we controlled for attention problems in each analysis.
Method
Participants
Data for this study came from 72 children residing in the upper-Midwest of the USA (34 boys; 38 girls; Mage =11.67, SDage =8.14 months; 94.4% Caucasian) and their parents (63 mothers; 9 fathers). Children came from primarily middle-class families with 5 (7.0%) reporting annual household incomes between $0 and $40,000, 19 (26.4%) between $41,000 and $60,000, 21 (29.2%) between $61,000 and $80,000, and 24 (33.3%) reporting incomes greater than $80,000. Three parents did not provide income data.
Children were recruited from a sample who had recently completed a longitudinal study examining links between peer relationships and children’s emotional, behavioral, and school adjustment. The participation rate for the initial study was 73.9%. Although the larger study consisted of 464 children, recruitment for this study focused on the 187 children living within a 20 minute drive to the university. Of these children, 69 (36.9%) had parents willing and able to bring them to the lab. The majority of parents declining to participate stated lack of time as their reason for not participating. A number of parents were not home or did not answer their phone when called. An additional attempt was made to recruit students living approximately 45 minutes away, although fewer attempts were made to reach these parents due to the unlikelihood that they would be willing to travel such a far distance. Three children were recruited from this subsample. For the families in this community, long distance was the primary reason for not participating in the lab portion of the study. The children who participated in the eye tracking portion of the study did not differ from those children who either couldn’t be reached or whose parents declined participation on teacher-reported peer victimization, teacher-reported aggression, or teacher-reported attention problems. The recruited sample was less overtly and relationally aggressive (Ms = 1.52 and 1.49, SD =.40 and .31, for overt and relational aggression, respectively) than the non-recruited sample (Ms = 1.70 and 1.59, SD =.47 and .36, for overt and relational aggression, respectively), t(208) = 2.78 and 1.99, p = .006 and .048, for overt and relational aggression, respectively. There was also a marginally significant difference in peer-reported victimization, t(208) = 1.89, p = .06, such that the recruited sample had lower peer-reported victimization scores (M = 1.49, SD = .22) than the non-recruited sample (M = 1.57, SD = .33).
Apparatus and Stimuli
Video clips
Stimuli for the eye-tracking task included short video clips depicting six scenes of ambiguous provocation, 18 scenes of bullying, and six scenes of prosocial behavior (i.e., 30 scenes total). Each scene was acted out twice – once by four boy actors and once by four girl actors. Thus, 60 video clips were created. Approximately 80 scenes were initially written. The final scripts used for this study were chosen based on piloting with four older elementary-school-age children (two boys and two girls) who indicated which scenes were the most realistic and plausible. The video clips lasted approximately 13s (M = 13.47s; duration ranged from 8.00 to 21.00s). See [blinded for peer review] for previous analysis of the ambiguous video clips.
Each scene showed four children engaged in an interaction. Of the 18 bullying scenes, six included physical bullying — throwing paper, poking repeatedly, hitting in the back of the head, pushing down, knocking books out of hand, and holding lunch out of reach — six included verbal bullying – calling “stupid,” mocking glasses, taunting about affection towards peer, making fun of smell, ordering to do homework, accusing of passing gas – and six included relational bullying – not inviting to party, whispering about someone, not including in game, teasing someone for not being invited to a party, gossiping about someone, refusing an offer of candy. These scenes were based on items widely used to assess bullying and peer victimization (e.g., Coyne, Archer, & Eslea, 2006; Crick & Grotpeter, 1996; Rudolph, Abaied, Flynn, Sugimura, & Agoston, 2011), as well as discussions with elementary and middle school children about the types of bullying they witness at school. Each bullying scene followed the same format. An actor playing the bully would aggress against the actor playing the victim. The victim responded in a manner that was ineffectual and communicated being in either physical or emotional pain (e.g., responding in a whiny voice, “stop it”). The bully then made a second aggressive act against the victim, and the victim once again responded ineffectually. During the scene, the actor playing the reinforcer laughed at the bully’s aggressive behavior, and the actor playing the defender looked sympathetically at the victim and disapprovingly at the bully.
Eight child actors between the ages of 10 and 13 were recruited from local theater groups. All actors looked very similar in age and had extensive training and experience in local theater productions. For each scene, actors were randomly assigned to a role; therefore, no actor could be associated with a particular role in the scenes. The actors wore jeans and plain, identical colored shirts provided to them by the investigators to insure that clothing did not influence visual attention.
In order to assess whether the actors were displaying the desired behaviors and emotions in the scenes, two undergraduate assistants independently coded on a 5-point scale each actor in each video clip on three dimensions: a) how mean the actor was behaving (1 = very mean to 5 = very nice), b) how amused the actor seemed by what was happening (1 = very amused to 5 = not at all amused), and c) how upset the actor seemed by what was happening (1 = very badly to 5 = very good). The coders’ scores for a role often ranged only 2 or 3 points for a particular item (e.g., ratings of amused for the bully ranged from 1 to 2 for both coders), resulting in constrained variance and low interrater reliability estimates even when the coders’ ratings were highly similar. Therefore, ratings were averaged across the two coders.
A series of one-way repeated measures ANOVA was conducted in which role (bully, victim, reinforcer, defender) served as the within-subjects factor and the behavior/affect dimensions (acts meanly, amused, feels badly) served as the dependent variables. Significant differences were found on all three dimensions, F(3, 105) = 165.69, 320.32, 436.31, all ps < .001, for acts meanly, amused, and feels badly, respectively. As would be expected, bullies (M = 1.18, SD = .05) and reinforcers (M = 2.01; SD = .08) were viewed as acting more meanly than victims (M = 3.10; SD = .09) or defenders (M = 3.22; SD = .08). Bullies were also seen as acting more meanly than reinforcers. However, no difference in acting meanly was found between victims and defenders. Bullies (M = 1.44, SD = .11) and reinforcers (M = 1.5, SD = .08) were seen as more amused than victims (M = 4.83, SD = .06) and defenders (M= 4.08, SD = .10). Victims were seen as less amused than defenders. There was no difference in being amused between bullies and reinforcers. Victims (M = 1.14, SD = .04) and defenders (M=2.10, SD = .08) were seen as feeling worse than bullies (M = 4.68, SD = .10) and reinforcers (M = 4.22, SD = .08). Victims were also seen as feeling worse than defenders, and reinforcers were seen as feeling worse than bullies. These differences provide strong evidence that the actors were portraying the desired behaviors and affect in the video clips.
Eye tracking
The 60 video clips were displayed to children on a NEC MultiSync FP2141SB monitor at a resolution of 1024 × 768 pixels and a refresh rate of 75 Hz. Children watched the video clips from a distance of 57 cm. A tower-mounted Eyelink 1000 Eye Tracker (SR Research Ltd., Mississauga, Ontario, Canada) was used to record participants’ eye movements at a rate of 1000 Hz. Only data collected while the children watched the 36 video clips portraying bullying are analyzed for this study. The entire set of 60 video clips were presented in one of two randomly assigned orders. Children were informed that their eye location was going to be monitored as they watched the video clips. No other instructions were given, and participants were asked no questions regarding the individual video clips. There were a total of 2592 trials (i.e., 72 participants × 36 video clips). Inspection of the raw data files showed that there was a loss of tracking for one trial for one participant. This child’s attention scores were computed using the remaining trials. For all other trials, eye tracking was uninterrupted with the exception of blinks.
Measures
Visual attention to social cues
For each participant, and for each of the 36 bullying video clips, the location and duration of each fixation were recorded by trained research assistants. Fixations shorter than 100 ms were eliminated (3.28%). Attention was coded as being on one of the four actors if a fixation occurred on any part of the actor’s body to account for physically aggressive acts that involved body parts other than the face (e.g., a hand slapping down books; the back of a victim being poked with a pencil). Coders did not record the location of fixations not on one of the four actors (e.g., a chair, a wall).
The total number of seconds attending to each of the four bullying roles was averaged for each video type (e.g., boys physical aggression; girls relational aggression). Cronbachs were calculated to determine if these six scores for each bullying role could create an internally reliable scale. All Cronbach alphas were acceptable (.91, .84, .71, and .78, for attention to the bully, victim, reinforcer, and defender, respectively). Therefore, attention to each of the four bullying roles was calculated as the average time fixating on that role across all 36 video clips. Children also varied as to whether they attended to the actors while watching the video clips or other parts of the video or screen (e.g., a chair, the wall; the margin of the screen outside the videoclip dispay). As differences in time spent looking at the actors may reflect attention problems, we calculated, and controlled for, the average time spent looking at one of the four actors for each video clip (i.e., total attention to actors).
Victimization
Peer victimization was measured using a combination of peer-report, teacher-report, and parent-report measures. Peer-reports and teacher-reports of victimization were obtained from ratings children received the previous spring as part of the larger study. Peer-reported victimization was obtained using four items from Ladd and Kochenderfer-Ladd’s (2002) Multi-informant Peer Victimization Scale (MPVS). For each item, children rated their participating classmates on a scale from 1 (never) to 4 (a lot). The items tapped physical (“hit or pushed by others”), verbal (“called names”), general (“picked on”), and relational (“told by other kids they can’t play with them or be friends with them”) victimization. The children in this study received peer ratings from an average of 15.49 classmates (min = 10; max = 24). Peer ratings received from classmates were averaged to create item-level scores, and these four items were averaged to create a composite peer victimization score (α = .89).
Teacher-reports of victimization were obtained using four items from the MPVS and four additional items that were written to provide a more comprehensive assessment of peer victimization experiences. The additional items included, “is excluded from other kids’ activities”, “is ignored by peers”, “is talked about in negative ways by other kids’, and “seems to allow other kid to tease or bully him/her.” Ratings received from teachers were averaged to create a composite victimization score (α = .91).
Parent-reports of victimization were obtained during the eye tracking lab visit. Parents responded to eight items, four derived from the MPVS and four additional items tapping social exclusion (e.g., is excluded from other kids’ activities). All items were scored on a scale from 1 (Not True) to 3 (Very True or Often True). Item ratings were averaged to create a composite peer victimization score (α = .85).
Significant correspondence was found between the three reports of peer victimization (r = .44, p < .001, between peer-reported and teacher-reported victimization; r = .40, p < .001, between peer-reported and parent-reported victimization; r = .67, p < .001, between teacher-reported and parent-reported victimization). As multi-informant measures of peer victimization have been shown to provide more valid assessments of children’s peer victimization experiences (Ladd & Kochenderfer-Ladd, 2002), peer-, teacher-, and parent-report measures of peer victimization were averaged to create a composite peer victimization score.
Aggression
Peer ratings of aggression were obtained at the same time and from the same classmates as the peer-ratings of victimization. Peer-reported overt aggression was measured using three items derived from the MPVS. They included, “hit or push other kids at school,” “pick on others,” and “call other kids bad names or say mean things to them.” Peer-reported relational aggression was measured with one item, “tell other kids that they can’t play with them or that they won’t be friends with them.” For each item, children rated their participating classmates on a scale from 1 (never) to 4 (a lot). Peer ratings received from classmates were averaged to create item-level scores, and scores on the three overt aggression items were averaged to create a composite peer-reported overt aggression score (α = .95). A final peer-reported relational aggression score was calculated by averaging all ratings received on the relational aggression item.
Teacher-reports of aggressive behavior were obtained using six items. Teachers rated each participating child on a scale from 1 (never) to 4 (a lot of the time). Items included “threatens or bullies,” “spreads rumors or lies about other kids,” “acts aggressively toward peers,” “gets kids to gang up on a peer he/she doesn’t like,” “likes to boss other kids around,” and “tries to get other kids in trouble.” These items are consistent with other teacher-reports of aggressive behavior (e.g., Achenbach, 1991; Dodge & Coie, 1987), have shown good concurrent validity in previous research (Troop-Gordon & Gerardy, 2012), and demonstrated good concurrent validity with the peer-report and parent-report measures of aggressive behavior used in this study. Ratings were averaged to create a composite aggression score (α = .93).
Attention problems
Children’s attention problems were assessed using teacher- and parent-reports. Teachers rated children on three items, “is inattentive,” “has poor concentration or short attention span,” and “is restless and runs about or jumps up and down,” on a scale from 1 (never) to 4 (a lot of the time). These items were taken from the four-item Hyperactive-Distractible subscale of the Child Behavior Scale, a well-validated measure of children’s social and behavioral risk (Ladd & Profilet, 1996; α = .83 for the current sample). Parents reported on their child’s attention problems using nine items from the Attention Problems subscale of the Child Behavior Checklist (Achenbach, 1991). Ratings were made on a scale from 1 (not true) to 3 (very true or often true). The items showed good internal reliability (α = .74). Teacher- and parent-reports of attention problems were significantly correlated (r = .56, p < .001) and, therefore, averaged to create a composite attention problem score.
Procedures
Children and one accompanying parent came individually to the lab. Upon arrival, the study was explained to the parent and child and parental consent and child assent forms were signed. The study consisted of two parts—an eye-tracking task and the completion of parent- and child-report questionnaires. Participants were randomly assigned to either complete the eye tracking or the questionnaires first. The parent and child completed the questionnaires in the same room with a research assistant present to ensure that they did not discuss or share their answers. The questionnaires took approximately 10 minutes to complete.
For the eye-tracking task, children were escorted to a sound-proofed room. Children were seated at a laboratory table and placed their head in the eye-tracker headrest, which was adjusted to make the child comfortable. The eye tracker was then calibrated and validated to ensure gaze position accuracy of 0.50 degrees or better. Children then performed a demonstration task in which they moved a picture across the computer screen with their eyes. This task allowed children to become more comfortable with the laboratory set up and insure that the height of the chair was comfortable for the children before proceeding. Children watched all 60 video clips (i.e., all children watched the boy and girl video clips). Between video clips, children fixated a cross located at the center of the computer screen. No other tasks were performed other than the viewing of the video clips. After completing the eye-tracking task and the questionnaires, parents and children were thanked for their participation, and parents were given a $25 honorarium.
Results
Missing Data, Descriptive Statistics, and Bivariate Correlations
Seven children had some missing data due to not having peer-report or teacher-report data. Only one difference emerged between these seven children and those with complete data. Children with missing data attended to the reinforcer less (M = 1320.89; SD = 383.02) than those with complete data (M = 1572.37; SD = 292.57), t(70) = −2.10, p = .04. Descriptive statistics are presented in Table 1. On average, children fixated longest on the bully and victim, with the greatest time being spent on the bully. Consistent with previous literature (e.g., Coyne et al., 2006; Troop-Gordon & Ladd, 2005), aggression and peer victimization scores were moderately low, as were scores for attention problems. On average, children attended to one of the four actors for approximately 12.5 seconds while watching each video clip, suggesting that children primarily attended to the actors. However, there was notable variance in the amount of time children attended to the actors, a factor that was controlled for in the analyses. T-tests were conducted to identify gender differences in the study variables. There were no gender differences in attention to the bully, reinforcer, or defender. A marginal gender difference emerged for attention to the victim, t(71) = 1.86, p = .06. Boys spent less time attending to the victim (M = 4323.23 ms; SD = 553.00 ms) than girls (M = 4618.56 ms; SD = 776.44 ms). Boys received higher overt aggression ratings than girls, t(71) = −2.60, p = .009, (Ms = 1.64 and 1.41; SDs = .42 and .32, for boys and girls, respectively) and higher scores on attention problems, t(71) = −2.48, p = .01, (Ms = 3.13 and 2.57; SDs = 1.04 and .76, for boys and girls, respectively).
Table 1.
Descriptive Statistics
| M | SD | Minimum | Maximum | |
|---|---|---|---|---|
| Attention to bully | 5011.45 | 912.76 | 2037.81 | 6560.44 |
| Attention to victim | 4479.10 | 694.90 | 2233.97 | 5837.69 |
| Attention to reinforcer | 1547.92 | 308.52 | 648.00 | 2392.78 |
| Attention to defender | 1490.81 | 364.34 | 657.47 | 2853.81 |
| Peer victimization | 1.36 | .34 | 1.00 | 2.59 |
| Peer-reported overt aggression | 1.52 | .40 | 1.00 | 2.79 |
| Peer-reported relational aggression | 1.49 | .31 | 1.00 | 2.63 |
| Teacher-reported aggression | 1.49 | .68 | 1.00 | 3.50 |
| Attention problems | 1.41 | .46 | 1.00 | 3.05 |
| Total attention to actors | 12529.28 | 1639.13 | 5577.25 | 14617.56 |
Note. Attention to the bully, victim, reinforcer, defender, and total attention to the actors reflects raw duration scores calculated in milliseconds.
Bivariate correlations are presented in Table 2. Attention to the bully and to the victim were positively correlated, as were attention to the reinforcer and defender. There was a modest, but significant, negative correlation between attention to the victim and reinforcer. Although peer victimization was unrelated to attention to any of the bullying roles, two patterns emerged for the aggression variables. All three measures of aggression were negatively correlated with attention to the victim, and peer-reported relational aggression and teacher-reported aggression were negatively correlated with attention to the defender. The measures of peer victimization, aggression, and attention problems were all positively correlated. Notably, there were no significant correlations between attention to any of the bullying roles and attention problems. Total attention to the actors was negatively correlated with teacher-reported aggression, but was not significantly correlated with attention problems.
Table 2.
Bivariate Correlations
| Bivariate correlations | |||||||||
|---|---|---|---|---|---|---|---|---|---|
|
|
|||||||||
| Variable | Attention to bully |
Attention to victim |
Attention to revinforcer |
Attention to defender |
Peer vicimization |
PR overt aggression |
PR relational aggression |
TR aggression |
Attenton problems |
| Attention to bully | --- | ||||||||
| Attention to victim | .64*** | --- | |||||||
| Attention to reinforcer | .27* | .15 | --- | ||||||
| Attention to defender | −.02 | .06 | .44*** | --- | |||||
| Peer victimization | −.04 | −.04 | −.00 | −.06 | --- | ||||
| Peer-reported overt aggression | .01 | −.25* | .06 | −.02 | .25* | --- | |||
| Peer-reported relational aggression | −.01 | −.25* | −.09 | −.22* | .35** | .79*** | --- | ||
| Teacher-reported aggression | −.11 | −.36*** | −.11 | −.22* | .55*** | .40*** | .58*** | --- | |
| Attention problems | −.02 | −.15 | −.12 | −.14 | .54*** | .25* | .24* | .38*** | --- |
| Total attention to actors | .87*** | .82*** | .50*** | .32** | −.05 | −.10 | −.18 | −.29* | −.13 |
Note. PR = peer-report. TR = teacher-report.
p < .05.
p < .01.
p < .001.
Regressions Predicting Aggression from Victimization Attention to the Bullying Roles, and Gender
In order to determine whether the associations between peer victimization and aggression were moderated by attention to each of the bullying roles and gender, four sets of regressions were conducted, one for each of the bullying roles. In each set of analyses, regressions were estimated simultaneously for peer-reported overt aggression, peer-reported relational aggression, and teacher-reported aggression using MPLUS (Muthén & Muthén, 1998–2007). As the primary objective of this study was to determine whether attention to the bullying roles moderates the link between victimization and aggression, all regressions included attention on one of the bullying roles, peer victimization, and their interaction. We also controlled for attention problems, total attention to the actors, and gender (0 = boys; 1 = girls) in each analysis. Two-way interactions between gender and victimization and gender and attention to the bullying role, as well as the three-way interaction between gender, peer victimization, and attention to the bullying role were tested. For parsimony, interactions with gender were removed from the final analysis if statistically nonsignificant; inclusion or exclusion of these interactions did not affect the study findings. All analyses were conducted using full information maximum likelihood (FIML; Enders & Bandalos, 2001). Therefore data from all 72 participants were included in these analyses. The MLR estimator was used due to non-normality of some of the variables. Significant interactions were decomposed by testing and plotting simple slopes at −1, 0, and +1 SDs (i.e., low, average, and high levels) of attention to the bullying role.
Attention to the bully
Table 3 shows the regressions predicting aggression from attention to the bully. A main effect of gender emerged for peer-reported overt aggression such that girls evidenced less overt aggression than boys. In addition, a main positive effect of peer victimization emerged for peer-reported relational aggression and teacher-reported aggression. The two-way interaction between gender and peer victimization, the two-way interaction between gender and attention to the bully, and the three-way interaction were nonsignificant. Attention to the bully was marginally positively associated with peer-reported overt aggression, and was significantly positively associated with peer-reported relational aggression and teacher-reported aggression. Moreover, the two-way interaction between attention to the bully and peer victimization was significant for peer-reported overt aggression and peer-reported relational aggression. The two-way interaction only approached significance (p = .099) for teacher-reported aggression. Plots of these interactions are presented in Figure 1. Although the interaction only approached significance for teacher-reported aggression, plots of this interaction are included for comparison purposes.
Table 3.
Regressions Predicting Aggression from Attention to the Bully, Peer Victimization, Gender, and their Interaction
| Aggression | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
||||||||||||
| Peer-reported overt aggression |
Peer-reported relational aggression |
Teacher-reported aggression |
||||||||||
|
|
|
|
||||||||||
| Predictors | b | β | p-value | R2 | b | β | p-value | R2 | b | β | p-value | R2 |
| Attention problems | .09 | .11 | .45 | .31** | .03 | .04 | .80 | .50*** | .19 | .13 | .36 | .41*** |
| Total attention to actors | −.86 | −.35 | .12 | −1.40 | −.73 | .002 | −3.30 | −.78 | .002 | |||
| Gender | −.25 | −.31 | .002 | −.09 | −.14 | .11 | .18 | .13 | .17 | |||
| Attention to bully | .02 | .38 | .09 | .03 | .71 | < .001 | .05 | .62 | < .001 | |||
| Peer victimization | .18 | .15 | .17 | .26 | .28 | .04 | .88 | .44 | .01 | |||
| Attention to bully × peer victimization | .06 | .38 | < .001 | .05 | .43 | < .001 | .06 | .20 | .099 | |||
Note: Gender was coded 0 = boys and 1 = girls.
p < .01.
p < .001.
Figure 1.
Plots of regressions predicting (a) peer-reported overt aggression, (b) peer-reported relational aggression, and (c) teacher-reported aggression from attention to the bully and peer victimization. P-values for significant simple slopes are labeled.
Across all three forms of aggression, peer victimization was associated with aggressive behavior at high levels of attention to the bully [b = .71, t(65) = 4.29, p < .001, for overt aggression; b = .73, t(65) = 6.85, p < .001, for relational aggression; and b = 1.38, t(65) = 5.98, p < .001, for teacher-reported aggression]. At moderate levels of attention to the bully, peer victimization was not related to peer-reported overt aggression, b = .18, t(65) = 1.38, p = .17, but was related to peer-reported relational aggression, b = .26, t(65) = 2.06, p = .04, and teacher-reported aggression, b = .88, t(65) = 2.58, p = .01. At low levels of attention to the bully, peer victimization was not related to peer-reported overt aggression, b = −.35, t(65) = −1.69, p = .10, relational aggression, b = −.21, t(65) = −.93, p = .36, or teacher-reported aggression, b = .38, t(65) = .64, p = .53. As can be seen in Figure 1, a combination of high levels of peer victimization and high levels of attention to the bully was associated with elevated levels of aggressive behavior. Aggression scores were relatively low at low levels of victimization regardless of time spent attending to the bully.
Attention to the victim
Table 4 shows the regressions predicting aggression from attention to the victim. Main effects of gender emerged indicating that boys evidenced greater peer-reported overt aggression than girls, but less teacher-reported aggression. There were also significant positive main effects of peer victimization on peer-reported relational aggression and teacher-reported aggression. Although attention to the victim did not moderate the effect of victimization on aggression, a significant main effect of attention to the victim emerged for peer-reported overt aggression, β = −.39, p = .01, and teacher-reported aggression, β = −.51, p < .001. Children evidenced lower levels of peer-reported overt aggression and lower levels of teacher-reported victimization at higher levels of attention to the victim.
Table 4.
Regressions Predicting Aggression from Attention to the Victim, Peer Victimization, Gender, and their Interaction
| Aggression | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
||||||||||||
| Peer-reported overt aggression |
Peer-reported relational aggression | Teacher-reported aggression |
||||||||||
|
|
|
|
||||||||||
| Predictors | B | β | p-value | R2 | b | β | p-value | R2 | b | β | p-value | R2 |
| Attention problems | .02 | .02 | .90 | .21* | −.07 | −.11 | .53 | .21 | .11 | .08 | .56 | .47*** |
| Total attention to actors | .64 | .26 | .21 | .16 | .08 | .73 | .72 | .17 | .38 | |||
| Gender | −.17 | −.22 | .05 | −.06 | −.10 | .39 | .31 | .23 | .01 | |||
| Attention to victim | −.02 | −.39 | .01 | −.01 | −.27 | .11 | −.05 | −.51 | < .001 | |||
| Peer victimization | .29 | .25 | .21 | .41 | .45 | .03 | 1.04 | .52 | < .001 | |||
| Attention to victim × peer victimization | −.01 | −.03 | .84 | −.03 | −.20 | .30 | −.05 | −.14 | .37 | |||
Note: Gender was coded 0 = boys and 1 = girls.
p = .05.
p < .001.
Attention to the reinforcer
Table 5 shows the regressions predicting aggression from attention to the reinforcer. Main effects of gender emerged indicating that boys evidenced greater peer-reported overt aggression than girls, but less teacher-reported aggression. There were no main effects of attention to the reinforcer on aggression and no significant interactions between attention on the reinforcer and peer victimization.
Table 5.
Regressions Predicting Aggression from Attention to the Reinforcer, Peer Victimization, Gender, and their Interaction
| Aggression | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
||||||||||||
| Peer-reported overt aggression |
Peer-reported relational aggression | Teacher-reported aggression |
||||||||||
|
|
|
|
||||||||||
| Predictors | b | β | p-value | R2 | b | β | p-value | R2 | b | β | p-value | R2 |
| Attention problems | .06 | .07 | .68 | .19 | .01 | .02 | .92 | .22 | .22 | .17 | .26 | .40*** |
| Total attention to actors | −.24 | −.10 | .36 | −.23 | −.12 | .41 | −1.11 | −.27 | .12 | |||
| Gender | −.23 | −.29 | .007 | −.10 | −.16 | .13 | .19 | .14 | .19 | |||
| Attention to reinforcer | .01 | .09 | .50 | .00 | −.04 | .80 | .02 | .07 | .52 | |||
| Peer victimization | .23 | .20 | .25 | .29 | .32 | .12 | .86 | .43 | .04 | |||
| Attention to reinforcer × peer victimization | .08 | .15 | .31 | .10 | .25 | .15 | .12 | .14 | .34 | |||
Note: Gender was coded 0 = boys and 1 = girls.
p < .001.
Attention to the defender
Table 6 shows the regressions predicting aggression from attention to the defender. A negative main effect of gender emerged indicating that boys evidenced greater peer-reported overt aggression than girls. There was a negative main effect of attention to the defender on peer-reported relational aggression and teacher-reported aggression. Moreover, the three-way interaction between peer victimization, attention to the defender, and gender was significant for peer-reported overt aggression, peer-reported relational aggression, and teacher-reported aggression. Plots of these interactions are presented in Figure 2.
Table 6.
Regressions Predicting Aggression from Attention to the Defender, Peer Victimization, Gender, and their Interaction
| Aggression | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
||||||||||||
| Peer-reported overt aggression |
Peer-reported relational aggression | Teacher-reported aggression |
||||||||||
|
|
|
|
||||||||||
| Predictors | b | β | p-value | R2 | b | β | p-value | R2 | b | β | p-value | R2 |
| Attention problems | .12 | .15 | .29 | .34** | −.02 | −.03 | .81 | .39* | .32 | .23 | .21 | .48*** |
| Total attention to actors | −.36 | −.15 | .25 | −.34 | −.18 | .27 | −1.24 | −.30 | .09 | |||
| Gender | −.18 | −.23 | .02 | −.08 | −.13 | .17 | .24 | .18 | .08 | |||
| Attention to defender | −.01 | −.08 | .48 | −.04 | −.41 | < .001 | −.04 | −.20 | .02 | |||
| Peer victimization | −.28 | −.24 | .32 | .13 | .14 | .59 | .19 | .09 | .59 | |||
| Attention to defender × peer victimization | −.24 | −.52 | .002 | −.18 | −.51 | .005 | .−.22 | −.28 | < .001 | |||
| Attention to defender × gender | .01 | .07 | .46 | .05 | .35 | .003 | .07 | .23 | .17 | |||
| Peer victimization × gender | .63 | .42 | .03 | .22 | .19 | .39 | .90 | .35 | .07 | |||
| Attention to defender × peer victimization × gender | .42 | .63 | < .001 | .34 | .65 | < .001 | .47 | .41 | < .001 | |||
Note: Gender was coded 0 = boys and 1 = girls.
p < .05.
p < .01.
p < .001.
Figure 2.
Plots of regressions predicting: (a) peer-reported overt aggression (b) peer-reported relational aggression, and (c) teacher-reported aggression from attention to the the defender, peer victimization, and gender.
For boys, peer victimization was negatively associate with peer-reported overt aggression at high levels of attention to the defender, b = −1.14, t(62) = −2.74, p = .008. However, peer victimization was not associated with peer-reported relational aggression, b = −.53, t(62) = −1.20, p = .23, or teacher-reported aggression, b = −.61, t(62) = −1.60, p = .11, at high levels of attention to the defender. For boys, at low levels of attention to the defender, peer victimization was positively associated with aggression. This association was significant for peer-reported relational aggression, b = .78, t(62) = 2.09, p = .04, and teacher-reported aggression, b = .99, t(62) = 3.76, p < .001. The positive association between peer victimization and peer-reported overt aggression was not significant at 1 SD below the mean on attention to the defender, b = .58, t(62) = 1.53, p = .13. As can be seen in Figure 2, high levels of aggression were estimated when boys evidenced high levels of victimization and low levels of attention to the defender. However, high levels of overt aggression were also estimated when boys evidenced low levels of peer victimization and high levels of attention to the defender.
A different pattern emerged for girls. Peer-victimization was positively associated with aggressive behavior at hgh levels of attention to the defender. This association was significant for peer-reported overt aggression, b = .99, t(62) = 4.99, p < .001, and teacher-reported aggression, b = 1.98, t(62) = 15.06, p < .001, but not for relational aggression, b = .92, t(62) = 1.62, p = .11. Peer victimization was not related to any of the measures of aggression for girls at low levels of attention to the defender [b = −.29, t(62) = −1.03, p = .31, for overt aggression; b = −.24, t(62) = −.22, p = .82, for relational aggression; b = .19, t(62) = .62, p = .53, for teacher-reported aggression]. As can be seen in Figure 2, for girls, aggression scores were highest when girls evidenced high levels of peer victimization and high attention to the defender.
Robustness of the Findings across Victimization Informant
A final set of analyses were conducted in which each of the three peer victimization scores (i.e., peer-report, teacher-report, and parent-report) were analyzed separately. A composite score for aggression was computed by averaging the peer-reported overt aggression, peer-reported relational aggression, and teacher-reported aggression scores. This score served as the dependent variable. The findings replicated our initial results. Specifically, across all three measures of victimization there was: a) a positive victimization × attention to the bully interaction (all ps ≤ .02), b) a negative main effect of attention to the victim (all ps ≤ .008), c) no significant main or interactive effects for attention to the reinforcer, and d) a positive victimization × attention to the defender × gender interaction (all ps ≤ .03).
Discussion
An extensive literature has been accrued documenting the roles children take within the bullying context (Salmivalli, 2010). This study is novel in its examination of those roles as important cues with which children interpret and respond to their social environment. By studying how children differentially attend to these social cues, we gain insights into the heterogeneity present among peer-victimized youth. As anticipated, attention to the most threatening cue, the bully, was associated with a heightened relation between victimization and aggression. Although attention to the defender, a proposed protective factor, mitigated the extent to which victimization was associated with aggression, this effect held for boys only. For girls, attending to the defender heightened the link between victimization and aggression, suggesting that boys and girls may have very different interpretations of, and reactions to, defenders’ responses. Furthermore, attending to victims, regardless of one’s own victimization from peers, was associated with being less aggressive. Thus, by drawing upon Racer and Dishion’s (2012) proposition that attentional problems exacerbate risk-psychopathology linkages, we were able to demonstrate that biased attentional processing of cues within socially threatening contexts may be a key factor in the co-occurrence of victimization and aggression.
Attention to Bullies and Reinforcers
Perhaps the strongest pattern of findings to emerge in this study was that showing that attention to the bully moderates the association between peer victimization and aggression. Specifically, victimization was associated with aggression only at moderate or high levels of attention to the bully. Moreover, this pattern held across all three measures of aggression (i.e., peer-reported overt and relational aggression and teacher-reported aggression). In addition to being consistent with previous research linking aggression or externalizing problems to hypervigilance to threatening cues (e.g., Gouze, 1987; Van Honk et al., 2001), the current study implicates a propensity to attend to interpersonal threat as a moderating factor augmenting the risk posed by peer victimization.
This finding helps explicate other known factors that differentiate aggressive from non-aggressive victims. Aggressive victims evidence greater emotional dysregulation (Georgiou & Stavrinides, 2008; Toblin, Schwartz, Gorman, Abou-ezzeddine, 2005), physiological reactivity to social stress (Rudolph et al., 2010), and hostile attribution biases (Pouwels, Scholte, van Noorden, & Cillessen, 2016) when compared to non-aggressive victims. Excessive attention to threat, specifically those who aggress against them, may underlie these differences by incurring heightened emotional and physical reactivity when faced with peers’ aggression and greater interpretations of potential harm. Attending to bullies may also bias children’s expectations regarding peers’ behavior. For example, antisocial peer beliefs (i.e., viewing peers as hostile and untrustworthy) have been shown to mediate the association between peer victimization and later externalizing problems (Ladd & Troop-Gordon, 2003; Troop-Gordon & Ladd, 2005). Visually attending to the aggressor when witnessing scenes of bullying may contribute to the development of such beliefs among children who are peer-victimized.
This explanation presumes that victimized youth were taking the perspective of the victim when watching the video clips. However, it is also possible that after repeated exposure to peer victimization, children begin to identify with the bullies when watching peer aggression. Rather than observing a bully as a threat, victimized children may begin to imagine themselves in the bully’s position, observing and learning the peers’ aggressive behavior. Indeed, whereas threat cues have often been operationalized as facial expressions or words of anger (e.g., Lonigan & Vasey, 2009; Mogg, Philippot, & Bradley, 2004; Van Honk et al., 2001), when asked to portray the role of the bully, the child actors in this study often expressed happiness and amusement. This was verified by the undergraduate assistants who coded the actors’ portrayals. On a scale from 1 (very amused) to 5 (not at all amused), the average rating the coders gave the actors portraying the bullies was 1.44. Thus, victimized chidren may learn from watching bullies that aggression against peers is enjoyable and mimic this behavior when given the opportunity.
Reinforcers also signal threat, and like bullies, communicate enjoyment at the peer aggression. However, the anticipated interaction between peer victimization and attention to the reinforcer did not emerge. Amusement by the reinforcer may be interpreted differently by children. Although some may see the reinforcer’s behavior as communicating pleasure at the expense of the victim and indicating that the peer group is hostile, others may view this behavior as a sign that the bullying is “just for fun,” minimizing threat to the victim. Alternatively, for some, attention to reinforcers may be part of a larger coping strategy of diverting attention from the bully to potentially more benign social cues. Subsequent studies that not only assess visual attention to the scenes, but also elicit participants’ interpretations of the bullying roles will help clarify how attention to reinforcers is processed by victimized children.
Attention to Defenders
Whereas most studies of attentional biases and aggression focus on hypervigilance to cues hypothesized to amplify risk, the current study is unique in examining attention to potentially protective cues. Defenders were conceived as signaling reduced threat through available social support. Thus, it was proposed that attention to defenders may reduce the positive association between peer victimization and aggression. Findings for boys were consistent with this proposition. Specifically, victimization was associated with heightened peer-reported overt and relational aggression, and with teacher-reported aggression, only when they evidenced low levels of attention to defenders. Defenders may be important to boys, who socialize predominantly in larger groups than girls (Ladd, 1983; Lever, 1978). Consequently, attention to defenders may reduce emotional reactivity and retaliatory responding by communicating that the bullying is not threatening the target’s standing or inclusion within the larger peer group.
Unexpectedly, and for overt aggression only, low victimization was associated with greater aggression at high attention to the defenders. It is possible that overtly aggressive boys who are themselves not the targets of bullying may be highly socially adept, including being aware of peers who may disapprove of their aggression (i.e., defenders) and cautious not to let their overtly aggressive behaviors be seen by adults. We would expect that such boys would be socially central (Rodkin, Farmer, Pearl, & Van Acker, 2000) and popular (Cillessen & Rose, 2005). This proposition will need to be tested in future research, particularly in light of the fact that this pattern did not replicate with relational or teacher-reported aggression.
Also requiring further study is the unexpected positive relation between all three forms of aggression and victimization for girls only at high levels of attention to the defender. Girls may interpret the defender somewhat differently than boys. Rather than perceiving an ally, they may view the defender’s behavior as confirmation that a hurtful experience is occurring. Looking to peers for sympathy and confirmation of distress would be consistent with girls’ greater tendency to co-ruminate (Rose, 2002). Visual confirmation that the bullying behavior is harmful may result in greater aggression toward peers. Alternatively, girls who are victimized may translate the presence of defenders into implicit support for any retaliatory aggression they may engage in.
Attention to Victims
Correlational analyses confirmed that attention to victims was associated with lower levels of overt, relational, and teacher-reported aggression, although these associations were somewhat attenuated when controlling for other study variables (e.g., peer victimization, attention problems). This is consistent with previous, lab-based studies, in which attention to victims has been shown to mitigate aggression (e.g., Baron, 1971, 1974; Kimonis et al., 2006; Nathanson & Cantor, 2000). This study is the first to show that attention to victims operates similarly when the victim’s distress is caused by bullying. Similar to Nathanson and Cantor (2000) it is possible that training children to attend to victims within bullying situations may help to minimize aggressive behaviors. Moreover, the relation between attention to victims and aggression did not interact with peer victimization. Thus, the benefits of attention to victims is not disrupted by a history of being the target of peers’ aggression. However, a gender difference in attention to victims did emerge. Boys spent less time looking at victims than girls did. Inattention to victims by boys may partially explain boys’ greater tendency to aggress directly against their victims (Card et al., 2008). Thus, programs that increase attention to victims may have their greatest impact on aggressive boys.
Limitations and Future Directions
By using eye tracking to study attention to naturally occurring social cues within bullying situations, this study revealed novel findings regarding how attentional biases may amplify or mitigate the relation between victimization and aggression. This study also had a number of additional strengths including the ability to test the robustness of findings across multiple informants of aggression and vicitmizaiton. However, a number of limitations of this study warrant mentioning and should be rectified in future research. We focused on early adolescence, an age during which bullying often peaks (Pepler, Craig, Connolly, Yuile, McMaster, Jiang, 2006; Solberg & Olweus, 2003) and peers become increasingly important in youth’s lives (Steinberg & Morris, 2001). We cannot assume that the findings generated here would generalize to younger children, who may have a very different interpretation of the social cues, or to older adolescents whose behavior in relation to victimization may be less affected by attentional processes. In addition to expanding the age range studied, research is also needed in which attentional patterns are assessed along with participants’ interpretations of, and identification with, the bullying roles. Indeed, many of the explanations presented here were premised on differential interpretations of the bullying roles. Only through direct assessment of those interpretations can these explanations be supported or refuted. An additional methodology to be employed is directing children and adolescents’ attention to particular social roles (e.g., the defender) to see if such manipulations affect cognitive and affective responses to the bullying scenes.
It should further be noted that although naturalistic scenes of bullying were portrayed, the participants were third-party observers, not directly involved in the bullying situation. Cognitive responses to hypothetical situations vary depending on whether participants are the direct target of that experience or are asked to take a third-party perspective (Kupersmidt, Stelter, & Dodge, 2011). The effects of attentional biases may be stronger, or qualitatively different, when children are experiencing being bullied. Developing an in vivo task that allows for simultaneously tracking participants’ attention would overcome this limitation. Such methodologies would also remove ambiguiuty as to whom participants are identifying when watching bullying. However, such paradigms would pose substantial ethical challenges.
Other methodological limitations should be addressed in follow-up research. The information regarding relational aggression was available from only one informant, and no measures were included designed to assess reactive and proactive aggression. It is very possible that some of the associations found here would hold up for reactive aggression (e.g., attention to the bully may increase anger and reactive aggression among victimized children) and others may be specific to proactive aggression (e.g., lack of attention to the victim may reflect psychopathic traits or callousness characteristic of those who engage in proactive aggression; Raine et al., 2006). In addition, although we have no reason to believe that awareness of the eye tracking procedure biased the results, it is possible that simply knowing they were being eye tracked influenced children’s allocation of attention to the scenes. Properties of the sample should also be considered. The sample size was suffiicent to detect medium effects (e.g., power = .80 for f2 of .11), but did not allow for reliably detecting small effects that, nonetheless, may have been meaningful. The sample was also highly homogeneous. Whether these findings replicate with a more racially/ethnically and econonomically diverse sample will need to be explored. Finally, only concurrent associations could be tested with this data set. To what extent victimization predicts future aggression as a function of attentional biases, or attentional biases moderate the link between aggression and future victimization is unknown. It is even possible that a combination of victimization and aggression precedes the development of attention to particular social cues. Only through longitudinal research will these prospective associations be elucidated.
Conclusion
Although attentional biases are known to be foundational in the development of psychopathology and behavioral problems (Dodge, 1993; Racer & Dishion, 2012), their role in adjustment problems evidenced by peer victimized youth have yet to be examined. This study addressed this gap in the literature by showing that victimization is associated with aggressive behavior only when children have a bias to threat (i.e., bullies) when viewing scenes of bullying. Moreover, this study showed that attention to defenders may serve a protective factor for boys, but heighten the risk victimization poses for girls. Also supported was the proposition that attention to victims is negatively associated with aggressive behavior. While these findings underscore the importance of attentional biases in victimization-adjustment linkages, we will only understand the developmental processes underlying these associations through studies that test these associations longitudinally and explore the how attentional biases are associated cognitive and affective responses to peer aggression.
Acknowledgments
This research was supported by NIH P20 GM103505. The National Institute of General Medical Sciences (NIGMS) is a component of the National Institutes of Health (NIH). The contents of this report are solely the responsibility of the authors and do not necessarily reflect the official views of the NIH or NIGMS. The authors would like to thank the school administrators, teachers, parents, and children who participated in this project.
Contributor Information
Wendy Troop-Gordon, Department of Psychology, North Dakota State University.
Robert D. Gordon, Department of Psychology, North Dakota State University
Bethany M. Schwandt, Department of Psychology, North Dakota State University
Gregor A. Horvath, Department of Psychology, North Dakota State University
Elizabeth Ewing Lee, Insight Research and Consulting.
Kari J. Visconti, School of Social and Family Dynamics, Arizona State University
References
- Achenbach TM. Manual for the Teacher’s Report Form and profile. Burlington: University of Vermont; 1991. [Google Scholar]
- Ayduk O, Mendoza-Denton R, Mischel W, Downey G. Regulating the interpersonal self: Strategic self-regulation for coping with rejection sensitivity. Journal of Personality and Social Psychology. 2000;79:776–792. doi: 10.1037//0022-3514.79.5.776. [DOI] [PubMed] [Google Scholar]
- Baron RA. Aggression as a function of magnitude of victim's pain cues, level of prior anger arousal, and aggressor-victim similarity. Journal of Personality and Social Psychology. 1971;18:48–54. doi: 10.1037/h0030643. [DOI] [PubMed] [Google Scholar]
- Baron RA. Aggression as a function of victim’s pain cues, level of prior anger arousal, and exposure to an aggressive model. Journal of Personality and Social Psychology. 1974;29:117–124. doi: 10.1037/h0035707. [DOI] [PubMed] [Google Scholar]
- Bjørnebekk G, Howard R. Sub-types of angry aggression in antisocial youth: Relationships with self-reported delinquency and teachers’ perceptions of social competence and emotional/behavioural problems. Personality and Individual Differences. 2012;53:312–316. doi: 10.1016/j.paid.2012.03.033. [DOI] [Google Scholar]
- Card NA, Stucky BD, Sawalani GM, Little TD. Direct and indirect aggression during childhood and adolescence: A meta-analytic review of gender differences, intercorrelations, and relations to maladjustment. Child Development. 2008;79:1185–1229. doi: 10.1111/j.1467-8624.2008.01184.x. [DOI] [PubMed] [Google Scholar]
- Coyne SM, Archer J, Eslea M. “We’re not friends anymore! Unless…”: The frequency and harmfulness of indirect, relational, and social aggression. Aggressive Behavior. 2006;32:294–307. doi: 10.1002/ab.20126. [DOI] [Google Scholar]
- Crick NR, Dodge KA. A review and reformulation of social information-processing mechanisms in children's social adjustment. Psychological Bulletin. 1994;115:74–101. doi: 10.1037/0033-2909.115.1.74. [DOI] [Google Scholar]
- Crick NR, Grotpeter JK. Children’s treatment by peers: Victims of relational and overt aggression. Development and Psychopathology. 1996;8:367–380. doi: 10.1017/S0954579400007148. [DOI] [Google Scholar]
- Dishion TJ, Connell A. Adolescents’ resilience as a self-regulatory process. Annals of the New York Academy of Sciences. 2006;1094:125–138. doi: 10.1196/annals.1376.012. [DOI] [PubMed] [Google Scholar]
- Dodge KA. Social-cognitive mechanisms in the development of conduct disorder and depression. Annual Review of Psychology. 1993;44:559–584. doi: 10.1146/annurev.ps.44.020193.003015. [DOI] [PubMed] [Google Scholar]
- Dodge KA, Coie JD. Social information-processing factors in reactive and proactive aggression in children’s peer groups. Journal of Peronsality and Social Psychology. 1987;53:620–635. doi: 10.1037/0022-3514.53.6.1146. [DOI] [PubMed] [Google Scholar]
- Dodge KA, Lochman JE, Harnish JD, Bates JE, Pettit GS. Reactive and proactive aggression in school children and psychiatrically impaired chronically assaultive youth. Journal of Abnormal Psychology. 1997;106:37–51. doi: 10.1037/0021-843X.106.1.37. [DOI] [PubMed] [Google Scholar]
- Enders CK, Bandalos DL. The relative performance of full information maximum likelihood estimation for missing data in structural equation modeling. Structural Equation Modeling. 2001;8:430–457. doi: 10.1207/S15328007SEM08035. [DOI] [Google Scholar]
- Gardner TW, Dishion TJ, Connell AM. Adolescent self-regulation as resilience: Resistance to antisocial behavior within the deviant peer context. Journal of Abnormal Child Psychology. 2008;36:273–284. doi: 10.1007/s10802-007-9176-6. [DOI] [PubMed] [Google Scholar]
- Georgiou SN, Stavrinides P. Bullies, victims and bully-victims: Psychosocial profiles and attribution. School Psychology International. 2008;29:574–589. doi: 10.1177/0143034308099202. [DOI] [Google Scholar]
- Goldbaum S, Craig WM, Pepler D, Connolly J. Developmental trajectories of victimization: Identifying risk and protective Factors. In: Zins JE, Elias MJ, Maher CA, editors. Bullying, victimization, and peer harassment: A handbook of prevention and intervention. New York, NY, US: Haworth Press; 2007. pp. 139–156. [DOI] [Google Scholar]
- Gouze KR. Attention and social problem solving as correlates of aggression in preschool males. Journal of Abnormal Child Psychology. 1987;15:181–197. doi: 10.1007/BF00916348. [DOI] [PubMed] [Google Scholar]
- Hanish LD, Guerra NG. A longitudinal analysis of patterns of adjustment following peer victimization. Development and Psychopathology. 2002;14:69–89. doi: 10.1017/s0954579402001049. [DOI] [PubMed] [Google Scholar]
- Hanish LD, Guerra N. Aggressive victims, passive victims, and bullies: Developmental continuity or developmental change? Merrill Palmer Quarterly. 2004;50:17–38. doi: 10.1353/mpq.2004.0003. [DOI] [Google Scholar]
- Hertz MF, Donato I, Wright J. Bullying and suicide: A public health approach. Journal of Adolescent Health. 2013;53:S1–S3. doi: 10.1016/j.jadohealth.2013.05.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hodges EV, Boivin M, Vitaro F, Bukowski WM. The power of friendship: Protection against an escalating cycle of peer victimization. Developmental Psychology. 1999;35:94–101. doi: 10.1037/0012-1649.35.1.94. [DOI] [PubMed] [Google Scholar]
- Hodges EVE, Perry DG. Personal and interpersonal antecedents and consequences of victimization by peers. Journal of Personality and Social Psychology. 1999;76:677–685. doi: 10.1037/0022-3514.76.4.677. [DOI] [PubMed] [Google Scholar]
- Horsley TA, de Castro BO, Van der Schoot M. In the eye of the beholder: Eyetracking assessment of social information processing in aggressive behavior. Journal of Abnormal Child Psychology. 2010;38:587–599. doi: 10.1007/s10802-009-9361-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kimonis ER, Frick PJ, Fazekas H, Loney BR. Psychopathic traits, aggression, and the processing of emotional stimuli in non-referred children. Behavioral Sciences and the Law. 2006;24:21–37. doi: 10.1002/bsl.668. [DOI] [PubMed] [Google Scholar]
- King S, Waschbush DA. Aggression in children with attention-deficit/hyperactivity disorder. Expert Review of Neurotherapeutics. 2010;10:1581–1594. doi: 10.1586/ern.10.146. [DOI] [PubMed] [Google Scholar]
- Kupersmidt JB, Stelter R, Dodge KA. Development and validation of the social information processing application: A web-based measure of social information processing patterns in elementary school-age boys. Psychological Assessment. 2011;23:834–847. doi: 10.1037/a0023621. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ladd GW. Social networks of popular, average, and rejected children in school settings. Merrill-Palmer Quarterly. 1983;29:283–307. [Google Scholar]
- Ladd GW, Troop-Gordon W. The role of chronic peer difficulties in the development of children's psychological adjustment problems. Child Development. 2003;74:1344–1367. doi: 10.1111/1467-8624.00611. [DOI] [PubMed] [Google Scholar]
- Leadbeater BJ, Hoglund WL. The effects of peer victimization and physical aggression on changes in internalizing from first to third grade. Child Development. 2009;80:843–859. doi: 10.1111/j.1467-8624.2009.01301.x. [DOI] [PubMed] [Google Scholar]
- Lever J. Sex differences in the complexity of children’s play and games. American Sociological Review. 1978;43:471–483. doi:131.204.254.104. [Google Scholar]
- Lonigan CJ, Vasey MW. Negative affectivity, effortful control, and attention to threat-relevant stimuli. Journal of Abnormal Child Psychology. 2009;37:387–399. doi: 10.1007/s10802-008-9284-y. [DOI] [PubMed] [Google Scholar]
- Mogg K, Philippot P, Bradley BP. Selective attention to angry faces in clinical social phobia. Journal of Abnormal Psychology. 2004;113:160–165. doi: 10.1037/0021-843X.113.1.160. [DOI] [PubMed] [Google Scholar]
- Muthén B, Muthén L. Mplus user’s guide. 6. Los Angeles, CA: Author; 1998–2007. [Google Scholar]
- Nansel TR, Overpeck M, Pilla RS, Ruan WJ, Simon-Morton B, Scheidt P. Bullying behaviors among U.S. youth: Prevalence and association with psychosocial adjustment. Journal of the American Medical Association. 2001;285:2094–2100. doi: 10.1001/jama.285.16.2094. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nathanson AI, Cantor J. Reducing the aggression-promoting effect of violent cartoons by increasing children’s fictional involvement with the victim: A study of active mediation. Journal of Broadcasting & Electronic Media. 2000;44:125–142. doi: 10.1207/s15506878jobem4401_9. [DOI] [Google Scholar]
- O’Connell P, Pepler D, Craig W. Peer involvement in bullying: Insights and challenges for intervention. Journal of Adolescence. 1999;22:437–452. doi: 10.1006/jabo.1999.0238. [DOI] [PubMed] [Google Scholar]
- Olson SL, Sameroff AJ, Kerr DCR, Lopez NL, Wellman HM. Developmental foundations of externalizing problems in young children: The role of effortful control. Development and Psychopathology. 2005;17:25–45. doi: 10.1017/S0954579405050029. [DOI] [PubMed] [Google Scholar]
- Pellegrini AD, Long JD. A longitudinal study of bullying, dominance, and victimization during the transition from primary school through secondary school. British Journal of Developmental Psychology. 2002;20:259–280. doi: 10.1348/026151002166442. [DOI] [Google Scholar]
- Pepler DJ, Craig WM, Connolly JA, Yuile A, McMaster L, Jiang D. A developmental perspective on bullying. Aggressive Behavior. 2006;32:376–384. doi: 10.1002/ab.20136. [DOI] [Google Scholar]
- Perry DG, Perry LC. Denial of suffering in the victim as a stimulus to violence in aggressive boys. Child Development. 1974;45:55–62. doi: 10.2307/1127749. [DOI] [PubMed] [Google Scholar]
- Pouwels JL, Scholte RHJ, van Noorden THJ, Cillessen AHN. Interpretations of bullying by bullies, victims, and bully victims in interactions at different levels of abstraction. Aggressive Behavior. 2016;42:54–65. doi: 10.1002/ab.21605. [DOI] [PubMed] [Google Scholar]
- Preacher KJ, Curran PJ, Bauer DJ. Computational tools for probing interaction effects in multiple linear regression, multilevel modeling and laten curve analysis. Journal of Educational and Behavioral Statistics. 2006;31:437–448. doi: 10.3102/10769986031004437. [DOI] [Google Scholar]
- Racer KH, Dishion TJ. Disordered attention: Implications for understanding and treating internalizing and externalizing disorders in childhood. Cognitive and Behavioral Practice. 2012;19:31–40. doi: 10.1016/j.cbpra.2010.06.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Raine A, Dodge KA, Loeber R, Gatzke-Kopp L, Lynam D, Regynolds C, et al. The reactive-proactive aggression questionnaire: Differential correlates of reactive and proactive aggression in adolescent boys. Aggressive Behavior. 2006;32:159–171. doi: 10.1002/ab.20115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reijntjes A, Kamphuis JH, Prinzie P, Boelen PA, Van der Schoot MJ, Telch M. Prospective linkages between peer victimization and externalizing problems in children: A meta-analysis. Aggressive Behavior. 2011;37:215–222. doi: 10.1002/ab.20374. [DOI] [PubMed] [Google Scholar]
- Reijntjes A, Kamphuis JH, Prinzie P, Telch MJ. Peer victimization and internalizing problems in children: A meta-analysis of longitudinal studies. Child Abuse & Neglect. 2010;34:244–252. doi: 10.1016/j.chiabu.2009.07.009. [DOI] [PubMed] [Google Scholar]
- Rodkin PC, Farmer TW, Pearl R, Van Acker R. Heterogeneity of popular boys: Antisocial and prosocial configurations. Developmental Psychology. 2000;36:14–24. doi: 10.1037/0012-1649.36.1.14. [DOI] [PubMed] [Google Scholar]
- Rose A. Co-rumination in the friendships of girls and boys. Child Development. 2002;73:1830–1843. doi: 10.1111/1467-8624.00509. [DOI] [PubMed] [Google Scholar]
- Rudolph KD, Abaied JL, Flynn M, Sugimura N, Agoston AM. Developing relationships, being cool, and not looking like a loser: Social goal orientation predicts children’s responses to peer aggression. Child Development. 2011;82:1518–1530. doi: 10.1111/j.1467-8624.2011.01631.x. [DOI] [PubMed] [Google Scholar]
- Rudolph KD, Troop-Gordon W, Granger DA. Peer victimization and aggression: Moderation by individual differences in salivary cortisol and alpha-amylase. Journal of Abnormal Child Psychology. 2010;38:843–856. doi: 10.1007/s10802-010-9412-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rudolph KD, Troop-Gordon W, Hessel ET, Schmidt JD. A latent growth curve analysis of early and increasing peer victimization as predictors of mental health across elementary school. Journal of Clinical Child & Adolescent Psychology. 2011;40:111–122. doi: 10.1080/15374416.2011.533413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rudolph KD, Troop-Gordon W, Monti JD, Miernicki ME. Moving against and away from the world: The adolescent legacy of peer victimization. Development and Psychopathology. 2014;26:721–734. doi: 10.1017/S0954579414000340. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salmivalli C. Bullying and the peer group. A review. Aggression and Violent Behavior. 2010;15:112–120. doi: 10.1016/j.avb.2009.08.007. [DOI] [Google Scholar]
- Salmivalli C, Lagerspetz K, Bjorkqvist K, Osterman K, Kaukiainen A. Bullying as a group process: Participant roles and their relations to social status within the group. Aggressive Behavior. 1996;22:1–15. doi: 10.1002/(SICI)1098-2337(1996)22:1<1::AID-AB1>3.0.CO;2-T. [DOI] [Google Scholar]
- Salmivalli C, Kaukiainen A, Kaistaniemi L, Lagerspetz KMJ. Self-evaluated self-esteem, peer-evaluated self-esteem, and defensive egotism as predictors of adolescents' participation in bullying situations. Personality and Social Psychology Bulletin. 1999;25:1268–1278. doi: 10.1177/0146167299258008. [DOI] [Google Scholar]
- Schwartz D. Subtypes of victims and aggressors in children’s peer groups. Journal of Abnormal Child Psychology. 2000;28:181–192. doi: 10.1023/A:1005174831561. [DOI] [PubMed] [Google Scholar]
- Schwartz D, Proctor LJ, Chien DH. The aggressive victim of bullying: Emotional and behavioral dysregulation as a pathway to victimization by peers. In: Juvonen J, Graham S, editors. Peer harassment in school: The plight of the vulnerable and victimized. Boston, MA: Guilford Press; 2001. pp. 147–174. [Google Scholar]
- Snyder AW, Mulcahy E, Taylor JL, Mitchell DJ, Sachdev P, Gandevia SC. Savant-like skills exposed in normal people by suppressing the left front-temporal lobe. Journal of Integrative Neuroscience. 2003;2:149–158. doi: 10.1142/S0219635203000287. [DOI] [PubMed] [Google Scholar]
- Solberg ME, Olweus D. Prevalence estimation of school bullying with the Olweus bullying/victimization questionnaire. Aggressive Behavior. 2003;29:239–268. doi: 10.1002/ab.10047. [DOI] [Google Scholar]
- Steinberg L, Morris AS. Adolescent development. Annual Review of Psychology. 2001;52:83–110. doi: 10.1146/annurev.psych.52.1.83. [DOI] [PubMed] [Google Scholar]
- Thayer JF, Lane RD. A model of neurovisceral integration in emotion regulation and dysregulation. Journal of Affective Disorders. 2000;61:201–216. doi: 10.1016/S0165-0327(00)00338-4. [DOI] [PubMed] [Google Scholar]
- Toblin RL, Schwartz D, Gorman AH, Abou-ezzeddine T. Social–cognitive and behavioral attributes of aggressive victims of bullying. Journal of Applied Developmental Psychology. 2005;26:329–346. doi: 10.1016/j.appdev.2005.02.004. [DOI] [Google Scholar]
- Todd RM, Cunningham WA, Anderson AK, Thompson E. Affect-biased attention as emotion regulation. Trends in Cognitive Sciences. 2012;16:365–372. doi: 10.1016/j.tics.2012.06.003. [DOI] [PubMed] [Google Scholar]
- Troop-Gordon W, Gordon RD, Vogel-Ciernia L, Ewing Lee E, Visconti KJ. Visual attention to dynamic scenes of ambigious provocation and children’s aggressive behavior. Journal of Clinical Child and Adolescent Psychology. doi: 10.1080/15374416.2016.1138412. (in press) [DOI] [PMC free article] [PubMed] [Google Scholar]
- Troop-Gordon W, Ladd GW. Trajectories of peer victimization and perceptions of the self and schoolmates: Precursors to internalizing and externalizing problems. Child Development. 2005;76:1072–1091. doi: 10.1111/j.146798624.2005.00898.x. [DOI] [PubMed] [Google Scholar]
- Van Baardewijk Y, Stegge H, Bushman BJ, Vermeiren R. Psychopathic traits, victim distress and aggression in children. Journal of Child Psychopathology and Psychiatry. 2009;50:718–725. doi: 10.1111/j.1469-7610.2008.02023.x. [DOI] [PubMed] [Google Scholar]
- Van Honk J, Tuiten A, de Haan E, vann de Hout M, Stam H. Attentional biases for angry faces: Relationships to trait anger and anxiety. Cognition and Emotion. 2001;15:279–297. doi: 10.1080/02699930126112. [DOI] [Google Scholar]
- Van Lier PAC, Barker ED, Tremblay RE, Vitaro F, Brendgen M, Boivin M. Peer victimization, poor academic achievement, and the link between childhood externalizing and internalizing problems. Child Development. 2012;83:1775–1788. doi: 10.1111/j.1467-8624.2012.01802.x. [DOI] [PubMed] [Google Scholar]
- Veenstra R, Lindenberg S, Oldehinkel AJ, De Winter AF, Verhulst FC, Ormel J. Bullying and victimization in elementary schools: a comparison of bullies, victims, bully/victims, and uninvolved preadolescents. Developmental Psychology. 2005;41:672–682. doi: 10.1037/0012-1649.41.4.672. [DOI] [PubMed] [Google Scholar]
- Wilson BJ, Petaja H, Mancil L. The attention skills and academic performance of aggressive/rejected and low aggressive/popular children. Early Education and Development. 2011;22:907–930. doi: 10/1080/10409289.2010.505258. [Google Scholar]
- Yeager DS, Fong CJ, Lee HY, Espelage DL. Declines in efficacy of anti-bullying programs among older adolescents: Theory and a three-level meta-analysis. Journal of Applied Developmental Psychology. 2015;37:36–51. doi: 10.1016/j.appdev.2014.11.005. [DOI] [Google Scholar]


