Abstract
Given the recent rise in online hate activity and the increased amount of time adolescents spend with media, more research is needed on their experiences with racial discrimination in virtual environments. This cross-sectional study examines the association between amount of time spent online, traditional and online racial discrimination and adolescent adjustment, including depressive symptoms, anxiety and externalizing behaviors. The study also explores the role that social identities, including race and gender, play in these associations. Online surveys were administered to 627 sixth through twelfth graders in K-8, middle and high schools. Multiple regression results revealed that discrimination online was associated with all three outcome variables. Additionally, a significant interaction between online discrimination by time online was found for externalizing behaviors indicating that increased time online and higher levels of online discrimination are associated with more problem behavior. This study highlights the need for clinicians, educational professionals and researchers to attend to race-related experiences online as well as in traditional environments.
Keywords: Aggressive Behavior/Bullying, Anxiety, Depression, Discrimination, Internet, Technology
INTRODUCTION
Racial discrimination is a common stressor and a growing threat to adolescent health and well-being. More specifically, within their lifetime, up to 94% of African American, Latino, and Asian youth have experienced traditional or face-to-face discrimination that was associated with their racial and ethnic background (Benner & Kim, 2009; Dotterer, McHale, & Crouter, 2009; Flanagan, Syvertsen, Gill, Gallay, & Cum-sille, 2009; Harris-Britt, Valrie, Kurtz-Costes, & Rowley, 2007; Huynh & Fuligni, 2010; Martin et al., 2011; Medvedeva, 2010; Neblett et al., 2008; Pachter, Szalacha, Bernstein, & Coll, 2010). Much of the research in the area of traditional racial discrimination focuses on the perceived frequency of these experiences within the classroom, including unfair treatment due to race (Chavous, Rivas-Drake, Smalls, Griffin, & Cogburn, 2008), where respondents may be treated with less respect or harassed because of their race or ethnicity (Rivas-Drake, Hughes, & Way, 2009; Shin, D’Antonio, Son, Kim, & Park, 2011). To extend this body of research, some scholars have explored disparities and experiences of tracking, unfair discipline, perceptions of lower levels of intelligence, or receiving less academic praise and reinforcement than their white counterparts (Benner & Kim, 2009; Dotterer et al., 2009; Cogburn, Chavous, & Griffin, 2011).
Race in Virtual Environments
While the foundation of literature for traditional discrimination is grounded in decades of empirical investigation, little is known about adolescents’ racial discrimination experiences in virtual environments. We define online racial discrimination as denigrating or excluding individuals or groups on the basis of race through the use of symbols, voice, video, images, text, and graphic representations. These experiences may resemble traditional discrimination and include being disrespected or being called race-related names (Gaylord-Harden & Cunningham, 2009; Roberts, Gibbons, Gerrard, Weng, Murry, Simons, & Lorenz, 2012; Umaña-Taylor, Wong, Gonzales, & Dumka, 2012). Online forms of racial discrimination occur in social networking sites, chat rooms, discussion boards, through text messaging, web pages, online videos, music, and online games. For example, a black female student from the prestigious Stuyvesant High School in New York was sent a video on Facebook in which white fellow students performed a five minute and forty second rap calling her “ni**er” and “ignorant,” and threatening her with sexual violence. Images and text also construct racial minorities as inferior, unintelligent, as criminals and, in many cases, animals. They also mock African American skin color and body types, cultural practices, and history (Tynes, Umaña-Taylor, Rose, Lin, & Anderson, 2012).
In the mid-1990s, the Internet was lauded for its potential to usher in a color-blind society. As the medium proliferated, scholars argued it could eliminate racial cues from communication and lead to a more egalitarian electronic global village, where there would be no race, gender or infirmities (Ess, 2001; Negroponte, 1995). Though visual signifiers of race may have been removed in early virtual environments, research on adults shows that across a range of online communication settings (in internet relay chat, for example; Glaser et al., 2002; Kang, 2000; Nakamura, 2002; Kendall, 1998), race takes on a linguistic form. Once made visible through text, it has been found to be central to the culture of computer-mediated environments. Further, many of the social norms and ills that exist offline are often reproduced in adult online communities (Burkhalter, 1999). This is increasingly evident as images, videos, and graphic representations of the body become more prevalent online.
To address the question of whether similar findings to those found with adults would be found with adolescent populations, Tynes and colleagues (2004) conducted one of the earliest studies of race-related discourse in monitored versus unmonitored teen chat. They found that 37 out of 38 half-hour transcripts had at least one racial or ethnic utterance and that, in the absence of monitors, participants were more likely to engage in negative racial and ethnic discourse. Other studies on adolescents suggest that they often encounter stereotypic and racist images, including text and video about people of color, but lack the digital and media literacy skills to determine who produces this material and whether it is legitimate or from a credible source (Daniels, 2009). Moreover, hate groups may assign ambiguous titles to websites, so that they are easily mistaken for more innocuous sites. Adolescents can unknowingly stumble upon these sites while searching for information online. While doing a report on weather for example, individuals may find the Stormfront. org for kids website. Its home page reads: “Need to do a school report of M.L. King? Visit this website for all your needs: www.martinlutherking.org.” The viewer is then redirected to the site and can click on a number of links, including one that reads “the truth about Martin Luther King.” Those who go there encounter a myriad of disparaging articles, speeches, and “facts” about this historical figure. Since children and adolescents are generally less able than adults to differentiate between truth and fiction online, hate messages masquerading as facts may be interpreted as truth.
Despite the election of the nation’s first African American president and reports of a post- racial America, there has been an increase in online hate activity (Simon Wiesenthal Center 2009). The numbers of extremist and hate sites rose exponentially from 6,000 to 10,000 from 2006 to 2009 and to 15,000 by 2011 (Simon Wiesenthal Center, 2012). Additionally Storm-front.org, arguably the Internet’s first and oldest hate site, crashed on the night of the election because it witnessed unprecedented numbers of visitors. Moreover, the Knights of the Ku Klux Klan site has seen its numbers of unique daily visitors almost triple, from 15,000 to 40,000 (Chen, 2009). Not only does a fringe element of society engage is discriminatory practices online, but Daniels (2012) outlines how researchers are beginning to understand race and racism across a range of mainstream virtual environments. Though theorizing about race online is in its infancy, scholars argue that individuals engage in “two faced racism” (Picca & Feagin, 2007), where tolerance is performed in multicultural spaces and explicit racism in private white only spaces (Daniels, 2012, Steinfeldt et al., 2010). A blurring of public and private (Daniels & Hughey, 2012), along with a perceived lack of monitoring (Tynes et al., 2004), may contribute to virtual environments where adolescents frequently receive negative messages about their racial group.
TRADITIONAL VS. ONLINE RACIAL DISCRIMINATION AND ADOLESCENT ADJUSTMENT
The increase in hate activity coupled with the fact that 95% of adolescents of ages 12 through 17 have access to the internet (Lenhart, Madden, Smith, Purcell, Zickuhr, & Raine, 2011) point to a pressing need to understand online racial discrimination. As growing numbers of youth gain access to the internet, youth of color may be more susceptible to discriminatory experiences because of their race or ethnicity (Kahn, Spencer & Glaser, 2013). Subrahmanyam and Smahel (2011) describe the behavioral coherence between an individual’s offline identity and the activities they engage in online. This may increase the number of online contexts and the nature of online interaction that may increase the likely of being victimized. For example, Tynes, Giang, Williams, and Thompson (2008) found that 29% of African American and 42% of multiracial/other high school students reported experiencing racial discrimination in online environments (via text message, social networking sites, online games, and other internet-based sites). To extend these findings to Asian American youth, Shin and colleagues (2011) assessed the nature and frequency of bullying among Korean American high school students, and determined that approximately 25% of the respondents experienced online victimization. Among the identified victims, 29% reported their victimization was the result of their point of origin (i.e., home country), while 23% were victimized due to their skin color.
Drawing from offline studies, African American adolescents who perceive higher levels of discrimination tend to exhibit lower levels of self-esteem (Seaton & Yip, 2009), exhibit more conduct problems (Brody et al. 2006), and report higher levels of depressive symptoms (Cogburn et al., 2011; Gaylord-Harden & Cunningham, 2009; Neblett et al. 2008). Perceived discrimination was also associated with increased depressive symptoms for Latino youth (Umaña-Taylor & Updegraff, 2007; Lorenzo-Blanco et al. 2011). Consequently, researchers have noted that discrimination is related to decreased psychological well-being for adolescents (Sellers et.al., 2006; Umaña-Taylor & Updegraff, 2007) and declines in grades, academic curiosity, and persistence (Alfaro, Umaña-Taylor, Gonzales-Backen, Bámaca, & Zeiders, 2009; Neblett, Philip, Cogburn, & Sellers, 2006; Wong et al., 2003). In a similar study of early adolescents, stress and psychological characteristics related to race were associated with behavioral and emotional adjustment, particularly for African Americans (DuBois, Burk- Braxton, Swenson, Tevendale, & Hardesty, 2002). Although it is conceivable that these experiences extend to online contexts, the association between these outcomes and online discrimination has been the focus of few empirical investigations.
From the limited number of existing studies, we know that experiences with online racial discrimination, independent of other types of discrimination and stress, are adversely related to adolescent mental health. For example, in the first study to explore online experiences with an ethnically diverse sample, racial discrimination was positively associated with depressive symptoms and anxiety, even after adjusting for offline racial discrimination and adolescent stress (Tynes et al., 2008). As noted by the authors, one limitation of the study was the creation of an “other” racial category, which included Latino, Asian, and multiracial youth. While this approach was necessary due to a limited sample size, it was not possible to assess the level of online discrimination for Latinos or Asians, nor the extent to which these experiences were related to their mental health.
In addition to the aforementioned methodological concerns, and the dearth of literature on online discrimination, a recent report using data from the Kaiser Family Foundation demonstrated that African American, Latino, and Asian youth spend approximately 4 and ½ more hours with media per day than their white counterparts (Rideout, Lauricella, & Wartella, 2011). Interestingly, even after controlling for parent education, and family structure, race was still a significant predictor of media exposure, where youth of color used forms of media, including mobile devices, an average of one hour more per day than their white counterparts.
The extant research on whether this extended media use is associated with mental health and behavioral outcomes is equivocal. For example, research has demonstrated that increased internet use is associated with depressive symptoms and loneliness (Belanger, Akre, Berchtold, & Michaud, 2011; Kraut et al., 1998; Lam & Peng, 2010; Park, 2009), yet some studies have also shown no association between time online, well-being (Gross 2004), or depressive symptoms (Sanders, Field, Diego, & Kaplan, 2000). Therefore, this study contributes to this debate by examining whether time online is associated with depressive symptoms, anxiety, and problem behavior among a sample of African American, Asian, and Latino adolescents, which are the specific subgroups of students noted in previous literature to have extended media exposure. Further, this study examines whether time online moderates the relationship between discrimination and the outcome mental health and behavioral variables.
In the current study it was hypothesized that higher levels of traditional or in school discrimination will be associated with higher levels of depressive symptoms, anxiety, and externalizing behaviors for all participants. Further, when accounting for traditional discrimination, it was hypothesized that online racial discrimination will also be a significant predictor for each outcome variable, consistent with foundational research by Tynes and colleagues (2008). Since past research is equivocal regarding the relationship between mental health and time online, interactions between time online and discrimination will also be tested. It was expected that experiences of discrimination will be moderated by time spent online indicating that time spent online for youth experiencing high levels of stress due to discrimination will be significant predictors for poor mental health and externalizing behaviors.
METHOD
Participants
Participants for the present study were selected from the first wave of a three wave longitudinal study that investigates the risk and protective factors associated with online experiences of students from twelve Midwestern US schools in grades 6 – 12. The current sample included 627 adolescents (45.3% male, 54.5%% female), with ages ranging from 10 – 18 (M = 14.42, SD = 1.98). The racial makeup of the sample, according to self-report, consisted of 53.7% Black or African American (n = 337), 37.2% Hispanic or Latino (n = 233), and 9.1% Asian or Asian American (n = 57). Overall, the average participation rate across the twelve schools was 49.8%.
PROCEDURE
Research assistants recruited students from classrooms, which were selected by administrators based on access to laptops or computers labs. Classes selected were primarily technology, English, and homeroom. Parental consent forms and fliers were distributed to approximately 150 students per school with copies available in English and Spanish. During distribution, research assistants gave a brief 10-minute presentation to the selected classes to describe the purpose of the study. On a prearranged date, researchers returned to each school to administer surveys via web link to all students who returned the affirmative parental consent forms.
Online surveys were sent to email addresses that were provided by participants, which were accessed during the allotted classroom time. In the event that participants did not have a valid email address prior to survey administration, temporary email addresses were established for survey access. In a small number of cases, surveys were accessed via a web link. Once access was granted, survey administration occurred over one to two consecutive class periods. Research assistants were present to inform students of confidentiality, explain terms, and troubleshoot any technical difficulties. Prior to beginning the survey, the research team explained that the respondents would be asked about their online experiences and their feelings about themselves. They were informed of confidentiality and told that they had the right to stop at any point in the survey. Following the completion or termination of the survey, all students were provided with resources such as local counseling services and internet safety websites to report online predators. As an incentive, students received $15 Amazon.com gift certificates for their participation for year one, and participating schools were provided with a small stipend. Recruitment and consent procedures were reviewed by the Institutional Review Board of the principal investigator’s institution.
MEASURES
Depressive Symptoms: A12-item version of the Center for Epidemiologic Studies Depression Scale (CESD-12) was used to measure adolescents’ depressive symptoms (Radloff, 1977; Roberts & Sobhan, 1992). Sample items include “I felt I was just as good as other people” and “I had crying spells”. Response options ranged from “0=Rarely or none of the time” to “3=Most or all of the time.” Cronbach’s alpha in the current study was .72;
Anxiety: Adolescents’ anxiety was assessed using four items from the tension subscale of the Profile of Mood States-Adolescents (Terry, Lane, Lane, & Keohane, 1999). Participants were asked to describe the extent that they felt each of the following: “panicky,” “anxious,” “worried,” and “nervous.” Responses ranged from “0=Not at all” to “4=Extremely.” Cronbach’s alpha in the current study was .79;
Externalizing Behaviors: The rule breaking subscale of the Youth Self Report of the Child Behavior Checklist (Achenbach, 1991) was used to measure externalizing behavior. It is a widely used measure of competencies, emotional and behavior problems in youth between the ages of 11–18. Sample items include “I break rules at home, school, or elsewhere” and “I smoke, chew, or sniff tobacco”. Responses ranged from “0=Not true” to “2=Very true or Often true”. Cronbach’s alpha in the current study was .80;
Time online: Time online was assessed using a single item indicator that assessed the average number of hours per day an individual spent online (i.e., How many hours are you online on a usual day when you use the internet?). Response options included “1 = 0 hours,” “2 = 1 hour or less,” “3 = 1 to 2 hours,” “4 = 2 to 3 hours,” “5 = 3 to 4 hours,” “6 = 4 to 5 hours,” “7 = 5 to 6 hours,” “8 = 6 to 7 hours,” “9 = 7 to 8 hours,” “10 = 8 to 9 hours,” “11 = 9 to 10 hours,” and “12 = more than 10 hours”;
Online Racial Discrimination: Adolescents’ online discrimination based on race and ethnicity was assessed using two subscales of the Online Victimization Scale (Tynes, Rose, & Williams, 2010). Individual Online Racial Discrimination refers to derogatory text, images, and symbols that directly target an individual because of his or her race or ethnicity. This subscale was comprised of 4 items (e.g., “People have said mean or rude things about me because of my race or ethnic group online”), with responses options ranging from “0=Never” to “5=Everyday.” Cronbach’s alpha in the current study was .74;
Offline Racial Discrimination: Adolescents’ perceived discrimination in offline settings was assessed using an abbreviated version of The Perceived Discrimination by Adults/Peers Scale (Way, 1997). Items capture experiences in two of three offline contexts: Other Students in School (i.e., Peers; 5 items; e.g. “How often do you feel that other students in school treat you with less respect because of your race or ethnicity”) and Adults in School (5 items, e.g. “How often do adults in school treat you like you’re NOT smart because of your race or ethnicity?”). Responses were scored on a 5-point Likert scale ranging from “0=Never” to “4=All the time.” A mean score was calculated for each context, with higher scores indicating greater perceived discrimination in each context. Cronbach’s alpha for peer and adult discrimination was .90 and .92 respectively.
DATA ANALYSIS
Data were analyzed to explore the differences in online and offline racial experiences and the impact of time online and online racial discrimination on depressive symptoms, anxiety, and externalizing behaviors for the three racial groups. Hierarchical multiple regression was used to examine the predictive nature of (1) time online, and (2) online and (3) offline peer and adult discrimination on (a) depressive symptoms, (b) anxiety, and (c) externalizing behaviors. Of particular interest was time online and the interactions of time online by online and offline racial experiences.
For each model, depression, anxiety, and externalizing behaviors served as separate dependent variables, with gender, grade, race, and time online entered in step 1; traditional peer and adult discrimination in step 2; online racial discrimination in step 3; and interactions for time online by online racial discrimination, time online by traditional adult discrimination, and time online by traditional peer discrimination in step 4. Variables were entered in this order to examine whether each block of variables is predictive over and above the variables entered earlier in the model by examining whether the change in the F-Statistic is significant at each step. If the change in the F-statistic was not significant, no further steps were added to the model. All predictor variables, with the exception of gender and race, were centered prior to creation of the interaction terms and analysis (see Table 1 for descriptive statistics prior to centering).
Table 1.
Means and standard deviations for scales by racial group and total sample
Item/Scale (Scale Values) | Asian | African American |
Latino | Total |
---|---|---|---|---|
Depressive Symptoms (0–3) | .79 (.42) | .86 (.44) | .84 (.44) | .85 (.44) |
Anxiety (0–4) | .70 (.77) | .70 (.85) | .67 (.78) | .69 (.82) |
Externalizing Behaviors (0–2) | .15 (.16) | .29 (.26) | .28 (.26) | .27 (.26) |
Time Online (1–12) | 4.32 (2.20) | 4.86 (2.51) | 3.92 (1.77) | 4.46 (2.27) |
Online Racial Discrimination (0–4) | .25 (.37) | .34 (.65) | .34 (.58) | .33 (.61) |
Racial Discrimination by Peers at School (0–4) |
.54 (.68) | .60 (.88) | .44 (.76) | .53 (.82) |
Racial Discrimination by Adults at School (0–4) |
.21 (.46) | .49 (.76) | .29 (.67) | .39 (.71) |
RESULTS
Depressive Symptoms: To explore the predictive nature of time online, traditional (adult and peer) racial discrimination, and online racial discrimination on depressive symptoms, a regression model for the entire group was constructed. Based on the significant changes in the F statistic (F(1.536) = 15.91 p < .001), the final model included the main effects, but did not include the interaction terms (i.e., Step 4), and accounted for approximately 17% of the variance in depressive symptoms (R2 = .165). Significant main effects included traditional peer discrimination (β =.16, p < .01), traditional adult discrimination (β=.12, p < .05), and online racial discrimination (β =.18, p < .001), while accounting for gender (Male = 0, β =.16, p < .01). These findings suggest that higher levels of discrimination, both offline and online, predicted higher levels of depressive symptoms for the sample population (See Table 2);
Anxiety: To explore the predictive nature of time online, traditional (adult and peer) racial discrimination, and online racial discrimination on anxiety, a regression model for the entire group was constructed. Based on the significant changes in the F statistic (F(3.526) = 6.13 p < .001), the final model included the main effects and interaction terms, and accounted for approximately 14% of the variance in anxiety (R2 = .144). While the final model included both main effects and interaction terms, the only significant main effect was online racial discrimination (β =.13, p < .01), while accounting for gender (Male = 0, β =.17, p < .001). These findings suggest that higher levels of online discrimination predicted higher levels of anxiety for the sample population (See Table 2).
Table 2.
Summary of final step of regression models for depression, anxiety, and rule breaking
Depression (Step 3) | Anxiety (Step 4) | Rule Breaking (Step 4) | ||||
---|---|---|---|---|---|---|
B (SE B) β | B (SE B) β | B (SE B) β | ||||
Final Model: Step 1 | ||||||
Gender (Female = 1) |
.14 (.04) | .16** | .29 (.07) | .17*** | −.01 (.02) | −.02 |
Grade | .00 (.01) | .01 | .00 (.02) | .00 | .02 (.01) | .11** |
Ethnicity (Asian = 1) |
−.01 (.06) | −.01 | .12 (.12) | .04 | −.10 (.04) | −.11** |
Ethnicity (Latino = 1) |
.02 (.04) | .03 | .04 (.08) | .02 | .02 (.02) | .04 |
Time Online | .01 (.01) | .07 | .01 (.02) | .00 | .02 (.01) | .13** |
Step 2 | ||||||
Peer Discrimination |
.08 (.03) | .16** | .09 (.06) | .09 | .03 (.02) | .08 |
Adult Discrimination |
.07 (.03) | .12* | .11 (.06) | .10 | .05 (.02) | .13* |
Step 3 | ||||||
Online Discrimination |
.13 (.03) | .18*** | .18 (.06) | .13** | .06 (.02) | .14** |
Step 4 | ||||||
Time Online by Online Discrimination |
--- | --- | −.03 (.03) | −.05 | .03 (.01) | .17*** |
Time Online by Peer Discrimination |
--- | --- | .07 (.03) | .18** | .00 (.01) | .03 |
Time Online by Adult Discrimination |
--- | --- | .01 (.03) | .02 | −.01 (.01) | −.04 |
Δ F(1.536) = 15.91 p <.001, R2 = .165, R2 Δ = .03 |
Δ F(3.526) =6.13 p < .001, R2 = .144, R2 Δ = .03 |
ΔF(3.522) = 6.08 p < .001, R2 = .211, R2 Δ = .03 |
Note: African American is reference group for all ethnicity analyses.
p<0.05,
p<.01,
p<.001.
In addition to the significant main effects, the interaction of time online by peer discrimination emerged as a significant predictor (β =.18, p < .001) of anxiety. While it should be noted that the main effects of time online (β =.00, p > .05) and peer discrimination (β =.09, p >.05) were not independently significant, all main effects are retained in the final model, and based on the a priori decision rules of significant changes in the F statistic, the significant interaction was probed and graphed based on ± 1 standard deviation, and simple slopes were evaluated with time online serving as the moderating variable (see Figure 1). The simple slope for individuals who reported high time online (i.e., one standard deviation above the mean) was significant (t(623) = 3.40, p < .001) for anxiety. More specifically, students who spent more time online and experienced high levels of traditional peer discrimination (i.e., one standard deviation above the mean) reported higher levels of anxiety than students who spent less time online:
Externalizing Behavior: To explore the predictive nature of time online, traditional (adult and peer) racial discrimination, and online racial discrimination on externalizing behaviors, a regression model for the entire group was constructed (see Figure 2). Based on the significant changes in the F statistic (F(3.522) = 6.08 p < .001), the final model included the main effects and interaction terms, and accounted for approximately 21% of the variance in externalizing behaviors (R2 = .211). Significant main effects included time online (β = .13, p < .01), traditional adult discrimination (β = .13, p < .05), and online racial discrimination (β = .14, p < .01), while accounting for grade (β = .11, p < .01) and ethnicity (Asian = 1, β = −.11, p < .001). These findings suggest that more time online, higher levels of adult offline discrimination, and higher levels of online discrimination, predicted higher levels of externalizing behaviors for this sample population (See Table 2).
Figure 1.
Time online as a moderator of the association between peer discrimination and anxiety
Figure 2.
Time online as a moderator of the association between online racial discrimination and externalizing behaviors
In addition to the significant main effects, the interaction of time online by online racial discrimination emerged as a significant predictor (β =.17, p < .001) of externalizing behavior. The significant interaction was probed and graphed based on ± 1 standard deviation of time online, and simple slopes were evaluated with time online serving as the moderating variable (see Figure 1). The simple slope for individuals who reported high time online (i.e., one standard deviation above the mean) was significant (t(623) = 5.234, p < .001) for externalizing behaviors. More specifically, students who spent more time online and experienced high levels of online racial discrimination (i.e., one standard deviation above the mean), reported more externalizing behaviors than students who spent less time online.
DISCUSSION
The purpose of this study was to explore the association between racial discrimination, both online and offline, and adjustment among a diverse sample of adolescents. Given the inconsistencies in previous research, and the overall dearth of online discrimination literature, time spent in virtual environments was of direct interest in this association. Results demonstrated that the total sample, on average, spent between two to four hours online per day and that extended time online was associated with increased online racial discrimination and higher levels of externalizing behaviors, as well as peer discrimination and anxiety. Moreover, consistent with the traditional discrimination literature, the results of the present study demonstrated associations between race-related victimization online and depressive symptoms, anxiety, and externalizing behavior (Brody et al. 2006; Coker et al. 2009; Greene Way, & Pahl, 2006; Huynh & Fuligni 2010; Pachter et al. 2010; Sellers, Caldwell, Schmeelk-Cone, & Zimmerman, 2003).
These findings parallel extant literature that has found associations between discrimination and adjustment for youth of color (Coker et al., 2009; Fisher, Wallace, & Fenton, 2000). Coker and colleagues (2009), for example, found for African American and Latino fifth graders, discrimination was associated with depressive symptoms and conduct disorder (attention deficit hyperactivity disorder and oppositional defiant disorder were also found for Latinos). In addition, Russell et al. (2012) found that youth who experienced bias-based harassment due to race, sexual orientation, disability, or religion reported lower mental health status and increased substance use levels. Consequently, it appears that being victimized because of these social identities has a particularly detrimental impact on health.
Though the current study results are only partially consistent with research that shows an association between internet use and externalizing behaviors (Holtz & Appel, 2011; Tsitsika et al., 2014), there is evidence that suggests it is the activities in which adolescents engage that may contribute most to adjustment outcomes; not simply time spent on the internet (Bell, 2007). It should also be noted that for the current study, and contrary to previous research, time online was not an independent significant predictor of anxiety or depressive symptoms (Belanger et al., 2011; Kraut et al., 1998; Lam & Peng, 2010; Park, 2009). However, a significant interaction between time online and peer discrimination in school was found for anxiety. This finding suggests that those who experience both discrimination at school and spend an increased amount of time online report more anxiety. However, it is not clear if those who are discriminated against at school turned to online environments or if the increased amount of time online happened concurrently with the discriminatory experiences and increased levels of anxiety. Further longitudinal research is needed to better understand the relationship between internet use and face-to-face discrimination. In addition, more research is needed to better understand the overlap between online and offline discriminatory experiences over time.
Another finding of note is that in each of the models, online discrimination was associated with negative outcomes for the youth of color in the study. This adds to the small body of literature examining online discrimination. Consistent with earlier findings by Tynes and colleagues (2008), online discrimination is related to poor mental health outcomes. The current study also found that online discrimination is associated with externalizing behaviors. Further, an interaction between time online and online discrimination demonstrates that individuals who spend an increased amount of time online and experience high levels of online discrimination reported more externalizing behaviors than those who spend an increased amount of time online and experienced lower levels of online discrimination. Specifically this suggests that the experiences youth have in virtual environments and the time spent online are important factors in externalizing behaviors.
As young people gain widespread access to the internet, they may face additional discrimination in virtual environments as demonstrated by the current study. Although this study adds to the existing body of literature regarding online discrimination and adolescent adjustment, some limitations should be noted. These limitations include the fact that this study is cross-sectional. Though significant relationships between discrimination and the psychological and behavioral outcomes did emerge, the temporal ordering of the variables in the associations of interest is unclear. Conceptually, we expected that discrimination would precede depressive symptoms, anxiety, and externalizing behaviors; however, the cross-sectional nature of our data did not enable testing that hypothesis directly. Additionally, it is unclear how long- term exposure to online discrimination may be related to mental health and behavioral outcomes. Future research should examine this relationship for adolescents of color.
CONCLUSION
This study is the first to explore associations between internet use, online racial discrimination, offline racial discrimination, mental health, and externalizing behavior among a diverse sample of students. Findings from the current study, along with previous literature, demonstrated that experiences online have unique contributions to mental health that are over and above offline experiences with discrimination (Tynes et al., 2008). Furthermore, these findings reinforce the necessity for mental health and educational professionals to assess and provide adolescents with coping strategies for online and traditional racial discrimination experiences. Overall, the findings from this study suggest that both time spent in virtual environments and the nature of adolescent interactions may impact mental health and behavioral outcomes, rather than increased time spent online alone.
Acknowledgments
Brendesha Tynes is faculty in the Rossier School of Education and the Psychology Department at USC. Research reported in this publication was supported by the Eunice Kennedy Shriver National Institute of Child Health and Human Development of the National Institutes of Health under Award Number R01HD061584. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Biographies
Brendesha M. Tynes is an associate professor of Education and Psychology at the USC Rossier School of Education. Her research focuses on the role of the Internet in child and adolescent development with special attention to academic performance, mental health and problem behavior. She is also interested in the design of online interventions that reduce cyber-bullying. She is the principal investigator of a longitudinal study of the risk and protective factors associated with online victimization as well as a study of the use of mobile devices to enhance STEM performance and social-emotional learning. Dr. Tynes earned a master’s in Learning Sciences from Northwestern University and a doctoral degree in Human Development and Psychology from UCLA.
Chad Rose holds a doctoral degree in Special Education from the University of Illinois at Urbana-Champaign. He is currently an assistant professor in the Department of Special Education at the University of Missouri. His research focuses on bullying and victimization among students with disabilities, bully prevention efforts within a multi-component framework, and the intersection of social/emotional learning and bully prevention for students with disabilities.
Sophia Hiss is a PhD student at the USC Rossier School of Education. Her research examines the social and peer influences of adolescents’ educational outcomes and psychological well-being. Specifically, she has studied the impact of peer victimization in online settings examining general victimization and racial discrimination. She is also interested in the ways that adolescents cope with victimization and the possible buffers that may mitigate the negative outcomes associated with victimization online.
Adriana J. Umaña-Taylor is Foundation Professor at Arizona State University in the T. Denny Sanford School of Social and Family Dynamics. She received her PhD in Human Development and Family Studies from the University of Missouri-Columbia. Dr. Umaña-Taylor’s research focuses on ethnic identity formation, familial socialization processes, culturally informed risk and protective factors, and psychosocial functioning among ethnic minority youth.
Kimberly Mitchell is a Research Associate Professor of Psychology at the Crimes against Children Research Center, located at the University of New Hampshire. Her areas of research focus on youth Internet victimization and how technology can be used as a tool for prevention and intervention. She has been studying Internet use among youth for over 12 years. Dr. Mitchell has directed or co-directed several national projects including the First and Second Youth Internet Safety Studies (YISS); the Survey of Internet Mental Health Issues; and the First, Second, and Third National Juvenile Online Victimization Studies. She was the Principal Investigator of the third YISS, a grant to investigate the commercial exploitation of children through the Internet; and a grant exploring the role of technology in youth harassment. She is the author or co-author of over 70 peer-reviewed papers in her field and has spoken at numerous national conferences.
David R. Williams holds a doctoral degree in Sociology from the University of Michigan. He is currently the Florence and Laura Norman Professor of Public Health at the Harvard School of Public Health, Professor of African and African American Studies and an Affiliate of the Sociology Department at Harvard University. His research has enhanced understanding of the complex ways in which race, racial discrimination, socioeconomic status and religious involvement can affect physical and mental health.
Contributor Information
Brendesha M. Tynes, University of Southern California, Los Angeles, CA, USA
Chad A. Rose, University of Missouri, Columbia, MO, USA
Sophia Hiss, University of Southern California, Los Angeles, CA, USA.
Adriana J. Umaña-Taylor, Arizona State University, Tempe, AZ, USA
Kimberly Mitchell, University of New Hampshire, Durham, NH, USA.
David Williams, Harvard University, Cambridge, MA, USA.
REFERENCES
- Achenbach TM. Child behavior checklist/4–18. Burlington: University of Vermont; 1991. [Google Scholar]
- Alfaro EA, Umaña-Taylor AJ, Gonzales-Backen M, Bámaca MY, Zeiders K. Discrimination, Academic Motivation, and Academic Success among Latino Adolescents. Journal of Adolescence. doi: 10.1016/j.adolescence.2008.08.007. (in press). PMID:18973937. [DOI] [PubMed] [Google Scholar]
- Belanger RE, Akre C, Berchtold A, Michaud PA. A U-shaped association between intensity of Internet use and adolescent health. Pediatrics. 2011;127(2):330–335. doi: 10.1542/peds.2010-1235. PMID:21242218. [DOI] [PubMed] [Google Scholar]
- Bell V. Online information, extreme communities and Internet therapy: Is the Internet good for our mental health? Journal of Mental Health (Abingdon, England) 2007;16(4):445–457. doi: 10.1080/09638230701482378. [DOI] [Google Scholar]
- Benner AD, Kim SY. Intergen-erational experiences of discrimination in Chinese American families: Influences of socialization and stress. Journal of Marriage and the Family. 2009;71(4):862–877. doi: 10.1111/j.1741-3737.2009.00640.x. PMID:20161516. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brody GH, Chen YF, Murry VM, Ge X, Simons RL, Gibbons FX, et al. Perceived discrimination and the adjustment of African American youths: A five-year longitudinal analysis with contextual moderation effects. Child Development. 2006;77(5):1170–1189. doi: 10.1111/j.1467-8624.2006.00927.x. PMID:16999791. [DOI] [PubMed] [Google Scholar]
- Chavous TM, Rivas-Drake D, Smalls C, Griffin T, Cogburn C. Gender matters, too: The influences of school racial discrimination and racial identity on academic engagement outcomes among African American adolescents. Developmental Psychology. 2008;44(3):637–654. doi: 10.1037/0012-1649.44.3.637. PMID:18473633. [DOI] [PubMed] [Google Scholar]
- Chen S. Growing hate groups blame Obama, economy. CNN.com. 2009 Feb 29; Retrieved from http://www.cnn.com/2009/US/02/26/hate.groups.report/index.html.
- Cogburn CD, Chavous TM, Griffin TM. School-based racial and gender discrimination among African American adolescents: Exploring gender variation in frequency and implications for adjustment. Race and Social Problems. 2011;3(1):25–37. doi: 10.1007/s12552-011-9040-8. PMID:22837794. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coker TR, Elliott MN, Kanouse DE, Grun-baum JA, Schwebel DC, Gilliland MJ, et al. Perceived racial/ethnic discrimination among fifth-grade students and its association with mental health. American Journal of Public Health. 2009;99(5):878–884. doi: 10.2105/AJPH.2008.144329. PMID:19299673. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Daniels J. Cyber racism: White supremacy online and the new attack on civil rights. Rowman & Littlefield Publishers; 2009. [Google Scholar]
- Daniels J. Race and racism in Internet studies: A review and critique. New Media & Society. 2012;15(5):695–719. doi: 10.1177/1461444812462849. [DOI] [Google Scholar]
- Daniels J, Hughey MW. Good Ideas and New Dilemmas: Hurdles for Studying Racism at Online News Sites. Paper Presented at Annual Meetings of the American Sociological Association; August, 2012; Denver, CO. 2012. [Google Scholar]
- Dotterer AM, McHale SM, Crouter AC. Sociocultural factors and school engagement among African American youth: The roles of racial discrimination, racial socialization, and ethnic identity. Applied Developmental Science. 2009;13(2):61–73. doi: 10.1080/10888690902801442. [DOI] [PMC free article] [PubMed] [Google Scholar]
- DuBois DL, Burk-Braxton C, Swenson LP, Tevendale HD, Hardesty JL. Race and Gender Influences on Adjustment in Early Adolescence: Investigation of an Integrative Model. Child Development. 2002;73(5):1573–1592. doi: 10.1111/1467-8624.00491. PMID:12361320. [DOI] [PubMed] [Google Scholar]
- Ess C, editor. Culture, technology, communication. Albany, NY: State University of New York Press; 2001. [Google Scholar]
- Fisher CB, Wallace SA, Fenton RE. Discrimination distress during dolescence. Journal of Youth and Adolescence. 2000;29(6):679–695. doi: 10.1023/A:1026455906512. [DOI] [Google Scholar]
- Flanagan CA, Syvertsen AK, Gill S, Gallay LS, Cumsille P. Ethnic awareness, prejudice, and civic commitments in four ethnic groups of American adolescents. Journal of Youth and Adolescence. 2009;38(4):500–518. doi: 10.1007/s10964-009-9394-z. PMID:19636724. [DOI] [PubMed] [Google Scholar]
- Gaylord-Harden NK, Cunningham JA. The impact of racial discrimination and coping strategies on internalizing symptoms in African American youth. Journal of Youth and Adolescence. 2009;38(4):532–543. doi: 10.1007/s10964-008-9377-5. PMID:19636726. [DOI] [PubMed] [Google Scholar]
- Glaser J, Dixit J, Green DP. Studying hate crime with the internet: What makes racists advocate racial violence? The Journal of Social Issues. 2002;58(1):177–193. doi: 10.1111/1540-4560.00255. [DOI] [Google Scholar]
- Greene ML, Way N, Pahl K. Trajectories of perceived adult and peer discrimination among Black, Latino, and Asian American adolescents: Patterns and psychological correlates. Developmental Psychology. 2006;42(2):218–236. doi: 10.1037/0012-1649.42.2.218. PMID:16569162. [DOI] [PubMed] [Google Scholar]
- Gross EF. Adolescent Internet use: What we expect, what teens report. Journal of Applied Developmental Psychology. 2004;25(6):633–649. doi: 10.1016/j.appdev.2004.09.005. [DOI] [Google Scholar]
- Harris-Britt A, Valrie CR, Kurtz-Costes B, Rowley SJ. Perceived racial discrimination and self-esteem in African American youth: Racial socialization as a protective factor. Journal of Research on Adolescence. 2007;17(4):669–682. doi: 10.1111/j.1532-7795.2007.00540.x. PMID:20700391. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holtz P, Appel M. Internet use and video gaming predict problem behavior in early adolescence. Journal of Adolescence. 2011;34(1):49–58. doi: 10.1016/j.adolescence.2010.02.004. PMID:20303580. [DOI] [PubMed] [Google Scholar]
- Huynh VW, Fuligni AJ. Discrimination hurts: The academic, psychological, and physical well-being of adolescents. Journal of Research on Adolescence. 2010;20(4):916–941. doi: 10.1111/j.1532-7795.2010.00670.x. [DOI] [Google Scholar]
- Kahn KB, Spencer K, Glaser J. Online prejudice and discrimination: From dating to hating. In: Amichai-Hamburger Y, editor. The social net: Understanding our online behavior. Oxford: Oxford University Press; 2013. pp. 201–219. [DOI] [Google Scholar]
- Kang J. Cyber-race. Harvard Law Review. 2000;113(5):1130–1208. doi: 10.2307/1342340. [DOI] [Google Scholar]
- Kendall L. Meaning and identity in “cyberspace”: The performance of gender, class, and race online. Symbolic Interaction. 1998;21(2):129–153. doi: 10.1525/si.1998.21.2.129. [DOI] [Google Scholar]
- Kraut R, Patterson M, Lundmark V, Kiesler S, Mukopadhyay T, Scherlis W. Internet paradox: A social technology that reduces social involvement and psychological well-being? The American Psychologist. 1998;53(9):1017–1031. doi: 10.1037/0003-066X.53.9.1017. PMID:9841579. [DOI] [PubMed] [Google Scholar]
- Lam LT, Peng ZW. Effect of pathological use of the Internet on adolescent mental health: A prospective study. Archives of Pediatrics & Adolescent Medicine. 2010;164(10):901–906. doi: 10.1001/archpediatrics.2010.159. PMID:20679157. [DOI] [PubMed] [Google Scholar]
- Lenhart A, Madden M, Smith A, Purcell K, Zickuhr K, Raine L. Teens, kindness and cruelty on social network sites. Pew Internet & American Life Project. 2011 Retrieved from http://www.pewinternet.org/~/media/Files/Reports/2011/PIP_teens_Kindness_Cruelty_S NS_Report_Nov_2011_FINAL_110711.pdf.
- Lorenzo-Blanco EI, Unger JB, Ritt-Olson A, Soto D, Baezconde-Garbanati L. Acculturation, gender, depression, and cigarette smoking among U.S. Hispanic youth: The mediating role of perceived discrimination. Journal of Youth and Adolescence. 2011;40(11):1519–1533. doi: 10.1007/s10964-011-9633-y. PMID:21293915. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martin MJ, McCarthy B, Conger RD, Gibbons FX, Simons RL, Cutrona CE, Brody GH. The enduring significance of racism: Discrimination and delinquency among Black American youth. Journal of Research on Adolescence. 2011;21(3):662–676. doi: 10.1111/j.1532-7795.2010.00699.x. PMID:21941426. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Medvedeva M. Perceived discrimination and linguistic adaptation of adolescent children of immigrants. Journal of Youth and Adolescence. 2010;39(8):940–952. doi: 10.1007/s10964-009-9434-8. PMID:20596820. [DOI] [PubMed] [Google Scholar]
- Nakamura L. Cybertypes: Race, ethnicity, and identity on the internet. New York: Routledge; 2002. [Google Scholar]
- Neblett EW, Philip CL, Jr, Cogburn CD, Sellers RM. African American Adolescents’ Discrimination Experiences and Academic Achievement: Racial Socialization as a Cultural Compensatory and Protective Factor. The Journal of Black Psychology. 2006;32(2):199–218. doi: 10.1177/0095798406287072. [DOI] [Google Scholar]
- Neblett EW, White RL, Jr, Ford KR, Philip CL, Nguyên HX, Sellers RM. Patterns of racial socialization and psychological adjustment: Can parental communications about race reduce the impact of racial discrimination? Journal of Research on Adolescence. 2008;18(3):477–515. doi: 10.1111/j.1532-7795.2008.00568.x. [DOI] [Google Scholar]
- Negroponte N. Being digital. New York: Knopf; 1995. [Google Scholar]
- Pachter LM, Szalacha LA, Bernstein BA, Coll CG. Perceptions of Racism in Children and Youth (PRaCY): Properties of a self-report instrument for research on children’s health and development. Ethnicity & Health. 2010;15(1):33–46. doi: 10.1080/13557850903383196. PMID:20013438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Park S. The association between Internet use and depressive symptoms among South Korean adolescents. Journal for Specialists in Pediatric Nursing. 2009;14(4):230–238. doi: 10.1111/j.1744-6155.2009.00191.x. PMID:19796322. [DOI] [PubMed] [Google Scholar]
- Picca LH, Feagin JR. Two-Faced Racism: Whites in the Backstage and the Frontstage. New York: Routledge; 2007. [Google Scholar]
- Radloff LS. The CES-D scale: A self report depression scale for research in the general population. Applied Psychological Measurement. 1977;1(3):385–401. doi: 10.1177/014662167700100306. [DOI] [Google Scholar]
- Rideout V, Lauricella A, Wartella E. Children, media and race: Media use among White, Black, and Hispanic, and Asian American children. Report of the Center on Media and Human Development School of Communication Northwestern University. 2011 [Google Scholar]
- Rivas-Drake D, Hughes D, Way N. A preliminary analysis of associations among ethnic-racial socialization, ethnic discrimination, and ethnic identity among urban sixth graders. Journal of Research on Adolescence. 2009;19(3):558–584. doi: 10.1111/j.1532-7795.2009.00607.x. [DOI] [Google Scholar]
- Roberts ME, Gibbons FX, Gerrard M, Weng CY, Murry VM, Simons LG, et al. From racial discrimination to risky sex: Prospective relations involving peers and parents. Developmental Psychology. 2012;48(1):89–102. doi: 10.1037/a0025430. PMID:21942666. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roberts RE, Sobhan M. Symptoms of depression in adolescence: A comparison of Anglo, African, and Hispanic Americans. Journal of Youth and Adolescence. 1992;21(6):639–651. doi: 10.1007/BF01538736. PMID:24264167. [DOI] [PubMed] [Google Scholar]
- Russell ST, Sinclair KO, Poteat VP, Koenig BW. Adolescent health and harassment based on discriminatory bias. American Journal of Public Health. 2012;102(3):493–495. doi: 10.2105/AJPH.2011.300430. PMID:22390513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sanders CE, Field TM, Diego M, Kaplan M. The relationship of Internet use to depression and social isolation among adolescents. Adolescence. 2000;35(138):237–242. PMID:11019768. [PubMed] [Google Scholar]
- Seaton EK, Yip T. School and neighborhood contexts, perceptions of racial discrimination, and psychological well-being among African American adolescents. Journal of Youth and Adolescence. 2009;38(2):153–163. doi: 10.1007/s10964-008-9356-x. PMID:19636714. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sellers RM, Caldwell CH, Schmeelk-Cone K, Zimmerman MA. The role of racial identity and racial discrimination in the mental health of African American young adults. Journal of Health and Social behavior. 2003;44(3):302–317. doi: 10.2307/1519781. PMID:14582310. [DOI] [PubMed] [Google Scholar]
- Sellers RM, Copeland-Linder N, Martin PP, Lewis RLH. Racial Identity Matters: The Relationship between Racial Discrimination and Psychological Functioning in African American Adolescents. [Blackwell Publishing Limited] Journal of Research on Adolescence. 2006;16(2):187–216. doi: 10.1111/j.1532-7795.2006.00128.x. [DOI] [Google Scholar]
- Shin JY, D’Antonio E, Son H, Kim SA, Park Y. Bullying and discrimination experiences among Korean-American adolescents. Journal of Adolescence. 2011;34(5):873–883. doi: 10.1016/j.adolescence.2011.01.004. PMID:21334057. [DOI] [PubMed] [Google Scholar]
- Simon Wiesenthal Center. iReport online terror + hate: The first decade. 2009 Retrieved from http://www.wiesenthal.com/atf/cf/%7BDFD2AAC1-2ADE-428A-9263-35234229D8D8%7D/IRE-PORT.PDF.
- Steinfeldt JA, Foltz BD, Kaladow JK, Carlson TN, Pagano L, Benton AE, Jr, Steinfeldt MC. Racism in the electronic age: Role of online forums in expressing racial attitudes about American Indians. Cultural Diversity & Ethnic Minority Psychology. 2010;16(3):362–371. doi: 10.1037/a0018692. PMID:20658879. [DOI] [PubMed] [Google Scholar]
- Terry PC, Lane AM, Lane HJ, Keohane L. Development and validation of a mood measure for adolescents. Journal of Sports Sciences. 1999;17(11):861–872. doi: 10.1080/026404199365425. PMID:10585166. [DOI] [PubMed] [Google Scholar]
- Tsitsika A, Janikian M, Schoenmakers TM, Tzavela EC, Olafsson KWójcik, Richardson C. Internet addictive behavior in adolescence: A cross-sectional study in seven European countries. Cyberpsychology, Behavior, and Social Networking; Advance online publication. 2014 doi: 10.1089/cyber.2013.0382. [DOI] [PubMed] [Google Scholar]
- Tynes B, Reynolds L, Greenfield PM. Adolescence, race, and ethnicity on the Internet: A comparison of discourse in monitored vs. unmoni-tored chat rooms. Journal of Applied Developmental Psychology. 2004;25(6):667–684. doi: 10.1016/j.ap-pdev.2004.09.003. [DOI] [Google Scholar]
- Tynes BM, Giang MT, Williams DR, Thompson GN. Online racial discrimination and psychological adjustment among adolescents. The Journal of Adolescent Health. 2008;43(6):565–569. doi: 10.1016/j.jadohealth.2008.08.021. PMID:19027644. [DOI] [PubMed] [Google Scholar]
- Tynes BM, Rose CA, Williams DR. The development and validation of the Online Victimization Scale for Adolescents. Cyberpsychology (Brno) 2010;4(2):1–15. [Google Scholar]
- Tynes BM, Umaña-Taylor AJ, Rose CA, Lin J, Anderson CJ. Online racial discrimination and the protective function of ethnic identity and self-esteem for African American adolescents. Developmental Psychology. 2012;48(2):342–355. doi: 10.1037/a0027032. PMID:22369340. [DOI] [PubMed] [Google Scholar]
- Umaña-Taylor AJ, Updegraff K. Latino adolescents’ mental health: Exploring the interrelations among discrimination, ethnic identity, cultural orientation, self-esteem, and depressive symptoms. Journal of Adolescence. 2007;30(4):549–567. doi: 10.1016/j.adolescence.2006.08.002. PMID:17056105. [DOI] [PubMed] [Google Scholar]
- Umana-Taylor AJ, Wong JJ, Gonzales NA, Dumka LE. Ethnic identity and gender as moderators of the association between discrimination and academic adjustment among Mexican-origin adolescents. Journal of Adolescence. 2012;35(4):773–786. doi: 10.1016/j.adolescence.2011.11.003. PMID:22152761. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Way N. Adult and peer discrimination measure. 1997. Unpublished Document. [Google Scholar]