Skip to main content
Springer logoLink to Springer
. 2022 Jul 5;10(4):1682–1692. doi: 10.1007/s40615-022-01353-z

Using Implicit Measures of Discrimination: White, Black, and Hispanic Participants Respond Differently to Group-Specific Racial/Ethnic Categories vs. the General Category “People of Color” in the USA

Maddalena Marini 1,2,, Pamela D Waterman 3, Emry R Breedlove 3, Jarvis T Chen 3, Christian Testa 3, Dana J Pardee 4, Merrily LeBlanc 4, Sari L Reisner 3, Apriani Oendari 5, Nancy Krieger 3
PMCID: PMC9813272  NIHMSID: NIHMS1821956  PMID: 35790626

Abstract

Recent studies showed that implicit measures are valuable instruments for assessing exposure to discrimination and predicting negative physical conditions. Between March 10, 2020, and April 1, 2020, we conducted three experiments (577 participants) in the USA to evaluate the use of group-specific vs. general race/ethnicity categories in implicit measures of discrimination. We measured implicit discrimination and attitudes towards the general race/ethnicity category “people of color” (POC) and two specific race/ethnicity categories (i.e., “Black people” and “Hispanic people”). Implicit discrimination and attitudes were assessed using the Brief Implicit Association Test (B-IAT). Among participants (mean age = 37, standard deviation = 10.5), 50% identified as White non-Hispanic (NH), 33.3% as Black NH, and 16.7% as Hispanic; 71.7% were female and 72.2% had a bachelor’s degree or higher. We found an implicit discrimination towards target groups and an in-group preference among all participant groups only when specific race/ethnicity categories were used in the B-IAT. When the general category POC was used, we observed a discrimination towards POC only for Black NH participants, while White NH participants showed no discrimination. Similarly, Black NH participants showed no in-group preference for POC, but did show an in-group preference for Black people. These results suggest that using the category POC in implicit measures may be inappropriate when evaluating discrimination and attitudes towards Black and Hispanic individuals as it may not capture specific experiences of discrimination and identity in these groups.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40615-022-01353-z.

Keywords: Discrimination, Implicit measures, Implicit Association Test (IAT), Brief Implicit Association Test (B-IAT), Race/ethnicity


In the USA, studies demonstrate the harmful effects of racial discrimination on physical and mental health [1, 2]. To prevent and mitigate its potential harms, it is thus crucial for health research to develop measures to quantify exposure to discrimination based on race/ethnicity.

Studies commonly rely on explicit self-reported measures of discrimination (explicit discrimination) [1, 2], leaving gaps in our understanding of implicit discrimination experiences, which reflect conscious and controllable evaluations that are subject to intentional and social desirability processes [3]. Explicit measures, however, are not designed to assess what can be measured by implicit measures, which are believed to infer automatic and spontaneous mental representations that exist in memory [4], and thus to capture constructs that are outside of intentional and direct control.

Research has demonstrated that implicit and explicit measures can display a large degree of dissociation or even opposite effects [57]. Moreover, studies have shown that implicit measures not only can predict variations in diverse behaviors, but they can do so often with more accuracy than explicit measures [811]. Of note, a series of health studies using the Implicit Association Test (IAT) [12]—a widely used and validated implicit measure—showed that a greater implicit recognition of racial discrimination towards Black people is positively associated with smoking [13], elevated blood pressure, and risk of hypertension [14, 15].

In a new study to evaluate use of implicit measures for assessing multiple types of discrimination in health and other population research [16], we have shown that a new brief validated version of the IAT (i.e., the Brief IAT, B-IAT) [17, 18] is a valuable instrument for quickly assessing discrimination based on race/ethnicity, sex, gender identity, sexual orientation, age, and weight. The B-IAT developed detected an implicit recognition of discrimination towards all target groups, among both individuals belonging to the specified target and perpetrator groups. However, one notable exception emerged: in the experiment assessing discrimination based on race/ethnicity, White individuals showed no implicit discrimination towards people of color (POC) [16].

One potential explanation of this result may be related to the term POC. In the USA, POC is primarily used to describe any person who is not considered White, e.g., African Americans, Asian Americans, Native Americans, Pacific Islander Americans, multiracial Americans, and Latino Americans. This term was introduced in the USA in the late twentieth century to counter the condescension implied by the terms “non-White” and “minority” [19]. However, some have argued that the term POC lessens the focus on the specific types of racism directed towards diverse racialized groups in the USA [20], particularly Black Americans [21], for whom the term POC does not capture the specificity of anti-Black racism. It thus is plausible to hypothesize that whereas White individuals may show implicit discrimination towards specific race/ethnicity groups (e.g., Black Americans), they might not for the term “POC” because of its lack of specificity [22, 23]. To test this hypothesis, we present a study in which we investigated the impact of using general versus specific race/ethnicity categories in implicit and explicit measures of discrimination. We also employed implicit and explicit measures of racial attitudes (i.e., preferences) to test a potential relationship between discrimination and attitudes based on race/ethnicity.

Materials and Methods

Participants

The present study included three experiments. The People of Color-White experiment evaluated being a target vs. perpetrator of discrimination towards POC; the Black-White experiment evaluated such discrimination towards Black people; and the Hispanic-White experiment evaluated such discrimination towards Hispanic people. Between March 10, 2020, and April 1, 2020, a total of 577 participants took part in the present study and completed at least one measure included in each experiment: 199 participants in the People of Color-White experiment, 198 participants in the White-Black experiment, and 180 participants in the Hispanic-White experiment.

Participants in all three experiments were United States (U.S.) citizens and residents, aged between 25 and 64 years. This age range was selected to focus on working-age adults, given the documented importance of work as a primary site for exposure to discrimination [1, 2426] and with this age group also having had the possibility of experiencing discrimination in multiple domains (e.g., at school, getting housing, from the legal system or police, getting medical care, getting a loan or mortgage, shopping, on the street or in a public setting) [1, 24, 25, 2731].

Participants in each experiment were recruited based on their self-identified race/ethnicity. In the People of Color-White experiment and in the Black-White experiment, only White non-Hispanic (NH) and Black NH participants were recruited, while in the Hispanic-White experiment, we enrolled only White NH and Hispanic participants. In the People of Color-White experiment, we enrolled only Black NH participants to test whether the term POC specifically obscures the deep animus of anti-Black racism [21].

All data were collected among volunteers at the Project Implicit website (https://implicit.harvard.edu), where they first completed a demographic registration form in which they were asked their self-identified race/ethnicity, age in years, sex assigned at birth, education, citizenship, and residency. Black NH participants were then randomly assigned to the People of Color-White or Black-White experiments; Hispanic participants were assigned to the Hispanic-White experiment; and White NH were randomly assigned to People of Color-White, Black-White, or Hispanic-White experiments. Once assigned to one of our experiments, participants completed an additional race/ethnicity item in which they evaluated themselves as a person of color or a White NH person (see response options for all sociodemographic questions in Table S1).

Data collection stopped once each experiment reached 150 participants (i.e., 75 participants for each race/ethnicity group of interest) with completed measures. This sample size was defined a priori to have a greater than 90% power to detect an implicit or an explicit score significantly different from zero with an effect size of Cohen’s d = 0.25 and an alpha significance criterion of 0.05 (one-tailed t test; G ∗ Power 3) [32].

The study protocol was approved by the institutional review board at the Harvard T.H. Chan School of Public Health (IRB 18–1128).

Brief Implicit Association Test

The Brief Implicit Association Test (B-IAT) is a new validated version of the IAT [12] that assesses mental contents (i.e., the contents of a mental state, such as a thought, a belief, or an attitude) indirectly by measuring how quickly and accurately a person can categorize and associate stimuli related to two conceptual categories and two evaluative attributes. The underlying presumption is that categories and attributes that are strongly associated at a mental representation level show shorter latencies and fewer errors when classified together than when they are not [12, 33]. Comparing latencies and errors in different experimental conditions is a conventional procedure in cognitive and social psychology for reaction time–based paradigms, such as the IAT and its versions, to infer the content of a mental state. Implicit mental content is operationalized by hypothesizing that if two concepts are mentally connected, it will be easier for participants to match these two concepts by using the same motor response compared to when they are not. This advantage in the performance will translate in faster latencies and fewer errors in the task.

The IAT has been used in hundreds of published research studies and has amassed a large literature clarifying its psychometric properties [3437]. Studies demonstrate the IAT has excellent internal validity [36, 3840], substantial internal consistency [4143], stable test–retest reliability over time [33], and good construct validity [4447].

Specifically, two B-IATs were used: a Target/Perpetrator Brief Implicit Association Test (Target/Perpetrator B-IAT) to assess implicit discrimination towards the target group and a Good/Bad Brief Implicit Association Test (Good/Bad B-IAT) to assess implicit racial/ethnic attitudes (i.e., preferences for a specific race/ethnicity group). In both B-IATs, participants were presented with words belonging to two attributes and two categories. Attributes in the Target/Perpetrator B-IAT and Good/Bad B-IAT were the same in all the experiments. The Target/Perpetrator B-IAT included words from the two attributes Target of Discrimination (e.g., victim and oppressed) and Perpetrator of Discrimination (e.g., perpetrator and abuser), while the Good/Bad B-IAT included words from the two attributes Good (e.g., love and pleasant) and Bad (e.g., hate and unpleasant). Categories in the Target/Perpetrator B-IAT and Good/Bad B-IAT differed by experiment. In the People of Color-White experiment, Target/Perpetrator B-IAT and Good/Bad B-IAT included words from the two race/ethnicity categories People of Color (e.g., Brown and non-White) and White People (e.g., White and Caucasian, with the latter problematic term chosen deliberately for reasons explained in Table 1); in the Black-White experiment, Target/Perpetrator B-IAT and Good/Bad B-IAT included words from the two race/ethnicity categories Black People (e.g., Black and African Descent) and White People (e.g., White and Caucasian); and in the Hispanic-White experiment, Target/Perpetrator B-IAT and Good/Bad B-IAT included words from the two race/ethnicity categories Hispanic People (e.g., Latinx and Hispanic) and White People (e.g., White and Caucasian). Specific stimuli used in the B-IATs are reported in Table 1. Both B-IATs followed the standard task procedure described by Sriram and Greenwald (2009). Participants were presented with words belonging to two attributes and two categories. They were instructed to focus on just one category and one attribute. Stimuli appeared one at a time in the middle of the screen and participants categorized each stimulus as either belonging to one of the focal category or attribute (press the “i” key) or not (press the “e” key). If the participant made an error, a red “X” appeared below the stimulus and the trial continued until the correct key was pressed.

Table 1.

Stimuli used in the B-IATs by experiment

B-IAT B-IAT attributes Stimuli
Target/Perpetrator Target of Discrimination Target, victim, oppressed
Perpetrator of Discrimination Perpetrator, abuser, racist
Good/Bad Good Love, pleasant, great, wonderful
Bad Hate, unpleasant, awful, terrible
Experiment B-IAT categories Stimuli
People of Color-White White People White, Euro-American, Caucasian
People of Color Black, Brown, non-White
Black-White White People White, Euro-American, Caucasian
Black People Black, African Descent, African American
Hispanic-White White People White, Euro-American, Caucasian
Hispanic People Latinx, Latino/a, Hispanic

Attributes in the Target/Perpetrator B-IAT and Good/Bad B-IAT were the same in all the experiments, while categories differed on the basis of the experiment. For example in the Black-White experiment, Target/Perpetrator B-IAT and Good/Bad B-IAT included words from the two categories White People (e.g., White and Caucasian) and Black People (e.g., Black and African Descent), while in the Hispanic-White experiment, Target/Perpetrator B-IAT and Good/Bad B-IAT included words from the two categories White People (e.g., White and Caucasian) and Hispanic People (e.g., Latinx and Hispanic). We chose these terms because of their common use, but acknowledge that the term “Caucasian,” while widely used, is a word that has deep roots in scientific racism and is not a legitimate scientific term or an accurate description (since it falsely conveys the idea humanity originated in the Caucasus Mountains in Europe); for more on the problematic history of the term “Caucasian,” see [4850]

Each B-IAT included four blocks of 20 trials each. In each block, the first four trials were selected from the race/ethnicity categories of interest (e.g., Black People and White People in the Black-White experiment). The remaining 16 trials for each block alternated between race/ethnicity categories of interest and attributes (i.e., Target of Discrimination and Perpetrator of Discrimination for the Target/Perpetrator B-IAT; Good and Bad for the Good/Bad B-IAT). All the blocks had the same focal attribute (i.e., Target of Discrimination for the Target/Perpetrator B-IAT and Good for the Good/Bad B-IAT) and alternated the focal category (Black People and White People in the Black-White experiment) such that the same combination between attribute and focal category (e.g., Black People + Target of Discrimination or Black People + Good) appeared in blocks 1 and 3 and the other combination (e.g., White People + Target of Discrimination or White People + Good) in blocks 2 and 4. The order of the combinations between attribute and focal category was counterbalanced across subjects.

Target/Perpetrator B-IAT and Good/Bad B-IAT were preceded by two 20-trial warm-up blocks. In one block, participants were presented with flowers (e.g., orchid and lilac) and good words as the focal categories and insects (e.g., flea and centipede) and bad words as non-focal categories. In the other block, participants were presented with insects and good words as the focal categories and flowers and bad words as non-focal categories. The order of the two practice blocks was counterbalanced across subjects.

Scores for the Target/Perpetrator B-IAT and Good/Bad B-IAT were computed according to the recommended B-IAT algorithm described by Nosek et al. (2014). We divided the difference in mean between the two B-IAT attribute-focal category conditions by the standard deviation of the latencies inclusive of the two conditions. Responses in the first four trials of each block and those slower than 10,000 ms were removed. Responses faster than 400 ms or slower than 2000 ms were recoded to 400 ms and to 2000 ms, respectively.

Participants faster than 400 ms on more than 10% of trials were excluded as indicative of careless participation. 8.5% of the B-IAT sessions were removed based on these exclusion criteria.

Scores could range from + 2 to − 2, with zero indicating no difference in association between attributes and social categories.

Self-Reported Items

In all experiments, explicit discrimination and attitudes were measured using self-reported items (see specific questions and responses employed in Table S2).

Explicit discrimination was assessed by two questions: one evaluating whether participants perceived the group as a target of discrimination (explicit group discrimination; e.g., in the Black-White experiment, “How often do you feel that Black people are discriminated against because of their race/ethnicity?”) and one assessing whether they themselves as individuals had experienced discrimination (explicit individual discrimination; e.g., in the Black-White experiment, “How often do you feel that you, personally, have been discriminated against because of your race, ethnicity, or color?”). Responses were obtained on a 4-point scale and coded as scores from 0 (never) to 3 (often).

Explicit attitudes were measured using a single item. Participants were asked to select which statement best described them from seven options. For example, in the Black-White experiment, options were as follows: (1) I strongly, (2) I moderately, (3) I slightly “prefer Black People to White People,” (4) “I like Black people and White people equally,” (5) I slightly, (6) I moderately, and (7) I strongly “prefer White people to Black people.” Responses were coded as scores from − 3 to + 3 with more positive scores indicating an explicit preference for White people.

Procedure

Given that the primary interest of this research was in implicit cognition, the order of the measures for each type of discrimination was fixed. For each type of discrimination, participants first completed the two BIATs and then the two explicit measures. However, to avoid order effects, the order within implicit and explicit measures was randomized across participants. Each experiment required about 10 min to complete.

Data Analysis

Descriptive statistics characterized participants’ demographics. One-sample t tests determined whether the mean explicit and implicit scores were statistically different from zero. Pearson’s correlation coefficient assessed the relationship between implicit and explicit measures and between each measure.

Results

Sample Characteristics

The average age of all participants was 37 (SD = 10.5); 50% were White non-Hispanic people, 33.3% were Black NH, and 16.7% were Hispanic; 71.7% were females and 28.2% were males; 0.7% had some or less than high school education, 3.6% had a high school degree, 23.5% had some college education, 35.7% had a bachelor of arts or a bachelor of science degree, and 36.5% had an advanced degree (e.g., graduate school, master’s degree, J.D., M.D., Ph.D., or M.B.A.). Sample demographics by experiment and participant group are presented in Table 2.

Table 2.

Sample demographics by experiment and participant group

Experiment Black-White People of Color-White Hispanic-White Total
Participant group: demographics White NH Black NH White NH Black NH White NH Hispanic
N = 89 N = 109 N = 94 N = 105 N = 103 N = 77 N = 577
Sex
  % female 65.9 73.4 68.8 72.1 77.7 72.7 71.7
  % male 34.1 26.6 31.2 27.9 22.3 27.3 28.2
Race/ethnicity
  % White NH 100 0 100 0 100 0 50
  % Black NH 0 100 0 100 0 0 33.3
  % Hispanic 0 0 0 0 0 100 16.7
Education (highest level completed)
  % some or less than high school 0.9 0 0 1.0 1.0 1.3 0.7
  % high school 4.5 4.3 6.4 1.0 2.9 2.6 3.6
  % some college 10.9 28.8 26.6 31.4 22.3 20.8 23.5
  % BA/BS 39.1 30.9 23.4 35.2 35.0 50.6 35.7
  % advanced degree 44.5 36.0 43.6 31.4 38.8 24.7 36.5
Age
  Mean 40.1 37.9 35.4 37.6 38.6 32.1 37
  SD 10.7 10.5 9.9 10.5 12.1 9.2 10.5

Sample size (N) and demographics refer to data of participants who completed at least one of the four measures used in each experiment (i.e., Target/Perpetrator B-IAT, Good/Bad B-IAT, self-reported items assessing explicit discrimination, and self-reported item assessing explicit attitudes). Sex refers to sex assigned at birth. All participants were U.S. citizens and residents, aged between 25 and 64 years. Percentages refer to percent distribution with no missing data

Implicit Discrimination

Table 3 presents the implicit and explicit scores and their correlations by experiment and participant group. Overall, participant groups showed an implicit discrimination towards the target group in each experiment (i.e., POC, Black, or Hispanic). In the Black-White experiment, both White (M = 0.23, 95% CI [0.16, 0.30]) and Black (M = 0.41, 95% CI [0.32, 0.50]) participants showed Black People + Target of Discrimination/White People + Perpetrator of Discrimination associations. These associations were stronger for Black than White participants (F(1, 132) = 9.773, p < 0.01, ηp2 = 0.69). Similarly, in the Hispanic-White experiment, both White (M = 0.18, 95% CI [0.08, 0.27]) and Hispanic (M = 0.31, 95% CI [0.31, 0.41]) participants showed Hispanic People + Target of Discrimination/White People + Perpetrator of Discrimination associations. The only exception was observed in the People of Color-White experiment. In this experiment, evidence of detecting an implicit discrimination towards People of Color (i.e., People of Color + Target of Discrimination/White People + Perpetrator of Discrimination associations) occurred only among Black participants (M = 0.41, 95% CI [0.31, 0.51]), whereas White participants were neutral (M = 0.06, 95% CI [− 0.03, 0.16]).

Table 3.

Implicit and explicit scores for discrimination and attitudes by experiment and participant group and their correlation

Experiment Participant group Implicit measures Explicit measures Implicit and explicit correlations
Target/Perpetrator B-IAT (implicit discrimination) Good/Bad B-IAT (implicit attitude) Explicit group discrimination Explicit individual discrimination Explicit attitude Target/Perpetrator B-IAT and explicit group discrimination Target/Perpetrator B-IAT and explicit individual discrimination Good-Bad B-IAT and explicit attitude
N Mean (SD) Group comparison N Mean (SD) Group comparison N Mean (SD) Group comparison N Mean (SD) Group comparison N Mean (SD) Group comparison r r r
People of Color-White White NH 69 0.06 (0.40) ** 71 0.33** (0.42) ** 73 2.74** (0.47) n.s 73 0.77** (0.72) ** 72 0.24** (0.64) **  − 0.09  − 0.18 0.04
Black NH 64 0.41** (0.40) 70

 − 0.09

(0.48)

74 2.64** (0.63) 75 2.08** (0.82) 70  − 1.34** (1.23)  − 0.01 0.29* 0.06
Black-White White NH 72 0.23** (0.32) ** 73 0.21** (0.43) ** 72 2.50** (0.61) ** 72 0.94** (0.67) ** 69 0.03 (0.66) ** 0.06  − 0.11 0.24
Black NH 62 0.41** (0.35) 71  − 0.23** (0.42) 74 2.77** (0.54) 74 2.15** (0.68) 73  − 1.37** (1.25) 0.09  − 0.08 0.09
Hispanic-White White NH 68 0.18** (0.40) n.s 75 0.10* (0.40) ** 76 2.59** (0.64) n.s 76 0.86** (0.76) ** 73 0.05 (0.94) **  − 0.02  − 0.26* 0.05
Hispanic 57 0.31** (0.38) 61  − 0.22** (0.37) 63 2.68** (0.50) 60 1.70** (0.74) 60  − 0.70** (1.11)  − 0.17 0.24 0.01

B-IAT scores could range from + 2 to − 2, whereas explicit scores could range from 0 to + 3. Positive scores in the Target/Perpetrator B-IAT and explicit group discrimination indicated the presence of a discrimination towards the target group. Positive scores in explicit individual discrimination indicated the presence of discrimination towards self as a member of a specific social group. Positive scores in the Good/Bad B-IAT and explicit attitude indicated a preference for the dominant group. Zero indicated no relative discrimination or preference. Note: group comparison refers to comparison of scores (mean values) across the participant groups for each experiment

M mean, SD standard deviation, n.s. not significant

*p < 0.05 (2-sided); **p < 0.01 (2-sided)

Explicit Group Discrimination

Similar to the implicit data, explicit measures showed a recognition of discrimination towards the target group for all participant groups in each experiment (Table 3). Black and White participants both reported feeling that target groups are discriminated against because of their race/ethnicity (Black-White experiment: Black participants, M = 2.77, 95% CI [2.65, 2.90]; White participants, M = 2.50, 95% CI [2.36, 2.64]; People of Color-White experiment: Black participants, M = 2.64, 95% CI [2.49, 2.78]; White participants, M = 2.74, 95% CI [2.63, 2.85]); the same held in the Hispanic-White experiment (Hispanic participants, M = 2.68, 95% CI [2.55, 2.81], White participants, M = 2.59, 95% CI [2.45, 2.74]). However, in the Black-White experiment, the Black participants were more likely than the White participants to report that Black people are exposed to discrimination (F(1, 144) = 8.151, p < 0.01, ηp2 = 0.54).

Explicit Individual Discrimination

In all experiments, participant groups self-reported exposure to discrimination towards themselves, i.e., reported an explicit individual discrimination. Black and White participants both reported feeling personally discriminated against because of their race/ethnicity (Black-White experiment: Black participants: M = 2.15, 95% CI [1.99, 2.31]; White participants: M = 0.94, 95% CI [0.79, 1.10]; People of Color-White experiment: Black participants: M = 2.08, 95% CI [1.89, 2.27]; White participants: M = 0.77, 95% CI [0.60, 0.93]); the same held for the Hispanic-White experiment (Hispanic participants: M = 1.70, 95% CI [1.51, 1.89]; White participants: M = 0.86, 95% CI [0.68, 1.03]). However, compared to White participants, members of the target groups (i.e., Black NH and Hispanic participants) reported more exposure to discrimination towards themselves (Black-White experiment: F(1, 144) = 116.979, p < 0.001, ηp2 = 0.45; People of Color-White experiment: F(1, 146) = 107.548, p < 0.001, ηp2 = 0.42; Hispanic-White experiment: F(1, 134) = 42.181, p < 0.001, ηp2 = 0.24).

Implicit-Explicit Discrimination Correlations

Few statistically significant correlations were observed between implicit and explicit discrimination scores (Table 3). In the People of Color-White experiment, Black participants who registered stronger implicit discrimination towards People of Color also reported experiencing greater explicit individual discrimination (r = 0.29, p < 0.05). In the Hispanic-White experiment, White participants who showed stronger implicit discrimination towards Hispanic people reported weaker explicit individual discrimination (r =  − 0.26, p < 0.05).

Implicit Attitudes

Overall, participant groups showed an implicit in-group attitude (Table 3). White participants showed a preference for White people (Black-White experiment: M = 0.21, 95% CI [0.11, 0.31]; Hispanic-White experiment: M = 0.10, 95% CI [0.01, 0.19]), Black participants showed a preference for Black people (Black-White experiment: M =  − 0.23, 95% CI [− 0.33, − 0.13]), and Hispanic participants showed a preference for Hispanic people (Hispanic-White experiment: M =  − 0.22, SD = 0.37, 95% CI [− 0.31, − 0.13]). However, in the People of Color-White experiment, an in-group attitude was observed only for White participants (M = 0.33, 95% CI [0.23, 0.43]), while Black participants showed no implicit preference for People of Color or White people (M =  − 0.09, 95% CI [− 0.21, 0.02]).

Explicit Attitudes

Results for explicit attitudes varied by experiment. Black (Black-White experiment: M =  − 1.37, 95% CI [− 1.66, − 1.08]) and Hispanic (Hispanic-White experiment: M =  − 0.70, 95% CI [− 0.99, − 0.41]) participants reported an in-group attitude, while White participants reported no significant attitudes (Black-White experiment: M = 0.03, 95% CI [− 0.13, 0.19]; Hispanic-White experiment: M = 0.05, 95% CI [− 0.16, 0.27]). Conversely, in the People of Color-White experiment, both Black (M =  − 1.34, 95% CI [− 1.64, − 1.05]) and White (M = 0.24, 95% CI [0.09, 0.39]) participants reported an explicit in-group attitude.

Implicit-Explicit Attitude Correlations

No statistically significant correlations between implicit and explicit attitudes emerged in experiments.

Implicit and Explicit Discrimination and Attitude Measures Correlations

Significant negative correlations between implicit discrimination and attitudes were observed for Black participants in the People of Color-White experiment (r =  − 0.45, p < 0.001) and for Hispanic participants in the White-Hispanic experiment (r =  − 0.29, p < 0.05) (Table S3), indicating that for these participants, stronger implicit discrimination towards the target group was associated with a weaker implicit preference for White people. A significant negative correlation between explicit group discrimination and explicit attitudes emerged for White participants in the Black-White experiment (r =  − 0.29, p < 0.05), indicating that White participants who reported stronger explicit discrimination towards Black people showed weaker explicit preferences for White people. Additionally, in the People of Color-White experiment, Black participants who showed weaker implicit preferences for White people reported more exposure to discrimination towards themselves (r =  − 0.25, p < 0.05), whereas White participants who showed weaker implicit discrimination towards People of Color reported stronger explicit preferences for White people (r =  − 0.26, p < 0.05).

Discussion

The present study investigated the effect of using specific versus general race/ethnicity categories in implicit and explicit measures of discrimination in the U.S. The central finding was that an implicit discrimination towards target groups was detected among all participants only when specific race/ethnicity categories were used in the B-IAT (i.e., in the Black-White and Hispanic-White experiments, but not in the White-People of Color experiment). The larger implication is that using specific race/ethnicity categories in implicit measures of discrimination may be more appropriate than using the general category POC.

Supporting our interpretation that POC fails to elicit the same response as the specific terms “Black” and “Hispanics” among White NH persons is the dramatic rise, since 2020, of the term “BIPOC” in the U.S. [5155]. This acronym stands for “Black, Indigenous, and People of Color” and it was coined in part because the term “POC” failed to capture the different types of racism experienced by diverse racialized groups in the U.S., including the excessive use of police violence targeted especially against Black and Indigenous persons [5155]. Although POC was introduced in the U.S. in the late twentieth century (around the late 1970s) [56, 57] to counter the terms “minority” and “non-White,” which were believed to reflect marginalization and racism, critics of the term have objected to its lack of specificity and find it racially offensive [22, 23] as it lessens the focus on distinct issues confronted by different racial and ethnic groups [20], particularly African Americans [21]. Preserving “whiteness” as an intact category while lumping every other racial group into an indiscriminate category (“of color”) can replicate the very marginalization the term was intended to counter. While the term “BIPOC” is intended to address this concern, the continued lumping of all racialized groups other than Black, Indigenous, and White into the “POC” part of “BIPOC” remains contested, acceptable to some, and rejected by others [5155]. Future research comparing how members of diverse racialized groups respond, both implicitly and explicitly, to the terms “BIPOC” and “POC” would be informative.

In addition, we also found that implicit attitudes showed different results across participant groups when the term “POC” or “Black people” was used. Black people showed no in-group preference for POC, but did show an in-group preference for Black people. This result suggests that Black people may not identify themselves as members of the group POC at the implicit level even though they reported considering themselves as people of color and showed an explicit in-group attitude on the explicit measures. This result seems to be in contrast with POC racial identity theory [58, 59], which states that although a person’s experience of racism may vary, POC develop a common racial identity as individuals who experience similar psychological struggles, coping strategies related to being classified, treated, and perceived as a person who is not white. This race identity develops regardless of nationality, language, or culture of origin. As suggested, however, by the rising use of the term BIPOC, the premises of this version of racial identity theory may no longer hold. Future studies, which measure both implicit and explicit race/ethnicity identity, and which take into account new shifts in terminology, would be valuable to test the extent to which the original POC racial identity theory does or does not hold among diverse racialized groups in the U.S. and potentially in other countries as well.

The findings of this study should be considered in light of its limitations. Although the sample was statistically large enough to make inferences about a population, it is not a random selection of the U.S. population. For example, 72.2% of our study’s participants had a bachelor’s degree or higher, which is fully two times higher than reported for U.S. adults age 25 and older in 2019 [60, 61]. In addition, it included a much larger number of female (71.7%) than male (28.2%) participants. However, we cannot identify a specific and valid reason why these factors would explain the different results observed in implicit measures when the term POC or specific race/ethnicity categories were used. Nonetheless, replication with other samples will be useful to increase confidence in the observed results. Such research also should be conducted in populations at diverse educational levels and recruiting a larger number of male participants.

In sum, our findings show that language can influence the recognition of discrimination towards target groups at the implicit level. In particular, we showed that the term POC may be too broad to capture the specific experience of racial discrimination for Black Americans and masks the discrimination that White Americans may direct specifically and distinctly at Black Americans compared to other racialized groups. These findings may have important implications for health policy and practice in the clinical setting. For example, they raise the question of whether it is appropriate or not to use the general term POC when referring to Black patients or to patients in other racialized groups included under the umbrella term POC. Possible harms may include blunting recognition, by White health care professionals and by the patients themselves, of the specific types of discrimination directed against specific racialized groups, thereby potentially exacerbating inequities in both health status and health care.

Supplementary Information

Below is the link to the electronic supplementary material.

Acknowledgements

We acknowledge, with written permission, Kenneth H. Mayer (The Fenway Institute) as part of the larger study team working on this project.

Author Contribution

MM: conceptualization, data acquisition, data analysis, interpretation, validation, roles/writing—original draft, writing—review and editing; PDW: conceptualization, data acquisition, interpretation, validation, writing—review and editing; ERB: conceptualization, validation, writing—review and editing; JTC: interpretation, validation, writing—review and editing; CT: interpretation, validation, writing—review and editing; DP: conceptualization, data acquisition, validation, writing—review and editing; ML: interpretation, validation, writing—review and editing; SLR: conceptualization, interpretation, validation, writing—review and editing; AO: interpretation, validation, writing—review and editing; NK: conceptualization, data acquisition, data analysis, interpretation, validation, roles/writing—original draft, writing—review and editing.

Funding

Open access funding provided by Istituto Italiano di Tecnologia within the CRUI-CARE Agreement. This study was supported by the National Institutes of Health (#1R01MD012793-01A1). The funding sources had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Data Availability

The data of this study are available from the corresponding author upon reasonable request.

Declarations

Ethics Approval

The study protocol was approved by the institutional review board at the Harvard T.H. Chan School of Public Health (IRB 18–1128).

Consent to Participate

Informed consent was obtained from all individual participants included in the study.

Competing Interests

The authors declare no competing interests.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Krieger N. Discrimination and health inequities. Int J Heal Serv. Baywood Publishing Co. Inc.; 2014 [cited 2020 Jul 13];44:643–710. Available from: https://pubmed.ncbi.nlm.nih.gov/25626224/ [DOI] [PubMed]
  • 2.Lewis TT, Cogburn CD, Williams DR. Self-reported experiences of discrimination and health: scientific advances, ongoing controversies, and emerging issues. Annu Rev Clin Psychol. Annu Rev Clin Psychol; 2015 [cited 2022 Feb 27];11:407–40. Available from: https://pubmed.ncbi.nlm.nih.gov/25581238/ [DOI] [PMC free article] [PubMed]
  • 3.Krumpal I. Determinants of social desirability bias in sensitive surveys: a literature review. Qual Quant. Springer; 2013 [cited 2020 Jul 13]. p. 2025–47. Available from: https://link.springer.com/article/10.1007/s11135-011-9640-9
  • 4.Greenwald AG, Banaji MR. Implicit social cognition: attitudes, self-esteem, and stereotypes. Psychol Rev. 1995;102:4–27. doi: 10.1037/0033-295X.102.1.4. [DOI] [PubMed] [Google Scholar]
  • 5.Marini M. Underweight vs. overweight/obese: which weight category do we prefer? Dissociation of weight-related preferences at the explicit and implicit level. Obes Sci Pract. 2017;3:390–8. doi: 10.1002/osp4.136. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Marini M, Sriram N, Schnabel K, Maliszewski N, Devos T, Ekehammar B, et al. Overweight people have low levels of implicit weight bias, but overweight nations have high levels of implicit weight bias. Serino A, editor. PLoS One. Public Library of Science; 2013;8:e83543. [DOI] [PMC free article] [PubMed]
  • 7.Marini M, Banaji MR. An implicit gender sex-science association in the general population and STEM faculty. J Gen Psychol. Routledge; 2020 [cited 2020 Dec 21]; Available from: https://pubmed.ncbi.nlm.nih.gov/33283665/ [DOI] [PubMed]
  • 8.Dovidio JF, Kawakami K, Johnson C, Johnson B, Howard A. On the nature of prejudice: automatic and controlled processes. J Exp Soc Psychol. 1997;33:510–540. doi: 10.1006/jesp.1997.1331. [DOI] [Google Scholar]
  • 9.Fazio RH, Jackson JR, Dunton BC, Williams CJ. Variability in automatic activation as an unobtrusive measure of racial attitudes: a bona fide pipeline? J Pers Soc Psychol. 1995;69:1013–1027. doi: 10.1037/0022-3514.69.6.1013. [DOI] [PubMed] [Google Scholar]
  • 10.Green AR, Carney DR, Pallin DJ, Ngo LH, Raymond KL, Iezzoni LI, et al. Implicit bias among physicians and its prediction of thrombolysis decisions for black and white patients. J Gen Intern Med. 2007;22:1231–1238. doi: 10.1007/s11606-007-0258-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Greenwald AG, Poehlman TA, Uhlmann EL, Banaji MR. Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity. J Pers Soc Psychol. 2009;97:17–41. doi: 10.1037/a0015575. [DOI] [PubMed] [Google Scholar]
  • 12.Greenwald AG, McGhee DE, Schwartz JL. Measuring individual differences in implicit cognition: the implicit association test. J Pers Soc Psychol. 1998;74:1464–1480. doi: 10.1037/0022-3514.74.6.1464. [DOI] [PubMed] [Google Scholar]
  • 13.Krieger N, Waterman PD, Kosheleva A, Chen JT, Carney DR, Smith KW, et al. Exposing racial discrimination: implicit & explicit measures-the my body, my story study of 1005 US-born black & white community health center members. PLoS One. PLoS One; 2011 [cited 2020 Jul 13];6. Available from: https://pubmed.ncbi.nlm.nih.gov/22125618/ [DOI] [PMC free article] [PubMed]
  • 14.Krieger N, Carney D, Lancaster K, Waterman PD, Kosheleva A, Banaji MR. Combining explicit and implicit measures of racial discrimination in health research. Am J Public Health. Am J Public Health; 2010 [cited 2020 Jul 13];100:1485–92. Available from: https://pubmed.ncbi.nlm.nih.gov/19965567/ [DOI] [PMC free article] [PubMed]
  • 15.Krieger N, Waterman PD, Kosheleva A, Chen JT, Smith KW, Carney DR, et al. Racial discrimination & cardiovascular disease risk: my body my story study of 1005 US-born black and white community health center participants (US). PLoS One. PLoS One; 2013 [cited 2020 Jul 13];8. Available from: https://pubmed.ncbi.nlm.nih.gov/24204765/ [DOI] [PMC free article] [PubMed]
  • 16.Marini M, Waterman PD, Breedlove E, Chen JT, Testa C, Reisner SL, et al. The target/perpetrator brief-implicit association test (B-IAT): an implicit instrument for efficiently measuring discrimination based on race/ethnicity, sex, gender identity, sexual orientation, weight, and age. BMC Public Health. BioMed Central Ltd; 2021 [cited 2021 Mar 19];21. Available from: https://pubmed.ncbi.nlm.nih.gov/33468085/ [DOI] [PMC free article] [PubMed]
  • 17.Nosek BA, Bar-Anan Y, Sriram N, Axt J, Greenwald AG. Understanding and using the Brief Implicit Association Test: recommended scoring procedures. PLoS One. Public Library of Science; 2014 [cited 2017 Apr 19];9:e110938. Available from: http://www.ncbi.nlm.nih.gov/pubmed/25485938 [DOI] [PMC free article] [PubMed]
  • 18.Sriram N, Greenwald AG. The brief implicit association test. Exp Psychol. Exp Psychol; 2009 [cited 2020 Jul 13];56:283–94. Available from: https://pubmed.ncbi.nlm.nih.gov/19439401/ [DOI] [PubMed]
  • 19.Jackson Y. Encyclopedia of multicultural psychology. SAGE: Thousand Oaks; 2006. [Google Scholar]
  • 20.Shoneye T. As a black woman, I hate the term “people of colour”. Indip. 2020. Available from: https://www.independent.co.uk/voices/black-women-people-colour-racism-beyonce-coachella-black-lives-matter-a8316561.html
  • 21.Holzman M. The misnomer called “people of color”. Dropout Nation. 2015. Available from: https://www.independent.co.uk/voices/phrase-people-person-colour-bme-black-woman-women-different-experiences-race-racism-a7868586.html
  • 22.Lamuye A. I am no ‘person of colour’, I am a black African woman. Indep. 2017. Available from: https://www.independent.co.uk/voices/phrase-people-person-colour-bme-black-woman-women-different-experiences-race-racism-a7868586.html
  • 23.Bland T. Opinion: The term ‘people of color’ fails to be properly inclusive of the black community. Dly. Aztec. 2020. Available from: https://thedailyaztec.com/100319/opinion/opinion-the-term-people-of-color-fails-to-be-properly-inclusive-of-the-black-community/
  • 24.Krieger N. Measures of racism, sexism, heterosexism, and gender binarism for health equity research: from structural injustice to embodied harm—an ecosocial analysis. Annu Rev Public Health. Annual Reviews; 2020 [cited 2020 Jul 22];41:37–62. Available from: https://pubmed.ncbi.nlm.nih.gov/31765272/ [DOI] [PubMed]
  • 25.Paradies Y. A systematic review of empirical research on self-reported racism and health. Int J Epidemiol. 2006 [cited 2020 Jul 13];35:888–901. Available from: https://academic.oup.com/ije/article/35/4/888/686369 [DOI] [PubMed]
  • 26.National Public Radio, Robert Wood Johnson Foundation, Harvard T.H. Chan School of Public Health. Discrimination in America: final summary. 2018. Available from: file:///C:/Users/nak963/AppData/Local/Temp/rwjf443620.pdf.
  • 27.Pascoe EA, Richman LS. Perceived discrimination and health: a meta-analytic review. Psychol Bull. NIH Public Access; 2009 [cited 2020 Jul 13];135:531–54. Available from: /pmc/articles/PMC2747726/?report=abstract. [DOI] [PMC free article] [PubMed]
  • 28.Blank RM, Babady R, Citro CF. Measuring racial discrimination. Washington, DC: National Research Council, National Academies Press; 2004. [Google Scholar]
  • 29.Williams DR, Mohammed SA. Discrimination and racial disparities in health: evidence and needed research. J Behav Med. J Behav Med; 2009 [cited 2020 Jul 13];32:20–47. Available from: https://pubmed.ncbi.nlm.nih.gov/19030981/ [DOI] [PMC free article] [PubMed]
  • 30.Mays VM, Cochran SD, Barnes NW. Race, race-based discrimination, and health outcomes among African Americans. Annu Rev Psychol. Annual Reviews; 2007 [cited 2020 Jul 13];58:201–25. Available from: https://pubmed.ncbi.nlm.nih.gov/16953796/ [DOI] [PMC free article] [PubMed]
  • 31.Krieger N. Embodying inequality: a review of concepts, measures, and methods for studying health consequences of discrimination. Int. J. Heal. Serv. Int J Health Serv; 1999 [cited 2020 Jul 13]. p. 295–352. Available from: https://pubmed.ncbi.nlm.nih.gov/10379455/ [DOI] [PubMed]
  • 32.Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39:175–191. doi: 10.3758/BF03193146. [DOI] [PubMed] [Google Scholar]
  • 33.Nosek BA, Greenwald AG, Banaji MR. The Implicit Association Test at 7 age 7: a methodological and conceptual review. In: Bargh JA, editor. Autom Process Soc Think Behav. 2007. p. 265–92.
  • 34.de Houwer J, Teige-Mocigemba S, Spruyt A, Moors A. Implicit measures: a normative analysis and review. Psychol Bull. 2009;135:347–368. doi: 10.1037/a0014211. [DOI] [PubMed] [Google Scholar]
  • 35.Lane KA, Banaji MR, Nosek BA, Greenwald AG. Understanding and using the Implicit Association Test: IV: procedures and validity. In: Wittenbrink B, Schwarz N, editors. Implicit Meas attitudes Proced Controv. New York: Guilford Press; 2007. pp. 59–102. [Google Scholar]
  • 36.Greenwald AG, Nosek BA, Banaji MR, Klauer KC. Validity of the salience asymmetry interpretation of the implicit association test: comment on Rothermund and Wentura (2004). J Exp Psychol Gen. 2005;134:420–5; author reply 426–30. [DOI] [PubMed]
  • 37.Teige-Mociemba S, Klauer KC, Sherman JW. A practical guide to Implicit Association Tests and related tasks. In: Gawronski B, Payne BK, editors. Handb Implicit Soc Cogn. New York: Guilford; 2010. pp. 117–139. [Google Scholar]
  • 38.Dasgupta N, Mcghee DE, Greenwald AG, Banaji MR. Automatic preference for White Americans: eliminating the familiarity explanation. J Exp Soc Psychol. 2000;36:316–328. doi: 10.1006/jesp.1999.1418. [DOI] [Google Scholar]
  • 39.Ottaway SA, Hayden DC, Oakes MA. Implicit attitudes and racism: effects of word familiarity and frequency on the Implicit Association Test Soc Cogn. 2001;97–144.
  • 40.Rudman LA, Greenwald AG, Mellott DS, Schwartz JLK. Measuring the automatic components of prejudice: flexibility and generality of the Implicit Association Test. Soc Cogn. 1999;17:437–465. doi: 10.1521/soco.1999.17.4.437. [DOI] [Google Scholar]
  • 41.Bosson JK, Swann WB, Pennebaker JW. Stalking the perfect measure of implicit self-esteem: the blind men and the elephant revisited? J Pers Soc Psychol. 2000;79:631–643. doi: 10.1037/0022-3514.79.4.631. [DOI] [PubMed] [Google Scholar]
  • 42.Greenwald AG, Farnham SD. Using the Implicit Association Test to measure self-esteem and self-concept. J Pers Soc Psychol. 2000;79:1022–1038. doi: 10.1037/0022-3514.79.6.1022. [DOI] [PubMed] [Google Scholar]
  • 43.Greenwald AG, Nosek BA. Health of the Implicit Association Test at age 3. Zeitschrift für Exp Psychol Organ der Dtsch Gesellschaft für Psychol. Citeseer; 2001;48:85–93. [DOI] [PubMed]
  • 44.Asendorpf JB, Banse R, Mücke D. Double dissociation between implicit and explicit personality self-concept: the case of shy behavior. J. Pers. Soc. Psychol. APA AMERICAN PSYCHOLOGICAL ASSOCIATION; 2002. [PubMed]
  • 45.Ashburn-Nardo L, Knowles ML, Monteith MJ. Black Americans’ implicit racial associations and their implications for intergroup judgment. Soc Cogn. 2003;21(1):61–87. doi: 10.1521/soco.21.1.61.21192. [DOI] [Google Scholar]
  • 46.Nosek BA, Banaji MR, Greenwald AG. Math = male, me = female, therefore math not = me. J Pers Soc Psychol. 2002;83:44–59. doi: 10.1037/0022-3514.83.1.44. [DOI] [PubMed] [Google Scholar]
  • 47.Wiers RW, van Woerden N, Smulders FTY, de Jong PJ. Implicit and explicit alcohol-related cognitions in heavy and light drinkers. J Abnorm Psychol. 2002;111:648–658. doi: 10.1037/0021-843X.111.4.648. [DOI] [PubMed] [Google Scholar]
  • 48.Krieger N. Stormy weather: race, gene expression, and the science of health disparities. Am J Public Health. 2005;95(12):2155–2160. doi: 10.2105/AJPH.2005.067108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Augstein HF. From the land of the Bible to the Caucasus and beyond: the shifting ideas of the geographical origin of humankind. In: Ernst W, Harris B, editors. Race, Science and Medicine, 1700–1960. London: Routledge; 1999. pp. 58–79. [Google Scholar]
  • 50.Schiebinger L. Nature’s Body: Gender in the Making of Modern Science. Boston: Beacon Press; 1993. pp. 115–142. [Google Scholar]
  • 51.Garcia SE. Where did BIPOC come from? The acronym, which stands for black, Indigenous, and people of color, is suddenly everywhere. Is it doing its job?. New York Times. 2020 [cited 2020 Jun 17]. Available from: https://www.nytimes.com/article/what-is-bipoc.html
  • 52.Grady C. Why the term “BIPOC” is so complicated, explained by linguists. VOX. 2020 [cited 2021 Jun 20]. Available from: https://www.vox.com/2020/6/30/21300294/bipoc-what-does-it-mean-critical-race-linguistics-jonathan-rosa-deandra-miles-hercules
  • 53.Raypole C. Yes, there is a difference between “BIPOC” and “POC” – here’s why it matters. Healthline. 2020 [cited 2021 Sep 30]. Available from: https://www.healthline.com/health/bipoc-meaning
  • 54.Meraji SM, Escobar N, Devarajan K. Is it time to say R.I.P. to “POC”?. Natl. Public Radio. 2020 [cited 2021 Jun 20]. Available from: https://www.npr.org/2020/09/29/918418825/is-it-time-to-say-r-i-p-to-p-o-c
  • 55.Zamudio-Suarez F. Race on campus: BIPOC, minority, or people of color?. Chron. High. Educ. 2021 [cited 2021 Jun 20]. Available from: https://www.chronicle.com/newsletter/race-on-campus/2021-06-08
  • 56.Clark C, Arboleda T. Teacher’s guide for in the shadow of race: growing up as a multiethnic, multicultural, and “multiracial” American. London, UK: Routledge: Taylor & Francis; 1999.
  • 57.Safire W. On language: people of color. New York Times. 1988 [cited 2021 Jun 28]. Available from: https://www.nytimes.com/1988/11/20/magazine/on-language-people-of-color.html
  • 58.Helms JE. An update on Helms’s White and People of Color (POC) racial identity models. In: Ponterotto JG, Casas JM, Suzuki LA, Alexander CM, editors. Handb Multicult Couns. Thousand Oaks: Sage; 1995. pp. 181–198. [Google Scholar]
  • 59.Helms JE. Toward a methodology for measuring and assessing racial as distinguished form ethnic identity. In: Sodowsky GR, Irnpara JC, editors. Multicult Assess Couns Clin Psychol. Lincoln: The Buros Institute of Mental Measurement; 1996. pp. 143–192. [Google Scholar]
  • 60.United States Census Bureau. Educational attainment in the United States: 2019. Table package. 2020 [cited 2021 Jul 9]. Available from: https://www.census.gov/content/census/en/data/tables/2019/demo/educational-attainment/cps-detailed-tables.html
  • 61.United States Census Bureau. U.S. Census Bureau releases new educational attainment data. Release number CB20-TPS.09. 2020 [cited 2021 Jul 9]. Available from: https://www.census.gov/newsroom/press-releases/2020/educational-attainment.html

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

The data of this study are available from the corresponding author upon reasonable request.


Articles from Journal of Racial and Ethnic Health Disparities are provided here courtesy of Springer

RESOURCES