Abstract
This study used qualitative methods and quantitative statistical analyses to examine whether race and gender are associated with reasons for which adults perceive a situation or object as fearful. The sample consists of 197 African-American and White adults (ages 18–85) recruited through a convenience sample and community sources in the Midwest. A cognitive interviewing instrument was utilized to examine respondents understanding of words and phrases from a mental health instrument. Using qualitative methods, free-response answers were content coded using 5 “fear-codes” (i.e., harm/danger, external locus of control, self-perception, and past experience), developed by the researchers. Results from logistic regression analyses indicate that race significantly predicts usage of specific fear codes (p<.05). In addition, a race by gender interaction was found.
Keywords: cognitive interview, phobia, qualitative research, race, anxiety, fear
Race, Gender, and Conceptualizations of Fear
Researchers have advocated for more serious consideration of culture and gender in the study of mental health (Angel & Thoits, 1987; Canino & Alegria, 2008; Littlewood, Jadhav, & Ryder, 2007; Lopez & Hernandez, 1986; Lopez & Nunez, 1987; Manson, 1995; Okazaki & Sue, 1995; Rogler, 1989, 1993; Rogler, Cortes, & Malgady, 1994). Disregarding the influence of these factors may lead to systematic bias in diagnosing and measuring mental health across social groups (Williams & Harris-Reid, 1999), which in turn may initiate an inappropriate course of treatment, perpetuate “unfair and discriminatory stereotypes of pathology” for particular social groups, and may affect health policy developments dependent on quality mental health research (Adebimpe, 1981; Malgady, 1996; Sabshin, Diesenhaus, & Wilkerson, 1970). In addition, a large body of research indicates that individuals from different socio-demographic backgrounds may manifest and communicate symptoms in ways not well understood by clinicians and researchers (Flaskerud, 1986; Sue, Fujino, Hu, & Takeuchi, 1991; U.S. Public Health Service, 2001). Cultures of racial and ethnic minorities influence their perceptions of symptoms, individual coping styles, their family and community supports, and their willingness to seek treatment, possibly contributing to existing disparities in mental health service utilization among ethnic/racial subpopulations (U.S. Public Health Service, 2001). A number of studies indicate that African Americans receive fewer mental health services than the white population for treatment of anxiety disorders in particular, including specific phobia (Alegria et al., 2002; Hatzenbuehler, Keyes, Narrow, Grant, & Hasin, 2008; Kessler et al., 2005; Kessler et al., 1996; Keyes et al., 2008; Swartz et al., 1998; Wang et al., 2005) Specific phobia (formerly simple phobia)is defined as “intense and persistent fear of a specific or circumscribed object or situation that may be present or anticipated” wherein an encounter with the phobic stimulus will almost invariably induce an instantaneous anxiety response such as a panic attack or other anxiety symptoms, recognized as excessive or unreasonable, and lead to avoidance or endurance characterized by marked anxiety and discomfort (American Psychiatric Association, 1994). Notably, findings from a number of large epidemiological studies suggest differential prevalence rates of specific phobia disorder among a number of racial and gender subgroups (Breslau, Aguilar-Gaciola, et al., 2006; Neighbors & Williams, 2000; Robins & Regier, 1984; Schwab, Bell, Warheit, & Schwab, 1979; U.S. Public Health Service, 2001; Williams, 1995; Zhang & Snowden, 1999). Specifically, this disorder has been found to be more prevalent among African Americans than any other group (Neal & Turner, 1991; Robins & Regier, 1984). Even when education, birthplace, and socioeconomic status are controlled statistically (Neal & Turner, 1991; Warheit, Holzer, & Arey, 1975), White Americans report simple phobia at a third of the prevalence rate of African Americans (Neal & Turner, 1991). Only a single study has found comparable rates of this disorder between African Americans and White respondents (Breslau, Aguilar-Gaxiola, et al., 2006). The research on adult African American populations with specific phobia is relatively sparse. A recent review by Hunter and Schmidt (2010) indicates that they were unable to locate any studies of African American adults carrying diagnoses of specific phobia; thus, the review included studies of only child and adolescent samples (Hunter & Schmidt, 2010). Differences in the conceptualization and understanding of specific phobia have yet to be studied.
Conceptualization and understanding of fear may vary across culturally diverse groups. The purpose of this study is to investigate the conceptualization and understanding of fear across two socio-demographic characteristics, race and gender. Specifically, we assess the possibility of systematic patterns across race and gender in the interpretation and understanding of a specific measurement item commonly used to assess specific phobia disorder. The study utilizes a methodology termed “cognitive interviewing” with White and African American men and women to build upon on an emerging literature that examines individual differences in the comprehension and interpretation of global health items and a standardized instrument, the World Health Organization’s (WHO) Composite International Diagnostic Interview (CIDI; Kessler, Andrews, Morczek, Ustun, & Wittchen, 1998; World Health Organization, 1990). The CIDI is a highly structured diagnostic instrument used primarily to assess prevalence rates of specific psychiatric disorders. It has been used in large national epidemiological studies like the Epidemiological Catchment Area Study (ECA) and the National Comorbidity Study (NCS) (Breslau, Aguilar-Gaxiola, et al., 2006; Kessler & Ustun, 2004; Robins, Wing, Wittchen, & Helzer, 1988) and has been shown to reveal similar prevalence rates of mental health diagnoses in a variety of socio-demographic subpopulations with DSM-IV diagnostic criteria (Alegria et al., 2009; Haro et al., 2006). However, systematic bias may occur in respondents’ interpretation and understanding because the interviewer does not follow up with additional questions to inquire further or clarify the structured questions.
The Use of Cognitive Interviewing in Health and Mental Health Research
In response to concerns about the conceptualization of measurement items across socio-demographic characteristics, health and social science researchers have begun to initiate collaborations, in order to gain a greater understanding of how survey questions are answered by diverse populations and to discover methods for improving survey questions (Schechter, 1997). The Questionnaire Design Research Laboratory (QDRL), the first formalized U.S. government collaboration developed to increase understanding of differential survey response patterns in diverse populations and to discover methods for improving survey questions (Schechter, 1997) has acknowledged cognitive interviewing as a valuable instrument in “evaluating whether health related surveys are comprehended and interpreted in the same way across all groups” (p. 308) (Williams & Harris-Reid, 1999).
Cognitive interviewing employs several techniques including probes, vignettes, and protocols that ask people to think aloud (Oksenberg, Cannell, & Kalton, 1991; Schechter, 1997). The use of cognitive interviewing techniques has occurred primarily with the interpretation of health survey questions (Groves, Fultz, & Martin, 1992; Krause & Jay, 1994) and to investigate gender and race-based differences in the interpretation and comprehension of health-related survey questions (Johnson et al., 1994; Warnecke et al., 1997). Research using cognitive interviewing to investigate the conceptualization of mental health, however, is limited. Emerging research has utilized cognitive interviewing techniques to understand conceptualizations of depression among African Americans (Ford, 2002). Using the probe, “What does the phrase sad, blue, or depressed mean to you” and “are there any other words or phrases that you would use to describe feeling sad, blue, or depressed”, Ford reports no significant differences by race or gender, supporting a “common language” for the conceptual meaning of depression, but notes that differences in understanding may occur when individuals provide examples of their own experiences with depression. To date, this is the only study to utilize cognitive interview probes to understand whether conceptualization of fear and specific phobia differs by race or gender.
Research Questions
To gain a greater understanding of race and gender differences in the conceptualization of specific phobia between African American and White men and women, we used cognitive interviewing techniques to investigate the following research questions: (1) Are there differences in the way that adults describe situations and/or objects as fearful? (2) If differences exist, are adults’ perceptions of objects or situations as fearful associated with race and gender?
Methods
The data used in this analysis is from a larger study examining cultural differences in the interpretation of CIDI and other mental health questions. One hundred and ninety seven participants from two counties in Southeastern Michigan were recruited for the study; the sample was divided evenly among African Americans and White respondents and men and women. Participants ranged from 18 to 85 years old and were on average 36 years old. Approximately half of the sample had less than a high school degree. About one-third of the sample were married and about 40% were never married (See Table 1).
Table 1.
Descriptive Statistics (N = 197) of Demographic Characteristics of the Sample and Significance of Differences by Race
| African American | White | |||
|---|---|---|---|---|
| Variables | Percent (%) | Mean/SD | Percent (%) |
Mean/SD |
| Age | 34.07(10.80) | 38.61(12.54)** | ||
| Gender | ||||
| Female | 55.6% | 46.9% | ||
| Male | 44.4% | 53.1% | ||
| Education | ||||
| Less than High School | 43.4% | 51.0% | ||
| High School Graduate or More | 56.6% | 49.0% | ||
| Marital Status | ||||
| Never Married | 51.5% | 28.5%** | ||
| Married or Living with Partner | 23.2% | 38.8% | ||
| Divorced/Separated/Widowed | 25.3% | 32.7% | ||
Note:
p < .10,
p < .05,
p < .01,
p < .001
This was a purposeful convenience sample, recruited from various community sources including Michigan Employment Security Commission Job Service, community groups, local churches, senior citizens’ organizations, shopping malls, and street corners throughout the two Michigan counties. The convenience sample was designed to fill certain cells and recruited to be equally divided between blacks and White respondents, and of high and low (high school or more versus less than high school) education within each race. Each participant was matched with a trained interviewer of the same race. Interviews were conducted at each of the respective community sites noted above or in a university office. Participants received $20 and a list of telephone numbers of mental health services in the event that a referral was needed for their participation in the study. This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
Measures
Demographic Items
Several items were used to solicit participants’ socio-demographic characteristics including: ethnicity (1=African American; 0=White), gender (1=female, 0=male), educational level (1=12 years or more, 0=11 years or less), age (in years), and marital status (2= divorced, separated, widowed, 1=married, 0=never married).
Qualitative Phobia Probe
A single open-ended verbal cognitive interviewing probe was used to examine how participants interpret specific words and phrases included in a question from the CIDI. Cognitive interviewing techniques, including verbal probes, are recognized by the QRDL as an acceptable research tool to identify differential response population-based response patterns (Schechter, 1997). The item investigated in the current study was: “What makes an object or situation fearful?” This probe was used to gain a greater understanding of how persons interpret a structured question from the CIDI used to assess the presence of phobia (“Did you ever have a strong unreasonable fear of a specific object or situation—for example, animals or insects, heights, storms, water, elevators, enclosed spaces, blood, going to the dentist or hospital?”) and, as a stand-alone question, was not sufficient to assess for DSM-IV diagnoses. Consistent with methodology identified by Willis and colleagues (Willis, Royston, & Bercini, 1991) and favored by many cognitive researchers (see Willis, DeMaio, & Harris-Kojetin, 1999), all graduate-level interviewers were trained in the use of the verbal probe comprehension/interpretation technique (Willis et al., 1991) to first ask the CIDI survey question to each participant. After the participant answered the question, the interviewer then asked for specific information relevant to either the question or the specific answer provided by the participant. Interviewers were instructed to note responses verbatim, but did not audio-record them. Interview responses were entered into a computer spreadsheet file (Microsoft Excel) and codes generated from these responses were entered into SPSS for Windows, v. 10, for further statistical analysis.
Analysis Plan
Qualitative Analysis
We used classical content analysis to examine the conceptualization of fear among a diverse sample. Content analysis aims at a classification of content for making inferences by objectively and systematically identifying specified characteristics of information (Holsti, 1969). Through the application of categorization rules, information is transformed into data that can be summarized and compared (Paisley, 1969). While content analysis was used originally to analyze “natural” or “available” data—data that exist without any active participation by the investigator—this method also has been used widely with open-ended questions generated from qualitative research (Holsti, 1969).
The qualitative analyses focused on responses to the single probe item, "What makes an object or situation fearful?" In order to explore patterns and deeper interpretations of the meanings captured by the probe, the researchers used a three-step data reduction process utilizing an inductive method adapted from the grounded theory approach. This process utilizes an inductive (i.e., bottom-up) method adapted from the grounded theory approach (Strauss & Corbin, 1990). The initial coding phase follows principles of open coding that have been employed within a constructivist approach to grounded theory data analytic methods (Charmaz, 2006).
In the first phase of the analyses, a key-word list was created, which depicted the respondents’ ideas regarding “What makes an object or situation fearful?” Second, study investigators sorted and sifted through the keywords, “teasing out themes” linking relevant keywords and clustering keywords into chunks representing distinct ideas or themes related to perceptions of fear. Third, data chunks were reviewed carefully to determine whether there might be other combinations of keywords that might represent higher levels of abstraction (Miles & Huberman, 1994). These chunks of keywords comprised seven descriptive fear categories that were defined carefully and utilized in the subsequent coding process.
In the second phase of the analyses, two codes(“definition or synonyms of fear” and an “other” category) were deleted from the analyses due to their low frequency and low inter-rater reliability.
The remaining fear categories were used to code the content of respondents’ original free-response answers to the interview probe. When a response included more than one idea or theme, multiple codes were assigned. The list of fear codes and their descriptions are included in Table 2. The presence of each fear code was measured as a dichotomous variable. The first and second authors coded the responses first. Coders were blind to respondents’ demographic information when coding transcripts. Later, the dichotomous variables generated by the fear codes were merged with each participant’s quantitative demographic data to examine the hypothesized association between race, gender, and respondents’ conceptualization of fear.
Table 2.
Definitions and frequencies for “What makes a situation or object fearful” codes (N=197)
| Fear Code | Definition | Examples | Kappa | N | Percent (%) |
|---|---|---|---|---|---|
| External Locus of Control | Expressing lack of control, that which is unknown or unexpected, or predictions of impending occurrences. | “When you don’t know or understand an outcome or what the outcome will be or you are unable to control a situation.” | .92 | 70 | 35.5 |
| “When you know yourself that you have no control over it. It can go any way it wants to.” | |||||
| “Sometimes not knowing what the outcome would be…he doesn’t know so that scares him.” | |||||
| Harm/Danger | Direct or indirect references to danger, the capacity to hurt or cause pain and suffering. | “That you could get hurt if something goes wrong.” | .80 | 56 | 29.3 |
| “When I was a taxi cab driver, I had a gun pulled on me and put to my head. That was really scary. I thought ‘Jesus, my life is done now.” | |||||
| Phobias | A specific object, person, or action as causing intense fear or anxiety. | “She’s scared of heights, doesn’t like roller coasters.” | .70 | 35 | 18.3 |
| “The sound of thunder we had last week. I had all the lights turned off and everything.” | |||||
| Past Experiences | Direct or indirect personal experience as causing fear or anxiety. | “If you had been on it and had had an accident on it. Just by experience you had with it.” | .83 | 30 | 15.7 |
| “Depends on what people have tried before. Things people hear about can cause them fear.” | |||||
| Self-perception | One’s own perceptions leads them to find a situation or object fearful; internal locus of control | “I believe fear is in the mind. So nothing makes the object fearful, it’s your mind that does it.” | .74 | 17 | 8.9 |
| “Believing you can’t deal with it.” |
Inter-rater Reliability
To examine the reliability of the qualitative fear codes, two graduate-level students were trained to follow the same procedures noted above. Student coders individually generated keywords from the respondents’ free-response answers to the probes and then clustered the keywords into chunks representing distinct ideas or themes related to perceptions of fear. Fear codes developed independently by graduate students were nearly identical to the fear codes composed by the investigators, indicating that the codes showed evidence of reliability and may be replicable.
Cohen’s (Cohen, 1960) Kappa statistic was used to measure the extent of agreement between the raters, in their assignment of fear codes to the free response answers to the probe. Landis and Koch (Landis & Koch, 1977) have provided benchmarks for evaluating Kappa statistics and suggest that Kappas of .41–.60, .61–.80, and .81–1.00 be evaluated as moderate, substantial, and almost perfect agreement, respectively. According to these standards, most of the Kappa estimates were found among the almost perfect agreement range, indicating that multiple coders could apply the fear codes reliably (See Table 2).
Statistical Analysis
First, descriptive statistics for all variables used in the analyses were calculated including race, gender, age, education, and marital status. Chi-square analyses of the association between each fear code and respondents’ race and gender were calculated. Finally, using each of the five fear codes, separate logistic regressions were computed to examine the association between race and gender and each fear category, controlling for age, education, and marital status. Race by gender interaction terms also were computed and added to each of the logistic main effects models for investigation.
Results
Table 1 presents the descriptive statistics for the demographic variables of the study. Chi-square analyses and one-way analysis of variance (ANOVA) were used to test the bivariate relationships among the demographic variables. Race differences were found in the sample for marital status and age. Specifically, African American respondents were more likely to have never married (χ2 = 10.75, df = 2, p < .01) and were younger, on average (F = 7.42, df = 1, p < .01), compared to White respondents. Gender differences were not found among the variables.
Table 2 presents the definitions and frequencies of the fear codes generated from the cognitive interview probes. The five themes represent the final codes retained for analyses. The external locus of control code, defined by expressions of lack of control or references to that which is unknown, constituted the most frequently expressed theme (35.5%). In this code, situations or objects were described as fearful when they involved a loss or lack of control, unpredictability, fate, or lack of clarity for that which is unknown. The second most frequently coded theme was harm/danger (29.3%). References to pain and suffering around unpleasant or dangerous circumstances defined this theme. Phobia was the third most frequent theme (18.3%). This theme represented the classical definition of specific phobia, defined by specific objects or situations as causing intense fear and anxiety. Avoidance of objects or situations that caused fear and anxiety was also coded within the harm/danger code. Reference to past experience was coded in 15.7% of the responses. Personal experiences, such as bad experiences, define this theme. Past experiences may also refer to some incident that was experienced by someone other than the respondent. Finally, self-perception was coded in 8.9% of the responses for this code. Individuals responded to the question of what makes an object or situation fearful by noting that fear is what you make it, one’s own self-perception. Examples of each code are presented in Table 2.
Table 3 summarizes the number and percentage of respondents coded for each of the five fear codes by gender and race. White females were coded for external locus of control about 1.5 times more often than African American females. White males were coded 3.5 times more for past experiences as compared to African American males.
Table 3.
Respondents acknowledging fear codes by gender and race
| Male | Female | |||
|---|---|---|---|---|
| Fear Codes | African American N (%) |
White N (%) |
African American N (%) |
White N (%) |
| Harm/Danger | 14 (33.3) | 17 (34.0) | 13 (24.1) | 12 (26.7) |
| External Locus of Control | 15 (34.1) | 13 (25.0) | 18 (32.7) | 24 (52.2)* |
| Phobias | 6 (14.3) | 8 (16.0) | 13 (24.1) | 8 (17.8) |
| Past Experiences | 3 (7.1) | 13 (26.0)* | 6 (11.1) | 8 (17.8) |
| Self-perception | 7 (16.7) | 6 (12.0) | 3 (5.6) | 1 (2.2) |
Note:
p< .10,
p< .05,
p< .01,
p< .001
Five logistic regression models were computed to test the association between the socio-demographic variables under investigation and the five fear codes. Three of the five models (external locus of control, past experiences, self-perception) revealed significant relationships for race and gender. A significant main effect of race was found for past experiences, where White respondents were significantly more likely to cite past experiences as a source of fear compared to African Americans (b = −1.02, O.R. = 0.36, p < .05; see Table 4). A significant main effect of gender was found for self-perception, where men are significantly more likely to endorse self-perception as a source of fear compared to women (b = −1.43, O.R. = 0.24, p < .05; table not shown).
Table 4.
Betas, SEs, Odds Ratios, and Significance for Past Experiences and External Locus of Control Codes
| Past Experiences | External Locus of Control | |||
|---|---|---|---|---|
| B | Odds Ratio |
B | Odds Ratio |
|
| Race (African American =1) | −1.02 (.45) | .36* | −.15 (.32) | 0.86 |
| Gender (Female =1) | −.17 (.41) | .84 | 0.55 (.31) | 1.73+ |
| Age | −.01 (.02) | .99 | .03 (.02) | 1.03* |
| Education (High School Grad =1) | .48 (.43) | 1.62 | .56 (.32) | 1.75+ |
| Marital Status (Never Married =0) Married | .31 (.54) | 1.36 | .06 (.40) | 1.10 |
| Divorced/Separated/Widowed | .73 (.57) | 2.10 | −.27 (.42) | .77 |
| Constant | −1.28 (.82) | .27 | −2.22 (.65) | .11*** |
Note:
p< .10,
p< .05,
p< .01,
p< .001
Gender was only marginally associated with external locus of control code; however, a significant race × gender interaction was found (b = −1.38, O.R. = 0.25, p < .05; see Table 5). External locus of control was endorsed most frequently by White women and least frequently by White men. African American men and women reported similarly with regard to this code.
Table 5.
Logistic Regression with Race by Gender Interaction for External Locus of Control Codes
| B | Odds Ratio |
|
|---|---|---|
| Race (African American =1) | .63 | 1.87 |
| Gender (Female =1) | 1.24 | 3.46** |
| Age | .03 | 1.03* |
| Education (High School Grad =1) | .58 | 1.79+ |
| Marital Status (Never Married =0) Married | .09 | 1.10 |
| Divorced/Separated/Widowed | −.27 | .77 |
| Race × Gender | −1.38 | .25* |
| Constant | −2.70 | .067 |
Note:
p< .10,
p< .05,
p< .01,
p< .001
Although not included in the primary analyses, age and education were associated significantly with the external locus of control and phobia codes, respectively. Older respondents were more likely to endorse external locus of control than younger respondents (b = .032, O.R. = 1.032, p =.032), while respondents who did not complete high school were more likely to endorse phobia than high-school graduates (b = −.875, O.R. = .417, p =.033).
Discussion
Using cognitive interviewing probes, the results of this study show that respondents do not define what is fearful uniformly. These findings suggest differential conceptualizations of the construct of fear and possible differences in interpretations of CIDI questions evaluating specific phobia. Specifically, respondents noted five themes when describing what makes an object or situation fearful: self-perception, phobias, harm/danger, external locus of control, and past experiences. Analyses to determine the association between respondents’ race and gender and fear codes revealed that White women were significantly more likely to endorse external locus of control and White respondents (men and women) were more likely to endorse past experiences when describing their understanding of fear than their African American counterparts. In addition, men endorsed self-perception more frequently than women, regardless of ethnicity. This study also suggests that women in this sample may conceptualize fears as phobias more frequently than their male counterparts, although these findings only reached marginal significance. While our research questions were focused on increasing our understanding of race and gender differences in the conceptualization of fear, findings also suggest some striking commonalties in conceptualization across demographic groups.
Race and gender socialization and social position due to race and gender may have significant implications for patterns in conceptualizations of fear displayed by the different social groups. Exposure to stressors and strains may vary as a function of social structures, status, power, and access to personal and social resources (Pearlin, 1989; Turner, Wheaton, & Lloyd, 1995). African-American men and women are more prone to acute and chronic stressors associated with institutionalized racism and discrimination (Brown, Eaton, & Sussman, 1990; Carter, Sbrocco, & Carter, 1996; Neal & Turner, 1991; Sennett & Cobb, 1973; Sigelman & Welch, 1993). In general, women also have a lower financial status compared to men, in many cases due to sexual discrimination(Wenzel, 1993). It is important to consider these contextual factors when attempting to understand racial and gender differences in conceptualization of fear.
Race and gender socialization also affect how social groups are viewed by society at large, which in turn affects how particular social groups perceive themselves. For example, a number of studies with diverse samples have shown that White women are more likely to be perceived favorably than their African-American counterparts (Farr, 2000; Landrine, 1985; Madriz, 1997; Young, 1986). Specifically, African-American females have been described as “hyper-sexed” (Farr, 2000, p.55; Madriz, 1997), and have been depicted as more dangerous and aggressive than White women(Brennan, 2006; Farr, 1997; Madriz, 1997; Young, 1986). Such negative stereotypes may drive popular media outlets to more frequently portray White women as the victims of violent crime (Madriz, 1997), when in fact Black women are more likely to be victims of crimes than their White counterparts(Bureau of Justice Statistics, 1995). Despite lower levels of victimization, White women report higher levels of fear of crime than African-American women(Madriz, 1997). Such media portrayals may increase White women’s perceptions that they are controlled by external forces, and may explain why White women were more likely to report external locus of control in their conceptualization of fear than their African American counterparts.
Research on coping mechanisms for discriminated and stigmatized social groups suggests that African American men and women may depend on various mechanisms for coping such as an external locus of control and social learning (Crocker, Major, & Steele, 1998; Lieberman, 1999). “Individuals with an external orientation are more likely to construe events as resulting from luck, chance, fate, or powers beyond their personal control in contrast to those with an internal orientation who perceive contingencies between their own behavior and subsequent events” (p. 1) (Strickland, 1989). A number of studies indicate that African Americans demonstrate a “stronger external orientation”, seeing themselves as more externally controlled (Gurin, Gurin, Lao, & Beattie, 1969; Lefcourt & Ladwig, 1965; Wenzel, 1993) (p. 496) and possessing a stronger belief in control by powerful others (Garcia, 1975; Wenzel, 1993) than their White counterparts. Conversely, encompassing a more internal locus of control and high levels of “John Henryism” (i.e., a commitment to the values of hard work, self-reliance and resistance to forces seeking to restrict personal freedom) has been linked to negative health and mental health of African Americans at least under some conditions (Neighbors, Jackson, Broman, & Thompson, 1996). The current study found evidence of an association between an external locus of control orientation and fear for White women. Not surprisingly, this association was not found for African Americans. A worldview that encompasses an external locus of control may be perceived as an adaptive coping strategy for African Americans, and may explain why fear was not conceptualized in this way.
Our findings also suggest that White respondents in this sample mention past experiences in their conceptualizations of fear more frequently than their African-American counterparts. African Americans’ experiences may be influenced more by unpredictable events including acts of racism and discrimination. Due to African Americans’ low social positioning in society and historical experiences with stressors associated with institutionalized racism and discrimination(Sennett & Cobb, 1973; Sigelman & Welch, 1993; Vines & Baird, 2009), African Americans may focus on the present and future in order to cope with adverse life experiences; therefore these themes may not be associated with fear.
Finally, results from this study indicate that respondents describe or identify phobias in their conceptualizations of fear but suggest gender and race differences in the inclusion of this theme in their responses. The results from this study indicate that female respondents mentioned phobia, the fear theme reflecting the DSM definition of specific phobia disorder, twice as often as their male counterparts. Although this difference did not reach statistical significance, this finding is particularly meaningful because this trend is consistent with findings from several other studies demonstrating higher prevalence rates of specific phobia among women as compared to men (Bourden et al., 1988; Fredrikson, Annas, Fischer, & Wik, 1996; Neal & Turner, 1991; Plaud & Vavrovsky, 1998; Robins et al., 1984; Schwab et al., 1979). Furthermore, our research findings replicate trends found in the ECA, indicating that Black women tend to exhibit higher rates of specific phobias compared to White and Black men. Women’s conceptualizations of fear (particularly African American women’s) seem to overlap most often with the concept of fear included in the specific phobia diagnostic category. Specifically, these results indicate differences in interpretation of a standardized question from the CIDI across specific groups, invariably affecting rates of endorsement. Though our study findings lack generalizability due to purposeful convenience sampling, they contribute to the understanding of race and gender differences in the prevalence of specific phobia reflected in the literature.
Differential conceptualizations of fear have implications for mental health professionals and researchers involved in the assessment and diagnosis of anxiety and for future research. Studies that utilize cognitive interviewing techniques have the potential to improve the diagnostic accuracy and sensitivity of existing measures, specifically for women and racial minorities who have been traditionally underrepresented in research, as well as in the development of interventions to reduce fear and anxiety. When differential conceptualizations of fear that are not examined, incidence and prevalence rates of anxiety disorders may be either under- or over-reported, depending on one’s social group.. Approaches to measurement, diagnosis, and intervention development should carefully consider the importance of culture when assessing and treating individuals suffering from anxiety disorders, especially in light of findings pertaining to fear codes ofpast experiences and locus of control. For example, specific guidelines for cross-cultural health-related quality of life measurement identified by Guillemin and colleagues (Guillemin, Bombardier, & Beaton, 1993) that underscore the need for incorporating variations in idiomatic, experiential, and conceptual interpretations of health-related factors could be used in assessment of anxiety disorders. Interventions also should be developed that are preventive in nature, examining societal forces that influence gender socialization and racial disparities that may be linked to anxiety, to promote well-being.
The use of cognitive interviewing has implications for research on anxiety as well as a wide range of other mental health disorders. The current study focused on the question, “What makes an object or situation fearful?” (probing the CIDI construct for phobias). Future research using cognitive interview techniques may further examine the extent and intensity to which these objects or situations are viewed as fearful as well as when these fears interfere with an individual’s quality of life. Few symptom measures have been developed with racial minority patient populations from clinical and research settings (Rogler, 1993); as such, it is unclear how symptom presentations vary across cultures or language domains or how cultural expectations affect the technical performance or interpretation of scale scores (Manson, 1995; Vega & Rumbaut, 1991). Continued research that utilizes a multi-dimensional approach to data collection is much needed. Specifically, future research may apply cognitive interview probes to examine whether individuals’ understand the language of mental health professionals and the DSM and whether they use this language to describe their symptoms of mental disorders.
Cognitive interviewing techniques are not without limitations and have much room for refinement and improvement. Analytic techniques in cognitive interviewing are complex and time consuming, requiring line-by-line keyword and code development and multiple coders to ensure reliability and validity through investigator triangulation (Patton, 2002). Just as care should be provided to the development of questionnaire items in survey research, cognitive interviewing also requires careful consideration of probes used to understand how construct are conceptualized. For example, in the current study, it was apparent that some respondents interpreted the question “What makes an object or situation fearful?” to mean what is an object or situation that causes fear. While this interpretation of the probe did not affect the overall development of codes or the results of the study, it is a potential limitation that should be considered in future research. As with other qualitative methods, it is difficult to obtain large, representative samples due to the intensive interviewing techniques utilized. The current study utilizes a relatively small, yet purposeful, convenience sample (by the standards of quantitative research), but is considered a large sample for a qualitative study. Finally, we chose not to audiotape respondents during the interviews for the purpose of developing rapport and honesty in responses. While interviewers were trained to record verbatim responses, there remains some concern over the extent to which this was achieved, and the lack of audio recording is a limitation of this study.
In conclusion, the current study contributes to a clearer understanding of gender and cultural differences in the interpretation of a question widely used to assess and diagnose anxiety. While cognitive interviewing techniques have been utilized with health survey questions, the utility of these methods with mental health survey questions, specifically the CIDI, has not been explored fully. Given findings from a recent study of adolescents indicating that significantly higher CIDI estimates for specific phobia on the CIDI compared to the K-SADS (Kessler et al., 2009), this is a direction for future research. The current study is one of the first studies to investigate the cultural sensitivity of these measures using this innovative technique.
Contributor Information
Jordana Muroff, Email: jmuroff@bu.edu, Boston University, School of Social Work.
Michael S. Spencer, University of Michigan
Abigail M. Ross, Boston University
David R. Williams, University of Michigan and Harvard University
Harold W. Neighbors, University of Michigan
James S. Jackson, University of Michigan
References
- Adebimpe VR. Overview: White norms and psychiatric diagnosis of Black patients. American Journal of Psychology. 1981;138(3):279–285. doi: 10.1176/ajp.138.3.279. [DOI] [PubMed] [Google Scholar]
- Alegria M, Canino G, Rios R, Vera M, Calderon J, Rusch D, Ortega AN. Inequalities in use of specialty mental health services among Latinos, African Americans, and non-Latino whites. [Comparative Study] Psychiatr Serv. 2002;53(12):1547–1555. doi: 10.1176/appi.ps.53.12.1547. [DOI] [PubMed] [Google Scholar]
- Alegria M, Shrout PE, Torres M, Lewis-Fernandez R, Abelson JM, Powell M, Canino G. Lessons learned from the clinical reappraisal study of the Composite International Diagnostic Interview with Latinos. International Journal of Methods in Psychiatric Research. 2009;18(2):84–95. doi: 10.1002/mpr.280. [DOI] [PMC free article] [PubMed] [Google Scholar]
- American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-IV. 4th ed. Washington, DC: American Psychiatric Association; 1994. [Google Scholar]
- Angel R, Thoits P. The impact of culture on the cognitive structure of illness. Culture Medicine and Psychiatry. 1987;11:465–494. doi: 10.1007/BF00048494. [DOI] [PubMed] [Google Scholar]
- Bourden KH, Boyd JH, Rae DS, Burns BJ, Thompson JW, Locke BZ. Gender differences in phobias: Results of the ECS community survey. Journal of Anxiety Disorders. 1988;2:227–241. [Google Scholar]
- Brennan Sentencing female misdemeanants: An examination of the direct and indirect effects of race/ethnicity. Justice Quarterly. 2006;23(1):60–95. [Google Scholar]
- Breslau J, Aguilar-Gaciola S, Kendler KS, Su M, Williams D, Kessler RC. Specifying race-ethnic differences in risk for psychiatric disorder in a USA national sample. Psychological Medicine. 2006;36:57–68. doi: 10.1017/S0033291705006161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Breslau J, Aguilar-Gaxiola S, Kendler KS, Su M, Williams D, Kessler RC. Specifying race-ethnic differences in risk for psychiatric disorder in a USA national sample. Psychological Medicine. 2006;36(1):57–68. doi: 10.1017/S0033291705006161. doi: S0033291705006161 [pii]10.1017/S0033291705006161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown DR, Eaton WW, Sussman L. Racial differences in prevalence of phobic disorders. Journal of Nervous & Mental Disease. 1990;178(7):434–441. doi: 10.1097/00005053-199007000-00004. [DOI] [PubMed] [Google Scholar]
- Bureau of Justice Statistics. Violence against women: Estimates from the redesigned survey. In National crime victimization survey. Washington, DC: US Department of Justice; 1995. [Google Scholar]
- Canino G, Alegria M. Psychiatric diagnosis - is it universal or relative to culture? Journal of Child Psychology and Psychiatry. 2008;49(3):237–250. doi: 10.1111/j.1469-7610.2007.01854.x. doi: JCPP1854 [pii]10.1111/j.1469-7610.2007.01854.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carter MM, Sbrocco T, Carter C. African Americans and anxiety disorders research: Development of a testable theoretical framework. Psychotherapy: Theory, Research, Practice, Training. 1996;33(3):449–463. [Google Scholar]
- Charmaz K. Constructing grounded theory: A practical guide through qualitative analysis. Thousand Oaks, CA: Sage Publications; 2006. [Google Scholar]
- Cohen J. A coefficient agreement for nominal scales. Educational and Psychological Measurement. 1960;20:37–46. [Google Scholar]
- Crocker J, Major B, Steele C. Social Stigma. 4th ed. Vol. 2. New York, NY: McGraw-Hill; 1998. [Google Scholar]
- Farr KA. Aggravating and differentiating factors in the cases of white and minority women on death row. Crime & Delinquency. 1997;43(3):260–278. [Google Scholar]
- Farr KA. Defeminizing and dehumanizing female murderers: Depictions of lesbians on death row. Women & Criminal Justice. 2000;11(1):49–66. [Google Scholar]
- Flaskerud JH. The effects of culture-compatible intervention on the utilization of mental health services by minority clients. Community Mental Health J. 1986;22:127–141. doi: 10.1007/BF00754551. [DOI] [PubMed] [Google Scholar]
- Ford BC. Unlocking the language of mental health: Using cognitive interviewing to examine the language of depression; Paper presented at the Annual meeting of American Public Health Association; Philadelphia, PA. 2002. [Google Scholar]
- Fredrikson M, Annas P, Fischer H, Wik G. Gender and age differences in the prevalence of specific fears and phobias. Behavior Research and Therapy. 1996;34:33–39. doi: 10.1016/0005-7967(95)00048-3. [DOI] [PubMed] [Google Scholar]
- Garcia CLH. Differences between Blacks' and Whites' expectations of control by chance and powerful others. Psychological Reports. 1975;37:563–566. doi: 10.2466/pr0.1975.37.2.563. [DOI] [PubMed] [Google Scholar]
- Groves RM, Fultz NH, Martin E. Direct questioning about comprehension in a survey setting. In: Tanur JM, editor. Questions about questions: Inquiries into the cognitive bases of surveys. New York: Sage Foundation; 1992. pp. 49–61. [Google Scholar]
- Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. Journal of Clinical Epidemiology. 1993;46(12):1417–1432. doi: 10.1016/0895-4356(93)90142-n. [DOI] [PubMed] [Google Scholar]
- Gurin P, Gurin G, Lao RC, Beattie M. Internal-external control in the motivational dynamics of Negro youth. Journal of Social Issues. 1969;25(3):29–53. [Google Scholar]
- Haro JM, Arbabzadeh-Bouchez S, Brugha TS, de Girolamo G, Guyer ME, Jin R, Kessler RC. Concordance of the Composite International Diagnostic Interview Version 3.0 (CIDI 3.0) with standardized clinical assessments in the WHO World Mental Health surveys. International Journal of Methods in Psychiatric Research. 2006;15(4):167–180. doi: 10.1002/mpr.196. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hatzenbuehler ML, Keyes KM, Narrow WE, Grant BF, Hasin DS. Racial/ethnic disparities in service utilization for individuals with co-occurring mental health and substance use disorders in the general population: results from the national epidemiologic survey on alcohol and related conditions. [Research Support N.I.H., Extramural Research Support, N.I.H., Intramural Research Support, Non-U.S. Gov't] J Clin Psychiatry. 2008;69(7):1112–1121. doi: 10.4088/jcp.v69n0711. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holsti OR. Content analysis for the social sciences and humanities. Reading, MA: Addison-Wesley; 1969. [Google Scholar]
- Hunter LR, Schmidt NB. Anxiety psychopathology in African American adults: literature review and development of an empirically informed sociocultural model. Psychological Bulletin. 2010;136(2):211–235. doi: 10.1037/a0018133. doi:2010-03383-009 [pii]10.1037/a0018133. [DOI] [PubMed] [Google Scholar]
- Johnson TP, O'Rourke D, Chavez N, Lacey L, Sudman S, Warnecke RB, Horm J. Cultural variations in the interpretation of health survey questions; Paper presented at the Proceedings of the 1993 Public Health Conference on Records and Statistics Toward the Year 2000.1994. [Google Scholar]
- Kessler RC, Andrews G, Morczek D, Ustun B, Wittchen HU. The World Health Organization Composite International Diagnostic Interview Short-Form (CIDI-SF) International Journal of Methods in Psychiatric Research. 1998;7:171–185. [Google Scholar]
- Kessler RC, Avenevoli S, Green J, Gruber MJ, Guyer M, He Y, Zaslavsky AM. National comorbidity survey replication adolescent supplement (NCS-A): III. Concordance of DSM-IV/CIDI diagnoses with clinical reassessments. Journal of the Americal Academy of Child and Adolescent Psychiatry. 2009;48(4):386–399. doi: 10.1097/CHI.0b013e31819a1cbc. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kessler RC, Demler O, Frank RG, Olfson M, Pincus HA, Walters EE, Zaslavsky AM. Prevalence and treatment of mental disorders, 1990 to 2003. [Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't Research Support, U.S. Gov't. P.H.S.] N Engl J Med. 2005;352(24):2515–2523. doi: 10.1056/NEJMsa043266. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kessler RC, Nelson CB, McGonagle KA, Edlund MJ, Frank RG, Leaf PJ. The epidemiology of co-occurring addictive and mental disorders: implications for prevention and service utilization. [Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, P.H.S.] Am J Orthopsychiatry. 1996;66(1):17–31. doi: 10.1037/h0080151. [DOI] [PubMed] [Google Scholar]
- Kessler RC, Ustun TB. The World Mental Health (WMH) Survey Initiative Version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI) International Journal of Methods of Psychiatry Research. 2004;13(2):93–121. doi: 10.1002/mpr.168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Keyes KM, Hatzenbuehler ML, Alberti P, Narrow WE, Grant BF, Hasin DS. Service utilization differences for Axis I psychiatric and substance use disorders between white and black adults. [Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't] Psychiatr Serv. 2008;59(8):893–901. doi: 10.1176/appi.ps.59.8.893. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krause NM, Jay GM. What do global self-rated health items measure? Medical Care. 1994;32(9):930–942. doi: 10.1097/00005650-199409000-00004. [DOI] [PubMed] [Google Scholar]
- Landis J, Koch G. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. [PubMed] [Google Scholar]
- Landrine H. Race × class stereotypes of women. Sex Roles. 1985;13(1/2):65–75. [Google Scholar]
- Lefcourt HM, Ladwig GW. The American Negro: A problem in expectancies. Journal of Personality and Social Psychology. 1965;1(4):377–380. doi: 10.1037/h0021867. [DOI] [PubMed] [Google Scholar]
- Lieberman JD. Terror management, illusory correlation, and perceptions of minority groups. Basic and Applied Social Psychology. 1999;21(1):13–23. [Google Scholar]
- Littlewood R, Jadhav S, Ryder AG. A cross-national study of the stigmatization of severe psychiatric illness: historical review, methodological considerations and development of the questionnaire. Transcultural Psychiatry. 2007;44(2):171–202. doi: 10.1177/1363461507077720. doi: 44/2/171 [pii]10.1177/1363461507077720. [DOI] [PubMed] [Google Scholar]
- Lopez S, Hernandez P. How culture is considered in evaluations of psychopathology. Journal of Nervous and Mental Disease. 1986;174(10):598–606. [PubMed] [Google Scholar]
- Lopez S, Nunez JA. Cultural factors considered in selected diagnostic criteria and interview schedules. Journal of Abnormal Psychology. 1987;96(3):270–272. doi: 10.1037//0021-843x.96.3.270. [DOI] [PubMed] [Google Scholar]
- Madriz EI. Images of criminals and victims: A study on women's fear and social control. Gender & Society. 1997;11(3):342–356. [Google Scholar]
- Malgady RG. The question of cultural bias in assessment and diagnosis of ethnic minority clients: Let's reject the null hypothesis. Professional Psychology, Research & Practice. 1996;27(1):73–77. [Google Scholar]
- Manson SM. Culture and major depression: Current challenges in the diagnosis of mood disorders. Psychiatric Clinics of North America. 1995;18:487–501. [PubMed] [Google Scholar]
- Miles MB, Huberman AM. Qualitative data analysis: An expanded sourcebook (2nd ed.) Thousand Oaks, CA: Sage; 1994. [Google Scholar]
- Neal AM, Turner SM. Anxiety disorders research with African Americans: Current status. Psychological Bulletin. 1991;109(3):400–410. doi: 10.1037/0033-2909.109.3.400. [DOI] [PubMed] [Google Scholar]
- Neighbors HW, Jackson JS, Broman C, Thompson E. Racism and the mental health of African Americans: the role of self and system blame. Ethnicity & Disease. 1996;6:167–175. [PubMed] [Google Scholar]
- Neighbors HW, Williams DR. The epidemiology of mental disorders among African Americans: 1985 to 2000. In: Braithwaite RL, Taylor SE, editors. Health Issues in the Black Community. San Francisco, CA: Jossey-Bass; 2000. pp. 99–128. [Google Scholar]
- Okazaki S, Sue S. Methodological issues in assessment research with ethnic minorities. Psychological Assessment. 1995;7(3):367–375. [Google Scholar]
- Oksenberg L, Cannell C, Kalton G. New strategies for pretesting survey questions. Journal of Official Statistics. 1991;7:349–365. [Google Scholar]
- Paisley WJ. Studying "style" as a deviation from encoding norms. In: Gerbner G, Hosti OR, Krippendorff K, Paisley WJ, Stone PJ, editors. The analysis of communication content: development on scientific theories and computer techniques. New York: Wiley; 1969. [Google Scholar]
- Patton M. Qualitative Research & Evaluation Methods. 3rd. Thousand Oaks, CA: Sage Publications; 2002. [Google Scholar]
- Pearlin LI. The sociological study of stress. Journal of Health and Social Behavior. 1989;30(3):241–256. [PubMed] [Google Scholar]
- Plaud JJ, Vavrovsky KG. Specific and social phobias. In: Wodarski JS, Thyer BA, editors. Handbook of empirical social work practice. New York: Wiley & Sons; 1998. pp. 327–342. [Google Scholar]
- Robins LN, Helzer JE, Weissman MM, Orvaschel H, Gruenberg E, Burke JD, Jr, Regier DA. Lifetime prevalence of specific psychiatric disorders in three sites. Archives of General Psychiatry. 1984;41:949–958. doi: 10.1001/archpsyc.1984.01790210031005. [DOI] [PubMed] [Google Scholar]
- Robins LN, Regier D. Lifetime prevalence of specific psychiatric disorders in three sites. Archives of General Psychiatry. 1984;41(10):949–958. doi: 10.1001/archpsyc.1984.01790210031005. [DOI] [PubMed] [Google Scholar]
- Robins LN, Wing J, Wittchen HU, Helzer JE. The Composite International Diagnostic Interview: An epidemiologic instrument for use in conjunction with different diagnostic systems and in different cultures. Archives of General Psychiatry. 1988;45(12):1069–1077. doi: 10.1001/archpsyc.1988.01800360017003. [DOI] [PubMed] [Google Scholar]
- Rogler LH. The meaning of culturally sensitive research in mental health. American Journal of Psychiatry. 1989;146(3):296–303. doi: 10.1176/ajp.146.3.296. [DOI] [PubMed] [Google Scholar]
- Rogler LH. Culture in psychiatric diagnosis: An issue of scientific accuracy. Psychiatry. 1993;56(4):324–327. [PubMed] [Google Scholar]
- Rogler LH, Cortes DE, Malgady RG. The mental health relevance of idioms of distress: Anger and perceptions of injustice among New York Puerto Ricans. Journal of Nervous and Mental Disease. 1994;182(6):327–330. doi: 10.1097/00005053-199406000-00003. [DOI] [PubMed] [Google Scholar]
- Sabshin M, Diesenhaus H, Wilkerson R. Dimensions of institutional racism in psychiatry. American Journal of Psychology. 1970;127(6):787–793. doi: 10.1176/ajp.127.6.787. [DOI] [PubMed] [Google Scholar]
- Schechter S, Herrmann D. The proper use of self-report questions in effective measurement of health outcomes. Evaluation & the Health Professions. 1997;20(1):28–46. doi: 10.1177/016327879702000103. [DOI] [PubMed] [Google Scholar]
- Schwab JJ, Bell RA, Warheit GJ, Schwab RB. Social order and mental health. New York: Bruner/Mazel; 1979. [Google Scholar]
- Sennett R, Cobb J. The hidden injuries of class. New York: Vintage Books; 1973. [Google Scholar]
- Sigelman L, Welch S. The contact hypothesis revisited: Black White interaction and positive racial attitudes. Social Forces. 1993;71(3):781–795. [Google Scholar]
- Strauss A, Corbin JM. Basics of qualitative research: Grounded theory procedures and techniques. Thousand Oaks, CA: Sage; 1990. [Google Scholar]
- Strickland BR. Internal-external control expectancies: From contingency to creativity. American Psychologist. 1989;44(1):1–12. [Google Scholar]
- Sue S, Fujino DC, Hu L, Takeuchi D. Community mental health services for ethnic minority groups: A test of the cultural responsiveness hypothesis. Journal of Consulting and Clinical Psychology. 1991;59(4):533–540. doi: 10.1037//0022-006x.59.4.533. [DOI] [PubMed] [Google Scholar]
- Swartz MS, Wagner HR, Swanson JW, Burns BJ, George LK, Padgett DK. Administrative update: utilization of services. I. Comparing use of public and private mental health services: the enduring barriers of race and age. [Research Support, U.S. Gov't, P.H.S.] Community Ment Health J. 1998;34(2):133–144. doi: 10.1023/a:1018736917761. [DOI] [PubMed] [Google Scholar]
- Turner RJ, Wheaton B, Lloyd DA. The epidemiology of social stress. American Sociological Review. 1995;60(1):104–125. [Google Scholar]
- U.S. Public Health Service. Mental Health: Culture, Race, and Ethnicity-A Supplement to Mental Health: A Report of the Surgeon General. Rockville, MD: 2001. [PubMed] [Google Scholar]
- Vega WA, Rumbaut RG. Ethnic minorities and mental health. Annual Review of Sociology. 1991;17(351–384) [Google Scholar]
- Vines AI, Baird DD. Stress of caring for children: the role of perceived racism. Journal of the National Medical Association. 2009;101(2):156–160. doi: 10.1016/s0027-9684(15)30829-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang PS, Berglund P, Olfson M, Pincus HA, Wells KB, Kessler RC. Failure and delay in initial treatment contact after first onset of mental disorders in the National Comorbidity Survey Replication. [Comparative Study Research Support, N.I.H., Extramural Research Support, Non-U.S. Gov't Research Support, U.S., Gov't P.H.S.] Arch Gen Psychiatry. 2005;62(6):603–613. doi: 10.1001/archpsyc.62.6.603. [DOI] [PubMed] [Google Scholar]
- Warheit GJ, Holzer CE, Arey SA. Race and mental illness: An epidemiologic update. Journal of Health and Social Behavior. 1975;16(3):243–256. [PubMed] [Google Scholar]
- Warnecke RB, Johnson T, Chavez N, Sudman S, O'Rourke D, Lacey L, Horm J. Improving question wording in surveys of culturally diverse populations. Annual Epidemiology. 1997;7:334–342. doi: 10.1016/s1047-2797(97)00030-6. [DOI] [PubMed] [Google Scholar]
- Wenzel SL. Gender, ethnic group, and homelessness as predictors of locus of control among job training participants. Journal of Social Psychology. 1993;133(4):495–505. doi: 10.1080/00224545.1993.9712174. [DOI] [PubMed] [Google Scholar]
- Williams DR. African American Mental Health: Persisting Questions and Paradoxical Findings. Perspectives. 1995;2(1) [Google Scholar]
- Williams DR, Harris-Reid M. Race and mental health: Emerging patterns and promising approaches. In: Horwitz AV, Scheid TL, editors. A handbook for the study of mental health: Social contexts, theories, and systems. New York: Cambridge University Press; 1999. pp. 295–314. [Google Scholar]
- Willis G, DeMaio T, Harris-Kojetin B. Is the Bandwagon Headed to the Methodological Promised Land? Evaluation of the Validity of Cognitive Interviewing Techniques. In: Sirken M, Herrmann D, Schechter S, Schwarz J, Tanur N, Tourangeau R, editors. Cognition and Survey Research. New York: Wiley; 1999. [Google Scholar]
- Willis GB, Royston P, Bercini D. The use of verbal report methods in the development and testing of survey questionnaires. Applied Cognitive Psychology. 1991;5:251–267. [Google Scholar]
- World Health Organization. Composite International Diagnostic Review (CIDI, Version 1.0) Geneva, Switzerland Washington, DC, US: American Psychiatric Press, Inc; 1990. [Google Scholar]
- Young VD. Gender expectations and their impact on black female offenders and victims. Justice Quarterly. 1986;3(3):305–327. [Google Scholar]
- Zhang AY, Snowden LR. Ethnic characteristics of mental disorders in five U.S. communities. Cultural Diversity & Ethnic Minority Psychology. 1999;5(2):134–146. doi: 10.1037/1099-9809.5.2.134. [DOI] [PubMed] [Google Scholar]
