Abstract
Introduction
Hazardous drinking is characterized by decisions to engage in excessive or risky patterns of alcohol consumption. Levels of impulsivity and behavioral approach and inhibition may differ in hazardous drinkers and nonhazardous drinkers. A comparison of the relative levels of dimensions of impulsivity and behavioral inhibition and approach in adult men and women hazardous and nonhazardous drinkers may inform treatment and prevention efforts.
Methods
In the present research, 466 men and women from a community sample were administered the Alcohol Use Disorders Identification Test (AUDIT), the Behavioral Inhibition System/Behavioral Approach System (BIS/BAS) Scale, and the Barratt Impulsiveness Scale, version 11 (BIS-11). Relations among the dimensions of these constructs were examined using Multivariate Analysis of Covariance (MANCOVA), with age and race as covariates.
Results
There were main effects of hazardous drinking on all three dimensions of impulsivity, the behavioral inhibition system, and the behavioral activation system Reward-Responsiveness, and Fun-Seeking components, with hazardous drinkers scoring higher than non-hazardous drinkers.
Conclusion
This research provides a better understanding of the manner in which impulsivity and behavioral inhibition and approach tendencies relate to hazardous alcohol use in men and women. The present results have implications for alcohol-related prevention and treatment strategies for adult men and women.
Keywords: impulsivity, behavioral approach, behavioral inhibition, hazardous drinking, sex
Introduction
Hazardous alcohol use is associated with many public health problems (Room et al., 2005), and can be considered in the broader framework of risk-taking (Fergusson and Lynskey, 1996; Fernie et al., in press; Stein et al., 2005) and poor decision-making (Goudriaan et al., 2007; Hildebrandt et al., 2008). Impulsivity reflects a tendency for rapid action with diminished regard for future consequences (Moeller et al., 2001). The psychological construct behavioral approach is characterized by appetitive, goal-oriented functioning and positive affect, while behavioral inhibition is characterized by inhibition in response to aversive stimuli (Gray, 1972). Impulsivity (Lejuez et al., 2010; MacKillop et al., 2007) and behavioral approach (Franken and Muris, 2006; Hundt et al., 2008; O'Connor et al., 2009) are separate but related constructs that each are positively associated with alcohol consumption. The present research was conducted to compare dimensions of impulsivity and behavioral inhibition system and behavioral approach system sensitivity in hazardous and nonhazardous-drinking adult men and women, and to determine which of these psychological factors are associated the most strongly with hazardous drinking.
The association of impulsivity with alcohol consumption has been reported in both human and animal research (Lejuez et al., 2010; Poulos et al., 1995). In rodents, amount of alcohol consumption has been associated with level of impulsivity on a behavioral task (Poulos et al., 1995). In humans, impulsivity has been associated with multiple stages of alcohol use: initiation of alcohol use, current use, early indicators of alcohol problems and alcohol abuse (Lejuez et al., 2010). Impulsivity, as measured by the Barratt Impulsiveness Scale, version-11 (BIS-11), is comprised of three dimensions: attentional, non-planning, and motor impulsivity (Patton et al., 1995). Stanford and colleagues (2009) conducted an extensive review of research with the BIS-11 and noted the value of assessing impulsivity with the BIS-11 subscales, an approach that was used in the present research (Stanford et al., 2009).
The three dimensions of impulsivity may be differentially associated with hazardous drinking. Although there were no differences in previous research between men and women or binge drinkers and non-binge drinkers on the three dimensions of impulsivity in an undergraduate sample, differential associations emerged between dimensions of impulsivity and various indicators of hazardous alcohol use (Balodis et al., 2009). Specifically, motor impulsivity and attentional impulsivity correlated with number of drinks per drinking occasion, and attentional impulsivity correlated with the length of drinking occasions. In a community sample of adult men and women, all three dimensions of impulsivity (non-planning, attentional, and motor impulsivity), as well as overall impulsivity, were independently predictive of alcohol consumption (Fox et al., 2010). There may be differences in the extent to which hazardous drinking associates with the various dimensions of impulsivity in the present community sample of adult men and women.
Related to impulsivity (Meda et al., 2009), the behavioral approach system is a reward-sensitive neural system thought to mediate appetitive, goal-oriented functioning and positive affect, while the behavioral inhibition system subserves inhibition in response to aversive stimuli and is implicated in punishment sensitivity. Historically, high behavioral approach system activation was thought to underlie impulsivity (Fowles, 1987; Gray, 1982). However, recent research has revealed that behavioral approach system activation and impulsivity as measured by the BIS-11 are separate but related constructs (Meda et al., 2009; Quilty and Oakman, 2004). Impulsivity has been reported to partially mediate the relationship between behavioral inhibition system and behavioral approach system activation and health risk behaviors (Braddock et al., 2011).
Carver and White (1994) identified three behavioral approach system dimensions (Drive, Reward Responsiveness, and Fun-Seeking) in their study of the behavioral inhibition system and behavioral approach system. High behavioral approach system sensitivity, as indicated by higher scores on the behavioral approach system measures, was associated with alcohol misuse and abuse (Hundt et al., 2008). The Fun-Seeking dimension of the behavioral approach system was associated with alcohol use (Loxton and Dawe, 2001; O'Connor et al., 2009; Voigt et al., 2009), risky alcohol consumption (Franken and Muris, 2006; O'Connor et al., 2009), and longtime alcohol abuse (Johnson et al., 2008). The Drive dimension was strongly associated with alcohol use in a sample of teenage girls (Loxton and Dawe, 2001). In heavy drinkers, higher Reward Responsiveness was associated with increased reactivity to an alcohol cue (Kambouropoulus and Staiger, 2001). Previous research has shown that behavioral inhibition system activation tends either to be negatively correlated with alcohol use (Franken and Muris, 2006; Loxton and Dawe, 2001) or not to be associated with alcohol use (O'Connor et al., 2009; Voigt et al., 2009), suggesting that if behavioral inhibition system sensitivity, as indicated by higher scores on the behavioral inhibition system measure, is implicated in alcohol use, it may serve a protective role against hazardous drinking. While the influence of behavioral inhibition system and behavioral approach system dimensions on hazardous alcohol use has been described, the relative associations of behavioral inhibition system and behavioral approach system dimensions and impulsivity dimensions with hazardous drinking have not been previously compared.
Gender differences have been noted in addictive processes, including drinking behavior (Holmila and Raitasalo, 2005; Livingston and Room, 2009; Wilsnack et al., 2000). While similar levels of impulsivity in men and women have been reported (Patton et al., 1995), research investigating the association between impulsivity and drinking behavior has been mixed with respect to sex differences. Similar relationships of impulsivity and drinking behavior have been reported in undergraduate men and women (Balodis et al., 2009), although other data indicate that sex moderates the association between impulsivity and alcohol use in an undergraduate sample, with a stronger association between impulsivity and alcohol use occurring in men than women (Stoltenberg et al., 2008). Research also is mixed with respect to sex differences in behavioral inhibition system and behavioral approach system sensitivity. There were sex differences in one of four experiments included in a research paper (Carver and White, 1994), with men having lower levels of behavioral inhibition system activation and Reward Responsiveness than women. A direct comparison of the levels of different dimensions of impulsivity and behavioral inhibition and approach in hazardous- and non-hazardous-drinking men and women would aid prevention and treatment development efforts.
In the present research, levels of impulsivity dimensions and theoretically related, yet distinct, behavioral inhibition system and behavioral approach system dimensions were compared in hazardous-drinking and non-hazardous-drinking adult men and women to more fully characterize the relationship between hazardous drinking and psychological factors. In addition, levels of the dimensions of impulsivity and behavioral approach and inhibition were directly compared in hazardous and non-hazardous-drinking adult men and women to determine which psychological constructs differ the most between hazardous and non-hazardous drinkers. It was hypothesized in the present research that attentional impulsivity, motor impulsivity, and non-planning impulsivity, as well as behavioral activation systems measures of Drive, Fun-Seeking, and Reward Responsiveness, would be higher in adult hazardous drinkers than in adult non-hazardous drinkers, and that behavioral inhibition system sensitivity would be lower in adult hazardous drinkers than in adult non-hazardous drinkers. Lastly, because human and animal research has demonstrated that impulsivity is strongly linked to alcohol consumption (Belin, 2008; Dalley et al., 2011; Lejuez et al., 2010; Poulos et al., 1995), it was hypothesized that differences between adult hazardous and non-hazardous-drinkers would be stronger with respect to impulsivity dimensions than behavioral inhibition system and behavioral approach system dimensions.
Methods
Participants
446 participants (240 female, 206 male) were recruited from the New Haven, CT area by advertisements in local newspapers or online. A community sample was recruited to assess history of psychiatric, psychosocial and addictive behaviors and measures of impulsivity and self-control. This included psychiatric data using the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID) (First et al., 1997) and assessment of quantity/frequency of licit drug use. Eligibility for the study was determined in an initial phone screen. In order to be eligible for the study, participants were required to be aged between 18 and 50 years and able to read and write in English to at least a sixth-grade level. With the exception of nicotine and alcohol use disorders, study exclusion criteria included meeting current diagnostic criteria for a DSM-IV-TR (American Psychiatric Association, 2000) psychiatric disorder or substance dependence as determined by the SCID. However, any participant requiring alcohol detoxification was excluded from the study. Individuals currently using prescription opiates, methadone, and medications for other acute or chronic psychiatric or medical conditions also were excluded. All participants gave written informed consent, and the study was approved by the Human Investigation Committee of the Yale University School of Medicine.
Procedure
After the initial phone screening to determine eligibility, participants were scheduled for assessment and evaluation at the Yale Stress Center. Participants completed basic demographic questionnaires and assessments of alcohol use (Alcohol Use Disorders Test - AUDIT), behavioral inhibition and approach (BIS/BAS), and impulsivity (BIS-11). Participants were administered breath alcohol testing and urine toxicology screens to verify self-reported alcohol and drug use information.
Assessments
Alcohol Use Disorders Test (AUDIT; Babor et al., 2001)
Hazardous drinking was assessed using the Alcohol Use Disorders Test (AUDIT). The AUDIT is a 10-item screening instrument that identifies drinking behaviors and distinguishes between low-risk drinkers and individuals with hazardous or risky patterns of alcohol use. In the AUDIT screen, individuals endorse one of five responses (i.e., 0 =Never, 1 = Less than Monthly, 2 = Monthly, 3 = Weekly, 4 = Daily or Almost Daily) to items such as, “How often during the last year have you been unable to remember what happened the night before because you had been drinking?” The AUDIT accurately assesses severity of problematic alcohol use behaviors across age, sex, and cultures (Allen et al., 1997). Women with an AUDIT score of 4 or greater and men with an AUDIT score of 8 or greater were categorized as hazardous drinkers in the present research (Babor et al., 2001; Bradley et al., 1998; Reinhert and Allen, 2002; von der Pahlen et al., 2008). AUDIT score was dichotomized into hazardous drinking and non-hazardous drinking in order to determine psychological factors associated with hazardous drinking using Multivariate Analyses of Covariance (MANCOVA). AUDIT scores have been correlated with those on the Michigan Alcohol Screening Test (MAST) (Bohn et al., 1995) and the CAGE alcohol screening instrument (Hays et al., 1995) as well as with future indicators of alcohol-related problems (Claussen and Aasland, 1993). The AUDIT has high test-retest reliability (Daeppen et al., 2000) and internal consistency reliability (Ivis et al., 2000).
Barratt Impulsiveness Scale (BIS-11; Patton et al., 1995)
The BIS-11 is a 30-item self-report questionnaire that assesses impulsivity and shows good test-retest reliability (Patton et al., 1995). In the BIS-11, participants endorse a response on the four-point Likert-like scales (1 = Rarely/Never, 2 = Occasionally, 3 = Often, 4 = Almost Always/Always) in response to each of 30 items (e.g., “I say things without thinking”). The three dimensions of impulsivity are assessed by subscales: attentional impulsivity, motor impulsivity, and non-planning impulsivity. The attentional impulsivity subscale measures tendencies related to attention and decision-making, the motor impulsivity subscale measures tendencies to act without fully thinking through consequences of the action, and the non-planning impulsivity subscale measures tendencies not to plan ahead. The three BIS-11 dimensions are non-overlapping and demonstrate good reliability (Spinella, 2007). The BIS-11 is widely used in research and clinical settings, and elevated scores are typically observed in individuals with disorders with deficits in impulse control as a component, including substance abuse (Lejuez et al., 2007).
Behavioral Inhibition System/Behavioral Approach System (BIS/BAS) Scale (Carver and White, 1994)
The BIS/BAS scale measures behavioral inhibition and behavioral approach (Gray, 1972; Gray, 1981). The measure consists of 24 statements regarding behavioral style (e.g., “When I get something I want, I feel excited and energized”) with which the participant may indicate agreement or disagreement using a Likert-style scale (1 = Strongly Disagree, 2 = Disagree, 3 = Neutral, 4 = Agree, and 5 = Strongly Agree). The BIS/BAS scale is both reliable and valid (Carver and White, 1994; Jorm et al., 1998). The four dimensions of the BIS/BAS scale are behavioral inhibition system, Reward Responsiveness, Drive, and Fun-Seeking. The behavioral inhibition system subscale measures inhibition in response to aversive stimuli, while the behavioral activation system-related subscales assess aspects of behavioral approach. Specifically, the Reward-Responsiveness subscale measures positive responses to anticipated or granted rewards, the Drive subscale measures the pursuit of goals, and the Fun-Seeking subscale measures the spontaneous approach of potential rewards and a desire for new rewards (Carver and White, 1994).
Data Analytic Strategy
All analyses were conducted using SPSS (version 16.0, SPSS Inc.), and the MANCOVA analysis was conducted using a Bonferroni correction. First, chi-square analyses were conducted to investigate differences between male and female participants on sociodemographic variables. Then, to address hypotheses about levels of impulsivity and behavioral approach and inhibition dimensions in hazardous and non-hazardous-drinking men and women, the variables were examined using a MANCOVA, with age and race as covariates. Race was used as a covariate because the number of African American women in our sample differed significantly from the number of African American men, and the number of men and women also differed significantly among people categorized as “Other.” Age was used as a covariate because associations of impulsivity and alcohol use tend to change with age (Littlefield et al., 2010). These analyses were conducted to determine which psychological factors were associated with hazardous alcohol use. While hazardous drinking was categorized by cut-off scores that were thresholded differently for men and women (Babor et al., 2001; Bradley et al., 1998; von der Pahlen et al., 2008), a common AUDIT cut-off score of 8 also has been used to identify hazardous drinking in previous research (Allen et al., 1997; Conigrave et al., 1995; Steinbauer et al., 1998). In addition to using AUDIT score cut-offs that were tailored to men and women, a MANCOVA also was conducted using a common cut-off score of 8 for men and women to determine whether any effects observed resulted from differential score treatment.
Results
Demographics
Demographic, psychological and alcohol-related variables are reported (Table 1). There were sex differences in race/ethnicity, with more women than men who were African American and classified as “Other,” a category which included individuals of Hispanic, Asian, and multi-racial origins.
Table 1.
Women (N = 240) | Men (N = 206) | |
---|---|---|
Age (mean yrs. (S.D.)) | 30.0 (9.42) | 29.96 (8.96) |
Education (mean yrs. (S.D.)) | 14.86 (2.28) | 14.91 (2.22) |
Gender (n (%)) | 240 (53.81%) | 206 (46.19%) |
Race/ethnicity (n (%)) | ||
African Americana | 62 (25.83%) | 38 (18.45%) |
Caucasian | 144 (60.0%) | 150 (72.82%) |
Othera | 34 (14.2%) | 18 (8.73%) |
Psychological Factors (mean (S.D.)) | ||
BIS-11 total | 61.39 (12.15) | 62.06 (11.35) |
Nonplanning | 23.25 (5.42) | 23.43 (5.06) |
Attentional | 17.04 (4.879) | 16.86 (4.33) |
Motor | 21.17 (4.54) | 21.76 (4.24) |
BISb | 20.34 (3.74) | 18.01 (3.67) |
BAS | 38.82 (5.70) | 38.80 (5.70) |
Reward Responsivenessb | 17.58 (2.39) | 16.70 (2.36) |
Drive | 11.07 (2.54) | 10.75 (2.47) |
Fun Seeking | 11.17 (2.38) | 11.35 (2.31) |
Alcohol-Related Characteristics (mean (S.D.)) | ||
AUDIT scoreb | 5.67 (6.72) | 8.64 (7.55) |
Drinking days in past monthb | 5.63 (6.68) | 9.04 (8.10) |
Consumption in past monthc2 | 23.53 (61.54) | 56.30 (121.72) |
Drinking Category (n (%))1 | ||
Hazardous | 56 (23.3%) | 95 (46.1%) |
Non-Hazardous | 184 (76.7%) | 111 (53.9%) |
Alcohol dependence (n (%)) | 14 (5.8%) | 17 (8.3%) |
sex difference at p < 0.050 in a Chi Square Test
sex difference at p < 0.001 in a t-test
sex difference at p < 0.010 in a t-test
AUDIT hazardous cutoff score = 8
number of alcoholic beverages
BIS = Behavioral Inhibition System, BAS = Behavioral Approach System, AUDIT = Alcohol Use Disorders Identification Test
Factors associated with hazardous drinking and sex
There were main effects of hazardous drinking on attentional [F(1,440) = 27.10, p < 0.001, η2 = 0.06], motor [F(1,440) = 32.91, p < 0.001, η2 = 0.07], and non-planning [F(1,440) = 17.62, p < 0.001, η2 = 0.04] impulsivity, with hazardous-drinkers having higher scores than nonhazardous-drinkers on each of the dimensions of impulsivity (Figure 1, Table 2). There also were main effects of hazardous drinking on activation of behavioral inhibition [F(1,440) = 11.99, p < 0.001, η2 = 0.03], Reward Responsiveness [F(1,440) = 7.28, p < 0.01, η2 = 0.02], and Fun-Seeking [F(1,440) = 28.90, p < 0.001, η2 = 0.07], with hazardous drinkers having higher scores than non-hazardous drinkers on the behavioral inhibition system, Reward Responsiveness, and Fun-Seeking subscales. Hazardous drinkers did not differ significantly from non-hazardous drinkers on Drive activation [F(1,440) = 4.31, p = 0.04, η2 = 0.01] after the Bonferroni correction. Results are collapsed across sex in Figure 1 because there was no main effect of sex on dimensions of impulsivity.
Table 2.
Main effect of hazardous drinking: | |||
---|---|---|---|
F statistic | p value | partial η2 | |
Attentional Impulsivity | 27.10 | < 0.001 | 0.06 |
Motor Impulsivity | 32.91 | < 0.001 | 0.07 |
Nonplanning Impulsivity | 17.62 | < 0.001 | 0.04 |
BIS | 11.99 | < 0.001 | 0.03 |
Drive | 4.31 | 0.04 | 0.01 |
Fun-Seeking | 28.90 | < 0.001 | 0.07 |
Reward Responsiveness | 7.28 | < 0.01 | 0.02 |
Main effect of sex: | |||
F statistic | p value | partial η2 | |
Attentional Impulsivity | 0.00 | 0.97 | 0.00 |
Motor Impulsivity | 2.76 | 0.10 | 0.01 |
Nonplanning Impulsivity | 0.47 | 0.50 | 0.00 |
BIS | 41.34 | < 0.001 | 0.09 |
BAS Drive | 0.82 | 0.37 | 0.00 |
Fun-Seeking | 1.07 | 0.30 | 0.00 |
Reward Responsiveness | 13.64 | < 0.001 | 0.03 |
Hazardous drinking × sex interaction: | |||
F statistic | p value | partial η2 | |
Attentional Impulsivity | 0.03 | 0.87 | 0.00 |
Motor Impulsivity | 1.29 | 0.26 | 0.00 |
Nonplanning Impulsivity | 0.29 | 0.59 | 0.00 |
BIS | 0.47 | 0.50 | 0.00 |
Drive | 0.20 | 0.66 | 0.00 |
Fun-Seeking | 0.05 | 0.83 | 0.00 |
Reward Responsiveness | 0.13 | 0.72 | 0.00 |
There were main effects of sex on behavioral inhibition [F(1,440) = 41.34, p < 0.001, η2 = 0.09] and Reward Responsiveness [F(1,440) = 13.64, p < 0.001, η2 = 0.03], with women having higher behavioral inhibition system and Reward Responsiveness scores than men (Figure 2, Table 2). There were no effects of sex on attentional impulsivity [F(1,440) = 0.00, p = 0.97, η2 = 0.00], motor impulsivity [F(1,440) = 2.76, p = 0.10, η2 = 0.01], non-planning impulsivity [F(1,440) = 0.47, p = 0.50, , η2 = 0.00], BAS Drive [F(1,440) = 0.82, p = 0.37, η2 = 0.00], and Fun-Seeking [F(1,440) = 1.07, p = 0.30, η2 = 0.00]. Results are presented by sex in Figure 2 because there were main effects of sex on behavioral inhibition and Reward Responsiveness.
There were no interactions of hazardous drinking and sex on attentional impulsivity [F(1,440) = 0.03, p = 0.87, η2 = 0.00], motor impulsivity [F(1,440) = 1.29, p = 0.26, η2 = 0.00], non-planning impulsivity [F(1,440) = 0.29, p = 0.59, η2 = 0.00], behavioral inhibition system [F(1,440) = 0.47, p = 0.50, η2 = 0.00], Drive [F(1,440) = 0.20, p = 0.66, η2 = 0.00], Fun-Seeking [F(1,440) = 0.05, p = 0.83, η2 = 0.00], and Reward Responsiveness [F(1,440) = 0.13, p = 0.72, η2 = 0.00].
A MANCOVA with age and race as covariates also was conducted using a common AUDIT cut-off score of 8 to identify hazardous drinking in both men and women. When using a cut-off score of 8, the effects were the same as when the cut-off score that was tailored to sex was used, except that the main effect of hazardous drinking on Reward Responsiveness activation was no longer significant [F(1,440) = 3.045, p = 0.08, η2 = 0.01].
Discussion
Levels of impulsivity and behavioral approach and inhibition were investigated in a community sample of adult social drinkers that included both hazardous and non-hazardous drinkers. There were several hypotheses. First, it was hypothesized that the three dimensions of impulsivity would be higher in hazardous drinkers than in non-hazardous drinkers. Second, it was hypothesized that in hazardous drinkers versus non-hazardous drinkers, behavioral inhibition would be lower and the three behavioral approach dimensions would be higher. Lastly, it was hypothesized that differences between hazardous and non-hazardous-drinkers would be stronger with respect to impulsivity dimensions than behavioral inhibition system and behavioral approach system dimensions. Overall, the present research had several principle findings. Hazardous drinkers had higher levels of all three dimensions of impulsivity (attentional, non-planning, and motor impulsivity), behavioral inhibition, and two of the behavioral approach dimensions (Reward Responsiveness and Fun-Seeking) than did non-hazardous drinkers. Additionally, hazardous drinking was more strongly associated with dimensions of impulsivity than dimensions of behavioral approach and inhibition. Each of the major findings and its implications is discussed below.
Hazardous drinking and dimensions of impulsivity, behavioral inhibition, and behavioral approach
The higher levels of attentional, non-planning, and motor impulsivity in hazardous drinkers than in nonhazardous-drinkers found in the present research support our a priori hypothesis and are consistent with previous research (Balodis et al., 2009; Fox et al., 2010). Higher levels of Reward Responsiveness and Fun-Seeking in hazardous drinkers than in non-hazardous drinkers also support our a priori hypothesis and are consistent with previous research (Loxton and Dawe, 2001; O'Connor et al., 2009; Voigt et al., 2009). However, the positive relationship between hazardous drinking and behavioral inhibition system sensitivity reported in the present research is inconsistent with the hypothesized effect and with previous reports (Franken and Muris, 2006; Loxton and Dawe, 2001). The divergence may be accounted for by differences in sample characteristics. The present research was based on results from an adult community sample with a mean age of 30 years that was evenly divided between men and women. Research reporting no association of behavioral inhibition system sensitivity with alcohol use was based on results from younger, undergraduate samples (O’Connor et al., 2009; Voigt et al., 2009), while research reporting a negative association of behavioral inhibition system sensitivity with alcohol use was based on a predominantly female sample of undergraduates (Franken and Murris, 2006) and an entirely female sample of adolescents (Loxton and Dawe, 2001). Therefore, the fact that our study used an older sample from the community could suggest that associations between behavioral inhibition system activation and alcohol use may depend on age, sex, and education-related characteristics, and that a positive association between behavioral inhibition system activation and alcohol use may emerge during adulthood. The positive relationship of behavioral inhibition system activation and hazardous-drinking reported in the present research may result from increased drinking to relieve anxiety associated with heightened punishment sensitivity (Khantzian et al., 1974), or alternatively, it could result from increased anxiety resulting from hazardous drinking. In addition, the absence of an effect of hazardous drinking on Drive activation was inconsistent with the hypothesis and with previous research (Loxton and Dawe, 2001), and also may result from age and sex differences.
Sex differences
The finding that women had higher scores than men on behavioral inhibition and Reward Responsiveness replicates the research of Carver and White (1994) in which sex differences in the same direction were reported on those dimensions. Greater behavioral approach and inhibition in women than men has implications for multiple behaviors that are influenced by behavioral inhibition system and behavioral approach system sensitivity, including problematic alcohol use (Hundt et al., 2008; Loxton and Dawe, 2001; Voigt et al., 2009). For example, with respect to risky alcohol use, women’s greater emotional responsiveness to rewarding and aversive stimuli may contribute to hazardous drinking in women.
When using the common AUDIT cut-off score of 8, the effect of hazardous drinking on BAS Reward Responsiveness became a non-significant trend, suggesting that this factor continued to contribute to hazardous drinking when the common cut-off score was used, although the contribution was somewhat diminished. All other reported effects remained the same when using the common AUDIT cut-off score. When using the tailored AUDIT hazardous-drinking cut-off scores of 4 for women and 8 for men, there were no sex differences in hazardous drinking, which is consistent with reports of similar levels of problematic alcohol use in men and women in recent years that may be attributable to increased drinking in women (Keyes et al., 2008). However, there also have been reports of more hazardous drinking in men than women (Holmila and Raitasalo, 2005; Livingston and Room, 2009; Wilsnack et al., 2000). When the common AUDIT hazardous-drinking cutoff score of 8 for both men and women was used in the present research, there was a sex difference in hazardous drinking, with more men than women engaging in hazardous drinking. Less behavioral inhibition system and BAS Reward Responsiveness in men than women may increase their risk for hazardous alcohol drinking. It is possible that more men are hazardous drinkers than women because they are less sensitive to the aversive aspects of hazardous drinking (i.e., after-effects, social consequences), and they must drink more than women to experience the same amount of reward because they are less sensitive to the rewarding aspects of alcohol consumption. Greater behavioral inhibition system and Reward Responsiveness in women than men may have implications for tailoring treatment and prevention strategies to men and women. Hazardous drinking treatment and prevention strategies for both men and women should focus on impulsivity as well as behavioral inhibition and approach. However, strategies for men may target reduced emotional responsiveness to both pleasant and aversive stimuli and teach alternative coping strategies.
Relative contributions of impulsivity and behavioral inhibition system and behavioral approach system sensitivity to hazardous-drinking
In hazardous drinkers there were elevated scores on most of the dimensions of impulsivity and behavioral approach and inhibition. This is consistent with previous research in which problem drinking was associated with impulsivity (Carlson et al., 2010; Fox et al., 2010) and behavioral approach and inhibition (Hundt et al., 2008; Voigt et al., 2009). However, the present research was the first to consider the joint contribution of impulsivity and behavioral inhibition system and behavioral approach system sensitivity to hazardous drinking in an adult community sample of men and women. When considering the variables together, impulsivity made the largest contribution to problematic alcohol use behavior, supporting our hypothesis. Traditionally, an effect size of η2 = 0.01 is considered small, an effect size of η2 = 0.06 is considered medium, and an effect size above η2 = 1.4 is considered large (Cohen, 1973). Following these guidelines, the effect sizes for the main effect of hazardous drinking on the dimensions of impulsivity were medium (Cohen, 1973), while the effect sizes for the main effect of hazardous drinking on behavioral inhibition system and behavioral approach system dimensions were small (with the exception of the Fun-Seeking effect size, which was medium). Therefore, it appears that impulsivity dimensions differ more in hazardous and non-hazardous drinkers than do behavioral inhibition system and behavioral approach system dimensions.
Implications for treatment and prevention of hazardous-drinking
In addition to revealing higher impulsivity and behavioral approach system dimensions in hazardous drinkers than non-hazardous drinkers, the present research was the first to reveal higher behavioral inhibition system sensitivity in hazardous drinkers than in non-hazardous drinkers. Individuals with high levels of behavioral inhibition may engage in hazardous drinking in response to stress associated with their increased punishment sensitivity (Khantzian et al., 1974; Sinha, 2008). Because impulsivity, behavioral inhibition, and behavioral approach dimensions each were elevated in hazardous drinkers, elevated levels of these psychological factors may be potential risk factors for alcohol problems. Treatment and prevention efforts that are tailored to individuals who have been identified to have high levels of impulsivity, behavioral inhibition, and behavioral approach may be particularly beneficial. For example, additional prevention efforts that teach alternative strategies to manage stress associated with elevated punishment sensitivity may help to reduce hazardous drinking in individuals with high behavioral inhibition system levels. Programs designed to enhance impulse control may help to reduce hazardous drinking in impulsive individuals. In fact, the greater effect of impulsivity dimensions than behavioral inhibition system and behavioral approach system dimensions to be higher in hazardous drinkers suggests that prevention efforts focused to enhance impulse control may be the most beneficial for reducing hazardous drinking.
Limitations, summary, and conclusions
The finding that impulsivity and behavioral approach were elevated in hazardous-drinking men and women is consistent with previous research in which alcohol use was associated with impulsivity (Dawe and Loxton, 2004; Fox et al., 2010; Gullo et al., 2010; Lejuez et al., 2010; MacKillop et al., 2007), behavioral approach system sensitivity (Franken and Muris, 2006; Hundt et al., 2008; Johnson et al., 2008; Loxton and Dawe, 2001; Voigt et al., 2009), and the combination of impulsivity, as assessed by the Impulsive Sensation Seeking scale (Zuckerman et al., 1993) and behavioral approach system sensitivity (Braddock et al., 2011). The present research reinforces the importance of these psychological constructs in hazardous drinking. In addition, the present research extends the literature by comparing impulsivity dimensions (as assessed by the BIS-11) and behavioral inhibition system and behavioral approach system dimensions in hazardous and non-hazardous drinkers to determine which factors have a greater contribution to hazardous drinking.
In the present research, the association of psychological factors, such as impulsivity, on hazardous alcohol use was examined. Strengths of the study include the use of well-validated measures and the assessment of a large community sample of adult men and women. While the present research reveals how dimensions of impulsivity and behavioral approach and inhibition differ in hazardous and non-hazardous drinking men and women, one limitation of the study is that the cross-sectional design does not allow causal relationships to be determined. A longitudinal study may have provided the opportunity to assess whether impulsivity dimensions and increased behavioral approach and inhibition predated hazardous alcohol drinking. Reliance on self-report measures is a second limitation of the present research. Because behavioral measures of impulsivity are not always correlated with self-report measures of impulsivity (Reynolds et al., 2006), future studies should examine behavioral measures of impulsivity to determine whether the relationship between impulsivity and hazardous drinking generalizes to various types of impulsivity. Behavioral and self-report measures of impulsivity may relate differently to important clinical factors like treatment outcome (Krishnan-Sarin et al., 2007). In addition, it is important to note that the present study is limited by the use of a single measure of alcohol use, the AUDIT. However, two additional alcohol-related outcomes, drinks per day and drinking days per week, were included in Table 1 to more fully-characterize the alcohol consumption of the participants. Additional measures of alcohol use (i.e. consumption of alcohol in the laboratory) would have strengthened the study. The validity of self-report measures depends on participants’ ability to accurately characterize their own behavioral styles and patterns of alcohol consumption, as well as their willingness to provide this information. Future research should determine whether there are differences in the extent to which psychological factors, such as impulsivity and behavioral approach and inhibition, associate with other maladaptive behaviors.
Acknowledgments
Support: This work was supported in part by the NIH (T32 DA07238, RL1-AA017539, P20-DA027844, UL1-DE019586, and PL1-DA024859), and the NIH Roadmap for Medical Research Common Fund. The contents of the manuscript are solely the responsibility of the authors and do not necessarily represent the official views of any of the funding agencies.
Footnotes
Disclosures: The authors report that they have no financial conflicts of interest with respect to the content of this manuscript. Dr. Potenza has received financial support or compensation for the following: Dr. Potenza has consulted for and advised Boehringer Ingelheim; has consulted for and has financial interests in Somaxon; has received research support from the National Institutes of Health, Veteran’s Administration, Mohegan Sun Casino, the National Center for Responsible Gaming and its affiliated Institute for Research on Gambling Disorders, and Forest Laboratories, Ortho-McNeil, Oy-Control/Biotie, Psyadon and Glaxo-SmithKline pharmaceuticals; has participated in surveys, mailings or telephone consultations related to drug addiction, impulse control disorders or other health topics; has consulted for law offices and the federal public defender’s office in issues related to impulse control disorders; provides clinical care in the Connecticut Department of Mental Health and Addiction Services Problem Gambling Services Program; has performed grant reviews for the National Institutes of Health and other agencies; has guest-edited journal sections; has given academic lectures in grand rounds, CME events and other clinical or scientific venues; and has generated books or book chapters for publishers of mental health texts.
References
- Allen J, Litten R, Fertig J, Babor T. A review of research on the Alcohol Use Disorders Identification Test (AUDIT) Alcoholism: Clinical and Experimental Research. 1997;21:613–619. [PubMed] [Google Scholar]
- Babor T, Higgins-Biddle J, Saunders J, Monteiro M. Guidelines for use in primary care. 2nd edn. World Health Organization:Department of Mental Health and Substance Dependence; 2001. AUDIT. The Alcohol Use Disorders Identification Test. [Google Scholar]
- Balodis IM, Potenza MN, Olmstead MC. Binge drinking in undergraduates: Relationships with gender, drinking behaviors, impulsivity, and the perceived effects of alcohol. Behavioral Pharmacology. 2009;20(5–6):518–526. doi: 10.1097/FBP.0b013e328330c779. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ. High Impulsivity Predicts the Switch to Compulsive Cocaine-Taking. Science. 2008;320:1352. doi: 10.1126/science.1158136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bohn M, Babor T, Kranzler H. The Alcohol Use Disorders Identification Test (AUDIT): validation of a screening instrument for use in medical settings. Journal of Studies on Alcohol and Drugs. 1995;56:423–432. doi: 10.15288/jsa.1995.56.423. [DOI] [PubMed] [Google Scholar]
- Braddock K, Dillard J, Voigt D, Stephenson M, Sopory P, Anderson J. Impulsivity partially mediates the relationship between BIS/BAS and risky health behaviors. Journal of Personality. 2011;79(4):793–810. doi: 10.1111/j.1467-6494.2011.00699.x. [DOI] [PubMed] [Google Scholar]
- Bradley KA, Boyd-Wickizer J, Powell SH, Burman ML. Alcohol screening questionnaires in women: a critical review. JAMA. 1998;280(2):166–171. doi: 10.1001/jama.280.2.166. [DOI] [PubMed] [Google Scholar]
- Carlson S, Johnson S, Jacobs P. Disinhibited characteristics and binge drinking frequency in university student drinkers. Addictive Behavior. 2010;35(3):242–251. doi: 10.1016/j.addbeh.2009.10.020. [DOI] [PubMed] [Google Scholar]
- Carver C, White T. Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS scales. Journal of Personality and Social Psychology. 1994;67(2):319–333. [Google Scholar]
- Claussen B, Aasland O. The Alcohol Use Disorders Identification Test (AUDIT) in a routine health examination of long-term unemployed. Addiction. 1993;88:363–368. doi: 10.1111/j.1360-0443.1993.tb00823.x. [DOI] [PubMed] [Google Scholar]
- Cohen J. Eta-squared and partial eta-squared in fixed factor ANOVA designs. Educational and Psychological Measurement. 1973;33:107–112. [Google Scholar]
- Conigrave KM, Hall WD, Saunders JB. The AUDIT questionnaire: choosing a cut-off score. Alcohol Use Disorder Identification Test. Addiction. 1995;90(10):1349–1356. doi: 10.1046/j.1360-0443.1995.901013496.x. [DOI] [PubMed] [Google Scholar]
- Daeppen J, Yersin B, Landry U, Pecoud A, Decrey H. Reliability and validity of the Alcohol Use Disorders Identification Test (AUDIT) imbedded within a general health risk screening questionnaire: results of a survey in 332 primary care patients. Alcoholism: Clinical and Experimental Research. 2000;24:659–665. [PubMed] [Google Scholar]
- Dalley JW, Everitt BJ, Robbins TW. Impulsivity, compulsivity, and top-down cognitive control. Neuron. 2011;69(4):680–694. doi: 10.1016/j.neuron.2011.01.020. [DOI] [PubMed] [Google Scholar]
- Dawe S, Loxton N. The role of impulsivity in the development of substance use and eating disorders. Neuroscience and Biobehavioral Reviews. 2004;28:343–351. doi: 10.1016/j.neubiorev.2004.03.007. [DOI] [PubMed] [Google Scholar]
- Fergusson DM, Lynskey MT. Alcohol misuse and adolescent sexual behaviors and risk-taking. Pediatrics. 1996;98:91–96. [PubMed] [Google Scholar]
- Fernie G, Cole J, Goudie A, Field M. Risk-taking but not response inhibition or delay discounting predict alcohol consumption in social drinkers. Drug and Alcohol Dependence. doi: 10.1016/j.drugalcdep.2010.05.011. (in press) [DOI] [PubMed] [Google Scholar]
- First M, Spitzer R, Gibbon M, Williams J. Structured clinical interview for the DSM-IV axis I disorders - Patient Edition (SCID-I/P Version 2.0, 4/97 revision) New York: New York State Psychiatric Institute; 1997. [Google Scholar]
- Fowles DC. Application of a behavioral theory of motivation to the concepts of anxiety and impulsivity. Journal of Research in Personality. 1987;21:417–435. [Google Scholar]
- Fox H, Bergquist K, Gu P, Sinha R. Interactive effects of cumulative stress and impulsivity on alcohol consumption. Alcoholism: Clinical and Experimental Research. 2010;34(8):1–10. doi: 10.1111/j.1530-0277.2010.01221.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Franken IHA, Muris P. BIS/BAS personality characteristics and college students’ substance use. Personality and Individual Differences. 2006;40:1497–1503. [Google Scholar]
- Goudriaan A, Grekin E, Sher K. Decision making and binge drinking: a longitudinal study. Alcoholism: Clinical and Experimental Research. 2007;31(6):928–938. doi: 10.1111/j.1530-0277.2007.00378.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gray J. The psychophysiological basis of introversion-extraversion: A modification of Eysenck's theory. In: Nebylitsyn V, Gray J, editors. The biological bases of individual behavior. San Diego, CA: Academic Press; 1972. pp. 182–205. [Google Scholar]
- Gray J. A critique of Eysenck's theory of personality. In: Eysenck H, editor. A model of personality. Berlin: Springer-Verlag; 1981. pp. 246–276. [Google Scholar]
- Gray JA. The neuropsychology of anxiety: an enquiry into the functions of the septohippocampal system. first ed. Oxford: Oxford university Press; 1982. [Google Scholar]
- Gullo M, Jackson C, Dawe S. Impulsivity and reversal learning in hazardous alcohol use. Personality and Individual Differences. 2010;48(2):123–127. [Google Scholar]
- Hays RD, Merz JF, Nicholas R. Response burden, reliability and validity of the CAGE, Short MAST, and AUDIT alcohol screening measures. Behavior Research Methods, Instruments, & Computers. 1995;27(2):277–280. [Google Scholar]
- Hildebrandt H, Brokate B, Fink F, Muller SV, Eling P. Impaired stimulus-outcome but preserved stimulus-response shifting in young substance-dependent individuals. Journal of Clinial and Experimental Neuropsychology. 2008;30(8):946–955. doi: 10.1080/13803390801894699. [DOI] [PubMed] [Google Scholar]
- Holmila M, Raitasalo K. Gender differences in drinking: why do they still exist? Addiction. 2005;100:1763–1769. doi: 10.1111/j.1360-0443.2005.01249.x. [DOI] [PubMed] [Google Scholar]
- Hundt N, Kimbrel N, Mitchell J, Nelson-Gray R. High BAS, but not low BIS, predicts externalizing symptoms in adults. Personality and Individual Differences. 2008;44:565–575. [Google Scholar]
- Ivis F, Adalf E, Rehm J. Incorporating the AUDIT into a general population telephone survey: a methodological experiment. Drug and Alcohol Dependence. 2000;60:97–104. doi: 10.1016/s0376-8716(99)00145-3. [DOI] [PubMed] [Google Scholar]
- Johnson C, Xiao L, Palmer P, Sun P, Wang Q, Wei Y, Jia Y, Grenard J, Stacy A, Bechara A. Affective decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in 10th grade Chinese adolescent binge drinkers. Neuropychologia. 2008;46:714–726. doi: 10.1016/j.neuropsychologia.2007.09.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jorm A, Christensen A, Henderson P, Jacomb A. Using the BIS/BAS scales to measure behavioural inhibition and behavioural activation: Factor structure, validity and norms in a large community sample. Personality and Individual Differences. 1998;26(1):49–58. [Google Scholar]
- Kambouropoulus N, Staiger PK. The influence of sensitivity to reward on reactivity to alcohol-related cues. Addiction. 2001;96:1175–1185. doi: 10.1046/j.1360-0443.2001.968117510.x. [DOI] [PubMed] [Google Scholar]
- Keyes K, Grant B, Hasin D. Evidence for a closing gender gap in alcohol use, abuse, and dependence in the United States population. Drug and Alcohol Dependence. 2008;93:21–29. doi: 10.1016/j.drugalcdep.2007.08.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Khantzian EJ, Mack JF, Schatzberg AF. Heroin use as an attempt to cope: Clinical observations. American Journal of Psychiatry. 1974;131:160–164. doi: 10.1176/ajp.131.2.160. [DOI] [PubMed] [Google Scholar]
- Krishnan-Sarin S, Reynolds B, Duhig AM, Smith A, Liss T, McFetridge A, Cavallo KM, Potenza MN. Behavioral impulsivity predicts treatment outcome in a smoking cessation program for adolescent smokers. Drug and Alcohol Dependence. 2007;88(1):79–82. doi: 10.1016/j.drugalcdep.2006.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lejuez CW, Bornovalova MA, Reynolds EK, Daughters SB, Curtin JJ. Risk factors in the relationship between gender and crack/cocaine. Experimental and Clinical Psychopharmacology. 2007;15(2):165–175. doi: 10.1037/1064-1297.15.2.165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lejuez CW, Magidson JF, Mitchell SH, Sinha R, Stevens MC, de Wit H. Behavioral and biological indicators of impulsivity in the development of alcohol use, problems, and disorders. Alcoholism: Clinical and Experimental Research. 2010;34(8):1334–1345. doi: 10.1111/j.1530-0277.2010.01217.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Littlefield AK, Sher KJ, Steinley D. Developmental trajectories of impulsivity and their association with alcohol use and related outcomes during emerging and young adulthood. Alcohol Clin Exp Res. 2010;34(8):1409–1416. doi: 10.1111/j.1530-0277.2010.01224.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Livingston M, Room R. Variations by age and sex in alcohol-related problematic behaviour per drinking volume and heavier drinking occasion. Drug and Alcohol Dependence. 2009;101:169–175. doi: 10.1016/j.drugalcdep.2008.12.014. [DOI] [PubMed] [Google Scholar]
- Loxton N, Dawe S. Alcohol abuse and dysfunctional eating in adolescent girls:The influence of individual differences in sensitivity to reward and punishment. International Journal of Eating Disorders. 2001;29:409–416. doi: 10.1002/eat.1042. [DOI] [PubMed] [Google Scholar]
- MacKillop J, Mattson R, MacKillop E, Castelda B, Donovick P. Multidimensional assessment of impulsivity in undergraduate hazardous drinkers and controls. Journal of Studies on Alcohol and Drugs. 2007;68:785–788. doi: 10.15288/jsad.2007.68.785. [DOI] [PubMed] [Google Scholar]
- Meda S, Stevens MC, Potenza MN, Pittman B, Gueorguieva R, Andrews MM, Thomas AD, Muska C, Hylton JL, Pearlson GD. Investigating the behavioral and self-report constructs of impulsivity domains using principal component analysis. Behavioural Pharmacology. 2009;20(5–6):390–399. doi: 10.1097/FBP.0b013e32833113a3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- O'Connor R, Stewart S, Watt M. Distinguishing BAS risk for university students’ drinking, smoking, and gambling behaviors. Personality and Individual Differences. 2009;46:514–519. [Google Scholar]
- Patton JM, Stanford MS, Barratt ES. Factor Structure of the Barratt Impulsiveness Scale. Journal of Clinical Psychology. 1995;51:768–774. doi: 10.1002/1097-4679(199511)51:6<768::aid-jclp2270510607>3.0.co;2-1. [DOI] [PubMed] [Google Scholar]
- Poulos CX, Le AD, Parker JL. Impulsivity predicts individual susceptibility to high levels of alcohol self-administration. Behavioral Pharmacology. 1995;6:810–814. [PubMed] [Google Scholar]
- Quilty L, Oakman J. The assessment of behavioural activation—the relationship between positive emotionality and the behavioural activation system. European Journal of Personality. 2004;18(7):557–571. [Google Scholar]
- Reinhert DF, Allen JP. The alcohol use disorders identification test (AUDIT): A review of recent research. Alcoholism: Clinical and Experimental Research. 2002;26(2):272–279. [PubMed] [Google Scholar]
- Room R, Babor T, Rehm J. Alcohol and public health. Lancet. 2005;365(9458):519–530. doi: 10.1016/S0140-6736(05)17870-2. [DOI] [PubMed] [Google Scholar]
- Sinha R. Chronic stress, drug use, vulnerability to addiction. Annals of the New York Academy of Sciences. 2008;1141:105–130. doi: 10.1196/annals.1441.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spinella M. Normative data and a short form of the Barratt Impulsiveness Scale. International Journal of Neuroscience. 2007;117:359–368. doi: 10.1080/00207450600588881. [DOI] [PubMed] [Google Scholar]
- Stanford M, Mathias C, Dougherty D, Lake S, Anderson N, Patton J. Fifty years of the Barratt Impulsiveness Scale: An update and review. Personality and Individual Differences. 2009;47:385–395. [Google Scholar]
- Stein M, Herman DS, Trisvan E, Pirraglia P, Engler P, Anderson BJ. Alcohol use and sexual risk behavior among Human Immunodeficiency Virus-positive persons. Alcoholism: Clinical and Experimental Research. 2005;29(5):837–843. doi: 10.1097/01.alc.0000164363.40533.e0. [DOI] [PubMed] [Google Scholar]
- Steinbauer JR, Cantor SB, Holzer CE, 3rd, Volk RJ. Ethnic and sex bias in primary care screening tests for alcohol use disorders. Ann Intern Med. 1998;129(5):353–362. doi: 10.7326/0003-4819-129-5-199809010-00002. [DOI] [PubMed] [Google Scholar]
- Stoltenberg S, Batien B, Birgenheir D. Does gender moderate associations among impulsivity and health-risk behaviors? Addictive Behaviors. 2008;33:252–265. doi: 10.1016/j.addbeh.2007.09.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Voigt DC, Dillard JP, Braddock KH, Anderson JW, Sopory P, Stephenson MT. Carver and White's (1994) BIS/BAS scales and their relationship to risky health behaviours. Personality and Individual Differences. 2009;47:89–93. [Google Scholar]
- von der Pahlen B, Santtila P, Witting K, Varjonen M, Jern P, Johansson A, Sandnabba NK. Factor structure of the alcohol use disorders identification test (AUDIT) for men and women in different age groups. Journal of Studies on Alcohol and Drugs. 2008;69:616–621. doi: 10.15288/jsad.2008.69.616. [DOI] [PubMed] [Google Scholar]
- Wilsnack R, Vogeltanz ND, Wilsnack SC, Harris TR, Ahlström S, Bondy S, Csémy L, Ferrence R, Ferris J, Fleming J, Graham K, Greenfield T, Guyon L, Haavio-Mannila E, Kellner F, Knibbe R, Kubicka L, Loukomskaia M, Mustonen H, Nadeau L, Narusk A, Neve R, Rahav G, Spak F, Teichman M, Trocki K, Webster ISW. Gender differences in alcohol consumption and adverse drinking consequences: cross-cultural patterns. Addiction. 2000;95(2):251–265. doi: 10.1046/j.1360-0443.2000.95225112.x. [DOI] [PubMed] [Google Scholar]
- Zuckerman M, Kuhlman DM, Joireman J, Teta P, Kraft M. A comparison of the three structural models for personality: The Big Three, the Big Five, and the Alternative Five. Journal of Personality and Social Psychology. 1993;65(4):757–768. [Google Scholar]