Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2012 Jul 22.
Published in final edited form as: Subst Use Misuse. 2010 Oct 26;46(5):687–695. doi: 10.3109/10826084.2010.528126

Heat Maps: A Technique for Classifying and Analyzing Drinking Behavior

Amy R Krentzman 1, Elizabeth A R Robinson 2, Jennifer M Jester 3, Brian E Perron 4
PMCID: PMC3401577  NIHMSID: NIHMS386163  PMID: 20977293

Introduction

Many alcoholics drink sporadically and unpredictably, even after treatment. This phenomenon presents a challenge to researchers who seek to define drinking outcomes in ways that are meaningful and optimally useful. Researchers have measured drinking at the end of treatment, drinking at follow-up, achievement of abstinence at various intervals, and reduced drinking. These approaches have merits but do not capture the pattern of drinking over time. Knowing more about longitudinal drinking patterns can reveal rich information and inform intervention efforts. This study introduces heat maps as a novel way of studying longitudinal drinking patterns. A heat map is a method of visualizing two-dimensional data where the hue or intensity of color varies according to a given value criterion. A basic heat map is a “color-shaded matrix display” (Wilkinson & Friendly, 2008, p. 3). In a clustered heat map, similar color patterns are grouped together to reveal larger structural properties of the data (Wilkinson & Friendly, 2008). While heat maps have been used extensively in the natural and biological sciences, this study is the first to apply the use of heat maps to drinking data and to validate the method by comparing results with those obtained by growth mixture modeling, a longitudinal data analytic technique.

The purpose of this study is to present heat maps as a method for classifying drinking data. Questions to be answered include (1) how does the heat map approach compare with growth mixture modeling, a commonly used approach for classifying drinking patterns? (2) Do heat maps produce classes that are meaningfully distinct as defined by baseline demographic and clinical variables?

Methods

Data for this secondary analysis are derived from a longitudinal survey whose original aims were to investigate the contribution of spiritual and religious change to reduced drinking. To assess a variety of alcoholics, the sample of 364 was recruited from treatment and non-treatment sources: a university-based outpatient treatment program (n=157), a VA outpatient treatment program (n=80), a moderation-based program (n=34), and untreated individuals from the local community (n=93). As part of the study, extensive data on covariates of drinking outcomes were collected, including baseline clinical characteristics, Alcoholics Anonymous (AA), and treatment involvement over time. Baseline diagnoses of alcohol dependence were assessed using the Structured Clinical Interview for DSM-IV Axis I Disorders (SCID; First et al., 1997). Of the many measures collected, we will only describe those relevant to this discussion of graphical and statistical analysis techniques to analyze drinking patterns over time. Respondents provided drinking data every three months for 2.5 years.

Measures

To determine baseline differences among the heat map groups, several variables were analyzed including recruitment site, demographics (age, years of education, income, race, gender, marital status, employment), and clinical variables (drinking frequency, drinking intensity, drinking consequences, desire for abstinence, Alcoholics Anonymous involvement, presence of family members with alcohol problems, previous treatment experience, age at first symptoms, frequency and current impact of negative life events, positive and negative social support).

Drinking data were gathered every 3 months via the TimeLine FollowBack Interview (TLFB; Sobell and Sobell 1992, 1996). This provided information on drinking frequency and intensity for the prior three-month period. Drinking frequency was measured by the percent days respondent was abstinent and the number of days since the respondent’s last drink. Drinking intensity was measured by the average drinks per drinking day and the percentage of heavy drinking days.

Drinking consequences were measured by the Short Index of Problems scale (SIP; Miller et al. 1995). Cronbach’s alpha for this sample at baseline was .93.

Baseline desire for abstinence was measured by a single-item question, “Is being abstinent from alcohol something you want to do?”

Alcoholics Anonymous Involvement was measured by a modified version of the Alcoholics Anonymous Involvement scale (Tonigan, Connors, & Miller, 1996). Two items related to meeting attendance were excluded as these questions were asked independently in the parent study. The modified version contained 6 items related to involvement in AA activities. Cronbach’s alpha for this sample was .81.

Presence of a family member with an alcohol problem was measured by the single-item question, “Has anyone in your family had problems with alcohol?”

Previous alcohol treatment was measured by the single-item question, “Have you ever been in treatment before for your alcohol problem?”

Age of onset of alcohol dependence was determined by a single item from the SCID instrument, “How old were you when you first had (interviewer here lists symptoms previously mentioned)?” (First, Spitzer, Gibbon & Williams, 1997).

The number of negative life events and the degree of their current effect on respondents were measured by the Life Events Questionnaire (Brugha & Cragg, 1990).

Positive and negative social support were measured by the “Receiving Social Support and Social Undermining” measure (Vinokur, Schul, Caplan, 1987; Vinokur & Caplan, 1987). Cronbach’s alpha for this sample was .93 for positive social support and .88 for negative social support.

Creation of Heat Map

Heat map categories were generated using mean drinks per drinking day at each 3-month time period and the conditional formatting feature of Microsoft Excel (Windows Office 2007). Drinks per drinking day were entered into the spreadsheet, with each row representing one participant and his or her mean drinks per drinking day for each consecutive 3 month period from baseline to 30 months (2.5 years) follow-up. Each cell in the spreadsheet represented 3 months of drinking. Next, conditional formatting was used to color code each cell. Coded dark grey, “heavy” drinking was defined as a mean of more than 4 drinks per drinking day for women and more than 5 for men. Coded medium grey, “moderate” drinking was defined as more than 0 but less than 4 drinks per drinking day for women, and more than 0 but less than 5 drinks per drinking day for men. Coded light grey, “abstinence” was defined as 0 drinks per drinking day. White cells represented missing data. Men’s and women’s heavy drinking in this study were interpreted differentially according to the definition of binge drinking established by the National Institute on Alcohol Abuse and Alcoholism (NIAAA, 2004).

Once all cells were coded, each case was visually inspected and sorted according to drinking pattern. This heat map procedure was in effect a form of graphical cluster analysis—the groupings were inspired by the data based on conceptual and empirical fit and there was no formal goodness of fit test.

Heat Map and Missing Data

Cases with final follow-up data were able to be classified into a heat map drinking pattern even if there were missing data between baseline and the final follow-up. However, a significant number of individuals (n = 79) could not be classified into a heat map drinking category due to missing end-point data caused by the respondent dropping out of the study (n = 28), failure to respond to outreach (n = 37), or death (n = 14). Therefore, out of the original 364 respondents, 285 cases were included in the heat map analysis.

Growth Mixture Modeling

Mplus version 6.2 was used for growth mixture modeling (GMM). Upon first examination of mean drinks per drinking day over time, a pattern prevalent in the collection of drinking data in alcoholic samples was observed; that is, the initial data point was significantly higher than the trajectory of all subsequent time points. Because the first time point did not reflect the rest of the trajectory, we chose to eliminate this time point from the growth mixture model. The models, therefore, start with the second time point.

We first estimated a latent growth model to find the order of the polynomial that would provide a good fit to the shape of the average trajectory. A linear model had a decent fit, with CFI = .90 and RMSEA = .093. A quadratic model generated an error until the variance of the quadratic term was set to zero. At that point, the model converged and the model fit was CFI = .90, RMSEA = .095. A delta-chi-square test showed that there was not a significantly better fit for this quadratic than the linear model (Δχ2(1)=−.43, p>.3). Because we suspected that there were underlying distinct populations that would be differentiated by their trajectories of drinking, we used growth mixture modeling to tease apart these populations. First, we modeled two linear classes. The Lo-Mendell-Rubin adjusted LRT test did not show evidence that two linear classes provided better fit than one linear class. Second, we attempted to model a solution that was linear for one class and a quadratic solution for another class. This model produced errors (negative variances of growth parameters). Therefore, we chose to use Latent Class Growth Analysis (LCGA) which is a form of growth mixture modeling in which the variance of parameters within each class is set to zero.

Growth Mixture Modeling and Missing Data

Mplus provided analysis of all of the data in the sample, with Full Information Maximum Likelihood analysis. The lowest value of the covariance coverage (a measure of the amount of missingness in the data) was 0.556. This falls well within the guidelines that each value of the covariance coverage matrix be greater than 0.5 (Schafer, 1997). Ten cases with only baseline data were eliminated; therefore, 354 cases were included in the GMM analysis.

Analysis Plan

The heat map classes and the growth mixture modeling classes were generated and visually inspected. The four heat map drinking pattern categories were compared on baseline demographic and clinical variables using chi square tests or one-way ANOVAS. Crosstabs that revealed less than 5 observed values per cell were analyzed using the Fisher’s Exact Test. For the race variable, categories were collapsed into “white” and “other” to produce an adequate number of cases per cell. To determine which groups were statistically different from other groups, standardized adjusted residuals were examined in the crosstab analyses and Tukey posthoc tests were examined in the one-way ANOVA analyses. Groups with standardized adjusted residuals of +/− 2.5 were identified to have statistically significant differences from other groups in the analysis. Standardized adjusted residuals of this magnitude are indicated in Table 1.

Table 1.

Descriptive Information for Baseline Variables by Drinking Pattern in the Life Transition Study Means (Standard Deviations) or Percentages (adjusted standard residuals if +/− 2.5)

Variable (% sample) Heavy
(n=78, 27.4%)
Stop/Start
(n=53, 18.6%)
Moderate
(n=58, 20.4%)
Abstinent
(n=96, 33.7%)
p
Demographics
Marital Status .000
Never married (28.1%) 44.9%
(3.9)
28.3% 17.20% 20.80%
Married/living with significant other (40.7%) 29.50% 30.2% 67.2%
(4.6)
39.60%
Separated, divorced, widowed (31.2%) 25.60% 41.5% 15.5%
(−2.9)
39.60%
White race* (81.1%) 71.8%
(−2.4)
73.6% 91.40% 86.50% .007
Age 40.6a
(14.1)
45.6
(12.9)
44.7
(11.6)
48.1a
(11.4)
.002
Years of education 14.1a
(2.0)
13.5b
(2.3)
16.3abc
(2.8)
14.5c
(2.1)
.000
Household Income .004
< $15,000 (27.1%) 34.6% 34.0% 8.8%
(−3.5)
28.10%
$15,001-$85,000 (49.6%) 47.4% 47.2% 50.90% 52.10%
$85,001 + (23.2%) 17.9% 18.9% 40.4%
(3.4)
19.80%
Employed (57.5%) 56.4% 49.1% 77.6%
(3.5)
51.00% .005
Male (65.3%) 60.3% 79.2% 56.90% 66.70% n.s.
Clinical Baseline Data
Percent days abstinent 46.3bd
(31.4)
65.5cd
(26.0)
48.7ac
(31.1)
63.6ab
(31.7)
.000
Percent heavy drinking days 44.0bcd
(31.1)
27.5d
(23.9)
17.8ac
(22.4)
31.4ab
(30.9)
.000
Drinks per drinking day 9.5a
(5.9)
11.6b
(8.7)
4.3abc
(3.7)
9.7c
(8.7)
.000
Days since last drink 14.8bd
(22.8)
31.9cd
(26.0)
12.6ac
(23.2)
38.6ab
(30.2)
.000
Age at first symptoms 28.0
(11.7)
27.9
(12.4)
30.0
(13.2)
30.0
(12.6)
n.s.
Negative consequences (SIP) 19.4a
(11.7)
24.3b
(11.7)
13.5abc
(9.2)
22.8c
(10.7)
.000
Alcoholics Anonymous involvement (AAI) 1.6bd
(1.8)
2.7cd
(2.1)
0.6abc
(.8)
2.2a
(2.1)
.000
Negative life events (LEQ) 2.2
(1.8)
2.5a
(1.9)
1.5ab
(1.7)
2.3b
(1.7)
.018
Negative life events still affecting you (LEQ) 2.1
(1.6)
2.3
(1.5)
2.1
(1.4)
2.1
(1.4)
n.s.
Positive social support 3.7
(.9)
3.4b
(.7)
3.8ab
(.7)
3.4a
(.8)
.007
Negative social support 1.8ab
(.7)
2.2a
(.7)
1.9
(.6)
2.0b
(.7)
.005
Want to be abstinent? Yes (69.8%) 61.5% 86.8%
(3.0)
36.2%
(−6.2)
87.5%
(4.6)
.000
Alcohol Problem in Family: Yes (86.3%) 83.3% 92.50% 87.90% 85.3% n.s.
Previous alcohol treatment? Yes (51.2%) 51.3% 73.6%
(3.3)
19.0%
(−5.6)
58.3% .000

N=285 except for Negative Life Events (n=283) and Negative Life Events Still Affecting You (n=223).

*

Compared with people of color in this sample: African Americans (n=29), Hispanics (n=5), Native Americans (n=4), Asians (n=2), multiracial individuals (n=11), and others (n=3).

abcd

Pairings in superscript indicate statistically significant differences between these groups.

Results

Heat Map Solution

Four general patterns emerged: "heavy," "stop and start," "moderate," and "abstinent." Visual inspection of the data suggested the following inclusion and exclusion criteria for each group. “Abstinence” (n = 96) is the pattern of having achieved a minimum of one year abstinence at the 30 month final time point. “Stop and start” (n = 53) is a pattern of drinking interrupted by either one 9 month period of abstinence, or multiple periods of abstinence with one period of at least 6 months duration over the 2.5–3 years of the survey. “Moderate” drinking (n = 58) featured a majority of cells coded moderate with a maximum of one cell of heavy drinking, or two cells of heavy drinking if the overall pattern represented a deceleration in drinking. “Heavy” drinking (n = 78) patterns had two or more cells of heavy drinking unless the individual fit criteria for stop-and-start, moderation, or abstinent drinking as defined above. Figure 1 features a heat map of six cases from each group to illustrate the visual patterns produced for each drinking pattern. Figure 2 displays the mean drinks per drinking day over time for each of the drinking patterns rendered by the heat map.

Figure 1.

Figure 1

Heat Map of Six Examples from Each Drinking Pattern Mean Drinks per Drinking Day in 3 Month Period (Rounded)

Figure 2.

Figure 2

Drinking Intensity by Heat Map Category (N=285)

Growth Mixture Model Solution

Using Latent Class Growth Analysis, we tested models with 1 linear class and one to three quadratic classes. In each case, the Lo-Mendell-Rubin Adjusted LRT did not provide support for a better model fit of a higher number of classes than a lower number of classes (p > .14, for each of the models). However, visual inspection of these models showed good differentiation between classes and each of the classes had a substantial number of members. Therefore, for substantive reasons and to compare with the heat map results, we chose the model with 4 classes, 3 quadratic and one linear. Figure 3 shows the 4 class solution, with the estimated means and sample means at each time point. We named these classes “very heavy,” “heavy increasing,” “moderate decreasing,” and “low.” The most problematic class, “very heavy,” was also the smallest. This class had 13 members, 3.7% of the sample, and had a high and only slightly decreasing trajectory of drinks per drinking day. The second two highest trajectory classes (“heavy increasing” and “moderate decreasing”) comprised 10.5% (n=37) and 20.3% (n=72) of the sample, respectively. These classes each started at about 6 drinks per drinking day, but one of the classes had an increasing trajectory over the course of the study and the other had a decreasing trajectory. The “low” drinking class contained 65.5% (n=232) of the sample and showed a low and decreasing number of average drinks per drinking day over the two and a half years.

Figure 3.

Figure 3

Drinking Intensity by Growth Mixture Modeling Class Actual and Estimated Means (N=354)

Comparison of Heat Map and Growth Mixture Modeling Approaches

A side-by-side comparison of Figures 2 and 3 provides a visual representation of the results of the two approaches. The heat map and the growth mixture modeling approaches each yielded four groups. The heat map approach was able to designate an abstinent and a stop-and-start group. Growth mixture modeling was able to classify cases with missing end-point data and thus included more cases (354 cases versus 285 cases with heat maps). Neither classification system was able to classify ten cases that contained baseline data only. Growth mixture modeling was able to display overall trends in drinking of each class, such as increasing or decreasing behavior. While the heat map approach identified heavy drinking, the growth mixture modeling approach stratified different intensities of heavy drinking. The heat map approach included baseline drinking while the growth mixture modeling approach eliminated baseline drinking before analysis.

Differences among the Heat Map Groups

Analyses revealed statistically significant differences among the four heat map groups. See Table 1 for a report of the results.

First, differences by recruitment site were observed. Heavy drinkers were more likely to come from the untreated community sample and less likely to come from the university outpatient treatment program. Stop and start drinkers were more likely to come from the VA treatment program and less likely to come from the moderation program. Moderate drinkers were more likely to come from the community or the moderation program and less likely to come from either outpatient treatment program. Those who achieved a year of abstinence were more likely to have come from the university treatment program and less likely to have come from the untreated community sample.

Demographics

Heavy drinkers were more likely to have never married. Moderate drinkers were more likely to be married or living with their significant other and less likely to be separated, divorced, or widowed. Moderate drinkers were also less likely than the other groups to be earning less than $15,000 per year, and more likely to be earning more than $85,000 per year. Moderate drinkers were also more likely to be employed and had more years of education than the other groups. Each of these differences was statistically significant. The abstinent group was oldest in age of all groups with significant differences compared with heavy drinkers (48.1 versus 40.6 years old, respectively). In this sample, Whites were less likely to be heavy drinkers, and people of color were more likely to be heavy drinkers. There were no significant differences between the four groups in terms of gender.

Baseline Clinical Variables

At baseline, the moderate group had the lowest drinks per drinking day, lowest number of days since last drink, and fewest negative consequences of drinking compared with the other groups. They had the lowest levels of Alcoholics Anonymous involvement, lowest desire for abstinence, and lowest rates of previous treatment for alcohol problems. The heavy drinkers had lowest percent days abstinent, highest percent heavy drinking days and second lowest desire for abstinence after the moderate drinkers.

The majority of all groups (ranging from 83.3% to 92.5%) stated they have a family member with alcohol problems; there was no statistically significant difference among groups on this issue. The moderate drinkers reported lowest levels of negative life events and highest levels of positive social support. The stop and start group had the highest levels of negative social support. Heavy drinkers reported lowest levels of negative social support.

Discussion

The main findings of this study were: (1) Heat maps made a unique contribution above and beyond growth mixture modeling by allowing theory to guide classification resulting in a fully abstinent and a stop-and-start category of drinkers. It is an approach that can be produced without advanced statistical procedures and can be created with widely available software (Microsoft Excel). However, cases are categorized one at a time, by hand, which would be possible only for smaller data sets and there is an absence of a formal statistical test to determine goodness of fit of the heat map groupings. (2) Growth mixture modeling made a unique contribution above and beyond heat maps in its ability to include missing data. It created classifications that were statistically justified and provided statistical tests to choose the number of classes. Its primary drawback is that it could not efficiently model multiple increases and decreases in outcome as represented in the heat map “stop-and-start” grouping. (3) Heat map classifications were statistically different from one another on baseline demographic and clinical indicators. Of specific note is the social and economic privilege of the “moderate” drinkers and the finding that people of color were more likely to be in the “heavy” drinking classification.

Meaningful differences among heat map groups at baseline suggest implications for future research and practice. Stop-and-start drinkers may represent a high risk group and yet may include individuals on the verge of long-term recovery. Our analysis revealed that this group had a mix of significant strengths and weaknesses compared with other groups. They had significantly more previous treatment for an alcohol problem, higher AA involvement, higher percent days abstinent, and higher desire to be abstinent, but also had more negative consequences of drinking, more negative life events in general, and higher negative social support. It may be that high negative life events and negative social support are obstacles to the achievement of long-term recovery even when abstinence is desired. Further study of this subgroup, now that it has been identified, could yield improved interventions strategies for those who desire sobriety, gain it for significant periods, but continually relapse.

Individuals diagnosed with alcohol dependence who demonstrate moderate drinking are of interest to alcohol researchers. This study revealed them to be significantly different along a host of key socioeconomic and clinical variables. The moderate drinking group was disproportionately privileged. They were more likely to make more than $85,000 a year and more likely to be employed and married. They had higher levels of positive social support. They were less likely to want to be abstinent, had fewer previous treatment episodes and less experience with AA. They had also suffered fewer negative life events generally and fewer negative consequences of drinking. Perhaps negative life events and harmful drinking consequences are necessary to motivate an individual toward 100% abstinence. The social class difference is particularly important to note. More research on the protective factors of socioeconomic privilege is warranted. Increased understanding can help illuminate the interaction of alcohol dependence, drinking behavior, and social class.

Differences at baseline reveal possible predictors of long term abstinence. The abstinent group respondents were older in age, had higher percent days abstinent at baseline, more days since last drink, more of them wanted to be abstinent, more had prior AA involvement, and more had experienced negative effects from drinking. This information can be used clinically to identify clients who may be more successful at achieving long-term abstinence, which can inform treatment planning.

Heavy drinkers revealed themselves even at baseline to be a high-risk group. They were more likely to have never married, more likely not to want abstinence, and had the highest percentages of days of heavy drinking. Heavy drinkers were also more likely to be individuals of color, suggesting racial health disparities in this sample. Again, further study can yield rich information about chronic alcoholism as it is stratified by levels of social class and disadvantage.

It is important to note that the heat map groups were equivalent at baseline on several variables. The majority of individuals in all four groups indicated they had a family member with an alcohol problem. Other similarities across the groups are the age when individuals manifested their first problems with alcohol, and gender composition. These characteristics are shared among alcoholics despite the course of the disease. These variables are not predictive of later drinking patterns.

A heat map of drinking patterns in a longitudinal study is valuable as it provides a stronger sense than many other techniques of both individual and group outcomes. Besides obtaining a snapshot of each person’s drinking career, it also serves the research team as a valuable at-a-glance guide to clusters of outcomes across a sample. It makes easier the task of identifying specific cases with drinking trajectories that may be of interest.

Limitations

When interpreting the findings of this study, an important consideration is our definition of moderate drinking. While we used NIAAA’s definition for binge drinking as a guideline in establishing that 4 or more drinks per day for women and 5 or more drinks per day for men would constitute the line between moderate and heavy drinking, it is important to note that other established guidelines are more stringent. The Centers for Disease Control and Prevention (CDC) defines heavy drinking as an average of more than 2 drinks per drinking day for men and more than 1 drink per drinking day for women (Centers for Disease Control and Prevention, 2010). One compelling idea for future research would be to further stratify the drinking categories used in this study to differentiate levels of moderate drinking according to CDC’s definition and, as was demonstrated in the GMM groupings, to differentiate heavy drinkers into heavy (5+ DDD) and very heavy (15+ DDD) intensities of drinking consumption. The heat map approach easily can be adapted to render these finer grained group differences.

In addition, the averaging of drinks per drinking day over three months muted spikes in drinking indicative of binging and other more problematic drinking behaviors. It is important to note that we have no information on the time frame within which drinks were consumed. Four or five drinks within a two-hour period represents binge drinking according to NIAAA’s definition (NIAAA, 2004). This is particularly important when interpreting the findings for the individuals in the current study’s moderation group. Further research should investigate daily or weekly drinking for these individuals (see Stout, 2000), should consider the CDC definition for moderate drinking, and the time frame in which drinks were consumed.

Another limitation relates to the method used to classify drinkers. While the group criteria were inspired by the data itself, cut offs between groups and judgments about borderline cases were made with a degree of subjectivity. Finally, as mentioned, hand classification, as was possible in this study of 364 alcoholics, would be possible only in smaller datasets. Much larger datasets would require computerized methods.

In summary, this analysis highlights the utility of using heat maps to categorize participants in alcoholism research and compares this technique to growth mixture modeling. Growth mixture modeling included more cases with missing data and created classes that were statistically justified, however, it could not model drinking patterns characterized by multiple increases and decreases. Using the heat map approach, cases were classified individually by visual inspection and it was not possible to render a statistical goodness of fit test. However, heat maps allowed theory to guide classification, were produced without advanced statistical techniques using Microsoft Excel, and provided rich information hidden by GMM; for example, the discovery of a class of drinkers who have a stop-and-start pattern. The identification of this subgroup enables further study of individuals with these patterns. The classes produced by the heat map differed on baseline demographic and clinical indicators.

This study is the first that we are aware of to apply the data visualization technique of heat maps to the interpretation of longitudinal drinking data. New research highlights the advantages of using drinking classes as outcomes in alcoholism research (Gueorguieva et al., 2010). Despite limitations, this study demonstrates the utility of heat maps as an innovative method for classifying drinkers’ outcomes and for visualizing and understanding drinking data.

Contributor Information

Amy R. Krentzman, Addiction Research Center, University of Michigan, Ann Arbor, Michigan, USA

Elizabeth A. R. Robinson, Addiction Research Center, University of Michigan, Ann Arbor, Michigan, USA

Jennifer M. Jester, Addiction Research Center, University of Michigan, Ann Arbor, Michigan, USA

Brian E. Perron, Department of Social Work, University of Michigan, Ann Arbor, Michigan, USA

References

  1. Brugha TS, Cragg D. The list of threatening experiences: The reliability and validity of a brief life events questionnaire. Acta Psychiatrica Scandinavica. 1990;82:77–81. doi: 10.1111/j.1600-0447.1990.tb01360.x. [DOI] [PubMed] [Google Scholar]
  2. Centers for Disease Control and Prevention. [Retrieved August 7, 2010];Alcohol and Public Health. Frequently Asked Questions. 2010 from: http://www.cdc.gov/alcohol/faqs.htm#heavyDrinking.
  3. First MB, Spitzer RL, Gibbon M, Williams JBW. Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I), Clinician Version: User’s Guide. Washington, DC: American Psychiatric Press; 1997. [Google Scholar]
  4. Gueorguieva R, Wu R, Donovan D, Rounsaville BJ, Couper D, Krystal JH, O’Malley SS. Naltrexone and combined behavioral intervention effects on trajectories of drinking in the COMBINE study. Drug and Alcohol Dependence. 2010;107(2–3):221–229. doi: 10.1016/j.drugalcdep.2009.10.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. The HABITS Lab at UMBC. Readiness Score for URICA. [Retrieved February 15, 2010]; (n.d.) from www.umbc.edu/psyc/habits/content/ttm_measures/urica/readiness.html. [Google Scholar]
  6. Miller WR, Tonigan JS, Longabaugh R. The Drinker Inventory of Consequences (DrInC): An Instrument for Assessing Adverse Consequences of Alcohol Abuse: Test manual. Project MATCH Monograph Series. Volume 4. Rockville, MD: National Institute on Alcohol Abuse & Alcoholism; 1995. [Google Scholar]
  7. National Institute on Alcohol Abuse and Alcoholism. Alcohol’s damaging effects on the brain. [Retrieved February 16, 2010];Alcohol Alert. 2004 63 from http://pubsniaaanihgov/publications/aa63/aa63htm. [Google Scholar]
  8. Schafer JL. Analysis of incomplete multivariate data. London, New York: Chapman & Hall; 1997. [Google Scholar]
  9. Sobell LC, Sobell MD. Timeline Follow-back: A technique for assessing self-reported alcohol consumption. In: Litten R, Allen J, editors. Measuring Alcohol Consumption: Psychosocial and Biochemical Methods. Totowa, NJ: Humana Press; 1992. [Google Scholar]
  10. Sobell LC, Brown J, Leo GI, Sobell MB. The reliability of the Alcohol Timeline Follow-back when administered by telephone and by computer. Drug and Alcohol Dependence. 1996;42(1):49–54. doi: 10.1016/0376-8716(96)01263-x. [DOI] [PubMed] [Google Scholar]
  11. Stout R. What is a drinking episode? Journal of Studies on Alcohol. 2000;61:455–461. doi: 10.15288/jsa.2000.61.455. [DOI] [PubMed] [Google Scholar]
  12. Tonigan JS, Connors GJ, Miller WR. Alcoholics Anonymous Involvement (AAI) scale: Reliability and norms. Psychology of Addictive Behaviors. 1996;10(2):75–80. [Google Scholar]
  13. Vinokur A, Caplan RD. Attitudes and social support: Determinants of job-seeking behavior and well-being among the unemployed. Journal of Applied Social Psychology. 1987;17(12):1007–1024. [Google Scholar]
  14. Vinokur A, Schul Y, Caplan RD. Determinants of perceived social support: Interpersonal Transactions, personal outlook, and transient affective states. Journal of Personality and Social Psychology. 1987;53(6):1137–1145. doi: 10.1037//0022-3514.53.6.1137. [DOI] [PubMed] [Google Scholar]
  15. Wilkinson L, Friendly M. The history of the cluster heat map. [Retrieved February 15, 2010];2008 from cs.uic.edu/~wilkinson/Pulbications/Heatmap.pdf. [Google Scholar]

RESOURCES