Skip to main content
Journal of Studies on Alcohol and Drugs logoLink to Journal of Studies on Alcohol and Drugs
. 2018 Jun 13;79(3):370–379. doi: 10.15288/jsad.2018.79.370

Childhood Risk Factors for Heavy Episodic Alcohol Use and Alcohol Problems in Late Adolescence: A Marginal Structural Model Analysis

Kenneth S Kendler a,b,c,*, Charles O Gardner a,b, Alexis C Edwards a,b, Danielle M Dick c,d,e, Matt Hickman f, John MacLeod f, Jon Heron f
PMCID: PMC6005251  PMID: 29885144

Abstract

Objective:

This study seeks to clarify the nature of the association between five well-studied late childhood predictors and alcohol-related behaviors in adolescence.

Method:

We examined, in 7,168 subjects from the Avon Longitudinal Study of Parents and Children (ALSPAC), using linear probability and marginal structural models, the association between parental alcohol problems, peer group deviance, antisocial behavior, and low parental monitoring, and sensation seeking assessed at multiple times from ages 12.5 to 18 years and heavy episodic drinking and alcohol problems at ages 16.5, 17.5, and 20 years.

Results:

Based on the pattern of the attenuation in the association with heavy episodic drinking and alcohol problems from the linear probability to marginal structural models, our five factors were divisible into three groups. For parental alcohol problems, no substantial attenuation was seen. For peer group deviance and antisocial behavior, the associations in the marginal structural models were modestly attenuated (10%–20%). By contrast, for low parental monitoring and sensation seeking, moderate attenuations of 41% and 35%, respectively, were observed.

Conclusions:

Our results are consistent with the hypothesis that all or nearly all of the association between parental alcohol problems and heavy episodic drinking and alcohol problems in mid to late adolescence is causal. For peer group deviance and antisocial behavior, the large majority of the associations appear to be causal, but confounding influences are also present. However, for low parental monitoring and sensation seeking, our findings suggest that a substantial proportion of the observed association with alcohol outcomes reflects confounding rather than causal influences.


Individual differences in levels of alcohol use and alcohol problems arise out of a complex developmental process influenced by a range of biological and environmental factors (Kendler et al., 2011b; Sher et al., 2005; Vaillant, 1983). Many individual putative risk factors have been associated with alcohol-related behaviors from both cross-sectional and longitudinal observational studies. However, these risk factors are frequently intercorrelated, often substantially so. Without randomized controlled experiments, it is challenging to clarify, from observational data, the degree to which these risk factors are causally related to increased alcohol use and problems. However, it is such insights that are needed to inform education, prevention, and early intervention programs. Two broad classes of approaches can be taken to problems of causal inference in nonexperimental data: natural experiments and specialized statistical methods (Rutter, 2007). In this report, we apply one such statistical method.

Marginal structural models (MSMs; Robins et al., 2000) provide a method to estimate the average causal effect of an exposure on an outcome using observational data in the presence of confounding. This method is particularly useful in cases where exposure and confounding may be time dependent, and confounders are influenced by exposure status. Central to this method is the assignment of a weight to each subject equal to the inverse probability of receiving their exposure conditional on the covariates and confounders. These weights provide a counterfactual estimation of the average causal effect—that is, the difference in means if all of a sample versus none of the sample received an exposure.

In this report, we examine five well-studied risk factors for alcohol-related outcomes in offspring generation from the Avon Longitudinal Study of Parents and Children (ALSPAC) cohort (Boyd et al., 2013; Golding et al., 2001; Ness, 2004; Pembrey, 2004): parental alcohol problems (Cotton, 1979), antisocial behavior (Fergusson et al., 2007; Heron et al., 2013), peer-group deviance (Dishion & Loeber, 1985; Li et al., 2002), parental monitoring (Webb et al., 2002), and sensation-seeking (Sher et al., 1999; Zuckerman, 1972; Zuckerman & Neeb, 1979) assessed in the offspring at 12.5 to 18 years of age. These risk factors were selected on the basis of a prior large structural equation model analysis (Edwards et al., 2016) because, amongst a broad range of putative predictors of alcohol-related behaviors in late adolescence/early adulthood, they were the ones that demonstrated both strong associations with our alcohol outcomes and with each other, suggesting their value both as potential causal influences and confounders. Using MSMs that contain both standard covariates and all the other risk factors measured before or concurrent with the exposure variable as potential confounders, we predicted, from these five exposures taken from each occasion of measurement, the outcomes of heavy episodic use and alcohol problems as assessed at 16.5, 17.5, and 20 years of age. All risk factors had two or more longitudinal measures (except parental alcohol problems). We compared the results from these MSMs with those obtained by standard linear probability regression so as to gain insight into the degree to which the association between these putative risk factors and our alcohol-related outcomes may be causal. If the attenuation were modest, we would interpret this as supportive of the hypothesis that the association between the risk factor and outcome is largely causal. If the attenuation were stronger, it would be consistent with the hypothesis that the risk factor–outcome association is substantially influenced by noncausal factors, that is, confounders.

Method

Sample

ALSPAC is an ongoing population-based study investigating a range of environmental and other influences on the health and development of children (Boyd et al., 2013; Golding et al., 2001; Ness, 2004; Pembrey, 2004). All pregnant women residing in the Avon district in England with an expected delivery date between April 1, 1991, and December 31, 1992, were invited to participate. The achieved sample was 14,541 pregnant women (80% of those eligible) with 13,988 live infants at age 12 months. ALSPAC parents and children have been followed up regularly since recruitment, with data obtained through questionnaires completed by mothers, children, and teachers, and through clinical assessments. Full details of all measures, procedures, sample characteristics and response rates are available at: www.alspac.bris.ac.uk. Please note that the study website contains details of all the data that are available through a fully searchable data dictionary: www.bris.ac.uk/alspac/researchers/dataaccess/datadictionary. Ethical approval for the study was obtained from the ALSPAC Ethics and Law Committee and the Local Research Ethics Committee.

Sample selection

Individuals chosen for inclusion in the sample were required to have at least one usable measurement of the four risk factors based on self-report (peer group deviance, antisocial behavior, lack of parental monitoring, and sensation seeking), all of which were in the interval from 12 years 6 months to 13 years 6 months. Among individuals meeting this criterion, we created a binary variable indicating whether all parental variables were missing or not, in case nonparticipation by parents had a predictive role. As outlined in Supplemental Table A, the variable that most strongly predicted attrition before early adolescence was parental socioeconomic status. (Supplemental material appears as an online-only addendum to the article on the journal’s website.) However, it was previously demonstrated using inverse probability weighting that such attrition had little effect on the association among the variables used in this study (Edwards et al., 2016). All individuals meeting the criterion for inclusion were subjected to multiple imputation using IVEware. This software uses a chained equation approach as described by Raghunathan et al. (2001). Variables used in the imputation model included all outcomes, risk factors, and covariates from the analyses along with earlier measures of lack of parental monitoring and conduct disorder that were not used in the analyses. Five imputed data sets were created.

Variables

Parental socioeconomic status was assessed as a composite of parental education (maximum of maternal and paternal education rated a “less than O level, O level, A level, and university degree”), parental occupational status (maximum for either parent; Kendler et al., 2014), and parental income (mean of 5 ordinal levels assessed at four ages [2 years 9 months, 3 years 11 months, 7 years 1 month, 8 years 1 month]; Melotti et al., 2013). Each variable was standardized and the mean taken. If any were missing, we used the mean of those remaining.

Parental alcohol problems were based on factor-derived scores from the parental alcohol use and alcohol-related problems as assessed by self and spouse report from before pregnancy (retrospectively) through age 12 of the offspring. (For further details, see Kendler et al., 2013, Table 1.) The sum scores for maternal and paternal problems were standardized and the mean taken (if both available). Otherwise, the score for the available parent was used.

Table 1.

Polychoric correlations among the risk factorsa

graphic file with name jsad.2018.79.370tbl1.jpg

Variable Age PAP PGD-12 ASB-13.5 LPM-13.5 SS-13.5 ASB-15.5 LPM-15.5 PGD-17.5 SS-18 ASB-18
Parental alcohol problems (PAP) <12
Peer group deviance (PGD) 12.5 .10
Antisocial behavior (ASB) 13.5 .10 .41
Low parental monitoring (LPM) 13.5 .07 .33 .41
Sensation seeking (SS) 13.5 .12 .34 .35 .36
Antisocial behavior (ASB) 15.5 .08 .39 .56 .36 .36
Low parental monitoring (LPM) 15.5 .06 .18 .23 .34 .20 .25
Peer group deviance (PGD) 17.5 .12 .34 .38 .28 .29 .48 .22
Sensation seeking (SS) 18 .13 .19 .20 .15 .58 .21 .12 .24
Antisocial behavior (ASB) 18 .12 .37 .43 .28 .38 .50 .22 .51 .31

Notes: All p values < .0001 except between LPM and PAP, where p < .001.

a

All correlations are positive.

Sensation seeking (Arnett, 1994) was assessed at age 13 years 6 months and again at 18 years.

Peer group deviance was assessed as a sum score of antisocial behaviors engaged in by members of the subjects’ peer group at 12 years 6 months and at 17 years 6 months (Edwards et al., 2015).

Antisocial behavior was assessed as a sum score of antisocial behaviors engaged in by the subject at ages 13 years 11 months, 15 years 6 months, and age 18 years (Edwards et al., 2016). Since the measure at 13 years 11 months concerned behavior in the past 12 months, we treated it as concurrent with the measures at 13 years 6 months. The specific items assessed in these three measures of antisocial behavior are seen in Supplemental Table C.

Lack of parental monitoring was assessed by self-report items reflecting the extent of parental knowledge of the subjects’ activities and peers at ages 13 years 6 months and 15 years 6 months (Stattin & Kerr, 2000).

Outcome variables for the models were derived from the Alcohol Use Disorders Identification Test (AUDIT; Saunders et al., 1993) administered at ages 16 years 6 months, 17 years 6 months, and 20 years. Heavy episodic use was defined as having six or more drinks on one occasion at least monthly at age 16 years 6 months and at least weekly at age 17 years 6 months and 20 years. Alcohol problems were based on Items 4–8 of the AUDIT and were defined as responding positively to at least one of these items at a frequency of monthly or more.

Variables used in creating the inverse probability weights for our marginal structural models were converted to three level ordinal variables to avoid potential problems in MSMs when using continuous or quasi-continuous measures and to base multiple imputation on a similar measurement scale for all variables. These scores were created by dividing the scores approximately into quartiles. The lowest quartile was scored 0. The second and third quartiles were scored 1, and the fourth quartile was scored 2. Certain variables had a substantial number of subjects with scores of 0 (peer group deviance and antisocial behavior). Those with 0 were scored 0. The rest were divided approximately into thirds. The upper third of the remainder was scored 2, whereas the bottom two thirds of this portion were scored 1. These ordinal scores were close to linear in describing the association with outcomes and with other risk factors. As a result, models for estimating effects (either unweighted or using inverse probability weighting) were done as linear probability models (LPMs) as described below rather than as models with multiplicative effects.

Assumptions of marginal structural models

Given that MSMs are likely new to many readers, we provide a brief background, specifically about their assumptions.

Exchangeability or no unmeasured confounding.

Although this is unobtainable in an absolute sense, the validity of our estimates will depend on whether we have accounted for a substantial portion of the confounding.

Positivity.

The covariates for each individual allow for a nonzero probability of receiving an exposure. Using categorical measures can be helpful toward preserving positivity.

No misspecification of the model for assigning weights.

The models for assigning weights should be free of excessively narrow parametric assumptions that may bias estimates.

Creating stabilized inverse probability weights.

The intent of inverse probability (IP) weighting is to eliminate confounding by creating a pseudo-population in which each subject has the same probability of receiving each level of exposure and all backdoor paths from exposure to outcome via confounders are eliminated.

The use of stabilized inversed probability weights (where the unconditional probability of exposure is divided by the estimated probability of exposure given the covariates) creates a pseudo-population the same size as the original sample with mean weights of 1. Thus, measured outcomes that are more likely based on covariates are weighted less than 1, whereas outcomes estimated to be less likely receive weights greater than 1. IP weights and stabilized IP weights give the same results, but in certain circumstances, stabilized IP weights will produce narrower confidence intervals.

Useful references for working with marginal structural models and much more include Hernán and Robins (2017; currently accessible in draft form at https://www.hsph.harvard.edu/miguel-hernan/causal-inference-book), VanderWeele (2015), and Thoemmes and Ong (2016).

To carry out MSMs, we need stabilized weights for each subject on the exposure variable of interest (Ai) based on potential confounders at the time of measurement and necessary covariates (Li). Weights (Supplemental Table B) were estimated using generalized logits (SAS Proc Logistic, SAS Institute Inc., Cary, NC) to estimate the probability of an individual receiving their exposure based on these confounders and covariates Pr[Ai|Li]. The logistic regression treated all the potential confounders and exposures as nominal categorical variables. This enables the avoidance of model misspecification due to any parametric assumptions of linearity or proportional odds in the regressions used to estimate weights. Stabilized weights are created by dividing the unconditional probability of exposure by the probability of the observed exposure given the covariates (stabilized inverse probability weights = Pr[Ai]/Pr[Ai|Li]). The distribution of weights was examined to ensure that mean weights were 1.0 and the distribution of weights did not contain extreme values either high or low indicating that positivity was maintained (Cole & Hernán, 2008). Because each individual was represented by five imputations, we averaged the estimated weights. More extreme weights created by unlikely combinations of imputed variables will receive some smoothing in this approach whereas weights based on actual measurements will be unaffected. This approach is similar to that of Mitra and Reiter (Mitra & Reiter, 2016) for propensity scores in multiple imputation where it was found that the averaging approach had a greater potential for bias reduction as opposed to using each imputation independently.

The MSM models were done as LPMs using a quasi-likelihood approach with an identity link function and a binomial error distribution constrained to keep the estimated probability of a positive outcome between .01 and .99. Each subject in each regression model was weighted by their appropriate stabilized inverse probability weight and robust standard errors were used. In multivariate models, weights were calculated for the variable at each time point of measurement and the model weight for each individual was the product of the weights for individual time points.

The general approach for the MSMs used here for predicting the total counterfactual effect from exposure to a risk factor on an outcome was to include appropriate measurements of the exposure made before or concurrent with the outcome. The inverse probability weight for an exposure was estimated using generalized logit regression including covariates and other potential confounders that were before or concurrent with the exposure whose weight was being calculated. If an exposure was measured at multiple time points before or concurrent with an outcome, stabilized inverse probability weights were calculated at each time point and the overall stabilized weight was the product of the individual weights (Robins et al., 2000). Because the sample involved data produced by multiple imputation, results were combined as described by Rubin (1987) to obtain the final results for each analysis.

Offspring sex was used as a covariate for models using parental alcohol problems as an exposure as offspring sex was deemed inappropriate as a weighting factor. For all other exposures, weights were created using standard covariates and the appropriate measures of other risk factors as described above, but the MSMs for counterfactual effects were performed with no covariates. Likewise, unweighted LPMs were carried out without covariates as there is no multivariate regression equivalent to longitudinal MSMs with time-varying risks and confounders.

The major focus of our analyses is the degree of attenuation of the associations between the risk factors and alcohol outcomes in our LPM and MSM analyses. For ease of interpretation, we used a crude but informative figure that is the mean reduction in the beta coefficients from the LPMs to the MSMs for each risk factor across ages given that both the LPM and MSM coefficients were statistically significant. In calculating this, we excluded aberrant results (marked by an asterisk in Tables 4 and 5) that would unduly influence our calculations.

Table 4.

Beta coefficients [95% confidence interval] predicting heavy episodic drinking at ages 16.5, 17.5, and 20 from five putative risk factors assessed analyzed using marginal structural and linear probability models

graphic file with name jsad.2018.79.370tbl4.jpg

Exposure Age Model Heavy episodic drinking age 16.5 Heavy episodic drinking age 17.5 Heavy episodic drinking age 20
Parental alcohol problems ≤12 MSM .088 [.068, .108] .091 [.069, .114] .083 [.059, .106]
LPM .088 [.068, .108] .091 [.068, .114] .084 [.060, .106]
% change 0 0 -1.2
Peer group deviance 12.5 MSM .096 [.076, .115] .036 [.016, .057] .003 [-.019, .025]
LPM .104 [.086, .122] .047 [.028, .066] .002 [-.020, .025]
% change -7.7 -23.4 +50*
17.5 MSM .151 [.116, .185] .089 [.066, .112]
LPM .175 [.145, .204] .103 [.084, .126]
% change -13.7 -13.5
Antisocial behavior 13.5 MSM .049 [.013, .084] .038 [.007, .069] .024 [-.006, .054]
LPM .068 [.028, .107] .054 [.022, .087] .016 [-.015, .047]
% change -27.9 -29.6 +50*
15.5 MSM .106 [.061, .150] .103 [.068, .138] .042 [.007, .077]
LPM .136 [.095, .177] .130 [.100, .161] .040 [.008, .071]
% change -22.0 -20.8 +5.0
18 MSM .052 [.008, .096]
LPM .083 [.032, .134]
% change -37.3
Lack of parental monitoring 13.5 MSM .068 [.041, .095] .058 [.026, .090] .016 [-.025, .056]
LPM .113 [.095, .131] .100 [.073, .128] .034 [.003, .065]
% change -39.8 -42.0 -52.9
15.5 MSM .038 [.014, .061] .026 [-.016, .069] .002[-.027, .031]
LPM .054 [.028, .081] .047 [.013, .082] .019 [-.008, .045]
% change -29.6 -44.6 -89.5*
Sensation seeking 13.5 MSM .092 [.065, .119] .097 [.068, .126] .019 [-.029, .067]
LPM .139 [.116, .162] .147 [.126, .167] .026 [-.016, .068]
% change -33.8 -34.0 -26.9
18 MSM .089 [.034, .143]
LPN .115 [.059, .172]
% change -22.6

Notes: MSM = marginal structural model; LPM = linear probability model.

*

These values are too extreme and known too imprecisely to be included in the calculation of the mean attenuation of the betas from the LPM to the MSM.

Table 5.

Beta coefficients [95% confidence interval] predicting alcohol problems at ages 16.5, 17.5, and 20 from five putative risk factors assessed analyzed using marginal structural and linear probability models

graphic file with name jsad.2018.79.370tbl5.jpg

Exposure Age Model Alcohol problems age 16.5 Alcohol problems age 17.5 Alcohol problems age 20
Parental alcohol problems ≤12 MSM .056 [.033, .078] .075 [.047, .104] .073 [.050, .096]
LPM .056 [.033, .078] .076 [.047, .104] .074 [.051, .097]
% change 0 -1.3 -1.3
Peer group deviance 12.5 MSM .073 [.052, .094] .053 [.034, .073] .034 [.002, .064]
LPM .071 [.049, .093] .046 [.029, .062] .031 [.002, .059]
% change +1.3 +15.2* +9.6*
17.5 MSM .129 [.102, .155] .101 [.074, .129]
LPM .146 [.142, .172] .119 [.091, .146]
% change -11.6 -15.2
Antisocial behavior 13.5 MSM .038 [.016, .060] .002 [-.024, .029] .000 [-.028, .028]
LPM .046 [.025, .068] .023 [-.003, .049] .004 [-.028, .036]
% change -17.4 -91.3* -100%*
15.5 MSM .076 [.051, .101] .103 [.074, .132] .078 [.038, .118]
LPM .094 [.068, .120] .122 [.090, .155] .082 [.050, .114]
% change -19.1 -15.5 -4.9
18 MSM .081 [.037, .125]
LPM .098 [.035, .162]
% change -17.3
Lack of parental monitoring 13.5 MSM .034 [-.010, .077] .058 [.026, .091] .038 [.010, .066]
LPM .063 [.027, .099] .087 [.047, .126] .056 [.029, .084]
% change -46.0 -33.3 -32.1
15.5 MSM .028 [-.009, .064] .011 [-.012, .034] .023[-.003, .049]
LPM .040 [.006, .074] .028 [-.001, .058] .042 [.020, .064]
% change -30.0 -60.7 -45.2
Sensation seeking 13.5 MSM .036 [-.002, .074] .048 [.022, .075] .023 [-.028, .074]
LPM .065 [.030, .099] .084 [.057, .110] .043 [-.010, .095]
% change -44.6 -42.9 -46.5
18 MSM .051 [.002, .099]
LPN .072 [.010, .134]
% change -29.2

Notes: MSM = marginal structural model; LPM = linear probability model.

*

These values are aberrant, too extreme, and/or known too imprecisely to be included in the calculation of the mean attenuation of the betas from the LPM to the MSM.

Results

The sample size for all analyses was 7,168 (3,522 males and 3,646 females). For details and predictors of attrition and the proportion of imputed data in each variable, see Supplemental Table A. We first present polychoric correlations among our risk factors (Table 1), our risk factors and outcomes (Table 2), and our outcomes (Table 3).

Table 2.

Polychoric correlations between the risk factor and outcome variablesa

graphic file with name jsad.2018.79.370tbl2.jpg

Variable Heavy episodic use at age
Alcohol problems at age
Age 16.5 17.5 20 16.5 17.5 20
Parental alcohol problems (PAP) <12 .18 .18 .18 .16 .18 .18
Peer group deviance (PGD) 12.5 .23 .21 .08 .22 .22 .17
Antisocial behavior (ASB) 13.5 .27 .23 .13 .25 .18 .17
Low parental monitoring (LPM) 13.5 .26 .23 .09 .22 .23 .17
Sensation seeking (SS) 13.5 .28 .29 .18 .18 .20 .19
Antisocial behavior (ASB) 15.5 .32 .30 .16 .32 .31 .28
Low parental monitoring (LPM) 15.5 .17 .15 .06 .16 .12 .14
Peer group deviance (PGD) 17.5 .41 .41 .25 .34 .41 .34
Sensation seeking (SS) 18 .26 .26 .28 .12 .15 .22
Antisocial behavior (ASB) 18 .36 .36 .23 .29 .36 .31

Notes: All p values < .0001 except between LPM and heavy episodic use at age 17.5, where p < .001.

a

All correlations are positive.

Table 3.

Polychoric correlations between the outcome variablesa

graphic file with name jsad.2018.79.370tbl3.jpg

Variable Heavy episodic use at age
Alcohol problems at age
Age 16.5 17.5 20 16.5 17.5 20
Heavy episodic use 16.5
17.5 .59
20 .34 .33
Alcohol problems 16.5 .67 .46 .23
17.5 .48 .61 .32 .49
20 .34 .37 .72 .37 .51

Notes: All p values < .0001.

a

All correlations are positive.

Tables 4 and 5 contain our main findings for the prediction of heavy episodic drinking and alcohol problems at ages 16.5, 17.5, and 20 using both marginal structural and linear probability models by each of our five putative risk factors. All predictor and dependent measures in our analyses are on the same scale so that the beta estimates within and across predictor variables are directly comparable. The frequency of each of these outcomes is presented in Supplemental Table D. We calculate the percent change in the regression coefficients from the linear probability to the marginal structural models. This percentage reflects the degree to which the effect size of the predictor variable declines when controlling for confounding.

We are interested in three features of these results: (a) the relative strength of the prediction of our two alcohol outcomes from our risk factors, (b) the attenuation of the association with time from exposure (as expressed by outcome by age of participants), and (c) most importantly, the reduction in association from the linear probability to the marginal structural models.

Parental alcohol problems were more strongly associated with heavy episodic drinking than alcohol problems and this effect was strongest at age 17.5 and modestly weaker at ages 16.5 and 20. The average reduction in predictive power when we controlled for confounders in the MSM was less than 1%.

Peer group deviance assessed at age 12.5 was more strongly associated with heavy episodic drinking than alcohol problems at age 16.5 but then predicted alcohol problems at the later ages. Peer deviance assessed at age 17.5 strongly predicted both contemporaneous heavy episodic drinking and alcohol problems with a moderate reduction in predictive effects at age 20. A modest attenuation of predictive power was seen in the MSM versus LPM results, with the mean reduction in the beta coefficient (when outlier results were excluded) equaling 12%.

Antisocial behavior at 13.5 years old was a modest and significant predictor of heavy episodic drinking at ages 16.5 and 17.5 but not age 20 and a significant predictor of alcohol problems only at age 16.5. Antisocial behavior evaluated at age 15.5 was a strong and similar predictor of heavy episodic drinking at ages 15.5 and 17.5 and weakened at age 20. By contrast, this measure predicted alcohol problems most strongly at age 17.5. A modest to moderate attenuation of predictive power was seen in the MSM versus LPM results, with reductions in the beta coefficient averaging 19%.

Low parental monitoring assessed at both ages 13.5 and 15.5 was modestly associated with heavy episodic drinking and alcohol problems with effects generally weakening with advancing age. Particularly noteworthy was the substantial attenuation of predictive power seen in the MSM versus LPM results, as the mean reduction in the beta coefficient was 41%.

Finally, sensation seeking measured at 13.5 and 18 years of age predicted heavy episodic drinking more strongly than alcohol problems. The impact of the earlier measurement declined substantially by age 20, especially when compared with the measure obtained at age 18. A modest to moderate attenuation of predictive power was seen in the MSM versus LPM results, with the average reductions in the beta coefficient equally 35%.

Discussion

In this report, we attempted to clarify, through the use of MSMs, the underlying sources of the association between five commonly studied risk factors assessed in early adolescence, and heavy episodic drinking and alcohol problems assessed at ages 16.5, 17.5, and 20. The results were diverse. Our five risk factors sorted themselves into three broad groups as a function of the attenuation of their association with our alcohol outcomes from our linear probability to marginal structural models.

For one risk factor—parental alcohol problems—the magnitude of the association did not appreciably change from our LPM to our MSM. This is not unexpected given the modest correlations seen between parental alcohol problems and the other risk factors. Furthermore, this was the only risk factor that was not assessed by offspring self-report. These results are consistent with, but not proof of, the hypothesis that the majority of the association between parental alcohol problems and our alcohol outcomes was causal. These findings would be congruent with a range of family, twin, and adoption studies showing that both levels of alcohol consumption and various measures of problematic alcohol use are strongly transmitted in families, probably as a result of both genetic and shared environmental factors (Hettema et al., 1999; Kendler et al., 2015; Prescott et al., 1994; Swan et al., 1990; Verhulst et al., 2015).

For two risk factors—peer group deviance and antisocial behavior—the magnitude of the association declined modestly from our linear probability to our marginal models, in the range of 10% to 20%. These findings are consistent with the hypothesis that most of the associations observed between these risk factors and heavy episodic use and alcohol problems in adolescence are causal but a small proportion of the association arises from confounders. Prior literature supports the hypothesis that a portion of the peer deviance− alcohol problems association might not be causal. For example, longitudinal studies suggested that prior externalizing behavior in adolescents predicts selection into deviant peer groups (Kandel, 1985). Peer deviance has been shown to be heritable (Kendler et al., 2007), with heritability increasing with age as individuals become more able to form their own social environment. Some have suggested that peer deviancy may be a result of gene–environment correlation (Hill et al., 2008). As predicted by this hypothesis, Harden et al. (2008) have shown that the genetic factors that influence selection of drug-using peers are positively correlated with the genes that predict substance use.

The relationship between antisocial behaviors and alcohol misuse has been conceptualized as part of the “externalizing pathway” to alcohol problems (Babor et al., 1992; Cloninger et al., 1996). A component of this association likely arises from a genetic correlation between alcohol misuse and other forms of externalizing behavior (Edwards & Kendler, 2012; Kendler et al., 2011a; Malone et al., 2004).

Last, with two of our risk factors—sensation seeking and low parental monitoring—the magnitude of the association declined substantially (specifically 35% and 41%, respectively) from our LPM to MSM analyses. These results suggest that a considerable proportion of the associations observed between these risk factors and key alcohol outcomes in adolescence result from confounders. The causal effects are likely present but are substantially upwardly biased in standard regression analyses. These results are consistent with other evidence. Previous studies have demonstrated associations between temperament/personality, conduct problems, and alcohol outcomes (Fergusson et al., 2007; Grekin et al., 2006; Kendler et al., 2011b; McGue & Iacono, 2008; Pardini et al., 2007; Whelan et al., 2014) and suggested genetic links between personality and substance use and abuse (Agrawal et al., 2004).

There have also been concerns about the direction of effects for parental monitoring (Fletcher et al., 1995). Low parental monitoring might arise because children are unresponsive to parental requests for information or are deceptive in the information they provide, or when parents at first try to control an unruly adolescent’s behavior and then give up (Crouter & Head, 2002). Apart from the direction of effect of this putative risk factor, the mechanism underlying its association with alcohol or other substance use outcomes is likely complicated. A study of Finnish twins found that parental monitoring had only a modest main effect on adolescent smoking, but that it moderated genetic and environmental influences on smoking (Dick et al., 2007). Fletcher and colleagues (1995) found interactions between parental monitoring and peer behavior in their impact on adolescent substance use.

These results have implications for efforts at prevention of negative alcohol-related outcomes. If our results are correct, efforts to reduce heavy episodic use or alcohol problems in late adolescence by improving parental monitoring in early adolescence will be less effective than expected in the results from standard longitudinal analyses. The causal impact of parental alcohol problems may be difficult to mitigate because of its genetic component. However, risk is also likely to be conferred via environmental exposure to the parent(s), given results from adoption studies that demonstrate an increased risk of alcohol use disorder in the adoptive children of alcoholic parents (Cloninger et al., 1981; Kendler et al., 2015). Thus, through medical, educational, or other social programs that improve parental alcohol outcomes, this risk factor may yet be a target for intervention.

Limitations

These results should be interpreted in the context of four potential limitations. First, these results are specific to the ALSPAC cohort and may or may not extrapolate to other samples. In particular, differences exist in the age at onset of drinking behavior in the United Kingdom and the United States (Hibell et al., 2007; Johnston et al., 2008). Second, we examined five factors as an illustration of how to test for causal associations—rather than a definitive exploration of all potential risk factors measured in childhood and adolescent drinking behaviors. Furthermore, we made no attempt to clarify, at a psychological or biological level, the mediating mechanisms underlying the observed associations that appeared likely to be substantially causal. These are important questions to be addressed in subsequent analyses. Third, the ALSPAC cohort underwent substantial attrition (Boyd et al., 2013; Golding et al., 2001; Ness, 2004; Pembrey, 2004). Multiple imputations provided complete data for variables missing responses due to attrition between the initial waves of data used in this study (12.5 and 13.5 years) and later outcomes. However, there is no way within MSM methodology to account for attrition before measurement of the initial exposures. In an earlier study (Edwards et al., 2016), we found that attrition before the early teen years was most strongly associated with parental socioeconomic status. There we found that inverse probability weighting for attrition before the exposure period had only a negligible effect on associations in our SEM model.

Footnotes

The authors are extremely grateful to all the families who took part in this study, the midwives for their help in recruiting them, and the whole Avon Longitudinal Study of Parents and Children (ALSPAC) team, which includes interviewers, computer and laboratory technicians, clerical workers, research scientists, volunteers, managers, receptionists and nurses. The UK Medical Research Council and Wellcome (Grant ref: 102215/2/13/2) and the University of Bristol provide core support for ALSPAC. This publication is the work of the authors, and the corresponding author will serve as guarantor for its contents. This work was supported by National Institutes of Health Grants RO1 AA018333 (to Danielle M. Dick and Kenneth S. Kendler), P50 AA022537 and R37AA011408 (to Kenneth S. Kendler), K01AA021399 (to Alexis C. Edwards), and K02 AA018755 (to Danielle M. Dick). Jon Heron is supported by the MRC and Alcohol Research UK (MR/L022206/1). Alcohol and ALSPAC at 24 funded by MRC and Alcohol Research UK (MR/L022206/1) and ELASTIC funded by ESRC (ES/L015471/1).

References

  1. Agrawal A., Jacobson K. C., Prescott C. A., Kendler K. S. A twin study of personality and illicit drug use and abuse/dependence. Twin Research. 2004;7:72–81. doi: 10.1375/13690520460741462. doi:10.1375/13690520460741462. [DOI] [PubMed] [Google Scholar]
  2. Arnett J. Sensation seeking: A new conceptualization and a new scale. Personality and Individual Differences. 1994;16:289–296. doi:10.1016/0191-8869(94)90165-1. [Google Scholar]
  3. Babor T. F., Hofmann M., DelBoca F. K., Hesselbrock V., Meyer R. E., Dolinsky Z. S., Rounsaville B. Types of alcoholics, I. Evidence for an empirically derived typology based on indicators of vulnerability and severity. Archives of General Psychiatry. 1992;49:599–608. doi: 10.1001/archpsyc.1992.01820080007002. doi:10.1001/archpsyc.1992.01820080007002. [DOI] [PubMed] [Google Scholar]
  4. Boyd A., Golding J., Macleod J., Lawlor D. A., Fraser A., Henderson J., Smith G. D. Cohort profile: The ‘children of the 90s’—the index offspring of the Avon Longitudinal Study of Parents and Children. International Journal of Epidemiology. 2013;42:111–127. doi: 10.1093/ije/dys064. doi:10.1093/ije/dys064. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Cloninger C. R., Bohman M., Sigvardsson S. Inheritance of alcohol abuse. Cross-fostering analysis of adopted men. Archives of General Psychiatry. 1981;38:861–868. doi: 10.1001/archpsyc.1981.01780330019001. doi:10.1001/archpsyc.1981.01780330019001. [DOI] [PubMed] [Google Scholar]
  6. Cloninger C. R., Sigvardsson S., Bohman M. Type I and Type II alcoholism: An update. Alcohol Health and Research World. 1996;20:18–23. [PMC free article] [PubMed] [Google Scholar]
  7. Cole S. R., Hernán M. A. Constructing inverse probability weights for marginal structural models. American Journal of Epidemiology. 2008;168:656–664. doi: 10.1093/aje/kwn164. doi:10.1093/aje/kwn164. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Cotton N. S. The familial incidence of alcoholism: A review. Journal of Studies on Alcohol. 1979;40:89–116. doi: 10.15288/jsa.1979.40.89. doi:10.15288/jsa.1979.40.89. [DOI] [PubMed] [Google Scholar]
  9. Crouter A. C., Head M. R. Parental monitoring and knowledge of children. In: Bornstein M., editor. Handbook of parenting: Becoming and being a parent (2nd ed., pp. 461–483) Mahwah, NJ: Erlbaum; 2002. [Google Scholar]
  10. Dick D. M., Viken R., Purcell S., Kaprio J., Pulkkinen L., Rose R. J. Parental monitoring moderates the importance of genetic and environmental influences on adolescent smoking. Journal of Abnormal Psychology. 2007;116:213–218. doi: 10.1037/0021-843X.116.1.213. doi:10.1037/0021-843X.116.1.213. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Dishion T. J., Loeber R. Adolescent marijuana and alcohol use: The role of parents and peers revisited. American Journal of Drug and Alcohol Abuse. 1985;11:11–25. doi: 10.3109/00952998509016846. doi:10.3109/00952998509016846. [DOI] [PubMed] [Google Scholar]
  12. Edwards A. C., Gardner C. O., Hickman M., Kendler K. S. A prospective longitudinal model predicting early adult alcohol problems: Evidence for a robust externalizing pathway. Psychological Medicine. 2016;46:957–968. doi: 10.1017/S0033291715002457. doi:10.1017/S0033291715002457. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Edwards A. C., Kendler K. S. Twin study of the relationship between adolescent attention-deficit/hyperactivity disorder and adult alcohol dependence. Journal of Studies on Alcohol and Drugs. 2012;73:185–194. doi: 10.15288/jsad.2012.73.185. doi:10.15288/jsad.2012.73.185. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Fergusson D. M., Horwood L. J., Ridder E. M. Conduct and attentional problems in childhood and adolescence and later substance use, abuse and dependence: Results of a 25-year longitudinal study. Drug and Alcohol Dependence. 2007;88(Supplement 1):S14–S26. doi: 10.1016/j.drugalcdep.2006.12.011. doi:10.1016/j.drugalcdep.2006.12.011. [DOI] [PubMed] [Google Scholar]
  15. Fletcher A., Darling N., Steinberg L. Parental monitoring and peer influences on adolescent substance use. In: McCord J., editor. Coercion and punishment in long-term perspectives (pp. 259–271) Cambridge, England: Cambridge University Press; 1995. [Google Scholar]
  16. Golding J., Pembrey M., Jones R. the ALSPAC Study Team. ALSPAC—the Avon Longitudinal Study of Parents and Children. I. Study methodology. Paediatric and Perinatal Epidemiology. 2001;15:74–87. doi: 10.1046/j.1365-3016.2001.00325.x. doi:10.1046/j.1365-3016.2001.00325.x. [DOI] [PubMed] [Google Scholar]
  17. Grekin E. R., Sher K. J., Wood P. K. Personality and substance dependence symptoms: modeling substance-specific traits. Psychology of Addictive Behaviors. 2006;20:415–424. doi: 10.1037/0893-164X.20.4.415. doi:10.1037/0893-164X.20.4.415. [DOI] [PubMed] [Google Scholar]
  18. Harden K. P., Hill J. E., Turkheimer E., Emery R. E. Geneenvironment correlation and interaction in peer effects on adolescent alcohol and tobacco use. Behavior Genetics. 2008;38:339–347. doi: 10.1007/s10519-008-9202-7. doi:10.1007/s10519-008-9202-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Hernán M. A., Robins J. M. Boca Raton, FL: Chapman & Hall/CRC; 2017. Causal inference. Retrieved from https://www.hsph.harvard.edu/miguel-hernan/causal-inference-book. [Google Scholar]
  20. Heron J., Maughan B., Dick D. M., Kendler K. S., Lewis G., Macleod J., Hickman M. Conduct problem trajectories and alcohol use and misuse in mid to late adolescence. Drug and Alcohol Dependence. 2013;133:100–107. doi: 10.1016/j.drugalcdep.2013.05.025. doi:10.1016/j.drugalcdep.2013.05.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Hettema J. M., Corey L. A., Kendler K. S. A multivariate genetic analysis of the use of tobacco, alcohol, and caffeine in a population based sample of male and female twins. Drug and Alcohol Dependence. 1999;57:69–78. doi: 10.1016/s0376-8716(99)00053-8. doi:10.1016/S0376-8716(99)00053-8. [DOI] [PubMed] [Google Scholar]
  22. Hibell B., Guttormsson U., Ahlstrom S., Balakireva O., Bjarnason T., Kokkevi A., Kraus L. Sweden: The Swedish Council for Information on Alcohol and Other Drugs (CAN) 2007. The 2007 ESPAD Report: Substance use among students in 35 European countries. [Google Scholar]
  23. Hill J., Emery R. E., Harden K. P., Mendle J., Turkheimer E. Alcohol use in adolescent twins and affiliation with substance using peers. Journal of Abnormal Child Psychology. 2008;36:81–94. doi: 10.1007/s10802-007-9161-0. doi:10.1007/s10802-007-9161-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Johnston L. D., O’Malley P. M., Bachman J. G., Schulenberg J. E. Bethesda, MD: National Institute on Drug Abuse; 2008. Monitoring the Future national results on adolescent drug use: Overview of key findings, 2007 (NIH Publication No. 08-6418) [Google Scholar]
  25. Kandel D. B. On processes of peer influences in adolescent drug use: a developmental perspective. Advances in Alcohol & Substance Abuse. 1985;4:139–162. doi: 10.1300/J251v04n03_07. doi:10.1300/J251v04n03_07. [DOI] [PubMed] [Google Scholar]
  26. Kendler K. S., Gardner C., Dick D. M. Predicting alcohol consumption in adolescence from alcohol-specific and general externalizing genetic risk factors, key environmental exposures and their interaction. Psychological Medicine. 2011a;41:1507–1516. doi: 10.1017/S003329171000190X. doi:10.1017/S003329171000190X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Kendler K. S., Gardner C. O., Edwards A., Hickman M., Heron J., Macleod J., Dick D. M. Dimensions of parental alcohol use/problems and offspring temperament, externalizing behaviors, and alcohol use/problems. Alcoholism: Clinical and Experimental Research. 2013;37:2118–2127. doi: 10.1111/acer.12196. doi:10.1111/acer.12196. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Kendler K. S., Gardner C. O., Hickman M., Heron J., Macleod J., Lewis G., Dick D. M. Socioeconomic status and alcohol-related behaviors in mid- to late adolescence in the Avon Longitudinal Study of Parents and Children. Journal of Studies on Alcohol and Drugs. 2014;75:541–545. doi: 10.15288/jsad.2014.75.541. doi:10.15288/jsad.2014.75.541. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Kendler K. S., Gardner C. O., Prescott C. A. Toward a comprehensive developmental model for alcohol use disorders in men. Twin Research and Human Genetics. 2011b;14:1–15. doi: 10.1375/twin.14.1.1. doi:10.1375/twin.14.1.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Kendler K. S., Jacobson K. C., Gardner C. O., Gillespie N., Aggen S. A., Prescott C. A. Creating a social world: A developmental twin study of peer-group deviance. Archives of General Psychiatry. 2007;64:958–965. doi: 10.1001/archpsyc.64.8.958. doi:10.1001/archpsyc.64.8.958. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Kendler K. S., Ji J., Edwards A. C., Ohlsson H., Sundquist J., Sundquist K. An extended Swedish national adoption study of alcohol use disorder. JAMA Psychiatry. 2015;72:211–218. doi: 10.1001/jamapsychiatry.2014.2138. doi:10.1001/jamapsychiatry.2014.2138. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Li F., Barrera M., Jr., Hops H., Fisher K. J. The longitudinal influence of peers on the development of alcohol use in late adolescence: A growth mixture analysis. Journal of Behavioral Medicine. 2002;25:293–315. doi: 10.1023/a:1015336929122. doi:10.1023/A:1015336929122. [DOI] [PubMed] [Google Scholar]
  33. Malone S. M., Taylor J., Marmorstein N. R., McGue M., Iacono W. G. Genetic and environmental influences on antisocial behavior and alcohol dependence from adolescence to early adulthood. Development and Psychopathology. 2004;16:943–966. doi: 10.1017/s0954579404040088. doi:10.1017/S0954579404040088. [DOI] [PubMed] [Google Scholar]
  34. McGue M., Iacono W. G. The adolescent origins of substance use disorders. International Journal of Methods in Psychiatric Research. 2008;17(Supplement S1):S30–S38. doi: 10.1002/mpr.242. doi:10.1002/mpr.242. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Melotti R., Lewis G., Hickman M., Heron J., Araya R., Macleod J. Early life socio-economic position and later alcohol use: Birth cohort study. Addiction. 2013;108:516–525. doi: 10.1111/add.12018. doi:10.1111/add.12018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Mitra R., Reiter J. P. A comparison of two methods of estimating propensity scores after multiple imputation. Statistical Methods in Medical Research. 2016;25:188–204. doi: 10.1177/0962280212445945. doi:10.1177/0962280212445945. [DOI] [PubMed] [Google Scholar]
  37. Ness A. R. The Avon Longitudinal Study of Parents and Children (ALSPAC)—a resource for the study of the environmental determinants of childhood obesity. European Journal of Endocrinology. 2004;151(Supplement 3):U141–U149. doi: 10.1530/eje.0.151u141. doi:10.1530/eje.0.151U141. [DOI] [PubMed] [Google Scholar]
  38. Pardini D., White H. R., Stouthamer-Loeber M. Early adolescent psychopathology as a predictor of alcohol use disorders by young adulthood. Drug and Alcohol Dependence. 2007;88(Supplement 1):S38–S49. doi: 10.1016/j.drugalcdep.2006.12.014. doi:10.1016/j.drugalcdep.2006.12.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Pembrey M. the ALSPAC Study Team. The Avon Longitudinal Study of Parents and Children (ALSPAC): A resource for genetic epidemiology. European Journal of Endocrinology. 2004;151(Supplement 3):U125–U129. doi: 10.1530/eje.0.151u125. doi:10.1530/eje.0.151U125. [DOI] [PubMed] [Google Scholar]
  40. Prescott C. A., Hewitt J. K., Heath A. C., Truett K. R., Neale M. C., Eaves L. J. Environmental and genetic influences on alcohol use in a volunteer sample of older twins. Journal of Studies on Alcohol. 1994;55:18–33. doi: 10.15288/jsa.1994.55.18. doi:10.15288/jsa.1994.55.18. [DOI] [PubMed] [Google Scholar]
  41. Raghunathan T. E., Lepkowski J. M., Van Hoewyk J., Solenberger P. A Multivariate technique for multiply imputing missing values using a sequence of regression models [Statistics Canada] Survey Methodology. 2001;27:85–95. [Google Scholar]
  42. Robins J. M., Hernán M. A., Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11:550–560. doi: 10.1097/00001648-200009000-00011. doi:10.1097/00001648-200009000-00011. [DOI] [PubMed] [Google Scholar]
  43. Rubin D. B. New York, NY: Wiley; 1987. Multiple imputation for nonresponse in surveys. [Google Scholar]
  44. Rutter M. London, England: Academy of Medical Sciences; 2007. Identifying the environmental causes of disease: How should we decide what to believe and when to take action? (The Academy of Medical Sciences) (Rep. No. November 2007) [Google Scholar]
  45. Saunders J. B., Aasland O. G., Babor T. F., de la Fuente J. R., Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption–II. Addiction. 1993;88:791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x. doi:10.1111/j.1360-0443.1993.tb02093.x. [DOI] [PubMed] [Google Scholar]
  46. Sher K. J., Grekin E. R., Williams N. A. The development of alcohol use disorders. Annual Review of Clinical Psychology. 2005;1:493–523. doi: 10.1146/annurev.clinpsy.1.102803.144107. doi:10.1146/annurev.clinpsy.1.102803.144107. [DOI] [PubMed] [Google Scholar]
  47. Sher K. J., Trull T. J., Bartholow B. D., Vieth A. Personality and alcoholism: Issues, methods, and etiological processes. In: Leonard K. E., Blane H. T., editors. Psychological theories of drinking and alcoholism (2nd ed., pp. 54–105) NY: Guilford Press; 1999. [Google Scholar]
  48. Stattin H., Kerr M. Parental monitoring: A reinterpretation. Child Development. 2000;71:1072–1085. doi: 10.1111/1467-8624.00210. doi:10.1111/1467-8624.00210. [DOI] [PubMed] [Google Scholar]
  49. Swan G. E., Carmelli D., Rosenman R. H., Fabsitz R. R., Christian J. C. Smoking and alcohol consumption in adult male twins: Genetic heritability and shared environmental influences. Journal of Substance Abuse. 1990;2:39–50. doi: 10.1016/s0899-3289(05)80044-6. doi:10.1016/S0899-3289(05)80044-6. [DOI] [PubMed] [Google Scholar]
  50. Thoemmes F., Ong A. D. A primer on inverse probability of treatment weighting and marginal structural models. Emerging Adulthood. 2016;4:40–59. doi:10.1177/2167696815621645. [Google Scholar]
  51. Vaillant G. E. Cambridge, MA: Harvard University Press; 1983. The natural history of alcoholism: Causes, patterns, and paths to recovery. [Google Scholar]
  52. VanderWeele T. J. New York, NY: Oxford University Press; 2015. Explanation in causal inference: Methods for mediation and interaction. [Google Scholar]
  53. Verhulst B., Neale M. C., Kendler K. S. The heritability of alcohol use disorders: A meta-analysis of twin and adoption studies. Psychological Medicine. 2015;45:1061–1072. doi: 10.1017/S0033291714002165. doi:10.1017/S0033291714002165. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Webb J. A., Bray J. H., Getz J. G., Adams G. Gender, perceived parental monitoring, and behavioral adjustment: Influences on adolescent alcohol use. American Journal of Orthopsychiatry. 2002;72:392–400. doi: 10.1037/0002-9432.72.3.392. doi:10.1037/0002-9432.72.3.392. [DOI] [PubMed] [Google Scholar]
  55. Whelan R., Watts R., Orr C. A., Althoff R. R., Artiges E., Banaschewski T., Garavan H. the IMAGEN Consortium. Neuropsychosocial profiles of current and future adolescent alcohol misusers. Nature. 2014;512:185–189. doi: 10.1038/nature13402. doi:10.1038/nature13402. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Zuckerman M. Drug use as one manifestation of a “sensationseeking trait.”. In: Keup W., editor. Drug abuse: Current concepts and research (pp. 154–163) Springfield, IL: Charles C. Thomas; 1972. [Google Scholar]
  57. Zuckerman M., Neeb M. Sensation seeking and psychopathology. Psychiatry Research. 1979;1:255–264. doi: 10.1016/0165-1781(79)90007-6. doi:10.1016/0165-1781(79)90007-6. [DOI] [PubMed] [Google Scholar]

Articles from Journal of Studies on Alcohol and Drugs are provided here courtesy of Rutgers University. Center of Alcohol Studies

RESOURCES