Abstract
Background:
Polysubstance use (PSU) is associated with worse prognosis and poorer physical and mental health compared to single substance use. The current study provides information about PSU patterns by examining a diverse range of alcohol/substance use behaviors ranging from low-level experimentation to indicators of severe abuse. In addition, the current study, for the first time, examines how simultaneous co-use of multiple substances cluster with other more commonly studied PSU behaviors.
Methods:
Latent Class Analysis was used to identify patterns of substance use, in a sample of young-adults (n = 2098), using 25 items from the Semi-Structured Assessment for the Genetics of Alcoholism (SSAGA-II) including: items assessing severity of problems with alcohol, cannabis, stimulants, opiates, and sedatives; items assessing # of lifetime uses; items assessing simultaneous co-use of all combinations of substances. Then the association of class membership and age, antisocial and impulsive personality, experience seeking, anxiety, and neuroticism was examined using Multinomial Regression.
Results:
Fit indices (i.e. AIC, SSABIC, and entropy) and interpretability of classes supported a five-class solution: “Low Problems” (32% of sample), “Alcohol Primary” (11%), “Alcohol and Cannabis” (25%), “Moderate PSU” (23%), and “Severe PSU” (9%). Simultaneous co-use behaviors discriminated between lower and higher severity groups. Externalizing personality constructs robustly predicted membership in the “Moderate” and “Severe” PSU classes compared to the “Alcohol Primary” class.
Conclusions:
PSU patterns followed an additive pattern of use with lower severity classes using alcohol/cannabis and more severe classes using other illicit substances in addition. Co-use items provided valuable information about PSU severity.
Keywords: Substance Use, Alcohol, Latent Class, Co-Use, Polysubstance, Externalizing
1. Introduction
Epidemiological research and behavior genetic studies have identified a robust pattern of co-occurrence of multiple substance use disorders (SUD) and alcohol use disorders (AUD) (Bierut et al., 1998; Kandel, 2002; Krueger et al., 2005). In fact, data from the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC) found that the majority of individuals with an SUD had at least one other co-occurring SUD and that these individuals had worse prognosis than those with single SUD (McCabe et al., 2017). Polysubstance abusers have been shown to be at elevated risk for overdose, poor physical health, risky behaviors, and poor treatment response (Connor et al., 2014; Feigelman et al., 1998; Earleywine & Newcomb, 1997; Petry, 2001). Furthermore, individuals with SUD or AUD are at greater risk for other forms of psychological dysfunction such as mood and anxiety disorders (Kessler et al., 2005) with some studies suggesting the co-occurring problems with multiple substances exacerbates current mental health problems (Connor et al., 2013; Hedden et al., 2010). Taken together, understanding assessment and etiology of polysubstance use behaviors should continue to be prioritized given the substantial public health risk and impact on our understanding of externalizing psychopathology.
Research suggests that alcohol and substance use problems are a manifestation of a broader externalizing dimension of psychopathology characterized by an inability to inhibit socially undesirable actions and restricted behaviors (Finn et al., 2009; Hicks et al., 2004; Iacono et al., 2008; Kendler et al., 1997; Krueger, 1999; Vollebergh et al., 2001). In this conceptualization, different externalizing disorders are viewed as indicators of this externalizing propensity, for example substance use dependence has been demonstrated to indicate higher externalizing severity than alcohol or nicotine dependence (Carragher et al., 2014). Although there is strong evidence for the existence and coherence of a general and continuous externalizing dimension, latent class analyses (LCA) that uncover discrete classes underlying substance use patterns provide additional knowledge about clusters of behaviors along this spectrum. Specifically, LCA provide a more “person centered” approach by identifying common patterns of use in individuals rather than just describing the relationship between latent constructs. Although an in-depth review of studies using latent class analyses of alcohol/substance use behaviors is beyond the scope of the current paper, studies in adolescents (see Tomczyk et al., 2016) and adults (see Connor et al., 2014) have supported classes of increasing usage of a variety of substances. Of substance users, lower severity classes tend to be characterized by alcohol, tobacco, and cannabis use, with higher severity classes using a variety of other substances in addition.
Despite the wealth of information pertaining to polysubstance use patterns already in the literature, the current study intends to address several knowledge gaps. The majority of previous studies have relied only on measures of use (e.g. use in the past 12 months) or DSM derived diagnoses. The current study examines a diverse array of substance use measures and symptoms ranging from minor experimentation to indicators of severe AUD/SUD for the following substances: alcohol, cannabis, stimulants, opiates, sedatives, hallucinogens, and “other” substances (e.g. ecstasy) in a high externalizing sample of young adults. This provides valuable information about patterns of severe use in addition to co-occurring subthreshold experimentation of substances. Furthermore, very few studies have been able to examine co-use (i.e. simultaneous use of two substances) of a variety of substances, with one study showing polysubstance users are very likely to report co-use in the previous 12-months in a representative Australian sample (Quek et al., 2013) and other studies showing high rates of co-use in smaller clinical populations (Herbeck et al., 2013; Olthuis et al., 2013). No study to our knowledge has utilized LCA to examine a wide variety of substance co-use that would allow for direct inspection of how these behaviors further inform our understanding of the clustering of PSU behaviors and serve to discriminate between individuals of different PSU severity. For example, it is possible that some individuals tend to participate in co-use of many substances compared to others. Perhaps these individuals are particularly sensation seeking leading them not only to use multiple substances, but also to maximize intoxication by using multiple substances in a very narrow timeframe. It is also possible that co-use items will serve as severity indicators discriminating between classes characterized by problematic use of substances from classes characterized by mild use or experimentation. In this case, simultaneous use of multiple substance may serve as markers of individuals who have progressed in terms of severity of PSU behaviors, making these items of particular assessment value. Furthermore, the current sample is particularly well suited to examine these questions given its high representation of externalizing disorders (~60% with AUD) and age distribution (mean age = 21.6), given research indicating that PSU is most common in young adults (Quek et al., 2013; White et al., 2013).
Lastly, after the identification of latent class structure, the current study will examine the association between continuous measures of externalizing (i.e. antisocial, impulsive, and experience seeking personality) and internalizing (i.e. trait anxiety and neuroticism) personality traits and the latent classes to aid in interpretation and validation of the identified classes. Research has repeatedly established the strong empirical and theoretical link between personality traits associated with behavioral disinhibition and problems with substance use management (Finn, 2002; Krueger et al., 2002; Sher and Trull, 1994). However, significantly less literature has examined the association between traits commonly associated with internalizing disorders (e.g. trait anxiety) and severity of PSU. Despite theoretical differences between externalizing and internalizing traits/disorders, research has demonstrated that the majority of dimensions of psychological dysfunction tend to covary together (Caspi et al., 2014; Caspi and Moffitt, 2018; Lahey et al., 2017). With this in mind, internalizing traits, in the current sample, may serve as a marker for individuals who struggle both with anxiety/affect regulation in addition to impulse regulation and therefore be at risk for more severe substance use problems.
2. Methods
2.1. Sample Characteristics
The current sample consisted of 2098 young adults ranging from 18–30 with a mean age of 21.6 (SD = 2.65) and was originally recruited for a study on risky decision-making and risk factors of externalizing psychopathology (Finn et al., 2014). The sample was intentionally recruited for an overrepresentation of externalizing problems with 58% of the current sample having an AUD, 45% with a Cannabis Use Disorder (CUD), and 23% with another illicit drug use disorder (DUD). In the current study, the majority of diagnoses (89% of the sample) were assessed using the Diagnostic and Statistical Manual of Mental Disorders fourth Edition (American Psychiatric Association, 2000) alcohol, cannabis, and drug abuse/dependence criteria, while the remaining sample utilized DSM-V (American Psychiatric Association, 2013) AUD, CUD, and other drug use disorder (DUD) criteria. In the current study, AUD, CUD, and other illicit DUDs include both DSM-IV abuse/dependence, and DSM-V AUD, CUD, and DUD diagnoses. This study was reviewed and approved by the Indiana University-Bloomington Institutional Review Board (IRB) and all participants gave informed consent.
2.2. Recruitment
Participants were recruited using flyers, advertisements in local newspapers, and business cards placed around the community, along with postings on the Indiana University student classifieds web page. The flyers and postings were designed utilizing the approach used by Finn and colleagues (2009) to obtain a sample with a large proportion and range of individuals with externalizing pathology specifically: alcohol use, alcohol problems, other substance use problems, and antisocial psychopathology. The postings and flyers asked for “adventurous, daring” individuals, “impulsive individuals”, “more reserved and introverted type person”, “social drinkers”, and persons who “got in a lot of trouble as a child” etc. Importantly, given that the majority of the sample was recruited for studies of alcohol misuse, individuals were not retained if they had externalizing diagnoses without an alcohol use disorder. Therefore, the current sample may have an underrepresentation of illicit drug use disorders without comorbid alcohol use problems.
2.3. Telephone screening interview
Those who responded to advertisements were screened via telephone to determine whether they met study inclusion criteria. Respondents who met study inclusion criteria could read and speak English, had at least a 6th grade education, did not report any history of severe head injuries, did not report a history of psychosis, had consumed alcohol on at least one occasion in their life, and were between ages 18 and 30. Participants were informed that they must abstain from using alcohol and other drugs for at least 12 hours before study sessions.
2.4. Test session exclusion criteria
Before every testing session participants were required to meet a set of criteria before proceeding. All participants were required to (1) have no self-reported use of drugs or alcohol within the past 12 hours prior to testing, (2) have gotten at least 6 hours of sleep the previous night, (3) have a breath alcohol level of 0.0% (tested with an AlcoSenor IV, Intoximeters Inc., St. Louis MO), and (4) not be experiencing symptoms of withdrawal or of any illness. Subjects were rescheduled if they did not meet these criteria.
2.5. Diagnoses and Alcohol/Substance Use Measures
Participants were administered the Semi-Structured Assessment for the Genetics of Alcoholism (Bucholz et al., 1994) to assess lifetime diagnoses of AUD, CUD, and DUD. The SSAGA has demonstrated good construct validity when compared with other semi-structured interviews (Hesselbrock et al., 1999), good test-retest reliability (Bucholz et al., 1994), and inter-rater reliability (Bucholz et al., 1995, 1994). Twenty-five items from the SSAGA were chosen for latent class analysis that reflected a broad range of alcohol/substance patterns. Likert items were created to assess number of uses of cannabis, hallucinogen, stimulant, opiate, sedative, and “other” substances respectively. The “other” category was predominantly the use of ecstasy (MDMA) and nitrous oxide (“whip-its”), in addition to other substances not included in the other substance classes. The number of uses were binned into the following categories: 0 lifetime uses, 1–10, 11–50, 51–99, and greater than 99. These items were meant to capture subthreshold experimentation of substances not normally captured by diagnostic criteria. Severity of problems with alcohol, cannabis, stimulant, opiate, and sedative use was assessed using a summed symptom count of the five core diagnostic features for each substance respectively. In addition, to the symptom count and number of use items, 14 dichotomous items were utilized to examine specific substance use behaviors. These items assessed co-use of every combination of alcohol, cannabis, stimulants, opiates, sedatives, and using alcohol to “come down” from cocaine. In addition to several items that assessed negative consequences associated with severe substance use (e.g. overdose and negative drug interactions), which research has indicated are of particular concern in PSU and especially simultaneous PSU (Kerr et al., 2007). The list of items is provided in Table 1.
Table 1.
Items used in LCA Analysis
| Item | Scoring |
|---|---|
|
Symptom Count Items for Alcohol, Cannabis, Stimulant, Opiates, Sedatives (1) Did you ever need larger amounts of [substance] to get an effect or find that you could no longer get high on the amount you used to use? (2) Have you ever had such a strong desire for [substance] that it was hard to think of anything else? (3) Have you ever tried to stop or cut down on [substance] but found that you couldn’t? (4) Have you ever given up or greatly reduced important activities while using [substance] like sports, work, or associating with friends or relatives? (5) People who stop, cut down, or go without drugs after using drugs steadily for some time may not feel well. These feelings are more intense and can last longer than the usual hangover. When you stopped, cut down, or went without [substance] did you ever experience any of the following problems for most of the day for 2 days or longer? |
Summed criteria for each substance. Range (0–6) |
|
Number of Lifetime Use items for Cannabis, Stimulant, Opiates, Sedatives, Hallucinogens, and Other substances How many times in your life have you used [substance]? |
Total # of uses binned into 0, 0–10, 11–50, 51–99, >99 Range (0–5) |
| Dichotomous Items | |
| Alcohol Binge: Have you ever gone on binges or benders when you kept on drinking for 2 days or more without sobering up, except for sleeping? | Dichotomous |
| Have you ever used 2 or more drugs together? - Alcohol and Cannabis - Alcohol and Stimulants - Alcohol and Opiates - Alcohol and Sedatives - Cannabis and Stimulant - Cannabis and Opiates - Cannabis and Sedatives - Stimulants and Opiates - Stimulants and Sedatives - Opiates and Sedatives |
Dichotomous |
| Did you ever use alcohol to make yourself feel better when coming down from the effects of cocaine? | Dichotomous |
| Did you have any harmful effects from mixing alcohol and any drugs? | Dichotomous |
| Did using drugs cause you to have any other problems like an overdose? | Dichotomous |
2.6. Personality Measures
Antisocial personality was assessed using a lifetime problem count calculated by summing positive responses to relevant SSAGA-II questions in the Antisocial Personality Disorder (ASPD) section of the SSAGA. Impulsive personality was assessed using the 19-item Impulsivity Scale I7 Questionnaire, which has shown good intra-item reliability (α = 84; Eysenck et al., 1985). Neuroticism was assessed using the 23 dichotomous-item neuroticism section of the Eysenck personality questionnaire (Eysenck and Eysenck, 1975), which has shown excellent test-rest reliability (r = .92; Sato, 2005). Trait anxiety was assessed using the 20 Likert-item Trait Anxiety Inventory (TAI) section of the State-Trait Anxiety Inventory (Spielberger, 1983), also with excellent test-retest reliability (average r = .88; Barnes et al., 2002). Lastly, Experience Seeking was assessed using the 10 forced-choice item experience seeking subscale of the Sensation-Seeking Scale (Zuckerman, 1979), which is meant to capture items the reflect a search for new experiences through a “non-conforming lifestyle” (Eysenck and Zuckerman, 1978).
2.7. Statistical Analyses
R version 3.5.3 was used for these analyses (R Development Core Team, 2013), including use of the “poLCA” package for latent class analyses (LCA)(Linzer and Lewis, 2011), the “VGAM” package for multinomial regression (Yee, 2015), the “missForest” package for data imputation (Stekhoven and Bühlmann, 2012), and the “ggplot2” package for figure creation (Wickham, 2016).
2.8. Missing Data and imputation
The current sample diagnostic interview, which was the source of the alcohol/substance use items, consisted of less than 1% missing data. This missing data was imputed using a random forest algorithm (Stekhoven and Bühlmann, 2012) using all other non-missing items. Random forest imputation has shown to outperform other commonly used methods of imputation and is considered highly accurate when imputing categorical data as in the current study (Stekhoven and Bühlmann, 2012; Waljee et al., 2013). Data were not imputed for personality measures because these data were not missing at random, but were missing due to structural issues. Some individuals in the current sample simply did not complete any or the majority of the personality measures due to slight changes in the battery of measures to reduce subject burden. Individuals who did not complete a given personality measure(s) were removed from the multinomial regression utilizing that respective measure(s).
2.9. Latent Class Analysis
Latent class analysis was conducted using the twenty-five categorical substance use items using the “poLCA” package (Linzer and Lewis, 2011), which utilizes the expectation-maximization (EM) algorithm (Dempster et al., 1977). Models ranging from 3 to 6 classes were evaluated based on the theoretical interpretability of the classes, Akaike’s Information Criterion (AIC), Sample Size Adjusted Bayesian Information Criterion (SSABIC; Sclove, 1987), entropy statistic (Celeux and Soromenho, 1996), and the size of the classes. In general, lower AIC and SSABIC values indicate a better model fit. SSABIC has been shown to be a very reliable and useful statistic in decisions of the number of latent classes to retain (Nylund et al., 2007). Entropy is an index of the precision of assigning latent class membership (ranges from 0 to 1) with values near 1 indicating high precision of assignment.
After examination of the fitted latent class models, the posterior probabilities of group membership were used to assign participants to classes. Class membership was assigned based on the highest modal posterior probability of each participant (Linzer and Lewis, 2011).
2.10. Multinomial Regression
Multinomial regression was used to assess the association between age, antisocial personality, impulsive personality, experience seeking, trait anxiety, and neuroticism with LCA defined classes.
3. Results
3.1. Latent Class Analysis: Class Identification
Table 2 presents the fit statistics for the fitted models ranging from 3 to 6 latent classes. AIC and SSABIC statistics supported retention of six latent classes. However, five latent classes produced a more interpretable solution. The six-class solution added another class that did not appear to be meaningfully different from the class characterized by alcohol and cannabis use described in the next paragraph, but merely was of slightly lower severity. The five-class model showed a large improvement over the four-class model in terms of AIC and SSABIC, while all models showed excellent entropy indicating strong precision in class assignment.
Table 2.
Latent Class Analysis Fit Statistics
| Model # | df | AIC | SSABIC | Entropy |
|---|---|---|---|---|
| Model 3 | 1907 | 57108.51 | 56730.98 | 0.95 |
| Model 4 | 1843 | 55723.41 | 55217.88 | 0.93 |
| Model 5 | 1779 | 55197.14 | 54563.61 | 0.92 |
| Model 6 | 1715 | 54715.51 | 53953.99 | 0.90 |
Model # = the number of latent class, df = residual degrees of freedom, SSABIC = Sample Size Adjusted Bayesian Information Criterion, AIC = Akaike’s Information Criterion.
The five-class solution consisted for the following classes: a “Low Problems” class (32% of total sample) characterized by low to moderate alcohol use without significant indicators of alcohol use problems, minimal experimentation with other substances, and very low probability of illicit drug problems; an “Alcohol Primary” class (11% of sample) characterized by moderate to heavy alcohol use, alcohol binging, mild to extensive experimentation with cannabis and stimulants in terms of # of uses without significant disorder symptoms, and mild to negligible experimentation of other illicit substances; a “Alcohol and Cannabis” class (26% of sample) characterized by light to heavy alcohol use, moderate to heavy cannabis use, high rates of alcohol and cannabis co-use, and light experimentation with other illicit drugs; a “Moderate PSU” class (23% of sample) characterized by moderate to heavy alcohol and cannabis use, high rates of co-use of alcohol and other substances, and substantial use of other illicit substances resulting in varying levels of SUD pathology; a “Severe PSU” group (9% of sample) characterized by heavy use of alcohol, cannabis, and all other illicit substances, high rates of substance co-use, and negative outcomes such as negative alcohol/drug interactions and overdoses. Table 3 presents the probability of response patterns for each item broken down by latent class. The average posterior probabilities for each class were “Low Problems” = 96%, “Alcohol Primary” = 91%, “Alcohol and Cannabis” = 95%, “Moderate PSU” = 96%, and Severe PSU” = 96%. Supplementary Figure 1* provides a visual representation of the probabilities of response in each category of summed symptom items and the lifetime use items broken down by latent class. Supplementary Figure 2* provides a visual representation of the probabilities of response for the dichotomous items broken down by latent class.
Table 3.
Response Probabilities for Each Latent Class
| Item | Low Problems | Alc. Primary | Alc. & Cannabis | Moderate PSU | Severe PSU |
|---|---|---|---|---|---|
| Sample % | 32% | 11% | 26% | 23% | 9% |
| Items with Six Response Categories | |||||
| Alc Sx | .5/.37/.1/ .02/.01/0 |
.07/.19/.32/ .17/.16/.09 |
.16/.33/.27/ .15/.07/.01 |
.06/.24/.3/ .18/.15/.06 |
.05/.14/.18/ .24/.17/.22 |
| Can Sx | 1/0/0/ 0/0/0 |
1/0/0/ 0/0/0 |
.24/.33/.22/ .12/.07/.03 |
.12/.23/.22/ .17/.17/.08 |
.08/.18/.2/ .21/.19/.13 |
| Stim Sx | 1/0/0/ 0/0/0 |
.94/.03/.01/ .01/0/0 |
.96/.02/.01/ 0/0/0 |
.55/.18/.12/ .08/.04/.03 |
.13/.12/.16/ .08/.2/.31 |
| OP Sx | 1/0/0/ 0/0/0 |
.99/0/0/ .01/0/0 |
.99/.01/0/ 0/0/0 |
.72/.14/.07/ .03/.02/.01 |
.09/.15/.13/ .16/.16/.31 |
| Sed Sx | 1/0/0/ 0/0/0 |
.98/0/.01/ .01/0/0 |
1/0/0/ 0/0/0 |
.81/.1/.04/ .03/.02/0 |
.23/.27/.16/ .12/.14/.08 |
| Items with Five Response Categories | |||||
| Can Use | .47/.41/.11/ 0/0 |
.1/.41/.39/ .1/0 |
.01/0/.02/ .53/.44 |
.03/0/.01/ .18/.78 |
.01/.01/0/ .06/.92 |
| Stim Use | .97/.03/0/ 0/0 |
.48/.34/.14/ .01/.02 |
.5/.36/.13/ .01/.01 |
.04/.19/.36/ .2/.21 |
.01/0/.09/ .1/.8 |
| OP Use | .99/.01/0/ 0/0 |
.71/.25/.02/ 0/.01 |
.64/.3/.05/ .01/0 |
.06/.39/.41/ .08/.05 |
0/.01/.12/ .12/.76 |
| Sed Use | .99/.01/0/ 0/0 |
.74/.23/.01/ .01/0 |
.71/.27/.02/ 0/0 |
.1/.45/.31/ .08/.05 |
.02/.02/.16/ .14/.66 |
| Hal Use | .99/.01/0/ 0/0 |
.76/.23/0/ 0/0 |
.52/.42/.05/ .01/0 |
.12/.52/.3/ .03/.03 |
.08/.22/.25/ .17/.28 |
| Other Use | .99/.01/0/ 0/0 |
.81/.17/.02/ 0/0 |
.69/.29/.02/ 0/0 |
.19/.55/.22/ .02/.02 |
.07/.23/.32/ .11/.26 |
| Dichotomous Items | |||||
| Alc Binge | .93/.07 | .37/.63 | .62/.38 | .36/.64 | .20/.80 |
| Alc for Cocaine | 1/0 | .98/.02 | .98/.02 | .71/.29 | .47/.53 |
| Alc+Can | .97/.03 | .88/.12 | .10/.90 | .19/.81 | .14/.86 |
| Alc+Stim | 1/0 | .97/.03 | .97/.03 | .73/.27 | .79/.21 |
| Alc+OP | 1/0 | .88/.12 | .88/.12 | .58/.42 | .34/.66 |
| Alc+Sed | 1/0 | .96/.04 | .96/.04 | .64/.36 | .37/.63 |
| Can+Stim | 1/0 | .99/.01 | .91/.09 | .53/.47 | .37/.63 |
| Can+OP | 1/0 | 1/0 | .89/.11 | .59/.41 | .44/.56 |
| Can+Sed | 1/0 | 1/0 | .98/.02 | .75/.25 | .63/.37 |
| Stim+OP | 1/0 | 1/0 | 1/0 | .93/.07 | .61/.39 |
| Stim+Sed | 1/0 | 1/0 | 1/0 | .94/.06 | .86/.14 |
| OP+Sed | 1/0 | .99/.01 | .99/.01 | .93/.07 | .75/.25 |
| Alc + Drug Interaction | 1/0 | .87/.13 | .93/.07 | .71/.29 | .54/.46 |
| Drug OD | 1/0 | .99/.01 | 1/0 | .94/.06 | .53/.47 |
Cells show the probability of endorsing each response category broken down latent classes. Sample % = the proportion of sample in each latent class. First value in each cell is the probability of endorsing the first response category followed by probability of following subsequent responses after each slash. Alc = Alcohol, Can = Cannabis, Stim = Stimulants, Op = Opiates, Sed = Sedatives, Sx = diagnostic symptoms, Alc for Cocaine = Using alcohol to mitigate the effects of coming down from cocaine, Alc/Drug Interaction = individuals who had a negative interaction from mixing alcohol with another drug, + = the co-use of the two substances, Drug OD = Drug overdose.
3.2. Multinomial Regression Results
Table 4 provides descriptive statistics of the measures used in multinomial regression analyses broken down by latent class, in addition to a breakdown of diagnoses by latent class. Table 5 provides the correlation between personality measures used in the current study. The “Alcohol Primary” class was chosen as the reference class to provide illustration of what factors may distinguish between single substance users (e.g. alcohol) and polysubstance users. Table 4 presents the odds ratios (OR) comparing all other latent classes to the “Alcohol Primary” class for the following measures age, antisocial personality, impulsive personality, experience seeking, trait anxiety, and neuroticism. In summary, measures of personality traits associated with externalizing psychopathology (i.e. antisocial, impulsivity, and experience seeking) were robust predictors of latent classes of high PSU severity compared to the “Alcohol Primary” class. Although, internalizing traits (i.e. anxiety and neuroticism) were also associated with more severe PSU classes, they were weaker predictors compared to externalizing measures.
Table 4.
Multinomial Regression Results
| Measure | Alcohol Primary | Low Use | Alcohol + Can | Moderate PSU | Severe PSU |
|---|---|---|---|---|---|
| n(female) | 213(92) | 677(329) | 537(299) | 476(275) | 195(120) |
| AUD Dx n(%) | 193(91%) | 163(24%) | 367(68%) | 346(73%) | 145(74%) |
| CUD Dx n(%) | 7(3%) | 1(<1%) | 397(72%) | 380(80%) | 163(84%) |
| Drug Dx n(%) | 14(7%) | 0(0%) | 26(5%) | 251(53%) | 188(96%) |
| Age (± SD) OR (n = 2098) |
21.67(2.45) - |
21.27(2.32) .94(.88,1.0)* |
21.24(2.38) .93(.88, .99)* |
21.51(2.51) .98(.92,1.04) |
23.84(3.66) 1.26(1.17,1.34) |
| Antisocial (± SD) OR (n = 2094) |
7.65(5.81) - |
2.90(3.54) .77(.74, .80) |
7.85(6.12) 1.00(.98, 1.03) |
11.13(7.26) 1.08(1.05, 1.11) |
17.90(8.88) 1.19(1.15, 1.22) |
| Impulsivity (±SD) OR (n = 2018) |
9.80(4.65) - |
6.43(4.37) .84(.81, .88) |
9.07(4.48) .97(.93, 1.00) |
10.62(4.20) 1.04(1.00, 1.08)* |
12.37(4.18) 1.15(1.09, 1.20) |
| Ex. Seeking (± SD) OR (n = 1826) |
5.95(2.24) - |
5.41(2.00) .90(.83, .97)** |
6.32(2.25) 1.08(1.0, 1.17)* |
6.61(2.26) 1.15(1.07, 1.26) |
7.15(1.98) 1.33(1.20, 1.48) |
| Anxiety (± SD) OR (n = 1810) |
42.09(10.49) - |
38.39(9.36) .96(.94, .98) |
40.05(8.90) .98(.96,1.00)* |
42.22(10.33) 1.00(.98, 1.02) |
46.61(10.74) 1.04(1.02, 1.06) |
| Neuroticism (±SD) OR (n = 1810) |
10.91(5.87) - |
7.55(5.19) .89(.87, .92) |
9.25(5.45) .95(.92, .98) |
10.95(5.59) 1.00(.97, 1.03) |
13.64(5.53) 1.09(1.05, 1.13) |
Dx = Diagnosis, AUD = Alcohol Use Disorder, CUD = Cannabis, Drug = other illicit drugs besides Cannabis, Antisocial = antisocial personality disorder measure, Ex. Seeking = Experience Seeking. The n value below each measure is the available n for each analysis. In the top row of each cell is the mean of the measure in each latent class along with standard deviation. Below is the Odds Ratio (OR) compared to the alcohol primary group for each given measure along with the 95% confidence intervals. The alcohol primary group served as the reference group for all analyses. Bolded values with asterisk are significant at p <.001
= p < .01
= p < .05, non-bolded ORs = not significant at p < .05.
Table 5.
Correlation of Personality Measures
| Antisocial | Impulsivity | Ex. Seeking | Anxiety | Neuroticism | |
|---|---|---|---|---|---|
| Antisocial | 1.00 | - | - | - | - |
| Impulsivity | 0.46 | 1.00 | - | - | - |
| Ex. Seeking | 0.25 | 0.24 | 1.00 | - | - |
| Anxiety | 0.29 | 0.28 | 0.06* | 1.00 | - |
| Neuroticism | 0.35 | 0.35 | 0.11 | 0.79 | 1.00 |
Pearson correlations.
= p < .05, not marked = significant at p < .001.
Ex. Seeking = Experience Seeking
4. Discussion
The current study aimed to identify common polysubstance use patterns and analyze what behaviors distinguish between classes of higher severity in a high-risk young adult population. LCA identified a five-class solution that followed an additive pattern of escalating PSU starting with a group with very low problems with any substance, followed by groups characterized by alcohol/cannabis use, and finally classes with heavy use of many drug classes. Items assessing co-use provide excellent discrimination between different levels of severity, indicating that individuals who use two substances simultaneously are very likely to have disordered use of both substances. Unsurprisingly, personality measures associated with externalizing pathology (antisocial, experience seeking, and impulsivity) were robust predictors of PSU compared to non-users. Interestingly, internalizing traits (trait anxiety and neuroticism) were elevated in the highest severity classes.
Latent class analysis based on class interpretability and relevant fit statistics identified a five-class solution. The first class labeled “Low Problems” can be characterized by mild to moderate alcohol use, experimentation with cannabis without features of problematic cannabis use, and negligible to nonexistent experimentation with other illicit substances. Interestingly, as shown in Table 4, about 24% of the “Low Problems” group had a diagnosed AUD. However, it is likely that despite having an AUD diagnosis, those in the “Low Problems” class actually have overall mild problematic substance use. Studies have shown that AUD criteria may diagnose individuals who actually have quite limited psychological dysfunction (Wakefield and Schmitz, 2015, 2014) and more stringent criteria should be considered to identify truly harmful alcohol/substance use. The second class identified was an “Alcohol Primary” class characterized by varying levels of alcohol use symptom severity (91% with AUD) and experimentation with cannabis and stimulants. Interestingly, the “Alcohol Primary” class only made up about 10% of the current sample. This is surprising given that the current sample was recruited primarily for individuals with alcohol misuse and simply allowed for co-occurring substance use. This highlights the importance of assessment of multiple substance use given the relative rarity of pathological alcohol use without significant levels of co-occurring use of other substances. The remaining three classes were consistent with previous literature that finds an additive pattern of polysubstance use starting with alcohol and cannabis use and then use of other illicit drugs such as stimulants, opiates, and sedatives (see Connor et al., 2014 for review). This pattern of additive use may suggest that the identified classes are best conceptualized as meaningful slices of a general substance use severity dimension rather than truly discrete patterns of polysubstance use.
Multinomial regression results examined the association between age and personality traits associated with externalizing and internalizing disorders respectively. The “Alcohol Primary” class was chosen as the reference category in multinomial regressions to examine what distinguished more extreme polysubstance use from predominantly alcohol use alone. As shown in Table 4, the classes appeared very close in age with only the “Severe PSU” group being meaningfully older. This may indicate that the “Severe PSU” may simply be farther along in a developmental trajectory of severe substance use than other classes. Consistent with previous research (Agrawal et al., 2007), antisocial personality was a robust discriminator between classes, with the “Alcohol Primary” class have significantly higher levels of antisocial personality than the “Low Problems” group, but also significantly lower levels than the “Moderate PSU” and “Severe PSU” classes. A similar pattern was observed with the measures of experience seeking and impulsivity. Overall, personality characteristics associated with externalizing pathology were lowest in the “Low Problems” class, and then increased in the “Alcohol Primary” and “Alcohol and Cannabis” classes, with the highest levels in the “Moderate PSU” and “Severe PSU” classes. Internalizing measures of personality (i.e. trait anxiety and neuroticism) were overall less strongly related to class membership than externalizing measures, however they did distinguish the highest severity class. Results indicated that the “Low Problems” class was associated with lower anxiety and neuroticism than the “Alcohol Primary” class. Only the “Severe PSU” class had higher levels of anxiety and neuroticism than the “Alcohol Primary” class. This supports the conceptualization that these classes are closely related to the general externalizing dimension of personality and pathology. Furthermore, individuals who struggle with both impulse regulation (e.g. substance use) and affect/anxiety regulation in tandem may be at particular risk to experience severe forms of psychopathology, in this case severe PSU.
Close examination of the latent class item probabilities in Table 3 (visually represented in supplementary Figures 1 and 2)* shows several important insights related to polysubstance use patterns and co-use behaviors. Importantly, results demonstrate the importance in the assessment of multiple substances given that abuse of one substance is usually co-occurring with at least significant experimentation of other substances. The classes suggest an additive progression from alcohol and alcohol/cannabis, to introduction of stimulant, opiate, and sedative use, and eventually in some individuals’ harmful use of many substances. Therefore, experimentation with a class of drug associated with higher severity (e.g. opiates) mostly likely indicates already existing significant use of alcohol and cannabis. Furthermore, simultaneous co-use items appear to be especially valuable markers of severity that discriminate between the identified classes. Simultaneous co-use of alcohol and cannabis was endorsed by about 50% of the current sample and interestingly is almost completely absent in the “Low Problems” and “Alcohol Primary” classes (see Table 4). This indicates that co-use of cannabis and alcohol is present in individuals who have at least had significant experimentation with both substances. Interestingly, moderate to high probability of simultaneous co-use of alcohol and any other illicit substance, co-use of cannabis with another illicit drug, or co-use of two illicit drugs besides cannabis were almost exclusively in the “Moderate PSU” and “Severe PSU” groups. This shows that simultaneous co-use of substances, with the exception of alcohol/cannabis, is an excellent indicator of high severity polysubstance use patterns. In summary, it appears that generally simultaneous co-use of substances is indicative of significant concurrent use of the given substances.
This study needs to be interpreted in light of its limitations. Given that the sample in the current study was collected for various studies of alcohol misuse and co-occurring externalizing problems, the current study likely has an underrepresentation of individuals with substance use problems in the absence of alcohol problems. Furthermore, the current study was not able to distinguish between abuse of prescription versus non-prescription drug use. The U.S. National Survey on Drug Use and Health reported that about 6% of Americans older than 12 years old have reported nonmedical prescription drug use (NMPDU) and 2.7% reported NMPDU in the past month (SAMSHSA, 2013). Future work should aim to study NMPDU patterns of use and examine how these patterns compare to more commonly studied patterns of illicit drug use. The current study was only able to assess the co-use of two substances simultaneously. In addition, the current study is restricted to a sample of young adults (ages 18 to 30) and therefore may not generalize to patterns observed in for example older adults. The current study is also constrained by cross-sectional data. Future studies should examine the relative stability of these patterns across time and common progression from one class to the other. Given that a portion of the sample, for structural reasons, did not complete some personality measures, we chose to fit the LCA model with the full sample and then validate using a subset of the sample using multinomial regression. Simulation studies have shown that this approach may lead to down biased associations between measures and latent class membership (Vermunt, 2010), however we believe this approach allowed us to maximize our sample for LCA estimation and present our results most clearly. Finally, LCA models have an assumption of local independence, meaning that there are not additional dependencies between items after accounting for class membership. Several studies have demonstrated that this may not always been practical in psychological research (Oberski et al., 2013; Reboussin et al., 2008). Future work should continue to analyze how these issues influence model estimation, however we believe given our consistency with previous findings our findings are unlikely driven by spurious effects caused by unaccounted for local dependence.
In summary, the current provides an illustration of common patterns of alcohol and illicit substance use in a large sample of high-risk young adults. Results indicated, consistent with previous research, that patterns of substance use are best conceptualized as increasingly severe additive substance use. Multinomial regression further validated this conceptualization by demonstrating the strong link between class membership and personality measures associated with externalizing pathology. Lastly, the current study demonstrates how simultaneous co-use behaviors serve as robust markers of severity that discriminate between different levels of polysubstance use.
Supplementary Material
Highlights.
Simultaneous co-use of substances was a powerful indicator of substance use severity
Simultaneous co-use of alcohol/cannabis was quite common
Lower severity polysubstance use consisted of alcohol and/or cannabis
High severity polysubstance use consisted of other illicit drugs in addition
Problematic use of alcohol, without problems with other substances, was quite rare
Antisocial, impulsive, and excitement seeking traits predicted polysubstance use severity
Severe polysubstance use was associated with high levels of anxiety/neuroticism
Acknowledgments
Role of Funding Source
This research was supported by National Institutes of Alcohol Abuse and Alcoholism grant [R01AA13650] and National Institute of Drug Abuse grant [DA017924] to Peter R. Finn and National Institute of Drug Abuse grant [T32 DA24628–10] to Allen Bailey.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Conflict of Interest
No conflict declared
Supplementary material can be found by accessing the online version of this paper.
References
- Agrawal A, Lynskey MT, Madden PAF, Bucholz KK, Heath AC, 2007. A latent class analysis of illicit drug abuse/dependence: Results from the national epidemiological survey on alcohol and related conditions. Addiction. 10.1111/j.1360-0443.2006.01630.x. [DOI] [PubMed]
- American Psychiatric Association., 2013. DSM-V, Am. J. Psychiatry. 10.1176/appi.books.9780890425596.744053. [DOI]
- American Psychiatric Association., 2000. Diagnostic and statistical manual of mental disorders: DSM-IV-TR (text revision), Am. J. Psychiatry.
- Barnes LLB, Harp D, Jung WS, 2002. Reliability generalization of scores on the spielberger state-trait anxiety inventory. Educ. Psychol. Meas. 62, 603–618. 10.1177/0013164402062004005. [DOI] [Google Scholar]
- Bierut LJ, Dinwiddie SH, Begleiter H, Crowe RR, Hesselbrock V, Nurnberger JI, Porjesz B, Schuckit MA, Reich T, 1998. Familial transmission of substance dependence: Alcohol, marijuana, cocaine, and habitual smoking: A report from the collaborative study on the genetics of alcoholism. Arch. Gen. Psychiatry. 10.1001/archpsyc.55.11.982. [DOI] [PubMed]
- Bucholz KK, Cadoret R, Cloninger CR, Dinwiddie SH, Hesselbrock VM, Nurnberger JI, Reich T, Schmidt I, Schuckit MA, 1994. A new, semi-structured psychiatric interview for use in genetic linkage studies: a report on the reliability of the SSAGA. J. Stud. Alcohol 55, 149–158. 10.15288/jsa.1994.55.149. [DOI] [PubMed] [Google Scholar]
- Bucholz KK, Hesselbrock VM, Shayka JJ, Nurnberger JI, Schuckit M. a, Schmidt I, Reich T, 1995. Reliability of individual diagnostic criterion items for psychoactive substance dependence and the impact on diagnosis. J. Stud. Alcohol. 10.15288/jsa.1995.56.500. [DOI] [PubMed]
- Carragher N, Krueger RF, Eaton NR, Markon KE, Keyes KM, Blanco C, Saha TD, Hasin DS, 2014. ADHD and the externalizing spectrum: Direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample. Soc. Psychiatry Psychiatr. Epidemiol. 49, 1307–1317. 10.1007/s00127-013-0770-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Caspi A, Houts RM, Belsky DW, Goldman-Mellor SJ, Harrington H, Israel S, Meier MH, Ramrakha S, Shalev I, Poulton R, Moffitt TE, 2014. The p factor: One general psychopathology factor in the structure of psychiatric disorders? Clin. Psychol. Sci. 2, 119–137. 10.1177/2167702613497473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Caspi A, Moffitt TE, 2018. All for one and one for all: Mental disorders in one dimension. Am. J. Psychiatry. 10.1176/appi.ajp.2018.17121383. [DOI] [PMC free article] [PubMed]
- Celeux G, Soromenho G, 1996. An entropy criterion for assessing the number of clusters in a mixture model. J. Classif. 10.1007/BF01246098. [DOI]
- Connor JP, Gullo MJ, Chan G, Young RMD, Hall WD, Feeney GFX, 2013. Polysubstance use in cannabis users referred for treatment: Drug use profiles, psychiatric comorbidity and cannabis-related beliefs. Front. Psychiatry. 10.3389/fpsyt.2013.00079. [DOI] [PMC free article] [PubMed]
- Connor JP, Gullo MJ, White A, Kelly AB, 2014. Polysubstance use: Diagnostic challenges, patterns of use and health. Curr. Opin. Psychiatry. 10.1097/YCO.0000000000000069. [DOI] [PubMed]
- Dempster APP, Laird NM, Rubin DB, Rubin DB, 1977. Maximum Likelihood from Incomplete Data via the EM Algorithm, Royal Statistical Society. Series B (Methodological). 10.2307/2984875. [DOI]
- Eysenck HJ, Eysenck SBG, 1975. Manual of the Eysenck Personality Questionnaire, J. Pers. Assess. 10.1177/014662168000400106. [DOI]
- Eysenck S, Zuckerman M, 1978. The relationship between sensation???seeking and Eysenck’s dimensions of personality. Br. J. Psychol. 10.1111/j.2044-8295.1978.tb02125.x. [DOI]
- Eysenck SBG, Pearson PR, Easting G, Allsopp JF, 1985. Age norms for impulsiveness, venturesomeness and empathy in adults. Pers. Individ. Dif. 6, 613–619. 10.1016/0191-8869(85)90011-X. [DOI] [Google Scholar]
- Feigelman W, Gorman BS, Lee JA, 1998. Binge drinkers, illicit drug users, and polydrug users: An epidemiological study of American collegians. J. Alcohol Drug Educ.
- Finn PR, 2002. Motivation, working memory, and decision making: a cognitive-motivational theory of personality vulnerability to alcoholism. Behav. Cogn. Neurosci. Rev. 10.1177/1534582302001003001. [DOI] [PubMed]
- Finn PR, Gunn RL, Gerst KR, 2014. The Effects of a working memory load on delay discounting in those with externalizing psychopathology. Clin. Psychol. Sci. 3, 202–214. 10.1177/2167702614542279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Finn PR, Rickert ME, Miller MA, Lucas J, Bogg T, Bobova L, Cantrell H, 2009. Reduced Cognitive Ability in Alcohol Dependence: Examining the Role of Covarying Externalizing Psychopathology. J. Abnorm. Psychol. 118, 100–116. . [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hedden SL, Martins SS, Malcolm RJ, Floyd L, Cavanaugh CE, Latimer WW, 2010. Patterns of illegal drug use among an adult alcohol dependent population: Results from the National Survey on Drug Use and Health. Drug Alcohol Depend. 10.1016/j.drugalcdep.2009.08.002. [DOI] [PMC free article] [PubMed]
- Herbeck DM, Brecht ML, Lovinger K, Raihan A, Christou D, Sheaff P, 2013. Poly-Drug and Marijuana Use Among Adults Who Primarily Used Methamphetamine. J. Psychoactive Drugs. 10.1080/02791072.2013.785824. [DOI] [PubMed]
- Hesselbrock M, Easton C, Bucholz KK, Schuckit M, Hesselbrock V, 1999. A validity study of the SSAGA--a comparison with the SCAN. Addiction 94, 1361–70. 10.1046/j.1360-0443.1999.94913618.x. [DOI] [PubMed] [Google Scholar]
- Hicks BM, Krueger RF, Iacono WG, McGue M, Patrick CJ, 2004. Family transmission and heritability of externalizing disorders: A Twin-Family Study. Arch. Gen. Psychiatry 61, 922–928. 10.1001/archpsyc.61.9.922. [DOI] [PubMed] [Google Scholar]
- Iacono WG, Malone SM, McGue M, 2008. Behavioral Disinhibition and the Development of Early-Onset Addiction: Common and Specific Influences. Annu. Rev. Clin. Psychol. 4, 325–348. 10.1146/annurev.clinpsy.4.022007.141157. [DOI] [PubMed] [Google Scholar]
- Kandel DB, 2002. Stages and Pathways of Drug Involvement: Examining the Gateway Hypothesis, in: Adolescence.
- Kendler KS, Davis CG, Kessler RC, 1997. The familial aggregation of common psychiatric and substance use disorders in the National Comorbidity Survey: A family history study. Br. J. Psychiatry 170, 541–548. 10.1192/bjp.170.6.541. [DOI] [PubMed] [Google Scholar]
- Kerr T, Fairbairn N, Tyndall M, Marsh D, Li K, Montaner J, Wood E, 2007. Predictors of non-fatal overdose among a cohort of polysubstance-using injection drug users. Drug Alcohol Depend. 10.1016/j.drugalcdep.2006.07.009. [DOI] [PubMed]
- Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE, 2005. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Erratum appears in Arch Gen Psychiatry. 2005 July;62(7):709 Note: Merikangas, Kathleen R added. Arch. Gen. Psychiatry. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krueger RF, 1999. The structure of common mental disorders. Arch. Gen. Psychiatry 56, 921–926. 10.1001/archpsyc.56.10.921. [DOI] [PubMed] [Google Scholar]
- Krueger RF, Hicks BM, Patrick CJ, Carlson SR, Iacono WG, McGue M, 2002. Etiologic connections among substance dependence, antisocial behavior, and personality: Modeling the externalizing spectrum. J. Abnorm. Psychol. 111, 411–424. 10.1037/0021-843X.111.3.411. [DOI] [PubMed] [Google Scholar]
- Krueger RF, Markon KE, Patrick CJ, Iacono WG, 2005. Externalizing psychopathology in adulthood: A dimensional-spectrum conceptualization and its implications for DSM-V. J. Abnorm. Psychol. 10.1037/0021-843X.114.4.537. [DOI] [PMC free article] [PubMed]
- Lahey BB, Krueger RF, Rathouz PJ, Waldman ID, Zald DH, 2017. A hierarchical causal taxonomy of psychopathology across the life span. Psychol. Bull. 10.1037/bul0000069. [DOI] [PMC free article] [PubMed]
- Linzer DA, Lewis JB, 2011. poLCA : An R Package for Polytomous Variable Latent Class Analysis. J. Stat. Softw. 10.18637/jss.v042.i10. [DOI]
- M., E., D, N.M, 1997. Concurrent versus simultaneous polydrug use: Prevalence, correlates, discriminant validity, and prospective effects on health outcomes. Exp. Clin. Psychopharmacol. [DOI] [PubMed]
- McCabe SE, West BT, Jutkiewicz EM, Boyd CJ, 2017. Multiple DSM-5 substance use disorders: A national study of US adults. Hum. Psychopharmacol. 10.1002/hup.2625. [DOI] [PMC free article] [PubMed]
- Nylund KL, Asparouhov T, Muthén BO, 2007. Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Struct. Equ. Model. 10.1080/10705510701575396. [DOI]
- Oberski DL, van Kollenburg GH, Vermunt JK, 2013. A Monte Carlo evaluation of three methods to detect local dependence in binary data latent class models. Adv. Data Anal. Classif. 10.1007/s11634-013-0146-2. [DOI]
- Olthuis JV, Darredeau C, Barrett SP, 2013. Substance use initiation: The role of simultaneous polysubstance use. Drug Alcohol Rev. 10.1111/j.1465-3362.2012.00470.x. [DOI] [PubMed]
- Petry NM, 2001. A behavioral economic analysis of polydrug abuse in alcoholics: Asymmetrical substitution of alcohol and cocaine. Drug Alcohol Depend. 10.1016/S0376-8716(00)00157-5. [DOI] [PubMed]
- Quek L-H, Chan GCK, White A, Connor JP, Baker PJ, Saunders JB, Kelly AB, 2013. Concurrent and Simultaneous Polydrug Use: Latent Class Analysis of an Australian Nationally Representative Sample of Young Adults. Front. Public Heal. 10.3389/fpubh.2013.00061. [DOI] [PMC free article] [PubMed]
- R Development Core Team., 2013. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria: URL http://www.R-project.org/. R Found. Stat. Comput. Vienna, Austria. [Google Scholar]
- Reboussin BA, Ip EH, Wolfson M, 2008. Locally dependent latent class models with covariates: An application to under-age drinking in the USA. J. R. Stat. Soc. Ser. A Stat. Soc. 10.1111/j.1467-985X.2008.00544.x. [DOI] [PMC free article] [PubMed]
- Sato T, 2005. The Eysenck Personality Questionnaire Brief Version: Factor Structure and Reliability. J. Psychol. 139, 545–552. 10.3200/JRLP.139.6.545-552 [DOI] [PubMed] [Google Scholar]
- Sclove SL, 1987. Application of model-selection criteria to some problems in multivariate analysis. Psychometrika. 10.1007/BF02294360. [DOI]
- Sher KJ, Trull TJ, 1994. Personality and disinhibitory psychopathology: Alcoholism and antisocial personality disorder. J. Abnorm. Psychol. 103, 92–102. 10.1037/0021-843X.103.1.92. [DOI] [PubMed] [Google Scholar]
- Spielberger CD, 1983. Manual for the State-Trait Anxiety Inventory (STAI Form Y), Consulting Psychologists Palo Alto. 10.1002/9780470479216.corpsy0943. [DOI]
- Stekhoven DJ, Bühlmann P, 2012. Missforest-Non-parametric missing value imputation for mixed-type data. Bioinformatics. 10.1093/bioinformatics/btr597. [DOI] [PubMed]
- Tomczyk S, Isensee B, Hanewinkel R, 2016. Latent classes of polysubstance use among adolescents-a systematic review. Drug Alcohol Depend. 10.1016/j.drugalcdep.2015.11.035. [DOI] [PubMed]
- Vermunt JK, 2010. Latent class modeling with covariates: Two improved three-step approaches. Polit. Anal. 10.1093/pan/mpq025. [DOI]
- Vollebergh WAM, Iedema J, Bijl RV, de Graaf R, Smit F, Ormel J, 2001. The structure and stability of common mental disorders: The nemesis study. Arch. Gen. Psychiatry 58, 597–603. https://doi.org/yoa20186 [pii]. [DOI] [PubMed] [Google Scholar]
- Wakefield JC, Schmitz MF, 2015. The harmful dysfunction model of alcohol use disorder: Revised criteria to improve the validity of diagnosis and prevalence estimates. Addiction. 10.1111/add.12859. [DOI] [PubMed]
- Wakefield JC, Schmitz MF, 2014. How many people have alcohol use disorders? Using the harmful dysfunction analysis to reconcile prevalence estimates in two community surveys. Front. Psychiatry. 10.3389/fpsyt.2014.00010. [DOI] [PMC free article] [PubMed]
- Waljee AK, Mukherjee A, Singal AG, Zhang Y, Warren J, Balis U, Marrero J, Zhu J, Higgins PDR, 2013. Comparison of imputation methods for missing laboratory data in medicine. BMJ Open. 10.1136/bmjopen-2013-002847. [DOI] [PMC free article] [PubMed]
- White A, Chan GCK, Quek LH, Connor JP, Saunders JB, Baker P, Brackenridge C, Kelly AB, 2013. The topography of multiple drug use among adolescent Australians: Findings from the National Drug Strategy Household Survey. Addict. Behav. 10.1016/j.addbeh.2013.01.001. [DOI] [PubMed]
- Wickham H, 2016. ggplot2 - Elegant Graphics for Data Analysis, in: J. Stat. Softw. 10.18637/jss.v077.b02. [DOI]
- Yee TW, 2015. Vector Generalized Linear and Additive Models: With an Implementation in R, Vector Generalized Linear and Additive Models: With an Implementation in R. 10.1007/978-1-4939-2818-7. [DOI]
- Zuckerman M, 1979. Sensation seeking: Beyond the optimal level of arousal. Pers. Individ. Dif. 10.1016/0191-8869(80)90044-6. [DOI]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
