Abstract
In the psychological science field, there is substantial interest in quantifying individual differences in self-regulatory capacity because of its transdiagnostic relevance to various forms of psychopathology. Trait disinhibition and impulsiveness are popular conceptualizations of dispositions reflecting self-regulation of behavioral and emotional responding. In the literature, these constructs are often treated interchangeably due to their shared focus on general disconstraint and a lack of direct comparisons between measures of each. The current work used structural modeling to examine conceptual and empirical differences between two popular operationalizations of these traits in two samples (Ns = 400, 308), and employed regression and dominance analyses to compare their predictive relations with criterion measures of externalizing problems and negative affectivity (NA). Impulsigenic traits were related both to externalizing problems and NA, whereas trait disinhibition was selectively associated with externalizing. In a dominance analysis, trait disinhibition exhibited ‘complete dominance’ over all impulsigenic traits in predicting externalizing problems. Conversely, multiple impulsigenic traits evidenced complete dominance over trait disinhibition in prediction of NA. The current work provides evidence that (1) disinhibition and impulsigenic traits are not interchangeable; (2) disinhibition specifically indexes propensity for externalizing problems; and (3) impulsigenic traits reflect a blend of externalizing and NA that appears relevant to diverse forms of psychopathology.
Keywords: Disinhibition, Impulsivity, Externalizing, Negative Affectivity, Dominance Analysis
Psychological scientists have long been interested in self-regulatory capacity due to its broad relevance to a host of psychological and behavioral outcomes. This construct is particularly important for clinical psychological science, as it is thought to operate as a transdiagnostic liability for psychopathological outcomes involving weak impulse control, poor emotional control, and dysregulated behavior. Several conceptualizations of trait dispositions relevant to self-regulatory ability are popular in the literature, including the construct of disinhibition reflected in the Externalizing Spectrum Inventory and the Triarchic Psychopathy Measure (ESI, Krueger et al., 2007; TriPM, Patrick, 2010), and the set of impulsivity-promoting (“impulsigenic”) traits measured by the UPPS-P scale (Negative Urgency, Premeditation, Perseverance, Sensation Seeking, and Positive Urgency, Whiteside & Lynam, 2001; Lynam et al., 2006). However, to date, it has not yet been clearly explicated what distinguishes disinhibition and impulsigenic traits — or if they are functionally interchangeable while being named differently (e.g., a case of the “jangle fallacy”; Kelley, 1927; Pedhazur, 1991; Thorndike, 1904). Further complicating this matter, the UPPS-P model is argued to represent five separate, divergent pathways to impulsive behavior (Smith, Whiteside, & Cyders, 2006), whereas disinhibition is conceptualized as a higher-order construct encompassing converging subfactors within the context of the externalizing spectrum model (Krueger et al., 2007). Thus, the current work sought to (1) illustrate areas of convergence and divergence between disinhibition and impulsigenic traits, and (2) compare the two models in predicting psychopathology-relevant criterion measures (i.e., externalizing problems and negative affective proclivities/problems).
Construct Definitions and Nomological Networks
Disinhibition.
Trait disinhibition is a dispositional construct encompassing recklessness, lack of planning and forethought, and deficient emotional and behavioral control (Patrick, Fowles, & Krueger, 2009). Although several models of personality and psychopathology include variations on the term “disinhibition,” the specific construct examined in this study is the common trait liability promoting risk for a range of disorders characterized by poor behavioral control (Krueger et al., 2002). One well-validated operationalization of trait disinhibition in the self-report domain comes from the Externalizing Spectrum Inventory (ESI; Krueger et al., 2007; Patrick et al., 2013a). Conceptually, ESI disinhibition is related to constructs from other models related to externalizing behavior, including Barratt’s (1994) impulsiveness as well as the low pole of the constraint dimension (i.e., hypothesized latent continuum of capacity for self-restraint) indexed by the Multidimensional Personality Questionnaire (MPQ; Tellegen, 1982). However, it differs from constructs tapped by these impulsivity measures in that it was deduced from twin-study research demonstrating a highly heritable factor accounting for systematic covariance among externalizing problems of various types and disinhibitory personality traits (e.g., Krueger et al., 2002; Young et al., 2001).
Prior research has demonstrated the utility of the latent construct indexed by the ESI’s general factor, showing that self-report scale measures of this disinhibition factor concurrently and prospectively predict multiple externalizing outcomes, including substance dependence (Iacono, Malone, & McGue, 2008, Joyner et al., 2019; Krueger et al., 2002; Tarter et al., 2004) along with conduct and attentional problems (Brislin et al., 2019). Furthermore, scale-assessed disinhibition is highly heritable (Yancey et al., 2013), and twin modeling work has shown that genetic influences on disinhibition explain a substantial amount of variance in the heritability of substance use disorders (Hicks et al., 2011; Joyner et al., 2020; Vrieze et al., 2013) and other externalizing problems (Yancey et al., 2013). Given these and other lines of evidence (see Nelson & Foell, 2018, for a review), trait disinhibition has been conceptualized as a liability factor for externalizing psychopathology (Perkins, Joyner, et al., 2020; see also Iacono et al., 1999; Patrick et al., 2013b; Young et al., 2009). Importantly, disinhibition can be operationalized in other modalities of measurement besides self-report, including poor behavioral performance on executive function tasks (Venables et al., 2018; Young et al., 2009) and impaired brain responding in cognitive-attentional tasks (Brennan & Baskin-Sommers, 2018; Iacono et al., 2002; Nelson et al., 2011; Patrick et al., 2006, 2013b; Yancey et al., 2013). Critically, the brain response measures found to covary with self-reported disinhibition prospectively predict the later emergence of substance use problems in individuals assessed prior to the onset of such problems (Iacono et al., 1999; 2002; Hill et al., 2009; Habeych et al., 2005). Although indexed in the current study using a self-report scale measure, the latent construct of ESI disinhibition thus reflects a broader neurobehavioral trait dimension anchored in behavioral performance and neural response in addition to experiential report (Patrick et al., 2013b, 2019; Venables et al., 2018).
Impulsivity and impulsigenic traits.
As with disinhibition, the term “impulsivity” has multiple meanings and connotations in the literature. The current study focused on the well-known model of impulsivity put forth by Lynam and colleagues (Lynam, Smith, Whiteside, & Cyders, 2006; Whiteside & Lynam, 2001) to consolidate these varied conceptualizations. In this model, impulsive behavior is viewed as an equifinal outcome that can result from various distinct impulsivity-promoting dispositions, or impulsigenic traits: heightened urgency for rash action driven by positive or negative mood states (“positive” and “negative urgency,” respectively); suboptimal pre-planning (“lack of premeditation”); poor sustained attention and prolonged goal pursuit (“lack of perseverance”); and propensity to engage in high-intensity or risky behaviors (“sensation seeking”). These five traits comprise the UPPS-P model1 and eponymous self-report measure (Lynam et al., 2006). The UPPS-P model was conceptually derived from the five-factor model of personality (FFM; Costa & McCrae, 1992), based on the idea that differing impulsigenic tendencies reflect ostensibly similar behavioral manifestations of core FFM traits (Lynam et al., 2006). The original paper on this model explained that 1) urgency is the manifestation of the ‘impulsiveness’ facet of FFM neuroticism; 2) lack of premeditation derives from the ‘lack of deliberation’ facet of conscientiousness; 3) lack of perseverance stems from the ‘self-discipline’ facet of conscientiousness; and 4) sensation seeking arises from the ‘excitement seeking’ facet of extraversion (Whiteside & Lynam, 2001; Lynam et al., 2006).
Myriad studies have demonstrated a concurrent and prospective link between impulsigenic traits and externalizing behavior (Carlson, Pritchard, & Dominelli, 2013; Settles, Fischer, & Cyders, 2012; Whiteside & Lynam, 2003), including several meta-analyses (Berg, Latzman, Bliwise, & Liliendfeld, 2015; Coskunpinar, Dir, & Cyders, 2013). However, self-report measures of these traits do not typically relate robustly to behavioral performance on executive function tasks (Derefinko et al., 2014; MacKillop et al., 2016) nor to the blunted brain reactivity observed for disinhibition (Petit, Kornreich, Noël, Verbanck, & Campanella, 2012). Furthermore, while early models of impulsivity conceptualized it as orthogonal to fear and anxiety (Barratt, 1965; Gray, 1978), the UPPS-P model includes explicit, substantial representation of negative affectivity (NA; Settles et al., 2012), which is a dispositional proneness to experience greater levels of negative emotion (Clark et al., 1994).
Although it is unsurprising that dysregulated behavior would be associated with negative emotional experiences, it should be noted that the observed covariation that impulsivity shows (when defined in terms of proneness to unplanned, emotion-driven action) with NA and internalizing problems is attributable substantially to common genetic influences (Gustavson et al., 2017; Racine et al., 2013). This suggests that the impulsigenic traits indexed by the UPPS-P may share etiological influences with both internalizing and externalizing psychopathology, reducing the specificity of their prediction to externalizing forms of psychopathology. Indeed, Whiteside & Lynam (2003) demonstrated that individuals with alcohol dependence showed elevations on all impulsigenic traits compared to controls, but these differences were eliminated when controlling for other types of psychopathology symptoms. Taken together, these empirical findings suggest that UPPS-P traits are saturated with negative-affect related variance, including variance not associated with externalizing psychopathology,2 in contrast to the specific neurobehavioral predisposition to externalizing represented by trait disinhibition.
Commonalities and Divergence Between Disinhibition and Impulsigenic Traits
As one might expect, there are several commonalities between disinhibition and impulsigenic traits due to their shared focus on disconstraint and dysregulation and their demonstrated links with psychopathology. For example, meta-analyses suggest that all five UPPS-P facets relate to substance use and aggression, with particularly strong associations for positive and negative urgency (Berg et al., 2015). Similarly, although a meta-analysis has yet to be conducted, numerous studies have reported links between trait disinhibition and various forms of externalizing psychopathology, including conduct problems, aggressive-antisocial behavior, and substance abuse (Iacono, Malone, & McGue, 2008, Joyner et al., 2019; 2020; Krueger et al., 2002; Tarter et al., 2004).
However, there are also salient points of divergence. Most broadly, the two models differ substantially in their approach to explaining behavioral dysregulation: Impulsigenic traits are conceptualized as separable, etiologically distinct phenomena, whereas disinhibition is characterized as a single, coherent liability factor for externalizing problems specifically. As a result, the UPPS-P self-report scale aims to provide a measure of various pathways to impulsive behavior thought to contribute to psychopathology, whereas the ESI Disinhibition scale was designed to capture the latent liability factor for externalizing reflected in the systematic covariance among different externalizing disorders that has been further characterized through twin (e.g., Patrick et al., 2013b; Yancey et al., 2013) and multi-method research studies (e.g., Venables et al., 2018). Authors of the UPPS-P measure articulate the importance of the UPPS-P model of impulsivity being treated as multidimensional instead of unidimensional (Whiteside & Lynam, 2001; Sperry, Lynam, Walsh, Horton, & Kwapil, 2016), whereas the authors of the ESI explicitly articulate the need for conceptualizing and measuring disinhibition as coherent dimension reflecting dispositional liability toward externalizing problems (Krueger et al., 2007; Patrick et al., 2013; Patrick et al., in press).
Relatedly, the two models differ in the depth and breadth of psychopathology they seek to explain. All five UPPS-P traits relate quite robustly to both internalizing (e.g., depression, suicidality) and externalizing symptoms (e.g., substance use) across studies (Berg et al., 2015). Given the importance of demarcating individual differences underlying broad, hierarchical psychopathology dimensions more clearly (Lynam & Miller, 2019), systematic research is needed to characterize trait dispositions conducive to internalizing and externalizing problems more distinctly from one another. Compared to the associations with both internalizing and externalizing problems exhibited by the UPPS-P traits, trait disinhibition is markedly more strongly related to externalizing than internalizing pathology (Nelson et al., 2016). Whereas UPPS-P traits appear to capture behavioral dysregulation and emotional instability that relates broadly to psychopathology, these traits do not show systematic associations with behavioral measures of inhibitory control (see, e.g., Cyders & Coskunpinar, 2011; MacKillop et al., 2016; Whiteside & Lynam, 2001). Trait disinhibition, on the other hand relates more specifically to externalizing problems, and demonstrates associations with neurophysiological as well as behavioral indicators of inhibitory control (Brislin et al., 2019; Ribes-Guardiola et al., 2020; Venables et al., 2018; Yancey et al., 2013; see also Young et al., 2009). These lines of evidence indicate that trait disinhibition may provide a more robust and specific index of latent externalizing liability.
Dominance Analysis
Given evidence supporting the value of both trait disinhibition and impulsigenic traits to clinical psychological research, it is useful to consider what types of questions might best be addressed using one versus the other. The current work was undertaken to provide empirical guidance on this topic through use of an under-utilized statistical approach, dominance analysis – along with the well-known approach of structural modeling. While tools for comparing the magnitude of bivariate correlations exist (e.g., Steiger-Z test; Steiger, 1980), these tools cannot be extended to multivariate regression models due to multiple predictor collinearity. The technique of dominance analysis (Budescu, 1993; Azen & Budescu, 2003) was developed to overcome the pitfalls of high collinearity between predictors, by defining predictor importance in terms of total unique variance accounted for in an outcome variable. Additionally, by allowing individual predictors to fall into differing ‘tiers’ of dominance, the approach overcomes concerns that have been raised regarding the use of variance partitioning (partialing) to evaluate predictive associations of correlated variables (e.g., Lynam, Hoyle, & Newman, 2006).
Specifically, a given predictor can demonstrate “complete,” “conditional,” or “general dominance” in relation to other variables included in a prediction model (Nimon & Oswald, 2013). Complete dominance over a second predictor of interest, the strongest form of dominance, is achieved when the main predictor of interest accounts for more unique variance in the outcome variable than the second predictor (1) at the zero-order level (i.e., a larger-magnitude correlation coefficient), (2) in a regression model including only those two predictors (i.e., a larger semi-partial correlation coefficient), and, if other predictors exist besides the main and second predictors, (3) in a regression model including all possible combinations of predictors (i.e., a larger semi-partial correlation coefficient when 1 through n other predictors are included in the model; Azen & Budescu, 2003).
If a predictor exhibits complete dominance over another predictor, it also possesses conditional and general dominance. One predictor has conditional dominance over another if it accounts for more variance than the other predictor in only some regression submodels (e.g., only at the zero-order level but not in the multiple regression models, or vice versa). The weakest form of dominance, general dominance, signifies that the predictor in question accounts for more unique variance than another predictor, on average, across all models (i.e., averaging variance accounted for in zero-order, two-predictor regression, and n-predictor regression models). Employing the technique of dominance analysis, then, the comparative strength of the predictors can be judged without reference to the psychological meaning of a residualized versus “full-variance” representation of a construct. Given its unique advantages as a method for comparing the predictive utility of different variables, we used dominance analysis to characterize the relative importance of ESI disinhibition and UPPS-P traits in predicting a range of psychopathological outcomes.
Current Study
While it is not feasible to fully compare the extensive nomological networks of these two constructs in a single study, the current work was undertaken to examine two highly popular scale-based operationalizations of each to begin to understand their similarities and differences. Our overarching hypothesis was that impulsigenic traits represent a mix of two distinct dispositional characteristics — externalizing and NA — and, compared to disinhibition, would relate more to NA and NA-related problems and less to impulsive-irresponsible (externalizing) psychopathology. We tested this hypothesis in two relatively large samples with self-report data for ESI Disinhibition, UPPS-P impulsigenic traits, and various measures of externalizing and NA. First, we utilized structural equation modeling (SEM) in Sample 1 and exploratory SEM (ESEM) in Sample 2 to define latent externalizing and NA dimensions and explored the degree of cross-loading of disinhibition and impulsigenic traits on these dimensions. Our specific hypothesis (1) was that disinhibition would load robustly onto the latent externalizing dimension and not on the NA dimension, whereas impulsigenic traits would load more weakly onto the latent externalizing dimension and significantly on the internalizing dimension as well. Next, we performed multiple regression and dominance analysis in the two samples separately to investigate the relative importance of each scale in predicting externalizing and NA factor scores derived from structural models in each sample. We hypothesized that (2) disinhibition would exhibit greater variable importance than all impulsigenic traits in prediction of externalizing problems; and (3) impulsigenic traits — especially positive and negative urgency — would exhibit greater variable importance than disinhibition in prediction of criterion variables more closely related to NA.
Method
Participants
Participants in Sample 1 were 400 college students (74% female; 40.5% Black, 24.0% White, 21.3% Asian, 5.5% Latino, 5.0% Multiracial, <1% each American Pacific Islander, Middle Eastern, Indian, or Indigenous American, Mage = 21.6 years, SD = 6.2 years) from a large university in the southern United States. Sample 2 included 308 college students (74% female; 31.8% White, 29.5% Black, 22% Latino; 31.8% freshmen, 29.5% sophomores, 22.4% juniors, 16.2% senior or above) from the same university. All participants provided informed consent prior to data collection, and all activities were approved by the university’s Institutional Review Board.3
Trait Measures
Disinhibition.
Trait disinhibition was assessed in both samples using the Externalizing Spectrum Inventory’s 20-item Disinhibition scale (ESI-Dis; Patrick et al., 2013a), which corresponds to the Disinhibition scale of the Triarchic Psychopathy Measure (TriPM; Patrick, 2010). The 20-item ESI-Dis scale was developed to provide a concise self-report index of the latent construct of biobehavioral liability for externalizing problems (Iacono et al., 1999; Patrick, Iacono, and Venables, 2019). This measure of disinhibition has good psychometric properties (Patrick, 2010; Patrick et al., 2013a) and demonstrates high convergent validity with other measures of dispositional liability to externalizing problems (Drislane, Patrick, & Arsal, 2014; Stanley, Wygant, & Sellbom, 2013). It displayed good internal consistency reliability within the two samples of the current study (Sample 1/Sample 2: α = .80/.87, ω = .80/.87).
Impulsigenic traits.
The UPPS-P scale (Lynam et al., 2006) was used to operationalize impulsigenic traits in both samples. The UPPS-P contains 59 items organized into five correlated subscales posited to quantify different routes to impulsive behavior (Lynam et al., 2006). These scales have been shown to exhibit good psychometric properties and measurement invariance across sex (Cyders, 2013). These scales displayed good internal consistency reliability in the current study (Sample 1/Sample 2: 14-item Positive Urgency α = .88/.90, ω = .89/.92; 12-item Negative Urgency α = .74/.83, ω = .81/.87; 11-item Lack of Premeditation α = .76/.82, ω = .78/.85; 10-item Lack of Perseverance α = .81/.82, ω = .81/.85; 12-item Sensation Seeking α = .82/.87, ω = .83/.87).
Externalizing Problem Measures
Sample 1.
Available measures in this sample assessed alcohol use problems and various forms of aggression. The 24-item Young Adult Alcohol Consequences Questionnaire – Brief Form (YAACQ-B; Read et al., 2007) and the 23-item Rutgers Alcohol Problems Index (RAPI; White & Labouvie, 1989) were used to operationalize alcohol problems. Both scales have been demonstrated to have good psychometric properties (Read et al., 2008; White & Labouvie, 1989), as well as evidence of convergent validity with diagnostic criteria of alcohol use disorder and other alcohol use and problems inventories (Kahler et al., 2008). These scales displayed good psychometric properties in this sample (YAACQ-B α = .95, ω = .95; RAPI α = .92, ω = .92).
The Reactive scale of Raine et al.’s (2006) Reactive-Proactive Aggression Questionnaire (RPQ-R) was used to operationalize reactive aggression. Because the RPQ’s Proactive scale (RPQ-P) operates more as an indicator of callous behavior than externalizing psychopathology (Fanti, Frick, Georgiou, 2008; Fite, Stoppelbein, & Greening, 2009), it was not used in the current work. The RPQ-R displayed good psychometric properties in the current sample (α = .92, ω = .92). Other measures of aggression were provided by the Indirect Aggression Scale (IAS; Forrest, Eatough, & Shevlin, 2005), which is composed of 25 items grouped into three subscales: Social Exclusion (IAS-S; 10 items), Malicious Humor (IAS-M; 9 items), and Guilt Induction (IAS-G; 6 items). Consistent with the exclusion of RPQ-P, IAS-G was excluded from analyses because of its strong and specific relations to callous behavior as opposed to externalizing psychopathology (Fanti et al., 2008). The two IAS subscales used displayed good psychometric properties in this sample (IAS-M α = .80, ω = .80; IAS-S α = .80, ω = .81).
Sample 2.
Measures of externalizing problems for Sample 2 were derived from the Structured Clinical Interview for DSM-IV Axis II Personality Disorders (SCID-II) screening questionnaire, which contains 119 items covering the diagnostic criteria for the 10 personality disorders (PDs) included in the 4th edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) and in Section II of the current 5th edition (DSM-5), as along with criteria for the provisional diagnosis of depressive PD included in DSM-IV. Four of these PDs — narcissistic, histrionic, conduct/antisocial (only conduct disorder-related symptoms are covered in the SCID-II screening questionnaire), and borderline PDs — are characterized by erratic behavior and poor emotional control, and are typically considered part of the externalizing spectrum (e.g., Krueger, Caspi, Moffitt, Silvia, 1998; James & Taylor, 2008; Caspi et al., 2014; Kotov et al., 2017), making them appropriate criterion variables for the current work. While borderline personality disorder (BPD) is considered part of Cluster B of the DSM PDs, it loads on both internalizing and externalizing problem dimensions in theoretical and data-driven structural models (Kotov et al., 2017). Accordingly, in the ESEM for Sample 2, BPD was specified as a complex indicator with loadings on both externalizing and NA factors..4
Negative Affectivity Measures
Sample 1.
Measures of NA in this sample were derived from questionnaires assessing facets of emotional reactivity and mood experience. Two subscales from the 21-item Emotion Reactivity Scale (ERS; Nock, Wedig, Holmberg, & Hooley, 2008) were used to operationalize emotional reactivity – its Emotional Sensitivity (ERS-S) scale, which indexes susceptibility to strong negative emotions, and its 7-item Emotional Arousal (ERS-A) scale, which assesses the intensity of negative experienced emotions. The ERS’s third scale, Emotional Persistence (ERS-P; 4 items), was not used, because its questions pertain to success or failure of emotion regulation rather than to emotional experience per se (Gross & Jazaieri, 2014). In the current sample, the ERS-S and ERS-A scales demonstrated very high internal consistency reliabilities (αs = .91 and .88, respectively, ωs = .91 and .88). In addition, the 10-item NA scale of the Positive and Negative Affect Schedule (PANAS; Watson & Clark, 1999) was used to assess the extent of negative emotions experienced over the past week. Its internal consistency reliability in the current sample was acceptably high (α = .85, ω = .85).
Sample 2.
Symptoms most aligned with NA were derived from the SCID-II items assessing avoidant, dependent, and depressive PDs. These PDs entail mood disturbance and emotion dysregulation and are closely associated with internalizing pathology and chronic negative emotionality; factor analytic work suggests they load heavily onto the internalizing spectrum alongside depressive and anxiety disorders (Kotov et al., 2011, 2017; Krueger et al., 2018). Further, they exhibit distinct criterion associations from externalizing problems (e.g., problematic drinking; Coid, Yang, Tyrer, Roberts, & Ullrich, 2006).
Data Analytic Plan
Correlational analyses were run in each sample to characterize the covariance among disinhibition and UPPS-P traits. Next, using data for Sample 1, a confirmatory factor analysis (CFA) model specifying correlated externalizing and NA factors was run with maximum likelihood estimation using the ‘lavaan’ package (Rosseel, 2012) of the R statistical environment (v.3.5.1; R Core Team, 2018). Specifically, the YAACQ-B, RAPI, RPQ-R, and IAS-S and IAS-M scales were specified as indicators of a latent externalizing factor, and the ERS-S, ERS-A, and PANAS-NA were specified as indicators of a latent NA factor. Because the two IAS and two ERS subscales came from the same parent instrument and the RAPI and B-YAACQ specifically assess alcohol use problems, residual covariances between these pairs were specified a priori. The goal of this specification strategy was to prevent the paired indicators from dominating their respective latent factors due to shared method variance, rather than because of shared construct-related variance. Using data for Sample 2, an exploratory structural equation model (ESEM) with target rotation specifying correlated externalizing and NA factors from personality disorder indicators was run with maximum likelihood using the ‘MplusAutomation’ package in R (Hallquist & Wiley, 2018) implemented via Mplus v.8.3 (Muthén & Muthén, 2019). ESEM allows all indicators to load onto all latent factors in the specified model, while still permitting confirmatory evaluation of hypothesized model structure (see Marsh et al., 2014). BPD was treated as a complex indicator in the model for Sample 2, being specified as belonging to both externalizing and NA factors. Histrionic, narcissistic, and antisocial PDs were specified as belonging to externalizing, while avoidant, dependent, and depressive PDs were specified as belonging to NA.
Absolute fit of these models was assessed using the chi-square (χ2), root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR) statistics, and incremental fit was assessed using the Comparative Fit Index (CFI) and Tucker-Lewis Index (TLI). The observed loadings from these models were then applied as fixed loadings in a second set of models, in which either disinhibition or one of the UPPS-P traits was added as an observed variable and allowed to cross-load onto both latent factors. Six models were run in each dataset, one for disinhibition and one for each UPPS-P scale. All parameter estimates reported in the results are standardized parameter estimates.
The next set of analyses utilized Bartlett’s (1937; see also Grice, 2001) method to quantify scores on the externalizing and NA factors modeled in each of Samples 1 and 2. First, to establish directionality of unique effects for disinhibition and UPPS-P traits, all six traits were entered into linear regression models predicting each factor in turn (four models total). In each sample, the regression analyses were then supplemented by dominance analyses using the ‘dominanceanalysis’ R package to quantify the relative degrees to which disinhibition and the five UPPS-P traits contributed to each outcome variable. ‘General Dominance Weights’ are generated by dominance analyses, which represent the average unique R2 contribution of a given variable across all models. The ‘GDW ratio’ is simply the GDW divided by the total R2 of a model including all predictors. Lastly, bootstrapped models (n = 1000) were implemented to ascertain the robustness of the dominance analysis results.
Results
Structural Models in Sample 1
The correlated two-factor model of externalizing problems and NA specified in Sample 1 is depicted in Figure 1. The model evidenced acceptable fit: CFI = .962, TLI = .934, χ2(28) = 63.28 (p < .001), RMSEA = .086, and SRMR = .048. Both factors exhibited strong and generally balanced loadings for their respective indicators (see Figure 1), and externalizing problems and NA were moderately correlated (ψ = .59, p < .001). The loadings from this first model were fixed in subsequent models. When ESI-Dis was added to the model and allowed to load onto both factors, it exhibited a strong and selective loading on the externalizing factor (λ = .67, p < .001) and a near-zero loading on the NA factor (λ = .05, p = .55). The UPPS-P’s lack of premeditation and lack of perseverance scales loaded weakly but significantly onto the externalizing factor (λs = .24 and .22, respectively, ps = .006 and .01) and negligibly onto the NA factor (λs = −.01 and .10, respectively, ps = .95 and .24). The UPPS’s negative and positive urgency scales loaded slightly more strongly onto the externalizing factor of the model, but at lower levels than for ESI-Dis (λs = .42 and .35, respectively, ps < .001), and they loaded nearly as strongly onto the NA factor (λs = .39 and .28, respectively, ps < .001). The UPPS’s fifth scale, sensation seeking, loaded more highly onto the externalizing factor (externalizing: λ = .52, p < .001), but also loaded to a prominent degree on the NA factor – in the opposing direction (λ = −.36, p < .001).5
Prediction Models in Sample 1
Correlations among ESI-Dis and UPPS-P trait scales can be found in Table 1 (above the diagonal). Disinhibition was positively associated with all impulsigenic trait scales, and with the extracted externalizing and NA factor scores (all ps < .001). In a linear regression model using all trait scales to predict the externalizing factor (R2 = .37, F(6, 392) = 39.15, p < .001), ESI-Dis (β = .39, p < .001), UPPS-P negative urgency (β = .24, p < .001), and UPPS-P sensation seeking (β = .10, p = .02) emerged as significant unique predictors, whereas the other three UPPS-P trait scales did not (βs = −.03 to .03, ps = .56 to .88). In contrast, in the counterpart regression model for the extracted NA factor score (R2 = .34, F(6, 392) = 33.87, p < .001), ESI-Dis evidenced a notably smaller contribution (β = .11, p = .05), whereas UPPS-P negative urgency (β = .50, p < .001), sensation seeking (β = −.20, p < .001), and lack of premeditation (β = −.13, p = .01) emerged as significant predictors, with the other two UPPS-P traits predicting negligibly (positive urgency: β = .10, p = .09; lack of perseverance: β = −.01, p = .77).
Table 1.
Variable | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 |
---|---|---|---|---|---|---|---|---|
-- | .61** [.54, .66] | .50** [.42, .57] | .33** [.24, .42] | .39** [.30, .47] | .26** [.16, .35] | .57** [.49, .63] | .36** [.28, .45] | |
2. Negative Urgency | .63** [.55, .69] | -- | .71** [.66, .76] | .36** [.27, .44] | .32** [.23, .41] | .24** [.15, .33] | .51** [.43, .58] | .54** [.47, .61] |
3. Positive Urgency | .59** [.52, .66] | .75** [.70, .79] | -- | .34** [.25, .42] | .35** [.26, .43] | .31** [.22, .39] | .42** [.33, .49] | .40** [.32, .48] |
4. Lack of Premeditation | .23** [.12, .33] | .08 [−.03, .19] | −.02 [−.13, .09] | -- | .55** [.47, .61] | .08 [−.02, .18] | .21** [.11, .30] | .10* [.00, .20] |
5. Lack of Perseverance | .43** [.34, .52] | .29** [.19, .39] | .24** [.13, .34] | .58** [.51, .65] | -- | −.05 [−.14, .05] | .23** [.13, .32] | .16** [.07, .26] |
6. Sensation Seeking | .37** [.27, .47] | .48** [.39, .56] | .56** [.48, .63] | .06 [−.05, .17] | −.01 [−.12, .11] | -- | .26** [.17, .35] | −.03 [−.13, .07] |
7. Manifest Externalizing Factor | .41** [.31, .50] | .30** [.20, .40] | .33** [.23, .43] | .21** [.10, .31] | .25** [.14, .35] | .26** [.16, .36] | -- | .37** [.29, .45] |
8. Manifest Negative Affectivity Factor | .26** [.15, .36] | .28** [.17, .38] | .13* [.02, .24] | .03 [−.08, .14] | .30** [.20, .40] | −.14* [−.24, −.02] | .24** [.13, .34] | -- |
Note. Values above the diagonal represent correlations from Sample 1 (N = 400); values above the diagonal represent correlations from Sample 2 (N = 308). Values in square brackets indicate the 95% confidence interval of the correlation coefficient.
p < .05,
p < .01.
In Sample 1, the Externalizing Factor was derived from a SEM with the Young Adult Alcohol Consequences Questionnaire-Brief form, Rutgers Alcohol Problems Index, Reactive-Proactive Aggression Questionnaire-Reactive scale, and Indirect Aggression Scale-Social and -Malicious Humor scales, and the Negative Affectivity Factor was derived from the PANAS-NA scale, Emotional Reactivity Scale-Sensitivity and -Arousal scales. In Sample 2, the Externalizing Factor was derived from a ESEM of the SCID-II Personality Disorder Questionnaire and was most prominently influenced by symptoms of Narcissistic, Conduct/Antisocial, and Histrionic Personality Disorder, and the Negative Affectivity Factor was most prominently influenced by symptoms of Depressive, Avoidant, and Dependent Personality Disorder.
Dominance analyses of externalizing.
In total, ESI-Dis and the five impulsigenic trait scales accounted for 37.5% of the variance in the externalizing factor score. Results indicated that ESI-Dis was by far the strongest predictor, with a general dominance weight (GDW) of .17 and “GDW to total model R2” ratio (hereafter called “ratio”) of 44.80%. This was followed by negative urgency (GDW = .11, ratio = 28.27%), positive urgency (GDW = .05, ratio = 13.87%), sensation seeking (GDW = .03, ratio = 7.20%), lack of perseverance (GDW = .01, ratio = 3.46%), and lack of premeditation (GDW = .01, ratio = 2.4%). ESI-Dis exhibited complete dominance over each of the five impulsigenic trait scales, yielding 1) larger average contributions than all other measures, and 2) larger unique contributions in all model subsets, regardless of how many other predictors were included in the models. Dominance analysis results are depicted in Figure 2. Next, bootstrapped resampling (n = 1000) was utilized to quantify the reproducibility and generalizability of observed dominance patterns. As shown in Supplemental Table 1, ESI-Dis exhibited complete dominance over negative urgency, positive urgency, lack of premeditation, lack of perseverance, and sensation seeking in 84.3%, 100%, 99.9%, 100%, and 99.9% of bootstrap resamples, respectively.
Dominance analyses of negative affectivity.
In total, ESI-Dis and the five UPPS-P trait scales accounted for 34.1% of the variance in the NA factor. Results showed negative urgency to be by far the strongest predictor, with a GDW of .18 (ratio = 53.67%), followed by positive urgency (GDW = .07, ratio 20.23%), ESI-Dis (GDW = .05, ratio = 15.25%), sensation seeking (GDW = .02, ratio = 6.45%), lack of premeditation (GDW = .01, ratio = 2.35%), and lack of perseverance (GDW = .01, ratio = 2.05%). Negative urgency exhibited complete dominance over ESI-Dis and each of the other four impulsigenic trait scales, exhibiting 1) larger average contributions than all other measures, and 2) larger unique contributions in all model subsets, regardless of how many other predictors were included in the models. Dominance analysis results are illustrated in Figure 2. Additionally, as shown in Supplemental Table 2, when using bootstrapped resampling, negative urgency exhibited complete dominance over ESI-Dis in 99.9% of bootstrap resamples and complete dominance over positive urgency, lack of premeditation, lack of perseverance, and sensation seeking in 99.8%, 99.7%, 100%, and 97.0% of bootstrap resamples, respectively.
Structural Models in Sample 2
The ESEM for externalizing problems and negative affectivity specified in Sample 2 is depicted in Figure 2. The model evidenced acceptable fit: CFI = .972, TLI = .926, χ2(8) = 27.53 (p < .001), RMSEA = .089, and SRMR = .026. The model parameters supported the relative division between externalizing and internalizing factors, with the candidate externalizing-PD symptom variables loading strongly onto the externalizing factor (histrionic λ = .75, narcissistic λ = .67, antisocial λ = .53), and the NA PD variables loading weakly or negligibly onto this factor (avoidant λ = −.22, depressive λ = .03, dependent λ = .32). Conversely, the candidate NA PD symptom variables all loaded strongly onto the NA factor (avoidant λ = .75, depressive λ = .85, dependent λ = .49), whereas the externalizing PD variables loaded weakly onto this factor (histrionic λ = −.16, narcissistic λ = .19, antisocial λ = .09). As expected, BPD loaded robustly onto both factors (externalizing λ = .42, NA λ = .51), supporting its placement as a complex indicator of personality pathology. The externalizing problems and NA factors of the model were moderately correlated (ψ = .35, p < .001). The loadings from this first model were fixed in subsequent models that examined associations of the externalizing and NA factors with the ESI-Dis and UPPS trait scales.
When ESI-Dis was added to the model and specified as loading onto both factors, it exhibited a markedly stronger loading on the externalizing factor (λ = .44, p < .001) than the NA factor (λ = .14, p = .02). Compared to ESI-Dis, negative urgency loaded more weakly onto the externalizing factor of the model (λ = .28, p < .001) and more strongly onto the NA factor (λ = .22, p = .001). Positive urgency loaded selectively onto the externalizing factor of the model (λ = .39, p < .001), showing no loading on the NA factor (λ = .02, p = .75). Lack of premeditation loaded to a lesser significant degree on the externalizing factor (λ = .25, p < .001) and negligibly on the NA factor (λ = −.05, p = .50). Lack of perseverance loaded slightly comparably on the NA and externalizing factors of the model (λs = .27 and .20, respectively, ps < .005). The UPPS’s fifth scale, sensation seeking, loaded to a moderate positive degree on the externalizing factor (λ = .40, p < .001), and negatively on the NA factor (λ = −.28, p < .001).
Prediction Models in Sample 2
Correlations among ESI-Dis and impulsigenic trait scales are shown in Table 1 (below the diagonal). ESI-Dis was positively associated with all impulsigenic trait scales as well as with the extracted externalizing and NA factor scores (ps < .001). In a linear regression model predicting scores on the externalizing-related PD factor (R2 = .21, F(6, 301) = 12.98, p < .001), only ESI-Dis (β = .26, p < .001) emerged as a significant unique predictor (positive urgency: β = .14, p = .10; negative urgency: β = −.04, p = .66; lack of premeditation: β = .13, p = .06; lack of perseverance: β = .04, p = .58; sensation seeking: β = .09, p = .15). In contrast, in a linear regression model predicting the NA-related PD factor (R2 = .23, F(6, 301) = 15.27, p < .001), only ESI-Dis (β = .13, p = .07) and positive urgency (β = −.13, p = .13) were not significant predictors, whereas all other impulsigenic traits evidenced significant unique predictive value (negative urgency: β = .36, p < .001; lack of perseverance: β = .28, p < .001; sensation seeking: β = −.27, p < .001; lack of premeditation: β = −.18, p = .007).
Dominance analyses of externalizing.
In total, ESI-Dis and the five impulsigenic trait scales accounted for 20.5% of the variance in the externalizing-related PD factor. Results indicated that ESI-Dis was by far the strongest predictor, with a GDW of .08 (ratio = 36.59%), followed by positive urgency (GDW = .04, ratio = 18.53%), sensation seeking (GDW = .02, ratio = 12.20%), negative urgency (GDW = .02, ratio = 12.20%), lack of premeditation (GDW = .02, ratio = 10.73%), , and lack of perseverance (GDW = .02, ratio = 10.24%). ESI-Dis again exhibited complete dominance over each of the five impulsigenic trait scales, exhibiting 1) larger average contributions than all other measures, and 2) larger unique contributions in all model subsets, regardless of how many other predictors were included in the models. Dominance analysis results are illustrated in Figure 2. As shown in Supplemental Table 3, bootstrapped resampling revealed that ESI-Dis exhibited complete dominance over negative urgency, positive urgency, lack of premeditation, lack of perseverance, and sensation seeking in 94.0%, 75.2%, 68.8%, 79.4%, and 83.1% of bootstrap resamples, respectively.
Dominance analyses of negative affectivity.
In total, ESI-Dis and the five impulsigenic trait scales accounted for 23.3% of the variance in the NA-related PD factor. Dominance analyses revealed negative urgency to be the most important predictor, with a GDW of .06 (ratio = 27.04%), followed by lack of perseverance (GDW = .06, ratio = 26.61%), sensation seeking (GDW = .05, ratio = 21.89%), disinhibition (GDW = .03, ratio = 14.16%), positive urgency (GDW = .01, ratio = 5.58%), and lack of premeditation (GDW = .01, ratio = 5.15%). Complete dominance could not be established for any scale over all others; however, complete dominance was established for (1) negative urgency over positive urgency, (2) negative urgency over ESI-Dis, (3) lack of perseverance over positive urgency, (4) lack of perseverance over lack of premeditation, and (5) sensation seeking over positive urgency. Lack of perseverance exhibited conditional dominance over ESI-Dis, and broadly, lack of perseverance and negative urgency each exhibited conditional dominance over the other impulsigenic trait scales. Dominance analysis results are illustrated in Figure 2. Finally, Supplemental Table 4 details the pattern of dominance results using bootstrapped resampling, demonstrating that negative urgency exhibited complete dominance over ESI-Dis in 63.7% of bootstrap resamples, and over positive urgency in 75.6% of bootstrap resamples. Lack of perseverance exhibited conditional dominance over disinhibition in 72.3% of bootstrap resamples.
Discussion
Behavioral disconstraint, poor planning ability, and emotion dysregulation (i.e., poor self-regulatory abilities) play a key role in various forms of psychopathology. Therefore, it is of critical importance to identify risk factors that promote these behavioral and emotional features. Both disinhibition, as reflected in the externalizing spectrum model (Krueger et al., 2002), and impulsigenic traits, as represented in the UPPS-P conceptualization (Lynam et al., 2006), have been extensively studied as dispositional traits associated with increased rates of mental illness. The current study elucidated the unique and common predictive properties of these widely-used measures of disinhibition and impulsigenic traits, providing direction for the field regarding the optimal inventories and conceptualizations to use for differing purposes. Disinhibition and all five impulsigenic traits showed similarly good psychometric properties in terms of internal consistency reliability. Across both samples, disinhibition was most highly correlated with UPPS-P negative urgency (r ~ .60), closely followed by positive urgency (r ~ .50). Conversely, disinhibition showed its smallest-magnitude association with UPPS-P sensation seeking (r ~ .30).
The Place of Disinhibition and Impulsigenic Traits in the Structure of Psychopathology
One of the major strengths of the current study was its ability to shed light on the dispositional traits of interest as part of the broader structure of psychopathology, building on prior work exploring the links between personality and clinical symptom dimensions (Clark, 2005; Clark, Watson, & Mineka, 1994; Krueger, McGue, & Iacono, 2001). We introduced each trait into a fixed structural model of externalizing and NA to explore their relative covariance with each dimension. Structural modeling demonstrated that whereas variance in disinhibition was strongly explained by a latent externalizing dimension (λ = .67), it did not load onto latent NA (λ = .05). The selective association between disinhibition and externalizing replicates past work on the Externalizing Spectrum Inventory operationalization of disinhibition (Joyner et al., 2019, 2020; Krueger et al., 2007; Nelson et al., 2016) and is consistent with the notion that disinhibition represents a specific liability factor for externalizing (Iacono et al., 1999; Patrick et al., 2013b, 2019).
A more complex picture emerged when examining the placement of the various UPPS-P-assessed impulsigenic traits in relation to externalizing and NA. Specifically, lack of premeditation and lack of perseverance loaded selectively with externalizing, although these loadings were much smaller than that of disinhibition (λs = .24 and .22, respectively). Premeditation and perseverance are considered to be behavioral manifestations of cognitive processes, and low levels of these attributes are presumed to reflect executive dysfunction more so than aberrant affective processing (Whiteside & Lynam, 2001). This conceptualization is consistent with these traits’ selective loading on the externalizing factor, which reflects proneness to unrestrained and irresponsible behavior, and with past work showing similar associations for these particular UPPS-P traits with externalizing problems (Latzman & Vaidya, 2013; Latzman, Vaidya, Malikina, Berg, & Lilienfeld, 2014). However, their markedly weaker loading relative to disinhibition suggests these two impulsigenic traits are less well-aligned with externalizing problems than disinhibition; this strength of disinhibition is discussed in further detail below.
In contrast to the selective findings for lack of premeditation and lack of perseverance, negative and positive urgency each evidenced fairly balanced loadings on externalizing and NA. Negative and positive urgency are impulsigenic traits that involve a dysregulated response to the experience of strong emotions and, thus, appear to reflect a combination of cognitive and affective processes. The affective component of these traits is reflected in the wording of urgency-related items within the UPPS-P, which invoke a conditional process (e.g., “when you’re feeling an intense emotion…”) in assessing poor behavioral control. The structural-modeling results for negative and positive urgency, showing cross-loadings on both externalizing and NA factors, are consistent with this interpretation. Positive and negative urgency may represent predispositions to broad psychological distress, given their relations to psychopathology spanning the internalizing and externalizing spectra.
Finally, sensation seeking loaded onto both latent factors, but positively on externalizing and negatively on NA. Attributes of sensation seeking or risk-taking have obvious positive relations with externalizing, but these constructs also include a fearlessness component, which is associated to a strong negative degree with internalizing propensity (Nelson et al., 2016) – evidenced by the negative loading of UPPS-P sensation seeking on the NA factor in the current work. Complementary to this explanation of the negative association between sensation seeking and internalizing, there is also FFM work showing that low extraversion (the FFM trait sensation seeking flows from) relates to heightened depressivity (Watson et al., 2019).
Comparing Disinhibition and Impulsigenic Traits as Predictors of Psychopathology
The second major focus of the current study was to directly compare these two popular models of weak self-restraint — disinhibition and impulsigenic traits — in terms of the magnitude of their predictive relations with differing forms of psychopathology, using popular scale-based operationalizations in multiple regression and dominance analysis in two samples.
Externalizing.
Although all UPPS-P impulsigenic traits demonstrated significant relations with externalizing psychopathology at the zero-order level, regression models comparing disinhibition and each impulsigenic trait revealed that disinhibition was by far the strongest independent predictor of externalizing in both samples, overshadowing observed associations for impulsigenic traits. Dominance analyses yielded clear, consistent evidence for disinhibition as the most important predictor of externalizing symptomatology, achieving complete dominance over all impulsigenic traits. Across both samples, disinhibition was twice as important, in raw units of general dominance weight, for predicting externalizing than the strongest impulsigenic trait predictor. Importantly, the two samples used distinct variables in their externalizing factors — with Sample 1 comprising alcohol problems and aggression and Sample 2 including impulsive-erratic PD symptoms — thus highlighting the robustness of this result.
Overall, our analyses indicate that disinhibition, as conceptualized by the externalizing spectrum model (Krueger et al., 2002), is likely to be markedly more useful than impulsigenic traits for assessing propensity for externalizing problems in a between-subjects manner. The measure of disinhibition derived from the Externalizing Spectrum Inventory has already been validated as a self-report indicator of latent dispositional liability for externalizing psychopathology, but the current study represents the first formal demonstration that this operationalization of latent disinhibition operates as a better predictor of externalizing problems than impulsigenic traits. Disinhibition is both (1) more specific to externalizing as opposed to NA, and (2) more strongly predictive of externalizing problems. This is a desirable quality for researchers seeking to better understand dispositional risk for externalizing problems as distinct from other forms psychopathology, while also connecting to the broader nomological network of a dispositional trait that crosses units of analysis (Patrick et al., 2019; Perkins et al., 2019).
Negative Affectivity.
Similar to the results for externalizing, at the zero-order (correlational) level, disinhibition and most impulsigenic traits were associated with the NA factor in each sample. This finding for disinhibition aligns with past work demonstrating its relations to certain NA-related constructs (e.g., Latzman et al., 2019a, b; Nelson et al., 2016). However, in the current study — in both samples — the disinhibition coefficients were appreciably reduced in regression models that included impulsigenic traits as co-predictors. In contrast, negative urgency, sensation seeking, and lack of premeditation retained significant independent prediction of NA in both samples; lack of perseverance was an additional independent predictor in Sample 2 only. Of note, in regressions for both samples, negative urgency showed the strongest relations of all impulsigenic traits to both externalizing and NA, consistent with meta-analytic findings that this trait exhibits the strongest associations of the UPPS-P facets with psychopathology-related outcomes (Berg et al., 2015).
Results from the dominance analyses provided further evidence of the weak association of disinhibition with NA, beyond impulsigenic traits. In Sample 1, negativity urgency was more than three times as important as disinhibition in predicting NA, demonstrating complete dominance over all other variables. In Sample 2, only conditional dominance (larger relations for the predictor of interest than the comparison predictor in some, but not all, regression submodels) was evident for some of the UPPS-P traits in predicting NA, but both lack of perseverance and negative urgency demonstrated complete dominance over disinhibition in about 50% of bootstrap resamples in predicting a PD symptom-based operationalization of NA.
Taken together, the dominance analyses consistently showed UPPS-P impulsigenic traits to be much stronger predictive of NA than disinhibition. As NA is considered to be the common feature of the internalizing spectrum (Clark, Watson, & Mineka, 1994; Watson, 2005), this finding clearly establishes impulsigenic traits as important predictors of internalizing, consistent with a growing literature emphasizing the role of impulsigenic traits in depressive and anxious symptomatology (e.g., Berg et al., 2015). More broadly, the current study echoes a larger literature supporting the links of impulsigenic traits with internalizing, externalizing, and psychotic forms of psychopathology (see Carver & Johnson, 2018). Impulsigenic traits may thus provide an important index of a general risk for psychopathology (perhaps for the “p-factor,” but see Watts, Poore, & Waldman, 2019, for concerns about the p-factor in its current operationalizations), and the common genetic liability for all mental disorders (Gustavson et al., 2017; Racine et al., 2013). However, if a p-factor does not account for the substantial covariation between externalizing and internalizing forms of psychopathology, future HiTOP-aligned research should seek to determine which specific factors underlying these traits differentiate relevant psychopathology spectra and which do not. Given that negative and positive urgency appear to have particular transdiagnostic relevance, as evidenced by their comparable loadings on externalizing and NA factors in the current study, the urgency construct may be useful for generating hypotheses regarding the covariation among psychopathology spectra. This may be reflective of the theoretical model of equifinality (Cicchetti & Rogosch, 1996) on which the UPPS-P was based; originally, impulsigenic traits were conceptualized as alternative routes to “impulsive” behavior, but perhaps the equifinal outcome captured is more akin to psychological distress, dysregulation, and impairment. From this perspective, impulsigenic traits may be useful especially useful at higher-order levels of a hierarchical-dimensional framework for psychopathology (Kotov et al., 2017), whereas disinhibition may have greater utility for studying the narrower spectrum of impulsive-externalizing problems (Perkins, Joyner, et al., 2020). Furthermore, the relative ‘division’ between trait-dispositions and psychopathology should continue to be investigated (e.g., Watson, Clark, & Chmielewski, 2008). The results from Sample 1 demonstrated disinhibition to be the best indicator of a latent externalizing factor, reiterating questions about the nature of the hierarchy of psychopathology and the degree to which basic personality is represented within it (cf., Clark, 2005; Watson, Clark, & Harkness, 1994).
Limitations and Future Directions
Some limitations of the current work warrant mention. First, although the present analyses utilized two fairly large samples (Ns = 400, 308) with adequate score variance for both independent and dependent measures, our results should be replicated and extended to other samples exhibited a wider range of clinical symptomatology, spanning detachment, somatoform, and thought disorder dimensions along with internalizing and externalizing.6 Secondly, measures used in this study were solely from the modality of self-report. Interview-based symptom assessments can provide an important complement to self-reported problems (Chmielewski, Clark, Bagby, & Watson, 2015), and future work should further evaluate predictive relations of impulsigenic traits and disinhibition with interview as well as self-report assessed symptomatology. Future work also should extend to within-subject investigations of these constructs. For example, ambulatory assessment work suggests UPPS-P urgency functions as more of a unified process at the within-subjects level, with positive urgency not being responsive to positive mood states in the moment, only negative mood states (Sperry, Lynam, & Kwapli, 2018).
Although two samples offering a diverse set of externalizing- and NA-related criterion variables were available, another limitation of the study is that single inventories were used to operationalize disinhibition and impulsigenic traits. It would be valuable to administer other measures of these dispositional constructs in future work to evaluate their interrelations and comparative predictive validity. In the case of trait disinhibition, various alternative measures of this construct have been developed using items from several popular personality inventories, including the Minnesota Multiphasic Personality Inventory – 2 (MMPI-2; Sellbom et al., 2016), the Multidimensional Personality Questionnaire (MPQ; Brislin et al., 2015), the NEO Personality Inventory – Revised (NEO-PI-R; Drislane, Brislin, Jones, & Patrick, 2017), and the Personality Inventory for DSM-5 (PID-5; Drislane et al., 2019). It would be valuable in future work to corroborate our findings using alternative — or ideally, multiple (e.g., Drislane & Patrick, 2017; Latzman et al., 2019a) — operationalizations of trait disinhibition in order to refine our understanding of this construct. In addition, other models of impulsivity (e.g., the Barratt Impulsiveness Scale; Barratt, 1959; Patton, Stanford, & Barratt, 1995) should be examined alongside disinhibition and the UPPS-P traits as competitive predictors of important criterion variables, with the goal of identifying the most useful models and measures for prediction of a given outcome. Although noted at other points in the paper, it bears repeating that the current study presents data for common operationalizations of these trait constructs only in the self-report domain. However, it will be valuable in future research to explore the broader nomological networks of these traits using indicators from other measurement modalities (e.g., task performance, physiological response). For example, recent work has demonstrated that UPPS-P impulsigenic traits do not share the same genetic bases as behavioral measures of executive function, and relate differently to externalizing disorders (Friedman et al., 2019). Should indicators from other modalities of measurement be identified for UPPS-P traits, future work could similarly examine how such indicators compare their relations with indicators of disinhibition within that measurement modality.
Conclusion
The current study provides a framework for conceptualizing disinhibition and impulsigenic traits as well as an empirical demonstration of their positions in the broader structure of psychopathology and their differential utility in predicting externalizing and NA. Our results indicate that disinhibition is selectively linked to the externalizing spectrum and is a more dominant predictor of externalizing psychopathology than impulsigenic traits, whereas impulsigenic traits are situated between externalizing and NA dimensions and demonstrate dominance over disinhibition in predicting NA. It is apparent from these findings that disinhibition and impulsigenic traits are not interchangeable. Specifically, disinhibition is a stronger and more specific predictor of externalizing psychopathology, whereas impulsigenic traits — especially negative urgency — are more potent predictors of NA and distress-related problems. Importantly, the current work does not suggest that impulsigenic traits are unrelated to externalizing problems, or that disinhibition is unrelated to NA. Instead, we sought to clearly demarcate which traits operate as better predictors of each outcome relative to one another, for purposes of guiding ongoing research efforts. As hierarchical structural models of psychopathology (e.g., Kotov et al., 2017; Krueger et al., 2018) gain prominence, the distinctions between disinhibition and impulsigenic traits warrant careful consideration. Disinhibition should be prioritized in studies of risk for externalizing psychopathology, and impulsigenic traits — particularly negative urgency — should be examined as risk factors for broad, non-specific psychopathological outcomes.
Supplementary Material
Public Significance Statement:
This study compared the traits of disinhibition and UPPS-P impulsivity in predicting externalizing problems and negative affectivity (NA). Disinhibition predicted externalizing problems more strongly than UPPS-P traits, and certain UPPS-P traits predicted NA more strongly. Future work should prioritize disinhibition for study of the externalizing spectrum and UPPS-P for study of impulsivity-relevant features of NA.
Acknowledgments
This work was supported by a Ford Foundation Predoctoral Fellowship administered by the National Academies of Sciences, Engineering, and Medicine (K.J.J.); National Institute of Mental Health grant F31MH122096 (E.R.P.); U.S. Army grant W911NF-14-1-0018 (C.J.P.). The content of this paper is solely the responsibility of the authors and does not necessarily reflect the official views of the U.S. Government, Department of Defense, Department of the Army, Department of Veterans Affairs, or U.S. Recruiting Command. Funding sources had no role in the study design, in the collection, analysis, and interpretation of data, in the writing of the report, or in the decision to submit the article for publication.
Footnotes
This model and measure differ from the original UPPS (Whiteside & Lynam, 2001) in that the latter did not differentiate between positive and negative urgency and thus included only four traits: urgency, lack of premeditation, lack of perseverance, and sensation seeking. In what follows, unless otherwise stated, the term “UPPS-P” is used to refer broadly to this model of impulsigenic traits without excluding papers using its original conceptualization as UPPS.
It should be noted that there is evidence relating externalizing problems to NA – in particular, facets of NA pertaining to hostility/aggressiveness and suspiciousness/mistrust (e.g., Krueger, 1999), which reflect elements of NA shared between externalizing and internalizing. In the current work, we were interested in comparing UPPS-P traits and disinhibition for representation of internalizing specific elements of NA (i.e., anxious-fearful proclivities) as opposed to elements common to externalizing and internalizing.
Other variables available in the current samples that were not utilized in the current work related to: Sample 1, cognitive-behavioral tasks and psychopathic personality; Sample 2, body modification, relationships, and sexual interests and experiences that were beyond the scope/unrelated to the goals of the current paper. Other articles published using subsets of these data concerning the constructs the above-mentioned measures seek to assess are: Watts, Bowes, Latzman, and Lilienfeld (2017); Watts, Donahue, Lilienfeld, and Latzman (2017); Willis, Birthrong, King, Nelson-Gray, and Latzman (2017).
We encourage interested readers to test their preferred alternative theoretical structural models using data and code available on the Open Science Framework for this article: https://osf.io/tc9qf/.
While fixing model parameters from the measurement model for the EXT and NA factors ensures their factor compositions do not change as a function of introducing the traits into the model, readers may be interested in whether the results would change as function of leaving all parameters free. The fit of the freed versus fixed models was very close to the same across the six models introducing each of the six traits to the latent model (freed CFIs = .95–.97, RMSEAs = .07–.09; fixed CFIs = .96–.97, RMSEA = .05–.06), and the loadings of the traits onto their respective factors are also highly similar (average absolute deviation from constrained to freed models across traits for unstandardized loadings = .02).
In response to a helpful comment from an anonymous reviewer, we compared the distribution of the ESI-Disinhibition scale across the two current study samples to that of a combined college and community sample (N = 821) exhibiting a much greater age range (18–47) and more balanced gender representation (54.0% female). In addition, we compared the distributions of SCID-II Questionnaire symptom scores in the current study Sample 2 to those for a separate community-only sample (N = 508) exhibiting different demographic characteristics (age range: 22–38, 50.6% female). The distributions of these variables for current study participants were highly similar to distributions for these comparison samples, somewhat mitigating these concerns. See Supplemental Materials for more details.
References
- Azen R, & Budescu DV (2003). The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods, 8(2), 129–148. [DOI] [PubMed] [Google Scholar]
- Barratt ES (1959). Anxiety and impulsiveness related to psychomotor efficiency. Perceptual and Motor Skills, 9(3), 191–198. [Google Scholar]
- Barratt ES (1965). Factor analysis of some psychometric measures of impulsiveness and anxiety. Psychological Reports, 16(2), 547–554. [DOI] [PubMed] [Google Scholar]
- Barratt ES, Monahan J, & Steadman HJ (1994). Impulsiveness and aggression. Violence and Mental Disorder: Developments in Risk Assessment, 10, 61–79. [Google Scholar]
- Bartlett MS (1937). The statistical conception of mental factors. British journal of Psychology, 28(1), 97–104. [Google Scholar]
- Berg JM, Latzman RD, Bliwise NG, & Lilienfeld SO (2015). Parsing the heterogeneity of impulsivity: A meta-analytic review of the behavioral implications of the UPPS for psychopathology. Psychological Assessment, 27(4), 1129–1146. [DOI] [PubMed] [Google Scholar]
- Brennan GM, & Baskin-Sommers AR (2018). Brain-behavior relationships in externalizing: P3 amplitude reduction reflects deficient inhibitory control. Behavioural Brain Research, 337, 70–79. [DOI] [PubMed] [Google Scholar]
- Brislin SJ, Drislane LE, Smith ST, Edens JF, & Patrick CJ (2015). Development and validation of triarchic psychopathy scales from the Multidimensional Personality Questionnaire. Psychological Assessment, 27(3), 838–851. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brislin SJ, Patrick CJ, Flor H, Nees F, Heinrich A, Drislane LE, … & Büchel C (2019). Extending the construct network of trait disinhibition to the neuroimaging domain: Validation of a bridging scale for use in the European IMAGEN project. Assessment, 26(4), 567–581. [DOI] [PubMed] [Google Scholar]
- Budescu DV (1993). Dominance analysis: a new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114(3), 542–551. [Google Scholar]
- Carlson SR, Pritchard AA, & Dominelli RM (2013). Externalizing behavior, the UPPS-P impulsive behavior scale and reward and punishment sensitivity. Personality and Individual Differences, 54(2), 202–207. [Google Scholar]
- Carver CS, & Johnson SL (2018). Impulsive reactivity to emotion and vulnerability to psychopathology. American Psychologist, 73(9), 1067–1078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chmielewski M, Clark LA, Bagby RM, & Watson D (2015). Method matters: Understanding diagnostic reliability in DSM-IV and DSM-5. Journal of Abnormal Psychology, 124(3), 764–769. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cicchetti D, & Rogosch FA (1996). Equifinality and multifinality in developmental psychopathology. Development and Psychopathology, 8(4), 597–600. [Google Scholar]
- Clark LA (2005). Temperament as a unifying basis for personality and psychopathology. Journal of Abnormal Psychology, 114(4), 505–521. [DOI] [PubMed] [Google Scholar]
- Clark LA, Watson D, & Mineka S (1994). Temperament, personality, and the mood and anxiety disorders. Journal of Abnormal Psychology, 103(1), 103–116. [PubMed] [Google Scholar]
- Coid J, Yang M, Tyrer P, Roberts A, & Ullrich S (2006). Prevalence and correlates of personality disorder in Great Britain. The British Journal of Psychiatry, 188(5), 423–431. [DOI] [PubMed] [Google Scholar]
- Coskunpinar A, & Cyders MA (2013). Impulsivity and substance-related attentional bias: a meta-analytic review. Drug and Alcohol Dependence, 133(1), 1–14. [DOI] [PubMed] [Google Scholar]
- Costa PT Jr, & McCrae RR (1992). Four ways five factors are basic. Personality and Individual Differences, 13(6), 653–665. [Google Scholar]
- Crawford JR, & Henry JD (2004). The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 43, 245–265. [DOI] [PubMed] [Google Scholar]
- Cyders MA, & Coskunpinar A (2011). Measurement of constructs using self-report and behavioral lab tasks: Is there overlap in nomothetic span and construct representation for impulsivity?. Clinical Psychology Review, 31(6), 965–982. [DOI] [PubMed] [Google Scholar]
- Cyders MA (2013). Impulsivity and the sexes: Measurement and structural invariance of the UPPS-P Impulsive Behavior Scale. Assessment, 20(1), 86–97. [DOI] [PubMed] [Google Scholar]
- Derefinko KJ, Peters JR, Eisenlohr-Moul TA, Walsh EC, Adams ZW, & Lynam DR (2014). Relations between trait impulsivity, behavioral impulsivity, physiological arousal, and risky sexual behavior among young men. Archives of Sexual Behavior, 43(6), 1149–1158. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Drislane LE, Patrick CJ, & Arsal G (2014). Clarifying the content coverage of differing psychopathy inventories through reference to the Triarchic Psychopathy Measure. Psychological Assessment, 26(2), 350–362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Drislane LE, Brislin SJ, Kendler KS, Andershed H, Larsson H, & Patrick CJ (2015). A triarchic model analysis of the Youth Psychopathic Traits Inventory. Journal of Personality Disorders, 29(1), 15–41. [DOI] [PubMed] [Google Scholar]
- Drislane LE, Brislin SJ, Jones S, & Patrick CJ (2018). Interfacing five-factor model and triarchic conceptualizations of psychopathy. Psychological Assessment, 30(6), 834–840. [DOI] [PubMed] [Google Scholar]
- Drislane LE, Sellbom M, Brislin SJ, Strickland CM, Christian E, Wygant DB, … & Patrick CJ (2019). Improving characterization of psychopathy within the Diagnostic and Statistical Manual of Mental Disorders, (DSM–5), alternative model for personality disorders: Creation and validation of Personality Inventory for DSM–5 Triarchic scales. Personality Disorders: Theory, Research, and Treatment, 10(6), 511–523. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fanti KA, Frick PJ, & Georgiou S (2009). Linking callous-unemotional traits to instrumental and non-instrumental forms of aggression. Journal of Psychopathology and Behavioral Assessment, 31(4), 285–298. [Google Scholar]
- Fite PJ, Stoppelbein L, & Greening L (2009). Proactive and reactive aggression in a child psychiatric inpatient population: Relations to psychopathic characteristics. Criminal Justice and Behavior, 36(5), 481–493. [Google Scholar]
- Forrest S, Eatough V, & Shevlin M (2005). Measuring adult indirect aggression: The development and psychometric assessment of the indirect aggression scales. Aggressive Behavior: Official Journal of the International Society for Research on Aggression, 31(1), 84–97. [Google Scholar]
- Gray JA (1987). The psychology of fear and stress (Vol. 5). CUP Archive. [Google Scholar]
- Grice JW (2001). Computing and evaluating factor scores. Psychological Methods, 6(4), 430–450. [PubMed] [Google Scholar]
- Gross JJ, & Jazaieri H (2014). Emotion, emotion regulation, and psychopathology: An affective science perspective. Clinical Psychological Science, 2(4), 387–401. [Google Scholar]
- Gustavson DE, du Pont A, Hatoum AS, Rhee SH, Kremen WS, Hewitt JK, & Friedman NP (2017). Genetic and environmental associations between procrastination and internalizing/externalizing psychopathology. Clinical Psychological Science, 5(5), 798–815. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hall JR, Drislane LE, Patrick CJ, Morano M, Lilienfeld SO, & Poythress NG (2014). Development and validation of Triarchic construct scales from the psychopathic personality inventory. Psychological Assessment, 26(2), 447–461. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Habeych ME, Charles PJ, Sclabassi RJ, Kirisci L, & Tarter RE (2005). Direct and mediated associations between P300 amplitude in childhood and substance use disorders outcome in young adulthood. Biological Psychiatry, 57(1), 76–82. [DOI] [PubMed] [Google Scholar]
- Hicks BM, Markon KE, Patrick CJ, Krueger RF, & Newman JP (2004). Identifying psychopathy subtypes on the basis of personality structure. Psychological Assessment, 16(3), 276–288. [DOI] [PubMed] [Google Scholar]
- Hicks BM, Schalet BD, Malone SM, Iacono WG, & McGue M (2011). Psychometric and genetic architecture of substance use disorder and behavioral disinhibition measures for gene association studies. Behavior Genetics, 41(4), 459–475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hill SY, Steinhauer SR, Locke-Wellman J, & Ulrich R (2009). Childhood risk factors for young adult substance dependence outcome in offspring from multiplex alcohol dependence families: a prospective study. Biological Psychiatry, 66(8), 750–757. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Iacono WG, Carlson SR, Taylor J, Elkins IJ, & McGue M (1999). Behavioral disinhibition and the development of substance-use disorders: findings from the Minnesota Twin Family Study. Development and Psychopathology, 11(4), 869–900. [DOI] [PubMed] [Google Scholar]
- Iacono WG, Carlson SR, Malone SM, & McGue M (2002). P3 event-related potential amplitude and the risk for disinhibitory disorders in adolescent boys. Archives of General Psychiatry, 59(8), 750–757. [DOI] [PubMed] [Google Scholar]
- Iacono WG, Malone SM, & McGue M (2008). Behavioral disinhibition and the development of early-onset addiction: common and specific influences. Annual Review of Clinical Psychology, 4, 325–348. [DOI] [PubMed] [Google Scholar]
- James LM, & Taylor J (2008). Associations between symptoms of borderline personality disorder, externalizing disorders, and suicide-related behaviors. Journal of Psychopathology and Behavioral Assessment, 30(1), 1–9. [Google Scholar]
- Joyner KJ, Bowyer CB, Yancey JR, Venables NC, Foell J, Worthy DA, … & Patrick CJ (2019). Blunted reward sensitivity and trait disinhibition interact to predict substance use problems. Clinical Psychological Science, 7(5), 1109–1124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Joyner KJ, Yancey JR, Venables NC, Burwell SJ, Iacono WG, & Patrick CJ (2020). Using a co-twin control design to evaluate alternative trait measures as indices of liability for substance use disorders. International Journal of Psychophysiology, 148, 75–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kahler CW, Hustad J, Barnett NP, Strong DR, & Borsari B (2008). Validation of the 30-day version of the Brief Young Adult Alcohol Consequences Questionnaire for use in longitudinal studies. Journal of Studies on Alcohol and Drugs, 69(4), 611–615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kelley TL (1927). Interpretation of Educational Measurements. Yonkers-on-Hudson, N.Y.: World Book Company. pp. 62–65. [Google Scholar]
- Kotov R, Krueger RF, & Watson D (2018). A paradigm shift in psychiatric classification: the Hierarchical Taxonomy Of Psychopathology (HiTOP). World Psychiatry, 17(1), 24–25. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kotov R, Ruggero CJ, Krueger RF, Watson D, Yuan Q, & Zimmerman M (2011). New dimensions in the quantitative classification of mental illness. Archives of General Psychiatry, 68(10), 1003–1011. [DOI] [PubMed] [Google Scholar]
- Kotov R, Krueger RF, Watson D, Achenbach TM, Althoff RR, Bagby RM, … & Eaton NR (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): a dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126(4), 454–477. [DOI] [PubMed] [Google Scholar]
- Krueger RF (1999). Personality traits in late adolescence predict mental disorders in early adulthood: A perspective‐epidemiological study. Journal of Personality, 67(1), 39–65. [DOI] [PubMed] [Google Scholar]
- Krueger RF, Caspi A, Moffitt TE, & Silva PA (1998). Longitudinal associations between depressive and anxiety disorders: a comparison of two trait models. Journal of Abnormal Psychology, 107, 216–227. [DOI] [PubMed] [Google Scholar]
- Krueger RF, Hicks BM, Patrick CJ, Carlson SR, Iacono WG, & McGue M (2002). Etiologic connections among substance dependence, antisocial behavior and personality: Modeling the externalizing spectrum. Journal of Abnormal Psychology, 111(3), 411–424. [PubMed] [Google Scholar]
- Krueger RF, Markon KE, Patrick CJ, Benning SD, & Kramer MD (2007). Linking antisocial behavior, substance use, and personality: an integrative quantitative model of the adult externalizing spectrum. Journal of Abnormal Psychology, 116(4), 645–666. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krueger RF, McGue M, & Iacono WG (2001). The higher-order structure of common DSM mental disorders: Internalization, externalization, and their connections to personality. Personality and Individual Differences, 30(7), 1245–1259. [Google Scholar]
- Krueger RF, Kotov R, Watson D, Forbes MK, Eaton NR, Ruggero CJ, … & Bagby RM (2018). Progress in achieving quantitative classification of psychopathology. World Psychiatry, 17(3), 282–293. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Latzman RD, Palumbo IM, Krueger RF, Drislane LE, & Patrick CJ (2019a). Modeling relations between triarchic biobehavioral traits and DSM internalizing disorder dimensions. Assessment. 10.1177/1073191119876022 [DOI] [PubMed] [Google Scholar]
- Latzman RD, Palumbo IM, Sauvigné KC, Hecht LK, Lilienfeld SO, & Patrick CJ (2019b). Psychopathy and internalizing psychopathology: A triarchic model perspective. Journal of Personality Disorders, 33(2), 262–287. [DOI] [PubMed] [Google Scholar]
- Latzman RD, & Vaidya JG (2013). Common and distinct associations between aggression and alcohol problems with trait disinhibition. Journal of Psychopathology and Behavioral Assessment, 35(2), 186–196. [Google Scholar]
- Latzman RD, Vaidya JG, Malikina MV, Berg JM, & Lilienfeld SO (2014). Exploring associations between psychopathic personality and components of Disinhibition vs. Constraint. Journal of Psychopathology and Behavioral Assessment, 36(4), 497–509. [Google Scholar]
- Lynam DR, Hoyle RH, & Newman JP (2006). The perils of partialling: Cautionary tales from aggression and psychopathy. Assessment, 13(3), 328–341. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lynam DR, Smith GT, Whiteside SP, & Cyders MA (2006). The UPPS-P: Assessing five personality pathways to impulsive behavior. West Lafayette, IN: Purdue University. [Google Scholar]
- MacKillop J, Weafer J, Gray JC, Oshri A, Palmer A, & de Wit H (2016). The latent structure of impulsivity: impulsive choice, impulsive action, and impulsive personality traits. Psychopharmacology, 233(18), 3361–3370. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nelson LD, Patrick CJ, & Bernat EM (2011). Operationalizing proneness to externalizing psychopathology as a multivariate psychophysiological phenotype. Psychophysiology, 48(1), 64–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nelson LD, Strickland C, Krueger RF, Arbisi PA, & Patrick CJ (2016). Neurobehavioral traits as transdiagnostic predictors of clinical problems. Assessment, 23(1), 75–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nimon KF, & Oswald FL (2013). Understanding the results of multiple linear regression: Beyond standardized regression coefficients. Organizational Research Methods, 16(4), 650–674. [Google Scholar]
- Nock MK, Wedig MM, Holmberg EB, & Hooley JM (2008). The emotion reactivity scale: development, evaluation, and relation to self-injurious thoughts and behaviors. Behavior Therapy, 39(2), 107–116. [DOI] [PubMed] [Google Scholar]
- Patrick CJ (2010). Operationalizing the triarchic conceptualization of psychopathy: Preliminary description of brief scales for assessment of boldness, meanness, and disinhibition. Unpublished test manual, Florida State University, Tallahassee, FL. [Google Scholar]
- Patrick CJ, Bernat EM, Malone SM, Iacono WG, Krueger RF, & McGue M (2006). P300 amplitude as an indicator of externalizing in adolescent males. Psychophysiology, 43(1), 84–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patrick CJ, Fowles DC, & Krueger RF (2009). Triarchic conceptualization of psychopathy: Developmental origins of disinhibition, boldness, and meanness. Development and Psychopathology, 21(3), 913–938. [DOI] [PubMed] [Google Scholar]
- Patrick CJ, Iacono WG, & Venables NC (2019). Incorporating neurophysiological measures into clinical assessments: Fundamental challenges and a strategy for addressing them. Psychological Assessment, 31(12), 1512–1529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patrick CJ, Joyner KJ, Watts AL, Lilienfeld SO, Somma A, Fossati A, … & Krueger R (in press). Latent variable modeling of item-based factor scales: Comment on ‘Triarchic or Septarchic?—Uncovering the Triarchic Psychopathy Measure’s (TriPM) Structure’. Personality Disorders: Treatment and Theory. [DOI] [PubMed] [Google Scholar]
- Patrick CJ, Kramer MD, Krueger RF, & Markon KE (2013a). Optimizing efficiency of psychopathology assessment through quantitative modeling: Development of a brief form of the Externalizing Spectrum Inventory. Psychological Assessment, 25(4), 1332–1348. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patrick CJ, Venables NC, Yancey JR, Hicks BM, Nelson LD, & Kramer MD (2013b). A construct-network approach to bridging diagnostic and physiological domains: Application to assessment of externalizing psychopathology. Journal of Abnormal Psychology, 122(3), 902–916. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patton JH, Stanford MS, & Barratt ES (1995). Factor structure of the Barratt impulsiveness scale. Journal of Clinical Psychology, 51(6), 768–774. [DOI] [PubMed] [Google Scholar]
- Pedhazur EJ, & Pedhazur Schmelkin L (1991). Exploratory factor analysis. Measurement, Design and Analysis: An Integrated Approach, 590–630. [Google Scholar]
- Perkins ER, Latzman RD, & Patrick CJ (2019). Interfacing neural constructs with the Hierarchical Taxonomy of Psychopathology:’Why’and ‘how’. Personality and Mental Health. Advance online publication. [DOI] [PubMed] [Google Scholar]
- Perkins ER, Joyner KJ, Patrick CJ, Bartholow BD, Latzman RD, DeYoung CG, & … Zald DH (2020). Neurobiology and the Hierarchical Taxonomy of Psychopathology: Progress toward ontogenetically informed and clinically useful nosology. Dialogues in Clinical Neuroscience, 22(1), 417–429. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Petit G, Kornreich C, Noël X, Verbanck P, & Campanella S (2012). Alcohol-related context modulates performance of social drinkers in a visual Go/No-Go task: a preliminary assessment of event-related potentials. PloS One, 7(5): e37466. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Racine SE, Keel PK, Burt SA, Sisk CL, Neale M, Boker S, & Klump KL (2013). Exploring the relationship between negative urgency and dysregulated eating: Etiologic associations and the role of negative affect. Journal of Abnormal Psychology, 122(2), 433–444. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Raine A, Dodge K, Loeber R, Gatzke-Kopp L, Lynam D, Reynolds C, … & Liu J (2006). The reactive–proactive aggression questionnaire: Differential correlates of reactive and proactive aggression in adolescent boys. Aggressive Behavior: Official Journal of the International Society for Research on Aggression, 32(2), 159–171. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Read JP, Beattie M, Chamberlain R, & Merrill JE (2008). Beyond the “binge” threshold: Heavy drinking patterns and their association with alcohol involvement indices in college students. Addictive Behaviors, 33(2), 225–234. [DOI] [PubMed] [Google Scholar]
- Read JP, Merrill JE, Kahler CW, & Strong DR (2007). Predicting functional outcomes among college drinkers: Reliability and predictive validity of the Young Adult Alcohol Consequences Questionnaire. Addictive Behaviors, 32(11), 2597–2610. [DOI] [PubMed] [Google Scholar]
- Rosseel Y (2012). Lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1 – 36. [Google Scholar]
- Tarter RE, Kirisci L, Habeych M, Reynolds M, & Vanyukov M (2004). Neurobehavior disinhibition in childhood predisposes boys to substance use disorder by young adulthood: direct and mediated etiologic pathways. Drug and Alcohol Dependence, 73(2), 121–132. [DOI] [PubMed] [Google Scholar]
- Tellegen A (1982). Brief manual for the Multidimensional Personality Questionnaire. Unpublished manuscript, University of Minnesota, Minneapolis. [Google Scholar]
- Thorndike E (1904). An introduction to the theory of mental and social measurements. New York: Teachers College, Columbia University. [Google Scholar]
- Torgersen S, Czajkowski N, Jacobson K, Reichborn-Kjennerud T, Røysamb E, Neale MC, & Kendler KS (2008). Dimensional representations of DSM-IV cluster B personality disorders in a population-based sample of Norwegian twins: a multivariate study. Psychological Medicine, 38(11), 1617–1625. [DOI] [PubMed] [Google Scholar]
- Trochim WMK, Donnelly JP (2006). The Research Methods Knowledge Base. Cincinnati, OH: Atomic Dog. [Google Scholar]
- Sellbom M, Drislane LE, Johnson AK, Goodwin BE, Phillips TR, & Patrick CJ (2016). Development and validation of MMPI-2-RF scales for indexing triarchic psychopathy constructs. Assessment, 23(5), 527–543. [DOI] [PubMed] [Google Scholar]
- Settles RE, Fischer S, Cyders MA, Combs JL, Gunn RL, & Smith GT (2012). Negative urgency: A personality predictor of externalizing behavior characterized by neuroticism, low conscientiousness, and disagreeableness. Journal of Abnormal Psychology, 121(1), 160–172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sperry SH, Lynam DR, & Kwapil TR (2018). The convergence and divergence of impulsivity facets in daily life. Journal of Personality, 86(5), 841–852. [DOI] [PubMed] [Google Scholar]
- Sperry SH, Lynam DR, Walsh MA, Horton LE, & Kwapil TR (2016). Examining the multidimensional structure of impulsivity in daily life. Personality and Individual Differences, 94, 153–158. [Google Scholar]
- Stanley JH, Wygant DB, & Sellbom M (2013). Elaborating on the construct validity of the Triarchic Psychopathy Measure in a criminal offender sample. Journal of Personality Assessment, 95(4), 343–350. [DOI] [PubMed] [Google Scholar]
- Steiger JH (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87(2), 245–251. [Google Scholar]
- Venables NC, Foell J, Yancey JR, Kane MJ, Engle RW, & Patrick CJ (2018). Quantifying inhibitory control as externalizing proneness: A cross-domain model. Clinical Psychological Science, 6(4), 561–580. [Google Scholar]
- Vrieze SI, McGue M, Miller MB, Hicks BM, & Iacono WG (2013). Three mutually informative ways to understand the genetic relationships among behavioral disinhibition, alcohol use, drug use, nicotine use/dependence, and their co-occurrence: twin biometry, GCTA, and genome-wide scoring. Behavior Genetics, 43(2), 97–107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watts AL, Poore HE, & Waldman ID (2019). Riskier tests of the validity of the bifactor model of psychopathology. Clinical Psychological Science, 7(6), 1285–1303. [Google Scholar]
- Watson D (2005). Rethinking the mood and anxiety disorders: a quantitative hierarchical model for DSM-V. Journal of Abnormal Psychology, 114(4), 522–536. [DOI] [PubMed] [Google Scholar]
- Watson D, & Clark LA (1994). The PANAS-X: Manual for the Positive and Negative Affect Schedule-Expanded Form. The University of Iowa Department of Psychological and Brain Sciences Publications. [Google Scholar]
- White HR, & Labouvie EW (1989). Towards the assessment of adolescent problem drinking. Journal of Studies on Alcohol, 50(1), 30–37. [DOI] [PubMed] [Google Scholar]
- Whiteside SP, & Lynam DR (2001). The five factor model and impulsivity: Using a structural model of personality to understand impulsivity. Personality and Individual Differences, 30(4), 669–689. [Google Scholar]
- Whiteside SP, & Lynam DR (2003). Understanding the role of impulsivity and externalizing psychopathology in alcohol abuse: application of the UPPS impulsive behavior scale. Experimental and Clinical Psychopharmacology, 11(3), 210–217. [DOI] [PubMed] [Google Scholar]
- Yancey JR, Venables NC, Hicks BM, & Patrick CJ (2013). Evidence for a heritable brain basis to deviance-promoting deficits in self-control. Journal of Criminal Justice, 41(5), 309–317. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Young SE, Friedman NP, Miyake A, Willcutt EG, Corley RP, Haberstick BC, & Hewitt JK (2009). Behavioral disinhibition: liability for externalizing spectrum disorders and its genetic and environmental relation to response inhibition across adolescence. Journal of Abnormal Psychology, 118(1), 117–130. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.