Abstract
Background
DSM-IV-TR suggests that clinicians should assess clinically relevant personality traits that do not necessarily constitute a formal personality disorder, and should note these traits on Axis II, but DSM-IV-TR does not provide a trait model to guide the clinician. Our goal was to provide a provisional trait model and a preliminary corresponding assessment instrument, in our roles as members of the DSM-5 personality and personality disorders workgroup and workgroup advisors.
Methods
An initial list of specific traits and domains (broader groups of traits) was derived from DSM-5 literature reviews and workgroup deliberations, with a focus on capturing maladaptive personality characteristics deemed clinically salient, including those related to the criteria for DSM-IV-TR personality disorders (PDs). The model and instrument were then developed iteratively using data from community samples of treatment seeking participants. The analytic approach relied on tools of modern psychometrics (e.g., item response theory models).
Results
Twenty-five reliably measured core elements of personality description emerged that, together, delineate five broad domains of maladaptive personality variation: negative affect, detachment, antagonism, disinhibition, and psychoticism.
Conclusions
We developed a maladaptive personality trait model and corresponding instrument as a step on the path toward helping users of DSM-5 assess traits that may or may not constitute a formal PD. The inventory we developed is reprinted in its entirety in the supplementary materials, with the goal of encouraging additional refinement and development by other investigators prior to the finalization of DSM-5. Continuing discussion should focus on various options for integrating personality traits into DSM-5.
Keywords: Personality Trait, Personality Disorder, Assessment, DSM
Introduction
In DSM-IV-TR, if maladaptive personality traits are part of the clinical picture but do not constitute a formal PD, the clinician is encouraged to record these traits on Axis II. Nevertheless, DSM-IV-TR does not provide a specific model for conceptualizing these traits, beyond their appearance as features of the 10 PDs. This is in spite of the fact that there has been much interest recently in the etiology (van den Oord et al. 2008; de Moor et al. 2011), treatment (Tang et al. 2009), clinical relevance (Hopwood et al. 2008), and social costs (Cuijpers et al. 2010) of personality traits in the psychiatric literature.
Our aim in the current research was (a) to construct a preliminary maladaptive personality trait model for DSM-5 and then (b) to test and refine it through the creation of a provisional corresponding assessment instrument. This research was conducted under the auspices of the DSM-5 personality and personality disorders workgroup, by members of the workgroup and workgroup consultants. Nevertheless, it is critical to emphasize that no decisions have been formalized regarding the conceptualization of PDs in DSM-5, or regarding the ways in which the constructs of personality traits and PDs might best be represented in DSM-5. By disseminating our findings to date in this report, our hope is to stimulate additional research from other investigators that can inform DSM-5 and subsequent revisions.
With regard to a personality trait model suitable for DSM-5, a variety of compelling models exist, instantiated in a corresponding variety of assessment instruments (for reviews see Trull & Durrett, 2005 and Clark, 2007). The DSM-5 workgroup and consultants (a number of whom are authors of published measures of clinically-relevant personality constructs; Clark et al. in press; Livesley & Jackson, 2009; Morey, 2003) began by reviewing these existing models and measures of maladaptive personality traits, with a particular focus on reviews completed as part of a 2004 pre-DSM-5 research planning meeting. In particular, Widiger and Simonsen (2005) provided evidence that four broad bipolar domains (i.e., domains with two opposite ends) of extraversion vs. introversion, antagonism vs. compliance, constraint vs. impulsivity, and negative affect vs. emotional stability could serve as an organizing framework for traits seen across 18 models that had been described in the literature. They also described a fifth potential domain, “unconventionality versus closedness to experience,” but noted that this domain was not well represented in the models they reviewed, although it is a major domain assessed by the Revised NEO Personality Inventory (NEO PI-R; Costa & McCrae, 1992). Moreover, a recent meta-analysis showed essentially zero correlation between this domain and DSM-IV PDs (Samuel & Widiger, 2008). Nevertheless, other research has identified a domain of peculiar or odd traits that provides coverage of features corresponding with some key components of Schizotypal PD, i.e., “cognitive or perceptual distortions and eccentricities of behavior” (DSM-IVTR, p. 685; Chmielewski & Watson, 2008; Harkness et al. 1995). Hence, in addition to the four major domains identified by Widiger and Simonsen (2005), we also sought to identify and measure traits in a fifth domain of psychoticism, resulting in a model that, at the domain-level, bears a strong resemblance to Harkness' Personality Psychopathology 5 (PSY-5) model of clinically relevant personality variants (Harkness et al. 1995).
Our focus was initially on identifying and operationalizing specific maladaptive personality dimensions falling within five broad domains, with a focus on the poles of these domains that are associated with PD (i.e., introversion, antagonism, impulsivity, negative affect, and psychoticism). That is, the features of PD tend to be concentrated at specific poles of these domains. In a meta-analytic review of literature linking the Five Factor Model of personality ([FFM]; see Costa & Widiger, 2002; Goldberg, 1993—which bears a strong resemblance to the model described by Widiger and Simonsen)—with the DSM-IV PDs (Samuel & Widiger, 2008), DSM-IV PDs were associated with introversion (the absence of FFM extraversion), antagonism (the absence of FFM agreeableness), impulsivity (the absence of FFM conscientiousness), and negative affect (FFM neuroticism). There were only two exceptions: an association between histrionic PD and FFM extraversion, and an association between obsessive compulsive PD and FFM conscientiousness. Hence, we endeavored to ensure that our trait list also covered core features of histrionic PD and obsessive compulsive PD. DSM-IV describes the core features of histrionic PD as “excessive emotionality and attention seeking” (p. 685) so we ensured coverage of those two primary traits. DSM-IV describes the core features of obsessive compulsive PD as “preoccupation with orderliness, perfectionism, and control” (p. 685). These traits broadly define the constraint pole of impulsivity vs. constraint in the Widiger and Simonsen model. Hence, we focused on the delineation and measurement of specific maladaptive traits in the domains of (I, high pole) introversion, (II, high pole) antagonism, (III, high pole) impulsivity vs. (III, low pole) constraint, (IV, high pole) negative affect, and (V, high pole) psychoticism. As described below, we subsequently changed the name of the introversion domain to detachment and the name of the impulsivity domain to disinhibition, to better reflect the content of these domains, at least as that content emerged in our project.
In sum, our approach was to synthesize existing models to arrive at a model and assessment instrument that (a) encompass the four major domains of maladaptive personality variation identified by Widiger and Simonsen (2005), with explicit measurement of the poles of those domains associated with DSM-IV-TR PDs; (b) also contains an additional fifth domain of psychoticism; and (c) contains multiple specific maladaptive trait facets within all five domains, with a focus on covering the maladaptive trait features of DSM-IV-TR PDs. To our knowledge, no existing model and assessment instrument encompasses this complete set of features. An additional consideration regarding existing models is that these models are not suited to being imported verbatim into the DSM because they are typically operationalized in specific, commercially-available assessment instruments. In sum, our approach was to draw broadly on research on existing models, to frame the generation of an empirically-based model and measure that is freely available and can be employed in research that can inform DSM-5 and beyond.
Measure Construction
We began with a hypothesized set of domains identified throughout the DSM-5 process to date as covering maladaptive personality variation in existing instruments and models. Work group members and consultants generated a list of 37 facets (specific personality traits, as opposed to broad domains containing multiple traits) as potential exemplars with the aim of covering all the domains. Each of the 11 members of the DSM-5 personality and personality disorders workgroup had the opportunity to contribute to this process and were given multiple opportunities to review the resulting list of facets. Once the preliminary list of 37 facets was finalized, the authors of the current paper wrote brief definitions of each of the facets, and relied on these definitions in writing items designed to tap their content.
Table 1 presents a list of these domains and facets, using the terminology we arrived at ultimately. Our initial measure construction took place over the course of two rounds of data collection, aimed at a) measuring each proposed facet reliably, and b) examining whether facets could be collapsed, or items reassigned among facets, within each of the domains. Both of these measure construction goals were completed by collecting data from an on-line panel of respondents specifically cultivated to ensure the ability to generalize to the U.S. population (the Knowledge Networks Panel; Dennis, 2010). Samples were selected from among persons in the Knowledge Networks Panel who responded positively to the question “have you ever seen a therapist for psychological or psychiatric counseling or therapy” in a previous survey. This sampling strategy was used in our initial rounds of data collection to help ensure that our respondents were more nationally representative than those who could be recruited from a specific clinic, but also more likely to show variation in maladaptive personality characteristics, relative to a sample not selected for seeking mental health services.
Table 1.
Original facet (prior to Round 1 data collection) | Restructured facet (after Round 2 analyses) | Final domain |
---|---|---|
Negative Affect | ||
| ||
Anxiousness | Anxiousness | |
|
||
Emotional lability | Emotional Lability | |
|
||
Hostility |
Hostility | |
Oppositionality | ||
|
||
Perseveration | Perseveration | |
|
||
(lack of) Restricted Affectivity | (lack of) Restricted Affectivity | |
|
||
Separation Insecurity | Separation Insecurity | |
|
||
Submissiveness | Submissiveness | |
| ||
Detachment | ||
| ||
Anhedonia | Anhedonia | |
|
||
Depressivity |
Depressivity | |
Guilt and Shame |
||
Low Self-Esteem |
||
Pessimism |
||
Self-Harm | ||
|
||
Intimacy Avoidance | Intimacy Avoidance | |
|
||
Suspiciousness | Suspiciousness | |
|
||
Social Detachment |
Withdrawal | |
Social Withdrawal | ||
| ||
Antagonism | ||
| ||
Attention Seeking | Attention Seeking | |
|
||
Aggression |
Callousness | |
Callousness | ||
|
||
Deceitfulness | Deceitfulness | |
|
||
Grandiosity | Grandiosity | |
|
||
Manipulativeness | Manipulativeness | |
| ||
Disinhibition | ||
| ||
Distractibility | Distractibility | |
|
||
Impulsivity | Impulsivity | |
|
||
Irresponsibility | Irresponsibility | |
|
||
(lack of) Orderliness |
(lack of) Rigid Perfectionism | |
(lack of) Perfectionism |
||
(lack of) Rigidity | ||
|
||
Recklessness |
Risk Taking | |
(lack of) Risk Aversion | ||
| ||
Psychoticism | ||
| ||
Cognitive Dysregulation |
Eccentricity | |
Eccentricity | ||
|
||
Dissociation Proneness | Cognitive and Perceptual Dysregulation | |
|
||
Unusual Beliefs |
Unusual Beliefs & Experiences | |
Unusual Perceptions |
(Note: Rigid Perfectionism and Restricted Affectivity are indicators of the opposite pole of their respective domains; see Table 3).
Round 1
The first round of data collection was designed to examine our ability to measure the 37 initial facets. We began by writing 8 specific personality items to measure each proposed facet. The reading level of all items was eighth grade or less, to ensure that the resulting inventory could be completed by persons with varying levels of education.
Participants
A total of 762 persons participated in our initial round of data collection. Knowledge Networks collected all data via a web-based survey. Demographic characteristics for all three waves of data collection are presented in Supplementary Table S1. Sampling weights were applied in all analyses (Asparouhov, 2005) to adjust the current sample demographics to be representative of the United States population (and, at Rounds 1 and 2, taking into account our study-specific inclusion criteria of having seen a psychiatrist or psychologist). The weighting took into account both sampling (e.g., under-sampling of telephone numbers not matched to a valid mailing address) and participant characteristics (i.e., sex, age, race/ethnicity, education, geographic location, living in a metropolitan area, and internet access).
Measure
The Round 1 item pool consisted of 296 items (8 per each of 37 facets). Item order was randomized, and the items were split into four sections of 74 items each. These sections were then combined into six item booklets. That is, if the 74-item sections are designated ABCD, the six booklets were: AB, AC, AD, BC, BD, and CD. Participants were then randomly assigned to receive one of the six booklets, such that each participant received 50% of the total measure and participant missingness across items was completely at random (see e.g., Smits and Vorst, 2007). This reduced the response burden on each participant, while still ensuring that covariances were estimable among all items. Each item was displayed on a separate screen. All items presented the same four response options of “Very false or often false”, “Sometimes or somewhat false”, “Sometimes or somewhat true”, and “Very true or often true”. The entire final measure, including respondent instructions, item content, and response options, is given in Appendix A.
Analyses
Analyses were completed in the software package Mplus (Muthen & Muthen, 1998–2010) on raw data, weighted according to Knowledge Networks' determined sampling weights to adjust the data to be population representative, using a robust maximum-likelihood estimator to estimate model parameters and to model missingness directly (MLR), and treating categorical manifest variables (e.g., item level responses) as categorical. Initially, Geomin-rotated exploratory factor analyses (EFAs) were run on all eight items within each facet, requesting factor results for one- to four-factors and treating the items as ordinal. Factor solutions were compared on their Bayesian Information Criterion (BIC; Schwarz, 1978), with a lower BIC indicating a better relative fit to the data. Because we were fitting directly to the raw response patterns, fit indices that can be obtained for ML estimation applied to moment matrices (e.g., covariances) were not available in this scenario. We relied on BIC because of its emphasis on parsimony, which corresponded with our aim of identifying parcels of items that measured a single factor (i.e., the most parsimonious model among models containing 1 to k factors). Specifically, if BIC indicated that a one-factor solution fit the data best, all items were retained for subsequent analyses. If BIC indicated that the best-fitting solution included more than one factor, we selected items loading on the largest factor (in terms of the greatest number of items) and re-ran the EFA to confirm that a one-factor solution fit best in the retained items.
We then fit one-factor models to items within each of the facets, with the aim of further refining these initial facet measures. Specifically, if any items had standardized loadings on their facet of less than 0.5, those items were dropped and the FAs were re-run with the retained items. We chose 0.5 as the minimum loading for retaining an item because this is a relatively conservative value, corresponding with high correlations among all items within a facet scale; we found that a cut-off of 0.5 ensured our ability to create scales with relatively good information curves and high levels of internal consistency (see Supplement and Table 2 for evidence that this strategy was ultimately effective).
Table 2.
Selected sample (R2) |
Representative sample (R3) |
||||||
---|---|---|---|---|---|---|---|
Items | Alpha | Mean | St. Dev. | Alpha | Mean | St. Dev. | |
Facet | |||||||
Anhedonia | 8 | 0.88 | 1.05 | 0.65 | 0.88 | 0.89 | 0.64 |
Anxiousness | 9 | 0.91 | 1.25 | 0.78 | 0.91 | 1.02 | 0.73 |
Attention Seeking | 8 | 0.88 | 0.86 | 0.63 | 0.89 | 0.81 | 0.65 |
Callousness | 14 | 0.88 | 0.46 | 0.44 | 0.91 | 0.40 | 0.50 |
Deceitfulness | 10 | 0.89 | 0.56 | 0.54 | 0.85 | 0.52 | 0.54 |
Depressivity | 14 | 0.94 | 0.66 | 0.65 | 0.95 | 0.53 | 0.62 |
Distractibility | 9 | 0.92 | 0.99 | 0.72 | 0.91 | 0.82 | 0.69 |
Eccentricity | 13 | 0.95 | 0.98 | 0.77 | 0.96 | 0.82 | 0.76 |
Emotional Lability | 7 | 0.90 | 1.06 | 0.74 | 0.89 | 0.94 | 0.74 |
Grandiosity | 6 | 0.73 | 0.84 | 0.55 | 0.72 | 0.82 | 0.58 |
Hostility | 10 | 0.88 | 1.05 | 0.63 | 0.89 | 0.91 | 0.67 |
Impulsivity | 6 | 0.85 | 0.85 | 0.67 | 0.77 | 0.77 | 0.57 |
Intimacy Avoidance | 6 | 0.84 | 0.79 | 0.69 | 0.84 | 0.61 | 0.65 |
Irresponsibility | 7 | 0.80 | 0.46 | 0.50 | 0.81 | 0.39 | 0.49 |
Manipulativeness | 5 | 0.80 | 0.81 | 0.61 | 0.81 | 0.80 | 0.67 |
Perceptual Dysregulation | 12 | 0.89 | 0.54 | 0.55 | 0.86 | 0.44 | 0.48 |
Perseveration | 9 | 0.86 | 0.88 | 0.61 | 0.88 | 0.82 | 0.62 |
Restricted Affectivity | 7 | 0.75 | 0.95 | 0.56 | 0.73 | 0.97 | 0.56 |
Rigid Perfectionism | 10 | 0.89 | 1.08 | 0.65 | 0.90 | 1.05 | 0.68 |
Risk Taking | 14 | 0.88 | 1.09 | 0.53 | 0.85 | 1.05 | 0.51 |
Separation Insecurity | 7 | 0.86 | 0.80 | 0.68 | 0.85 | 0.80 | 0.68 |
Submissiveness | 4 | 0.80 | 1.20 | 0.68 | 0.78 | 1.17 | 0.66 |
Suspiciousness | 7 | 0.83 | 1.04 | 0.67 | 0.73 | 0.95 | 0.58 |
Unusual Beliefs & Experiences | 8 | 0.85 | 0.66 | 0.62 | 0.83 | 0.64 | 0.63 |
Withdrawal | 10 | 0.93 | 1.12 | 0.71 | 0.93 | 1.01 | 0.72 |
Domain | |||||||
Negative affect | 53 | 0.94 | 1.16 | 0.44 | 0.93 | 1.07 | 0.44 |
Detachment | 45 | 0.96 | 0.91 | 0.54 | 0.96 | 0.78 | 0.54 |
Antagonism | 43 | 0.94 | 0.65 | 0.42 | 0.95 | 0.61 | 0.46 |
Disinhibition | 46 | 0.89 | 1.13 | 0.35 | 0.84 | 1.06 | 0.30 |
Psychoticism | 33 | 0.95 | 0.74 | 0.56 | 0.96 | 0.64 | 0.57 |
(Note: Item responses were coded 0 through 3, with higher scores indicating greater pathology. Statistics are based on list-wise deletion; therefore, individuals from Round 1 are not included due to planned missingness. Items from Restricted Affectivity and Rigid Perfectionism were reverse-scored for their inclusion in the Negative affect and Disinhibition domain scores, respectively.)
Once each facet had been reduced to items that 1) fit a one-factor model, and 2) all loaded highly on the facet, we examined the results in an item-response theory (IRT) framework (see Embretson & Reise, 2000, for a thorough description of IRT-based theory and methods). Using a 2-parameter logistic (2PL) IRT model (the two parameters are threshold and slope, with three thresholds per item in our case because the items had four response options) allowed us to estimate reliability for individuals contingent upon their latent trait level (theta). We estimated information for both individual items and the overall facet (or test information, the sum of information curves for each of the included items). Facets were considered well-measured if their test information was greater than 5 (equivalent to a standard error of measurement < 0.45) for at least 3 standard deviations of theta; this approach resulted in scales that would also be deemed reliable via evaluation using coefficient alpha (see Table 2).
Results
Test information curves (TICs) for each of the facets indicated that we were able to measure most, but not all, facets reliably. The following six facets were not well-measured by the Round 1 items: submissiveness, separation insecurity, attention seeking, oppositionality, perseveration, and rigidity. A total of 65 items (22% of those fielded) were dropped following Round 1, either because they a) did not fit a single-factor model within their designated facet, or b) had low loadings on their designated facet.
Round 2
In the second round of data collection, we included additional items to (a) enhance the measurement of facets that were not measured reliably in Round 1 and b) refine the structure of scales via item-level factor analysis.
Participants
A total of 366 participants responded to the second wave of data collection. Participant selection and weighting scheme were identical to that in the first wave of data collection.
Measure
In the second wave of data collection, all participants were asked to respond to all items. For those facets that were well-measured in Round 1, we wrote items to replace any dropped items so that each facet had at least 8 items going into Round 2 data collection. For facets not well-measured in Round 1, we wrote items so that each facet had at least 10 items. This resulted in 231 original items and 85 new items (for a total of 316 items) being fielded as part of the second wave of data collection. Participant instructions and response options were the same as those given in Round 1. Items were administered in the same relative random order as in Round 1, with replacement items inserted into the survey in place of removed items.
Analyses
To maximize the information included in the Round 2 analyses, and because they were collected using the same sampling scheme, data from Rounds 1 and 2 were combined for those items that had been presented in both phases. All data were again weighted by Knowledge Networks' provided sampling weights to adjust sample demographics to be representative of the U.S. population, taking into account our selection based on participants having seen a therapist. For each facet that was not well-measured in Round 1, we again ran an EFA within that facet. As before, if BIC indicated a solution with two or more factors fit best, we dropped items loading on all but the largest factor and confirmed through a subsequent EFA that a one-factor solution now fit the data best. We then examined one factor solutions within each of the facets, again dropping items with standardized loadings less than 0.5 on the facet. From these FA results, we re-examined the IRT-parameterized item and test information curves to ensure that all of the facets now were measured well by the remaining items.
We next conducted EFAs of all items within each of the proposed domains, estimating factor solutions up to one greater than the hypothesized number of facets (e.g., if 6 facets were hypothesized, we examined solutions up to and including 7 factors). Due to the computational complexity of estimating EFA solutions with a large number of factors for numerous polytomous items, these analyses were run in the program IRTPRO (Cai, 2010; Scientific Software International, 2010) using the default Oblique CF-Quartimax rotation and Metropolis-Hastings Robbins-Monro (MH-RM) estimator (Cai, 2010). From these EFAs, the solution with the best relative fit to the raw data, defined as the lowest BIC value, was selected for item assignment to final facets as long as that solution resulted in all factors being interpretable (i.e., each factor needed more than one item to load most highly on it). If the best fitting model did not present with all interpretable factors, we selected the factor solution with the next lowest BIC. Items were assigned to the facet on which they had the highest loading in the best-fitting factor solution. We reanalyzed each of the newly-defined facets using one-factor models in Mplus. Again, if any items had standardized loadings less than 0.5 on their assigned facet, they were dropped from further analyses. Facets were then “trimmed” to ensure that no facet had a disproportionate number of items assigned to it. Using a target maximum of 10 items per facet, we removed items ensuring that the retained items 1) were representative of the full range of items that had been assigned to that facet based on the item-level within-domain EFAs, both in terms of item model parameters and content coverage; and 2) continued to measure the restructured facet reliably (that is, test information greater than 5 for at least 3 standard deviations of the latent trait, theta).
Results
Our results following Round 2 data collection confirmed that all 37 of the originally proposed facets were well-measured by the current item set. The results of item-level within-domain EFAs, however, suggested that the 37 facets could be collapsed into a more parsimonious set of 25 final traits. In two cases, the results of the EFA suggested that two facets could be collapsed, but we kept these facets separate with the aim of retaining separate scales corresponding with both pairs of constructs. Specifically, for the single facets identified as 1) anxiousness combined with suspiciousness and 2) callousness combined with grandiosity, we re-ran EFAs including only these items (as opposed to all the items in the corresponding domains). In both cases the best-fitting model, based on the lowest BIC value, included two separable factors. We therefore split the items within these facets based on these results (i.e., separating anxiousness from suspiciousness and separating callousness from grandiosity). Similarly, the original facets of recklessness and risk aversion (reverse-scored) were collapsed into a single risk taking facet, based on prior evidence indicating a single dimension and a resulting well-fitting single-factor FA. A representation of how facets were collapsed as a result of these within-domain item-level EFAs is shown in Table 1.
One-factor models were then fit within each restructured facet identified in the EFA analyses, with items assigned to the facet on which they loaded most highly in the EFA. Following the removal of items that had standardized loadings of less than 0.5 on their assigned facet, as well as paring down items within several facets that now contained an unnecessarily large number of items (e.g., depressivity), we were left with a set of 220 items that reliably measured all 25 traits, with 4 to 14 items included within each facet.
Summary
Following the completion of the second wave of data collection, we were able to identify a reduced set of 25 empirically-derived reliable facets. The entire measure, along with facet scoring documentation, is available in Appendices A and B of the supplemental materials. We turn now to examining the norms and reliability of the measure in a population-representative sample (that is, one that was not selected for seeking mental health services).
Round 3
Participants
The third round of data collection was designed to examine the 25 identified facets in a representative sample (N=264), using Knowledge Networks' weights to adjust the sample to be U.S. population-representative. Participants responded to the entire final set of 220 items, presented in the same relative random order with the same instructions and response options as those given in previous rounds.
Results
All facets continued to meet IRT reliability criteria. In addition, Cronbach's alpha for each of the facets ranged from 0.72 to 0.96 in the normative (population-representative) sample data, with a median of 0.86. Table 2 presents alpha estimates and sum-score means and standard deviations for each facet (with results from the Round 2 data presented as well, for comparison purposes). Full item-level parameters for the final measure are presented in Appendix C of the supplemental material, along with IRT item and test information curves (IICs and TICs, supplemental Figures S1 and S2). To take advantage of both the selected and representative samples, latent trait levels, or factor scores, on each of the 25 facets were estimated by constraining the latent factors to have a mean of 0 and variance of 1 in the representative sample, with means and variances freely estimated in the selected sample. Consistent with the sampling strategy difference between rounds 1 and 2 and round 3, the latent means were higher in the selected sample compared with the representative sample for 24 of 25 scales (the one exception was that the restricted affectivity mean was slightly lower in the rounds 1 and 2 data) and the variances were similar; the exact values are available upon request. Facet factor scores estimated from this final model are used in all structural analyses described subsequently, unless otherwise indicated.
Preliminary Structure
Facet correlations
Correlations among all facets within both the selected (Rounds 1 and 2) and representative (Round 3) samples are presented in Supplemental Table S2. In general, the facets tended to be positively inter-correlated. The median correlation among facets within the selected sample was 0.30, while the median correlation among facets within the representative sample was 0.45.
Exploratory factor analyses
To evaluate the number of factors to extract and interpret, we focused primarily on substantive interpretability, but also took into account the minimum average partial (MAP) and parallel analysis criteria (Zwick & Velicer, 1986); in addition, we estimated bootstrap confidence intervals around eigenvalues of the facet score correlation matrix using the open-source statistical package R (Team RDC, 2010). MAP suggested three factors, parallel analysis suggested six, and eigenvalues for the first five factors were significantly greater than one (the values were 8.68, 2.42, 1.89, 1.38, and 1.02, all p < .02, p value for the 6th factor = .58).
Focusing on the goal of extracting the maximum number of interpretable dimensions within this potential range of 3–6 factors, a five-factor solution produced five readily interpretable factors, whereas the sixth factor was under-identified, with only two salient loadings (emotional lability and hostility). We therefore focus here on a five-factor EFA, using the CF-Equamax oblique rotation in Mplus (Muthén & Muthén, 1998–2010). We chose EFA over confirmatory factor analysis (CFA) because strong a priori hypotheses about the structure of these scales would be premature, and because simple structure CFA models are not realistic for personality data, in that many manifest personality variables tend to show meaningful factor cross loadings (Hopwood & Donnellan, 2010). We chose the CF-Equamax rotation because it aims to simplify both variable and factor complexity, spreading variances across the factors and combining features of both the Quartimax and Varimax criteria (Browne, 2001); we used the oblique version of Equamax because the general positive manifold among the facets (Supplemental Table S2) suggests that the factors are probably best conceived of as being correlated. The five-factor EFA loadings are presented in Table 3. The results correspond to domains that could be labeled negative affect, detachment, antagonism, disinhibition, and psychoticism. Of note, some facet scales are relatively “pure” markers of these domains (e.g., manipulativeness, unusual beliefs and experiences), whereas others (e.g., hostility) are located “in between” domains because they share features of more than one domain (cf. Markon et al. 2005).
Table 3.
Negative Affect | Detachment | Antagon | Disinhibition | Psychoticism | |
---|---|---|---|---|---|
Emotional Lability | 0.69 | 0.00 | 0.02 | 0.12 | 0.19 |
Anxiousness | 0.56 | 0.30 | 0.03 | 0.10 | 0.13 |
Restricted Affectivity | −0.54 | 0.48 | 0.20 | −0.01 | 0.17 |
Separation Insecurity | 0.47 | −0.06 | 0.16 | 0.14 | 0.04 |
Hostility | 0.38 | 0.25 | 0.34 | 0.21 | −0.02 |
Perseveration | 0.34 | 0.12 | 0.16 | 0.07 | 0.33 |
Submissiveness | 0.27 | 0.08 | 0.11 | −0.11 | −0.03 |
Withdrawal | −0.02 | 0.68 | −0.02 | 0.01 | 0.21 |
Anhedonia | 0.14 | 0.61 | −0.07 | 0.38 | −0.04 |
Depressivity | 0.33 | 0.46 | −0.05 | 0.34 | 0.12 |
Intimacy Avoidance | −0.14 | 0.44 | −0.07 | 0.04 | 0.22 |
Suspiciousness | 0.30 | 0.37 | 0.09 | 0.15 | 0.21 |
Manipulativeness | 0.00 | −0.12 | 0.76 | −0.02 | 0.05 |
Deceitfulness | 0.05 | 0.04 | 0.59 | 0.30 | 0.11 |
Grandiosity | −0.11 | 0.06 | 0.55 | −0.03 | 0.17 |
Attention Seeking | 0.13 | −0.21 | 0.51 | 0.08 | 0.13 |
Callousness | −0.18 | 0.23 | 0.48 | 0.38 | 0.05 |
Irresponsibility | 0.04 | 0.11 | 0.12 | 0.57 | 0.13 |
Impulsivity | 0.11 | −0.10 | 0.08 | 0.57 | 0.12 |
Rigid Perfectionism | 0.31 | 0.30 | 0.37 | −0.38 | 0.28 |
Distractibility | 0.24 | 0.14 | −0.06 | 0.34 | 0.28 |
Risk Taking | −0.19 | −0.28 | 0.21 | 0.31 | 0.30 |
Unusual Beliefs & Experiences | −0.01 | −0.05 | 0.08 | −0.09 | 0.76 |
Eccentricity | −0.05 | 0.09 | 0.04 | 0.21 | 0.63 |
Perceptual Dysregulation | 0.15 | 0.07 | 0.01 | 0.24 | 0.58 |
| |||||
Factor Intercorrelations | |||||
Detachment | 0.22 | ||||
Antagonism | 0.11 | 0.14 | |||
Disinhibition | 0.26 | 0.31 | 0.24 | ||
Psychoticism | 0.27 | 0.39 | 0.48 | 0.37 |
To investigate the appropriateness of the five-factor solution identified in the selected samples when applied to a normative population (i.e., the representative sample in Round 3), we estimated a targeted-rotation EFA in Mplus. For each of the five factors, the targeted loading of the 25 facets was specified as the estimated loading in the selected samples. We then estimated factor congruences (using R, see http://www.personality-project.org/R/html/factor.congruence.html) between the five-factor solutions in the selected and representative samples. Factor loadings were very similar across the selected and representative samples for each of the domains. For negative affect, the congruence coefficient was 0.91; detachment = 0.96; antagonism = 0.97; disinhibition = 0.93; and psychoticism = 0.89.
Discussion
The DSM-5 personality and personality disorders workgroup members and consultants pursued the creation of a maladaptive personality trait model and corresponding assessment instrument, drawing on and extending models in the existing literature (see, e.g., Trull & Durrett, 2005, Widiger & Simonsen, 2005, Clark, 2007, and Krueger & Eaton, 2010 for recent reviews). Our goal was to develop a model and corresponding assessment instrument (which can be referred to as “a Personality Inventory for DSM-5” or PID-5) that is freely available to all interested clinicians and researchers; the inventory is given here as part of the online supplement that accompanies this paper. In addition, other investigators are free to develop other assessment tools to assess DSM-5-relevant personality traits. One critical example along these lines is work on the Computerized Adaptive Assessment of Personality Disorder (CAT-PD) project (Simms et al. 2011). The CAT-PD project will result in a highly comprehensive multidimensional assessment instrument that can be administered efficiently via adaptive testing, and is thereby likely to have a fundamental impact on ongoing revisions of the DSM, as well as the broader field.
The major aim of the current project was realized. We created a publically available inventory with scales to assess 25 maladaptive personality traits. Our preliminary factor analytic results suggest these traits delineate five higher-order domains that constitute a model synthesizing other empirically-based maladaptive trait and disorder models in the literature (Austin & Deary, 2000; Clark, 2007; Costa & Widiger, 2002; De Clercq et al. 2006; Harkness et al. 1995; Kendler et al. 2011; Livesley, 2007; Markon, 2010; Nestadt et al. 2008; Piedmont et al., 2009; Pincus et al. 2010; Røysamb et al. 2011; Watson et al. 2008; Widiger et al. 2009).
Nevertheless, there are a number of important limitations to this work. First, to date, our instrument development efforts have been limited to self-report. A thorough clinical assessment of maladaptive traits should rely on reporters in addition to the self (Oltmanns & Turkheimer, 2009), and future work should focus on developing assessment instruments for use by other informants. Moreover, the assessment of personality and the diagnosis of PD require careful clinical judgment, judgment that can be informed – but not replaced by – self-report trait assessments. It will be important to evaluate the use of the trait model by clinicians in field trials (Kraemer et al. 2010). Second, our work has focused on the assessment of personality traits in adults. Further work is needed to determine if our assessment instrument can be adapted for use with other age groups (e.g., adolescents).
Third, our assessment instrument is focused specifically on maladaptive personality traits, i.e., those associated with DSM-IV-TR PDs. Given the limited time available in many clinical encounters, maladaptive traits arguably represent the more pressing areas of clinical concern, relative to adaptive traits. In addition, maladaptive qualities are the traditional focus of the DSM. Nevertheless, adaptive traits also have clinical utility (Harkness & Lilienfeld, 1997), and the trait model and assessment instrument we delineate here could be expanded to encompass these characteristics in future work. For example, our inventory lacks measures of openness to experience because openness generally is not highly correlated with PD. Our assessment could be expanded to encompass traits in this domain, or alternatively, a more comprehensive clinical assessment could augment our instrument with another designed to assess openness or other adaptive traits.
Fourth, our starting point was workgroup discussion regarding elements of maladaptive personality variation. Numerous additional maladaptive personality variants could, in theory, be identified. We look forward to future research on how these additional dimensions may relate to the dimensions operationalized in our provisional inventory. Fifth, we worked with statistical models that do not empirically estimate the form of the underlying latent trait distribution because these models are well established psychometric models for initial scale creation in personality research (Simms & Watson, 2007). However, future research designed to explore the empirical latent trait distribution underlying the scales we developed (e.g., via Johnson curves; van den Oord, 2005) would be valuable.
Sixth, additional validity research would be needed before these scales could be deemed appropriate for application in clinical settings (Cella et al., 2010). Our intent in conveying the current results at this juncture is to allow the broader field to explore the potential validity of these constructs and their corresponding scales, in the hopes that an empirical literature will coalesce, that can be referred to as the DSM continues to develop. We hope this can result in an approach to the development of the DSM that relies more on the accumulation of data, as opposed to the more traditional approach of investigators adopting DSM conventions, without pursuing research that questions those conventions and thereby aims to improve the reliability and validity of diagnosis. For example, although the provisional scales we provide here showed generally good internal consistency reliabilities (see Table 2), it may be desirable to further enhance some of the less reliable and shorter facet-level scales prior to contemplating their use in clinical settings. In addition, the preliminary factor structure we report here must be replicated in other samples before it could be considered a definitive account of the structure of our provisional scales, much less the broader domain of maladaptive personality variation.
Supplementary Material
ACKNOWLEDGEMENTS
The authors report no competing interests. Supported by a grant from the American Psychiatric Institute for Research and Education (APIRE). Ms. Derringer is supported by NIH grant DA029377. Dr. Krueger is supported by NIH grant AA018111. We thank Darrel A. Regier for his helpful comments on a previous draft of this paper.
References
- APA . Diagnostic and Statistical Manual of Mental Disorders. 4th edn American Psychiatric Association; Washington, DC: 1994. [Google Scholar]
- Asparouhov T. Sampling weights in latent variable modeling. Structural Equation Modeling. 2005;12:411–434. [Google Scholar]
- Austin EJ, Deary IJ. The `four As': A common framework for normal and abnormal personality? Personality and Individual Differences. 2000;28:977–995. [Google Scholar]
- Browne MW. An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research. 2001;36:111–150. [Google Scholar]
- Cai L. High-dimensional exploratory item factor analysis by a Metropolis-Hastings Robbins-Monro algorithm. Psychometrika. 2010;75:33–57. [Google Scholar]
- Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, Amtmann D, Bode R, Buysse DJ, Choi SW, Cook KF, DeVellis R, DeWalt D, Fries JF, Gershon R, Hahn E, Pilkonis P, Revicki D, Rose M, Weinfurt K, Hays RD, on behalf of the PROMIS Cooperative Group Initial item banks and first wave testing of the Patient–Reported Outcomes Measurement Information System (PROMIS) network: 2005–2008. Journal of Clinical Epidemiology. 2010;63:1179–1194. doi: 10.1016/j.jclinepi.2010.04.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chmielewski M, Watson D. The heterogeneous structure of schizotypal personality disorder: item-level factors of the schizotypal personality questionnaire and their associations with obsessive-compulsive disorder symptoms, dissociative tendencies, and normal personality. Journal of Abnormal Psychology. 2008;117:364–376. doi: 10.1037/0021-843X.117.2.364. [DOI] [PubMed] [Google Scholar]
- Clark LA. Assessment and diagnosis of personality disorder: Perennial issues and emerging conceptualization. Annual Review of Psychology. 2007;58:227–258. doi: 10.1146/annurev.psych.57.102904.190200. [DOI] [PubMed] [Google Scholar]
- Clark LA, Simms LJ, Wu KD, Casillas A. Manual for the schedule for nonadaptive and adaptive personality—Second edition (SNAP-2) University of Minnesota Press; Minneapolis, MN: in press. [Google Scholar]
- Costa PT, Jr, McCrae RR. Revised NEO Personality Inventory NEO–PI–R and NEO Five-Factor Inventory NEO–FFI professional manual. Psychological Assessment Resources; Odessa, FL: 1992. [Google Scholar]
- Costa PT Jr, Widiger TA, editors. Personality disorders and the five-factor model of personality. 2nd ed American Psychological Association; Washington DC: 2002. [Google Scholar]
- Cuijpers P, Smit F, Penninx BWJH, de Graaf R, ten Have M, Beekman ATF. Economic costs of neuroticism: a population-based study. Archives of General Psychiatry. 2010;67:1086–1093. doi: 10.1001/archgenpsychiatry.2010.130. [DOI] [PubMed] [Google Scholar]
- De Clercq B, De Fruyt F, Van Leeuwen K, Mervielde I. The structure of maladaptive personality traits in childhood: A step toward an integrative developmental perspective for DSM-5. Journal of Abnormal Psychology. 2006;115:639–657. doi: 10.1037/0021-843X.115.4.639. [DOI] [PubMed] [Google Scholar]
- de Moor MHM, Costa PT, Terracciano A, Krueger RF, de Geus EJC, Toshiko T, Penninx BW, Esko T, Madden PA, Derringer J, Amin N, Willemsen G, Hottenga JJ, Distel MA, Uda M, Sanna S, Spinhoven P, Hartman CA, Sullivan P, Realo A, Allik J, Heath AC, Pergadia ML, Agrawal A, Lin P, Grucza R, Nutile T, Ciullo M, Rujescu D, Giegling I, Konte B, Widen E, Cousminer DL, Eriksson JG, Palotie A, Peltonen L, Luciano M, Tenesa A, Davies G, Lopez LM, Hansell NK, Medland SE, Ferrucci L, Schlessinger D, Montgomery GW, Wright MJ, Aulchenko YS, Janssens AC, Oostra BA, Metspalu A, Abecasis GR, Deary IJ, Räikkönen K, Bierut LJ, Martin NG, van Duijn CM, Boomsma DI. Meta-analysis of genome-wide association studies for personality. Molecular Psychiatry. 2011 doi: 10.1038/mp.2010.128. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dennis JM. Summary of Knowledge Panel Design. 2010 Available from: http://www.knowledgenetworks.com/knpanel/docs/KnowledgePanel%28R%29-Design-Summary-Description.pdf.
- Embretson SE, Reise SP. Item response theory for psychologists. Lawrence Erlbaum Associates, Inc.; Mahwah, New Jersey: 2000. [Google Scholar]
- Goldberg LR. The structure of phenotypic personality traits. American Psychologist. 1993;48:26–34. doi: 10.1037//0003-066x.48.1.26. [DOI] [PubMed] [Google Scholar]
- Harkness AR, Lilienfeld SO. Individual differences science for treatment planning: Personality traits. Psychological Assessment. 1997;9:349–360. [Google Scholar]
- Harkness AR, McNulty JL, Ben-Porath YS. The personality psychopathology five (PSY-5): Constructs and MMPI-2 scales. Psychological Assessment. 1995;7:104–114. [Google Scholar]
- Hopwood CJ, Donnellan MB. How should the internal structure of personality inventories be evaluated? Personality and Social Psychology Review. 2010;14:332–346. doi: 10.1177/1088868310361240. [DOI] [PubMed] [Google Scholar]
- Hopwood CJ, Quigley BD, Morey LC, Bender DS, Skodol AE, Stout RL, McGlashan TH, Grilo CM, Gunderson JG. Personality traits and mental health treatment utilization. Personality and Mental Health. 2008;2:207–217. doi: 10.1002/pmh.51. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kendler KS, Aggen SH, Knudsen GP, Røysamb E, Neale MC, Reichborn-Kjennerud T. The structure of genetic and environmental risk factors for syndromal and subsyndromal common DSM-IV axis I and all axis II disorders. American Journal of Psychiatry. 2011;168:29–39. doi: 10.1176/appi.ajp.2010.10030340. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kraemer HC, Kupfer DJ, Narrow WE, Clarke DE, Regier DA. Moving toward DSM-5: the field trials. American Journal of Psychiatry. 2010;167:1158–1160. doi: 10.1176/appi.ajp.2010.10070962. [DOI] [PubMed] [Google Scholar]
- Krueger RF, Eaton NR. Personality traits and the classification of mental disorders: Toward a more complete integration in DSM-5 and an empirical model of psychopathology. Personality Disorders: Theory, Research, and Treatment. 2010;1:97–118. doi: 10.1037/a0018990. [DOI] [PubMed] [Google Scholar]
- Livesley WJ. A framework for integrating dimensional and categorical classifications of personality disorder. Journal of Personality Disorders. 2007;21:199–224. doi: 10.1521/pedi.2007.21.2.199. [DOI] [PubMed] [Google Scholar]
- Livesley WJ, Jackson DN. Manual for the dimensional assessment of personality pathology. Sigma Press; Port Huron: 2009. [Google Scholar]
- Markon KE. Modeling psychopathology structure: a symptom-level analysis of Axis I and II disorders. Psychological Medicine. 2010;40:273–288. doi: 10.1017/S0033291709990183. [DOI] [PubMed] [Google Scholar]
- Markon KE, Krueger RF, Watson D. Delineating the structure of normal and abnormal personality: An integrative hierarchical approach. Journal of Personality and Social Psychology. 2005;88:139–157. doi: 10.1037/0022-3514.88.1.139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morey LC. Essentials of PAI Assessment. John Wiley; New York: 2003. [Google Scholar]
- Muthén LK, Muthén BO. MPlus Users Guide. Sixth Edition Muthén & Muthén; Los Angeles, CA: 1998–2010. [Google Scholar]
- Nestadt G, Costa PT, Jr, Hsu F-C, Samuels J, Bienvenu OJ, Eaton WW. The relationship between the five-factor model and latent Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition personality disorder dimensions. Comprehensive Psychiatry. 2008;49:98–105. doi: 10.1016/j.comppsych.2007.05.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Oltmanns TF, Turkheimer E. Person perception and personality pathology. Current Directions in Psychological Science. 2009;18:32–36. doi: 10.1111/j.1467-8721.2009.01601.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Piedmont RL, Sherman MF, Sherman NC, Dy-Liacco GS, Williams JE. Using the five-factor model to identify a new personality disorder domain: The case for experiential permeability. Journal of Personality and Social Psychology. 2009;96:1245–1258. doi: 10.1037/a0015368. [DOI] [PubMed] [Google Scholar]
- Pincus AL, Lukowitsky MR, Wright AGC. The interpersonal nexus of personality and psychopathology. In: Millon T, Krueger R, Simonsen E, editors. Contemporary directions in psychopathology: Scientific foundations for DSM-V and ICD-11. Guilford; New York: 2010. pp. 523–52. [Google Scholar]
- Røysamb E, Kendler KS, Tambs K, Orstavik RE, Neale MC, Aggen SH, Torgersen S, Reichborn-Kjennerud T. The joint structure of DSM-IV Axis I and Axis II disorders. Journal of Abnormal Psychology. 2011;120:198–209. doi: 10.1037/a0021660. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Samuel DB, Widiger TA. A meta-analytic review of the relationships between the five-factor model and DSM-IV-TR personality disorders: A facet level analysis. Clinical Psychology Review. 2008;28:1326–1342. doi: 10.1016/j.cpr.2008.07.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schwarz GE. Estimating the dimension of a model. Annals of Statistics. 1978;6:461–464. [Google Scholar]
- Scientific Software International, Inc. IRTPRO Application. (Version 1.1.20215.1 BETA) 2010 Aug; http://www.ssicentral.com.
- Simms L, Watson D. The construct validation approach to personality scale construction. In: Robins RW, Fraley RC, Krueger RF, editors. Handbook of research methods in personality psychology. Guilford; New York: 2007. pp. 240–258. [Google Scholar]
- Simms L, Goldberg LR, Roberts JE, Watson D, Welte J, Rotterman JH. Computerized adaptive assessment of personality disorder: Introducing the CAT-PD project. Journal of Personality Assessment. 2011;93:380–389. doi: 10.1080/00223891.2011.577475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smits N, Vorst HCM. Reducing the length of questionnaires through structurally incomplete designs: An illustration. Learning and Individual Differences. 2007;17:25–34. [Google Scholar]
- Tang TZ, DeRubeis RJ, Hollon SD, Amsterdam J, Shelton R, Schalet B. Personality change during depression treatment: a placebo-controlled trial. Archives of General Psychiatry. 2009;66:1322–1330. doi: 10.1001/archgenpsychiatry.2009.166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Team RDC . R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing; Vienna, Austria: 2010. [Google Scholar]
- Trull TJ, Durrett CA. Categorical and dimensional models of personality disorder. Annual Review of Clinical Psychology. 2005;1:355–380. doi: 10.1146/annurev.clinpsy.1.102803.144009. [DOI] [PubMed] [Google Scholar]
- van den Oord EJCG. Estimating Johnson curve population distributions in MULTILOG. Applied Psychological Measurement. 2005;29:45–64. [Google Scholar]
- van den Oord EJCG, Kuo P-H, Hartmann AM, Webb BT, Moller H-J, Hettema JM, Giegling I, Bukszár J, Rujescu D. Genomewide association analysis followed by a replication study implicates a novel candidate gene for neuroticism. Archives of General Psychiatry. 2008;65:1062–1071. doi: 10.1001/archpsyc.65.9.1062. [DOI] [PubMed] [Google Scholar]
- Watson D, Clark LA, Chmielewski M. Structures of personality and their relevance to psychopathology: II. Further articulation of a comprehensive unified trait structure. Journal of Personality. 2008;76:1545–1586. doi: 10.1111/j.1467-6494.2008.00531.x. [DOI] [PubMed] [Google Scholar]
- Widiger TA, Livesley WJ, Clark LA. An integrative dimensional classification of personality disorder. Psychological Assessment. 2009;21:243–255. doi: 10.1037/a0016606. [DOI] [PubMed] [Google Scholar]
- Widiger TA, Simonsen E. Alternative dimensional models of personality disorder: Finding a common ground. Journal of Personality Disorders. 2005;19:110–130. doi: 10.1521/pedi.19.2.110.62628. [DOI] [PubMed] [Google Scholar]
- Zwick WF, Velicer WF. Comparison of five rules for determining the number of components to retain. Psychological Bulletin. 1986;99:432–442. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.