Abstract
The current diagnostic system suggests that personality disorder categories be applied to children and adolescents in rare circumstances due to expected changes in personality pathology across development. The present study examined the stability in personality pathology, specifically psychopathy, across childhood and adolescence. Using a short form of the Childhood Psychopathy Scale (CPS; Lynam, 1997) and mixed models incorporating fixed and random effects, we examined the reliability, individual stability, mean-level stability, and predictive utility of juvenile psychopathy as a function of age (i.e., from 7 years old to 17 years old) in over 1500 boys from the three cohorts of the Pittsburgh Youth Study. If adolescent development contributes to instability in personality pathology, large age-related fluctuations in reliability, stability, and predictive utility should be observed, particularly in the latter part of adolescence when normative changes are hypothesized to influence levels of psychopathy. Such fluctuations were not observed. In general, juvenile psychopathy could be reliably assessed beginning in childhood, was fairly stable across short and long intervals, showed little mean-level fluctuation, and predicted delinquency across adolescence. These results suggest that concerns about large changes in personality pathology across childhood and adolescence may be overstated. Implications and future directions are discussed.
Keywords: psychopathy, Childhood Psychopathy Scale, longitudinal, personality disorders
Personality disorders refer to patterns of thinking, feeling, and acting (i.e., personality traits) that are inflexible and maladaptive, and that cause significant functional impairment or subjective distress (American Psychiatric Association, 2000). These patterns are relatively stable and of long duration, and presumed to be first evident during childhood or adolescence. Despite this presumption, until recently there has been relatively little research into earlier manifestations of the personality disorders. One hindrance to this research has been a general opposition to the application of the construct of personality disorder to youth. For example, although recognizing the early manifestations of personality disorders, the Diagnostic and Statistical Manual—Fourth Edition, Test Revision (DSM-IVTR) asserts “the traits of a Personality Disorder that appear in childhood will often not persist unchanged into adult life” (p. 687) and allows a personality disorder diagnosis in childhood only in “relatively unusual instances” (p. 687). This opposition, however, seems to be based more on concerns about potential labeling effects and theoretical expectations rather than on actual empirical data. In fact, based on empirical research examining the temporal stability of personality generally (Roberts & DelVecchio, 2000), there is reason to expect a fair degree of stability from childhood on. Ultimately, however, the stability of personality pathology across development is an empirical question that must be explored.
Despite this general opposition, research has managed to burgeon on the early manifestations of two related personality disorders—Antisocial Personality Disorder and psychopathy. Despite being outside the official diagnostic nomenclature, psychopathy is a personality disorder. It is characterized by a lack of remorse, egocentricity, manipulativeness, superficial charm, impulsivity, unreliability, and shallow affect (Cleckley, 1941; Hare, 2003). It is strongly associated with impairment in the form of severe antisocial behavior; the psychopathic offender is among the most prolific, versatile, and violent of all offenders (e.g., Brinkley, Schmitt, Smith, & Newman, 2001; Porter, Birt, & Boer, 2001). Psychopathy is also quite stable over time and relatively resistant to efforts at rehabilitation through incarceration and treatment. While incarcerated, psychopathic offenders commit more institutional infractions (Walters, 2003) and recidivate more often when released (Salekin, Rogers, & Sewell, 1996; Walters, 2003). Although a relatively recent meta-analysis (Salekin, 2002) challenged the notion that psychopathic offenders are untreatable, several reports suggest that psychopathic offenders are less responsive to treatment efforts (e.g., Ogloff, Wong, & Greenwood, 1990; Shine & Hobson, 2000).
Juvenile Psychopathy
The severity and stability of antisocial behavior in adult psychopathy, its relative recalcitrance to treatment, and the focus on the assessment of personality inherent in the construct, led several researchers on child and adolescent antisocial behavior to borrow the construct of psychopathy from the adult literature in the hope that earlier identification and intervention might be more effective. Towards this end, several instruments have been constructed to assess psychopathic traits in adolescence and childhood (Forth, Kosson, & Hare, 2003; Frick, O’Brien, Wootton, & McBurnett, 1994; Lynam, 1997); each instrument attempts to assess the traits constituting psychopathy in adults using measures that are more appropriate developmentally.
Initial work examining juvenile psychopathy was rather adevelopmental, focusing on recreating the nomological network of adult psychopathy in juveniles. With few exceptions, juvenile psychopathy appears to act like adult psychopathy (see Lynam & Gudonis, 2005). The convergence is particularly strong in the relation between juvenile psychopathy and offending (see Kotler & McMahon, 2005). Robust moderate associations between measures of juvenile psychopathy and concurrent antisocial behavior have been observed in clinical (Christian, Frick, Hill, Tyler, & Frazer, 1997; Enebrink, Andershed, & Langstrom, 2005; Frick et al., 1994; Stafford & Cornell, 2003), community (Lynam, 1997; Frick, Cornell, Barry, Bodin, & Dane, 2003), and offender (Kosson, Cyterski, Steuerwald, Neumann, & Walker-Matthews, 2002; Murrie, Cornell, Kaplan, McConville, & Levy-Elkon, 2004; Salekin, Leistico, Neumann, DiCicco, & Duros, 2004) samples. Within offender samples, measures of juvenile psychopathy have been shown to predict institutional infractions (Brandt, Kennedy, Patrick, & Curtin, 1997; Murrie et al., 2004; Spain, Douglas, Poythress, & Epstein, 2004; Stafford & Cornell, 2003) and re-offending following release (Catchpole & Gretton, 2003; Corrado, Vincent, Hart, & Cohen, 2004; Falkenbach, Poythress, & Heide, 2003; Gretton, McBride, Hare, O’Shaughnessy, & Kumka, 2001). Finally, several studies have shown that juvenile psychopathy predicts antisocial behavior above and beyond other well-known risk factors, including previous offending, aggression, conduct problems, impulsivity, IQ, and attention problems (Frick et al., 2003; Lynam, 1997; Piatigorsky & Hinshaw, 2004; Salekin et al., 2004). All of these relations are consistent with those observed in adults.
Juvenile psychopathy has also been found to relate as predicted to constructs that do not involve offending, such as personality, cognitive processing, and other forms of psychopathology. Juvenile and adult psychopathy are related in similar ways to basic dimensions of personality (Lynam et al., 2005; Salekin, Leistico, Trobst, Schrum, & Lochman, 2005). Psychopathic juveniles, like their adult counterparts, show problems in emotional processing (e.g., Blair & Coles, 2000) and deficits in behavioral inhibition or impulsivity (e.g., O’Brien & Frick, 1996). The relations between juvenile psychopathy and other forms of psychopathology are somewhat divergent from what is observed for adults, although this may be due to higher rates of comorbidity among childhood disorders (Salekin & Frick, 2005). Lynam (1997) and Salekin et al. (2004) both report that psychopathic juveniles are more prone to externalizing problems than to internalizing problems, but neither study found the negative relations between juvenile psychopathy and internalizing problems often observed in adults.
More recent research on the construct, however, has begun to examine more basic developmental issues and concerns including the assessment of juvenile psychopathy using an “imported” instrument and the stability and predictive validity of psychopathy from adolescence into adulthood. For example, using data from the middle sample of the Pittsburgh Youth Study and items from the Common Language Q-sort (Caspi et al., 1992), Lynam, Derefinko, Caspi, Loeber, and Stouthamer-Loeber (2007) compared empirically the content of an imported instrument, the Childhood Psychopathy Scale (CPS; Lynam, 1997), to the content of scales created using more “indigenous” approaches—expert ratings of “the fledgling Cleckley psychopath” and a scale derived empirically using correlations with adult psychopathy. These authors found a very high degree of overlap among the items included on each scale with content correlations ranging from .90 to .95 and convergent correlations approaching the reliability of the measures. As a second example of more basic research, Lynam, Caspi, Moffitt, Loeber, and Stouthamer-Loeber (2007) examined the stability between psychopathy assessed at age 13 using the mother-reported CPS and the interviewer-rated Psychopathy Checklist: Screening Version (Hart, Cox, & Hare, 1995) at age 24 in 250 young men from the Pittsburgh Youth Study. Despite the long time lag (11 years on average), differences in method and source of assessment (mother-report versus interview rating) and some differences in content, psychopathy was found to be moderately stable (r = .31) from early adolescence into young adulthood.
One crucial and basic developmental issue raised by critics (Edens, Skeem, Cruise, & Cauffman, 2001; Seagrave & Grisso, 2002), however, remains relatively unexplored—the impact of developmental changes on psychopathy during adolescence. Adolescence is a developmental period filled with biological, social, and cognitive changes. Adolescents face a number of new developmental tasks including developing coherent identities, establishing relations with peers, and developing independence from parents. These changes and transitions may serve as contributors to discontinuity in pathological personality generally and psychopathy specifically. Seagrave and Grisso argued explicitly that normative developmental change may masquerade as juvenile psychopathy, identifying 8 specific characteristics of psychopathy that they believe may have transient developmental parallels: glibness, grandiosity, pathological lying, manipulation, lack of remorse, shallow affect, callousness, and failure to accept responsibility for one’s actions. Both possibilities would serve to reduce the stability of juvenile psychopathy across adolescence, underscore concerns about the application of personality disorder terms to adolescents, and render the juvenile psychopathy much less useful.
Although there is little evidence available to assess whether the specific psychopathic traits identified by Seagrave and Grisso (2002) show normative changes across adolescence alone or in combination, there is evidence for change in related constructs. Adolescents are more likely than children and adults to engage in a variety of risky behaviors, including binge drinking, smoking, casual sex, and criminal behavior (e.g., Wiesner & Silbereisen, 2003; Windle, Mun, & Windle, 2005). In fact, one of the most robust findings in the criminology literature is a curvilinear relation between age and crime such that offending for all crime types rises sharply in mid-adolescence and declines slightly less sharply again in young adulthood (e.g., Farrington, Loeber, & Jolliffe, 2008). Paralleling the changes in antisocial behavior are changes in the way in which time is spent; across adolescence, individuals spend more and more time in unstructured activities with peers—a robust predictor of delinquent involvement (Osgood, Wilson, O’Malley, Bachman, & Johnston, 1996). Also paralleling these changes, are changes in the adolescent brain that seem to render adolescents more sensitive to the reward value, and therefore less sensitive to the cost, of certain behaviors (Steinberg, 2008). A priori, one might expect, based on the robust relation between psychopathy and antisocial behavior, that psychopathy might also show normative developmental change.
Unfortunately, there are very few studies that have examined the stability of juvenile psychopathy across time. The study on stability discussed earlier by Lynam et al. (2007) examined the stability between psychopathy scores in early adolescence and young adulthood, bypassing mid- and late-adolescent stability. Frick, Kimonis, Dandreaux, and Farell (2003) examined the stability of scores on the Antisocial Process Screening Device (APSD; Frick & Hare, 2001) across four years in a small (n = 98) sample of non-referred children in the third, fourth, sixth, and seventh grades at the first assessment. The sample was selected from a larger population in order to over-represent individuals scoring high on the two dimensions of the APSD—callous-unemotional traits (CU) and impulsive conduct problems (ICP). Within-informant stability, calculated using intraclass correlations, ranged from .88 at two-year follow-up to .80 at four-year follow-up; the instantaneous stability was .93. Although the results support the stability of juvenile psychopathy across adolescence, more research is clearly required. The sample for this study was quite small with 98 children at the first assessment and 79 at the last. The small sample, in addition to raising concerns about replication, precluded examination of the relation between age and psychopathy and prevented separate examinations of stability among those selected because they were low and those selected because they were high on the APSD. This extreme-groups selection procedure may have artificially inflated stability estimates. Finally, the study did not avail itself of recent improvements in methodology for analyzing longitudinal data; the advantages offered by the linear mixed modeling approach used here are articulated in the next paragraph.
The present study extends the previous work by Frick et al. (2003) to examine the stability of juvenile psychopathy across adolescence specifically and the issue of stability in personality pathology more generally. Using data from over 1,500 boys from the three cohorts of the Pittsburgh Youth Study, we examine the stability of juvenile psychopathy from age 7 to age 18. Relative stability as a function of age and absolute stability are examined within high- and low-risk groups. We employ linear mixed models incorporating both fixed and random effects. These models have several advantages over more traditional correlational approaches. First, they allow explicit modeling of temporal trends in mean responses that can depend on one or more covariates. Second, they accommodate various sources of departure from these trends: contributions of unmeasurable subject-specific attributes that are static over time, contributions of unmeasurable subject-specific attributes that evolve over time, and measurement errors. Third, linear mixed models can accommodate missing data: a subject with one or more missing observations is not excluded from the computations involved in parameter estimation. To the extent that developmental changes across adolescence render personality pathology unstable across this same period, several findings should emerge. First, the assessment of such pathology should be relatively unreliable. Second, the stability of such pathology across adolescence should be low. Third, to the extent that normative developmental change affects personality pathology scores, scores should change across adolescence. Fourth and finally, the predictive power of personality pathology should also change across developmental. The present paper examines each of these possibilities.
Method
Participants
Participants are members of the three samples making up the Pittsburgh Youth Study. Full details of background characteristics and initial recruitment in 1987–1988 when children (all male) were aged 7 (youngest), 10 (middle), or 13 (oldest) are given elsewhere (Loeber, Farrington, Stouthamer-Loeber, & van Kammen, 1998). Briefly, boys attending the first, fourth, or seventh grades in the public school system in inner-city Pittsburgh (about 1,000 in each grade) were randomly selected from schools across the city. Among those families contacted, 85% of the boys and their parents agreed to participate. An initial screening assessment identified high-risk participants; specifically, about 250 boys at each grade level (i.e., 30% of those who agreed to participate) were identified as having more severe disruptive behavior problems based on caretaker, teacher, and self reports. An equivalent-sized random subset of the remaining 70% of boys was drawn at each grade level to form a complete follow-up sample. This selection process yielded approximately 500 boys in each follow-up sample (503 in the youngest sample, 508 in the middle sample, and 506 in the oldest sample), half high-risk and half low-risk. Each sample also had approximately equal representations of Caucasian and African American boys.
Each sample was followed regularly, every 6 months initially and every year thereafter, and assessed on a variety of measures quantifying the correlates, causes, and consequences of antisocial behavior. The youngest sample was followed from ages 7 to 20, the middle sample was followed from 10 to 13, and the oldest sample was followed from 13 to 25. This study relies predominantly on the assessments occurring between 7 and 18; as not all children in each grade level were exactly the same age, a very small fraction of the assessments used in this analysis occurred before age 7 or after age 18.
Juvenile psychopathy
Juvenile psychopathy was assessed using a short form of the Childhood Psychopathy Scale (CPS; Lynam, 1997). The CPS was developed to operationalize, in childhood and adolescence, the personality traits found in the Revised Psychopathy Checklist (PCL-R; Hare, 2003). Using descriptions of the PCL-R constructs and items previously collected from caregivers on an extended version of the Childhood Behavior Checklist (CBCL; Achenbach, 1991) and the Common-Language Q-sort (CCQ; Caspi et al., 1992), twelve of the 20 PCL-R constructs were operationalized as 2- to 4-item scales. Three PCL-R items, criminal versatility, juvenile delinquency, and early behavior problems were not included in the CPS so that it might serve as a relatively pure measure of personality uncontaminated by frankly antisocial behavior; there already exist many adequate assessments of antisocial behavior, and we believe that the greatest potential contribution of the psychopathy construct to developmental psychopathology lies in its focus on personality rather than behavior. Additionally, five constructs were not included in the original version of the CPS because they could not be adequately operationalized (boredom susceptibility), did not correlate with other items (grandiosity), or had no childhood counterparts (promiscuous sexual behavior, many short-term marital relationships, and revocation of conditional release). The operationalization was successful: 8 of the 12 construct scales had alphas above .60, and 10 of the 12 alphas were above .50. The reliability of the total scale was .91. To validate the CPS, its relation to known correlates of psychopathy was examined (Lynam, 1997). Boys who scored high on the CPS were already the most consequential offenders at ages 10 and 13 as well as the most stable offenders across the two ages. Additionally, high scorers were more impulsive on a multimethod, multisource battery of impulsivity measures. They were also prone to externalizing disorders but not internalizing disorders. Finally, scores on the CPS predicted serious delinquency above and beyond other known predictors (SES, IQ, previous delinquency, and impulsivity) and alternative parsings of the item pool. Additional studies have shown that the CPS is related to other theoretically meaningful constructs, including recidivism and poor treatment outcomes in adolescence (Falkenbach et al., 2003), the five factor model of personality (Lynam et al., 2005; Salekin et al., 2005), and electrodermal hyporesponsivity (Fung et al., 2005).
The short form of the CPS used in the present study consists of the 18 items drawn from the extended CBCL that were available at every assessment (see Table 1). Each item was rated as a 0 (not true), 1 (somewhat true), or 2 (very true). For each assessment, parents were asked to report on the boys’ behavior during the past year or past six months, depending on the assessment gap. The scores on these items were averaged to create a juvenile psychopathy index at each assessment. At age 13, this short form correlated at 0.91 with the full version, suggesting that the short form provides a valid assessment.
Table 1.
CPS construct | Item |
---|---|
Glibness | Exaggerates |
Untruthfulness | Lying or cheating |
You cannot trust what he says | |
Manipulation | Manipulates people |
Lack of Guilt | Doesn’t seem to feel guilty after misbehaving |
Poverty of Affect | Sudden changes in moods or feelings |
Callousness | Cruelty, bullying, meanness to others |
Teases a lot | |
Parasitic Lifestyle | Takes credit for what another has accomplished |
Behavioral Dyscontrol | Behaves explosively and unpredictably |
Demands must be met immediately (easily frustrated) | |
Lack of Planning | He never or rarely saves money |
Impulsiveness | Impulsive or acts without thinking |
Wants to have things right away | |
Unreliability | Behaves irresponsibly |
Borrows money and does not pay it back | |
Failure to Accept Responsibility | When confronted about his behavior, he is a “fast” or “smooth” talker |
Blames others excessively |
Delinquency
At each assessment, boys completed the Self-Report Delinquency Instrument used in the National Youth Survey (Elliott, Huizinga, & Ageton, 1985). The instrument inquires about each boy’s delinquency during the previous 6 months. The items assess both less serious (e.g., skipping school and stealing something worth less than $5) and more serious forms of delinquency (e.g., breaking and entering and robbery). Self-report delinquency data were supplemented with teacher and caretaker reports of delinquent behavior. Self-report measures of delinquency have strong psychometric properties, particularly when supplemented by reports from other informants (see Junger-Tas & Marshall, 1999).
Because simple frequency counts of delinquent behavior neglect the relative seriousness of the behaviors and can fail to order persons adequately along a dimension of delinquency, a seriousness classification scheme was developed (Loeber et al., 1998). The severity ratings, adapted from those developed by Wolfgang, Figlio, Tracey, and Singer (1985), place a boy in one of six delinquency levels (0 = no delinquency activity; 5 = multiple serious delinquent acts such as stealing cars, breaking and entering, or selling drugs) based on the most serious act committed in the last six months according to the boy, his teacher, or his caretaker.
General Statistical Approach
Data analysis took place in four phases, as described below. Calculations were carried out using version 8.2 of SAS (SAS Institute, Cary, NC) and version 2.3.1 of R (R Foundation for Statistical Computing, Vienna, Austria, 2006). Due to the multiplicity of hypothesis tests, we set the threshold for statistical significance to 0.01 rather than 0.05
Reliability across development
We calculated Cronbach alphas and basic descriptive statistics (mean, standard deviation, skewness) for the psychopathy measurements at each of 22 waves (corresponding to ages 7.0, 7.5, 8.0, etc.). The alphas constitute the reliability of the psychopathy measurements at the various waves. We also averaged the alphas over several consecutive waves (waves 1 to 7, 8 to 15, 16 to 22) to clarify whether reliability varied across lower, middle, and upper age groups (ages 7.0 to 10.0, 10.5 to 14.0, 14.5 to 17.5).
Cross-time stability
To examine stability across development, we calculated double-entry correlations for the psychopathy measurements over time lags of 6 months (waves 1 and 2, 2 and 3, 3 and 4, etc.), 1 year (waves 1 and 3, 2 and 4, 3 and 5, etc.), 2 years, and 5 years.1 The double-entry correlations, unlike ordinary Pearson correlations, take into account similarity in magnitude of scores in addition to rank-order.
Mean levels of psychopathy across development
We fit a linear mixed model (Verbeke and Molenberghs, 2000) relating psychopathy to age, risk status, and number of previous assessments. This model was used to quantify the mean-level stability over time of the psychopathy measurements for each risk group, as the quotient of model-implied mean square error by crude mean square error (see Results for details). This quotient will be close to 100% when there is little temporal variation in mean-level psychopathy. This linear mixed model will be referred to as “Model I” to distinguish it from the linear mixed model used in the next phase of the data analysis.
Predictive utility of psychopathy across development
We fit a second linear mixed model relating current delinquency to past delinquency, past psychopathy, age, and risk status. This linear mixed model was used to quantify the predictive utility of past psychopathy with respect to current delinquency and also to quantify the predictive utility of past delinquency. In particular, we sought to determine whether these predictive utilities varied with age. Predictive utility for past psychopathy is defined formally as the expected change in current delinquency given a one-unit change in past psychopathy while controlling for past delinquency and other model variables; predictive utility for past delinquency is defined analogously. This linear mixed model will be referred to as “Model II”.
Formulation of Model I
For each of the two risk groups (low-risk, high-risk), we express psychopathy scores by the equation
Yij represents the jth (square root-transformed) psychopathy score for the ith subject.2 Aij denotes the age (in decades) at the jth assessment for the ith subject.3 Mij reflects the number of previous assessments, as exploratory data analysis suggested that psychopathy scores might tend to be higher during the first few assessments (regardless of age); a phenomenon likely due to the risk-stratification design of our study.4
The coefficients β0 through β4 are unknown constants; these “fixed effects” are common to all subjects within a risk group (low-risk, high-risk) but may differ between risk groups. The quantity
constitutes the overall trend in psychopathy for a risk group as a function of age and the number of previous assessments (including the respective quadratic terms).5
The αi and γi are “random effects”, representing subject-specific adjustments to β0 and β1.6 The αi may be thought of as reflecting unmeasured attributes, static over time, that have a uniform effect on all of the psychopathy scores for a given subject. The γi reflect unmeasured attributes, static over time, that have a uniform effect on the rate of change underlying a given subject’s psychopathy scores. The αi and γi are assumed to arise from a multivariate normal distribution with variances and covariance depending only on the subject’s risk status.
The εij are “serially correlated errors” and reflect unmeasured attributes, dynamic over time, that have similar effects on consecutive psychopathy scores for a given subject. The εij for a given subject are assumed to arise from a multivariate normal distribution with a Gaussian correlation structure whose variance and covariance parameters depend on a subject’s risk status. Finally, the ζij are “residual errors” and represent departures from the overall trend adjusted for random effects and serially correlated errors. The ζij are assumed independent and to arise from a normal distribution.
Formulation of Model II
For each of the two risk groups (low-risk, high-risk), we express current delinquency scores by the equation
Xij represents the (square root-transformed) delinquency score at the jth assessment (j ≥ 2) for the ith subject.7 We define j′ = j − 1, so that Xij′ and Yij′ represent the immediate past (square root-transformed) delinquency and psychopathy scores. Aij denotes the age (in decades) at the jth assessment for the ith subject. Sij is a “separation variable” that equals 1 if the current and past assessments are separated by 1 year and equals 0 if these assessments are separated by 6 months; including Sij in the model allows us to modify a prediction for current delinquency if the information about past delinquency and past psychopathy is 1 year old instead of 6 months old.
The “fixed effects” β0 through β8 are common to all subjects within a risk group (low-risk, high-risk) but may differ between risk groups. The quantity
constitutes the prediction for current delinquency in terms of past delinquency, past psychopathy, age, and the separation variable (including quadratic and cubic terms in age as well as age/past psychopathy and age/past delinquency interaction terms).8 When all other variables are controlled for, the expected change in Xij associated with a one-unit increase in Xij′ (i.e., the predictive utility of past delinquency) is β1 + β6Aij; the corresponding expected change for a one- unit increase in Yij′ (i.e., the predictive utility of past psychopathy) is β2 + β7Aij. If β6= 0, the predictive utility of past delinquency does not change with age; if β7= 0, the predictive utility of past psychopathy does not change with age.
The random effects and residual errors for Model II are analogous to those for Model I. We did not include serially correlated errors in Model II because their presence would have yielded a singular matrix of estimated variance and covariance parameters.9
Results
Table 2 presents basic descriptive statistics both for the raw, untransformed psychopathy scores and for the square-root transformed psychopathy scores used to fit Models I and II in the later data analysis phases. The mean scores (with and without the square-root transformation) were somewhat elevated in waves 1, 7, 13, and 14. These elevations were coincident with cohorts entering the study at waves 1, 7, and 13. Hence, they should not be taken to imply that psychopathy peaks at ages 7, 10, and 13 in the general population. Rather, these elevations may reflect the boys’ lack of prior experience in being assessed, a factor for which we controlled in Model I. Except at the first wave, skewness of the untransformed scores stayed above 1.00. After the square-root transformation, skewness fell between −0.33 and 0.25 at all 22 waves.
Table 2.
Wave (Age) | Descriptives for raw scores | Descriptives for transformed scores | ||||
---|---|---|---|---|---|---|
Mean | Standard Deviation | Skewness | Mean | Standard Deviation | Skewness | |
1 (7.0) | 0.43 | 0.29 | 0.76 | 0.86 | 0.35 | −0.33 |
2 (7.5) | 0.38 | 0.31 | 1.08 | 0.78 | 0.39 | −0.16 |
3 (8.0) | 0.35 | 0.29 | 1.15 | 0.74 | 0.39 | −0.21 |
4 (8.5) | 0.36 | 0.29 | 1.11 | 0.75 | 0.39 | −0.19 |
5 (9.0) | 0.36 | 0.30 | 1.33 | 0.75 | 0.39 | −0.12 |
6 (9.5) | 0.32 | 0.30 | 1.42 | 0.68 | 0.41 | 0.03 |
7 (10.0) | 0.41 | 0.34 | 1.11 | 0.80 | 0.42 | −0.13 |
8 (10.5) | 0.37 | 0.33 | 1.13 | 0.74 | 0.42 | −0.07 |
9 (11.0) | 0.37 | 0.32 | 1.11 | 0.76 | 0.41 | −0.08 |
10 (11.5) | 0.36 | 0.31 | 1.30 | 0.76 | 0.40 | −0.12 |
11 (12.0) | 0.37 | 0.33 | 1.28 | 0.75 | 0.42 | −0.01 |
12 (12.5) | 0.37 | 0.32 | 1.15 | 0.76 | 0.41 | −0.07 |
13 (13.0) | 0.41 | 0.35 | 1.08 | 0.81 | 0.42 | −0.09 |
14 (13.5) | 0.42 | 0.32 | 1.01 | 0.84 | 0.38 | −0.14 |
15 (14.0) | 0.37 | 0.34 | 1.35 | 0.75 | 0.42 | 0.01 |
16 (14.5) | 0.38 | 0.32 | 1.06 | 0.78 | 0.39 | −0.05 |
17 (15.0) | 0.35 | 0.35 | 1.45 | 0.71 | 0.44 | 0.19 |
18 (15.5) | 0.35 | 0.35 | 1.33 | 0.70 | 0.45 | 0.13 |
19 (16.0) | 0.34 | 0.34 | 1.43 | 0.71 | 0.43 | 0.23 |
20 (16.5) | 0.34 | 0.35 | 1.46 | 0.70 | 0.44 | 0.20 |
21 (17.0) | 0.31 | 0.34 | 1.54 | 0.65 | 0.45 | 0.25 |
22 (17.5) | 0.33 | 0.32 | 1.34 | 0.70 | 0.43 | 0.07 |
Note: The columns under “Descriptives for raw scores” pertain to the psychopathy scores prior to the square-root transformation described in footnote 2, while the columns under “Descriptives for transformed scores” pertain to the psychopathy scores after the transformation. Skewness is the sample third central moment, divided by the sample variance raised to the 3/2 power. Skewness greater than 1 or less than −1 indicates considerable asymmetry (and, hence, non-normality) in the distribution of sample values.
Reliability across development
Table 3 shows Cronbach alphas for the raw, untransformed psychopathy scores at each of 22 waves. Except at the first wave, for which the reliability was 0.83, the reliabilities remained between 0.87 and 0.91. Moreover, the average reliability over waves 1 through 7 (lower age group) was 0.87, over waves 8 through 15 (middle age group) was 0.89, and over waves 16 through 22 (upper age group) was 0.90. Hence, during childhood and adolescence there is remarkably little fluctuation in the reliability with which psychopathy can be assessed. In particular, reliability does not decrease with age, which would be anticipated if normative changes interfered with the assessment of psychopathy.
Table 3.
Cohorts | |||||
---|---|---|---|---|---|
Age | Youngest | Middle | Oldest | Alpha | Average Alpha |
7 | 502 | .83 | .87 | ||
7.5 | 495 | .88 | |||
8 | 494 | .87 | |||
8.5 | 468 | .87 | |||
9 | 475 | .88 | |||
9.5 | 477 | .89 | |||
10 | 481 | 508 | .89 | ||
10.5 | 465 | 500 | .90 | .89 | |
11 | 463 | 490 | .89 | ||
11.5 | 471 | .89 | |||
12 | 467 | 477 | .90 | ||
12.5 | 472 | .89 | |||
13 | 463 | 471 | 502 | .90 | |
13.5 | 498 | .88 | |||
14 | 484 | 473 | .90 | ||
14.5 | 451 | .88 | .90 | ||
15 | 439 | 441 | .91 | ||
15.5 | 430 | .91 | |||
16 | 435 | .90 | |||
16.5 | 423 | .91 | |||
17 | 433 | .91 | |||
17.5 | 418 | .90 |
Note: The first column provides the age of participants. The second through fourth columns provide the number of participants assessed in each cohort at each age. The fifth column provides the coefficient alpha for the CPS-SF computed using all available participants at each age. The final column provides the arithmetic mean of the alphas in each of three age ranges: 7 to 10, 10.5 to 14, and 14.5 to 17.5.
Cross-wave stability
Table 4 displays double-entry correlations for the psychopathy measurements over time lags of 6 months, 1 year, 2 years, and 5 years; importantly, such correlations take into account not just rank-order stability but stability in score levels across time. Stability over a time lag of 6 months ranged from 0.65 to 0.80, but the low end becomes 0.72 if time intervals beginning with cohorts entering the study are omitted. In addition, 6-month stability did not exhibit a systematic pattern of increase or decrease through childhood and adolescence. Stability over a 1-year time lag ranged from 0.60 to 0.77. There was again no systematic pattern of increase or decrease in 1-year stability. Moreover, 1-year stability was generally similar to 6-month stability; the difference was less than 0.05 in 12 out of 16 instances for which a comparison was possible. The ranges of stability for 2-year and 5-year time lags were 0.56 to 0.76 and 0.49 to 0.62, respectively. Stability for a 5-year time lag was weaker than for shorter time lags, as expected, but the figures of 0.49 to 0.62 still suggest that: (i) boys who are relatively high on psychopathy in grade school tend to remain relatively high in early adolescence; and, (ii) boys who are relatively high on psychopathy in early adolescence tend to remain relatively high in late adolescence.
Table 4.
Length of Time-Lag | ||||
---|---|---|---|---|
Starting Wave (Age) | Six Month | One Year | Two Year | Five Year |
1 (7) | 0.68 (Y) | 0.60 (Y) | 0.56 (Y) | 0.49 (Y) |
2 (7.5) | 0.72 (Y) | 0.68 (Y) | 0.59 (Y) | |
3 (8) | 0.74 (Y) | 0.73 (Y) | 0.70 (Y) | 0.55 (Y) |
4 (8.5) | 0.79 (Y) | 0.73 (Y) | 0.69 (Y) | |
5 (9) | 0.72 (Y) | 0.75 (Y) | 0.68 (Y) | 0.51 (Y) |
6 (9.5) | 0.78 (Y) | 0.73 (Y) | ||
7 (10) | 0.74 (Y, M) | 0.72 (Y, M) | 0.64 (Y, M) | 0.62 (Y) |
8 (10.5) | 0.76 (Y, M) | 0.69 (M) | 0.71 (M) | |
9 (11) | 0.75 (M) | 0.74 (Y, M) | 0.69 (Y, M) | 0.56 (Y) |
10 (11.5) | 0.76 (M) | 0.77 (M) | ||
11 (12) | 0.76 (M) | 0.77 (Y, M) | 0.76 (Y) | 0.60 (Y) |
12 (12.5) | 0.80 (M) | |||
13 (13) | 0.65 (M) | 0.68 (Y, O) | 0.61 (Y, O) | |
14 (13.5) | 0.73 (O) | 0.67 (O) | 0.67 (O) | |
15 (14) | 0.72 (O) | 0.69 (Y, O) | 0.69 (Y) | |
16 (14.5) | 0.72 (O) | 0.71 (O) | 0.59 (O) | |
17 (15) | 0.73 (O) | 0.72 (Y, O) | 0.72 (Y) | |
18 (15.5) | 0.70 (O) | 0.71 (O) | ||
19 (16) | 0.73 (Y) | |||
20 (16.5) | 0.76 (O) | |||
Average | 0.74 | 0.71 | 0.67 | 0.56 |
Note: The first column provides the beginning wave for each assessment of stability with the prototypical age provided in parentheses. The second through fifth columns provide the double-entry correlations across various time lags using all participants who provide a given time lag from a particular starting wave; participating cohorts are given in parentheses. For example, participants from the younger and middle cohorts provided six-month stability information at Wave 7, but the younger and older cohorts provided information on one-year stability at Wave 17 when participants were around 15 years old.
Mean levels of psychopathy across development
Table 5 shows the estimates β0 through β4 from Model I for each of the two risk groups, along with standard errors and p-values reflecting whether the estimates are significantly different from zero. The overall trend in psychopathy is estimated as
Table 5.
Estimating parameters for the low-risk groupa | |||
---|---|---|---|
Parameter | Estimate | Standard error | P-value |
β0 (constant) | 0.4282 | 0.07593 | < 0.0001 |
β1 (age) | 0.2248 | 0.1137 | 0.0482 |
β2 (age squared) | −0.08100 | 0.04453 | 0.0692 |
β3 (assessment) | 0.02906 | 0.03403 | 0.3932 |
β4 (assessment squared) | 0.1513 | 0.03120 | < 0.0001 |
Estimating parameters for the high-risk groupa | |||
Parameter | Estimate | Standard error | P-value |
β0 (constant) | 0.5060 | 0.07920 | < 0.0001 |
β1 (age) | 0.5784 | 0.1220 | < 0.0001 |
β2 (age squared) | −0.2363 | 0.04854 | < 0.0001 |
β3 (assessment) | 0.005975 | 0.03645 | 0.8698 |
β4 (assessment squared) | 0.1895 | 0.03288 | < 0.0001 |
Estimate of residual error variance: 0.04554b | |||
Results for hypothesis tests of interest | |||
Null hypothesis | DF | Chi-square | P-value |
β2 = 0 in both groups | 2 | 27.01 | < 0.0001 |
β4 = 0 in both groups | 2 | 56.74 | < 0.0001 |
fixed effects equal in both groups | 5 | 305.03 | < 0.0001 |
Notes:
The parameters β0 through β4 are the intercept and coefficients for Aij, Aij2, Mij, and Mij2, respectively.
The square root of the residual error variance represents the magnitude of a typical departure from the overall trend, adjusted for random effects and serially correlated errors. Hence, the estimated residual error variance may be regarded as a measure of model fit, although it is a different kind of measure than the cAIC mentioned in footnote 5: the cAIC is useful for determining how to structure a model, but the estimated residual error variance is useful for describing a model’s performance once its structure has been determined.
For example, mean psychopathy for low-risk 12 year-olds who have been assessed once before is estimated as 0.4282 + 0.2248 (1.2) − 0.08100 (1.2)2 + 0.02906 (5/6) + 0.1513 (5/6)2 = 0.7106, while the corresponding estimate for high-risk 12 year-olds is 0.9964.10
Also shown in Table 5 are results for the central questions. The first test indicates that there is a significant nonlinear effect of age on psychopathy scores. Similarly, the second test indicates a significant nonlinear effect of assessment on psychopathy scores. Finally, the last test indicates that the equations describing psychopathy differ across the two risk groups
Figure 1 places these results in perspective. Estimated mean psychopathy is displayed as a function of age for high-risk boys and for low-risk boys, assuming the boys have been assessed often enough so that Mij = 0.11 In line with different fixed effects across groups, Figure 1 shows that mean psychopathy is greater for high-risk boys uniformly throughout childhood and adolescence. Although the quadratic effect of age is statistically significant, the contribution of age is practically small. Indeed, the difference between the highest and lowest points on the curve for low-risk boys is only 0.038—10.3% of a standard deviation among low-risk boys. The corresponding numbers for high-risk boys are 0.065 and 15.8%.
We more formally quantified absolute (mean-level) stability for the risk groups by dividing the mean square error from Model I (adjusted for age and assessment) by the crude mean square error. For the low-risk group, this quotient is
where the averages are taken over all observations of low-risk boys and 0.6218 represents the average of these. If mean-level psychopathy does not vary greatly with age or the number of previous assessments, then the quotient will be close to 100%. For the high-risk group, the quotient is
Where averages are taken over all observations of high-risk boys and .8836 represents the averge. We obtain absolute (mean-level) stabilities of 97.1% and 97.0% for low- and high-risk boys respectively. These extremely high percentages correspond to the near flat (but statistically not exactly flat) curves in Figure 1. Thus, assuming we already have knowledge of a boy’s risk status, we reduce average squared error in predicting psychopathy by 3.0% with the added knowledge of age and the number of previous assessments,12 signifying that mean-level psychopathy does not change substantially with age or the number of previous assessments.
Predictive utility of psychopathy across development
The results from Model II in which future delinquency is predicted by previous delinquency, previous psychopathy, and age are provided in Table 6. Among low-risk boys the prediction for current delinquency is estimated as
Table 6.
Estimating parameters for the low-risk groupa | |||
---|---|---|---|
Parameter | Estimate | Standard error | P-value |
β0 (intercept) | 2.4089 | 0.9988 | 0.0159 |
β1 (previous delinquency) | 0.2852 | 0.05320 | < 0.0001 |
β2 (previous psychopathy) | 0.4060 | 0.2446 | 0.0971 |
β3 (age) | −6.3400 | 2.4731 | 0.0104 |
β4 (age-squared) | 6.1660 | 1.9972 | 0.0020 |
β5 (age-cubed) | −1.7810 | 0.5211 | 0.0006 |
β6 (previous del. X age) | −0.06137 | 0.04040 | 0.1288 |
β7 (previous psych. X age) | −0.00635 | 0.1931 | 0.9738 |
β8 (6 months or 1 year) | 0.3125 | 0.06475 | < 0.0001 |
Estimating parameters for the high-risk groupa | |||
Parameter | Estimate | Standard error | P-value |
β0 (intercept) | 1.5128 | 1.0289 | 0.1415 |
β1 (previous delinquency) | 0.2530 | 0.04781 | < 0.0001 |
β2 (previous psychopathy) | 0.6077 | 0.2405 | 0.0116 |
β3 (age) | −3.4561 | 2.4857 | 0.1644 |
β4 (age-squared) | 5.0782 | 1.9858 | 0.0106 |
β5 (age-cubed) | −1.7742 | 0.5135 | 0.0006 |
β6 (previous del. X age) | −0.06045 | 0.03680 | 0.1006 |
β7 (previous psych. X age) | −0.1307 | 0.1828 | 0.4748 |
β8 (6 months or 1 year) | 0.1478 | 0.06512 | 0.0233 |
Estimate of residual error variance: 2.2232 | |||
Results for hypothesis tests of interest | |||
Null hypothesis | DF | Chi-square | P-value |
β1 = β6 = 0 in both groups | 4 | 472.20 | < 0.0001 |
β2 = β7 = 0 in both groups | 4 | 83.80 | < 0.0001 |
β5 = 0 in both groups | 2 | 23.62 | < 0.0001 |
β8 = 0 in both groups | 2 | 28.44 | < 0.0001 |
β6 = 0 in both groups | 2 | 5.01 | 0.0820 |
β7 = 0 in both groups | 2 | 0.51 | 0.7742 |
fixed effects equal in both groups | 9 | 349.95 | < 0.0001 |
β1, β6 equal in both groups | 2 | 3.04 | 0.2187 |
β2, β7 equal in both groups | 2 | 0.48 | 0.7868 |
The parameters β0 through β8 are the intercept and coefficients for Xij′, Yij′, Aij, Aij2, Aij3, Xij′, Aij, Yij′Aij, and Sij respectively.
whereas for high-risk boys we have
Hence, the predictive utility of past psychopathy is estimated to be 0.4060 − 0.00635*age for low-risk boys and 0.6077 − 0.1307*age for high-risk boys. A one-point increase in past psychopathy for a low-risk 12 year-old boy increases the prediction for current delinquency by an estimated 0.3984 points (0.4060 − 0.00635*1.2). The predictive utility of past delinquency is estimated to be 0.2852 − 0.06137*age for low-risk boys and 0.2530 − 0.06045*age for high-risk boys.
Table 6 also provides results related to another of our central questions. The first two tests indicate that previous delinquency and previous psychopathy are significantly predictive of current delinquency. The next test indicates that the cubic term for age and the separation variable cannot be removed from the model. The final two tests are most central to the present purposes; these tests indicate that the predictive utilities of both previous delinquency and previous psychopathy do not change significantly with age. Furthermore, although the fixed effects in general do differ across low and high risk groups, the fixed effects specific to previous delinquency (β1 and β6) or previous psychopathy (β2 and β7) do not differacross the risk groups.
Figure 2 illustrates these results. The estimated expected change in current delinquency corresponding to a one-point change in either past psychopathy or past delinquency is shown as a function of age for low-risk boys and for high-risk boys. None of the lines in Figure 2 approaches the horizontal axis, corresponding to rejection of the null hypotheses asserting zero predictive utility (β1= β6= 0; β2= β7= 0). The two lines for past delinquency (one for low-risk boys, one for high-risk boys) are very close, corresponding to non-rejection of the null hypothesis that β1, β6 are the same in the two groups. The two lines for past psychopathy are also close, corresponding to non-rejection of the null hypotheses that β2, β7 are the same. Finally, three of the lines in Figure 2 are nearly flat, while the fourth is only modestly sloped, corresponding to non-rejection of the null hypotheses asserting zero change in predictive utility over time (β6= 0; β7= 0). 13
Discussion
Reliability was relatively high at all ages (i.e., average alpha = .89) and showed no tendency to increase or decrease with age. Stability was quite high across 6-month, one-year, two-year, and five-year periods with average intraclass correlations of .74, .71, .67, and .56 respectively. Additionally, there was no evidence for change across childhood and adolescence in the levels of stability. There was evidence of age-related changes in the mean levels of psychopathy across time; specifically, the fitted trend for each risk group followed a quadratic pattern, suggesting a tendency for psychopathy to be lower at the earliest and latest ages. However, when the fluctuations in the fitted trends were explicitly examined, they were found to be quite small in magnitude. The largest fluctuation in each risk group across the entire 11-year period was less than 1/6th of the within-group standard deviation, and the error for predicting psychopathy was reduced by less than 3% when age and assessment number were taken into account. Hence, although there are statistically significant changes in the estimates of mean psychopathy across adolescence, these changes are small; mean level stability, on the other hand, is quite high. Finally, we examined the utility of juvenile psychopathy in predicting future delinquency above and beyond current delinquency. Both juvenile psychopathy and current delinquency proved useful in predicting future delinquency, and their predictive utilities did not differ as a function of age or risk status.
Implications
The implications of the present study are relatively straightforward, particularly in relation to the construct of juvenile psychopathy. Some have raised concerns that developmentally normative changes in certain traits might masquerade as psychopathy or make the assessment of psychopathy prohibitively difficult (Edens et al., 2001; Seagrave & Grisso, 2002). Given the number of developmental changes taking place across adolescence and the normative changes in antisocial behavior across this period, these concerns could not be dismissed a priori. The results of the present study directly address these concerns. We found little evidence for the kinds of age-related changes in reliability, stability, and predictive utility anticipated by these criticisms. Our results, along with previous work by Frick et al. (2003), suggest that juvenile psychopathy is fairly stable across adolescence. In fact, the levels of stability found in the present study are very similar to the levels of stability observed for basic dimensions of personality. In their meta-analysis on the rank-order consistency of personality, Roberts and Del Vecchio (2000) found the rank-order consistency of personality to be 0.43 across 6.7 years among adolescents (aged 12 to 17.9). Our present estimates are also similar to the stability of scores from the Revised Psychopathy Checklist (Hare, 2003) in adults; in a sample of 200 male methadone patients, Rutherford, Cacciola, Alterman, McKay, and Cook (1999) reported a 2-year stability of .60.
Although we believe that the present results support the basic construct validity of juvenile psychopathy, its assessment in childhood and adolescence, and its predictive utility, we do not believe that these results support necessarily the use of juvenile psychopathy scores in forensic decision-making, particularly in late childhood (see Frick, 2002). The 5-year relative stabilities are fairly good given the ages of the participants and the relatively long span; however, while these levels are high enough for the developmental psychopathology field, they are not high enough for forensic decision-making. Simply put, the standards of use for the juvenile psychopathy construct differ across research and applied contexts. It is widely accepted that standards of reliability differ across these settings; standards for validity and stability also differ. Referring to exams used in college admissions, Nunally (1978) writes, “…in such instances, it is frightening to think that any measurement error is permitted” (p. 246). Such error is even more frightening in the context of forensic decisions (e.g., sentencing and trial of juveniles as adults). For these more applied contexts, higher stabilities and more ecologically valid assessment contexts (e.g., assessments without the promise of confidentiality) are required to support the use of the construct.
We also believe that the current results speak to concerns about personality pathology in childhood and adolescence more generally. In the absence of much empirical data (Cohen & Crawford, 2005) and on the basis of theoretical expectations and concerns about labeling, the American Psychiatric Association’s (APA) Diagnostic and Statistical Manual of Mental Disorders—Fourth Edition, Text Revision (DSM-IVTR) cautions against applying PD diagnoses to children and adolescents. The present results suggest that this caution may be too strong. The stability of psychopathic traits across childhood and adolescence are much higher than what is implied by the characterization provided within the DSM-IVTR.
Although it is possible that the results obtained for psychopathic traits in the present study may not generalize to other PDs, we believe this unlikely. The assessment of psychopathy relies heavily on inferences about personality traits rather than on the assessment of specific behaviors, allowing the referents for psychopathy to be open-ended (i.e., not tied to a specific behavior or set of behaviors) and to therefore be different at different ages, essentially building in a degree of heterotypic continuity. For example, within the Hare Psychopathy Checklist-Revised (PCL-R, 2003) a lack of remorse is described as a general lack of concern for the negative consequences that a person’s actions have on others. The specific actions may differ across development; they might involve teasing or ostracism of peers in childhood, destruction of property in adolescence, and battery in adulthood. The general lack of concern for the negative consequences of these actions on others, however, is relevant at each developmental period and can be assessed despite the changing nature of the acts. Although this was less true in previous versions of the DSM, the PD criteria in DSM-IVTR also tend to rely on open-ended referents. For example, one criterion for Narcissistic PD is interpersonal exploitation—taking advantage of others to achieve one’s own ends. Because the referents are open, this criterion is relevant across ages even as its specific manifestations change from getting a friend to do one’s homework to getting a parent to support one in living beyond one’s means as an adult.
Limitations
There are limitations to the present study. Although we resolved some potential assessment issues, other problems remain. Parents are typically capable and willing informants, particularly in a research setting, so enlisting their aid was a good choice. The problem with potentially overlapping assessments was solved by asking parents to report on the boys only since the last assessment. Nonetheless, the use of the same rater at each age is somewhat problematic and raises concerns about negative and positive “halo” effects. Incorporating serially correlated errors into the statistical model mitigates this concern, but future research using different raters is obviously needed. Another limitation is the inclusion of only boys in the PYS. This exclusion is understandable from a pragmatic standpoint given the focus of the PYS (i.e., the causes and correlates of serious delinquency) and does not influence our estimates of reliability, stability, and predictive utility for boys; however, this exclusion precludes gender-based comparisons of psychopathy, an important area receiving increased interest. Also, drawing conclusions based on null results (in particular, the absence of significant age effects on the predictive utility of psychopathy) may at first appear problematic. We emphasize, however, that the sample size was large enough to ensure adequate power for detecting even moderate effects. For instance, if the change in predicted delinquency corresponding to a one-unit increase in psychopathy at age 18 differed by one point (1/5th the range of the delinquency scale) from the change at age 7, we would have had about 87% power to detect this in a given risk/race group via a significant estimate for β6 in the second mixed model. Finally, before accepting the stability of personality pathology across childhood and adolescence in general, research will need to be conducted on other PDs.
Future Directions
Several future directions are also relatively clear. The most straightforward for the construct of juvenile psychopathy involve replication using other samples and assessment instruments. In the present study, we examined the stability of juvenile psychopathy across adolescence in a high-risk community sample from inner-city Pittsburgh using a short form of the CPS. It will be important to examine the stability of juvenile psychopathy in institutional, forensic, and rural settings. There are multiple reliable and valid means of assessing psychopathy at both the juvenile and adult levels. To the extent that similar stabilities are obtained across different settings and instruments, the greater will be our confidence in applying the psychopathy construct to youth.
Similar research should also be conducted for other PDs. Although we believe levels of stability similar to those found here should be observed for other PDs, this is ultimately an empirical question. There are several approaches available to studying the early manifestations of the DSM-IVTR PDs. The first is to use a “downward translation” approach such as the one used in the present study in which adult PD assessments are “translated” to be more developmentally appropriate for children and adolescents. Although we noted earlier that most of the psychopathy criteria involved assessment of personality traits with relatively open referents, this was not true for all criteria. For example, the PCL-R includes items assessing promiscuous sexual behavior, juvenile delinquency, many short-term marital relations, and revocation of conditional release (i.e. parole); these criteria are less open in their referents and have stronger developmental boundaries. In the development of the Childhood Psychopathy Scale, these behaviors were not included. The same issue will be faced in “translating” other PDs. For example, the criteria for Borderline PD include “impulsivity in at least two areas that are potentially self-damaging (e.g., spending, sex, substance abuse, reckless driving, binge eating)” (p. 710). Future research examining the stability of other PDs will need to be mindful of such closed referents if the downward translation approach is to be used.
A potentially promising alternative for identifying child and adolescent precursors of other PDs is the use of a general model of personality functioning, such as the Five Factor Model of personality (Costa & McCrae, 1992) which consists of five broad domains (Neuroticism, Extraversion, Openness to Experience, Agreeableness, and Conscientiousness) with each domain underlaid by 6 specific facets. A large body of research suggests that the DSM-IVTR PDs can be understood, and even assessed, as maladaptive constellations of the FFM facets (Saulsman & Page, 2004). Lynam and colleagues (Miller, Lynam, Widiger, & Leukefeld, 2003; Lynam & Widiger, 2001) have provided expert-generated FFM profiles for each DSM PD and psychopathy that have been shown to be robust across derivation methods and, when used to assess the PDs, to show expected relations to external variables (e.g., Gudonis, Miller, Miller, & Lynam, 2008; Lynam & Widiger, 2007; Trull, Widiger, Lynam, & Costa, 2003). The FFM has also been shown to be a viable model of personality in children and adolescents (Shiner, 1998). The five domains of the FFM have been identified in children and adolescents in studies using parent, teacher, and self-reports (e.g., Caspi & Shiner, 2006). The 30 more articulated facets of the FFM have been validly assessed in children and adolescents using the recently revised NEO PI-3, a revision of one of the most widely-used FFM assessments in adults (McCrae, Martin, & Costa, 2005). Given the heterotypic continuity built naturally into personality assessments, the identification of the developmental precursors of adult PDs might profitably begin with the FFM traits in childhood and adolescence that characterize the adult PDs.
Future research should also aim to elucidate the development of psychopathy across childhood and adolescence and into adulthood. One of the more important directions entails examination of the mechanisms of stability. It may be time to move beyond asking whether personality pathology is stable and to begin asking why personality pathology is stable. Basic research in developmental personality suggests that stability is not a phenomenon in its own right but rather is underlaid by various processes. Research is needed to explore how psychopathy and other PDs remain stable across a developmental period rife with developmental changes. One place to begin is with the reactive, evocative, and proactive person-environment transactions that promote stable individual differences (Caspi, 1997). Reactive transactions occur when individuals exposed to the same environment experience it, interpret it, and react to it according to their pre-existing tendencies. Evocative transactions occur when individuals evoke distinctive reactions from their social environments based on their personalities. Finally, proactive transactions occur when individuals select or create social environments that are in line with their existing personalities. In all cases, these person-environment transactions reinforce rather than repudiate the existing personality. In the case of antisocial or psychopathic behavior, this reinforcement may come through an accumulation of negative consequences. From this perspective, adult psychopaths may be relatively resistant to treatment due to their accretion of negative consequences (e.g., alienation from family, addiction to drugs or alcohol, being part of a criminal peer group, school dropout, injuries, patchy work histories, and multiple incarcerations) that have closed the doors to more legitimate opportunities.
Another important future direction in developmental terms is a search for discontinuities in psychopathy and the factors that promote it. The present paper demonstrates that there is considerable degree of continuity to psychopathy across childhood and adolescence, suggesting that personality pathology can be assessed during these developmental periods. Stability in the present paper, however, was far from perfect; there is also a degree of discontinuity in psychopathy as seen in the average 5-year stability 0.56. Discontinuity, like continuity, should be examined and explained. Identifying factors or events that contribute to discontinuity will inform etiology and intervention. In a previous report, we searched for moderators of the relation between psychopathy at ages 13 and 24 (Lynam, Loeber, Stouthamer-Loeber, 2008). Across thirteen potential moderators that included demographics, parenting factors, previous delinquency, peer delinquency, and other individual factors, we found little evidence for moderation. However, these predictors were static rather than dynamic and the assessment only included two ages. Future research should include a broader array of factors assessed at multiple timepoints.
Acknowledgments
This research was supported in part by NIMH grants MH45070, MH49414 and MH60104; grant 86-JN-CX-0009 from the Office of Juvenile Justice and Delinquency, Office of Justice Programs, U.S. Department of Justice; and the University of Wisconsin Graduate School. We would like to thank the boys and their families from the PYS for providing the data.
Footnotes
The ordinary Pearson correlations were very close to the double-entry correlations (maximum difference 0.034, average difference 0.007) and so will not be reported here.
Yij equals the square root of 2 times an individual’s raw psychopathy score. The square root transformation reduces the skewness of the distributio of raw psychopathy scores (see Table 3). The factor of 2 ensures that the Yij fall between 0 and 2, as do the raw scores.
Aij is defined in decades rather than in years so that estimation of the overall trend is not susceptible to distortion through rounding of coefficient estimates.
Mij is mathematically expressed as the larger of (7 − j)/6 and 0. Hence, Mij decreases from 1 at the first assessment to 5/6 at the second assessment and continues decreasing in increments of 1/6 until it reaches 0. Note that Mij is not confounded with Aij since one cohort entered the study at wave 7 and another cohort entered the study at wave 13.
We used Bozdogan’s (1987) cAIC to validate this structure for the fixed effects in Model I. The cAIC is a measure of model fit that balances fidelity to the present sample against generalizability to the underlying population; a lower score indicates a better fitting model. Model I had a cAIC score of 3411.8, whereas removing the quadratic term in Aij would have yielded 3422.0 (oversimplification; less fidelity to the present sample); adding a cubic term in Aij would have yielded 3422.4 (overcomplexification; less generalizability to the underlying population). Removing the quadratic term in Mij or adding a cubic term would have also been deleterious (3451.6, 3413.2). Finally, defining Mij to decrease to 0 more rapidly (in increments of 1/5 rather than 1/6) would have adversely affected the cAIC score (3415.4).
The cAIC did not support making a subject-specific adjustment to β2.
Xij equals the square root of 5 times an individual’s raw delinquency score. The square root transformation reduces the skewness of the distribution while the factor of 5 ensures that the Xij fall between 0 and 5, as do the raw delinquency scores.
We used Bozdogan’s (1987) cAIC to validate this structure for the fixed effects in Model II. The cAIC score for Model II was 50168.6. For example, eliminating the cubic term in age would have yielded a cAIC score of 50175.5, while adding age-squared/past psychopathy and age-squared/past delinquency interaction terms would have yielded a cAIC score of 50189.5.
In this context, a singular matrix means that there is some linear combination of random effects, residual errors, and serially correlated errors for which the variance is estimated to be zero. This is loosely analogous to the concept of collinearity in ordinary linear regression. The solution is to remove either the random effects or the serially correlated errors; for this data set, the cAIC is lower (better) when the serially correlated errors are removed.
Here and in the remainder of the Results section, any reference to a psychopathy score or a delinquency score is to the square root-transformed version.
Assuming a different value for Mij, would shift the curves in Figure 1 vertically.
If we pool the observations from high-risk boys and low-risk boys, ignoring the distinction between risk groups altogether, we obtain an absolute (mean-level) stability of 97.4%.
The slope of the fourth line in Figure 2 is −0.01307, representing an estimated loss of 0.1307 over 10 years in the predictive utility of psychopathy among high-risk boys. Although the fourth line may stand out visually, the 0.1307 is fairly modest and should also be evaluated in light of its standard error (0.1828).
Contributor Information
Donald R. Lynam, Purdue University
Richard Charnigo, University of Kentucky.
Terrie E. Moffitt, Duke University and Institute of Psychiatry, King’s College London
Adrian Raine, University of Southern California.
Rolf Loeber, University of Pittsburgh.
Magda Stouthamer-Loeber, University of Pittsburgh.
References
- Achenbach TM. Manual for the Child Behavior Checklist and 1991 Profile. Burlington, VT: University of Vermont, Department of Psychiatry; 1991. [Google Scholar]
- American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 4. Washington, D.C: 2000. Text Revision. [Google Scholar]
- Blair RJR, Coles M. Expression recognition and behavioural problems in early adolescence. Cognitive Development. 2001;15:421–434. [Google Scholar]
- Bozdogan H. Model selection and Akaike’s Information Criterion (AIC): The general theory and its analytical extensions. Psychometrika. 1987;52:345–370. [Google Scholar]
- Brandt J, Kennedy W, Patrick C, Curtin J. Assessment of psychopathy in a population of incarcerated adolescent offenders. Psychological Assessment. 1997;9:429–435. [Google Scholar]
- Brinkley CA, Schmitt WA, Smith SS, Newman JP. Construct validation of a self-report psychopathy scale: Does Levenson’s self-report psychopathy scale measure the same constructs as Hare’s psychopathy checklist-revised? Personality and Individual Differences. 2001;31(7):1021–1038. [Google Scholar]
- Caspi A. Personality development across the life course. In: Damon W, Eisenberg N, editors. Handbook of child psychology, Volume 3: Social, emotional, and personality development. New York: Wiley; 1997. pp. 311–388. [Google Scholar]
- Caspi A, Block J, Block JH, Klopp B, Lynam D, Moffitt TE, et al. A “common language” version of the California Child Q-Set (CCQ) for personality assessment. Psychological Assessment. 1992;4:512–523. [Google Scholar]
- Caspi A, Shiner R. Personality development. In: Eisenberg N, Damon W, Lerner RM, editors. Handbook of child psychology: Vol. 3, Social, emotional, and personality development. Vol. 6. Hoboken, NJ: John Wiley & Sons Inc; 2006. pp. 300–365. [Google Scholar]
- Catchpole R, Gretton HM. The predictive validity of risk assessment with violent young offenders: A 1-year examination of criminal outcome. Criminal Justice and Behavior. 2003;30:688–708. [Google Scholar]
- Christian RE, Frick PJ, Hill NL, Tyler L. Psychopathy and conduct problems in children: II. Implications for subtyping children with conduct problems. Journal of the American Academy of Child Psychiatry. 1997;36:233–241. doi: 10.1097/00004583-199702000-00014. [DOI] [PubMed] [Google Scholar]
- Cleckley H. The mask of sanity: An attempt to reinterpret the so-called psychopathic personality. Oxford, England: Mosby; 1941. [Google Scholar]
- Cohen P, Crawford T. Developmental issues. In: Oldham J, Skodol A, Bender D, editors. The American Psychiatric Publishing textbook of personality disorders. Washington, DC: American Psychiatric Publishing; 2005. pp. 171–185. [Google Scholar]
- Corrado RR, Vincent GM, Hart SD, Cohen IM. Predictive validity of the Psychopathy Checklist: Youth Version for general and violent recidivism. Behavioral Sciences and the Law. 2004;22:5–22. doi: 10.1002/bsl.574. [DOI] [PubMed] [Google Scholar]
- Costa PT, Jr, McCrae RR. Revised NEO Personality Inventory (NEO-PI-R) and NEO Five Factor Inventory (NEO-FFI) professional manual. Odessa, FL: PAR; 1992. [Google Scholar]
- Edens JF, Skeem JL, Cruise KR, Cauffman E. Assessment of “juvenile psychopathy” and its association with violence: A critical review. Behavioral Sciences and the Law. 2001;19:53–80. doi: 10.1002/bsl.425. [DOI] [PubMed] [Google Scholar]
- Elliot DZ, Huizinga D, Ageton SS. Explaining delinquency and drug-use. Beverly Hills, CA: Sage; 1985. [Google Scholar]
- Enebrink P, Andersen HS, Langstrom N. Callous-unemotional traits are associated with clinical severity in referred boys with conduct problems. Nordic Journal of Psychiatry. 2005;59:431–440. doi: 10.1080/08039480500360690. [DOI] [PubMed] [Google Scholar]
- Falkenbach DM, Poythress NG, Heide KM. Psychopathic features in a juvenile diversion population: Reliability and predictive validity of two self-report measures. Behavioral Sciences and the Law. 2003;21:787–805. doi: 10.1002/bsl.562. [DOI] [PubMed] [Google Scholar]
- Farrington DP, Loeber R, Jolliffe D. The age-crime curve in reported offending. In: Loeber R, Farrington DP, Stouthamer-Loeber M, Raskin H, editors. Violence and serious theft: Development and prediction from childhood to adulthood. New York, NY: Routledge/Taylor & Francis Group; 2008. pp. 77–104. [Google Scholar]
- Forth AE, Kosson DS, Hare R. Hare Psychopathy Checklist: Youth Version. Toronto, Ontario: Multi-Health Systems; 2003. [Google Scholar]
- Frick P. Juvenile psychopathy from a developmental perspective: Implications for construct development and use in forensic assessments. Law and Human Behavior. 2002;26:247–253. doi: 10.1023/a:1014600311758. [DOI] [PubMed] [Google Scholar]
- Frick P, Cornell A, Barry C, Bodin S, Dane H. Callous-unemotional traits and conduct problems in the prediction of conduct problem severity, aggression, and self-report of delinquency. Journal of Abnormal Child Psychology. 2003;31:457–470. doi: 10.1023/a:1023899703866. [DOI] [PubMed] [Google Scholar]
- Frick PJ, Hare R. Antisocial process screening device. Toronto, Canada: Multi-Health Systems; 2001. [Google Scholar]
- Frick PJ, Kimonis ER, Dandreaux DM, Farell JM. The 4-year stability of psychopathic traits in non-referred youth. Behavioral Science Law. 2003c;21:713–736. doi: 10.1002/bsl.568. [DOI] [PubMed] [Google Scholar]
- Frick PJ, O’Brien BS, Wootton JM, McBurnett K. Psychopathy and conduct problems in children. Journal of Abnormal Psychology. 1994;103:700–707. doi: 10.1037//0021-843x.103.4.700. [DOI] [PubMed] [Google Scholar]
- Fung MT, Raine A, Loeber R, Lynam DR, Steinhauer SR, Venables PH, Stouthamer-Loeber M. Reduced electrodermal activity in psychopathy-prone adolescents. Journal of Abnormal Psychology. 2005;114:187–196. doi: 10.1037/0021-843X.114.2.187. [DOI] [PubMed] [Google Scholar]
- Gretton HM, McBride M, Hare RD, O’Shaughnessy R, Kumka G. Psychopathy and recidivism in adolescent sex offenders. Criminal Justice and Behavior. 2001;28:427–449. [Google Scholar]
- Gudonis LC, Miller DJ, Miller JD, Lynam DR. Conceptualizing personality disorders from a general model of personality functioning: Antisocial personality disorder and the Five-Factor Model. Personality and Mental Health. 2008;2:249–264. [Google Scholar]
- Hare R. Manual for the Revised Psychopathy Checklist. 2. Toronto, Ontario: Multi-Health Systems; 2003. [Google Scholar]
- Hart SD, Cox DN, Hare RD. The Hare Psychopathy Checklist: Screening Version. Toronto, Canada: Multi-Health Systems; 1995. [Google Scholar]
- Junger-Tas J, Marshall IH. The self report methodology in crime research. Crime and Justice: A Review of Research. 1999;25:291–365. [Google Scholar]
- Kosson DS, Cyterski TD, Steuerwald BL, Neumann CS, Walker-Matthews S. The reliability and validity of the Psychopathy Checklist: Youth Version (PCL:YV) in nonincarcerated adolescent males. Psychological Assessment. 2002;14:97–109. doi: 10.1037//1040-3590.14.1.97. [DOI] [PubMed] [Google Scholar]
- Kotler JS, McMahon RJ. Child psychopathy: Theories, measurement, and relations with the development and persistence of conduct problems. Clinical Child and Family Psychology Review. 2005;8:291–325. doi: 10.1007/s10567-005-8810-5. [DOI] [PubMed] [Google Scholar]
- Loeber R, Farrington DP, Stouthamer Loeber M, Van Kammen WB. Antisocial behavior and mental health problems: Explanatory factors in childhood and adolescence. Mahwah, NJ: Lawrence Erlbaum Associates; 1998. [Google Scholar]
- Lynam DR. Pursuing the psychopath: Capturing the fledgling psychopath in a nomological net. Journal of Abnormal Psychology. 1997;106:425–438. doi: 10.1037//0021-843x.106.3.425. [DOI] [PubMed] [Google Scholar]
- Lynam DR, Caspi A, Moffit TE, Raine A, Loeber R, Stouthamer-Loeber M. Adolescent psychopathy and the Big Five: Results from two samples. Journal of Abnormal Child Psychology. 2005;33:431–43. doi: 10.1007/s10648-005-5724-0. [DOI] [PubMed] [Google Scholar]
- Lynam DR, Caspi Moffitt, Loeber, Stouthamer-Loeber Longitudinal evidence that psychopathy scores in early adolescence predict adult psychopathy. Journal of Abnormal Psychology. 2007;116:155–165. doi: 10.1037/0021-843X.116.1.155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lynam DR, Derefinko KJ, Caspi A, Loeber R, Stouthamer-Loeber M. The content validity of juvenile psychopathy: An empirical examination. Psychological Assessment. 2007;19:363–367. doi: 10.1037/1040-3590.19.3.363. [DOI] [PubMed] [Google Scholar]
- Lynam DR, Gudonis L. The development of psychopathy. Annual Review of Clinical Psychology. 2005;1:381–407. doi: 10.1146/annurev.clinpsy.1.102803.144019. [DOI] [PubMed] [Google Scholar]
- Lynam DR, Loeber R, Stouthamer-Loeber M. The stability of psychopathy from adolescence into adulthood: The search for moderators. Criminal Justice and Behavior. 2008;35:228–243. doi: 10.1177/0093854807310153. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lynam DR, Widiger T. Using the five factor model to represent the personality disorders: An expert consensus approach. Journal of Abnormal Psychology. 2001;110:401–412. doi: 10.1037//0021-843x.110.3.401. [DOI] [PubMed] [Google Scholar]
- Lynam DR, Widiger TA. Using a general model of personality to identify the basic elements of psychopathy. Journal of Personality Disorders. 2007;21:160–178. doi: 10.1521/pedi.2007.21.2.160. [DOI] [PubMed] [Google Scholar]
- McCrae RR, Costa PT, Martin TA. The NEO-PI-3: A More Readable Revised NEO Personality Inventory. Journal of Personality Assessment. 2005;84:261–270. doi: 10.1207/s15327752jpa8403_05. [DOI] [PubMed] [Google Scholar]
- Miller JD, Lynam DR, Widiger TA, Leukefeld C. Personality disorders as extreme variants of common personality dimensions: Can the Five-Factor Model adequately represent psychopathy? Journal of Personality. 2001;69:253–276. doi: 10.1111/1467-6494.00144. [DOI] [PubMed] [Google Scholar]
- Murrie DC, Cornell DG, Kaplan S, McConville D, Levy-Elkon A. Psychopathy scores and violence among juvenile offenders: A multi-measure study. Behavioral Sciences and the Law. 2004;22:49–67. doi: 10.1002/bsl.573. [DOI] [PubMed] [Google Scholar]
- Nunnally JC. Psychometric Theory. 2. New York: McGraw-Hill; 1978. [Google Scholar]
- O’Brien BS, Frick PJ. Reward dominance: Associations with anxiety, conduct problems, and psychopathy in children. Journal of Abnormal Child Psychology. 1996;24:223–240. doi: 10.1007/BF01441486. [DOI] [PubMed] [Google Scholar]
- Ogloff JR, Wong S, Greenwood A. Treating criminal psychopaths in a Therapeutic Community program. Behavioral Sciences and the Law. 1990;8:181–190. [Google Scholar]
- Osgood DW, Wilson JK, O’Malley PM, Bachman JG, Johnston LD. Routine activities and individual deviant behavior. American Sociological Review. 1996;61:635–655. [Google Scholar]
- Piatigorsky A, Hinshaw SP. Psychopathic traits in boys with and without attention-deficit/hyperactivity disorder: Concurrent and longitudinal correlates. Journal of Abnormal Child Psychology. 2004;32:535–550. doi: 10.1023/b:jacp.0000037782.28482.6b. [DOI] [PubMed] [Google Scholar]
- Porter S, Birt A, Boer DP. Investigation of the criminal and conditional release profiles of Canadian federal offenders as a function of psychopathy and age. Law and Human Behavior. 2001;25:647–661. doi: 10.1023/a:1012710424821. [DOI] [PubMed] [Google Scholar]
- Roberts BW, DelVecchio WF. The rank-order consistency of personality traits from childhood to old age: A quantitative review of longitudinal studies. Psychological Bulletin. 2000;126:3–25. doi: 10.1037/0033-2909.126.1.3. [DOI] [PubMed] [Google Scholar]
- Rutherford M, Cacciola JS, Alterman AI, McKay JR, Cook TG. The 2-year test-retest reliability of the Psychopathy Checklist-Revised in methadone patients. Assessment. 1999;6:285–291. doi: 10.1177/107319119900600308. [DOI] [PubMed] [Google Scholar]
- Salekin RT. Psychopathy and therapeutic pessimism: Clinical lore or clinical reality? Clinical Psychology Review. 2002;22:79–112. doi: 10.1016/s0272-7358(01)00083-6. [DOI] [PubMed] [Google Scholar]
- Salekin RT, Frick PJ. Psychopathy in children and adolescents: The need for a developmental perspective. Journal of Abnormal Child Psychology. 2005;33:403–409. doi: 10.1007/s10802-005-5722-2. [DOI] [PubMed] [Google Scholar]
- Salekin RT, Leistico AMR, Neumann CS, DiCicco TM, Duros RL. Psychopathy and comorbidity in a young offender sample: Taking a closer look at psychopathy’s potential importance over disruptive behavior disorders. Journal of Abnormal Psychology. 2004;113:416–427. doi: 10.1037/0021-843X.113.3.416. [DOI] [PubMed] [Google Scholar]
- Salekin RT, Leistico AMR, Trobst KK, Schrum CL, Lochman JE. Adolescent psychopathy and personality theory-the interpersonal circumplex: Expanding evidence of a nomological net. Journal of Abnormal Child Psychology. 2005;33:445–460. doi: 10.1007/s10802-005-5726-y. [DOI] [PubMed] [Google Scholar]
- Salekin RT, Rogers R, Sewell KW. A review and meta-analysis of the Psychopathy Checklist and Psychopathy Checklist--Revised: Predictive validity of dangerousness. Clinical Psychology: Science and Practice. 1996;3:203–215. [Google Scholar]
- Saulsman LM, Page AC. The five-factor model and personality disorder empirical literature: A meta-analytic review. Clinical Psychology Review. 2004;23:1055–1085. doi: 10.1016/j.cpr.2002.09.001. [DOI] [PubMed] [Google Scholar]
- Seagrave D, Grisso T. Adolescent development and the measurement of juvenile psychopathy. Law and Human Behavior. 2002;26:219–239. doi: 10.1023/a:1014696110850. [DOI] [PubMed] [Google Scholar]
- Shine J, Hobson J. Institutional behaviour and time in treatment among psychopaths admitted to a prison-based therapeutic community. Medicine, Science and the Law. 2000;40:327–335. doi: 10.1177/002580240004000408. [DOI] [PubMed] [Google Scholar]
- Shiner R. How shall we speak of children’s personalities in middle childhood? A preliminary taxonomy. Psychological Bulletin. 1998;124:308–332. doi: 10.1037/0033-2909.124.3.308. [DOI] [PubMed] [Google Scholar]
- Spain SE, Douglas KS, Poythress NG, Epstein M. The relationship between psychopathic features, violence and treatment outcome: The comparison of three youth measures of psychopathic features. Behavioral Sciences and the Law. 2004;22:85–102. doi: 10.1002/bsl.576. [DOI] [PubMed] [Google Scholar]
- Stafford E, Cornell DG. Psychopathy scores predict adolescent inpatient aggression. Assessment. 2003;10:102–112. doi: 10.1177/1073191102250341. [DOI] [PubMed] [Google Scholar]
- Steinberg L. A social neuroscience perspective on adolescent risk-taking. Developmental Review. 2008;28:78–106. doi: 10.1016/j.dr.2007.08.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Trull TJ, Widiger TA, Lynam DR, Costa PT. Borderline personality disorder from the perspective of general personality functioning. Journal of Abnormal Psychology. 2003;112:193–202. doi: 10.1037/0021-843x.112.2.193. [DOI] [PubMed] [Google Scholar]
- Verbeke G, Molenberghs G. Linear mixed models for longitudinal data. New York: Springer-Verlag; 2000. [Google Scholar]
- Walters GD. Predicting institutional adjustment and recidivism with the psychopathy checklist factor scores: A meta-analysis. Law and Human Behavior. 2003;27:541–558. doi: 10.1023/a:1025490207678. [DOI] [PubMed] [Google Scholar]
- Wiesner M, Silbereisen RK. Trajectories of delinquent behaviour in adolescence and their covariates: Relations with initial and time-averaged factors. Journal of Adolescence. 2003;26:753–771. doi: 10.1016/j.adolescence.2003.09.001. [DOI] [PubMed] [Google Scholar]
- Windle M, Mun E, Windle RC. Adolescent-to-young adulthood heavy drinking trajectories and their prospective predictors. Journal of Studies on Alcohol. 2005;66:313–322. doi: 10.15288/jsa.2005.66.313. [DOI] [PubMed] [Google Scholar]
- Wolfgang M, Figlio RM, Tracey PE, Singer FI. The National Survey of Crime Severity. Washington, D.C: U.S. Government Printing Office; 1985. [Google Scholar]