Abstract
Recent research has described the structure of psychopathology as including one general and multiple specific factors, and this structure has been found in samples across development. However, little work has examined whether this structure is consistent across time, particularly in young children, within the same sample. Further, few studies have examined factors that influence the magnitude of the stability of latent dimensions of psychopathology. In the present study, we examine these issues in a community sample of 545 children assessed at ages 3 and 6. In addition, we explored child temperament, parental history of psychopathology, and parenting behaviors as potential moderators of the longitudinal stability of latent dimensions of psychopathology. We found that the same bifactor model structure identified at age 3 provided an adequate fit to the data at age 6. Further, our model revealed significant homotypic stability of the general, internalizing, and externalizing specific factors. We also found evidence of differentiation of psychopathology over time with the general factor at age 3 predicting the externalizing factor at age 6. However, we failed to identify moderators of the longitudinal associations between psychopathology latent factors. Overall, our results bolster support for the bifactor structure of psychopathology, particularly in early childhood.
Keywords: psychopathology, structure, stability, preschool
Clinically significant psychiatric disorders frequently co-occur (Angold, Costello, & Erkanli, 1999); these high rates of comorbidity raise concerns about the distinctness of specific disorders (Krueger & Markon, 2006). As a result, dimensional models of psychopathology have been examined to understand underlying factors that contribute to diverse phenotypes (e.g., Krueger, 1999; Krueger, Caspi, Moffitt, & Silva, 1998; Krueger & Markon, 2006; Slade & Watson, 2006). Despite much work examining structural models, little is known about temporal stability of the latent dimensions and factors that influence patterns of stability.
There is extensive evidence for models of psychopathology that include two correlated latent factors reflecting internalizing and externalizing disorders in children, adolescents, and adults, and across cultures (Achenbach & Rescorla, 2000; Krueger & Markon, 2006; Lahey et al., 2008; Vollebergh et al., 2001). Although studies have focused on several developmental periods, these studies have predominantly used cross-sectional designs, with some exceptions. Krueger, Caspi, Moffitt, and Silva (1998) found that both the internalizing and externalizing dimensions of psychopathology demonstrated strong stability (βs = .69 and .86, respectively) from age 18 to 21 in the Dunedin cohort, yielding support for homotypic continuity of emotional and behavioral problems. Conversely, there was no evidence of heterotypic continuity. Likewise, Vollebergh et al. (2001) examined the stability of anxious-misery, fear, and externalizing latent factors over the course of a one-year follow-up in a sample of individuals from 18–64 years. These data found strong stability for all factors with stability of externalizing (β = .96) being stronger than for anxious-misery and fear latent dimensions (βs = .85 and .89, respectively).
Although most research on dimensional models of psychopathology has focused on internalizing and externalizing dimensions, recent work has found support for an alternative structure. Lahey et al. (2012) found that a bifactor model that included a general factor and specific internalizing and externalizing factors provided a better fit to the data in a large sample of adults. Examining lifetime psychopathology from adolescence through adulthood, Caspi et al. (2014) independently replicated this structure. There have been additional replications of the bifactor structure in cross-sectional studies (e.g., Hankin et al., 2017; Kim & Eaton, 2015; Lahey et al., 2015; Lahey, Van Hulle, Singh, Waldman, & Rathouz, 2011; Murray, Eisner, & Ribeaud, 2016; Pettersson, Larsson, & Lichtenstein, 2016; Stochl et al., 2015), typically in samples of older children, adolescents, and adults. Far less attention has been paid to the structure of psychopathology in young children. Olino et al. (2014) compared several models of psychopathology with data collected from semi-structured diagnostic interviews conducted with primary caregivers of three-year-old children; the authors found that the bifactor model provided the best fit, relative to a correlated two-factor model and a single factor model. Further, the general factor was positively associated with temperamental surgency and negative affect, and negatively associated with effortful control; the internalizing factor was negatively associated with surgency; and the externalizing factor was positively associated with surgency and negatively associated with effortful control, using parent reports of child temperament.
Although the bifactor model of psychopathology has been replicated in a number of studies, there are important questions that need to be addressed to advance this line of research. The present study extends this work in four key ways. First, we tested one-factor, two-factor (correlated internalizing-externalizing model), and bifactor models to identify the structure that fits the data at age six. We expected that the same bifactor model identified at age three would remain a well-fitting model at age six.
Second, we examined whether the latent factors demonstrate homotypic continuity. Lack of longitudinal stability would raise questions about model validity. There have been three evaluations of general psychopathology factor stability in samples of older youth and adults. In a cohort studied annually from ages 7 to 15, Murray et al. (2016) found that the general factor had high internal consistency (indexed by omega-hierarchical) over time, suggesting longitudinal coherence of the structure. However, modest autocorrelations (β range = .10–.33 across waves) over time were found, indicating low temporal stability. Snyder, Young, and Hankin (2017) examined the stability of the general, specific internalizing, and specific externalizing factors across an 18-month period in adolescence (from approximately age 13.5 to 15 years). The authors reported strong homotypic continuity for all factors (general factor β = .86; internalizing factor β = .72; and externalizing β = .71). Lastly, Greene and Eaton (2017) reported on three-year stability of the bifactor solution in a large epidemiologic survey of adults (age range = 18–90+). The authors reported strong homotypic continuity (general factor β = .67; distress factor β = .53; fear factor β = .87; and externalizing β = .87). However, these studies relied on full longitudinal models that empirically compromised assumptions about the orthogonality of the later timepoints (Koch et al., in press). Hence, these previous studies may report biased results based on model misspecifications. This may be partially mitigated by the modest associations between factors observed in these studies. Nonetheless, estimation of associations using recently developed methods (Koch et al., in press) are needed. Moreover, stability of latent dimensions of psychopathology has not yet been examined during early childhood. As rapid development in young children’s cognition, language, inhibitory control, and social relationships is typical (Egger & Angold, 2006), stability of psychopathology may be more modest than in individuals from more advanced developmental periods.
Third, we examined heterotypic continuity to determine whether dimensions at age 3 are associated with different dimensions at age 6. Snyder et al. (in press) and Greene and Eaton (2017) found no evidence of heterotypic continuity. However, these studies examined different developmental periods. Heterotypic continuity might be more common in early childhood when rapid changes in development are present. If heterotypic continuity exists, it is important to determine whether the general factor becomes more differentiated with age or whether the specific factors converge to increase the magnitude of the general factor.
Finally, although there has been some interest in understanding determinants and correlates of latent factors (Hankin et al., 2017; Lahey et al., 2012; Olino et al., 2014), limited attention has been given to factors that influence the stability of latent dimensions of psychopathology over time. Previous studies (Greene & Eaton, 2017; Snyder et al., 2017) have examined the influence of sex and age on homotypic stability of latent psychopathology dimensions in adolescents and adults. Neither study found that sex moderated the stability of any dimension. Greene and Eaton (2017) found no evidence for age moderating homotypic continuity. However, Snyder et al. (in press) found that stability of internalizing problems increased with age. Although these studies examined age and sex as moderators of homotypic continuity, construct domains highly relevant to psychopathology have not been examined. In addition, moderators of heterotypic continuity have not been examined.
We focused on well-established vulnerability factors for and/or correlates of youth psychopathology as potential moderators of both homotypic and heterotypic continuity of the latent psychopathology factors: child sex, child temperament, parental psychopathology, and parenting. There are established gender differences in levels and rates of internalizing (Hankin et al., 1998) and externalizing (Negriff & Susman, 2011) problems. Similarly, there is greater persistence of internalizing pathology in women (Essau, Lewinsohn, Seeley, & Sasagawa, 2010) and externalizing in men (Hicks et al., 2007). Temperament reflects individual differences in emotional reactivity and regulation (Rothbart, Ahadi, Hershey, & Fisher, 2001) and is well-documented as a risk factor for psychopathology in youth (e.g., Caspi, Moffitt, Newman, & Silva, 1996; Dougherty, Klein, Durbin, Hayden, & Olino, 2010) and an influence on the course of disorders (e.g., Bufferd, Dougherty, Olino, et al., in press; Chassin, Flora, & King, 2004). Parent-to-child transmission of internalizing and externalizing psychopathology is also well-established (e.g., Hicks, Krueger, lacono, McGue, & Patrick, 2004; Klein, Lewinsohn, Rohde, Seeley, & Olino, 2005) and influences persistence of child psychopathology (e.g., Weissman et al., 2016). Finally, maladaptive parenting behavior is associated with youth psychopathology (e.g., McLeod, Weisz, & Wood, 2007) and course of psychopathology (e.g., Nanni, Uher, & Danese, 2012; Silk et al., 2009).
The present study examines the stability of structural models of psychopathology across early childhood. This is a critical period of development when prevention or intervention before formal schooling may ameliorate emergence of problem behaviors (Anticich, Barrett, Silverman, Lacherez, & Gillies, 2013; Chronis-Tuscano et al., 2015). As an earlier onset of many disorders is associated with poorer course and outcomes compared to later onset (e.g., Nagin & Tremblay, 2001; Weissman et al., 1999), it is critical to identify factors that influence the persistence of early-onset psychopathology. We anticipate the general structure of psychopathology will be consistent throughout early childhood and that latent factors will be at least moderately stable. However, we hypothesize that stability will be weaker in later developmental periods. In addition, we explore heterotypic continuity between latent factors, and child and parental moderators of homotypic and heterotypic continuity in latent dimensions of psychopathology.
Methods
Participants
Participants were 541 3-year old children and their families in a study of temperament and risk for psychopathology (Olino, Klein, Dyson, Rose, & Durbin, 2010) recruited from commercial mailing lists. Primary caregivers were required to speak English, and children with significant medical disorders or developmental disabilities were excluded. Informed consent was obtained prior to participation. The study was approved by the institutional review board at Stony Brook University.
Children were 3.56 years (SD = .27); 247 (53.9%) were male and 398 (86.9%) were White/non-Hispanic. Children’s receptive language ability, assessed by the Peabody Picture Vocabulary Test (PPVT; Dunn & Dunn, 1997), was in the average range (M = 102.9, SD = 13.9). Mean ages of mothers and fathers were 36.2 years (SD = 4.5) and 38.5 years (SD = 5.4), respectively. Most parents were married or cohabiting (96.0%) when they entered the study; approximately half of the parents (56.7% of the mothers and 46.7% of the fathers) graduated from college. The sample was representative of the surrounding county based on census data (Olino et al., 2010). Participants were invited to participate in a follow-up assessment approximately three years later. Families with follow-up data (n = 466; 86.1%) had children who were 6.09 (SD = .44) years old and 254 (54.5%) were male. Participants who declined the follow-up assessment did not significantly differ on child sex or race, any of the measure of youth temperament, parental psychopathology, and parenting behavior, or symptom counts at age 3, with the exception of panic symptoms: participants were more likely to drop out if parents reported higher levels of panic when children were age 3; t (539) = 3.18, p < .01. Families were compensated for their participation at both assessments. Research staff conducting diagnostic and temperament assessments at age 3 were unaware of other variables, and diagnostic interviewers at age 6 were unaware of age 3 data.
Measures
Child psychiatric disorders (ages 3 and 6)
The Preschool Age Psychiatric Assessment (PAPA; Egger, Ascher, & Angold, 1999) is a reliable, developmentally sensitive interview to assess DSM-IV-TR disorders. The PAPA uses a structured format and an interviewer-based approach, applying a priori guidelines for rating symptoms and associated impairment using a detailed glossary. A 3-month primary period is used to enhance recall. Diagnoses are derived using algorithms. Although the PAPA was designed for 2–5-year-olds, it has been used in children as old as 8 years (Luby, Si, Belden, Tandon, & Spitznagel, 2009). We used the PAPA at both age 3 and 6 to maintain comparability across assessments. Interviews were conducted with the primary caregiver by telephone at age 3 (97.6% mothers) and in person at age 6 (92.1% mothers); parent-report diagnostic interviews have been found to yield equivalent results when administered by telephone and in-person (Lyneham & Rapee, 2005). Details about both assessments are available elsewhere (Bufferd, Dougherty, Carlson, & Klein, 2011; Bufferd, Dougherty, Carlson, Rose, & Klein, 2012).
Following Olino et al. (2014), we used symptom scales for depression, GAD, phobias (the sum of social phobia, specific phobia, and agoraphobia symptoms), separation anxiety, panic, inattention, hyperactivity, impulsivity, and oppositional defiant disorder (ODD) to parallel the domains usually examined in quantitative classification studies. For each dimension, symptoms were counted present if they exceeded a clinically significant threshold. Symptoms (e.g., concentration problems) common to diagnostic criteria for multiple disorders were included for all relevant dimensions.
Inter-rater reliability of all symptom scales was acceptable at both assessments (i.e., intra-class correlations [ICCs] > .78, n = 21 at age 6 and n = 35 at age 6), with the exception of phobic symptoms at age 6. In the random selection of cases to be reviewed, there was very limited variability in this dimension for both raters, precluding quantitative analysis of this dimension.
Observed child temperament (age 3)
Temperament was assessed in 541 children during a 2-hour laboratory visit which included a structured observation consisting of 12 episodes from the Laboratory Temperament Assessment Battery (Lab-TAB; Goldsmith, Reilly, Lemery, Longley, & Prescott, 1995). Principal Components Analysis coded variables was conducted to reduce the number of temperament variables (Dougherty et al., 2011). This analysis yielded five temperament scales: Sociability/Assertiveness (α = .93), Dysphoria (α = .80), Fear/Inhibition (α = .71), Exuberance (α = .88), and Disinhibition (α = .70). Interrater reliability was adequate for all scales, with ICCs as follows: Sociability/Assertiveness (.82), Dysphoria (.88), Fear (.82), Exuberance (.92), and Disinhibition (.83). Additional details about the assessment and coding are available in the online supplement.
Parental psychopathology
Children’s parents were interviewed using the Structured Clinical Interview for DSM-IV, Non-patient version (SCID-NP; First, Spitzer, Gibbon, & Williams, 1996). Interviews were conducted by telephone, which yields similar results as face-to-face interviews (Rohde, Lewinsohn, & Seeley, 1997), by two Masters-level raters with no knowledge of the temperament ratings. SCIDs were obtained from 535 (99.8%) mothers and 443 (82.6%) fathers. When parents were unavailable, family history interviews were conducted with the co-parent. Diagnoses based on family history data were obtained for an additional one (0.2%) mother and 83 (15.5%) fathers. Based on audiotapes of 30 SCID interviews, kappas for inter-rater reliability of lifetime diagnoses were .93 for depressive disorders; .91 for anxiety disorders; and 1.00 for substance abuse/dependence. Of the children, 219 (40.9%) had at least one parent with a lifetime depressive disorder (35.3% MDD; 14.6% dysthymic disorder); 32.3% of mothers and 17.3% of fathers had a lifetime depressive disorder; 237 children (44.2%) had a parent with a lifetime anxiety disorder; 34.0% of mothers and 19.0% of fathers had a lifetime anxiety disorder; 264 children (49.3%) had a parent with a lifetime substance use disorder; 22.0% of mothers and 36.9% of fathers had a lifetime substance use disorder.
Maternal Self-reported parenting
Parenting style at the age three assessment was assessed via the 37-item Parenting Styles and Dimensions Questionnaire (PSDQ; Robinson, Mandleco, Olsen, & Hart, 1995), a widely parent-report measure to assess three styles of parenting: authoritative (warm/supportive, but with structure/limits; α = .82), authoritarian (unsupportive, controlling, punitive; α = .75), and permissive (warm/supportive, but lacking structure/limits; α = .74).
Data analysis
As expected in a community sample, symptom scores were positively skewed. Hence, all symptom scores were log transformed to better approximate normal distributions. Furthermore, all models were estimated using robust full information maximum likelihood in Mplus, version 8.0 (Muthén & Muthén, 1998–2017). Models were evaluated on several indices of goodness of fit, as well as whether theoretical predictions, as indicated by specific paths within the model, were supported. Based on recent discussion of the challenges of applying CFA in temperament and personality and clinical science research (e.g., Marsh, Hau, & Wen, 2004), Hopwood and Donnellan’s (2010) relied on RMSEA < .10 and CFI < .90 for acceptable model fit, while acknowledging that this is a liberal criterion. For completeness, we also report chi-square tests, but do not interpret them. We also include the Bayesian Information Criteria (BIC) as an additional index of model fit, with lower values indicating better fit.
To maximize our data for the evaluation of models at age 6, we used Markov Chain Monte Carlo estimation to impute 100 datasets with the SEQUENTIAL option in Mplus (Asparouhov & Muthén, 2010; Raghunathan, Lepkowski, Van Hoewyk, & Solenberger, 2001). We used age 3 and (when available) age 6 data to impute missing age 6 symptom dimension scores. All analyses relied on imputed data for analysis. This approach maintained comparable data when estimating the models with the age 6 data, only, and the full longitudinal models. All fit information is reported as the mean index across the 100 imputed datasets.
First, we examined one-factor, two-factor (correlated internalizing-externalizing), and bi-factor models for the age 6 assessment. Consistent with Olino et al. (2014), residual correlations between the depression and ODD dimension scores were freely estimated in the age 6 models. Second, we estimated a longitudinal model that included covariance paths between latent factors at each of the two assessment waves. We present tests of longitudinal measurement invariance (Widaman, Ferrer, & Conger, 2010) in the online supplement. Third, we estimated a model that included homotypic and heterotypic continuity paths following the recommendations from Koch, Holtmann, Bohn, and Eid (in press). Briefly, this method provides unbiased prediction estimates of orthogonal latent factors. This requires two-steps in which the prediction to the general factor is estimated in one analysis and prediction to the specific factors is estimated in a separate step. Finally, we estimated models examining whether child sex and observed temperament, parental psychopathology, and parenting moderated homotypic and/or heterotypic continuity paths. These models were estimated using principles from Koch et al. (in press) that relied on separate analyses for the prediction to the general and specific factors. Tests of moderation included interactions between latent variables and continuous observed variables. In order to specify the interaction terms in the analysis, we used the TYPE = RANDOM analysis option. Interaction effects between latent variables and categorical observed variables (e.g., child sex, specific forms of parental psychopathology) were estimated using multiple group models.
Results
Table 1 displays the bivariate correlations between age three and age six symptom counts. Correlations between dimensions at age three are displayed above the diagonal and at age six below the diagonal. To examine the similarity between patterns of correlations, we estimated ICCs for the 36 pairs of correlations between the age three and six data. This analysis revealed substantial similarity (ICC = .91). For both assessments, there was consistency in significant associations among internalizing symptoms and among externalizing symptoms. There were also significant associations between depression and GAD symptoms with all externalizing symptoms; however, associations between separation anxiety, panic symptoms, and phobia symptoms with externalizing symptoms were more modest.
Table 1.
DEP | GAD | SEP | PANIC | PHOB | INAT | HYP | IMP | ODD | |
---|---|---|---|---|---|---|---|---|---|
DEP | --- | .59*** | .24*** | .16*** | .19*** | .28*** | .21*** | .18*** | .47*** |
GAD | .66** | --- | .32*** | .25*** | .26*** | .42*** | .38*** | .25*** | .39*** |
SEP | .33*** | .22*** | --- | .09* | .25*** | .05 | .10* | .04 | .15*** |
PANIC | .17*** | .15*** | .12*** | --- | .21*** | .06 | .03 | .09* | .05 |
PHOB | .17*** | .19*** | .17*** | .24*** | --- | .00 | −.03 | −.04 | −.01 |
INAT | .42*** | .48*** | .11* | .01 | .04 | --- | .59*** | .45*** | .31*** |
HYP | .23*** | .31*** | .05 | .05 | .00 | .48*** | --- | .50*** | .43*** |
IMP | .19** | .20*** | .18*** | .02 | −.04 | .31*** | .47*** | --- | .41*** |
ODD | .36** | .29*** | .21*** | .12*** | .06 | .23*** | .36*** | .40*** | --- |
p < .05;
p < .001.
Pearson correlations are displayed above the diagonal for age 3 assessments and below the diagonal for age 6 for observed variables using the raw data, only. DEP = Depression Symptoms; GAD = Generalized Anxiety Disorder Symptoms; SEP = Separation Anxiety Disorder Symptoms; PANIC = Panic Disorder Symptoms; PHOB = Social and Specific Phobia Total Symptoms; INAT = Inattention Symptoms; HYP = Hyperactivity Symptoms; IMP = Impulsivity Symptoms.
Age 6 Models
One-factor Model
The one-factor model specified that all disorders were due to a single underlying liability factor. All symptom dimensions demonstrated significant factor loadings (at p < .05, with standardized loadings ranging from .24 (phobias) to .77 (GAD). However, this model provided a very poor fit to the data (Table 2).
Table 2.
Chi-square | df | CFI | RMSEA | BIC | |
---|---|---|---|---|---|
1. One-Factor Model | 427.909 | 26 | 0.578 | 0.168 | 5623.856 |
2. Two-Factor Model | 237.612 | 26 | 0.777 | 0.122 | 5409.646 |
3. Bi-Factor Model | 88.688 | 19 | 0.927 | 0.081 | 5255.735 |
Two-factor Model
The two-factor model specified that depression, GAD, and separation anxiety, panic, and phobic disorder scores loaded on an internalizing factor, and inattention, hyperactivity, impulsivity, and oppositional-defiant disorder scores loaded on an externalizing factor. Factor loadings for all disorders on their respective factors were significant (p < .01). Standardized factor loadings ranged from .29 (phobias) to .90 (depression) for the internalizing factor and from .51 (ODD) to .73 (hyperactivity) for the externalizing factor. The correlation between the internalizing and externalizing factors was moderate (r = .41, p < .001). Model fit was poor (Table 2), but better than for the one-factor model.
Bifactor Model
In this model, depression, GAD, separation anxiety, panic, inattention, hyperactivity, impulsivity, and ODD scores were indicators of the age 6 general factor; depression, GAD, separation anxiety, panic, and phobia scores were indicators of the age 6 internalizing factor; and inattention, hyperactivity, impulsivity, and ODD scores were indicators of the age 6 externalizing factor. Consistent with the age 3 model (Olino et al., 2014), phobic symptoms did not load on the general factor at age 6 in preliminary analyses. Thus, we removed this loading in all models. Consistent with the conventional application of bifactor models, all latent factors were specified to be orthogonal. This model provided a good fit to the data (Table 2). Beyond global model fit, all indicators had significant factor loadings on the general factor, except for panic symptoms (Table 3, left panel). All internalizing indicators had significant factor loadings on the internalizing factor and all externalizing indicators had significant factor loadings on the externalizing factor. The bifactor model had the best fit of the age 6 models.
Table 3.
Age 6 | Age 3 | Age 6 | |||||||
---|---|---|---|---|---|---|---|---|---|
Common | Int | Ext | Common | Int | Ext | Common | Int | Ext | |
DEP | 0.60*** | 0.54*** | 0.62*** | 0.22*** | 0.64*** | 0.47*** | |||
GAD | 0.77*** | 0.31** | 0.86*** | 0.30*** | 0.77*** | 0.30** | |||
SEP | 0.18+ | 0.35* | 0.22*** | 0.27*** | 0.19* | 0.37** | |||
PANIC | −0.13 | 0.75*** | 0.13 | 0.38* | −0.01 | 0.59** | |||
PHOB | 0.51*** | 0.68*** | 0.67*** | ||||||
INAT | 0.55*** | 0.38*** | 0.46*** | 0.56*** | 0.53*** | 0.40*** | |||
HYP | 0.34*** | 0.67*** | 0.37*** | 0.73*** | 0.33*** | 0.73*** | |||
IMP | 0.24*** | 0.64*** | 0.26*** | 0.61*** | 0.26*** | 0.56*** | |||
ODD | 0.38*** | 0.35*** | 0.37*** | 0.39*** | 0.37*** | 0.31*** |
p < .08
p < .05;
p < .001.
Common = General factor; Int = Internalizing Factor; Ext = Externalizing Factor; DEP = Depression Symptoms; GAD = Generalized Anxiety Disorder Symptoms; SEP = Separation Anxiety Disorder Symptoms; PANIC = Panic Disorder Symptoms; PHOB = Social and Specific Phobia Total Symptoms; INAT = Inattention Symptoms; HYP = Hyperactivity Symptoms; IMP = Impulsivity Symptoms. Empty cells indicate paths that were not included in the model (i.e., fixed at 0 a priori). As the longitudinal homotypic model includes age 3 factors and indicators in the model, parameter estimates change.
Longitudinal Model
We then added the final age 3 model from Olino et al. (2014) with the exception that we made the internalizing and externalizing specific factors orthogonal at age 3 like the age 6 model and included covariance paths between the general, internalizing, and externalizing factors across time. The model was an adequate fit to the data as indicated by the RMSEA = .076, but inadequate according to other indices, χ2 (109) = 455.56, p < .001 and CFI = .856. All indicators had significant factor loadings on the expected factors at both age 3 and age 6, except for panic symptoms on the common factor at each time point. Modification indices suggested the model would be improved by adding residual correlations across time for separation anxiety, inattention, and ODD symptoms. After including these three additional parameters to the model, the model was a good fit to the data, χ2 (106) = 327.62, p < .001; CFI = .91; and RMSEA = .062. All indicators had significant factor loadings on the expected factors at both age 3 and age 6 (all ps < .05; factor loadings shown in Table 3, right panel), with the exception that panic failed to significantly load on the general factor at age 3 and age 6 (both ps > .10). Longitudinal correlations for the general, internalizing, and externalizing factors were all significant (rs = .54, .84, and .50, respectively, all ps < .001). The only significant heterotypic correlation was found between the common factor at age 3 and the externalizing factor at age 6 (r = .16, p < .05). The structural parameters of the model (e.g., factor loadings and covariance paths) remained virtually unchanged (ICC = .99 for agreement of parameters across models) with and without the post-hoc covariance parameters included. This suggest that these additional post-hoc paths are not substantively influencing our interpretation of the major structural elements of the model.
Longitudinal Model Incorporating Heterotypic Paths
Following the methods from Koch et al. (n press), we estimated individual models for prediction of the age 6 general factor and the age 6 specific factors from the age 3 general and specific factors. This method is necessary to preserve the othogonality of the dependent latent variables. Overall, these models were a good fit to the data (χ2 (106) = 341.07, p < .001; CFI = .90; and RMSEA = .064 for the model predicting the age 6 common factor and χ2 (106) = 323.18, p < .001; CFI = .90; and RMSEA = .061 for the model predicting the age 6 specific factors). In these models, we found significant homotypic continuity for all three latent factors and heterotypic continuity between the general factor at age 3 and the specific factors at age 6. The age 3 general factor was positively associated with age 6 externalizing problems. A schematic presentation of the major longitudinal associations is presented in Figure 1.
Moderators of Homotypic and Heterotypic Continuity
Finally, we examined whether child sex or temperament, maternal reports of parenting, or parental history of psychopathology moderated homotypic and heterotypic continuity paths. Consistent with the previous models, we estimated interaction influences for the common and specific factors in separate models. Across all models, a total of 108 interaction effects were estimated. Only two reached conventional levels of significance. As these did not exceed the number of interactions expected due to chance, we do not pursue them further. Full results are in the online supplement.
Discussion
Studies of the structure of psychopathology have provided important information about the nature of comorbidity. Higher order and bifactor models have both consistently explained covariation in psychopathological symptoms across development. However, only a small number of studies (Greene & Eaton, 2017; Krueger et al., 1998; Murray et al., 2016; Snyder et al., 2017) have examined consistency in structural models over time. Further, no previous work has examined whether the stability of latent factors are moderated by established risk factors for psychopathology, beyond sex and age. In addition, multiple investigations of the structure of psychopathology have examined late childhood, adolescence, and adulthood; however, there are few investigations of the structure of psychopathology in preschool-aged children. Given that rates of DSM-IV disorders in young children are relatively low (e.g., Bufferd et al., 2011; Bufferd et al., 2012), examination of the structure of symptoms can help to clarify the nature of these difficulties during this important and understudied developmental period. Here, we examined the stability of a bifactor model of psychopathology in early childhood, and tested whether child sex, temperament, parental psychopathology, and maternal parenting behaviors moderated homotypic and heterotypic paths. Overall, we found evidence for the stability of the latent factors, but no moderators of stability.
The same bifactor structure of psychopathology symptoms identified at age three (Olino et al., 2014) was also a good fit to the data for the same children at age six. Thus, a similar structure across longitudinal assessments supports the validity of the model. However, our measurement invariance analyses (presented in the online supplementary material) showed that the magnitude of factor loadings changed across this developmental window. The interpretation of the factors is not isomorphic across time and our interpretations are not about pure stability of the same latent constructs, but longitudinal associations between constructs with the same manifest indicators. In addition, our general factor has strong loadings to distress (i.e., MDD and GAD) indicators and our internalizing factor has stronger loadings to fear (i.e., phobia, panic). Thus, the interpretation of these factors may be different from some other studies.
The general, internalizing, and externalizing latent factors all had strong stability across the three-year interval, with standardized regression coefficients reflecting moderate-large effects. In their examination of the stability of the internalizing-externalizing factor model, Krueger et al. (1998) found homotypic continuity for both internalizing and externalizing factors from age 18 to 21 in the Dunedin cohort with effect magnitudes in the same range. Krueger et al. (1998) found that the correlation between internalizing and externalizing was similar across assessment waves, providing indirect evidence that the common variance between these factors was consistent over time. Snyder et al. (in press) and Greene and Eaton (2017) found moderate-strong stability of each latent dimension. Murray et al. (2016) failed to find stability of the general factor across ages 7–15. However, these studies relied on analytic methods that could have introduced bias into the stability of the latent factors. Our results provide stronger tests of longitudinal associations finding moderate stability for the common and externalizing factor and strong stability for the internalizing factor. As described below, we found little evidence for specific constructs that differentially influence the stability of these domains.
We further examined heterotypic continuity of the latent dimensions of psychopathology. In our models, we found that the general factor at age three was positively associated with the externalizing factor at age six. This pathway suggests that the common psychopathology dimension in the preschool period differentiates into more specific externalizing later in development. Given this findings, it is crucial to identify factors that lead to these differentiated responses. For example, Kessel et al. (2016) found that for youth with heightened responses to errors, early irritability predicted later internalizing problems, whereas for youth with attenuated responses to errors, early irritability predicted later externalizing problems. Previous studies (e.g., Snyder et al., in press; Greene & Eaton, 2017) failed to identify heterotypic associations in their models, but did so in models that were ill-specified. Thus, our contrasting findings could be due to differences in model estimation, or to developmental differences in the samples.
Our finding of moderate-strong homotypic continuity from an early age is encouraging regarding the likely success of early screening and prevention/early interventions, as it encourages downward extension of existing assessment approaches and treatments. In addition, preschool psychopathology is often regarded as reflecting developmental normative behaviors (Wakschlag & Danis, 2004) or transient responses to the immediate environment (Bufferd, Dougherty, & Olino, in press). These findings are consistent with evidence that preschool psychopathology is often persistent, highlighting the importance of early detection and intervention.
We examined multiple child and parent factors that could influence the stability of longitudinal relationships between latent dimensions of psychopathology. However, given the many tests conducted, the number of significant findings did not exceed chance. The high degree of stability in our study may have limited our ability to identify moderators of internalizing stability, as there was modest variability to predict. Future studies could examine other potential moderators, such as genetic profile scores (Nikolova, Ferrell, Manuck, & Hariri, 2011) and stressful life events (Vrshek-Schallhorn et al., 2013). In addition, our sample was not very diverse in terms of race/ethnicity and socioeconomic status, so these findings might differ in samples with greater demographic heterogeneity. It is critical to identify substantive moderators of the stability of latent psychopathology dimensions as this sample progresses into older developmental periods as these data may yield important insights for intervention.
Although bifactor models are gaining popularity in investigations of psychopathology structure, there are limitations on estimation (e.g., restricting the covariance between the common and specific factors to zero) that may be too restrictive in accurately describing the data (Bonifay, Lane, & Reise, in press; Reise, 2012; Widiger & Oltmanns, in press). Furthermore, there are concerns about the interpretation of the general factor. For example, bifactor models may represent a methodological artifact. In previous studies of bifactor modeling, participants were interviewed directly (Caspi et al., 2014; Greene & Eaton, 2017; Kim & Eaton, 2015; Lahey et al., 2012) or completed self-report measures of symptoms (Murray et al., 2016). Both of these contexts require self-appraisals of the presence of psychopathology. In contrast, our study relied on parent reports of their children’s psychopathology. Importantly, our results support a similar model. Thus, we cannot rule out the possibility that parents may be relying on stable perceptions of their children, rather than providing veridical reports of the children’s behavior, which could overestimate the stability of psychopathology. However, other studies (e.g., Hankin et al., 2017; Snyder et al., in press) have replied on a combination of child self-reports and parent-reports of psychopathology. Thus, this is evidence against the bifactor model solutions being driven solely by monomethod artifacts. Finally, recent genetics work finds heritability for the general factor (Waldman, Poore, van Hulle, Rathouz, & Lahey, 2016) and associations between several single nucleotide polymorphisms and the general factor (Neumann, et al., 2016), which provides additional construct validity of the general psychopathology factor.
Some investigators have speculated that neuroticism is a large component of the general factor (Lahey, 2009; Lahey, Krueger, Rathouz, Waldman, & Zald, in press) and meta-analytic evidence is consistent with this interpretation (Kotov, Gamez, Schmidt, & Watson, 2010). Thus, examinations of the development of neuroticism, more generally, may provide valuable insights for understanding the development of the general psychopathology factor (e.g., Ebstein, 2006; Viken, Rose, Kaprio, & Koskenvuo, 1994). However, some studies (e.g., Griffith et al., 2010) find near perfect associations between neuroticism and internalizing, raising questions about the role of neuroticism in the general or internalizing dimension. Furthermore, consistent with the Hierarchical Taxonomy of Psychopathology (Kotov et al., 2017), the presence of a general psychopathology factor indicates the need for greater attention to transdiagnostic screening, interventions, and etiological factors. Screening may benefit from focusing on general psychopathology for identifying those in need of clinical attention. Transdiagnostic interventions have demonstrated promise for addressing a broad array of symptomatology (Farchione et al., 2012). Research on etiology may find stronger effects on the general factor than solely focusing on specific factors. However, this is speculative as further work is needed in this area.
This study benefited from longitudinal assessments of psychopathology in a large sample of youth using a semi-structured diagnostic interview and sophisticated modeling methods. However, the study should be evaluated in light of several limitations. First, levels of symptoms were modest in this unselected community sample. Thus, tests of these models in samples with higher levels of psychopathology are needed. Second, we relied on DSM disorder symptom counts. It is possible that other indicators may better discern true latent dimensions. Third, some disorders (e.g., social phobia) had few indicators; therefore, we collapsed multiple phobias into a single dimension. Fourth, our models included several cross-time residual correlations to achieve a good model fit. Thus, this specific structure may fail to replicate in different samples. However, analyses were repeated without these residual correlations and the quantitative and substantive results were virtually identical. This indicates that these residual correlations did not bias the conclusions. Moreover, as noted elsewhere, (Marsh et al., 2004), there has been growing concern that fit criteria have been overly stringent and lead to rejecting well-fitting and theoretically sound models. This has been particularly concerning for models in the area of personality and psychopathology. Finally, our sample was representative of the geographical region from which it came. However, this region is predominantly Caucasian and middle/working class. Inasmuch as these demographic factors influence levels of symptoms and/or our moderators, our results may not generalize to other samples.
In sum, the present study revealed a similar structure of psychopathology in youth assessed twice during early childhood. We observed moderate-high homotypic continuity of the general, internalizing, and externalizing dimensions of psychopathology and found that the general factor was positively associated with externalizing problems and negatively associated with internalizing problems later in development.
Supplementary Material
Acknowledgments
This work was supported by NIMH grants RO1 MH069942 (Klein), F31 MH084444 (Bufferd) and R01 MH107495 (Olino).
Contributor Information
Thomas M. Olino, Temple University
Sara J. Bufferd, California State University San Marcos
Lea R. Dougherty, University of Maryland College Park
Margaret W. Dyson, University of California San Diego School of Medicine
Gabrielle A. Carlson, Stony Brook University School of Medicine
Daniel N. Klein, Stony Brook University
References
- Achenbach TM, Rescorla LA. Manual for the ASEBA Preschool Forms & Profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families; 2000. [Google Scholar]
- Angold A, Costello EJ, Erkanli A. Comorbidity. Journal of Child Psychology and Psychiatry and Allied Disciplines. 1999;40(1):57–87. [PubMed] [Google Scholar]
- Anticich SA, Barrett PM, Silverman W, Lacherez P, Gillies R. The prevention of childhood anxiety and promotion of resilience among preschool-aged children: A universal school based trial. Advances in School Mental Health Promotion. 2013;6(2):93–121. [Google Scholar]
- Asparouhov T, Muthén B. Multiple imputation with Mplus. MPlus Web Notes 2010 [Google Scholar]
- Bonifay W, Lane SP, Reise SP. Three Concerns With Applying a Bifactor Model as a Structure of Psychopathology. Clinical Psychological Science. 5(1):184–186. doi: 10.1177/2167702616657069. in press. [DOI] [Google Scholar]
- Bufferd SJ, Dougherty LR, Carlson GA, Klein DN. Parent-reported mental health in preschoolers: Findings using a diagnostic interview. Comprehensive Psychiatry. 2011;52(4):359–369. doi: 10.1016/j.comppsych.2010.08.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bufferd SJ, Dougherty LR, Carlson GA, Rose S, Klein DN. Psychiatric disorders in preschoolers: continuity from ages 3 to 6. American Journal of Psychiatry. 2012;169(11):1157–1164. doi: 10.1176/appi.ajp.2012.12020268. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bufferd SJ, Dougherty LR, Olino TM. Mapping the Frequency and Severity of Depressive Behaviors in Preschool-Aged Children. Child Psychiatry & Human Development. doi: 10.1007/s10578-017-0715-2. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bufferd SJ, Dougherty LR, Olino TM, Dyson MW, Carlson GA, Klein DN. Temperament distinguishes persistent/recurrent from remitting anxiety disorders across early childhood. Journal of Clinical Child and Adolescent Psychology. doi: 10.1080/15374416.2016.1212362. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Caspi A, Houts RM, Belsky DW, Goldman-Mellor SJ, Harrington H, Israel S, … Poulton R. The p factor one general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science. 2014;2(2):119–137. doi: 10.1177/2167702613497473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Caspi A, Moffitt TE, Newman DL, Silva PA. Behavioral observations at age 3 years predict adult psychiatric disorders: Longitudinal evidence from a birth cohort. Archives of General Psychiatry. 1996;53(11):1033–1039. doi: 10.1001/archpsyc.1996.01830110071009. [DOI] [PubMed] [Google Scholar]
- Chassin L, Flora DB, King KM. Trajectories of alcohol and drug use and dependence from adolescence to adulthood: the effects of familial alcoholism and personality. Journal of Abnormal Psychology. 2004;113(4):483–498. doi: 10.1037/0021-843x.113.4.483. [DOI] [PubMed] [Google Scholar]
- Chronis-Tuscano A, Rubin KH, O’Brien KA, Coplan RJ, Thomas SR, Dougherty LR, … Huggins SL. Preliminary evaluation of a multimodal early intervention program for behaviorally inhibited preschoolers. Journal of Consulting and Clinical Psychology. 2015;83(3):534–540. doi: 10.1037/a0039043. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dougherty LR, Bufferd SJ, Carlson GA, Dyson M, Olino TM, Durbin CE, Klein DN. Preschoolers' observed temperament and psychiatric disorders assessed with a parent diagnostic interview. Journal of Clinical Child and Adolescent Psychology. 2011;40(2):295–306. doi: 10.1080/15374416.2011.546046. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dougherty LR, Klein DN, Durbin CE, Hayden EP, Olino TM. Temperamental positive and negative emotionality and children’s depressive symptoms: A longitudinal prospective study from age three to age ten. Journal of Social and Clinical Psychology. 2010;29(4):462–488. doi: 10.1521/jscp.2010.29.4.462. [DOI] [Google Scholar]
- Dunn LM, Dunn LM. Peabody picture vocabulary Test. 3. Circle Pines, Minnesota: American Guidance Service; 1997. [Google Scholar]
- Ebstein R. The molecular genetic architecture of human personality: beyond self-report questionnaires. Molecular Psychiatry. 2006;11(5):427–445. doi: 10.1038/sj.mp.4001814. [DOI] [PubMed] [Google Scholar]
- Egger HL, Angold A. Common emotional and behavioral disorders in preschool children: presentation, nosology, and epidemiology. Journal of Child Psychology and Psychiatry. 2006;47(3–4):313–337. doi: 10.1111/j.1469-7610.2006.01618.x. [DOI] [PubMed] [Google Scholar]
- Egger HL, Ascher BH, Angold A. The Preschool Age Psychiatric Assessment: Version 1.1. Duke University Medical Center; Durham, NC: 1999. [Google Scholar]
- Essau CA, Lewinsohn PM, Seeley JR, Sasagawa S. Gender differences in the developmental course of depression. Journal of Affective Disorders. 2010;127(1):185–190. doi: 10.1016/j.jad.2010.05.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Farchione TJ, Fairholme CP, Ellard KK, Boisseau CL, Thompson-Hollands J, Carl JR, … Barlow DH. Unified protocol for transdiagnostic treatment of emotional disorders: a randomized controlled trial. Behavior Therapy. 2012;43(3):666–678. doi: 10.1016/j.beth.2012.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- First MB, Spitzer RL, Gibbon M, Williams JBW. The Structured Clinical Interview for DSM-IV Axis I Disorders – Non-patient edition. New York: Biometrics Research Department, New York State Psychiatric Institute; 1996. [Google Scholar]
- Goldsmith HH, Reilly J, Lemery KS, Longley S, Prescott A. Laboratory Temperament Assessment Battery: Preschool Version. University of Wisconsin; 1995. Unpublished Manuscript. [Google Scholar]
- Greene AL, Eaton NR. The temporal stability of the bifactor model of comorbidity: An examination of moderated continuity pathways. Comprehensive Psychiatry. 2017;72:74–82. doi: 10.1016/j.comppsych.2016.09.010. [DOI] [PubMed] [Google Scholar]
- Griffith JW, Zinbarg RE, Craske MG, Mineka S, Rose RD, Waters AM, Sutton JM. Neuroticism as a common dimension in the internalizing disorders. Psychological Medicine. 2010;40(7):1125–1136. doi: 10.1017/S0033291709991449. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hankin BL, Abramson LY, Moffitt TE, Silva PA, McGee R, Angell KE. Development of depression from preadolescence to young adulthood: Emerging gender differences in a 10-year longitudinal study. Journal of Abnormal Psychology. 1998;107(1):128–140. doi: 10.1037//0021-843x.107.1.128. [DOI] [PubMed] [Google Scholar]
- Hankin BL, Davis EP, Snyder H, Young JF, Glynn LM, Sandman CA. Temperament factors and dimensional, latent bifactor models of child psychopathology: Transdiagnostic and specific associations in two youth samples. Psychiatry Research. 2017;252:139–146. doi: 10.1016/j.psychres.2017.02.061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hicks BM, Blonigen DM, Kramer MD, Krueger RF, Patrick CJ, Iacono WG, McGue M. Gender differences and developmental change in externalizing disorders from late adolescence to early adulthood: A longitudinal twin study. Journal of Abnormal Psychology. 2007;116(3):433–447. doi: 10.1037/0021-843X.116.3.433. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hicks BM, Krueger RF, lacono WG, McGue M, Patrick CJ. Family transmission and heritability of externalizing disorders: A twin-family study. Archives of General Psychiatry. 2004;61(9):922–928. doi: 10.1001/archpsyc.61.9.922. [DOI] [PubMed] [Google Scholar]
- Hopwood CJ, Donnellan MB. How should the internal structure of personality inventories be evaluated? Personality and Social Psychology Review. 2010;14(3):332–346. doi: 10.1177/1088868310361240. [DOI] [PubMed] [Google Scholar]
- Kessel EM, Meyer A, Hajcak G, Dougherty LR, Torpey-Newman DC, Carlson GA, Klein DN. Transdiagnostic factors and pathways to multifinality: The error-related negativity predicts whether preschool irritability is associated with internalizing versus externalizing symptoms at age 9. Development and Psychopathology. 2016;28(4pt1):913–926. doi: 10.1017/S0954579416000626. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim H, Eaton NR. The hierarchical structure of common mental disorders: Connecting multiple levels of comorbidity, bifactor models, and predictive validity. Journal of Abnormal Psychology. 2015;124(4):1064. doi: 10.1037/abn0000113. [DOI] [PubMed] [Google Scholar]
- Klein DN, Lewinsohn PM, Rohde P, Seeley JR, Olino TM. Psychopathology in the adolescent and young adult offspring of a community sample of mothers and fathers with major depression. Psychological Medicine. 2005;35(03):353–365. doi: 10.1017/s0033291704003587. [DOI] [PubMed] [Google Scholar]
- Koch T, Holtmann J, Bohn J, Eid M. Explaining General and Specific Factors in Longitudinal, Multimethod, and Bifactor Models: Some Caveats and Recommendations. Psychological Methods. doi: 10.1037/met0000146. in press. [DOI] [PubMed] [Google Scholar]
- Kotov R, Gamez W, Schmidt F, Watson D. Linking “big” personality traits to anxiety, depressive, and substance use disorders: A meta-analysis. Psychological Bulletin. 2010;136(5):768–821. doi: 10.1037/a0020327. [DOI] [PubMed] [Google Scholar]
- Kotov R, Krueger RF, Watson D, Achenbach TM, Althoff RR, Bagby RM, … Clark LA. The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology. 2017;126(4):454–477. doi: 10.1037/abn0000258. [DOI] [PubMed] [Google Scholar]
- Krueger RF. The structure of common mental disorders. Archives of General Psychiatry. 1999;56(10):921–926. doi: 10.1001/archpsyc.56.10.921. [DOI] [PubMed] [Google Scholar]
- Krueger RF, Caspi A, Moffitt TE, Silva PA. The structure and stability of common mental disorders (DSM-III-R): A longitudinal-epidemiological study. Journal of Abnormal Psychology. 1998;107(2):216–227. doi: 10.1037//0021-843x.107.2.216. [DOI] [PubMed] [Google Scholar]
- Krueger RF, Markon KE. Reinterpreting comorbidity: A model-based Approach to Understanding and Classifying Psychopathology. Annual review of clinical psychology. 2006;2:111–133. doi: 10.1146/annurev.clinpsy.2.022305.095213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lahey BB. Public health significance of neuroticism. American Psychologist. 2009;64(4):241–256. doi: 10.1037/a0015309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lahey BB, Applegate B, Hakes JK, Zald DH, Hariri AR, Rathouz PJ. Is There a General Factor of Prevalent Psychopathology During Adulthood? Journal of Abnormal Psychology. 2012;121(4):971–977. doi: 10.1037/a0028355. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lahey BB, Krueger RF, Rathouz PJ, Waldman ID, Zald DH. A Hierarchical Causal Taxonomy of Psychopathology Across the Life Span. Psychological Bulletin. 143(2):142–186. doi: 10.1037/bul0000069. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lahey BB, Rathouz PJ, Keenan K, Stepp SD, Loeber R, Hipwell AE. Criterion validity of the general factor of psychopathology in a prospective study of girls. Journal of Child Psychology and Psychiatry. 2015;56(4):415–422. doi: 10.1111/jcpp.12300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lahey BB, Rathouz PJ, Van Hulle C, Urbano RC, Krueger RF, Applegate B, … Waldman ID. Testing structural models of DSM-IV symptoms of common forms of child and adolescent psychopathology. Journal of Abnormal Child Psychology. 2008;36(2):187–206. doi: 10.1007/s10802-007-9169-5. [DOI] [PubMed] [Google Scholar]
- Lahey BB, Van Hulle CA, Singh AL, Waldman ID, Rathouz PJ. Higher-order genetic and environmental structure of prevalent forms of child and adolescent psychopathology. Archives of General Psychiatry. 2011;68(2):181–189. doi: 10.1001/archgenpsychiatry.2010.192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Luby JL, Si X, Belden AC, Tandon M, Spitznagel E. Preschool depression: Homotypic continuity and course over 24 months. Archives of General Psychiatry. 2009;66(8):897–905. doi: 10.1001/archgenpsychiatry.2009.97. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyneham HJ, Rapee RM. Agreement between telephone and in-person delivery of a structured interview for anxiety disorders in children. Journal of the American Academy of Child & Adolescent Psychiatry. 2005;44(3):274–282. doi: 10.1097/00004583-200503000-00012. [DOI] [PubMed] [Google Scholar]
- Marsh HW, Hau KT, Wen Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling. 2004;11(3):320–341. doi: 10.1207/s15328007sem1103_2. [DOI] [Google Scholar]
- McLeod BD, Weisz JR, Wood JJ. Examining the association between parenting and childhood depression: A meta-analysis. Clinical Psychology Review. 2007;27(8):986–1003. doi: 10.1016/j.cpr.2007.03.001. [DOI] [PubMed] [Google Scholar]
- Murray AL, Eisner M, Ribeaud D. The Development of the General Factor of Psychopathology ‘p Factor’Through Childhood and Adolescence. Journal of Abnormal Child Psychology. 2016;44(8):1–14. doi: 10.1007/s10802-016-0132-1. [DOI] [PubMed] [Google Scholar]
- Muthén LK, Muthén BO. Mplus User’s Guide. 8. Los Angeles, CA: Muthén & Muthén; 1998–2017. [Google Scholar]
- Nagin DS, Tremblay RE. Parental and early childhood predictors of persistent physical aggression in boys from kindergarten to high school. Archives of General Psychiatry. 2001;58(4):389–394. doi: 10.1001/archpsyc.58.4.389. [DOI] [PubMed] [Google Scholar]
- Nanni V, Uher R, Danese A. Childhood maltreatment predicts unfavorable course of illness and treatment outcome in depression: a meta-analysis. American Journal of Psychiatry. 2012;169(2):141–151. doi: 10.1176/appi.ajp.2011.11020335. [DOI] [PubMed] [Google Scholar]
- Negriff S, Susman EJ. Pubertal timing, depression, and externalizing problems: A framework, review, and examination of gender differences. Journal of Research on Adolescence. 2011;21(3):717–746. doi: 10.1111/j.1532-7795.2010.00708.x. [DOI] [Google Scholar]
- Nikolova YS, Ferrell RE, Manuck SB, Hariri AR. Multilocus genetic profile for dopamine signaling predicts ventral striatum reactivity. Neuropsychopharmacology. 2011;36(9):1940–1947. doi: 10.1038/npp.2011.82. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olino TM, Dougherty LR, Bufferd SJ, Carlson GA, Klein DN. Testing models of psychopathology in preschool-aged children using a structured interview-based assessment. Journal of Abnormal Child Psychology. 2014;42(7):1201–1211. doi: 10.1007/s10802-014-9865-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olino TM, Klein DN, Dyson MW, Rose SA, Durbin CE. Temperamental emotionality in preschool-aged children and depressive disorders in parents: Associations in a large community sample. Journal of Abnormal Psychology. 2010;119(3):468–478. doi: 10.1037/a0020112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pettersson E, Larsson H, Lichtenstein P. Common psychiatric disorders share the same genetic origin: a multivariate sibling study of the Swedish population. Molecular Psychiatry. 2016;21(5):717–721. doi: 10.1038/mp.2015.116. [DOI] [PubMed] [Google Scholar]
- Raghunathan TE, Lepkowski JM, Van Hoewyk J, Solenberger P. A multivariate technique for multiply imputing missing values using a sequence of regression models. Survey Methodology. 2001;27(1):85–96. [Google Scholar]
- Reise SP. The rediscovery of bifactor measurement models. Multivariate Behavioral Research. 2012;47(5):667–696. doi: 10.1080/00273171.2012.715555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Robinson CC, Mandleco B, Olsen SF, Hart CH. Authoritative, authoritarian, and permissive parenting practices: Development of a new measure. Psychological Reports. 1995;77(3):819–830. doi: 10.2466/pr0.1995.77.3.819. [DOI] [Google Scholar]
- Rothbart MK, Ahadi SA, Hershey KL, Fisher P. Investigations of temperament at three to seven years: The Children's Behavior Questionnaire. Child Development. 2001;72(5):1394–1408. doi: 10.1111/1467-8624.00355. [DOI] [PubMed] [Google Scholar]
- Silk JS, Ziegler ML, Whalen DJ, Dahl RE, Ryan ND, Dietz LJ, … Williamson DE. Expressed emotion in mothers of currently depressed, remitted, high-risk, and low-risk youth: Links to child depression status and longitudinal course. Journal of Clinical Child and Adolescent Psychology. 2009;38(1):36–47. doi: 10.1080/15374410802575339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Slade T, Watson D. The structure of common DSM-IV and ICD-10 mental disorders in the Australian general population. Psychological Medicine. 2006;36(11):1593–1600. doi: 10.1017/S0033291706008452. [DOI] [PubMed] [Google Scholar]
- Snyder HR, Young JF, Hankin BL. Strong Homotypic Continuity in Common Psychopathology-, Internalizing-, and Externalizing-Specific Factors Over Time in Adolescents. Clinical Psychological Science. 2017;5(1):98–110. doi: 10.1177/2167702616651076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stochl J, Khandaker G, Lewis G, Perez J, Goodyer I, Zammit S, … Jones P. Mood, anxiety and psychotic phenomena measure a common psychopathological factor. Psychological Medicine. 2015;45(07):1483–1493. doi: 10.1017/S003329171400261X. [DOI] [PubMed] [Google Scholar]
- Viken RJ, Rose RJ, Kaprio J, Koskenvuo M. A developmental genetic analysis of adult personality: extraversion and neuroticism from 18 to 59 years of age. Journal of Personality and Social Psychology. 1994;66(4):722. doi: 10.1037//0022-3514.66.4.722. [DOI] [PubMed] [Google Scholar]
- Vollebergh WAM, Iedema J, Bijl RV, de Graaf R, Smit F, Ormel J. The structure and stability of common mental disorders: the NEMESIS study. Archives of General Psychiatry. 2001;58(6):597–603. doi: 10.1001/archpsyc.58.6.597. [DOI] [PubMed] [Google Scholar]
- Vrshek-Schallhorn S, Mineka S, Zinbarg RE, Craske MG, Griffith JW, Sutton J, … Adam EK. Refining the Candidate Environment Interpersonal Stress, the Serotonin Transporter Polymorphism, and Gene-Environment Interactions in Major Depression. Clinical Psychological Science. 2013;2(3):235–248. doi: 10.1177/2167702613499329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wakschlag L, Danis B. Assessment of disruptive behavior in young children: A clinical-developmental framework. In: DelCarmen-Wiggins R, Carter A, editors. Handbook of infant, toddler and preschool mental health assessment. New York, NY: Oxford University Press; 2004. pp. 421–440. [Google Scholar]
- Weissman MM, Wickramaratne P, Gameroff MJ, Warner V, Pilowsky D, Kohad RG, … Talati A. Offspring of Depressed Parents: 30 Years Later. American Journal of Psychiatry. 2016;173(10):1024–1032. doi: 10.1176/appi.ajp.2016.15101327. [DOI] [PubMed] [Google Scholar]
- Weissman MM, Wolk S, Wickramaratne P, Goldstein RB, Adams P, Greenwald S, … Steinberg D. Children with prepubertal-onset major depressive disorder and anxiety grown up. Archives of General Psychiatry. 1999;56(9):794–801. doi: 10.1001/archpsyc.56.9.794. [DOI] [PubMed] [Google Scholar]
- Widaman KF, Ferrer E, Conger RD. Factorial invariance within longitudinal structural equation models: Measuring the same construct across time. Child Development Perspectives. 2010;4(1):10–18. doi: 10.1111/j.1750-8606.2009.00110.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Widiger TA, Oltmanns JR. The General Factor of Psychopathology and Personality. Clinical Psychological Science. 5(1):182–183. doi: 10.1177/2167702616657042. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.