Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2015 Oct 1.
Published in final edited form as: Twin Res Hum Genet. 2015 Mar 2;18(2):171–178. doi: 10.1017/thg.2014.88

Shared genetic and environmental influences on early temperament and preschool psychiatric disorders in Hispanic twins

Judy L Silberg 1,2, Nathan Gillespie 1,2,3, Ashlee A Moore 1,4, Lindon J Eaves 1,2, John Bates 5, Steven Aggen 1,2, Elizabeth Pfister 1, Glorisa Canino 6
PMCID: PMC4402136  NIHMSID: NIHMS674840  PMID: 25728588

Abstract

Objective

Despite an increasing recognition that psychiatric disorders can be diagnosed as early as preschool, little is known how early genetic and environmental risk factors contribute to the development of psychiatric disorders during this very early period of development.

Method

We assessed infant temperament at age 1, and attention deficit hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), and separation anxiety disorder (SAD) at ages 3 through 5 years in a sample of Hispanic twins. Genetic, shared, and non-shared environmental effects were estimated for each temperamental construct and psychiatric disorder using the statistical program MX. Multivariate genetic models were fitted to determine whether the same or different sets of genes and environments account for the co-occurrence between early temperament and preschool psychiatric disorders.

Results

Additive genetic factors accounted for 61% of the variance in ADHD, 21% in ODD, and 28% in SAD. Shared environmental factors accounted for 34% of the variance in ODD and 15% of SAD. The genetic influence on difficult temperament was significantly associated with preschool ADHD, SAD, and ODD. The association between ODD and SAD was due to both genetic and family environmental factors. The temperamental trait of resistance to control was entirely accounted for by the shared family environment.

Conclusions

There are different genetic and family environmental pathways between infant temperament and psychiatric diagnoses in this sample of Puerto Rican preschool age children.

Keywords: preschoolers, psychiatric disorders, temperament, twins


ADHD, many anxiety disorders, and persistent conduct problems are already well established by middle childhood. What is not clear is how early these problems begin.

Serious behavioral and emotional problems have been reported in children as young as preschool age (Lavigne et al., 2009; McDonnell & Glod, 2003; Zeanah, 2000). Because of the rapidity of developmental change and reorganization that takes place during their earliest years, many of the problems children manifest, such as aggression, non-compliance and anxiety, are often transitory in nature. Whether or not one uses psychopathological labels to describe problem behaviors in children less than three years of age, there is a growing consensus that a significant number of children exhibit persistent and severe behavioral problems (Keenan et al., 2007; Shaw et al., 2012).

Formal psychiatric diagnoses have also been reported in preschool age children. These diagnoses imply that the children’s symptoms are associated with notable impairment in meeting developmentally appropriate task demands. Using varying structured instruments for diagnosing psychiatric disorders, studies have shown significant rates and high degrees of comorbidity (Egger & Angold, 2006; Egger et al., 2006). Given the evident impact of preschool-age problems, it is important to understand how such problems arise.

Early infant temperament appears to be an important precursor of behavioral and emotional maladjustment in childhood. Early studies of reaction patterns in very young children (Thomas & Chess, 1977) suggest that ‘early-emerging’ temperamental traits are significant predictors of later behavioral and emotional disturbance (Bates et al., 2014; Caspi et al., 1996; Rothbart & Bates, 2006). In general, studies relate the construct of difficult temperament (i.e., negative emotionality, fussiness, difficulty soothing) to a myriad of behavioral and emotional problems (Bates et al., 2014).

Numerous studies have shown that children who are highly reactive as infants and who have difficulty in emotional and behavioral self-regulation are at risk for conduct problems, and in particular, severe and persistent conduct disturbances beginning in early childhood (DePauw & Mervielde, 2010; Saudino, 2005). Early unadaptability, inhibition, or withdrawal from novel stimuli, and in particular stable behavior inhibition, is specifically associated with internalizing problems (Bates et al., 2014; Kagan et al., 1999; Prior et al., 2000).

Although it has been recognized that early temperamental difficulties reflect a significant liability to early behavioral and emotional disturbance, the mechanisms are not yet well understood (Goldsmith et al., 2004). Using varying definitions and labeling of temperamental constructs, twin studies show a demonstrable influence of genetic factors on most infant temperament measures (Saudino, 2005), such as activity level, negative affect, effortful control (Gagne & Saudino, 2010), distress to novelty, stranger distress (Cherny et al., 1994), shyness (Robinson et al., 2004), anxiety (Cherny et al., 2001), and inhibitory control (Gagne & Saudino, 2010).

Twin studies also underscore the importance of genetic factors in many aspects of preschool behavior (Derks et al., 2004) and patterns of comorbidity (Mikolajewski et al., 2010). Heritable influences are reported for hyperactivity (Price et al., 2001) and nearly all forms of anxiety, particularly shyness/inhibition and obsessive-compulsive behaviors (Eley et al., 2003). Evidence for a shared environmental influence on disruptive behaviors has been reported, although the findings are mixed (Schmitz et al., 1994; van den Oord et al., 1996). However, there is strong and consistent evidence of genetic effects on early and pervasive antisocial behavior (Bates et al., 2014; Mikolajewski et al., 2010), comparable to that found in twin studies of older children (Eaves et al., 1997).

Given the pervasiveness of genetic effects on early infant temperament and its association with later behavioral and emotional problems, we propose that the same genes and/or environments underlying early temperament also contribute to the development of psychiatric disorders in early childhood.

The key goal of the present study is to understand the etiological mechanisms underlying early temperament and psychiatric disorders occurring in the preschool period. With longitudinal data collected on infant twins in Puerto Rico, we seek to: (1) address the extent to which genetic, shared (family) environmental and non-shared environmental factors contribute to individual differences in preschool psychiatric disorders; and (2) estimate the influence of genetic and environmental factors in the co- occurrence of infant temperament and psychopathology. Our study is unique with its focus on a minority population of young twins and rigorous prospective assessments of psychiatric disorders to study the etiological links between difficult and inhibited temperament and preschool ADHD, SAD, and ODD.

Materials and Methods

Sample

The Puerto Rican Infant Twin Study (PRINTS; Silberg et al., 2005) comprised two waves; the first was completed from 2006 to 2007, and the second wave three years later from 2009–2010. All families with a multiple gestation pregnancy in Puerto Rico in 2006 were considered eligible. Contact information was obtained from the Puerto Rico Neonatal Twin Registry, established with the assistance of the Puerto Rico Department of Health. Of the 399 families that were eligible, 339 (85%), each with a set of twins, agreed to participate. Parents were contacted when the twins were an average of 1 year of age to assess infant temperament and basic demographics. When the children were 3-years old, 312 (92%) of the original 339 families completed the preschool psychiatric assessment using DISC-YC (Lucas et al., 2000). The study had IRB approval from both the University of Puerto Rico and Virginia Commonwealth University.

Measures and Procedures

In the first wave of the study, mothers were interviewed to assess child temperament using a Spanish translation of the Infant Characteristics Questionnaire (ICQ; Bates et al., 1979). The ICQ has good validity and test–retest reliability and correlates well with observer ratings and other rating scales assessing distress to limitations (difficultness) and fear (unadaptability).

During the second wave of the study, mothers were administered the Young Diagnostic Interview Schedule for Preschool Children (DISC-YC). The DISC-YC was translated into Spanish for use among Spanish-speaking populations (Matias-Carrelo et al., 2003). The most common diagnostic categories of ADHD, ODD, and SAD were analyzed for the present study. DNA microsatellite profiling was used for determining the zygosity of the twins (Hannelius et al., 2007).

Data analysis

Factor analysis of the Infant Characteristics Questionnaire

A latent factor analysis was used to explore the dimensionality of the items of the ICQ using maximum likelihood. The continuous factor scores comprising the latent temperamental factors were then used in subsequent analyses.

Prevalence of Psychiatric Diagnoses

We derived the rates for the most prevalent psychiatric disorders of ADHD, ODD, and SAD using DSM-IV criteria. Each child was given a 0 or 1 depending upon the presence or absence of the diagnosis. For the more complicated multivariate analyses (described below) subscale scores of behaviors comprising each of the three diagnoses were used.

Product moment correlations were estimated using SAS for evaluating the degree of association between the indices of temperament and the subscale scores comprising ADHD, SAD, and ODD.

Univariate and Multivariate Analyses

Standard biometrical genetic model fitting methods were used (Neale & Cardon, 1992) to decompose the observed variation in temperament and DSM-IV diagnoses of ADHD, ODD, and SAD in terms of additive genetic (A), shared environmental (C) and non-shared or unique environmental (E) risks. Additive gene action (A) reflects the additive or average effect of individual alleles at genetic loci influencing a trait or behavior. Common environmental effects (C) describe influences that make family members more alike compared to random pairs of individuals. Non- shared or unique environmental risks (E) capture aspects of the environment that are unique to each individual and are therefore uncorrelated between twins. Since MZ twin pairs are genetically identical, the additive genetic correlation is fixed to 1.0. The additive genetic correlation for DZ twin pairs is fixed to 0.5 because on average DZ twin pairs share only half their genes in common. Non-shared environmental effects (E) are by definition uncorrelated and also include measurement error, including short-term fluctuations of the environment.

Ordinal Data Analysis

Because the psychiatric diagnoses were coded as present or absent (0 or 1), the data for model fitting was analyzed using the raw ordinal data option in the Mx software package (Neale et al., 2003). This approach assumes that the observed ordinal categories within each variable are an imprecise measure of an underlying latent normal liability distribution, and that this liability distribution has one or more threshold values that discriminate between the categories. Thresholds can be conceived of as cut points along a standard normal distribution, which classify individuals in terms of a probability or risk of endorsing one of two or more discrete (ordinal) categories.

Multivariate Genetic Analysis

With multivariate data, it is possible to make use of the information in the cross-twin cross-trait correlations to determine the degree of genetic and environmental overlap between early temperamental traits and the symptoms comprising DSM-IV diagnoses (Martin et al., 1978). The most commonly used multivariate method is the Cholesky decomposition (Neale & Cardon, 1992). The Cholesky is a method of triangular decomposition where the first variable (difficult temperament) is assumed to be caused by a latent factor (A1) that can explain the variance in the remaining variables (e.g., inhibition, unsociability, resistance to control, ODD, SAD, and ADHD). The second variable, behavioral inhibition, is assumed to be caused by a second latent factor (A2) that can explain variation in the second as well as remaining variables. This pattern continues until the final observed variable (SAD) is explained by a latent variable that is constrained from explaining the variance in any of the previous observed variables. A Cholesky decomposition is specified for each latent source of additive genetic (A), shared environmental (C), and individual specific environmental variance (E).

Individual parameters or ‘paths’ were dropped from the full model, beginning with the smallest parameters first. Initially, we sought a simplification of the shared environmental structure and then the additive genetic structure, with the goal of obtaining the most parsimonious account of the data with the least number of parameters. Each reduced model’s fit was evaluated using likelihood ratio χ2 tests, in which the difference between −2 log-likelihood of two alternative models is distributed as a χ2, with degrees of freedom (df) equal to the difference in the number of parameters estimated.

Results

Sample Characteristics

Baseline characteristics of the participating families showed that of the 339 fathers, 226 (77%) had at least a high school education, and 207 (71%) were working full time; their mean age was 29.8 years (SD 7 years). Of the 339 mothers, 277 (82%) had at least a high school education, and 118 (35%) were working either full or part time; their mean age was 26.8 years (SD 6 years). Most (84%) of the 339 parental couples lived together. The number of families living below the median household income in Puerto Rico was 63%. Of the 339 families, 51% were receiving public assistance such as food stamps, government benefits, subsidized housing, and/or energy assistance.

Data Analysis

We found that the overall rates of ADHD, ODD, and SAD, using the DISC-YC, are comparable to those reported in other Hispanic samples. Lavigne et al. (2009) reported a rate of 9.7% for ADHD compared to the PRINTS rate of 11.1% and 9.8% for ODD versus our rate of 10.8%. In the present sample, 7.9% met the criteria for SAD. There were no significant differences in the means or prevalence of the disorders between boys and girls.

The factor analysis of the 35 ICQ items showed that an oblique four-dimensional structure provided the most interpretable solution to the data with a Cronbach’s alpha of 0.83. This four-factor solution was the same reported by Bates et al. (1979) on a non-twin, Caucasian sample. Items such as frequent fussiness and irritability, difficulty in calming down, loud crying, needing to be held, and moodiness characterized the first dimension, difficultness. The correlated second factor, inhibition, was characterized by introverted responses such as the infant’s adaptation to new people and places. The third factor, sociability, included items such as how often infants smile and make happy noises. Persisting in playing/going someplace even when she/he is told not to, as well as sleep and eating irregularities, comprised the fourth factor, resistant to control.

Table 1 shows the Pearson correlations, twin correlations and genetic and environmental parameter estimates for the four temperament traits and the three psychiatric diagnoses. All the temperamental indices and psychiatric traits were highly intercorrelated. There was a significant correlation between unsociable and resistant temperament and later SAD and ODD. There was also a significant association between preschool SAD and ODD.

TABLE 1.

Phenotypic Correlations, Twin Pair correlations, and Standardized Proportions of Variance Explained by Additive Genetic (A), Shared Environmental (C), and Non-Shared Environmental (E) Risk Factors

Variables Pearson product moment correlations Twin pair correlations Univariate parameter estimates (95%)

1 2 3 4 5 6 MZ DZ A C E
Difficult 1 0.56 0.12 0.48 (0.20 – 0.64) 0.00 (0.00 – 0.18) 0.52 (0.36 – 0.71)
Inhibited 0.19 1 0.52 0.48 0.07 (0.00 – 0.50) 0.46 (0.12 – 0.60) 0.48 (0.32 – 0.62)
Unsocial 0.19 0.12 1 0.53 0.26 0.46 (0.21 – 0.62) 0.00 (0.00 – 0.42) 0.54 (0.51 – 0.65)
Resistant 0.37 0.23 0.44 1 0.68 0.59 0.00 (0.00 – 0.43) 0.61 (0.51 – 0.70) 0.39 (0.28 – 0.60)
ADHD 0.14 0.08 0.03 0.08 1 0.71 0.19 0.61 (0.00 – 0.92) 0.00 (0.00 – 0.69) 0.38 (0.38 – 0.95)
ODD 0.13 0.16 0.02 0.05 0.25 1 0.55 0.45 0.21 (0.00 – 0.65) 0.34 (0.00 – 0.58) 0.45 (0.30 – 0.62)
SAD 0.10 0.13 0.01 0.07 0.42 0.31 0.43 0.29 0.28 (0.00 – 0.62) 0.15 (0.00 – 0.44) 0.57 (0.38 – 0.79)

Note: ADHD = attention deficit hyperactivity disorder, ODD = oppositional defiant disorder, SAD = separation anxiety disorder. Bold items represent significant correlations at α= 0.05.

The comparison of the MZ and DZ twin correlations reveal significant shared environmental influences on behavioral inhibition and resistant temperament. For these two temperamental traits, the DZ correlations were significantly higher than half the MZ correlation. In marked contrast, for difficult temperament, the monozygotic twin pair correlation (0.56) was significantly more than twice the dizygotic twin pair correlation (0.12), indicating non-additive genetic variation such as genetic dominance, epistasis, or gene-environment correlation.

The pattern of DZ and MZ twin pair correlations for preschool ODD and SAD suggest that a combination of both additive genetic and shared environmental factors are responsible for any observed familial aggregation. The relatively low DZ correlation of 0.19, as compared to the MZ correlation of 0.71 for ADHD, is strongly genetic, and resembles the twin correlations observed for difficult temperament.

The results in Table 1 reflect the decomposition of the total phenotypic variance of each trait into its additive genetic (A), shared environmental (C) and non-shared environmental (E) standardized variance components. Familial aggregation for the temperamental trait of difficultness is due to genetic and non-shared environmental variation, with no effect of the shared environment. In contrast, almost half of the total variance in behavioral inhibition is explained by shared environmental factors.

The results of the univariate genetic analysis for preschool psychiatric diagnoses indicate that additive genetic risks explain 21% of the variance in ODD, 28% of the variance in SAD, and 61% of the variance in ADHD. Shared environmental factors account for 34% of the variance in ODD and 15% of the variance in SAD.

The multivariate analysis reveals a unique genetic and environmental structure underlying infant temperament and the preschool psychopathology. As shown in Figures 1 and 2, the covariation among temperament and psychopathology are attributable to both genetic and common environmental factors. A single additive genetic factor accounts for the covariation between difficult temperament and all the other traits and psychiatric diagnoses except for ‘resistance to control’, which is entirely under environmental control. An additional genetic factor reflects the association between behavioral inhibition, ODD, and SAD, and there are genetic effects specific to ADHD.

FIGURE 1.

FIGURE 1

Genetic structure between early temperament and preschool ADHD, SAD, and ODD (standardized variance components). Note: Ac = Common genetic effect, Asp = Specific genetic effect, ADHD = attention deficit hyperactivity disorder, ODD = oppositional defiant disorder, SAD = separation anxiety disorder.

FIGURE 2.

FIGURE 2

Shared environmental structure between early temperament and ADHD, SAD, and ODD (standardized variance components). Note: Cc = common shared environmental effect, Csp = Specific shared environmental effect, ADHD = attention deficit hyperactivity disorder, ODD = oppositional defiant disorder, SAD = separation anxiety disorder.

As shown in Figure 2, there is a shared environmental factor reflecting behavioral inhibition and SAD, a second shared environmental factor influencing SAD and ODD, and a shared environmental influence specific to resistant temperament. Because the effect of the individual specific environment was mostly trait specific it is not included in the figures.

Discussion

The prevalence rates in this Puerto Rican sample of 11.1%, 9.7%, and 7.2% for ADHD, ODD, and SAD respectively are comparable to those reported for other Hispanic samples using the DISC-YC (Lavigne et al., 2009). Considerable variability in rates using different instruments prevents strong assertions about prevalence. However, the coherence of the results from our genetically informed analyses suggests that the DISC-YC can make valid and meaningful diagnostic distinctions.

We found that both genetic and environmental factors influence the co-occurrence of difficult and inhibited temperament, as well as preschool ADHD, SAD, and ODD. The results from the multivariate genetic analysis reveal different patterns of genetic and environmental transmission. We found a single genetic factor reflecting difficult temperament, SAD, ODD, and ADHD. This genetic pattern is consistent with difficult temperament reflecting two different patterns of behavior: (1) a heightened sensitivity to the environment that can relate to later internalizing behaviors (e.g., SAD), and (2) frustration with a lack of stimulation that may be associated with subsequent behavioral disinhibition and externalizing behaviors (e.g., ADHD and ODD; Rothbart & Bates, 2006).

We found behavioral inhibition to be an early risk factor for ODD and SAD through both genetic and environmental pathways. It has been theorized that the genetic association between ODD and SAD may result from a common underlying process reflecting emotion regulation deficiencies (Cunningham & Ollendick, 2010). The shared environmental association between SAD and ODD may reflect parenting practices. Child anxiety disorders can involve oppositional and coercive behaviors with parents to avoid separation from caregivers. Oppositional behavior can produce unproductive conflict with caregivers that may create anxiety, especially in children who are temperamentally predisposed to anxiety (Fraire & Ollendick, 2012). Further research is needed on the specific developmental mechanisms that may be involved.

In contrast to most studies of behavioral inhibition showing marked genetic effects, the present findings on early temperament replicate previous work in the Puerto Rican population, showing a significant shared environmental influence on behavioral inhibition (Silberg et al., 2005). This environmental effect may reflect a socialization process specific to Puerto Rico, which encourages early social interactions. It is this greater social engagement within the community that may account for the lowered risk of impairment observed in children’s later development (Canino et al., 2004).

Whether genetic or environmental, our findings underscore the continuity of behavior. Genes may affect behavior in several ways. Our multivariate analysis illustrates that some genes have a main effect on overall liability to problem behavior. Main effects of the genes likely account for early temperamental differences, self-regulation, and behavioral outcomes that emerge at key developmental phases. Difficult temperament and ADHD are examples. A second underlying mechanism, ‘heterotypic continuity’, refers to genetic or environmental factors that are associated with phenotypic differences at different phases of development (e.g., behavioral inhibition and ODD). Lastly, the link between behavioral inhibition and SAD is illustrative of ‘homotypic continuity’, in which the same genes influence a similar behavior (fear of separation) first in infancy then in the preschool period.

Limitations

Our findings must be interpreted in the context of the following limitations. Because of the very low rates of other disorders, we were limited to analyzing the three preschool diagnoses of ADHD, ODD, and SAD. However, the pattern of genetic and environmental effect is consistent with both theoretical explanations and empirical findings linking difficult temperament to both externalizing and internalizing disorders, as well as genetic and shared environmental pathways linking behavioral inhibition and SAD.

It has previously been shown that low DZ correlations (such as those for ADHD in the present study) can arise from evocative gene-environment correlation, whereby genetic effects underlying children’s early reactivity evoke increased negative parental reactions (Silberg & Eaves, 2005). The present study does not directly address the possibility of evocative gene-environment correlation. In addition, genetic differences in response to impaired parenting, or genotype x environment interaction was not examined. These important mechanisms that may underlie the developmental association of difficult temperament and preschool psychopathology remain to be studies in future analyses.

Acknowledgments

This work was supported by grant #R01HD049685 (PI Silberg) from the National Institute of Child Health and Development (NICHD).

References

  1. Bates JE, Freeland CB, Lounsbury ML. Measurement of infant difficultness. Child Development. 1979;50:794–803. [PubMed] [Google Scholar]
  2. Bates JE, Schermerhorn AC, Petersen IT. Temperament concepts in developmental psychopathology. In: Lewis M, Rudolph K, editors. Handbook of developmental psychopathology. 3. New York: Guilford; 2014. [Google Scholar]
  3. Canino GJ, Shrout PE, Rubio-Stipec M, Bird HR, Bravo M, Ramirez R, Martinez-Taboas A. The DSM-IV rates of child and adolescent disorders in Puerto Rico: Prevalence, correlates, service use, and the effects of impairment. Archives of General Psychiatry. 2004;61:85–93. doi: 10.1001/archpsyc.61.1.85. [DOI] [PubMed] [Google Scholar]
  4. Caspi A, Moffit TE, Newman DL, Silva PA. Behavioral observations at age 3 years predict adult psychiatric disorders. Archives of General Psychiatry. 1996;53:1033–1039. doi: 10.1001/archpsyc.1996.01830110071009. [DOI] [PubMed] [Google Scholar]
  5. Cherny SS, Fulker DW, Corley R, Plomin R, DeFries JC. Continuity and change in infant shyness from 14 to 20 months. Behavior Genetics. 1994;21:365–379. doi: 10.1007/BF01067538. [DOI] [PubMed] [Google Scholar]
  6. Cherny SS, Saudino KJ, Fulker DW, Plomin R, Corley R, DeFries JC. The development of observed shyness from 14 to 20 months: Shyness in context. In: Emde R, Hewitt JK, editors. Infancy to early childhood: Genetic and environmental influences on developmental change. Oxford: Oxford University Press; 2001. pp. 269–282. [Google Scholar]
  7. Cunningham N, Ollendick T. Comorbidity of anxiety and conduct problems in children: Implications for clinical research and practice. Clinical Child and Family Psychology Review. 2010;13:333–347. doi: 10.1007/s10567-010-0077-9. [DOI] [PubMed] [Google Scholar]
  8. DePauw SS, Mervielde I. Temperament, personality, and developmental psychopathology: A review based on the conceptual dimensions underlying childhood traits. Child Psychiatry and Human Development. 2010;41:313–329. doi: 10.1007/s10578-009-0171-8. [DOI] [PubMed] [Google Scholar]
  9. Derks EM, Hudziak JJ, van Bejisterveldt CE, Dolan CV, Boomsma DI. A study of genetic and environemntal influences on maternal and paternal syndrome scores in a large sample of 3-year old Dutch twins. Behavior Genetics. 2004;34:571–583. doi: 10.1007/s10519-004-5585-2. [DOI] [PubMed] [Google Scholar]
  10. Eaves LJ, Silberg JL, Meyer JM, Maes HH, Simonoff E, Pickles A, Hewitt JK. Genetics and developmetnal psychopathology: 2. The main effects of genes and environment on behavioral problems in the Virginia twin study of adolescent behavioral development. Journal of Child Psychology and Psychiatry. 1997;38:965–980. doi: 10.1111/j.1469-7610.1997.tb01614.x. [DOI] [PubMed] [Google Scholar]
  11. Egger H, Angold A. Common emotional and behavioral disorders in preschool children: Presentation, nosology, and epidemiology. Journal of Child Psychology and Psychiatry. 2006;47:313–337. doi: 10.1111/j.1469-7610.2006.01618.x. [DOI] [PubMed] [Google Scholar]
  12. Egger H, Erkanli E, Keelr G. Test-retest reliability of the preschool age psychiatric assessment (PAPA) Journal of the American Academy of Child and Adolescent Psychiatry. 2006;45:538–549. doi: 10.1097/01.chi.0000205705.71194.b8. [DOI] [PubMed] [Google Scholar]
  13. Eley TC, Bolton D, O’Conner TG, Perrin S, Smith P, Plomin R. A twin study of anxiety-related behaviors in preschool children. Journal of Child Psychology and Psychiatry. 2003;44:945–960. doi: 10.1111/1469-7610.00179. [DOI] [PubMed] [Google Scholar]
  14. Fraire MG, Ollendick TH. Anxiety and oppositional defiant disorder: A transdiagnostic conceptualization. Clinical Psychology Review. 2012;33:229–240. doi: 10.1016/j.cpr.2012.11.004. [DOI] [PubMed] [Google Scholar]
  15. Gagne J, Saudino KJ. Wait for it! A twin study of inhibitory control in early childhood. Behavior Genetics. 2010;40:327–337. doi: 10.1007/s10519-009-9316-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Goldsmith H, Lemery K, Essex M. Temperament as a liability factor for childhood behavioral disorders: The concept of liability. In: DiLalla LF, editor. Behavior genetics principles: Perspectives in development, personality, and psychopathology. Washington, DC: American Psychological Association; 2004. pp. 19–39. [Google Scholar]
  17. Hannelius U, Gherman L, Makela VV, Lindstedt A, Zucchelli M, Lagerberg C, Lindgren CM. Large-scale zygosity testing using single polymorphisms. Twin Research and Human Genetics. 2007;10:604–625. doi: 10.1375/twin.10.4.604. [DOI] [PubMed] [Google Scholar]
  18. Kagan J, Snidman N, Zentner M, Peterson E. Infant temperament and anxious symptoms in school age children. Development and Psychopathology. 1999;11:209–224. doi: 10.1017/s0954579499002023. [DOI] [PubMed] [Google Scholar]
  19. Keenan K, Wackschlag L, Danis B, Hill C, Humphries M, Duax BA, Donald R. Further evidence of the reliability and validity of DSM-IV ODD and CD in preschool children. Journal of the American Academy of Child and Adolescent Psychiatry. 2007;46:457–468. doi: 10.1097/CHI.0b013e31803062d3. [DOI] [PubMed] [Google Scholar]
  20. Lavigne JV, LeBailly S, Hopkins J, Gouze K, Binns H. The prevalence of ADHD, ODD, depression, and anxiety in a community sample of 4-year olds. Journal of Clinical Child and Adolescent Psychology. 2009;38:315–328. doi: 10.1080/15374410902851382. [DOI] [PubMed] [Google Scholar]
  21. Lucas CP, Fisher P, Luby J. The young child DISC. New York: Columbia DISC Development Group; 2000. [Google Scholar]
  22. Martin NG, Eaves LJ, Kearsey MJ, Davis P. The power of the classical twin study. Heredity. 1978;40:97–116. doi: 10.1038/hdy.1978.10. [DOI] [PubMed] [Google Scholar]
  23. Matias-Carrelo L, Chavez L, Negron G, Canino G, Agulair-Gaxiola S, Hoppe S. The Spanish translation and cultural adoptation of five outcome measures. Culture, Medicine and Psychiatry. 2003;27:291–313. doi: 10.1023/a:1025399115023. [DOI] [PubMed] [Google Scholar]
  24. McDonnell MA, Glod C. Prevalence of psychopathology in preschool-age children. Journal of Child and Adolescent Psychiatric Nursing. 2003;16:141–152. doi: 10.1111/j.1744-6171.2003.00141.x. [DOI] [PubMed] [Google Scholar]
  25. Mikolajewski AJ, Allan NP, Hart SA, Lonigan CJ, Taylor J. Negative affect shares genetic and environmental Influences with symptoms of childhood internalizing and externalizing disorders. Journal of Abnormal Child Psychology. 2010;41:411–423. doi: 10.1007/s10802-012-9681-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Neale MC, Baker SM, Xie G, Maes HH. Mx statistical modeling. 6. Richmond, VA: Department of Psychiatry, Virginia Commonwealth University; 2003. [Google Scholar]
  27. Neale MC, Cardon LR. Methodology for genetic studies of twins and families. Dordrecht, The Netherlands: Kluwer Academic Publishers; 1992. [Google Scholar]
  28. Price TS, Simonoff ES, Waldman I, Asherson P, Plomin R. Hyperactivity in preschool children is highly heritable. Journal of the American Academy Child and Adolescent Psychiatry. 2001;40:1362–1363. doi: 10.1097/00004583-200112000-00002. [DOI] [PubMed] [Google Scholar]
  29. Prior M, Smart D, Sanson A, Oberklaid F. Does shy-inhibited temperament in childhood lead to anxiety problems in adolescence? Journal of the American Academy Child and Adolescent Psychiatry. 2000;39:461–468. doi: 10.1097/00004583-200004000-00015. [DOI] [PubMed] [Google Scholar]
  30. Robinson J, Kagan J, Reznick J, Corley R. The heritability of inhibited and uninhibited behavior: A twin study. Developmental Psychology. 2004;28:1030–1037. [Google Scholar]
  31. Rothbart MK, Bates JE. Temperament. In: Eisenberg N, Damon W, Lerner RM, editors. Handbook of child psychology: Social, emotional, and personality development. 6. Vol. 4. Hoboken, NJ: John Wiley & Sons; 2006. pp. 99–166. [Google Scholar]
  32. Saudino KJ. Behavioral genetics and child temperament. Journal of Developmental and Behavioral Pediatrics. 2005;26:214–223. doi: 10.1097/00004703-200506000-00010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Schmitz S, Cherny SS, Fulker DW, Mrazek DA. Genetic and environmental influences on early childhood behavior. Behavior Genetics. 1994;24:25–34. doi: 10.1007/BF01067926. [DOI] [PubMed] [Google Scholar]
  34. Shaw DS, Hyde LW, Brennan LM. Early predictors of boys’ antisocial trajectories. Development and Psychopathology. 2012;24:871–888. doi: 10.1017/S0954579412000429. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Silberg JL, Eaves LJ. Parent-child feedback predicts sibling contrast: Using twin studies to test theories of parent-offspring interaction in infant behavior. Twin Research and Human Genetics. 2005;8:1–4. doi: 10.1375/1832427053435337. [DOI] [PubMed] [Google Scholar]
  36. Silberg J, San Miguel VF, Prom E, Bates JE, Canino G, Egger H, Eaves LJ. Genetic and environmental influences on temperament in the first year of life: The puerto rican infant twin study (PRINTS) Twin Research and Human Genetics. 2005;8:328–336. doi: 10.1375/1832427054936808. [DOI] [PubMed] [Google Scholar]
  37. Thomas A, Chess S. Temperament and Development. New York: Brunner/Mazel; 1977. [Google Scholar]
  38. van den Oord EJ, Verhulst FC, Boomsma DI. A genetic study of maternal and paternal ratings of problem behaviors in 3-year-old twins. Abnormal Psychology. 1996;105:349–357. doi: 10.1037//0021-843x.105.3.349. [DOI] [PubMed] [Google Scholar]
  39. Zeanah CH. Handbook on infant mental health. New York: Guilford; 2000. [Google Scholar]

RESOURCES