Abstract
Risk factors for the childhood development of co-occurring internalizing and externalizing symptoms are not well understood, despite a high prevalence and poor clinical outcomes associated with this co-occurring phenotype. We examined inherited and environmental risk factors for co-occurring symptoms in a sample of children adopted at birth and their birth mothers and adoptive mothers (N = 293). Inherited risk factors (i.e., birth mothers’ processing speed and internalizing symptoms) and environmental risk factors (i.e., adoptive mothers’ processing speed, internalizing symptoms, and uninvolved parenting) were examined as predictors for the development of internalizing-only, externalizing-only, or co-occurring symptoms using structural equation modeling. Results suggested a unique pattern of predictive factors for the co-occurring phenotype, with risk conferred by adoptive mothers’ uninvolved parenting, birth mothers’ slower processing speed, and the birth mothers’ slower processing speed in tandem with adoptive mothers’ higher internalizing symptoms. Additional analyses indicated that when co-occurring-symptom children were incorporated into internalizing and externalizing symptom groups, differential risk factors for externalizing and internalizing symptoms emerged. The findings suggest that spurious results may be found when children with co-occurring symptoms are not examined as a unique phenotypic group.
The investigation of risk factors for child problem behaviors often focuses on children with either internalizing or externalizing problems (Fox, Henderson, Marshall, Nichols, & Ghera, 2005; Simmel, Brooks, Barth, & Hinshaw, 2001). Although these are meaningful groups to examine, considerably less research has focused specifically on children who exhibit both internalizing and externalizing symptoms. This investigative limitation is noteworthy because the co-occurring phenotype is highly prevalent, with co-occurring symptoms represented in up to 50% of externalizing samples (Cosgrove et al., 2011; Lavigne et al., 1996; Lilienfeld, 2003; McConaughy & Skiba, 1993). Children with co-occurring symptoms, across age ranges from young childhood to early adolescence, commonly experience more negative outcomes than do those without co-occurring symptoms. These outcomes include increased risk taking, suicidality, psychiatric inpatient admissions, and substance use problems, compared to children with either externalizing-only or internalizing-only problems (Dishion, 2000; Fanti & Henrich, 2010; Fite, Stoppelbein, Greening, & Dhossche, 2008; Pardini, White, & Stouthamer-Loeber, 2007).
A developmental psychopathology approach offers a promising framework for conceptualizing the development of problem phenotypes (externalizing-only, internalizing-only, or co-occurring; Cicchetti, 1984; Cicchetti & Rogosch, 1996). A central feature of this framework is the consideration of how risk factors for a given problem phenotype (such as co-occurring) may originate from multiple interacting levels, including inherited genetic vulnerabilities and early rearing environmental influences (Cicchetti, 2013). An additional question is whether risk factors for co-occurring problems are separable or shared with those that predict the development of internalizing and/or externalizing symptoms.
Although it has been well documented that a child’s early rearing environment contributes to the emergence of problem behavior through risk factors such as ineffective discipline (Maccoby & Martin, 1983), research suggests that genetic contributions also play a substantial role (Burt, 2009). However, identifying separable genetic and environmental risk factors is difficult because much of the support for genetic contributions to child problem behavior comes from research on familial aggregation of symptomatology, which does not trace the contributions of specific risk factors (Burt, 2009; Deater-Deckard & Plomin, 1999). Other research designs follow parents and their biological children, but in these designs, genetic and environmental influences within the family are confounded because the child receives both from his/her rearing parents. In such designs, the effects of genetic and environmental influences cannot be disentangled; thus, it is difficult to isolate discernable antecedents of children’s negative behaviors.
In contrast to prior research in this area, our study used a unique methodological design that enabled us to separately examine inherited and environmental influences on child problem phenotypes, including internalizing, externalizing, and co-occurring symptomology. In particular, we investigated maternal risk factors for the emergence of problem behavior during childhood by using a prospective longitudinal adoption design that collected information from both birth and adoptive parents. Data were drawn from a sample of children reared from birth with adoptive parents they were not genetically related to (The Early Growth and Development Study; blinded for review). In this type of design, associations between characteristics of birth parents and characteristics of the adopted child can be inferred to reflect inherited and/or prenatal influences. The influence of postnatal environmental factors is identified through associations between adoptive parent characteristics and adopted child characteristics. In addition, by investigating the independent contributions of specific birth mother and adoptive mother variables, we were able to examine the possible role of gene-environment interplay in predicting co-occurring problems (Reiss, Leve, & Neiderhiser, 2013).
Examining problem behaviors in children ages 6–7 was of particular interest because children in this age group have recently made the transition to elementary school and may exhibit problem behaviors both at home and in school. Understanding problem behaviors at early elementary school age is of further importance because these behaviors have substantial stability over time and predict the development of academic problems in later years (Masten et al., 2005). We focused on maternal variables and not on paternal variables or both, because of the limited previous research on co-occurring symptoms and the increased effect size found for maternal risk variables as opposed to paternal risk variables for predicting later child behavior (Connell & Goodman, 2002).
While constructing a framework to examine inherited and environmental influences, we drew from multiple perspectives, including social learning theory and gene–environment interplay, to identify candidate risk factors for co-occurring problem behavior, in accordance with a developmental psychopathology perspective (Cicchetti, 2013). This approach was chosen because it is consistent with the assumption that co-occurring symptoms may arise from a range of influences at both genetic and environmental levels (Cosgrove et al., 2011; Fanti & Henrich, 2010).
Social learning theory suggests that the social environment in which a child is reared influences his or her behavior (Bandura, 1986). Parents are primarily responsible for the social environment of young children, which can include multiple pathways to problem behavior (O’Connor, Matias, Futh, Tantam, & Scott, 2013). Examples of such parenting influences include social modeling of negative emotions, a lack of reinforcement for positive emotionality, and uninvolved parenting that reduces children’s socialization to compliant behaviors (Barber, Olsen, & Shagle, 1994; de Rosnay, Cooper, Tsigaras, & Murray, 2006; Elgar, McGrath, Waschbusch, Stewart, & Curtis, 2004; O’Connor et al., 2013; Patterson, DeBaryshe, & Ramsey, 1989).
Gene–environment interplay theory posits that genetically influenced attributes may make some children more sensitive to their environmental context, than other children or may exacerbate the effects of risky environments (see Reiss et al., 2013, for a review of different forms of gene–environment interplay). In our study, birth mother characteristics were conceptualized to index inherited liabilities that may be moderated by social environmental factors, which are indexed by adoptive mother characteristics. In addition to potential main effects of genetic attributes, inherited and social–environmental attributes may moderate each other through a number of processes, such as differential susceptibility to either favorable or adverse environments or goodness of fit between an individual’s inherited attributes and qualities of the social environment (Belsky & Pluess, 2009; Reiss et al., 2013).
As described below, social learning and gene–environment interplay perspectives supported our investigation of multiple risk factors, including maternal internalizing symptoms as indexed by depressive and anxious symptoms (measured in birth mothers and adoptive mothers), maternal processing speed deficits (measured in birth mothers and adoptive mothers), and uninvolved parenting as indexed by higher levels of inconsistent discipline and poor monitoring (measured in adoptive mothers). By simultaneously investigating these contributors to co-occurring problem behavior, we aimed to better describe how co-occurring problems may develop through multiple risk pathways. Furthermore, we examined if these pathways were shared or distinct from the development of single-dimension (internalizing-only/externalizing-only) behavior.
The Role of Maternal Internalizing Symptoms
According to social learning theory, observed behavior (i.e. modeling) is one mechanism that can contribute to the development of problem behavior (Bandura, 1986). Research has confirmed that young children tend to affectively match their mother’s internalizing symptoms (de Rosnay et al., 2006; Elgar et al., 2004). For example, infants were found to be more fearful and avoidant of strangers when they observed their mothers interacting with them in a socially anxious rather than in a nonsocially anxious manner (de Rosnay et al., 2004). Young children of depressed mothers have also been documented to match the low tone and slow rate of their mother’s speech during routine interactions while also matching their mother’s fast-paced and anxious style of speech in response to mild stressors (Breznitz & Sherman, 1987). Such findings suggest that in the process of social modeling, young children’s exposure to maternal internalizing symptoms may be associated with child internalizing behavior (Goodman & Gotlib, 1999).
Other research suggests that mothers with higher levels of internalizing symptoms (depression, anxiety, or both) are less likely to provide a parenting environment that is responsive and warm, which may lead to the development of both internalizing and externalizing symptoms (Feldman et al., 2009). Mothers with internalizing symptoms are more likely to be disengaged from parenting and exhibit a negative parenting style, which predicts the emergence of both internalizing and externalizing problem behaviors in young children (Bögels & Brechman-Toussaint, 2006; Dawson et al., 2003; Goodman & Gotlib, 1999; McLeod, Wood, & Weisz, 2007; Pemberton et al., 2010). Negative and insensitive parenting styles also influence the social environment in that the parents are less likely to provide appropriate parental scaffolding of effective emotion regulation strategies. Without such environmental input, children are likely to exhibit poor regulation of negative emotions, which contributes to internalizing (e.g., sadness) and externalizing (e.g., anger) behaviors (Hoffman, Crnic, & Baker, 2006; Morris, Silk, Stienberg, Myers, & Robinson, 2007). Previous research among children ages 2–12 years has found that early exposure to maternal depression confers exaggerated risk for developing chronic co-occurring problems (compared to internalizing-only or externalizing-only problems), but similar research has not been examined outcomes related to maternal anxiety (Fanti & Henrich, 2010).
Research about genetic contributions of maternal internalizing symptoms to child problem behavior in the current sample found that birth mother lifetime depression predicted children’s externalizing symptoms during the preschool years, after controlling for prenatal risk and environmental experiences (blinded for review). However, other research has found that the link between birth mother depression (prior to pregnancy) and toddler depressive symptoms was present only in the context of prenatal risk experiences (blinded for review). An integrative review about childhood anxiety noted that, although familial aggregation is commonly reported, most studies do not separate genetic from environmental influences, so there is meager evidence for heritability (Murray, Creswell, & Cooper, 2009). In sum, genetic contributions of maternal internalizing symptoms to child problem behavior may be found only in the context of additional environmental risk. Despite the limited evidence of heritable effects of birth mother internalizing symptoms on child problem behavior, it was necessary to include this variable to highlight the comparative importance of early environmental exposure to maternal internalizing symptoms to child problem behaviors at school entry. Based on these findings, we predicted that adoptive mother internalizing symptoms would predict child co-occurring behavior. We also expected that birth mother internalizing symptoms would confer inherited sensitivity to adverse environmental experiences, consistent with the gene–environment interplay perspective, but did not expect birth mother internalizing symptoms to have a direct effect on child problem behavior (Reiss et al., 2013).
Maternal Processing Speed
Maternal processing speed was another variable of primary interest with regard to the development of co-occurring problems in children. This cognitive skill reflects the efficiency with which information is processed throughout the brain (Brunnekreef et al., 2007). Unfortunately, we did not have a measure of child processing speed, but on the basis of the moderate to high heritability of cognitive skills, we considered birth mother processing speed to reflect an inherited risk factor (Beaujean, 2005; Friedman et al., 2008). We identified birth mother processing speed as a risk factor because rapid processing speed contributes to effective self-regulation and social information processing, which have been theorized to be central to the co-occurring problem behavior phenotype (White, Jarrett, & Ollendick, 2013). Specifically, children with co-occurring problems exhibit self-regulatory difficulties in willfully disengaging from negative affect (common to internalizing) and inhibiting reactive aggression (common to externalizing) responses (Bubier & Drabick, 2009; White et al., 2013). Slower processing speed can also contribute to deficits in social information processing, which could exacerbate co-occurring problems through negative attribution biases (Drabick, Ollendick, & Bubier, 2010). Further evidence about the importance of inherited risk for processing speed deficits includes findings of slow processing speed in children with co-occurring symptoms (Brunnekreef et al., 2007; Kusche, Cook, & Greenberg, 1993). We hypothesized that birth mother slow processing speed would confer genetic risk for the co-occurring problem behavior phenotype. The role of gene–environment interplay was also of interest because of the possible role of birth mother processing speed contributing inherited risk or differential susceptibility to environmental stressors in predicting child problem behavior. However, because of the lack of previous research about gene–environment interactions with inherited risk for poor processing speed, these specific interactions were largely exploratory. Adoptive mother processing speed was not predicted to be associated with child problem behavior because in previous research it has not been linked to internalizing or externalizing symptoms.
Uninvolved parenting
As described by Barber and colleagues (1994), social learning theory emphasizes the need for adequate parental structure and discipline to socialize conformity and rule adherence. If predictable contingencies and monitoring are not in place to instill desired behaviors, children may be less likely to learn to inhibit externalizing behaviors and develop appropriate self-regulatory mechanisms (Maccoby & Martin, 1983). Social learning and related models of socialization (e.g., Baumrind, 1971; Maccoby & Martin, 1983) link low levels of parental involvement (conceptualized here to include both poor parental monitoring and high inconsistent discipline) to externalizing behaviors (Dishion & McMahon, 1998; Shaw, Criss, Schonberg, & Beck, 2004). For example, in some studies, mothers’ uninvolved parenting has been associated with young children’s expression of internalizing and externalizing problem behavior (McWayne, Fantuzzo, Cohen, & Sekino, 2004). Other studies suggest that uninvolved parenting is associated only with externalizing problems (Howes, 1990), or the relationship between uninvolved parenting and internalizing problems is no longer present when other parenting domains are controlled for (Stormshak, Bierman, McMahon, & Lengua, 2000). Research also suggests that effective maternal monitoring can buffer the development of externalizing behaviors in young children living in low-quality neighborhoods (defined by high rates of serious crime, overcrowding, and poverty; Supplee, Unikel, & Shaw, 2007). Inconsistent maternal limit setting also has been found to relate to externalizing problem behaviors, across studies, including those with early school-age children (Gonzales, Pitts, Hill, & Roosa, 2000; Kilgore, Snyder, & Lentz, 2000; Lengua & Kovacs, 2005). In some studies, inconsistent maternal discipline predicted internalizing problems (Gonzales et al. 2000), but not in other studies (Lengua & Kovacs, 2005). We hypothesized that inconsistent discipline and low monitoring (combined into a “uninvolved parenting” variable) would predict the externalizing-only symptom phenotype, but on the basis of inconsistent previous findings, it was unknown if uninvolved parenting would predict the child internalizing symptom phenotype. Uninvolved parenting was also expected to predict co-occurring problem behavior, based on the strong associations between these dimensions of parenting and externalizing behaviors identified in previous research.
This Study
Consistent with previous developmental psychopathology research, the hypotheses presented are based on the assumption that childhood problem behaviors can arise from different mechanisms at the genetic and environmental levels (Racer & Dishion, 2012). We expected main effects of adoptive mothers’ higher levels of internalizing symptoms, birth mothers’ slower processing speed, and adoptive mothers’ uninvolved parenting on child co-occurring behavior. We also hypothesized that birth mothers’ higher levels of internalizing symptoms and birth mothers’ slower processing speed would confer inherited sensitivity to the social environment, so we investigated interactions between genetic and environmental indices as predictors of child problem behavior. Because previous research on co-occurring problem behavior has not examined specific mechanisms of gene–environment interplay in young children, these interactions were largely exploratory.
Due to the minimal research about risk factors for co-occurring symptoms, we used two approaches to analyze the data and compared the patterns of results. First, we investigated risk factors for child problem phenotypes by considering children with internalizing-only, externalizing-only, and co-occurring problems as three distinct and mutually exclusive problem phenotype groups, compared with those of a low-symptom group (defined by a clinically insignificant number of internalizing or externalizing symptoms). Next, we used a dimensionalized approach to reanalyze the data by considering children with internalizing problems (versus low symptom) and externalizing problems (versus low symptom) to investigate if this method of analysis would yield a different set of risk patterns. In these dimensionalized analyses, children with co-occurring symptoms were included in internalizing and externalizing symptom groups.
The underlying aim of the analyses was to gain a better understanding of (a) whether dissociable genetic, environmental, and interacting pathways predict co-occurring, internalizing-only, and externalizing-only symptom groups (as compared with a low-symptom group), and (b) whether the mutually exclusive group patterns have distinctive predictors from dimensionalized methodological designs.
Methods
Participants
Participants (n = 293) were drawn from a study of 361 linked sets of adoptive parents, children, and birth mothers in Cohort 1 of The Early Growth and Development Study (EGDS). Children were excluded from this study’s analyses if there were no outcomes data on the Child Behavior Checklist (CBCL) from either parent at child age 6 or age 7 (n = 59), or if both adoptive parents were men (n = 9; because of our study’s focus on maternal risk variables). Cohort 1 of this longitudinal study was recruited between 2003 and 2006 from 33 adoption agencies in 10 states across the Northwest, Mid-Atlantic, and Southwest regions of the United States. These agencies comprised the full range of adoption agencies operating in the United States, including public, private, religious, secular, those favoring open adoptions, and those favoring closed adoptions. Participants were identified by agency staff if they met all the following eligibility criteria: (a) the adoption placement was domestic; (b) the infant was placed within 3 months postpartum (M = 7.11 days postpartum, SD = 13.28; median = 2 days); (c) the infant was placed with a nonrelative adoptive family; (d) birth and adoptive parents were able to read or understand English at the eighth-grade level; and (e) the infant had no known major medical conditions, such as extreme prematurity or extensive medical surgeries. Of the families who met eligibility criteria, 68% agreed to participate. The participants were representative of the adoptive parent population that completed adoption plans at the participating agencies during the same time period (blinded for review)
Demographically, the adopted children included 57% males and 43% females from a range of racial and ethnic backgrounds, including 57.6% White, 11.1% Black/African American, 9.4% Latino, 20.8% multiracial, .3% American Indian/Alaskan native, and .6% unknown or not reported. The mean age for birth mothers at child birth was 24.78 (SD = 6.28), with 41.8% single and never married and 48.1% in a stable marital or marriage-like relationship. Half of birth mothers reported an education level as high-school equivalent, 18.8% had less than a high school degree, and 31.0% had trade school or higher. Adoptive mothers had a mean age of 37.59 (SD = 5.53) at child birth and predominantly reported a stable marital or marriage-like relationship (90.2%), White racial identity (92.0%), and an education level of trade school or higher (92.4%). Adoptive fathers had a mean age of 38.13 (SD = 5.81) at child birth and also predominantly reported a stable or marriage-like relationship (90.6%), White racial identity (92.1%), and an education level of trade school or higher (84.9%).
Current analyses are based on the subset (n = 293) of the total sample for which maternal report or paternal report of child problem behavior data at child age 6 or 7 were available. Although data collection was attempted for each child at age 6 and age 7, some families declined to participate at a given wave or declined to complete the CBCL measure, and thus there was missing CBCL data (26.3%–33.5%) at each time point. When data from both time points were available, the highest score was used as the criterion for inclusion or exclusion from the problem behavior group. Parent and child data for this study were collected through in-person interviews, home-based questionnaires, and web-based assessments. Little’s missing completely at random chi-square tests found no significant patterns of missing data, suggesting that the data were missing completely at random, χ2(194) = 208.10, p > 0.05.
Measures
Symptom phenotypes
Child externalizing-only, internalizing-only, co-occurring, and low-symptom phenotypes were classified based on the Child Behavior Checklist (CBCL) borderline clinical scores (T-scores of 60 or greater) as rated by adoptive parents (mothers or fathers) at child age 6 or 7 (Achenbach, 1991; Eisenberg et al., 2001). Parents were asked to base their ratings on child behavior during the past 2 months at child age 6 and during the past 6 months at child age 7. The CBCL Internalizing scale included items from three domains: withdrawal, somatic complaints, and anxiety/depression (mother α = .81–.85, father α = .82–.89). The withdrawal domain includes problems related to a child’s shyness, withdrawal, and inclination to be alone, and the somatic complaints domain includes child symptoms related to aches, fatigue, or stomach problems. Anxiety/depression items included child experiences of sadness, fear, perfectionism, and worry. The Externalizing scale included items related to aggressive symptoms (e.g., attention seeking, arguing, bragging, teasing, having a temper) and delinquent symptoms (e.g., lying, cheating, stealing; mother α = .89–.91, father α = .89–.93; Achenbach, 1991).
If children had clinically significant symptoms at either time point, as rated by either parent, they were placed in the appropriate “problem phenotype” group that included child internalizing-only (n = 23), externalizing-only (n = 44), co-occurring (n = 39), and low-symptom (n = 187) behaviors. A score of 60 represents the 84th percentile in normative populations, in which ~16% of children would be expected to have scores of 60 or higher. In our study sample, borderline clinical scores were found for externalizing symptoms in 28.5% of children and for internalizing symptoms in 23.0% of children. This finding suggests a slightly higher rate of problems when compared with normative samples but similar rates to other nonclinical samples, such as children from low socioeconomic neighborhoods where problem behavior that exceeds borderline clinical scores has been found in 21%–27% and 13%–40% of children for externalizing and internalizing problems, respectively (reviewed in Qi & Kaiser, 2003).
The means for internalizing and externalizing T-scores for each symptom phenotype are presented in Table 1. We compared of level of internalizing and externalizing behavior in the low-symptom group with each of the problem-behavior groups using independent sample t-tests in SPSS v.19. Each problem behavior group exhibited significantly elevated levels of both internalizing and externalizing symptoms, compared with the low-symptom group, with the exception of externalizing symptoms in the internalizing-only symptom group, which reached only marginal significance (p > .10). These t-test statistics are presented in Table 1. Independent sample t-tests were also conducted on symptom levels between children in the co-occurring group and children in the internalizing-only and externalizing-only groups to examine if children in the co-occurring group exhibited higher levels of symptoms. Results indicated that children in the co-occurring group scored higher than children in the externalizing-only group on both internalizing, t(81) = 11.31, p < .001, and externalizing, t(81) = 3.28, p < .01, symptoms. Children in the co-occurring group scored higher than did children in the internalizing-only group on externalizing, t(60) = 9.93, p < .001, but not internalizing (p > .05) symptoms.
Table 1.
Average Levels of Problem Behaviors, by Symptom Phenotype
| Low symptom | Externalizing-only | Internalizing-only | Co-occurring | |
|---|---|---|---|---|
| Internalizing | ||||
| CBCL T-score M (SD) | 49.47 (6.19) | 53.61 (4.78) | 64.13 (3.62) | 65.36 (4.65) |
| t-test of problem phenotype versus low-symptom group | — | t(229) = −4.16, p < .001 | t(208) = −11.12, p < .001 | t(224) = −18.25, p < .001 |
| Externalizing T-score | ||||
| CBCL T-score M (SD) | 50.39 (6.23) | 63.48 (3.62) | 52.87 (4.56) | 67.05 (5.88) |
| t-test of problem phenotype versus low-symptom group | — | t(229) = −13.39, p < .001 | t(208) = −1.85, p < .10 | t(224) = −15.32, p < .001 |
Risk factors
Birth mothers’ internalizing symptoms, birth mothers’ processing speed, adoptive mothers’ internalizing symptoms, and uninvolved parenting were collected when the child was approximately 4.5 years old. Adoptive mothers’ processing speed was measured at child age 6 years. Thus, with the exception of adoptive mothers’ processing speed, all risk factors were assessed prior to parental ratings of child behavioral problems (child age 6–7 years). Given the high stability of processing speed over time, this likely does not pose a major limitation (Strauss, Allen, Jorgensen, & Cramer, 2005). Each risk factor is described in the following subsections.
Maternal internalizing symptoms
Internalizing symptoms for both the birth mother and adoptive mother were a composite of the Beck Anxiety Inventory (BAI) and the Beck Depression Inventory (BDI) scores. The BAI and BDI are validated and reliable measures of depression and anxiety symptoms (Beck & Steer, 1993; Beck, Steer, & Carbin, 1988). Each scale consists of 21 questions with four possible answers related to the relative presence or absence of each investigated symptom during the past week, resulting in a maximum possible score or 63. The suicidal item was dropped from the original BDI 21-item scale in this study to reduce situations that would require a clinical follow-up. Alphas were acceptable for BAI and BDI scores for both birth and adoptive mothers (α = .83–.90). To maximize symptom range in our study sample, the internalizing scores were determined as the cumulative number of depression and anxiety symptoms for both birth mothers and adoptive mothers. These scores were log-transformed because of a large positive skew (> 1.5), which violated assumptions of normality. They log-transformed scores were then multiplied by 10 so that they reflected a similar range to other variables used in statistical analyses.
Maternal processing speed
Average reaction time in correct trials during the Stroop color-word naming task was used as a proximal measure of maternal processing speed (Stroop, 1935). The Stroop color-word naming task provides color words (i.e., blue, green, yellow) in either the matching, congruent color or nonmatching, incongruent color. Participants are required to press a button indicating the color of the word, and the reaction time is measured as the latency between when the word appears on the screen and when the participant presses the button box. To index processing speed, we averaged reaction time scores across all correct trials for each participant. This index of processing speed has been shown to have strong reliability over time (Strauss et al., 2005). In our sample, birth mothers’ and adoptive mothers’ reaction times were found to be highly consistent across trial sets (r = 0.71 and r = .77, respectively) and were log-transformed following standard reaction time analysis procedures (Whelan, 2010).
Uninvolved parenting
Uninvolved parenting was assessed with adoptive mothers when children were age 6 through a summation of the Inconsistent Discipline and Poor Monitoring subscales of the Alabama Parenting Questionnaire (APQ; Shelton, Frick, & Wootton, 1996). In the APQ, parents are asked 35 questions relating to frequency of parenting behaviors on a 5-point Likert scale ranging from 1 (never) to 5 (always). The subscale scores represent average frequencies of behaviors among the subscale items. Higher scores on these subscales are reflective of more uninvolved parenting (i.e., higher rates of inconsistent discipline and higher rates of poor monitoring/low involvement; mother ratings α = .48–.69). These subscales have been shown to have good divergent validity, reliability, and meaningful correlations to disruptive behaviors (Shelton et al., 1996). Data from one participant was greater than three standard deviations above the mean and was Winsorized to reduce the impact of outliers on results.
Covariates
Although some sex differences have been found for internalizing and externalizing problems, we did not expect distinct differences in the associations between risk factors and child symptoms to have emerged by age 6. However, child sex was investigated as a covariate given that some differences have been found (Brennan & Shaw, 2013; Leve, Kim, & Pears, 2005). We also investigated child age as a covariate to account for possible developmental differences (age range 60–72 months). The “openness in adoption” variable was investigated to account for possible contact between birth mother and adopted children that could muddle effects of genetic and environmental influences because of differences in contact. This variable is determined from a 7-point scale of perceived adoption openness ranging from 1 (very closed) to 7 (very open). We computed a composite of openness ratings from each of the birth mother, adoptive mother, and adoptive father ratings of the level of contact between parties (Ge et al., 2008). In addition, we investigated obstetric complications (including pregnancy complications, neonatal complications, substance use during pregnancy, and exposure to toxins during pregnancy) based on birth mother report at 4 months postpartum, weighted for severity, because intrauterine events could confound estimates of genetic influences (Marceau et al., 2013). These covariates were used in all following structural equation models.
Analysis Plan
Bivariate correlations were first examined in SPSS v.19 to determine how the child symptom membership (externalizing-only, internalizing-only, or co-occurring) as opposed to low-symptom group membership related to each hypothesized risk factor. We used structural equation modeling (SEM) in Mplus v.6 with two models to determine (a) main effects of genetic and environmental risk factors, and (b) interaction effects of Genetic × Environmental risk variables in a full model (with centered variables; Muthén & Muthén, 2010). In these structural equation models, children’s exclusionary phenotype group membership was considered a nominal variable and each “problem” phenotype (i.e., internalizing, externalizing, and co-occurring) was contrasted against the low-symptom group. Birth mothers’ risk factors were allowed to covary with each other, as were adoptive mothers’ factors. Because older age has been associated with slower processing speed, birth mother and adoptive mother processing speed variables were regressed on participant age to control for possible age-related influences (Salthouse, 1996).
Next, we repeated the SEM analyses by using the typical dimensionalized approach to studying child problem behavior for two-group analyses of low-symptom versus internalizing symptomatology and low-symptom versus externalizing symptomatology. In these analyses, children in the co-occurring group were included in both the internalizing (n = 67) and externalizing (n = 83) groups. This analysis enabled us to examine if risk factors for groups with internalizing and externalizing symptoms would be confounded with findings associated with the co-occurring symptom group.
Results
Correlations Among Primary Variables and Covariates
Bivariate correlations between each of the covariates and dummy-coded symptom group variables comparing each problem group with the low-symptom group are shown in Table 2. Of the covariates investigated, child age, openness of adoption, and child sex were not significantly associated with any of the problem symptom groups (p > 0.05). Obstetric complications were significantly associated with the externalizing-symptom group compared with the low-symptom group (r = 0 .14, p < 0.05). Descriptive data for each of the covariate predictors are presented in Table 3. In all the subsequent analyses, the log-transformed data (birth mother internalizing, adoptive mother internalizing, birth mother processing speed, adoptive mother processing speed) were used, but for the descriptive data, raw values have been presented for interpretability.
Table 2.
Bivariate Correlations
| Variable | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Child symptom group | |||||||||||||
| 1 Internalizing only+ | 1.00 | ||||||||||||
| 2 Externalizing only+ | - | 1.00 | |||||||||||
| 3 Co-occurring+ | - | - | 1.00 | ||||||||||
| Covariates | |||||||||||||
| 4 Sex (male reference group) | .04 | −.13 | −.01 | 1.00 | |||||||||
| 5 Openness to adoption | −.10 | .08 | .05 | −.03 | 1.00 | ||||||||
| 6 Obstetric complications | .06 | .14* | .13 | .04 | −.12 | 1.00 | |||||||
| 7 Age | −.01 | −.00 | .05 | −.02 | −.04 | −.03 | 1.00 | ||||||
| Birth mother | |||||||||||||
| 8 Internalizing | −.02 | .09 | .01 | .08 | .09 | .12* | −.05 | 1.00 | |||||
| 9 Processing speed (reaction time) | .06 | .03 | .14* | −.06 | −.23** | .15* | −.01 | −.12 | 1.00 | ||||
| 10 Age | .01 | −.01 | .15* | −.08 | −.26** | .19** | .00 | .06 | .34** | 1.00 | |||
| Adoptive mother | |||||||||||||
| 11 Internalizing | .08 | .05 | .06 | −.11 | .05 | −.01* | −.02 | −.14* | .07 | −.08 | 1.00 | ||
| 12 Processing speed (reaction time) | −.03 | .01 | .02 | .09 | −.03 | −.03 | −.13* | .05 | −.04 | .06 | −.04 | 1.00 | |
| 13 Uninvolved parenting | .11 | .06 | .24** | −.02 | −.10 | −.02 | −.06 | .01 | .07 | .05 | .19** | .03 | 1.00 |
| 14 Age | −.02 | −.07 | .07 | .02 | −.04 | .01 | .04 | .08 | .02 | .01 | .03 | .16* | −.00 |
Note.
Child symptom groups, with low-symptom reference group.
p < 0.05.
p < 0.01.
Table 3.
Predictive Risk Factor Descriptives, by Symptom Phenotype
| Low symptom | Internalizing only | Externalizing only | Co-occurring | |
|---|---|---|---|---|
| 1. Covariates | ||||
| Gender | ||||
| % Males | 54.5% | 47.8% | 70.5% | 56.4% |
| Obstetric complications | ||||
| M (SD) | 8.71 (6.92) | 10.04 (4.61) | 11.25 (6.83) | 11.03 (6.67) |
| Openness | ||||
| M (SD) | −.01 (.97) | −.30 (.90) | .18 (.68) | .11 (.88) |
| Child’s age at CBCL assessment | ||||
| Age in months, M (SD) | 71.81 (1.95) | 71.78 (2.07) | 71.82 (1.74) | 72.08 (2.49) |
| 2. Birth mother risk | ||||
| Internalizing | ||||
| Anxiety & depression, symptom count, BAI & BDI, M (SD) | 13.56 (13.69) | 10.08 (9.36) | 15.37 (14.11) | 14.48 (14.48) |
| Processing speed | ||||
| Stroop reaction time (ms), M (SD) | 712.06 (113.63) | 734.13 (125.32) | 714.96 (83.13) | 756.84 (125.48) |
| 3. Adoptive mother risk | ||||
| Internalizing | ||||
| Anxiety & depression, symptom count: BAI & BDI, M (SD) | 8.83 (7.82) | 10.38 (6.74) | 9.68 (8.13) | 10.53 (9.11) |
| Processing speed | ||||
| Stroop reaction time (ms), M (SD) | 760.23 (92.94) | 752.32 (96.85) | 760.38 (82.09) | 766.83 (102.56) |
| Uninvolved parenting | ||||
| Poor monitoring & inconsistent discipline behavior count on ABQ, M (SD) | 1.64 (.28) | 1.74 (.30) | 1.69 (.32) | 1.83 (.37) |
Mutually Exclusive Group Analyses (Internalizing-only, Externalizing-only, and Co-occurring Versus Low-Symptom)
The first structural equation model (Model 1; loglikelihood = −5,871.63, AIC = 11,907.26, BIC = 12,209.04) examined whether each birth mother and adoptive mother risk factor significantly predicted membership in each symptom group rather than in the low-symptom group. Next, we examined possible Genetic × Environmental risk factors by examining interaction terms for each inherited risk factor (birth mother processing speed, birth mother internalizing) and social environmental variable (adoptive mother internalizing symptoms, adoptive mother processing speed, and uninvolved parenting (Model 2); loglikelihood = −8,191.85, AIC = 16,733.70, BIC = 17,377.73). Standardized coefficients from Models 1 and 2 are presented in Table 4. Logistic odds ratios (OR) for significant effects are presented in the text.
Table 4.
Hierarchical Multinomial Logistic Regression Analysis Predicting Child-Symptom Group Membership Using Mutually Exclusive 3-Symptom Group Analysis Models
| Model results for exponentiated coefficients for Model 1 and Model 2 (standard errors) | ||||||
|---|---|---|---|---|---|---|
|
| ||||||
| Externalizing-only versus low-symptom | Internalizing-only versus low-symptom | Co-occurring-only versus low-symptom | ||||
|
| ||||||
| Model 1 | Model 2 | Model 1 | Model 2 | Model 1 | Model 2 | |
| Birth mother (BM) | ||||||
|
| ||||||
| Processing speed | .07 (.25) | .04 (.27) | .01 (.37) | −.35 (.41) | .57* (.28) | .63* (.30) |
|
| ||||||
| Internalizing | .05 (.04) | .08 (.05) | −.01 (.05) | −.04 (.05) | .01 (.05) | .02 (.06) |
| Adoptive mother (AM) | ||||||
| Processing speed | .10 (.32) | .08 (.35) | −.19 (.47) | −.44 (.49) | .09 (.38) | .08 (.39) |
| Internalizing | .03 (.05) | .05 (.05) | .07 (.08) | .15* (.06) | .01 (.05) | .01 (.06) |
| Uninvolved parenting | .65 (.65) | .40 (.71) | .94 (.88) | .40 (.78) | 2.20** (.68) | 2.07** (.71) |
| Interactions | ||||||
| BM Processing Speed × AM Internalizing | — | .13 (.08) | — | .32** (.11) | — | .21* (.09) |
| BM Processing Speed × AM Processing Speed | — | .25 (.54) | — | −2.37*** (.66) | — | −.24 (.66) |
| BM Processing Speed × AM Uninvolved parenting | — | −.16 (.87) | — | −1.97* (.99) | — | −1.11 (.96) |
| BM Internalizing × AM Internalizing | — | .01 (.01) | — | .07*** (.02) | — | .00 (.02) |
| BM Internalizing × AM Processing Speed | — | .06 (.18) | — | .07 (.21) | — | .01 (.20) |
| BM Internalizing × AM Uninvolved parenting | — | .26 (.17) | — | −.30 (.22) | — | .08 (.21) |
| Covariates | ||||||
| Obstetric complications | .06* (.03) | .06* (.03) | .03 (.03) | .02 (.03) | .06* (.03) | .06* (.03) |
| Openness | .37 (.20) | .38 (.22) | −.30 (.23) | −.39 (.30) | .39 (.22) | .39 (.24) |
| Age | .03 (.08) | .06 (.09) | −.00 (.11) | .13 (.12) | .12 (.10) | .13 (.11) |
| Gender | −.73 (.38) | −.77* (.39) | .34 (.44) | .54 (.53) | −.05 (.38) | −.05 (.03) |
p< 0.05,
p < 0.01,
p < 0.001
In the main effects model (Model 1; see Table 4) birth mothers’ processing speed (OR: 1.78 [1.13–2.79]) and adoptive mothers’ uninvolved parenting (OR: 9.05 [2.94–27.88]) predicted membership in the co-occurring group versus low-symptom group, and obstetric complications predicted membership in the externalizing-only versus the low-symptom group (OR: 1.06 [1.02–1.11]) and co-occurring versus low-symptom group (OR: 1.06 [1.01–1.11]). Results from the full model (Model 2; see Table 4) indicated that main effects of adoptive mothers’ uninvolved parenting (OR: 7.91 [2.45–25.69]; Figure 1A) and main effects of birth mother slower processing speed (OR: 1.88 [1.16–3.05]; Figure 1B) remained significant for predicting membership in the co-occurring versus low-symptom group. In addition, the interaction of Birth Mother Processing Speed × Adoptive Mother Internalizing (OR: 1.25 [1.08–1.44]) significantly predicted membership in the co-occurring versus the low-symptom group. A greater number of obstetric complications (OR: 1.06 [1.01–1.11]) also predicted co-occurring versus low-symptom group membership. Membership in the child internalizing-only (versus low-symptom) group was significantly predicted by a main effect of more adoptive mother internalizing symptoms (OR: 1.17 [1.05–1.30]; Figure 1C). Interactions of Birth Mother Processing Speed × Adoptive Mother Internalizing Symptoms (OR: 1.37 [1.15–1.64]), Birth Mother Processing Speed × Adoptive Mother Processing Speed (OR: .09 [.03–28]), and Birth Mother Processing Speed × Uninvolved Parenting (OR: .14 [.03–.71]) predicted membership in the child internalizing-only rather than in the low-symptom group. Birth Mother Internalizing Symptoms × Adoptive Mother Internalizing Symptoms (OR: 1.07 [1.04–1.10]) also predicted membership in the child internalizing-only group. Finally, main effects of a greater number of obstetric complications (OR: 1.06 [1.01–1.11]) and main effects of male gender (OR: .46 [.24–.87])) significantly predicted membership in the externalizing-only group.
Figure 1.
Graphical display of main effects of risk factors predicting child symptom group membership (versus the low-symptom group) for the full mutually exclusive group structural equation model.
Post-hoc independent sample t-tests were performed to investigate interactions that predicted child internalizing-only and child co-occurring group membership. They were examined using a median split of each variable to determine the contributing influences of each interaction. Graphs of these interactions are presented in Supplementary Figure 1. In the Birth Mother Internalizing × Adoptive Mother Internalizing interaction, the presence of adoptive mother high internalizing predicted membership in the child internalizing-only group, but only when birth mother internalizing was high. This was supported by a marginally significant difference in adoptive mother internalizing between child internalizing-only and low-symptom groups, when birth mother internalizing was high, t(80) = −1.72, p < .10.
In the Birth Mother Processing Speed × Adoptive Mother Uninvolved Parenting interaction, it was determined that the presence of uninvolved parenting predicted internalizing symptoms only when the birth mother’s processing speed was fast. This was supported by a marginally significant t-test between levels of uninvolved parenting between the internalizing-only versus the low-symptom groups when birth mother processing speed was fast, t(80) = −1.68, p < .10. In the Birth Mother Processing Speed × Adoptive Mother Processing Speed interaction, post-hoc analyses suggested that when an adoptive mother had fast processing speed, but the birth mother had slow processing speed, or when an adoptive mother had slow processing speed and the birth mother had fast processing speed, the child was more likely to exhibit internalizing-only symptoms. This was indicated by a significant difference in birth mother processing speed when adoptive mother processing speed was fast between internalizing-only and low-symptom groups, t(82) = −2.65, p < .05, and by a significant difference in adoptive mother processing speed when birth mother processing speed was fast between the internalizing-only and low-symptom groups, t(81) = 2.30, p < .05. In visual inspection, the Birth Mother Processing Speed × Adoptive Mother Internalizing interaction appeared to be driven by inherited risk for slow processing speed in the internalizing-only group versus the low symptom group, when adoptive mother internalizing was high. However, the t-test of birth mother processing speed between internalizing-only and low-symptom groups at adoptive mother high internalizing did not approach significance (p > .10).
Post-hoc analyses for the Birth Mother Processing Speed × Adoptive Mother Internalizing term suggested that when adoptive mother internalizing was low, there were minimal differences in birth mother processing speed between co-occurring and low-symptoms groups, but when adoptive mother internalizing was high, having inherited risk for slow processing speed predicted co-occurring rather than low-symptom group membership. This was indicated by a marginally significant difference in birth mother processing speed between co-occurring and low-symptom groups when adoptive mother internalizing was high, t(88) = −1.95, p < .10.
Dimensionalized Problem Behavior Analyses (Internalizing and Externalizing Versus Low-Symptom)
As the next step in our analysis plan, the same SEM analyses were conducted (as described previously) to examine children with elevated internalizing symptoms (versus low symptoms) and externalizing symptoms (versus low symptoms) without considering if these children had co-occurring problems. The results from these dimensionalized 2-symptom group main effect and full models are presented in Table 5, with ORs for significant results presented in the text. In this set of analyses, main effect models found that uninvolved parenting significantly predicted membership in the externalizing rather than in the low-symptom group (OR: 3.76 [1.61–8.77]) and internalizing rather than in the low-symptom group (OR: 5.35 [2.20–12.99]). Obstetric complications (OR: 1.06 [1.02–1.10]) and adoption openness (OR: 1.41 [1.07–1.85]) significantly predicted membership in the externalizing rather than in the low-symptom group.
Table 5.
Hierarchical Logistic Regression Analysis Predicting Child-Symptom Group Membership Using Dimensionalized 2-Symptom Group Analysis Models With Co-Occurring Children Included in Both Externalizing and Internalizing Analyses
| Model results for exponentiated coefficients for Model 1 and Model 2 (standard errors)
|
||||
|---|---|---|---|---|
| Externalizing versus low symptom | Internalizing versus low symptom | |||
| Model 1 | Model 2 | Model 1 | Model 2 | |
| Birth mother (BM) | ||||
| Processing speed | .28 (.21) | .29 (.23) | .34 (.22) | .37 (.26) |
| Internalizing | .03 (.03) | .05 (.04) | −.00 (.04) | −.01 (.04) |
| Adoptive mother (AM) | ||||
| Processing speed | .09 (.28) | .07 (.29) | .01 (.30) | .03 (.32) |
| Internalizing | .02 (.04) | .03 (.04) | .03 (.05) | .04 (.05) |
| Uninvolved parenting | 1.32* (.52) | 1.14* (.54) | 1.68** (.54) | 1.54** (.58) |
| Interactions | ||||
| BM Processing Speed × AM Internalizing | — | .17* (.07) | — | .23** (.08) |
| BM Processing Speed × AM Processing Speed | — | .05 (.49) | — | −.84 (.51) |
| BM Processing Speed × AM Uninvolved parenting | — | .62 (.77) | — | −1.24 (.82) |
| BM Internalizing × AM Internalizing | — | .01 (.01) | — | .02 (.01) |
| BM Internalizing × AM Processing Speed | — | .03 (.14) | — | .07 (.15) |
| BM Internalizing × AM Uninvolved parenting | — | .16 (.15) | — | −.03 (.16) |
| Covariates | ||||
| Obstetric complications | .06* (.02) | .06* (.02) | .04 (.02) | .05* (.02) |
| Openness | .34* (.17) | .33* (.18) | .09 (.17) | .11 (.19) |
| Age | .07 (.07) | .09 (.08) | .06 (.08) | .11 (.09) |
| Gender | −.41 (.29) | −.46 (.30) | .11(.31) | .16 (.34) |
p < 0.05.
p < 0.01.
In the full, dimensionalized model, uninvolved parenting predicted membership in the internalizing rather than in the low-symptom group (OR: 4.67 [1.82–11.90]) and in the externalizing rather than in the low-symptom group (OR: 3.11 [1.29–7.52]). The interaction of Birth Mother Processing Speed × Adoptive Mother Internalizing symptoms was found to predict membership in the internalizing (OR: 1.26 [1.11–1.44]) and externalizing (OR: 1.19 [1.06–1.34]) versus low-symptom groups. Obstetric complications were found to predict internalizing (OR: 1.05 [1.01–1.09]) and externalizing (OR: 1.06 [1.02–01.10]) group membership. Finally, adoption openness was also found to predict externalizing (OR: 1.39 [1.03–1.87]) group membership. Child gender was no longer predictive of membership in the externalizing group.
Discussion
While examining genetic and environmental risk factors for child problem behaviors, this study found a distinctive risk profile for children with co-occurring symptoms. These findings are consistent with our hypothesis that inherited and social environmental risk factors would predict co-occurring problem behavior. Although some similar risk factors were found for the co-occurring and the internalizing-only groups, suggesting multifinality (i.e., Birth Mother Slower Processing Speed × Adoptive Mother Higher Internalizing symptoms), unique risk factors (i.e., the main effects of slow birth mother processing speed and uninvolved parenting) were also identified for co-occurring children. In addition, risk factors that predicted membership in the internalizing-only group were not found to predict co-occurring symptom group membership. Taken together, these findings suggest that certain risk factors for child problem behaviors may be particularly predictive of co-occurring (as opposed to either internalizing-only or externalizing-only) symptoms. The findings underscore the importance of examining children with co-occurring problem behavior as a distinct group.
Uninvolved parenting, as measured by adoptive mothers’ inconsistent discipline and poor monitoring, conferred significant risk for experiencing co-occurring symptoms. In prior research in both child and young adolescent samples, uninvolved parenting has been associated with externalizing and internalizing symptoms, but more consistently with externalizing problems (Barber, Stolz, Olsen, Collins & Burchinal 2005; Gonzales et al., 2000; Kilgore et al., 2000; Lengua & Kovacs, 2005). These findings are consistent with social learning theory, which suggests that coercive parent–child interactions occur when families use inconsistent contingencies of positive and negative (or punishing) reinforcers. In such circumstances, children may learn to use coercive (externalizing) behaviors, such as aggression, to escape situations that may be aversive (Patterson et al., 1989). Social learning theory also suggests that when a child experiences uninvolved parenting, he or she is less likely to be socialized to models of effective emotion regulation or the importance of compliance, which may lead to the emergence of problem behavior (Barber et al., 2005; Elgar et al., 2004).
Another risk pathway of interest for co-occurring symptom group membership was the main effect of birth mother slow processing speed (1A) and the interaction of birth mother slow processing speed combined with adoptive mother high internalizing symptoms. This interaction can be conceptualized as a poor social environment (i.e., adoptive mother internalizing) predicting the co-occurring problem phenotype, but only when children had inherited risk for slow processing speed. Consistent with the gene–environment interplay perspective, this association suggests that genetic risk for slow processing speed creates an inherited sensitivity to stressors in the social environment (Reiss et al., 2013).
Although the link between children’s co-occurring symptoms and maternal processing speed is novel, it is consistent with processing speed deficits previously found in children with co-occurring symptoms (Brunnekreef et al., 2007). It is also consistent with research that has revealed the combination of negative emotionality (potentially influenced by adoptive mother internalizing symptoms in our study sample) with lower cognitive skills as a key contributor to development of the co-occurring phenotype (Bubier & Drabick, 2009; Drabick et al., 2010). Given the established heritability of cognitive functions, such as processing speed, our findings suggest that a genetic liability for processing speed deficits may be associated with the development of co-occurring problems when the social environment is also poor (Friedman et al., 2008).
Child externalizing behavior was not associated with specific inherited or social environmental risk factors beyond the influence of obstetric complications. Although previous research has linked prenatal exposure to maternal internalizing symptoms with child externalizing problems, links between maternal internalizing symptoms prior to pregnancy (measured here) and externalizing problems are less established (Luoma et al., 2001; Van den Bergh & Marcoen, 2004). Prior research on postnatal maternal internalizing symptoms also suggests that some of the association with child externalizing behavior is mediated by prenatal risk experiences (potentially accounted for here by obstetric complications; Barker, Jaffee, Uher, & Maughan, 2011; Bonari & Koren, 2004). Given the evidence in previous research of uninvolved parenting contributing to externalizing behavior, it is noteworthy that this association was not found in our sample. A possible explanation could be that uninvolved parenting has a weaker association with externalizing behavior at ages 6–7 and may be more present in older children (Barber et al., 1994; Galambos, Barker, & Almeida, 2003). Alternatively, previous findings may be confounded by the inclusion of children with co-occurring problems; when we included co-occurring children in the externalizing group in dimensionalized analyses, a significant link was found between uninvolved parenting and externalizing symptoms.
Both a main effect of adoptive mother higher internalizing symptoms and interactions of adoptive mother internalizing symptoms and each birth mother risk factor (birth mother slower processing speed and birth mother higher internalizing symptoms) predicted internalizing-only rather than low-symptom group membership. This finding is consistent with findings from previous research, that environmental links exist between maternal internalizing symptoms and child internalizing symptoms above and beyond effects of maternal internalizing symptoms during the prenatal period (Barker et al., 2011). From a gene–environment interplay perspective, this suggests that a genetic liability for internalizing problems (i.e., high birth mother internalizing) may create an inherited sensitivity to the social environmental stressor of having an adoptive mother who is also experiencing internalizing symptoms (Lim, Wood, & Miller, 2008; Reiss et al., 2013). Because post-hoc t-tests investigating the Adoptive Mother Internalizing × Birth Mother Processing Speed did not approach significance, we refrain from interpreting the directionality of this interaction.
An investigation of the interaction between birth mother processing speed and adoptive mother uninvolved parenting suggests that if children had birth mothers without slow processing speed, the presence of uninvolved parenting would contribute risk to the development of internalizing-only symptoms rather than membership in the low-symptom group. This suggests the importance of uninvolved parenting for predicting child internalizing problems in the absence of inherited risk. A final interaction that predicted child internalizing-only group membership was a mismatch in processing speed between children’s birth and adoptive mothers. Although the effect of mismatch between parent–child cognitive function has not been previously reported, research in foster care samples with parent-report data has found that goodness of fit between parent and adolescent characteristics (e.g., temperament) may predict better family functioning and adjustment (Green, Braley, & Kisor, 1996).
Notably, when analyses were conducted using the dimensionalized approach of examining internalizing and externalizing behaviors without considering whether children in these groups also experienced co-occurring problems, a different pattern of results emerged. These findings suggest that studies that do not consider co-occurring symptoms run the risk of drawing spurious conclusions about risk pathways for externalizing or internalizing symptoms that may be better described as contributing risk for co-occurring problems. When co-occurring-symptom children were folded into the externalizing and internalizing groups, risk factors predicted externalizing and internalizing typologies that had previously been implicated only in the co-occurring typology group (e.g., uninvolved parenting). This outcome demonstrates the advantages of examining children with co-occurring problem behavior as a distinct group when one is investigating predictors of child problem behavior. However, we also note the potential challenges of interpreting findings for children with the co-occurring phenotype. Similar to some (but not all) previous studies, children in our sample with co-occurring problems exhibited higher externalizing symptoms than did the externalizing-only group, suggesting that children with co-occurring problems may represent a group with more severe symptomatology (reviewed in Oland & Shaw, 2005). Accordingly, risk factors that contributed specific risk for co-occurring symptoms (e.g., uninvolved parenting) could instead represent risk factors for higher levels of externalizing symptoms. Despite this interpretive limitation, we suggest that examining risk factors specific to the co-occurring symptom phenotype is appropriate because of the need to identify relevant risk factors for this understudied and highly at-risk group of children (Eisenberg et al., 2009; Stieben et al., 2007).
Certain limitations should be noted to contextualize the findings for future research. First, the relatively small sample size in each of the symptom groups (n = 23–45) may have resulted in underpowered analyses. This may have limited our ability to detect the predictive utility of specific risk factors and increased the likelihood of spurious results. The combination of maternal depression and anxiety symptoms into the internalizing variables is also a limitation; although similar patterns of risk are associated with maternal depression and with anxiety, differences also exist. Our combined maternal internalizing factor was chosen as an alternative to omitting the risk factors on the basis of the low incidence of internalizing symptoms on either scale taken alone, but it does not allow for delineation of effects resulting from maternal anxiety versus maternal depression. Considering the low incidence of clinically significant internalizing symptoms in birth and in adoptive mothers, it is possible that different results would have emerged in a sample that included mothers from clinical samples. Similarly, given that a substantial majority of the child sample does not exhibit clinically elevated behavior problems, it is unknown if these findings would be replicated in a higher risk sample. Finally, the self-report nature of all risk factors (except processing speed) may lead to biased results, which could be a particular confound for adoptive mother risk factors because adoptive mothers are also one of the informants of the outcome measures of child problem behavior. However, this concern is somewhat mitigated because both adoptive mother and father ratings of child problem behavior were included. The lack of inclusion of paternal risk factors is also a limitation. Findings should also be interpreted with caution and replicated in future research in that odds ratios for all risk factors, with the exception of uninvolved parenting, suggest small effect sizes.
Other potential risk factors for child problem behavior, such as maternal externalizing, were not examined in our study because comparable measures were not included for adoptive and birth mothers. The study was not designed to test transactions between psychopathologies (i.e., consequences of externalizing symptoms causing internalizing symptoms), which have been postulated as a possible mechanism underlying co-occurrence (Oland & Shaw, 2005). Future research should also examine the contributions of paternal risk factors and the potential moderating role of ethnic or cultural differences.
This investigation of inherited and social environmental risk factors that predict child problem behavior suggests that children with co-occurring symptoms should be studied as a unique phenotypic group. Although prior research with twin samples has estimated significant roles of both genetic and environmental factors in the etiology of co-occurring externalizing and internalizing problems (Cosgrove et al., 2011; O’Connor, McGuire, Reiss, Hetherington, & Plomin, 1998), such studies are rarely able to examine the role of specific risk factors (Jaffee, Moffitt, Caspi, Taylor, & Arseneault, 2002). Our study findings add to the literature by suggesting a distinctive etiological path to co-occurrence through a range of both inherited and social environmental influences (Fanti & Henrich, 2010; Oldehinkel, Hartman, De Winter, Veenstra, & Ormel, 2004). We also highlight risk factors for co-occurring symptoms (i.e., processing speed, uninvolved parenting) to inform future research in this area. In research that has previously examined externalizing and internalizing symptoms, it may be relevant to reanalyze the data to specifically examine or exclude children with co-occurring problems so that results for internalizing and/or externalizing symptoms are not confounded with findings more relevant for the development of co-occurring symptoms. Through more precise research investigating predictors of co-occurring problem behavior, interventions may be better targeted to meet the needs of this high-risk group of children.
Supplementary Material
Acknowledgments
This project was supported by R01 HD042608 from NICHD, NIDA, and OBSSR, NIH, U.S. PHS (PI Years 1–5: David Reiss; PI Years 6–10: Leslie Leve); R01 MH092118 from NIMH, NIH, U.S. PHS (PIs: Jenae Neiderhiser and Leslie Leve); R01 DA020585 from NIDA, NIMH and OBSSR, NIH, U.S. PHS (PI: Jenae Neiderhiser); and P50 DA035763 from NIDA, NIH, U.S. PHS (PIs: Patricia Chamberlain and Philip Fisher). The content is solely the responsibility of the authors and does not necessarily represent the official views of the Eunice Kennedy Shriver National Institute of Child Health & Human Development or the National Institutes of Health.
We would like to thank the birth parents and adoptive families who participated in this study and the adoption agencies who helped with the recruitment of study participants. We gratefully acknowledge Rand Conger, John Reid, Xiaojia Ge, Jody Ganiban, and Laura Scaramella for their contributions to the larger study.
Footnotes
The content is solely the responsibility of the authors and does not necessarily represent the official views of the Eunice Kennedy Shriver National Institute of Child Health & Human Development or the National Institutes of Health.
References
- Achenbach TM. Integrative guide for the 1991 CBCL/4–18, YSR, and TRF profiles. Burlington: Department of Psychiatry, University of Vermont; 1991. [Google Scholar]
- Bandura A. Social foundations of thought and action. Englewood Cliffs, NJ: Prentice Hall; 1986. pp. 5–107. [Google Scholar]
- Barber BK, Olsen JE, Shagle SC. Associations between parental psychological and behavioral control and youth internalized and externalized behaviors. Child Development. 1994;65:1120–1136. [PubMed] [Google Scholar]
- Barber BK, Stolz HE, Olsen JA, Collins A, Burchinal M. Parental support, psychological control, and behavioral control: Assessing relevance across time, culture, and method: Abstract. Monographs of the Society for Research in Child Development. 2005;70(4):vii, 125–137. doi: 10.1111/j.1540-5834.2005.00365.x. doi: http://dx.doi.org/10.1111/j.1540-5834.2005.00365.x. [DOI] [PubMed] [Google Scholar]
- Barker ED, Jaffee SR, Uher R, Maughan B. The contribution of prenatal and postnatal maternal anxiety and depression to child maladjustment. Depression and Anxiety. 2011;28:696–702. doi: 10.1002/da.20856. [DOI] [PubMed] [Google Scholar]
- Baumrind D. Current patterns of parental authority. Developmental Psychology. 1971;4(1):1–103. [Google Scholar]
- Beaujean AA. Heritability of cognitive abilities as measured by mental chronometric tasks: A meta-analysis. Intelligence. 2005;33:187–201. [Google Scholar]
- Beck AT, Steer RA. Beck Anxiety Inventory manual. San Antonio, TX: The Psychological Corporation; 1993. [Google Scholar]
- Beck AT, Steer RA, Carbin MG. Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review. 1988;8:77–100. [Google Scholar]
- Belsky J, Pluess M. Beyond diathesis stress: Differential susceptibility to environmental influences. Psychological Bulletin. 2009;135(6):885. doi: 10.1037/a0017376. [DOI] [PubMed] [Google Scholar]
- Bögels SM, Brechman-Toussaint ML. Family issues in child anxiety: Attachment, family functioning, parental rearing and beliefs. Clinical Psychology Review. 2006;26:834–856. doi: 10.1016/j.cpr.2005.08.001. [DOI] [PubMed] [Google Scholar]
- Bonari L, Koren G. Perinatal risks of untreated depression during pregnancy. Canadian Journal of Psychiatry. 2004;49:726–735. doi: 10.1177/070674370404901103. [DOI] [PubMed] [Google Scholar]
- Brennan LM, Shaw DS. Revisiting data related to the age of onset and developmental course of female conduct problems. Clinical Child and Family Psychology Review. 2013;16:35–58. doi: 10.1007/s10567-012-0125-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Breznitz Z, Sherman T. Speech patterning of natural discourse of well and depressed mothers and their young children. Child Development. 1987:395–400. [PubMed] [Google Scholar]
- Brunnekreef JA, De Sonneville LM, Althaus M, Minderaa RB, Oldehinkel AJ, Verhulst FC, Ormel J. Information processing profiles of internalizing and externalizing behavior problems: Evidence from a population-based sample of preadolescents. Journal of Child Psychology and Psychiatry. 2007;48:185–193. doi: 10.1111/j.1469-7610.2006.01695.x. [DOI] [PubMed] [Google Scholar]
- Bubier JL, Drabick DA. Co-occurring anxiety and disruptive behavior disorders: The roles of anxious symptoms, reactive aggression, and shared risk processes. Clinical Psychology Review. 2009;29:658–669. doi: 10.1016/j.cpr.2009.08.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burt SA. Rethinking environmental contributions to child and adolescent psychopathology: A meta-analysis of shared environmental influences. Psychological Bulletin. 2009;135(4):608. doi: 10.1037/a0015702. [DOI] [PubMed] [Google Scholar]
- Cicchetti D. The emergence of developmental psychopathology. Child Development. 1984;55:1–7. [PubMed] [Google Scholar]
- Cicchetti D. An overview of developmental psychopathology. The Oxford Handbook of Developmental Psychology. 2013;2:455–480. [Google Scholar]
- Cicchetti D, Rogosch FA. Equifinality and multifinality in developmental psychopathology. Development and Psychopathology. 1996;8:597–600. [Google Scholar]
- Connell AM, Goodman SH. The association between psychopathology in fathers versus mothers and children’s internalizing and externalizing behavior problems: A meta-analysis. Psychological Bulletin. 2002;128:746–773. doi: 10.1037/0033-2909.128.5.746. [DOI] [PubMed] [Google Scholar]
- Cosgrove VE, Rhee SH, Gelhorn HL, Boeldt D, Corley RC, Ehringer MA, Hewitt JK. Structure and etiology of co-occurring internalizing and externalizing disorders in adolescents. Journal of Abnormal Child Psychology. 2011;39:109–123. doi: 10.1007/s10802-010-9444-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dawson G, Ashman SB, Panagiotides H, Hessl D, Self J, Yamada E, Embry L. Preschool outcomes of children of depressed mothers: Role of maternal behavior, contextual risk, and children’s brain activity. Child Development. 2003;74(4):1158–1175. doi: 10.1111/1467-8624.00599. doi: http://dx.doi.org/10.1111/1467-8624.00599. [DOI] [PubMed] [Google Scholar]
- De Rosnay M, Cooper PJ, Tsigaras N, Murray L. Transmission of social anxiety from mother to infant: An experimental study using a social referencing paradigm. Behaviour Research and Therapy. 2006;44(8):1165–1175. doi: 10.1016/j.brat.2005.09.003. [DOI] [PubMed] [Google Scholar]
- Deater-Deckard K, Plomin R. An adoption study of the etiology of teacher and parent reports of externalizing behavior problems in middle childhood. Child Development. 1999;70(1):144–154. doi: 10.1111/1467-8624.00011. [DOI] [PubMed] [Google Scholar]
- Dishion TJ. Cross-setting consistency in early adolescent psychopathology: Deviant friendships and problem behavior sequelae. Journal of Personality. 2000;68:1109–1126. doi: 10.1111/1467-6494.00128. [DOI] [PubMed] [Google Scholar]
- Dishion TJ, McMahon RJ. Parental monitoring and the prevention of child and adolescent problem behavior: A conceptual and empirical formulation. Clinical Child and Family Psychology Review. 1998;1(1):61–75. doi: 10.1023/a:1021800432380. [DOI] [PubMed] [Google Scholar]
- Drabick DA, Ollendick TH, Bubier JL. Co-occurrence of ODD and anxiety: Shared risk processes and evidence for a dual-pathway model. Clinical Psychology: Science and Practice. 2010;17:307–318. doi: 10.1111/j.1468-2850.2010.01222.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eisenberg N, Cumberland A, Spinrad TL, Fabes RA, Shepard SA, Reiser M, Guthrie IK. The relations of regulation and emotionality to children’s externalizing and internalizing problem behavior. Child Development. 2001;72:1112–1134. doi: 10.1111/1467-8624.00337. [DOI] [PubMed] [Google Scholar]
- Eisenberg N, Valiente C, Spinrad TL, Cumberland A, Liew J, Reiser M, Losoya SH. Longitudinal relations of children’s effortful control, impulsivity, and negative emotionality to their externalizing, internalizing, and co-occurring behavior problems. Developmental Psychology. 2009;45:988. doi: 10.1037/a0016213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Elgar FJ, McGrath PJ, Waschbusch DA, Stewart SH, Curtis LJ. Mutual influences on maternal depression and child adjustment problems. Clinical Psychology Review. 2004;24(4):441–459. doi: 10.1016/j.cpr.2004.02.002. [DOI] [PubMed] [Google Scholar]
- Fanti KA, Henrich CC. Trajectories of pure and co-occurring internalizing and externalizing problems from age 2 to age 12: Findings from the National Institute of Child Health and Human Development Study of Early Child Care. Developmental Psychology. 2010;46:1159–1175. doi: 10.1037/a0020659. [DOI] [PubMed] [Google Scholar]
- Feldman R, Granat A, Pariente C, Kanety H, Kuint J, Gilboa-Schechtman E. Maternal depression and anxiety across the postpartum year and infant social engagement, fear regulation, and stress reactivity. Journal of the American Academy of Child & Adolescent Psychiatry. 2009;48:919–927. doi: 10.1097/CHI.0b013e3181b21651. [DOI] [PubMed] [Google Scholar]
- Fite PJ, Stoppelbein L, Greening L, Dhossche D. Child internalizing and externalizing behavior as predictors of age at first admission and risk for repeat admission to a child inpatient facility. American Journal of Orthopsychiatry. 2008;78:63–69. doi: 10.1037/0002-9432.78.1.63. [DOI] [PubMed] [Google Scholar]
- Fox NA, Henderson HA, Marshall PJ, Nichols KE, Ghera MM. Behavioral inhibition: Linking biology and behavior within a developmental framework. Annual Review of Psychology. 2005;56:235–262. doi: 10.1146/annurev.psych.55.090902.141532. [DOI] [PubMed] [Google Scholar]
- Friedman NP, Miyake A, Young SE, DeFries JC, Corley RP, Hewitt JK. Individual differences in executive functions are almost entirely genetic in origin. Journal of Experimental Psychology: General. 2008;137:201–225. doi: 10.1037/0096-3445.137.2.201. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Galambos NL, Barker ET, Almeida DM. Parents do matter: Trajectories of change in externalizing and internalizing problems in early adolescence. Child Development. 2003;74:578–594. doi: 10.1111/1467-8624.7402017. [DOI] [PubMed] [Google Scholar]
- Ge X, Natsuaki MN, Martin DM, Leve LD, Neiderhiser JM, Shaw DS, Reiss D. Bridging the divide: Openness in adoption and postadoption psychosocial adjustment among birth and adoptive parents. Journal of Family Psychology. 2008;22:529–540. doi: 10.1037/a0012817. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goldsmith HH, Pollak SD, Davidson RJ. Developmental neuroscience perspectives on emotion regulation. Child Development Perspectives. 2008;2:132–140. doi: 10.1111/j.1750-8606.2008.00055.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gonzales NA, Pitts SC, Hill NE, Roosa MW. A mediational model of the impact of interparental conflict on child adjustment in a multiethnic, low-income sample. Journal of Family Psychology. 2000;14:365–379. doi: 10.1037//0893-3200.14.3.365. [DOI] [PubMed] [Google Scholar]
- Goodman SH, Gotlib IH. Risk for psychopathology in the children of depressed mothers: A developmental model for understanding mechanisms of transmission. Psychological Review. 1999;106(3):458. doi: 10.1037/0033-295x.106.3.458. [DOI] [PubMed] [Google Scholar]
- Green RG, Braley D, Kisor A. Matching adolescents with foster mothers and fathers: An evaluation of the role of temperament. Journal of Child and Family Studies. 1996;5:267–283. [Google Scholar]
- Hoffman C, Crnic KA, Baker JK. Maternal depression and parenting: Implications for children’s emergent emotion regulation and behavioral functioning. Parenting: Science and Practice. 2006;6(4):271–295. [Google Scholar]
- Howes C. Can the age of entry into child care and the quality of child care predict adjustment in kindergarten? Developmental Psychology. 1990;26(2):292. [Google Scholar]
- Jaffee SR, Moffitt TE, Caspi A, Taylor A, Arseneault L. Influence of adult domestic violence on children’s internalizing and externalizing problems: An environmentally informative twin study. Journal of the American Academy of Child & Adolescent Psychiatry. 2002;41:1095–1103. doi: 10.1097/00004583-200209000-00010. Reference blinded for review. [DOI] [PubMed] [Google Scholar]
- Kilgore K, Snyder J, Lentz C. The contribution of parental discipline, parental monitoring, and school risk to early-onset conduct problems in African American boys and girls. Developmental Psychology. 2000;36(6):835–845. doi: 10.1037//0012-1649.36.6.835. [DOI] [PubMed] [Google Scholar]
- Kusche CA, Cook ET, Greenberg MT. Neuropsychological and cognitive functioning in children with anxiety, externalizing, and comorbid psychopathology. Journal of Clinical Child Psychology. 1993;22:172–195. [Google Scholar]
- Lavigne JV, Gibbons RD, Christoffel KK, Arend R, Rosenbaum D, Binns H, Isaacs C. Prevalence rates and correlates of psychiatric disorders among preschool children. Journal of the American Academy of Child & Adolescent Psychiatry. 1996;35:204–214. doi: 10.1097/00004583-199602000-00014. [DOI] [PubMed] [Google Scholar]
- Lengua LJ, Kovacs EA. Bidirectional associations between temperament and parenting and the prediction of adjustment problems in middle childhood. Journal of Applied Developmental Psychology. 2005;26:21–38. [Google Scholar]
- Leve LD, Kim HK, Pears KC. Childhood temperament and family environment as predictors of internalizing and externalizing trajectories from ages 5 to 17. Journal of Abnormal Child Psychology. 2005;33:505–520. doi: 10.1007/s10802-005-6734-7. Reference blinded for review. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lilienfeld SO. Comorbidity between and within childhood externalizing and internalizing disorders: Reflections and directions. Journal of Abnormal Child Psychology. 2003;31:285–291. doi: 10.1023/a:1023229529866. [DOI] [PubMed] [Google Scholar]
- Lim J, Wood BL, Miller BD. Maternal depression and parenting in relation to child internalizing symptoms and asthma disease activity. Journal of Family Psychology. 2008;22:264–273. doi: 10.1037/0893-3200.22.2.264. [DOI] [PubMed] [Google Scholar]
- Luoma I, Tamminen T, Kaukonen P, Laippala P, Puura K, Salmelin R, Almqvist F. Longitudinal study of maternal depressive symptoms and child well-being. Journal of the American Academy of Child & Adolescent Psychiatry. 2001;40:1367–1374. doi: 10.1097/00004583-200112000-00006. [DOI] [PubMed] [Google Scholar]
- Maccoby EE, Martin J. Socialization in the context of the family: Parent–child interaction. In: Müssen PH, Hetherington EM, editors. Handbook of child psychology: Vol. 4. Socialization, personality, and social development. New York, NY: Wiley; 1983. pp. 1–101. [Google Scholar]
- Marceau K, Ram N, Neiderhiser JM, Laurent HK, Shaw DS, Fisher P, Leve LD. Disentangling the effects of genetic, prenatal and parenting influences on children’s cortisol variability. Stress. 2013;16:607–615. doi: 10.3109/10253890.2013.825766. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Masten AS, Roisman GI, Long JD, Burt KB, Obradović J, Riley JR, Tellegen A. Developmental cascades: Linking academic achievement and externalizing and internalizing symptoms over 20 years. Developmental Psychology. 2005;41:733. doi: 10.1037/0012-1649.41.5.733. [DOI] [PubMed] [Google Scholar]
- McConaughy SH, Skiba RJ. Comorbidity of externalizing and internalizing problems. School Psychology Review. 1993;22:421–436. [Google Scholar]
- McLeod BD, Wood JJ, Weisz JR. Examining the association between parenting and childhood anxiety: A meta-analysis. Clinical Psychology Review. 2007;27:155–172. doi: 10.1016/j.cpr.2006.09.002. [DOI] [PubMed] [Google Scholar]
- McWayne C, Fantuzzo J, Cohen HL, Sekino Y. A multivariate examination of parent involvement and the social and academic competencies of urban kindergarten children. Psychology in the Schools. 2004;41(3):363–377. [Google Scholar]
- Moffitt TE, Arseneault L, Belsky D, Dickson N, Hancox RJ, Harrington H, Caspi A. A gradient of childhood self-control predicts health, wealth, and public safety. Proceedings of the National Academy of Sciences. 2011;108:2693–2698. doi: 10.1073/pnas.1010076108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morris AS, Silk JS, Steinberg L, Myers SS, Robinson LR. The role of the family context in the development of emotion regulation. Social Development. 2007;16:361–388. doi: 10.1111/j.1467-9507.2007.00389.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murray L, Creswell C, Cooper PJ. The development of anxiety disorders in childhood: An integrative review. Psychological Medicine. 2009;39(9):1413–1423. doi: 10.1017/S0033291709005157. doi: http://dx.doi.org/10.1017/S0033291709005157. [DOI] [PubMed] [Google Scholar]
- Muthén BO, Muthén L. Mplus version 6. Los Angeles, CA: University of California, Los Angeles; 2010. [Google Scholar]
- O’Connor TG, Matias C, Futh A, Tantam G, Scott S. Social learning theory parenting intervention promotes attachment-based caregiving in young children: Randomized clinical trial. Journal of Clinical Child & Adolescent Psychology. 2013;42(3):358–370. doi: 10.1080/15374416.2012.723262. [DOI] [PubMed] [Google Scholar]
- O’Connor TG, McGuire S, Reiss D, Hetherington EM, Plomin R. Co-occurrence of depressive symptoms and antisocial behavior in adolescence: A common genetic liability. Journal of Abnormal Psychology. 1998;107:27–37. doi: 10.1037//0021-843x.107.1.27. [DOI] [PubMed] [Google Scholar]
- Oland AA, Shaw DS. Pure versus co-occurring externalizing and internalizing symptoms in children: The potential role of socio–developmental milestones. Clinical Child and Family Psychology Review. 2005;8:247–270. doi: 10.1007/s10567-005-8808-z. [DOI] [PubMed] [Google Scholar]
- Oldehinkel AJ, Hartman CA, De Winter AF, Veenstra R, Ormel J. Temperament profiles associated with internalizing and externalizing problems in preadolescence. Development and Psychopathology. 2004;16:421–440. doi: 10.1017/s0954579404044591. [DOI] [PubMed] [Google Scholar]
- Pardini D, White HR, Stouthamer-Loeber M. Early adolescent psychopathology as a predictor of alcohol use disorders by young adulthood. Drug and Alcohol Dependence. 2007;88:S38–S49. doi: 10.1016/j.drugalcdep.2006.12.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patterson GR, DeBaryshe BD, Ramsey E. A developmental perspective on antisocial behavior. American Psychologist. 1989;44:329–335. doi: 10.1037/0003-066X.44.2.329. Reference blinded for review. [DOI] [PubMed] [Google Scholar]
- Qi CH, Kaiser AP. Behavior problems of preschool children from low-income families review of the literature. Topics in Early Childhood Special Education. 2003;23:188–216. [Google Scholar]
- Racer KH, Dishion TJ. Disordered attention: Implications for understanding and treating internalizing and externalizing disorders in childhood. Cognitive and Behavioral Practice. 2012;19:31–40. doi: 10.1016/j.cbpra.2010.06.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reiss D, Leve LD, Neiderhiser JM. How genes and the social environment moderate each other. American Journal of Public Health. 2013;103(S1):S111–S121. doi: 10.2105/AJPH.2013.301408. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salthouse TA. The processing-speed theory of adult age differences in cognition. Psychological Review. 1996;103:403. doi: 10.1037/0033-295x.103.3.403. [DOI] [PubMed] [Google Scholar]
- Shaw DS, Criss M, Schonberg M, Beck J. The development of family hierarchies and their relation to children’s conduct problems. Development and Psychopathology. 2004;16(3):483–500. doi: 10.1017/s0954579404004638. [DOI] [PubMed] [Google Scholar]
- Shelton KK, Frick PJ, Wootton J. Assessment of parenting practices in families of elementary school-age children. Journal of Clinical Child Psychology. 1996;25:317–329. [Google Scholar]
- Simmel C, Brooks D, Barth RP, Hinshaw SP. Externalizing symptomatology among adoptive youth: Prevalence and preadoption risk factors. Journal of Abnormal Child Psychology. 2001;29:57–69. doi: 10.1023/a:1005251513130. [DOI] [PubMed] [Google Scholar]
- Stieben J, Lewis MD, Granic I, Zelazo PD, Segalowitz S, Pepler D. Neurophysiological mechanisms of emotion regulation for subtypes of externalizing children. Development and Psychopathology. 2007;19:455–480. doi: 10.1017/S0954579407070228. [DOI] [PubMed] [Google Scholar]
- Stormshak EA, Bierman KL, McMahon RJ, Lengua LJ. Parenting practices and child disruptive behavior problems in early elementary school. Journal of Clinical Child Psychology. 2000;29(1):17–29. doi: 10.1207/S15374424jccp2901_3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Strauss GP, Allen DN, Jorgensen ML, Cramer SL. Test–retest reliability of standard and emotional stroop tasks an investigation of color-word and picture-word versions. Assessment. 2005;12:330–337. doi: 10.1177/1073191105276375. [DOI] [PubMed] [Google Scholar]
- Stroop JR. Studies of interference in serial verbal reactions. Journal of Experimental Psychology. 1935;18:643. [Google Scholar]
- Supplee LH, Unikel EB, Shaw DS. Physical environmental adversity and the protective role of maternal monitoring in relation to early child conduct problems. Journal of Applied Developmental Psychology. 2007;28(2):166–183. doi: 10.1016/j.appdev.2006.12.001. doi: http://dx.doi.org/10.1016/j.appdev.2006.12.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van den Bergh BR, Marcoen A. High antenatal maternal anxiety is related to ADHD symptoms, externalizing problems, and anxiety in 8 and 9 year olds. Child Development. 2004;75:1085–1097. doi: 10.1111/j.1467-8624.2004.00727.x. [DOI] [PubMed] [Google Scholar]
- Whelan R. Effective analysis of reaction time data. The Psychological Record. 2010;58:475–482. [Google Scholar]
- White BA, Jarrett MA, Ollendick TH. Self-regulation deficits explain the link between reactive aggression and internalizing and externalizing behavior problems in children. Journal of Psychopathology and Behavioral Assessment. 2013;35:1–9. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

