Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2013 Dec 28.
Published in final edited form as: Dev Psychopathol. 2013 May;25(2):10.1017/S0954579412001150. doi: 10.1017/S0954579412001150

Codevelopment of externalizing and internalizing symptoms in middle to late childhood: Sex, baseline respiratory sinus arrhythmia, and respiratory sinus arrhythmia reactivity as predictors

J Benjamin Hinnant a, Mona EL-Sheikh b
PMCID: PMC3874140  NIHMSID: NIHMS496002  PMID: 23627954

Abstract

We investigated the roles of sex and respiratory sinus arrhythmia (RSA), an index of autonomic parasympathetic nervous system activity, as predictors of codeveloping externalizing and internalizing symptoms in middle childhood. We expected that sex, baseline RSA (RSA-B), and RSA reactivity (RSA-R) to two types of tasks would interact to differentiate co-occurring trajectories of symptoms. We tested these hypotheses by combining longitudinal data from two independent samples (n = 390; 210 girls, 180 boys) with repeated measures at ages 8, 9, 10, and 11. RSA-R was measured in response to a socially stressful and frustrating stressor. Indicators of growth in externalizing and internalizing symptoms were derived from multiple domain growth models and used in person-centered growth mixture analyses. Three groups of externalizing and internalizing trajectories were found. Profile membership was predicted by several two-way interactions among sex, RSA-B, or RSA-R but was not predicted by three-way interactions. Children with low RSA-B and strong RSA withdrawal, girls with low RSA-B, and girls with strong RSA withdrawal were more likely to be on a developmental trajectory of low externalizing symptoms and moderately elevated internalizing symptoms. Membership in the high externalizing and high internalizing trajectory was predicted by weak RSA withdrawal for boys and strong RSA withdrawal for girls. The type of stressor task also played a role in predicting probability of profile membership. Results are discussed in the context of developmental psychobiology and implications for the codevelopment of psychopathology symptoms in childhood.


Psychiatric disorders in children co-occur at rates much higher than would be expected by chance (Angold & Costello, 1993; Bird, Gould, & Staghezzi, 1993) and codevelop at high rates as well (Kovacs, Paulauskas, Gatsonis, & Richards, 1988). Even among seemingly minimally related disorders that involve distinctly different symptoms, such as conduct disorder and depression, comorbidity rates are high. This co-occurrence of disorders across similar and different domains has been termed homotypic and heterotypic comorbidity (Angold, Costello, & Erkanli, 1999). A meta-analysis on this topic revealed that individuals with depression were 8.2 times more likely to be diagnosed with an anxiety disorder (an example of homotypic comorbidity), while individuals with a conduct disorder were 6.6 and 3.1 times more likely to be diagnosed with a depressive or anxiety disorder, respectively (examples of heterotypic comorbidity; Angold et al., 1999). The heterotypic comorbidity of externalizing and internalizing problems could be summarized as “bad things are related to other bad things,” and it has been quite difficult to untangle why individuals develop primarily externalizing problems, internalizing problems, or co-occurring problems. Our objective was to examine the heterotypic codevelopment of children's externalizing and internalizing symptoms within individuals and investigate whether children's membership in codeveloping externalizing–internalizing trajectories can be differentially predicted by sex and biological risk and protective factors as indexed by parasympathetic nervous system (PNS) activity.

Codevelopment of Symptoms

Researchers have continued to investigate the seeming puzzle of why disorders with such different symptoms co-occur. These efforts have emphasized moving beyond the descriptive to the use of theory-driven longitudinal studies in conjunction with putative risk factors to uncover the etiology of co-occurring and codeveloping externalizing and internalizing problems (Angold et al., 1999; Boylan, Vaillancourt, Boyle, & Szatmari, 2007; Zahn-Waxler, Shirtcliff, & Marceau, 2008). Our recent search of the literature revealed more than 60 published manuscripts since 1990 that focused on the development of both externalizing and internalizing symptoms in childhood and adolescence. The vast majority of these papers also included environmental characteristics such as peer relations (e.g., Brendgen, Vitaro, Bukowski, Doyle, & Markiewicz, 2001; Dekovic, Buist, & Reitz, 2004; Fanti & Henrich, 2010; Galambos, Barker, & Almeida, 2003; Keiley, Bates, Dodge, & Pettit, 2000), parent–child relations (e.g., Dekovic et al., 2004; Galambos et al., 2003; Gilliom & Shaw, 2004; Hollenstein, Granic, Stoolmiller, & Snyder, 2004), and individual psychological characteristics such as emotion regulation, trait emotionality, and impulsivity (e.g., Eisenberg et al., 2009; Gilliom & Shaw, 2004) as correlates or predictors of the development of externalizing and internalizing symptoms. Physiological regulatory systems also play an important role in the expression of externalizing and internalizing symptoms (Beauchaine, 2001; Thayer & Lane, 2009), but relatively few studies have evaluated the impact of physiological systems on change in symptoms over time and none have investigated how physiological systems are related to codeveloping externalizing and internalizing symptoms within individuals.

Respiratory Sinus Arrhythmia (RSA)

The study of physiological stress response systems has facilitated understanding of the development of psychopathology (Cicchetti & Gunnar, 2008; van Goozen & Fairchild, 2008). One particularly informative area of study has emphasized investigations of autonomic nervous system (ANS) activity, and a substantial literature has developed around the study of the parasympathetic branch of the ANS. Both branches of the ANS (PNS and sympathetic nervous system) are grounded in and controlled by central nervous system activity and can be traced through hierarchical, bidirectional connections to multiple brain structures (Berthoud & Neuhuber, 2000; Saper, 2002; Ulrich-Lai & Herman, 2009).

The PNS is responsible for “rest and digest” bodily functions but also has an important role in how the body copes with stress (Porges, 2003, 2007). It is a first-response coping system that can respond very quickly to environmental cues, on the order of milliseconds, as compared to the sympathetic nervous system, which operates on the order of seconds (Saul, 1990). Research delving into psychophysiology and bioregulatory processes has offered critical insights into how PNS activity is related to symptoms of psychopathology (Beauchiane, 2001; Porges, 2007; Thayer & Lane, 2009). Porges's polyvagal theory explains the important role of PNS function as part of a hierarchical stress response system wherein (evolutionarily) older stress response systems are activated when more recently developed stress response systems (i.e., the PNS) are insufficient for coping. This most recent evolutionary development of the body's stress response system includes the ventral vagal complex and facilitates engagement with the environment by promoting incremental changes in heart rate to support attentional control, emotion regulation, and the of use appropriate social strategies.

PNS influence through the vagus is commonly assessed via RSA. RSA is the variability in heart rate owing to respiration (heart rate increases during inspiration and decreases during exhalation) and, when specific conditions are met, reflects parasympathetic–vagal influence (Berntson, Cacioppo, & Grossman, 2007). Where appropriate, from this point forward we use RSA to refer specifically to the operationalized assessments of PNS influence on the heart that are used in relevant studies. Consistent with functional PNS–hypothalamic–limbic connections, RSA both at rest and in response to stress is associated with emotion and emotion regulation (Kreibig, 2010; Lane et al., 2009; Mauss & Robinson, 2009; Vasilev, Crowell, Beauchaine, Mead, & Gatzke-Kopp, 2009). Higher baseline RSA (RSA-B) is thought to index the physiological capacity to engage in and cope with environmental stress (Porges, 1995) and trait positive emotionality (Oveis et al., 2009). RSA reactivity (RSA-R; indicated by changes in RSA from baseline) is thought to index active and adaptive physiological engagement with the environment, with greater RSA withdrawal (i.e., decreases in RSA from baseline) being positively associated with attentional, emotional, and behavioral self-regulation at a wide range of ages (Calkins & Keane, 2004; Gentzler, Santucci, Kovacs, & Fox, 2009; Graziano, Keane, & Calkins, 2007; Suess, Porges, & Plude, 1994). For the sake of simplicity, we specify RSA-R as being stronger RSA-R (greater than average RSA withdrawal) or weaker RSA-R (less than average RSA withdrawal or increases in RSA from resting levels, sometimes termed RSA activation) when referring to results of studies.

RSA-B and RSA-R have consistently been linked to children's and adolescents' externalizing and internalizing symptoms (for a review see Beauchaine, 2001), though longitudinal studies in this area are scarce. Lower RSA-B appears to function as a nonspecific risk factor for externalizing and internalizing symptoms (Beauchaine, Gatzke-Kopp, & Mead, 2007; Calkins & Dedmon, 2000; El-Sheikh & Hinnant, 2011; Forbes, Fox, Cohn, Galles, & Kovacs, 2006; Hinnant & El-Sheikh, 2009) in both clinical and community samples. The relation between lower RSA-B and adjustment problems may be mediated by deficits in attention and social engagement mechanisms, emotion regulation problems, and low positive emotionality; null findings of associations between RSA-B and adjustment have also been reported, however (Calkins, Graziano, & Keane, 2007).

Whereas RSA withdrawal to multiple cognitive challenges has been associated with social competence and adaptive self-regulation in community samples (e.g., Graziano et al., 2007), excessive RSA withdrawal to simulated peer rejection has also been associated with internalizing problems and social exclusion (Gazelle & Druhen, 2009). Thus, the nature of the stressor (e.g., cognitive vs. social) may play a role in the prediction of adjustment. Beauchaine and colleagues (Beauchaine, 2001; Beauchaine et al., 2007) proposed and tested the hypothesis that lower RSA-B in combination with excessive RSA withdrawal may serve as a physiological index of lowered trait capacity for self-regulation and emotional lability in response to stress, with the final result being the physiological dysregulation partially underlying panic, anxiety, and reactive forms of aggression. Consistent with allostatic load theory (McEwen & Stellar, 1993), the depletion of resources in physiological stress response systems that is driven by chronic exposure to stress may be reflected in decreases in function of stress response systems in a resting state (e.g., decreased RSA-B over time; El-Sheikh & Hinnant, 2011).

Recent research supports the importance of interactions between RSA-B and RSA withdrawal in the prediction of psychopathology symptoms. For example, lower RSA-B in combination with greater RSA withdrawal to a social stressor (hearing a staged argument between adults) predicted increased internalizing symptoms over time (controlling for prior externalizing and internalizing symptoms); however, lower RSA-B in combination with weaker RSA withdrawal to a cognitively frustrating stressor (tracing an outline of a star while looking in a mirror) predicted increased externalizing symptoms (controlling for prior symptoms; Hinnant & El-Sheikh, 2009). Similar longitudinal results have been found in another study and sample; boys with lower RSA-B and weaker RSA-R evidenced increasing delinquency symptoms over time while symptoms for other children were stable or declining (El-Sheikh, Hinnant, & Erath, 2011). Collectively, these findings highlight the importance of contemporaneous assessments of RSA during resting and reactivity conditions, and examinations of interactions between them, in the prediction of psychopathology symptoms. Results also suggest that the particular laboratory tasks used to elicit RSA withdrawal are pertinent for the prediction of child outcomes. We believe that, in combination with lower RSA-B (which is tied to poorer potential for emotion regulation and trait negative emotionality), strong RSA withdrawal promotes a physiological state related to emotion dysregulation, hypervigilance, and internalizing symptoms in which high levels of anxiety are a core characteristic. Lower RSA-B and weaker RSA withdrawal, in contrast, may promote a physiological state related to emotional disengagement, callous behavior, and externalizing symptoms such as increased instrumental aggression, bullying, and delinquent acts.

A few studies with community samples have evaluated the relations between RSA and co-occurring externalizing and internalizing symptoms within individuals. Boyce et al. (2001) used mother- and teacher-reported child symptoms to define groups of children who were normative, high internalizers, high externalizers, or high on both. They found that children with higher internalizing symptoms exhibited stronger RSA withdrawal to a range of social, cognitive, physical, and emotional tasks (RSA-R was composited) than did control children. Children with higher externalizing symptoms exhibited weaker RSA withdrawal than did control children, and children higher on both types of symptoms were not differentiated from control children by RSA-R. Calkins and colleagues (2007) employed a larger sample and used clinical risk t scores to define three groups of children: low risk for problems, risk for externalizing problems, and risk for internalizing–externalizing problems. Consistent with the findings of Boyce and colleagues, children at risk for externalizing problems exhibited weaker RSA withdrawal across a range of self-regulatory, attentional, and emotional tasks than did children at risk for internalizing–externalizing problems. Differences between the low-risk group and the other groups were marginally significant, with the overall pattern indicating weaker RSA withdrawal in the externalizing only group, stronger RSA withdrawal in the internalizing–externalizing group, and the low-risk group between the two with moderate RSA withdrawal. However, both of the studies were cross-sectional, leaving open the question of how RSA-B and RSA-R are related to the codevelopment of externalizing and internalizing symptoms.

Sex, RSA, and Psychopathology Symptoms

Theoretical reviews (Beauchaine, Klein, Crowell, Derbridge, & Gatzke-Kopp, 2009; Zahn-Waxler, 1993; Zahn-Waxler et al., 2008) and longitudinal studies have underscored the importance of evaluating sex differences in the development of psychopathology. There are clear sex differences in young adolescents' levels and change over time in externalizing and internalizing symptoms (e.g., Dekovic et al., 2004; Hankin, Wetter, & Cheely, 2008), though this evidence is less clear in middle to late childhood. In models in which codeveloping externalizing and internalizing symptoms within individuals are measured, boys are more likely to be members of developmental trajectories that include more pure externalizing symptoms (Fanti & Henrich, 2010) and externalizing and internalizing symptoms, and trajectories of these symptoms have been found to be more highly correlated for girls than for boys (Wiesner & Kim, 2006). In studies using person-centered analyses similar to those in the current study, Wiesner and Kim (2006) found four codeveloping internalizing and externalizing trajectories for boys (n = 472) and three for girls (n = 513). Fanti & Henrich (2010) identified 11 profiles of codeveloping externalizing and internalizing symptoms with a sample of over 1,200 children; although boys were more likely to be in profiles of pure externalizing problems, the profiles were not analyzed separately by sex.

Overall, these studies demonstrate that throughout childhood and adolescence initial levels and change over time in internalizing symptoms are positively related to initial levels and change over time in externalizing symptoms; there are important sex differences in the relations between externalizing and internalizing symptoms and their codevelopment; there is significant heterogeneity in developmental trajectories of externalizing and internalizing symptoms; and putative risk factors provide important insights into how externalizing and internalizing symptoms develop.

Further, some research indicates that relations between RSA and symptoms of psychopathology may depend upon child sex. Negative relations between RSA-B and externalizing problems may be stronger for boys (Beauchaine, Hong, & Marsh, 2008; Calkins & Dedmon, 2000; El-Sheikh & Hinnant, 2011). Some studies with community samples have found that weaker RSA withdrawal to frustration is related to higher levels of externalizing problems for boys (e.g., El-Sheikh et al., 2011). Conversely, other studies have found no sex differences in relating RSA-R in response to a battery of emotional and problem-solving tasks to externalizing problems (e.g., Calkins & Dedmon, 2000) or have found the opposite effect when RSA-R is measured in response to free-play in social groups (Hastings, Nuselovici, Utendale, Coutya, & Sullivan, 2008). Possible explanations for these sex differences lie outside the scope of the this study but include a stronger genetic influence on externalizing behavior for boys (Sildberg et al., 1996), a stronger link between internalizing and externalizing symptoms for girls (Wiesner & Kim, 2006) that may blur relations between autonomic function and symptoms, or differential effects of socializing influences on emotion regulation strategies and self-regulatory behaviors based on sex (Zahn-Waxler et al., 2008). In addition, it is worth noting that findings for boys with clinically diagnosed externalizing problems do not differ from healthy control children in their RSA withdrawal to reward (Beauchaine et al., 2007, 2008) but do have lower RSA-B, which suggests that there may be some key differences in what RSA withdrawal means for physiological regulation of boys in clinical versus community samples. Finally, and relevant to the current study, it is difficult to discern the pattern of effects regarding sex as a moderator in the relations between RSA-R and externalizing or internalizing symptoms when so many different types of stressor tasks have been used. Thus, we attempted to clarify these relations using RSA-R to two specific types of stressors (social stress and cognitive frustration).

The Current Paper

Overall, the literature that has used primarily community samples and cross-sectional analyses indicates that lower RSA-B is a risk factor for both externalizing and internalizing symptoms in both clinical (Beauchaine et al., 2007) and community samples (Hinnant & El-Sheikh, 2009), weaker RSA withdrawal may indicate risk for primarily externalizing problems, and stronger RSA withdrawal in response to stress may indicate risk for internalizing symptoms or co-occurring internalizing–externalizing symptoms (Boyce et al., 2001; Calkins et al., 2007). Our objective was to study the codevelopment of externalizing and internalizing symptoms in a community sample during middle childhood in order to shed light on how the codevelopment of symptoms is tied to sex and patterns of RSA activity.

We used a large community sample (combined from two independent studies) with longitudinal data from middle to late childhood to examine initial levels, change over time, and variability in children's externalizing and internalizing symptoms through the use of multiple domain latent growth modeling (e.g., Keiley et al., 2000). These analyses allowed us to derive indicators for a growth mixture model that captures codeveloping patterns of externalizing and internalizing symptoms within and across groups of children. We also investigated whether sex, RSA-B, RSA-R, and their interactions are predictive of membership in profiles of codeveloping externalizing and internalizing symptoms. We expected to find three to five codeveloping trajectories of psychopathology symptoms encompassing some combination of normative externalizing/internalizing, low externalizing/low internalizing, high externalizing/low internalizing, low externalizing/high internalizing, and high externalizing/internalizing. Controlling for demographics (race and socioeconomic status [SES]) and study (Study 1 and Study 2), we also expected that profile membership would be predicted by RSA-B, RSA-R to the two laboratory stress tasks, and interactions among sex, RSA-B, and RSA-R.

Consistent with evidence supportive of relations between parasympathetic hypoarousal and psychopathology, we hypothesized that low RSA-B and/or weak RSA-R, especially for boys, would predict membership in a profile of children who are high on externalizing symptoms and relatively low on internalizing symptoms. We also hypothesized that children with lower RSA-B and stronger RSA-R would be more likely to fall into a profile of high externalizing/internalizing symptoms or low externalizing/high internalizing symptoms. This hypothesis is more fitting with evidence relating dysregulated parasympathetic withdrawal to psychopathology, especially co-occurring or codeveloping externalizing–internalizing symptoms. Investigations of the moderating roles of sex and RSA-R to different types of tasks are largely exploratory and are consistent with calls for additional research in these areas to augment limited existing knowledge (Beauchaine et al., 2008; Obradovic, Bush, & Boyce, 2011).

Method

Participants

Data for the current study come from two independent, three-time-point longitudinal data sets used to examine relations between familial stress and children's development. Participants in both studies included school-recruited children residing in two-parent homes. To minimize potential confounds, families with children diagnosed with a chronic illness, a learning disability, mental retardation, or attention-deficit/hyperactivity disorder were not eligible to participate. Further information on recruitment procedures can be found in El-Sheikh et al. (2009). For Study 1, 165 children participated during the first wave of data collection (T1), 132 participated in the second wave (T2; 80% of the original sample), and 113 participated in the third wave (T3; 86% of those who participated at T2). For Study 2, participants were 248 children at T1, 217 at T2 (86% of the original sample), and 183 at T3 (84% of those who participated at T2). In Study 1 there was a 2-year lag between Waves 1 and 2 and a 3-year lag between Waves 2 and 3. For Study 2, there was a 1-year lag between consecutive waves. Reasons for attrition in both studies included the inability to be located, hectic schedules, lack of interest, and geographic relocation.

Due to similarity in sample characteristics and study designs, the two samples were aggregated to create a larger sample and one additional time point of measurement (i.e., a total of four time points). Such combined-sample, accelerated designs have been found to approximate true longitudinal designs (Duncan, Duncan, & Hops, 1996; Stanger, Achenbach, & Verhulst, 1994). The total sample comprised 390 children (180 boys and 210 girls) who had data available for externalizing and internalizing symptoms for at least one time point along with physiological data. Similar to community demographics, 67% of children were European American and 33% were African American. Families were from a wide range of socioeconomic backgrounds, based on Hollingshead (1975) criteria, and the median family income was in the $35,000 to $50,000 range. In analyses, we controlled for any differences that may be due to the particular study features in which children participated, that is, we created a variable with two levels, Study 1 (coded as 0) and Study 2 (coded as 1), and included it as a control in all analyses. Studies 1 and 2 corresponded to the same studies described in El-Sheikh et al. (2009).

Because each study consisted of three waves, each child could contribute data at up to three time points (see Table 1). Children's data were sorted based on their chronological age, rather than each study's data collection wave. This approach minimized variability in age within time points and maximized the measurement of true developmental change (Mehta & West, 2000). Children who contributed information between the ages of 7.50 and 8.50 were sorted into the first assessment (age 8; M = 8.13, SD = 0.33), children between the ages of 8.51 and 9.50 were sorted into the second assessment (age 9; M = 8.98, SD = 0.28), children between the ages of 9.51 and 10.50 were sorted into the third assessment (age 10; M = 10.05, SD = 0.31), and children who contributed information between the ages of 10.51 and 12.50 were sorted into the fourth assessment (age 11; M = 11.03, SD = 0.45). Because of the small subsample size available for children 13 years and older and the increased variability in age that adding these children would create, we did not include data from children older than 12.50 in the fourth assessment (n = 82; M age = 13.65, SD = 0.48). Sixty-seven children had data for one time point, 166 had data for two time points, and 157 had data for three time points.

Table 1. Longitudinal data contributed from two studies.

Child Age

8 9 10 11
Study 1 (n) 46 111 32 25
Study 2 (n) 162 191 113 68
Total (N) 208 302 179 93

Procedure

Approval from the university's internal review board was granted for both studies. Procedures are nearly identical across both studies unless otherwise indicated (for more information on each study's procedures, see El-Sheikh et al., 2009). Families visited our university-based research laboratory during each study wave. Mothers and fathers self-reported on questionnaires while children completed the questionnaires via interview with a trained researcher. In addition, children's physiological responses (i.e., RSA) were assessed while being presented with two independent mildly stressful tasks. After attaching electrodes, a 6-min adaptation period occurred followed by a 3-min baseline assessment. The researcher then presented the child with two laboratory tasks, each lasting 3 min, with a recovery period between conditions. In the first task, children listened to an audiotape recording of an argument between two adults. This task is considered a mild social stressor that successfully elicits significant variability in physiological stress responses (El-Sheikh, Harger, & Whitson, 2001).

Following the argument, a 3-min recovery period occurred followed by a second 3-min baseline for both studies, with one exception; at T1 in Study 1, a 12-min recovery period (vs. 6-min) occurred between the argument task and the star-tracing task. Children were then presented with the star-tracing task, which is a frustrating and well-established cognitive stressor (Matthews, Rakaczky, Stoney, & Manuck, 1987; Matthews, Woodall, & Stoney, 1990) and has been linked with individual differences associated with family risk and child adjustment (El-Sheikh et al., 2009). For the star-tracing task, a sheet of paper that contained the outline of a star was placed in front of the child on a writing tray. Children traced the star for 3 min while only looking through a mirror (Mirror Tracer, Lafayette Instrument Company, Lafayette, IN); the star was blocked from direct view but was visible through the mirror. The examination of children's responses to both social and nonsocial stressors can provide greater specificity about psychophysiological responses (Chen, Matthews, Salomon, & Ewart, 2002).

Measures

RSA data acquisition and reduction

During each study wave, children's RSA was assessed following standard guidelines (Berntson et al., 1997). Two electrocardiography (ECG) electrodes were placed on the rib cage, about 10 to 15 cm below the armpits. To ground the signal, a third electrode was placed on the center of the chest. A pneumatic bellows was firmly placed around the chest to measure respiratory changes. The ECG signal was digitized at a sampling rate of 1,000 readings per second using bandpass filtering with half power cutoff frequencies of 0.1 and 1000 Hz and a gain of 500. An interbeat interval (IBI) analysis system from the James Long Company (Caroga Lake, NY) was used to process the ECG signal. To minimize phase or time shifts in the assessment of respiration, a pressure transducer with a bandpass of DC to 4000 Hz was used with the bellows.

Identification of R-waves was provided via an automated algorithm. In the rare case that it was needed, an interactive graphical program was used for manual correction of misidentified R-waves. R-wave times were then converted to IBIs and resampled into equal time intervals of 125 ms. All IBIs that spanned the 125-ms interval were prorated. The program prorates at every eighth of a second. The prorated IBIs were stored for computation of the mean and variance of heart period as well as assessing heart period variability due to RSA. The first RSA-B prior to the challenge tasks (i.e., the interparental argument, or RSA-R argument; and the star-tracing task, or RSA-R star tracing) was calculated for the entire epoch. RSA was calculated using the peak-to-valley method, which is an acceptable approach for quantifying RSA (Bernston et al., 1997). RSA was computed by using the difference in IBI readings from inspiration to expiration onset.1 RSA-R was calculated by subtracting RSA during the relevant task from RSA during the first baseline. Thus, lower values for RSA-R are indicative of stronger RSA withdrawal in response to either of the challenge conditions.

Children's internalizing symptoms

Depressive symptoms

Children's depressive symptoms were assessed via the 27-item Children's Depression Inventory (CDI; Kovacs & Beck, 1977), which has established reliability and validity. One item assessing suicidal ideation was not administered in both studies. The overall scale score was used in analyses, and higher scores reflect more depressive symptoms. For Study 1, T1, T2, and T3 internal consistencies for the CDI were α = 0.89, 0.77, and 0.81, respectively. For Study 2, internal consistencies for the CDI were α = 0.95, 0.85, and 0.83 for the three study waves. Sorting based on chronological age indicated that at ages 8, 9, 10, and 11, the proportion of children having scores in the borderline or clinical range (scores ≥ 20) was 3%, 6%, 3%, and 1%, respectively.

Anxiety symptoms

Children's symptoms were derived from the 28 items of the Revised Children's Manifest Anxiety Scale (RCMAS; Reynolds & Richmond, 1978). The RCMAS has demonstrated good psychometric properties (James, Reynolds, & Dunbar, 1994). For Study 1, internal consistencies for the RCMAS were α = 0.86, 0.89, and 0.86 during the three study waves. For Study 2, reliabilities for the RCMAS were α = 0.92, 0.90, and 0.92. Sorting based on chronological age showed that at ages 8,9,10, and 11, the following percentages of children had scores in the borderline or clinical range (scores ≥ 20): 14%, 10%, 9%, and 2%, respectively.

Children's depressive symptoms were highly correlated with anxiety symptoms at all time points for both studies (rs =.41–.62 in Study 1 and .40–.75 in Study 2) and were averaged at each time point to capture internalizing symptoms broadly.

Children's externalizing symptoms

Both mothers and fathers reported on children's externalizing behaviors using the Personality Inventory for Children—II (PIC2; Lachar & Gruber, 2001). The PIC2 has demonstrated discriminant and construct validity, interrater reliability, and test–retest reliability (Lachar & Gruber, 2001; Wirt, Lachar, Klinedinst, & Seat, 1990). We examined children's symptoms on the externalizing scale, which consists of 47 items that assess children's impulsivity, aggression, disruptive behavior, noncompliance, and delinquency.

Mother and father reports of children's externalizing symptoms were highly correlated at each time point for both studies (rs = 37–.71 in Study 1 and .39–.84 in Study 2) and were averaged at each time point. For Study 1, internal consistency for the externalizing scale raw scores were α = 0.88, 0.92, and 0.93 across the three waves. After sorting children based on their chronological age, proportions of children with borderline or clinical levels of externalizing symptoms (T ≥ 60) at ages 8, 9, 10, and 11 were 8%, 11%, 10%, and 7%, respectively.

In latent growth modeling, repeated measures must have a common metric (i.e., they must have the same meaning at each time point; Singer & Willett, 2003). Because the PIC2 T scores are age and sex corrected, raw scores were used to assess growth of externalizing symptoms. Unfortunately, this precluded the use of the established clinical risk cutoff values (i.e., T scores) as comparisons in the growth models. However, as a comparison, Lachar and Gruber (2001) reported a mean externalizing raw score of 6.4 for their standardization (i.e., normative) sample of over 2,000 children, adolescents, and young adults and a mean externalizing raw score of 16.5 for their referred (i.e., clinical) sample of approximately 1,500 children, adolescents, and young adults.

Plan of analysis

Based on our hypotheses and the results of prior studies modeling the codevelopment of externalizing and internalizing symptoms (Fanti & Henrich, 2010; Wiesner & Kim, 2006), we sought to identify different patterns of psychopathology over time. We used a form of growth mixture modeling (GMM) to capture profiles of individuals who display similar patterns of development. GMM is part of a new generation of person-centered analyses that are being used increasingly when researchers expect that a sample distribution may be composed of unobserved but distinct groups of individuals on similar developmental trajectories (profiles), each with its own distribution (McLachlan & Peel, 2000; Muthen, 2004). One clear advantage to this approach is that it gives freedom to model developmental trajectories in multiple domains (externalizing and internalizing symptoms) within individuals; a traditional latent growth model approach would be limited to predicting levels and change in one domain from levels and change in another domain or from covariates (e.g., Curran, Stice, & Chassin, 1997). It is important to note that there are different forms of person-centered growth analyses, and one difference between a GMM approach and more restrictive forms such as latent class or profile analysis is the assumption made about within-profile variance (Muthen, 2004; Sterba & Bauer, 2010; see also Nagin, 1999). In our GMM analyses within-profile variances were freely estimated and reflect that even within profiles individuals may be different in terms of development.

We derived the codevelopment profiles from four indicators: factor scores of initial (intercept) levels of externalizing and internalizing symptoms and change over time (slope) in externalizing and internalizing symptoms that were created from a multiple domain growth model. Although we addressed and tested quadratic growth in this multiple domain growth model,2 linear trajectories of externalizing and internalizing symptoms provided the best fitting and most parsimonious summary of the data, and so growth in the multiple domain model was limited to a linear form. Covariances among the latent growth variables were freely estimated in this original model.

One important component of building support for multiple trajectories for individuals involves the use of theoretically derived predictors to correctly classify individuals (Bauer & Curran, 2003; Muthen, 2003, 2004). In this study, sex, RSA-B, and RSA-R were the primary predictors. Each profile predictor estimate is a logistic regression coefficient and indicates the relation between the predictor and membership in one profile versus a comparison profile. These logistic regression coefficients are translated into probabilities of membership in a profile (which can vary between 0 and 1) or odds ratios to aid in interpretation (see Peng, Lee, & Ingersoll, 2002, for an overview). As in linear regression, significant interactions take precedence over main effects. Interactions were assessed by plotting the predictor against probability of membership in profile at standard levels of the moderator (i.e., ±1 SD). A macro provided by Hayes and Matthes (2009) was used to assess the simple slopes and derive values for plotting. Plotted probabilities do not necessarily have a linear form (Flom & Strauss, 2003).

There are no hard and fast rules for when it is best to interpret interactions because the creation of interaction terms reduces power (Whisman & McClelland, 2005). Our rule of thumb was to interpret interactions that were significant at traditional alpha levels (p < .05) as well as more liberal alpha levels (p < .10) for the Wald chi-square statistic. This is because the Wald statistic indicates that the predictor variable differentiated the other profiles from the comparison (dummy coded) profile overall but not which specific profile was differentiated from the comparison profile (much like in analysis of variance and its post hoc comparisons). Thus, it is possible for the Wald statistic to not reach traditional significance while the interaction for a specific logistic regression was significant. Traditional p values were used for the more specific predictions of profile membership (i.e., the comparison profile compared to a specific other profile).

Statistical Package for the Social Sciences was used to derive overall descriptive statistics and values for plotting significant interactions. The original multiple domain latent growth model used to derive factor scores was created in AMOS. All GMM analyses were conducted with Latent Gold (a program designed for mixture modeling). Missing data in the original latent growth model and subsequent GMM were handled with full information maximum likelihood estimation. This procedure does not impute missing data but uses all available information to estimate model parameters (Acock, 2005). Following recommended best practices, the best fitting model and number of profiles was directed by bootstrapped comparisons (described below).

Results

Missing data

We evaluated associations between demographic characteristics (race, sex, and SES) and the number of time points at which children contributed data (one time point, n = 67; two time points, n = 166; three time points, n = 157). Chi-square analyses indicated no sex, χ2 (2) = 0.94, p = .63, or race, χ2 (2) = 3.92, p = .14, differences for children who contributed data at one, two, or three time points. A one-way analysis of variance indicated no differences based on SES, F (2) = 1.80, p = .17. Thus, missing data was not based on these demographic characteristics.

Descriptive statistics

Means, standard deviations, and correlations among all study variables are shown in Table 2. Single sample t tests indicated that children exhibited significant RSA withdrawal to the argument, t (400) = −3.92, p < .001, and the star tracing, t (393) = −8.36, p < .001, tasks. As shown in Table 2, RSA-B was negatively related to RSA-R to the argument and the star tracing; children with higher RSA-B show greater RSA withdrawal to the two tasks. Further, the two measures of reactivity were positively associated. The RSA measures were generally not directly correlated with the repeated measures of externalizing and internalizing symptoms. Repeated measures of externalizing and internalizing symptoms were correlated within and across domains.

Table 2. Descriptive statistics and correlations among study variables.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
1. Study
2. Sex .05
3. Race .04 −.04
4. SES .08 .05 −.21**
5. RSA-B .13* .07 .16** −.06
6. RSA-R arg .06 −.02 .02 −.07 −.28**
7. RSA-R star .04 .04 −.07 −.05 −.41** .37**
8. Age 8 internalizing .05 .01 .10 .06 .08 −.08 −.09
9. Age 9 internalizing .04 .01 .04 −.05 .02 −.08 −.02 .51**
10. Age 10 internalizing .06 .07 .17* −.08 .16* −.09 −.08 .42** .41**
11. Age 11 internalizing −.18* −.09 .06 −.14 2.04 .06 −.01 .37* .49** .61**
12. Age 8 externalizing −.01 .18** −.02 .00 .07 −.03 .01 .16* .14 .09 .06
13. Age 9 externalizing .01 .18** −.01 −.08 .00 .04 .03 .18* .17** .14 .26** .75**
14. Age 10 externalizing .17* .13 −.07 −.12 −.07 .10 .19* .23* .07 .08 .22* .84** .79**
15. Age 11 externalizing .10 .17* −.07 −.01 −.06 −.02 .14 .30* .25** .09 .08 .70** .49** .82**
M (SD) 0.60 0.47 0.33 36.83 14.81 −0.80 −2.58 9.52 8.81 7.41 5.14 4.32 4.53 4.71 4.14
(9.72) (8.24) (4.09) (6.11) (5.18) (5.66) (5.14) (4.27) (3.47) (3.78) (4.03) (3.91)

Note: Study was coded 0 for Study 1 and 1 for Study 2. Sex was coded 0 for girls and 1 for boys. Race was coded 0 for European American and 1 for African American. Correlations are pairwise, which explains why some weaker correlations have a lower p value than stronger correlations; the sample size differs based on time. SES, socioeconomic status; RSA, respiratory sinus arrhythmia; -B, baseline; -R, reactivity.

*

p < .05.

**

p < .01.

Overall growth of externalizing and internalizing symptoms

We first defined an overall unconditional dual trajectory latent growth model for externalizing and internalizing symptoms. As stated earlier, trajectories were constrained to estimate linear growth and time was coded so that intercepts represent initial levels of symptoms and slopes represent change over time from that point.2 This dual trajectory model had acceptable fit statistics, χ2 (93.94)/df (28) = 3.36, root mean square error of approximation = 0.076. The average initial level of externalizing symptoms was 4.53 and the average slope was −0.07. This slope was not significantly different from zero (i.e., on average, there was no significant change in externalizing symptoms over time). The average initial level of internalizing symptoms was 9.87 and the average slope was −1.14, indicating a significant decrease in internalizing symptoms over time (p < .001). In addition, there was significant variability in intercepts and slopes for both types of symptoms (all ps < .01). Intercepts for externalizing and internalizing symptoms were positively correlated (r = .29, p = .002); no other correlations were significant. Factor scores for intercepts and slopes of externalizing and internalizing symptoms were output from this analysis into the Statistical Package for the Social Sciences to be used as the indicators for the GMM.

Number of profiles

We tested a series of models, with each successive model estimating an additional profile to find the number of profiles that provided the best fit to the data (Nylund, Asparouhov, & Muthen, 2007). Five hundred random starts were used for each model to avoid local maxima (an incorrect and non-replicable convergence), and all analyses were estimated twice to ensure that results were replicated (which would be highly unlikely if the first solution was due to arriving at a local maxima; McLachlan & Peel, 2000). We evaluated the models using recommended indices of fit: the Bayesian information criterion and the bootstrap likelihood ratio test (BLRT; McLachlan & Peel, 2000; Nylund et al., 2007). The BLRT is a formal test of whether a bootstrapped log likelihood difference distribution between a model with k profiles is a significant improvement over a model with k − 1 profiles. Our models bootstrapped 500 samples. The BRLT provides a p value with significant values, indicating that the addition of a model with k profiles fits better than a model with k − 1 profiles. A nonsignificant p value indicates that a model with k profiles does not fit better than a model with k − 1 profiles (i.e., it would indicate that the simpler model with fewer profiles should be accepted). We used the BLRT as our first choice in determining the number of profiles because of its superior performance in a simulation study (Nylund et al., 2007).

The indicators (intercepts and slopes of externalizing and internalizing symptoms) were allowed to covary within profiles in our models. As indicated by the BLRT model comparisons (shown in Table 3), we found that the best fitting model contained three profiles of individuals. This model and all subsequent analyses were based on children who had data available from all predictor and indicator variables (n = 390).

Table 3. Nested model comparisons for trajectories of externalizing and internalizing symptoms.

Profile Log Likelihood BIC BLRT p
1 −2499.68 5082.89
2 −2349.29 4955.11 300.80 <.001
3 −2309.67 5048.90 102.20 <.002
4 −2262.39 5127.35 71.60 <.13

Note: BIC, Bayesian information criterion; BLRT, bootstrap likelihood ratio test.

Profile indicators

Descriptive statistics of the three profiles are provided in Table 4. Figure 1a and b present the trajectories for the three profiles. The first profile of individuals was termed “normative” because of its size (49% of the sample) and similarity to the levels and change over time in externalizing and internalizing symptoms of the overall dual trajectory identified in the latent growth model. Children in this profile exhibited moderate levels of RSA-B and RSA withdrawal to the argument and the star-tracing tasks.

Table 4. Profile descriptive statistics for indicators and predictors.

Profile 1: Normative Profile 2: Low Ext./Mod. Int. Profile 3: High Ext./High Int.
Profile size 190 (49%) 161 (41%) 39 (10%)
Indicators
 Ext. intercept 4.69 2.55 11.26
 Ext. slope −0.13 −0.05 0.21
 Int. intercept 9.38 9.60 12.66
 Int. slope −1.33 −0.96 −0.89
Predictors
 Study 0.67 0.51 0.53
 Sex 0.49 0.39 0.66
 Race 0.30 0.36 0.37
 SES 37.20 36.93 35.41
 RSA-B 14.46 14.91 13.40
 RSA-R argument −0.67 −0.96 −0.16
 RSA-R star tracing −1.92 −3.89 −1.17

Note: Estimates for dichotomous variables are proportions. Study was coded 0 for Study 1 and 1 for Study 2. Sex was coded 0 for girls and 1 for boys. Race was coded 0 for European American and 1 for African American. SES, socioeconomic status; RSA, respiratory sinus arrhythmia; -B, baseline; -R, reactivity.

Figure 1.

Figure 1

Profile trajectories of externalizing and internalizing symptoms.

The second profile was also quite large (41%) and was termed “low externalizing/moderate internalizing” because it had children with the lowest levels of externalizing symptoms initially and over time. While initial levels of internalizing symptoms for children in the second profile were similar to those in the normative profile, children in this second profile showed less steep declines in internalizing slopes, which resulted in higher internalizing symptoms over time (in comparison to the normative trajectory profile). Children in the second profile had the highest RSA-B and the strongest RSA withdrawal to the argument and the star-tracing tasks. Formal comparisons of indicator variables to the normative profile revealed that children in the low externalizing/moderate internalizing profile had lower initial externalizing symptoms, t (346) = −13.66, p < .001, and a less steep decline in internalizing symptoms over time, t (346) = 7.52, p < .001. No other differences in indicator variables were significant.

The third profile was termed “high externalizing/internalizing” and was relatively small (10%). Children in the high externalizing/internalizing profile had the highest initial levels of externalizing and internalizing symptoms, a positive slope for externalizing symptoms, and the least steep decline in internalizing symptoms (slope). Children in this profile had the lowest RSA-B and the weakest RSA withdrawal to the argument and the star-tracing tasks. Formal comparisons to the normative profile indicated that children in the high externalizing/internalizing profile were significantly different on all indicator variables: Initial externalizing and internalizing symptoms were significantly higher, t (227) = 12.65, p < 001 and t (227) = 7.36, p < .001, respectively; the externalizing slope was significantly higher (i.e., a positive slope), t (227) = 2.75, p = .006; and the internalizing slope was higher (i.e., a less negative slope), t (227) = 3.06, p = .004.

Posterior probabilities indicated that individuals were correctly classified in the majority of cases: The mean probability of correct classification was .88 for the normative profile, .84 for the low externalizing/moderate internalizing profile, and .95 for the high externalizing/internalizing profile. Average probabilities greater than .70 typically imply satisfactory fit (Nagin, 2005). Finally, there was significant variability on all of the indicator variables within profiles (all ps < .01), which suggests that even within profiles, children differ somewhat in their initial levels and change over time in externalizing and internalizing symptoms. The latent profile variable accounted for a total of 62% of the variance in initial levels of externalizing symptoms, 4% of the variance in change over time in externalizing symptoms, 13% of the variance in initial levels of internalizing symptoms, and 11% of the variance in change over time in internalizing symptoms.

Profile predictors

Table 5 presents estimates for predicting profile membership with the normative profile as the comparison. Wald chi-square tests for demographics and study were not significant (race, SES, and Study 1 vs. 2 did not differentiate membership in either the low externalizing/moderate internalizing or the high externalizing/internalizing profiles from the normative profile). Overall, two main effects involving RSA-B and RSA-R to the star-tracing task were significant. In addition, two interactions were significant: RSA-B × RSA-R to the argument and Sex × RSA-R to the star-tracing task. A third interaction between sex and RSA-B was marginally significant. Neither of the three-way interactions were significant.

Table 5. Estimates for predictors of profile membership: Normative profile as comparison.

Profile 2: Low Ext./Mod. Int. Profile 3: High Ext./High Int.


Estimate SE Estimate SE Wald
Intercept 1.02 1.09 −0.15 1.22 1.36
Demographics
 Study −0.78 0.40 −0.65 0.43 4.24
 Sex −0.07 0.51 0.81 0.52 3.12
 Race 0.37 0.42 0.31 0.48 0.83
 SES −0.01 0.02 −0.01 0.02 0.88
Physiological variables
 RSA-B −0.17* 0.08 −0.13 0.07 5.85*
 RSA-R argument −0.10 0.12 −0.01 0.14 0.85
 RSA-R star tracing −0.37** 0.13 −0.27* 0.13 8.88**
Interactions
 RSA-B × RSA-R Argument 0.05** 0.02 0.03 0.02 8.67**
 RSA-B × RSA-R Star Tracing −0.03 0.01 −0.02 0.02 3.75
 Sex × RSA-B 0.18* 0.09 0.13 0.09 4.65
 Sex × RSA-R Argument 0.08 0.14 0.03 0.15 0.29
 Sex × RSA-R Star Tracing 0.42** 0.14 0.35** 0.14 10.33**
 Sex × RSA-B × RSA-R Argument −0.03 0.02 −0.03 0.02 2.79
 Sex × RSA-B × RSA-R Star Tracing 0.01 0.02 0.01 0.02 0.67

Note: Estimates are logistic regression coefficients. Wald is the Wald chi-square statistic. Study was coded 0 for Study 1 and 1 for Study 2. Sex was coded 0 for girls and 1 for boys. Race was coded 0 for European American and 1 for African American. SES, socioeconomic status; RSA, respiratory sinus arrhythmia; -B, baseline; -R, reactivity.

p <.10.

*

p < .05.

**

p < .01.

In comparison to Profile 1 (normative), Profile 2 (low externalizing/moderate internalizing) membership was predicted by RSA-B and RSA-R to the star-tracing tasks. Both of these main effects were subsumed by significant interactions. Plotting the interaction between RSA-B and RSA-R to the argument (Figure 2) indicates that RSA-R to the argument was negatively related to the probability of membership in the low externalizing/moderate internalizing profile for children who are lower in RSA-B (z = −4.31, p < .001) while the relation was positive for children higher in RSA-B (z = 3.24, p = .001). The odds of membership in the low externalizing/moderate internalizing profile versus the normative profile was 41 for individuals with lower RSA-B and stronger RSA-R to the argument (greater withdrawal), meaning that children with these characteristics were 41 times more likely to be in the low externalizing/moderate internalizing profile as opposed to the normative profile. These are very high probabilities by any standard. Conversely, individuals with higher RSA-B and stronger RSA-R to the argument had very low odds of membership in this profile (odds ratio = 0.06).

Figure 2.

Figure 2

The interaction between baseline respiratory sinus arrhythmia and respiratory sinus arrhythmia reactivity argument significantly predicts probability of membership in Profile 2 (low externalizing/moderate internalizing). The comparison profile is Profile 1 (normative).

The interaction between sex and RSA-B is depicted in Figure 3. The relation between RSA-B and the probability of membership in the low externalizing/moderate internalizing profile was negative for girls (z = -5.16, p < .001), and there was no relation for boys (z = 0.95, p = .34). Girls with lower RSA-B were 3.5 times more likely to be in the low externalizing/moderate internalizing profile. The interaction between sex and RSA-R to the star-tracing task was similar (Figure 4a); RSA-R was negatively related to the probability of membership in this profile for girls (z = −5.53, p < .001). Girls with stronger RSA withdrawal to the star-tracing task had increased odds of being members of the low externalizing/moderate internalizing profile (odds ratio = 8.1), while there was no relation for boys (z = 0.81, p = .42).

Figure 3.

Figure 3

The interaction between sex and baseline respiratory sinus arrhythmia significantly predicts probability of membership in Profile 2 (low externalizing/moderate internalizing). The comparison profile is Profile 1 (normative).

Figure 4.

Figure 4

The interaction between sex and respiratory sinus arrhythmia reactivity star tracing significantly predicts probability of membership in Profile 2 (low externalizing/moderate internalizing) and Profile 3 (high externalizing/internalizing). The comparison profile is Profile 1 (normative).

In comparison to the normative profile, membership in the high externalizing/internalizing profile was predicted by RSA-B (this relation was marginally significant) and RSA-R to the star-tracing task. RSA-B was negatively related to probability of membership in this profile; as RSA-B increased, probability of membership in the profile decreased (z = −1.75, p = .08), and for every one unit increase in RSA-B, odds of membership in the profile decreased by 0.12. The main effect of RSA-R to the star-tracing task was subsumed by an interaction between sex and RSA-R to the star-tracing task. This interaction is presented in Figure 4b and indicates that the relation between RSA-R to the star-tracing task and odds of membership in the high externalizing/internalizing profile was negative for girls (z = −2.39, p = .02) and positive for boys (z = 1.92, p = .05). The odds of membership in this profile for girls who exhibited stronger RSA withdrawal to the star-tracing task was higher (1.27) but was much lower at either average or weak RSA withdrawal (0.10 and 0.01, respectively). As can be seen in the figure, boys did not have a high probability of being in the high externalizing/internalizing profile at any plotted level of RSA-R to the star-tracing task but exhibited a clear positive slope, indicating increasing risk of being in this profile. At high levels of RSA activation (as opposed to RSA withdrawal), boys had increased odds of being in this profile (1.42 at +3 SD). Thus, only boys with unusually high levels of RSA activation were likely to be in the high externalizing/internalizing profile.

Discussion

We examined the codevelopment of externalizing and internalizing symptoms in relation to child sex and PNS function, measured by RSA, at rest (RSA-B) and in response to lab challenges (RSA-R), with a large longitudinal sample assessed from middle to late childhood. Findings make two important contributions to the literature on the codevelopment of symptoms of psychopathology. The first contribution relates to addressing inconsistencies in how PNS activity is related to the codevelopment of externalizing and internalizing symptoms. Studies with community samples have indicated that lower RSA-B or weaker RSA withdrawal, especially in response to cognitive challenge, are related to externalizing problems, while excessive RSA withdrawal may be related to emotional lability, internalizing problems, and aggression driven by emotion dysregulation (Boyce et al., 2001; Calkins et al., 2007; Hinnant & El-Sheikh, 2009). Our results indicate that RSA-B and RSA-R are important physiological characteristics that can help differentiate children's normative developmental trajectories from more maladaptive trajectories characterized by higher levels of externalizing and/or internalizing symptoms. Current findings also contribute to the literature on sex differences in psychopathology. In most of our analyses, the relation between RSA and probability of membership in a trajectory profile of externalizing–internalizing symptoms was dependent upon sex. In the second contribution, we illustrate that when researchers are interested in understanding the co-occurrence or codevelopment of symptoms within individuals, it may be informative to consider person-centered analyses strategies because they offer some advantages over more traditional latent growth modeling techniques. We expand on these points below.

We used multiple domain latent growth modeling to evaluate overall trajectories of externalizing and internalizing symptoms. Estimates from these models were then used to construct a growth mixture model that captured change in both externalizing and internalizing symptoms simultaneously within individuals. Fit indices indicated that a three-trajectory profile model provided the best fit to the data. This number of profiles is fairly consistent with what is reported by a study using a community sample with a similar sample size that analyzed boys and girls separately (Wiesner & Kim, 2006). Levels of externalizing and internalizing symptoms in our profiles also matched reasonably well with those of Wiesner and Kim's (2006) study. We found a large normative trajectory group (49% of the sample), a low externalizing/moderate internalizing trajectory group (41%), and a high externalizing/internalizing trajectory group (10%). It is important to remember that levels of symptoms for the high externalizing/internalizing group were high for a community sample, but overall there were relatively few individuals who exceeded clinical risk cutoffs for either set of symptoms. A hypothesized trajectory group of children high in externalizing symptoms and low in internalizing symptoms did not emerge. In retrospect, this finding should not be surprising given the rarity of trajectories of pure externalizing problems and the strong association between externalizing and internalizing symptoms in studies with community samples (e.g., Fanti & Henrich, 2010).

The results from the current study help to extend findings from community samples relating RSA to psychopathology over time. The normative profile had moderate RSA-B and RSA-R to the argument and the star-tracing tasks. The low externalizing/moderate internalizing profile had the highest RSA-B and the greatest RSA withdrawal to the tasks, whereas the high externalizing/internalizing profile had the lowest RSA-B and the weakest RSA-R. Our findings supported the hypotheses that interactions among sex, RSA-B, and RSA-R play a role in predicting membership in profiles of codeveloping externalizing and internalizing symptoms. Our first hypothesis that lower RSA-B in combination with weaker RSA-R, especially for boys, would predict membership in a high externalizing/low internalizing profile was not supported; we found no evidence for a profile with these levels of symptoms in our sample. However, these combinations of RSA-B and RSA-R for boys did predict membership in the high externalizing/internalizing trajectory profile; interpretations of these findings are discussed in the next paragraph. Our second hypothesis that lower RSA-B and stronger RSA-R would predict membership in a trajectory profile of low externalizing/high internalizing or high externalizing/high internalizing symptoms was largely supported, but with some caveats. A significant interaction indicated that probability of membership in the low externalizing/moderate internalizing trajectory profile was especially high for children with lower RSA-B and stronger RSA-R to a social stressor (listening to an interadult argument). Children with higher RSA-B and stronger RSA-R, however, were much less likely to be in this profile. Sex-related interactions indicated that girls with lower RSA-B or girls with stronger RSA-R to a cognitively frustrating stressor (the star-tracing task) had a higher probability of being in the low externalizing/moderate internalizing profile. For boys, no simple slopes for any of the physiological variables (RSA-B, RSA-R argument, or star tracing) predicted increasing probability of membership in this profile. These findings support theories relating lower levels of RSA at rest and/or a strong RSA withdrawal response to internalizing symptoms (Beauchaine, 2001; Gazelle & Druhen, 2009; Hinnant & El-Sheikh, 2009), although at least one other study has found the opposite with an at-risk sample (Gentzler, et al., 2009). Consistent with prior recommendations for further investigation of sex differences in relations between ANS activity and psychopathology (Beauchaine, 2009), our results suggest that girls may be especially at risk for developing elevated levels of internalizing symptoms when they also exhibit lower RSA-B or excessive RSA withdrawal to cognitive stress.

The probability of children's membership in the high externalizing/internalizing trajectory profile was predicted (marginally) by RSA-B and (significantly) by an interaction between sex and RSA-R to the cognitively frustrating star-tracing task. Children with lower RSA-B were marginally more likely to be in this profile as compared to the normative profile. This tendency toward lower RSA-B in both nonnormative trajectory profiles seems to support lower RSA-B as a common but nonspecific risk factor for psychopathology. This finding also fits with theories that view RSA-B as a physiological index of emotionality and the capacity to attend to and deal with stress (e.g., Oveis et al., 2009; Porges, 1995). Additional support for causal relations might be found longitudinally; if RSA-B is causally related to adjustment, then changes in RSA-B should be related to alterations in adjustment. Evidence for changes in RSA-B in relation to psychopathology or emotion regulation comes from only a very few sources. Using an at-risk sample, Vasilev et al. (2009) found that later emotion regulatory abilities predicted increases in RSA-B over time, whereas El-Sheikh and Hinnant (2011) found that higher initial levels of RSA-B (but not changes in RSA-B over time) predicted decreases in externalizing problem trajectories for boys. Both of these longitudinal studies were of fairly short duration, and the proposed allostatic shifts may occur over an extended period of time.

Girls with stronger RSA-R to the star-tracing task were slightly more likely to be in the high externalizing/internalizing profile as were boys with weaker RSA-R. Weaker RSA-R or RSA activation to cognitively demanding or frustrating tasks has previously been related to increased externalizing and delinquency problems, but these studies did not account for, or only controlled for, internalizing problems (El-Sheikh et al., 2011; Hinnant & El-Sheikh, 2009). The two cross-sectional studies of RSA and co-occurring symptoms have not found that children with high externalizing and internalizing problems are differentiated from other groups of children based on RSA-R (Boyce et al., 2001) or have found stronger RSA-R (Calkins et al., 2007). However, neither of these studies investigated interactions with sex.

The observed sex-related interactions point to potentially different processes by which boys and girls use self-regulatory processes to integrate physiological stress and arousal into behavior (e.g., Calkins, Dedmon, Gill, Lomax, & Johnson, 2002; Zahn-Waxler, 1993). Given the sex differences in the manifestations of internalizing symptoms (with boys who later show severely depressed mood being more likely to be aggressive and undercontrolled; Crick & Zahn-Waxler, 2003), the physiological underarousal associated with failure to engage may be especially related to high levels of externalizing and internalizing symptoms for boys, potentially through disengagement of attentional and emotional systems that are necessary for building healthy social relationships. Ties between physiological stress response system activity and codeveloping symptoms may be different for girls: in this study, high levels of parasympathetic withdrawal to stress (stronger RSA-R) were related to increased likelihood of internalizing or externalizing–internalizing problems, which points to increased feelings of stress to environmental challenges, with emotion overarousal or dysregulation serving as possible mediators.

It is important to interpret the findings of this study in light of its strengths and weaknesses, which point to directions for future investigations. First, a first key limitation is that we do not have the data that would illuminate the behavioral or psychological constructs (e.g., emotion regulation, effortful control, fearlessness, and impulsivity) mediating the links between physiological responses and symptoms of psychopathology (e.g., Eisenberg et al., 2009; Gilliom & Shaw, 2004). In addition, although we found important sex differences in how RSA was linked to externalizing and internalizing symptoms, we can only speculate on how these mediators may be sex specific. Relevant to this shortcoming, other research groups are actively investigating these intervening or mediating processes (e.g., Blandon, Calkins, Keane, & O'Brien, 2008; Butler, Wilhelm, & Gross, 2006; Gentzler et al., 2009).

Second, task specificity in RSA-R played a role in our findings; reactivity to the socially stressful argument task was most relevant to predicting membership in the low externalizing/moderate internalizing trajectory profile and suggests some specificity to internalizing symptoms. However, reactivity to the frustrating star-tracing task was relevant to predicting membership in both of the profiles termed nonnormative. It seems likely that as research in this field progresses, it will become increasingly important to select laboratory stressors (that are preferably standardized and validated) to elicit physiological reactivity that are conceptually and empirically relevant to the outcomes under consideration (Hinnant & El-Sheikh, 2009; Obradovic et al., 2011). If, for example, researchers are interested in understanding the role of physiological stress response systems in the development of social anxiety, it would be important to employ a laboratory stressor that is validated as a physiologically stressful social task. Related to this, symptom specificity will also be an important topic of future research. In the current study, we averaged children's self-reported anxiety and depressive symptoms to index overall internalizing symptoms, an important first step in understanding how PNS activity is related to the codevelopment of symptoms. In order to apply this research to intervention and prevention efforts, however, it will be necessary to examine symptoms with an eye toward greater specificity.

Third, environmental characteristics were not considered in the relations between RSA and symptoms of psychopathology. Prior research has shown that these relations are also dependent upon environmental characteristics such as familial marital conflict, with higher RSA-B or stronger RSA-R acting as protective factors in risky environments. For example, children with lower RSA-B may still function well and may not exhibit significant psychopathology symptoms in homes with lower levels of parent marital conflict (El-Sheikh et al., 2011). Clearly, biology by environment interactions are important for understanding individual differences in adjustment trajectories (Beauchaine et al., 2008; Steinberg & Avenevoli, 2000). Environmental stressors shape the development of physiological stress response systems through allostatic processes (McEwen & Stellar, 1993; see also the recent 2011 special issues on allostatic load in this journal) that push systems toward vigilant or withdrawn profiles of function (Del Giudice, Ellis, & Shirtcliff, 2011; Del Giudice, Hinnant, Ellis, & El-Sheikh, 2012).

Fourth, our sample was community based; children diagnosed with attention-decficit/hyperactivity disorder, a learning disability, or a chronic illness were excluded. This limits generalizability and leaves open the possibility that relations investigated in this sample may be different in clinical samples. A guiding principal of developmental psychopathology is that development in normative samples should be contrasted with development in individuals with clinical disorders (Beauchaine, 2001; Cicchetti & Rogosch, 2002). Large-scale, longitudinal studies that assess normative children and children with clinical disorders will be important for understanding how these processes operate across the full spectrum of symptoms of psychopathology. Such large-scale studies are imperative for understanding the role of physiological systems in complex, multilevel influences on the development of psychopathology, its treatment, and efficacious intervention efforts (Cicchetti & Gunnar, 2008).

Fifth, while the growth mixture approach we used is very promising because it can elucidate complex patterns of development in multiple domains within and across individuals, there are still some issues to be resolved in this new generation of data analysis methods (for reviews see Bauer & Curran, 2003, 2004; Sterba & Bauer, 2010). It is important to note that our choice of analytic techniques was driven by the research questions and the desire to capture developmental trends in multiple domains simultaneously. We do not claim that we are capturing “true” latent profiles. For example, true latent classes or profiles may sometimes be found in clinical research (as in the presence of specific disorders like schizophrenia, which result in qualitative differences in function over multiple domains). The developmental trajectories presented here are almost certainly capturing quantitative differences in normative trends rather than qualitative differences. Despite this shortcoming, however, we think that this approach provided useful information about codeveloping symptoms.

To summarize, this is the first study to investigate how physiological systems are related to codeveloping externalizing and internalizing symptoms. We tested how interactions between sex and PNS activity as indexed by RSA-B and RSA-R predict probability of membership in three trajectory profiles (normative, low externalizing/moderate internalizing, and high externalizing/internalizing) in middle to late childhood. Relations between RSA and trajectory profiles were largely dependent upon sex, but they consistently pointed to RSA as an important measure of the body's stress response system that is predictive of codeveloping patterns of psychopathology symptoms. Continued study in the area of codeveloping symptoms is of great importance because high levels of co-occurring or codeveloping symptoms are related to persistence in symptoms over longer periods of time and less optimal long-term function (Angold et al., 1999). Our hope is that this study will contribute to a better understanding of physiological systems that underlie symptoms of psychopathology and the identification of children that are most at risk for developing externalizing and internalizing disorders.

Acknowledgments

This research was supported by National Institute of Health Grant R01-HD046795 and National Science Foundation Grants 0339115 and 0623936. We thank the staff of our Research Laboratory, most notably Lori Staton and Bridget Wingo, for data collection and preparation, and the school personnel, children, and parents who participated.

Footnotes

1

Outlier data points included three children with RSA-B and RSA-R values far outside the expected range (between ± 5 and 8 SD around the means, most likely because of electrode malfunction), and so these values were deleted from the data set.

2

Because we had four time points, it was possible to assess quadratic, nonlinear change in children's externalizing and internalizing symptoms. Our results, however, did not suggest that adding quadratic components to the growth model was useful; model fit was not significantly worsened by constraining quadratic growth to zero for either internalizing or externalizing symptoms in the unconditional growth models. In addition, there was not significant variability in quadratic growth for symptom domain. We conducted further post hoc tests of quadratic growth with the three levels of the GMM trajectories used as a grouping variable. Five of the six variance components for the quadratic latent variables were not significantly different from zero, suggesting that even when the data were analyzed separately by trajectory group, there was no real advantage to including the nonlinear form. Thus, our analyses focused on explicating linear change.

References

  1. Acock AC. Working with missing values. Journal of Marriage and Family. 2005;67:1012–1028. [Google Scholar]
  2. Angold A, Costello EJ. Depressive comorbidity in children and adolescents: Empirical, theoretical, and methodological issues. American Journal of Psychiatry. 1993;150:1779–1791. doi: 10.1176/ajp.150.12.1779. [DOI] [PubMed] [Google Scholar]
  3. Angold A, Costello EJ, Erkanli A. Comorbidity. Journal of Child Psychology and Psychiatry. 1999;40:57–87. [PubMed] [Google Scholar]
  4. Bauer DJ, Curran PJ. Distributional assumptions of growth mixture models: Implications for overextraction of latent trajectory classes. Psychological Methods. 2003;8:338–363. doi: 10.1037/1082-989X.8.3.338. [DOI] [PubMed] [Google Scholar]
  5. Bauer DJ, Curran PJ. The integration of continuous and discrete latent variable models: Potential problems and promising opportunities. Psychological Methods. 2004;9:3–29. doi: 10.1037/1082-989X.9.1.3. [DOI] [PubMed] [Google Scholar]
  6. Beauchaine T. Vagal tone, development, and Gray's motivational theory: Toward an integrated model of autonomic nervous system functioning in psychopathology. Development and Psychopathology. 2001;13:183–214. doi: 10.1017/s0954579401002012. [DOI] [PubMed] [Google Scholar]
  7. Beauchaine TP. Commentary: Some difficulties in interpreting psychophysiological research with children. Monographs of the Society for Research in Child Development. 2009;74:80–88. doi: 10.1111/j.1540-5834.2009.00509.x. [DOI] [PubMed] [Google Scholar]
  8. Beauchaine TP, Gatzke-Kopp L, Mead HK. Polyvagal theory and developmental psychopathology: Emotion dysregulation and conduct problems from preschool to adolescence. Biological Psychology. 2007;74:174–184. doi: 10.1016/j.biopsycho.2005.08.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Beauchaine TP, Hong J, Marsh P. Sex differences in autonomic correlates of conduct problems and aggression. Journal of the American Academy of Child & Adolescent Psychiatry. 2008;47:788–796. doi: 10.1097/CHI.0b013e318172ef4b. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Beauchaine TP, Klein DN, Crowell SE, Derbridge C, Gatzke-Kopp L. Multifinality in the development of personality disorders: A Biology × Sex × Environment interaction model of antisocial and borderline traits. Development and Psychopathology. 2009;21:735–770. doi: 10.1017/S0954579409000418. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Berntson GG, Bigger JT, Jr, Eckberg DL, Grossman P, Kaufmann PG, Malik M, et al. Heart rate variability: Origins, methods, and interpretive caveats. Psychophysiology. 1997;34:623–648. doi: 10.1111/j.1469-8986.1997.tb02140.x. [DOI] [PubMed] [Google Scholar]
  12. Berntson GG, Cacioppo JT, Grossman P. Whither vagal tone. Biological Psychology. 2007;74:295–300. doi: 10.1016/j.biopsycho.2006.08.006. [DOI] [PubMed] [Google Scholar]
  13. Berthoud HR, Neuhuber WL. Functional and chemical anatomy of the afferent vagal system. Autonomic Neuroscience: Basic and Clinical. 2000;85:1–17. doi: 10.1016/S1566-0702(00)00215-0. [DOI] [PubMed] [Google Scholar]
  14. Bird HR, Gould MS, Staghezzi BM. Patterns of diagnostic comorbidity in a community sample of children aged 9 through 16 years. Journal of the American Academy of Child & Adolescent Psychiatry. 1993;32:361–368. doi: 10.1097/00004583-199303000-00018. [DOI] [PubMed] [Google Scholar]
  15. Blandon AY, Calkins SD, Keane SP, O'Brien M. Individual differences in trajectories of emotion regulation processes: The effects of maternal depressive symptomatology and children's physiological regulation. Developmental Psychology. 2008;44:1110–1123. doi: 10.1037/0012-1649.44.4.1110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Boyce WT, Quas J, Alkon A, Smider NA, Essex MJ, Kupfer DJ. Autonomic reactivity and psychopathy in middle childhood. British Journal of Psychiatry. 2001;179:144–150. doi: 10.1192/bjp.179.2.144. [DOI] [PubMed] [Google Scholar]
  17. Boylan K, Vaillancourt T, Boyle M, Szatmari P. Comorbidity of internalizing disorders in children with oppositional defiant disorder. European Child & Adolescent Psychiatry. 2007;16:484–494. doi: 10.1007/s00787-007-0624-1. [DOI] [PubMed] [Google Scholar]
  18. Brendgen M, Vitaro F, Bukowski WM, Doyle AB, Markiewicz D. Developing profiles of peer social preference over the course of elementary school: Associations with trajectories of externalizing and internalizing behavior. Developmental Psychology. 2001;37:308–320. doi: 10.1037//0012-1649.37.3.308. [DOI] [PubMed] [Google Scholar]
  19. Butler EA, Wilhelm FH, Gross JJ. Respiratory sinus arrhythmia, emotion, and emotion regulation during social interaction. Psychophysiology. 2006;43:612–622. doi: 10.1111/j.1469-8986.2006.00467.x. [DOI] [PubMed] [Google Scholar]
  20. Calkins SD, Dedmon SE. Physiological and behavioral regulation in two-year-old children with aggressive/destructive behavior problems. Journal of Abnormal Child Psychology. 2000;28:103–118. doi: 10.1023/a:1005112912906. [DOI] [PubMed] [Google Scholar]
  21. Calkins SD, Dedmon SE, Gill KL, Lomax LE, Johnson LM. Frustration in infancy: Implications for emotion regulation, physiological processes, and temperament. Infancy. 2002;3:175–197. doi: 10.1207/S15327078IN0302_4. [DOI] [PubMed] [Google Scholar]
  22. Calkins SD, Graziano PA, Keane SP. Cardiac vagal regulation differentiates among children at risk for behavior problems. Biological Psychology. 2007;74:144–153. doi: 10.1016/j.biopsycho.2006.09.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Calkins SD, Keane SP. Cardiac vagal regulation across the preschool period: Stability, continuity, and implications for childhood adjustment. Developmental Psychobiology. 2004;45:101–112. doi: 10.1002/dev.20020. [DOI] [PubMed] [Google Scholar]
  24. Chen E, Matthews KA, Salomon K, Ewart CK. Cardiovascular reactivity during social and nonsocial stressors: Do children's personal goals and expressive skills matter? Health Psychology. 2002;21:16–24. [PubMed] [Google Scholar]
  25. Cicchetti D, Gunnar MR. Integrating biological measures into the design and evaluation of preventive interventions. Development and Psychopathology. 2008;20:737–743. doi: 10.1017/S0954579408000357. [DOI] [PubMed] [Google Scholar]
  26. Cicchetti D, Rogosch FA. A developmental psychopathology perspective on adolescence. Journal of Consulting and Clinical Psychology. 2002;70:6–20. doi: 10.1037//0022-006x.70.1.6. [DOI] [PubMed] [Google Scholar]
  27. Crick NR, Zahn-Waxler C. The development of psychopathology in females and males: Current progress and future challenges. Development and Psychopathology. 2003;15:719–742. [PubMed] [Google Scholar]
  28. Curran PJ, Stice E, Chassin L. The relation between adolescent alcohol use and peer alcohol use: A longitudinal random coefficients model. Journal of Consulting and Clinical Psychology. 1997;65:130–140. doi: 10.1037//0022-006x.65.1.130. [DOI] [PubMed] [Google Scholar]
  29. Dekovic M, Buist KL, Reitz E. Stability and changes in problem behavior during adolescence: Latent growth analysis. Journal of Youth and Adolescence. 2004;33:1–12. [Google Scholar]
  30. Del Giudice M, Ellis BJ, Shirtcliff EA. The adaptive calibration model of stress responsivity. Neuroscience & Biobehavioral Reviews. 2011;35:1562–1592. doi: 10.1016/j.neubiorev.2010.11.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Del Giudice M, Hinnant JB, Ellis BJ, El-Sheikh M. Adaptive patterns of stress responsivity: A preliminary investigation. Developmental Psychology. 2012;48:775–790. doi: 10.1037/a0026519. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Duncan SC, Duncan TE, Hops H. Analysis of longitudinal data within accelerated longitudinal designs. Psychological Methods. 1996;1:236–248. [Google Scholar]
  33. Eisenberg N, Valiente C, Spinrad TL, Cumberland A, Liew J, Reiser M, et al. Longitudinal relations of children's effortful control, impulsivity, and negative emotionality to their externalizing, internalizing, and co-occurring behavior problems. Developmental Psychology. 2009;45:988–1008. doi: 10.1037/a0016213. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. El-Sheikh M, Harger J, Whitson S. Exposure to parental conflict and children's adjustment and physical health: The moderating role of vagal tone. Child Development. 2001;72:1617–1636. doi: 10.1111/1467-8624.00369. [DOI] [PubMed] [Google Scholar]
  35. El-Sheikh M, Hinnant JB. Marital conflict, respiratory sinus arrhythmia, and allostatic load: Interrelations and associations with the development of children's externalizing behavior. Development and Psychopathology. 2011;23:815–829. doi: 10.1017/S0954579411000320. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. El-Sheikh M, Hinnant JB, Erath S. Developmental trajectories of delinquency symptoms in childhood: The role of marital conflict and autonomic nervous system activity. Journal of Abnormal Psychology. 2011;120:16–32. doi: 10.1037/a0020626. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. El-Sheikh M, Kouros CD, Erath S, Cummings EM, Keller P, Staton L. Marital conflict and children's externalizing behavior: Interactions between parasympathetic and sympathetic nervous system activity. Monographs of the Society for Research in Child Development. 2009;74(1, Serial No. 231) doi: 10.1111/j.1540-5834.2009.00501.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Fanti KA, Henrich CC. Trajectories of pure and co-occurring internalizing and externalizing problems from age 2 to age 12: Findings from the national institute of child health and human development study of early child care. Developmental Psychology. 2010;46:1159–1175. doi: 10.1037/a0020659. [DOI] [PubMed] [Google Scholar]
  39. Flom PL, Strauss SM. Some graphical methods for interpreting interactions in logistic and OLS regression. Instrument Validation. 2003;29:1–7. [Google Scholar]
  40. Forbes EE, Fox NA, Cohn JF, Galles SF, Kovacs M. Children's affect regulation during a disappointment: Psychophysiological responses and relation to parent history of depression. Biological Psychology. 2006;71:264–277. doi: 10.1016/j.biopsycho.2005.05.004. [DOI] [PubMed] [Google Scholar]
  41. Galambos NL, Barker ET, Almeida DM. Parents do matter: Trajectories of change in externalizing and internalizing problems in early adolescence. Child Development. 2003;74:578–594. doi: 10.1111/1467-8624.7402017. [DOI] [PubMed] [Google Scholar]
  42. Gazelle H, Druhen MJ. Anxious solitude and peer exclusion predict social helplessness, upset affect, and vagal regulation in response to behavioral rejection by a friend. Developmental Psychology. 2009;45:1077–1096. doi: 10.1037/a0016165. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Gentzler AL, Santucci AK, Kovacs M, Fox NA. Respiratory sinus arrhythmia reactivity predicts emotion regulation and depressive symptoms in at-risk and control children. Biological Psychology. 2009;82:156–163. doi: 10.1016/j.biopsycho.2009.07.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Gilliom M, Shaw DS. Codevelopment of externalizing and internalizing problems in early childhood. Development and Psychopathology. 2004;16:313–333. doi: 10.1017/s0954579404044530. [DOI] [PubMed] [Google Scholar]
  45. Graziano PA, Keane SP, Calkins SD. Cardiac vagal regulation and early peer status. Child Development. 2007;78:264–278. doi: 10.1111/j.1467-8624.2007.00996.x. [DOI] [PubMed] [Google Scholar]
  46. Hankin BL, Wetter E, Cheely C. Sex differences in child and adolescent depression: A developmental psychopathological approach. In: Abela JRZ, Hankin BL, editors. Handbook of child and adolescent depression. New York: Guilford Press; 2008. pp. 377–414. [Google Scholar]
  47. Hastings PD, Nuselovici JN, Utendale WT, Coutya J, Sullivan C. Applying the polyvagal theory to children's emotion regulation: Social context, socialization, and adjustment. Biological Psychology. 2008;79:299–306. doi: 10.1016/j.biopsycho.2008.07.005. [DOI] [PubMed] [Google Scholar]
  48. Hayes AF, Matthes J. Computational procedures for probing interactions in OLS and logistic regression: SPSS and SAS implementations. Behavior Research Methods. 2009;41:924–936. doi: 10.3758/BRM.41.3.924. [DOI] [PubMed] [Google Scholar]
  49. Hinnant JB, El-Sheikh M. Children's externalizing and internalizing symptoms over time: The role of individual differences in patterns of RSA responding. Journal of Abnormal Child Psychology. 2009;37:1049–1061. doi: 10.1007/s10802-009-9341-1. [DOI] [PubMed] [Google Scholar]
  50. Hollenstein T, Granic I, Stoolmiller M, Snyder J. Rigidity in parent–child interactions and the development of externalizing and internalizing behavior in early childhood. Journal of Abnormal Child Psychology. 2004;32:595–607. doi: 10.1023/b:jacp.0000047209.37650.41. [DOI] [PubMed] [Google Scholar]
  51. Hollingshead AB. Four Factor Index of Social Status. Unpublished manuscript 1975 [Google Scholar]
  52. James EM, Reynolds CR, Dunbar J. Self-report instruments. In: Ollendick TH, King NJ, Yule W, editors. International handbook of phobic and anxiety disorders in children and adolescents. New York: Springer; 1994. pp. 317–330. [Google Scholar]
  53. Keiley MK, Bates J, Dodge K, Pettit G. A cross-domain analysis: Externalizing and internalizing behaviors during 8 years of childhood. Journal of Abnormal Child Psychology. 2000;28:161–179. doi: 10.1023/a:1005122814723. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Kovacs M, Beck AT. The wish to die and the wish to live in attempted suicides. Journal of Clinical Psychology. 1977;33:361–365. doi: 10.1002/1097-4679(197704)33:2<361::aid-jclp2270330207>3.0.co;2-h. [DOI] [PubMed] [Google Scholar]
  55. Kovacs M, Paulauskas S, Gatsonis C, Richards C. Depressive disorders in childhood III: A longitudinal study of comorbidity with and risk for conduct disorders. Journal of Affective Disorders. 1988;15:205–217. doi: 10.1016/0165-0327(88)90018-3. [DOI] [PubMed] [Google Scholar]
  56. Kreibig SD. Autonomic nervous system activity in emotion: A review. Biological Psychology. 2010;84:394–421. doi: 10.1016/j.biopsycho.2010.03.010. [DOI] [PubMed] [Google Scholar]
  57. Lachar D, Gruber CP. Personality Inventory for Children: Second edition (PIC-2) Los Angeles: Western Psychological Services; 2001. [Google Scholar]
  58. Lane RD, McRae K, Reiman EM, Chen K, Ahern GL, Thayer JF. Neural correlates of heart rate variability during emotion. NeuroImage. 2009;44:213–222. doi: 10.1016/j.neuroimage.2008.07.056. [DOI] [PubMed] [Google Scholar]
  59. Matthews KA, Rakaczky CJ, Stoney CM, Manuck SB. Are cardiovascular responses to behavioral stressors a stable individual difference variable in childhood? Psychophysiology. 1987;24:464–473. doi: 10.1111/j.1469-8986.1987.tb00318.x. [DOI] [PubMed] [Google Scholar]
  60. Matthews KA, Woodall KL, Stoney CM. Changes in and stability of cardiovascular responses to behavioral stress: Results from a four-year longitudinal study of children. Child Development. 1990;61:1134–1144. [PubMed] [Google Scholar]
  61. Mauss IB, Robinson MD. Measures of emotion: A review. Cognition & Emotion. 2009;23:209–237. doi: 10.1080/02699930802204677. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. McEwen BS, Stellar E. Stress and the individual: Mechanisms leading to disease. Annals of Internal Medicine. 1993;153:2093–2102. [PubMed] [Google Scholar]
  63. McLachlan GJ, Peel D. Finite mixture models. New York: Wiley; 2000. [Google Scholar]
  64. Mehta PD, West SG. Putting the individual back into individual growth curves. Psychological Methods. 2000;5:23–43. doi: 10.1037/1082-989x.5.1.23. [DOI] [PubMed] [Google Scholar]
  65. Muthen B. Statistical and substantive checking in growth mixture modeling: Comment on Bauer and Curran (2003) Psychological Methods. 2003;8:369–377. doi: 10.1037/1082-989X.8.3.369. [DOI] [PubMed] [Google Scholar]
  66. Muthen B. Latent variable analysis: Growth mixture modeling and related techniques for longitudinal data. In: Kaplan D, editor. Handbook of quantitative methodology for the social sciences. Newbury Park, CA: Sage; 2004. [Google Scholar]
  67. Nagin DS. Analyzing developmental trajectories: A semiparametric, group-based approach. Psychological Methods. 1999;4:139–157. doi: 10.1037/1082-989x.6.1.18. [DOI] [PubMed] [Google Scholar]
  68. Nagin DS. Group-based modeling of development. Cambridge, MA: Harvard University Press; 2005. [Google Scholar]
  69. Nylund KL, Asparouhov T, Muthen BO. Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling. 2007;14:535–569. [Google Scholar]
  70. Obradovic J, Bush NR, Boyce WT. The interactive effect of marital conflict and stress reactivity on externalizing and internalizing symptoms: The role of laboratory stressors. Development and Psychopathology. 2011;23:101–114. doi: 10.1017/S0954579410000672. [DOI] [PubMed] [Google Scholar]
  71. Oveis C, Cohen AB, Gruber J, Shiota MN, Haidt J, Keltner D. Resting respiratory sinus arrhythmia is associated with tonic positive emotionality. Emotion. 2009;9:265–270. doi: 10.1037/a0015383. [DOI] [PubMed] [Google Scholar]
  72. Peng CJ, Lee KL, Ingersoll GM. An introduction to logistic regression analysis and reporting. Journal of Educational Research. 2002;96:3–14. [Google Scholar]
  73. Porges SW. Cardiac vagal tone: A physiological index of stress. Neuroscience & Biobehavioral Reviews. 1995;19:225–233. doi: 10.1016/0149-7634(94)00066-a. [DOI] [PubMed] [Google Scholar]
  74. Porges SW. The Polyvagal theory: Phylogenetic contributions to social behavior. Physiology & Behavior. 2003;79:503–513. doi: 10.1016/s0031-9384(03)00156-2. [DOI] [PubMed] [Google Scholar]
  75. Porges SW. The polyvagal perspective. Biological Psychology. 2007;74:116–143. doi: 10.1016/j.biopsycho.2006.06.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Reynolds CR, Richmond BO. What I think and feel: A revised measure of children's manifest anxiety. Journal of Abnormal Child Psychology. 1978;6:271–280. doi: 10.1007/BF00919131. [DOI] [PubMed] [Google Scholar]
  77. Saper CB. The central autonomic nervous system: Conscious visceral perception and autonomic pattern generation. Annual Review of Neuroscience. 2002;25:433–469. doi: 10.1146/annurev.neuro.25.032502.111311. [DOI] [PubMed] [Google Scholar]
  78. Saul JP. Beat-to-beat variations of heart rate reflect modulation of cardiac autonomic outflow. News in Physiological Sciences. 1990;5:32–37. [Google Scholar]
  79. Sildberg J, Rutter M, Meyer J, Maes H, Hewitt J, Loeber R. Genetic and environmental influences on the covariation between hyperactivity and conduct disturbance in juvenile twins. Journal of Child Psychology and Psychiatry. 1996;37:803–816. doi: 10.1111/j.1469-7610.1996.tb01476.x. [DOI] [PubMed] [Google Scholar]
  80. Singer JD, Willett JB. Applied longitudinal data analysis: Modeling change and event occurrence. New York: Oxford University Press; 2003. [Google Scholar]
  81. Stanger C, Achenbach TM, Verhulst FC. Accelerating longitudinal research on child psychopathology: A practical example. Psychological Assessment. 1994;6:102–107. [Google Scholar]
  82. Steinberg L, Avenevoli S. The role of context in the development of psychopathology: A conceptual framework and some speculative propositions. Child Development. 2000;71:66–74. doi: 10.1111/1467-8624.00119. [DOI] [PubMed] [Google Scholar]
  83. Sterba SK, Bauer DJ. Matching method with theory in person-oriented developmental psychopathology research. Development and Psychopathology. 2010;22:239–254. doi: 10.1017/S0954579410000015. [DOI] [PubMed] [Google Scholar]
  84. Suess PE, Porges SW, Plude DJ. Cardiac vagal tone and sustained attention in school-age children. Psychophysiology. 1994;31:17–22. doi: 10.1111/j.1469-8986.1994.tb01020.x. [DOI] [PubMed] [Google Scholar]
  85. Thayer JF, Lane RD. Claude Bernard and the heart–brain connection: Further elaboration of a model of neurovisceral integration. Neuroscience & Biobehavioral Reviews. 2009;33:81–88. doi: 10.1016/j.neubiorev.2008.08.004. [DOI] [PubMed] [Google Scholar]
  86. Ulrich-Lai YM, Herman JP. Neural regulation of endocrine and autonomic stress responses. Nature Reviews Neuroscience. 2009;10:397–409. doi: 10.1038/nrn2647. [DOI] [PMC free article] [PubMed] [Google Scholar]
  87. van Goozen SHM, Fairchild G. How can the study of biological processes help design new interventions for children with severe antisocial behavior? Development and Psychopathology. 2008;20:941–973. doi: 10.1017/S095457940800045X. [DOI] [PubMed] [Google Scholar]
  88. Vasilev CA, Crowell SE, Beauchaine TP, Mead HK, Gatzke-Kopp LM. Correspondence between physiological and self-report measures of emotion dysregulation: A longitudinal investigation of youth with and without psychopathology. Journal of Child Psychology and Psychiatry. 2009;50:1357–1364. doi: 10.1111/j.1469-7610.2009.02172.x. [DOI] [PubMed] [Google Scholar]
  89. Whisman MA, McClelland GH. Designing, testing, and interpreting interactions and moderator effects in family research. Journal of Family Psychology. 2005;19:111–120. doi: 10.1037/0893-3200.19.1.111. [DOI] [PubMed] [Google Scholar]
  90. Wiesner M, Kim HK. Co-occurring delinquency and depressive symptoms of adolescent boys and girls: A dual trajectory modeling approach. Developmental Psychology. 2006;42:1220–1235. doi: 10.1037/0012-1649.42.6.1220. [DOI] [PubMed] [Google Scholar]
  91. Wirt RD, Lachar D, Klinedinst JK, Seat PS. Personality Inventory for Children—Revised. Los Angeles: Western Psychological Services; 1990. [Google Scholar]
  92. Zahn-Waxler C. Warriors and worriers: Gender and psychopathology. Development and Psychopathology. 1993;5:79–89. [Google Scholar]
  93. Zahn-Waxler C, Shirtcliff EA, Marceau K. Disorders of childhood and adolescence: Gender and Psychopathology. Annual Review of Clinical Psychology. 2008;4:275–303. doi: 10.1146/annurev.clinpsy.3.022806.091358. [DOI] [PubMed] [Google Scholar]

RESOURCES