Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2022 May 1.
Published in final edited form as: Dev Psychobiol. 2020 Aug 2;63(4):782–792. doi: 10.1002/dev.22023

The Moderating Role of Externalizing Problems on the Association Between Anxiety and the Error-Related Negativity in Youth

Jennifer H Suor 1, Maria Granros 1,2, Autumn Kujawa 3, Kate D Fitzgerald 4, Christopher S Monk 5, K Luan Phan 1,6, Katie L Burkhouse 1
PMCID: PMC7855835  NIHMSID: NIHMS1627011  PMID: 32743851

Abstract

The error-related negativity (ERN) is an event-related potential that reflects error monitoring. Enhanced ERN indicates sensitivity to performance errors and is a correlate of anxiety disorders. In contrast, youth with externalizing problems exhibit a reduced ERN, suggesting decreased error monitoring. Anxiety and externalizing problems commonly co-occur in youth, but no studies have tested how comorbidity might modulate the ERN. In a sample of youth (N = 46, ages 7-19) with and without anxiety disorders, this preliminary study examined the interactive effect of anxiety and externalizing problems on ERN. Results suggest that externalizing problems moderate the relation between anxiety symptoms and ERN in youth. Anxious youth with less externalizing problems exhibited enhanced ERN response to errors. Conversely, anxious youth with greater externalizing problems demonstrated diminished ERN in response to errors. The regions of significance and proportion affected tests indicated that the moderating effect of externalizing problems was only significant for youth with anxiety disorders. Findings suggest that enhanced neural error sensitivity could be a specific neurophysiological marker for anxiety disorders, whereas anxious individuals with comorbid externalizing problems demonstrate reduced error monitoring, similar to those with primary externalizing pathology. Results underscore the utility of examining neural correlates of pediatric anxiety comorbidity subtypes.

Keywords: anxiety, externalizing behaviors, error-related negativity

Introduction

Anxiety disorders are some of the most common forms of childhood psychopathology (e.g., Copeland, Angold, Shanahan, & Costello, 2014), which typically emerge in late childhood and early adolescence (e.g., Beesdo, Knappe, & Pine 2009). Epidemiological studies of community samples of adolescents have shown the prevalence estimate of having any type of anxiety disorder is 25% within a 12-month period, and 15% in a 30-day period (e.g., Kessler et al., 2012). Longitudinal representative population-based research has also estimated that 16% of youth have an anxiety disorder at some point during their childhood and adolescence, and 30% of these anxious youth also meet criteria for an anxiety disorder at subsequent assessments (e.g., Bittner, Egger, Costello, Foley, & Angold, 2007). Notably, many youth with anxiety disorders also have other comorbid psychiatric diagnoses, including externalizing pathology. Among clinical and general population samples, research has indicated that anywhere from 15% to 23% of anxious youth meet criteria for attention-deficit hyperactivity disorder (ADHD; Angold, Costello, & Erkanli,1999a; Kendall, Brady, & Verduin, 2001), and about 9% of anxious youth meet criteria for oppositional defiant disorder (ODD; Kendall et al., 2001). It is well established that childhood comorbidity is associated with significantly worse short- and long-term psychosocial impairments (Fraire & Ollendick, 2013; Franco, Saavedra, & Silverman, 2007). Despite moderate rates of anxiety and externalizing psychopathology comorbidity, their neurobiological origins are not well understood, which is significant given increasing clinical research emphasis on understanding the underlying pathophysiology of common psychiatric disorders and syndromes, and identifying the extent to which disorders and subtypes are associated with similar or unique neurophysiological characteristics (Insel et al., 2010; Shankman & Gorka, 2015).

Psychophysiological tools, such as scalp-recorded electroencephalogram (EEG) recordings in response to environmental cues of threat and error monitoring, have proven to be useful in identifying neural correlates of different forms of psychopathology across the lifespan (e.g., Shankman & Gorka, 2015). Over 50 studies have focused on the error-related negativity (ERN), an event-related potential (ERP) component typically measured at frontocentral electrodes 50-100 ms following commission of an error (Olvet & Hajcak, 2008; Weinberg, Riesel, & Hajcak, 2012). Source localization studies and investigations employing EEG and functional magnetic resonance imaging (fMRI; Debener et al., 2005; Fitzgerald et al., 2005; Mathalon, Whitfield, & Ford, 2003) have identified the anterior cingulate cortex (ACC) as the region of the brain that generates the ERN. The ACC is the primary brain mechanism involved in on-line monitoring for conflict between simultaneously active but incompatible streams of information (Shiels & Hawk, 2010). Greater ERN amplitudes are theorized to reflect processes of heightened conflict monitoring (Yeung, Botvinick, & Cohen, 2004), and sensitivity to threat (Weinberg et al., 2016) and punishment (Shackman et al., 2011; Zambrano-Vazquez, & Allen, 2014). Research has indicated that the ERN represents a trait-like neural response to errors, as it demonstrates strong test-rest reliability and rank-order stability. Furthermore, ERN amplitudes appear to be multiply determined by genetic and environmental influences (Weinberg et al., 2012a).

Research has shown that the ERN is a neural correlate of psychopathology, particularly anxiety disorders. Specifically, enhanced (i.e., more negative) ERN in anxious individuals is frequently observed, and has been consistently replicated in both adult (Hajcak, Klawohn, & Meyer, 2019; Weinberg, Dieterich, & Riesel, 2015) and pediatric samples (Ladouceur, Dahl, Birmaher, Axelson, & Ryan, 2006; Meyer, 2017). Enhanced ERN has been shown to prospectively predict the onset of anxiety psychopathology in school-age children (Meyer, Proudfit, Torpey-Newman, Kujawa, & Klein, 2015), adolescents (Meyer, Nelson, Perlman, Klein, & Kotov, 2018), and adults (Tang et al., 2020), to identify individuals with a family history of anxiety (Riesel et al., 2019), and to associate with fear-based anxiety symptoms in adults (Gorka, Burkhouse, Afshar, & Phan, 2017)

Although studies have been more limited, differences in ERN have also been documented in individuals with externalizing symptomatology (Pasion & Barbosa, 2019). Externalizing symptoms and disorders have been linked with error-related hypoactivity or a blunted ERN, which means more positive rather than negative ERN amplitudes, the latter being observed in anxiety disorders (Shiels & Hawk, 2010; Hall, Bernat, & Patrick, 2007; Pasion & Barbosa, 2019). Blunted ERNs have been documented in youth with ADHD and disruptive behaviors disorders (Geburek, Rist, Gediga, Stroux, & Pedersen, 2013; Meyer & Klein, 2018; Vilà-Balló, Hdez-Lafuente, Rostan, Cunillera, & Rodriguez-Fornells, 2014). This suggests that externalizing symptoms and psychopathology are characterized by deficient error responding and impaired error evaluation.

It is important to note that ERN findings in the anxiety and externalizing literatures have not been entirely consistent, such that symptom/disorder and ERN patterns do not always demonstrate the expected directional relationships, particularly when there is comorbid psychopathology. For example, some adult studies have found that ERN and anxiety disorder associations differ when individuals have comorbid depression (Weinberg, Klein, & Hajcak, 2012b; Weinberg, Kotov, & Proudfit, 2015). In addition, Stieben et al. (2007) found that the association between externalizing problems and a blunted ERN was less apparent among children with comorbid internalizing problems.

Despite the high prevalence of anxiety disorders (Beesdo et al., 2009; Copeland et al., 2014) and frequent co-occurrence of externalizing problems in childhood (Angold, et al.,1999a; Kendall et al., 2010; Verdiun & Kendall, 2003), how anxiety and externalizing comorbidity patterns relate to ERN profiles has yet to be tested. Research that examines these relations could have the potential to resolve some of the inconsistencies observed in the ERN pediatric literature; and furthermore, increase precision in our understanding of neural correlates of anxiety comorbidity subtypes, and elucidate primary sources of impairment that could have translational implications. Accordingly, the primary aim of this preliminary study was to be one of the first to investigate how ERN responses could differentiate anxious subtypes as defined by those with and without comorbid externalizing problems in a pediatric sample. Healthy youth, defined as those without lifetime histories of psychiatric disorders, were also included in order to examine psychiatric symptom and ERN relations dimensionally. The overall sample consisted of anxious youth and healthy controls (ages 7 – 19 years old) who were recruited for a study of the treatment of pediatric anxiety disorders. Based on prior work on ERN in anxiety disorders (Meyer, 2017; Meyer et al., 2013), we hypothesized that youth with greater anxiety symptoms who did not have co-occurring externalizing problems would demonstrate enhanced ERN (i.e., greater sensitivity to errors). Drawing on preliminary studies suggesting anxiety and ERN relations could be qualified by psychiatric comorbidity (Stieben et al., 2007), we predicted that youth with co-occurring anxiety symptoms and externalizing problems would exhibit a blunted ERN, indicating reduced error monitoring.

Methods

Procedures and Participants

The current sample was drawn from a multi-site study of pediatric anxiety disorders at the University of Michigan (UM) and the University of Illinois at Chicago (UIC) that recruited youth with and without anxiety disorders. At each site youth were recruited from outpatient psychiatric clinics and from the surrounding communities via Internet postings and flyers. Participants and their parents completed a battery of diagnostic interviews and symptom assessments. Youth completed a Flanker task while electroencephalogram (EEG) was recorded. Participants included 46 youth (anxious participants, n = 27; healthy controls, n = 19) who were between the ages of 7 and 19 years old (M = 13.11, SD = 3.21) and had usable EEG and complete questionnaire data. Psychiatric diagnoses were obtained through the semi-structured Schedule of Affective Disorders and Schizophrenia for School-Age Children (Kaufman et al., 1997), which was administered by trained master’s-level and doctoral-level clinicians. Anxious participants (n = 27) had primary diagnoses of generalized anxiety disorder (n = 18); social anxiety disorder (n = 7); or separation anxiety disorder (n = 2). Some anxious participants also met criteria for panic disorder (n = 1) and specific phobia (n = 1), and 37.0% met criteria for more than one anxiety disorder. Anxious youth also had comorbid major depressive disorder (n = 2), obsessive compulsive disorder (n = 1), and ADHD (n = 2). Healthy controls (n = 19) had no lifetime psychiatric histories. Exclusionary criteria included history of bipolar or schizophrenia disorders, intellectual disability, pervasive developmental disorders, current substance abuse, and current suicidal ideation.

Approximately 47.8% of the participants were female (n = 22). Participants identified as Caucasian (60.9%), Latinx (10.9%), African American (21.7%), and Asian or Pacific Islander (6.5%). About 23.9% of the sample identified as Hispanic. Study procedures were approved by the UM and UIC Institutional Review Boards prior to data collection. Informed consent and assent was obtained from youth and their legal guardians prior to the administration of study measures.

Assessment of anxiety symptoms and externalizing behavior problems

To measure anxiety symptom severity, youth were administered the Pediatric Anxiety Rating Scale (PARS), which is an interviewer-rated measure of anxiety symptom severity across seven dimensions of anxiety (e.g., frequency and number of symptoms, overall symptom severity, physical symptom severity, avoidance, and interference at home and outside of the home) (Research Units on Pediatric Psychopharmacology Anxiety Study Group, 2002). Parents completed the Child Behavior Checklist for Ages 6-18 (CBCL; Achenbach & Rescorla, 2001), which is a parent report measure of a broad range of problems experienced by youth. Parents indicate whether their child experiences a particular behavior problem on a 0-2 rating scale (0 = Not true, 1= Somewhat or Sometimes True, 2 = Very true or Often True). The CBCL includes 8 empirically derived syndrome scales. The aggressive behavior (α = .89), rule-breaking behavior (α = .69), and social problems (α = .83) subscales were used as indicators of externalizing behavior problems, and demonstrated adequate internal consistency. We also chose to use the social problems subscale, as prior research has demonstrated that it assesses specific social behavior problems of externalizing behaviors that are not captured by the aggressive behavior and rule-breaking scales (e.g., Bunford et al., 2017). We observed variability in scores across the different CBCL subscales. On the social problems subscale, 52.2% of the sample had scores above the normative mean, with 13% of scores ≥ 1 standard deviation (SD) above the normative mean. For the aggressive behavior subscale, 28.2% of the sample had scores above the normative mean, with 17.4% of scores falling ≥ 1 SD above the normative mean. For rule-breaking behavior, 47.8% of the sample had scores above the normative mean, with 13% of participants with scores ≥ 1 SD above the normative mean. The subscales were positively and significantly correlated with each other (rs ranged from .58 – .70, ps < .01). Principal components analysis with varimax rotation was performed on the three subscales. Inspection of the eigenvalues (> 1) and scree plot supported a single-factor solution. The solution accounted for 75.06% of the variance, yielding positive loadings for aggressive behavior (r = 89), rule-breaking (r = .88), and social problems (r =. 83). Subscales were aggregated to create an internally consistent composite of youth externalizing behavior problems (α = .75). Anxiety symptoms and the externalizing problems composite were significantly correlated, r = .61, p < .01. Anxiety symptoms and externalizing problems were normally distributed (absolute skewness < 2; absolute kurtosis < 4; George & Mallery, 2010; Hair, Black, Babin, & Anderson, 2010).

Error Monitoring Task

Participants completed a modified Flanker task (Falkenstein, Hohnsbein, Hoormann, & Blanke, 1991), which measures performance monitoring in response to errors. A large body of evidence has shown that the Flanker task reliably elicits the ERN across development and evinces excellent test-retest reliability (e.g., Olvet & Hajcak, 2009; Weinberg & Hajcak, 2011). The Flanker task consists of 11 blocks of 30 trials (330 trials total). On each trial horizontally aligned arrowheads are presented on a computer screen for 200 ms, which is then followed by an intertrial interval between 2,300 and 2,800 ms. On half the trials, the arrows are aligned in the same direction (>>>>> or <<<<<), and on the other half, the center arrowhead is in an opposing, incompatible direction to the other arrowheads (<< > << or >> < > >). Participants were instructed to press the left or right mouse button to indicate the direction of the center arrow. Participants completed a practice block of 30 trials before starting the task to ensure their understanding of the rules of the task. Participants received feedback on their performance at the end of each block in order to obtain an adequate number of error trials. The message “Please try to be more accurate” was displayed on the screen if their accuracy was below 75%, and “Please try to respond faster” was displayed if their accuracy was above 90%. Otherwise, the message “You’re doing a great job” appeared on the screen. To reduce the potential impact of study site effects, procedures for the Flanker task were identical across the two study sites (e.g., administered in a quiet room with one observer present, same version of the task and software). To be consistent with exclusionary criteria from published studies with this dataset (Kujawa et al., 2016; Peters et al., 2019) all of the participants had permissible error rates (> 6 errors after artifact rejection) and percent accuracy (> 60% correct on trials with responses) on the task. On average, youth committed 32.80 errors (SD = 24.74, Range = 3 – 98), which corresponds with an overall percent accuracy rate of 90% (SD = .08, Range = .70 – .99). Average response time across the trials was 445.99 ms (SD = 137.26, Range = 152.65 – 975.46). Anxious youth and healthy youth did not differ in total errors (F (1, 41) = .24, p = .63), percent accuracy (F (1, 41) = .24, p = .63), or average reaction time (F (1, 41) = .50, p = .48) on the task.

EEG data acquisition and preprocessing

The EEG data acquisition and preprocessing steps were identical across the study sites. Continuous EEG recordings were collected while participants completed the Flanker task using the BioSemi (Amsterdam, Netherlands) 34- channel cap (32 channels plus FCz and lz). Data acquisition and processing procedures for the study have been detailed in previous publications (Kujawa et al., 2016; Peters et al., 2019). Electrodes were placed on the right and left mastoids. To account for ocular artifacts that result from eye blinks and other eye movements, electrooculargram (EOG) signals were recorded from two electrodes placed 1 cm above and below the right eye to measure vertical eye blinks and movements and two electrodes placed 1 cm beyond the outer edge of each eye to measure horizontal eye blinks and movements. Data were digitized at a 24-bit resolution with Least Significant Bit (LSB) value of 31.25 nV and sampling rate of 1,024 Hz. Processing of EEG data was performed offline using Brain Vision Analyzer software (Brain Products, Gilching, Germany). Data were converted to a linked mastoid reference, filtered with high-pass and low-pass filters of .1 and 30 Hz, and segmented 500 ms before the response through 1,000 ms after the response. Eye blinks were corrected using standard methods (Gratton, Coles, & Dochin, 1983), and semi-automated artifact rejection procedures were used to detect and eliminate artifacts with a voltage step of > 50μV between sample points, with a maximum voltage difference of 175 μV within 400 ms intervals, and additional artifacts were removed using visual inspection. ERPs to errors and correct responses were averaged separately and baseline corrected to the window 500– 300 ms before the response. The ERN was scored by pooling frontocentral sites (Fz, FCz, Cz) as mean activity 0 to 100 ms after the response (Figure 1; prior to adjusting for other study variables of interest). As expected, the ERP was more negative to error versus correct responses (t (45) = − 6.14, p < .001). As employed in prior work (Meyer, Lerner, De Los Reyes, Laird, & Hajcak, 2017), a residual scoring approach was used to operationalize ERN. This was accomplished by regressing the error values on to the correct values in order to obtain unstandardized residual scores, which were then saved in the dataset and used in the study analyses. The unstandardized residual ERN score allows for isolation of the variance in the ERP wave related to performance monitoring (Luck, 2005). More negative residual ERN amplitudes indicate enhanced response to errors relative to correct responses (i.e., increased error monitoring).

Figure 1.

Figure 1.

The topographic map of neural activity (error minus correct) and response-locked event-related potential (ERP) waveforms at an average of Fz, FCz, and Cz across the entire sample. The raw waveforms for correct and error responses and the error-correct difference (dotted line) are shown in the graph. Negative voltages are plotted down, and represent increases in ΔERN.

Data analytic plan

Statistical analyses were conducted with SPSS Version 25 (IBM Corp., Armonk, N.Y., USA). Multiple linear regression analyses were performed to examine main and interactive effects between anxiety symptoms and externalizing problems in relation to ERN amplitudes in youth and in association with youths’ behavioral performance on the flanker task (e.g., reaction time, total errors, percent accuracy). For the interaction analysis we employed a residual centering approach (Little, Bovaird, & Widaman, 2006), which ensures orthogonality between the interaction variable and the first-order main effects. This technique began with centering the main effect variables and then multiplying them to create the product term. In the next step, the product term was regressed on the centered main effect predictor variables to remove main effect information contained in the interaction term. The residual score was saved as a new variable in the dataset and utilized in the analysis. Significant interactions were followed up with simple slopes analysis (Fraley, 2012; http://www.yourpersonality.net/interaction/ros.pl). Anxiety symptoms and externalizing problems were plotted at −/+ 1 SDs from their centered means.

Results

Descriptive Statistics

Demographic and clinical characteristics of the sample are presented in Table 1. Age and gender distributions were similar across healthy and anxious youth participants, as were proportions of youth who identified as Caucasian, African American, Asian, and Hispanic. There were marginally more anxious participants who identified as Latinx (n = 5) relative to the healthy youth (n = 0; χ2 (1) = 3.95, p = .05). Mean levels of anxiety symptoms (F (1, 46) = 41.73, p < .01) and externalizing behaviors (F (1, 46) = 29.17, p < .001) were significantly greater among anxious youth compared to healthy youth.

Table 1.

Demographic and clinical characteristics of anxious and healthy youth

Healthy Youth
(n = 19)
Anxious Youth
(n = 27)
Overall
(n = 46)
M SD M SD M SD F p value
Age 14 2.92 12.48 2.92 13.11 3.21 2.59 .12
PARS Total Score 1.16 2.29 23.96 4.23 14.54 11.89 41.73 < .01
Externalizing Problems 1.89 2.08 12.33 9.94 8.02 9.27 29.17 < .01
Accuracy (% Correct) .91 .07 .90 .08 .90 .07 .24 .63
Total Errors 30.62 23.09 34.43 26.13 32.8 24.74 .24 .53
Response Time 428.54 131.97 459.09 142.46 445.99 137.26 .50 .48
N % N % N % χ2 p value
Sex (% female) 8 42.1 14 51.9 22 47.8 .43 .52
Ethnicity
Hispanic 3 15.8 8 29.6 11 23.9 1.17 .28
Race
Caucasian 13 68.4 15 55.6 28 60.9 .78 .38
African American 6 31.6 4 14.8 10 21.7 1.84 .18
Asian or Pacific Isl. 0 0.0 3 11.1 3 6.5 2.26 .13
Latinx 0 0.0 5 18.5 5 21.7 3.95 .05
Primary Diagnoses
Generalized Anxiety -- -- 18 39.1
Separation Anxiety -- -- 2 4.3
Social Anxiety -- -- 7 15.2
Comorbid Diagnoses
ADHD -- -- 2 4.3
Depressive Disorders -- -- 2 4.3
Obsessive-Compulsive -- -- 1 2.2
Panic -- -- 3 6.5
Specific Phobia -- -- 1 2.2

Note. SD = Standard Deviation. PARS = Pediatric Anxiety Rating Scale. Isl. = Islander. ADHD = Attention-Deficit Hyperactivity Disorder.

Primary Analysis

To examine the relation between anxiety and externalizing symptoms and the ERN, the main effects of anxiety symptoms and externalizing problems, and their two-way interaction were entered into a multiple linear regression model with ERN set as the dependent variable. The overall model accounted for significant variance in youth ERN (F (3, 45) = 4.13, p = .01, R2 = .23). The main effect of anxiety symptoms on ERN was not significant (β = −.19, t = − 1.10, p = .28, 95% CI = −.22, .06). The main effect of externalizing problems on ERN was significant (β = .37, t = 2.14, p = .04, 95% CI = .01, .38), specifically greater externalizing problems were associated with reduced ERN amplitudes (i.e., blunted error response). There was a significant two-way interaction effect between anxiety symptoms and externalizing problems on ERN (β = .38, t = 2.78, p = .01, 95% CI = .011, .068; See Table 2). We reanalyzed the regression model adjusting for the potential influence of age and gender on ERN. The two-way interaction effects remained significant (β = .31, t =2.215, p = .03, 95% CI = .003, .06). The main effects of age (β = −.22, t = .47, p = .15, 95% CI = −.80, .13) and gender (β = −.07, t = .49, p = .63, 95% CI = −3.64, 2.21) on ERN were not significant.

Table 2.

Multiple Regression linear regression analysis examining the interaction effect between anxiety symptoms and externalizing problems on ERN

Independent Variable b SE β t p value
Anxiety Symptoms −.078 .07 −.19 −1.10 .28
Ext. Problems .197 .09 .37 2.14 .04*
Anxiety Symptoms x Ext. Problems .039 1.56 .38 2.78 .01**

Note. Ext. = Externalizing. SE = Standard Error.

To parse the significant two-way interaction, we performed a simple slopes analysis. Youth anxiety and externalizing problems were plotted at − /+ 1 SDs from their respective centered means, and externalizing problems was set as the moderator. For youth with less externalizing problems (− 1 SD from the mean), greater anxiety symptom severity was associated with an enhanced ERN response (greater error monitoring, b = −.44, t = 2.96, p = .01; Figure 2). For youth with greater externalizing problems (+ 1 SD from the mean), greater anxiety symptom severity was associated with a trend for a diminished ERN (i.e., reduced error monitoring, b = .28, t = 1.91, p = .06; Figure 2). However, the regions of significance showed that this relation became significant for values of externalizing problems that were greater than 10.41, which represents 1.12 SD from the centered mean and was represented in the dataset. Regions of significance test for anxiety symptoms showed that low and high externalizing youth did not differ in ERN responses when anxiety symptoms were at the low end of the distribution (b = −.27, t = 1.40, p = .17). However, youth with high and low externalizing problems demonstrated significantly different and opposing ERN amplitudes when anxiety symptoms were at the high end of the distribution (b = .66, t = 3.47, p = .001).

Figure 2.

Figure 2.

Plot of the significant anxiety symptom x externalizing problems interaction on youth’s error-related negativity (ERN). Values on the Y-axis represent unstandardized residual ERN values, and negative values are plotted down. More negative values indicate enhanced error monitoring. Values on the X-axis are centered anxiety symptoms. Higher scores indicate greater anxiety symptom severity. Solid line represents the simple slope for youth with externalizing problems at − 1 SD from the centered mean. Dashed line represents the simple slope for youth with externalizing problems at + 1 SD from the centered mean.

We also examined the proportion affected (PA) index, which quantifies the number of participants who are differentially affected by the interaction effect. The PA index is computed by finding the value on anxiety symptoms where the regression lines intersect, which corresponded with a total score of 18 on the Pediatric Anxiety Rating Scale (Sample Range = 0 - 30). We accomplished this by creating a new variable in the dataset where 1 was coded for all the participants whose anxiety symptoms were above the cross-over point. When we examined how many cases in the dataset that fell above the cut-off we found it directly corresponded with the number of youth in the sample that had anxiety disorders (n = 27). Given that low and high externalizing youth only differed in ERN responses when anxiety symptoms were high, this suggests youth with anxiety disorders were the participants driving the interaction effect.

Lastly, we performed multiple linear regression to examine the main effects of anxiety symptoms and externalizing problems and their two-way interaction with total errors, percent accuracy, and average reaction time. There were no main effects of anxiety symptoms on total errors (β = .16, t = .81, p = .43, 95% CI = −.50, 1.16), percent accuracy (β = −.16 , t = .81, p = .43, 95% CI = −.004, .002), or average reaction time (β = −.10, t = −.48, p = .63, 95% CI = −5.83, 3.58). There were also no main effects of externalizing problems on total errors (β = .02, t = .09, p = .93 , 95% CI = −.99, 1.09), percent accuracy (β = −.02, t = −.09, p = .93 , 95% CI = −.003, .003), or average reaction time (β = .32, t = 1.59, p = .12, 95% CI = −1.27, 10.57). There were no significant two-way interaction effects between externalizing problems and anxiety symptoms on total errors (β = .29, t = 1.90, p = .07, 95% CI = −.01, .30), percent accuracy (β = −.29, t = −1.90, p = .07, 95% CI = −.001, .000), or average reaction time (β = .02, t = .13, p = .90, 95% CI = −.83, .95). Effects were unchanged when adjusting for age and gender in the models. However, there were significant main effects of age on total errors (β = −.80, t = −6.97, p < .001, 95% CI = −8.55, .−4.70) and percent accuracy (β =.80, t = 6.97, p < .001, 95% CI = .01, .03), which indicated that older children were more accurate in their responses and committed fewer errors. Lastly, there were no significant main effects of gender on total errors (β = .09, t = .84, p = .40, 95% CI = −6.39, 15.48), percent accuracy (β = −.09, t = −.84, p = .40, 95% CI = −.05, .02), or average reaction time (β = .03, t = 1.17, p = .87, 95% CI = −87.30, 103.08).

Discussion

The overarching goal of the study was to examine whether youth error monitoring patterns, as measured by the ERN, were qualified by the extent to which youth had co-occurring anxiety and externalizing problems. Consistent with our hypotheses, we found that externalizing problems moderated the relation between anxiety symptoms and ERN. For youth with low externalizing problems, greater anxiety symptom severity was significantly associated with enhanced ERN amplitudes. In contrast for youth with greater externalizing problems, greater anxiety symptom severity was associated with decreased ERN amplitudes, demonstrating an opposing blunted pattern. Further parsing of the simple slope effect showed that youth with low and high externalizing problems only demonstrated statistically different ERN amplitudes when anxiety symptoms were at the higher, and not the lower end of the distribution. Furthermore, we found that the proportion of youth who were affected by the interaction effect directly corresponded with the 27 youth in the sample with diagnosed anxiety disorders.

It is well documented that many anxious youth have co-occurring issues with externalizing behaviors (Angold, et al.,1999a; Kendall et al., 2010; Verdiun & Kendall, 2003). However, there is a gap in understanding of the neuropsychological patterns that characterize this clinical subpopulation, since anxiety and externalizing symptom comorbidity is generally not accounted for in pediatric ERN studies. To our knowledge, the current study provides initial novel evidence that the direction of the relation between anxiety symptoms and ERN depends on whether youth have co-occurring externalizing problems, and that youth with comorbidity demonstrate diminished error sensitivity patterns that are more characteristic of patients with ADHD (e.g., Geburek, et al., 2013; Shiels & Hawk, 2010; Meyer & Klein, 2018) and ODD (Meyer & Klein, 2018; Vilà-Balló et al., 2014). In other words, in instances of comorbidity, anxiety and ERN relations are driven by the presence of externalizing problems. These findings are also notable in that only two participants in our sample met criteria for an externalizing disorder (e.g., ADHD),which potentially suggests that this neuropsychological profile emerges at sub-threshold levels of externalizing pathology. This finding is in line with evidence that subclinical syndromes are associated with psychosocial impairments (Angold et al., 1999b; Bubier & Drabick, 2009), and sub-threshold clinical conditions represent important areas of focus in prevention and intervention efforts (e.g., Shankman et al., 2009).

Specific conclusions regarding why youth with comorbid anxiety and externalizing problems demonstrate a diminished sensitivity to error responding cannot be derived from the current findings. However, drawing on existing theory one hypothesis for this finding is that for anxious youth with comorbid externalizing problems sustained anxiety may induce the depletion of inhibitory control and other monitoring processes, which then confers challenges with performance monitoring and response inhibition and manifests in acting out or aggressive behaviors (Drabick, Ollendick, & Bubier, 2010; Oh, Greenberg, Willoughby, & Family Life Project Key Investigators, 2020). Although this hypothesis is completely speculative, it could be useful in guiding future studies that can address these questions. For example, longitudinal studies that include youth with primary anxiety and psychiatric externalizing disorders (e.g., ADHD, ODD, conduct disorder) and anxiety-externalizing disorder comorbidities could empirically examine how comorbid anxiety and externalizing psychiatric disorders impact inhibitory control and other monitoring processes in predicting specific social and behavioral challenges.

There were limitations to the current study that warrant attention. First, the current study was preliminary with a relatively small sample size, and replication is needed in a larger study. The majority of anxious youth in the sample had a primary diagnosis of GAD relative to other anxiety disorders. Given this, future studies should examine whether the detected ERN patterns were primarily driven by a specific anxiety disorder and externalizing comorbidity profile. Additionally, we did not detect gender or age-related effects in our ERN analyses; a larger sample might be required to detect these effects. Although some prior work has documented age-related attenuation in the ERN in anxious populations (e.g., Davies, Segalowitz, & Gavin, 2004), it is important to note that the two-way anxiety symptom x externalizing problems interaction effect on ERN remained significant even when adjusting for age in the model. Furthermore, age did not provide unique variance in ERN above and beyond anxiety symptoms, externalizing problems, and their interaction.

In addition, the current study was cross-sectional. Therefore, it is unclear whether an enhanced or reduced ERN represents a correlate or neural vulnerability that predicts risk for specific anxiety-externalizing comorbidity subtypes, or is a consequence of these disorders, and what this could mean for risk for disorders with adult onset, such as substance and alcohol abuse. For example, adolescent anxiety and externalizing comorbidity is associated with increased risk for alcohol and substance abuse problems (e.g., Egerton et al., 2020), although some research has found protective effects of anxiety (e.g., Colder et al., 2017). With respect to the neuropsychological literature, some studies have indicated that adults with substance use disorders (SUD) demonstrate a decreased ERN (Franken, Ivan Strien, Franzek, & van de Wetering, 2007; Luijten et al., 2014), a relationship that has been extended to cocaine abuse (Franken et al., 2007; Morie, De Sanctis, Garavan, & Foxe, 2014; Sokhadze, Stewart, Hollifield, & Tasman 2008), smoking (Luijten, van Meel, & Franken, 2011) and current alcohol use and abuse (Bartholow, Henry, Lust, Saults, & Wood, 2012; Gorka et al., 2019; Smith & Mattick, 2013). The extent to which ERN and alcohol and substance abuse patterns are predicted by anxiety and externalizing comorbidities with childhood onset is unknown. Future prospective and longitudinal studies should examine how neural ERN profiles associated with pediatric anxiety-externalizing subtypes predict substance abuse and health risk behaviors (e.g., smoking) in adulthood.

Finally, future studies should also determine the temporal association between ERN and anxiety subtypes to determine which precedes the other and the influence of environmental factors. Meyer et al. (2015) demonstrated that harsh parenting shapes children’s neural error responding, which later predicted increased ERN among anxious youth. A separate study found that youth who remain in institutional rearing environments demonstrated reduced event-related mediofrontal theta oscillations, a neural mechanism that contributes to ERN and cognitive control, at age 16, which in turn predicted greater transdiagnostic risk for psychopathology (Buzzell et al., 2020). Thus, future studies should consider the potential role of socialization experiences in predicting ERN patterns in commonly occurring anxiety subtypes and psychopathology.

Determining whether anxiety disorders with and without comorbid externalizing symptoms associate with unique neural patterns could have translational implications for increasing precision in psychiatric diagnosis and improving treatment response for anxiety disorder subgroups. Clinical translational neuroscience research approaches could empirically test whether ERN profiles can be used to identify whether the anxiety or externalizing disorder is the primary source of impairment among patients with comorbid presentations. This has particular clinical importance as some treatment studies indicate that anxious youth with comorbid externalizing problems are less responsive to traditional treatments for anxiety, such as cognitive behavioral therapy (CBT), and exhibit worse outcomes over time (Flannery-Schroeder, Suveg, Safford, Kendall, & Webb, 2004; Rapee et al., 2013). Greater understanding of neural correlates of co-occurring anxiety and externalizing problems may provide novel insights into potential treatment moderators and targets for youth with comorbid conditions. Indeed, recent clinical translation studies have shown that neuromarkers (e.g., ERPs) can be used to predict CBT and psychopharmacological treatment (e.g., serotonin uptake inhibitors) responses in youth and adults with heterogeneous anxiety disorders (e.g., Kujawa et al., 2016). Extending this work to pediatric patients with anxiety and externalizing disorder comorbidity could increase understanding of the neurobiological profiles of these diagnostic anxiety subtypes and the extent to which neural traits predict treatment response (medication versus CBT) for this particular clinical population that can be difficult to treat effectively.

Acknowledgements:

This work was supported by National Institute of Mental Health Grant [R01-MH086517] to K.L.P. and C.S.M. J.H.S. is supported by F32-HD100075 award from the National Institute of Child Health and Human Development. K.L.B. is supported by K23-MH113793 award from the National Institute of Mental Health. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Footnotes

Conflict of Interest: None.

References

  1. Achenbach TM, & Rescorla LA (2001). Manual for the ASEBA school-age forms & profiles: An integrated system of multi-informant assessment Burlington, VT: University of Vermont. Research Center for Children, Youth, & Families, 1617. [Google Scholar]
  2. Angold A, Costello EJ, & Erkanli A (1999a). Comorbidity. Journal of Child Psychology and Psychiatry, 40, 57–87. 10.1111/1469-7610.00424 [DOI] [PubMed] [Google Scholar]
  3. Angold A, Costello EJ, Farmer EM, Burns BJ, & Erkanli A (1999b). Impaired but undiagnosed. Journal of the American Academy of Child & Adolescent Psychiatry, 38(2), 129–137. [DOI] [PubMed] [Google Scholar]
  4. Bartholow BD, Henry EA, Lust SA, Saults JS, & Wood PK (2012). Alcohol effects on performance monitoring and adjustment: affect modulation and impairment of evaluative cognitive control. Journal of Abnormal Psychology, 121, 173–186. 10.1037/a0023664. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Beesdo K, Knappe S, & Pine DS (2009). Anxiety and anxiety disorders in children and adolescents: Developmental issues and implications for DSM-V. Psychiatric Clinics of North America, 32, 483–524. 10.1016/j.psc.2009.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bittner A, Egger HL, Erkanli A, Costello EJ, Foley DL, & Angold A (2007). What do childhood anxiety disorders predict?. Journal of Child Psychology and Psychiatry, 48, 1174–1183. 10.1111/j.1469-7610.2007.01812.x [DOI] [PubMed] [Google Scholar]
  7. Bubier JL, & Drabick DA (2009). Co-occurring anxiety and disruptive behavior disorders: The roles of anxious symptoms, reactive aggression, and shared risk processes. Clinical Psychology Review, 29, 658–669. 10.1016/j.cpr.2009.08.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Bunford N, Kujawa A, Swain JE, Fitzgerald KD, Monk CS, & Phan KL (2017). Attenuated neural reactivity to happy faces is associated with rule breaking and social problems in anxious youth. European Child & Adolescent Psychiatry, 26, 215–230. 10.1007/s00787-016-0883-9 [DOI] [PubMed] [Google Scholar]
  9. Buzzell GA, Troller-Renfree SV, Wade M, Debnath R, Morales S, Bowers ME, … & Fox NA (2020). Adolescent cognitive control and mediofrontal theta oscillations are disrupted by neglect: Associations with transdiagnostic risk for psychopathology in a randomized controlled trial. Developmental cognitive neuroscience, 100777. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Colder CR, Shyhalla K, Frndak S, Read JP, Lengua LJ, Hawk LW Jr, & Wieczorek WF (2017). The prospective association between internalizing symptoms and adolescent alcohol involvement and the moderating role of age and externalizing symptoms. Alcoholism: Clinical and Experimental Research, 41, 2185–2196. 10.1111/acer.13512 [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Copeland WE, Angold A, Shanahan L, & Costello EJ (2014). Longitudinal patterns of anxiety from childhood to adulthood: the Great Smoky Mountains Study. Journal of the American Academy of Child & Adolescent Psychiatry, 53, 21–33. 10.1016/j.jaac.2013.09.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Davies PL, Segalowitz SJ, & Gavin WJ (2004). Development of response-monitoring ERPs in 7- to 25-year-olds. Developmental Neuropsychology, 25, 355–376. 10.1207/s15326942dn2503_6 [DOI] [PubMed] [Google Scholar]
  13. Debener S, Ullsperger M, Siegel M, Fiehler K, Von Cramon DY, & Engel AK (2005). Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. Journal of Neuroscience, 25, 11730–11737. 10.1523/JNEUROSCI.3286-05.2005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Drabick DA, Ollendick TH, & Bubier JL (2010). Co-occurrence of ODD and anxiety: Shared risk processes and evidence for a dual pathway model. Clinical Psychology: Science and Practice, 17, 307–318. 10.1111/j.1468-2850.2010.01222.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Egerton GA, Jenzer T, Blayney JA, Kimber J, Colder CR, & Read JP (2020). Distress-Related internalizing symptoms interact with externalizing symptoms to predict alcohol problems in an inpatient adolescent sample. The American Journal on Addictions, 29, 57–64. doi: 10.1111/ajad.12980 [DOI] [PubMed] [Google Scholar]
  16. Falkenstein M, Hohnsbein J, Hoormann J, & Blanke L (1991). Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. Electroencephalography and Clinical Neurophysiology, 78, 447–455. 10.1016/0013-4694(91)90062-9 [DOI] [PubMed] [Google Scholar]
  17. Fitzgerald KD, Welsh RC, Gehring WJ, Abelson JL, Himle JA, … & Taylor SF (2005). Error-related hyperactivity of the anterior cingulate cortex in obsessive-compulsive disorder. Biological Psychiatry, 57, 287–294. 10.1016/j.biopsych.2004.10.038 [DOI] [PubMed] [Google Scholar]
  18. Flannery-Schroeder E, Suveg C, Safford S, Kendall PC, & Webb A (2004). Comorbid externalising disorders and child anxiety treatment outcomes. Behaviour Change, 21, 14–25. 10.1375/bech.21.1.14.35972 [DOI] [Google Scholar]
  19. Fraire MG, & Ollendick TH (2013). Anxiety and oppositional defiant disorder: A transdiagnostic conceptualization. Clinical Psychology Review, 33, 229–240. 10.1016/j.cpr.2012.11.004 [DOI] [PubMed] [Google Scholar]
  20. Fraley CR (2012). Probing interactions for differential susceptibility research [web application]. Retrieved from http://www.yourpersonality.net/interaction/ros.pl [Google Scholar]
  21. Franco X, Saavedra L, & Silverman W (2007). External validation of comorbid patterns of anxiety disorders in children and adolescents. Journal of Anxiety Disorders, 21, 717–729. 10.1016/j.janxdix.2006.10.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Franken IH, van Strien JW, Franzek EJ, & van de Wetering BJ (2007). Error-processing deficits in patients with cocaine dependence. Biological Psychology, 75, 45–51. 10.1016/j.biopsycho.2006.11.003 [DOI] [PubMed] [Google Scholar]
  23. Geburek AJ, Rist F, Gediga G, Stroux D, & Pedersen A (2013). Electrophysiological indices of error monitoring in juvenile and adult attention deficit hyperactivity disorder (ADHD)—A meta-analytic appraisal. International Journal of Psychophysiology, 87, 349–362. 10.1016/j.ijpsycho.2012.08.006 [DOI] [PubMed] [Google Scholar]
  24. George D & Mallery M (2010). SPSS for Windows Step by Step: A Simple Guide and Reference, 17.0 update (10a ed.) Boston: Pearson. [Google Scholar]
  25. Gilliom M, & Shaw DS (2004). Codevelopment of externalizing and internalizing problems in early childhood. Development and Psychopathology, 16, 313–333. 10.1017/S0954579404044530 [DOI] [PubMed] [Google Scholar]
  26. Gratton G, Coles MG, & Donchin E (1983). A new method for off-line removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55, 468–484. 10.1016/0013-4694(83)90135-9 [DOI] [PubMed] [Google Scholar]
  27. Gorka SM, Burkhouse KL, Afshar K, & Phan KL (2017). Error-related brain activity and internalizing disorder symptom dimensions in depression and anxiety. Depression and Anxiety, 34, 985–995. 10.1002/da.22648. [DOI] [PubMed] [Google Scholar]
  28. Gorka SM, Lieberman L, Kreutzer KA, Carrillo V, Weinberg A, & Shankman SA (2019). Error-related neural activity and alcohol use disorder: Differences from risk to remission. Progress in Neuro-Psychopharmacology and Biological Psychiatry, 92, 271–278. 10.1016/j.pnpbp.2019.01.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Hair J, Black WC, Babin BJ & Anderson RE (2010) Multivariate data analysis (7th ed.). Upper Saddle River, New Jersey: Pearson Educational International. [Google Scholar]
  30. Hajcak G, Klawohn J, & Meyer A (2019). The utility of event-related potentials in clinical psychology. Annual Review of Clinical Psychology, 15, 71–95. 10.1146/annurev-clinpsy-050718-095457 [DOI] [PubMed] [Google Scholar]
  31. Hall JR, Bernat EM, Patrick CJ (2007). Externalizing psychopathology and the error-related negativity. Psychological Science, 18, 326–333. 10.1111/j.1467-9280.2007.01899.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, … & Wang P (2010). Research domain criteria (RDoC): Toward a new classification framework for research on mental disorders. The American Journal of Psychiatry, 167, 748–751. 10.1176/appi.ajp.2010.09091379 [DOI] [PubMed] [Google Scholar]
  33. Kaufman J, Birmaher B, Brent D, Rao UMA, Flynn C, Moreci P, … & Ryan N (1997). Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child & Adolescent Psychiatry, 36, 980–988. 10.1097/00004583-199707000-00021 [DOI] [PubMed] [Google Scholar]
  34. Kendall PC, Brady EU, & Verduin TL (2001). Comorbidity in childhood anxiety disorders and treatment outcome. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 787–794. 10.1097/00004583-200107000-00013 [DOI] [PubMed] [Google Scholar]
  35. Kendall PC, Compton SN, Walkup JT, Birmaher B, Albano AM, Sherrill J, Ginsburg G, … & Piacentini J (2010). Clinical characteristics of anxiety disordered youth. Journal of Anxiety Disorders, 24, 360–365. 10.1016/j.janxdis.2010.01.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Kessler RC, Avenevoli S, Costello EJ, Georgiades K, Green JG, Gruber MJ, … & Sampson NA (2012). Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the National Comorbidity Survey Replication Adolescent Supplement. Archives of General Psychiatry, 69, 372–380. 10.1001/archgenpsychiatry.2011.160 [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Kujawa A, Weinberg A, Bunford N, Fitzgerald KD, Hanna GL, Monk CS, … & Phan KL (2016). Error-related brain activity in youth and young adults before and after treatment for generalized or social anxiety disorder. Progress in Neuro-psychopharmacology & Biological Psychiatry, 71, 162–168. 10.1016/j.pnpbp.2016.07.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Ladouceur CD, Dahl RE, Birmaher B, Axelson DA, & Ryan ND (2006). Increased error-related negativity (ERN) in childhood anxiety disorders: ERP and source localization. Journal of Child Psychology and Psychiatry, 47, 1073–1082. 10.1111/j.1469-7610.2006.01654.x [DOI] [PubMed] [Google Scholar]
  39. Little TD, Bovaird JA, & Widaman KF (2006). On the merits of orthogonalizing powered and product terms: Implications for modeling interactions among latent variables. Structural Equation Modeling, 13, 497–519. 10.1207/s15328007sem1304_1 [DOI] [Google Scholar]
  40. Luck SJ (2005). An introduction to the event-related potential technique (pp. 45–64). Cambridge, MA: MIT press. [Google Scholar]
  41. Luijten M, Machielsen MWJ, Veltman DJ, Hester R, de Haan L, & Franken IHA (2014). Systematic review of ERP and fMRI studies investigating inhibitory control and error processing in people with substance dependence and behavioural addictions. Journal of Psychiatry & Neuroscience, 39, 149–169. 10.1503/jpn.130052 [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Luijten M, van Meel CS, & Franken IH (2011). Diminished error processing in smokers during smoking cue exposure. Pharmacology Biochemistry and Behavior, 97, 514–520. 10.1016/j.pbb.2010.10.012 [DOI] [PubMed] [Google Scholar]
  43. Mathalon DH, Whitfield SL, & Ford JM (2003). Anatomy of an error: ERP and fMRI. Biological Psychology, 64, 119–141. 10.1016/S0301-0511(03)00105-4 [DOI] [PubMed] [Google Scholar]
  44. Meyer A (2017). A biomarker of anxiety in children and adolescents: A review focusing on the error-related negativity (ERN) and anxiety across development. Developmental Cognitive Neuroscience, 27, 58–68. 10.1016/j.dcn.2017.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Meyer A, Hajcak G, Torpey DC, Kujawa A, Kim J, Bufferd S, Carlson G, & Klein DN (2013). Increased error-related brain activity in six-year-old children with clinical anxiety. Journal of Abnormal Child Psychology, 41, 1257–1266. 10.1007/s10802-013-9762-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Meyer A, & Klein DN (2018). Examining the relationships between error-related brain activity (the ERN) and anxiety disorders versus externalizing disorders in young children: Focusing on cognitive control, fear, and shyness. Comprehensive Psychiatry, 87, 112–119. 10.1016/j.comppsych.2018.09.009 [DOI] [PubMed] [Google Scholar]
  47. Meyer A, Lerner MD, De Los Reyes A, Laird RD, & Hajcak G (2017). Considering ERP difference scores as individual difference measures: Issues with subtraction and alternative approaches. Psychophysiology, 54, 114–122. 10.1111/psyp.12664 [DOI] [PubMed] [Google Scholar]
  48. Meyer A, Nelson B, Perlman G, Klein DN, & Kotov R (2018). A neural biomarker, the error-related negativity, predicts the first onset of generalized anxiety disorder in a large sample of adolescent females. Journal of Child Psychology and Psychiatry, 59, 1162–1170. 10.1111/jcpp.12922. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Meyer A, Proudfit GH, Bufferd SJ, Kujawa AJ, Laptook RS, … & Klein DN (2015b). Self-reported and observed punitive parenting prospectively predicts increased error-related brain activity in six-year-old children. Journal of Abnormal Child Psychology, 43, 821–829. 10.1007/s10802-014-9918-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Meyer A, Proudfit GH, Torpey-Newman DC, Kujawa A, & Klein DN (2015a). Enhanced error-related brain activity in children predicts the onset of anxiety disorders between the ages of 6 and 9. Journal of Abnormal Psychology, 124, 266–274. 10.1037/abn0000044 [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Morie KP, De Sanctis P, Garavan H, & Foxe JJ (2014). Executive dysfunction and reward dysregulation: A high-density electrical mapping study in cocaine abusers. Neuropharmacology, 85, 397–407. 10.1016/j.neuropharm.2014.05.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Oh Y, Greenberg MT, Willoughby MT, & Family Life Project Key Investigators. (2020). Examining longitudinal associations between externalizing and internalizing behavior problems at within-and between-child levels. Journal of Abnormal Child Psychology, 48, 467–480 10.1007/s10802-019-00614-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Olvet DM, & Hajcak G (2008). The error-related negativity (ERN) and psychopathology: Toward an endophenotype. Clinical Psychology Review, 28, 1343–1354. 10.1016/j.cpr.2008.07.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Olvet DM, & Hajcak G (2009). Reliability of error-related brain activity. Brain Research, 1284, 89–99. 10.1016/j.brainres.2009.05.079 [DOI] [PubMed] [Google Scholar]
  55. Pasion R, & Barbosa F (2019). ERN as a transdiagnostic marker of the internalizing-externalizing spectrum: A dissociable meta-analytic effect. Neuroscience & Biobehavioral Reviews, 103, 133–149. 10.1016/j.neubiorev.2019.06.013 [DOI] [PubMed] [Google Scholar]
  56. Peters AT, Burkhouse KL, Kujawa A, Afshar K, Fitzgerald KD, Monk CS, … & Phan KL (2019). Impact of pubertal timing and depression on error‐related brain activity in anxious youth. Developmental Psychobiology, 61, 69–80. 10.1002/dev.21763. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Rapee RM, Lyneham HJ, Hudson JL, Kangas M, Wuthrich VM, & Schniering CA (2013). Effect of comorbidity on treatment of anxious children and adolescents: results from a large, combined sample. Journal of the American Academy of Child & Adolescent Psychiatry, 52, 47–56. 10.1016/j.jaac.2012.10.002 [DOI] [PubMed] [Google Scholar]
  58. Research Units on Pediatric Psychopharmacology Anxiety Study Group. (2002). The pediatric anxiety rating scale (PARS): Development and psychometric properties. Journal of the American Academy of Child & Adolescent Psychiatry, 41, 1061–1069. 10.1097/00004583-200209000-00006 [DOI] [PubMed] [Google Scholar]
  59. Riesel A, Klawohn J, Grützmann R, Kaufmann C, Heinzel S, Bey K, … Kathmann N (2019). Error-related brain activity as a transdiagnostic endophenotype for obsessive-compulsive disorder, anxiety and substance use disorder. Psychological Medicine, 49, 1207–1217. 10.1017/S0033291719000199 [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Shackman AJ, Salomons TV, Slagter HA, Fox AS, Winter JJ, & Davidson RJ (2011). The integration of negative affect, pain and cognitive control in the cingulate cortex. Nature Reviews Neuroscience. 12, 154–167. 10.1038/nrn2994 [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Shankman SA, & Gorka SM (2015). Psychopathology research in the RDoC era: Unanswered questions and the importance of the psychophysiological unit of analysis. International Journal of Psychophysiology, 98, 330–337. 10.1016/j.ijpsycho.2015.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Shankman SA, Lewinsohn PM, Klein DN, Small JW, Seeley JR, & Altman SE (2009). Subthreshold conditions as precursors for full syndrome disorders: A 15-year longitudinal study of multiple diagnostic classes. Journal of Child Psychology and Psychiatry, 50, 1485–1494. 10.1111/j.1469-7610.2009.02117.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. Shiels K, & Hawk LW Jr. (2010). Self-regulation in ADHD: The role of error processing. Clinical Psychology Review, 30, 951–961. 10.1016/j.cpr.2010.06.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Smith JL, & Mattick RP (2013). Evidence of deficits in behavioural inhibition and performance monitoring in young female heavy drinkers. Drug and Alcohol Dependence, 133, 398–404. 10.1016/j.drugalcdep.2013.06.020 [DOI] [PubMed] [Google Scholar]
  65. Sokhadze E, Stewart C, Hollifield M, & Tasman A (2008). Event-related potential study of executive dysfunctions in a speeded reaction task in cocaine addiction. Journal of Neurotherapy, 12, 185–204. 10.1080/10874200802502144 [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Stieben J, Lewis MD, Granic I, Zelazo PD, Segalowitz S, & Pepler D (2007). Neurophysiological mechanisms of emotion regulation for subtypes of externalizing children. Development and Psychopathology, 19, 455–480. 10.1017/S0954579407070228 [DOI] [PubMed] [Google Scholar]
  67. Tang A, Crawford H, Morales S, Degnan KA, Pine DS, & Fox NA (2020). Infant behavioral inhibition predicts personality and social outcomes three decades later. Proceedings of the National Academy of Sciences, 117, 9800–9807. 10.1073/pnas.1917376117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  68. Verduin TL, & Kendall PC (2003). Differential occurrence of comorbidity within childhood anxiety disorders. Journal of Clinical Child & Adolescent Psychology, 32, 290–295. 10.1207/S15374424JCCP3202_15 [DOI] [PubMed] [Google Scholar]
  69. Vilà-Balló A, Hdez-Lafuente P, Rostan C, Cunillera T, & Rodriguez-Fornells A (2014). Neurophysiological correlates of error monitoring and inhibitory processing in juvenile violent offenders. Biological Psychology, 102, 141–152. 10.1016/j.biopsycho.2014.07.021 [DOI] [PubMed] [Google Scholar]
  70. Weinberg A, Dieterich R, & Riesel A (2015). Error-related brain activity in the age of RDoC: A review of the literature. International Journal of Psychophysiology, 98, 276–299. 10.1016/j.ijpsycho.2015.02.029. [DOI] [PubMed] [Google Scholar]
  71. Weinberg A, & Hajcak G (2011). Longer term test–retest reliability of error-related brain activity. Psychophysiology, 48, 1420–1425. 10.1111/j.1469-8986.2011.01206.x [DOI] [PubMed] [Google Scholar]
  72. Weinberg A, Klein DN, & Hajcak G (2012a). Increased error-related brain activity distinguishes generalized anxiety disorder with and without comorbid major depressive disorder. Journal of Abnormal Psychology, 121, 885–896. 10.1037/a0028270 [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Weinberg A, Kotov R, & Proudfit GH (2015). Neural indicators of error processing in generalized anxiety disorder, obsessive-compulsive disorder, and major depressive disorder. Journal of Abnormal Psychology, 124, 172–185. 10.1037/abn0000019 [DOI] [PubMed] [Google Scholar]
  74. Weinberg A, Meyer A, Hale-Rude E, Perlman G, Kotov R, Klein DN, & Hajcak G (2016). Error□related negativity (ERN) and sustained threat: Conceptual framework and empirical evaluation in an adolescent sample. Psychophysiology, 53, 372–385. [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. Weinberg A, Riesel A, & Hajcak G (2012b). Integrating multiple perspectives on error-related brain activity: The ERN as a neural indicator of trait defensive reactivity. Motivation and Emotion, 36, 84–100. 10.1007/s11031-011-9269-y [DOI] [Google Scholar]
  76. Yeung N, Botvinick MM, & Cohen JD (2004). The neural basis of error detection: Conflict monitoring and the error-related negativity. Psychological Review, 111, 931–959. 10.1037/0033-295X.111.4.939 [DOI] [PubMed] [Google Scholar]
  77. Zambrano-Vazquez L, & Allen JJB (2014). Differential contributions of worry, anxiety, and obsessive-compulsive symptoms to ERN amplitudes in response monitoring and reinforcement learning tasks. Neuropsychologia, 61, 197–209. 10.1016/j.neuropsychologia.2014.06.023 [DOI] [PubMed] [Google Scholar]

RESOURCES