Abstract
Differences in emotional processing are prevalent in adolescents with attention deficit/hyperactivity disorder (ADHD) and are related to clinical impairment, but substantial heterogeneity exists. Within ADHD, some individuals experience difficulty with positive/approach emotions, negative/withdrawal emotions, or both. These problems may reflect differences in emotional reactivity, emotion regulation, or a combination, and the neurophysiological correlates remain unclear. Event-related potentials were collected from 109 adolescents (49 with ADHD) while they completed an emotional go/no-go task with three conditions: happy (positive/approach), fear (negative/withdrawal), and neutral. The P1 and N170 were used as a marker of early emotional processing and the P3b and late positive potential (LPP) were used as markers of later elaborative emotional processing. Emotional response style was assessed with parent and adolescent report on the Early Adolescent Temperament Questionnaire. There were no effects of emotion or group for the P1. Typically-developing adolescents exhibited a larger N170 to emotional vs. neutral faces while adolescents with ADHD showed the opposite pattern. All adolescents exhibited a larger P3b to fearful versus other faces and a larger LPP to emotional vs. non-emotional faces. Within the ADHD group, N170 responses to happy faces predicted parent ratings of positive/approach emotions. Findings highlight the importance of considering within-group heterogeneity when studying clinical populations and help clarify the time-locked neurophysiological correlates of emotion dysregulation.
Introduction
Individuals who meet criteria for the same categorical DSM diagnosis may still vary widely in their symptoms presentations and other clinically-relevant traits. Attention-deficit/hyperactivity disorder (ADHD) is emblematic of the problems created by heterogeneity within psychiatric diagnostic categories [1]. Developmental instability and the lack of clear neurobiological bases for symptom-based presentations (e.g., inattentive, hyperactive, and combined presentations) hinder their use for either predicting disorder trajectory or treatment matching [2]. Thus, recent research guided by NIMH’s Research Domain Criteria (RDoC) initiative seeks to understand within-group variability by expanding beyond traditional symptom domains to consider other dimensions that may be relevant for refining psychiatric nosology to correspond to physiological mechanisms.
Although there are many dimensions of heterogeneity (e.g., neuropsychological profiles [3] and reward processing [4]), the importance of which will vary based on context and translational goals, the focus here is on emotion. Emotional response differences are prevalent in ADHD [5,6] and their presence is related to functional impairment [5,6] and risk for comorbid disorders [7,8]. Although the recent emphasis in the clinical literature has been on differences in negative emotions [9,10], emotional differences is not specific to negative valence contexts and can also manifest as differences in expression of positive emotions, such as excitement [5]. This is particularly the case in ADHD, where theories of the disorder have long pointed to upregulated positive/approach-motivation as one possible causal mechanism [11]. To this point, recent research has identified individual differences among individuals with ADHD in their valence-specific emotion response profiles based on temperament [12]. While some with ADHD show normative emotion profiles, others show high levels of either positive/approach emotions (i.e., “surgency”) or negative emotions (e.g., sadness, fear, anger). Preliminary data suggest that these emotion-based ADHD groups have distinct patterns of resting-state fMRI functional connectivity of the amygdala, suggesting a neurobiological basis for observed differences in emotional responding.
Temperament, as used here, describes a set of behavioral and incentive response tendencies, similar to personality traits in adults [13] that are related to information processing and emotional reactivity, regulation, and valence. At the broadest level, the differences in emotional expression captured by temperament measures reflects the combination of early automatic reactivity and later regulatory processing. Thus, consistent with recent neurobiological models of emotion dysregulation [14], an individual’s emotional expression reflects the interaction of early, physiological reactivity and later elaborative processing or regulation of this reactivity [13,15]. These early and later processes also interact [16,17], but the distinction provides a useful heuristic to describe the partially distinct processes of early and later stages of emotional processing.
Many theories have focused on ADHD as primarily a disorder of later, regulatory processing of emotion [18]; however, multiple pathway models suggest that early automatic processing may also play a role, particularly in the case of positive/approach emotions [19]. The current study further investigates this idea by examining the contribution of both early and late emotional processing to positive and negative affect in adolescents with ADHD. At the group level, individuals with ADHD show mixed evidence for differences in both early and later processing of emotional stimuli [10], and additional studies using time-locked central nervous-system measures are needed to clarify the neurobiological bases of emotional response differences in ADHD. The temporal precision of event-related potentials (ERPs) is ideal for clarifying the neurophysiological contributions to individual differences in emotion dysregulation. ERPs have a long history of application in studies of emotional processing and several components are sensitive to emotion [20,21] including: a) occipito-temporal P1 (peaking ~50–150 ms), b) occipito-temporal N170 (peaking ~150–200 ms) post-stimulus, c) centro-posterior P3b (~300–500 ms post-stimulus), and d) centro-posterior late positive potential (LPP; a slow wave extending beyond ~400 ms post-stimulus).
The current study focuses on the processing of emotional and non-emotional facial expressions. The ability to appropriately recognize and process emotional faces is particularly important for social interactions and generating the appropriate emotional responses in social contexts [22]. Those with ADHD are known to have difficulty with social interactions and are often rejected by their peers [23]. Although there seems to be a large body of evidence suggesting differences in facial emotion processing in ADHD [24,25], few studies have examined how the processing of emotional faces in ADHD changes across the processing stream [26,27]. Additionally, to the best of our knowledge, none have examined how early and late processing of emotional faces related to individual differences in emotional response style.
The current studies investigates both early and late processing of emotional faces. The P1 and N170 are used as markers of early emotional processing. Both of these components are involved in early perceptual processing of faces. The P1 is thought to be generated by the extrastriate cortex and reflects basic early visual processing of stimuli. Although not specifically sensitive to faces, the P1 has been found to be modulated by emotional face expression such that the P1 is larger to emotional vs. neutral faces, reflecting relative prioritization of emotional content [28]. The N170 has been specifically linked to the structural encoding of faces and is consistently larger to face than non-face objects [29,30]. A recent meta-analysis further confirms significant effects of emotion on the N170 with reliably larger amplitude N170 responses to angry, fearful, and happy expressions as compared to neutral expressions [31], and it has been examined as a marker of early emotional processing in several studies of ADHD in adults and adolescents [26,27,32,33].
The P3b and LPP are used as indicators of late or sustained emotional processing. P3b amplitude generally reflects the allocation of attention to task-relevant stimuli [34]. Emotional stimuli have been found to capture attention and are theorized to be automatically processed as task-relevant [21]. In line with this theory, a number of studies have found that the P3b is larger to emotional than non-emotional stimuli [35,36] including emotional vs. non-emotional faces [37–39]. More recently, researchers have noted increased positivities to emotional stimuli in a time window extending beyond the P3b [21]. In contrast to the P3b, which is responsive to a variety of manipulations including emotional salience, this later positive deflection, called the late positive potential (LPP), appears to be specifically sensitive to emotion with larger amplitude LPPs observed in response to both pleasant and unpleasant as compared to neutral stimuli, including emotional faces [40,41]. LPP amplitude is thought to reflect the degree of sustained, elaborative processing of emotional stimuli [42,43].
Within ADHD, patterns of findings for the P1 and N170 [26,27,32,33,44] or P3b and LPP components [26,27,44,45] are inconsistent, with studies variously reporting smaller, larger, and equivalent neurophysiological responses as compared to typically-developing individuals. Raz et al., (2015) found a larger P1 to emotional vs. non-emotional faces in adults with ADHD, as well as differences in the N170 component indicating individuals with ADHD responded more strongly to negative than positive affective faces. In contrast, Tye et al., (2014) and Ibáñez et al., (2014), who both focus only on the N170 component, found no differences between emotional and non-emotional faces for individuals with ADHD. Regarding later processing of emotional stimuli, Raz et al., (2015) found no differences in P3b emotion modulation between ADHD and control participants whereas Williams et al. (2008) found that those with ADHD generated smaller P3bs to anger and fear faces than controls and Singhal et al. (2012) found that those with ADHD have a larger LPP to fearful and sad faces than neutral.
Although there are relatively few studies of emotional face processing in ADHD, one intriguing possibility is that inconsistencies in findings may be attributable, in part, to emotional heterogeneity [12]. The current work tests this hypothesis directly by comparing P1, N170, P3b, and LPP responses under neutral, positive, and negative valence contexts between typically-developing adolescents and adolescents with ADHD, and then relating individual differences in neurophysiological responses to temperament ratings of both positive and negative affect. Typically-developing adolescents were expected to exhibit larger amplitude P1, N170, P3b, and LPP responses to emotional than non-emotional stimuli, whereas ADHD adolescents would not. However, this apparent weaker response to emotional stimuli in ADHD was hypothesized to be related to within-group heterogeneity, and neurophysiological responses within the ADHD group were expected to predict individual differences in emotional response style.
Methods
Participants and recruitment
109 individuals (nADHD = 49) were recruited from a larger, ongoing longitudinal study and were invited to participate in an additional EEG testing visit. Recruitment for the larger study uses a community-based strategy based on public advertising and outreach. A parent/legal guardian provided written informed consent, and adolescents provided written assent for the study. Ethics approval was obtained from the Institutional Review Boards at Oregon Health & Science University.
After an initial screening phone call, a parent/guardian and teacher completed standardized rating scales, including the Conners’ Rating Scales, 3rd edition [46] and the ADHD Rating Scale (ADHD-RS) [47]. The parent/guardian also completed a semi-structured clinical interview (Kiddie Schedule for Affective Disorders and Schizophrenia, K-SADS) administered by a Master’s-level clinician who had achieved research reliability [48]. The parent/guardian reported on lifetime and current symptom levels, as well as age of onset and impairment. IQ was estimated based on a reliable and valid two-subtest short form of the WISC-IV (Block Design and Vocabulary; [49]).
Final DSM-IV diagnostic groups were determined as follows: individuals with ADHD were required to meet full diagnostic criteria for ADHD on the K-SADS, including symptom counts, impairment, and age of onset. Although cross-situational severity is incorporated into the K-SADS diagnosis, to confirm this we also required children in the ADHD group to have at least one parent and one teacher rating of inattention and/or hyperactivity that exceeded 85th percentile (T-score = 60). Those in the typically-developing control group were required to have no parent or teacher ratings exceeding T-score = 60 and to not meet diagnostic criteria for ADHD on the K-SADS. Further, to avoid inclusion of borderline cases in the typically-developing group, these adolescents were required to have 3 or fewer current hyperactivity symptoms, 3 or fewer current inattention symptoms, and 4 or fewer total symptoms. Total symptom counts were determined by combining parent (K-SADS) and teacher (ADHD-RS) report using an “OR” algorithm [50].
Exclusion criteria
Adolescents were excluded from the current study if they were prescribed long-acting, non-stimulant psychotropic medications; had self-reported history of neurological impairment such as seizures or head injury with loss of consciousness; had a history of substance abuse; had prior diagnosis of intellectual disability, autism spectrum disorder, or psychosis; were currently experiencing a major depressive episode; or had estimated IQ < 70.
Medication washout
Adolescents with ADHD taking stimulant medications were included in the study but were required to be off medication for 24 (for short-acting preparations) to 48 hours (for long-acting preparations) prior to testing.
Temperament ratings
A parent/guardian and the adolescent separately completed the Early Adolescent Temperament Questionnaire (EATQ; [51]), which is derived from a well-regarded conceptual model using confirmatory factor analysis [52]. The surgency factor and fear subscale were used in the current study. Surgency is related to extraversion and experience of positive emotions (e.g., excitement), and is associated with approach tendencies [11,15]. The fear subscale was selected as a measure of withdrawal-related negative affect. Parent-reported surgency and adolescent-reported fear are used in all analyses consistent with literature suggesting that in adolescence, self-report of internal states and parent-report of observable behaviors are most reliable [53]. 5.8% of parent reported and 11.8% of adolescent reported temperament data was missing due to incomplete questionnaires and were handled using missing data procedures described below.
Experimental procedure
Fig 1depicts an example experimental run. Participants completed three separate conditions (fear, happy, neutral) of an emotional go/no-go task (70% go, 30% no-go) in counterbalanced order. For each condition, participants were shown a series of grey-scale faces from 12 individuals (6 female) from the NimStim set [54] and were asked to respond by button press to specified target faces. Within each condition, 172 trials were presented in semi-random order in two equal blocks (total of 344 trials). In the emotionally-salient (fear or happy) conditions, participants responded with a key press to emotional expressions and withheld responding to faces with neutral expressions. In the neutral condition, all faces had neutral expressions and participants responded to either male or female faces and withheld responding to the other sex (counterbalanced by block). Analyses here focus on the go trials because these are the stimuli that contain emotional content and our primary hypotheses here were related to processing of emotional stimuli. This approach is consistent with other studies, which similarly uses cognitive paradigms (e.g., oddball or go/no-go tasks) [26,27,33,55,56], but focus on response to specific subsets of stimuli. Although we do not consider no-go trials here, the use of a task that demands attention and response to specific stimulus types may be particularly important for eliciting effects for emotional face stimuli in clinical groups that are not seen in other types of tasks [57].
ERP recordings
EEG was recorded at 500Hz with 32 Ag-AgCl active electrodes using PyCorder v1.0.9. The electrode array was based on the international 10–20 system centered at Cz. EEG signals were amplified by a BrainVision actiCHamp2 amplifier (Cary, NC). Recordings were referenced to Cz online then re-referenced offline.
Data analysis
EEG data were analyzed using ERPLAB [58] and EEGLAB [59] toolboxes for MATLAB. Raw EEG data were resampled to 250 Hz and referenced offline to the average of all channels. EEG signals were filtered using an IIR filter with a bandwidth of .01–50 Hz [60]. Eye artifacts were removed through independent component analysis.
Epochs from -200 to 1000 ms were time-locked to the onset of the face stimuli. A 200 ms prestimulus period was used for baseline correction. Trials were discarded from the analyses if they contained baseline drift or movement artifacts greater than 90 μV. Only correct responses to go trials in each of the three conditions (fear, happy, neutral) were included in analyses because the emphasis of the current work was on responses to the emotional faces, specifically. Based on a priori criteria, a participant’s data for a given condition were excluded from analyses if >50% of the total trials were rejected due to artifacts. This resulted in exclusion of 1.8% of data (1 fear, 2 neutral, and 3 happy condition). Missing data were handled via missing data methods described below.
Component amplitudes were measured as mean area amplitude in a specified stimulus-locked time windows and at electrode sites selected based on those used most commonly in the literature [60]: a) P1: between 60 and 160 ms post stimulus at bilateral occipito-temporal electrode sites P7 and P8; b) N170: between 150 and 250 ms post stimulus at the bilateral occipito-temporal electrode sites P7 and P8; c) P3b: between 300 and 600 ms post stimulus at centro-posterior electrode sites P3, Pz, and P4 [34]; and d) LPP: between 600 and 1000 ms post stimulus also at centro-posterior electrode sites P3, Pz, and P4 [21].
Statistical analysis
Cognitive performance and ERPs were analyzed separately using a linear mixed model with a compound symmetry repeated covariance structure in SPSS (v.22.0). Linear mixed models are a well-established method for analyzing data with repeated measures which, in contrast to methods like repeated measures ANOVA, has the advantage of being able to accommodate missing dating [61–63]. The linear mixed effect model specified in the current analysis is nearly identical to a repeated measures ANOVA; the main difference is that in these analyses missing data are handled using maximum likelihood estimation rather than listwise deletion [64]. For regression analyses, ERP difference waves were calculated by subtracting the mean amplitude from the neutral condition from that of the emotional conditions (i.e., fear-neutral and happy-neutral). Relationships between temperament (surgency or fear) and ERP difference waves were examined using moderation analyses in MPLUS (7.2). Predictors (ERP difference waves) were mean centered prior to model parametrization. Age and sex were used as covariates in all analyses. Although IQ differed between groups, this was not used as a covariate since a lower IQ often accompanies ADHD and by controlling for this variable we may be controlling for a feature inherent to the disorder [65]. The number of trials was also used as a covariate in linear mixed models including ERPs. Missing data were handled using maximum likelihood methods [66]. A false discovery rate (FDR) correction for multiple comparisons was used on all analyses with a false discovery rate set at .05. FDR corrected p-values are presented for all tests.
Results
Sample description & task performance
See Table 1for participant demographic, clinical, and cognitive performance scores. As expected, for go accuracy, there was a main effect of group (F(1,109.3) = 10.04, p = .002, d = .60), such that accuracy was higher for controls than for ADHD participants. There was also an effect of condition (F(2,217.5) = 9.15, p < .001) such that go accuracy was lower during the fear condition than the other two (fear < neutral = happy). There was no group x condition interaction (F(2,217.5) = 2.18, p = .26).
Table 1. demographic information and clinical and cognitive performance scores (means(SD)).
Control | ADHD | F | Effect Size (95% CI) | |
---|---|---|---|---|
N | 60 | 49 | ||
Age (years) | 13.87 (1.08) | 13.70 (1.48) | 0.48 | 0.13 (-.32-.66) |
IQ | 116.23 (11.72) | 107.24 (14.92) | 12.41** | 0.67 (3.93–14.05) |
(Boys:Girls) | 38:22 | 42:7 | X2 = 6.92* | |
ADHD presentation type (%) | ||||
Inattentive | — | 61.90 | ||
Hyperactive | — | 4.76 | ||
Combined | — | 33.33 | ||
EATQ | ||||
Surgencya | 3.60 (0.58) | 3.50 (0.62) | 0.59 | 0.17 (-.13-.34) |
Fearb | 2.41 (0.63) | 2.58 (0.80) | 1.36 | 0.23 (-.46-.12) |
Conners’ (Parent) | ||||
Hyperactivity | 48.55 (9.44) | 70.60 (15.52) | 78.43** | 1.72 (17.11–26.98) |
Inattention | 48.23 (10.67) | 75.26 (10.63) | 164.65** | 2.53 (22.85–31.20) |
Learning Problems | 46.23 (4.78) | 61.87 (11.78) | 81.55** | 1.74 (12.21–19.08) |
Executive Functioning | 49.20 (10.00) | 70.79 (11.90) | 100.20** | 1.96 (17.31–25.87) |
Conners’ (Teacher) | ||||
Hyperactivity | 48.83 (7.34) | 62.32 (14.58) | 31.21** | 1.17 (8.69–18.29) |
Inattention | 48.62 (7.53) | 65.32 (12.10) | 62.05** | 1.66 (12.49–20.91) |
Learning Problems & | 47.62 (6.89) | 58.56 (10.97) | 32.24** | 1.19 (7.11–14.78) |
Executive Functioning | ||||
Go Accuracy (%)c | 10.04* | 0.60 (.02-.07) | ||
Fear | 96.10 (9.30) | 89.60 (9.10) | ||
Neutral | 97.30 (9.30) | 93.90 (9.10) | ||
Happy | 98.40(9.30) | 95.90 (9.10) | ||
RT (ms)c | 0.08 | 0.06 (-36.25–48.22) | ||
Fear | 573.29 (123.99) | 557.58 (124.40) | ||
Neutral | 526.01 (123.99) | 526.18 (124.40) | ||
Happy | 503.90 (124.55) | 501.49 (124.40) |
Significance based on FDR corrected p values. EATQ = Early Adolescent Temperament Questionnaire; Connors’ = Connors’ rating scale; RT = reaction time
**p < .001
*p < .01
a parent report
b child report
c estimated marginal means after controlling for age and sex presented
For go RTs, there was no effect of group (F(1,109) = .08, p = .80, d = .08). However, there was a main effect of condition (F(2,217.1) = 19.89, p < .001) such that RTs were faster in the happy condition than the neutral conditions, consistent with greater approach-motivation, and slower in the fear condition than the neutral condition, consistent with greater withdrawal. The group x condition interaction was not significant (F(2,217.1) = .36, p = .79). Overall, the behavioral performance measures suggest that both groups responded as expected to the emotional manipulation.
ERPs
Fig 2depicts the grand average waveforms and Fig 3depicts topographic head plots of the difference waves for each component.
P1
There was no main effect of group (F(1,104) = .91, p = .51, d = .05) or condition (F(2,520) = 1.12, p = .51). There was a main effect of electrode (F(1,520) = 20.04, p <. .001, d = .47) such that the P1 was largest at electrode site P8. There was no group x condition interaction (F(2,520) = 1.97, p = .30) or any interactions with electrode (all ps > .51).
N170
There was no main effect of group (F(1,104) = .15, p = .79, d = .07), condition (F(2,520) = .1.02, p = .51), or electrode (F(1,520) = 1.31, p = .45, d = .10). However, lack of main effects was qualified by a significant group x condition interaction (F(2,520) = 8.08, p = .001). Adolescents with ADHD had a larger N170 to non-emotional that to emotional faces (neutral > fear = happy), while typically-developing adolescents showed the opposite pattern with larger N170 to emotional than non-emotional faces (fear = happy > neutral). There was also a group x electrode interaction (F(1,520) = 5.98, p < .05) such that the control group had a larger N170 response at electrode site P7 whereas the ADHD group demonstrated a similar amplitude response at all sites. There were no other interactions with electrode site (all ps > .79)
P3b
There was no main effect of group (F(1,104) = 1.80, p = .36, d = .26). There was a main effect of condition (F(2,832) = 23.31, p < .001) such that the P3b response under the fear condition was larger than under the neutral or happy conditions (fear > neutral = happy). There was also a main effect of electrode (F(2,832) = 37.08, p < .001) due to the P3b at electrode site P3 being smaller than at the other two electrode sites (P3 < P4 = Pz). There was no condition x group interaction (F(2,832) = .26, p = .80) or any interactions with electrode (all ps > .07).
LPP
There was no main effect of group (F(1,104) = .85, p = .51, d = .18). There was a main effect of condition (F(2,832) = 50.12, p < .001) such that the LPP was larger under the fear condition followed by the happy condition and finally the neutral condition (fear > happy > neutral). There was a main effect of electrode (F2,832) = 130.56, p < .001) such that the LPP was largest at electrode site Pz followed by P4 and smallest at P3 (Pz > P4 > P3). There was no condition x group interaction (F(2,832) = 1.67, p = .36) or any other interactions with electrode (all ps > .05).
Relationship between ERPs and temperament
We next examined relationships between neurophysiological response and emotional response style by diagnostic group. Because there were no electrode x condition or group x electrode x condition effects, moderations were run for each component averaged across electrode sites (i.e., P7/P8 for the P1 and N170 and P3/P4/Pz for the LPP and P3b). However, for completeness, we also note effects at each site separately. Beta weights and standard errors for primary regressions and moderation analyses are presented in Table 2.
Table 2. Regression coefficients.
Surgency | Fear | |||
---|---|---|---|---|
Variable | β | SE | β | SE |
P1 H-N | .12 | .10 | — | — |
P1 H-N group interaction | -.05 | .72 | — | — |
P1 F-N | — | — | -.001 | .12 |
P1 F-N group interaction | — | — | -.09 | .17 |
N170 H-N | -.15 | .14 | — | — |
N170 H-N x group interaction | -.34* | .13 | — | — |
N170 F-N | — | — | -.02 | .88 |
N170 F-N x group interaction | — | — | .10 | .12 |
P3b H-N | -.10 | .11 | — | — |
P3b H-N x group interaction | .04 | .17 | — | — |
P3b F-N | — | — | .12 | .11 |
P3b F-N x group interaction | — | — | .09 | .17 |
LPP H-N | -.10 | .09 | — | — |
LPP H-N x group interaction | .23 | .14 | — | — |
LPP F-N | — | — | .08 | .13 |
LPP F-N x group interaction | — | — | -.09 | .23 |
Standardized coefficients presented. Significance level based on FDR corrected p values. F-N = fear–neutral; H-N = happy = neutral.
* p < .05
Surgency
As shown in Table 2and Fig 4, group significantly moderated the relationship between N170 amplitude and surgency, β = -.34, p = .04. A larger N170 in the happy condition, indicating greater early response, was related to higher surgency within the ADHD group, β = -.43, p < .001, but not the control group, β = .01, p = .94. This pattern was significant at electrode site P8 (p = .008), but not at P7 (p = .17).
There were no significant moderation effects between a surgent temperament and the P1, P3b, or LPP in the primary analyses (all ps > .20). However, secondary analyses examining effects at each electrode site found a significant moderation by group of the relationship between LPP and surgency at site Pz (where LPP was largest for both groups; β = -.30, p = .02. Results indicated that a smaller LPP was related to greater surgency in the control group (p = .001), but not the ADHD group (p = .80). This effect was not significant at lateral electrode sites P3 and P4.
Fear
There were no significant moderation effects between a fearful temperament and any of the ERP measures (all ps > .40). See Table 2.
Discussion
Emotional response is a critical dimension of heterogeneity in ADHD, but the neurophysiological correlates of these differences and the contributions of relatively earlier and later processing are not clear. In the current study, typically-developing adolescents showed expected patterns of neural differentiation between emotional and neutral faces for the N170, while those with ADHD did not. If not explored further, group-level results suggest that adolescents with ADHD have a blunted early neurophysiological response to emotional stimuli. In contrast, further examination demonstrated that magnitude of the N170 response in the ADHD group to positive emotional stimuli was related to emotional heterogeneity, with larger N170 response predicting higher surgency. These findings are in line with prior theory suggesting that excessive approach-motivation and response to positive incentives in ADHD is not driven solely by regulatory deficits, but can also be related to differences in earlier, potentially more reactive processing in the absence of differences in later regulatory processing [19].
Interestingly, the relationship between early emotional processing and temperament were only present for the N170 and not the P1. In the current study, the P1 was not modulated by emotional expression. The N170, which is specifically related to encoding of facial features, and was larger to both fearful and happy expressions in our typically-developing sample, may be more sensitive to individual differences in emotional face processing for both negative and positive expressions, particularly as these difference relate to emotional response style. Future work should continue to investigate the functional differences between the P1 and N170 in terms of emotional processing and how these processes related to real-world functioning.
Most studies of emotional responding to-date have used the P3b as a marker of later emotional processing of stimuli. The P3b component is not specifically sensitive to emotion and reflects other processes, such as working memory updating and decision making [67]. Although both the P3b and LPP have been found to be sensitive to emotion, in the current sample the P3b was only larger under the fear condition, whereas responses to happy and neutral stimuli did not differ. This may be consistent with threat-related information being more highly prioritized for processing than other emotional information and, therefore, more likely to be reflected in ERP components that are broadly related to attention and cognition. In contrast, the LPP was larger under both the fear and happy conditions as compared to the neutral condition. Given its unique association with emotional processing, the LPP may be a more sensitive measure of later, elaborative emotional processing than the P3b and/or may be sensitive to a broader range of emotions. However, these two components spatially and temporally overlap [20,21]. Future work in our lab will continue to investigate the relationship between the P3b, LPP, and emotion regulation in ADHD.
Of note, our primary analyses indicated no relationship between the P3b or LPP and individuals’ emotional response styles, despite the fact that these components differed between emotion conditions. We also failed to identify any relationships between ERP components (early or late) and fearful temperament. Face stimuli are commonly used in studies of emotional processing and elicit emotional responses [31]. In our study, in addition to emotional effects on ERP components, reaction times differed in the expected directions by condition for both groups, giving us confidence that the emotional manipulation was effective. Nonetheless, emotional scenes may elicit a more robust neurophysiological responses than faces. Future work examining the relationship between ERPs (particularly later components) and negative affect using a variety of emotional stimuli types may be informative.
One caveat to the lack of relationships between later ERP components and emotional response style was a secondary finding that a smaller LPP in the happy condition predicted higher surgency in typically-developing controls. However, this effect was only significant at electrode site Pz and not in the primary analyses which collapsed across electrode sites. Although there was no condition x electrode interaction, the LPP response was largest at Pz. If replicated, this finding may suggest partially distinct neurophysiological correlates for increased positive approach-motivation in normative adolescent development and ADHD. This is an intriguing possibility, but should not be over-interpreted given the secondary nature of the analyses by electrode site. Additional studies that take into account LPP topographical difference in those with and without ADHD are needed.
As expected [68], ADHD participants generally performed more poorly than non-ADHD controls on the go/no-go task. The current study focuses on relationships between emotional face processing and emotional response styles in ADHD, and therefore analyses were restricted to the emotional go stimuli. Emotional effects on inhibitory control and other measures of executive function remain relatively poorly characterized [69,70], and additional studies of how the inhibitory process is affected by emotional context, although outside the scope of the current work, will be important. This is a direction for our own future work and will be important for integrating across the multiple domains of heterogeneity that likely play a role in ADHD and other clinical disorders.
The groups in the current study were not matched for sex with proportionally more males in the ADHD than control group, consistent with well-documented sex differences in rates of ADHD diagnoses [71]. Sex was used as a covariate in all analyses, suggesting current findings are not attributable to sex differences in the samples. However, future research focused specifically on the effects of sex on the relationship between emotional response style and ERP markers of emotional processing in adolescents with ADHD will be important.
Summary
The current study identifies neurophysiological correlates of emotional heterogeneity in ADHD. Results are consistent with prior theories identifying over-reactivity to positive affective cues, even in the presence of normative regulation, as one pathway leading to ADHD impairment. Parsing this emotional heterogeneity will be important for RDoC-informed efforts to identify more neurobiologically-informed subgroups within ADHD and other clinical populations.
Supporting information
Acknowledgments
The authors would like to thank Libby Nousen for her assistance with dataset compilation, lab volunteers for their help in data collection, and Dr. Joel Nigg for his additional mentorship related to the project.
Data Availability
All relevant data are within the paper and its Supporting Information files.
Funding Statement
This study was supported by the National Institute of Mental Health; www.nimh.nih.gov: R37 MH59105; K23 MH108656; SK. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Sibley MH, Pelham WE, Molina BSG, Gnagy EM, Waschbusch DA, Garefino AC, et al. Diagnosing ADHD in adolescence. J Consult Clin Psychol. 2012;80: 139–150. doi: 10.1037/a0026577 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Willcutt EG, Nigg JT, Pennington BF, Solanto MV, Rohde LA, Tannock R, et al. Validity of DSM-IV attention deficit/hyperactivity disorder symptom dimensions and subtypes. J Abnorm Psychol. 2012;121: 991–1010. doi: 10.1037/a0027347 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Fair DA, Bathula D, Nikolas MA, Nigg JT. Distinct neuropsychological subgroups in typically developing youth inform heterogeneity in children with ADHD. Proc Natl Acad Sci U S A. 2012;109: 6769–6774. doi: 10.1073/pnas.1115365109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Costa Dias TG, Iyer SP, Carpenter SD, Cary RP, Wilson VB, Mitchell SH, et al. Characterizing heterogeneity in children with and without ADHD based on reward system connectivity. Dev Cogn Neurosci. 2015;11: 155–174. doi: 10.1016/j.dcn.2014.12.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Bunford N, Evans SW, Wymbs F. ADHD and Emotion Dysregulation Among Children and Adolescents. Clin Child Fam Psychol Rev. 2015;18: 185–217. doi: 10.1007/s10567-015-0187-5 [DOI] [PubMed] [Google Scholar]
- 6.Shaw P, Stringaris A, Nigg J, Leibenluft E. Emotion dysregulation in attention deficit hyperactivity disorder. Am J Psychiatry. 2014;171: 276–293. doi: 10.1176/appi.ajp.2013.13070966 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Anastopoulos AD, Smith TF, Garrett ME, Morrissey-Kane E, Schatz NK, Sommer JL, et al. Self-Regulation of Emotion, Functional Impairment, and Comorbidity Among ChildrenWith AD/HD. J Atten Disord. 2011;15: 583–592. doi: 10.1177/1087054710370567 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Steinberg EA, Drabick DAG. A Developmental Psychopathology Perspective on ADHD and Comorbid Conditions: The Role of Emotion Regulation. Child Psychiatry Hum Dev. 2015;46: 951–966. doi: 10.1007/s10578-015-0534-2 [DOI] [PubMed] [Google Scholar]
- 9.Rosen PJ, Factor PI. Emotional Impulsivity and Emotional and Behavioral Difficulties Among Children With ADHD: An Ecological Momentary Assessment Study. J Atten Disord. 2015;19: 779–793. doi: 10.1177/1087054712463064 [DOI] [PubMed] [Google Scholar]
- 10.Shaw P, Stringaris A, Nigg J, Leibenluft E. Emotion Dysregulation in Attention Deficit Hyperactivity Disorder. FOCUS. 2016;14: 127–144. doi: 10.1176/appi.focus.140102 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Nigg JT. Temperament and developmental psychopathology. J Child Psychol Psychiatry. 2006;47: 395–422. doi: 10.1111/j.1469-7610.2006.01612.x [DOI] [PubMed] [Google Scholar]
- 12.Karalunas SL, Fair D, Musser ED, Aykes K, Iyer SP, Nigg JT. Subtyping attention-deficit/hyperactivity disorder using temperament dimensions: toward biologically based nosologic criteria. JAMA Psychiatry. 2014;71: 1015–1024. doi: 10.1001/jamapsychiatry.2014.763 [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
- 13.Rothbart MK, Ahadi SA. Temperament and the development of personality. J Abnorm Psychol. 1994;103: 55–66. [DOI] [PubMed] [Google Scholar]
- 14.Ochsner KN, Gross JJ. The cognitive control of emotion. Trends Cogn Sci. 2005;9: 242–249. doi: 10.1016/j.tics.2005.03.010 [DOI] [PubMed] [Google Scholar]
- 15.Rothbart MK. Temperament, Development, and Personality. Curr Dir Psychol Sci. 2007;16: 207–212. doi: 10.1111/j.1467-8721.2007.00505.x [Google Scholar]
- 16.McRae K, Misra S, Prasad AK, Pereira SC, Gross JJ. Bottom-up and top-down emotion generation: implications for emotion regulation. Soc Cogn Affect Neurosci. 2012;7: 253–262. doi: 10.1093/scan/nsq103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Nigg JT, Casey BJ. An integrative theory of attention-deficit/ hyperactivity disorder based on the cognitive and affective neurosciences. Dev Psychopathol. 2005;17: 785–806. doi: 10.1017/S0954579405050376 [DOI] [PubMed] [Google Scholar]
- 18.Barkley RA. Behavioral inhibition, sustained attention, and executive functions: constructing a unifying theory of ADHD. Psychol Bull. 1997;121: 65–94. [DOI] [PubMed] [Google Scholar]
- 19.Nigg JT, Goldsmith HH, Sachek J. Temperament and attention deficit hyperactivity disorder: the development of a multiple pathway model. J Clin Child Adolesc Psychol Off J Soc Clin Child Adolesc Psychol Am Psychol Assoc Div 53 2004;33: 42–53. doi: 10.1207/S15374424JCCP3301_5 [DOI] [PubMed] [Google Scholar]
- 20.Foti D, Hajcak G, Dien J. Differentiating neural responses to emotional pictures: evidence from temporal-spatial PCA. Psychophysiology. 2009;46: 521–530. [DOI] [PubMed] [Google Scholar]
- 21.Hajcak G, MacNamara A, Olvet DM. Event-Related Potentials, Emotion, and Emotion Regulation: An Integrative Review. Dev Neuropsychol. 2010;35: 129–155. doi: 10.1080/87565640903526504 [DOI] [PubMed] [Google Scholar]
- 22.Collin L, Bindra J, Raju M, Gillberg C, Minnis H. Facial emotion recognition in child psychiatry: A systematic review. Res Dev Disabil. 2013;34: 1505–1520. doi: 10.1016/j.ridd.2013.01.008 [DOI] [PubMed] [Google Scholar]
- 23.Kats-Gold I, Besser A, Priel B. The role of simple emotion recognition skills among school aged boys at risk of ADHD. J Abnorm Child Psychol. 2007;35: 363–378. doi: 10.1007/s10802-006-9096-x [DOI] [PubMed] [Google Scholar]
- 24.Singh SD, Ellis CR, Winton AS, Singh NN, Leung JP, Oswald DP. Recognition of facial expressions of emotion by children with attention-deficit hyperactivity disorder. Behav Modif. 1998;22: 128–142. doi: 10.1177/01454455980222002 [DOI] [PubMed] [Google Scholar]
- 25.Corbett B, Glidden H. Processing affective stimuli in children with attention-deficit hyperactivity disorder. Child Neuropsychol J Norm Abnorm Dev Child Adolesc. 2000;6: 144–155. doi: 10.1076/chin.6.2.144.7056 [DOI] [PubMed] [Google Scholar]
- 26.Williams LM, Hermens DF, Palmer D, Kohn M, Clarke S, Keage H, et al. Misinterpreting emotional expressions in attention-deficit/hyperactivity disorder: evidence for a neural marker and stimulant effects. Biol Psychiatry. 2008;63: 917–926. doi: 10.1016/j.biopsych.2007.11.022 [DOI] [PubMed] [Google Scholar]
- 27.Raz S, Dan O. Altered event-related potentials in adults with ADHD during emotional faces processing. Clin Neurophysiol Off J Int Fed Clin Neurophysiol. 2015;126: 514–523. doi: 10.1016/j.clinph.2014.06.023 [DOI] [PubMed] [Google Scholar]
- 28.Batty M, Taylor MJ. Early processing of the six basic facial emotional expressions. Brain Res Cogn Brain Res. 2003;17: 613–620. [DOI] [PubMed] [Google Scholar]
- 29.Bentin S, Allison T, Puce A, Perez E, McCarthy G. Electrophysiological Studies of Face Perception in Humans. J Cogn Neurosci. 1996;8: 551–565. doi: 10.1162/jocn.1996.8.6.551 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Rossion B. Understanding face perception by means of human electrophysiology. Trends Cogn Sci. 2014;18: 310–318. doi: 10.1016/j.tics.2014.02.013 [DOI] [PubMed] [Google Scholar]
- 31.Hinojosa JA, Mercado F, Carretié L. N170 sensitivity to facial expression: A meta-analysis. Neurosci Biobehav Rev. 2015;55: 498–509. doi: 10.1016/j.neubiorev.2015.06.002 [DOI] [PubMed] [Google Scholar]
- 32.Ibáñez A, Aguado J, Baez S, Huepe D, Lopez V, Ortega R, et al. From neural signatures of emotional modulation to social cognition: individual differences in healthy volunteers and psychiatric participants. Soc Cogn Affect Neurosci. 2014;9: 939–950. doi: 10.1093/scan/nst067 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Tye C, Battaglia M, Bertoletti E, Ashwood KL, Azadi B, Asherson P, et al. Altered neurophysiological responses to emotional faces discriminate children with ASD, ADHD and ASD+ADHD. Biol Psychol. 2014;103: 125–134. doi: 10.1016/j.biopsycho.2014.08.013 [DOI] [PubMed] [Google Scholar]
- 34.Polich J. Updating P300: an integrative theory of P3a and P3b. Clin Neurophysiol Off J Int Fed Clin Neurophysiol. 2007;118: 2128–2148. doi: 10.1016/j.clinph.2007.04.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Mini A, Palomba D, Angrilli A, Bravi S. Emotional information processing and visual evoked brain potentials. Percept Mot Skills. 1996;83: 143–152. doi: 10.2466/pms.1996.83.1.143 [DOI] [PubMed] [Google Scholar]
- 36.Radilová J. The late positive component of visual evoked response sensitive to emotional factors. Act Nerv Super (Praha). 1982;Suppl 3: 334–337. [PubMed] [Google Scholar]
- 37.Chai H, Chen WZ, Zhu J, Xu Y, Lou L, Yang T, et al. Processing of facial expressions of emotions in healthy volunteers: An exploration with event-related potentials and personality traits. Neurophysiol Clin Neurophysiol. 2012;42: 369–375. doi: 10.1016/j.neucli.2012.04.087 [DOI] [PubMed] [Google Scholar]
- 38.Laurian S, Bader M, Lanares J, Oros L. Topography of event-related potentials elicited by visual emotional stimuli. Int J Psychophysiol Off J Int Organ Psychophysiol. 1991;10: 231–238. [DOI] [PubMed] [Google Scholar]
- 39.Zhang D, Luo W, Luo Y. Single-trial ERP analysis reveals facial expression category in a three-stage scheme. Brain Res. 2013;1512: 78–88. doi: 10.1016/j.brainres.2013.03.044 [DOI] [PubMed] [Google Scholar]
- 40.Eimer M, Holmes A. Event-related brain potential correlates of emotional face processing. Neuropsychologia. 2007;45: 15–31. doi: 10.1016/j.neuropsychologia.2006.04.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Eimer M, Holmes A, McGlone FP. The role of spatial attention in the processing of facial expression: an ERP study of rapid brain responses to six basic emotions. Cogn Affect Behav Neurosci. 2003;3: 97–110. [DOI] [PubMed] [Google Scholar]
- 42.Hajcak G, Nieuwenhuis S. Reappraisal modulates the electrocortical response to unpleasant pictures. Cogn Affect Behav Neurosci. 2006;6: 291–297. [DOI] [PubMed] [Google Scholar]
- 43.Schupp HT, Cuthbert BN, Bradley MM, Cacioppo JT, Ito T, Lang PJ. Affective picture processing: the late positive potential is modulated by motivational relevance. Psychophysiology. 2000;37: 257–261. [PubMed] [Google Scholar]
- 44.Singhal A, Shafer AT, Russell M, Gibson B, Wang L, Vohra S, et al. Electrophysiological correlates of fearful and sad distraction on target processing in adolescents with attention deficit-hyperactivity symptoms and affective disorders. Front Integr Neurosci. 2012;6: 119 doi: 10.3389/fnint.2012.00119 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Köchel A, Leutgeb V, Schienle A. Disrupted response inhibition toward facial anger cues in children with attention-deficit hyperactivity disorder (ADHD): an event-related potential study. J Child Neurol. 2014;29: 459–468. doi: 10.1177/0883073813476139 [DOI] [PubMed] [Google Scholar]
- 46.Conners CK. Conners’ rating scales—revised technical manual. North Tonawanda, NY: Multi-Health Systems Inc.; 2001. [Google Scholar]
- 47.DuPaul GJ, Anastopoulos AD, Power TJ, Reid R, Ikeda MJ, McGoey KE. Parent Ratings of Attention-Deficit/Hyperactivity Disorder Symptoms: Factor Structure and Normative Data. J Psychopathol Behav Assess. 1998;20: 83–102. [Google Scholar]
- 48.Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): Initial Reliability and Validity Data. J Am Acad Child Adolesc Psychiatry. 1997;36: 980–988. doi: 10.1097/00004583-199707000-00021 [DOI] [PubMed] [Google Scholar]
- 49.Wechsler D. Wechsler intelligence scale for children, 4th ed (wisc-iv) technical and interpretive manual. San Antonio: Harcourt Brace; 2003.
- 50.Pelham WE, Fabiano GA, Massetti GM. Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. J Clin Child Adolesc Psychol. 2005;34: 449–476. doi: 10.1207/s15374424jccp3403_5 [DOI] [PubMed] [Google Scholar]
- 51.Ellis LK, Rothbart MK. Revision of the Early Adolescent Temperament Questionnaire. Poster presented at: Biennial Meeting of the Society for Research in Child Development; 2001; Minneapolis, MN.
- 52.Capaldi DM, Rothbart MK. Development and Validation of an Early Adolescent Temperament Measure. J Early Adolesc. 1992;12: 153–173. doi: 10.1177/0272431692012002002 [Google Scholar]
- 53.Sibley MH, Pelham WE, Molina BSG, Waschbusch DA, Gnagy EM, Babinski DE, et al. Inconsistent self-report of delinquency by adolescents and young adults with ADHD. J Abnorm Child Psychol. 2010;38: 645–656. doi: 10.1007/s10802-010-9404-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Tottenham N, Tanaka JW, Leon AC, McCarry T, Nurse M, Hare TA, et al. The NimStim set of facial expressions: judgments from untrained research participants. Psychiatry Res. 2009;168: 242–249. doi: 10.1016/j.psychres.2008.05.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Degabriele R, Lagopoulos J. Delayed early face processing in bipolar disorder. Neuroreport. 2012;23: 152–156. doi: 10.1097/WNR.0b013e32834f218c [DOI] [PubMed] [Google Scholar]
- 56.Martens U, Leuthold H, Schweinberger SR. On the temporal organization of facial identity and expression analysis: Inferences from event-related brain potentials. Cogn Affect Behav Neurosci. 2010;10: 505–522. doi: 10.3758/CABN.10.4.505 [DOI] [PubMed] [Google Scholar]
- 57.Churches O, Wheelwright S, Baron-Cohen S, Ring H. The N170 is not modulated by attention in autism spectrum conditions. Neuroreport. 2010;21: 399–403. [DOI] [PubMed] [Google Scholar]
- 58.Lopez-Calderon J, Luck SJ. ERPLAB: an open-source toolbox for the analysis of event-related potentials. Front Hum Neurosci. 2014;8: 213 doi: 10.3389/fnhum.2014.00213 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004;134: 9–21. doi: 10.1016/j.jneumeth.2003.10.009 [DOI] [PubMed] [Google Scholar]
- 60.Luck SJ. An introduction to the event-related potential technique. 2nd ed. Cambridge, MA: MIT Press; 2014. [Google Scholar]
- 61.McCulloch CE, Searle SR. Generalized, Linear, and Mixed Models. John Wiley & Sons, Inc.; 2000. [Google Scholar]
- 62.Verbeke G, Molenberghs G. Linear Mixed Models for Longitudinal Data. Springer; 2000. [Google Scholar]
- 63.Gueorguieva R, Krystal J. Move over anova: Progress in analyzing repeated-measures data andits reflection in papers. Arch Gen Psychiatry. 2004; 310–317. doi: 10.1001/archpsyc.61.3.310 [DOI] [PubMed] [Google Scholar]
- 64.SPSS. Linear Mixed-Effects Modeling in SPSS: An Introduction to the MIXED Procedure [Internet]. 2005. Available: http://www.spss.ch/upload/1126184451_Linear%20Mixed%20Effects%20Modeling%20in%20SPSS.pdf
- 65.Dennis M, Francis DJ, Cirino PT, Schachar R, Barnes MA, Fletcher JM. Why IQ is not a covariate in cognitive studies of neurodevelopmental disorders. J Int Neuropsychol Soc JINS. 2009;15: 331–343. doi: 10.1017/S1355617709090481 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Graham JW. Missing Data Analysis: Making It Work in the Real World. Annu Rev Psychol. 2009;60: 549–576. doi: 10.1146/annurev.psych.58.110405.085530 [DOI] [PubMed] [Google Scholar]
- 67.Donchin E. Presidential address, 1980. Surprise!…Surprise? Psychophysiology. 1981;18: 493–513. [DOI] [PubMed] [Google Scholar]
- 68.Willcutt EG, Doyle AE, Nigg JT, Faraone SV, Pennington BF. Validity of the executive function theory of attention-deficit/hyperactivity disorder: a meta-analytic review. Biol Psychiatry. 2005;57: 1336–1346. doi: 10.1016/j.biopsych.2005.02.006 [DOI] [PubMed] [Google Scholar]
- 69.Johnstone SJ, Barry RJ, Clarke AR. Ten years on: a follow-up review of ERP research in attention-deficit/hyperactivity disorder. Clin Neurophysiol Off J Int Fed Clin Neurophysiol. 2013;124: 644–657. doi: 10.1016/j.clinph.2012.09.006 [DOI] [PubMed] [Google Scholar]
- 70.López-Martín S, Albert J, Fernández-Jaén A, Carretié L. Emotional response inhibition in children with attention-deficit/hyperactivity disorder: neural and behavioural data. Psychol Med. 2015;45: 2057–2071. doi: 10.1017/S0033291714003195 [DOI] [PubMed] [Google Scholar]
- 71.Willcutt EG. The prevalence of DSM-IV attention-deficit/hyperactivity disorder: a meta-analytic review. Neurother J Am Soc Exp Neurother. 2012;9: 490–499. doi: 10.1007/s13311-012-0135-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All relevant data are within the paper and its Supporting Information files.