Abstract
This study explores the feasibility of using mobile-phone ecological momentary assessment (EMA) to evaluate negative emotion in adolescent girls with attention-deficit/hyperactivity disorder (ADHD). A total of 13 girls with ADHD, ages 12-16 years old (38.5% with a comorbid depression), and their mothers completed several daily surveys assessing the intensity and variability of youth negative emotion using mobile-phone-based EMA for approximately one week. The rate of response to survey prompts by youth and maternal report was examined. In addition, associations between girls’ and mothers’ ratings of negative emotion were calculated. Lastly, the severity and fluctuation in negative emotion was compared between girls with and without depression. Girls and their mothers demonstrated a high level of compliance with assessment procedures and maternal and youth ratings were significantly correlated. In addition, girls with comorbid depression and their mothers endorsed significantly more intense and variable negative emotion compared to girls with ADHD alone. These preliminary findings show that EMA is a feasible and valid method for collecting information on emotion regulation among girls with ADHD and their mothers that can be applied to future work aimed at collecting ecologically valid assessments of functioning in girls with ADHD.
Attention-deficit/hyperactivity disorder (ADHD) is diagnosed two to nine times more frequently in boys than girls (Arnold, 1996), and as a result, much less research has been conducted on girls than boys with ADHD. While it had once been assumed that girls manifested a similar or sometimes less severe presentation of ADHD compared to boys with the disorder (Arnold, 1996), emerging work suggests that girls with ADHD demonstrate heightened risk for depression that is greater and more severe than what has been documented among boys with ADHD (Biederman et al., 2008; Chronis-Tuscano et al., 2010). By early adulthood, as many as 67.9% of girls with ADHD have experienced a major depressive episode (Biederman et al., 2008), which is at least double the prevalence reported in the general population of women (Kessler et al., 2003). The co-occurrence of ADHD and depression in girls is associated with severe outcomes, including suicidality, self-harm, and substance use (Biederman et al., 2008; Chronis-Tuscano et al., 2010). Thus, attention to examining factors associated with depression among girls with ADHD is of great importance.
Accumulating evidence has identified emotion regulation (ER) difficulties as a key mechanism underlying the risk for depression in youth with ADHD (Seymour et al., 2012; Steinberg & Drabick, 2015). While the definition of ER difficulties is broad, ER difficulties typically involve problems modulating the intensity of emotion, particularly problems related to inhibiting and controlling negative emotional reactions to distressing or frustrating situations (Cole, Martin, & Dennis, 2004). Large differences have been documented among youth with and without ADHD in regulating negative emotion (Graziano & Garcia, 2016). However, the majority of work examining ER among youth with ADHD to date has relied on self-reports from parents and youth. While informative, these one-time assessments may mask more nuanced patterns of ER that may emerge over time. Specifically, methodologies that consider both the intensity of emotional response as well as the duration of the emotional response are needed to comprehensively study ER difficulties in youth with ADHD (Bunford, Evans, & Wymbs, 2015). There has been some work using observational paradigms to assess ER difficulties in youth with ADHD during frustrating tasks, such as attempting to complete a puzzle with missing pieces or peer competitions (e.g., Melnick & Hinshaw, 2000; Seymour et al., 2012). Results from these tasks suggest that compared to youth without ADHD, youth with ADHD exhibit more negative emotion reactivity when frustrated and require more time to regulate this emotion. However, the magnitude of effects between youth with and without ADHD from observational studies has been smaller than those reported from parent and teacher ratings, raising the possibility that alternative methods of assessment may be needed to assess ER difficulties in youth with ADHD. Additionally, girls have typically not been included in these studies, despite the apparent importance of identifying mechanisms of the risk for depression in adolescent girls with ADHD. Thus, exploration of additional methods to assess ER and inclusion of girls is worthwhile.
Ecological momentary assessment (EMA) may provide unique insight into the assessment of ER in girls with ADHD (Heron, Everhart, McHale, & Smyth, 2017). Using mobile phones, EMA can be used to collect frequent and naturalistic assessments girls’ ER in real-time. EMA data collection occurs outside the laboratory setting allowing for a more ecologically valid assessment of ER, and collection of ER at multiple time points provides a more reliable measure of ER. Such assessment reduces the limitations of traditional self-report methods, such as retrospective recall bias, memory difficulties, and self-perception difficulties (Heron et al., 2017), which have been documented among youth with ADHD (Owens, Goldfine, Evangelista, Hoza, & Kaiser, 2007). A large and growing literature shows that EMA with adults provides useful information, and emerging work suggests that it is useful for collecting information from youth as young as eight years old (Heron et al., 2017).
A few emerging studies have used EMA to examine ER difficulties in samples comprised predominantly of school-aged boys with ADHD (Rosen, Epstein, & Van Orden, 2013; Rosen & Factor, 2015). For example, in one study (Rosen et al., 2013) parents of 11 youth (ages 8-11 years old) with ADHD were asked to complete ratings of their children’s overall mood rated on an 11-point scale (−5 [much worse mood than usual] to +5 [much better mood than usual], with 0 equivalent to normal mood for that child). Ratings were collected three times per day (i.e., before school, after school, and evening) over the course of 28 days. Parents demonstrated a high level of adherence to study procedures (i.e., 86.53% of ratings were completed), and EMA ratings of greater emotional intensity and variability were significantly associated with internalizing problems. When youth were asked to complete similar assessment procedures across a 28 day period, similarly high adherence (i.e., 84.43%) was reported, and youth reports were significantly correlated with parent EMA ratings (Rosen et al., 2013). However, youth ratings were generally more positive than parent ratings. In addition, there was some evidence that youth were less likely to not complete ratings when they were rated as distressed by their parent, suggesting potential bias in youth EMA ratings, and raising questions about the feasibility and validity of EMA for youth with ADHD. It is not clear whether similar biases would be evident among adolescent girls with ADHD. Although self-perception difficulties have been widely reported among youth, largely school-aged boys with ADHD, emerging research focused on girls with ADHD has not found pronounced self-perception biases (Swanson, Owens, & Hinshaw, 2012). It may be that ratings of mood may be more salient to adolescent girls compared to previous studies of preadolescent youth. This may be due to age-related increases in self-awareness (Sebastian, Burnett, & Blakemore, 2008), or to the increasing salience of mood in adolescence (Biederman et al., 2008; Chronis-Tuscano et al., 2010).
The primary goal of this study was to evaluate the feasibility of using EMA for assessing ER in an exploratory sample of 13 adolescent girls with ADHD. Feasibility was assessed by examining the rate of adherence to EMA prompts by girls and their mothers. Collection of both parent and youth report is important to provide a comprehensive assessment of youth functioning, particularly given previous work that has raised concerns about the validity of self-report ratings among youth with ADHD (Owens et al., 2007; Rosen et al., 2013). To further evaluate the feasibility of EMA, concordance between youth and maternal EMA ratings of the intensity and variability of negative emotion was also examined as a measure of convergent validity. Lastly, the intensity and fluctuation of negative mood were compared between girls with ADHD and comorbid depression versus ADHD alone as a measure of discriminant validity. Based on accumulating evidence demonstrating the feasibility of EMA (Heron et al., 2017; Rosen & Factor, 2015), we hypothesized that EMA would be a feasible method to collect information on ER among adolescent girls with ADHD and their mothers. Specifically, we hypothesized that girls and parents would demonstrate adherence to the EMA protocol. In addition, we hypothesized that maternal and youth EMA ratings of negative emotion would be significantly associated. Lastly, based on previous work showing ER dysfunction as a marker of depression (e.g., Seymour et al., 2012), we hypothesized that greater ER difficulties would be demonstrated in girls with versus without comorbid depression based on youth and maternal report.
Methods
Participants
A total of 17 girls with ADHD were recruited to participate in a pilot study broadly assessing mood and social functioning. Girls were recruited using advertisements posted within an academic medical center and the surrounding community in the mid-Atlantic region of the United States. Girls were required to be between 12 and 16 years old (inclusive) and have an IQ>70 based on the Wechsler Abbreviated Scales of Intelligence (Wechsler, 2011). ADHD, oppositional defiant disorder (ODD), and conduct disorder (CD) diagnoses were assigned based on maternal report on the Disruptive Behavior Disorders Interview (DBD-I; Pelham, Fabiano, & Massetti, 2005). The DBD-I is a semi-structured interview examining DSM symptoms of ADHD, ODD, and CD, with supplemental probes for symptom severity and situational variability; the DBD-I was conducted by a master’s or doctoral level clinician. High levels of internal consistency have been reported for symptoms of ADHD using the DBD-I (alpha=.93 for inattentive symptoms, alpha=.81 for hyperactive/impulsive symptoms; Hartung, McCarthy, Milich, & Martin, 2005). Furthermore, parent ratings on the DBD-I are strongly correlated with ADHD symptom dimensions collected using self-report questionnaires (r=.90 for inattentive symptoms, r=.81 for hyperactive/impulsive symptoms; Hartung et al., 2005). Mothers also completed the Disruptive Behavior Disorders Rating Scale (Pelham et al., 2005). Diagnoses were made if a sufficient number of symptoms were endorsed (considering all available diagnostic information). In addition, mood and anxiety disorder modules of the Schedule for Affective Disorders and Schizophrenia for School-Aged Children (K-SADS; Kaufman et al., 1997) were administered to girls and their mothers to assess current co-occurring psychopathology. Autism, schizophrenia, psychosis, and non-English speaking were exclusionary.
Study procedures were completed in two appointments conducted from September 2016 through January 2017. Diagnostic information was collected in the first appointment and girls and their mothers were provided with cell phones to collect EMA ratings at the end of the first appointment. Cell phones were returned at the second study visit, when additional measures of social-emotional functioning were collected including self-report rating scales from mothers and girls, behavioral observation, and neurophysiological assessment. Four girls and their mothers did not complete EMA procedures. One family took the phones but did not complete ratings as they later decided to withdraw from the study. The other three families did not complete initial diagnostic procedures and were lost to follow-up. Thus, a total of 13 girls (5 with a comorbid diagnosis of depression) and their mothers provided EMA study procedures and their data is described herein. Demographic characteristics are presented in Table 1. One girl with ADHD only was medicated for anxiety, and one girl in the ADHD with comorbid depression group was medicated for depression and anxiety. Girls with ADHD and depression were significantly more likely to be diagnosed with a comorbid anxiety disorder. No differences in age, race, ethnicity, IQ, ADHD presentation, ADHD medication status, or comorbid ODD/CD diagnosis emerged.
Table 1.
Demographic Characteristics
| ADHD (n=8) |
ADHD + Depression (n=5) |
p-value | |
|---|---|---|---|
| Age (M, SD) | 14.13 (1.73) | 12.80 (0.84) | .14 |
| White Race (%) | 87.50 | 80.00 | .72 |
| Hispanic/Latino (%) | 12.50 | 20.00 | .72 |
| IQ (M, SD) | 100.00 (12.55) | 102.80 (20.96) | .77 |
| ADHD Presentation | .57 | ||
| Inattentive (%) | 75.00 | 60.00 | |
| Combined (%) | 25.00 | 40.00 | |
| ADHD medication (%) | 37.50 | 50.00 | .43 |
| ODD/CD Diagnosis (%) | 37.50 | 20.00 | .51 |
| Anxiety Disorder (%) | 37.50 | 100.00 | .02 |
EMA of Negative Emotion
Girls and their mothers were provided with cell phones that were modified to allow access only to the surveys and not internet or call out features. Participants were instructed that the device would signal at random times to complete a rating. Cell phones were programmed so that survey prompts were sent to girls and their mothers for one week (Monday-Friday between 4-6pm and 7:30-9:30pm; Saturday-Sunday between 11am-12:30pm, 2:00-3:30pm, 4:30pm-6:00pm, and 7:30-9:30pm). The time frames were selected so that cell phone use would not interfere with girls’ school day, and also because this time period allows for variable levels of freedom and social interaction. Participants had the opportunity to use a snooze feature that would postpone the completion of the survey for 10 minutes. After 10 minutes if the survey was not completed, participants were again prompted to complete the survey. The snooze feature could be used multiple times, but phones were programmed so that if participants did not respond to the prompt within 60 minutes, they would no longer have access to the survey. Participants were reminded to charge the cell phones during the week and to keep phones on in order to receive surveys. Technical problems were reported by one family (Participant 03; prompts for EMA collection were not initially received). However, this issue was resolved by resetting the survey programming allowing for adequate data collection. Participants were instructed to complete EMA ratings for one week, although in some cases participants completed additional ratings when their return visit was scheduled later than one week from their initial study visit. The total available data were included due to the exploratory and descriptive nature of this pilot study. Data was collected over an average of 8.3 days (range: 4 to 14 days).
Intensity of negative emotion.
Each phone assessment measured negative emotion intensity using six items (i.e., lonely, sad, worried, bored, hopeless, and in pain [stomachaches, headaches, etc]), each rated on a scale from 1 (very slightly or not at all) to 5 (very much). Items reflecting sadness and worry were selected from the short form of the Positive and Negative Affect Schedule for Children (PANAS-C; Laurent et al., 1999; Ebesutani et al., 2012), which has been used with EMA collection in youth (Dunton et al., 2014; Rosen, Walerius, Fogleman, & Factor, 2015), and additional items reflecting depressive symptomology, including hopelessness, boredom and loneliness were selected (American Psychiatric Association, 2013). An item assessing pain was also included, as somatic complaints have been shown to be a common manifestation of negative emotion in youth (Terwogt, Rieffe, Miers, Jellesma, & Tolland, 2006). Girls were asked to rate their own negative emotion, and mothers were asked to rate the negative emotion of their daughters (see Table 2). Total negative emotion scores were created by summing scores across all six emotions for girls (Cronbach’s alpha=.84) and their mothers (Cronbach’s alpha=.75). However, to obtain the most comprehensive assessment of treatment outcome, both adolescent and maternal ratings were also combined by taking the maximum score on an item-by-item basis as has been done in past research and as recommended on theoretical and empirical grounds (e.g., Rhew et al., 2010). Total negative emotion using combined maternal and youth report was calculated by summing ratings across all negative emotion ratings (Cronbach’s alpha=.82). Scores ranged from 6 to 30, with higher scores indicating greater negative emotion.
Table 2.
EMA Ratings of Negative Emotion Intensity and Variability by Youth, Maternal and Combined Report
| Total sample | ADHD | ADHD+depression | ES | |
|---|---|---|---|---|
| Youth report | ||||
| Intensity of negative emotion | ||||
| Pain | 1.74 (1.26) | 1.47 (1.06) | 2.34 (1.46) | .68** |
| Hopeless | 1.34 (0.92) | 1.14 (0.65) | 1.82 (1.23) | .69** |
| Worried | 1.37 (0.85) | 1.09 (0.36) | 2.00 (1.25) | 1.00** |
| Bored | 1.91 (1.26) | 1.69 (1.11) | 2.39 (1.45) | .54** |
| Sad | 1.37 (0.84) | 1.12 (0.45) | 1.95 (1.19) | .92** |
| Lonely | 1.25 (0.73) | 1.08 (0.37) | 1.66 (1.12) | .70** |
| Total negative emotion | 8.93 (4.43) | 7.62 (2.34) | 12.15 (6.22) | .96** |
| Variability of negative emotion | 15.75 (38.87) | 7.32 (16.51) | 36.81 (63.98) | .63* |
| Maternal report | ||||
| Intensity of negative emotion | ||||
| Pain | 1.39 (0.90) | 1.19 (0.65) | 1.78 (1.17) | .62** |
| Hopeless | 1.13 (0.51) | 1.01 (0.12) | 1.37 (0.81) | .62** |
| Worried | 1.42 (0.78) | 1.26 (0.63) | 1.74 (0.94) | .60** |
| Bored | 1.79 (1.02) | 1.53 (0.76) | 2.30 (1.25) | .74** |
| Sad | 1.31 (0.71) | 1.17 (0.53) | 1.58 (0.91) | .55** |
| Lonely | 1.34 (0.68) | 1.21 (0.50) | 1.59 (0.91) | .52** |
| Total negative emotion | 8.37 (3.13) | 7.39 (1.96) | 10.31 (4.00) | .93** |
| Variability of negative emotion | 9.92 (19.42) | 5.18 (11.48) | 19.64 (27.44) | .69** |
| Combined youth and maternal report | ||||
| Intensity of negative emotion | ||||
| Pain | 1.74 (1.23) | 1.45 (1.04) | 2.27 (1.37) | .67** |
| Hopeless | 1.31 (0.85) | 1.12 (0.58) | 1.66 (1.12) | .61** |
| Worried | 1.53 (0.91) | 1.28 (0.65) | 1.99 (1.13) | .77** |
| Bored | 2.08 (1.21) | 1.85 (1.07) | 2.50 (1.35) | .53** |
| Sad | 1.47 (0.89) | 1.25 (0.62) | 1.90 (1.15) | .70** |
| Lonely | 1.41 (0.80) | 1.23 (0.55) | 1.74 (1.06) | .60** |
| Total negative emotion | 9.53 (4.36) | 8.18 (2.60) | 12.06 (5.69) | .88** |
| Variability of negative emotion | 17.78 (41.23) | 9.52 (16.35) | 33.79 (64.37) | .52* |
Note. ES=Cohen’s d effect size. ES was calculated for comparisons between girls with ADHD versus girls with ADHD and comorbid depression. Combined youth and maternal report was computed by taking the maximum score on an item-by-item considering youth and maternal ratings.
p<.05
p<.01.
Variability of negative emotion.
The average Mean Square Successive Difference (MSSD) score was used to assess variability of total negative emotion (Rosen & Factor, 2015; Solhan et al., 2009). The MSSD is calculated by determining the difference in each successive, within day total negative emotion rating, then squaring this difference. Thus, for weekday assessments, the MSSD would be calculated from the afternoon (i.e., 4-6pm) assessment to the evening (i.e., 7:30-9:30pm) assessment, and for weekends, the MSSD was calculated from the 11am-12:30pm assessment to the 2:00-3:30pm assessment, from the 2:00-3:30pm assessment to the 4:30pm-6:00pm assessment, and from the 4:30-6:00pm to 7:30-9:30pm assessment.
Data Analytic Plan
The feasibility of EMA was assessed in three ways. First, adherence to the EMA protocol was examined using the percentages of completed prompts from mothers and girls. The rate of compliance to study prompts considering response from either parent or adolescent was also calculated. Associations between rate of compliance and youth age, IQ, and depression status (i.e, yes/no) were also considered using bivariate correlations. Second, the convergent validity of EMA ratings was assessed. Specifically, the concordance between ratings collected from mothers and girls, maternal and youth ratings of negative emotion intensity and fluctuation were compared using t-tests and bivariate correlations were examined across maternal and youth reports of negative emotion intensity and fluctuation. Third, to assess the discriminant validity of EMA ratings, group differences between girls with and without comorbid depression on parent, youth, and combined mood intensity and mood variability measures were examined using t-tests. Cohen’s d is also provided as a measure of effect size with small, medium, and large effects equivalent to d=0.20, 0.50, and 0.80, respectively (Cohen, 1992).
Results
Adherence to the EMA protocol
The average rate of adherence to study prompts using combined parent and youth report was 87.1% (mothers: 91.0%, youth: 84.0%). There was no significant difference between rate of compliance between girls with and without a comorbid depression, when considering combined parent-youth report (ADHD only: 88.6% vs. ADHD+depression: 86.6%, p=.76), youth report (ADHD only: 83.4% vs. ADHD+depression: 86.0%, p=.65), or maternal report (ADHD only: 93.9% vs ADHD+depression: 87.2%, p=.38). Age was not significantly associated with rate of compliance by combined report (r=.24, p=.43), youth report (r=.03, p=.91), or maternal report (r=.32, p=.29). Compliance was also not associated with youth IQ (by combined report: r=.02, p=.94, by youth report: r=−.13, p=.67, or maternal report: r=.17, p=.59).
Concordance between Maternal and Youth Ratings
Intensity of negative emotion.
Maternal and youth ratings for each negative emotion item and total negative emotion are reported in Table 2. Maternal and youth reports of pain and loneliness were significantly different. Specifically, in the full sample, youth reported greater pain compared to mothers (p<.001) and mothers reported higher levels of loneliness compared to girls (p=.021). Maternal and youth ratings did not differ on other negative emotion items or total mood intensity (p’s>.06). Maternal and youth report were correlated for pain (r=.47, p<.001), hopeless (r=.45, p<.001), worried (r=.47, p<.001), bored (r=.44, p<.001), sad (r=.33, p<.001), lonely (r=.51, p<.001), and total negative emotion (r=.55, p<.001).
Variability of negative emotion.
Maternal and youth ratings of mood variability were computed in the full sample and are reported in Table 2. Maternal and youth report were not significantly different on this measure (p=.80). The bivariate correlation between maternal and youth MSSD was significant, r=.41, p<.001).
Negative emotion ratings in girls with ADHD only versus ADHD+depression
Intensity of negative emotion.
Parent, youth, and combined EMA ratings of negative emotion intensity for girls with ADHD only versus ADHD+depression are reported in Table 2. All negative emotion ratings were significantly different between girls with ADHD alone and ADHD + depression, with ratings for girls with ADHD and depression significantly greater than ratings of girls without ADHD alone.
Variability of negative emotion.
Negative emotion variability MSSD scores by maternal, child, and combined report for girls with and without comorbid depression are presented in Table 2. Given the significant correlation between maternal and youth report, and consistent with guidelines showing that the combination of parent and youth report are associated with the most meaningful information (Rhew et al., 2010), combined parent-youth reports are presented visually in figures. Total negative emotion ratings using combined parent and youth report are presented for youth with ADHD alone in Figure 1 and for youth with ADHD and depression in Figure 2.
Figure 1. Combined Youth and Maternal Negative Emotion Ratings for Girls with ADHD Only.
Note. X-axis depicts each timepoint and Y-axis depicts the total intensity of negative emotion scored calculated using combined parent and youth report. Dx = diagnosis; y.o.= years old; ADHD I=ADHD Inattentive Presentation; ADHD-C=ADHD Combined Presentation. Response rate was calculated based on combined parent and youth report. All available data are presented visually due to the exploratory nature of the study.
Figure 2. Combined Youth and Maternal Negative Emotion Ratings for Girls with ADHD and Depression.
Note. X-axis depicts each timepoint and Y-axis depicts the total intensity of negative emotion scored calculated using combined parent and youth report. Dx = diagnosis; y.o.= years old; ADHD I=ADHD Inattentive Presentation; ADHD-C=ADHD Combined Presentation. Response rate was calculated based on combined parent and youth report. All available data are presented visually due to the exploratory nature of the study.
Discussion
This exploratory study examined the feasibility of EMA to assess ER difficulties in adolescent girls with ADHD. Mobile-phones were provided to both girls and their mothers to assess ratings of girls’ negative emotions. The intensity of negative emotion and the variability of negative emotion were assessed using maternal and youth report. The results demonstrated that EMA was a feasible and valid method to assess negative emotion in girls with ADHD. There was a high level of compliance with daily assessment procedures, and youth and maternal ratings of negative emotion were significantly correlated. Furthermore, EMA ratings differentiated girls with ADHD with and without comorbid depression. Specifically, girls with comorbid depression demonstrated greater negative emotion and significantly more variability in negative emotion compared to girls with ADHD only. These findings are discussed herein.
The high rate of adherence among participants was at or better than rates of adherence reported in previous studies of youth (e.g., Heron et al., 2017), and specifically youth with ADHD (Rosen et al., 2013; Rosen & Factor, 2015). The high level of adherence to study procedures is also notable, as procedures in the current study required most parents and some girls to carry around two devices (the study phone and their own cellphone), which may have been cumbersome. Emerging research suggests alternative methods of collecting EMA, including using mobile-phone based applications that can be downloaded onto participants’ own cellphone (Kleiman et al., 2017), which may be useful for future EMA research with adolescent youth with ADHD. Previous EMA studies have focused on elementary-aged youth with ADHD, who may have limited self-control to complete frequent EMA ratings. As the severity of ADHD symptoms often decreases as youth reach adolescence (Sasser, Kalvin, & Bierman, 2016), it may be that EMA is of relatively greater utility for adolescent girls versus preadolescent youth with ADHD. It is also plausible that negative mood was a highly salient topic for girls with ADHD and their mothers, which resulted in high engagement in completing EMA surveys.
The high adherence to the EMA protocol may also be due to the relatively short period of time EMA was collected, as previous studies have collected EMA ratings over the course of intervals lasting as long as a month (Heron et al., 2017; Rosen et al., 2013). Importantly, even with our relatively brief interval of assessment over the course of approximately one week, it appears that valid data was collected. With the exception of girls rating greater pain compared to mothers, and mothers rating endorsing greater loneliness to youth report, consistent differences between maternal and youth report of negative emotion were not identified. The similarity between maternal and youth report contrast previous EMA research showing youth with ADHD provide positively skewed ratings of mood (Rosen et al., 2013), and may be due to increasing self-insight in adolescents versus elementary-aged youth (Sebastian et al., 2008). In addition, maternal and youth reports of negative emotion were significantly correlated, and the strength of associations between maternal and youth ratings of negative emotion was in line with previous work showing modest associations between ratings of functioning collected across raters (Verhulst & van der Ende, 1992; Youngstrom, Loeber, & Stouthamer-Loeber, 2000).
Comparisons between girls with ADHD and comorbid depression compared to girls with ADHD alone also provide evidence of the feasibility of collecting valid EMA ratings. Girls with ADHD and comorbid depression rated greater negative emotion intensity and fluctuation by self, maternal, and combined report. These consistent group differences fit with existing research showing ER difficulties to be a marker of depression in youth with (Seymour et al., 2012) and without ADHD (Silk, Steinberg, & Morris, 2003). Notably, girls with ADHD and depression demonstrated highs and lows in negative emotion, which is somewhat distinct from conceptualizations of depression that involve persistent negative mood (Bennik, Nederhof, Ormel, & Oldehinkel, 2014). As our study is cross-sectional, we are not able to determine whether the greater negative emotion and fluctuations in negative emotion also identify risk for depression in girls prior to the development of depression. For example, some of the girls in the non-depressed group (e.g., participant 11) displayed variability in ratings of negative affect, which may potentially signal risk for the development of depression later in development. However, ER dysregulation has also been associated with ADHD (Barkley, 2014; Martel, 2009), and inclusion of a sample of girls without ADHD is needed to identify whether unique patterns of regulating negative emotion are associated with ADHD versus depression. Similarly, the majority of girls in the ADHD and depression group were also diagnosed with an anxiety disorder, which may also contribute to these findings.
It is important to mention several limitations of the current work. As this is a small pilot study that included only girls with ADHD, generalizability is limited. In addition, we focused only on regulation of six specific negative emotions and attention to other measures of ER, including changes in positive affect, frustration tolerance, or anger may also be relevant to consider. We incorporated maternal and youth EMA ratings in order to provide the most comprehensive evaluation of mood, which has been recommended on empirical and theoretical grounds (e.g., Rhew et al., 2010). However, it may also be useful in a larger sample to consider more nuanced differences in maternal and youth ratings or potential covariates, including ADHD medication use and additional comorbidities (e.g., ODD, anxiety). A larger sample may also afford opportunities to consider alternative methods of data analysis, such as partial least squares algorithms (Hair, Ringle, & Starstedt, 2011). We did not consider information on other important areas of functioning, particularly social functioning, which may serve to further contextualize these findings. Peer difficulties have been identified in the development of youth with ADHD (Humphreys et al., 2012). Thus, attention to the relationship between peer stress and changes in negative emotion over time may serve to clarify antecedents to mood difficulties in girls.
Despite these limitations, this work provides an important step towards prioritizing the study of girls with ADHD in adolescence when mood difficulties become particularly prominent. Indeed, given these promising preliminary findings, additional research incorporating EMA holds great promise for understanding the real-time functioning of girls with ADHD. Accumulating research shows that ER difficulties among individuals with ADHD are associated with a broad range of psychopathology and functional impairments beyond depression, including social and occupational impairment, as well as substance abuse (Barkley, 2014). Thus, continued attention to assess this construct is of critical importance.
References
- American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author. [Google Scholar]
- Arnold LE (1996). Sex differences in ADHD: conference summary. Journal of Abnormal Child Psychology, 24, 555–569. doi: 10.1007/BF01670100 [DOI] [PubMed] [Google Scholar]
- Barkley RA (2015). Emotional dysregulation is a core component of ADHD In Barkley RA (Ed.), Attention-deficit hyperactivity disorder: A handbook for diagnosis and treatment (pp. 81–115). New York, NY, US: Guilford Press. [Google Scholar]
- Bennik EC, Nederhof E, Ormel J, & Oldehinkel AJ (2014). Anhedonia and depressed mood in adolescence: course, stability, and reciprocal relation in the TRAILS study. European Child and Adolescent Psychiatry, 23, 579–586. doi: 10.1007/s00787-013-0481-z [DOI] [PubMed] [Google Scholar]
- Biederman J, Ball SW, Monuteaux MC, Mick E, Spencer TJ, McCreary M, … Faraone SV (2008). New insights into the comorbidity between ADHD and major depression in adolescent and young adult females. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 426–434. doi: 10.1097/CHI.0b013e31816429d3 [DOI] [PubMed] [Google Scholar]
- Bunford N, Evans SW, & Wymbs F (2015). ADHD and emotion dysregulation among children and adolescents. Clinical Child and Adolescent Psychology Review, 18, 185–217. doi: 10.1007/s10567-015-0187-5 [DOI] [PubMed] [Google Scholar]
- Chronis-Tuscano A, Molina BSG, Pelham WE, Applegate B, Dahlke A, Overmyer M, & Lahey BB (2010). Very early predictors of adolescent depression and suicide attempts in children with attention-deficit/hyperactivity disorder. Archives of General Psychiatry, 67, 1044–1051. doi: 10.1001/archgenpsychiatry.2010.127 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen J (1992). A power primer. Psychological Bulletin, 112, 155–159. doi: 10.1037/0033-2909.112.1.155 [DOI] [PubMed] [Google Scholar]
- Cole PM, Martin SE, & Dennis TA (2004). Emotion regulation as a scientific construct: methodological challenges and directions for child development research. Child Development, 75, 317–333. doi: 10.1111/j.1467-8624.2004.00673.x [DOI] [PubMed] [Google Scholar]
- Dunton GF, Huh J, Leventhal A, Riggs N, Spruijt D, Pentz MA, & Hedeker D (2014). Momentary assessment of affect, physical feeling states, and physical activity in children. Health Psychology, 33, 255–263. doi: 10.1037/a0032640 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ebesutani C, Regan J, Smith A, Reise S, Higa-McMillan C, & Chorpita BF (2012). The 10-item positive and negative affect schedule for children, child and parent shortened versions: application of item response theory for more efficient assessment. Journal of Psychopathology and behavioral Assessment, 34, 191–203. doi: 10.1037/a0022057 [DOI] [Google Scholar]
- Graziano PA & Garcia A (2016). Attention-deficit hyperactivity disorder and children’s emotion dysregulation: a meta-analysis. Clinical Psychology Review, 46, 106–123. doi: 10.1016/j.cpr.2016.04.011 [DOI] [PubMed] [Google Scholar]
- Hair JF, Ringle CM, & Sarstedt M (2011). PLS-SEM: indeed a silver bullet. Journal of Marketing Theory and Practice, 12, 139–152. doi: 10.2753/MTP1069-6679190202 [DOI] [Google Scholar]
- Hartung CM, McCarthy DM, Milich R, & Martin CA (2005). Parent-adolescent agreement on disruptive behavior symptoms: a multitrait-multimethod model. Journal of Psychopathology and Behavioral Assessment, 27, 159–168. doi: 10.1007/s10862-005-0632-8 [DOI] [Google Scholar]
- Heron KE, Everhart RS, McHale SM, & Smyth JM (2017). Using mobile-technology-based ecological momentary assessment (EMA) methods with youth: a systematic review and recommendations. Journal of Pediatric Psychology, 42, 1087–1107. doi: 10.1093/jpepsy/jsx078 [DOI] [PubMed] [Google Scholar]
- Humphreys KL, Katz SJ, Lee SS, Hammen C, Brennan PA, & Najman JM (2013). The association of ADHD and depression: mediation by peer problems and parent-child difficulties in two complementary samples. Journal of Abnormal Psychology, 122, 854–867. doi: 10.1037/a0033895 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, . . . Ryan N (1997). Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36. doi: 10.1097/00004583-199707000-00021 [DOI] [PubMed] [Google Scholar]
- Kessler RC, Berglund P, & Demler O, Jin R, Koretz D, Merikangas KR, … Wang PS (2003). The epidemiology of major depressive disorder: results from the National Comorbidity Survey Replication (NCS-R). JAMA, 289, 3095–3105. doi: 10.1001/jama.289.23.3095 [DOI] [PubMed] [Google Scholar]
- Kleiman EM, Turner BJ, Fedor S, Beale EE, Huggman JC, … Nock MK (2017). Examination of real-time fluctuations in suicidal ideation and its risk factors: results from two ecological momentary assessment studies. Journal of Abnormal Psychology, 126, 726–738. doi: 10.1037/abn0000273 [DOI] [PubMed] [Google Scholar]
- Laurent J, Catanzaro SJ, Joiner TE Jr., Rudolph KD, Potter KI, Lambert S, … Gathright T (1999). A measure of positive and negative affect for children: scale development and preliminary validation. Psychological Assessment, 11, 326–338. doi: 10.1037/1040-3590.11.3.326 [DOI] [Google Scholar]
- Martel MM (2009). Research review: a new perspective on attention-deficit/hyperactivity disorder: emotion dysregulation and trait models. Journal of Child Psychology and Psychiatry, 50, 1042–1051. doi: 10.1111/j.1469-7610.2009.02105.x [DOI] [PubMed] [Google Scholar]
- Melnick SM & Hinshaw SP (2000). Emotion regulation and parenting in AD/HD and comparison boys: linkages with social behaviors and peer preference. Journal of Abnormal Child Psychology, 28, 73–86. doi: 10.1023/A:1005174102794 [DOI] [PubMed] [Google Scholar]
- Owens JS, Goldfine ME, Evangelista NM, Hoza B, & Kaiser NM (2007). A critical review of self-perceptions and the positive illusory bias in children with ADHD. Clinical Child and Family Psychology Review, 10, 335–351. doi: 10.1007/s10567-007-0027-3 [DOI] [PubMed] [Google Scholar]
- Pelham WE, Fabiano GA, & Massetti GM (2005). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 449–476. doi: 10.1207/s15374424jccp3403_5 [DOI] [PubMed] [Google Scholar]
- Rhew IC, Simpson K, Tracy M, Lymp J, McCauley E, Tsuang D, & Stoep A Vander. (2010). Criterion validity of the Short Mood and Feelings Questionnaire and one- and two-item depression screens in young adolescents. Child and Adolescent Psychiatry and Mental Health, 4, 8. doi: 10.1186/1753-2000-4-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rosen PJ, Epstein JN, & Van Orden G (2013). I know it when I quantify it: ecological momentary assessment and recurrence quantification analysis of emotion dysregulation in children with ADHD. ADHD Attention Deficit and Hyperactivity Disorders, 5, 283–294. doi: 10.1007/s12402-013-0101-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rosen PJ & Factor PI (2015). Emotional impulsivity and emotional and behavioral difficulties among children with ADHD: an ecological momentary assessment study. Journal of Attention Disorders, 19, 779–793. doi: 10.1177/1087054712463064 [DOI] [PubMed] [Google Scholar]
- Rosen PJ, Walerius DM, Fogelman ND, & Factor PI (2015). The association of emotional lability and emotional and behavioral difficulties among children with and without ADHD. ADHD Attention Deficit and Hyperactivity Disorders, 7, 281–294. doi: 10.1007/s12402-015-0175 [DOI] [PubMed] [Google Scholar]
- Sasser TR, Kalvin CB, & Bierman KL (2016). Developmental trajectories of clinically significant attention-deficit/hyperactivity disorder (ADHD) symptoms from grade 3 through 12 in a high-risk sample: predictors and outcomes. Journal of Abnormal Psychology, 125, 207–219. doi: 10.1037/abn0000112 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sebastian C, Burnett S, & Blakemore S (2008). Development of the self-concept during adolescence. Trends in Cognitive Sciences, 12, 441–446. doi: 10.1016/j.tics.2008.07.008 [DOI] [PubMed] [Google Scholar]
- Seymour KE, Chronis-Tuscano A, Halldorsdottir T, Stupica B, Owens K, & Sacks T (2012). Emotion regulation mediates the relationship between ADHD and depressive symptoms in youth. Journal of Abnormal Child Psychology, 40, 595–606. doi: 10.1007/s10802-011-9593-4 [DOI] [PubMed] [Google Scholar]
- Silk JS, Steinberg L, & Morris AM (2003). Adolescents’ emotion regulation in daily life: links to depressive symptoms and problem behaviors. Child Development, 74, 1869–1880. doi: 10.1046/j.1467-8624.2003.00643.x [DOI] [PubMed] [Google Scholar]
- Solhan MB, Trull TJ, Jahng S, & Wood PK (2009). Clinical assessment of affective instability: comparing EMA indices, questionnaire records, and retrospective recall. Psychological Assessment, 21, 425–436. doi: 10.1037/a0016869 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Steinberg EA & Drabick DAG (2015). A developmental psychopathology perspective on ADHD and comorbid conditions: the role of emotion regulation. Child Psychiatry and Human Development, 46, 951–966. doi: 10.1007/s10578-015-0534-2 [DOI] [PubMed] [Google Scholar]
- Swanson EN, Owens EB, & Hinshaw SP (2012). In the positive illusory bias illusory? Examining discrepant self-perceptions of competence in girls with ADHD. Journal of Abnormal Child Psychology, 40, 987–998. doi: 10.1007/s10802-012-9615-x [DOI] [PubMed] [Google Scholar]
- Terwogt MM, Rieffe C, Miers AC, Jellsma FC, & Tolland A (2006). Emotions and self-esteem as indicators of somatic complains in children. Infant and Child Development, 15, 581–592. doi: 10.1002/icd.479 [DOI] [Google Scholar]
- Verhulst FC & van der Ende J (1992). Agreement between parents’ reports and adolescents’ self-reports of problem behavior. Journal of Child Psychology and Psychiatry, 33, 1011–1023. doi: 10.1111/j.1469-7610.1992.tb00922.x [DOI] [PubMed] [Google Scholar]
- Wechsler D (2011). Wechsler Abbreviated Scale of Intelligence-II (WASI-II). San Antonio, TX: Harcourt Assessment. [Google Scholar]
- Youngstrom E, Loeber R, & Stouthamer-Loeber M (2000). Patterns and correlates of agreement between parent, teacher, and male adolescent ratings of externalizing and internalizing problems. Journal of Consulting and Clinical Psychology, 68, 1038–1050. doi: 10.1037//0022-006X.68.6.1038 [DOI] [PubMed] [Google Scholar]


