Abstract
Research examining set-shifting has revealed significant difficulties for adults with autism spectrum disorders (ASDs). However, research with high-functioning children with ASDs has yielded mixed results. The current study tested 6- to 13-year-old high-functioning children with ASD and typically developing controls matched on age, gender, and IQ using the Intradimensional/Extradimensional (ID/ED) Shift Test from the Cambridge Neuropsychological Test Automated Battery. Children with ASDs completed as many ED shifts and reversal ED shifts as controls; however, they made significantly more errors than controls while completing the ED reversal shifts. Analyses on a subset of cases revealed a significant positive correlation between ED reversal errors and the number of repetitive behavior symptoms in the ASD group. These findings suggest that high-functioning children with ASDs require additional feedback to shift successfully. In addition, the relationship between set-shifting and non-social symptoms suggests its utility as a potentially informative intermediate phenotype in ASDs.
Keywords: attention, autism, ID/ED shift task, set-shifting
Individuals with autism spectrum disorders (ASDs) struggle to shift their attention during daily activities (Gioia et al., 2002) and on laboratory measures (see Hill, 2004 and Pennington and Ozonoff, 1996 for comprehensive reviews). Set-shifting in laboratory tasks requires successful switching between two tasks or sorting the same stimulus by different features. Set-shifting is one of several cognitive components that fall within the executive function (EF) domain, which enables individuals to achieve goals efficiently (Pennington and Ozonoff, 1996). The present study examines: (1) set-shifting in 6- to 13-year-old children with and without high-functioning ASDs using the Intradimensional/Extradimensional (ID/ED) Shift Test from the Cambridge Neuropsychological Test Automated Battery, and (2) the relationship between set-shifting performance and core repetitive behavior/restricted interest symptoms in the ASD group.
Set-shifting is one cognitive process that holds promise as an intermediate phenotype in ASDs. Intermediate phenotypes include cognitive processes that serve as a link between the observed behavioral symptoms of neurodevelopmental and psychiatric disorders and their brain and/or genetic bases (Gottesman and Gould, 2003).This connection requires establishing an association between the cognitive process and core symptoms as well as brain and genetic indices. Several independent investigations report a positive relationship between set-shifting deficits and restricted interest/repetitive behavior symptoms in autism (Lopez et al., 2005; South et al., 2007). Furthermore, in a recent functional neuroimaging investigation of set-shifting in adults with ASDs, the activation patterns of anterior cingulate cortex and left intraparietal sulcus correlated negatively with the restricted interest/repetitive behaviors index from the Autism Diagnostic Interview–Revised (ADI–R: Shafritz et al., 2008).This finding connects brain function during a set-shifting task with core symptoms of ASDs. Taken together, these findings suggest set-shifting as a potentially valuable intermediary between ASD symptoms and neurobiological functioning.
To investigate this possibility further, a reliable measure of set-shifting with as few extraneous (cognitive and motor) demands as possible and with an established link to brain function is needed. Investigations of set-shifting in ASD have typically relied on two measures of flexibility: the Wisconsin Card Sorting Test and the ID/ED Test. The former is criticized for its lack of specificity to flexibility (Hill, 2004), social administration (Ozonoff, 1995), and language demands (Liss et al., 2001). In contrast, the ID/ED Test measures flexibility in a systematic fashion that allows for controlled increases in shifting demands (Cambridge Cognition, 1996). It consists of nine stages, which encompass three types of tasks: simple object discrimination; shifting within a single dimension (e.g. shape: intra-dimensional (ID) shift); and shifting attention from one dimension to another (e.g. ignore shape and attend to previously ignored line: extra-dimensional (ED) shift). Embedded in ID and ED shifting is a reversal shift that requires participants to maintain the same rule but select an alternate exemplar (see Figure 1). Success on ID/ED is measured both by the ability to pass a stage (number of stages completed) and by the number of errors made while passing a stage (errors to criterion). Experiments with monkeys have linked lesions to lateral and orbital regions of the prefrontal cortex with impaired performance on ED and ED reversal shifts, respectively (Dias et al., 1996). Atypical development of orbital (Girgis et al., 2007) and lateral (Carper and Courchesne, 2005) prefrontal regions in ASDs highlights the importance of assessing flexibility in ED shift and ED reversal shift conditions.
Figure 1.
Stages of the ID/ED test. (a) Stimuli presented in stages 1 and 2. (b) Stimuli presented in stage 3. (c) Stimuli presented in stages 4 and 5. (d) Stimuli presented in stages 6 and 7. (e) Stimuli presented in stages 8 and 9. Reproduced with kind permission of Cambridge Cognition Limited © Copyright 2008, all rights reserved
While ID/ED is a promising task for investigating flexibility in children with ASDs, studies to date have yielded mixed results. Some investigations report deficits (Hughes et al., 1994; Ozonoff et al., 2000; 2004) while others do not (Edgin and Pennington, 2005; Goldberg et al., 2005; Happé et al., 2006; Landa and Goldberg, 2005). Conflicting results may reflect variability in the participants’ age and the stages of the task which are analyzed. Studies focusing on younger and narrower age ranges of high-functioning children have not reported performance on ED reversal shifting and have not found ED shift deficits in ASD groups. Two of the three studies finding deficits on the ID/ED involve ASD groups with mean ages in the teens, and the third involves cognitively impaired children. In addition, both of the studies that analyzed ED reversal shifting found deficits in the ASD group. In summary, previous investigations document deficits in ED shifts and reversal shifts in high-functioning adolescents and adults with ASD, while investigations of primary school age children have failed to find deficits in ED shifts and have not reported on ED reversal shifts (see Table 1 for a summary of ID/ED studies in ASD).
Table 1.
Summary of previous studies using the ID/ED test to assess set-shifting among individuals with ASD
Reference | Sample characteristicsa | Stages comparedb | Key findings |
---|---|---|---|
Hughes et al. (1994) | N: ASD = 35, ID = 38,TD = 47 | ED shift and ED reversal | ASD < TD and ASD < ID on ED shift |
Age: ASD = 12.9, ID = 13.3,TD = 8.1 | ASD < TD and ASD < ID on ED reversal shift | ||
VMA: ASD = 7.2, ID = 7.3,TD = (not tested) | |||
Ozonoff et al. (2000) | N: HFA = 23, ASP = 12,TD = 27 | ED shift | ASP < TD for ED shift |
Age:HFA = 13.3 (3.9), ASP = 13.9 (4.5),TD = 12.5 (3.2) | HFA = TD for ED shift | ||
IQ: HFA = 108.9 (13.8), ASP = 115.6 (15.6),TD = 111.0 (10.6) | |||
Ozonoff et al. (2004) | N: ASD = 79,TD = 70 | ED shift, ED reversal | ASD < TD for ED shift and ED reversal shift |
Age: ASD = 15.7 (8.7),TD = 16.0 (7.6) | |||
FSIQ: ASD = 106.3 (16.3),TD = 106.0 (11.5) | |||
Edgin and Pennington (2005) | N: ASD = 24,TD = 34 | ED shift | HFA = TD for ED shift |
Age: ASD = 11.5 (2.32),TD = 12.0 (2.52) | |||
Goldberg et al. (2005) | N: HFA = 17, ADHD = 21,TD = 32 | ED shift | HFA = ADHD = TD for ED shift |
Age: HFA = 10.3 (1.8), ADHD = 9.8 (1.3),TD = 10.4 (1.5) | |||
FSIQ: HFA = 96.5 (15.9), ADHD = 113.8 (10.3),TD = 112.6 (12.1) | |||
Landa and Goldberg (2005) | N: HFA = 19,TD = 19 | ED shift | HFA = TD for ED shift |
Age: HFA = 11.01 (2.89),TD = 11.00 (2.85) | |||
FSIQ: HFA = 109.7 (15.8),TD = 113.4 (14.3) | |||
Happé et al. (2006) | N: ASD = 29, ADHD = 28,TD = 31 | ED shift | HFA = ADHD = TD for ED shift |
Age: ASD = 10.9 (2.4), ADHD = 11.6 (1.7),TD = 11.2 (2.0) | |||
FSIQ: ASD = 99.7 (18.7), ADHD = 99.1 (17.7),TD = 106.8 (13.4) |
ASD = autism spectrum disorder, ID = intellectual disability,TD = typically developing, HFA = high-functioning autism, ASP = Asperger syndrome, ADHD = attention deficit/hyperactivity disorder. Means, and standard deviations in parentheses, are reported for age and full-scale IQ (FSIQ) when available. For Hughes and colleagues (1994) standard deviation for all groups and VMA scores for the younger typically developing controls was not reported.
Several of these studies examined more stages, but we highlight the ED shift and ED reversal shift performance, because of the relevance for the current article.
The current study attempts to address this gap in primary school age children (6–13 years) by probing both ED shifting and ED reversal shifting in high-functioning children with ASDs and typically developing (TD) controls matched on age, gender ratio, and IQ. We focus on higher-functioning individuals because ASD-specific difficulties are best observed in individuals whose deficient performance is not confounded with general cognitive impairments (arguments made by Hill and Bird, 2006). In light of previous work with smaller samples in our age range we predict group differences in errors, but not in the number of stages completed (Goldberg et al., 2005; Landa and Goldberg, 2005). Consistent with this hypothesis, Luciana and Nelson (2002) report a lack of sensitivity of the stage success criterion beyond 9 years of age. Given conflicting evidence regarding increased errors during the ED shifting stage, we constrain our hypothesis to an expectation of increased errors in the ASD group on the ED reversal stage, as reported by Ozonoff and colleagues (2004). In addition, in line with recent evidence that shifting relates to restricted interests/repetitive behaviors (Lopez et al., 2005; South et al., 2007), we predict a positive relationship between the number of errors committed during these two stages and restricted interest/repetitive behavior symptoms in the ASD group.
Method
Participants
Autism spectrum disorders (ASDs)
Forty-two children with ASDs (35 with high-functioning autism and seven with pervasive developmental disorder not otherwise specified) were recruited for this study through a hospital clinic specializing in ASDs and neuropsychological assessment. Specific diagnoses were informed by diagnostic testing outlined below and made by experienced clinicians using DSM-IV-TR criteria (American Psychiatric Association, 2000) in combination with criteria outlined by the Collaborative Programs of Excellence in Autism (CPEA: Lainhart et al., 2006).The ASD diagnostic subgroups did not differ significantly from one another on demographic characteristics (age, IQ, and gender) or ID/ED performance (stages completed, mean errors across stages; data not shown). To increase power they were collapsed into an omnibus ASD group. One child was prescribed psychostimulant medication (methylphenidate) at the time of the study, but the parents withheld medication 24 hours prior to testing; one other child was on other psychotropic medications that were not discontinued (sertraline, mirtazapine, atomoxetine). All children but one (with a comorbid diagnosis of tic disorder not otherwise specified) in the ASD group had a history free from comorbid neurological disorders. Inclusion of this child’s ID/ED data did not alter the pattern of results; therefore, these data were retained in all analyses. See Table 2 for descriptive characteristics and ASD versus TD comparisons.
Table 2.
Participant demographics and task performance by diagnosis
ASD | TD | |
---|---|---|
Chronological age (years): | ||
Mean (SD) | 10.19 (2.00) | 10.26 (2.08) |
Range | 6.61–13.66 | 6.10–14.37 |
Full-scale IQ:a | ||
Mean (SD) | 111.95 (18.04) | 113.18 (11.94) |
Range | 81–143 | 83–140 |
Gender (male:female) | 33:9 | 65:19 |
ADOS b | ||
Social & Communication score: | ||
Mean (SD) | 11.55 (4.34) | |
Range | 4–27 | |
ADI/ADI–R c | ||
Social total score: | ||
Mean (SD) | 18.82 (5.85) | |
Range | 1–27 | |
Communication total score: | ||
Mean (SD) | 16.50 (4.94) | |
Range | 2–24 | |
Repetitive behaviors total score: | ||
Mean (SD) | 7.42 (2.54) | |
Range | 1–12 | |
ID/ED | ||
Stages completed: | ||
Mean (SD) | 8.07 (0.89) | 8.17 (0.97) |
Stage 8 errors: | ||
Mean (SD) | 14.90 (10.29) | 13.88 (11.40) |
Stage 9 errors: | ||
Mean (SD) | 16.90 (11.81) | 12.07 (11.77) |
No significant differences between diagnostic groups on any characteristics (t and χ2 < 1, and p > 0.58).
IQ data unavailable for three children in the ASD group.
ADOS data unavailable for two children in the ASD group.
ADI–R data unavailable for four children in the ASD group.
Typically developing (TD) children
Eighty-four TD children were recruited from the community via advertisements and through studies at the National Institute of Mental Health (NIMH). Participants were screened and excluded if found to have developmental, learning, neurological, or psychiatric disorders as well as psychiatric medication usage.
Measures
Diagnoses in the ASD group were confirmed with the Autism Diagnostic Observation Schedule (ADOS–G: Lord et al., 2000) and the Autism Diagnostic Interview (ADI: Le Couteur et al., 1989) or Autism Diagnostic Interview–Revised (ADI–R: Lord et al., 1994). Children enrolled in the TD group did not receive diagnostic measures, but were screened through a brief parent-completed interview and questionnaire. For both groups, a full-scale IQ score of at least 80 was required for study entry and was derived from testing on a Wechsler instrument: Wechsler Abbreviated Scale of Intelligence, Wechsler Intelligence Scale for Children - Third Edition, Wechsler Intelligence Scale for Children - Fourth Edition (Wechsler, 1991; 1999; 2003).
Experimental measure: Intradimensional/Extradimensional Shift Test
(Cambridge Cognition, 1996). In this task, four empty rectangular boxes appear on a computer screen, and each trial starts with two stimuli in separate opposing boxes (left–right or top–bottom).The stimuli are abstract unfamiliar pink shapes or white line drawings. Children are instructed to select a stimulus and then induce a rule through computer feedback (‘correct’ displayed in green or ‘wrong’ displayed in red); after selecting correctly for six consecutive trials, the rule changes. Children must make six consecutive correct selections within 50 trials to successfully complete a stage, and the task ends when they fail a stage. The task has nine stages (see Figure 1). Stages 1–5 are discrimination stages which require the subject to distinguish between one of two shapes through trial and error learning, while ignoring distracting shapes. Stages 6 and 7 introduce ID shifting demands to apply the old rule to new stimuli. Specifically:
Stage 6 introduces new pink shapes and white lines but still requires the participant to maintain the same rule for selecting targets (always choose a pink shape).
Stage 7 introduces reversal shifting because the correct answer is now the previously irrelevant pink shape (pink shape that was ignored in stage 6).
Stage 8 and 9 require ED shifting because the subject must attend to a previously ignored feature of the stimulus. Specifically:
Stage 8 introduces new pink shapes and white lines again and requires the participant to now select the previously ignored dimension (a white line figure).
Stage 9 requires reversal shifting because the correct answer is now the previously irrelevant white line figure (white line figure that was ignored in stage 8).
Dependent measures include: (1) the number of stages completed, (2) the number of errors to criterion within a stage (hereafter referred to as errors), and (3) the total trials to criterion (errors + correct answers).
Procedure
All participants were tested in a laboratory setting within the context of two separate larger studies. Parental consent and participant assent were obtained prior to testing in accordance with the requirements of the IRB from the Children’s National Medical Center and the National Institute of Mental Health. Children received monetary compensation for their time.
Analysis
For the current analysis, we included the number of stages completed and errors for the ED and ED reversal stage; trials to criterion were not included for either stage because this measure is fairly redundant with errors to criterion. The trials-to-criterion variable provides information on whether children break cognitive set (i.e. change rules without negative feedback). Previous set-shifting findings suggest that individuals with ASD, regardless of functioning level, are more likely to perseverate than break cognitive set (Pennington and Ozonoff, 1996).
Stages completed
We first examined stage completion in an independent groups t-test and non-parametrically in stage completion (pass; fail) by group (ASD;TD) χ2 analysis for stages 8 and 9 to investigate overall set-shifting success. Previous studies have employed parametric analyses to document group differences (Goldberg et al., 2005; Luciana and Nelson, 2002); however, we also conducted a non-parametric analysis because of the discontinuous nature of the dependent variable. For all t-tests, a Welch t-test was used to correct for the unequal sample sizes between the two diagnostic groups.
Stage errors
We next examined the number of errors by group (2) and stage (2) with a repeated measures multivariate analysis of variance (RMANOVA). We focused on stages 8 and 9 which require ED shifting and ED reversal shifting, respectively. When children did not attempt a stage, they were assigned 25 errors as per the CANTAB manual (Cambridge Cognition, 1996).
Subset analysis
We re-examined stage errors only among children who attempted all nine stages. This subset analysis excluded children who received a substitution score of 25 errors (chance performance) by not attempting or reaching stage 9. It is unknown whether children who fail to reach stage 9 would perform at chance or perform worse than chance by applying a previously reinforced rule. The final subset of 78 children (27 ASD; 51 TD controls) maintained matching on IQ (t(75) = 1.18, p = 0.24), age (t(76) = 0.86, p = 0.39), and gender ratio (χ2(2, N = 78) = 1.19, p = 0.28) that was observed in the full sample. For all t-tests, a Welch t-test was used to correct for the unequal sample sizes between the two diagnostic groups.
Correlation analysis
Substitution scores included for children not attempting a stage could increase variability and skew the distribution when conducting correlation analyses with symptoms from the ADI/ADI–R. Therefore, we conducted our correlation analyses on the subset of children with ASD that attempted all nine stages. Data from the ADI/ADI–R were used in the correlation analyses with ID/ED performance as the ADOS provides a narrow window (30–45 minute child interview) in which to observe symptoms while the ADI/ADI–R covers the child’s lifetime. We conducted both Pearson’s r and Spearman’s rho correlations to examine relationships with symptom scores from the ADI/ADI–R because these scores have not been established as continuous measures of symptom severity (Sears et al., 1999).
Results
Full sample analyses
The ASD and TD groups did not differ in stages completed, t(88.11) = 0.55, p = 0.59 (see Table 2 for stages completed and stage errors). The χ2 analyses revealed no group differences in number of children completing stage 8 (χ2(2, N = 126) = 0.15, p = 0.70) or stage 9 (χ2(2, N = 126) = 1.92, p = 0.17).Twenty-seven of 42 children in the ASD group and 51/84 children in the TD group passed stage 8; 18/42 children in the ASD group and 47/84 children in the TD group passed stage 9. The group by stage RMANOVA on errors to criterion did not show a main effect of group (F(1, 124) = 2.02, p = 0.16). However, the analysis revealed a significant stage by group interaction (F(1, 125) = 9.08, p < 0.005). Follow-up t-tests revealed that children in the ASD group made significantly more errors than children in the TD group during stage 9 (t(124) = 2.17, p < 0.05) but not during stage 8 (t(124) = 0.49, p = 0.63) (see Figure 2).
Figure 2.
Errors by the ASD and TD groups on stages 8 and 9.The ASD group made significantly more errors on stage 9
Subset analyses
The group by stage RMANOVA on errors to criterion on the subset of 78 children yielded a significant main effect of group (F(1, 76) = 13.77, p < 0.001), with children in the ASD group making significantly more errors than children in the TD group. Furthermore, the analysis also revealed a significant stage by group interaction (F(1, 76) = 10.64, p < 0.005). Follow up t-tests again showed that children with ASD made significantly more errors in stage 9 than children in the TD group (t(34.14) = 3.31, p < 0.01) and a trend in this direction in stage 8 (t(49.92) = 1.82, p = 0.07) (see Figure 3).
Figure 3.
Errors by the subset of children from the ASD and TD groups who attempted all nine stages of the ID/ED test. This subset ASD group made significantly more errors during stage 9 than the subset TD group, and trended toward more errors during stage 8
Correlation analysis between ID/ED performance and ADI/ADI–R symptoms
Correlation analyses revealed significant relationships between the ADI/ADI–R restricted interest/repetitive behavior symptom domain and ID/ED performance on stage 9, but not on stage 8 (see Table 3). This finding was significant using both Pearson’s r and Spearman’s rho correlations. Social and communication domain scores from the ADI/ADI–R were not significantly associated with either stage 8 or stage 9 ID/ED performance.
Table 3.
Pearson’s r and Spearman’s rho correlations between ID/ED stage 9 performance and ADI/ADI–R symptom domains
Stage | Social | Communication | RIRB |
---|---|---|---|
Stage 8: | |||
r | 0.19 | 0.26 | 0.30 |
rho | 0.19 | 0.19 | 0.25 |
Stage 9: | |||
r | 0.16 | 0.20 | 0.43* |
rho | 0.27 | 0.30 | 0.44* |
p < 0.05.
Because IQ has been significantly related to restricted interests/repetitive behavior symptoms (Gabriels et al., 2005),we partialled full-scale IQ from the correlation, and the relationship was weakened but trending toward significance, r(n = 25) = 0.37, p = 0.08.
Discussion
This study probed set-shifting abilities in high-functioning children with ASD by assessing both stage completion and errors on the ID/ED shift test. Consistent with previous reports, children with ASD completed as many stages as TD children; however, children with ASD made significantly more errors than TD children during the ED reversal stage.We did not observe group differences in the number of errors made during the ED shift stage. We also examined errors within a large subset of children who at least attempted all nine stages. This subset analysis was consistent with the full sample analysis in that children with ASD made significantly more errors during the ED reversal stage than did TD controls. Correlation analyses revealed a significant positive relationship between restricted interest/repetitive behavior symptoms on the ADI/ADI–R and errors completed during ED reversal shifting, but not during ED shifting.
The current investigation not only documents ED reversal shifting deficits but also, for the first time, links these deficits with restricted interest/repetitive behavior symptoms among high-functioning children with ASD. Our finding of an ED reversal shifting deficit for high-functioning children in the full and subset analyses supports the two previous studies which have reported on ED reversal shifting in ASD. The present study extends findings from a study of low-functioning children with ASDs (Hughes et al., 1994) and a study including a combined group of children and adults with high-functioning ASDs (Ozonoff et al., 2004). Our findings are consistent with, and expand on, previous investigations of high-functioning primary school age children with ASD, which reported intact ED shifting but did not report on ED reversal shift performance.
ED reversal involves reversing a valence assignment, switching the reward value from positive to negative for a stimulus, and the orbitofrontal cortex plays a key role in stimulus–reward assignments (Loveland et al., 2008). Associating a stimulus and reward within a social interaction (i.e. reward is meted out by a person) is impaired in young children with ASDs (Dawson et al., 2002). Loveland and colleagues reduced the level of social demands and still reported reversal deficits in primary school aged children (Loveland et al., 2008). The present findings extend this line of investigation by demonstrating ED reversal deficits in a computerized task that has no social demands, suggesting that the orbitofrontal-limbic network may also underlie non-social reversal learning deficits.
The correlation between ED reversal errors and restricted interest/repetitive behavior symptoms highlights the utility of reversal set-shifting as a potential intermediate phenotype for ASDs. As discussed above, intermediate cognitive phenotypes serve as a link between behavioral symptoms and brain and genetic assays. In line with past studies, the present findings confirm the relationship between set-shifting difficulties and restricted interest/repetitive behavior symptoms in children with ASDs (Kenworthy et al., 2008; Lopez et al., 2005; South et al., 2007). Further investigation of ED reversal shifts might include other groups of children with developmental disorders, however, in order to determine the specificity of these findings to ASDs alone. In addition, it would be important to investigate whether this relationship occurs across all ages and functioning levels of individuals with ASDs. Previous studies investigating ED reversal shifts did not investigate the relationship between ED reversal shifting performance and ASD symptoms (Hughes et al., 1994; Ozonoff et al., 2004).
One puzzling aspect of the current findings is the relatively unimpaired ED shifting but deficient ED reversal shifting in our high-functioning ASD group. Past studies of individuals with ASDs of similar ages and functioning levels also report successful ED shifting (Edgin and Pennington, 2005; Goldberg et al., 2005; Happé et al., 2006; Landa and Goldberg, 2005), but the one study probing ED reversal shifting found deficits in both ED shifting and ED reversal shifting (Ozonoff et al., 2004). Two potential interacting confounds may explain this apparent discrepancy of findings: (1) the inclusion of a substitution score of 25 errors for stages not attempted, and (2) the age groups tested in previous studies. The substitution score inflates variance and this may obscure group differences of modest effect size in the ED shift stage. Studies reporting no ED shifting deficits for ASD groups tested mostly primary school aged samples. Primary school aged samples may require a higher number of substitution scores for both ASD and TD groups during the ED shift stage than an older, particularly TD, sample. This discrepancy in the utilization of substitution scores may lead to reduced variability in the older sample which increases the power to detect differences of moderate effect size.
While the present study provides novel insights into the set-shifting abilities of high-functioning children with ASDs, several unanswered questions remain for future investigations. Examination of the relationship between these deficits and restricted interest/repetitive behavior symptoms was coarse due to utilization of a summary score (i.e. the restricted interest/repetitive behavior symptoms scale from the ADI/ADI–R), and would be better investigated using a continuous measure, such as the Social Responsiveness Scale (Constantino and Gruber, 2005). Future investigations of ED reversal shift deficits may also elect to segregate this behavioral symptom construct and probe whether ED reversal shifting deficits relate to higher-order cognitive rigidity, reflected in resistance to change, insistence on sameness, and rituals, or to lower-order repetitive and sensory behaviors, reflected in stereotypies and self-stimulation. Additionally, the high average IQ of our ASD group may limit generalizing the current results to lower-functioning children with ASDs.
Strengths of the study include the large, well-characterized ASD sample within a narrow age range, which provided adequate power to detect group differences and significant correlations. Children with ASDs were well matched group-wise (with a two-to-one ratio) for age, IQ, and gender ratio; this matching was sustained on the subset analysis. The current investigation also presents ID/ED data on the largest exclusively pediatric ASD sample published to date (n = 42), which allowed matching the ASD and TD groups on performance. While the correlation analysis was conducted on a subset of the total sample (n = 27), raising issues of power or sample stability, this sample size was equal to or larger than full samples reported earlier (Edgin and Pennington, 2005; Goldberg et al., 2005; Landa and Goldberg, 2005). Furthermore, the significant correlation observed between the number of ED reversal shift errors and restricted interest/repetitive behavior symptoms was robust and immune to the influence of outliers because we used non-parametric (Spearman’s rho) correlations. Thus, we avoided limitations of previous investigations by recruiting a large group of high-functioning children with ASDs over a narrow age range when dynamic developmental gains in set-shifting skills are observed (Luciana and Nelson, 2002), and by examining group differences in performance on both the ED shift and ED reversal shift tasks.
The present study documents inefficient ED reversal shifting among high-functioning children with ASDs, and reinforces the utility of the ID/ED test in parsing specific components of set-shifting difficulty among individuals with ASD. Furthermore, the current investigation establishes a link between ED reversal shifting and restricted interest/repetitive behavior symptoms used to diagnose ASDs. This finding strengthens the case for utilizing set-shifting as a potential intermediate phenotype for informing gene–brain–behavior models of ASDs.
Acknowledgements
We thank the Frederick and Elizabeth Singer Foundation, the Studies for the Advancement of Autism Research and Treatment (STAART: NIMH U54 MH066417), and the NIMH Intramural Research Program (IRP) for supporting data collection. We also thank the Intellectual and Developmental Disabilities Research Center at Children’s National Medical Center (NIH IDDRC P30HD40677) for supplementary support. A T-32 postdoctoral fellowship through the IDDRC (NIH T32HD046388) supported BEY and the NIMH IRP supported GLW, MJC and JNG. Thanks to Dr Laura Anthony for comments on an earlier draft. Finally, we thank the children and families that offered their time and energy for the current study.
Footnotes
Contributor Information
Benjamin E. Yerys, Children’s National Medical Center, USA
Gregory L. Wallace, National Institute of Mental Health, USA
Bryan Harrison, Children’s National Medical Center, USA.
Mark J. Celano, National Institute of Mental Health, USA
Jay N. Giedd, National Institute of Mental Health, USA
Lauren E. Kenworthy, Children’s National Medical Center, USA
References
- American Psychiatric Association. Diagnostic Statistical Manual of Mental Disorders. Washington, DC: APA; 2000. 4th edn text rev. (DSM-IV-TR) [Google Scholar]
- Cambridge Cognition. CANTAB. Cambridge: Cambridge Cognition Ltd; 1996. [Google Scholar]
- Carper RA, Courchesne E. Localized Enlargement of the Frontal Cortex in Early Autism. Biological Psychiatry. 2005;57:126–133. doi: 10.1016/j.biopsych.2004.11.005. [DOI] [PubMed] [Google Scholar]
- Constantino JN, Gruber CP. Social Responsiveness Scale. Los Angeles, CA: Western Psychological Services; 2005. [Google Scholar]
- Dawson G, Munson J, Estes A, Osterling J, McPartland J, et al. Neurocognitive Function and Joint Attention Ability in Young Children with Autism Spectrum Disorder versus Developmental Delay. Child Development. 2002;73:345–358. doi: 10.1111/1467-8624.00411. [DOI] [PubMed] [Google Scholar]
- Dias R, Robbins TW, Roberts AC. Dissociation in Prefrontal Cortex of Attentional and Affective Shifts. Nature. 1996;380:69–72. doi: 10.1038/380069a0. [DOI] [PubMed] [Google Scholar]
- Edgin JO, Pennington BF. Spatial Cognition in Autism Spectrum Disorders: Superior, Impaired, or Just Intact? Journal of Autism and Developmental Disorders. 2005;35:729–744. doi: 10.1007/s10803-005-0020-y. [DOI] [PubMed] [Google Scholar]
- Gabriels RL, Cuccaro ML, Hill DE, Ivers BJ, Goldson E. Repetitive Behaviors in Autism: Relationships with Associated Clinical Features. Research in Developmental Disabilities. 2005;26:169–181. doi: 10.1016/j.ridd.2004.05.003. [DOI] [PubMed] [Google Scholar]
- Gioia GA, Isquith PK, Kenworthy L, Barton RM. Profiles of Everyday Executive Function in Acquired and Developmental Disorders. Child Neuropsychology. 2002;8:121–137. doi: 10.1076/chin.8.2.121.8727. [DOI] [PubMed] [Google Scholar]
- Girgis RR, Minshew NJ, Melhem NM, Nutche JJ, Keshavan MS, et al. Volumetric Alterations of the Orbitofrontal Cortex in Autism. Progress in Neuro-Psychopharmacology & Biological Psychiatry. 2007;31:41–45. doi: 10.1016/j.pnpbp.2006.06.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goldberg MC, Mostofsky SH, Cutting LE, Mahone EM, Astor BC, et al. Subtle Executive Impairments in Children with Autism and Children with ADHD. Journal of Autism and Developmental Disorders. 2005;35:279–293. doi: 10.1007/s10803-005-3291-4. [DOI] [PubMed] [Google Scholar]
- Gottesman II, Gould TD. The Endophenotype Concept in Psychiatry: Etymology and Strategic Intentions. American Journal of Psychiatry. 2003;160:636–645. doi: 10.1176/appi.ajp.160.4.636. [DOI] [PubMed] [Google Scholar]
- Happé F, Booth R, Charlton R, Hughes C. Executive Function Deficits in Autism Spectrum Disorders and Attention-Deficit/Hyperactivity Disorder: Examining Profiles across Domains and Ages. Brain and Cognition. 2006;61:25–39. doi: 10.1016/j.bandc.2006.03.004. [DOI] [PubMed] [Google Scholar]
- Hill EL. Evaluating the Theory of Executive Dysfunction in Autism. Developmental Review. 2004;24:189–233. [Google Scholar]
- Hill EL, Bird CM. Executive Process in Asperger Syndrome: Patterns of Performance in Multiple Case Series. Neuropsychologia. 2006;44:2822–2835. doi: 10.1016/j.neuropsychologia.2006.06.007. [DOI] [PubMed] [Google Scholar]
- Hughes C, Russell J, Robbins TW. Evidence for Executive Dysfunction in Autism. Neuropsychologia. 1994;32:477–492. doi: 10.1016/0028-3932(94)90092-2. [DOI] [PubMed] [Google Scholar]
- Kenworthy L, Black DO, Harrison B, Della Rosa A, Wallace GL. Are Executive Control Functions Related to Autism Symptoms in High Functioning Children? Child Neuropsychology. 2009;27:1–16. doi: 10.1080/09297040802646983. [DOI] [PubMed] [Google Scholar]
- Lainhart JE, Bigler ED, Bocian M, Coon H, Dinh E, et al. Head Circumference and Height in Autism: A Study by the Collaborative Program for Excellence in Autism. American Journal of Medical Genetics: Part A. 2006;140A:2257–2274. doi: 10.1002/ajmg.a.31465. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Landa RJ, Goldberg MC. Language, Social, and Executive Functions in High-Functioning Autism: A Continuum of Performance. Journal of Autism and Developmental Disorders. 2005;35:557–573. doi: 10.1007/s10803-005-0001-1. [DOI] [PubMed] [Google Scholar]
- Le Couteur A, Rutter M, Lord C, Rios P, Robertson S, et al. Autism Diagnostic Interview: A Standardized Investigator-Based Instrument. Journal of Autism and Developmental Disorders. 1989;19:363–387. doi: 10.1007/BF02212936. [DOI] [PubMed] [Google Scholar]
- Liss M, Fein D, Allen D, Dunn M, Feinstein C, et al. Executive Functioning in High-Functioning Children with Autism. Journal of Child Psychology and Psychiatry. 2001;42:261–270. [PubMed] [Google Scholar]
- Lopez BR, Lincoln AJ, Ozonoff S, Lai Z. Examining the Relationship Between Executive Functions and Restricted, Repetitive Symptoms of Autistic Disorder. Journal of Autism and Developmental Disorders. 2005;35:445–460. doi: 10.1007/s10803-005-5035-x. [DOI] [PubMed] [Google Scholar]
- Lord C, Rutter M, Le Couteur A. Autism Diagnostic Interview–Revised: A Revised Version of a Diagnostic Interview for Caregivers of Individuals with Possible Pervasive Developmental Disorders. Journal of Autism and Developmental Disorders. 1994;24:659–685. doi: 10.1007/BF02172145. [DOI] [PubMed] [Google Scholar]
- Lord C, Risi S, Lambrecht L, Cook EH, Jr, Leventhal BL, et al. The Autism Diagnostic Observation Schedule–Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism. Journal of Autism and Developmental Disorders. 2000;30:205–223. [PubMed] [Google Scholar]
- Loveland KA, Bachevalier J, Pearson DA, Lane DM. Fronto-Limbic Functioning in Children and Adolescents with and without Autism. Neuropsychologia. 2008;46:49–62. doi: 10.1016/j.neuropsychologia.2007.08.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Luciana M, Nelson CA. Assessment of Neuropsychological Function through Use of the Cambridge Neuropsychological Testing Automated Battery: Performance in 4- to 12-Year-Old Children. Developmental Neuropsychology. 2002;22:595–624. doi: 10.1207/S15326942DN2203_3. [DOI] [PubMed] [Google Scholar]
- Ozonoff S. Reliability and Validity of the Wisconsin Card Sorting Test in Studies of Autism. Neuropsychology. 1995;9:491–500. [Google Scholar]
- Ozonoff S, South M, Miller JN. DSM-IV-Defined Asperger Syndrome: Cognitive, Behavioral, and Early History Differentiation from High-Functioning Autism. Autism. 2000;4:29–46. [Google Scholar]
- Ozonoff S, Cook I, Coon H, Dawson G, Joseph RM, et al. Performance on Cambridge Neuropsychological Test Automated Battery Subtests Sensitive to Frontal Lobe Function in People with Autistic Disorder: Evidence from the Collaborative Programs of Excellence in Autism. Journal of Autism and Developmental Disorders. 2004;34:139–150. doi: 10.1023/b:jadd.0000022605.81989.cc. [DOI] [PubMed] [Google Scholar]
- Pennington BF, Ozonoff S. Executive Functions and Developmental Psychopathologies. Journal of Child Psychology & Psychiatry. 1996;37:51–87. doi: 10.1111/j.1469-7610.1996.tb01380.x. [DOI] [PubMed] [Google Scholar]
- Sears LL, Vest C, Mohamed S, Bailey J, Ranson BJ, et al. An MRI Study of the Basal Ganglia in Autism. Progress in Neuro-Psychopharmacology & Biological Psychiatry. 1999;23:613–624. doi: 10.1016/s0278-5846(99)00020-2. [DOI] [PubMed] [Google Scholar]
- Shafritz KM, Dichter GS, Baranek GT, Belger A. The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism. Biological Psychiatry. 2008;63:974–980. doi: 10.1016/j.biopsych.2007.06.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- South M, Ozonoff S, McMahon WM. The Relationship between Executive Functioning, Central Coherence, and Repetitive Behaviors in the High-Functioning Autism Spectrum. Autism. 2007;11:437–451. doi: 10.1177/1362361307079606. [DOI] [PubMed] [Google Scholar]
- Wechsler D. Wechsler Scales of Intelligence–Third Edition. San Antonio, TX: Psychological Corporation; 1991. [Google Scholar]
- Wechsler D. Wechsler Abbreviated Scales of Intelligence. San Antonio, TX: Psychological Corporation; 1999. [Google Scholar]
- Wechsler D. Wechsler Scales of Intelligence–Fourth Edition. San Antonio, TX: Psychological Corporation; 2003. [Google Scholar]