Abstract
The major symptoms of Tourette syndrome are motor and vocal tics, but Tourette syndrome is occasionally associated with cognitive alterations as well. Although Tourette syndrome does not affect the majority of cognitive functions, some of them improve. There is scarce evidence on the impairment of learning functions in patients with Tourette syndrome. The core symptoms of Tourette syndrome are related to dysfunction of the basal ganglia and the frontostriatal loops. Acquired equivalence learning is a kind of associative learning that is related to the basal ganglia and the hippocampi. The modified Rutgers Acquired Equivalence Test was used in the present study to observe the associative learning function of patients with Tourette syndrome. The cognitive learning task can be divided into two main phases: the acquisition and test phases. The latter is further divided into two parts: retrieval and generalization. The acquisition phase of the associative learning test, which mainly depends on the function of the basal ganglia, was affected in the entire patient group, which included patients with Tourette syndrome with attention deficit hyperactivity disorder, obsessive compulsive disorder, autism spectrum disorder, or no comorbidities. Patients with Tourette syndrome performed worse in building associations. However, the retrieval and generalization parts of the test phase, which primarily depend on the function of the hippocampus, were not worsened by Tourette syndrome.
Introduction
Tourette syndrome (TS) is a disorder that presents before the age of 18 years, affecting 1% of school-aged children [1–4]. The most frequent symptoms are motor and vocal tics [1, 5], which significantly improve in many patients by young adulthood [6]. In addition to these primary symptoms, pure Tourette syndrome is associated with some mild alterations in cognitive functions, mainly in a few executive functions (i.e., verbal fluency, working memory, and Stroop effect), which extend into adulthood [7–9], and others, which disappear with age (i.e., deficits demonstrated by the Wisconsin Card Sorting Test [10]).
The symptoms of Tourette syndrome are mainly related to dysfunction of the basal ganglia and the connected frontal lobe [11, 12]. Reduced left caudate nucleus volume [13], prefrontal hypertrophy, and structural changes have been described in Tourette syndrome [14–16]. The connection between the frontal lobe and the basal ganglia via parallel and overlapping frontostriatal circuits [5, 12, 17–22] is significantly weaker in Tourette syndrome [23].
This frontostriatal system is responsible for motor functions and several cognitive functions [24]. However, significant impairment of cognitive functions has only been rarely described in patients with Tourette syndrome without any comorbidities [25], and the impairment often depends on the level of tic severity [26–28]. Most impairment has been reported in Tourette syndrome with its most frequent comorbidity, attention deficit hyperactivity disorder (ADHD) [29–31]. Previous studies have emphasized that most alterations of cognitive functions are primarily associated with concomitant ADHD and TS [32–36]. These results suggest that the cognitive performance of patients with TS + ADHD is more similar to that of patients with ADHD than that of patients with Tourette syndrome [33, 35, 37, 38]. Accordingly, Channon et al. did not find any impairment in explicit or implicit memory or learning processes in Tourette syndrome alone but did find these impairments in TS + ADHD [39]. In reinforcement learning, the results are conflicting, but most results show no difference between patients with Tourette syndrome and healthy controls [26, 40–43]. Patients with Tourette syndrome have intact motor sequence learning [44], but the procedural (habit) learning in a probabilistic classification learning, which is connected to the dorsal striatum [45] was significantly altered [46, 47]. However, hippocampus-related learning was not affected in patients with Tourette syndrome alone [47]. Another procedural learning type, implicit probabilistic sequence learning, was not affected or was even better in patients with Tourette syndrome [48, 49]. These learning functions function via frontostriatal loops as well as associative learning, which has not yet been investigated for Tourette syndrome.
Associative learning, in which discrete and often different signals are linked together, is a type of conditioning. For example, when we remember a face, we record all the facial features, and the parts reinforce each other. This basic cognitive function is related to basal ganglia and hippocampus functions. The Rutgers Acquired Equivalence Test [35] investigates this specific learning ability. The primary advantage of this test is that each phase of the paradigm has well-described neural substrates. The acquisition phase, which primarily depends on the function of the basal ganglia [35, 50], tests the association of two different visual stimuli with the help of feedback about the correctness of the responses. In the test phase, which primarily depends on the function of the hippocampus and the mediotemporal lobe [35, 50], the previously learned associations are presented without any feedback (retrieval part), and previously not presented but predictable associations (generalization part) are shown. This learning function was previously investigated in adult patients with Parkinson’s disease, Alzheimer’s disease, schizophrenia, and migraine without aura [35, 51–53] but never in children with neurological or psychiatric disorders compared with healthy controls. Thus, the description of this learning ability in Tourette syndrome remains missing. Since Tourette syndrome is related to dysfunction of the basal ganglia and the frontostriatal loops, we hypothesized that the acquisition phase could be primarily affected in the Acquired Equivalence Test. Thus, the primary aim of the present study was to determine whether visually guided associative acquired equivalence learning is affected in children with Tourette syndrome. We also investigated whether similar to other cognitive deficits of patients with Tourette syndrome the ADHD is the primary reason for reduced associative learning ability in patients with Tourette syndrome.
Methods
Participants
Altogether, 46 children with Tourette syndrome participated in the present research. The children were recruited from Vadaskert Child Psychiatry Hospital in Budapest, Hungary. The children were diagnosed by both a licensed clinical psychologist and a board-certified child psychiatrist at the hospital according to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-V) criteria [1]. A total of 21 patients were diagnosed with Tourette syndrome without any other neurological or psychiatric comorbidities (TS group); 15 were diagnosed with Tourette syndrome and comorbid ADHD (TS + ADHD group); and 10 were diagnosed with Tourette syndrome and some other comorbidity (obsessive compulsive disorder [OCD] or autism spectrum disorder [ASD]; TS + OCD/ASD group). In this study, we analyzed associative learning of patients in the TS, TS + ADHD, and TS + OCD/ASD groups in detail (32 boys and 14 girls, mean age: 11.64±2.38 years, age range: 8–17 years). Children with other neurodevelopmental or psychiatric comorbidities or learning disabilities were excluded. The mean Yale Global Tic Severity Scale (YGTSS) total tic score (TTS) was 20.7±6.4 (range: 8–33) [5, 54] in the whole patient group. Two participants showed minimal tic severity (TTS ≤ 10); 17 showed mild tic severity (score 11–20); and 19 showed moderate to severe tic severity (score > 20). There were no significant differences (Kruskal–Wallis ANOVA, p>0.05) among the patient subgroups according to age, IQ level, and tic severity. Twelve of the children involved in this study (3 from the TS group, 6 from the TS + ADHD group, and 3 from the TS + OCD/ASD group) were medicated because of the symptoms of their disorder. The TS group received dopamine 2 receptor antagonists (haloperidol and risperidone). The TS + ADHD patients received a norepinephrine–dopamine reuptake inhibitor (methylphenidate), a dopamine 2 receptor antagonist (haloperidol), or a partial agonist of the dopamine 2 and serotonin 1A receptors (aripiprazole), a norepinephrine transporter and dopamine reuptake inhibitor (atomoxetine), or melatonin. The TS + OCD/ASD group received selective serotonin reuptake inhibitors (fluvoxamine and sertraline), a partial agonist of the dopamine 2 and serotonin 1A receptors (aripiprazole), a serotonin and dopamine antagonist (risperidone), or a norepinephrine-dopamine reuptake inhibitor (methylphenidate).
The parents of all participants signed an informed consent form and did not receive financial compensation for their participation. The protocol of the study conformed to the tenets of the Declaration of Helsinki in all respects, and it was approved by the Ministry of Human Capacities in Budapest, Hungary (11818-6/2017/EÜIG).
From our database of control children recruited from local schools, 46 control children (31 boys and 15 girls, mean age: 11.55±2.38 years, range: 8–17.5 years) were assorted and individually matched based on sex, age (differing in age by no more than six months), and IQ level to the patient groups. There were no significant differences (Kruskal–Wallis ANOVA, p>0.05) among the control subgroups according to age and IQ level. Table 1 shows the demographic data for the patient and control groups.
Table 1. Demographic parameters of the investigated groups.
Group | Number of cases | Male | Age, mean ± SD (years) | Age, range (years) |
---|---|---|---|---|
All patients | 46 | 32 | 11.64±2.38 | 8–17 |
All controls | 46 | 31 | 11.55±2.38 | 8–17.5 |
TS | 21 | 14 | 11.74±2.26 | 9–17 |
TS controls | 21 | 13 | 11.50±2.30 | 9–17 |
TS + ADHD | 15 | 12 | 11.20±2.10 | 9–16.5 |
TS + ADHD controls | 15 | 12 | 11.27±2.12 | 9–16 |
TS + OCD/ASD | 10 | 6 | 12.10±2.84 | 8–17 |
TS + OCD/ASD controls | 10 | 6 | 12.05±2.88 | 8–17.5 |
TS: Tourette syndrome, ADHD: attention deficit hyperactivity disorder, OCD/ASD: obsessive compulsive disorder or autism spectrum disorder.
The control group only included children without any known psychiatric, neurological, or neurodevelopmental disorders. All participants (patients and controls) had normal or corrected-to-normal vision and normal hearing. The intactness of color vision was tested by Ishihara plates prior to testing to exclude color blindness [55] both in the patient and control groups. Only patients and controls with normal color vision were analyzed in the present study. We estimated the IQ level with Raven’s Standard [56] and Colored [57] Progressive Matrices [58].
Visually guided associative learning paradigm
The principle of the visual learning paradigm is based on the Rutgers Acquired Equivalence Test [35]. The original visual associative learning test [35] written for iOS (Apple Inc.’s operating system) was slightly modified, translated to Hungarian, and rewritten in Assembly (for Windows) with the written permission of Prof. Catherine E. Myers (Rutgers University, NJ, USA). The test was run on a PC. The testing sessions occurred in a dark and quiet room with the participants sitting at a standard distance (114 cm) from the computer screen with comfortable visibility and legible brightness. The participants were asked to learn associations between antecedent stimuli (four faces: A1, A2, B1, and B2) and consequent stimuli (four fish with different colors: X1, X2, Y1, and Y2). The four possible faces were a male adult, a male child, a female adult, and a female child. The four colors were red, green, blue, and yellow. The antecedent-consequent pairings were randomly generated by the computer from these stimuli for each participant. The acquired equivalence paradigm was structured as follows (Fig 1).
Acquisition phase
During each trial of the task, participants saw a face and a pair of fish and had to learn through trial and error which of the fish matched which face. In the initial training stages, participants were expected to learn that when face A1 or A2 appears, the correct choice is fish X1 over fish Y1; when face B1 or B2 appears, the correct choice is fish Y1 over fish X1. If the associations are successfully learned, participants also learn that faces A1 and A2 are equivalent with respect to the associated fish (faces B1 and B2 are likewise equivalent with respect to the associated fish). Next, participants learned a new set of pairs: if presented with face A1, they had to choose fish X2 over Y2, and in the case of face B1, fish Y2 over X2. Altogether, six stimulus combinations were shown in the acquisition phase of the paradigm in which the computer provided feedback about the success of the acquisition after each trial. New associations were individually introduced during the acquisition stages. New associations were mixed with trials of previously learned associations. The participants had to achieve a certain number of consecutive correct responses after the presentation of each new association (4 after the presentation of the first association, and 4, 6, 8, 10, and 12 with the introduction of each new association, respectively) to be allowed to proceed. The number of trials in the acquisition phase was not constant. It depended on the performance of the participant in learning the associations.
Test phase (retrieval and generalization parts)
After successful acquisition, the participant continued with the test phase of the paradigm, in which no more feedback was provided about the correctness of the choices. The participant had to recall the six previously built associations (retrieval part) and had to make two new but predictable associations (generalization part). In the generalization part of the test, the participant was asked to choose fish X2 or Y2 when face A2 or B2 was presented. Having learned that faces A1 and A2 were equivalent in the acquisition phase, participants may generalize from learning that if A1 goes with X2, A2 also goes with X2; the same holds for B2 (equivalent to B1) and Y2 (associated with B1). In the test phase, the new associations were mixed with the previously learned associations. The test phase consistently contained 48 trials, including 36 previously built associations (retrieval part) and 12 new, previously not presented but predictable associations (generalization part). The participants’ task throughout the acquisition and testing phases was to indicate their choice in each trial by pressing one of two keyboard buttons labeled LEFT and RIGHT.
Participants were tested individually without a time limit, so they could pay undivided attention to learning. No forced quick responses were expected. While the formal description may imply that the task was difficult, healthy children and intellectually disabled individuals reliably make these kinds of generalizations.
Data analysis
The number of trials in the acquisition phase and the response accuracy (error ratios) in the acquisition phase, the retrieval part of the test phase, and the generalization part of the test phase were analyzed. We registered the number of trials required to complete the acquisition phase (the number of acquisition trials [NAT]), the number of correct and incorrect choices during the acquisition phase, and the number of correct and incorrect responses for known and unknown associations during the retrieval and generalization parts of the test phase. Using these data, the error ratios were calculated by dividing the number of incorrect responses by the total number of responses provided. The proportion of the number of incorrect responses in the acquisition phase (the acquisition learning error ratio [ALER]), the number of incorrect responses divided by the total number of responses [36] in the retrieval part of the test phase (i.e., the retrieval error ratio [RER]), and the number of incorrect responses divided by the total number of responses [12] in the generalization part of the test phase (the generalization error ratio [GER]) were measured.
Statistical analysis
First, we tested the distribution of our data. If the data sets were not normally distributed according to the Shapiro–Wilk normality test, the comparisons between the performance of patients with Tourette syndrome and that of control children were performed with the Mann–Whitney rank test. A Kruskal–Wallis ANOVA was used to compare the performances of the TS, TS + ADHD, and TS + OCD/ASD groups and to compare the performances of the control subgroups, too. The median values and ranges are presented in the results section. If the data were normally distributed according to the Shapiro–Wilk test but the homogeneity of the variance test revealed different variance in the performances of patients with Tourette syndrome and that of healthy control children, Welch’s t-test was used to compare the two groups. The mean and SD values are presented in the results section. Statistical analyses were performed in Statistica 13.4.0.14 (1984–2018 TIBCO Software Inc., Palo Alto, CA, USA) and CogStat 1.8.0 and 1.9.0 (2012–2020 Attila Krajcsi).
Results
In this study, we present the performance of 46 pediatric patients with Tourette syndrome with and without comorbidities and 46 matched healthy control children. All of the participants completed the entire visually guided acquired equivalence learning paradigm.
The performances of the entire Tourette syndrome group with and without comorbidities versus healthy control children
In order to reduce the effect of multiple (twice in this case) application of the same data, the statistical results were evaluated after Bonferroni correction at a significance level of 0.025. The median NAT was 79.0 (range: 42–202, n = 46) in all patients with Tourette syndrome (with and without medication) and 62.0 (range: 46–124, n = 46) in the control group. The NAT values were significantly higher in patients with Tourette syndrome (Mann–Whitney rank test U = 636, p < 0.001). The median ALER was 0.102 (range: 0–0.325, n = 46) in all patients with Tourette syndrome and 0.085 (range: 0–0.186, n = 46) in the control group. The ALER values, similar to the NAT values, were significantly higher in patients with Tourette syndrome (Mann–Whitney rank test U = 690, p = 0.004). In the retrieval part of the test phase, there was no statistically significant difference (Mann–Whitney rank test U = 1.17e+0.3, p = 0.360) between the patients with Tourette syndrome (median: 0.056, range: 0–0.333, n = 46) and the control group (median: 0.083, range: 0–0.472, n = 46). In the generalization part of the test phase, similar to the retrieval part, there was no statistically significant difference (Mann–Whitney rank test U = 1.26e+0.3, p = 0.103) between the patients with Tourette syndrome (median: 0.125, range: 0–0.667, n = 46) and the control group (median: 0.167, range: 0–0.917, n = 46, Fig 2).
The effect of medication on the performances of patients with Tourette syndrome with and without comorbidities
To examine the effects of medications on the performances in the applied associative learning test, we compared the performances of the unmedicated patients (TS, TS + ADHD, and TS + OCD/ASD) and their matched healthy controls, the unmedicated patients with Tourette syndrome and all patients with TS, and the medicated and unmedicated patients with Tourette syndrome.
Unmedicated pediatric patients with Tourette syndrome versus healthy control children
In order to reduce the effect of multiple (twice in this case) application of the same data (first application was above in the comparison with the entire TS group), the statistical results were evaluated after Bonferroni correction at a significance level of 0.025. The median NAT was 78.5 (range: 42–202, n = 34) in all unmedicated patients and 60.5 (range: 46–124, n = 34) in the matched control group. The NAT values were significantly higher in patients with Tourette syndrome (Mann–Whitney rank test, U = 345, p = 0.004). The median ALER was 0.102 (range: 0–0.325, n = 34) in patients with Tourette syndrome and 0.086 (range: 0–0.186, n = 34) in the control group. The ALER values, similar to NAT values, were significant higher in patients with Tourette syndrome (Mann–Whitney rank test U = 392, p = 0.023). In the retrieval part of the test phase, there was no statistically significant difference (Mann–Whitney rank test U = 657, p = 0.330) between the TS group (median: 0.056, range: 0–0.333) and the control group (median: 0.083, range: 0–0.472). In the generalization part of the test phase, there was no statistically significant difference (Mann–Whitney rank test U = 734, p = 0.053) between the patients with Tourette syndrome (median: 0.083, range: 0–0.667) and the control group (median: 0.208, range: 0–0.917, Fig 3)
All pediatric patients with Tourette syndrome versus unmedicated patients with Tourette syndrome
Comparing the performances of the whole patient group (TS, TS + ADHD, and TS + OCD/ASD) with the unmedicated patient group (TS, TS + ADHD, and TS + OCD/ASD), we did not find any significant differences. The median NAT was 79.0 (range: 42–202, n = 46) in the whole patient group and 78.5 (range: 42–202, n = 34) in the unmedicated patient group. There was no significant difference in the NAT between these groups (Mann–Whitney rank test U = 763, p = 0.857). The median ALER was 0.102 (range: 0–0.325, n = 34) in the whole patient group and 0.102 (range: 0–0.325, n = 34) in the unmedicated patient group. The ALER values, similar to the NAT values, did not significantly differ (Mann–Whitney rank test U = 786, p = 0.969). In the retrieval part of the test phase, the median RER was 0.056 in the whole patient group (range: 0–0.333, n = 46) and 0.056 (range: 0–0.333, n = 34) in the unmedicated patient group, and this difference was not statistically significant (Mann–Whitney rank test U = 774, p = 0.937). In the generalization part of the test phase, the median GER was 0.125 in the whole patient group (range: 0–0.667, n = 46) and 0.083 (range: 0–0.667, n = 34) in the unmedicated patient group and this difference was not statistically significant (Mann–Whitney rank test U = 742, p = 0.698).
Medicated versus unmedicated pediatric patients with Tourette syndrome
The performance of the medicated patient group did not differ significantly from the performance of the unmedicated patient group. The median NAT was 79.0 (range: 68–101, n = 12) for the medicated patient group and 78.5 (range: 42–202, n = 34) for the unmedicated patient group. There was no statistically significant difference in the NAT between these groups (Mann–Whitney rank test U = 185, p = 0.643). The median ALER was 0.106 (range: 0.056–0.250, n = 12) in the medicated patient group and 0.102 (range: 0–0.325, n = 34) in the unmedicated patient group. The ALER values, similar to the NAT values, did not significantly differ (Mann–Whitney rank test U = 208, p = 0.920). In the retrieval part of the test phase, the median RER was 0.083 in the medicated patient group (range: 0–0.139, n = 12) and 0.056 (range: 0–0.333, n = 34) in the unmedicated patient group, and this difference was not statistically significant (Mann–Whitney U test U = 196, p = 0.840). In the generalization part of the test phase, the median GER was 0.208 in the medicated patient group (range: 0–0.667, n = 12) and 0.083 (range: 0–0.667, n = 34) in the unmedicated patient group, and the difference was not statistically significant (Mann–Whitney rank test U = 164, p = 0.319).
Comparison of the performances among the patients with TS, TS + ADHD, and TS + OCD/ASD
In the first step we have compared the performances in one multiple comparison of the three TS patient and the three control subgroups with Kruskal–Wallis ANOVA analysis. These results revealed significant differences among the six subgroups in NAT (χ2 (5, N = 92) = 14.1829, p = 0.0145) and ALER (χ2 (5, N = 92) = 11.7513, p = 0.0384) but not in RER (χ2 (5, N = 92) = 1.9133, p = 0.861) and GER (χ2 (5, N = 92) = 3.3317, p = 0.6490). In the next step we have compared the performances among the three TS patient subgroups. There were no significant differences in the performances of the three patient groups (TS, TS + ADHD, and TS + OCD/ASD with or without medication) for any of the investigated parameters. The results of the comparisons are shown in Table 2.
Table 2. The performances of the Tourette syndrome, Tourette syndrome and attention deficit hyperactivity disorder, and Tourette syndrome and obsessive compulsive disorder or autism spectrum disorder groups (with or without medication).
TS (n = 21) | TS + ADHD (n = 15) | TS + OCD/ASD (n = 10) | Kruskal–Wallis test | |
---|---|---|---|---|
NAT | median: 79 range: 52–130 | median: 78 range: 42–202 | median:72 range: 46–169 | χ2(2, N = 46) = 0.0498, p = 0.975 |
ALER | median: 0.101 range: 0.018–0.325 | median: 0.120 range: 0–0.287 | median: 0.106 range:0.043–0.172 | χ2(2, N = 46) = 1.13, p = 0.568 |
RER | median: 0.056 range: 0–0.333 | median: 0.056 range: 0.028–0.222 | median: 0.097 range: 0.028–0.222 | χ2(2, N = 46) = 1.1, p = 0.577 |
GER | median: 0.083 range: 0–0.667 | median: 0.167 range: 0–0.667 | median: 0.208 range: 0–0.583 | χ2(2, N = 46) = 0.389 p = 0.823 |
TS: Tourette syndrome, ADHD: attention deficit hyperactivity disorder, OCD/ASD: obsessive compulsive disorder or autism spectrum disorder, NAT: the number of the necessary trials in the acquisition phase of the paradigm, ALER: the error ratios in the acquisition phase of the paradigm, RER: the error ratios in the retrieval part of the test phase, and GER: the error ratio in the generalization part of the test phase.
After the subtraction of the performances of the medicated patients from the analysis, there were no significant differences among the TS, TS + ADHD, and TS + OCD/ASD groups (Table 3).
Table 3. The performances of the three unmedicated patient groups.
TS (n = 18) | TS + ADHD (n = 9) | TS + OCD/ASD (n = 7) | Kruskal–Wallis test | |
---|---|---|---|---|
NAT | median: 79,5 range: 52–130 | median: 62 range: 42–202 | median: 89 range: 46–169 | χ2(2, N = 34) = 0.877, p = 0.645 |
ALER | median: 0.102 range: 0.018–0.325 | median: 0.097 range: 0–0.287 | median: 0.136 range: 0.043–0.172 | χ2(2, N = 34) = 0.694, p = 0.707 |
RER | median: 0.056 range: 0–0.333 | median: 0.056 range: 0.028–0.222 | median: 0.028 range: 0.028–0.222 | χ2(2, N = 34) = 0.535, p = 0.765 |
GER | median: 0.083 range: 0–0.667 | median: 0.083 range: 0–0.161 | median: 0.167 range: 0–0.583 | χ2(2, N = 34) = 0.255, p = 0.880 |
TS: Tourette syndrome, ADHD: attention deficit hyperactivity disorder, OCD/ASD: obsessive compulsive disorder or autism spectrum disorder, NAT: the number of the necessary trials in the acquisition phase of the paradigm, ALER: the error ratios in the acquisition phase of the paradigm, RER: the error ratios in the retrieval part of the test phase, and GER: the error ratio in the generalization part of the test phase.
To avoid the significant effect of the different performances of the three different control subgroups we have compared the performances of the control subgroups, too. We have found no significant differences in each of the investigated values among the control subgroups (Kruskal–Wallis ANOVA, NAT: χ2 (2, N = 46) = 3.7562, p = 0.153; ALER: χ2 (2, N = 46) = 3.5641, p = 0.168; RER: χ2 (2, N = 46) = 0.7136, p = 0.965; GER: χ2 (2, N = 46) = 0.16242, p = 0.922).
Performance of the three TS groups versus their matched healthy control groups
To determine whether the significant findings described above originated in a similar manner for patients with Tourette syndrome without comorbidities and for patients with Tourette syndrome and comorbidities (TS + ADHD or TS + OCD/ASD) we separately compared the data of these three subpopulations with their matched healthy control groups.
Children with Tourette syndrome without any comorbidities versus healthy control children
We examined the difference between the performance of patients with Tourette syndrome and that of matched healthy controls. The median NAT was 79.0 (range: 52–130, n = 21) in the TS group and 60.0 (range: 46–124, n = 21) in the control group. The NAT was significantly higher in patients with Tourette syndrome (Mann–Whitney rank test U = 109, p = 0.005). The median ALER of patients with Tourette syndrome was 0.101 (range: 0.018–0.325, n = 21), and that of the healthy control group was 0.083 (range: 0–0.186, n = 21). The ALER values, similar to the NAT values, were higher in the TS group (Mann–Whitney rank test U = 142, p = 0.049). In the retrieval part of the test phase, the median RER in the TS group was 0.056, (range: 0–0.333, n = 21) and that in the matched healthy group was 0.083 (range: 0–0.361, n = 21). Although the RER was smaller in the Tourette syndrome group, this difference was not statistically significant (Mann–Whitney rank test U = 260, p = 0.327). In the generalization part of the test phase, the median GER was 0.083 (range: 0–0.667, n = 21) in the group of patients with Tourette syndrome and 0.167 (range: 0–0.917, n = 21) in the healthy control group. This difference was not statistically significant (Mann–Whitney rank test U = 270, p = 0.209, Fig 4).
Patients with TS + ADHD versus healthy controls
These comparisons revealed the same tendencies as those in the TS without any comorbidities and TS+OCD/ASD groups. The NAT and ALER values were higher in the TS + ADHD than in the control group, while the RER and GER values were lower in patients with TS+ADHD, but these differences did not significantly differ from those values of the matched control children. The median NAT was 78.0 (range: 42–202, n = 15) in the TS + ADHD group and 75.0 (range: 45–97, n = 15; Mann–Whitney rank test U = 89, p = 0.340) in the matched healthy control group. The median ALER was 0.120 (range: 0.0–0.287, n = 21) in the TS + ADHD group and 0.105 (range: 0.056–0.143, n = 15, Welch’s test t(22,2) = -1.56, p = 0.138) in the control group. In the retrieval part of the test phase, the median RER was 0.056 (range: 0.028–0.222, n = 15) in the TS + ADHD group and 0.083 (range: 0.0–0.472, n = 15, Mann–Whitney rank test U = 120, p = 0.784) in the control group. In the generalization part of the test phase, the median GER was 0.167 (range: 0–0.667, n = 15) in the TS + ADHD group and 0.167 (range: 0–0.917, n = 15, Mann–Whitney rank test U = 140, p = 0.255) in the matched healthy control group (Fig 5).
Patients with TS + OCD/ASD versus healthy controls
This comparison revealed the same significant differences as were demonstrated above by the patients with Tourette syndrome without any comorbidities. The NAT and ALER values were significantly higher in the TS + OCD/ASD group than in the control group, while the RER and GER values did not differ between the TS + OCD/ASD and control groups. The median NAT was 72.0 (range: 46–169, n = 10) in the TS + OCD/ASD group and 60.5 (range: 49–84, n = 10; independent samples t-test t(18) = -2.21, p = 0.041) in the matched healthy control group. The median ALER was 0.106 (range: 0.043–0.172, n = 10) in the TS + OCD/ASD group and 0.083 (range: 0.019–0.125, n = 10, independent samples t-test t(18) = -2.48, p = 0.023) in the control group. In the retrieval part of the test phase, the median RER was 0.097 (range: 0.028–0.222, n = 10) in the TS + OCD/ASD group and 0.083 (range: 0.027–0.250, n = 10, independent samples t-test t(18) = 0.335, p = 0.741) in the control group. In the generalization part of the test phase, the median GER was 0.208 (range: 0–0.583, n = 10) in the TS + OCD/ASD group and 0.208 (range: 0–0.750, n = 10, Mann–Whitney rank test U = 51.5, p = 0.939) in the matched healthy control group (Fig 6).
Discussion
The Rutgers Acquired Equivalence Test (face and fish test, [35]), which investigates visually guided associative learning in humans, has a well-defined neurological background. The acquisition phase, which primarily depends on the function of the basal ganglia [35, 50] tests the association between two different visual stimuli. The test phase, in which the previously learned associations (retrieval part) and new, but acquisition-based, predictable associations (generalization part) are evaluated, primarily depends on the hippocampi and the mediotemporal lobe [35, 50]. These cognitive functions were previously investigated in adult neurological and psychiatric patients which were shown to be related to dysfunction of the basal ganglia and the hippocampi (i.e., Parkinson’s disease [34, 35], Alzheimer's disease [51], and migraine without aura [53]). However, the present study is the first to describe the alteration of visual associative learning in a group of children with Tourette syndrome with and without comorbidities. This finding is interesting because only in rare cases have significant impairments in any cognitive functions been described in Tourette syndrome. Tourette syndrome is strongly related to dysfunction of the basal ganglia and the frontal associative cortex. Because of the involvement of the basal ganglia in the pathogenesis of Tourette syndrome, the acquisition phase, which mainly depends on the basal ganglia, was primarily affected in the associative learning test. Based on our results, all patients with Tourette syndrome made the associations with less effectiveness than healthy control children. However, the retrieval and generalization parts of the test phase, which primarily depend on the function of the hippocampi, were not negatively affected by Tourette syndrome. Because of the compensation of the weaker acquisition building, even better performances were found in these phases of the paradigm, although these differences were not statistically significant [36, 47].
Our results demonstrated that in the acquisition phase, the performance (NAT and ALER) of all patients (TS, TS + ADHD, and TS + OCD/ASD) was significantly weaker than in the sex, age, and IQ level-matched healthy control group. The question arises whether the alterations in equivalence learning in all patients with Tourette syndrome were primarily due to TS or its most common comorbidity, ADHD. In most cases, Tourette syndrome and ADHD, which seems to plays a major role, are jointly responsible for the alterations in cognitive functions [44, 59–61]. We compared the performances of the three patient groups and found no significant difference among their performances. This finding does not support the predominant role of ADHD in the described alterations in the acquisition phase of the associative learning task. The comparison of each patient group with its matched healthy control group revealed significantly increased NAT or ALER values in patients with Tourette syndrome without any comorbidities and TS + OCD/ASD but not in patients with TS + ADHD. These results together could suggest that concomitant ADHD and TS was not primarily responsible for the visual acquisition learning deficits in patients with Tourette syndrome. This is in contrast with previous findings that ADHD is primarily responsible for the alteration of cognitive functions in patients with TS + ADHD [33, 37, 38, 43]. Therefore, the visually guided acquired equivalence learning, similar to stimulus-response or habit learning [24, 45], which is mediated by the dorsal frontostriatal pathways, is more attributable to Tourette syndrome than ADHD, despite ADHD symptoms affecting the dorsolateral frontostriatal circuits [62].
The volume of the hippocampi is significantly larger in patients with pure Tourette syndrome than that of their healthy counterparts [63], and no explicit memory (which is connected to the hippocampus) deficits were reported in children with Tourette syndrome [45, 47]. Our results are in line with these findings. The performance in the retrieval and generalization parts of the test phase, which are primarily related to the hippocampi was not worse in the entire group of patients with Tourette syndrome with and without comorbidities. Concerning the three investigated subpopulations of the patients with Tourette syndrome (TS without comorbidities, TS + ADHD, and TS + OCD/ASD), the RER and GER values did not differ from those of the matched healthy control children.
Another question is the possible influence of medication on the performance of patients with Tourette syndrome with or without comorbidities. Because of the relatively low number of cases in the comorbid groups, we could not perform a valid comparison between the performance of medicated and unmedicated TS + ADHD and TS + OCD/ASD patients. Thus, we used the entire TS population (TS without comorbidities, TS + ADHD, and TS + OCD/ASD) to get information about the possible role of medication. The performances in the acquisition phase of the associative learning task in unmedicated TS pediatric patients, similar to the entire TS population, were significantly weaker than those of the matched healthy control children. The comparison of the performances of the entire and the unmedicated TS patient groups revealed no differences. Similarly, we found no differences between the performances of the entire population of medicated and unmedicated pediatric patients with Tourette syndrome. These findings collectively suggest that medication had no or only a weak influence on our results.
In this study, we functionally confirmed the results of neuroimaging [14–16, 23] and functional studies that the dorsal frontostriatal circuits are strongly affected in Tourette syndrome, and these circuits are critical to the acquisition process of visually guided associative learning [46, 47]. The hippocampus mediated recall of previously learned associations, and the building of new but acquisition-based, predictable associations were not altered in Tourette syndrome.
Supporting information
Acknowledgments
The authors thank Emese Bognár, Kristóf Kollár, András Puszta, Xenia Katona, Nóra Cserháti, Nándor Görög and Dóra Dózsai for their help in conducting the investigation and data collection and all the participants for engaging in the research. The open access publication was founded by the University of Szeged Open Access Fund, Grant number: 4780.
Data Availability
All relevant data are within the manuscript and its Supporting Information files.
Funding Statement
(AN) Faculty Research Fund, Albert Szent-Györgyi Grant, Faculty of Medicine, University of Szeged. SZTE ÁOK-KKA grant No: 2019/270-62-2. http://www.med.u-szeged.hu/karunkrol/kari-palyazatok/aok-kari-kutatasi-alap-181005 The funders did not play any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Battle DE. Diagnostic and Statistical Manual of Mental Disorders (DSM). Codas. 2013;25(2):191–2. 10.1590/s2317-17822013000200017 [DOI] [PubMed] [Google Scholar]
- 2.Robertson MM. The prevalence and epidemiology of Gilles de la Tourette syndrome. Part 1: the epidemiological and prevalence studies. J Psychosom Res. 2008;65(5):461–72. 10.1016/j.jpsychores.2008.03.006 [DOI] [PubMed] [Google Scholar]
- 3.Robertson MM. A personal 35 year perspective on Gilles de la Tourette syndrome: prevalence, phenomenology, comorbidities, and coexistent psychopathologies. Lancet Psychiatry. 2015;2(1):68–87. 10.1016/S2215-0366(14)00132-1 [DOI] [PubMed] [Google Scholar]
- 4.Scharf JM, Miller LL, Gauvin CA, Alabiso J, Mathews CA, Ben-Shlomo Y. Population prevalence of Tourette syndrome: a systematic review and meta-analysis. Mov Disord. 2015;30(2):221–8. 10.1002/mds.26089 [DOI] [PubMed] [Google Scholar]
- 5.Leckman JF, Peterson BS, Anderson GM, Arnsten AF, Pauls DL, Cohen DJ. Pathogenesis of Tourette's syndrome. J Child Psychol Psychiatry. 1997;38(1):119–42. 10.1111/j.1469-7610.1997.tb01508.x [DOI] [PubMed] [Google Scholar]
- 6.Pappert EJ, Goetz CG, Louis ED, Blasucci L, Leurgans S. Objective assessments of longitudinal outcome in Gilles de la Tourette's syndrome. Neurology. 2003;61(7):936–40. 10.1212/01.wnl.0000086370.10186.7c [DOI] [PubMed] [Google Scholar]
- 7.Eddy CM, Cavanna AE. Set-Shifting Deficits: A Possible Neurocognitive Endophenotype for Tourette Syndrome Without ADHD. J Atten Disord. 2017;21(10):824–34. 10.1177/1087054714545536 [DOI] [PubMed] [Google Scholar]
- 8.Eddy CM, Rickards HE, Cavanna AE. Executive functions in uncomplicated Tourette syndrome. Psychiatry Res. 2012;200(1):46–8. 10.1016/j.psychres.2012.05.023 [DOI] [PubMed] [Google Scholar]
- 9.Robertson MM. A personal 35 year perspective on Gilles de la Tourette syndrome: assessment, investigations, and management. Lancet Psychiatry. 2015;2(1):88–104. 10.1016/S2215-0366(14)00133-3 [DOI] [PubMed] [Google Scholar]
- 10.Lange F, Seer C, Muller-Vahl K, Kopp B. Cognitive flexibility and its electrophysiological correlates in Gilles de la Tourette syndrome. Dev Cogn Neurosci. 2017;27:78–90. 10.1016/j.dcn.2017.08.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Mink JW. Basal ganglia dysfunction in Tourette's syndrome: a new hypothesis. Pediatr Neurol. 2001;25(3):190–8. 10.1016/s0887-8994(01)00262-4 [DOI] [PubMed] [Google Scholar]
- 12.Osmon DC, Smerz JM. Neuropsychological evaluation in the diagnosis and treatment of Tourette's syndrome. Behav Modif. 2005;29(5):746–83. 10.1177/0145445505279380 [DOI] [PubMed] [Google Scholar]
- 13.Makki MI, Behen M, Bhatt A, Wilson B, Chugani HT. Microstructural abnormalities of striatum and thalamus in children with Tourette syndrome. Mov Disord. 2008;23(16):2349–56. 10.1002/mds.22264 [DOI] [PubMed] [Google Scholar]
- 14.Muller-Vahl KR, Kaufmann J, Grosskreutz J, Dengler R, Emrich HM, Peschel T. Prefrontal and anterior cingulate cortex abnormalities in Tourette Syndrome: evidence from voxel-based morphometry and magnetization transfer imaging. BMC Neurosci. 2009;10:47 10.1186/1471-2202-10-47 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Peterson BS, Thomas P, Kane MJ, Scahill L, Zhang H, Bronen R, et al. Basal Ganglia volumes in patients with Gilles de la Tourette syndrome. Arch Gen Psychiatry. 2003;60(4):415–24. 10.1001/archpsyc.60.4.415 [DOI] [PubMed] [Google Scholar]
- 16.Plessen KJ, Bansal R, Peterson BS. Imaging evidence for anatomical disturbances and neuroplastic compensation in persons with Tourette syndrome. J Psychosom Res. 2009;67(6):559–73. 10.1016/j.jpsychores.2009.07.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Alexander GE, Crutcher MD, DeLong MR. Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. Prog Brain Res. 1990;85:119–46. [PubMed] [Google Scholar]
- 18.Alexander GE, DeLong MR, Strick PL. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci. 1986;9:357–81. 10.1146/annurev.ne.09.030186.002041 [DOI] [PubMed] [Google Scholar]
- 19.Da Cunha C, Boschen SL, Gomez AA, Ross EK, Gibson WS, Min HK, et al. Toward sophisticated basal ganglia neuromodulation: Review on basal ganglia deep brain stimulation. Neurosci Biobehav Rev. 2015;58:186–210. 10.1016/j.neubiorev.2015.02.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Groenewegen HJ, van den Heuvel OA, Cath DC, Voorn P, Veltman DJ. Does an imbalance between the dorsal and ventral striatopallidal systems play a role in Tourette's syndrome? A neuronal circuit approach. Brain Dev. 2003;25 Suppl 1:S3–s14. [DOI] [PubMed] [Google Scholar]
- 21.Marsh R, Maia TV, Peterson BS. Functional disturbances within frontostriatal circuits across multiple childhood psychopathologies. Am J Psychiatry. 2009;166(6):664–74. 10.1176/appi.ajp.2009.08091354 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Tremblay L, Worbe Y, Thobois S, Sgambato-Faure V, Feger J. Selective dysfunction of basal ganglia subterritories: From movement to behavioral disorders. Mov Disord. 2015;30(9):1155–70. 10.1002/mds.26199 [DOI] [PubMed] [Google Scholar]
- 23.Makki MI, Govindan RM, Wilson BJ, Behen ME, Chugani HT. Altered fronto-striato-thalamic connectivity in children with Tourette syndrome assessed with diffusion tensor MRI and probabilistic fiber tracking. J Child Neurol. 2009;24(6):669–78. 10.1177/0883073808327838 [DOI] [PubMed] [Google Scholar]
- 24.Packard MG, Knowlton BJ. Learning and memory functions of the Basal Ganglia. Annu Rev Neurosci. 2002;25:563–93. 10.1146/annurev.neuro.25.112701.142937 [DOI] [PubMed] [Google Scholar]
- 25.Termine C, Luoni C, Fontolan S, Selvini C, Perego L, Pavone F, et al. Impact of co-morbid attention-deficit and hyperactivity disorder on cognitive function in male children with Tourette syndrome: A controlled study. Psychiatry Res. 2016;243:263–7. 10.1016/j.psychres.2016.06.048 [DOI] [PubMed] [Google Scholar]
- 26.Crawford S, Channon S, Robertson MM. Tourette's syndrome: performance on tests of behavioural inhibition, working memory and gambling. J Child Psychol Psychiatry. 2005;46(12):1327–36. 10.1111/j.1469-7610.2005.01419.x [DOI] [PubMed] [Google Scholar]
- 27.Jeter CB, Patel SS, Morris JS, Chuang AZ, Butler IJ, Sereno AB. Oculomotor executive function abnormalities with increased tic severity in Tourette syndrome. J Child Psychol Psychiatry. 2015;56(2):193–202. 10.1111/jcpp.12298 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Yaniv A, Benaroya-Milshtein N, Steinberg T, Ruhrman D, Apter A, Lavidor M. Executive control development in Tourette syndrome and its role in tic reduction. Psychiatry Res. 2018;262:527–35. 10.1016/j.psychres.2017.09.038 [DOI] [PubMed] [Google Scholar]
- 29.Burd L, Freeman RD, Klug MG, Kerbeshian J. Tourette Syndrome and learning disabilities. BMC Pediatr. 2005;5:34 10.1186/1471-2431-5-34 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Openneer TJC, Forde NJ, Akkermans SEA, Naaijen J, Buitelaar JK, Hoekstra PJ, et al. Executive function in children with Tourette syndrome and attention-deficit/hyperactivity disorder: Cross-disorder or unique impairments? Cortex. 2020;124:176–87. 10.1016/j.cortex.2019.11.007 [DOI] [PubMed] [Google Scholar]
- 31.Hirschtritt ME, Lee PC, Pauls DL, Dion Y, Grados MA, Illmann C, et al. Lifetime prevalence, age of risk, and genetic relationships of comorbid psychiatric disorders in Tourette syndrome. JAMA Psychiatry. 2015;72(4):325–33. 10.1001/jamapsychiatry.2014.2650 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Dube WV, McIlvane WJ, Maguire RW, Mackay HA, Stoddard LT. Stimulus class formation and stimulus-reinforcer relations. J Exp Anal Behav. 1989;51(1):65–76. 10.1901/jeab.1989.51-65 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Morand-Beaulieu S, Leclerc JB, Valois P, Lavoie ME, O'Connor KP, Gauthier B. A Review of the Neuropsychological Dimensions of Tourette Syndrome. Brain Sci. 2017;7(8). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Myers CE, Hopkins RO, DeLuca J, Moore NB, Wolansky LJ, Sumner JM, et al. Learning and generalization deficits in patients with memory impairments due to anterior communicating artery aneurysm rupture or hypoxic brain injury. Neuropsychology. 2008;22(5):681–6. 10.1037/0894-4105.22.5.681 [DOI] [PubMed] [Google Scholar]
- 35.Myers CE, Shohamy D, Gluck MA, Grossman S, Kluger A, Ferris S, et al. Dissociating hippocampal versus basal ganglia contributions to learning and transfer. J Cogn Neurosci. 2003;15(2):185–93. 10.1162/089892903321208123 [DOI] [PubMed] [Google Scholar]
- 36.Ullman MT, Pullman MY. A compensatory role for declarative memory in neurodevelopmental disorders. Neurosci Biobehav Rev. 2015;51:205–22. 10.1016/j.neubiorev.2015.01.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Harris EL, Schuerholz LJ, Singer HS, Reader MJ, Brown JE, Cox C, et al. Executive function in children with Tourette syndrome and/or attention deficit hyperactivity disorder. J Int Neuropsychol Soc. 1995;1(6):511–6. 10.1017/s1355617700000631 [DOI] [PubMed] [Google Scholar]
- 38.Mahone EM, Koth CW, Cutting L, Singer HS, Denckla MB. Executive function in fluency and recall measures among children with Tourette syndrome or ADHD. J Int Neuropsychol Soc. 2001;7(1):102–11. 10.1017/s1355617701711101 [DOI] [PubMed] [Google Scholar]
- 39.Channon S, Pratt P, Robertson MM. Executive function, memory, and learning in Tourette's syndrome. Neuropsychology. 2003;17(2):247–54. 10.1037/0894-4105.17.2.247 [DOI] [PubMed] [Google Scholar]
- 40.Palminteri S, Lebreton M, Worbe Y, Hartmann A, Lehericy S, Vidailhet M, et al. Dopamine-dependent reinforcement of motor skill learning: evidence from Gilles de la Tourette syndrome. Brain. 2011;134(Pt 8):2287–301. 10.1093/brain/awr147 [DOI] [PubMed] [Google Scholar]
- 41.Palminteri S, Pessiglione M. Reinforcement learning and Tourette syndrome. Int Rev Neurobiol. 2013;112:131–53. 10.1016/B978-0-12-411546-0.00005-6 [DOI] [PubMed] [Google Scholar]
- 42.Salvador A, Worbe Y, Delorme C, Coricelli G, Gaillard R, Robbins TW, et al. Specific effect of a dopamine partial agonist on counterfactual learning: evidence from Gilles de la Tourette syndrome. Sci Rep. 2017;7(1):6292 10.1038/s41598-017-06547-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Shephard E, Jackson GM, Groom MJ. The effects of co-occurring ADHD symptoms on electrophysiological correlates of cognitive control in young people with Tourette syndrome. J Neuropsychol. 2016;10(2):223–38. 10.1111/jnp.12071 [DOI] [PubMed] [Google Scholar]
- 44.Shephard E, Groom MJ, Jackson GM. Implicit sequence learning in young people with Tourette syndrome with and without co-occurring attention-deficit/hyperactivity disorder. J Neuropsychol. 2019;13(3):529–49. 10.1111/jnp.12167 [DOI] [PubMed] [Google Scholar]
- 45.Goodman J, Marsh R, Peterson BS, Packard MG. Annual research review: The neurobehavioral development of multiple memory systems—implications for childhood and adolescent psychiatric disorders. J Child Psychol Psychiatry. 2014;55(6):582–610. 10.1111/jcpp.12169 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Keri S, Szlobodnyik C, Benedek G, Janka Z, Gadoros J. Probabilistic classification learning in Tourette syndrome. Neuropsychologia. 2002;40(8):1356–62. 10.1016/s0028-3932(01)00210-x [DOI] [PubMed] [Google Scholar]
- 47.Marsh R, Alexander GM, Packard MG, Zhu H, Wingard JC, Quackenbush G, et al. Habit learning in Tourette syndrome: a translational neuroscience approach to a developmental psychopathology. Arch Gen Psychiatry. 2004;61(12):1259–68. 10.1001/archpsyc.61.12.1259 [DOI] [PubMed] [Google Scholar]
- 48.Takacs A, Kobor A, Chezan J, Elteto N, Tarnok Z, Nemeth D, et al. Is procedural memory enhanced in Tourette syndrome? Evidence from a sequence learning task. Cortex. 2018;100:84–94. 10.1016/j.cortex.2017.08.037 [DOI] [PubMed] [Google Scholar]
- 49.Takacs A, Shilon Y, Janacsek K, Kobor A, Tremblay A, Nemeth D, et al. Procedural learning in Tourette syndrome, ADHD, and comorbid Tourette-ADHD: Evidence from a probabilistic sequence learning task. Brain Cogn. 2017;117:33–40. 10.1016/j.bandc.2017.06.009 [DOI] [PubMed] [Google Scholar]
- 50.Moustafa AA, Myers CE, Gluck MA. A neurocomputational model of classical conditioning phenomena: a putative role for the hippocampal region in associative learning. Brain Res. 2009;1276:180–95. 10.1016/j.brainres.2009.04.020 [DOI] [PubMed] [Google Scholar]
- 51.Bodi N, Csibri E, Myers CE, Gluck MA, Keri S. Associative learning, acquired equivalence, and flexible generalization of knowledge in mild Alzheimer disease. Cogn Behav Neurol. 2009;22(2):89–94. 10.1097/WNN.0b013e318192ccf0 [DOI] [PubMed] [Google Scholar]
- 52.Keri S, Nagy O, Kelemen O, Myers CE, Gluck MA. Dissociation between medial temporal lobe and basal ganglia memory systems in schizophrenia. Schizophr Res. 2005;77(2–3):321–8. 10.1016/j.schres.2005.03.024 [DOI] [PubMed] [Google Scholar]
- 53.Oze A, Nagy A, Benedek G, Bodosi B, Keri S, Palinkas E, et al. Acquired equivalence and related memory processes in migraine without aura. Cephalalgia. 2017;37(6):532–40. 10.1177/0333102416651286 [DOI] [PubMed] [Google Scholar]
- 54.Kim S, Greene DJ, Bihun EC, Koller JM, Hampton JM, Acevedo H, et al. Provisional Tic Disorder is not so transient. Sci Rep. 2019;9(1):3951 10.1038/s41598-019-40133-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Ishihara S, Major IJA, Handaya MCT, Haruchiko H. H.V.W. Tests for color blindness. American Journal of Ophtalmology. 1918;1(6):457. [Google Scholar]
- 56.Rózsa S. Raven Progresszív Mátrixok: Kézikönyv. 1st ed. Budapest: OS Hungary Press; 2006. [Google Scholar]
- 57.Rózsa S, Oláh A. A pszichológiai mérés alapjai Budapest: Bölcsész Konzorcium Press; 2006. [Google Scholar]
- 58.Martin AW, Wiechers JE. Raven's colored progressive matrices and the Wechsler intelligence scale for children. J Consult Psychol. 1954;18(2):143–4. 10.1037/h0055913 [DOI] [PubMed] [Google Scholar]
- 59.Barkley RA. Attention-deficit/hyperactivity disorder, self-regulation, and time: toward a more comprehensive theory. J Dev Behav Pediatr. 1997;18(4):271–9. [PubMed] [Google Scholar]
- 60.Brand N, Geenen R, Oudenhoven M, Lindenborn B, van der Ree A, Cohen-Kettenis P, et al. Brief report: cognitive functioning in children with Tourette's syndrome with and without comorbid ADHD. J Pediatr Psychol. 2002;27(2):203–8. 10.1093/jpepsy/27.2.203 [DOI] [PubMed] [Google Scholar]
- 61.Spencer T, Biederman J, Harding M, O'Donnell D, Wilens T, Faraone S, et al. Disentangling the overlap between Tourette's disorder and ADHD. J Child Psychol Psychiatry. 1998;39(7):1037–44. [PubMed] [Google Scholar]
- 62.Denckla MB. Attention-deficit hyperactivity disorder (ADHD) comorbidity: a case for "pure" Tourette syndrome? J Child Neurol. 2006;21(8):701–3. 10.1177/08830738060210080701 [DOI] [PubMed] [Google Scholar]
- 63.Peterson BS, Choi HA, Hao X, Amat JA, Zhu H, Whiteman R, et al. Morphologic features of the amygdala and hippocampus in children and adults with Tourette syndrome. Arch Gen Psychiatry. 2007;64(11):1281–91. 10.1001/archpsyc.64.11.1281 [DOI] [PMC free article] [PubMed] [Google Scholar]