Abstract
Background
The Stroop test is frequently used to assess deficits in inhibitory control in people with multiple sclerosis (MS). This test has limitations and antisaccade eye movements, that also measure inhibitory control, may be an alternative to Stroop.
Objectives
The aim of this study was twofold: (i) to investigate if the performance in the antisaccade task is altered in patients with MS and (ii) to investigate the correlation between performances in neuropsychological tests, the Stroop test and the antisaccade task.
Methods
We measured antisaccades (AS) parameters with an infrared eye tracker (SMIRED 250 Hz) using a standard AS paradigm. A total of 38 subjects diagnosed with MS and 38 age and gender matched controls participated in this study. Neuropsychological measures were obtained from the MS group.
Results
Patients with MS have higher error rates and prolonged latency than controls in the antisaccade task. There was a consistent association between the Stroop performance and AS latency. Stroop performance but not AS latency was associated with other neuropsychological measures in which the MS group showed deficits.
Conclusions
Our findings suggest that AS may be a selective and independent measure to investigate inhibitory control in patients with MS. More studies are necessary to confirm our results and to describe brain correlates associated with impaired performance in the antisaccade task in people diagnosed with MS.
Keywords: Eye movements, Antisaccades, Multiple sclerosis, Stroop test, Inhibitory control, Executive functions
Introduction
Multiple sclerosis (MS) is a neurodegenerative disease producing inflammation of the central nervous system characterised by loss of oligodendrocytes and axonal degeneration (Keegan & Noseworthy, 2002). Cognitive deficit is often the first indicator of the disease progression and can involve a variety of functions such as processing speed, long-term memory, attention and executive functions (Chiaravalloti & DeLuca, 2008; Patti et al., 2009; Ruggieri et al., 2003). Executive functions involve, amongst others cognitive processes, inhibitory control. Inhibitory control can be defined as the ability to suppress prepotent but incorrect responses and the ability to filter out irrelevant information within a stimulus set (Botvinick et al., 2001). Prepotent response inhibition summons processes that regulate the selection of a weaker, but task-relevant response, over a competing strong, but task-irrelevant, response (Miller & Cohen, 2001). Antisaccades (AS) performance obtained with an AS task is considered a good indicator of inhibitory control in humans. For example, performance on this task is correlated with neuropsychological tests of executive functions in multiple neurodegenerative diseases (Heuer et al., 2013; Hutton, 2008).
The AS task requires suppression of an automatic saccade towards a sudden-onset peripheral visual target (defined as prosaccade) and the generation of a volitional (endogenous) saccade towards the mirrored target location (antisaccade) (Hutton & Ettinger, 2006; Munoz & Everling, 2004; Olk & Kingstone, 2003; Talanow et al., 2016). In humans the integrity of the dorsolateral prefrontal cortex (DLPFC) and anterior cingulate gyrus (ACC) seems to be critical for good AS performance (Pierrot-Deseilligny et al., 2003). Animal studies have shown that neural activity in correct AS (looking away from the target) in regions such as the prefrontal and anterior cingulate cortices is higher than when a wrong decision (prosaccade, or looking at the target) is made (Amador, Schlag-Rey & Schlag, 2004; Johnston & Everling, 2011).
Programming AS requires inhibitory and generation phases involving activation of the ventrolateral and dorsolateral cortices (Asaad, Rainer & Miller, 2000; Miller & Cohen, 2001). These areas are also involved in, for example, decision making (Ettinger et al., 2008). A detailed description of the process can be found in the referred literature. In brief, the structures involved are thought to be mediating processes of vector transformation—for AS the locations of the stimulus and the saccadic goal are not the same and, in the transition from stimulus encoding to the initiation of the response, the stimulus vector must be inverted 180° into the movement vector (Moon et al., 2007; Talanow et al., 2016).
There are different opinions concerning the cognitive mechanisms underlying AS performance, a good summary can be found in a publication by Talanow et al. (2016). In his publication Talanow describes a theoretical model that is currently accepted to explain AS performance in terms of parallel programming, often linked to a competition model or the horse-race metaphor (Hutton, 2008; Hutton & Ettinger, 2006; Kristjansson, 2007; Munoz & Everling, 2004; Talanow et al., 2016). According to this model prosaccade and AS signs are generated simultaneously in response to a visual stimulus. Both signs compete until one of them wins the competition. Good AS performance thus requires efficient cognitive processes that are sensitive to changes in brain structure occurring in neurodegenerative diseases or with age (Heuer et al., 2013; Lemos et al., 2016; Pa et al., 2014).
Some studies looked at cross-sectional (Fielding et al., 2009) and longitudinal alterations (Fielding et al., 2012) in AS performance in people diagnosed with MS. These studies found that in people with MS the number of errors and latency are associated with general cognitive functioning. Others observed that AS performance was associated with structural and microstructural changes in the cerebellum (Kolbe et al., 2014). However, given that performance in AS tasks rely strongly in inhibitory control, we hypothesise that performance in this task may be associated with neuropsychological tests such as the Stroop test that relies in a similar type of cognitive control.
Like the AS task, the Stroop task requires overriding of the prepotent response or prepotent response inhibition. In a Stroop colour-naming task participants have to name the ink colour of a printed colour word. Greater conflict occurs for incongruent (e.g. the word red in green ink) than for congruent (e.g. the word red in red ink) trials—this is the Stroop interference effect (Vanderhasselt, De Raedt & Baeken, 2009). Brain correlates indicate that the cognitive control of this task involves cortico-subcortical circuit and that includes the ACC and the DLPFC (Carter & Van Veen, 2007; MacDonald et al., 2000). A response conflict is generated when there is a coactivation of incompatible stimulus-response processes, the conflicting signal is used to recruit cognitive control in order to reduce the conflict and improve performance (Carter & Van Veen, 2007; Johnston & Everling, 2011). According to the prominent conflict-monitoring hypothesis the occurrence of response conflict is signalled by the ACC leading to recruitment in the DLPFC of more cognitive control for subsequent performance (Botvinick et al., 2001; Vanderhasselt, De Raedt & Baeken, 2009).
The current neurophysiological tests such as the Stroop test may have limitations to assess inhibitory control. For example, Stroop interference performance can be related with reading ability (Protopapas, Archonti & Skaloumbakas, 2007). Also, some studies reported effects of intelligence and education in this test (Homack & Riccio, 2004) and others failed to show differences in performance between clinical groups and controls even if differences were supposed to occur (Schwartz & Verhaeghen, 2008). Another known factor that can interfere with the Stroop test performance are colour vision defects that occur, for example, with normal aging or as a result of diseases such as MS (Ben-David & Schneider, 2010; Martinez-Lapiscina et al., 2014). These facts inspired us to investigate if the AS task can be a reliable test that overcomes some of the known limitations of the Stroop test but still provides a fine assessment of inhibitory control in people with MS (Heuer et al., 2013; Sisco et al., 2016).
The aim of this study was to investigate AS performance in patients with MS and the association between AS and Stroop performances. We formulate two hypotheses: (i) the AS task is sensitive to capture subclinical functional impairment in inhibitory control in people with MS and (ii) AS performance is correlated with the performance in the Stroop task.
Methods
Participants
A total of 38 patients diagnosed with MS were recruited by one of the authors (João José Cerqueira) at Hospital de Braga. An equal number of controls, age and gender matched, was recruited. The inclusion criteria for the MS group were: age between 18 and 45 years old, relapsing remitting course, early stages of disease severity as measured by the Expanded Disability Status Scale (EDSS) ≤3 (Kurtzke, 1983), and normal or corrected to normal visual acuity. Exclusion criteria were: on-going relapse/relapse in the previous month, presence of clinically diagnosed cognitive impairment, history of traumatic brain injury and/or stroke, depression (self-reported or detected during the study using the Beck Depression Inventory (BDI) (Beck, Steer & Carbin, 1988)). Those with clinically visible oculomotor abnormalities were not recruited (e.g. nystagmus or internuclear ophthalmoplegia, see references (Frohman et al., 2005; Serra, Chisari & Matta, 2018 (Table 1); Serra et al., 2003) for comprehensive lists. Controls were subject to equivalent exclusion criteria. The ethics committee at University of Minho granted ethical approval to carry out the study, ref: SECVS 083-2013, and all participants were informed about the aim and procedures involved before signing the informed consent. For a summary of demographic characteristics see Table 1 and for neuropsychological results see Table 2.
Table 1. Summary of the demographic and clinical information of the final sample of participants for both groups (SD = standard deviation).
Variable | Group | |
---|---|---|
MS (n = 38) | Control (n = 38) | |
Gender (n (%)) | 24 females (63%) | 21 females (55%) |
Age (mean (SD)) | 37 (6) | 36 (6) |
Time since diagnosis in months (mean (SD)) | 96 (59) | – |
EDSS (median (IQR)) | 1.5 (2) | – |
Note:
Differences in age and gender were not statistically significant.
Table 2. Summary of the psychological evaluation results of the final sample of MS patients and normalised data for the Portuguese population (SD = standard deviation).
Variable | Group | ||
---|---|---|---|
MS (n = 38) | Normative | p-value | |
Mean (SD) | Mean (SD) | ||
MOCA total | 24.03 (2.7) | 26.4 (2.2) | p < 0.001 |
Digit span (WAIS-III) | 9.8 (2.2) | 10 (3) | 0.68 |
Trail making (women) | 111 (64) | 61 (37) | p = 0.001 |
Trail making (men) | 108 (54) | 52 (37) | p = 0.002 |
SDMT (women) | 51.61 (8.4) | 60 (10.1) | p < 0.001 |
SDMT (men) | 51.07 (10.7) | 65.9 (12.2) | p < 0.001 |
COWAT | 32.3 (10.25) | 33.2 (9.6) | 0.60 |
Twenty questions (D-KEFS) | 10.5 (3.3) | 10 (3) | 0.35 |
Equipment and procedures
Eye movements were monitored using a binocular eyetracker running at 250 Hz (RED250; SMIGmb, Teltow, Germany). The eyetracker has a spatial resolution <0.4°, is controlled with iView X software (v2.8, August 2011; SMIGmb, Teltow, Germany) and stimuli were presented on a 22 inch (1,680 × 1,050 px) LCD monitor running at 60 Hz (Dell P2210). The system used was formed of two computers connected by a high-speed Ethernet. One computer controls the eyetracker and other controls the stimulus presentation. A Matlab software development kit provided by SMI and elements of the Psychophysics toolbox were used for running the experiment (Pelli, 1997). Code for data analysis was also written in Matlab v2010b (The MathWorks, Inc., Natick, MA, USA).
Experiments were performed in a dimly lit room (∼10 lux) and stimulus Michelson contrast was 90%. One block of eight practice trials were performed before data collection to make participants familiar with calibration and with the task, a second block of practice was given when participants did predominantly errors in the practice trials or expressed difficulties to understand their task. A five-point calibration procedure was applied, only participants with calibration accuracy (mean deviation for the expected position) of 1° or less in both x-axis and y-axis were considered. Participants were seated 70 cm from the monitor with their head restrained with a headband attached to the seat.
The paradigm shown in Fig. 1 consisted of two steps. Step 1: subjects had to fixate a centrally located target (cross) during a variable interval of 1,250 or 1,600 ms, intervals were assigned in a random order. The fixation target for step 1 was only visible after fixating a gaze-contingent box for 150 ms. Step 2: after the interval defined for step 1, a peripheral target was presented at 5° or 10° of visual angle at right or left side of the fixation target, all locations were assigned in random order. Before data collection and during practice trials subjects were clearly instructed to look to the empty side of the screen to a position equivalent to where the target was visible: an AS. They were also instructed to perform this movement as quickly as possible. Each subject performed 40 trials and the duration of the task was approximately 3 min.
Neuropsychological tests
A battery of tests was chosen to characterise the cognitive status of our participants with MS. The neuropsychological tests used were: (1) BDI (Beck, Steer & Carbin, 1988; Serra & Abreu, 1973); (2) Montreal Cognitive Assessment (Freitas et al., 2010; Nasreddine et al., 2005); (3) Digit Span (WAIS-III: Wechsler Adult Intelligence Scale—Version III) and (4) Trail Making Test, Part A (Bucks, 2013; Cavaco et al., 2013; Seabra-Santos et al., 2003; Tombaugh, 2004; Wechsler, 1997); (5) Symbol Digit Modalities Test (SDMT) (Da Costa Pinto, 2004; Smith, 1968); (6) Controlled Oral Word Association Test (COWAT) for phonetic fluency (Cavaco et al., 2013; Heaton et al., 2004; Tombaugh, Kozak & Rees, 1999); (7) A total of 20 Questions Test from Delis-Kaplan Executive Function System (DKEFS 20Q) (Delis, Kaplan & Kramer, 2001; Stephens, 2014); (8) Stroop Colour-Word test. All neuropsychological tests have normative data for the Portuguese population (tests have been translated into the Portuguese language and administered to native Portuguese speakers), results from the MS group are compared with the normative values in Table 2. These tests were not performed by controls and were performed by MS participants after the AS task.
The final score of the Stroop colour-word test corresponds to the number of correctly reported colours in 45 s, the maximum possible score is 100 (Castro, Martins & Cunha, 2003; Golden, 1975). We scored the Stroop test using different methods that have been described by others (Denney & Lynch, 2009; Sisco et al., 2016) and formulas are specified in Table 3. We used different formulas to cover different scenarios because there are reports in the literature showing that two different formulas applied to the same data can lead to opposite conclusions (Denney & Lynch, 2009; Sisco et al., 2016).
Table 3. Summary of Stroop results for the multiple sclerosis group.
Stroop test score | Values | |
---|---|---|
Mean (SD) | Median (IQR) | |
Word reading (W) | 90.97 (13.01) | 95.00 (5.00) |
Colour naming (C) | 69.50 (9.99) | 69.00 (5.75) |
Interference | ||
Raw (CW = correct colours in 45 s) | 35.50 (9.04) | 38.00 (5.75) |
Golden = ((W × C)/(W + C)) − CW | −3.35 (7.50) | −0.55 (3.85) |
Relative = ((C − CW/C) × 100 | 48.08 (10.47) | 43.28 (7.16) |
Ratio = (C/CW) × 10 | 19.54 (3.74) | 17.63 (2.56) |
Note:
Formulas for each score are specified in the table (SD = standard deviation, IQR = interquartile range).
Data analysis
Eye movements were collected binocularly with the point-of-regard (POR) information being: (PORright + PORleft)/2, that is the mean POR of both eyes. AS latency is shown in Fig. 1B and represents the period of time from target onset until the reaction of the eyes moving towards the mirrored target location. For analysed trials, AS detection was performed after smoothing xy positions with a five-sample moving average. This method has been proposed and used to reduce noise (Engbert & Kliegl, 2003; Ferreira et al., 2017). After smoothing, eye velocity and acceleration were computed, saccades were detected using the velocity threshold of 30°/s and/or acceleration threshold of 8,500°/s2 with a minimum duration of 12 ms (Macedo, Crossland & Rubin, 2008, 2011), microsaccades were ignored (Martinez-Conde, Macknik & Hubel, 2004).
In addition to the number of errors and peak-velocity, three latencies were computed: (1) AS, (2) prosaccades and (3) corrective saccades. When the first saccade is made towards the target the movement is defined as a prosaccade and corresponds to an error. When after a prosaccade participants made a saccade away from the target this is defined as corrective saccade, the interval between the prosaccade and the corrective saccade is defined as corrective saccade latency. Corrective saccades were considered when its amplitude was 2° or more and performed away from the target.
Statistical analysis
The normality of the variables was tested using the Kolmogorov–Smirnov test. Differences between neuropsychological results and normative values for the Portuguese population were verified with t-test, the difference in number of errors between groups was evaluated with t-test as well.
The effect of group, direction and eccentricity on AS parameters was tested with linear mixed models (LMM) in SPSS (IBM SPSS Statistics for Windows, Version 22.0. IBM Corp, Armonk, NY, USA) and R (lme4 package) (Bates et al., 2015; Ferreira et al., 2017; Kliegl et al., 2010). For this analysis eye movements parameters reported were defined as ‘dependent variable’ or ‘response variable of interest’ (e.g. latency). Participants were defined as ‘random factors’ or ‘group specific effects.’ Explanatory factors or ‘fixed factors’ were: ‘group’ (MS and Control), ‘direction’ (right and left), ‘eccentricity’ (5° and 10°) and ‘saccade type’ (antisaccade, prosaccade and corrective). Bonferroni correction was applied for multiple comparisons. Means described in the text and shown in graphs are the estimated marginal means (EMM = mean response for each variable, adjusted for any other variables in the model) and their standard errors (SEs) for the specified factors. Correlations between neuropsychological tests and AS parameters were also tested.
Results
Demographic characteristics of the 38 participants for each group are summarised in Table 1. Table 2 summarises the comparisons between the normative values for the neuropsychological testes and the results for our participants. Table 3 summarises the Stroop test results scored in accordance with different formulas.
AS errors
There was no effect of eccentricity in any of the AS results analysed and therefore results for 5° and 10° are reported together. The mean proportion of directional errors was 26% (SD = 18) for the MS group and 16% (SD = 11) for the control group. The mean difference of 10% in the number of errors between the MS group and the control group was statistically significant, t(60) = 2.8 (p = 0.007, unequal variances considered).
AS latency
Latency results are shown in Fig. 2. A model (LMM) with four fixed factors was run (group: patients or controls; saccade type: AS, prosaccades or corrective; eccentricity: 5° or 10°; direction of the eye movement: left or right) to compare latencies. Only statistically significant effects are reported. There was a main effect of group F(1, 88) = 6.4 (p = 0.013) and an interaction group × saccade type F(2, 2382) = 24 (p < 0.001). There was also a main effect of saccade type F(2, 2382) = 1,298 (p < 0.001) and trial direction F = (1, 2367) = 25 (p < 0.001). The directional effect has been reported before and is likely to be explained by the higher frequency of right-eye dominance (Vergilino-Perez et al., 2012).
Antisaccades latency was higher in the MS group than in controls, the EMM in the MS group was 325 ms (SE = 6.0) and 280 ms (SE = 6.0) in the control group. The difference between means was 45 ms, t(2,362) = 5.1 (p < 0.001). The latency of prosaccades was different from the latency of corrective saccades and both were different from the latency of AS. The mean latency for prosaccades was 209 ms (SE = 5.0), for corrective saccades was 161 ms (SE = 5.0), the difference between means was 47 ms, t(2,362) = −8.4 (p < 0.001). The mean difference between eye movements performed to the right (target presented at left) and to the left (target presented at right) was 10 ms, t(2,362) = −5.3 (p < 0.001). Differences in latency for prosaccades and corrective saccades between groups were not statistically significant, more details are given in supplemental files.
AS peak-velocity
A model similar to that reported for latency was used to determine differences in peak-velocity. Here we found two main effects: saccade type F(2, 2377) = 98 (p < 0.001) and trial direction F(1, 2366) = 24 (p < 0.001). The mean difference in peak-velocity between right (EMM = 288°/s, SE = 7.0) and left (EMM = 275°/s, SE = 7.0) AS was 13°/s, t(2,362) = −4.84 (p < 0.001). Corrective saccades (EMM = 321°/s, SE = 7.8) showed higher peak-velocities than prosaccades (EMM = 260°/s, SE = 7.9) and AS (EMM = 263°/s, SE = 6.9). The mean difference between prosaccades and corrective saccades was 60°/s, t(2,362) = −11.51 (p < 0.001) and between corrective and AS was 58°/s, t(2,362) = 13.81 (p < 0.001). Differences in peak-velocity, for all types of saccades, between groups were not statistically significant. More details are given in supplemental files.
Correlations between neuropsychological tests and antisaccades
Correlations between Stroop test scores and neuropsychological tests scores are summarised in Table 4. The neuropsychological tests are categorised for the main cognitive function assessed.
Table 4. Correlations between the Stroop test and other neuropsychological measures (‘Test’ column).
Test | Measure | Stroop | Stroop interference | ||||
---|---|---|---|---|---|---|---|
Word reading | Colour naming | Raw | Golden | Relative | Ratio | ||
MOCA (n = 38) | General | r = 0.32 p = 0.05 | ns | r = 0.42 p = 0.01 | ns | ns | r = −0.32 p = 0.050 |
WAISIII digit span (n = 28ϕ) | Memory attention | ns | ns | r = 0.44 p = 0.018 | ns | ns | ns |
Trail making A (n = 37) | Attention | r = −0.33 p = 0.05 | ns | ns | ns | ns | ns |
SDMT (n = 37ϕ) | Processing | ns | ns | r = 0.48 p = 0.003 | r = 0.37 p = 0.024 | r = 0.36 p = 0.028 | ns |
COWAT (n = 38) | Executive | ns | ns | r = 0.37 p = 0.021 | r = 0.32 p = 0.052 | r = −0.47 p = 0.003 | r = −0.33 p = 0.042 |
DKEFS 20Q (n = 37ϕ) | Executive | ns | ns | ns | ns | ns | ns |
Note:
When n is less than 38 is because there was missing data from the neuropsychological test. Executive = Executive function; General = General cognitive function; Processing = Processing speed measure. “ns” = the correlation is not statistically significant.
Correlations between Stroop test and latency of AS, prosaccades and corrective saccades, are summarised in Table 5. The correlations between scores of all other neuropsychological tests, AS errors and latency were not statistically significant.
Table 5. Correlation between antisaccades measures and Stroop interference scores.
Anti-saccades | Stroop interference | |||
---|---|---|---|---|
Raw | Golden | Relative | Ratio | |
Errors | ns | ns | ns | ns |
AS latency | r = −0.35, p = 0.034 (n = 38) | r = −0.33, p = 0.044 (n = 38) | r = −0.41, p = 0.01 (n = 38) | r = −0.38, p = 0.018 (n = 38) |
Prosaccade latency | ns | ns | r = −0.33, p = 0.039 (n = 38) | ns |
Corrective latency | r = −0.43, p = 0.011 (n = 35) | ns | ns | ns |
Note:
Errors, prosaccades and corrective saccades are defined in the methods section.
Discussion
Deficits in inhibitory control, that is, the ability to suppress prepotent but incorrect responses, are expected in people diagnosed with MS. The Stroop interference task and the antisaccade task both require good inhibitory control and; therefore, the performance of patients with MS in these tasks is likely to be impaired (Carter & Van Veen, 2007; Johnston & Everling, 2011). In this study we hypothesise that the antisaccade task can be a quantitative surrogate marker of neural damage leading to impairment in inhibitory control in people with MS. In the present study we investigated whether Stroop and AS performances are altered in people with MS and if both performances are correlated. In line with our hypotheses AS and Stroop performances were impaired and correlated. These findings are in agreement with other studies and are particularly relevant because the disease in our group of patients was at early stages—median EDSS 1.5 in a 0–10 scale, see Table 1 (Kolbe et al., 2014; Ting et al., 2015). The AS task remains a research tool because measuring and analysing eye movements requires specialised equipment and training that still note available to use in clinics. Also, the extraction of results is time-consuming and data recording protocols need standardization (Antoniades et al., 2013). Although, we must acknowledge that we found the results reported in the literature, from different laboratories and acquired with different equipment, remarkably consistent. For a good review of the clinical utility of AS task and other eye movements metrics in MS we recommend a recent review by Serra (Serra, Chisari & Matta, 2018).
Our results show a consistent association between the interference Stroop test performance and AS latency. Of note, Stroop performance—but not AS latency—was associated with other cognitive measures such as processing speed (measured with the SDMT) and verbal fluency/executive function (measure with COWAT) (Whiteside et al., 2016). These findings suggest that the Stroop performance can be influenced by unspecific cognitive deficits (Denney & Lynch, 2009). In contrast, AS performance in our study was not correlated with cognitive, visual and socio-demographic aspects. Nevertheless, the AS task is likely to be affected by reduced visual acuity, poor comprehension of the instructions or slow cognitive response. To our knowledge, our study is the first to show the association between Stroop and AS tasks in patients with MS. Although, there is a recent study by Ting showing a equivalent association in patients with mild traumatic brain injury and concussion (Ting et al., 2015). Previous studies also pointed that different methods to compute Stroop scores would lead to different conclusions about the cognitive status of patients with neurological diseases (Sisco et al., 2016). To cover this aspect, our comparison included Stroop interference scores computed using different formulas. Notwithstanding the approach tested, the association between Stroop interference scores and AS latency was consistent, further suggesting its biological significance. Below we discuss in detail the consistency and the implications of our AS findings.
AS performance was worse in patients with MS than in controls. These results are in line with other studies investigating AS in MS (Fielding et al., 2012, 2009; Kolbe et al., 2014) and other neurological diseases (Crawford et al., 2005; Peltsch et al., 2008; Ting et al., 2015). We noticed that the number of directional errors in our control group was higher than the values reported by Fielding that reported only about 10% (Fielding et al., 2009). However, according to Hutton, healthy individuals can have a proportion of directional errors up to 20% in AS tasks (Hutton, 2008). In our study, the latency values in both groups are in good agreement with previous studies (Aichert et al., 2012; Fielding et al., 2009). Increased latency in the MS group can be explained considering the competition model described before. Poor performance in the AS task in MS is likely to occur because of a slow cognitive response that is due to increased neural recruitment that is necessary to compensate for reduced neural transmission (Amador, Schlag-Rey & Schlag, 2004; Chiaravalloti & DeLuca, 2008; Crawford et al., 2002). We speculate that MS is reducing the cognitive ability to process the vector inversion (suppression a prosaccadic reflex (Edelman, Valenzuela & Barton, 2006)) to program a volitional saccade. The possible consequences of a reduced cognitive ability to process the vector inversion are: (1) an increased time to perform the AS or (2) a prosaccade wins the competition (error). Impaired neural transmission that increases latency and probably also error rates is likely to occur in areas of the frontal cortex such as DLPFC and ACC (Amador, Schlag-Rey & Schlag, 2004; Johnston & Everling, 2011; Miller & Cohen, 2001). However, some studies mention lesions in other areas of the brain associated with reduced AS performance (Kolbe et al., 2014; Ting et al., 2015).
Differences between groups for prosaccades and corrective saccades latency and peak-velocities (for all types of saccades) were not statistically significant. Our interpretation of a lack of statistically significant differences for the latency is that—the generation of reflexive prosaccades and corrective saccades was not compromised in our MS participants. Our findings for controls, are consistent with the results from Evdokimidis in which the mean value of prosaccades latency from a sample of 2,006 young men was 208 ms (Evdokimidis et al., 2002) and corrective saccades is typically 130 ms (Tatler & Hutton, 2007). These results are in line with results from other studies in MS (Fielding et al., 2009) and in other neurological diseases (Crawford et al., 2005). The lack of statistically significant differences in peak-velocities between groups for all types of saccades (AS, pro and corrective saccades) is reassuring because this indicates that internuclear ophthalmoplegia was unlikely in our participants with MS (Bird & Leech, 1976). Conversely, the difference in peak-velocities between AS and, for example, corrective saccades was obtained as expected. Corrective saccades are associated with larger amplitudes and it is known that peak-velocities increase with amplitude according with a relationship defined by the main sequence (Leigh & Kennard, 2004). In summary, latencies for prosaccades and corrective saccades and peak-velocities indicate that the integrity of the oculomotor plant was well preserved in our participants with MS.
One limitation of the current study is the lack of experimental data measuring neurocognitive performance in controls and that reduces the strength of the neurocognitive comparisons between groups. It has also been pointed during revision that the validity of our findings may be limited because: (a) differences between groups in the AS task may be driven by other aspects of MS, rather than deficits in inhibitory control per se; and (b) is unclear that AS measures are selective for MS per se, or if the same differences would be present in other comorbid conditions (excluded from the tested population). Concerning (a), we performed a comprehensive characterization of the neurocognitive performance in the MS group and measured its association with the results of Stroop and the AS task. These experimental decisions were made to minimise this possible limitation imposed by multiples deficits caused by MS. Concerning (b), comorbid conditions that can interfere with AS performance were excluded in the sample tested.
Conclusions
Our findings suggest that AS may be a selective and independent measure to investigate inhibitory control in patients with MS. More studies are necessary to confirm our results and to describe brain correlates associated with impaired performance in the AS task in people diagnosed with MS.
Supplemental Information
Acknowledgments
We would like to thank the Clinical and Academic Centre (2CA-Hospital de Braga) for providing facilities for data collection. We also want to acknowledge: (i) Carla Sofia Ferreira for scheduling all the MS participants and most of the controls; (ii) one anonymous reviewer for his opinion about an early version of this manuscript; and (iii) Dora Marques for her help with data collection. Parts of this work have been presented at 3rd International Porto Congress of Multiple Sclerosis, February 27–28, 2015, Porto, Portugal and ARVO 2015 annual meeting, May 3–7, Denver, Colorado. In ARVO 2015 the number of participants was different because the neuropsychological tests were only performed in a sub-group of participants with MS.
Funding Statement
The Vision Rehabilitation Lab and Antonio Filipe Macedo receive or received funding from Shamir Optical Industry Lt, Portugal, from grants PTDC/DTP-EPI/0412/2012 (Prevalence and Costs of Visual Impairment in Portugal) and UID/FIS/04650/2013 (Framework of the Strategic Funding granted to Centre of Physics at Minho University). Multiple Sclerosis Association “Todos com a Esclerose Multiple” paid the salary of Marisa Borges Ferreira. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Additional Information and Declarations
Competing Interests
The authors declare that they have no competing interests.
Author Contributions
Marisa Borges Ferreira conceived and designed the experiments, performed the experiments, analysed the data, prepared figures and/or tables, authored or reviewed drafts of the paper, approved the final draft.
Paulo Alexandre Pereira conceived and designed the experiments, authored or reviewed drafts of the paper, approved the final draft, funding.
Marta Parreira conceived and designed the experiments, performed the experiments, analysed the data, authored or reviewed drafts of the paper, approved the final draft.
Ines Sousa conceived and designed the experiments, analysed the data, authored or reviewed drafts of the paper, approved the final draft.
José Figueiredo Figueiredo conceived and designed the experiments, authored or reviewed drafts of the paper, approved the final draft.
João José Cerqueira conceived and designed the experiments, contributed reagents/materials/analysis tools, authored or reviewed drafts of the paper, approved the final draft, recruitment and selection.
Antonio Filipe Macedo conceived and designed the experiments, performed the experiments, analyzed the data, prepared figures and/or tables, authored or reviewed drafts of the paper, approved the final draft.
Human Ethics
The following information was supplied relating to ethical approvals (i.e., approving body and any reference numbers):
The ethics committee at University of Minho granted ethical approval to carry out the study, ref: SECVS 083-2013.
Data Availability
The following information was supplied regarding data availability:
The raw data and R code are provided in the Supplemental Files.
References
- Aichert et al. (2012).Aichert DS, Williams SC, Moller HJ, Kumari V, Ettinger U. Functional neural correlates of psychometric schizotypy: an fMRI study of antisaccades. Psychophysiology. 2012;49(3):345–356. doi: 10.1111/j.1469-8986.2011.01306.x. [DOI] [PubMed] [Google Scholar]
- Amador, Schlag-Rey & Schlag (2004).Amador N, Schlag-Rey M, Schlag J. Primate antisaccade. II. Supplementary eye field neuronal activity predicts correct performance. Journal of Neurophysiology. 2004;91(4):1672–1689. doi: 10.1152/jn.00138.2003. [DOI] [PubMed] [Google Scholar]
- Antoniades et al. (2013).Antoniades C, Ettinger U, Gaymard B, Gilchrist I, Kristjánsson A, Kennard C, John Leigh R, Noorani I, Pouget P, Smyrnis N, Tarnowski A, Zee DS, Carpenter RHS. An internationally standardised antisaccade protocol. Vision Research. 2013;84:1–5. doi: 10.1016/j.visres.2013.02.007. [DOI] [PubMed] [Google Scholar]
- Asaad, Rainer & Miller (2000).Asaad WF, Rainer G, Miller EK. Task-specific neural activity in the primate prefrontal cortex. Journal of Neurophysiology. 2000;84(1):451–459. doi: 10.1152/jn.2000.84.1.451. [DOI] [PubMed] [Google Scholar]
- Bates et al. (2015).Bates D, Mächler M, Bolker B, Walker S. Fitting linear mixed-effects models using lme4. Journal of Statistical Software. 2015;67(1):48. doi: 10.18637/jss.v067.i01. [DOI] [Google Scholar]
- Beck, Steer & Carbin (1988).Beck AT, Steer RA, Carbin MG. Psychometric properties of the beck depression inventory: twenty-five years of evaluation. Clinical Psychology Review. 1988;8(1):77–100. doi: 10.1016/0272-7358(88)90050-5. [DOI] [Google Scholar]
- Ben-David & Schneider (2010).Ben-David BM, Schneider BA. A sensory origin for color-word stroop effects in aging: simulating age-related changes in color-vision mimics age-related changes in Stroop. Aging, Neuropsychology, and Cognition. 2010;17(6):730–746. doi: 10.1080/13825585.2010.510553. [DOI] [PubMed] [Google Scholar]
- Bird & Leech (1976).Bird AC, Leech J. Internuclear ophthalmoplegia. An electro-oculographic study of peak angular saccadic velocities. British Journal of Ophthalmology. 1976;60(9):645–651. doi: 10.1136/bjo.60.9.645. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Botvinick et al. (2001).Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD. Conflict monitoring and cognitive control. Psychological Review. 2001;108(3):624–652. doi: 10.1037/0033-295X.108.3.624. [DOI] [PubMed] [Google Scholar]
- Bucks (2013).Bucks RS. Trail-making test. In: Gellman MD, Turner JR, editors. Encyclopedia of Behavioral Medicine. New York: Springer; 2013. pp. 1986–1987. [Google Scholar]
- Carter & Van Veen (2007).Carter CS, Van Veen V. Anterior cingulate cortex and conflict detection: an update of theory and data. Cognitive, Affective, & Behavioral Neuroscience. 2007;7(4):367–379. doi: 10.3758/cabn.7.4.367. [DOI] [PubMed] [Google Scholar]
- Castro, Martins & Cunha (2003).Castro SL, Martins L, Cunha L. 111th Annual Convention of the American Psychological Association. Toronto: 2003. Neuropsychological screening with a Portuguese Stroop test. [Google Scholar]
- Cavaco et al. (2013).Cavaco S, Gonçalves A, Pinto C, Almeida E, Gomes F, Moreira I, Fernandes J, Teixeira-Pinto A. Semantic fluency and phonemic fluency: regression-based norms for the Portuguese population. Archives of Clinical Neuropsychology. 2013;28(3):262–271. doi: 10.1093/arclin/act001. [DOI] [PubMed] [Google Scholar]
- Chiaravalloti & DeLuca (2008).Chiaravalloti ND, DeLuca J. Cognitive impairment in multiple sclerosis. Lancet Neurology. 2008;7(12):1139–1151. doi: 10.1016/s1474-4422(08)70259-x. [DOI] [PubMed] [Google Scholar]
- Crawford et al. (2002).Crawford TJ, Bennett D, Lekwuwa G, Shaunak S, Deakin JFW. Cognition and the inhibitory control of saccades in schizophrenia and Parkinson’s disease. Progress in Brain Research. 2002;140:449–466. doi: 10.1016/s0079-6123(02)40068-4. [DOI] [PubMed] [Google Scholar]
- Crawford et al. (2005).Crawford TJ, Higham S, Renvoize T, Patel J, Dale M, Suriya A, Tetley S. Inhibitory control of saccadic eye movements and cognitive impairment in Alzheimer’s disease. Biological Psychiatry. 2005;57(9):1052–1060. doi: 10.1016/j.biopsych.2005.01.017. [DOI] [PubMed] [Google Scholar]
- Da Costa Pinto (2004).Da Costa Pinto A. Diferenças de sexo em provas de memória operatória, memória episódica e teste de símbolos. Psicologia, Educação e Cultura. 2004;8:7–19. [Google Scholar]
- Delis, Kaplan & Kramer (2001).Delis DC, Kaplan E, Kramer JH. Delis-Kaplan Executive Function System (D-KEFS) examiner’s manual. San Antonio, TX: The Psychological Corporation; 2001. pp. 1–218. [Google Scholar]
- Denney & Lynch (2009).Denney DR, Lynch SG. The impact of multiple sclerosis on patients’ performance on the Stroop Test: processing speed versus interference. Journal of the International Neuropsychological Society. 2009;15(3):451–458. doi: 10.1017/s1355617709090730. [DOI] [PubMed] [Google Scholar]
- Edelman, Valenzuela & Barton (2006).Edelman JA, Valenzuela N, Barton JJS. Antisaccade velocity, but not latency, results from a lack of saccade visual guidance. Vision Research. 2006;46(8–9):1411–1421. doi: 10.1016/j.visres.2005.09.013. [DOI] [PubMed] [Google Scholar]
- Engbert & Kliegl (2003).Engbert R, Kliegl R. Microsaccades uncover the orientation of covert attention. Vision Research. 2003;43(9):1035–1045. doi: 10.1016/s0042-6989(03)00084-1. [DOI] [PubMed] [Google Scholar]
- Ettinger et al. (2008).Ettinger U, Ffytche DH, Kumari V, Kathmann N, Reuter B, Zelaya F, Williams SCR. Decomposing the neural correlates of antisaccade eye movements using event-related FMRI. Cerebral Cortex. 2008;18(5):1148–1159. doi: 10.1093/cercor/bhm147. [DOI] [PubMed] [Google Scholar]
- Evdokimidis et al. (2002).Evdokimidis I, Smyrnis N, Constantinidis TS, Stefanis NC, Avramopoulos D, Paximadis C, Theleritis C, Efstratiadis C, Kastrinakis G, Stefanis CN. The antisaccade task in a sample of 2,006 young men. I. Normal population characteristics. Experimental Brain Research. 2002;147(1):45–52. doi: 10.1007/s00221-002-1208-4. [DOI] [PubMed] [Google Scholar]
- Ferreira et al. (2017).Ferreira M, Pereira PA, Parreira M, Sousa I, Figueiredo J, Cerqueira JJ, Macedo AF. Using endogenous saccades to characterize fatigue in multiple sclerosis. Multiple Sclerosis and Related Disorders. 2017;14:16–22. doi: 10.1016/j.msard.2017.01.014. [DOI] [PubMed] [Google Scholar]
- Fielding et al. (2012).Fielding J, Kilpatrick T, Millist L, Clough M, White O. Longitudinal assessment of antisaccades in patients with multiple sclerosis. PLOS ONE. 2012;7(2):e30475. doi: 10.1371/journal.pone.0030475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fielding et al. (2009).Fielding J, Kilpatrick T, Millist L, White O. Antisaccade performance in patients with multiple sclerosis. Cortex. 2009;45(7):900–903. doi: 10.1016/j.cortex.2009.02.016. [DOI] [PubMed] [Google Scholar]
- Freitas et al. (2010).Freitas S, Simões MR, Martins C, Vilar M, Santana I. Estudos de adaptação do Montreal Cognitive Assessment (MoCA) para a população portuguesa. Avaliação Psicológica. 2010;9:345–357. [Google Scholar]
- Frohman et al. (2005).Frohman EM, Frohman TC, Zee DS, McColl R, Galetta S. The neuro-ophthalmology of multiple sclerosis. Lancet Neurology. 2005;4(2):111–121. doi: 10.1016/s1474-4422(05)00992-0. [DOI] [PubMed] [Google Scholar]
- Golden (1975).Golden CJ. A group version of the Stroop Color and Word Test. Journal of Personality Assessment. 1975;39(4):386–388. doi: 10.1207/s15327752jpa3904_10. [DOI] [PubMed] [Google Scholar]
- Heaton et al. (2004).Heaton RK, Miller SW, Taylo MJ, Grant I. Revised Comprehensive Norms for and Expanded Halstead-Reitan Battery: Demographically Adjusted Neurophyschological Norms for African America and Caucasian Adults. Lutz: PAR; 2004. [Google Scholar]
- Heuer et al. (2013).Heuer HW, Mirsky JB, Kong EL, Dickerson BC, Miller BL, Kramer JH, Boxer AL. Antisaccade task reflects cortical involvement in mild cognitive impairment. Neurology. 2013;81(14):1235–1243. doi: 10.1212/WNL.0b013e3182a6cbfe. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Homack & Riccio (2004).Homack S, Riccio CA. A meta-analysis of the sensitivity and specificity of the Stroop color and word test with children. Archives of Clinical Neuropsychology. 2004;19(6):725–743. doi: 10.1016/j.acn.2003.09.003. [DOI] [PubMed] [Google Scholar]
- Hutton (2008).Hutton SB. Cognitive control of saccadic eye movements. Brain and Cognition. 2008;68(3):327–340. doi: 10.1016/j.bandc.2008.08.021. [DOI] [PubMed] [Google Scholar]
- Hutton & Ettinger (2006).Hutton SB, Ettinger U. The antisaccade task as a research tool in psychopathology: a critical review. Psychophysiology. 2006;43(3):302–313. doi: 10.1111/j.1469-8986.2006.00403.x. [DOI] [PubMed] [Google Scholar]
- Johnston & Everling (2011).Johnston K, Everling S. Frontal cortex and saccadic control. In: Liversedge SP, Gilchrist ID, Everling S, editors. The Oxford Handbook of Eye Movements. New York: Oxford UP; 2011. pp. 279–302. [Google Scholar]
- Keegan & Noseworthy (2002).Keegan BM, Noseworthy JH. Multiple sclerosis. Annual Review of Medicine. 2002;53(1):285–302. doi: 10.1146/annurev.med.53.082901.103909. [DOI] [PubMed] [Google Scholar]
- Kliegl et al. (2010).Kliegl R, Wei P, Dambacher M, Yan M, Zhou X. Experimental effects and individual differences in linear mixed models: estimating the relationship between spatial, object, and attraction effects in visual attention. Frontiers in Psychology. 2010;1:238. doi: 10.3389/fpsyg.2010.00238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolbe et al. (2014).Kolbe SC, Kilpatrick TJ, Mitchell PJ, White O, Egan GF, Fielding J. Inhibitory saccadic dysfunction is associated with cerebellar injury in multiple sclerosis. Human Brain Mapping. 2014;35(5):2310–2319. doi: 10.1002/hbm.22329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kristjansson (2007).Kristjansson A. Saccade landing point selection and the competition account of pro- and antisaccade generation: the involvement of visual attention—a review. Scandinavian Journal of Psychology. 2007;48(2):97–113. doi: 10.1111/j.1467-9450.2007.00537.x. [DOI] [PubMed] [Google Scholar]
- Kurtzke (1983).Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS) Neurology. 1983;33(11):1444–1452. doi: 10.1212/wnl.33.11.1444. [DOI] [PubMed] [Google Scholar]
- Leigh & Kennard (2004).Leigh RJ, Kennard C. Using saccades as a research tool in the clinical neurosciences. Brain. 2004;127(3):460–477. doi: 10.1093/brain/awh035. [DOI] [PubMed] [Google Scholar]
- Lemos et al. (2016).Lemos J, Pereira D, Almendra L, Rebelo D, Patricio M, Castelhano J, Cunha G, Januario C, Cunha L, Freire A, Castelo-Branco M. Distinct functional properties of the vertical and horizontal saccadic network in Health and Parkinson’s disease: an eye-tracking and fMRI study. Brain Research. 2016;1648:469–484. doi: 10.1016/j.brainres.2016.07.037. [DOI] [PubMed] [Google Scholar]
- MacDonald et al. (2000).MacDonald AW, 3rd, Cohen JD, Stenger VA, Carter CS. Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science. 2000;288(5472):1835–1838. doi: 10.1126/science.288.5472.1835. [DOI] [PubMed] [Google Scholar]
- Macedo, Crossland & Rubin (2008).Macedo AF, Crossland MD, Rubin GS. The effect of retinal image slip on peripheral visual acuity. Journal of Vision. 2008;8(14):16. doi: 10.1167/8.14.16. [DOI] [PubMed] [Google Scholar]
- Macedo, Crossland & Rubin (2011).Macedo AF, Crossland MD, Rubin GS. Investigating unstable fixation in patients with macular disease. Investigative Opthalmology & Visual Science. 2011;52(3):1275–1280. doi: 10.1167/iovs.09-4334. [DOI] [PubMed] [Google Scholar]
- Martinez-Conde, Macknik & Hubel (2004).Martinez-Conde S, Macknik SL, Hubel DH. The role of fixational eye movements in visual perception. Nature Reviews Neuroscience. 2004;5(3):229–240. doi: 10.1038/nrn1348. [DOI] [PubMed] [Google Scholar]
- Martinez-Lapiscina et al. (2014).Martinez-Lapiscina EH, Ortiz-Perez S, Fraga-Pumar E, Martinez-Heras E, Gabilondo I, Llufriu S, Bullich S, Figueras M, Saiz A, Sanchez-Dalmau B, Villoslada P. Colour vision impairment is associated with disease severity in multiple sclerosis. Multiple Sclerosis Journal. 2014;20(9):1207–1216. doi: 10.1177/1352458513517591. [DOI] [PubMed] [Google Scholar]
- Miller & Cohen (2001).Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annual Review of Neuroscience. 2001;24(1):167–202. doi: 10.1146/annurev.neuro.24.1.167. [DOI] [PubMed] [Google Scholar]
- Moon et al. (2007).Moon SY, Barton JJS, Mikulski S, Polli FE, Cain MS, Vangel M, Hamalainen MS, Manoach DS. Where left becomes right: a magnetoencephalographic study of sensorimotor transformation for antisaccades. NeuroImage. 2007;36(4):1313–1323. doi: 10.1016/j.neuroimage.2007.04.040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Munoz & Everling (2004).Munoz DP, Everling S. Look away: the anti-saccade task and the voluntary control of eye movement. Nature Reviews Neuroscience. 2004;5(3):218–228. doi: 10.1038/nrn1345. [DOI] [PubMed] [Google Scholar]
- Nasreddine et al. (2005).Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, Cummings JL, Chertkow H. The montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society. 2005;53(4):695–699. doi: 10.1111/j.1532-5415.2005.53221.x. [DOI] [PubMed] [Google Scholar]
- Olk & Kingstone (2003).Olk B, Kingstone A. Why are antisaccades slower than prosaccades? A novel finding using a new paradigm. NeuroReport. 2003;14(1):151–155. doi: 10.1097/00001756-200301200-00028. [DOI] [PubMed] [Google Scholar]
- Pa et al. (2014).Pa J, Dutt S, Mirsky JB, Heuer HW, Keselman P, Kong E, Trujillo A, Gazzaley A, Kramer JH, Seeley WW, Miller BL, Boxer AL. The functional oculomotor network and saccadic cognitive control in healthy elders. NeuroImage. 2014;95:61–68. doi: 10.1016/j.neuroimage.2014.03.051. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patti et al. (2009).Patti F, Amato MP, Trojano M, Bastianello S, Tola MR, Goretti B, Caniatti L, Di Monte E, Ferrazza P, Brescia Morra V, Lo Fermo S, Picconi O, Luccichenti G, For the COGIMUS Study Group Cognitive impairment and its relation with disease measures in mildly disabled patients with relapsing–remitting multiple sclerosis: baseline results from the cognitive impairment in multiple sclerosis (COGIMUS) study. Multiple Sclerosis Journal. 2009;15(7):779–788. doi: 10.1177/1352458509105544. [DOI] [PubMed] [Google Scholar]
- Pelli (1997).Pelli DG. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spatial Vision. 1997;10(4):437–442. doi: 10.1163/156856897x00366. [DOI] [PubMed] [Google Scholar]
- Peltsch et al. (2008).Peltsch A, Hoffman A, Armstrong I, Pari G, Munoz DP. Saccadic impairments in Huntington’s disease. Experimental Brain Research. 2008;186(3):457–469. doi: 10.1007/s00221-007-1248-x. [DOI] [PubMed] [Google Scholar]
- Pierrot-Deseilligny et al. (2003).Pierrot-Deseilligny C, Muri RM, Ploner CJ, Gaymard B, Demeret S, Rivaud-Pechoux S. Decisional role of the dorsolateral prefrontal cortex in ocular motor behaviour. Brain. 2003;126(6):1460–1473. doi: 10.1093/brain/awg148. [DOI] [PubMed] [Google Scholar]
- Protopapas, Archonti & Skaloumbakas (2007).Protopapas A, Archonti A, Skaloumbakas C. Reading ability is negatively related to Stroop interference. Cognitive Psychology. 2007;54(3):251–282. doi: 10.1016/j.cogpsych.2006.07.003. [DOI] [PubMed] [Google Scholar]
- Ruggieri et al. (2003).Ruggieri RM, Palermo R, Vitello G, Gennuso M, Settipani N, Piccoli F. Cognitive impairment in patients suffering from relapsing-remitting multiple sclerosis with EDSS < = 3.5. Acta Neurologica Scandinavica. 2003;108(5):323–326. doi: 10.1034/j.1600-0404.2003.00157.x. [DOI] [PubMed] [Google Scholar]
- Schwartz & Verhaeghen (2008).Schwartz K, Verhaeghen P. ADHD and Stroop interference from age 9 to age 41 years: a meta-analysis of developmental effects. Psychological Medicine. 2008;38(11):1607–1616. doi: 10.1017/s003329170700267x. [DOI] [PubMed] [Google Scholar]
- Seabra-Santos et al. (2003).Seabra-Santos MJ, Simões MR, Albuquerque CP, Pereira M, Almeida LS, Lopes AF. Avaliação psicológica: Instrumentos validados para a população portuguesa. Coimbra: Quarteto; 2003. Escala de Inteligência de Wechsler para a Idade Pré-Escolar e Primária; pp. 197–219. [Google Scholar]
- Serra & Abreu (1973).Serra ASV, Abreu JLP. Aferição dos quadros clıínicos depressivos: I. Ensaio de aplicação do “Inventário Depressivo de Beck” a uma amostra portuguesa de doentes deprimidos. Coimbra Médica. 1973;20:623–644. [Google Scholar]
- Serra, Chisari & Matta (2018).Serra A, Chisari CG, Matta M. Eye movement abnormalities in multiple sclerosis: pathogenesis, modeling, and treatment. Frontiers in Neurology. 2018;9:31. doi: 10.3389/fneur.2018.00031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Serra et al. (2003).Serra A, Derwenskus J, Downey DL, Leigh RJ. Role of eye movement examination and subjective visual vertical in clinical evaluation of multiple sclerosis. Journal of Neurology. 2003;250(5):569–575. doi: 10.1007/s00415-003-1038-8. [DOI] [PubMed] [Google Scholar]
- Sisco et al. (2016).Sisco SM, Slonena E, Okun MS, Bowers D, Price CC. Parkinson’s disease and the Stroop color word test: processing speed and interference algorithms. Clinical Neuropsychologist. 2016;30(7):1104–1117. doi: 10.1080/13854046.2016.1188989. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith (1968).Smith A. The symbol digit modalities test: a neuropsychologic test of learning and other cerebral disorders. In: Helmuth J, editor. Learning Disorders. Seattle: Special Child Publications; 1968. pp. 83–91. [Google Scholar]
- Stephens (2014).Stephens TL. The assessment of executive functioning using the delis-kaplan executive functions system (D-KEFS) In: Goldstein S, Naglieri JA, editors. Handbook of Executive Functioning. New York: Springer; 2014. pp. 209–222. [Google Scholar]
- Talanow et al. (2016).Talanow T, Kasparbauer AM, Steffens M, Meyhofer I, Weber B, Smyrnis N, Ettinger U. Facing competition: neural mechanisms underlying parallel programming of antisaccades and prosaccades. Brain and Cognition. 2016;107:37–47. doi: 10.1016/j.bandc.2016.05.006. [DOI] [PubMed] [Google Scholar]
- Tatler & Hutton (2007).Tatler BW, Hutton SB. Trial by trial effects in the antisaccade task. Experimental Brain Research. 2007;179(3):387–396. doi: 10.1007/s00221-006-0799-6. [DOI] [PubMed] [Google Scholar]
- Ting et al. (2015).Ting WKC, Schweizer TA, Topolovec-Vranic J, Cusimano MD. Antisaccadic eye movements are correlated with corpus callosum white matter mean diffusivity, Stroop performance, and symptom burden in mild traumatic brain injury and concussion. Frontiers in Neurology. 2015;6:271. doi: 10.3389/fneur.2015.00271. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tombaugh (2004).Tombaugh TN. Trail making test A and B: normative data stratified by age and education. Archives of Clinical Neuropsychology. 2004;19(2):203–214. doi: 10.1016/S0887-6177(03)00039-8. [DOI] [PubMed] [Google Scholar]
- Tombaugh, Kozak & Rees (1999).Tombaugh TN, Kozak J, Rees L. Normative data stratified by age and education for two measures of verbal fluency: FAS and animal naming. Archives of Clinical Neuropsychology. 1999;14(2):167–177. doi: 10.1093/arclin/14.2.167. [DOI] [PubMed] [Google Scholar]
- Vanderhasselt, De Raedt & Baeken (2009).Vanderhasselt MA, De Raedt R, Baeken C. Dorsolateral prefrontal cortex and Stroop performance: tackling the lateralization. Psychonomic Bulletin & Review. 2009;16(3):609–612. doi: 10.3758/pbr.16.3.609. [DOI] [PubMed] [Google Scholar]
- Vergilino-Perez et al. (2012).Vergilino-Perez D, Fayel A, Lemoine C, Senot P, Vergne J, Dore-Mazars K. Are there any left-right asymmetries in saccade parameters? Examination of latency, gain, and peak velocity. Investigative Opthalmology & Visual Science. 2012;53(7):3340–3348. doi: 10.1167/iovs.11-9273. [DOI] [PubMed] [Google Scholar]
- Wechsler (1997).Wechsler D. WAIS-III Administration and Scoring Manual. San Antonio, TX: The Psychological Corporation; 1997. [Google Scholar]
- Whiteside et al. (2016).Whiteside DM, Kealey T, Semla M, Luu H, Rice L, Basso MR, Roper B. Verbal fluency: language or executive function measure? Applied Neuropsychology: Adult. 2016;23(1):29–34. doi: 10.1080/23279095.2015.1004574. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The following information was supplied regarding data availability:
The raw data and R code are provided in the Supplemental Files.