Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2013 Oct 2;8(10):e69674. doi: 10.1371/journal.pone.0069674

On the Temporal Characteristics of Performance Variability in Attention Deficit Hyperactivity Disorder (ADHD)

Bernd Feige 1, Monica Biscaldi 2, Christopher W N Saville 2,3, Christian Kluckert 2, Stephan Bender 4, Ulrich Ebner-Priemer 5, Klaus Hennighausen 2, Reinhold Rauh 2, Christian Fleischhaker 2, Christoph Klein 2,3,*
Editor: Thomas Boraud6
PMCID: PMC3805479  PMID: 24204553

Abstract

Increased intra-subject variability of reaction times (ISV-RT) is one of the most consistent findings in attention-deficit/hyperactivity disorder (ADHD). Although the nature of this phenomenon is still unclear, it has been hypothesised to reflect interference from the Default Mode Network (DMN). So far, ISV-RT has been operationally defined either as a frequency spectrum of the underlying RT time series, or as a measure of dispersion of the RT scores distribution. Here, we use a novel RT analysis framework to link these hitherto unconnected facets of ISV-RT by determining the sensitivity of different measures of RT dispersion to the frequency content of the underlying RT time series. N=27 patients with ADHD and N=26 healthy controls performed several visual N-back tasks. Different measures of RT dispersion were repeatedly modelled after individual frequency bands of the underlying RT time series had been either extracted or suppressed using frequency-domain filtering. We found that the intra-subject standard deviation of RT preserves the “1/f noise” characteristic typical of human RT data. Furthermore and most importantly, we found that the ex-Gaussian parameter τ is rather exclusively sensitive to frequencies below 0.025 Hz in the underlying RT time series and that the particularly slow RTs, which nourish τ, occur regularly as part of an quasi-periodic, ultra-slow RT fluctuation. Overall, our results are compatible with the idea that ISV-RT is modulated by an endogenous, slowly fluctuating process that may reflect DMN interference.

Introduction

1: Intra-subject variability of reaction times is a current topic in ADHD research

Increased intra-subject variability of reaction times (ISV-RT) in attention-deficit hyperactivity disorder (ADHD) has turned from a neglected abnormality [1-3] to a field of productive research [4-9]. This increase in interest is in part due to evidence that ISV reflects a stable trait [10-12] and possibly a unitary construct that generalises across a broad range of tasks and sensory modalities [7,13,14]. Furthermore, ISV is both familial [15,16] and hereditary [17,18], thus qualifying as a candidate endophenotype of ADHD [1,19].

2: Specific measures of RT dispersion are required to characterise increased ISV in ADHD

However, while it is clear that patients with ADHD show increased RT variability, it is not clear what this actually reflects. Part of this ambiguity stems from the fact that in the vast majority of ADHD studies ISV has been quantified through the intra-subject standard deviation of RT (RTSD [8]). By summing up all deviations from the average, RTSD becomes sensitive to all such sources of ISV (e.g., fluctuations on different frequency scales, irregularly occurring particularly fast or slow responses, (non-)linear trends etc.), and is thus specific to none. Furthermore, while RTSD assumes Gaussian normality of the RT distribution, RT distributions are in fact skewed, with a long tail of slow responses. RT distributions instead resemble ex-Gaussian distributions, that is, convolutions of a Gaussian distribution with an exponential distribution [20-22]. The ex-Gaussian distribution parameters µ and σ represent mean and standard deviation, respectively, of the Gaussian component, while τ represents mean and standard deviation of the exponential component. The increased mean RT and RTSD found in ADHD appear to reflect increased τ, with normal µ and σ [23], suggesting that increased ISV could be the consequence of increased density of slow responses. Slow responses have been found to be preceded by reduced pre-stimulus activity in fMRI studies with healthy participants [24]; they may thus reflect temporary reductions in preparatory attention and, with regard to ADHD, have been metaphorically considered by some authors as “lapses in attention” due to a defective effort control mechanism [23]. Increased τ has been replicated consistently for children, adolescents and adults with ADHD so far [25-28]. But abnormally high σ has also been found in most of these studies (with the exception of the adults in [27]), suggesting that whatever drives the slow responses reflected in τ is not the only “ingredient” of increased ISV in ADHD.

3: Investigating temporal structures of RT time series reveals important features of ISV

While measures such as τ identify increased ISV as an abnormality in the RT distribution, other approaches consider the same data as reaction time series [29,30] and search for abnormalities in patients in the temporal structure of the time series. Castellanos et al. [3] were the first to analyse the periodic structure of RT series in patients with ADHD and reported increased power of RT oscillations around 0.05Hz, thus pointing to fluctuations with a cycle length of about 20 seconds. This finding has been replicated conceptually in other studies [11,31,26,32].

4: The aims of the present study

Referring to the first four sections of this article, the aims of the present study are as follows. As the same RT data can be considered as a dispersion of RT scores (see section 1.2) or a temporally structured RT time series (section 1.3), the aim of the present study is the characterisation of commonly used RT dispersion measures in terms of their frequency specificity. To that end, we focused on RTSD as the “gold standard” measure of ISV in ADHD, on τ and σ as the two ISV components of the ex-Gaussian model that contribute to RSTD, and on the consecutive standard deviation (“CSD”) as the standard deviation of the differenced time series (i.e., difference between subsequent RTs [33]) that has been considered to quantify moment-to-moment fluctuations of the process under scrutiny [7,34,35]. Our characterisation of dispersion measures by their frequency specificity employs standard filters to extract or suppress certain frequency bands in the RT time series before re-modelling the measures of RT dispersion (see methods and Figure 1).

Figure 1. Averages (solid lines) with 95% confidence intervals (dotted lines) are shown for controls (in black) and patients (in red).

Figure 1

The black bar above the x-axes in figures a and b indicates an uncorrected point-wise “p<.05” difference between the groups to provide an indication where group effect sizes are considerable. “Suppression filters” (upper, thick lines in Figure 1 c-f) demonstrate the impact of removing each particular frequency band from the RT time series on the group aggregate of the individual variability scores; the “extraction filters” (lower, thin lines in Figure 1 c-f) show the said measures of variability for each RT time series frequency band alone. Suppression and extraction filters are therefore complementary ways of visualising one and the same relationship.

Materials and Methods

1: Ethics statement

Our study had been approved by the ethics committee of the Universitätsklinikum Freiburg. Written informed consent was obtained from all parents whose child participated in the study.

2: Participants

Outpatients of the Department of Child and Adolescent Psychiatry who had received a diagnosis of ADHD according to DSM-IV criteria were recruited for the study. Diagnoses had been routinely obtained by experienced clinical psychologists and psychiatrists on the basis of (a) Conner’s parent and teacher rating scales, (b) medical files of the treating psychiatrist, and (c) interviews with the child and accompanying parent about the child’s patient history. Diagnostic information was complemented (d) by a video-taped clinical observation of child behaviour obtained in a group session with standardized situations (e.g., structured play, homework, test taking). An ADHD diagnosis was given if these sources yielded converging information. The diagnostic interview K-SADS-PL [36] was administered to parents and patients separately to confirm the ADHD diagnosis, accomplish DSM-IV-based subtype classification and screen for co-morbid disorders. Parents filled in the Child Behaviour Check List (CBCL [37]). Data from N=27 patients with an ADHD diagnosis (all males, mean age ± SD: 11.1±0.9 years, range: 9.9-12.5, mean IQ ± SD: 98.0±11.0, range: 81.6-116.9) were available for statistical analyses. Eight patients were of combined type (DSM-IV code: 314.01), 9 predominantly inattentive (314.00), 3 predominantly hyperactive-impulsive (314.02), and 6 were not further specified according to the K-SADS-PL algorithm (that is, “NOS”). At the time of the study, 21 patients were taking methylphenidate medication, which was interrupted for more than 24 hours before the testing day. In some participants ADHD was accompanied by one or more co-morbid disorders, namely conduct disorder (N=3) and/or encopresis, enuresis (N=3). N=26 healthy controls (all males, mean age ± SD: 11.7±0.9 years, range 10.0-12.0; mean IQ ± SD: 99.6±14.3, range 85.1-130.8) were recruited through advertisements in schools or local newspapers and had no history of psychiatric or neurological disorders, as reported by the parents upon telephone interviewing. Patients and controls differed significantly in most CBCL subscales (see Table 1 ), but not in IQ, as assessed with Raven’s Standard Progressive Matrices, a well-established proxy of general intelligence (F1,51<1, p=0.64; Raven’s SPM [38]).

Table 1. Means (±SD) of CBCL/4-18 Subscales and CBCL/4-18 Total Score.

TD ADHDa z p
Withdrawn 1.50 ± 1.50 2.50 ± 2.36 1.49 .14
Somatic Complaints 0.69 ± 0.79 1.63 ± 1.84 1.90 .06
Anxious/Depressed 1.73 ± 2.32 4.79 ± 4.42 2.97 <.003
Social Problems 0.77 ± 1.03 3.46 ± 2.59 4.41 <.0001
Thought Problems 0.31 ± 0.62 1.13 ± 2.07 1.61 .11
Attention Problems 2.19 ± 2.33 6.21 ± 3.60 4.12 <.0001
Delinquent Rule-Breaking Behaviour 1.12 ± 1.51 3.46 ± 3.02 3.23 .002
Aggressive Behaviour 4.77 ± 4.25 13.50 ± 9.03 3.97 <.0001
Internalizing 3.77 ± 3.57 8.50 ± 7.30 2.65 .009
Externalizing 5.88 ± 5.35 16.96 ± 11.75 3.81 .0002
Total Problems 14.65 ± 11.51 39.58 ± 26.44 3.99 <.0001

Note. aN=24 because (i) two ADHD patients did not return questionnaires, and (ii) one had too many missing values; TD = Typical Development, ADHD = Attention-Deficit/Hyperactivity Disorder; z = z approximation of the Wilcoxon-Mann-Whitney test;

3: Hardware and Procedure

Data were collected as part of a larger study that also included EEG recordings (Feige et al., in preparation). Stimuli were presented on a 17" VGA monitor with "Presentation" (Neurobehavioral Systems, Albany, CA) and responses were collected with a self-made response pad consisting of two separate push-buttons of 3x3 cm size each. Given that increased ISV in ADHD may be influenced by the task context in which it is observed, we experimentally manipulated two well-replicated factors of cognitive deficits in ADHD, working memory [39] and temporal processing [40], in a letter version of the N-back task. During 0-back tasks, presentation of an “E” was defined as an “event”, presentation of all other letters as “non-events”. During 1-back tasks, the stimulus types event vs. non-event were defined as presentation of a letter that was identical or non-identical with the previous letter, respectively. Event-rate was 25% in all tasks, and participants had to respond as quickly and accurately as possible with the left- or right-hand response buttons to all events and all non-events. The assignment of response hand to trial type was counter-balanced across participants. Stimulus presentation duration was 0.5s. Stimulus-onset asynchrony was 2.5s on average, being fixed in "non-jittered" and varying (2.0-3.0s) in "jittered" conditions. The four task groups (0-back/1-back x jittered/ non-jittered) consisting of 2x180 trials each (with pauses between the two blocks and the four task groups) were preceded by at least 20 practice trials and presented in permutated order across participants of both groups.

4: Data analysis

As part of our exploratory data analysis, we derived the RT probability density function (showing the relative frequency of responses in 20 ms bins from 0 to 2000 ms; see Figure 1a ) separately for each subject and condition after normalizing the median reaction time to 600 ms by dividing each RT by the median for this subject and condition and multiplying by 600 ms. This processing step was accomplished to visualize group differences in RT distribution. The normalized probability density functions were then plotted with group statistics (mean and 95% CI for each RT bin).

The Primary data analysis consisted of three steps. First, we differentiated three sources of RT variability: ISV proper, linear trends (e.g., due to fatigue) and event/non-event RT differences (for a taxonomy of sources of ISV, see 41,30). To analyse ISV proper independently of the other sources, we “residualized” RTs by subtracting the fit to a linear model from all task blocks. The linear model included a trial time covariate for linear trends and the factors STIMULUS TYPE (event/non-event) and inter-run factors TASK (0-back/1-back) and JITTER (jitter/no-jitter). The range of valid RT was 200-1500 ms, excluding anticipations or excessively slow responses. This residualisation procedure thus removed all components of intra-subject variability due to task, stimulus manipulations or trends.

Second, we derived different measures of dispersion. The intra-individual RT standard deviation (RTSD) was computed for reasons of comparison, being the "gold standard" in the ADHD literature [7]. The "consecutive standard deviation" (CSD [7]) was computed as standard deviation of trial-to-trial RT differences (sqrt(∑(RTi-RTi+1)2/(n-1)); i=trial number, n=number of trials, sqrt=square root). Ex-Gaussian σ and τ were derived using the GAMLSS package for the open-source statistical package R [21,22,42]. Non-residualized measures of central tendency were arithmetic mean (MRT), median (MnRT) and ex-Gaussian µ. Error measures were proportion of omission errors (om) and proportion of correct responses (cor).

Third, after re-sampling the residualized RT time series to a frequency of 1 Hz by linear interpolation, Fast Fourier Transforms (FFT) were run separately for each subject in each experimental condition to examine the RT variability frequency range (0-0.25 Hz) in bins of 0.004 Hz for both groups.

To determine contributions of fluctuations on different time scales to RTSD, CSD, σ and τ, the same frequency range was subdivided into 10 frequency bands of 0.025 Hz width. For each participant and frequency band separately, RT series of four experimental conditions were filtered with a suppression filter (filtering out the given band) and an extraction filter (filtering out all bands except the given band), after which the individual RTSD, CSD, σ and τ scores were re-calculated and statistically analysed. The extraction filter thus removes all frequencies except the given band, whereas the suppression filter removes only the given frequency band. Filtering was performed on each residualized RT time series after resampling to 1Hz using linear interpolation. For manipulations in the frequency domain, it is important that the residualisation described above de-means and detrends the RT time series, which effectively suppresses the effects of very slow variations (trends such as effects of fatigue as well as oscillations with a cycle length comparable to the block length or longer, i.e. 0.001 Hz with the block length of 900 s). The resampled time series was zero-padded to the next power-of-two length, converted into the frequency domain using a raw complex-valued FFT, multiplied by the desired frequency characteristic and converted back by inverse FFT. The frequency characteristics were constructed as simple pass- or stop bands with a linear flank of width 0.001 Hz at either side, limiting the steepness of the filter.

As mentioned in the introduction, τ can be viewed quite specifically in terms of particularly slow reaction times interspersed in a background of, on average, faster reactions. Furthermore, the low-frequency components of RT time series should represent relatively long alternating phases of faster and slower reaction times. Therefore, and in order to express both τ and the low-frequency components in the time domain, we carried out the following analysis steps. Particularly slow or fast RTs (residualized, as explained before) within a given block of trials were defined by the theoretical 1% threshold of a Gaussian distribution (median ± 2.33 SD, where SD was computed non-parametrically as IQR/1.349, IQR=Inter-Quartile Range). Next, a running median RT was computed across all other RTs, using a 40 s time window. This "background RT fluctuation" was, in turn, divided into three classes, depending upon whether the current value fell into the lower, middle or upper tercile of all values. Finally, in order to determine whether the particularly slow or fast RTs were associated with the phase of background RT fluctuation, we compared the number of slow or fast RTs within each of the background RT terciles. As a control, we also checked whether the occurrence of omission errors was associated with either class of RT. Separately for slow and fast RTs as well as omissions, the counts for lower, middle or upper RT classes were compared using χ2 tests.

5: Statistics

Measures of central tendency, dispersion and error were statistically analysed with univariate repeated measures ANCOVA, including the aforementioned with-subject factors NBACK, JITTER and STIMULUS TYPE, the between-subject factor GROUP (patients/controls); age in months was added as covariate to reduce (age-related) error variance (within-group sums of squares).

Results

1: Overall characterisation of group differences and experimental effects

Figure 1a shows probability density distributions of RTs individually normalized to a median of 600 ms for both groups. Probability density is shown as the relative frequency of responses in 20 ms bins from 0 to 2000 ms. Overall, the patients’ RT distribution appears broader and flatter than that of controls, with higher RT probability densities at both extremes and lower densities around the median due to total probability being fixed to 1. When considering the same RT data as time series, patients show greater spectral power across the entire frequency spectrum, with group differences being particularly pronounced at slow frequencies (<0.1 Hz). The range above .15 Hz shows smallest group differences (see Figure 1b ). Furthermore, while the number of early responses (RT<200 ms) was greater in patients as compared to controls (see Table 2 ), the number of particularly slow responses (>1,500 ms) was only somewhat greater in those with ADHD (7.5±14.2) than in healthy children (1.9±3.7; GROUP: F1,51=3.61, p=.063). The manipulations of working memory load or temporal task structure exerted no impact on any of the reaction time measures.

Table 2. Group Differences in Reaction Time and Error Measures.

MRT MnRT mu RTSD sigma tau CSD om corr early FB≤0.1
GROUP <1 <1 <1 15.6*** 3.1+ 18.1*** 18.8*** 9.7** 16.9*** 16.8*** 19.6***
Controls 634±118 630±118 546±103 142±40 108±36 79±33 181±46 3.2±3.4 83.7±7.5 5.7±5.4 5.6±0.5
Patients 652±127 635±129 531±130 186±41 125±33 127±48 240±53 7.7±7.5 72.3±12.0 1.2±1.8 6.2±0.4

Note: MRT: mean RT, MnRT: median RT; µ: mean of the Gaussian component of the RT distribution; RTSD: intra-subject standard deviation of reaction times; σ: standard deviation of the Gaussian component of the RT distribution; τ: mean and standard deviation of the exponential (ex-Gaussian) component of the reaction time distribution; con: consecutive standard deviation; om: percentage of omission errors; corr: percentage of correct responses; FB≤0.1: power in the pooled frequency bands of 0-0.1 Hz; GROUP: F-values of main effect

GROUP or indication of their non-significance (n.s.); ** p≤.01, *** p≤.001;

2: Frequency specificity of tau and the other measures of ISV

Figure 1c clearly reveals that it is the lowest frequency band (0.001-0.025 Hz) that contributes most to τ. This frequency band corresponds to a cycle length of at least 40 seconds. Furthermore, the non-overlapping confidence intervals for the group means in τ after extracting the 0.001-0.025 Hz frequency band demonstrate the significantly greater impact of this slow frequency component on τ in patients compared to controls.

Testing the association of particularly fast and slow RTs with background RT fluctuation (see Figure 2) revealed the following. In both patients (χ2=43.62, p<.0001) and control children (χ2=116.80, p<.0001), particularly slow responses occurred preferentially in the slow tercile of the background RT, whereas particularly fast responses occurred preferentially in its fast tercile (patients: χ2=35.25, p<.0001; controls: χ2=44.77, p<.0001). Conversely, omissions were evenly distributed across the background RT terciles both in patients (χ2=1.16, p=.56) and in controls (χ2=0.61, p=.74).

Figure 2. Typical residualized RT time series is shown for one patient (P029) and one condition (0-back non-jittered) for illustrative purposes.

Figure 2

Successive RTs are connected with black lines; the outer horizontal dashed lines mark the threshold for particularly low and high RTs (Gaussian 1% threshold, cf. Methods). Very fast or slow reactions, exceeding the thresholds, are marked with circles. The red line shows the 40 s running median of values within the thresholds (background response fluctuation) and the inner horizontal dashed lines its tercile boundaries (1/3 of all values lying in each partition). The occurrence of each of these events (low/high value or omission) was associated with the tercile of the background response fluctuation. It can be seen that the few very fast RTs occur during a time of fast background RTs; similarly the larger number of very slow RTs (contributing to τ) occur preferentially during phases of slow background RT fluctuation.

Regarding the other measures of ISV, RTSD and σ are less specific in their frequency composition than τ. Overall, RTSD values are larger than σ, and patients exhibit more variability across the entire frequency range than controls. Note that this RTSD analysis and the spectral power analysis (Figure 1b ) correspond mathematically. While RTSD shows significant group differences in the 0.001-0.025 Hz frequency band that characterises τ, σ does not.

The effect of RT time series filtering on CSD is shown in Figure 1d for patients and controls. Numerical values, even for the full bands, are lower than for the original RT sequence (Table 2 ) because the RT time series was interpolated to a sampling rate of 1 Hz for this analysis. It is obvious that CSD contains little (quasi-)periodicity and is non-specific to any frequency band. Still, this ISV facet is clearly more pronounced in patients than in controls. Overall the CSD spectrum is compatible with the fact that the square of CSD is the power of the temporal derivative of the RT time series: Low frequencies are suppressed and high frequency enhanced, relative to RTSD.

Group differences in the different variables are shown in Table 2 . Although the group difference in τ was strongest in the 0.001-0.025 Hz frequency band, the spectral power in the frequency range up to 0.1 Hz and RTSD differentiated patients and controls highly significantly (3.57≤t≤4.51), too. As the four RT power frequency bands below 0.1 Hz were positively correlated (controls: r≥.92; patients: r≥.78), we pooled them to the new frequency band variable “FB≤0.1”. Table 2 reveals that patients with ADHD showed significantly increased scores on all ISV measures except σ, with greatest group differences for τ, FB≤0.1 and CSD. Also, patients had more omissions than controls and gave fewer correct responses overall. While there was no significant GROUP difference for any measure of central tendency, patients were somewhat slower than controls regarding MRT, similar regarding MnRT and faster regarding µ.

Patients thus differed from controls in showing a greater exponential component (τ), more low-frequency spectral power and RT variance, overall and in consecutive trials, but normal Gaussian variability (σ) which, together, increased the arithmetic mean of the overall distribution despite somewhat faster Gaussian mean RT (µ).

Discussion

The present study is the first systematic examination of the intra-individual relationships between measures of RT dispersion and RT time series in ADHD, focusing on the frequency specificity of τ, RTSD, σ, and CSD as a set of conceptually diverse and commonly used measures of ISV. Rather than determining inter-individual correlations between these variables [43], we developed a novel and more direct, two-level approach which, firstly, determines these relationships intra-individually and, secondly, outputs these individual data for group statistics.

The main new result of this study is that the group differences in the ex-Gaussian parameter τ are mostly driven by RT fluctuations below 0.025 Hz. This corresponds to a cycle length of at least 40 s. Additionally, we analysed blocks of 900s duration in which the RT time series was detrended, thereby eliminating systematic RT drifts and limiting the influence of very slow RT oscillations with a cycle length comparable to the block length or longer. This suggests that the particularly slow responses contributing to τ might occur with a quasi-periodic structure - rather than, for instance, occurring randomly across a block of trials or amassing just at the beginning or just the end of a task block. This interpretation was supported by a highly statistically significant clustering of particularly slow responses at the slow edges of a low-frequency background RT fluctuation (see Figure 2 ). Leth-Steensen et al. [23] explained the “tau effect” in ADHD as a recurrence of lapses in attention due to deficient allocation of effort and thus cognitive-energetic factors [44]. This concurs with the interpretation of increased ISV in ADHD as “impaired state regulation” [17,8]. It is not in contradiction to the aforementioned interpretations to hypothesise that increased τ in ADHD with its low-frequency spectral signature might be related to “default mode” network abnormalities in ADHD [45]; This is all the more plausible as inefficient de-activation of “default mode” brain structures has been shown to be related with “lapses in attention” [24] or increased reaction time variability [46], at least in adults. Furthermore, it has been shown with electrocorticography that the default network is characterized by significant high gamma-band coherence, fluctuating at infra-slow (<0.1 Hz) frequencies and suggesting that the neurophysiological basis of DMN is quasi-periodic, infra-slow changes in local cortical activity [47]. The direct link established here between τ and slow frequency RT oscillations is thus in accordance with Sonuga-Barke & Castellanos’ [48] default mode interference (DMI) hypothesis (see also 49), according to which task performance in ADHD is modulated by endogenous fluctuations of attention with slow frequencies of less than 0.1 Hz. This is the spectral range of the four frequency bands that discriminated patients and controls best in the present study (see Table 1 ). That this relationship holds for both groups, albeit much stronger for patients, suggests that DMI characterises children as young as those of the present study in general, but is increased in children with ADHD. The brain’s “default regions” seem to be intact and functioning at an early age [50], although their functional connectivity increases throughout childhood and adolescence [51].

The particularly slow responses appear to be embedded into the recurring slow phases of a large-scale background process that potentially reflects DMN activity. The specificity of this finding is underlined by the complete absence of a comparable accumulation of omissions in either tercile of the background RT fluctuation. Omissions, no less than particularly slow responses, can arguably be conceived of as “lapses in attention”. The temporal structure of their occurrence, however, indicates that they are not embedded in an on-going background RT fluctuation and thus reflect “lapses” with a different temporal structure; in this sense, particularly slow responses and omissions may be considered to reflect different kinds of “lapses”. This suggested dissociation concurs with a recent finding reported by Kuntsi and colleagues [15], who found omission errors and RT variability to load two different familial factors of cognitive impairment in ADHD.

Like τ, the other distributional measures of RT variability exhibit their own spectral signature. The frequency specificity of RTSD, for instance, appears to share the 1/f distribution characteristic of typical human RT data (for which logarithmic RT spectral power falls off quasi-linearly with increasing frequency; “1/f noise” [30,52] or the spectral content of spontaneous fluctuations of BOLD responses related to inter-trial variability of button press force [53]. It is thus tempting to speculate that the frequency spectrum of RTSD reflects the temporal dynamics of the coupling of certain functional brain systems with behaviour.

By contrast to both τ and RTSD, the parameter CSD extracts trial-to-trial differences in RT and therefore suppresses low frequencies and linearly emphasizes high frequencies. However, both power and group differences are maximum for low frequencies and minimum for high frequencies (see Figure 1b ). This has two implications. Firstly, the absence of group differences in the high frequencies as found in the present study, would argue against the notion that moment-to-moment fluctuations of attention are characteristic of ADHD [54]. Likewise, neuronal processes that would give rise to increases in such short-term fluctuations in attention (e.g., “neural noise” [55]) are not altered in ADHD according to the present data. Secondly, the absence of group differences in the high frequency fluctuations renders CSD primarily sensitive to group differences in the medium-to-low frequency range of approximately 0.05-0.10 Hz (10-20 sec cycle lengths; see Figure 1f ), despite its “computational” sensitivity to the high frequency fluctuations. This supports the above interpretation of our τ-related low-frequency variability increases and argues in favour of etiological models of ADHD that emphasise more general, regulatory processes [56,57]. Regulatory processes that are involved in generating time series with 1/f noise-like characteristics are presumably manifold, and include the combination of short-range processes with different characteristic time scales (such as the different human memory systems), strategy shifts or fluctuations in speed-accuracy criteria and the like [33]. Whether any of these processes is involved in generating the group differences in spectral power reported here remains to be determined.

Conclusions and Potential Directions for Future Research

We have characterised distributional measures of ISV in terms of their spectral signature and thus linked two domains of ISV research that have been relatively unrelated so far, namely the distributional and time series approaches. Our results add to the ADHD literature by confirming the great sensitivity of the ex-Gaussian parameter τ to ADHD (see Tables 2 and 3 ) and by showing for the first time that τ is “nourished” by slow quasi-periodic RT fluctuations that might be reflective of the default mode interference suggested to underlie ADHD psychopathology [48]. Obviously, proper neurophysiological data are required to substantiate this interpretation. Furthermore, we show that the “gold standard” ISV parameter, RTSD, picks up the “1/f noise” characteristic of RT fluctuations and that fast-frequency moment-to-moment fluctuations of performance do probably not contribute to the increases in ISV that are so characteristic of patients with ADHD.

Table 3. Overview of GROUP differences (F-values) in measures of ISV.

Study Age MRT SDRT Mu Sigma Tau CSD Com Om
Leth-Stensen et al. 2000 10-11 22.9 50.1 1.4 0.2 53.8
Hervey et al. 2006 10 9.9 25.5 5.3 8.2 28.7 0.8 7.4
Vaurio et al. 2009 7-13 1.3 9.9a 0.1 4.5 6.9 17.0
Kollins et al. 2009 31-32 7.8 n.s. 5.6
Buzy et al. 2009 7-14 0.10 6.2 10.2 1.2b 7.5

Note: a coefficient of variation (CV=SDRT/MRT) reported; b percentage accurate responses reported;

A potential limitation of our sample is its clinical heterogeneity. However, Rucklidge & Tannock [58] have found ISV to be the best predictor of both inattentive and hyperactive/impulsive symptoms.

Future ISV research should address the dimensionality of these possibly different facets of ISV and compare them, if possible, in the latent variable space, with respect to three key aspects of research on intra-subject variability in (neuro-) psychiatric disorders: reliability, nosological specificity including (differential) sensitivity to varying “contexts” (situations, tasks, internal states etc.; see also 3).

Funding Statement

The authors have no support or funding to report.

References

  • 1. Castellanos FX, Tannock R (2002) Neuroscience of Attention-Deficit/Hyperactivity Disorder: The Search For Endophenotypes. Neuroscience 3: 617-628. PubMed: 12154363. [DOI] [PubMed] [Google Scholar]
  • 2. Klein C, von Stralendorff I (2002) Neuropsychologische Defizite bei Aufmerksamkeitsdefizit-Störung (ADS): Theorien und Phänomene. In: Myrtek M. Die Person im biologischen und sozialen Kontext. Göttingen: Hogrefe-Verlag; pp. 29-60. [Google Scholar]
  • 3. Castellanos FX, Sonuga-Barke EJ, Scheres A, Hyde Ch, Walters JA (2005) Varieties of ADHD-Related Intra-Individual Variability. Biol Psychiatry 57: 1416-1423. doi: 10.1016/j.biopsych.2004.12.005. PubMed: 15950016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Bellgrove MA, Hawi Z, Kirley A, Gill M, Robertson IH (2005) Dissecting the Attention Deficit Hyperactivity Disorder (ADHD) Phenotype: Sustained Attention, Response Variability and Spatial Attentional Asymmetries in Relation to Dopamine Transporter (DAT1) Genotype. Neuropsychologia 43: 1847-1857. doi: 10.1016/j.neuropsychologia.2005.03.011. PubMed: 16168728. [DOI] [PubMed] [Google Scholar]
  • 5. Halperin JM, Trampush JW, Miller CJ, Marks DJ, Newcorn JH (2008) Neuropsychological Outcome in Adolescents/Young Adults with Childhood ADHD: Profiles of Persisters, Remitters and Controls. J Child Psychol Psychiatry 64: 958-966. PubMed: 18573145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Johnson KA, Barry E, Bellgrove MA, Cox M, Kelly SP et al. (2008) Dissociation in Response to Methylphenidate on Response Variability in a Group of Medication Naive Children with ADHD. Neuropsychologia 46: 1532-1541. doi: 10.1016/j.neuropsychologia.2008.01.002. PubMed: 18289615. [DOI] [PubMed] [Google Scholar]
  • 7. Klein C, Wendling K, Huettner P, Ruder H, Peper M (2006) Intra-Subject Variability in Attention-Deficit Hyperactivity Disorder. Biol Psychiatry 60: 1088-1097. doi: 10.1016/j.biopsych.2006.04.003. PubMed: 16806097. [DOI] [PubMed] [Google Scholar]
  • 8. Kuntsi J, Klein C (2012) Intra-Individual Variability in ADHD and its Implications for Research of Causal Links. In Stanford C, Tannock R, Current Topics in Behavioral Neurosciences: Behavioral Neurobiology of ADHD and its Treatment [DOI] [PubMed] [Google Scholar]
  • 9. Rubia K, Smith AB, Brammer MJ, Taylor E (2007) Temporal Lobe dysfunction in Medication-Naïve Boys with Attention-Deficit/Hyperactivity Disorder During Attention Allocation and its Relation to Response Variability. Biological Psychiatry 62: 999-1006. [DOI] [PubMed] [Google Scholar]
  • 10. Flehmig HC, Steinborn M, Langner R, Scholz A, Westhoff K (2007) Assessing Intraindividual Variability in Sustained Attention: Reliability, Relation to Speed and Accuracy, and Practice Effects. Psychol Sci 49: 132-149. [Google Scholar]
  • 11. Johnson KA, Kelly SP, Bellgrove MA, Barry E, Cox M et al. (2007) Response Variability in Attention Deficit Hyperactivity Disorder: Evidence for Neuropsychological Heterogeneity. Neuropsychologia 45: 630-638. doi: 10.1016/j.neuropsychologia.2006.03.034. PubMed: 17157885. [DOI] [PubMed] [Google Scholar]
  • 12. Saville CWN, Pawlings R, Trullinger M, Daley DM, Intriligator J, Klein C (2011) On the Stability of Instability: Reliability and Redundancy in Metrics of Intra-Subject Variability of Reaction Times. Pers Individ Dif 51: 148-153. doi: 10.1016/j.paid.2011.03.034. [DOI] [Google Scholar]
  • 13. Ram N, Rabbitt P, Stollery B, Nesselroade JR (2005) Cognitive Performance Inconsistency: Intraindividual Change and Variability. Psychol Aging 20: 623-633. doi: 10.1037/0882-7974.20.4.623. PubMed: 16420137. [DOI] [PubMed] [Google Scholar]
  • 14. Saville CWN, Shikhare S, Iyengar S, Daley DM, Intriligator J et al. (2011) Is Reaction Time Variability Consistent across Modalities? Insights from Latent Variable Analysis of Single-Trial P3b Latencies. Biol Psychol 91: 275-282. [DOI] [PubMed] [Google Scholar]
  • 15. Kuntsi J, Wood AC, Rijsdijk F, Johnson KA, Andreou P et al. (2010) Separation of Cognitive Impairments in Attention-Deficit/Hyperactivity Disorder into 2 Familial Factors. Arch Gen Psychiatry 67: 1159-1167. doi: 10.1001/archgenpsychiatry.2010.139. PubMed: 21041617. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Rommelse NNJ, Altink ME, Oosterlaan J, Beem L, Buschgens CJM et al. (2008) Speed, Variability, and Timing of Motor Output in ADHD: Which Measures are Useful for Endophenotypic Research? Behav Genet 38: 121-132. doi: 10.1007/s10519-007-9186-8. PubMed: 18071893. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Kuntsi J, Stevenson J (2001) Psychological Mechanisms in Hyperactivity: II. The Role of Genetic Factors. J Child Psychol Psychiatry 42: 211-219. doi: 10.1111/1469-7610.00712. PubMed: 11280417. [DOI] [PubMed] [Google Scholar]
  • 18. Wood AC, Asherson P, van der Meere JJ, Kuntsi J (2010) Separation of Genetic Influences on Attention Deficit Hyperactivity Disorder Symptoms and Reaction Time Performance from those on IQ. Psychol Med 40: 1027-1037. doi: 10.1017/S003329170999119X. PubMed: 19751540. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Uebel H, Albrecht B, Asherson P, Börger N, Butler L et al. (2010) Performance Variability, Impulsivity Errors and the Impact of Incentives as Gender-Independent Endophenotypes for ADHD. J Child Psychol Psychiatry 511: 210-218. PubMed: 19929943. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Ratcliff R (1979) Group Reaction Time Distributions and an Analysis of Distribution Statistics. Psychol Bull 86: 446-461. doi: 10.1037/0033-2909.86.3.446. PubMed: 451109. [DOI] [PubMed] [Google Scholar]
  • 21. Heathcote A (1996) RTSYS: A DOS Application for the Analysis of Reaction Time Data. Behav Res Methods 28: 427-445. doi: 10.3758/BF03200523. [DOI] [Google Scholar]
  • 22. Heathcote A, Brown S, Cousineau D (2004) QMPE: Estimating Lognormal, Wald, and Weibull RT Distributions with a Parameter-Dependent Lower Bound. Behav Res Methods Instrum Comput 36: 277-290. doi: 10.3758/BF03195574. PubMed: 15354694. [DOI] [PubMed] [Google Scholar]
  • 23. Leth-Steensen C, Elbaz ZK, Douglas VI (2000) Mean Response Times, Variability, and Skew in the Responding of ADHD Children: A Response Time Distributional Approach. Acta Psychol 104: 167-190. doi: 10.1016/S0001-6918(00)00019-6. PubMed: 10900704. [DOI] [PubMed] [Google Scholar]
  • 24. Weissman DH, Roberts KC, Visscher KM, Woldorff MG (2006) The Neural Bases of Momentary Lapses in Attention. Nat Neurosci 9: 971-978. doi: 10.1038/nn1727. PubMed: 16767087. [DOI] [PubMed] [Google Scholar]
  • 25. Hervey AS, Epstein JN, Curry JF, Tonev S, Arnold LE et al. (2006) Reaction Time Distribution Analysis of Neuropsychological Performance in an ADHD Sample. Child Neuropsychol 12: 125-140. doi: 10.1080/09297040500499081. PubMed: 16754533. [DOI] [PubMed] [Google Scholar]
  • 26. Vaurio RG, Simmonds DJ, Mostofsky SH (2009) Increased Intra-Individual Reaction Time Variability in Attention-Deficit/Hyperactivity Disorder Across Response Inhibition Tasks with Different Cognitive Demands. Neuropsychologia 47: 2389-2396. doi: 10.1016/j.neuropsychologia.2009.01.022. PubMed: 19552927. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Kollins SH, MCClernon FJ, Epstein JE (2009) Effects of Smoking Abstinence on; Time Reaction. (2009) Variability in Smokers with and without ADHD: An ex-Gaussian Analysis. Drug Alcohol Depend 100: 169-172 doi:10.1016/j.drugalcdep.2008.09.019. PubMed: 19041198. [Google Scholar]
  • 28. Buzy WM, Medoff DR, Schweitzer JB (2009) Intra-Individual Variability Among Children with ADHD on a Working Memory Task: An Ex-Gaussian Approach. Child Neuropsychol 15: 441-459. doi: 10.1080/09297040802646991. PubMed: 19184779. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Gilden DL, Thornton T, Mallon MW (1995) 1/f Noise in Human Cognition. Science 267: 1837-1839. doi: 10.1126/science.7892611. PubMed: 7892611. [DOI] [PubMed] [Google Scholar]
  • 30. Gilden DL (2001) Cognitive Emissions of 1/f Noise. Psychol Rev 108: 33-56. doi: 10.1037/0033-295X.108.1.33. PubMed: 11212631. [DOI] [PubMed] [Google Scholar]
  • 31. Di Martino A, Ghaffari M, Curchack J, Reiss P, Hyde C et al. (2008) Decomposing Intra-Subject Variability in Children with Attention-Deficit/Hyperactivity Disorder. Biol Psychiatry 64: 607-614. doi: 10.1016/j.biopsych.2008.03.008. PubMed: 18423424. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Helps SK, Broyd SJ, Bitsakou P, Sonuga-Barke EJS (2011) Identifying a distinctive familial frequency band in reaction time fluctuations in ADHD. Neuropsychology 25: 711–719. doi: 10.1037/a0024479. PubMed: 21728424. [DOI] [PubMed] [Google Scholar]
  • 33. Wagenmakers EJ, Farrell S, Ratcliff R (2004) Estimation and Interpretation of 1/f Noise in Human Cognition. Psychon Bull Rev 11: 579-615. doi: 10.3758/BF03196615. PubMed: 15581115. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Ebner-Priemer UW, Kuo J, Kleindienst N, Welch SS, Reisch T et al. (2007) State affective instability in borderline personality disorder assessed by ambulatory monitoring. Psychol Med 37: 961-970. doi: 10.1017/S0033291706009706. PubMed: 17202005. [DOI] [PubMed] [Google Scholar]
  • 35. Ebner-Priemer UW, Eid M, Kleindienst N, Stabenow S, Trull TJ (2009) Analytic strategies for understanding affective (in)stability and other dynamic processes in psychopathology. J Abnorm Psychol 118: 195-202. doi: 10.1037/a0014868. PubMed: 19222325. [DOI] [PubMed] [Google Scholar]
  • 36. Kaufman J, Birmaher B, Brent D, Rao U, Ryan N (2001) Kiddie-Sads-Present and Lifetime Version (K-SADS-PL), version 1.0 of October 1996. German adaptation by K-SADS-Arbeitsgruppe. Berlin; Bern Köln.Frankfurt/M.. Jena, Mannheim, Rostock: Hamburg. [Google Scholar]
  • 37. Döpfner M, Plueck J, Boelte S, Lenz K, Melchers P, Heim K (2008) CBCL/4-18 Elternfragebogen über das Verhalten von Kindern und Jugendlichen ( 2. Aufl.). Köln: Arbeitsgruppe Kinder-, judged- und Familiendiagnostik (KJFD).
  • 38. Heller KA, Kratzmeier H, Lengfelder A (1998) Standard Progressive Matrices / Matrizen-Test-Manual (Band 1). Beltz Test
  • 39. Martinussen R, Hayden J, Hogg-Johnson S, Tannock R (2005) A meta-analysis of working memory impairments in children with attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry 44: 377-384. doi: 10.1097/01.chi.0000153228.72591.73. PubMed: 15782085. [DOI] [PubMed] [Google Scholar]
  • 40. Toplak ME, Dockstader C, Tannock R (2006) Temporal information processing in ADHD: findings to date and new methods. J Neurosci Methods 151: 15–29. doi: 10.1016/j.jneumeth.2005.09.018. PubMed: 16378641. [DOI] [PubMed] [Google Scholar]
  • 41. Fiske DW, Rice L (1955) Intra-Individual Response Variability. Psychol Bull 52: 217-250. doi: 10.1037/h0045276. PubMed: 14371891. [DOI] [PubMed] [Google Scholar]
  • 42. Stasinopoulos DM, Rigby RA (2007) Generalized Additive Models for Location Scale and Shape (GAMLSS) in R. J Stat Softw 23: 1-46. [Google Scholar]
  • 43. Johnson KA, Robertson IH, Kelly SP, Silk TJ, Barry E et al. (2007) Dissociation in Performance of Children with ADHD and High-Functioning Autism on a Task of Sustained Attention. Neuropsychologia 45: 2234-2245. doi: 10.1016/j.neuropsychologia.2007.02.019. PubMed: 17433378. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Sergeant JA (2000) The Cognitive-Energetic Model: An Empirical Approach to Attention-Deficit Hyperactivity Disorder. Neurosci Biobehav Rev 24: 7-12. doi: 10.1016/S0149-7634(99)00060-3. PubMed: 10654654. [DOI] [PubMed] [Google Scholar]
  • 45. Uddin LQ, Kelly AMC, Biswal BB, Castellanos FX, Milham MP (2008) Functional Connectivity of Default Mode Network Components: Correlation, Anticorrelation, and Causality. Hum Brain Mapp 30: 625-637. PubMed: 18219617. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Kelly AMC, Uddin LQ, Biswal BB, Castellanos FX, Milham MP (2008) Competition Between Functional Brain Networks Mediates Behavioral Variability. NeuroImage 39: 527-537. doi: 10.1016/j.neuroimage.2007.08.008. PubMed: 17919929. [DOI] [PubMed] [Google Scholar]
  • 47. Ko AL, Darvas F, Poliakov A, Ojemann J, Sorensen LB (2011) Quasi-Periodic Fluctuations in Default Mode Network Electrophysiology. J Neurosci 31: 11728-11732. doi: 10.1523/JNEUROSCI.5730-10.2011. PubMed: 21832202. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Sonuga-Barke EJS, Castellanos FX (2007) Spontaneous Attentional Fluctuations in Impaired States and Pathological Conditions: A Neurobiological Hypothesis. Neurosci Biobehav Rev 31: 977-986. doi: 10.1016/j.neubiorev.2007.02.005. PubMed: 17445893. [DOI] [PubMed] [Google Scholar]
  • 49. Tian L, Jiang T, Wang Y, Zang Y, He Y et al. (2006) Altered Resting-State Functional Connectivity Patterns of Anterior Cingulate Cortex in Adolescents with Attention-Deficit Hyperactivity Disorder. Neurosci Lett 400: 39-43. doi: 10.1016/j.neulet.2006.02.022. PubMed: 16510242. [DOI] [PubMed] [Google Scholar]
  • 50. Marsh R, Zhu H, Schultz RT, Quackenbush G, Royal J et al. (2006) A Developmental fMRI Study on Self-Regulatory Control. Hum Brain Mapp 27: 848-863. doi: 10.1002/hbm.20225. PubMed: 16421886. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Fair DA, Cohen AL, Dosenbach NUF, Church JA, Miezin FM et al. (2008) The Maturing Architecture of the Brain’s Default Network. Proc Natl Acad Sci U S A 105: 4028-4035. doi: 10.1073/pnas.0800376105. PubMed: 18322013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. Van Orden GC, Holden JG, Turvey MT (2003) Self-Organisation of Cognitive Performance. J Exp Psychol Gen 132: 331-350. doi: 10.1037/0096-3445.132.3.331. PubMed: 13678372. [DOI] [PubMed] [Google Scholar]
  • 53. Fox MD, Snyder AZ, Zacks JM, Raichle ME (2006) Coherent Spontaneous Activity Accounts for Trial-to-Trial Variability in Human Evoked Brain Responses. Nat Neurosci 9: 23-25. doi: 10.1038/nn1616. PubMed: 16341210. [DOI] [PubMed] [Google Scholar]
  • 54. Russell VA, Oades RD, Tannock R, Killeen PR, Auerbach JG et al. (2006) Response Variability in Attention-Deficit/Hyperactivity Disorder: A Neuronal and Glial Energetics Hypothesis. Behav Brain Funct 2: 30. doi: 10.1186/1744-9081-2-30. PubMed: 16925830. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55. Hendrickson A (1982) The biological basis of intelligence. In Eysenck HJ, A model for intelligence. Berlin: Springer Verlag. [Google Scholar]
  • 56. Douglas VI (1999) Cognitive Control Processes in Attention-Deficit/Hyperactivity Disorder. In Quay HC, Hogan AE, Handbook of Disruptive Behaviour Disorders, Kluwer Academic/Plenum Publishers, New York: 105-138. [Google Scholar]
  • 57. Sergeant JA, Oosterlaan J, van der Meere J (1999) Information Processing and Energetic Factors in Attention-Deficit/Hyperactivity Disorder. In Quay HC, Hogan AE, Handbook of Disruptive Behavior Disorders, Kluwer Academic/Plenum Publishers, New York: 75-104. [Google Scholar]
  • 58. Rucklidge JJ, Tannock R (2002) Neuropsychological Profiles of Adolescents With ADHD: Effects of Reading Difficulties and Gender. J Child Psychol Psychiatry 43: 988-1003. doi: 10.1111/1469-7610.00227. PubMed: 12455921. [DOI] [PubMed] [Google Scholar]

Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES