Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2011 Dec 14.
Published in final edited form as: Atten Percept Psychophys. 2010 Oct;72(7):1913–1929. doi: 10.3758/APP.72.7.1913

NONINDEPENDENT AND NONSTATIONARY RESPONSE TIMES IN STOPPING AND STEPPING SACCADE TASKS

Matthew J Nelson 2, Leanne Boucher 1, Gordon D Logan 1, Thomas J Palmeri 1, Jeffrey D Schall 1
PMCID: PMC3237060  NIHMSID: NIHMS341312  PMID: 20952788

Abstract

Saccade stop-signal and target-step tasks are used to investigate the mechanisms of cognitive control. Performance of these tasks can be explained as the outcome of a race between stochastic GO and STOP processes. The race-model analyses assume that response times (RTs) measured throughout an experimental session are independent samples from stationary stochastic processes. This article demonstrates that RTs are neither independent nor stationary for humans and monkeys performing saccade stopping and target-step tasks. We investigate the consequences this has on analyses of these data. Nonindependent and nonstationary RTs artificially flatten inhibition functions and account for some of the systematic differences in RTs following different types of trials. However, nonindependent and nonstationary RTs do not bias the estimation of the stop-signal RT. These results demonstrate the robustness of the race model to some aspects of nonindependence and nonstationarity, and point to useful extensions of the model.

INTRODUCTION

Cognitive control is revealed in experiments that require subjects to change their performance in response to changes in their environment (e.g., Logan, 1985). The stop-signal task (Logan, 1994; Verbruggen & Logan, 2008b) and the target-step task (Camalier et al., 2007; Murthy, Ray, Shorter, Schall, & Thompson, 2009) have been used to examine executive control of saccadic eye movements in humans and macaque monkeys (Camalier et al., 2007; Hanes & Schall, 1995). These tasks present a target for an eye movement and then present either a stop signal, which indicates that the eye movement should be withheld, or a “stepped” target, which indicates that the eye movement should be directed to a new location. Performance on these tasks can be understood as the outcome of a race between a GO process that makes the initial saccade and a STOP process that inhibits the initial saccade to maintain fixation or to allow a new saccade to the new location (Camalier et al., 2007; Logan & Cowan, 1984; see also Boucher, Palmeri, Logan, & Schall, 2007). The race model assumes that the finish times for the GO and STOP processes as a function of trial number are stationary stochastic processes with independence between trials. This article reports data that challenge those assumptions and explores the consequences of those violations for analyses based on the race model. Our goal is not to evaluate the causes of nonindependence and nonstationarity but rather to document them in stopping and stepping tasks, and evaluate their effects on race-model and trial history analyses.

Nonstationarity refers to a stochastic process described by a mean or variance that changes over time. Response times (RTs) gradually becoming slower from the beginning to the end of an experimental session is one example of nonstationarity. Nonindependence refers to statistical dependence across samples in a time series. A correlation in RT between successive trials is one example of nonindependence. A time series that is nonstationary must be nonindependent, but the reverse is not necessarily true (e.g., auto-regressive and moving average models, Wagenmakers, Farrell, & Ratcliff, 2004).

The fact that RTs are often nonstationary and nonindependent is well established (e.g., Gilden, 2001; Wagenmakers et al., 2004). For instance, RT on a given trial can vary with the stimulus and response that occurred on the preceding trial (e.g., Fecteau & Munoz, 2003; Luce, 1986). Furthermore, RT can change with arousal, fatigue, learning, and motivation throughout a session (Broadbent, 1971; Freeman, 1933; Welford, 1968, 1980). Several investigators have documented apparently systematic changes in RT during performance of the stop signal task (Cabel, Armstrong, Reingold & Munoz, 2000; Emeric et al., 2007; Kornylo, Dill, Saenz, & Krauelis, 2003; Li, Krystal, & Mathalon, 2005; Özyurt, Colonius, & Arndt, 2003; Rieger & Gauggel, 1999; Schachar et al., 2004; Verbruggen & Logan, 2008b; Verbruggen, Logan, Liefooghe & Vandierendonck, 2008). For example, the RT decreases after no stop signal trials and increases after stop signal trials.

Race-model analyses of stopping and stepping tasks focus on two measures of performance. First is the inhibition function, the probability of failing to cancel the response to the initial stimulus on a stop or step trial as a function of the interval between the onset of the initial stimulus and the stop or step signal (stop-signal delay, SSD, or target-step delay, TSD). Second is the RT on trials with and without a stop (step) signal. From these quantities can be derived a measure of the time needed to interrupt the initial response. This measure is referred to as the stop-signal RT (SSRT) in stopping tasks and the target-step RT (TSRT) in stepping tasks.

Here we first explore whether RT is nonindependent and nonstationary, and how this impacts estimates of SSRT and TSRT derived from the race model. We also explore how nonindependence and nonstationarity might impact measures of trials-to-trial adaptations of RT. To address these issues, we measured the extent to which RTs were nonindependent and nonstationary across trials during performance of saccade stopping and stepping tasks by humans and macaque monkeys, and assessed the impact of this on conventional analyses of these data.

METHOD

With the exception of search step data from monkey T, all the data presented here have formed the basis of previous publications (Boucher, Palmeri, Logan & Schall, 2007; Boucher, Stuphorn, Logan, Schall & Palmeri, 2007; Camalier et al., 2007; Hanes, Patterson, & Schall, 1998; Paré & Hanes, 2003). Here we reanalyze these data with a focus on the magnitude and impact of nonindependence and nonstationarity of RT.

Stop-signal task

In the stop-signal task, no-signal and stop-signal trials were randomly interleaved (Figure 1). On no-signal trials, subjects fixated a central point until it disappeared whereupon a peripheral target appeared without any distractors. Subjects were then required to shift gaze to that location. On stop-signal trials, the central fixation point reappeared following a variable delay after the appearance of the target. We refer to this variable delay as the stop-signal delay (SSD). On these trials, subjects were instructed to cancel any impending saccade and maintain fixation on the initial fixation position. We refer to these trials as cancelled trials (they are also called “signal-inhibit” trials in the literature). Monkeys were rewarded following both the cancelled stop-signal trials and correct no-signal trials. Because the occurrence and timing of the stop signal was unpredictable, on some trials subjects could not cancel their movement but instead made a saccade to the target. We refer to these error trials as noncancelled trials (they are also called “signal-respond” trials in the literature). Monkeys were not rewarded following these trials.

Figure 1.

Figure 1

The experimental tasks. A: Stopping. The dotted circle indicates the subject’s gaze within each frame. A one-sided arrow indicates a saccade. A majority of trials are no-signal trials in which the subject fixates centrally and responds to a peripheral target that appears by making a saccade to it. A minority of trials are stop trials in which following some delay after the presentation of the target, the central fixation point reappears, directing the subject to maintain central fixation. If they are able to successfully withhold the impending saccade, the trial is labeled as a cancelled trial. If the subject errantly makes a saccade to the target, the trial is labeled as a noncancelled trial. B: Search-step. A one-sided arrow indicates a saccade the subject makes. A majority of trials are no-signal trials in which the subject fixates centrally and responds to an array of stimuli that appears by making a saccade to the oddball target. A minority of trials are step trials in which following some delay after the presentation of the target, the location of the oddball singleton moves to a different location on the array through two isoluminant color changes, directing the subject to make a saccade to the new location of the target. If they are able to successfully make a saccade to the new target location, the trial is labeled as a compensated trial. If the subject errantly makes a saccade to the target, the trial is labeled as a noncompensated trial.

In this paper, we consider data collected for this task from five monkeys (Macaca mulatta and Macaca radiata) (Hanes et al., 1998; Paré & Hanes, 2003) and five human participants (Boucher, Stuphorn, et al., 2007). For the monkeys, the target could appear in one of two locations: either to the left or the right of the fixation point, positioned in the receptive field or movement field of a neuron.

For the human participants, the target could appear in one of four locations: in the upper or lower left, or the upper and lower right relative to the fixation point. The proportion of stop trials varied from 10 to 70% for monkeys (typically 25%), and was 30% for humans. The mean elapsed time between the start of consecutive trials was ~4 seconds for monkeys and humans. Target eccentricities were 8.5 degrees for humans, and varied between 4 and 16 degrees for monkeys, according to receptive field location for the neuron recorded as part of the neurophysiological experiment. More task details are available in the cited publications.

Search-step task

In the search-step task, no-signal and target-step trials were randomly interleaved (Figure 1). On no-signal trials, subjects were required to shift gaze to a color singleton, either a red target among green distractors or a green target among red distractors. The color of the singleton varied across sessions. On target-step trials, the target stepped to a different location in the array after a variable delay after its appearance in its initial location. We refer to this variable delay as the target-step delay (TSD). On these trials subjects were instructed to cancel their response to the initial location and shift their gaze directly to the new location (i.e., to compensate for the target step). We refer to these trials as compensated trials. Monkeys were rewarded following both compensated target-step trials and correct no-signal trials. Because the occurrence, timing, and location of the steps were unpredictable, on some trials subjects could not compensate for the step but instead made a saccade to the initial target location. We refer to these error trials as noncompensated trials. Monkeys were not rewarded following these trials.

In this paper, we consider data collected for this task from four monkeys (Murthy et al., 2007; Murthy et al., 2009) and three human participants (Camalier et al., 2007). For the majority of the sessions in which the monkey data were collected, the target appeared with 7 distractors (set size of 8). The target and distractors were evenly spaced in a circle around the central fixation point at the eccentricity of the receptive field of the neurons (4–16 degrees). For the human data, 1, 3, or 7 distractors appeared with the target randomly from trial to trial for most sessions at a fixed eccentricity of 9.5 degrees. On a subset of sessions with monkeys and a subset of blocks within sessions with humans, the target appeared without any distractors. This condition is equivalent to the familiar double-step task (e.g., Becker & Jürgens, 1979). For both humans and monkeys, the effects described here did not vary between the double-step and search-step tasks with different set sizes, so we combined data from the two tasks. The proportion of step trials varied from 25 to 50% for monkeys and was 40% for humans. The mean elapsed time between the start of consecutive trials was ~3 seconds for monkeys and ~5 seconds for humans.

Manipulation of stop signal or target step delay

In the stopping and stepping tasks, SSD and TSD are independent variables. When the delay is short, subjects are more likely to cancel the impending saccade. When the delay is long, subjects are more likely to make a saccade to the initial target location. For some sessions presented here, the values of SSD (TSD) were predetermined and presented randomly throughout the session independent of the subject’s behavior. We refer to these as randomized SSD (TSDs). In other sessions, a 1-up/1-down staircase was used to adjust SSD (TSD) on each trial based on the subject’s behavior. In this procedure, the delay was increased by a predetermined amount (50 ms for humans in both tasks, 17 to 50 ms in monkeys) following each cancelled or compensated trial and was decreased by the same amount following each noncancelled or non-compensated trial. The goal of this procedure is to ensure that subjects respond successfully to the stop signal or target step on around 50% of the trials (Logan, Schachar, & Tannock, 1997; Osman, Kornblum, & Meyer, 1990). We refer to these as staircased SSDs (TSDs). Most of the data for the stopping task were recorded using randomized SSDs, with the exception of data from monkeys H and N, which was primarily recorded using a staircase procedure. All of the search step data were recorded using the staircase procedure. For certain analyses pertinent to the manner of SSD or TSD selection, subsets of data are grouped and analyzed based on whether or not the staircase procedure was used.

Stop task SSDs ranged from 25 to 275 ms for humans, and 25 to 450 ms for monkeys for both staircased and non-staircased data. Step task TSDs ranged from 50 to 250 ms for humans and from 33 to 250 ms for monkeys. Monitor refresh rates varied between subjects and tasks but were either 60 or 80 Hz, depending on the experimental equipment used.

Race model accounts of performance in stopping and stepping

Performance in the stop-signal task can be understood as the outcome of a race between two stochastic processes, a GO process and a STOP process (Logan, 1994; Logan & Cowan, 1984; see also Boucher, Palmeri et al., 2007). The process that finishes first determines which behavior is produced. Recently this model has been extended to the search-step and double-step task with the addition of a second GO process to produce the compensated saccade (Camalier et al., 2007; see also Verbruggen, Schneider, & Logan, 2008). The race model formulation affords the ability to calculate the correct time needed to interrupt preparation of the initial movement (Logan & Cowan, 1984). This time is referred to as stop signal reaction time (SSRT) for the stop-signal task and target step reaction time (TSRT) for the search-step task.

We used two methods to estimate SSRT and TSRT (Figure 2). With the integration method, SSRT or TSRT can be calculated for each SSD or TSD by integrating the no-signal RT distribution until the proportion of RTs is equal to the proportion of noncancelled or noncompensation trials on the inhibition or compensation function for a particular SSD or TSD. The SSRT or TSRT is then given by that point in time minus the SSD or TSD. Using this method, an estimate of SSRT or TSRT is determined for each SSD or TSD, with the overall measure typically averaged across SSDS or TSDs. With the difference method, the mean of the inhibition (compensation) function is calculated by treating the function as a cumulative distribution function. The SSRT or TSRT is then equal to the mean of the no-signal RT distribution minus this value. SSRTs and TSRTs we report in this article are the average of the values from these two methods.

Figure 2.

Figure 2

Illustration of how SSRT and TSRT are calculated according to the race model. A: Probability density of response times in trials with no stop signal. Mean of distribution indicated by vertical dashed line. Duration of SSD (TSD) and of SSRT (TSRT) indicated by horizontal arrows. Shaded portion of the function indicates proportion of trials in which response would have occurred before the critical time of SSD + SSRT (TSD + TSRT) for a given SSD (TSD). B: Inhibition function plots the probability of responding on trials calling for a stop (step) response as a function of SSD (TSD). Lower horizontal arrow highlights the fraction of failures for the shortest SSD (TSD) which corresponds to shaded area in A. SSRT (TSRT) determined from difference between mean RT on no-signal trials and the midpoint of the inhibition function indicated by upper horizontal arrow.

Response time spectra

Power spectra quantify trial-by-trial nonindependence in RT data (Gilden, 2001; Wagenmakers et al., 2004). If the processes producing RTs in a time series are independent across trials (which also requires stationarity), the spectrum of the data series will be flat, like the spectrum of white noise sampled with the same frequency. To test whether RT data deviate from this prediction, we estimated the power spectra of RT series and averaged them across sessions for each subject. Power spectra of RTs on no-signal trials were estimated using the Lomb-Scargle method for unevenly sampled data (Lomb, 1976; Scargle, 1982) with stop or step trials treated as missing data. For each session, this produced a spectral estimate with frequency step sizes equal to the reciprocal of the number of trials in the session. The resulting frequencies ranged from one such step up to the Nyquist limit. Adjacent frequency components were averaged into bins spaced evenly on a logarithmic scale, and then averaged across each session to give a spectral estimate for each subject. Confidence intervals were calculated using the assumption that the spectral density estimates follow a chi-square distribution with degrees of freedom equal to twice the number of averaged estimates (Jarvis & Mitra, 2001). We considered this to be the number of sessions for each subject. For comparison, we randomly permuted the trial order once for each session and estimated the trial-shuffled spectrum by the same procedure used for the original data. For more details on these methods, please see Appendix C.

RESULTS

Data were obtained from humans and macaque monkeys performing a stop signal task and a search-step task with saccadic eye movements. All statistical tests were performed at a 0.05 significance level.

Nonindependent and nonstationary response times

We observed fluctuations in RT during the course of a session occurring on immediate (1 trial), local (~10 to 100 trials), and global (~1000 trials) time scales. Fluctuations on all of these scales can be seen in Figure 3, which shows a representative session of a monkey performing the step task. The raw RTs are presented in the top panel and the 100-trial running averages of RT, TSD, and percentage of step trials are shown in the middle and lower panels. Immediate variability can be attributed to the irreducible randomness of RT or adaptive control across successive trials. Local variation of RT often coincided with gradual changes of the running fraction of step trials or average target step delay (see also Emeric et al., 2007). Global variation could be expressed as a gradual slowing (or speeding) of RT across a session, probably resulting from extraneous factors not controlled or manipulated by the experiment such as fatigue or motivation fluctuations.

Figure 3.

Figure 3

Immediate, local, and global variation of RT, TSD and the percentage of step trials in a sample session of a monkey performing the search-step task with TSDs determined by a 1-up/1-down staircase procedure. The top plot shows unfiltered no-signal RTs. Arrows indicate two trials with RTs that exceeded the scale of the plot (left 431 ms, right 556 ms). The middle plot shows 100 trial running average of the RT (black), TSD (blue) and the percentage of step trials (red) for the same set of trials. The lower plot shows the same for a portion of the session.

A gradual increase of RT mean and variance is evident in Figure 3. To assess this for all of the sessions, we divided each session into thirds by trial number and compared the mean and variance between the initial and final thirds of each session. Table 1 summarizes the trends, indicating the numbers and percentages of sessions with significant increases or decreases of RT mean and variance (ranksum for mean, Levene’s nonparametric test for variance, both two tailed; the expected chance level is 2.5% for each cell in the table). More sessions than would be expected by chance had significant changes in RT mean and variance, although across subjects and sessions both decreases and increases of RT mean and variance were observed. Thus, RTs were nonstationary.

Table 1.

Numbers and proportions of sessions for each subject with significant increases and decreases to the mean and standard deviation of RT when comparing the first and last of three evenly sized epochs in a session. Means were tested using a nonparametric rank sum test, and variances were tested using Levene’s nonparametric test. Both tests were two-tailed. The expected chance level is 2.5% for each cell in the table.

Human stop
Subject Mean increase Mean decrease Standard deviation increase Standard deviation decrease
 SN 1/10 (10%) 1/10 (10%) 0/10 (0%) 1/10 (10%)
 JB 2/6 (33%) 0/6 (0%) 0/6 (0%) 0/6 (0%)
 KW 3/9 (33%) 1/9 (11%) 0/9 (0%) 0/9 (0%)
 EF 2/9 (22%) 1/9 (11%) 0/9 (0%) 0/9 (0%)
 EL 1/7 (14%) 1/7 (14%) 1/7 (14%) 0/7 (0%)

Human step
 CC 9/38 (24%) 24/38 (63%) 2/38 (5%) 5/38 (13%)
 LB 5/40 (13%) 16/40 (40%) 0/40 (0%) 3/40 (8%)
 SS 14/40 (35%) 15/40 (38%) 4/40 (10%) 2/40 (5%)

Monkey stop
 A 4/89 (4%) 3/89 (3%) 10/89 (11%) 3/89 (3%)
 C 2/17 (12%) 2/17 (12%) 1/17 (6%) 2/17 (12%)
 F 1/24 (4%) 3/24 (13%) 2/24 (8%) 1/24 (4%)
 H 8/67 (12%) 6/67 (9%) 3/67 (4%) 1/67 (1%)
 N 50/269 (19%) 45/269 (17%) 30/269 (11%) 21/269 (8%)

Monkey step
 C 12/34 (35%) 2/34 (6%) 12/34 (35%) 1/34 (3%)
 F 13/41 (32%) 8/41 (20%) 4/41 (10%) 5/41 (12%)
 L 21/47 (45%) 3/47 (6%) 9/47 (19%) 4/47 (9%)
 T 42/42 (100%) 0/42 (0%) 28/42 (67%) 1/42 (2%)

To quantify the degree of independence of RTs across trials, we calculated the frequency spectrum of RTs for each subject. Figure 4 shows the power spectra for the successive RTs produced by each subject with confidence intervals compared to the power spectra derived from a shuffled sequence of the same RTs. For both humans and monkeys in both the stepping and stopping tasks, spectral power was elevated at low frequencies. Across subjects, the power at the lowest frequency was at least twice the power at the highest frequencies. We observed the same pattern when calculating the RT spectra after removing any linear trends from the data. Thus, RTs show significant slow fluctuations beyond a linear trend occur during performance of these tasks. The higher power at low trial frequencies indicates that RTs within immediate and local time scales are expected to be positively correlated. We verified that this was the case for pairs of consecutive no-signal trials.

Figure 4.

Figure 4

Spectrum of RTs. The panels show RT mean-square power spectra plotted against frequency in units of cycles per trial, averaged across sessions for each subject. For each panel, the solid black line shows the power spectrum, with 95% confidence intervals shown in the dashed lines. The grey line in each panel shows the spectral estimate of the same data when the trial order within each session is randomly permuted. Plots are collected in each column based on the species and task for each subject as indicated. Across species and tasks RT spectra are significantly not flat for most subjects, with increased power at low frequencies and decreased power at high frequencies compared to that of the independent trial-shuffled spectrum.

Impact of nonindependent and nonstationary RTs on inhibition functions

Performance in stopping or stepping tasks is characterized by the probability of failing to cancel the initial movement as a function of the delay of the stop or step signal. The relationship of this inhibition (or compensation) function to the distribution of RTs is used to calculate SSRT (or TSRT). Having already demonstrated the nonindependence and nonstationarity of RT, in this section we consider the impact these have on the form of the inhibition (or compensation) function.

We plotted inhibition functions from different chronological epochs within sessions. Figure 5 displays data from a representative session in which a monkey performed the stop-signal task with the SSD adjusted through the staircase procedure. Figure 5A shows that RT increased gradually over the course of the session, coincident with a gradual increase in SSD. Figure 5B compares the inhibition function derived over the entire session to inhibition functions derived from an early epoch (during which RT and SSD were shorter) and a later epoch (during which RT and SSD were longer). The inhibition function over the entire session had a shallower slope than the inhibition functions from either epoch. Many sessions across species and tasks showed similar differences between session-level and epoch-level inhibition functions or compensation functions.

Figure 5.

Figure 5

Effects of nonindependent and nonstationary RTs on inhibition functions for staircased data. A: 100 trial running average of the RT (black), SSD (blue) and the percentage of step trials (red) for a sample session of a monkey performing the stopping task. SSDs for this session were determined by a 1-up/1-down staircase procedure. B: Comparison of inhibition function for an entire session with inhibition functions within two epochs. C: Transformation of inhibition functions by subtracting from the SSD the difference between the mean no-signal RT in an epoch and the mean no-signal RT over the entire session. D: Transformation of the inhibition function and of no-signal RT distribution resulting from subtracting from each SSD and RT the difference between the mean local RT and the mean overall RT. Left panel shows original and transformed inhibition functions. Right panel shows original and transformed no-signal RT distributions. SSRT calculated from original and transformed distributions were 141 and 136 ms respectively.

To compare inhibition functions across sessions, it has been shown previously that the abscissa of the inhibition function can be transformed to represent the relative finishing time of the STOP and GO processes by subtracting SSD and SSRT from the mean RT for each epoch (Logan & Cowan, 1984). The logic of this transformation follows from the race model claim that the probability of inhibiting depends on the relative finishing time of these processes, not on the absolute finishing time of either process alone. Specifically, as illustrated in Figure 5C, we produced a transformed SSD (referred to as SSD′) by subtracting the difference between the mean RT in each epoch and the mean RT over the entire session from the original SSD:

SSD=SSD(EpochRT¯RT¯).

This translates the inhibition functions from an epoch when a subject responds more quickly to higher values of SSD′ and translates the inhibition function from an epoch when a subject responds more slowly to lower values of SSD′. The transformed inhibition functions overlap each other as well as the inhibition function from the entire session. Note that this procedure does not change the slopes. We extended this epoch-by-epoch transformation procedure to a trial-by-trail transformation according to

SSDi=SSDi(localRTiRT¯).

The SSDi (TSDi) for the ith stop (step) trial was transformed to SSDi′ (or TSDi′) by subtracting the difference between the average RT on no-signal trials in the 101-trial interval centered on that trial (represented by Local RTi above) and the session average RT(RT¯above). The length of the averaging window was truncated as necessary near the start or end of a session. Resulting SSD′ (TSD′) values were binned, and the proportion of stop (step) trials in which the subject failed to cancel the initial responses in each bin was determined. The transformed inhibition (compensation) functions, which plot this proportion against the SSD′ (TSD′) values, allows us to probe the impact of nonindependence and nonstationarity on inhibition functions by providing an example of what the data would look like if fluctuations of mean RT were removed. The forms of these transformed inhibition (compensation) functions were characterized by cumulative Weibull function fits to the values. The slopes of the transformed inhibition (compensation) function were tested statistically as follows. We performed a permutation test comparing the median slopes of the transformed inhibition function to the slopes when trial order was randomly permuted 1000 times before applying the transformation procedure.

The left panel of Figure 5D shows the fitted cumulative Weibull distributions for the original and transformed inhibition functions for this sample session. The number and proportion of sessions in which the transformed inhibition function was significantly steeper than the original inhibition function is shown in the first column of Table 2. Across the population, the transformed inhibition function is significantly steeper in most sessions. In the human search step data this effect was less prevalent.

Table 2.

Numbers and proportions of staircased sessions for each subject in which a transformation to remove RT fluctuations significantly affected indicated values at a p < 0.05 level.

Human step
Subject Inhibition function slope No-signal RT standard deviation TSRT
 CC 2/38 (5%) 31/38 (82%) 0/38 (0%)
 LB 0/40 (0%) 34/40 (85%) 0/40 (0%)
 SS 1/40 (3%) 28/40 (70%) 0/40 (0%)

Monkey stop (staircase)
 H 34/67 (51%) 18/67 (27%) 0/67 (0%)
 N 25/56 (45%) 20/56 (36%) 0/56 (0%)

Monkey step
 C 28/34 (82%) 16/34 (47%) 2/34 (6%)
 F 30/41 (73%) 18/41 (44%) 0/41 (0%)
 L 38/47 (81%) 22/47 (47%) 0/47 (0%)
 T 27/42 (64%) 42/42 (100%) 14/42 (33%)

The foregoing analyses focused on data from sessions in which SSD (TSD) was adjusted on a staircase according to subjects’ performance. With the staircase procedure, a different range of SSD (TSD) values is presented within different epochs of an experimental session due to differences in RTs across epochs. To determine if the underestimation of the inhibition function slope is specific to the use of staircasing, we performed the same analyses on data from a monkey performing the stop-signal task with a set of SSD’s randomly presented with equal probability. Figure 6A shows a 100-trial running mean of the RTs and the probability of not canceling on stop trials, with two epochs highlighted. Clearly, the probability of not canceling varied inversely with RT. For the same SSD values, subjects are more likely to inhibit the initial movement during an epoch of slower responding.

Figure 6.

Figure 6

Effects of nonindependent and nonstationary RTs on inhibition functions when SSD is not adaptively staircased. Conventions as in Figure 5.

Figure 6B compares the inhibition functions from each epoch with that from the entire session. We compared the heights and slopes of these inhibition functions. The inhibition function from the epoch when the subject was responding more quickly lies above that from the epoch when the subject was responding more slowly. The inhibition function slopes between these particular epochs and the overall session were not noticeably different. However, when the same transformation applied to staircased sessions was applied to this session, the transformed inhibition function was again found to be significantly steeper than the original. This procedure was applied to each session with fixed SSD (TSD). The number and proportion of sessions of nonstaircased data for each subject in which the transformed inhibition function was significantly steeper than the original is shown in the first column of Table 3. Across the population this was significant for many nonstaircased sessions. Thus a shallower slope of the inhibition function from an entire session seems to be a general consequence of nonindependence and not due to adapting SSD (TSD) to performance via staircasing.

Table 3.

Numbers and proportions of nonstaircased sessions for each subject in which a transformation to remove RT fluctuations significantly affected indicated values at a p < 0.05 level.

Subject Inhibition function slope No-signal RT standard deviation SSRT
 A 25/89 (28%) 31/89 (35%) 1/89 (1%)
 C 2/17 (12%) 6/17 (35%) 0/17 (0%)
 F 12/24 (50%) 13/24 (54%) 1/24 (4%)
 N 43/213 (20%) 106/213 (50%) 0/213 (0%)

Estimating SSRT or TSRT

The transformation procedure was also used to calculate a transformed SSRT (TSRT) (designated SSRT′ (TSRT′)). To do so, RTs were transformed as follows:

RTi=RTi(LocalRTiRT¯).

The RTi for the ith trial with no stop (step) signal was transformed to RTi′ by subtracting the difference between the local average RT and the session average RT as described above.

Naturally, the distribution of RT′ is centered on the session mean but with less variance, as shown in the right panel of Figure 5D. Although modest, the significance of the reduction of variance for this session was verified statistically using another 1000 shuffle permutation test comparing the standard deviation of the RT′ distribution. For the session illustrated in Figure 6, the reduction of no-signal RT variance by the transformation approached significance (p = 0.055). For each subject, the number and proportion of sessions in which the transformation significantly reduced the RT standard deviation is shown in the second column of Tables 1 and 2 for staircased and nonstaircased data, respectively. Adjusting for RT nonindependence and nonstationarity by this transformation procedure significantly reduced the variance of no-signal RT distributions in many sessions for all subjects.

Using the SSD′ (TSD′) and RT′ values from which slow fluctuations in RT have been removed, we obtained a transformed SSRT′ (TSRT′). SSRT′ and SSRT values were not significantly different for the session illustrated in Figure 5 (SSRT = 141 ms, SSRT′ = 136 ms, permutation test) or Figure 6 (SSRT = 153 ms, SSRT′ = 152 ms, permutation test). The distributions of differences of SSRT′ (TSRT′) and SSRT (TSRT) across subjects and conditions are illustrated in Figure 7. Overall, accounting for the nonindependence and nonstationarity of RT had very little effect on the estimate of stop process duration SSRT (TSRT). The third columns of Tables 1 and 2 display for each subject the numbers and proportions of sessions in which SSRT′ (TSRT′) was significantly different from SSRT (TSRT). Adjusting for RT nonindependence and nonstationarity by this transformation rarely changed significantly the SSRT (TSRT). The only exception was monkey T performing the search step task, for whom 14 of 42 sessions showed a significant difference between TSRT and TSRT′.

Figure 7.

Figure 7

Effects of nonindependent and nonstationary RTs on estimations of SSRT or TSRT. Each panel show histograms of the original SSRT or TSRT values minus the transformed value (SSRT′ or TSRT′) for each session for a given subject, with plots arranged by species, task, and staircase condition as indicated.

Furthermore, we found no systematic bias in the distributions of SSRT′ (TSRT′) relative to SSRT (TSRT) (paired t-tests). Only subject CC performing the step task exhibited a significant difference between TSRT′ than TSRT (12.5 ms slower, t(37) = 3.3, p < 0.05). In spite of these idiosyncrasies we conclude that the estimation of SSRT (TSRT) is robust against nonstationarity or nonindependence of RT. Moreover, in Appendix A we show mathematically that with fluctuating GO and STOP process finish time distributions, one method of measuring SSRT (TSRT) provides a time-weighted average of the SSRT (TSRT) value over the entire session. This suggests that even as a subject’s RT fluctuates, the value of SSRT remains stable.

Trial-by-trial RT adjustments during stopping and stepping

A hallmark of executive control is the ability to change behavior based on past stimuli, responses, and outcomes. Many studies have shown that subjects adjust their RT based on the previous trial’s stimulus parameters (e.g., Verbruggen & Logan, 2008a) or their behavior on the previous trial (e.g., Emeric et al., 2007). These and related studies implicitly assume independence and stationarity in RT when examining RTs on trial n+1 based on the stimuli or responses in trial n. However, if the occurrence of the stop (step) response on trial n varies with fluctuations of RT alone, then conclusions drawn from an examination of RTs on trial n+1 alone may be misleading.

A change in RT on trial n+1 could be due to an executive control signal influencing behavior based on the outcome of trial n. Alternatively, relationships between performance on trials n and n+1 could simply be consequence of nonindependence and nonstationarity of RT. Hence, a change in RT on trial n+1 may not be due to an executive control signal. One way to account for the effects of nonindependence and nonstationarity is to consider what happened on the n−1 trial.

Figure 8 shows the RTs on no-signal trials before (n−1) and after (n+1) all three trial types for the stop task (no-signal, cancelled, and noncancelled) and the step task (no-signal, compensated, and noncompensated). Colors for each subject are indicated, and the horizontal dotted lines denote the grand mean no signal RT for each subject for comparison. We restricted this analysis to 3-trial sequences for noncancelled and cancelled trial types to those triplets in which the n−1 and n+1 trial were both no-signal trials. For the no-signal trial type we just required that the n−1 trial type was a no-signal trial. As shown previously, RTs appear slower following cancelled trials as opposed to noncancelled trials (e.g., Emeric et al., 2007). The current analysis shows that RT was also slower before noncancelled trials. Appendix B demonstrates mathematically that these differences in RT with trial history are a simple consequence of fluctuations in RT. The proof relies on the fact that for a given SSD more cancelled trials will tend to occur when the subject is responding slowly, while more noncancelled trials will tend to occur when the subject is responding quickly. Thus, the incidence of successful or unsuccessful inhibition varies with RT fluctuations, which is manifest in the RTs of trials before and after the alternative responses.

Figure 8.

Figure 8

Trial triplet analysis. As indicated in the schematics below panels C and D, the data included here are taken from occurrences of sequences of (from left to right) two consecutive no-signal trials, a cancelled (compensated) trial with a no-signal trial before and after it, and a noncancelled (noncompensated) trial with a no-signal trial before and after it during the stop (step) task. The mean RT on the no-signal trials from each sequence are plotted as indicated for each subject with colors corresponding to each subject as indicated beside each plot. The horizontal dotted lines show the overall mean no-signal RT for each subject. The thick dashed lines in A and C show for one human participant and one monkey the comparison that was made in Emeric et al. (2007) with these data. A and C show data for human participants and monkeys respectively performing the stop task, and panels B and D show data for human subjects and monkeys respectively performing the step task. For each condition, the monkey data in C and D plot the mean of all the session mean values for each subject, and the human data in A and B plot the aggregate mean value for all the trials pooled from all sessions.

To determine if the variation of RT after different types of trials exceeds what can be explained by nonindependence and nonstationarity of RT, we performed a pair of planned interaction contrasts of RT for each combination of species and task in a 3×2 design with trial type (no-signal, canceled/compenstated, noncanceled/noncompensated) and trial sequence (RT before or after the target trial type) as within-subject factors. An interaction in this design will reveal trial history effects independent of effects of RT fluctuations. A repeated measures omnibus ANOVA using Greenhouse-Geisser adjusted degrees of freedom revealed a significant interaction of trial type and sequence in the stop task for both humans (F(1.3, 5.2) = 11.7) and monkeys (F(1.5,6.0) = 7.1) but not in the step task (humans: F(2.0,4.0) = 1.7; monkeys: F(2.0,6.0) = 2.5).

We investigated the omnibus interaction in the stop task further. To determine if the magnitude of RT changes following cancelled trials differs from that following noncancelled trials, we performed a paired t-test of the differences in RTs before and after cancelled trials to the differences in RTs before and after noncancelled trials. No significant difference was found for either humans (t(4) = −0.5) or monkeys (t(4) = 0.8). To investigate whether subjects slow their responses following cancelled or noncancelled stop signal trials relative to responses following a no-signal trial, we performed paired t-test of the differences in RTs of consecutive no-signal trials compared to the average difference in RTs before and after cancelled or noncancelled trials. RTs were significantly faster following a no-signal trial as compared to following a cancelled or noncancelled trial (humans −21.7 ms, t(4) = −11.0; monkeys −6.0 ms, t(4) = −3.6). Taken together, these results show that both humans and monkeys are slower following a stop trial as opposed to following a no-signal trial, but the amount of slowing is comparable between cancelled and noncancelled trials. In the step task, generalized slowing following step trials was not observed.

DISCUSSION

We have shown that RTs in humans and monkeys performing the saccade stop-signal and search-step tasks are nonindependent and nonstationary across trials. However, we have shown empirically and mathematically that methods used to estimate SSRT (TSRT) are robust to such RT fluctuations. Nevertheless, nonindependence and nonstationarity of RT can result in an underestimate of the slope of the inhibition (compensation) function across a session. We have also shown how nonindependence and nonstationarity of RT influences analyses of trial history. We propose that examining the RT on trials both before and after a trial of interest can help account for changes in RT due only to nonindependence and nonstationarity. We found that RT was relatively slower both before and after cancelled stop signal trials compared to before and after noncancelled trials and RT was not specifically slowed after cancelled as compared to noncancelled trials.

Nonstationarity of the STOP process

We have shown that no-signal RTs in the saccade stop-signal and target-step tasks are nonindependent and nonstationary. Within the race model, this would be modeled as a GO process that slowly varies throughout a session and that is subject to trial-to-trial correlations. The stop process also could vary throughout a session (see Appendix A). However, because measurement of the SSRT (TSRT) requires 100 or more trials to produce a stable estimate, it is difficult to demonstrate the nonstationarity of SSRT (TSRT). Thus, we have not explicitly shown the nonstationarity of the stop process.

Race model implications

An important contribution of this work has been to show that the calculations of SSRT (TSRT) are largely unaffected by RT fluctuations. Calculations using the mean difference method will yield a time-weighted average of the SSRT (TSRT) over the session. Validating the measurement of SSRT (TSRT) is important because of its utility as a measure of impulsivity in clinical and developmental studies (e.g., Schachar et al., 2004).

While fluctuations in RT do not affect SSRT or TSRT calculations, we did demonstrate that it results in shallower inhibition functions. Because the slope of the inhibition function can be used to derive a measure of the variability of SSRT (Band et al., 2003; Colonius, 1990; Logan & Cowan, 1984), these new results suggest that fluctuations in RT can result in an overestimate of the variability of SSRT.

Choice of staircased or versus randomized SSDs

A subject of methodological interest for investigators using stopping or stepping tasks is whether to adjust the SSD (TSD) by a staircase procedure or randomly select from preset values. RT fluctuations occur in both staircased and nonstaircased sessions, but as we have shown, fluctuating RTs manifest some of their effects differently depending on how the SSDs are selected. For example, whether SSDs are staircased or randomized will affect how strongly RT fluctuations impact the trial history analyses. As RT varies during a session, a greater concentration of noncancelled trials will occur when a subject is responding quickly, while a greater concentration of cancelled trials will occur when a subject is responding slowly. This imbalance will be particularly prevalent when the SSDs are randomized. When using the staircase procedure, however, the proportion of canceled stop trials will be stabilized over global RT fluctuations, though there will still be some remaining bias because of local fluctuations in RT. All of the human and most of the monkey stopping data analyzed here and in Emeric et al. (2007) used randomized SSDs, which likely contributed to the magnitude of the RT shifts between the trials before cancelled and noncancelled trials.

Additionally, when staircasing is used, SSDs fluctuate in response to RT fluctuations, which creates a correlation of RT with SSD. We have found this correlation to be significant in most individual staircased sessions across species and tasks. One practical consequence of this is that this correlation should be taken into account when comparing noncancelled RTs to no-signal RTs. To verify that behavior conforms to the race model, investigators often compare the distribution of noncancelled RTs at each SSD to the distribution of no-signal RTs over the whole session. If at any SSD the noncancelled distribution exceeds the no-signal distribution, this is seen as a violation of the independence premise of the race model. However, when staircasing is used, this may not be a valid comparison because this correlation dictates that the overall no-signal RT distribution will be different from the RT distribution at each SSD, (TSD) particularly at the highest and lowest SSD (TSD). Instead it may be preferable to compare the noncancelled RT distribution at each SSD (TSD) to the RT distribution on no-signal trials when that same SSD (TSD) was expected.

In contrast to when staircased, when randomized SSD (TSD) is used, the values remain constant despite the RT fluctuations. Instead of a positive correlation between SSD (TSD) and RT there is a negative correlation between the probability of responding on a stop (step) trial and RT, as one would expect from the race model.

Stopping trial history

We have shown that inferences about the effect that events on trial n has on performance on trial n+1 must control for the nonindependence and nonstationarity of RT. We suggest using the no-signal trials on trial n−1 as a simple control comparison (since events on trial n cannot affect events on prior trial n−1). Of course, one could argue that trial n−1 is preceded by other trial types that would influence its RT, which in turn are influenced by other preceding trials, and so on. However, in practice, the numbers of equivalent trials preceding n−1 or following n+1 and beyond in these tasks are too few for sufficient statistical power.

Cabel et al. (2000) and Emeric et al. (2007) found greater slowing of RTs following canceled as compared to following noncancelled trials. Emeric et al. (2007) also reported no systematic slowing of RTs following noncancelled trials. This apparent lack of post-error slowing following a missed stop signal was surprising given the apparent ubiquity of post-error slowing in a range of tasks (e.g., Hajcak, McDonald & Simons, 2003; Rabbit, 1966). However, when we accounted for RT nonindependence and nonstationarity by examining trial n−1, we found that subjects are indeed slower to respond on trials following noncancelled (error) trials. Of note, however, subjects slowed their RTs to the same degree following cancelled (correct) trials. Thus, current results indicate a general slowing of RT following any stop signal trial. Clearly, accounting for RT nonindependence and nonstationarity has important implications for understanding alternative mechanisms whereby trial history affects performance (e.g., Botvinick, Braver, Barch, Carter, & Cohen, 2001; Schall & Boucher, 2007; Verbruggen, Logan, et al. 2008).

Acknowledgments

We thank Doug Hanes, Veit Stuphorn, Alex Gotler, Adi Murthy, and Kirk Thompson for their efforts in the original data collection, Corrie Camalier and Erik Emeric for assistance working with the datasets as well as original data collection, Courtney Segovis for assistance with the manuscript, and Pierre Pouget and Richard Heitz for helpful discussions. This work was supported by NIH R01-MH55806, NIH RO1-EY08890, NIH F32-EY016679, AFOSR FA 9550-07-1-0192, NSF SBE-0542013, NIH P30-EY08126, NIH P30-HD015052, the Temporal Dynamics of Learning Center SBE-0542013, an NSF Science of Learning Center, and Robin and Richard Patton through the E. Bronson Ingram Chair of Neuroscience.

APPENDIX A

Effect of nonindependence and nonstationarity on SSRT calculation with the mean-difference method

Here we will show that one common measurement of SSRT is robust to the nonindependent and nonstationary fluctuations that we have shown to exist in RT data. This holds provided that the proportion of stop trials presented to the subject remains constant through the RT changes. In particular, here we consider SSRT calculation using the mean-difference method (see Methods, Logan & Cowan, 1984).

For simplification, in the following formulation we consider the STOP and GO processes in discrete epochs of arbitrary numbers of trials with each process being stationary within an epoch. In the extreme case these epochs of stationarity can be as short as one trial, which makes no assumption of stationarity between any trials. The logic of the formulation would remain the same in this case, with two minor differences. The epoch means we describe would instead be considered to be the expected value of a single trial’s RT rather than the mean RT across an epoch, and the value of wi for all i could be simplified to 1/N where N is the number of trials in the session.

Using conventions from Logan and Cowan (1984), let f(t) denote the probability density function of the distribution of GO process finish times as measured by the RTs on no-signal trials over the entire session. Let wi denote the proportion of the total number of no-signal trials over the entire session that is contained within epoch i, and let ft(t) denote the distribution of GO process finish times within that epoch. Thus we define that

f(t)=iwifi(t). (1)

The mean GO process finish time is thus

T¯=tf(t)dt=t[iwifi(t)]dt=iwitfi(t)dt=iwiT¯i, (2)

where t is the mean GO process finish time for epoch i.

As described in Logan and Cowan (1984) the inhibition function, which is the probability of not canceling an initial saccade on a stop trial with a given SSD, can be treated as the cumulative distribution of some random function Td. Let Td be distributed as the function Φ(td) such that

φ(td)=dPr(td)dt, (3)

Where Pr(td) is the probability of responding on a stop trial with an SSD of td. For simplicity, we will assume that the duration of the ballistic component of the movement is zero, although that can be added to the model for completeness without affecting these results. Let fst(t) denote the distribution of STOP process finish times within each epoch. Thus for epoch i, the distribution of Td is given by

φi(td)=fSi(u)fi(u+td)du. (4)

For the entire session,

φ(td)=iwiφi(td)=iwifSi(u)fi(u+td)du. (5)

Importantly, if the ratio of stop trials is identical in each epoch, then each wi here will correspond to the wi for the no-signal distribution in equation 1 as the weight of each epoch’s contribution to the entire session’s inhibition function and the no-signal distribution will be the same.

We can then calculate the mean of this distribution as

T¯d=tdφ(td)dtd=iwitdfSi(u)fi(u+td)dudtd. (6)

With the observation that tdfSi(u)fi(u+td)dudtd=T¯iT¯si,, where si is the mean STOP process finish time for epoch I, equation 6 can be rewritten as

T¯d=iwi(T¯iT¯si)=iwiT¯iiwiT¯si. (7)

The difference-of-means method presented in Logan and Cowan (1984) suggests that one method to estimate SSRT for a given dataset is to subtract the mean of the inhibition function from the mean of the no-signal RT distribution for the entire session. Applying equations 2 and 7 we see that if the distributions of the GO and STOP process that vary across epochs within a session, this measurement would still amount to a weighted average of the SSRT in each epoch.

T¯T¯d=iwiT¯si. (8)

This would be the measurement of interest in most cases even if the SSRT distribution does vary within a session, and so this measurement of SSRT is robust to fluctuations in RT and SSRT during a session, given that the assumptions in the analysis hold.

One assumption that would not hold strictly true is that the fraction of stop trials is constant in every epoch simply due to randomness in the determination of stop trials and the timing of changes in RT. If this happens, it would bias the measurement of SSRT to some extent. For example, if during a given epoch in which the subject is responding faster than normal the subject was also presented with more stop trials than normal, that epoch would have a disproportionate effect in determining the inhibition function for the overall session than it would in determining the no-signal RT distribution for the entire session. This would shift the inhibition function earlier in time so that the no-signal RT distribution and resulting measurements of SSRT for the entire session would overestimate SSRT.

It is also worth noting that a change in the proportion of stop trials arising by chance can induce changes in RT (Emeric et al., 2007). This would suggest that these spontaneously occurring epochs could serve to bias the calculation of SSRT, resulting in some degree of underestimation of SSRT following the logic described above. For this reason it may be wise for experimenters to follow the common practice of pseudorandomizing the presentation of stop trials to prevent long stretches of too few or too many stop trials locally to mitigate this effect.

This would also suggest that a session with rapidly fluctuating RTs would result in more noise being added to the estimation of SSRT, but that measurements made from longer sessions should be more robust to the effects of this noise.

APPENDIX B

Effect of RT nonindependence and nonstationarity during stopping or stepping tasks on measurements of response times before and after cancelled and noncancelled trials

Here we will show that fluctuations in RT will cause the mean RT on no-signal trials before and after cancelled trials to be higher than the mean RT on no-signal trials before and after noncancelled trials even when the presence of a cancelled or noncancelled trial does not have any effect on the distribution of no-signal RTs on any trial. The proof below explicitly shows this for trials following a cancelled or noncancelled trial, but the same logic applies to trials preceding a cancelled or noncancelled trial.

For the sake of simplicity, we will consider the case in which an experimental session consists of two epochs of equal size and the SSDs are randomized such that each SSD is presented with the same probability in the two epochs. In epoch 1, suppose that the cumulative distribution function of the GO process finish times are given by some function F(t) with an expected value of T, and that the finish time distribution in epoch 2 is the same but slowed by a constant amount, tslow. Thus, in epoch 2 the cumulative distribution function of GO finish times is given by F(ttslow) with an expected value of + tslow.

Let RTNC1t and RTNC2t denote the ith RT on a no-signal trial following a noncancelled trial in the first and second epochs, respectively, and likewise let RTc1t and RTc2t denote the ith RT on a no-signal trial following a cancelled trial in the first and second epochs, respectively. Let the mean RT on no-signal trials following noncancelled and cancelled trials be given by TNC and c, respectively. Then,

T¯NC=1N1NC+N2NC(iN1NCRTNC1i+iN2NCRTNC2i)T¯C=1N1C+N2C(iN1CRTC1i+iN2CRTC2i), (1)

Where N1NC and N2NC are the total numbers of no-signal trials following noncancelled trials in the first and second epochs, respectively, and N1C and N2C are the total numbers of no-signal trials following cancelled trials in the first and second epochs, respectively. Focusing on noncancelled trials, because RTNC1t and RTNC2t are determined from independent identically distributed samples of the GO process’s finish time distribution, this means that:

E(T¯NC)=E(N1NC)T¯+E(N2NC)(T¯+tslow)E(N1NC)+E(N2NC). (2)

For the sake of simplicity, let SSRT be the same constant value between epochs, s. Let the variable Ntdj denote the number of stop trials in an epoch at a given SSD value tdj. By the logic of the race model,

E(N1NC)=jF(T¯s+tdj)E(Ntdj)E(N2NC)=jF(T¯s+tdjtslow)E(Ntdj). (3)

Note that when a staircase procedure is not used and the SSD is randomized as we consider here, the expectation of Ntdj is the same for both epochs. Similarly, for cancelled trials:

E(N1C)=j[1F(T¯s+tdj)]E(Ntdj)E(N2C)=j[1F(T¯s+tdjtslow)]E(Ntdj). (4)

The function F is a monotonically increasing cumulative distribution, so for any tdj:

F(T¯s+tdjtslow)F(T¯s+tdj), (5)

where the limit of equality is reached only if the value of F does not change anywhere in the range from Ts + tdjtslow to Ts + tdj Thus:

E(N1NC)E(N2NC) (6)

and

E(n1C)E(n2C). (7)

Equation 2 can be rewritten as:

E(T¯NC)=(1w2NC)T¯+w2NC(T¯+tslow)=T¯+w2NCtslow, (8)

where w2NC=E(N2NC)E(N1NC)+E(N2NC)

Similarly, it can be shown that:

E(T¯C)=T¯+w2Ctslow, (9)

where w2C=E(N2C)E(N1C)+E(N2C)

Using equations 6 and 7, we see that w2C ≥ 0.5 ≥ w2NC and thus

E(T¯C)E(T¯NC) (10)

even though there is no direct effect of any cancelled or noncancelled trial slowing the response on the following trial.

APPENDIX C

Spectral Methods

Here we provide background to the spectral analyses we used to test whether our RT data display power spectra that deviate from the flat spectrum associated with an independent time series.

For a given discretely sampled time series x[t] with a constant interval between samples, a direct estimate of its power spectrum can be obtained through the conventional periodogram. As shown below, the periodogram reflects a normalized square of a correlation of the time series with sinusoidal signals at a given frequency across all time points in the sample.

Px[f]=1No|t=1Nox[t]e2πift|2,

or equivalently

Px[f]=1No[(t=1Nox[t]cos(2πft))2+(t=1Nox[t]sin(2πft))2],

where N0 refers to the number of time points in the sample.

Such computations are often performed on signals that are digital samples over time of some underlying temporally continuous value. Examples from electrophysiology research include a local field potential or an electroencephalogram channel. Here we consider RT spectra analyses that are analogous to these signals, but with differences in the underlying implications. The unit of ‘time’ in these analyses is an ultimately discrete unit of trial numbers rather than a precise unit of time like seconds or ms. We thus consider frequency in units of inverse trial numbers rather than Hertz. However, in this analysis the concept of frequency may be more easily conceptualized by considering the corresponding period of a given frequency, which has units of trials. For the dependent variable of the time series, instead of volts (or indeed micro-volts) we measure RT in units of ms and measure power in units of ms2. The maximum possible sampling rate is fixed at 1 sample per trial, which results in a Nyquist frequency limit of 0.5 inverse trials that we can meaningfully consider.

The spectral analysis associated with the stopping and stepping tasks we consider in this paper come with an additional caveat. We are interested in the spectrum of the GO process, which can be directly measured from the RTs of no-signal trials only (Logan & Cowan, 1984). This means that we can only include these trials’ RTs in our spectral analysis which results in a missing datum for every stop or step trial. Importantly, it would be incorrect to ignore these missing data and analyze the sequence of no-signal trials only using techniques that assume regularly spaced data samples. Instead to accurately measure the RT power spectra, we must take into account the specific trial position of every no-signal RT. To do so we used techniques described in Lomb (1976) and Scargle (1982) for the spectral analysis of irregularly spaced data which we briefly review below.

Scargle (1982) presents the use of a modified periodogram:

P(f)=12{[jX(tj)cos(2πf(tjτ))]2jcos2(2πf(tjτ))+[jX(tj)sin(2πf(tjτ))]2jsin2(2πf(tjτ))},

where τ is defined as:

τ=122πftan1[jsin(22πftj)jcos(22πftj)].

Using the details described in Lomb (1976), Scargle (1982) demonstrates that this is the equivalent of a least-squares fit of sine waves to irregularly spaced data. Indeed regularly spaced data can be seen as a special case of this more general measure, as Scargle shows that in this case these expressions reduce to the conventional expressions for periodograms. The effect of the parameter τ is to maintain the invariance of the estimate to a time-shift in the input time series, as well as to preserve the accurate relative phases between different frequencies. For the special case of regularly spaced data, τ will equal zero. As Scargle shows, the other modifications of the periodogram serve to produce resulting estimates of spectral power that have the same statistical properties as the conventional periodogram with regularly spaced data. Based on this, we use statistical techniques that are described in Jarvis & Mitra (2001), and developed in Percival & Walden (1993). Specifically, a 95% confidence interval for the population spectral power at a given frequency, Ppop(f), given the estimated spectral power, P(f), is given by:

v0P(f)q2Ppop(f)voP(f)q1,

q1 and q2 respectively refer to the 2.5th and 97.5th percentiles of the chi-square distribution with degrees of freedom of vo. In our case the degrees of freedom are equal to twice the number of sessions averaged across. Before averaging across sessions, we also averaged spectral estimates in adjacent frequency bins within each session, but we did not add these estimates to our total degrees of freedom since some of these adjacent estimates would not be totally independent.

References

  1. Band GP, van der Molen MW, Logan GD. Horse-race model simulations of the stop-signal procedure. Acta Psychologica (Amsterdam) 2003;112:105–142. doi: 10.1016/s0001-6918(02)00079-3. [DOI] [PubMed] [Google Scholar]
  2. Becker W, Jürgens R. An analysis of the saccadic system by means of double step stimuli. Vision Research. 1979;19:967–983. doi: 10.1016/0042-6989(79)90222-0. [DOI] [PubMed] [Google Scholar]
  3. Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD. Conflict monitoring and cognitive control. Psychological Review. 2001;108:624–652. doi: 10.1037/0033-295x.108.3.624. [DOI] [PubMed] [Google Scholar]
  4. Boucher L, Palmeri TJ, Logan GD, Schall JD. Inhibitory control in mind and brain: An interactive race model of countermanding saccades. Psychological Review. 2007;114:376–397. doi: 10.1037/0033-295X.114.2.376. [DOI] [PubMed] [Google Scholar]
  5. Boucher L, Stuphorn V, Logan GD, Schall JD, Palmeri TJ. Stopping eye and hand movements: Are the processes independent? Perceptual Psychophysics. 2007;69:785–801. doi: 10.3758/bf03193779. [DOI] [PubMed] [Google Scholar]
  6. Broadbent DE. Decision and Stress. London: Academic Press; 1971. [Google Scholar]
  7. Cabel DW, Armstrong IT, Reingold E, Munoz DP. Control of saccade initiation in a countermanding task using visual and auditory stop signals. Experimental Brain Research. 2000;133:431–441. doi: 10.1007/s002210000440. [DOI] [PubMed] [Google Scholar]
  8. Camalier CR, Gotler A, Murthy A, Thompson KG, Logan GD, Palmeri TJ, et al. Dynamics of saccade target selection: Race model analysis of double step and search step saccade production in human and macaque. Vision Research. 2007;47:2187–2211. doi: 10.1016/j.visres.2007.04.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Colonius H. A note on the stop-signal paradigm or how to observe the unobservable. Psychological Review. 1990;97:309–312. [Google Scholar]
  10. Emeric EE, Brown JW, Boucher L, Carpenter RH, Hanes DP, Harris R, et al. Influence of history on saccade countermanding performance in humans and macaque monkeys. Vision Research. 2007;47:35–49. doi: 10.1016/j.visres.2006.08.03. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Fecteau JH, Munoz DP. Exploring the consequences of the previous trial. Nature Reviews Neuroscience. 2003;4:435–443. doi: 10.1038/nrn1114. [DOI] [PubMed] [Google Scholar]
  12. Freeman GL. The facilitative and inhibitory effects of muscular tension upon performance. American Journal of Psychology. 1933;26:602–608. [Google Scholar]
  13. Gilden DL. Cognitive emissions of 1/f noise. Psychological Review. 2001;108:33–56. doi: 10.1037/0033-295x.108.1.33. [DOI] [PubMed] [Google Scholar]
  14. Hajcak G, McDonald N, Simons RF. To err is autonomic: Error-related brain potentials, ANS activity and post-error compensatory behavior. Psychophysiology. 2003;40:895–903. doi: 10.1111/1469-8986.00107. [DOI] [PubMed] [Google Scholar]
  15. Hanes DP, Patterson WF, Schall JD. The role of frontal eye field in countermanding saccades: Visual, movement and fixation activity. Journal of Neurophysiology. 1998;79:817–834. doi: 10.1152/jn.1998.79.2.817. [DOI] [PubMed] [Google Scholar]
  16. Hanes DP, Schall JD. Countermanding saccades in macaque. Visual Neuroscience. 1995;12:929–937. doi: 10.1017/s0952523800009482. [DOI] [PubMed] [Google Scholar]
  17. Kornylo K, Dill N, Saenz M, Krauzlis RJ. Canceling of pursuit and saccadic eye movements in human and monkeys. Journal of Neurophysiology. 2003;89:2984–2999. doi: 10.1152/jn.00859.2002. [DOI] [PubMed] [Google Scholar]
  18. Jarvis MR, Mitra PP. Sampling properties of the spectrum and coherency of sequences of action potentials. Neural Computation. 2001;13:717–749. doi: 10.1162/089976601300014312. [DOI] [PubMed] [Google Scholar]
  19. Li CS, Krystal JH, Mathalon DH. Fore-period effect and stop-signal reaction time. Experimental Brain Research. 2005;167:305–309. doi: 10.1007/s00221-005-0110-2. [DOI] [PubMed] [Google Scholar]
  20. Logan GD. Skill and automaticity: Relations, implications and future directions. Canadian Journal of Psychology. 1985;39:367–386. [Google Scholar]
  21. Logan GD. On the ability to inhibit thought and action: A user’s guide to the stop signal paradigm. In: Dagenbach D, Carr T, editors. Inhibitory processes in attention, memory, and language. San Diego: Academic Press; 1994. pp. 189–239. [Google Scholar]
  22. Logan GD, Cowan WB. On the ability to inhibit simple and choice reaction time responses: A theory of an act of control. Psychological Review. 1984;91:295–327. doi: 10.1037//0096-1523.10.2.276. [DOI] [PubMed] [Google Scholar]
  23. Logan GD, Schachar RJ, Tannock R. Impulsivity and inhibitory control. Psychological Science. 1997;8:60–64. [Google Scholar]
  24. Lomb NR. Least-squares frequency analysis of unequally spaced data. Astrophysical and Space Science. 1976;39:447–462. [Google Scholar]
  25. Luce RD. Response Times: Their Role in Inferring Elementary Mental Organization. New York: Oxford University Press; 1986. [Google Scholar]
  26. Murthy A, Ray S, Shorter SM, Priddy EG, Schall JD, Thompson KG. Frontal eye field contributions to rapid corrective saccades. Journal of Neurophysiology. 2007;97:1457–1469. doi: 10.1152/jn.00433.2006. [DOI] [PubMed] [Google Scholar]
  27. Murthy A, Ray S, Shorter SM, Schall JD, Thompson KG. Neural control of visual search by frontal eye field: Effects of unexpected target displacement on visual selection and saccade preparation. Journal of Neurophysiology. 2009;101:2485–2506. doi: 10.1152/jn.90824.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Osman A, Kornblum S, Meyer DE. Does motor programming necessitate response execution? Journal of Experimental Psychology: Human Perception and Performance. 1990;16:183–198. doi: 10.1037//0096-1523.16.1.183. [DOI] [PubMed] [Google Scholar]
  29. Özyurt J, Colonius H, Arndt PA. Countermanding saccades: Evidence against independent processing of go and stop signals. Perception & Psychophysics. 2003;65:420–428. doi: 10.3758/bf03194573. [DOI] [PubMed] [Google Scholar]
  30. Paré M, Hanes DP. Saccadic reaction time in the monkey: Advanced preparation of oculomotor programs is primarily responsible for express saccade occurrence. Journal of Neurophysiology. 2003;76:3666–3681. doi: 10.1152/jn.1996.76.6.3666. [DOI] [PubMed] [Google Scholar]
  31. Percival DB, Walden AT. Spectral analysis for physical applications. Cambridge: Cambridge University Press; 1993. [Google Scholar]
  32. Rabbit PM. Error correction time without external error signals. Nature. 1966;212:438. doi: 10.1038/212438a0. [DOI] [PubMed] [Google Scholar]
  33. Rieger M, Gauggel S. Inhibitory after-effects in the stop signal paradigm. British Journal of Psychology. 1999;90:509–518. [Google Scholar]
  34. Scargle JD. Studies in astronomical time series analysis. II. Statistical aspects of spectral analysis of unevenly spaced data. Astrophysical Journal. 1982;263:835–853. [Google Scholar]
  35. Schachar RJ, Chen S, Logan GD, Ornstein TJ, Crosbie J, Ickowicz A, Pakulak A. Evidence for an error monitoring deficit in attention deficit hyperactivity disorder. Journal of Abnormal Child Psychology. 2004;32:285–293. doi: 10.1023/b:jacp.0000026142.11217.f2. [DOI] [PubMed] [Google Scholar]
  36. Schall JD, Boucher L. Executive control of gaze by the frontal lobes. Cognitive Affective and Behavioral Neuroscience. 2007;7:396–412. doi: 10.3758/cabn.7.4.396. [DOI] [PubMed] [Google Scholar]
  37. Verbruggen F, Logan GD. Long-term aftereffects of response inhibition: Memory retrieval, task goals, and cognitive control. Journal of Experimental Psychology: Human Perception and Performance. 2008a;34:1229–1235. doi: 10.1037/0096-1523.34.5.1229. [DOI] [PubMed] [Google Scholar]
  38. Verbruggen F, Logan GD. Response inhibition in the stop-signal paradigm. Trends in Cognitive Sciences. 2008b;12:418–424. doi: 10.1016/j.tics.2008.07.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Verbruggen F, Logan GD, Liefooghe B, Vandierendonck A. Short-term aftereffects of response inhibition: repetition priming or between-trial control adjustments. Journal of Experimental Psychology: Human Perception and Performance. 2008;34:413–426. doi: 10.1037/0096-1523.34.2.413. [DOI] [PubMed] [Google Scholar]
  40. Verbruggen F, Schneider DW, Logan GD. How to stop and change a response: The role of goal activation in multi-tasking. Journal of Experimental Psychology: Human Perception and Performance. 2008;34:1212–1228. doi: 10.1037/0096-1523.34.5.1212. [DOI] [PubMed] [Google Scholar]
  41. Wagenmakers EJ, Farrell S, Ratcliff R. Estimation and interpretation of 1/fα noise in human cognition. Psychonomic Bulletin & Review. 2004;11:579–615. doi: 10.3758/bf03196615. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Welford AT. Fundamentals of Skill. London: Methuen; 1968. [Google Scholar]
  43. Welford AT. Choice reaction time: Basic concepts. In: Welford AT, editor. Reaction Times. New York: Academic Press; 1980. pp. 73–128. [Google Scholar]

RESOURCES