Significance
The hippocampus is important for many kinds of learning and memory. We explored the role of the hippocampus in the learning of statistical regularities. We administered a motion discrimination task where expectation about stimulus regularities, the degree of attention afforded to the relevant stimulus, and the amount of available sensory information were manipulated. Although modestly slower overall, patients with bilateral damage to the hippocampus performed similar to controls, exhibiting a normal tendency to respond faster and more accurately when the motion direction was more probable, when the stimulus was better attended, and when more sensory evidence was present. These findings show that the ability to acquire expectations based on regularities of a sensory environment can be independent of the hippocampus.
Keywords: expectation, memory, hippocampus
Abstract
Prior knowledge about the probabilistic structure of visual environments is necessary to resolve ambiguous information about objects in the world. Expectations based on stimulus regularities exert a powerful influence on human perception and decision making by improving the efficiency of information processing. Another type of prior knowledge, termed top-down attention, can also improve perceptual performance by facilitating the selective processing of relevant over irrelevant information. While much is known about attention, the mechanisms that support expectations about statistical regularities are not well-understood. The hippocampus has been implicated as a key structure involved in or perhaps necessary for the learning of statistical regularities, consistent with its role in various kinds of learning and memory. Here, we tested this hypothesis using a motion discrimination task in which we manipulated the most likely direction of motion, the degree of attention afforded to the relevant stimulus, and the amount of available sensory evidence. We tested memory-impaired patients with bilateral damage to the hippocampus and compared their performance with controls. Despite a modest slowing in response initiation across all task conditions, patients performed similar to controls. Like controls, patients exhibited a tendency to respond faster and more accurately when the motion direction was more probable, the stimulus was better attended, and more sensory evidence was available. Together, these findings demonstrate a robust, hippocampus-independent capacity for learning statistical regularities in the sensory environment in order to improve information processing.
Visual input provides inherently ambiguous information about objects in the world (1). Prior knowledge about the probabilistic structure of the world plays a critical role in resolving this ambiguity (2). Thus, expectations about statistical regularities can improve the efficiency of decision making (3–16). For example, we learn from past experience that certain objects are more likely to be seen in particular contexts. Thus, when presented with an image of a gym, people are better at recognizing and processing information about a treadmill than a piano (17, 18).
A second factor that is based on prior knowledge, termed top-down attention, can also improve perceptual performance by facilitating the processing of information that is immediately relevant in the context of current behavioral goals (19–21). Attention sharpens the quality of relevant information by increasing the responsiveness of neurons in early visual cortex to task-relevant signals (22–24). Thus, when looking for your car in a parking lot, knowledge about its color, shape, and size can improve search by selectively facilitating the processing of potentially relevant target features. Critically, these 2 types of prior knowledge (expectation and top-down attention) are different, because expectations about what stimuli will be encountered in a given context can be entirely independent of what stimuli are attended based on behavioral relevance.
While much is known about attention, the process by which expectation about statistical regularities is acquired and used to guide behavior is not well-understood. The hippocampus has been implicated as a key structure involved in or perhaps necessary for the learning of statistical regularities (25, 26). In one study, controls were faster on a visual search task when search displays were repeated than when they were novel, but amnesic patients did not exhibit this advantage (25). There is some ambiguity about what damage was responsible for this impairment, because MRI scans were available for only 2 of the 4 patients tested and these indicated damage extending well beyond the hippocampus. In a subsequent study (27), patients with hippocampal damage confirmed by MRI performed similar to controls, that is, patients, like controls, searched repeated displays faster than novel displays. An impairment was observed only in a patient with damage extending beyond the hippocampus to include the parahippocampal gyrus and lateral temporal cortex.
In another study (26), a patient with large lesions of the medial temporal lobe viewed a long sequence of stimuli that contained a repeating pattern of 12 items. Unlike controls, the patient failed to learn the pattern. However, knowledge was assessed by asking participants to explicitly report or recognize the repeating pattern. These measures are unlikely to be representative of the patient’s knowledge, as memory-impaired patients can exhibit knowledge about the regularities in sequences indirectly through performance, despite an inability to verbally report declarative knowledge about the sequence (28). In the same way, patients can successfully acquire skills or habits even when they are unable to express knowledge about the task itself (29–31). Notably, in a serial reaction time task, hippocampal patients and controls learned a 12-item sequence of 4 button presses guided by visual cues (28). Reaction time improved as participants practiced the sequence and came to anticipate the order in which the cues appeared. Critically, both groups markedly slowed their reaction times when the sequence was unexpectedly changed, thereby demonstrating that they had learned the sequence. Nevertheless, the patients were unable to verbally report the sequence or to recognize it. These considerations point out the utility of indirect, performance-based measures to assess knowledge about statistical regularities and raise doubts about the importance of the hippocampus in acquiring such information.
The present study examined the contribution of the hippocampus to the learning of statistical regularities more directly by devising a motion discrimination task in which expectation was manipulated by presenting one (expected) motion direction more frequently than other (unexpected) directions. Four memory-impaired patients with bilateral damage to the hippocampus, as well as controls, reported the direction of motion by moving a joystick from the starting point to an end point along a trajectory from 0 to 360° (Fig. 1). We also included 2 additional conditions: (i) a manipulation of the amount of sensory information (high versus low motion coherence) available in each stimulus display, and (ii) a manipulation of top-down attention (focused versus divided). Manipulating the amount of sensory information allowed us to parametrically assess interactions between the strength of sensory signals with top-down attention and expectation. Notably, sensory and attentional processes are thought to be independent of hippocampal function on the basis of findings from patients such as H.M. and E.P. (25–28). Accordingly, the manipulations of sensory information and attention serve as control or baseline conditions against which to evaluate the ability of patients to form and use expectations about statistical regularities.
Fig. 1.
Sample trial. A trial began with an attention cue (1,000 to 1,500 ms) to indicate the color of the dots that would represent coherent motion. A white (black) attention cue indicated that coherent motion would be represented with white (black) dots. A blue attention cue indicated that coherent motion would be represented with either white or black dots, that is, the participant had to discern which color of dots was in coherent motion. (A) At 300 ms after stimulus onset (motion direction 112° in this case, as indicated by the arrow), the participant has not yet begun a response, and the black dot represents the stationary joystick. The response trajectory, which is the distance that the joystick has moved from the center, remains close to 0, and the response error is approximately at chance (90°). (B) At 700 ms after stimulus onset, the participant has accumulated some information about the direction of coherent motion and begun a response, trying to match the movement of the joystick to the direction of motion. The response error shows the difference between the direction of the participant’s response and the target motion direction at each time point. (C) At 1,000 ms after stimulus onset, the participant has moved the joystick its maximal distance. The response trajectory reaches its maximum at this time, and the response error is now close to 0.
Results
Response Trajectories.
The response trajectory indicated how far the joystick had moved from the center at each time point (0 to 1,500 ms). The coherence level of the motion displays (high/low coherence) affected controls and patients similarly (Fig. 2A). For controls, the trajectory amplitudes were different from 567 to 1,408 ms after stimulus onset (high > low coherence). For patients, the trajectory amplitudes were different from 633 to 1,225 ms after stimulus onset (high > low coherence) (all resampled P < 0.05).
Fig. 2.
Response trajectories. Response trajectories for controls and patients with hippocampal lesions were plotted from the onset of coherent motion (0 ms) to 1,500 ms after onset. (A–C) Response trajectories were plotted (A) as a function of coherence level (high/low), (B) as a function of attention (focused/divided), and (C) as a function of expectation (expected/unexpected). (D and E) Differences in response trajectories for each manipulation condition were plotted together with the associated P values. From 567 to 1,408 ms in controls, and from 633 to 1,225 ms in patients (A), the joystick had moved farther when coherent motion was presented at a high coherence than at a low level (resampled P < 0.05). From 550 to 1,392 ms in controls, and from 600 to 1,492 ms in patients (B), the joystick had moved farther when attention was focused than when attention was divided (resampled P < 0.05). From to 508 to 892 ms in controls, and from 567 to 1,017 ms in patients (C), the joystick had moved farther when coherent motion was presented in the expected direction than in the unexpected direction (resampled P < 0.05). In addition, from 1,400 to 1,500 ms in controls, and from 1,258 to 1,500 ms in patients (C), the joystick had moved farther when coherent motion was presented in the unexpected direction than in the expected direction (resampled P < 0.05). For E, the legend is the same as in D. Error bars for each of the 3 measures indicate 95% CIs computed by resampling the data distribution.
Manipulations of attention (focused/divided) also affected controls and patients similarly (Fig. 2B). For controls, the trajectory amplitudes were different from 550 to 1,392 ms after stimulus onset (focused > divided). For patients, the trajectory amplitudes were different from 600 to 1,492 ms after stimulus onset (focused > divided) (all resampled P < 0.05).
Expectation (expected/unexpected) also affected controls and patients similarly (Fig. 2C). For controls, the trajectory amplitudes were different from 508 to 892 ms after stimulus onset (expected > unexpected) and also from 1,400 to 1,500 ms after stimulus onset (unexpected > expected). This effect is not visually remarkable in Fig. 2C, but is clear in Fig. 2D. For patients, the trajectory amplitudes were different from 567 to 1,017 ms after stimulus onset (expected > unexpected) and also from 1,258 to 1,500 ms after stimulus onset (unexpected > expected). Fig. 2D summarizes the effects of coherence level, attention, and expectation. Fig. 2E shows the P values for each condition and at each time point (0 to 1,500 ms) (all resampled P < 0.05). There were no interactions between coherence levels, attention, and expectation on response trajectories for either controls or patients.
Patients performed similar to controls across all 3 manipulations of coherence level, attention, and expectation. Each patient performed within the 95% confidence intervals of the control group in all conditions (SI Appendix). Note that the onset of these effects was delayed in patients compared with controls (coherence level: 567 ms [controls] vs. 633 ms after stimulus onset [patients]; attention: 550 ms [controls] vs. 600 ms [patients]; expectation: 508 ms [controls] vs. 567 ms [patients]; all resampled P < 0.05). As this effect was similar across manipulations of bottom-up sensory information and top-down factors like attention and expectation, this slowing likely reflects a modest impairment in the ability of patients to exploit available perceptual information in the service of decision-making tasks (27, 28, 32).
Response Errors.
Response errors were computed as the absolute difference at each time point between the participant’s response angle and the calibrated angle for that participant. The magnitude of the response errors, before and after the onset of the joystick movement, indexed the accuracy of the direction judgment of participants.
The coherence level of the presented motion directions (high/low coherence) affected controls and patients similarly (Fig. 3A). For controls, the magnitude of the response errors was different from 642 to 1,100 ms after stimulus onset (high < low coherence). For patients, the magnitude of the response errors was different from 733 to 1,050 ms after stimulus onset (high < low coherence) (all resampled P < 0.05).
Fig. 3.
Response errors. Response errors for controls and patients with hippocampal lesions were plotted from the onset of coherent motion (0 ms) to 1,500 ms after onset. (A–C) Response errors were plotted (A) as a function of coherence level (high/low), (B) as a function of attention (focused/divided), and (C) as a function of expectation (expected/unexpected). (D and E) Differences in response trajectories for each manipulation condition were plotted together with the associated P values. From 642 to 1,100 ms in controls, and from 733 to 1,050 ms in patients (A), response errors were lower when coherent motion was presented at a high coherence than at a low level (resampled P < 0.05). From 567 to 1,133 ms in controls, and from 775 to 817 ms in patients (B), response errors were lower when attention was focused than when attention was divided (resampled P < 0.05). (C) Expectation reduced baseline response errors (i.e., at the onset of coherent motion; 0 ms), and this effect lasted until 708 and 1,067 ms after stimulus onset in controls and patients, respectively (resampled P < 0.05). For E, the legend is the same as in D. Error bars for each of the 3 measures indicate 95% CIs computed by resampling the data distribution.
Attention (focused/divided) also affected controls and patients similarly (Fig. 3B). For controls, the magnitude of the response errors was different from 567 to 1,133 ms after stimulus onset (focused < divided). For patients, the magnitude of the response errors was different from 775 to 817 ms after stimulus onset (focused < divided) (all resampled P < 0.05).
Expectation (expected/unexpected) also affected controls and patients similarly (Fig. 3C). For controls, the magnitude of the response errors was different from 0 to 708 ms after stimulus onset (expected < unexpected). For patients, the magnitude of the response errors was different from 0 to 1,067 ms after stimulus onset (expected < unexpected) (all resampled P < 0.05). Fig. 3D summarizes the effects of coherence level, attention, and expectation. Fig. 3E shows the P values for each condition and at each time point (0 to 1,500 ms). There were no interactions between coherence levels, attention, and expectation on response errors for either controls or patients. Each patient performed within the 95% confidence intervals of the control group in all conditions (SI Appendix).
Discussion
We examined the contribution of the hippocampus to the ability to learn statistical regularities by devising a motion discrimination task where expectation about motion direction was manipulated such that one (expected) direction was presented more frequently than other (unexpected) directions. We also asked if patients with lesions to the hippocampus would benefit as much as controls from the effects of focused versus divided attention and from the effects of strong versus weak sensory evidence. Despite a modest slowing in response initiation across all task conditions, patients performed similar to controls. Both controls and patients exhibited a similar benefit of expectation on response accuracy and speed beginning immediately after stimulus onset (Figs. 2C and 3C), both groups responded more quickly and more accurately when attending to 1 color of dots versus 2 colors (Figs. 2B and 3B), and both groups responded more quickly and more accurately when the sensory evidence was strong (high coherence) than when it was weak (low coherence) (Figs. 2A and 3A). Together, these findings indicate that the ability to learn statistical regularities, selectively attend to behaviorally relevant stimuli, and perform better when given stronger sensory evidence is intact after bilateral hippocampal lesions.
The present study used a continuous decision task, such that performance could be assessed at all time points from stimulus onset to response offset. Participants reported the direction of motion by moving a flight simulator joystick along a path (0 to 360°) to match the perceived direction of moving dots. Knowledge about the statistical regularities of motion direction was indirectly assessed by measuring how far the joystick had moved and how accurate the response was at each time point. These indirect, performance-based measures were used because hippocampal patients have been shown to acquire skills and habits even when they do not have explicit knowledge about the task itself (28), and even when they are unaware that they have been tested before (29–31).
Expectation about statistical regularities improves information processing and behavior in a variety of perceptual tasks (2, 14–16, 33–35). Past work suggested that the hippocampus might be critical in the learning of statistical regularities (25, 36) in light of its importance for many forms of learning and memory. In our study, however, patients successfully learned about statistical regularities, and they were able to exploit expectations as well as controls. Our results are in line with an earlier study that tested hippocampal patients in a serial reaction time task. In that study, participants learned a sequence of button presses guided by visual cues (28). Reaction time for both controls and patients improved as they practiced the sequence and successfully learned the order in which the lights would appear. Like controls, patients slowed their reaction times when the sequence of lights unexpectedly changed. Despite this evidence for implicit knowledge about the learned sequence, the patients were unable to verbally report the sequence or to recognize it among 4 choices. A similar finding was reported in an earlier study of statistical learning in which a patient with large medial temporal lobe lesions attempted to learn a repeating pattern of 12 items (26). As in Reber and Squire (28), this patient also failed to exhibit knowledge of the sequence when asked for an explicit report of the repeating sequence or when asked to recognize it. However, the patient was not tested using indirect, performance-based measures that might have revealed implicit knowledge about the sequence.
One way in which our task differed from previous tasks is in the nature of the information needed to be learned and used to support performance. To benefit from statistical learning in our task, participants had to form knowledge about the direction of motion that had the highest probability of being presented in each test block. It is possible that the statistical learning of other kinds of information (such as spatial locations) might yield different results.
With the current task, we cannot determine if the effects of expectation on response error reflect response bias or changes in perceptual sensitivity or both. However, recent work has demonstrated that response bias (i.e., expectation about motor responses) affects information processing in the same manner as expectation about stimulus features such as stimulus color and orientation (34, 35). In addition, there is an effect of response error at 0 ms (i.e., stimulus onset), consistent with an important role for response bias. Thus, we argue that the effects on response errors are primarily driven by changes in response bias that occurred due to learned expectations about the motor responses associated with each of the expected coherent motion directions.
In the present study, patients also benefited as much as controls from manipulations of attention and the amount of available sensory evidence. These findings are consistent with a sizeable literature showing that patients with hippocampal lesions perform well on tests of intelligence and perceptual function (37–41). That said, previous work has not specifically examined the importance of the hippocampus for the top-down deployments of selective attention. Thus, the intact performance reported here, though not surprising, demonstrates directly that the hippocampus is not necessary to exploit attentional cues in order to determine behavioral relevance.
In summary, we evaluated statistical learning, attention, and processing of sensory evidence in memory-impaired patients with circumscribed hippocampal lesions. Patients and controls performed similarly in all respects. Thus, patients exhibited a normal tendency to perform faster and more accurately when the stimulus was probable, behaviorally relevant, and provided stronger sensory evidence. These findings demonstrate a robust capacity for acquiring expectations about statistical regularities in the sensory environment that can operate independent of the hippocampus.
Methods
Participants.
Four memory-impaired patients participated with bilateral lesions thought to be limited to the hippocampus (CA fields, dentate gyrus, and subicular complex) (Table 1). Patients D.A. and G.W. became amnesic in 2011 and 2001, respectively, following a drug overdose and associated respiratory failure. K.E. became amnesic in 2004 after an episode of ischemia associated with kidney failure and toxic shock syndrome. L.J. (the only female) became amnesic during a 6-mo period in 1988 with no known precipitating event. Her memory impairment has been stable since that time.
Table 1.
Characteristics of memory-impaired patients
| Patient | Age, y | Education, y | WAIS-III IQ | WMS-R | ||||
| Attention | Verbal | Visual | General | Delay | ||||
| D.A. | 34 | 12 | 95 | 104 | 90 | 91 | 90 | 56 |
| K.E. | 76 | 13.5 | 108 | 114 | 64 | 84 | 72 | 55 |
| L.J. | 81 | 12 | 101 | 105 | 83 | 60 | 69 | <50 |
| G.W. | 58 | 12 | 108 | 105 | 65 | 86 | 70 | <50 |
WAIS-III, Wechsler Adult Intelligence Scale III; WMS-R, Wechsler Memory Scale Revised. The WMS-R does not provide numerical scores for individuals who score <50. The IQ score for D.A. is from the WAIS-IV.
For the 4 patients, the average score per passage for delayed recall (30 min) of 2 short prose passages was 1.0 segment (25 segments per passage). The average score for delayed recall (10 min) of a complex diagram was 5.4 (maximum score 36). Paired-associate learning of 10 unrelated noun–noun pairs summed across each of 3 successive trials was 3.8 pairs (30 pairs total) (Table 2). On these same tests, 11 controls scored 20.2 for the prose passages, 18.3 for the diagram, and 24.1 for paired-associate learning (42).
Table 2.
Neuropsychological scores for memory-impaired patients
| Patient | Prose recall, segments | Diagram recall | Paired-associate learning, pairs |
| D.A. | 3 | 9 | 13 |
| K.E. | 0.5 | 4.5 | 2 |
| L.J. | 0 | 5 | 0 |
| G.W. | 0.5 | 3 | 0 |
Estimates of medial temporal lobe (MTL) damage were based on quantitative analysis of magnetic resonance (MR) images from 19 age-matched, healthy males for K.E. and G.W., 11 age-matched, healthy females for patient L.J. (43), and 8 young healthy males for D.A.; patients D.A., K.E., L.J., and G.W. have an average bilateral reduction in hippocampal volume of 35, 49, 46, and 48%, respectively (all values are at least 2.9 SDs from the control mean). On the basis of 2 patients (L.M. and W.H.) with similar bilateral volume loss in the hippocampus for whom detailed postmortem neurohistological information was obtained (44), the degree of volume loss in these four patients may reflect nearly complete loss of hippocampal neurons. That is, patients L.M. and W.H. had a nearly complete loss of hippocampal neurons, despite exhibiting considerable sparing of hippocampal volume as measured by MRI. Apparently, neuronal death need not lead to disappearance of all hippocampal tissue, perhaps because the tissue can be supported to some extent by glia and white matter.
The volume of the parahippocampal gyrus (temporopolar, perirhinal, entorhinal, and parahippocampal cortices) is reduced by −5, 11, −17, and 10%, respectively (all values within 2 SDs of the control mean). Minus values indicate volumes that were larger for a patient than for controls. These values are based on published guidelines for identifying the boundaries of the parahippocampal gyrus (45, 46). Eight coronal magnetic resonance images from each patient, together with detailed descriptions of the MTL lesions, can be found elsewhere (47).
Ten healthy controls (3 female) also participated (mean age 64.9 ± 13.5 y; mean education 14.3 ± 1.8 y). All procedures were approved by the Institutional Review Board at the University of California, San Diego, and both patients and controls gave written informed consent prior to participation.
Stimuli.
In each of 2 ∼1-h test sessions, participants completed a block of calibration trials (n = 60 trials), a block of practice trials (n = 104 trials), and 5 test blocks (n = 104 trials for each block).
For the calibration trials, stimuli consisted of 400 black dots (diameter 0.18°) displayed in an annulus (outer diameter 22°; inner diameter 2.4°) on a dark gray background (luminous intensity 42.68 ± 2.20 cd/m2; Fig. 1). Black dots within the annulus were flickered at 33 Hz for the duration of the trial, and each dot was randomly replotted on each frame. On each trial, 100% of the dots (i.e., 100% coherence) were coherently moved in one of the 5 possible motion directions (46 to 334° with 72° increments). Dot stimuli moved at a speed of 100 pixels per ms. Participants were instructed to report the motion direction of these moving dots via a USB-compatible flight simulator joystick. The purpose of the calibration trials was to estimate how each participant represented each motion direction. These estimates were used to compute performance accuracy on the test trials.
For the practice and test trials, stimuli consisted of 200 black dots and 200 white dots (diameter 0.18°) displayed in an annulus, as in the calibration trials, but surrounding an attention cue of either black, white, or blue. Black and white dots within the annulus were flickered at 33 Hz for the duration of the trial, and each dot was randomly replotted on each frame. During coherent motion, either 50% (low coherence) or 70% (high coherence) of the black (or white) dots was randomly selected on each frame to be displaced in one of 5 possible motion directions (46 to 334° with 72° increments), while the remaining dots were assigned one of 5 other motion directions. Dot stimuli moved at a speed of 100 pixels per ms. Participants were instructed to report the motion direction of the moving dots via a USB-compatible 360° flight simulator joystick.
Stimuli were presented on a PC with Windows XP using MATLAB (MathWorks) and the Psychophysics Toolbox [version 3.0.8 (48, 49)]. Participants were seated 60 cm from the CRT monitor running at 100 Hz with a gray background of 42.68 ± 2.20 cd/m2.
Procedure.
Participants performed a version of the random dot motion task (50–52), such that the amount of sensory evidence (coherence levels), selective attention, and expectation about target direction could be manipulated. Participants completed 2 test sessions, each of which consisted of calibration trials, practice trials, and 5 blocks of test trials as described above. Each test trial began with a display consisting of an attention cue, either black, white, or blue. A black or white cue informed participants to monitor either the black or white dots (focused attention), and the blue cue informed participants to monitor both black and white dots (divided attention) to determine which color of dots displayed coherent motion. After 1,000 to 1,500 ms, black and white moving dots were presented for 2,000 ms, such that a proportion, either 50% (low coherence) or 70% (high coherence) of either black or white dots, formed coherent motion in one of the 5 possible directions. The remaining dots were randomly assigned to the other 4 directions. Note that the attention cue was always valid such that on focused-attention trials the coherent motion was represented by black dots on half the trials and by white dots on half the trials. For each test block of 104 trials, half of the test trials were focused-attention trials and the other half were divided-attention trials, yielding a total of 520 trials for focused- and divided-attention conditions for each participant in each of the 2 test sessions. Presentation of the moving dots was followed by a 500- to 800-ms blank intertrial interval (ITI). For each test block, expectation about motion direction was manipulated such that one (expected) direction (out of 5 possible directions) was presented on 69.2% of trials (72 trials per block), whereas the other (unexpected) directions were presented equally on the remaining 30.8% of trials (32 trials per block). The expected motion direction differed from one test block to another such that each of the 5 possible motion directions was assigned as the expected direction in just one block per session. Participants indicated the target motion direction by moving the flight simulator joystick its maximal distance in a direction matching the coherent motion. After making a response, participants returned the joystick to the center in preparation for the next trial. Responses were considered valid when they occurred in the interval between stimulus onset and ITI offset. In summary, each participant was given 1,040 trials. All 3 factors of interest (attention, expectation, and coherence levels) were manipulated orthogonally such that each participant was given a total of 520 focused-attention trials (260 of which were low-coherence trials and the other 260 high-coherence trials), 520 divided-attention trials (260 of which were low-coherence trials and the other 260 high-coherence trials), 720 expected trials, and 320 unexpected trials.
To familiarize participants with the task and the joystick, practice trials were given at the beginning of each session. There were a total of 104 practice trials from all attention conditions (focused/divided), coherence levels (high/low coherence level), motion directions (46 to 334° in 72° increments), and target color conditions (black/white). After practice, participants performed a block of calibration trials. Participants reported coherent motion consisting of 100% coherent dots using the flight simulator joystick. In each session, participants completed one block of 60 calibration trials (12 of each of the 5 possible motion directions).
Data Analysis.
We first estimated how each participant responded to each of the 5 motion directions (46 to 334° in 72° increments) by computing circular medians of the participant’s responses to each motion direction on the calibration trials (mean responses across controls and patients were 41.3, 127.5, 169.1, 250.6, and 303.5° for the motion directions of 46, 117, 189, 261, and 333°, respectively). These calibrated angles were later used as participant-specific baselines to compute performance accuracy on the test trials for each participant.
For each test trial in the main task, we first computed at each time point how far the joystick had moved from the center (response trajectory). We next identified the coordinate of the joystick at its maximum distance from the starting point and used that value to compute the angle in degrees from the starting point to the end point. We then computed the difference between the response angle at each time point and the calibrated response at each time point (response error). Response errors could be recorded even before the joystick began moving toward the end point, based on the direction in which the joystick was oriented. Test trials where responses were either made after the response deadline or where the response errors at the joystick’s maximal distance were more than 150° were excluded from further analysis.
We also examined the effect of coherence level (low/high), attention (focused/divided), and expectation (expected/unexpected) on response trajectories and response errors across time. Finally, we asked whether each patient’s performance conformed to control performance by comparing response trajectories and response errors of each patient with the control averages.
Statistical Procedures.
Due to the small number of participants (10 controls and 4 patients), a bootstrapping procedure was performed to assess significant differences between conditions and to establish 95% confidence intervals. Specifically, each of the bootstrapping iterations was performed by resampling with replacement at the level of individual trials and computing means for each comparison of interest. All reported confidence intervals (CIs) were computed based on 1,000 bootstrapping iterations for each comparison. Note that this method constrains the resolution of P values to a lower limit of P ≤ 0.001. We generated permuted null distributions of response trajectories and response errors for each participant, each condition, and each time point. For tests comparing a bootstrapped distribution against 0, P values were computed by conducting 2 one-tailed tests against 0 (e.g., mean[difference in response trajectories < 0] and mean[difference in response trajectories > 0] and doubling the smaller P value).
Supplementary Material
Acknowledgments
This work was supported by the Medical Service of the Department of Veterans Affairs (51K6CX001644) (to L.R.S.), Award CX000359 (to L.R.S.), National Institute of Mental Health Grant 24600 (to L.R.S.), NIH R01-EY025872 (to J.T.S.), James S. McDonnell Foundation (J.T.S.), and mission funding from the US Army Research Laboratory. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the Army Research Laboratory or the US Government. We thank Jennifer Frascino for assistance.
Footnotes
The authors declare no conflict of interest.
This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1904502116/-/DCSupplemental.
References
- 1.von Helmholtz H., Helmholtz’s Treatise on Physiological Optics [in German] (Optical Society of America, Rochester, NY, 1924), vol. 1.
- 2.Summerfield C., de Lange F. P., Expectation in perceptual decision making: Neural and computational mechanisms. Nat. Rev. Neurosci. 15, 745–756 (2014). Erratum in: Nat. Rev. Neurosci.15, 816 (2014). [DOI] [PubMed] [Google Scholar]
- 3.Edwards W., Optimal strategies for seeking information : Models for statistics, choice reaction times, and human information. J. Math. Psychol. 2, 312–329 (1965). [Google Scholar]
- 4.Ratcliff R., Smith P. L., A comparison of sequential sampling models for two-choice reaction time. Psychol. Rev. 111, 333–367 (2004). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Wald A., Wolfowitz J., Bayes solutions of sequential decision problems. Proc. Natl. Acad. Sci. U.S.A. 35, 99–102 (1949). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Wolfe J. M., O’Neill P., Bennett S. C., Why are there eccentricity effects in visual search? Visual and attentional hypotheses. Percept. Psychophys. 60, 140–156 (1998). [DOI] [PubMed] [Google Scholar]
- 7.Knill D. C., Richards W., Perception as Bayesian Inference (Cambridge University Press, Cambridge, UK, 1996). [Google Scholar]
- 8.Albright T. D., On the perception of probable things: Neural substrates of associative memory, imagery, and perception. Neuron 74, 227–245 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Gilbert C. D., Li W., Top-down influences on visual processing. Nat. Rev. Neurosci. 14, 350–363 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Sekuler R., Ball K., Mental set alters visibility of moving targets. Science 198, 60–62 (1977). [DOI] [PubMed] [Google Scholar]
- 11.Doherty J. R., Rao A., Mesulam M. M., Nobre A. C., Synergistic effect of combined temporal and spatial expectations on visual attention. J. Neurosci. 25, 8259–8266 (2005). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Yu A. J., Dayan P., Uncertainty, neuromodulation, and attention. Neuron 46, 681–692 (2005). [DOI] [PubMed] [Google Scholar]
- 13.Chalk M., Seitz A. R., Seriès P., Rapidly learned stimulus expectations alter perception of motion. J. Vis. 10, 2 (2010). [DOI] [PubMed] [Google Scholar]
- 14.Kok P., Jehee J. F. M., de Lange F. P., Less is more: Expectation sharpens representations in the primary visual cortex. Neuron 75, 265–270 (2012). [DOI] [PubMed] [Google Scholar]
- 15.Cheadle S., Egner T., Wyart V., Wu C., Summerfield C., Feature expectation heightens visual sensitivity during fine orientation discrimination. J. Vis. 15, 14 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Wyart V., Nobre A. C., Summerfield C., Dissociable prior influences of signal probability and relevance on visual contrast sensitivity. Proc. Natl. Acad. Sci. U.S.A. 109, 3593–3598 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Biederman I., Glass A. L., Stacy E. W. Jr, Searching for objects in real-world scenes. J. Exp. Psychol. 97, 22–27 (1973). [DOI] [PubMed] [Google Scholar]
- 18.Biederman I., Mezzanotte R. J., Rabinowitz J. C., Scene perception: Detecting and judging objects undergoing relational violations. Cognit. Psychol. 14, 143–177 (1982). [DOI] [PubMed] [Google Scholar]
- 19.Desimone R., Duncan J., Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 18, 193–222 (1995). [DOI] [PubMed] [Google Scholar]
- 20.Theeuwes J., Top-down and bottom-up control of visual selection. Acta Psychol. (Amst.) 135, 77–99 (2010). [DOI] [PubMed] [Google Scholar]
- 21.Serences J. T., Kastner S., “A multi-level account of selective attention” in Oxford Handbook of Attention, Kastner S., Nobre K., Eds. (Oxford University Press, 2014), pp. 76–104. [Google Scholar]
- 22.McAdams C. J., Maunsell J. H., Attention to both space and feature modulates neuronal responses in macaque area V4. J. Neurophysiol. 83, 1751–1755 (2000). [DOI] [PubMed] [Google Scholar]
- 23.Martinez-Trujillo J. C., Treue S., Feature-based attention increases the selectivity of population responses in primate visual cortex. Curr. Biol. 14, 744–751 (2004). [DOI] [PubMed] [Google Scholar]
- 24.Reynolds J. H., Chelazzi L., Attentional modulation of visual processing. Annu. Rev. Neurosci. 27, 611–647 (2004). [DOI] [PubMed] [Google Scholar]
- 25.Chun M. M., Phelps E. A., Memory deficits for implicit contextual information in amnesic subjects with hippocampal damage. Nat. Neurosci. 2, 844–847 (1999). [DOI] [PubMed] [Google Scholar]
- 26.Schapiro A. C., Gregory E., Landau B., McCloskey M., Turk-Browne N. B., The necessity of the medial temporal lobe for statistical learning. J. Cogn. Neurosci. 26, 1736–1747 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Manns J. R., Squire L. R., Perceptual learning, awareness, and the hippocampus. Hippocampus 11, 776–782 (2001). [DOI] [PubMed] [Google Scholar]
- 28.Reber P. J., Squire L. R., Encapsulation of implicit and explicit memory in sequence learning. J. Cogn. Neurosci. 10, 248–263 (1998). [DOI] [PubMed] [Google Scholar]
- 29.Milner B., “Physiologie de l’hippocampe” in Centre National de La Recherche Scientifique, Passouant P., Ed. (Centre National de la Recherche Scientifique, Paris, 1962), pp. 257–272. [Google Scholar]
- 30.Cohen N. J., Squire L. R., Preserved learning and retention of pattern-analyzing skill in amnesia: Dissociation of knowing how and knowing that. Science 210, 207–210 (1980). [DOI] [PubMed] [Google Scholar]
- 31.Bayley P. J., Frascino J. C., Squire L. R., Robust habit learning in the absence of awareness and independent of the medial temporal lobe. Nature 436, 550–553 (2005). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Cave C. B., Squire L. R., Intact and long-lasting repetition priming in amnesia. J. Exp. Psychol. Learn. Mem. Cogn. 18, 509–520 (1992). [DOI] [PubMed] [Google Scholar]
- 33.Berns G. S., Cohen J. D., Mintun M. A., Brain regions responsive to novelty in the absence of awareness. Science 276, 1272–1275 (1997). [DOI] [PubMed] [Google Scholar]
- 34.Rungratsameetaweemana N., Itthipuripat S., Salazar A., Serences J. T., Expectations do not alter early sensory processing during perceptual decision-making. J. Neurosci. 38, 5632–5648 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Bang J. W., Rahnev D., Stimulus expectation alters decision criterion but not sensory signal in perceptual decision making. Sci. Rep. 7, 17072 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Turk-Browne N. B., Scholl B. J., Chun M. M., Johnson M. K., Neural evidence of statistical learning: Efficient detection of visual regularities without awareness. J. Cogn. Neurosci. 21, 1934–1945 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Milner B., Corkin S., Teuber H. L., Further analysis of the hippocampal amnesic syndrome: 14-year follow-up study of H.M. Neuropsychologia 6, 215–234 (1968). [Google Scholar]
- 38.Milner B., Disorders of learning and memory after temporal lobe lesions in man. Clin. Neurosurg. 19, 421–446 (1972). [DOI] [PubMed] [Google Scholar]
- 39.Insausti R., Annese J., Amaral D. G., Squire L. R., Human amnesia and the medial temporal lobe illuminated by neuropsychological and neurohistological findings for patient E.P. Proc. Natl. Acad. Sci. U.S.A. 110, E1953–E1962 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Shrager Y., Gold J. J., Hopkins R. O., Squire L. R., Intact visual perception in memory-impaired patients with medial temporal lobe lesions. J. Neurosci. 26, 2235–2240 (2006). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Wixted J. T., Squire L. R., The medial temporal lobe and the attributes of memory. Trends Cogn. Sci. 15, 210–217 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Smith C. N., Frascino J. C., Hopkins R. O., Squire L. R., The nature of anterograde and retrograde memory impairment after damage to the medial temporal lobe. Neuropsychologia 51, 2709–2714 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Gold J. J., Squire L. R., Quantifying medial temporal lobe damage in memory-impaired patients. Hippocampus 15, 79–85 (2005). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Rempel-Clower N. L., Zola S. M., Squire L. R., Amaral D. G., Three cases of enduring memory impairment after bilateral damage limited to the hippocampal formation. J. Neurosci. 16, 5233–5255 (1996). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Insausti R., et al. , MR volumetric analysis of the human entorhinal, perirhinal, and temporopolar cortices. AJNR Am. J. Neuroradiol. 19, 659–671 (1998). [PMC free article] [PubMed] [Google Scholar]
- 46.Frankó E., Insausti A. M., Artacho-Pérula E., Insausti R., Chavoix C., Identification of the human medial temporal lobe regions on magnetic resonance images. Hum. Brain Mapp. 35, 248–256 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Urgolites Z. J., Smith C. N., Squire L. R., Eye movements support the link between conscious memory and medial temporal lobe function. Proc. Natl. Acad. Sci. U.S.A. 115, 7599–7604 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Brainard D. H., The Psychophysics Toolbox. Spat. Vis. 10, 433–436 (1997). [PubMed] [Google Scholar]
- 49.Pelli D. G., Uncertainty explains many aspects of visual contrast detection and discrimination. J. Opt. Soc. Am. A 2, 1508–1532 (1985). [DOI] [PubMed] [Google Scholar]
- 50.Britten K. H., Shadlen M. N., Newsome W. T., Movshon J. A., Responses of neurons in macaque MT to stochastic motion signals. Vis. Neurosci. 10, 1157–1169 (1993). [DOI] [PubMed] [Google Scholar]
- 51.Churchland A. K., Kiani R., Shadlen M. N., Decision-making with multiple alternatives. Nat. Neurosci. 11, 693–702 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Forstmann B. U., Brown S., Dutilh G., Neumann J., Wagenmakers E.-J., The neural substrate of prior information in perceptual decision making: A model-based analysis. Front. Hum. Neurosci. 4, 40 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.



