Abstract
Functional magnetic resonance imaging (1.5mm isotropic voxels) was employed to investigate the relationship between hippocampal activity and memory strength in a continuous recognition task. While being scanned, subjects were presented with colored photographs that each appeared on four occasions. The requirement was to make one response when an item was presented for the first or the third time, and to make a different response when an item appeared for the second or the fourth time. Consistent with prior findings, items presented for the first time elicited greater hippocampal and parahippocampal activity than repeated items. The activity elicited by repeated items declined linearly as a function of number of presentations (‘graded’ new > old effects). No medial temporal lobe (MTL) regions could be identified where activity elicited by repeated items exceeded that for new items, or where activity elicited by repeated items increased with number of presentations. These findings are inconsistent with the proposal that retrieval-related hippocampal activity is positively correlated with memory strength. We also identified graded new > old effects in several cortical regions outside the MTL, including the left retrosplenial/posterior cingulate cortex and the right lateral occipito-temporal cortex. By contrast, graded old > new effects were evident in bilateral mid-intraparietal sulcus (IPS) and precuneus.
INTRODUCTION
fMRI studies have demonstrated that neural responses in the hippocampus elicited by recognition memory test items differ according to the study status of the item and the nature of the associated behavioral judgment. Two patterns of differential activity have been observed. In several studies, correctly endorsed ‘old’ test items were reported to elicit a smaller response than correctly classified ‘new’ items (e.g., Vilberg & Rugg, 2009; Daselaar, Fleck & Cabeza, 2006; Duzel et al., 2003; Rugg, Henson, & Robb, 2003; Stark & Okado, 2003; Rombouts, Barkhof, Witter, Machielsen, & Scheltens, 2001). This finding has frequently been interpreted as a hippocampal ‘novelty’ response that reflects a bias to encode experimentally novel events into memory (e.g., Nyberg, 2005; Stark & Okado, 2003). A second, more frequently reported, pattern of retrieval-related hippocampal activity takes the form of relatively greater old item activity when recognition is accompanied, rather than unaccompanied, by retrieval of information about the study context, as indexed either by phenomenal report (e.g., Woodruff, Johnson, Uncapher, & Rugg, 2005; Yonelinas, Otten, Shaw, & Rugg, 2005; Wheeler & Buckner, 2004; Eldridge, Knowlton, Furmanski, Bookheimer, & Engel, 2000) or accurate source memory (e.g., Vilberg & Rugg, 2009; Weis et al., 2004; Dobbins, Rice, Wagner, & Schacter, 2003; Cansino, Maquet, Dolan, & Rugg, 2002). These findings have been taken as support for the view that the hippocampus supports the recollection of episodic information, but that it does not contribute to the undifferentiated sense of familiarity that also allows old and new recognition test items to be discriminated (e.g., Eichenbaum, Yonelinas, & Ranganath, 2007).
This interpretation of recollection-related enhancement of hippocampal activity has recently been challenged (Wais, Squire, & Wixted, 2010; Wais, 2008; Squire, Wixted, & Clark, 2007). These authors have argued that the relevant studies invariably confounded recollection with the ‘strength’ of the memory signal supporting recognition, as operationalized by the confidence with which a test item is (or would have been) judged as old on a test of old/new recognition. According to Wais et al. (2010), if strength is equated between recollected and unrecollected items (in their case, by restricting analysis of the effects of source accuracy to studied items attracting confident ‘old’ judgments on an immediately preceding recognition test), both classes of item elicit greater levels of hippocampal activity than do items of lesser strength, indicating that the hippocampus contributes to ‘strong’ memories regardless of whether the memories contribute to recollection or familiarity.
We obtained findings relevant to this issue in a recent study that employed a continuous recognition procedure (Johnson, Muftuler, & Rugg, 2008). Test items (words and pictures) were presented a total of four times, and subjects were required to respond ‘new’ to items seen for the first time and ‘old’ to any repeated item. Accuracy of old judgments – and, presumably, memory strength - increased markedly across the successive presentations of each test item. The activity elicited by new items was enhanced relative to the activity associated with correctly endorsed old items in several hippocampal regions, but no regions could be identified where activity was greater for old than for new items, or where activity increased as a function of the number of old item presentations. Thus, there was no evidence for a positive association between hippocampal activity and memory strength, as would be expected from the perspective of Wais and colleagues (2010; see above). Johnson et al. (2008) speculated that their findings reflected the failure of their subjects to engage recollection when discriminating between old and new test items, the subjects relying instead on the less demanding strategy of evaluating the relative familiarity of the test items. Thus, item repetition increased familiarity strength but not the likelihood of recollection.
This conjecture receives support from the findings of a second study (Suzuki, Johnson, & Rugg, in press) that also employed a continuous recognition procedure. In this study, however, accurate task performance necessitated the engagement of recollection. Test items were each surrounded by a colored frame. The requirement was to respond ‘new’ to items presented for the first time, but to respond ‘old’ to a repeated item only if its surrounding frame matched the frame color of the item when it was first presented, responding ‘new’ otherwise. Thus, a correct response to an old item with a ‘mismatching’ frame necessitated recollection of the frame color associated with its first presentation – reliance on familiarity alone would result in an incorrect response (Jacoby, 1991). Consistent with the view that retrieval-related enhancement of hippocampal activity is a signature of successful recollection, Suzuki et al. (in press) identified a right hippocampal region where recollection-related activity (operationalized as the difference in activity elicited by mismatching old items attracting correct vs. incorrect responses) positively correlated across subjects with probability of successful color recollection.
Together, the findings of Johnson et al. (2008) and Suzuki et al. (in press) are consistent with the proposal that, during continuous recognition, old items elicit enhanced hippocampal activity when they are recollected, and not merely when they elicit a ‘strong’ memory. It can be argued however that comparison of the findings of the two studies is complicated by a task confound; whereas in Johnson et al. (2008) the task was simply to discriminate between new and old items, in Suzuki et al. (in press) it was further necessary to discriminate between different classes of old item. These differing task demands raise the possibility that the disparate findings of the two studies reflect differences not in the nature of the retrieved information (i.e. familiarity vs. recollection), but in how that information was used in service of the memory test. To address this issue, in the present study we employed the same basic procedure as in Johnson et al. (2008), but with the requirement to discriminate between test items on the basis of the number of times the items had been presented. Subjects were required to make one response when an item was presented for the first or the third time, and to make a different response when an item appeared for the second or the fourth time. Thus, as was the case in Suzuki et al. (in press), it was necessary to discriminate between different classes of old item in order to meet task requirements. Importantly, although the present task involves a more fine-grained judgment than does new/old recognition, we assumed that the primary basis for what amounts to a discrimination based on frequency of occurrence would be the relative familiarity (the ‘familiarity strength’) of the test items (cf. Chalmers, 2005; Shiffrin, 2003; Hintzman, 1988), rather than recollected content. If the failure to identify hippocampal regions where activity scaled positively with memory strength in the study of Johnson et al. (2008) merely reflected the use of an experimental task that did not require discrimination between the memory signals elicited by different classes of old test items, then strength-sensitive regions should be identified in the present study, given that the present task necessitates just such a discrimination. If, however, enhancement of retrieval-related hippocampal activity in the study of Suzuki et al (in press) is linked specifically with recollection, the findings from the present study should replicate those of its predecessor: abundant evidence of hippocampal ‘new > old effects’, but no evidence that activity in hippocampal regions is positively associated with the memory strength of old items (as operationalized by number of prior item presentations).
Although the primary aim of the present study was to further elucidate the relationship between hippocampal activity and memory strength, we took advantage of the relatively extensive field of view of our high resolution imaging protocol to also investigate retrieval-related activity in cortical regions outside the MTL – including retrosplenial and posterior cingulate cortex, medial parietal cortex, and intra-parietal sulcus – that have been implicated in numerous previous studies of successful recognition memory (Vilberg & Rugg, 2009; Shannon & Buckner, 2004; for reviews, see Ciaramelli, Grady, & Moscovitch, 2008; Skinner & Fernandez, 2007; Wagner, Shannon, Kahn, & Buckner, 2005; Rugg & Henson, 2002). Thus, we were able to ask which, if any, of these extra-hippocampal regions demonstrated response profiles that paralleled profiles evident within the hippocampus.
METHODS
Subjects
Eighteen subjects (8 males; 18–31 years of age; mean age 21.2) participated in the experiment. All subjects reported themselves to be right-handed, native English speakers with normal or corrected-to-normal vision, and no history of neurological illness or other contraindications for MR imaging. In accordance with the requirements of the Institutional Review Board of UCI, which approved the study, informed consent was obtained from all subjects. Two subjects’ data were excluded because of inadequate memory performance (> 2 SDs below mean accuracy in at least one item category). Thus, data from a total of 16 subjects (8 males) are reported here.
Stimulus materials
Stimuli were 360 color photographs of common objects. For each subject, these items were randomly sampled to create six item lists. Each of these lists was then used form a continuous recognition list comprising 39 filler items, and 21 critical items that were each presented between one and four times (inter-item lag between 3 and 34 items; mean 16 items)- hereafter referred to as the first, second, third, and fourth presentations. Allocation of items to the lists and experimental conditions was randomized on a subject-specific basis.
Each continuous recognition list was organized into a series of 7 sub-blocks (as in Johnson et al, 2008). After the initial three sub-blocks, each sub-block consisted of half new and half repeated items, and included an equal number of critical items from every experimental condition (12 items each for the items presented for first, second, third, and fourth time). All behavioral and fMRI results reported here are based on data obtained from these final four sub-blocks.
During each continuous recognition run, experimental items were projected onto a screen viewed by the subject via a mirror mounted on the scanner head coil. Items were presented one by one, each surrounded by a grey frame. The visual angle of each item (including the surrounding frame) subtended 9.5 deg × 9.5 deg. Presentation duration was 500ms, with a stimulus onset asynchrony (SOA) of 2400ms excluding null trials (see below). A white central fixation cross (+) was presented throughout the inter-item interval, which varied between 1900 and 9100 ms, depending on number of intervening null trials. Five null trials were added to the end of each run. Each scanned run consisted of 105 item trials, randomly intermixed with 35 null trials.
Experimental procedure
Instructions and practice for the task were given prior to the scanning, outside the scanner. Subjects responded with the index (‘first’, ‘third’ presentations) and middle (‘second’, ‘fourth’ presentations) fingers of their right hand, discriminating between the different categories of experimental item as described above. They were instructed to respond as quickly as possible without sacrificing accuracy.
fMRI scanning
Scanning was performed on a 3T Philips Achieva scanner (Philips Medical Systems, Andover, MA) equipped with an 8-channel SENSE head coil. Functional images were acquired using a T2*-weighted, FE-EPI pulse sequence (TR, 2000 ms; TE, 25 ms; flip angle, 70°; matrix size, 176×176; FOV, 240×180 mm; slice thickness, 1.5 mm; interslice gap, 0.5 mm; resolution, 1.5 mm3; SENSE factor, 2.5; half-scan factor, 0.75). Twenty-six oblique axial slices were acquired parallel to the long axis of hippocampus and covering the whole MTL. One-hundred and sixty five volumes were acquired during each run. The first four volumes of each run were discarded to allow for T1 equilibration. After the six functional runs, whole-brain anatomical images were acquired using a sagittal T1-weighted, 3D MP-RAGE (TR, 11 ms; TE, 4.6 ms; flip angle, 18°; matrix size, 320×320; FOV, 240×150 mm; slice thickness, 0.75 mm; resolution, 0.75 mm3).
Data Analysis
For two subjects, the data from one of the six functional runs were not analyzed. In one case this was because of a technical problem; in the second case the subject felt asleep during that run. Functional data preprocessing and statistical analyses were performed with Statistical Parametric Mapping (SPM5, Wellcome Department of Cognitive Neurology, London; http://www.fil.ion.ucl.ac.uk/spm) implemented in MATLAB7.0.4 (The Mathworks, Natick, MA). Functional data were initially spatially realigned to the first image of the series and then realigned to the across-run mean image and, subsequently, resliced. Each subject’s anatomical data were coregistered to the mean functional image, and then segmented to allow estimation of deformation parameters for different tissue compartments. The anatomical and resliced functional images were spatially normalized to a sample template generated from all subjects’ anatomical images using the ‘DARTEL’ algorithm (Ashburner, 2007; http://www.fil.ion.ucl.ac.uk/~john/misc/dartel_guide.pdf) and affine-transformed into Montreal Neurological Institute (MNI) stereotactic space (Cocosco, Kollokian, Kwan, & Evans, 1997). The functional images were then resampled into 1.5 mm3 voxels, and spatially smoothed with a 3 mm full-width half-maximum (FWHM) Gaussian kernel.
Statistical analyses were performed in two stages of a mixed effects model. In the first stage, neural activity was modeled by a delta function (impulse event) at stimulus onset. These functions were then convolved with a canonical hemodynamic response function (HRF) and its temporal and dispersion derivatives (Friston et al., 1998) to yield regressors in a general linear model that modeled the BOLD response to each event type. Results from the HRF derivatives did not add any theoretically meaningful information to those from the canonical HRF and are not reported (they are available from the corresponding author upon request).
Six event types of interest were defined: correctly judged items presented for the first time, correctly judged items presented for the second time, and both correctly and incorrectly judged items presented for the third time and fourth time. Null trials were modeled as an implicit baseline. Six regressors modeling movement-related variance (three rigid-body translations and three rotations determined from the realignment stage) and session-specific constant terms modeling the mean over scans were also used in the design matrix. Parameter estimates for events of interest were estimated using a general linear model. Nonsphericity of the error covariance was accommodated by an AR(1) model in which the temporal autocorrelation was estimated by pooling over suprathreshold voxels (Friston et al., 2002). Effects of interest were tested using linear contrasts of the parameter estimates. These contrasts were carried forward to a second stage of analysis treating subjects as a random effect.
Parameter estimates for each event type of interest were derived for each subject. The estimates were entered into the second stage analysis in which each subject served as a random effect in a repeated-measures analysis of variance (ANOVA). The ANOVA used a common error term for all effects and was corrected for nonsphericity using a correction factor that was estimated after pooling over all suprathreshold voxels (Henson & Penny, 2003). The ANOVA of the main effect of number of presentations as well as all subsidiary pairwise contrasts (see Results for detail) were conducted within this ANOVA model.
To evaluate the reliability of effects within the MTL, a mask was created by manually tracing the MTL of the across-subjects mean normalized 3D anatomical image (based on standard anatomical landmarks; Insausti et al., 1998) and then smoothing the mask with a 3-mm FWHM Gaussian kernel using MRIcron (Rorden, Karnath, & Bonilha, 2007). Unless otherwise noted, clusters were accepted as significant only if the number of contiguously activated voxels (two-tailed threshold of p < 0.005) exceeded a corrected cluster-level threshold of p < 0.05. The corresponding cluster extent thresholds were 19 voxels for the area within the MTL mask, and 29 voxels for the remainder of the imaging volume, as determined by Monte Carlo simulations implemented in AlphaSim (Ward, 2000). The results of the ANOVA were used to identify in an unbiased manner all clusters where activity differed between the events of interest. The outcome of the ANOVA was then employed as a mask (region of interest) within which specific directional contrasts were implemented (see below). These contrasts were thresholded at P < 0.005 (one-tailed), again with a corrected cluster extent threshold of P < 0.05. All coordinates are reported in MNI space.
Following Johnson et al. (2008), we attempted to distinguish between regions demonstrating categorical and graded new/old effects by estimated two differently weighted contrasts (categorical: +3 −1 −1 −1 and −3 +1 +1 +1 for correctly judged first, second, third and fourth presentations, respectively; graded: +3 +1 −1 −3 and −3 −1 +1 +3). Preliminary analyses revealed that these two sets of weights gave rise to virtually identical results (approximately 90% of the voxels identified by the two contrasts overlapped). Therefore we report below the findings derived from the graded new/old contrasts only. To identify regions where activity varied with response accuracy, we contrasted the activity elicited by correctly versus incorrectly judged third and fourth presentations (too few errors were made to second presentations to allow an analysis by accuracy). Finally, to assess whether hippocampal activity is positively related to memory strength (see Introduction), we searched for regions where old item activity increased as a function of presentation number by applying the contrast weights −1, 0, and 1 to correctly judged second, third, and fourth presentations respectively.
To further elucidate significant effects, subject-specific parameter estimates for events of interest were extracted from the voxels of each cluster that exceeded the statistical thresholds described above. The parameter estimates were averaged across voxels to a give mean value for each cluster. Since we were unable to identify any clusters where activity varied according to behavioral accuracy, estimates for correctly and incorrectly endorsed items presented for third and fourth times were each averaged to give a single value.
In light of the findings of Huijbers, Pennartz, & Daselaar (2010; see Discussion for details), we performed a second set of analyses that asked whether activity elicited by old items varied according to the number of items intervening between successive presentations (inter-item lag effects). We performed separate analyses on items presented for the second, third and fourth times. In each item category, we contrasted the activity elicited by the items according to whether they were repeated after a relatively short (lags of 3–14 items) or a relatively long (lags of 19–34 items) inter-item lag.
RESULTS
Behavioral performance
Table 1 shows the mean proportion of correct responses and the mean response times (RTs) to each item category (i.e. first through to fourth presentations). A one-way repeated-measures ANOVA of the proportion data revealed a significant effect (F (1.9, 29.0) = 29.53, Ps < 0.001)1. Pairwise tests revealed that judgments for new items were more accurate than the judgments for any other condition (all Ps < 0.001). Additionally, the accuracy for items presented for the second time was higher than for items presented for the third or fourth times (both Ps < 0.005) Accuracy for these latter two conditions did not significantly differ.
Table 1.
Presentation Number | Proportions | RTs (ms) |
---|---|---|
First | 0.99 ± 0.02 | 813 ± 136 |
Second | 0.84 ± 0.10 | 1041 ± 123 |
Third | 0.68 ± 0.15 | 1244 ± 125 |
Fourth | 0.68 ± 0.15 | 1188 ± 159 |
A one-way repeated-measures ANOVA of the reaction times (RTs) also revealed a significant effect (F (2.3, 35.1) = 116.77, Ps < 0.001). Pairwise tests revealed that responses to new items were significantly faster than those to any other type of event (all Ps < 0.001). Additionally, RTs to correctly endorsed second presentations were faster than the responses to items presented for the third or fourth time (all Ps < 0.001). RTs for correct responses to these latter items did not differ.
To evaluate the effects of inter-item lag on behavioral performance, we separated the mean proportions of correct responses and associated RTs according to presentation number (second, third, fourth) and inter-item lag (short vs. long, see Methods) (Table 2). A two-way repeated measures ANOVA (factors of presentation number and lag) on the accuracy scores revealed a significant main effect of item presentation (F (1.4, 21.6) = 9.35, P < 0.005), again reflecting greater accuracy for second than for subsequent presentations. There was no significant lag effect, nor did lag interact with presentation number. ANOVA of the RTs also gave rise to a main effect of number of presentations (F (1.61, 24.11) = 34.64, P < 0.001), but no other significant effects.
Table 2.
Presentation Number/Inter-item Lag | Proportions | RTs (ms) | ||
---|---|---|---|---|
Short | Long | Short | Long | |
Second | 0.87 ± 0.11 | 0.83 ± 0.12 | 1027.4 ± 115.9 | 1074.0 ± 150.7 |
Third | 0.68 ± 0.16 | 0.68 ± 0.16 | 1251.5 ± 123.2 | 1256.8 ± 150.9 |
Fourth | 0.70 ± 0.18 | 0.70 ± 0.14 | 1179.7 ± 153.2 | 1185.6 ± 182.4 |
fMRI findings
We first analyzed the fMRI data in a manner unbiased with respect to specific directional hypotheses to identify clusters where activity differed between the item categories. We accomplished this with a one-way ANOVA of the main effect of number of presentations. Using the outcome of the ANOVA as a mask, we then searched for regions where there was an old vs. new effect or where activity elicited by old items varied according to presentation number (see Methods).
Brain regions demonstrating a main effect of number of presentations
As is evident in Figure 1, the global ANOVA identified effects in bilateral hippocampus and parahippocampal cortex as well as in extra-MTL regions, including bilateral parietal cortex, precuneus, right lateral occipito-temporal cortex, left retrosplenial/posterior cingulate cortex and cuneus.
Outcome of specific contrasts
MTL
Graded new > old effects were observed in bilateral hippocampus and parahippocampal cortex (Figure 2A, Table 3). As is evident from Figure 2B, there was a tendency in all regions for a stepwise decrease in activity from first to fourth presentations (Figure 2B). No MTL regions were identified where activity was greater for old than for new items. Nor were there any MTL regions where old item activity was enhanced as a function of number of presentations (this remained the case even when the threshold for this contrast was relaxed to p < 0.05)2.
Table 3.
Coordinates |
||||||
---|---|---|---|---|---|---|
Brain region | L/R | No. of voxels | x | y | z | Z score |
Graded new > old effects | ||||||
MTL regions | ||||||
Hippocampus | L | 106 | −24 | −21 | −17 | 5.06 |
Hippocampus | R | 89 | 23 | −20 | −17 | 5.70 |
Parahippocamal cortex | L | 141 | −32 | −42 | −11 | 5.48 |
Parahippocamal cortex | R | 43 | 33 | −35 | −17 | 4.60 |
Parahippocamal cortex | R | 26 | 24 | −39 | −14 | 3.79 |
Extra-MTL regions | ||||||
Occipito-temporal cortex | R | 57 | 36 | −83 | 18 | 3.72 |
Occipito-temporal cortex | R | 64 | 45 | −74 | 23 | 3.81 |
Retrosplenial/posterior cingulate cortex | L | 281 | −5 | −54 | 18 | 4.69 |
Graded old > new effects | ||||||
Intraparietal sulcus | L | 194 | −30 | −65 | 41 | 5.07 |
Intraparietal sulcus | R | 166 | 33 | −65 | 39 | 5.4 |
Precuneus | L | 151 | −6 | −72 | 47 | 4.98 |
Precuneus | R | 416 | 9 | −75 | 41 | 6.53 |
Cuneus | L | 39 | −11 | −77 | 9 | 3.82 |
Z values refer to the peak of the activated cluster. Coordinates (in MNI space) are rounded to the nearest mm. L, left; R, right. MTL, medial temporal lobe.
Regions outside the MTL
Regions demonstrating graded new > old effects included right occipito-temporal cortex and left retrosplenial/posterior cingulate cortex (Figure 3A, Table 3). There was a tendency for a stepwise decrease in activity from first to fourth presentations in these regions (Figure 3B).
Graded old > new effects were evident in bilateral intraparietal sulcus (IPS), precuneus and left cuneus (Figure 3A, Table 3). As is illustrated in Figure 3B, activity in these regions tended to increase as a function of number of presentations.
Effects of Inter-Item lag
We did not detect any lag effects in the MTL that came near to our criteria for statistical significance. For fourth presentations only, we identified a single retrosplenial cluster (MNI coordinates: x = −8, y = −53, z = 23, Z value = 4.06, 29 voxels) where activity was greater for the long relative to short lags.
Effects of Response Accuracy
The contrast between third and fourth presentations as a function of response accuracy failed to identify any effects.
DISCUSSION
Behavioral Performance
We assume that, as was directly demonstrated by Johnson et al. (2008), memory strength of the test items increased with the number of prior presentations. Classification of new items in the present study was near ceiling, indicating that subjects had no difficulty in detecting ‘unstrengthened’, situational unfamiliar items. The accuracy of the judgments accorded old items on their second presentation was substantially lower (around 80% correct), but was lower still on the two subsequent presentations (around 65% correct in each case). Thus it would appear that subjects were rarely able recollect how many times an old test item had been presented, especially after its second presentation. This finding accords with the subjective experience of subjects undertaking this task, who reported that they quickly lost track of the number of times items have been presented, and selected their responses on the basis of how familiar the item felt (cf. Chalmers, 2005; Shiffrin, 2003; Hintzman, 1988). We cannot however rule out the possibility that recollection supported accurate responding on at least some proportion of trials.
Retrieval-related activity in the MTL
There were robust differences in the activity elicited by different categories of test items in both the hippocampus and parahippocampal cortex. Crucially, these differences exclusively took the form of new > old effects; even at a much relaxed statistical threshold, we failed to find any MTL voxels where old item activity increased as a function of number of presentations. Thus the present results join the findings of Johnson et al. (2008) in opposing the idea that retrieval-related hippocampal activity is positively associated with the strength of an undifferentiated memory signal (Wais et al., 2010; Wais, 2008; Squire et al., 2007; note that this conclusion stands regardless of whether responding in the present task was based largely upon the assessment of familiarity, as we assume, or upon recollection also). As in the study of Suzuki et al. (in press; see Introduction), the experimental task employed here required subjects to discriminate between different classes of old test item. Evidently, this task requirement is not sufficient to reverse the findings reported by Johnson et al. (2008). We hypothesize that the crucial factor is whether or not the memory signal employed to discriminate between old test items carries episodic information.
Our failure to find evidence for a positive association between hippocampal activity and memory strength is complemented by the findings from another recent fMRI study of continuous recognition memory (Huijbers et al., 2010; see Brozinsky, Yonelinas, Kroll, & Ranganath, 2005, for similar but weaker findings) as well as those of Daselaar et al. (2006). In Huijbers et al. items were repeated once only, and the critical manipulation was the inter-item lag between first and second presentations, which ranged from 0 to 31 intervening items. Longer lags were associated with lower recognition accuracy and longer response latencies, indicating that memory strength weakened as the interval between successive presentations increased. No hippocampal regions were reported where activity was negatively associated with lag, however; rather, activity in bilateral anterior hippocampus (and retrosplenial cortex) was reported to covary positively with lag (there was a hint of a similar effect in the present study for the retrosplenial cortex, but not for the hippocampus; see Results). The authors conjectured that their findings indicated that as lag increased, recognition became increasingly reliant on a hippocampally-mediated recollection signal. Regardless of the validity of this account, the findings of Huijbers et al. (2010) add weight to the view that retrieval-related hippocampal activity is not positively correlated with memory strength (see also Diana, Yonelinas, & Ranganath, in press).
Employing a study-test design, Daselaar et al. (2006) identified a region of the left anterior hippocampus where activity was negatively and linearly associated with recognition confidence (a small volume correction within a 3mm sphere centered on the peak of that effect, MNI coordinates: x = −19, y = −8, z = −16, revealed a reliable (p < 0.005) negatively graded effect in the present study also). In as much as confidence is a proxy for strength (Wixted, 2007) these findings, like the present results, suggest that activity in at least some hippocampal regions is a negative function of memory strength. In contrast to the present findings, however, Daselaar et al. also identified a parahippocampal region where activity was positively associated with recognition confidence. It is unclear which of the many differences between that study and the current one is responsible for this discrepancy. Another study reporting a positive relationship between memory strength (operationalized by recognition confidence) and MTL activity is that of Wais et al. (2010). These authors reported that studied test items attracting highly confident ‘old’ judgments elicited enhanced hippocampal activity relative to items incorrectly endorsed as new (misses), regardless of the level of accuracy of a subsequent source memory judgment. If it is assumed that inaccurate source judgments signify the failure of recollection, these findings are indicative of a positive relationship between hippocampal activity and memory strength in the absence of recollection. As Wais et al. (2010) note, however, their findings are equally consistent with the assumption that hippocampal effects on trials associated with inaccurate source judgments were driven by recollection of task-irrelevant study details (‘noncriterial recollection’; Yonelinas & Jacoby, 1996) rather than by familiarity strength.
As already noted, we identified robust new > old effects throughout the hippocampus in the present study. Reminiscent of the findings of Johnson et al. (2008), a substantial proportion of the voxels demonstrating these effects showed a graded response profile (specifically, 98% of the voxels identified by the initial ANOVA exhibited a graded profile according to the follow-up parametric analysis), such that activity declined in a linear fashion as a function of number of presentations (Figure 2B). This profile is indicative of a process sensitive to the relative familiarity (or novelty) of the test items rather than one that is responsive merely to whether an item is new or old. One possibility, consistent with prior accounts of hippocampal new > old effects (e.g., Nyberg, 2005; Stark & Okado, 2003), is that these findings reflect the graded modulation of a novelty-sensitive encoding process. That is, encoding processes that are engaged maximally by situationally novel stimulus events are progressively ‘dampened’ as the event becomes more familiar. Alternatively, the present findings can be taken as evidence that retrieval-related hippocampal activity is indeed correlated with memory strength (or, more accurately, familiarity strength), but that the correlation is negative rather than positive. From this perspective, new > old effects could be construed as a hippocampally-derived memory signal capable of supporting differential responding on the basis of the test items’ study histories, much as has been argued for analogous effects in perirhinal cortex3 (e.g., Aggleton & Brown, 2006; Henson, Cansino, Herron, Robb, & Rugg, 2003). Whereas Johnson et al. (2008) offered a number of reasons why hippocampal new > old effects likely do not constitute such a memory signal, we are unaware of any evidence that speaks directly to this issue.
Retrieval-related activity in cortical regions outside the MTL
In addition to the MTL, differences in the activity elicited by the different classes of test items were also evident in posterior cortical regions, including regions that have been implicated previously in successful recognition memory (Vilberg & Rugg, 2009; Shannon & Buckner, 2004; for reviews, see Ciaramelli et al., 2008; Skinner & Fernandez, 2007; Wagner et al., 2005; Rugg & Henson, 2002). Thus, graded new > old effects were evident in the left retrosplenial/posterior cingulate cortex, along with the right lateral occipito-temporal cortex, while graded old > new effects were found in the bilateral mid-IPS, precuneus and right medial occipital cortex. Two general points arise from these findings. First, the dissociation between retrosplenial/posterior cingulate effects on the one hand, and the medial and superior parietal effects on the other, provides compelling evidence for functional heterogeneity between these two sets of regions (see also Huijbers et al., 2010), despite the fact that they have sometimes been described as belonging to a common ‘retrieval-success’ network (e.g., Wagner et al., 2005; Shannon & Buckner, 2004). Second, whereas robust old > new effects were evident in the mid-IPS (see below), these effects did not extend to more lateral and posterior parietal regions – which were within the field of view of our functional imaging volume – where old > new effects have been reported to be associated selectively with successful recollection (e.g., Yonelinas et al., 2005; Wheeler & Buckner, 2004; for review see Vilberg & Rugg, 2008). Although null results should be interpreted cautiously, the insensitivity of this ‘recollection-sensitive’ parietal region to the study status of the test items supports the assumption (see above) that old items elicited little or no recollection.
The graded new > old effects observed in the retrosplenial cortex and adjacent posterior cingulate parallel the effects observed in the hippocampus (and parahippocampal cortex). The retrosplenial cortex in particular is strongly interconnected with the hippocampus and parahippocampal cortex (Vann, Aggleton, & Maguire, 2009; Kahn, Andrews-Hanna, Vincent, Snyder, & Buckner, 2008; Kobayashi & Amaral, 2007) and has been proposed as a component (along with diencephalic structures) of an ‘extended hippocampal system’ that selectively supports episodic memory (Aggleton, 2008). From this perspective, the parallel effects observed in these regions in the present study suggest that the different components of this system responded in concert to the level of familiarity (or novelty) of the test items. As noted above, the functional significance of these responses remains to be ascertained.
Graded new > old effects were also evident in lateral occipito-temporal cortex, on the border between BAs 39 and 19 (Figure 3A). Although it is possible that, like the retrosplenial cortex, the region is functionally coupled with the hippocampus, this seems unlikely in view of the lack of prior evidence for its involvement in memory. An alternative possibility is that the occipito-temporal new > old effects are an example of ‘repetition suppression’ – the attenuation of item-elicited activity that is often held to be a neural correlate of repetition priming (Henson, 2003).
Old > new effects in the vicinity of the mid-IPS have been reported in numerous previous studies of recognition memory (Vilberg & Rugg, 2008). Whereas there is some consensus that IPS old/new effects are elicited in the absence of recollection (Cabeza, Ciaramelli, Olson, & Moscovitch, 2008; Vilberg & Rugg, 2008), their functional significance is debated. One possibility is that the effects reflect the role of this region as a mnemonic ‘accumulator’, such that the activity elicited by a test item is proportional to the amount of evidence that the item is old (Donaldson, Wheeler, & Petersen, 2010; Vilberg & Rugg, 2009; Wagner et al., 2005). The present finding that IPS activity increases with memory strength (and hence amount of evidence that an item is old) is clearly compatible with this proposal. Graded old > new effects were also evident in the bilateral precuneus (Figure 3B). Like the IPS, old > new effects in this region are consistently reported in studies of recognition memory. On the basis of their finding that retrieval-related precuneus activity paralleled that in the IPS, Donaldson et al. (2010) proposed that like the latter region, the precuneus also acted as a mnemonic accumulator. Clearly, the present findings are also consistent with this proposal.
Conclusion
We identified robust hippocampal new > old effects in a continuous recognition task that required discrimination between the test items on the basis of number of prior presentations. These effects showed a graded response profile, such that their activity declined linearly as a function of number of presentations. We were unable to identify any hippocampal region where activity increased with number of study presentations. Together with prior findings (Suzuki et al., in press; Johnson et al., 2008), the present results strongly suggest that retrieval-related hippocampal activity is not positively correlated with memory strength.
Acknowledgments
We thank the members of the University of California, Irvine Research Imaging Center for their assistance with fMRI data acquisition. This research was supported by NIMH grant 5R01MH072966-02. MS was supported by JSPS Postdoctoral Fellowships for Research Abroad from the Japan Society for the Promotion of Science.
Footnotes
The degrees of freedom for ANOVAs were adjusted for nonsphericity using the Greenhouse-Geisser correction.
A reviewer noted it would be of interest to report the pattern of effects within the right hippocampal region identified as ‘recollection-sensitive’ in our previous study (Suzuki et al., in press). Mean parameter estimates within a 3mm sphere centered on the peak voxel of the region (MNI coordinates: x = 26, y = −11, z = −21) demonstrated robust, graded new > old effect (estimates of 0.04, −1.08, −1.36, −2.00 for first to fourth presentations respectively, p < 0.001 two-tailed for the contrast between first and fourth presentations).
The high-resolution fMRI protocol employed in this study yielded low signal return in ventral anterior MTL in the vicinity of the perirhinal cortex, likely because of the vulnerability of this region to magnetic susceptibility artifact.
References
- Aggleton JP. EPS Mid-Career Award 2006. Understanding anterograde amnesia: disconnections and hidden lesions. Quarterly journal of experimental psychology (Colchester) 2008;61:1441–1471. doi: 10.1080/17470210802215335. [DOI] [PubMed] [Google Scholar]
- Aggleton JP, Brown MW. Interleaving brain systems for episodic and recognition memory. Trends in Cognitive Sciences. 2006;10:455–463. doi: 10.1016/j.tics.2006.08.003. [DOI] [PubMed] [Google Scholar]
- Ashburner J. A fast diffeomorphic image registration algorithm. Neuroimage. 2007;38:95–113. doi: 10.1016/j.neuroimage.2007.07.007. [DOI] [PubMed] [Google Scholar]
- Brozinsky CJ, Yonelinas AP, Kroll NEA, Ranganath C. Lag-sensitive repetition suppression effects in anterior parahippocampal gyrus. Hippocampus. 2005;15:557–561. doi: 10.1002/hipo.20087. [DOI] [PubMed] [Google Scholar]
- Cabeza R, Ciaramelli E, Olson IR, Moscovitch M. The parietal cortex and episodic memory: an attentional account. Nature Reviews Neuroscience. 2008;9:613–625. doi: 10.1038/nrn2459. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cansino S, Maquet P, Dolan RJ, Rugg MD. Brain activity underlying encoding and retrieval of source memory. Cerebral Cortex. 2002;12:1048–1056. doi: 10.1093/cercor/12.10.1048. [DOI] [PubMed] [Google Scholar]
- Chalmers KA. Basis of recency and frequency judgements of novel faces: generalised strength or episode-specific memories? Memory. 2005;13:484–498. doi: 10.1080/09658210444000188. [DOI] [PubMed] [Google Scholar]
- Ciaramelli E, Grady C, Moscovitch M. Top-down and bottom-up attention to memory: A hypothesis (AtoM) on the role of the posterior parietal cortex in memory retrieval. Neuropsychologia. 2008;46:1828–1851. doi: 10.1016/j.neuropsychologia.2008.03.022. [DOI] [PubMed] [Google Scholar]
- Cocosco C, Kollokian V, Kwan RS, Evans A. Brainweb: online interface to a 3D MRI simulated brain database. Neuroimage. 1997;5:S425. [Google Scholar]
- Daselaar SM, Fleck MS, Cabeza R. Triple Dissociation in the Medial Temporal Lobes: Recollection, Familiarity, and Novelty. Journal of Neurophysiology. 2006;96:1902–1911. doi: 10.1152/jn.01029.2005. [DOI] [PubMed] [Google Scholar]
- Diana RA, Yonelinas AP, Ranganath C. Medial temporal lobe activity during source retrieval reflects information type, not memory strength. Journal of Cognitive Neuroscience. doi: 10.1162/jocn.2009.21335. (in press) [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dobbins IG, Rice HJ, Wagner AD, Schacter DL. Memory orientation and success: separable neurocognitive components underlying episodic recognition. Neuropsychologia. 2003;41:318–333. doi: 10.1016/s0028-3932(02)00164-1. [DOI] [PubMed] [Google Scholar]
- Donaldson DI, Wheeler ME, Petersen SE. Remember the source: dissociating frontal and parietal contributions to episodic memory. Journal of Cognitive Neuroscience. 2010;22:377–391. doi: 10.1162/jocn.2009.21242. [DOI] [PubMed] [Google Scholar]
- Duzel E, Habib R, Rotte M, Guderian S, Tulving E, Heinze HJ. Human hippocampal and parahippocampal activity during visual associative recognition memory for spatial and nonspatial stimulus configurations. Journal of Neuroscience. 2003;23:9439–9444. doi: 10.1523/JNEUROSCI.23-28-09439.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eichenbaum H, Yonelinas AP, Ranganath C. The medial temporal lobe and recognition memory. Annual Review of Neuroscience. 2007;30:123–152. doi: 10.1146/annurev.neuro.30.051606.094328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eldridge LL, Knowlton BJ, Furmanski CS, Bookheimer SY, Engel SA. Remembering episodes: a selective role for the hippocampus during retrieval. Nature Neuroscience. 2000;3:1149–1152. doi: 10.1038/80671. [DOI] [PubMed] [Google Scholar]
- Friston KJ, Fletcher P, Josephs O, Holmes A, Rugg MD, Turner R. Event-related fMRI: characterizing differential responses. Neuroimage. 1998;7:30–40. doi: 10.1006/nimg.1997.0306. [DOI] [PubMed] [Google Scholar]
- Friston KJ, Glaser DE, Henson RNA, Kiebel S, Phillips C, Ashburner J. Classical and bayesian inference in neuroimaging: applications. Neuroimage. 2002;16:484–512. doi: 10.1006/nimg.2002.1091. [DOI] [PubMed] [Google Scholar]
- Henson RNA. Neuroimaging studies of priming. Progress in Neurobiology. 2003;70:53–81. doi: 10.1016/s0301-0082(03)00086-8. [DOI] [PubMed] [Google Scholar]
- Henson RNA, Cansino S, Herron JE, Robb WGK, Rugg MD. A familiarity signal in human anterior medial temporal cortex? Hippocampus. 2003;13:301–304. doi: 10.1002/hipo.10117. [DOI] [PubMed] [Google Scholar]
- Henson RNA, Penny W. ANOVAs and SPM, Technical report. London: Wellcome Department of Imaging Neuroscience, University College London; 2003. [Google Scholar]
- Hintzman DL. Judgments of frequency and recognition memory in a multiple-trace memory model. Psychological Review. 1988;95:528–551. [Google Scholar]
- Huijbers W, Pennartz CMA, Daselaar SM. Dissociating the “retrieval success” regions of the brain: Effects of retrieval delay. Neuropsychologia. 2010;48:491–497. doi: 10.1016/j.neuropsychologia.2009.10.006. [DOI] [PubMed] [Google Scholar]
- Insausti R, Juottonen K, Soininen H, Insausti AM, Partanen K, Vainio P, Laakso MP, Pitkanen A. MR volumetric analysis of the human entorhinal, perirhinal, and temporopolar cortices. American Journal of Neuroradiology. 1998;19:659–671. [PMC free article] [PubMed] [Google Scholar]
- Jacoby LL. A process dissociation framework: separating automatic from intentional uses of memory. Journal of Memory and Language. 1991;30:513–541. [Google Scholar]
- Johnson JD, Muftuler LT, Rugg MD. Multiple repetitions reveal functionally and anatomically distinct patterns of hippocampal activity during continuous recognition memory. Hippocampus. 2008;18:975–980. doi: 10.1002/hipo.20456. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kahn I, Andrews-Hanna JR, Vincent JL, Snyder AZ, Buckner RL. Distinct cortical anatomy linked to subregions of the medial temporal lobe revealed by intrinsic functional connectivity. Journal of Neurophysiology. 2008;100:129–139. doi: 10.1152/jn.00077.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kobayashi Y, Amaral DG. Macaque monkey retrosplenial cortex: III. Cortical efferents. Journal of Comparative Neurology. 2007;502:810–833. doi: 10.1002/cne.21346. [DOI] [PubMed] [Google Scholar]
- Nyberg L. Any novelty in hippocampal formation and memory? Current Opinion in Neurology. 2005;18:424–428. doi: 10.1097/01.wco.0000168080.99730.1c. [DOI] [PubMed] [Google Scholar]
- Rombouts SA, Barkhof F, Witter MP, Machielsen WC, Scheltens P. Anterior medial temporal lobe activation during attempted retrieval of encoded visuospatial scenes: an event-related fMRI study. Neuroimage. 2001;14:67–76. doi: 10.1006/nimg.2001.0799. [DOI] [PubMed] [Google Scholar]
- Rorden C, Karnath HO, Bonilha L. Improving lesion-symptom mapping. Journal of Cognitive Neuroscience. 2007;19:1081–1088. doi: 10.1162/jocn.2007.19.7.1081. [DOI] [PubMed] [Google Scholar]
- Rugg MD, Henson RNA. Episodic memory retrieval: an (event-related) functional neuroimaging perspective. In: Parker AE, Wilding EL, Bussey T, editors. The Cognitive Neuroscience of Memory Encoding and Retrieval. Hove, UK: Psychology Press; 2002. pp. 3–37. [Google Scholar]
- Rugg MD, Henson RNA, Robb WG. Neural correlates of retrieval processing in the prefrontal cortex during recognition and exclusion tasks. Neuropsychologia. 2003;41:40–52. doi: 10.1016/s0028-3932(02)00129-x. [DOI] [PubMed] [Google Scholar]
- Shannon BJ, Buckner RL. Functional-anatomic correlates of memory retrieval that suggest nontraditional processing roles for multiple distinct regions within posterior parietal cortex. Journal of Neuroscience. 2004;24:10084–10092. doi: 10.1523/JNEUROSCI.2625-04.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shiffrin RM. Modeling memory and perception. Cognitive Science. 2003;27:341–378. [Google Scholar]
- Skinner EI, Fernandez MA. Neural correlates of recollection and familiarity: a review of neuroimaging and patient data. Neuropsychologia. 2007;45:2163–2179. doi: 10.1016/j.neuropsychologia.2007.03.007. [DOI] [PubMed] [Google Scholar]
- Squire LR, Wixted JT, Clark RE. Recognition memory and the medial temporal lobe: a new perspective. Nature Reviews Neuroscience. 2007;8:872–883. doi: 10.1038/nrn2154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stark CEL, Okado Y. Making memories without trying: medial temporal lobe activity associated with incidental memory formation during recognition. Journal of Neuroscience. 2003;23:6748–6753. doi: 10.1523/JNEUROSCI.23-17-06748.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Suzuki M, Johnson JD, Rugg MD. Recollection-related hippocampal activity during continuous recognition: a high-resolution fMRI study. Hippocampus. doi: 10.1002/hipo.20781. (in press) [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vann SD, Aggleton JP, Maguire EA. What does the retrosplenial cortex do? Nature Reviews Neuroscience. 2009;10:792–802. doi: 10.1038/nrn2733. [DOI] [PubMed] [Google Scholar]
- Vilberg KL, Rugg MD. Memory retrieval and the parietal cortex: a review of evidence from a dual-process perspective. Neuropsychologia. 2008;46:1787–1799. doi: 10.1016/j.neuropsychologia.2008.01.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vilberg KL, Rugg MD. An investigation of the effects of relative probability of old and new test items on the neural correlates of successful and unsuccessful source memory. Neuroimage. 2009;45:562–571. doi: 10.1016/j.neuroimage.2008.12.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wagner AD, Shannon BJ, Kahn I, Buckner RL. Parietal lobe contributions to episodic memory retrieval. Trends in Cognitive Sciences. 2005;9:445–453. doi: 10.1016/j.tics.2005.07.001. [DOI] [PubMed] [Google Scholar]
- Wais PE. fMRI signals associated with memory strength in the medial temporal lobes: a meta-analysis. Neuropsychologia. 2008;46:3185–3196. doi: 10.1016/j.neuropsychologia.2008.08.025. [DOI] [PubMed] [Google Scholar]
- Wais PE, Squire LR, Wixted JT. In search of recollection and familiarity signals in the hippocampus. Journal of Cognitive Neuroscience. 2010;22:109–123. doi: 10.1162/jocn.2009.21190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ward BD. Simultaneous inference for fMRI data. Milwaukee: Biophysics Research Institute, Medical College of Wisconsin; 2000. [Google Scholar]
- Weis S, Specht K, Klaver P, Tendolkar I, Willmes K, Ruhlmann J, Elger CE, Fernández G. Process dissociation between contextual retrieval and item recognition. Neuroreport. 2004;15:2729–2733. [PubMed] [Google Scholar]
- Wheeler ME, Buckner RL. Functional-anatomic correlates of remembering and knowing. Neuroimage. 2004;21:1337–1349. doi: 10.1016/j.neuroimage.2003.11.001. [DOI] [PubMed] [Google Scholar]
- Wixted JT. Dual-process theory and signal-detection theory of recognition memory. Psychological Review. 2007;114:152–176. doi: 10.1037/0033-295X.114.1.152. [DOI] [PubMed] [Google Scholar]
- Woodruff CC, Johnson JD, Uncapher MR, Rugg MD. Content-specificity of the neural correlates of recollection. Neuropsychologia. 2005;43:1022–1032. doi: 10.1016/j.neuropsychologia.2004.10.013. [DOI] [PubMed] [Google Scholar]
- Yonelinas AP, Jacoby LL. Noncriterial recollection: Familiarity as automatic, irrelevant recollection. Consciousness and Cognition. 1996;5:131–141. [PubMed] [Google Scholar]
- Yonelinas AP, Otten LJ, Shaw KN, Rugg MD. Separating the brain regions involved in recollection and familiarity in recognition memory. Journal of Neuroscience. 2005;25:3002–3008. doi: 10.1523/JNEUROSCI.5295-04.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]