Significance
The transformation of memories into long-term storage relies on their reactivation, which typically occurs during sleep or idle wake. Here, we test a hypothesis that this transformation is optimal when reactivation is not consciously experienced, thereby explaining why “offline” states are better suited for reactivation. Our experiment showed that consciously reactivating a memory benefitted target memories and weakened other associations, whereas unconscious reactivation led to broader non-selective benefits both for the target memory and for memories associated with it. Results provide insight into the mechanisms underlying memory consolidation, supporting the hypothesis that associative spread is greater for unconscious as compared to conscious reactivation.
Keywords: memory consolidation, memory reactivation, inhibition, consciousness
Abstract
Consolidating memories for long-term storage depends on reactivation. Reactivation occurs both consciously, during wakefulness, and unconsciously, during wakefulness and sleep. While considerable work has examined conscious awake and unconscious sleep reactivation, in this study, we directly compare the consequences of conscious and unconscious reactivation during wakefulness. Forty-one participants learned associations consisting of adjective–object–position triads. Objects were clustered into distinct semantic groups (e.g., fruits, vehicles) such that we could examine consequences of reactivation on semantically related memories. After an intensive learning protocol, we systematically reactivated some of the triads by presenting the adjective as a cue. Reactivation was done so that it was consciously experienced for some triads, and only unconsciously processed for others. Memory for spatial positions, the most distal part of the association, was affected by reactivation in a consciousness-dependent and memory-strength-dependent manner. Conscious reactivation resulted in weakening of semantically related memories that were strong initially, resonating with prior findings of retrieval-induced forgetting. Unconscious reactivation, on the other hand, selectively benefited weak reactivated memories, as previously shown for reactivation during sleep. Semantically linked memories were not impaired, but rather were integrated with the reactivated memory. These results taken together demonstrate that conscious and unconscious reactivation have qualitatively different consequences. Results support a consciousness-dependent inhibition account, whereby unconscious reactivation entails less inhibition than conscious reactivation, thus allowing more liberal spread of activation. Findings set the stage for additional exploration into the role of conscious experience in memory storage and structuring.
Most of the events we experience will be forgotten, but some will transform into lasting memories (1). Whether or not the memory for a recent experience is preserved is governed by both the progression of forgetting and an extended process that transpires after the experience of an event has ended, namely consolidation. Consolidation refers to post-encoding stabilization and reorganization of memories and, for declarative memory, is thought to involve hippocampal-cortical brain networks (2). A critical mechanism supporting the process of consolidation may be the post-encoding replay or reactivation of memories (3, 4). Although little is known about the relationship between consciousness and memory reactivation, it is assumed that we can be either unaware or aware of a transpiring reactivation event and that it can occur during either sleep or wakefulness (3, 5). The unique mechanisms that play out in these different circumstances are presently unclear (6).
Sleep possesses some unique characteristics that may render it uniquely suited for optimal reactivation. Sleep is relatively sheltered from external stimuli and involves an oscillatory milieu that may optimize communication between the cortex and subcortical regions (1, 5, 7). However, a fundamental characteristic of memory reactivation during sleep, that has received little attention, is that it apparently occurs outside the realm of conscious awareness. During wakefulness, spontaneous reactivation driving memory consolidation occurs during offline periods, characterized by a lack of a task or goal and by reduced outward attention (6, 8–10). Recent work has found that briefly cueing memories while participants were performing an unrelated task benefited later memory to a greater extent for participants who were less vigilant and engaged (as reflected by longer response times on the unrelated task) and less aware of the cueing (11). These findings suggest that the benefits of memory reactivation could be greater during offline as compared to online states for certain kinds of memories (11). Taken together, these findings raise the question of how conscious access to reactivated content moderates the consequences of memory reactivation.
It is important to consider the mechanistic distinctions between conscious and unconscious reactivation. Conscious memory retrieval is often characterized as a competitive process in which one memory is selected and brought into conscious awareness while competing alternatives are suppressed and made less accessible (12–15). This process of selection improves directed access to the selected memory (16) and may even be useful for reducing interference during future similar retrieval events (17, 18). This form of directed memory retrieval is thought to be driven by prefrontal-controlled inhibition (19, 20). Inhibition of non-targets may rely, therefore, on the conscious activation of the target memory. Thus, in reactivation scenarios in which no memory is selected for conscious retrieval, competing activations would be spared suppression and allowed to persist.
Evidence for patterns of consciousness-dependent inhibition can be found in other domains of neuroscience. Inhibition applied to supraliminal but not subliminal stimulation led to qualitatively different outcomes in such domains as perceptual learning (21), motor control (22), odor priming (23), and word processing (24). Results from the word-processing domain are particularly relevant to ideas about retrieval that we consider here: Supraliminal stimulation yielded a single selected activation while subliminal stimulation yielded several activations and no selection. Thus, whereas selection and inhibition may be critical for goal-directed behavior, the opposite may be true in offline situations. Reduced inhibition may benefit memory restructuring in the brain by permitting more distal associations to be strengthened. Accordingly, we hypothesize that unconsciously triggered reactivations will therefore lead to greater benefits to more distal and related associations, and may also lead to increased binding between them.
To address this issue, in this study, we contrasted the effects of conscious versus unconscious reactivation on later memory retrieval. Our design allowed us to investigate the effects these reactivations had on associations that were either proximal or distal to the reactivated memory (vertical associative spread) and also on memories that were semantically related to the reactivated memory (horizontal associative spread). To do so, we first identified perceptual thresholds in each participant. We used this to reactivate compound memories, made of an adjective–object–position triad, either consciously or not, by presenting the adjectives below or above each individual’s threshold. Importantly, we controlled reactivation using cues to selectively reactivate only a subset of recent memories. This procedure builds on targeted memory reactivation, a technique used to bias reactivation during sleep via the unobtrusive presentation of learning-related stimuli (25, 26), previously adapted for awake reactivation as well (11, 27). We then tested memory for proximal adjective–object associations and for more distal object–position associations, both in reactivated memories and in semantically linked memories that were not themselves cued.
We hypothesized that unconscious reactivation while awake might resemble sleep reactivation and thus differ from conscious reactivation in two major ways: [A] It will elicit more liberal associative spread, not imposing suppression on distal and related semantic memories; and [B] it will be particularly beneficial for weak memories (10, 11, 28–31). On the other hand, we hypothesized that conscious reactivation may have inhibitory consequences on related memories, replicating retrieval-induced forgetting (RIF; 13). Last, we hypothesized that unconscious reactivation may also lead to increased integration with related memories, due to more liberal spread of activation and, hence, concurrent reactivation (32). Our results support these hypotheses, suggesting that activation and inhibition dynamics following reactivation are memory-strength-dependent and consciousness-dependent. While conscious reactivation boosted stronger memories—improving recall of cued associations and impairing memory for related associations—unconscious reactivation benefited weaker memories and facilitated their integration. This diverging pattern of effects suggests that conscious and unconscious reactivations are qualitatively different and may have different unique roles in memory.
Results
Individualized Visibility Calibration.
Participants first completed a task aimed at identifying their individual perceptual thresholds for being able to read masked words (Fig. 1D). This calibration converged within 81.6 trials on average (SD = 25.4; range: 53 to 145 trials). The average detected threshold was 33.82 ms (SD = 8.99 ms). Average accuracy in naming the masked words when exposed at the perceptual threshold was 3.1% (SD = 3.4%; Fig. 2A). The average accuracy when using the maximal duration of 160 ms was 97.6% (SD = 10.9%).
Fig. 1.
Study design. (A) Participants learned associative triads comprised of an adjective (e.g., “loose”), an object (e.g., a pear), and a position on a grid. Memory for triads was tested with the adjective–object and object–position tests before and after memory reactivation. In the latter test, recall error was taken as the distance between the object position selected and the veridical position where the object had appeared during training. (B) Objects in each triad belonged to one of nine semantic categories (e.g., fruit). There were six objects in each category, such that there were 54 triads in total. Half of the memories of six categories (3 × 6 = 18 triads) were reactivated: triads from three categories with conscious reactivation (C-cued) and triads from three categories with unconscious reactivation (U-cued). The three remaining categories were not reactivated (NR). The six objects in each category had systematic spatial positions; the three cued objects were within a 90° segment of the grid and the three noncued objects were within an adjacent 90° segment of the grid. (C) In each reactivation trial, an uppercase target adjective (“LOOSE”) was sandwiched between masks (“MWMWMWM”). Between-image blank durations were adjusted to either be brief for subliminal cues or long for supraliminal cues. (D) Experimental timeline. Participants first underwent a calibration session to determine their individualized perceptual threshold. Then, they were trained to criterion on associative triads. Following a break, memory for adjective–object associations and the object positions was tested. Some of the associations were then reactivated using adjectives as cues (as in panel C). After a break, participants took a recall test for the objects in each category and a test for their spatial positions. Last, individualized perceptual thresholds were used in two manipulation checks. Response times were measured for repeated versus non-repeated words, followed by calibration verification as used initially.
Fig. 2.
Visibility controls and overall recall and spatial memory results. (A) Individualized visibility calibration. Colored lines indicate the accuracy in naming the masked word as a function of the blank duration relative to the duration parameter chosen for U-cued trials (i.e., the perceptual threshold). The blue line reflects the Individualized Calibration session at experiment onset, and the red line reflects the Individualized Calibration Validation session at the end of the experiment. Dotted lines mark the individualized duration that was converged on for U-cued trials (Left), and the average gap between it and the 160 ms duration used for C-cued trials (Right). Accuracy improved as expected when longer blanks were used, and performance was comparable across sessions. Importantly, word recognition was below 10% when using the U-cued duration, and close to 100% when using the C-cued duration. Inset: distribution of the perceptual threshold values across participants. (B) Subliminal priming reduced response times in a semantic judgment task (i.e., repetition priming). This result suggests that the individualized thresholds were sufficient to impact perception. (C) Category-cued recall was superior for objects from C-cued triads than all other objects. (D) Post-reactivation position error was larger for C-noncued than for U-noncued and NR objects. In all plots error bars reflect SEM. NR – non-reactivated; C-cued – consciously cued; C-noncued – not cued from groups that contained C-cued items; U-cued – unconsciously cued; U-noncued – not cued from groups that contained U-cued items. ~P < 0.1, *P < 0.05, **P < 0.01, ***P < 0.001.
When we checked perceptual thresholds again at the end of the session, average accuracy was higher than it was originally (M = 8.9%, SD = 10.9%; t(38) = −3.35, P = 0.002; Fig. 2A). Importantly, however, performance remained far below the level of conscious cueing and under the 10% criterion used to determine the threshold (see Procedure). Therefore, despite improvement in masked word identification, the unconscious cueing presentation procedure did not reliably produce conscious perception either at the beginning or at the end of the session.
Subliminal Presentation and Unconscious Processing.
To validate that our method of subliminal presentation produced unconscious processing, a Repetition Priming task was included. On each trial, participants made a judgment (natural/artificial) on a lower-case word preceded by a masked upper-case word (same parameters as in main tasks), which, on half the trials, was the same word. Results revealed a significant priming effect, in that responses to target words were significantly faster when the preceding masked word was the same compared to different [t(38) = 2.23, P = 0.032; Fig. 2B]. This manipulation check replicated previously reported unconscious repetition priming (e.g., ref. 33) and demonstrated that the unconscious cueing presentation procedure was potent enough to affect semantic processing.
Training.
The main memory task used in this study involved triadic associations among adjectives, objects, and on-screen positions. Memories were reactivated for items in six of the nine categories: Three were unconsciously reactivated and three were consciously reactivated. Only half of the triads within each of these categories were cued, whereas the others were not. In the remaining three categories, none of the triads were reactivated. Triads were therefore divided into five conditions: unconsciously cued (U-cued); noncued members of an unconsciously cued category (U-noncued); consciously cued (C-cued); noncued members of a consciously cued category (C-noncued); non-reactivated (NR; see Fig. 1B). Triads were assigned to conditions according to performance during training, such that memory strength would be balanced across conditions (Procedure). Indeed, all pre-manipulation performance measures—the number of learning iterations required to reach learning criterion, the average success rate of adjective–object association during training, the average error in object–position association during training, and the object–position error in the Pre-reactivation Memory Test—were statistically equivalent across conditions (Table 1).
Table 1.
Pre-manipulation performance measures of associative triads, per condition (mean ± SD)
| NR | C-cued | C-noncued | U-cued | U-noncued | Condition effect | |
|---|---|---|---|---|---|---|
| Number of required training iterations | 3.7 ± 1.1 | 3.8 ± 1.1 | 3.7 ± 1.2 | 3.6 ± 1.1 | 3.7 ± 1.4 |
F(4, 2042) = 0.39, P = 0.816 |
| Training object naming accuracy | 90.4 ± 6.0 | 89.9 ± 7.2 | 91.2 ± 6.3 | 90.4 ± 6.8 | 91.8 ± 5.5 |
F(4, 2042) = 1.25, P = 0.289 |
| Training average position error | 71.5 ± 21.9 | 72.5 ± 24.7 | 77.7 ± 25.7 | 70.8 ± 23.6 | 75.8 ± 26.3 |
F(4, 2042) = 1.58, P = 0.176 |
| Pre-reactivation object naming accuracy | 82.3 ± 16.0 | 84.0 ± 19.3 | 84.0 ± 17.9 | 85.4 ± 15.7 | 87.3 ± 16.5 |
F(4, 2042) = 1.38, P = 0.239 |
| Pre-reactivation position error | 69.7 ± 15.3 | 71.7 ± 16.2 | 74.8 ± 18.0 | 71.9 ± 20.1 | 73.4 ± 20.4 |
F(4, 2042) = 0.85, P = 0.496 |
Accessibility of Proximal Associations.
We first assessed the effect that reactivation of adjectives (e.g., “SCARED”) had on recall of objects linked with those adjectives (e.g., “banana”). Participants were asked to recall as many objects as they could for each semantic category (e.g., “apple”, “banana”, “grapes”, etc.). A main effect of condition was found in the probability to recall objects (F(4, 1994) = 4.03, P = 0.003). Follow-up analysis revealed that recall of C-cued objects was significantly higher than recall of objects of all other conditions (C-cued versus NR: t(1994) = −2.75, P = 0.006; C-cued versus U-noncued: t(1994) = −3.32, P = 0.001; C-cued versus U-cued: t(1994) = −3.18, P = 0.001; C-cued versus C-noncued: t(1994) = −3.32, P = 0.001; Fig. 2C). This indicates that consciously reactivating a triad memory led to greater accessibility of the associated object. It did not, however, affect other triads from the same group: Recall rate of C-noncued triads was similar to that of other noncued items (C-noncued versus NR: t(1994) = 1.08, P = 0.28; C-noncued versus U-noncued: t(1994) = 0.02, P = 0.984).
Following unconscious cueing, recall rates were similar to those of noncued items (U-cued versus NR: t (1994) = 0.91, P = 0.362; U-cued versus U-noncued: t(1994) = −0.13, P = 0.896; U-cued versus C-noncued: t(1994) = −0.15, P = 0.881). This lack of effect suggests that unconscious cueing did not impact free recall, whereas conscious cueing did. Whether this difference indicates a meaningful difference between conscious and unconscious cueing or simply lack of sensitivity to a smaller effect elicited by unconscious cueing cannot be inferred from this test. It does, however, validate the manipulation, demonstrating that U-cued trials were not consciously perceived. To further explore the differences between conscious and unconscious cueing, we next turned to the more sensitive measure of object position.
Accessibility of Distal Associations.
Subsequent analyses focused on memory for more “distal” parts of the triadic memory, namely, the effects of reactivation on memory for the associated object positions. We first examined post-reactivation positioning errors as a general function of condition. No main effect of condition was found (F(4, 2042) = 1.61, P = 0.168), but planned comparisons revealed that post-reactivation positioning error of C-noncued items was higher than that of U-noncued items (t(40) = 1.90, P = 0.033, one-tailed) and marginally higher than NR items (t(40) = 1.55, P = 0.064, one-tailed), implying a consciousness-driven inhibition effect on these spatial associations (Fig. 2D). Our major analysis, however, incorporated memory strength as well, as studies of both sleep and awake reactivation persistently find that it does not affect all memories equally, but rather preferentially benefits memories whose initial strength is weak (11, 28, 29) and intermediate (34, 35).
Despite being trained to reach the same learning criterion, triads in our task varied in how strongly they were encoded, as reflected in the distribution of pre-reactivation spatial error values (M = 71.8 pixels, SD = 49; Fig. 3A). Thus, we considered pre-reactivation spatial error as the metric of memory strength in our task. This model revealed a main effect of pre-reactivation error (F(1, 2037) = 227.34, P < 0.001), a main effect of condition (F(4, 2037) = 3.08, P = 0.015), and an interaction between them (F(4, 2037) = 2.99, P = 0.018, P-FDR (false discovery rate) = 0.027; Fig. 3A).
Fig. 3.
Post-reactivation effects per memory strength. (A, Top) Stronger memories (with small initial positioning error) remained stronger, and weaker memories remained weaker over time. However, weak U-cued and C-noncued memories benefited from reactivation more than other weak memories. (Bottom) Scatter plots of individual triads depict the relationship between pre- and post-reactivation spatial memory for all objects in each condition. Weak memories from the U-cued and C-noncued conditions mostly improved from pre- to post-reactivation. Dashed lines represent the y = x line in all panels. (B, Left) Memory for the position of objects from strongly learned memories deteriorated over time. Memory for C-noncued triads deteriorated more than memory for triads of all other conditions. (Right) Weak memories benefited from reactivation in a condition-dependent manner. U-cued and C-noncued memories benefited more than other memories in their categories. Error bars reflect SEM. NR – non-reactivated; C-cued – consciously cued; C-noncued – noncued member of a list with C-cued items. U–cued unconsciously cued; U-noncued – noncued member of a list with U-cued items. *P < 0.05, **P < 0.01, ***P < 0.001.
A main effect of pre-reactivation error can be expected, as weak memories remain relatively weaker by the end of the experiment, and strong memories remain relatively stronger. We therefore performed follow-up analyses on the main effect of condition and on the interaction effect. These analyses were augmented by a permutation test to validate their robustness (Analyses in Materials and Methods).
Follow-up analyses on the main effect of condition demonstrated that, when taking pre-reactivation position error into account, post-reactivation position error of C-noncued items was significantly higher than that of NR, U-noncued and C-cued items (C-noncued versus NR: t(2037) = −2.19, P = 0.029, P-permutation = 0.001; C-noncued versus U-noncued: t(2037) = −3.26, P = 0.001, P-permutation = 0.002; C-noncued versus C-cued: t(2037) = −2.40, P = 0.017, P-permutation = 0.001). Further, U-cued items had higher post-reactivation position error than U-noncued items (t(2037) = −2.10, P = 0.036, P-permutation = 0.004). Follow-up analyses of the interaction effect revealed that memory-strength-dependent effects of U-cued spatial memories differed from all other conditions except C-noncued (U-cued versus NR: t(2037) = 1.75, P = 0.079, P-permutation = 0.028; U-cued versus U-noncued: t(2037) = 2.62, P = 0.009, P-permutation = 0.007; U-cued versus C-cued: t(2037) = 2.48, P = 0.013, P-permutation = 0.046; U-cued versus C-noncued: t(2037) = 0.22, P = 0.823, P-permutation = 0.811). These effects are driven by improvements for weaker memories in the U-cued group (and detriments for stronger ones) relative to the other conditions. A similar yet less robust effect was found for C-noncued memories: C-noncued versus C-cued: t(2037) = 2.21, P = 0.027, P-permutation = 0.022; C-noncued versus U-noncued: t(2037) = 2.37, P = 0.018, P-permutation = 0.084, and here no difference was found with NR categories (C-noncued versus NR: t(2037) = 1.47, P = 0.141, P-permutation = 0.069). There was no difference between C-noncued and U-cued items in the main effect of memory strength (t(2037) = −1.17, P = 0.243, P-permutation = 0.126), nor between their interaction effects with memory strength (t(2037) = −0.22, P = 0.823, P-permutation = 0.811). Taken together, these results indicate that the weaker a spatial memory was initially (i.e., with larger pre-reactivation errors), the more it improved in a condition-dependent manner, thus reflecting more than mere regression to the mean. Specifically, weak U-cued and C-noncued memories improved more than weak memories of other conditions.
Having established an encoding-strength difference in the effect of reactivation type, we next analyzed the benefit that reactivation had on strong and weak memories separately (Fig. 3B). The pre-reactivation error range was split in two, so that triads were considered “strong” if pre-reactivation error was under or equal to 125 pixels (half the allowed error, see Trial and Participant Exclusion) and “weak” if it was above 125 pixels (Fig. 3B). On average, 13.6% ± 7.5% of participants’ triads were considered weak according to this division. A position benefit score was defined per triad as the change in position error from pre- to post-reactivation [i.e., (Pre-Position ↔ True-Position) – (Post-Position ↔ True-Position)]. A positive value implies that spatial memory had improved following reactivation, and a negative value implies that the memory had degraded following reactivation.
For strong memories, the position error increased in all conditions, meaning that forgetting was dominant and not influenced by reactivation (Fig. 3 B, Left). This is to be expected and likely reflects a trivial regression to the mean. However, a main effect of condition (F(4, 1771) = 4.37, P = 0.002, P-FDR = 0.005) indicated differences in forgetting between conditions. C-noncued triads grew worse in spatial memory precision as compared to all other conditions (C-noncued versus NR: t(1771) = 2.87, P = 0.004; C-noncued versus C-cued: t(1771) = 2.29, P = 0.022; C-noncued versus U-cued: t(1771) = 3.05, P = 0.002; C-noncued versus U-noncued: t(1771) = 4, P < 0.001) even though pre-reactivation positioning error of strong memories was equivalent among all conditions (F(4, 1771) = 0.48, P = 0.753). These results suggest that for strong memories, reactivation had a detrimental effect on spatial memory for related memories when reactivation was conscious, but not when it was unconscious. This finding resonates with the phenomenon of RIF (13), in which reactivation of a memory leads to inhibition of related memories (19). The pattern of results found in position memory is aligned with our hypothesis that conscious reactivation of a target item is accompanied by inhibition, while unconscious reactivation is not. However, it should be noted that there were no apparent benefits for cueing either consciously or unconsciously (C-cued vs NR: t(1771) = 0.19, P = 0.848; U-cued versus NR: t(1771) = −0.65, P = 0.514), nor were there differences between the benefits for C-cued relative to U-cued items (C-cued vs U-cued: t(1771) = 0.73, P = 0.468).
Within the weak memories, there was an evident overall improvement in spatial memory (Fig. 3 B, Right). Once again, these improvements are to be expected based on regression to the mean produced by a priori selection of weak memories. Critically, however, results again show a difference within selected memories: A main effect of condition was found within weak memories (F(4, 266) = 2.47, P = 0.045, P-FDR = 0.045), even though pre-reactivation errors of weak memories were the same across conditions (F(4, 266) = 1.16, P = 0.327). Weak U-cued items improved more than weak C-cued items (t(266) = −1.99, P = 0.048) and more than weak U-noncued (t(266) = −2.22, P = 0.027). A similar pattern of results was also found for weak C-noncued items (C-noncued versus C-cued: t(266) = −2.20, P = 0.029; C-noncued versus U-noncued: t(266) = −2.43, P = 0.016). Reactivation benefits for weak U-cued and weak C-noncued, however, were equivalent (t(266) = 0.21, P = 0.837). These results suggest, again, that subliminal activation, either via unconscious reactivation (i.e., U-cued) or via spreading activation from conscious reactivation (i.e., C-noncued), preferentially benefited weak memories.
Reorganization of Distal Associations.
Finally, we investigated whether systematic biases existed in post-reactivation spatial memory. An implication of our hypothesis that unconscious reactivation involves lesser inhibition is that spreading activation from unconscious reactivations will not be countered by inhibition, and so unconsciously reactivated memories will co-activate with related memories. Such co-activation may result in integration in memory (32). Thus, if our hypothesis is correct, U-cued items may be active alongside U-noncued items in our experiment, and the two would become bound together more than C-cued and C-noncued items would. To test this, the spatial layout of items on the grid was set so that cued and noncued items of each category occupied separate neighboring quadrants (Fig. 1B). If indeed U-noncued items were activated alongside U-cued items, we would expect the reported position memory of U-noncued items to be biased toward the positions of U-cued items.
To examine this hypothesis, we calculated the mean position of cued and noncued members of each category, and termed these the “centers” of the cued and the noncued quadrants. We then compared the distance between where objects were placed and the quadrant centers, pre-reactivation and post-reactivation [i.e., (Post-Position ↔ Quadrant center) – (Pre-Position ↔ Quadrant center)]. The difference between the two is a measure of shift toward the quadrant center (negative values indicating a shift toward the center and positive values a shift away from it). Our analysis considered two types of shifts: noncued items that shifted toward the cued center (i.e., U-noncued → U-cued center; C-noncued → C-cued center), and cued items that shifted toward the noncued center (i.e., U-cued → U-noncued center; C-cued → C-noncued center).
For noncued items, we found an interaction between condition and strength in accounting for the shift toward the cued quadrant (F(1, 681) = 8.70, P = 0.003; There was no main effect of condition: F(1, 681) = 0.01, P = 0.937, nor a main effect of strength: F(1, 681) = 1.60, P = 0.207). Follow-up analysis of weak memories only revealed that, post-reactivation, weak U-noncued items shifted closer to the quadrant of their U-cued peers more than weak C-noncued items shifted toward the quadrant of their C-cued peers (t(89) = 2, P = 0.048; Fig. 4). This effect was not present for strong memories (t(592) = 0.09, P = 0.927). Again, a permutation test was performed to validate this finding. The coefficient size obtained in our data (β = 38.61) was more extreme than 96.4% of the coefficients obtained under random permutations (M = 0.19, SD = 18.72; P-permutation = 0.036), suggesting that the unconscious nature of cueing had indeed introduced a systematic bias toward the cued positions.
Fig. 4.
Shifts in spatial error of weak memories post-reactivation. For this visualization, positions were transformed so that all categories were superimposed over the top 180° of the grid, with the cued quadrant on the Left and the non-cued quadrant on the Right. Lines indicate the direction (in degrees) and size (in pixels) of the difference between post-reactivation and pre-reactivation positioning (smoothed using a sliding average over 145°). This visualization shows a leftward shift in weak U-noncued positioning post-reactivation, i.e., that after reactivation these items were systematically placed closer to the cued quadrant of the same category.
In cued items, no difference was found between the conditions in their shift toward their noncued quadrants (main effect of condition: F(1, 683) = 1.02, P = 0.313; main effect of strength: F(1, 683) = 0.19, P = 0.660; interaction between condition and strength: F(1, 683) = 0.09, P = 0.766).
Discussion
In this paper, we contrasted the effects of awake conscious and unconscious reactivation on memory. Participants were trained to learn triadic memories (adjective–object–position) prior to reactivation, when a portion of these memories were cued by presenting the adjective either subliminally or supraliminally. We hypothesized that conscious and unconscious memory reactivation would benefit memory in qualitatively distinct ways, owing to the observation that conscious reactivation should be accompanied by more inhibition of other related memories than unconscious reactivation would (13, 20). Specifically, we predicted that conscious reactivation would strongly benefit the consciously retrieved content but may also have detrimental effects on semantically related non-rehearsed memories, as observed in RIF experiments (13). By contrast, we predicted that unconscious reactivation would be more likely to improve memory for weaker associations, without causing impairment to associated memories. We also tested an additional implication of our hypothesis, that unconscious reactivation would promote integration of associated memories due to nonrestrictive spreading activation.
Results provided partial support for our hypotheses. As predicted, conscious reactivation improved retrieval of the cued objects compared to unconscious reactivation. With regards to the more distal spatial position association, conscious and unconscious cueing had a memory-strength-dependent effect that differed between conditions. Consciously reactivating some memories from a semantic category affected other memories belonging to that category according to their strength: Strongly encoded memories were impaired while weakly encoded memories were improved (more than can be expected by regression to the mean). Unconscious reactivation, on the other hand, benefited weakly encoded memories and caused their integration with associated memories, without impacting strongly encoded memories. Thus, these results highlight that conscious and unconscious memory reactivation have qualitatively distinct consequences on memory strength and integration.
The detrimental effect that conscious but not unconscious reactivation had on related memories that were strongly encoded is in line with our hypothesis of decreased inhibition recruited by unconscious reactivation. The RIF effect is mostly driven by inhibitory dynamics (19) and is thus expected to be found following conscious reactivation but not following unconscious reactivation. The finding that only strongly encoded memories suffered impairment following conscious cueing is consistent with the competitive framework of conscious retrieval and the “interference dependence” aspect of RIF, which demonstrates that related memories are suppressed according to the strength of their link to the reactivated memory (13). Weakly encoded memories may also be weakly linked with the reactivated category. They could thereby be rescued from RIF, perhaps due to nonmonotonic plasticity dynamics (36).
Beneficial effects of reactivation on weakly encoded memories are in line with previous reports on the contribution of offline reactivation to memory. For example, Schapiro et al. (2018) showed that memory reactivation during post-task rest predicted memory improvement, but only for weakly encoded memory (10). Similarly, targeted memory reactivation studies have shown a selective benefit for weakly encoded memories during sleep (28–31) and during wakefulness (11). Importantly, these effects cannot be explained by regression to the mean or floor effects, since they contrast weakly encoded memories that were either reactivated or not and shared similar starting points and expected trajectories. This selective benefit is consistent with neurobiological models of synaptic tag and capture (37, 38), and may be the result of prioritized offline consolidation of memories that have been tagged as needing such strengthening (39, 40). The effects of unconscious reactivation on weakly, but not strongly, encoded memories are therefore in line with emerging work examining the effects of exogenous or endogenous reactivation on later memory.
Last, unconscious reactivation did not affect the accessibility of other semantically related memories but it did affect their content, indicating some spreading activation in unconscious reactivation, as is also found during sleep (31). Stimulation in U-cued trials was weakened in order to render it unconscious. Weak and shallow processing alone would be expected to yield little if any spreading activation, and so evidence of spreading activation is in line with the hypothesis that unconscious processing is more permissible to it. However, more work is needed to completely dissociate consciousness from these highly linked factors. Furthermore, the seemed infiltration of cued items’ spatial memory into the spatial memory of their noncued associates supports the hypothesis that unconscious reactivation would permit their co-activation (32). This integration resonates with the emergence of relational memory found following sleep consolidation (41) and the increases in neural integration (42). However, more work is needed to understand this aspect of unconscious reactivation, and whether it has similar influences on memory during sleep and wakefulness. Unconscious reactivation during wake and sleep may have distinct influences on memory, and unconscious activations during sleep may also be stronger than the activations used in this task, which were set to be weak in order to remain unconscious.
Results did not meet our hypotheses in three ways. First, conscious reactivation had no determinantal effect on the recall of objects from the same category that were not cued, as would be predicted by RIF. This lack of an RIF effect in our first-order association may be due to category binding being weaker in our design than in typical RIF studies, in which the category word is always presented alongside the cue word during both study and retrieval. This could have caused the categorical effect to be too weak to affect object recall, and so only discernable in the more sensitive measure of spatial memory. Second, conscious reactivation had no effect on spatial precision of the target memory, but rather only on its associated memories from the same category. Third, the benefits of unconscious reactivation for weakly encoded memories were not significantly larger than the effects observed in NR categories. These last two null effects are difficult to interpret. Notably, models incorporating pre-reactivation memory strength as a continuous measure provide evidence for some hypothesized effects, including a difference between unconsciously reactivated and NR items. It may therefore be that analyses dividing memories dichotomously by memory strength were underpowered to detect these effects in aggregated spatial error. Future studies should be powered based on the effects observed in this study to shed light on these findings.
The key feature of the current work was our intentional manipulation of conscious experience of reactivated content. We adopted several measures to confirm that our unconscious stimulus presentations were neither too strong (e.g., explicit report was at chance) nor too weak (e.g., presentations evoked repetition priming). As discussed above, several studies have considered the role of offline memory processing during wakefulness (3, 8–10, 43); see ref. 6 for review. However, although offline states were linked before to sensory decoupling and lack of attention to reactivated material (6), no study to the best of our knowledge has examined the effect that conscious awareness of the reactivated material has on subsequent memory. Tambini and colleagues (11) set the stage for isolating the effects of unaware awake processing on memory. Our experiment has taken this question further by examining unconscious awake processing, guided by a hypothesis that processing outside of conscious access has unique characteristics that may be beneficial for certain mnemonic operations. Indeed, our results demonstrate qualitative differences in the effects that conscious and unconscious reactivation has on later memory, resonating with similar findings made in other domains of neuroscience (21–24). Notably, while the impact of consciousness on memory accessibility has been extensively studied (see, e.g., ref. 44), our study investigates the effect that unconscious reactivation has on memory accessibility and integration at a later timepoint. Hence, it could not be attributed to mere short-term facilitation, as effects of unconscious priming are typically short-lived, on the order of a few hundred milliseconds (45, 46). Rather, they suggest longer-term modification in the storage of reactivated memories (47).
Nevertheless, our design had some notable limitations. First, our reactivation paradigm relied on links between the adjectives (that served as cues), the objects, and finally their spatial positions. Adjective–object associations were well learned before reactivation (~84% correctly recalled), while the second-order object–position associations were purposefully not learned to ceiling. This was done to allow room for improvement and variability in initial memory strength, because the extant literature strongly suggest that offline reactivation may selectively benefit weaker memories. However, one consequence of this experimental choice is that the initial memory links may not have been sufficiently strong to reliably reactivate downstream spatial positions given the adjective cue. Second, our unconscious reactivation trials differed from those used by Tambini and colleagues (11) in a way that may have impacted their effects. Whereas the previous study presented cues while participants were engaged in a boring, mind-wandering-inducing task, our design mixed conscious and unconscious reactivation trials within the same blocks, thereby requiring participants to be constantly alert and attending to the presented information. This may have reduced the effectiveness of the unconscious manipulation, which might have been greater if participants were in an ideal “offline” state during reactivation (11, 43).
By contrasting conscious and unconscious reactivation within the same design, our results constitute a first step in considering the effect of consciousness on associative spread and subsequent accessibility and organization of memory. Indeed, our results indicate that consciousness plays a role in determining these trajectories. While conscious rehearsal remains more advantageous for retrieval later in time, our study demonstrates that unconscious reactivation also has consequences for memory representations, which are different, perhaps beneficial to other aspects of memory storage, and probably more similar to the effects of endogenous memory replay during sleep or rest. To fully understand the impact of different conscious states on consolidation, and distinguish them from other related factors such as stimulation strength and processing depth, future studies should examine unconscious reactivation induced by different means (e.g., attentional blink, continuous flash suppression), as they have been shown to be processed differently (48), as well as the full range of naturally occurring conscious states, including full alertness, mind wandering, and the different stages of sleep.
Materials and Methods
Participants.
Forty-eight Northwestern University undergraduate students participated in the study for course credit. Data for seven participants were excluded from analysis: three participants did not complete all the critical experimental phases, one participant was excluded due to technical errors, and three participants were excluded due to poor learning of the experimental material (Trial and Participant Exclusion). The final sample included 41 participants (25 identified as female, 16 as male; 38 right-handed) between the ages of 18 and 23 y (M = 18.85, SD = 0.99). All participants were presented a standard written consent form to participate in the study. They signed if they agreed to participate, after any questions they had were answered, and they were offered a copy of the completed document. The Northwestern University Institutional Review Board approved the procedures, and the experiment was performed in accordance with relevant guidelines and regulations.
Stimuli.
Stimuli in the experiment were used to form three-way associations (associative triads); each triad included an adjective, an image of an object, and a spatial on-screen position (Fig. 1). Stimuli included 76 adjectives, each of which had 4 to 6 letters, 1 to 2 syllables, and were taken from the Medical Research Council psycholinguistics database (https://websites.psychology.uwa.edu.au/school/mrcdatabase/uwa_mrc.htm), with a 500 to 700 familiarity rating (plus one additional adjective, scared). For each participant, 54 adjectives were randomly assigned to triads, an additional 18 were used as novel words in the Reactivation phase, and four were used in practice trials (including one, short, that appeared on instruction screens and was always assigned to practice trials).
Object images were collected from online sources and belonged to nine distinct semantic categories: animals, clothing, fruit, furniture, hospital, games, sports, tools, and vehicles. The “games” category was replaced by the music category for the final 25 participants, as an interim analysis of category-cued recall showed that games and sports categories overlapped and caused confusion. Each of the nine categories included six distinct objects (e.g., apple, banana, grapes, pear, pineapple, strawberry), totaling 54 critical objects. Four additional objects from the plant category were used for practice, one of which was also used in instructions.
For each participant, the 54 objects were each randomly paired with an adjective and were each assigned an on-screen position. These positions were pseudo-random, partly determined by category and condition. Objects from the same category were assigned positions that were confined to one half of the grid (Fig. 1B). As nine categories were used, category regions were offset by 40° one from the other and overlapped (each covered 180°). Semi-circles of U and C categories were further divided into two quadrants. The three triads from these categories that were cued during the Reactivation phase (i.e., U-cued and C-cued) were assigned positions in one quadrant, while the three noncued triads (i.e., U-noncued and C-noncued) were assigned positions in the other quadrant (Fig. 1B).
For the repetition priming test, 120 nouns were used, each comprised of 4 to 6 letters; 60 denoted natural objects (e.g., grass) and 60 denoted artificial objects (e.g., mirror). An additional 112 nouns were used for the Individualized Calibration and Individualized Calibration Validation phases, described below.
Stimuli were presented on a 20.75 × 11.67 inch Dell P2417H screen, controlled by Matlab2020b code using the Psychtoolbox-3 toolbox (49). The experiment alternated between two presentation settings: 1,920 × 1,080 pixels at 60 Hz (Slow setting) and 1,280 × 1,024 pixels at 75 Hz (Fast setting). The Fast setting was used in phases that required masking: Individualized Calibration, Reactivation, Repetition Priming Test, and Individualized Calibration Validation. These phases contained word stimuli only (see the following Masked Cueing section for a detailed description of presentation settings during these phases). All other parts of the experiment were done under the Slow setting. For the spatial positioning task, objects were presented such that their long axis extended 150 pixels, overlaid on top of a 700 × 700 pixel image of a circular grid. The entire stimuli set, experimental code and data, can be found online at (50).
Masked Cueing.
Our procedure involved multiple phases which included target words presented in between two masks (Fig. 1C). We collectively refer to the trials in these phases as masked trials. Depending on the timing of stimuli display, the target word in these trials was sometimes presented subliminally and sometimes supraliminally. These trials make up the Reactivation phase, the core manipulation of the study, but are also used in the Individualized Calibration, Repetition Priming Test and Individualized Calibration Validation phases (Fig. 1D).
In masked trials, target words (cues) were presented in uppercase letters between two identical strings of uppercase letters acting as masks: “MWMWMWM”. Each cueing sequence contained, in order: a forward mask, a blank screen, the target word, another blank screen, and a backward mask (i.e., MASK-BLANK-TARGET-BLANK-MASK). Masks were presented for 80 ms and target words for 13.33 ms. The critical manipulation pertained to the duration of the blank screens. When the blank screens had a very short duration, participants could not consciously perceive the target words (51). The minimal blank screen duration used was 13.333 ms. To manipulate conscious and unconscious perception, we identified the maximal blank screen duration for each participant that persistently did not produce conscious awareness of the target word (Procedure). Each individual’s perceptual threshold was then used in some trials to render the target word imperceivable, hence producing unconscious reactivation. In other trials, a longer duration was used to render the target word visible, hence producing conscious reactivation.
Procedure.
The experiment was made of multiple consecutive phases (Fig. 1D).
1) Individualized Calibration: The goal of the Individualized Calibration phase was to find the longest blank duration that still renders the target word unreadable (i.e., the perceptual threshold). Specifically, the duration of the blank screens separating target words from surrounding masks in masked trials was manipulated and conscious reports were collected (Fig. 2A). To this end, on each trial, participants were shown masked trials which included nouns as target words, and were asked to say out loud the word they saw. If they were unsure or did not consciously perceive any word, they were asked to say the first word that came to mind. An experimenter in the room registered whether each response was correct or incorrect. To identify the perceptual threshold, we used a 1-down-4-up staircase procedure that continuously modified the blank duration: each correct response caused the duration of the blank screen to shorten; four consecutive incorrect responses caused the duration of the blank to lengthen. Both shortening and lengthening were made in steps of 13.33 ms. Blank duration was initialized at 160 ms and was allowed to reach a minimum of 13.33 ms. Calibration ended when the participant’s perceptual threshold was identified, defined as the blank duration that was used in at least 30 trials and produced less than 10% correct responses.
2) Training: The goal of this phase was for participants to learn 54 adjective–object–position triad associations. Objects came from nine distinct semantic categories (Stimuli). Six objects from each category were included. Learning was divided into six blocks. Before the first block, a practice block was administered using an additional category (plants) that consisted of four objects only. Each block included training of nine associations. Each pair of consecutive blocks encompassed three categories (e.g., learning block 1 contained three animal objects, three vehicle objects, and three tool objects, and learning block 2 contained the remaining three animal objects, three vehicle objects, and three tool objects). At the beginning of each block, participants were familiarized with each category’s objects before learning their associated adjectives and positions: Before each pair of blocks containing three new categories, all items from each of the three categories were displayed on-screen all at once, together with their names, one category at a time. In every three categories that were learned together in the same learning blocks, one category was assigned to each of the three conditions (Reactivation). This ensured that learning recency was balanced across conditions.
Each learning block began with Guided-training of all associations. In Guided-training, a circular grid appeared at the center of the screen and a fixation cross appeared above it. After 250 ms, the fixation was replaced by an adjective. After 1 s, the object appeared in the center of the grid. After another 500 ms, a white dot appeared on the grid, marking the veridical position for this specific object. Participants were instructed to move the object image (using the mouse) to the position indicated by the white dot and to remember this object-specific position. The Guided-training trial ended when the participant “dropped” the object (by clicking the mouse button) within 20 pixels of the white dot.
After Guided-training of all the associations in the block was completed, Feedback-training began. During this part of the task, the nine adjective–object–position triads were repeated until the learning criterion was met (see below). Feedback-training trials included two consecutive parts. First, the adjective–object association was tested, and then, if a correct response was given, the object–position association was tested (Fig. 1A). For adjective–object testing, a fixation cross appeared at the center of the screen for 250 ms, and was then replaced by an adjective (e.g., SCARED). Participants were asked to type the name of the object associated with it (e.g., “BANANA”). Participants were allowed to only type in the first four letters of a word to avoid spelling-related errors and save time. A “success” or “failure” tone was then played, along with the correct object image and name which were presented on screen for 1 s. Incorrect trials were then terminated. If correct, an object–position test then commenced: the grid appeared behind the object and participants were asked to drag the object to its correct position and drop it there. Dropping an object within 100 pixels of the veridical position was considered a correct response in this part of the task. Either a green check-mark or a red X appeared in the selected position, and an appropriate success or failure tone was played. After this feedback, and regardless of whether the response was correct or not, a white dot appeared on the grid indicating the veridical position for the object. This feedback remained on-screen for 1 s before the next trial began.
Testing blocks continued until all associations reached the defined learning criterion. An association was considered learned when both the adjective–object test and the object–position test were marked as correct on two consecutive trials. Once an association was learned, participants no longer had to go through the object–position tests for these triads; Only the adjective–object test was given for the triad from that moment on. Once all nine associations were learned, the block was terminated and the next block began.
3) Pre-reactivation Memory Test: Following a 2-min break, a memory test of all associations was carried out, to provide a baseline measure of memory prior to reactivation. Testing was similar to testing during the Training phase, with two differences. First, no feedback was given during testing. Second, tests were divided into two parts. Adjective–object associations were tested for all triads, and then object–position associations were tested for all triads. Both parts began with the four practice associations (i.e., linked with the plant category), and the remaining 54 associations were then tested in random order.
4) Reactivation: After the test, triads were divided to three conditions. Triads belonging to three categories (i.e., 18 adjective–object–position triads) were assigned to the conscious (C) reactivation condition, triads of three categories were assigned to the unconscious (U) reactivation condition, and triads of the remaining three categories were assigned to the NR condition. Conditions were assigned such that memory across conditions was matched. This was achieved by dividing the three categories learned in each learning block between the three conditions. This ensured that stimuli of all conditions were encountered at the same times and tested following the same time lag. Then, all options to assign conditions under this constraint were explored, and the configuration producing the minimal variability in pre-reactivation errors across conditions was selected.
Within categories in the reactivated conditions (U and C), only half of the triads (three) were cued during the Reactivation phase. This allowed us to examine later memory for cued and noncued triads from the same category. The cued triads’ spatial positions occupied one quadrant of a category’s semi-circle, whereas the noncued triads’ positions occupied the other quadrant (Stimuli).
In reactivation trials, the triad’s adjective was presented as the target word in a masked trial. For triads in the U-cued condition, the timing constant that was revealed in the calibration phase was used as the duration of the blank screen buffering between the adjective and the surrounding masks, rendering the adjective imperceivable. For triads in the C-cued condition, the duration of the blank screen was always 160 ms, rendering the adjective consciously visible. Triads belonging to the NR condition were not presented in this phase.
During the reactivation phase, participants were instructed to try and identify the target word, presented in uppercase letters. Unlike masked trials presented in the Calibration phase, reactivation trials included an additional screen that preceded the first masked screen. In this screen, a word was presented in lowercase letters for 400 ms (hence clearly visible). It informed participants which category the triad belongs to (e.g., for the adjective SCARED, which was paired with a banana, the lower-case word would be “fruit”). Participants were told that the target word may be an adjective that they had learned before, in which case, the lower-case word will indicate the category of the object associated with the adjective. If they were able to identify the target word as one of the adjectives, participants should imagine both the adjective and its linked object as vividly as possible (e.g., a scared banana). Participants were told that the main objective of this experiment is to test how imagination affects cognition. Participants were also told that if the target word is either unfamiliar or impossible to see, no action is required. Each masking trial was followed by a 4 s blank screen to provide time for the participants to vividly imagine the associations.
Altogether, 18 adjectives from learned associations were cued during Reactivation: nine U-cued triads and nine C-cued triads (three triads from each of three C/U categories), in addition to 18 novel adjectives used as control which were never seen before in the experiment. Each adjective was reactivated three times. This was done over three blocks, such that each block included a single presentation of all 36 adjectives. Blocks were separated by self-paced breaks. Each block started with buffer trials which consisted of practice triads (i.e., from the plant category): the first block started with four such trials (two presented supraliminally and two subliminally); the other blocks started with two supraliminal trials. Altogether, the Reactivation phase comprised 116 trials: 36 adjectives cued 3 times each, and eight practice trials.
5) Object Recall Test: Following a 1-min break, participants were asked to recall all learned objects. A category name was shown on screen (e.g., fruit), and participants were asked to type as many of the objects they remember from that category, in any order. The order in which categories were tested was randomized, except for the practice category (plants) which was always tested first. This phase was self-paced and no feedback was provided. Two participants failed to understand the instructions for this phase and their data from this phase was not included in the analysis.
6) Post-reactivation Memory Test: Next, memory for all object–position associations was tested like in the Pre-reactivation Memory Test. Note that unlike the previous phase, adjective–object associations were not tested here.
7) Repetition Priming Test: The goal of this phase was to test whether masking trials presented rapidly (i.e., using an individual’s identified perceptual threshold) produced an unconscious repetition priming effect as has been shown previously (e.g., ref. 30). This phase was added to rule out the possibility that stimuli were presented too rapidly to be processed under U-cued conditions. A repetition priming effect would demonstrate that despite being imperceivable, subliminally cued words were processed.
Participants began each trial by clicking the spacebar key. The repetition priming test consisted of 240 masked trials presented subliminally, immediately followed by a word in lowercase letters, which was presented supraliminally (the “target”). Participants were asked to judge, in each trial, whether the target word was “natural” or “artificial”, using the left and right arrow keys on the keyboard, respectively. The target remained on the screen until one of these buttons was pressed. Critically, in half of the trials the masked word (the “prime”), presented in uppercase letters, was the same as the target at the end of the sequence (e.g., “MIRROR” followed by “mirror”). Therefore, if the masked word was indeed processed, response for the target should be facilitated, even though the two words were not presented in the same case, indicating semantic priming (33).
Response category (i.e., natural or artificial) was counterbalanced across targets within repeating and within non-repeating trials. Trials were ordered so that the response category did not repeat for more than three consecutive trials, and neither primes nor targets repeated in consecutive trials. As in Dehaene et al. (33), the words in non-repeating trials always came from different response categories (e.g., masking “WATER”, which is natural, and then presenting “broom”, which is artificial). Last, words in non-repeating trials were of the same number of letters and did not share a first letter.
8) Individualized Calibration Validation: We repeated a variation of the Individualized Calibration phase again at the end of the study. Trial and task structure were the same as in the original Individualized Calibration phase. This phase consisted of 40 trials: five trials using the blank duration used for the C-cued condition: 160 ms, 15 trials using the identified perceptual threshold (i.e., the blank duration used for the U-cued condition), 10 trials with a blank duration that was 13.33 ms longer than the perceptual threshold, and 10 trials with a blank duration that was 13.33 ms shorter than the perceptual threshold. Trial order was randomized. Two participants failed to complete the Individualized Calibration Validation phase due to their experiment taking more time than scheduled, and their data from this phase was not included in the analysis.
Analyses.
All analyses were completed using Matlab 2020a (MathWorks Inc., Natick, MA). Statistical analyses were conducted using linear mixed-effects models (fitglme function in Matlab), including a random intercept for participants. F-test and t tests were used to analyze fixed effects (using the anova function of the GeneralizedLinearMixedModel class in Matlab).
For permutation tests, ten thousand random shuffles of labels among conscious and unconscious category labels were sampled (i.e., randomly selecting three categories as conscious and three as unconscious among the six categories that were not NR per each participant). The same analysis performed on the original labels was carried out for all samples. P-permutation values indicate the ratio of samples in which the obtained coefficient size (β) was as or more extreme than the coefficient size obtained under the true labels. Note that shuffling was done within cued categories only (conscious and unconscious), and that within each category “cued” and “noncued” labels remained intact, so results reflect the significance of the type of cueing, not of cueing itself.
For testing the interaction between condition and memory strength in explaining spatial memory benefit, and the follow-up tests among weak and strong memories separately, a Benjamini–Hochberg FDR correction for multiple comparisons was conducted (52). Corrected P-values are reported in the relevant analyses as P-FDR.
Accuracy in Individualized Calibration and Individualized Calibration Validation trials was registered by the experimenter online after each trial. In five cases (0.1% of trials), the experimenter indicated that they were not sure about the participant’s last response, making the program ignore the last trial.
To mitigate spelling challenges, only the first 4 letters of each word were required in Recall. Responses were evaluated manually offline. Nonetheless, there were still twelve cases that were considered spelling mistakes (e.g., “jeas” instead of “jeans” and “herm” instead of “harm” for “harmonica”) and one case of a naming mistake (“plan” presumably for “plane”, instead of “airplane”) that were considered a correct response.
Trial and Participant Exclusion.
This study sought to investigate the effect of unconscious reactivation on pre-existing memories. Memories that were not properly formed at the onset, as indicated by poor memory immediately after learning and prior to reactivation, were thus excluded from analysis. Triads containing objects that were positioned over 250 pixels away from their veridical position during the Pre-reactivation Memory Test (2.7 inch; ~35% of circle diameter and 2.5 times the allowed margin of error during Training) were removed from analysis. This led to the exclusion of M = 5.83, SD = 6.76 triads per participant (10.8%).
In addition to triad exclusions, three participants (6.25%) were excluded due to pre-reactivation memory score indicating lack of initial learning. To detect these participants, a two-parameter Weibull distribution was fit to each participant’s pre-reactivation error scores (in pixels). The Weibull describes a non-negative distribution of values that may be skewed. Pre-reactivation spatial memory accuracy should rise sharply on the left and have a long rightward tail, indicating that the majority of items are remembered well (i.e., with little spatial error) while a minority of items are weaker. We compared the fitted shape parameter of the distribution to the group average. The shape value of three participants (M = 288.62 SD = 54.23) was larger by more than two SD from the group average (M = 115.47 SD = 55.04), indicating that the distribution of spatial error of these participants was abnormally centered around higher values, with tails on both sides of the center. Indeed, the percentage of outlier items of these participants (M = 51.23% SD = 15.42) was more than two SD larger than the group average (M = 10.8% SD = 12.53). Thus, these participants were excluded from analysis due to overall poor memory performance.
In the Repetition Priming Test, incorrect responses (5.7% of responses), as well as responses that were either longer or shorter than each participant’s average by more than 2.5 SD (2.6% of responses), were excluded from analysis. Additionally, participants whose responses were either longer or shorter than the group average by more than 2.5 SD were removed from analysis (2/41 participants).
Acknowledgments
This work was supported by NIH (USA) grant R00-MH122663 for E.S., NSF (USA) grant BCS-2048681 for K.A.P., and NSF-BSF Grant 2048587 for A.T. and L.D.
Author contributions
A.T., E.S., K.A.P., and L.D. designed research; E.S. and B.C. performed research; A.T. and E.S. analyzed data; and A.T., E.S., K.A.P., and L.D. wrote the paper.
Competing interests
The authors declare no competing interest.
Footnotes
Preprint available at: https://www.biorxiv.org/content/10.1101/2023.07.26.546400v1.
This article is a PNAS Direct Submission.
Contributor Information
Amir Tal, Email: amirostal@gmail.com.
Eitan Schechtman, Email: eitans@uci.edu.
Data, Materials, and Software Availability
Anonymized behavioral responses in CSV format data have been deposited in OSF (50).
References
- 1.Paller K. A., Wagner A. D., Observing the transformation of experience into memory. Trends Cogn. Sci. 6, 93–102 (2002). [DOI] [PubMed] [Google Scholar]
- 2.Squire L. R., Cohen N. J., Nadel L., “The medial temporal region and memory consolidation: A new hypothesis” in Memory Consolidation: Psychobiology of Cognition, H. Weingartner, E. S. Parder, Eds. (Psychology Press, 1984), pp. 185–210. [Google Scholar]
- 3.Tambini A., Davachi L., Awake reactivation of prior experiences consolidates memories and biases cognition. Trends Cogn. Sci. 23, 876–890 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Paller K. A., Antony J. W., Mayes A. R., Norman K. A., “Replay-based consolidation governs enduring memory storage” in The Cognitive Neurosciences, Poeppel D., Mangun G. R., Gazzaniga M. S., Eds. (MIT Press, ed. 6, 2020), pp. 263–274. [Google Scholar]
- 5.Diekelmann S., Born J., The memory function of sleep. Nat. Rev. Neurosci. 11, 114–126 (2010). [DOI] [PubMed] [Google Scholar]
- 6.Wamsley E. J., Offline memory consolidation during waking rest. Nat. Rev. Psychol. 1, 441–453 (2022). [Google Scholar]
- 7.Staresina B. P., Niediek J., Borger V., Surges R., Mormann F., How coupled slow oscillations, spindles and ripples coordinate neuronal processing and communication during human sleep. Nat. Neurosci. 26, 1429–1437 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Tambini A., Davachi L., Persistence of hippocampal multivoxel patterns into postencoding rest is related to memory. Proc. Natl. Acad. Sci. U.S.A. 110, 19591–19596 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Tambini A., Ketz N., Davachi L., Enhanced brain correlations during rest are related to memory for recent experiences. Neuron 65, 280–290 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Schapiro A. C., McDevitt E. A., Rogers T. T., Mednick S. C., Norman K. A., Human hippocampal replay during rest prioritizes weakly learned information and predicts memory performance. Nat. Commun. 9, 3920 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Tambini A., Berners-Lee A., Davachi L., Brief targeted memory reactivation during the awake state enhances memory stability and benefits the weakest memories. Sci. Rep. 7, 15325 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Healey M. K., Campbell K. L., Hasher L., Ossher L., Direct evidence for the role of inhibition in resolving interference in memory. Psychol. Sci. 21, 1363–1547 (2010). [DOI] [PubMed] [Google Scholar]
- 13.Anderson M. C., Rethinking interference theory: Executive control and the mechanisms of forgetting. J. Mem. Lang. 49, 415–445 (2003). [Google Scholar]
- 14.Kuhl B. A., Bainbridge W. A., Chun M. M., Neural reactivation reveals mechanisms for updating memory. J. Neurosci. 32, 3453–3461 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Tal A., Bar M., The proactive brain and the fate of dead hypotheses. Front. Comput. Neurosci. 8, 138 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Roediger H. L., Karpicke J. D., Test-enhanced learning: Taking memory tests improves long-term retention. Psychol. Sci. 17, 249–255 (2006). [DOI] [PubMed] [Google Scholar]
- 17.Hulbert J. C., Norman K. A., Neural differentiation tracks improved recall of competing memories following interleaved study and retrieval practice. Cereb. Cortex 25, 3994–4008 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Kuhl B. A., Dudukovic N. M., Kahn I., Wagner A. D., Decreased demands on cognitive control reveal the neural processing benefits of forgetting. Nat. Neurosci. 10, 908–914 (2007). [DOI] [PubMed] [Google Scholar]
- 19.Storm B. C., et al. , A review of retrieval-induced forgetting in the contexts of learning, eyewitness memory, social cognition, autobiographical memory, and creative cognition. Psychol. Learn. Motiv. Adv. Res. Theory 62, 141–194 (2015). [Google Scholar]
- 20.Schmitz T. W., Correia M. M., Ferreira C. S., Prescot A. P., Anderson M. C., Hippocampal GABA enables inhibitory control over unwanted thoughts. Nat. Commun. 8, 1–11 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Tsushima Y., Sasaki Y., Watanabe T., Greater disruption due to failure of inhibitory control on an ambiguous distractor. Science 314, 1786–1788 (2006). [DOI] [PubMed] [Google Scholar]
- 22.Schlaghecken F., Eimer M., Motor activation with and without inhibition: Evidence for a threshold mechanism in motor control. Percept. Psychophys. 64, 148–162 (2002). [DOI] [PubMed] [Google Scholar]
- 23.Li W., Moallem I., Paller K. A., Gottfried J. A., Subliminal smells can guide social preferences. Psychol. Sci. 18, 1044–1049 (2007). [DOI] [PubMed] [Google Scholar]
- 24.Marcel T., “Conscious and preconscious recognition of polysemous words: Locating the selective effects of prior verbal context” in Attention and Performance Viii, R. S. Nickerson, Ed. (Psychology Press, 1980), pp. 435–457. [Google Scholar]
- 25.Hu X., Cheng L. Y., Chiu M. H., Paller K. A., Promoting memory consolidation during sleep: A meta-analysis of targeted memory reactivation. Psychol. Bull. 146, 218–244 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Oudiette D., Paller K. A., Upgrading the sleeping brain with targeted memory reactivation. Trends Cogn. Sci. 17, 142–149 (2013). [DOI] [PubMed] [Google Scholar]
- 27.Alm K. H., Ngo C. T., Olson I. R., Hippocampal signatures of awake targeted memory reactivation. Brain Struct. Funct. 224, 713–726 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Cairney S. A., Lindsay S., Sobczak J. M., Paller K. A., Gaskell M. G., The benefits of targeted memory reactivation for consolidation in sleep are contingent on memory accuracy and direct cue-memory associations. Sleep 39, 1139–1150 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Creery J. D., Oudiette D., Antony J. W., Paller K. A., Targeted memory reactivation during sleep depends on prior learning. Sleep 38, 755–763 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Schechtman E., et al. , Sleep reactivation did not boost suppression-induced forgetting. Sci. Rep. 11, 1383 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Schechtman E., Heilberg J., Paller K. A., Memory consolidation during sleep involves context reinstatement in humans. Cell Rep. 42, 112331 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Lewis P. A., Durrant S. J., Overlapping memory replay during sleep builds cognitive schemata. Trends Cogn. Sci. 15, 343–351 (2011). [DOI] [PubMed] [Google Scholar]
- 33.Dehaene S., et al. , Cerebral mechanisms of word masking and unconscious repetition priming. Nat. Neurosci. 4, 752–758 (2001). [DOI] [PubMed] [Google Scholar]
- 34.Schechtman E., Heilberg J., Paller K. A., Context matters: Changes in memory over a period of sleep are driven by encoding context. Learn. Mem. 30, 36–42 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Stickgold R., How do I remember? Let me count the ways. Sleep Med. Rev. 13, 305–308 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Ritvo V. J. H., Turk-Browne N. B., Norman K. A., Nonmonotonic plasticity: How memory retrieval drives learning. Trends Cogn. Sci. 23, 726–742 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Redondo R. L., Morris R. G. M., Making memories last: The synaptic tagging and capture hypothesis. Nat. Rev. Neurosci. 12, 17–30 (2010). [DOI] [PubMed] [Google Scholar]
- 38.Frey U., Morris R. G. M., Synaptic tagging and long-term potentiation. Nature 385, 533–536 (1997). [DOI] [PubMed] [Google Scholar]
- 39.Dunsmoor J. E., Murty V. P., Clewett D., Phelps E. A., Davachi L., Tag and capture: How salient experiences target and rescue nearby events in memory. Trends Cogn. Sci. 26, 782–795 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Lewis P. A., Bendor D., How targeted memory reactivation promotes the selective strengthening of memories in sleep. Curr. Biol. 29, R906–R912 (2019). [DOI] [PubMed] [Google Scholar]
- 41.Ellenbogen J. M., Hu P. T., Payne J. D., Titone D., Walker M. P., Human relational memory requires time and sleep. Proc. Natl. Acad. Sci. U.S.A. 104, 7723–7728 (2007). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Tompary A., Davachi L., Consolidation promotes the emergence of representational overlap in the hippocampus and medial prefrontal cortex. Neuron 96, 228–241 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Nicosia J., Balota D. A., Targeted memory reactivation and consolidation-like processes during mind-wandering in younger and older adults. J. Exp. Psychol. Learn. Mem. Cogn., 10.1037/xlm0001187 (2022). [DOI] [PubMed] [Google Scholar]
- 44.Churchill L., Conscious and unconscious semantic activation in episodic memory retrieval (Washington University Undergraduate Research Digest, 2017), vol. 2, pp. 12–20. [Google Scholar]
- 45.Kouider S., Dehaene S., Levels of processing during non-conscious perception: A critical review of visual masking. Philos. Trans. R. Soc. B Biol. Sci. 362, 857–875 (2007). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Greenwald A. G., Draine S. C., Abrams R. L., Three cognitive markers of unconscious semantic activation. Science 273, 1699–1702 (1996). [DOI] [PubMed] [Google Scholar]
- 47.Reber T. P., Henke K., Integrating unseen events over time. Conscious Cogn. 21, 953–960 (2012). [DOI] [PubMed] [Google Scholar]
- 48.Breitmeyer B. G., Psychophysical “blinding” methods reveal a functional hierarchy of unconscious visual processing. Conscious Cogn. 35, 234–250 (2015). [DOI] [PubMed] [Google Scholar]
- 49.Brainard D. H., The Psychophysics Toolbox. Spat. Vis, 10, 433–436 (1997). [PubMed] [Google Scholar]
- 50.Tal A., Schechtman E., Caughran B., Paller K. A., Davachi L., The reach of reactivation: The effects of conscious vs. unconscious reactivation of associative memory. Open Science Framework. https://osf.io/fdr8a/. Deposited 3 December 2022.
- 51.Biderman D., Shir Y., Mudrik L., B or 13? Unconscious top-down contextual effects at the categorical but not the lexical level. Psychol. Sci. 31, 663–677 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Benjamini Y., Hochberg Y., Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. 57, 289–300 (1995). [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Anonymized behavioral responses in CSV format data have been deposited in OSF (50).




