Skip to main content
Royal Society Open Science logoLink to Royal Society Open Science
. 2023 Jun 14;10(6):201791. doi: 10.1098/rsos.201791

The evasive truth: do mere exposures at the subliminal and supraliminal levels drive the illusory truth effect?

Kyoshiro Sasaki 1,, Maiko Kobayashi 2,3,, Koyo Nakamura 2,3,4,, Katsumi Watanabe 2,5
PMCID: PMC10265004  PMID: 37325601

Abstract

The subjective truth of a statement is boosted by mere exposure to itself or a part of itself. This phenomenon is referred to as the illusory truth effect. We examined whether subliminal pre-exposure to the statement topic would increase its subjective truth. In the exposure phase, participants observed the topic, which was presented supraliminally or subliminally. After the exposure phase, they rated the subjective truth of the statement. If unconscious processing contributed to the illusory truth effect, subliminal exposure to the topic would increase the subjective truth of the statement. On the other hand, if the illusory truth effect required conscious and controlled processing, increases in the subjective truth of a statement would be induced only by supraliminal exposure to the topic. The results showed that the illusory truth effect was not found in either supraliminal or subliminal groups. Our findings provide no reliable evidence that pre-exposure to the statement topic saliently promotes its subjective truth.

Keywords: illusory truth effect, awareness, subliminal mere exposure, masking

1. Introduction

‘The first author's hobby is photography’. Is this statement true? Presumably, most readers will be unsure of its veracity (though the statement is, in fact, true). How can we increase the subjective truth of such a statement? One way might be to present a statement repeatedly, and several anecdotal tips on effective presentation and speaking suggest that important ideas should be repeated to make audiences believe them. In fact, the effectiveness of repeating a statement has been demonstrated in the field of psychology and has been named the illusory truth effect (e.g. [14]). These previous studies have demonstrated that statements to which listeners have been exposed are often evaluated to be more truthful.

The illusory truth effect occurs in various contexts. Several studies have found that the mere repeated presentation of a trivial statement increases its subjective truth status (e.g. [2,5,6]). The illusory truth effect also occurs when forming social opinions [5] and in product-related claims (e.g. [710]). A meta-analysis of studies in various contexts confirmed that the repetition of statements increases their subjective truth [11]. Thus, the illusory truth effect is robust and has important outcomes in wide-ranging social situations.

One might wonder if the illusory truth effect occurs only when identical statements are repeated. In this regard, Begg et al. [12] found that the subjective truth of a statement (e.g. ‘The temperature of a hen's body is about 104 degrees Fahrenheit’) increased even after pre-exposure to only a part of the statement (e.g. ‘A hen's body temperature’). Similarly, Arkes et al. [1] found that participants who were previously exposed to arbitrary China-related topics were more likely to judge subsequent China-related statements to be true. In one study, the subjective truth of target claims was found to be boosted by the repetition of associated claims that shared only some words with the target claims [13]. Furthermore, a recent study showed that pre-exposure to statements increased the subjective truth of paraphrases of the same statements [14]. This suggests that the illusory truth effect can be induced by mere exposure to keywords that are semantically related to target statements.

Previous studies have also discussed the underlying mechanism of the illusory truth effect. For example, it was found that repeatedly presented information is judged to be true owing to increased familiarity from mere exposure [3,5]. In particular, Begg et al. [3] showed that repetition increases the subjective truth of statements even when the source of the statements is of questionable credibility. The familiarity effect has been hypothesized to derive from processing fluency [15], which is the ease with which perceptual or cognitive information can be processed. In other words, higher processing fluency should correlate with an increase in the subjective truth of statements. For example, rhyming aphorisms, which are processed fluently, are judged to be highly true [16]. Previous studies have identified two possible sources of the illusory truth effect (e.g. [17]), namely the promotion of processing fluency based on repetition (i.e. automatic processing), and the promotion of validity owing to recollection (i.e. controlled processing). These two processes should be independent but interrelated; in general, repetitive exposure to certain stimuli allows for efficient and fluent perceptual processing of the stimuli, frequently leading to the misattribution of perceptual fluency to subjective familiarity [18,19]. In this way, repetition enhances the subjective truth of statements.

Processing fluency can be increased even without conscious exposure to objects and repeated unconscious exposure to objects often evokes positive affective reactions to them—a phenomenon known as the subliminal mere exposure effect (SME effect; e.g. [20,21]). The SME effect is assumed to occur because of familiarity resulting from higher processing fluency [18]; unconscious repeated exposure to objects facilitates cognitive processing of the objects, thereby establishing a preference for them. Given that the illusory truth effect and the SME effect share an underlying cognitive mechanism in terms of mere exposure [11], the familiarity stemming from higher processing fluency plays a key role in both effects. Previous studies on the SME effect have often used a masking paradigm (e.g. [22,23]). In the masking paradigm, a visual mask is used for suppressing the visibility of stimuli presented for an extremely short time (less than 50 ms: e.g. [24]). Preferences for masked stimuli were found to increase despite the participants being unaware of their exposure to these stimuli (e.g. [22,23]). Therefore, it is possible that even SME to parts of certain statements can trigger the illusory truth effect; however, to our best knowledge, there has been no direct evidence for this yet.

The present study examined whether subliminal pre-exposure to parts of statements (i.e. topics) would increase the statements' subjective truth by using the visual masking paradigm. Such an examination may help identify the stages of mental processing involved in the illusory truth effect. As discussed above, both automatic and controlled processing is likely to involve the illusory truth effect (e.g. [17]). If automatic processing was sufficient for the occurrence of the illusory truth effect, subliminal pre-exposure to the topic would induce the illusory truth effect. On the other hand, if conscious access to the topic at the pre-exposure phase (i.e. controlled processing) was necessary, then increases in the subjective truth of statements would be induced only by supraliminal exposure to the topic.

2. Method

2.1. Participants

We planned to perform a two-way mixed-design analysis of variance (ANOVA), with repetition (repeated versus new) as a within-participant factor and exposure groups (supraliminal versus subliminal) as a between-participant factor. The required sample sizes were calculated using PANGEA (Westfall, 2016 PANGEA: power analysis for general ANOVA designs. Unpublished manuscript: see http://jakewestfall.org/publications/pangea.pdf). Although we set a high-power level (i.e. 1 − β = 0.95), the actual power level is possibly low in designs including several different tests [25]. Generally, the two-way mixed-design ANOVA addresses the tests up to seven effects (i.e. two main effects, an interaction effect, and four simple main effects). Considering this, we decided to adopt a higher power level 0.951/7 = 0.993 to maintain the high-power level. We performed a preliminary test to detect the main effect of repetition (Cohen's d = 0.45, replications = 20, var [error] = 0.333, var [participant * repetition] = 0.167, 1 − β = 0.993), and the sample size was estimated to be 36 per group (e.g. 72 in total) 0.1

Moreover, we conducted a preliminary experiment to confirm whether recollection performance would be different between the exposure methods. In the preliminary experiment, we planned to perform a two-tailed t-test for two exposure groups. We calculated the required sample size with G*power ([26]; Cohen's d = 0.45, α = 0.05, 1 − β = 0.95, allocation ratio = 1). As a result, we considered the sample size n = 130 per group (i.e. 260 in total) to be valid in the preliminary experiment.

After the in-principle acceptance, we started data collection. Although we were supposed to collect the sample size as planned in the preliminary experiment, the participant count was exceeded by 1 in the main experiment because the experimenters miscounted the number of participants. As a result, the total sample size in the visible group was 37. We used the data for statistical analyses in the order of the earliest timestamp and also reported the results for all the participants in a footnote (for details see the Results section).

2.2. Apparatus

The stimuli were presented on a 23.5-inch LED monitor (FORIS FG2421, EIZO) with a refresh rate of 100 Hz and a screen resolution of 1920 × 1080 pixels. Stimuli presentation and data collection were controlled using MATLAB running on a MacMini. The stimuli were generated by MATLAB with the Psychtoolbox extension [27,28].

2.3. Stimuli

We selected 60 pairs of true/false statements from Unkelbach & Rom [6] as the stimuli (e.g. ‘The most toxic jellyfish in the world is Chironex fleckeri’ versus ‘The most toxic jellyfish in the world is Cotylorhiza tuberculata’). The statements were translated into Japanese by a translation agency (Editage: https://www.editage.jp/). Next, we recruited two persons who were unaware of our purpose and asked them to choose a topic from each pair of statements. First, we excluded the pairs of statements from which they picked different words as the topic. Second, we extracted only nouns or proper nouns as topics from the remaining selections. Finally, we excluded the pairs of statements whose topic words had more than 10 characters. Ultimately, 40 pairs of statements and their topics remain to be used as stimuli (please see the electronic supplementary material).

2.4. Procedure

The experiment consisted of two phases: exposure and test. In the exposure phase, the participants performed a visibility rating task (figure 1). Participants initiated each trial by pressing the space key, after which a black fixation circle with a 1 deg diameter appeared (i.e. blank screen) for 500 ms. In the supraliminal group, a visual mask (i.e. ‘XXXXXXXXXX’)2 appeared for 100 ms, after which the blank screen was presented again for 100 ms. Then, the stimulus (i.e. topic) appeared on the computer display for 30 ms.2 After the topic disappeared, the blank screen was presented again for 100 ms, followed by presentation of the mask for 100 ms. In the subliminal group, the stimulus presentation was identical to the supraliminal condition, except that the temporal order of the mask and blank screen after the initial blank screen was reversed. After stimulus presentation, participants were asked to rate the visibility of the topic on a four-point scale (1: no experience, 2: brief glimpse, 3: almost clear experience, 4: clear experience) derived from a previous study [29]. Prior to the experiment, we provided a detailed explanation of each point of the visibility rating (i.e. no experience = ‘no impression of the stimulus. All answers are considered to be mere guesses'; brief glimpse = ‘a feeling that something has been shown. Not characterized by any content, and this cannot be specified any further’; almost clear experience = ‘ambiguous experience of the stimulus. Some stimulus aspects are experienced more vividly than others. A feeling of almost being certain about one's answer’; clear experience = ‘non-ambiguous experience of the stimulus. No doubt in one's answer’). These explanations were taken verbatim from Ramsøy & Overgaard [29]. Before the exposure phase, we told the participants that some words, which had under 10 characters, were presented as stimuli. Twenty topics were randomly selected across the participants. Each topic was presented 10 times, and thus participants performed 200 trials in total. The trial order was randomized across the participants.

Figure 1.

Figure 1.

An example of the timeline of a single trial in the (a) supraliminal and (b) subliminal exposure phases.

After completing the exposure phase, participants performed the test phase. The participants initiated each trial by pressing the space key, after which a statement was presented. They were asked to rate the subjective truth of the statement on a seven-point scale (1 = certain it is false; 7 = certain it is true). We randomly selected one statement from each pair and 40 statements were presented in total; half the statements were true, and the other half were false. Each of the repetition conditions (repeated versus new) included 20 true and 20 false versions. The trial order was randomized across participants. Prior to the test phase, the participants were informed that half the statements are true and the other half false.

To confirm whether recognition of the topics was promoted only by the supraliminal pre-exposure, we also planned to run a preliminary experiment for a different group of participants. We conducted a recognition phase instead of the rating phase in the preliminary experiment. In the recognition phase, we presented all the topics one-by-one and asked the participants to judge whether each topic was presented in the exposure phase. The other procedure was identical to the main experiment.

2.5. Data analysis

We set the α-level to 0.05 and reported effect sizes (ηp2, Cohen's d and Cohen's dz) for all the analyses. We computed the average scores of the subjective truth for each condition in the main experiment. Then, we performed a two-way mixed-design ANOVA on the subjective truth, with the repetition (repeated versus new) as a within-participant factor and exposure groups (supraliminal versus subliminal) as a between-participant factor. If the interaction effect was statistically significant, we would perform subsequent simple main effect tests. If subliminal pre-exposure to parts of statements (i.e. topics) increased the subjective truth of the statements, the following two cases were expected. One was that the main effect of the repetition would be significant. However, when there was a difference in the effect size of the repetition, the interaction effect would be significant; in this case, the simple main effect of the repetition would be significant in both of the repetition conditions. On the other hand, if the occurrence of the subjective truth effect required conscious access to the topic at the pre-exposure phase, the significant interaction effect would be found and the simple main effect of the repetition would be significant only in the supraliminal condition. To ascertain that the masking procedure rendered the stimuli invisible in the subliminal group, we would perform a two-tailed t-test on the visibility scores between the supraliminal and subliminal groups; the scores would be significantly lower in the subliminal group than in the supraliminal group.

Moreover, we computed d′ based on the signal detection theory in the preliminary experiment3 and planned to perform a two-tailed t-test on d′ between the supraliminal and subliminal groups. If recollection was promoted only by the supraliminal pre-exposure, d′ would be higher in the supraliminal group than in the subliminal group.

3. Results

All the data are available at the Open Science Framework (OSF) page (https://osf.io/wvru5/).

3.1. Preliminary experiment

3.1.1. Visibility task

Figure 2a shows the results of the visibility score in the preliminary experiment. The t-test revealed that the score was significantly higher in the supraliminal group than in the subliminal group (t258 = 21.589, p < 0.001, Cohen's d = 2.678).

Figure 2.

Figure 2.

The results of the visibility task (a) and recognition task (b) in the preliminary experiment.

3.1.2. Recognition task

Figure 2b shows the results of d′ in the preliminary experiment. The t-test revealed that d′ was significantly higher in the supraliminal group than in the subliminal group (t258 = 9.789, p < 0.001, Cohen's d = 1.214).

3.2. Main experiment4

3.2.1. Visibility task

Figure 3a shows the results of the visibility score in the main experiment. The t-test revealed that the score was significantly higher in the supraliminal group than in the subliminal group (t70 = 12.608, p < 0.001, Cohen's d = 2.972).

Figure 3.

Figure 3.

The results of the visibility task (a) and truth rating task (b) in the main experiment.

3.2.2. Truth rating task

Figure 3b shows the truth rating scores in the main experiment. The ANOVA revealed that the main effects of repetition (F1, 70 = 0.062, p = 0.805, ηp2=0.001) and exposure groups (F1, 70 = 0.282, p = 0.597, ηp2=0.004) were not significant. The interaction effect was also not significant (F1, 70 = 2.075, p = 0.152, ηp2=0.029).

4. Discussion

We aimed to examine whether the subjective truth of a statement would increase by subliminal and supraliminal pre-exposure to a part of it. The main effect of repetition and the interaction effect were not significant. Our findings provide no reliable evidence that pre-exposure to a part of the statement has a salient impact on its subjective truth.

Previous studies have demonstrated that pre-exposure to a trivial statement boosts its subjective truth (e.g. [14]). This illusory truth effect was found in the case of pre-exposure to a part of the statement [12]. The supraliminal condition in the current study is a conceptual replication of this; we examined whether pre-exposure to the topic of a statement would increase the subjective truth of the statement. We found no significant difference in the truth scores between the new and repeated conditions in the supraliminal condition. Therefore, we failed to conceptually replicate the results of the previous study [12].

Furthermore, the subliminal group did not present the illusory truth effect. The illusory truth effect is not solely based on the controlled processing but also the automatic processing owing to processing fluency (e.g. [17]). As SME to objects is assumed to evoke processing fluency (e.g. [20,21]), subliminal pre-exposure to the topic of a statement would increase the subjective truth of the statement; however, our results did not support this. Moreover, the present study did not find the illusory truth effect in the supraliminal group; hence, we cannot conclude that the illusory truth effect requires conscious exposure.

The promotion of validity through recollection is assumed to play a key role in the illusory truth effect (e.g. [17,31]). One might argue that recollection is difficult in the set-up of the current study, which, in turn, attenuates the illusory truth effect. However, the d's were not low in the preliminary experiment (subliminal group: M = 1.643; supraliminal condition: M = 2.369) and the effect sizes compared with 1 were also large (subliminal group: Cohen's dz = 1.093; supraliminal condition: Cohen's dz = 2.251). Thus, recollection performances were unlikely to be low or involved in the failure to replicate the illusory truth effect. Moreover, considering that the d's were larger in the supraliminal than in the subliminal group, the effects of repetition on subjective truth were not significant in either the subliminal or supraliminal groups, and the illusory truth effect was independent of the degrees of recollection. Taken together, it is less likely that recollection was involved in the illusory truth effect, at least in the current study.

Why then were we not able to obtain reliable evidence of the illusory truth effect not salient in the current study? Perhaps, the presentation duration of the topics (i.e. 30 ms) was so short in the exposure phase that they were not invisible even in the supraliminal group. However, the visibility score was not low in the supraliminal group (preliminary experiment: M = 3.586; main experiment: M = 3.546), and therefore the topics were likely to be visible in the exposure phase. Moreover, although most studies adopted a small number of repetitions (cf. [32]), the current study repeated each topic 10 times during the exposure phase. Considering that a large number of repetitions makes the illusory truth effect more salient (e.g. [13,3335]), it is unlikely that pre-exposure to the topics was insufficient to produce the illusory truth effect.

Is the illusory truth effect truly robust in the first place? A meta-analysis of studies has shown that repetition affects subjective truth in various contexts [11]. It has also been reported that the illusory truth effect was insusceptible to individual differences in cognitive ability, need for cognitive closure and cognitive style [36]. These studies confirm the robustness of the illusory truth effect. However, a recent study raised concerns about a generalization of the illusory truth effect [37]. It pointed out that the location of research on the illusory truth effect is biased towards Western universities. Indeed, to the best of our knowledge, there are few studies on the illusory truth effect on Japanese people. Therefore, it is possible that the illusory truth effect is not salient among Japanese people. To shed light on the extent to which the illusory truth effect is generalizable, multi-laboratory replications of the illusory truth effect would be warranted.

Visibility scores in the subliminal group were somewhat variable and overlapped with those in the supraliminal group, suggesting our stimulus presentation method may not have been ideal for examining subliminal or non-conscious processing. While this did not bias our current findings—as our findings provide no reliable evidence that pre-exposure to a part of the statement has a noticeable impact on its perceived truth—it does highlight a potential issue. Had we found a significant effect in both subliminal and supraliminal groups, we would not have been able to assert that the illusory truth effect is triggered by subliminal pre-exposure. These potential issues would be avoided only by thoroughly refining the protocol at the review process of the 1st Stage in the Registered Reports system. That is, before the protocol was accepted, we could have conducted preliminary experiments to better mask stimuli or defined a clear visibility score threshold for invisibility, devising an outcome-neutral test that only includes data meeting this criterion for the main hypothesis test. Future studies will address these issues.

Supplementary Material

Acknowledgements

We hired experimenters who were unaware of our purpose for collecting the data. We would like to thank them. We are deeply grateful to Dr Chris Chambers. The protocol was initially accepted in principle by another journal. However, begrudging withdrawal of the protocol owing to difficulty in meeting the deadline occurred owing to the COVID-19 pandemic (for details, see [38]). At this time, Dr Chambers was instrumental in transferring the in-principle acceptance of our protocol to the Royal Society Open Science.

Footnotes

1

One might argue that a preliminary test should be performed to detect the interaction effect. Indeed, we are interested in both the interaction and main effects of repetition. We did perform a preliminary test to detect the interaction effect (Cohen's d = 0.45, replications = 20, var [error] = 0.5, var [participant * repetition] = 0.167, 1 − β = .993), resulting in a required sample size of 36 per group (i.e. 72 in total). Thus, the number of the required sample size was identical to those in the case of detecting the main effect of repetition.

2

In the accepted protocol, we planned to present the stimuli for 50 ms and the string of ‘XXXX’ as the visual mask. Although we prepared the programme in line with this, according to our observations, the visibility of the stimuli was too high even in the subliminal condition. Thus, we decided to shorten the presentation duration of the target (i.e. 30 ms) and enlarge the length of the visual mask to completely cover the target with the maximum number of characters in our stimulus set (i.e. 10 characters, ‘XXXXX XXXXX’). Accordingly, we also modified figure 1. We reported these minor deviations to the action editor of the previous journal and obtained their approval.

3

When a hit rate and false alarm rate are 0 or 1.0, d′ cannot be calculated. To avoid this, when their rates are under 0.1 and over 0.9, we adjusted them to 0.1 and 0.9, respectively [30]. We missed explaining these in the accepted protocol but determined this method of calculation before checking the collected data.

4

Here, we report the results for all participants. For the visibility task, the t-test revealed that the score was significantly higher in the supraliminal group than in the subliminal group (t71 = 12.812, p < 001, Cohen's d = 2.999). For the truth-rating task, the ANOVA revealed that the main effects of repetition (F1, 71 = 0.047, p = 0.829, ηp2=0.001) and grouping (F1, 71 = 0.242, p = 0.624, ηp2=0.003) were not significant. Moreover, the interaction effect was not significant (F1, 71 = 2.029, p = 0.159, ηp2=0.028). The trends in these results are similar to those reported in the main text.

Ethics

The ethics committee of Waseda University (2015-033) and Kansai University (2020-001) approved the protocol for the present study. All procedures were conducted according to the guidelines contained in the Helsinki Declaration. Written informed consent was obtained from all participants in advance.

Data accessibility

Our data, digital materials/code and the approved Stage 1 protocol are available at the OSF page (data and digital materials/code: https://osf.io/wvru5/; protocol: https://osf.io/9wfh8). Data are also provided in the electronic supplementary material [39].

Authors' contributions

K.S.: conceptualization, data curation, formal analysis, funding acquisition, investigation, methodology, project administration, resources, software, visualization, writing—-original draft, writing—review and editing; M.K.: data curation, formal analysis, funding acquisition, investigation, methodology, resources, software, visualization, writing—review and editing; K.N.: conceptualization, data curation, formal analysis, funding acquisition, methodology, resources, software, visualization, writing—review and editing; K.W.: funding acquisition, resources, supervision, writing—review and editing.

All authors gave final approval for publication and agreed to be held accountable for the work performed therein.

Conflict of interest declaration

We declare we have no competing interests.

Funding

This research is supported by JSPS KAKENHI (grant nos. JP17J05236, JP19K14482, JP22K13881, JP23H03702 to K.S., JP19K20591 and JP21J01731 to M.K., JP17J04125 to K.N., JP17H06344 and JP22H00090 to K.W., and JP21K18534 and JP23H01046 to K.S. and M.K.), and JST-Moonshot R&D grant (JPMJMS2012) to K.W.

References

  • 1.Arkes HR, Boehm LE, Xu G. 1991. Determinants of judged validity. J. Exp. Soc. Psychol. 27, 576-605. ( 10.1016/0022-1031(91)90026-3) [DOI] [Google Scholar]
  • 2.Bacon FT. 1979. Credibility of repeated statements: memory for trivia. J. Exp. Psychol. 5, 241-252. ( 10.1037/0278-7393.5.3.241) [DOI] [Google Scholar]
  • 3.Begg I, Anas A, Farinacci S. 1992. Dissociation of processes in belief: source recollection, statement familiarity, and the illusion of truth. J. Exp. Psychol. 121, 446-458. ( 10.1037/0096-3445.121.4.446) [DOI] [Google Scholar]
  • 4.Hasher L, Goldstein D, Toppino T. 1977. Frequency and the conference of referential validity. J. Verb. Learn. Verb. Behav. 16, 107-112. ( 10.1016/S0022-5371(77)80012-1) [DOI] [Google Scholar]
  • 5.Arkes HR, Hackett C, Boehm L. 1989. The generality of the relation between familiarity and judged validity. J. Behav. Decision Making 2, 81-94. ( 10.1002/bdm.3960020203) [DOI] [Google Scholar]
  • 6.Unkelbach C, Rom SC. 2017. A referential theory of the repetition-induced truth effect. Cognition 160, 110-126. ( 10.1016/j.cognition.2016.12.016) [DOI] [PubMed] [Google Scholar]
  • 7.Hawkins SA, Hoch SJ. 1992. Low-involvement learning: memory without evaluation. J. Consumer Res. 19, 212-225. ( 10.1086/209297) [DOI] [Google Scholar]
  • 8.Law S, Hawkins SA, Craik FIM. 1998. Repetition-induced belief in the elderly: rehabilitating age-related memory deficits. J. Consumer Res. 25, 91-107. ( 10.1086/209529) [DOI] [Google Scholar]
  • 9.Roggeveen AL, Johar GV. 2002. Perceived source variability versus familiarity: testing competing explanations for the truth effect. J. Consumer Psychol. 12, 81-91. ( 10.1207/S15327663JCP1202_02) [DOI] [Google Scholar]
  • 10.Roggeveen AL, Johar GV. 2007. Changing false beliefs from repeated advertising: the role of claim-refutation alignment. J. Consumer Psychol. 17, 118-127. ( 10.1016/S1057-7408(07)70018-9) [DOI] [Google Scholar]
  • 11.Dechêne A, Stahl C, Hansen J, Wänke M. 2010. The truth about the truth: a meta- analytic review of the truth effect. Pers. Soc. Psychol. Rev. 14, 238-257. ( 10.1177/1088868309352251) [DOI] [PubMed] [Google Scholar]
  • 12.Begg I, Armour V, Kerr T. 1985. On believing what we remember. Can. J. Behav. Sci. 17, 199-214. ( 10.1037/h0080140) [DOI] [Google Scholar]
  • 13.Hawkins SA, Hoch SJ, Meyers-Levy J. 2001. Low-involvement learning: repetition and coherence in familiarity and belief. J. Consumer Psychol. 11, 1-11. ( 10.1207/S15327663JCP1101_1) [DOI] [Google Scholar]
  • 14.Silva RR, Garcia-Marques T, Reber R. 2017. The informative value of type of repetition: perceptual and conceptual fluency influences on judgments of truth. Conscious Cogn. 51, 53-67. ( 10.1016/j.concog.2017.02.016) [DOI] [PubMed] [Google Scholar]
  • 15.Reber R, Schwarz N. 1999. Effects of perceptual fluency on judgments of truth. Conscious Cogn. 8, 338-342. ( 10.1006/ccog.1999.0386) [DOI] [PubMed] [Google Scholar]
  • 16.McGlone MS, Tofighbakhsh J. 2000. Birds of a feather flock conjointly (?): rhyme as reason in aphorisms. Psychol. Sci. 11, 424-428. ( 10.1111/1467-9280.00282) [DOI] [PubMed] [Google Scholar]
  • 17.Unkelbach C, Stahl C.. 2009. A multinomial modeling approach to dissociate different components of the truth effect. Conscious. Cogn. 18, 22-38. ( 10.1016/j.concog.2008.09.006) [DOI] [PubMed] [Google Scholar]
  • 18.Bornstein RF, D'Agostino PR. 1992. Stimulus recognition and the mere exposure effect. J. Pers. Soc. Psychol. 63, 545-552. ( 10.1037/0022-3514.63.4.545) [DOI] [PubMed] [Google Scholar]
  • 19.Bornstein RF, D'Agostino PR. 1994. The attribution and discounting of perceptual fluency: preliminary tests of a perceptual fluency/attributional model of the mere exposure effect. Soc. Cogn. 12, 103-128. ( 10.1521/soco.1994.12.2.103) [DOI] [Google Scholar]
  • 20.Elliott R, Dolan RJ. 1998. Neural response during preference and memory judgments for subliminally presented stimuli: a functional neuroimaging study. J. Neurosci. 18, 4697-4704. ( 10.1523/JNEUROSCI.18-12-04697.1998) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Kunst-Wilson WR, Zajonc RB. 1980. Affective discrimination of stimuli that cannot be recognized. Science 207, 557-558. ( 10.1126/science.7352271) [DOI] [PubMed] [Google Scholar]
  • 22.Kawakami N, Yoshida F. 2015. How do implicit effects of subliminal mere exposure become explicit? Mediating effects of social interaction. Soc. Influence 10, 43-54. ( 10.1080/15534510.2014.901245) [DOI] [Google Scholar]
  • 23.Yoshimoto S, Imai H, Kashino M, Takeuchi T. 2014. Pupil response and the subliminal mere exposure effect. PLoS ONE 9, e90670. ( 10.1371/journal.pone.0090670) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Cox EJ, Sperandio I, Laycock R, Chouinard PA. 2018. Conscious awareness is required for the perceptual discrimination of threatening animal stimuli: a visual masking and continuous flash suppression study. Conscious Cogn. 65, 280-292. ( 10.1016/j.concog.2018.09.008) [DOI] [PubMed] [Google Scholar]
  • 25.Francis G, Thunell E. 2019. Excess success in ‘Ray of hope: Hopelessness Increases Preferences for Brighter Lighting’. Collabra: Psychology 5, 22. ( 10.1525/collabra.213) [DOI] [Google Scholar]
  • 26.Faul F, Erdfelder E, Lang AG, Buchner A. 2007. G* Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39, 175-191. ( 10.3758/BF03193146) [DOI] [PubMed] [Google Scholar]
  • 27.Brainard DH. 1997. The psychophysics toolbox. Spat. Vis. 10, 433-436. ( 10.1163/156856897X00357) [DOI] [PubMed] [Google Scholar]
  • 28.Pelli DG. 1997. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat. Vis. 10, 437-442. ( 10.1163/156856897X00366) [DOI] [PubMed] [Google Scholar]
  • 29.Ramsøy TZ, Overgaard M. 2004. Introspection and subliminal perception. Phenomenol. Cogn. Sci. 3, 1-23. ( 10.1023/B:PHEN.0000041900.30172.e8) [DOI] [Google Scholar]
  • 30.Nuechterlein KH. 1983. Signal detection in vigilance tasks and behavioral attributes among offspring of schizophrenic mothers and among hyperactive children. J. Abnorm. Psychol. 92, 4-28. ( 10.1037/0021-843X.92.1.4) [DOI] [PubMed] [Google Scholar]
  • 31.Unkelbach C, Koch A, Silva RR, Garcia-Marques T. 2019. Truth by repetition: explanations and implications. Curr. Dir. Psychol. Sci. 28, 247-253. ( 10.1177/0963721419827854) [DOI] [Google Scholar]
  • 32.Udry J, White SK, Barber SJ. 2022. The effects of repetition spacing on the illusory truth effect. Cognition 225, 105157. ( 10.1016/j.cognition.2022.105157) [DOI] [PubMed] [Google Scholar]
  • 33.DiFonzo N, Beckstead JW, Stupak N, Walders K. 2016. Validity judgments of rumors heard multiple times: the shape of the truth effect. Soc. Influence 11, 22-39. ( 10.1080/15534510.2015.1137224) [DOI] [Google Scholar]
  • 34.Fazio LK, Pillai RM, Patel D. 2022. The effects of repetition on belief in naturalistic settings. J. Exp. Psychol. 151, 2604-2613. ( 10.1037/xge0001211) [DOI] [PubMed] [Google Scholar]
  • 35.Hassan A, Barber SJ. 2021. The effects of repetition frequency on the illusory truth effect. Cogn. Res. 6, 38. ( 10.1186/s41235-021-00301-5) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.De Keersmaecker J, Dunning D, Pennycook G, Rand DG, Sanchez C, Unkelbach C, Roets A. 2020. Investigating the robustness of the illusory truth effect across individual differences in cognitive ability, need for cognitive closure, and cognitive style. Pers. Soc. Psychol. Bullet. 46, 204-215. ( 10.1177/0146167219853844) [DOI] [PubMed] [Google Scholar]
  • 37.Henderson EL, Westwood SJ, Simons DJ. 2022. A reproducible systematic map of research on the illusory truth effect. Psychon. Bull. Rev. 29, 1065-1088. ( 10.3758/s13423-021-01995-w) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Sasaki K, Yamada Y. 2020. Boosting immunity of the Registered Reports system in psychology to the pandemic. Front. Res. Metrics Analytics 5, 20. ( 10.3389/frma.2020.607257) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Sasaki K, Kobayashi M, Nakamura K, Watanabe K. 2023. The evasive truth: do mere exposures at the subliminal and supraliminal levels drive the illusory truth effect? Figshare. ( 10.6084/m9.figshare.c.6688735.v1) [DOI] [PMC free article] [PubMed]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Citations

  1. Sasaki K, Kobayashi M, Nakamura K, Watanabe K. 2023. The evasive truth: do mere exposures at the subliminal and supraliminal levels drive the illusory truth effect? Figshare. ( 10.6084/m9.figshare.c.6688735.v1) [DOI] [PMC free article] [PubMed]

Supplementary Materials

Data Availability Statement

Our data, digital materials/code and the approved Stage 1 protocol are available at the OSF page (data and digital materials/code: https://osf.io/wvru5/; protocol: https://osf.io/9wfh8). Data are also provided in the electronic supplementary material [39].


Articles from Royal Society Open Science are provided here courtesy of The Royal Society

RESOURCES