Abstract
Placebos are known to yield significant effects in many conditions. We examined deceptive and open-label placebo effects on guilt, which is important for self-regulation and a symptom of mental disorders. Following an experimental induction of guilt, healthy subjects were randomized to deceptive placebo (DP; n = 35), open-label placebo (OLP; n = 35), or no treatment (NT; n = 39). The primary outcome was guilt responses assessed in area under the curve (AUC). Secondary outcomes were shame, guilt, and affect. We hypothesized that DP and OLP would reduce guilt compared to NT. Guilt responses were higher in the NT group than in the placebo groups (estimate = 2.03, 95% CI = 0.24–3.82, d = 0.53), whereas AUC guilt did not differ significantly between the placebo groups (estimate = −0.38, 95% CI = −2.52–1.76, d = −0.09). Placebos are efficacious in reducing acute guilt responses, regardless of the placebo administration (i.e., open vs. deceptive). Furthermore, we observed narrative-specific effects with significant changes of guilt but not shame, pride, or affect. These results indicate not only that guilt is amenable to placebos but also that placebos can be administered in an ethical and potentially emotion-specific manner.
Subject terms: Psychology, Preclinical research
Introduction
Placebos have been found to have clinically significant effects on subjective and objective outcomes in a variety of conditions1,2. This especially holds true for acute and chronic pain, where the administration of a placebo has led to analgesia in healthy and clinical populations3–5, as well as for depressive disorders, for which placebo responses have been found to be so substantial that differences between a placebo and antidepressant medication are a subject of constant debate6,7.
Placebo effects have also been demonstrated in a number of nonclinical psychological domains, such as in reducing social pain8; facilitating social trust and approach behavior9; increasing happiness and reducing stress and depression10,11; increasing short- and midterm subjective well-being12; reducing unpleasantness, sadness and rumination13–16; diminishing disgust17; and increasing the subjective pleasantness of wine18. However, in contrast to the plethora of established experimental pain paradigms, such as the Cold Pressure Test e.g.19–21, experimentally induced heat pain22,23, or intracutaneous electrical stimulation24,25, comparable experimental paradigms are scarce in placebo research on psychological and behavioral outcomes. For example, experimentally inducing sadness by watching a sad movie15,26, reading self-deprecating statements27, listening to sad music28,29, or inducing anxiety by looking at fearful pictures30,31 are rare examples of experimental paradigms in nonpain placebo research. Given that comparable experimental paradigms would enable important insights into the inner workings of clinically relevant phenomena it is of vital importance for placebo research to extend the range of experimental nonpain paradigms.
One area in current placebo research where experimental paradigms would be of great importance is research into the ethical application of placebo interventions. This field of research has recently gained continuous attention and has provided initial evidence that placebos can also work when they are fully disclosed and administered transparently32. Such open-label placebos (OLPs) have been found to have significant effects, for example, in pain conditions (e.g.,33–35) and for test anxiety36, with mixed results for depression37,38. In a pilot study with a diagnosed sample of major depression37, the OLP group did not significantly differ compared to the no treatment control group, which can possibly be explained by the lack of power due to a small sample size of only 20 participants. The second study investigated OLPs as an add-on to treatment as usual in 38 depressed patients38. There, symptoms of depression only decreased significantly in a subgroup of non-geriatric patients with an early onset of depression compared to the treatment-as-usual control group alone. In the light of the well-documented placebo effects in antidepressant trials, these findings are surprising and raise the need for further investigations into OLP effects in depression. Experimental studies might in particular help shed light on the underlying OLP mechanisms.
Depression is unquestionably a multifaceted disease. Nevertheless, the experimental induction of single symptoms of depression in healthy and clinical populations may be a promising approach for better understanding the efficacy of OLPs in the symptom picture of depression15,16,29,39. In this context, self-conscious emotions like guilt and shame are of interest40. Although they may at first sight seem very similar, the emotion shame focuses on the perceived shortcomings of the self, while guilt focuses on the negative consequences of specific actions41. In their adaptive form, these emotions are conceptualized as important moral emotions42. As such, guilt in particular can function as a relationship enhancer43,44 and can motivate reparative actions like apologies and confessions45. However, in their maladaptive forms, guilt and shame have also been linked to perfectionism46, which has long been conceptualized as a pathology-causing personality trait47. Feeling guilty in everyday life has been associated with heightened aversive arousal states, social distress (e.g., rejection, and loneliness), fewer pleasant and relaxed states48, and, in the absence of opportunities for compensation, with self-punishment49. In addition, guilt can be found at the core of many psychological disorders, such as major depressive disorder50,51 and of posttraumatic stress disorder52,53. Given the relevance and high prevalence of guilt in the general54 and psychiatric population, examining the possible effects of placebos on guilt is of interest.
In the present study, we set out to test the efficacy of placebos in reducing experimentally induced feelings of guilt in a randomized controlled trial with healthy subjects. To pursue this research question, we employed an autobiographic writing task to evoke acute feelings of guilt55,56. To test the potential of an ethically feasible placebo intervention for guilt, we used both a deceptive placebo (DP) and an OLP. Interestingly, direct comparisons of OLPs with DPs have led to inconclusive evidence. Whereas some studies have reported comparable symptom reduction with both OLPs and DPs21,22,57–59, other studies have found OLPs to be inferior to DPs15,16. Despite conflicting evidence, we expected no difference between the efficacies of the DP and that of the OLP in reducing the experience of experimentally induced guilt. Finally, we hypothesized that both the DP and the OLP would lead, when provided with plausible and symptom-specific treatment explanations, to a symptom-specific reduction of the emotional response to experimentally induced guilt as compared to no treatment (NT).
Materials and methods
Study design
Between August 2019 and March 2020, we conducted a randomized controlled parallel-group trial at the Division of Clinical Psychology and Psychotherapy (Faculty of Psychology, University of Basel, Switzerland). Written delayed informed consent was obtained from each subject before participation in the study. The Ethics Committee of the Faculty of Psychology at the University of Basel, Switzerland, approved the design and the informed consent of the study. The study was carried out in accordance with the protocol and principles enunciated in the current version of the Declaration of Helsinki. It was registered retrospectively as a clinical trial on the German Clinical Trials Register (DRKS00029098; 25/05/2022) and follows the reporting guidelines of the Consolidated Standards of Reporting Trials (CONSORT).
Study population
In total, 112 subjects were recruited through the online recruitment system of the Faculty of Psychology (BAPS-Sona, http://baps.sona-systems.com) and through advertisements in lectures at the University of Basel. On the flow of subjects through the study and assessments, see Fig. 1. Interested subjects registered online for the study. Subjects received study credits for their participation. To participate, they had to be healthy by self-report, aged between 18 and 40 years, and be sufficiently proficient in German. Exclusion criteria were self-reported acute or chronic somatic diseases or psychiatric disorders, being in psychological or psychiatric treatment, and taking psychotropic drugs.
Figure 1.
Study design and flow of subjects. Note: DP, deceptive placebo; OLP, open-label placebo; NT, no treatment; PFQ-2, Personal Feelings Questionnaire-2; SSGS, State Shame and Guilt Scale; PANAS, Positive and Negative Affect Schedule; CMQ, Context Model Questionnaire.
Study procedure, guilt induction, and guilt boost
Upon arrival, subjects received a description of the study and were informed that they would not receive all information on the nature of the treatment before the start of the study due to the studies research design, but that this missing information would be fully disclosed after the termination of the study. After providing delayed informed consent, inclusion and exclusion criteria were checked, subjects’ demographics were registered, and baseline measures of guilt proneness, state guilt, shame, pride, and emotional valence (for a description of all assessments, see section “Measures and questionnaires”; T0) were assessed. Meanwhile, investigators opened a sequentially numbered sealed envelope to determine the treatment assignment of the subject and kept the group allocation to themselves. Then the subjects in all the groups were invited to write on paper about an experience in which the subject had behaved unfairly toward an intimate person, infringed important rules of conduct, or hurt or even harmed a trusted person through their behavior. We specified that subjects should choose a situation that still emotionally burdened them (for a detailed description of the guilt-induction instructions, see the supplementary material). Similar autobiographic approaches have previously been shown to be efficacious in eliciting guilt in healthy subjects55,56,60–62. The guilt induction had a duration of 10 min, and subjects kept their writing to themselves. Afterward, state guilt, shame, pride, and emotional valence were assessed again (T1). Subjects then received either a DP or an OLP (for descriptions, see below), whereas the NT subjects were invited to read travel magazines such as Geo Roadtrips and Terra Mater.
After the DP, the OLP, or NT, all subjects of each group were instructed to answer a question regarding their expected guilt reduction in response to the DP, the OLP or NT before reading a neutral travel magazine for 5 min. Subsequently, state guilt, shame, pride, and emotional valence were assessed again (T2). However, we did not expect to observe any treatment effects immediately after treatment because inductions of negative affects in healthy subjects are known to be of short duration63. To observe possible treatment effects, we therefore implemented a guilt boost: subjects were instructed to think back to the event they had written down during the guilt induction for 1 min with closed eyes (see the supplementary material for details on the guilt boost). Following the guilt boost, state guilt, shame, pride, and emotional valence were quantified again (T3). The final assessment of state guilt, shame, pride, and emotional valence followed after an interval of about 7 min (T4). Finally, in order to terminate the study with a positive feeling, all subjects were asked to write down three things they were thankful for.
Upon termination of the study in March 2020, all study subjects were debriefed about the aims of the experiment and the deception in the DP group and were provided with the opportunity to withdraw their data.
Treatments
Subjects in the DP group received a blue medium-sized placebo pill (P-dragee, blau, Lichtenstein manufactured by Zentiva Pharma GmbH). A study team member told them that the pill contained a phytopharmacon that supposedly reduces the feeling of guilt through its calming and comforting properties and that this effect would occur within 3–5 min (see the supplementary material for a translation of the German script). Subjects in the OLP group received the same pill but were provided with the rationale used by Kaptchuk et al.33: they were told that placebos are efficacious, that they work through expectation and previous conditioning, and that an open attitude toward the treatment could be helpful but was not necessary for its effect. The instructions were identical in terms of structure and format in both placebo groups, but they differed in content. Furthermore, in order to foster the expectation of relief, both the deceptive and open-label rationales included information on the expected efficacy of the given treatment (see supplementary material for the scripted instructions).
Randomization and blinding
The random allocation sequence was created by an independent research assistant prior to the study start using www.randomizer.org. To implement the random allocation sequence (allocation ratio: 1/3:1/3:1/3), investigators opened a sealed envelope containing the group allocation of a subject after the baseline assessment (T0). Due to the nature of the interventions, only subjects in the DP condition were blind to their treatment allocation.
Measures and questionnaires
To measure the primary and secondary outcomes the State Shame and Guilt Scale (SSGS64) and the German version of the Positive and Negative Affect Schedule (PANAS65) were applied. The SSGS consists of three subscales measuring state shame, guilt, and pride with five items each that are rated on a 5-point Likert scale. For the purpose of this study, we translated the SSGS from English into German. The PANAS consists of two subscales measuring positive and negative affect with 10 items each that are rated on a 5-point Likert scale. The SSGS subscale “guilt” served as the primary outcome of this study, whereas SSGS “shame” and “pride” and the PANAS “positive” and “negative” subscales served as secondary outcomes. All the subscales of the SSGS and the PANAS were applied in all assessments (i.e., T0–T4).
Throughout the experiment additional variables and potential predictors of primary and secondary outcomes were assessed. At the baseline assessment (T0), demographic variables (e.g., age, sex) and a measurement of guilt proneness (German version of the Personal Feelings Questionnaire, PFQ-266,67) were applied. Finally, the expectation of relief was measured once in all groups at T2 right after administration of the placebo, by asking subjects the following question: “On a scale of 1–10, how much do you expect your guilt to be reduced? (1 = not at all, 10 = completely)”. Higher numbers indicated a greater expectation. See Fig. 1 for an overview of all the assessments and their respective time points.
Statistical analyses
All analyses were carried out using RStudio for Mac. To examine the validity of the experimental guilt induction and the guilt boost, two-way mixed analyses of variance (ANOVAs) were computed for the time points T0–T2 (guilt induction) and T2–T4 (guilt boost). However, whenever the assumptions for a two-way mixed ANOVA were not met, a robust two-way mixed ANOVA with 20% trimmed means using WRS2 package68 was calculated with the independent between-subject factor “group” and the within-subject factor “time.” Separate analyses were carried out for each subscale of the SSGS and the PANAS.
To detect differences between the groups, area-under-the-curve (AUC) parameters were calculated for the SSGS and PANAS subscales between T0 and T2 (guilt induction validation check) and between T2 and T4 (treatment effects); the AUC of the SSGS guilt subscale from T2–T4 was defined as the primary outcome. Using the AUC to assess group differences across different time points offers the unique possibility of simplifying the statistical analysis without the losing of the information contained in multiple measurements while also increasing the power69. Following the trapezoid formula, the AUC was calculated with respect to increase (AUCi), which refers to changes over time69. AUCi values were calculated for the different time intervals between measurements (see Fig. 1) and were compared between conditions with a one-factor between-subject ANOVA. If the normality assumption for the ANOVA was not met, a Kruskal–Wallis test was used. If there were significant extreme outliers, as assessed by above quartile 3 + 3 times the interquartile range or below quartile 1 − 3 times the interquartile range, a robust ANOVA using the WRS2 package was applied. To test our hypotheses, the following two a priori contrasts were calculated: DP & OLP vs. NT (C1); DP vs. OLP (C2). Contrasts are reported as mean differences (estimates) and confidence intervals (CI). Despite nonnormal AUCi scores in each of the two subscales of the PANAS, all a priori contrast analyses were performed on the untrimmed data.
To investigate the influence of different variables (e.g., guilt and shame proneness, and expectation of relief), Pearson correlations with AUCi sizes for each outcome were calculated. Differences across groups regarding the scores of predictors were assessed using a one-factor between-subject ANOVA or, if appropriate, a Kruskal–Wallis test. For pairwise comparisons of secondary outcomes (e.g., expectation of relief), a pairwise Wilcoxon test with a BH adjustment70 was used.
An alpha level of 0.05 was used for all tests. There was no missing data. Unless indicated, all results shown are means + /− standard deviations (SD). Using the statistical software G*Power, we conducted a conservative power calculation on the basis of an F test for a multivariate analysis of variance (MANOVA) with a within-and-between-factor interaction for three groups. This analysis showed that we would need a sample size of N = 110 for a power of 0.9 to detect a medium to large effect size of f = 0.3 (based on observed effect sizes in previous clinical32 and experimental OLP studies22) with a one-sided alpha level of 0.05.
Results
Sample characteristics and general overview of data
In total, 112 subjects signed up for the study. Three subjects had to be excluded because they did not meet the inclusion criteria (see Fig. 1). Thus, 109 subjects were included in the analysis. Baseline characteristics did not differ significantly across the groups (see Table 1). Figure 2 displays the temporal course of the SSGS subscales. A complete overview of mean values per group for each outcome at each assessment time point can be found in Table S1 in the online supplementary material.
Table 1.
Baseline between-group comparisons on demographic and outcome measures.
DP | OLP | NT | F/X2 | |
---|---|---|---|---|
n (% female) | 35 (80.00%) | 35 (74.29%) | 39 (64.10%) | X2(2, 109) = 0.29, p = .864 |
Age in years, mean (SD) | 22.89 (3.62) | 24.03 (5.56) | 21.67 (3.13) | F(2, 106) = 2.93, p = .058 |
SSGS | ||||
Guilt, mean (SD) | 2.05 (0.80) | 2.06 (1.00) | 1.92 (0.70) | F(2, 106) = 0.32, p = .729 |
Shame, mean (SD) | 1.53 (0.55) | 1.67 (0.79) | 1.34 (0.44) | F(2, 106) = 2.67, p = .074 |
Pride, mean (SD) | 3.45 (0.45) | 3.47 (0.55) | 3.62 (0.58) | F(2, 106) = 1.05, p = .353 |
PANAS | ||||
Positive, mean (SD) | 3.05 (0.58) | 3.27 (0.60) | 3.25 (0.61) | F(2, 106) = 1.51, p = .226 |
Negative, mean (SD) | 1.30 (0.36) | 1.44 (0.42) | 1.52 (0.42) | F(2, 106) = 2.64, p = .076 |
PFQ-2 | ||||
Guilt, mean (SD) | 21.71 (3.16) | 21.14 (4.03) | 21.28 (3.02) | F(2, 106) = 0.27, p = .766 |
Shame, mean (SD) | 32.66 (3.32) | 33.31 (2.97) | 32.18 (3.49) | F(2, 106) = 1.11, p = .334 |
SD, standard deviation; DP, deceptive placebo; OLP, open-label placebo; NT, no treatment; SSGS, State Shame and Guilt Scale; PANAS, Positive and Negative Affect Schedule; PFQ-2, Personal Feelings Questionnaire 2.
Figure 2.
Temporal course of the SSGS guilt (a), shame (b) and pride (c) scale scores across experimental groups. Note: Displayed are means per group: error bars represent the standard error of the mean. DP, deceptive placebo; OLP, open-label placebo; NT, no treatment; SSGS, State Shame and Guilt Scale; AUC, area under the curve.
Validation check of guilt induction and guilt boost in primary and secondary outcomes
To examine the validity of the experimental guilt induction, two-way mixed ANOVAs were calculated for the subjective ratings of guilt, shame, pride, and positive affect, and negative affect from T0 to T2. The assumptions for a standard two-way mixed ANOVA were only met for the analyses of pride and positive affect. For all outcomes, there was a highly significant effect of time from T0 to T2 (all ps < 0.001; see Table S2), which indicates that the guilt induction led to significant responses in all the assessed affective states, with most pronounced changes from T0 to T1 in guilt (see Table S2).
Regarding the guilt boost, two-way mixed ANOVAs were calculated for subjective ratings of guilt, shame, pride, and positive affect, and negative affect from T2 to T4. The assumptions for standard two-way mixed ANOVA were not met for all analyses. For all outcomes, there was a highly significant effect of time from T2 to T4 (all ps < 0.001; see Table S3), which indicates that the guilt boost successfully changed all the assessed affective states, with most pronounced changes from T2 to T3 in guilt and pride (see Table S3).
To assess possible group differences in their responses to the guilt induction (T0–T1), AUCi sizes were compared for the time points of T0 and T2 across groups using a one-factor ANOVA for guilt and a Kruskal–Wallis test for all the other outcomes. As expected, the mean size of the AUCi between T0 and T2 did not differ significantly across the groups (all ps > 0.121; see Tables S4 and S5), which indicates that the groups had comparable responses to the initial guilt induction.
Group differences in primary and secondary outcomes
For possible differences in emotional responses following the guilt boost between subjects receiving a DP, an OLP, or NT, the AUCi from T2 to T4 was compared across groups with a one-factor ANOVA. These analyses showed significantly different AUCi sizes for guilt (F(2, 106) = 3.38, p = 0.038) but not for shame, pride, positive affect, or negative affect (all ps > 0.191; see Table S4). A priori orthogonal contrasts of guilt showed significantly smaller AUCi guilt scores for the two treatment groups taken together in comparison to the NT scores (DP & OLP vs. NT: estimate = 2.03, 95% CI = 0.24–3.82, d = 0.53), which indicates a smaller increase in guilt following the guilt boost. No significant difference in AUCi sizes between the two treatment groups was found (DP vs. OLP: estimate = −0.38, 95% CI = −2.52–1.76, d = −0.09). Table 2 shows mean AUCi values from T2 to T4 for each group and subscale and the differences in the means of each calculated contrast.
Table 2.
Area-under-the-curve SSGS and PANAS scores and between-group contrasts for T2–T4.
DP (n = 35) | OLP (n = 35) | NT (n = 39) | DP & OLP vs. NT | DP vs. OLP | |
---|---|---|---|---|---|
SSGS | Mean (SD) | Mean difference (CI) | |||
Guilt | 1.02 (3.16) | 0.64 (4.04) | 2.85 (4.48) | 2.03 (0.24–3.82)*, d = 0.53 | − 0.38 (− 2.52–1.76), d = − 0.09 |
Shame | 0.69 (3.06) | 0.68 (3.52) | 1.10 (3.23) | 0.41 (− 1.08–1.89), d = 0.13 | − 0.01 (− 1.79–1.76), d = 0.0 |
Pride | − 1.35 (2.65) | − 1.85 (3.31) | − 2.67 (3.37) | − 1.07 (− 2.49–0.35), d = − 0.35 | − 0.50 (− 2.20–1.20), d = − 0.16 |
PANAS | |||||
Positive | − 0.83 (3.00) | − 1.26 (3.02) | − 1.59 (3.22) | − 0.54 (− 1.94–0.86), d = -0.18 | 0.42 (− 1.25–2.09), d = 0.14 |
Negative | 0.70 (2.02) | 0.22 (2.35) | 0.75 (2.62) | 0.29 (− 0.78–1.36), d = 0.12 | 0.49 (− 0.79–1.76), d = 0.21 |
SD, standard deviation; DP, deceptive placebo; OLP, open-label placebo; NT, no treatment; SSGS, State Shame and Guilt Scale; AUCi, area under the curve with respect to increase; CI, confidence interval, *p < 0.05.
Associations of additional variables of interest with outcomes
The mean expectation of relief, guilt proneness, and shame proneness, including their correlation with the AUCi values of the SSGS and PANAS subscales from T2 to T4 are shown in Table S6 for all groups.
Omnibus tests showed that the groups differed in their expectation of guilt relief following the treatments (Kruskal–Wallis test p = 0.021): the OLP group (M = 4.49, SD = 2.11) displayed significantly higher expectations of guilt relief than the DP group (M = 3.23, SD = 1.72; post hoc Wilcoxon test p adj. = 0.031). The expectation of guilt relief in the NT group (M = 4.23, SD = 2.10) did not significantly differ from that in the OLP group (Wilcoxon test, p adj. = 0.544) but differed significantly from that in the DP group (Wilcoxon test, p adj. = 0.045). However, despite significant group differences in the expectation of relief, there was no significant correlation with any primary or secondary outcomes (see Table S6). The groups did not differ with regard to guilt and shame proneness (guilt: Kruskal–Wallis test, p = 0.671; shame: Kruskal–Wallis test, p = 0.241).
Discussion
Given the high prevalence of guilt as a self-conscious emotion that is associated with a variety of unpleasant psychological states in everyday life, its relevance in depression and other psychological disorders, and the substantial magnitude of placebo effects in pharmacological and psychotherapeutic treatments of depressive disorders, we set out to assess the effects of deceptive and open-label placebos on experimentally induced guilt responses in healthy subjects in comparison to a no-treatment condition.
First, our experimental guilt induction and a subsequent guilt boost elicited robust emotional responses of guilt as well as—although to a lower degree—of shame, pride, and positive affect, and negative affect. Second, and importantly, the administration of the placebo—either deceptive or open—significantly reduced the guilt responses to the guilt boost in comparison to no treatment with a medium effect size of d = 0.53. Interestingly, this effect was not observed for any other outcome, which suggests the possibility that the symptom-specific placebo rationales led to symptom-specific placebo effects.
In the following, the observed effects will be discussed from an empirical, and a methodological perspective. Empirically, our findings show that deceptive and open placebos were equally efficacious in reducing the self-conscious emotion of guilt. These findings are in line with a growing number of reports that have found OLPs to have significant effects on emotions, including anxiety36,71, depression37,38, sadness16,28, general emotional well-being72,73, and emotional distress74. Furthermore, our results are also in line with studies reporting that DPs and OLPs have equal effects in healthy subjects21,22,57, which highlights the potential of OLPs as a means of ethically harnessing placebo effects in these conditions. But there is also contradicting evidence: for example, studies have found that DPs lead to greater heat-pain tolerance than OLPs did in healthy subjects59 or that the placebo effect disappears when it is openly administered to treat motion-induced nausea75. With regard to nonanalgesic paradigms, only one placebo study has compared OLPs to DPs for experimentally induced sadness in depressed subjects16, and it found greater placebo effects from DPs. However, while the DPs decreased sadness from before to after the induction of sadness, OLPs were also efficacious at preventing an increase in sadness while there was an increase in the NT group. In summary, the evidence on the comparative efficacy of DPs and OLPs is promising even if it is, to some extent, mixed and seems to depend on the target condition. Further studies are needed to fully understand the similarities and differences of the efficacy and mechanisms of DPs and OLPs across different fields of application and populations. Despite the inconclusive evidence, even if OLPs are found to be less efficacious than DPs in some cases, the effects of OLPs are, in contrast to those of DPs, ethically acceptable and thus suitable to use in practice76. Regarding the underlying mechanisms of deceptive and open-label placebos, there is some evidence that optimism is not of the same importance in OLPs as it is in DPs12, which suggests that the mechanisms operating in DPs and OLPs are not entirely the same. This finding is complemented by the results of the present study, which found no association between the expectation of guilt relief—a well-studied mechanism of deceptive placebos77—and the response to the guilt induction. However, since the pattern of the expectation of relief across the groups, differed from what we expected78 (i.e., the DP group displayed significantly lower expectations of relief as compared to the two other groups), it is questionable, whether the scale we employed was capable of reliably measuring expectations of guilt reduction. Another possible explanation for this finding could be that the rationale used in the DP group (i.e., that it is a phytopharmaceutical) might not have been entirely convincing, leaving subjects of that group with fewer expectations towards guilt reduction. Thus, more research using validated scales is needed in order to establish the importance of expectations of relief in OLP effects.
From a methodological point of view, we found that the employed guilt paradigm exerted its intended effects by inducing guilt as a consequence of writing (“guilt induction”) and thinking (“guilt boost”) about an interpersonally unfair behavior toward another person. The tasks did not only impact guilt but also all the other assessed affective states. Yet as indicated by the amount of change between the baseline and the measurement after guilt induction (T0–T1), the effects were most pronounced for guilt. These promising results are in line with other studies testing this approach56 and open new possibilities for conducting experimental placebo research on affective states. For example, the nature of the experimental design, in which the intervention is delivered prior to the guilt induction of interest (i.e. the guilt boost), offers the unique possibility of testing the short-term preventive effect of a placebo intervention. Furthermore, in the context of the ethical application of placebo interventions, experimental paradigms facilitate the systematic manipulation of the treatment setting and application, which can aid our understanding of the mechanisms involved in how OLPs influence affective states. In this regard, the finding that the symptom-specific rationale might have led to a symptom-specific effect points to an interesting line of research which needs to be systematically addressed in future studies. If future randomized controlled trials testing differential effects of symptom-specific rationales were to support the observation of this study, the various and different effects of placebos across disorders, populations, and settings could be seen as specific to the rationales employed.
This study corroborates important findings on the efficacy of OLPs on affective states. In addition, we successfully tested a guilt-inducing paradigm, which will enable further research on placebo effects on psychological parameters. However, several aspects of the study require critical examination. First, within the study design, only a single medication intake was simulated and assessed for its immediate effects, so we cannot draw any conclusions regarding the durability of the effects we found. Second, the measurements of the outcomes were subjective rather than objective, which raises the question of report and social-desirability bias. Nevertheless, self-report measures are standard outcomes in trials of affective outcomes, and research indicates that placebo treatments are most efficacious for such subjective complaints79. Third, since the absence of a significant difference is not the same as equivalence80, future studies should use noninferiority comparisons of DP and OLP treatments to answer the question of the equivalence of both treatments. Fourth, in the current study the observation of a symptom-specific placebo response following a symptom-specific rationale might be biased, as this was not systematically tested in a randomized fashion. Last, guilt in healthy individuals and guilt in patients might not be comparable. In our study, guilt was experimentally induced in healthy subjects, who can be assumed to have good strategies for dealing with negative emotions. Furthermore, a meta-analytical review on the association of different forms of guilt and depressive symptoms found that maladaptive guilt correlates substantially with depressive symptoms81 but that contextually legitimate or adaptive guilt does not (r = 0.06). There is thus a need to replicate the findings of our study in clinical populations.
Guilt can be a burdensome emotion, in both healthy and clinical populations. The present study investigated whether a deceptive and an open-label placebo could reduce experimentally induced guilt in healthy subjects. The results show that placebos are efficacious in reducing acute experimentally induced guilt responses in comparison to no treatment, regardless of the placebo administration (i.e., open vs. deceptive). This indicates that placebos can have demonstrable effects on guilt and that these effects can be employed while respecting important ethical principles.
Supplementary Information
Acknowledgements
The authors thank Emil Nissen, Mareike Rytz, Saruga Kunaratnam, Tim Kilb, Maya Lüthi, Samuel Jenny, Rebecca Bendel, and Julia Gottstein for conducting the studies, for their input on designing of the experiment and on processing and analyzing the data, and for their help with the references. We also thank Kyrill Schwegler for his valuable input and help with establishing the guilt-induction paradigm.
Author contributions
J.G. had the idea for the study. J.G. and C.L. designed the study. J.G. contributed to the data acquisition. D.S. carried out the analysis. D.S. wrote the manuscript, which was revised by all the authors.
Funding
CL received funding from the Swiss National Science Foundation (SNSF): PZ00P1_201972.
Data availability
The protocol and datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
The online version contains supplementary material available at 10.1038/s41598-022-25446-1.
References
- 1.Evers AW, et al. Implications of placebo and nocebo effects for clinical practice: Expert consensus. Psychother. Psychosom. 2018;87:204–210. doi: 10.1159/000490354. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Evers AW, et al. What should clinicians tell patients about placebo and nocebo effects? Practical considerations based on expert consensus. Psychother. Psychosom. 2021;90:49–56. doi: 10.1159/000510738. [DOI] [PubMed] [Google Scholar]
- 3.Forsberg JT, Martinussen M, Flaten MA. The placebo analgesic effect in healthy individuals and patients: A meta-analysis. Psychosom. Med. 2017;79:388–394. doi: 10.1097/PSY.0000000000000432. [DOI] [PubMed] [Google Scholar]
- 4.Cragg JJ, et al. Meta-analysis of placebo responses in central neuropathic pain: Impact of subject, study, and pain characteristics. Pain. 2016;157:530–540. doi: 10.1097/j.pain.0000000000000431. [DOI] [PubMed] [Google Scholar]
- 5.Vase L, Riley JL, Price DD. A comparison of placebo effects in clinical analgesic trials versus studies of placebo analgesia. Pain. 2002;99:443–452. doi: 10.1016/S0304-3959(02)00205-1. [DOI] [PubMed] [Google Scholar]
- 6.Cipriani A, et al. Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: A systematic review and network meta-analysis. Focus. 2018;16:420–429. doi: 10.1176/appi.focus.16407. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Munkholm K, Paludan-Müller AS, Boesen K. Considering the methodological limitations in the evidence base of antidepressants for depression: A reanalysis of a network meta-analysis. BMJ Open. 2019;9:e024886. doi: 10.1136/bmjopen-2018-024886. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Koban L, Jepma M, Geuter S, Wager TD. What’s in a word? How instructions, suggestions, and social information change pain and emotion. Neurosci. Biobehav. Rev. 2017;81:29–42. doi: 10.1016/j.neubiorev.2017.02.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Yan X, Yong X, Huang W, Ma Y. Placebo treatment facilitates social trust and approach behavior. Proc. Natl. Acad. Sci. USA. 2018;115:5732–5737. doi: 10.1073/pnas.1800779115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Woodworth RJ, O'Brien-Malone A, Diamond MR, Schüz B. Web-based positive psychology interventions: A reexamination of effectiveness. J. Clin. Psychol. 2017;73:218–232. doi: 10.1002/jclp.22328. [DOI] [PubMed] [Google Scholar]
- 11.Darragh M, et al. A take-home placebo treatment can reduce stress, anxiety and symptoms of depression in a non-patient population. Aust. N. Z. J. Psychiatry. 2016;50:858–865. doi: 10.1177/0004867415621390. [DOI] [PubMed] [Google Scholar]
- 12.Gaab J, Kossowsky J, Ehlert U, Locher C. Effects and components of placebos with a psychological treatment rationale–three randomized-controlled studies. Sci. Rep. 2019;9:1–8. doi: 10.1038/s41598-018-37945-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Petrovic P, et al. Placebo in emotional processing—induced expectations of anxiety relief activate a generalized modulatory network. Neuron. 2005;46:957–969. doi: 10.1016/j.neuron.2005.05.023. [DOI] [PubMed] [Google Scholar]
- 14.Rebstock L, Schäfer LN, Kube T, Ehmke V, Rief W. Placebo prevents rumination: An experimental study. J. Affect. Disord. 2020;274:1152–1160. doi: 10.1016/j.jad.2020.06.010. [DOI] [PubMed] [Google Scholar]
- 15.Glombiewski AJ, Rheker J, Wittkowski J, Rebstock L, Rief W. Placebo mechanisms in depression: An experimental investigation of the impact of expectations on sadness in female participants. J. Affect. Disord. 2019;256:658–667. doi: 10.1016/j.jad.2019.06.070. [DOI] [PubMed] [Google Scholar]
- 16.Haas JW, Rief W, Glombiewski JA, Winkler A, Doering BK. Expectation-induced placebo effect on acute sadness in women with major depression: An experimental investigation. J. Affect. Disord. 2020;274:920–928. doi: 10.1016/j.jad.2020.05.056. [DOI] [PubMed] [Google Scholar]
- 17.Schienle A, Übel S, Schöngaßner F, Ille R, Scharmüller W. Disgust regulation via placebo: An fMRI study. Soc. Cogn. Affect. Neurosci. 2014;9:985–990. doi: 10.1093/scan/nst072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Werner CP, et al. Price information influences the subjective experience of wine: A framed field experiment. Food Qual. Prefer. 2021;92:104223. doi: 10.1016/j.foodqual.2021.104223. [DOI] [Google Scholar]
- 19.Mitchell L. Cold pressor test. Encycl. Behav. Med. 2013 doi: 10.1007/978-1-4419-1005-9_239. [DOI] [Google Scholar]
- 20.Geers AL, Wellman JA, Fowler SL, Helfer SG, France CR. Dispositional optimism predicts placebo analgesia. J. Pain. 2010;11:1165–1171. doi: 10.1016/j.jpain.2010.02.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Disley N, Kola-Palmer S, Retzler C. A comparison of open-label and deceptive placebo analgesia in a healthy sample. J. Psychosom. Res. 2021;140:110298. doi: 10.1016/j.jpsychores.2020.110298. [DOI] [PubMed] [Google Scholar]
- 22.Locher C, et al. Is the rationale more important than deception? A randomized controlled trial of open-label placebo analgesia. Pain. 2017;158:2320–2328. doi: 10.1097/j.pain.0000000000001012. [DOI] [PubMed] [Google Scholar]
- 23.Krummenacher P, et al. Expectancy-induced placebo analgesia in children and the role of magical thinking. J. Pain. 2014;15:1282–1293. doi: 10.1016/j.jpain.2014.09.005. [DOI] [PubMed] [Google Scholar]
- 24.Schneider T, Luethi J, Mauermann E, Bandschapp O, Ruppen W. Pain response to open label placebo in induced acute pain in healthy adult males. Anesthesiology. 2020;132:571–580. doi: 10.1097/ALN.0000000000003076. [DOI] [PubMed] [Google Scholar]
- 25.Koppert W, et al. A new model of electrically evoked pain and hyperalgesia in human skin: The effects of intravenous alfentanil, S (+)-ketamine, and lidocaine. J. Am. Soc. Anesthesiol. 2001;95:395–402. doi: 10.1097/00000542-200108000-00022. [DOI] [PubMed] [Google Scholar]
- 26.Gross JJ, Levenson RW. Eliciting emotions using films. Cogn. Emot. 1995;9:87–108. doi: 10.1080/02699939508408966. [DOI] [Google Scholar]
- 27.Velten E. A laboratory task for induction of mood states. Behav. Res. Ther. 1968;6:473–482. doi: 10.1016/0005-7967(68)90028-4. [DOI] [PubMed] [Google Scholar]
- 28.Hahn A, Göhler AC, Hermann C, Winkler A. Even when you know it is a placebo, you experience less sadness: First evidence from an experimental open-label placebo investigation. J. Affect. Disord. 2022 doi: 10.1016/j.jad.2022.02.043. [DOI] [PubMed] [Google Scholar]
- 29.Göhler AC, Haas JW, Sperl MF, Hermann C, Winkler A. Placebo nasal spray protects female participants from experimentally induced sadness and concomitant changes in autonomic arousal. J. Affect. Disord. 2021;295:131–138. doi: 10.1016/j.jad.2021.07.037. [DOI] [PubMed] [Google Scholar]
- 30.Geeraerts B, et al. Influence of experimentally induced anxiety on gastric sensorimotor function in humans. Gastroenterology. 2005;129:1437–1444. doi: 10.1053/j.gastro.2005.08.020. [DOI] [PubMed] [Google Scholar]
- 31.Morris JS, et al. A differential neural response in the human amygdala to fearful and happy facial expressions. Nature. 1996;383:812–815. doi: 10.1038/383812a0. [DOI] [PubMed] [Google Scholar]
- 32.von Wernsdorff M, Loef M, Tuschen-Caffier B, Schmidt S. Effects of open-label placebos in clinical trials: A systematic review and meta-analysis. Sci. Rep. 2021;11:1–14. doi: 10.1038/s41598-021-83148-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Kaptchuk TJ, et al. Placebos without deception: A randomized controlled trial in irritable bowel syndrome. PLoS ONE. 2010;5:1–7. doi: 10.1371/journal.pone.0015591. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Carvalho C, et al. Open-label placebo treatment in chronic low back pain: A randomized controlled trial. Pain. 2016;157:2766. doi: 10.1097/j.pain.0000000000000700. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Kleine-Borgmann J, Schmidt K, Hellmann A, Bingel U. Effects of open-label placebo on pain, functional disability, and spine mobility in patients with chronic back pain: A randomized controlled trial. Pain. 2019;160:2891–2897. doi: 10.1097/j.pain.0000000000001683. [DOI] [PubMed] [Google Scholar]
- 36.Schaefer M, et al. Open-label placebos reduce test anxiety and improve self-management skills: A randomized-controlled trial. Sci. Rep. 2019;9:1–6. doi: 10.1038/s41598-019-49466-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Kelley JM, Kaptchuk TJ, Cusin C, Lipkin S, Fava M. Open-label placebo for major depressive disorder: A pilot randomized controlled trial. Psychother. Psychosom. 2012 doi: 10.1159/000337053. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Nitzan U, et al. Open-Label placebo for the treatment of unipolar depression: Results from a randomized controlled trial. J. Affect. Disord. 2020;276:707–710. doi: 10.1016/j.jad.2020.07.077. [DOI] [PubMed] [Google Scholar]
- 39.Friehs T, Rief W, Glombiewski JA, Haas J, Kube T. Deceptive and non-deceptive placebos to reduce sadness: A five-armed experimental study. J. Affect. Disord. 2022;9:100349. doi: 10.1016/j.jadr.2022.100349. [DOI] [Google Scholar]
- 40.Tangney, J. P. E. & Tracy, J. L. Self-conscious emotions. (2012).
- 41.Tangney, J. P. & Dearing, R. L. Shame and guilt. (Guilford Press, 2003).
- 42.Tangney JP. Moral affect: The good, the bad, and the ugly. J. Pers. Soc. Psychol. 1991;61:598. doi: 10.1037/0022-3514.61.4.598. [DOI] [PubMed] [Google Scholar]
- 43.Baumeister RF, Stillwell AM, Heatherton TF. Guilt: An interpersonal approach. Psychol. Bull. 1994;115:243. doi: 10.1037/0033-2909.115.2.243. [DOI] [PubMed] [Google Scholar]
- 44.Cryder CE, Springer S, Morewedge CK. Guilty feelings, targeted actions. Pers. Soc. Psychol. Bull. 2012;38:607–618. doi: 10.1177/0146167211435796. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Graton A, Ric F. How guilt leads to reparation? Exploring the processes underlying the effects of guilt. Motiv. Emot. 2017;41:343–352. doi: 10.1007/s11031-017-9612-z. [DOI] [Google Scholar]
- 46.Fedewa BA, Burns LR, Gomez AA. Positive and negative perfectionism and the shame/guilt distinction: Adaptive and maladaptive characteristics. Pers. Individ. Differ. 2005;38:1609–1619. doi: 10.1016/j.paid.2004.09.026. [DOI] [Google Scholar]
- 47.Hewitt PL, Flett GL. Perfectionism in the self and social contexts: Conceptualization, assessment, and association with psychopathology. J. Pers. Soc. Psychol. 1991;60:456. doi: 10.1037/0022-3514.60.3.456. [DOI] [PubMed] [Google Scholar]
- 48.Baumeister RF, Reis HT, Delespaul PA. Subjective and experiential correlates of guilt in daily life. Pers. Soc. Psychol. Bull. 1995;21:1256–1268. doi: 10.1177/014616729521120. [DOI] [Google Scholar]
- 49.Nelissen R, Zeelenberg M. When guilt evokes self-punishment: Evidence for the existence of a Dobby effect. Emotion. 2009;9:118. doi: 10.1037/a0014540. [DOI] [PubMed] [Google Scholar]
- 50.Ghatavi K, Nicolson R, MacDonald C, Osher S, Levitt A. Defining guilt in depression: a comparison of subjects with major depression, chronic medical illness and healthy controls. J. Affect. Disord. 2002;68:307–315. doi: 10.1016/S0165-0327(01)00335-4. [DOI] [PubMed] [Google Scholar]
- 51.Singh SM, Sharma A. The prevalence and correlates of guilt in depression: A study from North India. Asian J. Psychiatr. 2013;6:622–623. doi: 10.1016/j.ajp.2013.05.010. [DOI] [PubMed] [Google Scholar]
- 52.Bovin MJ, et al. Does guilt mediate the association between tonic immobility and posttraumatic stress disorder symptoms in female trauma survivors? J. Trauma. Stress. 2014;27:721–724. doi: 10.1002/jts.21963. [DOI] [PubMed] [Google Scholar]
- 53.Beck JG, et al. Exploring negative emotion in women experiencing intimate partner violence: Shame, guilt, and PTSD. Behav. Ther. 2011;42:740–750. doi: 10.1016/j.beth.2011.04.001. [DOI] [PubMed] [Google Scholar]
- 54.Luck T, Luck-Sikorski C. Feelings of guilt in the general adult population: Prevalence, intensity and association with depression. Psychol. Health Med. 2021;26:1143–1153. doi: 10.1080/13548506.2020.1859558. [DOI] [PubMed] [Google Scholar]
- 55.Mills C, D'Mello S. On the validity of the autobiographical emotional memory task for emotion induction. PLoS ONE. 2014;9:e95837. doi: 10.1371/journal.pone.0095837. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Schär S, et al. Guilt is effectively induced by a written auto-biographical essay but not reduced by experimental pain. Front. Behav. Neurosci. 2022 doi: 10.3389/fnbeh.2022.891831. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Mundt JM, Roditi D, Robinson ME. A comparison of deceptive and non-deceptive placebo analgesia: Efficacy and ethical consequences. Ann. Behav. Med. 2017;51:307–315. doi: 10.1007/s12160-016-9854-0. [DOI] [PubMed] [Google Scholar]
- 58.Lembo A, et al. Open-label placebo vs double-blind placebo for irritable bowel syndrome: A randomized clinical trial. Pain. 2021;162:2428–2435. doi: 10.1097/j.pain.0000000000002234. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Kube T, et al. Deceptive and nondeceptive placebos to reduce pain: An experimental study in healthy individuals. Clin. J. Pain. 2020;36:68–79. doi: 10.1097/AJP.0000000000000781. [DOI] [PubMed] [Google Scholar]
- 60.Bastian B, Jetten J, Fasoli F. Cleansing the soul by hurting the flesh: The guilt-reducing effect of pain. Psychol. Sci. 2011;22:334. doi: 10.1177/0956797610397058. [DOI] [PubMed] [Google Scholar]
- 61.Inbar Y, Pizarro DA, Gilovich T, Ariely D. Moral masochism: On the connection between guilt and self-punishment. Emotion. 2013;13:14. doi: 10.1037/a0029749. [DOI] [PubMed] [Google Scholar]
- 62.De Hooge IE, Nelissen R, Breugelmans SM, Zeelenberg M. What is moral about guilt? Acting “prosocially” at the disadvantage of others. J. Pers. Soc. Psychol. 2011;100:462. doi: 10.1037/a0021459. [DOI] [PubMed] [Google Scholar]
- 63.Frost RO, Green ML. Velten mood induction procedure effects: Duration and postexperimental removal. Pers. Soc. Psychol. Bull. 1982;8:341–347. doi: 10.1177/0146167282082024. [DOI] [Google Scholar]
- 64.Marschall, D., Sanftner, J. & Tangney, J. P. The state shame and guilt scale. George Mason University, (1994).
- 65.Krohne HW, Egloff B, Kohlmann C-W, Tausch A. Untersuchungen mit einer deutschen version der" positive and negative affect schedule"(PANAS) Diagnostica. 1996;42:139–156. [Google Scholar]
- 66.Harder DH, Zalma A. Two promising shame and guilt scales: A construct validity comparison. J. Pers. Assess. 1990;55:729–745. doi: 10.1080/00223891.1990.9674108. [DOI] [PubMed] [Google Scholar]
- 67.Rüsch N, et al. Measuring shame and guilt by self-report questionnaires: A validation study. Psychiat. Res. 2007;150:313–325. doi: 10.1016/j.psychres.2006.04.018. [DOI] [PubMed] [Google Scholar]
- 68.Mair P, Wilcox R. Robust statistical methods in R using the WRS2 package. Behav. Res. Methods. 2020;52:464–488. doi: 10.3758/s13428-019-01246-w. [DOI] [PubMed] [Google Scholar]
- 69.Pruessner JC, Kirschbaum C, Meinlschmid G, Hellhammer DH. Two formulas for computation of the area under the curve represent measures of total hormone concentration versus time-dependent change. Psychoneuroendocrinology. 2003;28:916–931. doi: 10.1016/S0306-4530(02)00108-7. [DOI] [PubMed] [Google Scholar]
- 70.Benjamini Y, Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. Series B Stat. Methodol. 1995;57:289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x. [DOI] [Google Scholar]
- 71.Schaefer M, Hellmann-Regen J, Enge S. Effects of open-label placebos on state anxiety and glucocorticoid stress responses. Brain Sci. 2021;11:508. doi: 10.3390/brainsci11040508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Kleine-Borgmann J, et al. Effects of open-label placebos on test performance and psychological well-being in healthy medical students: A randomized controlled trial. Sci. Rep. 2021;11:1–11. doi: 10.1038/s41598-021-81502-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.El Brihi J, Horne R, Faasse K. Prescribing placebos: an experimental examination of the role of dose, expectancies, and adherence in open-label placebo effects. Ann. Behav. Med. 2019;53:16–28. doi: 10.1093/abm/kay011. [DOI] [PubMed] [Google Scholar]
- 74.Guevarra DA, Moser JS, Wager TD, Kross E. Placebos without deception reduce self-report and neural measures of emotional distress. Nat. Commun. 2020;11:1–8. doi: 10.1038/s41467-020-17654-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Barnes K, Yu A, Josupeit J, Colagiuri B. Deceptive but not open label placebos attenuate motion-induced nausea. J. Psychosom. Res. 2019;125:109808. doi: 10.1016/j.jpsychores.2019.109808. [DOI] [PubMed] [Google Scholar]
- 76.Blease C, Colloca L, Kaptchuk TJ. Are open-label placebos ethical? informed consent ethical equivocations. Bioethics. 2016;30:407–414. doi: 10.1111/bioe.12245. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Kirsch I. Response expectancy and the placebo effect. Int. Rev. Neurobiol. 2018;138:81–93. doi: 10.1016/bs.irn.2018.01.003. [DOI] [PubMed] [Google Scholar]
- 78.Haas JW, Rief W, Doering BK. Open-label placebo treatment: Outcome expectations and general acceptance in the lay population. Int. J. Behav. Med. 2021;28:444–454. doi: 10.1007/s12529-020-09933-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Benedetti F, Frisaldi E, Shaibani A. Thirty years of neuroscientific investigation of placebo and nocebo: The interesting, the good, and the bad. Annu. Rev. Pharmacol. 2022;62:323–340. doi: 10.1146/annurev-pharmtox-052120-104536. [DOI] [PubMed] [Google Scholar]
- 80.Mauri L, D’Agostino RB., Sr Challenges in the design and interpretation of noninferiority trials. N. Engl. J. Med. 2017;377:1357–1367. doi: 10.1056/NEJMra1510063. [DOI] [PubMed] [Google Scholar]
- 81.Kim S, Thibodeau R, Jorgensen RS. Shame, guilt, and depressive symptoms: A meta-analytic review. Psychol. Bull. 2011;137:68. doi: 10.1037/a0021466. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The protocol and datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.