Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2024 Mar 14;19(3):e0300501. doi: 10.1371/journal.pone.0300501

The therapeutic alliance between study participants and intervention facilitators is associated with acute effects and clinical outcomes in a psilocybin-assisted therapy trial for major depressive disorder

Adam W Levin 1,2, Rafaelle Lancelotta 1, Nathan D Sepeda 1,3, Natalie Gukasyan 3, Sandeep Nayak 3, Theodore L Wagener 4,5, Frederick S Barrett 3, Roland R Griffiths 3, Alan K Davis 1,3,*
Editor: Herb Covington6
PMCID: PMC10939230  PMID: 38483940

Abstract

We examined if the therapeutic alliance between study participants and intervention facilitators in a psilocybin-assisted therapy (PAT) trial changed over time and whether there were relationships between alliance, acute psilocybin experiences, and depression outcomes. In a randomized, waiting list-controlled clinical trial for major depressive disorder in adults (N = 24), participants were randomized to an immediate (N = 13) or delayed (N = 11) condition with two oral doses of psilocybin (20mg/70kg and 30mg/70kg). Ratings of therapeutic alliance significantly increased from the final preparation session to one-week post-intervention (p = .03, d = .43). A stronger total alliance at the final preparation session predicted depression scores at 4 weeks (r = -.65, p = .002), 6 months (r = -.47, p = .036), and 12 months (r = -.54, p = .014) post-intervention. A stronger total alliance in the final preparation session was correlated with higher peak ratings of mystical experiences (r = .49, p = .027) and psychological insight (r = .52, p = .040), and peak ratings of mystical experience and psychological insight were correlated with depression scores at 4 weeks (r = -.45, p = .030 for mystical; r = -.75, p < .001 for insight). Stronger total alliance one week after the final psilocybin session predicted depression scores at 4 weeks (r = -.85, p < .001), 3 months (r = -.52, p = .010), 6 months (r = -.77, p < .001), and 12 months (r = -.61, p = .001) post-intervention. These findings highlight the importance of the therapeutic relationship in PAT. Future research should explore therapist and participant characteristics which maximize the therapeutic alliance and evaluate its relationship to treatment outcomes.

Trial registration: Registration: Clinicaltrials.gov NCT03181529. https://classic.clinicaltrials.gov/ct2/show/NCT03181529.

Introduction

Psychedelic-assisted therapy (PAT) is a therapeutic intervention which has shown promise in the treatment of a wide range of psychiatric disorders, including depression [14], post-traumatic stress disorder (PTSD) [5], addiction [6,7], and end-of-life anxiety and depression [8]. Although this approach centers around the administration of a psychedelic drug, it has long been claimed that the psychological milieu, as well as the physical environment of the drug administration, referred to as the ‘set’ and ‘setting’ respectively, are important in determining the quality of the acute psychedelic experience [911]. One aspect of the ‘set and setting’, emphasized in modern clinical trials, are the hours of preparatory and integrative psychotherapy surrounding the drug administration, as well as the supportive, nondirective, therapy during the actual drug session [1214]. Although some have suggested the superiority of specific therapeutic orientations [15], thus far, a range of therapeutic approaches have produced comparable outcomes (e.g. cognitive behavioral therapy [16], motivational enhancement therapy [6], acceptance and commitment therapy (e.g., Accept-Connect-Embody [2]). This has prompted others to advocate for a ‘common factors’ framework, which emphasizes the common elements between therapeutic approaches rather than those associated with any specific orientation [17].

One of the most widely investigated of these ‘common factors’ is the therapeutic alliance, broadly defined as the sense of collaboration between patient and clinician [1820]. Decades of research show that a stronger alliance is associated with positive treatment outcomes, and this association appears to be robust and consistent across disorders, cultures, and theoretical orientations (for recent reviews see: [21,22]). To date, few studies have empirically investigated the effect of the therapeutic alliance on outcomes in PAT. Some observational research has suggested that various states and traits traditionally associated with a strong alliance, such as acceptance, openness to experience, and a strong intention are associated with better therapeutic outcomes [23,24]. However, this evidence is indirect and based on psychedelic use in naturalistic settings where a traditional therapeutic alliance may not be established.

In a recent study of PAT, Murphy et al. (2022) [25] found that the strength of the therapeutic alliance predicted depression scores at follow-up and that this effect was mediated by the intensity of the acute psychedelic experience. Specifically, they demonstrated that a strong therapeutic alliance predicted a positive pre-psychedelic session rapport, which then predicted greater emotional breakthrough and mystical-type experiences during the psilocybin session leading to improved therapeutic outcomes [25]. Importantly, their analysis also demonstrated that a weaker alliance predicted less emotional breakthrough and mystical quality of the acute experience.

The mystical-type experience, as measured by the Mystical Experience Questionnaire (MEQ), has been, to date, the most extensively researched dimension of the acute psychedelic experience and has been correlated with positive therapeutic outcomes in multiple clinical trials and across diagnoses [26,27]. However, recent research suggests that psychological insight, especially when paired with a mystical experience, might be a more robust predictor of change [28]. Although many psychotherapeutic approaches, especially in the psychodynamic tradition, emphasize the emergence of insight in the context of a strong therapeutic alliance [20,29,30], this relationship has yet to be empirically investigated in the context of PAT. Additionally, although Murphy et al.’s analysis suggests that a weaker alliance might limit therapeutic effectiveness, the causal mechanisms of this are unknown and have not been investigated.

Therefore, in a replication and extension of Murphy et al. (2022) [25], we analyzed data from a recently published randomized, waitlist-controlled clinical trial of psilocybin-assisted therapy for major depressive disorder (MDD) [3] to examine: 1) whether the participant-rated therapeutic alliance varies from before to after psilocybin administration sessions, 2) whether the alliance is correlated with depression scores following the intervention, 3) whether the therapeutic alliance is correlated with peak mystical-type and psychological insight effects of the intervention, and 4) the relationship between ratings of the mystical-type and psychological insight effects and post-treatment depression scores.

Methods

Study design

The primary outcomes from this study have been published and full details, including a study protocol, have been described previously [3]. Procedures were approved by The Johns Hopkins University School of Medicine Institutional Review Board (IRB00101821). In brief, this study was a randomized waitlist-controlled trial testing the effect of two ascending doses of psilocybin in conjunction with approximately 11 hours of psychotherapy in adults with moderate-to-severe MDD. The decision to recruit 24 participants was made based on the results of a prior study of psilocybin-assisted therapy for cancer patients [8], which showed very large effect sizes of this intervention. Therefore, as a preliminary trial we were confident that a sample size of N = 24 would provide sufficient power to detect a moderate effect size of pre-psilocybin to post-psilocybin change in depressive symptoms. Recruitment occurred between August 2017 to August 2019 and all participants provided written informed consent. Data were collected through final 12-month follow-up timepoint in August 2020. Participants in this trial were 21–75 years of age who met criteria for a moderate to severe episode of MDD (≥17 on the GRID-Hamilton Depression Rating Scale [GRID-HAMD]) and were medically stable. Individuals with a first- or second-degree relative with history of psychiatric conditions (e.g., psychotic or bipolar I or II disorder) deemed incompatible with safe exposure to psilocybin were excluded. Participants were also required to refrain from using certain medications (e.g., antidepressants) for at least five half-lives before screening and through our primary outcome measurement at 4-weeks post psilocybin session two. Following screening and baseline assessments, participants were randomized to an immediate or delayed treatment condition.

During the intervention phase of the study, participants were provided with approximately 8 hours of preparatory therapy sessions with two intervention facilitators. At least one facilitator had clinical training in mental health at the master’s or doctoral level (e.g., Master of Social Work, Ph.D. in clinical psychology, M.D. specializing in psychiatry). Following preparation sessions, participants received two doses (20 mg/70 kg and 30 mg/70 kg) of psilocybin, approximately one-to-two weeks apart. Psilocybin was administered under the supervision of both facilitators in a comfortable room following established safety guidelines [12]. On psilocybin session days, a nondirective psychotherapeutic approach was employed. The following day and one week after each psilocybin session, participants returned for follow-up integrative therapy sessions and assessments. Follow-up assessments, including a 1–2 hour meeting with at least one of the therapist facilitators, were also conducted at 1- and 4-weeks, and 3-, 6-, and 12-months following the second psilocybin session.

Measures

Therapeutic alliance

The 12-item, participant-rated, Working Alliance Inventory-Short Revised (WAI-SR; [31]) was used to assess the therapeutic alliance between intervention facilitators and study participants at the final preparatory session prior to psilocybin administration and one week following the first and second psilocybin sessions. The WAI-SR is a shortened version of the 36-item Working Alliance Inventory (WAI; [32,33]) which utilizes a three factor model based on the three aspects of the therapeutic alliance as theorized by Bordin [18]: The goals of treatment (e.g., “____ and I collaborate on setting goals for my therapy”), the tasks of therapy (e.g., “As a result of these sessions I am clearer as to how I might be able to change”), and the bond between therapist and client (e.g., “I believe ____ likes me”). The 12 items are rated on a five-point Likert scale ranging from Seldom (1) to Always (5). Internal consistency reliability, measured with Cronbach’s alpha, was calculated for WAI bond (α = .61, .77, .94), goal (α = .89, .91, .95), task (α = .76, .92, .96), and total score (α = .87, .92, .95) at the final preparatory session, 1-week post-psilocybin session 1, and 1-week post-psilocybin session 2, respectively.

Depression severity

Depression was measured by blinded clinician rating using the GRID-HAMD [34,35], as previously described [3]. Depression severity was assessed at baseline and at 1-, 3-, 6-, and 12-month follow-up timepoints. Inter-rater reliability was 87.5% across all follow-ups.

Acute psilocybin effects

Measures of acute psilocybin effects that were assessed at the end of the drug administration or the following day have been reported previously [3]. Included in this follow-up analysis is the Mystical Experience Questionnaire (MEQ30) [36], which was rated on a 6-point scale ranging from 0–5 (none; not at all = 0, so slight cannot decide = 1, slight = 2, moderate = 3, strong [equivalent in degree to any other strong experience] = 4, extreme [more than any other time in my life and stronger than 4] = 5). We also included a single item measure of psychological insight [37] on which participants rated the degree to which the psilocybin session was psychologically insightful on a scale from 1 = “no more than routine, everyday experiences” to 8 = “the single most psychologically insightful experience of my life.” The use of a single-item measure, while not ideal, has shown reliability and validity in similar psychological interventions [38].

Statistical analyses

Data were analyzed from all 24 participants who completed the full intervention. Four participants did not complete the WAI-SR during the final preparatory session and those data were therefore excluded. Additionally, four participants did not complete the psychological insight item, so those data were excluded for the relevant analyses. First, we explored the distribution of scores for each variable and found that several variables violated the assumption of a normal distribution. However, given that Pearson correlations and t-tests are robust against violations of the normal distribution assumption [3941], and given that this study is exploratory and hypothesis-generating, we chose to proceed with our analytic plan. Next, we used paired samples t tests to compare alliance scores from the final preparatory session to one week following the second psilocybin session. Following this, we calculated Pearson’s correlations to examine the relationship between participant ratings of the alliance at the final preparatory session and one week following the first and second psilocybin session, and depression scores at 4-week, and 3-, 6-, and 12-month follow ups. Then, we calculated Pearson’s correlations between alliance ratings at the final preparatory session and one week following the first and second psilocybin session, and measures of peak acute mystical and insight effects across the two psilocybin sessions. Finally, we calculated Pearson’s correlations between peak acute effects and depression scores at 4-weeks, 3-, 6-, and 12-month follow ups. A p-value of .05 was used to determine statistical significance in all analyses, and effect sizes are reported for all t-test and correlations. Data analysis was conducted using SPSS, version 28 [42].

Results

The sample (n = 20) was comprised of 15 women (75%) and 5 men (25%) and was 90% white, with a mean (SD) age of 37.6 (11.0) years. Most participants also reported they were heterosexual (85%), non-Hispanic (100%), had a college degree (90%), were never married (55%), and employed (55%). On average, the sample reported it had been 20.7 (SD = 18.5) months since their current major depressive episode began, and 19.6 (SD = 11.4) years since their first major depressive episode.

As Table 1 shows, participant ratings of the total therapeutic alliance between study participants and intervention facilitators increased from the final preparatory session to 1-week post-intervention (p = .027, d = .43). Although each of the subscales increased during this time point (p = .620, d = .11 for goal, p = .135, d = .34 for bond), only ratings of task increased significantly (p < .001, d = .65).

Table 1. Comparisons of therapeutic alliance ratings (via the working alliance inventory- short revised) at intervention time-points.

WAI-SR Preparatory Session 2 1-week post-psilocybin session 2
M SD M SD T p Cohen’s d
Bond 18.55 1.70 19.29 2.12 1.56 .135 .34
Goal 17.40 3.28 17.79 3.56 .50 .620 .11
Task 14.85 2.80 17.17 3.70 3.99 < .001*** .65
Total 50.80 6.55 54.25 8.27 2.40 .027* .43

*p < .05,

**p < .01,

***p < .001.

d = .2 (small), d = .5 (medium), d = .8 (large).

As Table 2 shows, a stronger total alliance reported at the final preparatory session predicted depression scores at 4 weeks (r = -.65, p = .002), 6 months (r = -.47, p = .036), and 12 months (r = -.54, p = .014) post-intervention. A stronger total alliance reported 1-week following the first psilocybin session was also correlated with decreased depression scores at 4 weeks (r = -.73, p < .001), 3 months (r = .42, p = .041), 6 months (r = -.71, p < .001) and 12 months (r = -.54, p = .006). A stronger total alliance reported 1-week after the second psilocybin session predicted depression scores at 4 weeks (r = -.85, p < .001), 3 months (r = -.52, p = .010), 6 months (r = -.77, p < .001), and 12 months (r = -.61, p = .001).

Table 2. Correlation between therapeutic alliance ratings (via the working alliance inventory- short revised) and depression outcomes (GRID-HAMD).

WAI GRIDHAMD (4-weeks post-session 2) GRIDHAMD (3-month follow-up) GRIDHAMD (6-month follow-up) GRIDHAMD (12-month follow-up)
Bond Final Preparatory Session (N = 20) -.454* -.062 -.228 -.355
1-week post-psilocybin session 1 -.502* -.375 -.470* -.524**
1-week post-psilocybin session 2 -.674*** -.571** -.680*** -.718***
Goal Final Prep -.491* -.229 -.362 -.489*
1-week post-session 1 -.539** -.274 -.541** -.417*
1-week post-session 2 -.688*** -.290 -.594** -.386
Task Final Prep -.673** -.353 -.540* -.480*
1-week post-session 1 -.783*** -.448* -.745*** -.502*
1-week post-session 2 -.853*** -.551** -.768*** -.589**
Total Final Prep -.651** -.282 -.471* -.542*
1-week post-session 1 -.734*** -.420* -.710*** -.541**
1-week post-session 2 -.851*** -.518** -.774** -.614**

*p < .05,

**p < .01,

***p < .001.

r = .1 (small), r = .3 (medium), r = .5 (large).

As Table 3 shows, a stronger total therapeutic alliance reported in the final preparation session was correlated with higher peak ratings of mystical-type experiences (r = .49, p = .027) and of psychological insight (r = .52, p = .040). A stronger therapeutic alliance reported 1-week following the first psilocybin session was significantly correlated with higher peak ratings of psychological insight (r = .75, p < .001) across both psilocybin sessions. Higher peak ratings of psychological insight across both psilocybin sessions significantly predicted higher total alliance ratings reported 1-week following the final psilocybin session (r = .83, p < .001), and higher peak ratings of mystical-type experiences and psychological insight predicted higher bond ratings reported one week following the second psilocybin session (r = .45, p = .029 for mystical-type, r = .81, p < .001 for insights).

Table 3. Correlation between therapeutic alliance (via the working alliance inventory- short revised) and peak acute mystical-type and insight effects.

WAI Mystical Experiences Questionnaire (MEQ) N = 20 Psychological Insight Item
N = 16
Bond Final Preparatory Session .487* .467
1-week post-session 1 .416* .648**
1-week post- session 2 .447* .814***
Goal Final Prep .237 .359
1-week post-session 1 .17 .481*
1-week post-session 2 .155 .596****
Task Final Prep .579** .531*
1-week post-session 1 .469* .812***
1-week post-session 2 .439* .831***
Total Final Prep .493* .518*
1-week post-session 1 .392 .746***
1-week post-session 2 .378 .826***

*p < .05,

**p < .01,

***p < .001.

r = .1 (small), r = .3 (medium), r = .5 (large).

As Table 4 shows, higher peak ratings of mystical-type experience were correlated with lower depression scores at 4 weeks (r = -.45, p = .030), and higher peak ratings of psychological insight were correlated with lower depression scores at 4 weeks (r = -.75, p < .001), 3 months (r = -.52, p = .020), 6 months (r = -.82, p < .001), and 12 months (r = -.70, p < .001) post-intervention.

Table 4. Correlation between peak acute mystical-type and insight effects and depression outcomes (GRID-HAMD).

Peak Acute Effects 4-weeks post-session 2 3-month follow-up 6-month follow-up 12-month follow-up
Mystical Experiences Questionnaire (MEQ)
N = 24
-.445* -.156 -.291 -.307
Psychological Insight Item N = 20 -.748*** -.515* -.819*** -.704***

*p < .05,

**p < .01,

***p < .001.

r = .1 (small), r = .3 (medium), r = .5 (large).

Our analysis revealed similar patterns with regards to the three WAI subscales. Correlations between the task alliance subscale and outcomes were most robust, with higher ratings of task alliance at the final preparatory session significantly predicting depression scores at 4 weeks (r = -.67, p = .001), 6 months (r = -.54, p = .014) and 12 months (r = -.48, p = .032) post-intervention. Further, ratings of task alliance 1-week following the second psilocybin session were strongly correlated with decreased depression scores at 4 weeks (r = -.85, p < .001), 3 months (r = -.55, p = .005), 6 months (r = -.77 p < .001), and 12 months (r = -.59, p = .013) months. Higher ratings of goal alliance at the final preparatory session predicted outcomes at 4 weeks (r = -.49, p = .028) and 12 months (r = -.49, p = .029), and ratings of goal alliance 1-week following the second psilocybin session were correlated with outcomes at 4 weeks (r = -.69, p < .001) and 6 months (r = -.59, p = .002). A stronger bond reported at the final preparation session predicted scores at 4 weeks (r = -.45, p = .044) but did not predict long term depression scores (ps > .05). However, a stronger bond reported 1-week after the final psilocybin session predicted depression scores at 4-weeks (r = -.67, p < .001), 3-months (r = -.57, p = .004), 6 months (r = -.68, p < .001), and 12 months (r = -.72, p < .001).

With regards to the WAI subscales relationship with acute psilocybin effects, ratings of task alliance at the final preparatory session were correlated with higher ratings of both mystical-type experience (r = .58, p = .007) and psychological insight (r = .53, p = .034). Further, higher peak ratings of both mystical and psychological insight predicted higher task alliance ratings 1-week following the second psilocybin session (r = .44, p = .032 for mystical-type, r = -.83, p < .001 for insight). A stronger bond reported in the final preparation session was significantly correlated with higher peak ratings of mystical-type experiences (r = .49, p = .029). Additionally, a stronger bond reported one week following the second psilocybin session was significantly correlated with mystical-type experiences (r = .45, p = .029) and psychological insight (r = .81, p < .001). Ratings of goal alliance at the final preparatory session were not significantly correlated with peak ratings of mystical-type experience (r = .24, ps > .05) or psychological insight (r = .36, ps > .05), however, peak ratings of psychological insight predicted goal ratings one week following the second psilocybin session (r = .60 p = .006).

Discussion

This analysis of a randomized controlled trial of psilocybin-assisted therapy for adults with MDD found that a stronger participant-rated therapeutic alliance was correlated with improvements in depression outcomes up to one year later, and that this correlation strengthened throughout the course of the study. A stronger alliance in the final preparatory session predicted higher peak ratings of mystical-type and psychological insight experiences, and these acute effects were correlated with improvements in depression. These results suggest that therapeutic alliance plays an important role in optimizing the acute psychedelic experience towards improved outcomes and extend those of Murphy et al. (2022) [25] by employing clinician-rated depression outcomes (vs self-report), including acute psychological insight and mystical-type effects (vs emotional breakthrough and mystical-type effects), and extending the timeline to 12-months post-intervention (vs 6-weeks).

In one sense, these findings place PAT firmly within the bounds of traditional psychotherapies, in which a stronger therapeutic alliance is correlated with positive outcomes across modalities and diagnoses [21,22,43,44]. In another sense, the alliance seems to have an amplified role in PAT through its interaction with the acute psychedelic experience. Several large meta-analyses of traditional therapies have placed the alliance-outcome correlation consistently in the small to medium range [22,4547], and a recent meta-analysis, looking specifically at the alliance-depression outcome correlation, found a small effect [48]. By contrast, our analysis showed moderate to large correlations. It is possible that outliers in our sample, or positive expectancy effects, drove these correlations [2,49], however, our results suggest other possible explanations. For example, the task alliance subscale is often associated with improved outcomes in psychotherapy, but our finding that the bond subscale correlated with outcomes is significantly less common [5055]. If psychedelics are ‘unspecific amplifiers of mental processes’, as some have suggested [56], then the participant/facilitator bond itself may be subject to that amplification, leading to larger effects.

This model supports many long-held assumptions, in both the traditional and contemporary use of psychedelics, about the importance of the therapist or facilitator in a therapeutic psychedelic experience. Traditional Ayahuasca practitioners undergo extensive apprenticeships and are thought to directly affect healing through emotional and spiritual ‘resonance’ during complex ceremonies [57]. Modern clinical trials employ a therapeutic dyad with two session facilitators per participant present throughout dosing sessions and during extensive preparatory and integrative therapeutic work. Safety guidelines include recommendations for ancillary staff given that “all individuals at the study site having contact with the volunteer on or before the session day may influence a volunteer’s reaction to a hallucinogen” [11, p.12].

Although assumptions about the importance of facilitators through altered states of consciousness are pervasive, they have only recently been empirically substantiated. A large survey of ayahuasca users in ceremonial settings showed that ‘adequate leadership’ was associated with higher levels of mystical-type experience, and that clear instructions and feelings of social adhesion predicted fewer challenging experiences [58]. Other naturalistic survey studies have demonstrated a correlation between ‘clear intentions’ and mystical-type experiences [23,24], and a recent prospective survey study of participants at psychedelic retreats found that rapport with facilitators prior to a group psychedelic session mediated a sense of harmony during the session [59]. However, the present study and that of Murphy et al. [25] are the first to demonstrate a correlation between the contemporary construct of the therapeutic alliance and the quality of the acute psychedelic experience. Within this construct, it seems plausible that the task alliance subscale of the WAI, which was most robustly correlated with outcomes in our analysis, might be analogous to the concept of ‘clear intentions’ or ‘adequate leadership’, within the naturalistic models outlined above, while the bond subscale may more accurately reflect the rapport or ‘communitas’ [59]. However, further research is needed to elucidate the overlap and contrasts between these constructs.

The correlation between the strength of the acute psychedelic experience and clinical outcomes has been well established in the modern era of psychedelic research [60] and was further validated in the present study. The most widely used construct of the subjective experience (e.g., mystical-type) has been correlated with positive therapeutic outcomes in multiple clinic trials and across indications [26,27]. Interestingly, in both ours and Murphy et al.’s (2022) analyses, mystical-type scores were less predictive of improvements in depression than were other measures of acute effects. In our analysis, although both peak ratings of psychological insight and mystical-type experience correlated with decreases in depression at 4 weeks, only ratings of psychological insight correlated with depression scores at long-term follow-up. Similarly, Murphy et al. (2022) found that ratings of emotional breakthrough were more predictive of decreases in depression than ratings of the mystical-type experience and that emotional breakthrough was more predictive in the first psilocybin session while mystical-type experiences were more predictive in the second session.

These findings suggest that the combination of a more psychologically grounded experience with a mystical-type experience might be a more robust predictor of long-term therapeutic change than the mystical-type experience alone [28,61,62] and lend support to a model in which working through interpersonal content occurs prior to mystical-type breakthroughs [56,62,63]. If future research confirms these findings in more diverse samples and in other clinical indications, it suggests that PAT might be best viewed as an inter- and intra-personal process, which can be enhanced via a strong alliance between study participants and intervention facilitators.

Our findings also strongly suggest that the acute psychedelic experience directly enhances the therapeutic alliance. Psilocybin’s ability to enhance emotional empathy [64] and feelings of connectedness [59,65], along with its reduction of subjective and neurological responses to social exclusion [66], might explain this phenomenon. These effects not only persist well beyond the acute drug effect [67] but may also foster more secure attachment patterns [68]. In our study, stronger alliances one week after the second psilocybin session correlated with higher peak ratings of acute effects. Murphy et al., (2022) also found that stronger emotional breakthroughs in the first psilocybin session predicted better alliances before the second session. Collectively, these results suggests that psilocybin could directly and progressively enhance the therapeutic alliance.

The effects of the alliance on depression outcomes increased over the course of the intervention, with the strongest effects following the second psilocybin session. In Murphy et al. (2022), ratings of alliance reported prior to the second psilocybin session, but not prior to the first, predicted depression outcomes in a manner that was independent of the acute psychedelic experience in the second session. Similarly, a recent large, prospective survey study of psychedelic use in guided group retreat settings showed that the enduring positive effects were explained by the extension of feelings of social connectedness and bond beyond the acute psychedelic state [59]. Given that the therapeutic alliance itself is likely an independent driver of therapeutic change [21], this suggests that positive therapeutic outcomes in PAT may be in part driven by the enhancement and extension of the alliance beyond the acute psychedelic experience. Thus, PAT might be best viewed as a progressive and reciprocal process, as opposed to a one-off, short-term, intervention. Namely, the psilocybin sessions are both enhanced by, and enhance, the therapeutic alliance towards improved therapeutic outcomes over time.

This model has many implications for both treatment approaches and future areas of research. For one, the dynamic and reciprocal nature of the alliance would seem to recommend both flexible dosing and timing of dosing sessions, as well as frequent assessment and repair of alliance ruptures [25,43,44]. There may be specific doses, or even specific compounds, which are more suited for certain stages of therapy, for example, in strengthening the therapeutic alliance or in working through interpersonal, versus spiritual or existential, content [69]. Such approaches have been employed historically, for example, in the ‘psycholytic’ model, which used lower doses of psychedelics to elicit and work through interpersonal and psychodynamic content, but are underrepresented in contemporary research [62]. Recently, in a real-world clinical study of psychedelic-assisted group therapy, most participants required multiple dosing sessions (ranging from 1 to 12 per participant), where MDMA was used preferentially and initially to establish the therapeutic alliance, and higher doses of classic psychedelics were used only subsequently [63]. Notably, the primary diagnosis in this study was complex-PTSD, and all participants were already in regular psychotherapy with the authors. This approach, while preliminary, may presage the realities inherent to the real-world implementation of PAT, especially in the context of certain complex, chronic diagnoses.

Perhaps the clearest implication of our findings is the potential benefits of the long-term maintenance of the therapeutic alliance beyond the timeline of typical clinical trials. Although this potential has long been recognized in traditional and historical approaches to work with psychedelics, the incentives associated with commercialization and medicalization may attempt to reframe PAT as a medicine administration procedure and to undermine the importance of therapeutic support [70]. It will be important to continue to investigate and empirically validate the role of the therapeutic alliance and to attempt to develop cost-effective approaches that incorporate these findings.

Future research should define and measure the components of a strong therapeutic alliance in the context of PAT. Although there will undoubtedly be significant overlap with traditional therapeutic modalities, it is likely that some contingencies unique to PAT will require novel analytic approaches and training [71]. Much of the therapeutic support provided in psychedelic sessions is non-verbal [72] and ‘supportive’ or ‘therapeutic’ touch is commonly employed [12,73]. While physical touch is often discouraged in traditional psychotherapy, evidence suggests that it may be essential in providing support and connection in psychedelic states [72]. It is therefore important that mutual agreement and informed consent are directly addressed and defined. Additionally, there is the question of whether therapists should themselves have personal experience with psychedelics in order to provide clear guidance and to support informed consent. Although such personal training experiences are considered essential in indigenous traditions [57], as well as to other modalities of psychotherapy, such as psychoanalysis [20,30], current laws in the United States prohibit psychedelic use for training purposes. As a result, little is known empirically about how personal psychedelic experience may or may not impact the therapeutic alliance, though there are some indications that participants might prefer facilitators with personal experience [74]. In the coming years, as training opportunities with psychedelics become more widely and legally available [75], it will be important to evaluate this relationship empirically (for an in depth review of this topic, see: [76]).

Limitations

There are several limitations of this study. This study was conducted prior to the development of several psychological insight scales validated for use in PAT [77,78]. As such, we used a single item measure for insight, which may limit the results. However, it is worth noting that such measures have demonstrated excellent test-retest reliability and validity in other similar studies and may be beneficial in limiting participant burden. Our sample consisted of individuals who self-referred for a novel treatment intervention which has recently received significant positive media attention. As a result, participants may have been more susceptible to expectancy bias and the placebo effect [49], and may have been more likely or willing to form strong, trusting bonds with their intervention facilitators, thus exaggerating the role of the therapeutic alliance in predicting psilocybin effects and outcomes. In addition, we were not able to control for any participant, therapist, or treatment setting influences, perhaps most impacted by the fact that two therapy facilitators are incorporated in this intervention. Future studies could explore whether the alliance with one, or both, facilitators impacts the relationships with acute effects and therapeutic outcomes. Future studies should include multiple raters of alliance (including third-party) to elucidate the dynamic relations among the triad and its impact on outcomes [79].

Because most participants were White (92%), Female (67%), and heterosexual (96%), we also caution against extrapolating our findings to more diverse populations, as it is possible that this participant demographic would have a higher likelihood of forming strong alliances with intervention facilitators [80]. Additionally, we were unable to control for diversity in therapist demographics or their orientations and approaches to providing therapy which could have played a role in explaining improvements related to alliance, acute psilocybin effects, and depression outcomes. Further studies should address the influence of these factors on alliance formation by ensuring more diverse participant populations and discussing the identities of the intervention facilitators. Lastly, we also found that there were violations of the assumption of normality in our data. Although evidence shows that t tests and Pearson correlations are robust against such violations, we nevertheless suggest that these data be interpreted with caution and that future studies with larger samples replicate these findings.

Conclusion

The strength of the participant-rated therapeutic alliance was positively correlated with decreases in depression up to one-year following a psilocybin-assisted therapy intervention for depression. The correlation strengthened throughout the course of the intervention and was strongest at the final integration session. The strength of the therapeutic alliance prior to, and following, psilocybin dosing sessions was correlated with peak ratings of mystical-type experience and psychological insight, and these ratings were correlated with depression scores at follow-up. These findings reveal a reciprocal relationship between the therapeutic alliance and the acute psychedelic experience, in which each acts to strengthen the other over the course of an intervention towards improved outcomes. Psilocybin may thus be best administered in the context of a long-term therapeutic relationship. Future research should seek to replicate these findings in different therapeutic settings and approaches, and to elucidate the characteristics, of both participants and therapists, which facilitate an optimal therapeutic alliance.

Data Availability

Data Availability: All relevant data are available on the Open Science Framework public repository at https://osf.io/speqc/?view_only=90add9a193b04fa9ba3c5865c3bc15fb Identifier: DOI 10.17605/OSF.IO/SPEQC.

Funding Statement

This study was funded in part by a crowd-sourced funding campaign organized by Tim Ferriss and a grant from the Riverstyx Foundation. AKD, NDA, NG, SN, FSB, and RRG are supported by funding from Tim Ferriss, Matt Mullenweg, Craig Nerenberg, Blake Mycoskie, the Steven and Alexandra Cohen Foundation. AKD, RL, and AWL are supported by the Center for Psychedelic Drug Research and Education in the College of Social Work at Ohio State University, funded by anonymous private donors. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. AKD and RL are board members of Source Research Foundation. AKD is a Lead Trainer at Fluence. FB is a scientific advisor for WavePaths, Ltd and Mindstate Design Labs, Inc, and has provided consultation services for Gilgamesh Pharmaceuticals, Inc. These organizations were not involved in the design/execution of this study or the interpretation or communication of findings.

References

  • 1.Carhart-Harris R, Bolstridge M, Rucker J, Day CMJ, Erritzoe D, Kaelen M, et al. Psilocybin with psychological support for treatment-resistant depression: an open-label feasibility study. Lancet Psychiatry. 2016. Jul 1;3(7):619–27. doi: 10.1016/S2215-0366(16)30065-7 [DOI] [PubMed] [Google Scholar]
  • 2.Carhart-Harris R, Giribaldi B, Watts R, Baker-Jones M, Murphy-Beiner A, Murphy R, et al. Trial of Psilocybin versus Escitalopram for Depression. N Engl J Med. 2021. Apr 15;384(15):1402–11. doi: 10.1056/NEJMoa2032994 [DOI] [PubMed] [Google Scholar]
  • 3.Davis AK, Barrett FS, May DG, Cosimano MP, Sepeda ND, Johnson MW, et al. Effects of Psilocybin-Assisted Therapy on Major Depressive Disorder. JAMA Psychiatry. 2021. May;78(5):1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Goodwin GM, Aaronson ST, Alvarez O, Arden PC, Baker A, Bennett JC, et al. Single-Dose Psilocybin for a Treatment-Resistant Episode of Major Depression. N Engl J Med. 2022. Nov 3;387(18):1637–48. doi: 10.1056/NEJMoa2206443 [DOI] [PubMed] [Google Scholar]
  • 5.Mitchell JM, Bogenschutz M, Lilienstein A, Harrison C, Kleiman S, Parker-Guilbert K, et al. MDMA-assisted therapy for severe PTSD: a randomized, double-blind, placebo-controlled phase 3 study. Nat Med. 2021. Jun;27(6):1025–33. doi: 10.1038/s41591-021-01336-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Bogenschutz MP, Ross S, Bhatt S, Baron T, Forcehimes AA, Laska E, et al. Percentage of Heavy Drinking Days Following Psilocybin-Assisted Psychotherapy vs Placebo in the Treatment of Adult Patients With Alcohol Use Disorder: A Randomized Clinical Trial. JAMA Psychiatry [Internet]. 2022. Aug 24 [cited 2022 Sep 7]; Available from: doi: 10.1001/jamapsychiatry.2022.2096 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Johnson MW, Garcia-Romeu A, Griffiths RR. Long-term follow-up of psilocybin-facilitated smoking cessation. Am J Drug Alcohol Abuse. 2017. Jan 2;43(1):55–60. doi: 10.3109/00952990.2016.1170135 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Griffiths RR, Johnson MW, Carducci MA, Umbricht A, Richards WA, Richards BD, et al. Psilocybin produces substantial and sustained decreases in depression and anxiety in patients with life-threatening cancer: A randomized double-blind trial. J Psychopharmacol Oxf Engl. 2016. Dec;30(12):1181–97. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Beyer SV. Singing to the plants: a guide to mestizo shamanism in the upper Amazon. 1. paperback print. Albuquerque: University of New Mexico Press; 2010. 530 p.
  • 10.Hartogsohn I. Constructing drug effects: A history of set and setting. Drug Sci Policy Law. 2017. Jan 1;3:2050324516683325. [Google Scholar]
  • 11.Leary T, Litwin GH, Metzner R. Reactions to psilocybin administered in a supportive environment. J Nerv Ment Dis. 1963;137(6):561–73. [DOI] [PubMed] [Google Scholar]
  • 12.Johnson MW, Richards WA, Griffiths RR. Human Hallucinogen Research: Guidelines for Safety. J Psychopharmacol Oxf Engl. 2008. Aug;22(6):603–20. doi: 10.1177/0269881108093587 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Reiff CM, Widge AS. Psychedelics and Psychedelic-Assisted Psychotherapy. Am J Psychiatry. 2020;20. [DOI] [PubMed] [Google Scholar]
  • 14.Roseman L, Preller KH, Fotiou E, Winkelman MJ. Editorial: Psychedelic sociality: Pharmacological and extrapharmacological perspectives. Front Pharmacol [Internet]. 2022. [cited 2023 Jan 13];13. Available from: https://www.frontiersin.org/articles/10.3389/fphar.2022.979764 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Yaden DB, Earp D, Graziosi M, Friedman-Wheeler D, Luoma JB, Johnson MW. Psychedelics and Psychotherapy: Cognitive-Behavioral Approaches as Default. Front Psychol [Internet]. 2022. [cited 2022 Sep 5];13. Available from: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.873279 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Johnson MW, Garcia-Romeu A, Cosimano MP, Griffiths RR. Pilot study of the 5-HT2AR agonist psilocybin in the treatment of tobacco addiction. J Psychopharmacol (Oxf). 2014. Nov 1;28(11):983–92. doi: 10.1177/0269881114548296 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Gukasyan N, Nayak SM. Psychedelics, placebo effects, and set and setting: Insights from common factors theory of psychotherapy. Transcult Psychiatry. 2021. Jan 26;1363461520983684. doi: 10.1177/1363461520983684 [DOI] [PubMed] [Google Scholar]
  • 18.Bordin ES. The generalizability of the psychoanalytic concept of the working alliance. Psychother Theory Res Pract. 1979;16:252–60. [Google Scholar]
  • 19.Horvath AO, Luborsky L. The role of the therapeutic alliance in psychotherapy. J Consult Clin Psychol. 1993;61:561–73. doi: 10.1037//0022-006x.61.4.561 [DOI] [PubMed] [Google Scholar]
  • 20.McWilliams N. Psychoanalytic psychotherapy: a practitioner’s guide. New York, NY: Guilford; 2004. 353 p. [Google Scholar]
  • 21.Baier AL, Kline AC, Feeny NC. Therapeutic alliance as a mediator of change: A systematic review and evaluation of research. Clin Psychol Rev. 2020. Dec 1;82:101921. doi: 10.1016/j.cpr.2020.101921 [DOI] [PubMed] [Google Scholar]
  • 22.Flückiger C, Del Re AC, Wampold BE, Horvath AO. The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy. 2018. Dec;55(4):316–40. doi: 10.1037/pst0000172 [DOI] [PubMed] [Google Scholar]
  • 23.Aday JS, Davis AK, Mitzkovitz CM, Bloesch EK, Davoli CC. Predicting Reactions to Psychedelic Drugs: A Systematic Review of States and Traits Related to Acute Drug Effects. ACS Pharmacol Transl Sci. 2021. Apr 9;4(2):424–35. doi: 10.1021/acsptsci.1c00014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Haijen ECHM, Kaelen M, Roseman L, Timmermann C, Kettner H, Russ S, et al. Predicting Responses to Psychedelics: A Prospective Study. Front Pharmacol [Internet]. 2018. [cited 2022 Aug 31];9. Available from: https://www.frontiersin.org/articles/10.3389/fphar.2018.00897 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Murphy R, Kettner H, Zeifman R, Giribaldi B, Kartner L, Martell J, et al. Therapeutic Alliance and Rapport Modulate Responses to Psilocybin Assisted Therapy for Depression. Front Pharmacol [Internet]. 2022. [cited 2022 Sep 7];12. Available from: https://www.frontiersin.org/articles/10.3389/fphar.2021.788155 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Romeo B, Hermand M, Pétillion A, Karila L, Benyamina A. Clinical and biological predictors of psychedelic response in the treatment of psychiatric and addictive disorders: A systematic review. J Psychiatr Res. 2021. May 1;137:273–82. doi: 10.1016/j.jpsychires.2021.03.002 [DOI] [PubMed] [Google Scholar]
  • 27.Yaden DB, Griffiths RR. The Subjective Effects of Psychedelics Are Necessary for Their Enduring Therapeutic Effects. ACS Pharmacol Transl Sci. 2020 Dec 10;acsptsci.0c00194. [DOI] [PMC free article] [PubMed]
  • 28.Davis AK, Barrett FS, Griffiths RR. Psychological flexibility mediates the relations between acute psychedelic effects and subjective decreases in depression and anxiety. J Context Behav Sci. 2020. Jan;15:39–45. doi: 10.1016/j.jcbs.2019.11.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Kleiger MJP. Beginnings: the art and science of planning psychotherapy. 2. ed. New York, NY: Routledge; 2012. 437 p.
  • 30.Yalom ID. The gift of therapy: an open letter to a new generation of therapists and their patients. Reissued. New York: Harper Perennial; 2017. 263 p. [Google Scholar]
  • 31.Hatcher RobertL Gillaspy JA. Development and validation of a revised short version of the working alliance inventory. Psychother Res. 2006. Jan;16(1):12–25. [Google Scholar]
  • 32.Horvath AO, Greenberg LS. The development of the Working Alliance Inventory. In: The psychotherapeutic process: A research handbook. New York, NY, US: Guilford Press; 1986. p. 529–56. (Guilford clinical psychology and psychotherapy series). [Google Scholar]
  • 33.Horvath AO, Greenberg LS. Development and validation of the Working Alliance Inventory. J Couns Psychol. 1989;36:223–33. [Google Scholar]
  • 34.Hamilton M. A Rating Scale for Depression. J Neurol Neurosurg Psychiatry. 1960. Feb 1;23(1):56–62. doi: 10.1136/jnnp.23.1.56 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Williams JBW, Kobak KA, Bech P, Engelhardt N, Evans K, Lipsitz J, et al. The GRID-HAMD: standardization of the Hamilton Depression Rating Scale. Int Clin Psychopharmacol. 2008. May;23(3):120–9. doi: 10.1097/YIC.0b013e3282f948f5 [DOI] [PubMed] [Google Scholar]
  • 36.Barrett FS, Johnson MW, Griffiths RR. Validation of the revised Mystical Experience Questionnaire in experimental sessions with psilocybin. J Psychopharmacol (Oxf). 2015. Nov 1;29(11):1182–90. doi: 10.1177/0269881115609019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Carbonaro TM, Johnson MW, Griffiths RR. Subjective features of the psilocybin experience that may account for its self-administration by humans: a double-blind comparison of psilocybin and dextromethorphan. Psychopharmacology (Berl). 2020. Aug 1;237(8):2293–304. doi: 10.1007/s00213-020-05533-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Dollinger SJ, Malmquist D. Reliability and validity of single-item self-reports: with special relevance to college students’ alcohol use, religiosity, study, and social life. J Gen Psychol. 2009. Jul;136(3):231–41. doi: 10.3200/GENP.136.3.231-242 [DOI] [PubMed] [Google Scholar]
  • 39.Van den Brink WP. The robustness of the t test of the correlation coefficient and the need for simulation studies. Br J Math Stat Psychol. 1988;41(2):251–6. [Google Scholar]
  • 40.Havlicek LL, Peterson NL. Effect of the violation of assumptions upon significance levels of the Pearson r. Psychol Bull. 1977;84(2):373–7. [Google Scholar]
  • 41.Edgell SE, Noon SM. Effect of violation of normality on the t test of the correlation coefficient. Psychol Bull. 1984;95(3):576–83. [Google Scholar]
  • 42.IBM. SPSS Statistics for Windows. Armonk, NY: IBM Corp; 2021.
  • 43.Falkenström F, Ekeblad A, Holmqvist R. Improvement of the working alliance in one treatment session predicts improvement of depressive symptoms by the next session. J Consult Clin Psychol. 2016. Aug;84(8):738–51. doi: 10.1037/ccp0000119 [DOI] [PubMed] [Google Scholar]
  • 44.Flückiger C, Rubel J, Del Re AC, Horvath AO, Wampold BE, Crits-Christoph P, et al. The reciprocal relationship between alliance and early treatment symptoms: A two-stage individual participant data meta-analysis. J Consult Clin Psychol. 2020. Sep;88(9):829–43. doi: 10.1037/ccp0000594 [DOI] [PubMed] [Google Scholar]
  • 45.Flückiger C, Del Re AC, Wlodasch D, Horvath AO, Solomonov N, Wampold BE. Assessing the alliance-outcome association adjusted for patient characteristics and treatment processes: A meta-analytic summary of direct comparisons. J Couns Psychol. 2020. Nov;67(6):706–11. doi: 10.1037/cou0000424 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Horvath AO, Del Re AC, Flückiger C, Symonds D. Alliance in individual psychotherapy. Psychotherapy. 2011;48(1):9–16. doi: 10.1037/a0022186 [DOI] [PubMed] [Google Scholar]
  • 47.Martin DJ, Garske JP, Davis MK. Relation of the therapeutic alliance with outcome and other variables: A meta-analytic review. J Consult Clin Psychol. 2000;68:438–50. [PubMed] [Google Scholar]
  • 48.Cameron SK, Rodgers J, Dagnan D. The relationship between the therapeutic alliance and clinical outcomes in cognitive behaviour therapy for adults with depression: A meta-analytic review. Clin Psychol Psychother. 2018;25(3):446–56. doi: 10.1002/cpp.2180 [DOI] [PubMed] [Google Scholar]
  • 49.Muthukumaraswamy SD, Forsyth A, Lumley T. Blinding and expectancy confounds in psychedelic randomized controlled trials. Expert Rev Clin Pharmacol. 2021. Sep 2;14(9):1133–52. doi: 10.1080/17512433.2021.1933434 [DOI] [PubMed] [Google Scholar]
  • 50.Alodaibi F, Beneciuk J, Holmes R, Kareha S, Hayes D, Fritz J. The Relationship of the Therapeutic Alliance to Patient Characteristics and Functional Outcome During an Episode of Physical Therapy Care for Patients With Low Back Pain: An Observational Study. Phys Ther. 2021. Apr 1;101(4):pzab026. doi: 10.1093/ptj/pzab026 [DOI] [PubMed] [Google Scholar]
  • 51.Gómez Penedo JM, Babl AM, Holtforth M grosse, Hohagen F, Krieger T, Lutz W, et al. The Association of Therapeutic Alliance With Long-Term Outcome in a Guided Internet Intervention for Depression: Secondary Analysis From a Randomized Control Trial. J Med Internet Res. 2020. Mar 24;22(3):e15824. doi: 10.2196/15824 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Hagen K, Solem S, Opstad HB, Vogel PA, Ottesen Kennair LE, Kvale G, et al. Therapist Variability in the Task/Goal Dimension of the Early Working Alliance Predicts Outcome in Exposure and Response Prevention Treatment for Obsessive-Compulsive Disorder. Clin Neuropsychiatry. 2016. Dec;13(6):94–9. [Google Scholar]
  • 53.Huppert JD, Kivity Y, Barlow DH, Gorman JM, Shear MK, Woods SW. Therapist effects and the outcome–alliance correlation in cognitive behavioral therapy for panic disorder with agoraphobia. Behav Res Ther. 2014. Jan 1;52:26–34. doi: 10.1016/j.brat.2013.11.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Webb CA, DeRubeis RJ, Amsterdam JD, Shelton RC, Hollon SD, Dimidjian S. Two Aspects of the Therapeutic Alliance: Differential Relations with Depressive Symptom Change. J Consult Clin Psychol. 2011. Jun;79(3):279–83. doi: 10.1037/a0023252 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Wheaton MG, Huppert JD, Foa EB, Simpson HB. HOW IMPORTANT IS THE THERAPEUTIC ALLIANCE IN TREATING OBSESSIVE-COMPULSIVE DISORDER WITH EXPOSURE AND RESPONSE PREVENTION? AN EMPIRICAL REPORT. Clin Neuropsychiatry. 2016. Dec;13(6):88–93. [PMC free article] [PubMed] [Google Scholar]
  • 56.Grof S. Realms of the Human Unconscious: Observations from LSD Research. Main edition. Souvenir Press; 2019. 320 p.
  • 57.Tafur J, Maté G. The Fellowship of the River: A Medical Doctor’s Exploration into Traditional Amazonian Plant Medicine. Espiritu Books and Joseph Tafur; 2017. 290 p.
  • 58.de D Pontual AA, Tófoli LF, Corradi-Webster CM, van Oorsouw K, Delgado ARO, Ramaekers JG. The influence of ceremonial settings on mystical and challenging experiences occasioned by ayahuasca: A survey among ritualistic and religious ayahuasca users. Front Psychol [Internet]. 2022. [cited 2022 Dec 7];13. Available from: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.857372. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Kettner H, Rosas FE, Timmermann C, Kärtner L, Carhart-Harris RL, Roseman L. Psychedelic Communitas: Intersubjective Experience During Psychedelic Group Sessions Predicts Enduring Changes in Psychological Wellbeing and Social Connectedness. Front Pharmacol [Internet]. 2021. [cited 2022 Sep 4];12. Available from: https://www.frontiersin.org/articles/10.3389/fphar.2021.623985 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Herrmann Z, Earleywine M, De Leo J, Slabaugh S, Kenny T, Rush AJ. Scoping Review of Experiential Measures from Psychedelic Research and Clinical Trials. J Psychoactive Drugs. 2022. Sep 20;1–17. doi: 10.1080/02791072.2022.2125467 [DOI] [PubMed] [Google Scholar]
  • 61.Nikolaidis A, Lancelotta R, Gukasyan N, Griffiths RR, Barrett FS, Davis AK. Subtypes of the psychedelic experience have reproducible and predictable effects on depression and anxiety symptoms. J Affect Disord. 2023. Mar 1;324:239–49. doi: 10.1016/j.jad.2022.12.042 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Passie T, Guss J, Krähenmann R. Lower-dose psycholytic therapy–A neglected approach. Front Psychiatry [Internet]. 2022. [cited 2022 Dec 19];13. Available from: https://www.frontiersin.org/articles/10.3389/fpsyt.2022.1020505 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Oehen P, Gasser P. Using a MDMA- and LSD-Group Therapy Model in Clinical Practice in Switzerland and Highlighting the Treatment of Trauma-Related Disorders. Front Psychiatry [Internet]. 2022. [cited 2022 Dec 19];13. Available from: https://www.frontiersin.org/articles/10.3389/fpsyt.2022.863552 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Pokorny T, Preller KH, Kometer M, Dziobek I, Vollenweider FX. Effect of Psilocybin on Empathy and Moral Decision-Making. Int J Neuropsychopharmacol. 2017. Sep 1;20(9):747–57. doi: 10.1093/ijnp/pyx047 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Watts R, Day C, Krzanowski J, Nutt D, Carhart-Harris R. Patients’ accounts of increased “connectedness” and “acceptance” after psilocybin for treatment-resistant depression. J Humanist Psychol. 2017;57:520–64. [Google Scholar]
  • 66.Preller KH, Pokorny T, Hock A, Kraehenmann R, Stämpfli P, Seifritz E, et al. Effects of serotonin 2A/1A receptor stimulation on social exclusion processing. Proc Natl Acad Sci U S A. 2016. May 3;113(18):5119–24. doi: 10.1073/pnas.1524187113 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Mason NL, Mischler E, Uthaug MV, Kuypers KPC. Sub-Acute Effects of Psilocybin on Empathy, Creative Thinking, and Subjective Well-Being. J Psychoactive Drugs. 2019. Mar 15;51(2):123–34. doi: 10.1080/02791072.2019.1580804 [DOI] [PubMed] [Google Scholar]
  • 68.Stauffer CS, Anderson BT, Ortigo KM, Woolley J. Psilocybin-Assisted Group Therapy and Attachment: Observed Reduction in Attachment Anxiety and Influences of Attachment Insecurity on the Psilocybin Experience. ACS Pharmacol Transl Sci. 2021. Apr 9;4(2):526–32. doi: 10.1021/acsptsci.0c00169 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Stolaroff MJ. Thanatos to Eros: thirty five years of psychedelic exploration. Berlin: VWB, Verl. für Wiss. und Bildung; 1994. 192 p. (Reihe Ethnomedizin und Bewußtseinsforschung).
  • 70.Noorani T. Making psychedelics into medicines: The politics and paradoxes of medicalization. J Psychedelic Stud. 2020. Mar 1;4(1):34–9. [Google Scholar]
  • 71.Phelps J, Henry J. Foundations for Training Psychedelic Therapists. Curr Top Behav Neurosci. 2022;56:93–109. doi: 10.1007/7854_2021_266 [DOI] [PubMed] [Google Scholar]
  • 72.Gramling R, Bennett E, Curtis K, Richards W, Rizzo DM, Arnoldy F, et al. Developing a Direct Observation Measure of Therapeutic Connection in Psilocybin-Assisted Therapy: A Feasibility Study. J Palliat Med. 2023. Aug 17. doi: 10.1089/jpm.2023.0189 [DOI] [PubMed] [Google Scholar]
  • 73.Mithoefer MC. A Manual for MDMA-Assisted Psychotherapy in the Treatment of Posttraumatic Stress Disorder. 2016. [DOI] [PMC free article] [PubMed]
  • 74.Earleywine M, Low F, Altman BR, De Leo J. How Important Is a Guide Who Has Taken Psilocybin in Psilocybin-Assisted Therapy for Depression? J Psychoactive Drugs. 2022. Mar 23;1–11. doi: 10.1080/02791072.2022.2047842 [DOI] [PubMed] [Google Scholar]
  • 75.MAPS. MAPS Wins Appeal and Authorization to Study MDMA in Healthy Volunteer Therapists [Internet]. Multidisciplinary Association for Psychedelic Studies—MAPS. 2021 [cited 2022 Dec 29]. https://maps.org/news/media/maps-wins-appeal-and-authorization-to-study-mdma-in-healthy-volunteer-therapists/.
  • 76.Nielson EM, Guss J. The influence of therapists’ first-hand experience with psychedelics on psychedelic-assisted psychotherapy research and therapist training. J Psychedelic Stud. 2018. Dec 1;2(2):64–73. [Google Scholar]
  • 77.Peill JM, Trinci KE, Kettner H, Mertens LJ, Roseman L, Timmermann C, et al. Validation of the Psychological Insight Scale: A new scale to assess psychological insight following a psychedelic experience. J Psychopharmacol Oxf Engl. 2022. Jan;36(1):31–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Davis AK, Barrett FS, So S, Gukasyan N, Swift TC, Griffiths RR. Development of the Psychological Insight Questionnaire among a sample of people who have consumed psilocybin or LSD. J Psychopharmacol (Oxf). 2021. Apr 1;35(4):437–46. doi: 10.1177/0269881120967878 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Kamilar-Britt P, Gordis EB, Earleywine M. The Therapeutic Alliance in Psychedelic-Assisted Psychotherapy: A Novel Target for Research and Interventions. Psychedelic Med [Internet]. 2023. Aug 18 [cited 2023 Nov 6]; Available from: https://www.liebertpub.com/doi/10.1089/psymed.2023.0020. [Google Scholar]
  • 80.Behn A, Davanzo A, Errázuriz P. Client and therapist match on gender, age, and income: Does match within the therapeutic dyad predict early growth in the therapeutic alliance? J Clin Psychol. 2018;74(9):1403–21. doi: 10.1002/jclp.22616 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Herb Covington

30 Nov 2023

PONE-D-23-21083The therapeutic alliance between study participants and intervention facilitators is associated with acute effects and clinical outcomes in a psilocybin-assisted therapy trial for Major Depressive DisorderPLOS ONE

Dear Dr. Davis,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

 Three reviewers have made helpful comments to increase the reach of your paper at PLoS One. Reviewer One, in particular, has provided an excellent and detailed list of comments. Reviewer Three captures the essence of comments made by Reviewer Two, and thus addresses those primary concerns about the sample size and how to approach the data analyses sufficiently. Therefore, when resubmitting please outline your responses and edits according to only Reviewer's 1 & 3.

Please submit your revised manuscript by Jan 12 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Herb Covington, Ph.D.

Academic Editor

PLOS ONE

Additional Comments from Editor: Please note that I have acted as a reviewer for this manuscript, and you will find my comments below, under Reviewer 3.

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Competing Interests section:

“AKD and RL are on the board of Source Research Foundation. RRG is on the board of the Heffter Research Institute. AKD is a lead trainer at Fluence.”

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: I Don't Know

Reviewer #3: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This paper is delightful. As the authors emphasize, the work is essential, fills a relevant gap, and addresses a key issue empirically in ways few other studies have. The Introduction motivates the analysis superbly. The consistent reporting of effect sizes is most welcome. The Discussion underscores the essential take-home messages well while touching on the necessary limitations of the current data. I’m trying to take the perspective of the folks who recently asserted, in so many words, that we really just need to keep folks safe during the acute effects and that’ll do the trick. I think that one statistical issue will be critical. I’ve identified a few points that might generate more criticism than the authors want as well.

1. Readers are bound to wonder if a handful of outliers are driving the whole effect. I don’t need a Florence Nightingale Rose or Violin Plot, but the authors should report the skew for anything where they use a Pearson’s or t-test. Anything over an absolute value of 1 will probably need a transformation or a non-parametric alternative or some other strategy to sidestep the issue. (With an N this small, the statistical tests for violations of normality will never reach significance, but they’re ass backwards anyway.) Detailed rationale and potential interventions or transformations appear in:

Osborne JW. Best practices in data cleaning: A complete guide to everything you need to do before and after collecting your data. Sage publications; 2012 Jan 10.

I would guess that anchoring at 1 and taking a log or square-root would not seem to abstruse for most readers.

I’ve got shpilkes about a few other issues, but in PLOS, these potential changes are really the authors’ call:

2. The writing is completely on par with the quality in our field—a low bar. If the authors would consider eschewing passive constructions and grammatical expletives, readability would improve. The word “this” without a definite antecedent, also interrupts the flow. I am guessing that the published version will generate more attention with some tightening. These steps alone would make the Abstract more accessible and provide space to show more details or enthusiasm. Take this paragraph from the Discussion:

Although the model outlined above is well supported by our findings, there is also evidence for reverse causality (i.e., that the acute psychedelic experience enhances the therapeutic alliance). This could be explained by the findings that psilocybin enhances emotional empathy [61] and feelings of connectedness [55,62], and reduces subjective and neurological responses to social exclusion [63]. Furthermore, there is evidence that these effects persist well beyond the acute drug effect [64], and may lead to more secure attachment patterns [60]. In our analysis, peak ratings of acute effects were correlated with a stronger alliance reported one week following the second psilocybin session. Although our analysis cannot reveal causality in this direction, Murphy et al., (2022) were able to demonstrate that the strength of emotional breakthrough in the first psilocybin session predicted improvements in the alliance reported prior to the second session. Taken together, this evidence suggests that psilocybin may work to directly enhance the alliance reported by participants, both acutely and over the longer time course of an intervention.

Perhaps this version reads easier:

Our findings strongly support the model outlined above, showing evidence for reverse causality—specifically, the acute psychedelic experience enhances the therapeutic alliance. Psilocybin's ability to enhance emotional empathy and feelings of connectedness, along with its reduction of subjective and neurological responses to social exclusion, might explain this phenomenon. These effects not only persist but may also foster more secure attachment patterns. In our study, stronger alliances one week after the second psilocybin session correlated with higher peak ratings of acute effects. Murphy et al. (2022) also found that stronger emotional breakthroughs in the first psilocybin session predicted better alliances before the second session. Collectively, this result suggests that psilocybin could directly and progressively enhance the therapeutic alliance.

See what I mean? I think it’s 40 words shorter. Reading it aloud is more pleasant.

3. INTRO. The single-item indicator is bound to generate some concern and skepticism. The authors might want to mention this paper or comparable ones supporting the validity of single-item measures.

Dollinger, S. J., & Malmquist, D. (2009). Reliability and validity of single-item self-reports: with special relevance to college students' alcohol use, religiosity, study, and social life. The Journal of General Psychology, 136(3), 231-242.

4. INTRO The authors might want to mention these publications, some of which might not have appeared at the time of submission, for the sake of comprehensiveness.

Gramling, R., Bennett, E., Curtis, K., Richards, W., Rizzo, D. M., Arnoldy, F., ... & Agrawal, M. (2023). Developing a Direct Observation Measure of Therapeutic Connection in Psilocybin-Assisted Therapy: A Feasibility Study. Journal of Palliative Medicine.

As the title emphasizes, this paper points out a way to sidestep one of the shortcomings of the current data.

Kamilar-Britt P, Gordis EB, Earleywine M. The Therapeutic Alliance in Psychedelic-Assisted Psychotherapy: A Novel Target for Research and Interventions. Psychedelic Medicine. 2023 Aug 18.

This paper also shows the need for multiple raters on the alliance measures.

5. The writing is completely comparable to published work in our field—a very low bar. Changing passive constructions to active voice and eliminating grammatical expletives would improve readability. This paragraph from the Discussion might prove illustrative:

Although the model outlined above is well supported by our findings, there is also evidence for reverse causality (i.e., that the acute psychedelic experience enhances the therapeutic alliance). This could be explained by the findings that psilocybin enhances emotional empathy [61] and feelings of connectedness [55,62], and reduces subjective and neurological responses to social exclusion [63]. Furthermore, there is evidence that these effects persist well beyond the acute drug effect [64], and may lead to more secure attachment patterns [60]. In our analysis, peak ratings of acute effects were correlated with a stronger alliance reported one week following the second psilocybin session. Although our analysis cannot reveal causality in this direction, Murphy et al., (2022) were able to demonstrate that the strength of emotional breakthrough in the first psilocybin session predicted improvements in the alliance reported prior to the second session. Taken together, this evidence suggests that psilocybin may work to directly enhance the alliance reported by participants, both acutely and over the longer time course of an intervention. (169 words)

Our findings strongly support the model outlined above, showing evidence for reverse causality—specifically, the acute psychedelic experience enhances the therapeutic alliance. Psilocybin's ability to enhance emotional empathy and feelings of connectedness, as well as to reduce subjective and neurological responses to social exclusion, explains this relationship. These effects not only persist well beyond the acute drug effect but also potentially foster more secure attachment patterns. Our analysis correlates peak ratings of acute effects with a stronger alliance reported one week after the second psilocybin session. Murphy et al., (2022) demonstrated that the strength of emotional breakthrough in the first psilocybin session predicted improvements in the alliance before the second session. This evidence collectively suggests that psilocybin directly enhances the alliance that participants report, both in the short term and over the course of the intervention. (136 words)

6. METHODS- McDonald’s Omega has become the standard on internal consistency now, in part because the approach requires fewer assumptions. I’m pretty sure SPSS has the option in a straightforward way. Details appear in:

Hayes AF, Coutts JJ. Use omega rather than Cronbach’s alpha for estimating reliability. But…. Communication Methods and Measures. 2020 Jan 2;14(1):1-24.

These authors walk through the issue related to assumptions of tau-equivalence, not that the current paper needs those details.

7. RESULTS- I’m not enjoying the “small,” “medium,” and “large” designations with the effect sizes in the tables. Cohen would admit that he literally pulled the distinctions from thin air and the significance designations certainly help get the point across.

8. DISCUSSION- I think the expression “reverse causality” is ill-advised here. More readers will grow confused than entertained or enlightened.

Reviewer #2: Important note: This review pertains only to ‘statistical aspects’ of the study and so ‘clinical aspects’ [like medical importance, relevance of the study, ‘clinical significance and implication(s)’ of the whole study, etc.] are to be evaluated [should be assessed] separately/independently. Further please note that any ‘statistical review’ is generally done under the assumption that (such) study specific methodological [as well as execution] issues are perfectly taken care of by the investigator(s). This review is not an exception to that and so does not cover clinical aspects {however, seldom comments are made only if those issues are intimately / scientifically related & intermingle with ‘statistical aspects’ of the study}. Agreed that ‘statistical methods’ are used as just tools here, however, they are vital part of methodology [and so should be given due importance]. I look at the manuscript in/with statistical view point, other reviewer(s) look(s) at it with different angle so that in totality the review is very comprehensive. However, there should be efforts from authors side to improve (may be by taking clues from reviewer’s comments). Therefore, please do not limit the revision only (with respect) to comments made here.

COMMENTS: I note your ABSTRACT is well drafted (in my opinion), but is ‘assay type’. It is preferable [refer to item 1b of CONSORT checklist 2010: Structured summary of trial design, methods, results, and conclusions] to divide the ABSTRACT with small sections like ‘Objective(s)’, ‘Methods’, ‘Results’, ‘Conclusions’, etc. which is an accepted practice of most of the good/standard journals [including this one, though ‘The PLoS One Guidelines to Authors’ did not specify an Abstract format, it is desirable]. It will definitely be more informative then, I guess, whatever the article type may be.

Although your article is classified as “Article Type: Research Article” you described the study as “randomized, waiting list-controlled clinical trial” (lines 44-45). Moreover, you have not given/discussed ‘How the required minimum sample size for this study was determined’ which nevertheless is a very-very important question [one of the important items in CONSORT checklist, item 7a] for any type of study (clinical trial or else). This point needs to be discussed in adequate details {including assumptions made at the time of estimation, power (confidence/accuracy/precision in case of single-arm/group studies) of the study, software used, etc.}. Even if this is a sort of off-shoot study of some main (published) study [Effects of Psilocybin-Assisted Therapy on Major Depressive Disorder. JAMA Psychiatry. 2021 May;78(5):1–9], this one being an independent publication, you are expected to cover these details {strangely, such details are not even covered in that paper as well}.

Further though you have clarified/admitted (lines 261-62: It is possible that, given the small sample size, these correlations were influenced by outliers in our sample), one should keep in mind that highly significant (large) value of ‘Pearson’s correlation coefficient’ alone does not imply cause-effect relationship. There are other certain criteria which are to be considered before making any causal inference(s). As ‘P-value’ heavily depends on sample size, it is customary to use the (available in most text books on ‘Biostatistics’ or on ‘www/net’) guidelines [very strongly suggesting] to consider an absolute value of ‘Correlation coefficient’ for interpreting positive or negative correlations (and do not rely only on corresponding ‘P’-value but also consider an absolute value of ‘Correlation coefficient’). [This argument is equally applicable to non-parametric Spearman’s ‘Correlation coefficient (ρ)’ as well.]

As you may already know that “all ‘Clinical Trials’ must follow CONSORT guidelines”. Since you described the study as ‘Clinical Trial’, you are supposed to cover these items in the report. Other important items (other than randomization) are ‘How sample size was determined (Item 7a), Allocation concealment (Item 9), Blinding (Item 11a)} of/in CONSORT checklist which are not adequately described/found in the manuscript. An important word ‘CONSORT’ itself does not appear.

I am sorry to note that my search on WWW/NET reveals that “psilocybin-assisted therapy (PAT) is currently not a standard medical practice – in many parts of the world, it is considered illegal” [update on 07-Jul-2022]. If that is true, my question is “how does it matter 1. if the therapeutic alliance between study participants and intervention facilitators in a psilocybin-assisted therapy (PAT) or 2. if there are relationships between alliance, acute psilocybin experiences, and depression outcomes?”. Unfortunately, I do not understand medical/clinical implications of it but further my search reveals that “Psilocybin is a hallucinogenic chemical found in certain types of mushrooms (sometimes referred to as magic mushrooms). Psilocybin has been shown to produce feelings of euphoria and sensory distortions that are similar to those produced by hallucinogenic drugs like LSD {which is considered to be a very strong hallucinogen}” and that is not desirable, in my knowledge. However, there are/were few very encouraging evidences/studies [example: BMJ Open. 2021; 11(12): e056091. Published online 2021 Dec 1. doi: 10.1136/bmjopen-2021-056091]. No definite answer/conclusion. But any case, authors should adequately discuss this point. Some discussion appears in ‘Introduction’ section (example: lines 85-91), however, that may not suffice.

Please note that, although the measures/tools used are [seems to be] appropriate {like Working Alliance Inventory-Short Revised (WAI-SR), GRID-HAMD, Mystical Experience Questionnaire (MEQ30)}, most of them are likely to yield data that are in ‘ordinal’ level of measurement [and not in ratio level of measurement for sure {as the score two times higher does not indicate presence of that parameter/phenomenon as double (for example, a Visual Analogue Scales VAS score or say ‘depression’ score)}]. Then application of suitable non-parametric (or distribution free) test(s) is/are indicated/advisable [even if distribution may be ‘Gaussian’ (also called ‘normal’)]. Use Mann-Whitney test instead of unpaired ‘t’ test, Spearman’s Correlation Coefficient instead of Pearson’s Correlation Coefficient [even if you get the same/similar results, you are expected to use a right/correct/indicated technique]. Agreed that there is/are no non-parametric test(s)/technique(s) available to be used as alternative in all situation(s), but should be used whenever/wherever they are available. Therefore, in short use suitable non-parametric test(s)/technique(s) while dealing with data that are in ‘ordinal’ level of measurement even if [despite that] the distribution may be ‘Gaussian’. Testing ‘normality’ in sample [by using any normality test(s)} is not required/desired while dealing with data that are in ‘ordinal’ level of measurement [as most of the normality tests are not valid for ‘ordinal’ data].

Though few limitations of the study are mentioned/listed in a section ‘Limitations’ [lines 396 onwards], one very important limitation (namely small sample size) is surprisingly missing. As pointed out in ‘important note’ above “This review pertains only to ‘statistical aspects’ of the study and so ‘clinical aspects’ should be assessed separately/independently [one should carefully consider/look at the clinical implications of the study]. In my opinion, to make this article acceptable (which is quite possible and easy), some amount of re-vision (re-drafting) may be needed. However, please do not limit the revision only (with respect) to comments made here. More improvement is expected. The respected ‘Editor’ may consider accepting/further processing only if found ‘clinical implications’ valuable [i.e., add(s) to clinical knowledge or positively influence clinical practice]. ‘Major revision’ is recommended.

Reviewer #3: The authors provide a nice analysis of human depression scores that emphasizes a relationship between environmental factors (therapeutic alliance) and drug effects (psilocybin-assisted therapy) in clinical population.

My only concerns are the small sample size and the reliance on parametric statistical analyses to assess meaningful relationships:

1. I suggest bolstering the current piece by providing more details to the Methods Section. Specifically, the design of this study, the rationale for the number of subjects selected, and the tools/software used to generate planned analyses should include more details.

2. The authors should carefully consider alternatives to the current use of parametric analyses where the n is small and the range of values is large.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Mar 14;19(3):e0300501. doi: 10.1371/journal.pone.0300501.r002

Author response to Decision Letter 0


17 Jan 2024

Reviewer #1:

This paper is delightful. As the authors emphasize, the work is essential, fills a relevant gap, and addresses a key issue empirically in ways few other studies have. The Introduction motivates the analysis superbly. The consistent reporting of effect sizes is most welcome. The Discussion underscores the essential take-home messages well while touching on the necessary limitations of the current data. I’m trying to take the perspective of the folks who recently asserted, in so many words, that we really just need to keep folks safe during the acute effects and that’ll do the trick. I think that one statistical issue will be critical. I’ve identified a few points that might generate more criticism than the authors want as well.

1. Readers are bound to wonder if a handful of outliers are driving the whole effect. I don’t need a Florence Nightingale Rose or Violin Plot, but the authors should report the skew for anything where they use a Pearson’s or t-test. Anything over an absolute value of 1 will probably need a transformation or a non-parametric alternative or some other strategy to sidestep the issue. (With an N this small, the statistical tests for violations of normality will never reach significance, but they’re ass backwards anyway.) Detailed rationale and potential interventions or transformations appear in:

Osborne JW. Best practices in data cleaning: A complete guide to everything you need to do before and after collecting your data. Sage publications; 2012 Jan 10.

I would guess that anchoring at 1 and taking a log or square-root would not seem to abstruse for most readers.

Author Response: We thank the reviewer for this suggestion. Given the evidence that shows that Pearson correlations and t-tests are robust against violations of the normal distribution of scores and given that this study is a secondary data analysis from one very small clinical trial which is meant to be exploratory and hypothesis-generating (and not a definitive answer to this research question), we have chosen not to change our analytic method. However, we added details about this rationale to the methods section (lines 186-190) and we added this as a limitation of this study in the discussion section (lines 865-876).

2. The writing is completely on par with the quality in our field—a low bar. If the authors would consider eschewing passive constructions and grammatical expletives, readability would improve. The word “this” without a definite antecedent, also interrupts the flow. I am guessing that the published version will generate more attention with some tightening. These steps alone would make the Abstract more accessible and provide space to show more details or enthusiasm.

Author Response: We appreciate the stylistic guidance and agree that readability could be improved. As such, we have attempted to remove passive constructions and grammatical expletives throughout the manuscript and to cut words for clarity and to improve flow where possible. In service of this goal, we also replaced the term “psychedelic-assisted psychotherapy” with PAT throughout the manuscript. We also included those recommended edits in Paragraph 7 of the Discussion (lines 806-816), as we believe it significantly enhances readability.

Introduction

3. The single-item indicator is bound to generate some concern and skepticism. The authors might want to mention this paper or comparable ones supporting the validity of single-item measures.

Dollinger, S. J., & Malmquist, D. (2009). Reliability and validity of single-item self-reports: with special relevance to college students' alcohol use, religiosity, study, and social life. The Journal of General Psychology, 136(3), 231-242.

Author Response: We agree that the single-item indicator is worth addressing in more detail. We included an explanation/justification in both the Methods (Lines 179-181) and the Limitations section (Lines 825-845) using the reference you provided above. We also added two additional references (refs. 74, 75) highlighting recently validated (since this study) insight scales for psychedelic therapy.

4. The authors might want to mention these publications, some of which might not have appeared at the time of submission, for the sake of comprehensiveness.

Gramling, R., Bennett, E., Curtis, K., Richards, W., Rizzo, D. M., Arnoldy, F., ... & Agrawal, M. (2023). Developing a Direct Observation Measure of Therapeutic Connection in Psilocybin-Assisted Therapy: A Feasibility Study. Journal of Palliative Medicine.

As the title emphasizes, this paper points out a way to sidestep one of the shortcomings of the current data.

Kamilar-Britt P, Gordis EB, Earleywine M. The Therapeutic Alliance in Psychedelic-Assisted Psychotherapy: A Novel Target for Research and Interventions. Psychedelic Medicine. 2023 Aug 18.

This paper also shows the need for multiple raters on the alliance measures.

Author Response: Thank you for bringing our attention to these highly relevant recent publications. We felt that they were most appropriately incorporated into the Discussion and Limitations sections. We added the Gramling et al. 2023 citation in our discussion of measuring and defining the therapeutic alliance in psychedelic assisted therapy (Lines 809-814). We added the Kamilar-Britt et al. 2023 paper in the Limitations section (Lines 855-857), suggesting future studies incorporate multiple raters (including third-party).

5. The writing is completely comparable to published work in our field—a very low bar. Changing passive constructions to active voice and eliminating grammatical expletives would improve readability.

Author Response: This has been incorporated throughout as mentioned above.

Methods

6. McDonald’s Omega has become the standard on internal consistency now, in part because the approach requires fewer assumptions. I’m pretty sure SPSS has the option in a straightforward way. Details appear in:

Hayes AF, Coutts JJ. Use omega rather than Cronbach’s alpha for estimating reliability. But…. Communication Methods and Measures. 2020 Jan 2;14(1):1-24.

These authors walk through the issue related to assumptions of tau-equivalence, not that the current paper needs those details.

Author Response: Thank you for this suggestion. However, this statistic has not become the standard in our discipline, and we believe that the alpha value is a better way to communicate the internal consistency of our scales.

Results

7. I’m not enjoying the “small,” “medium,” and “large” designations with the effect sizes in the tables. Cohen would admit that he literally pulled the distinctions from thin air and the significance designations certainly help get the point across.

Author Response: Thank you for your comment. Although, possibly arbitrary, the ranking of effect sizes is still widely accepted in the field and offers useful context to readers who are unfamiliar with statistics. That said, we agree that including these distinctions within the table is unnecessary and distracting. Therefore, we have removed them from the table and maintained the footnote to aid in interpretation.

Discussion

8. I think the expression “reverse causality” is ill-advised here. More readers will grow confused than entertained or enlightened

Author Response: We removed this term in favor of a more clear and concise statement (line 697-698): “Our findings also strongly suggest that the acute psychedelic experience directly enhances the therapeutic alliance.”

Reviewer #3:

Comment: The authors provide a nice analysis of human depression scores that emphasizes a relationship between environmental factors (therapeutic alliance) and drug effects (psilocybin-assisted therapy) in clinical population. My only concerns are the small sample size and the reliance on parametric statistical analyses to assess meaningful relationships:

1. I suggest bolstering the current piece by providing more details to the Methods Section. Specifically, the design of this study, the rationale for the number of subjects selected, and the tools/software used to generate planned analyses should include more details.

Author Response: We have added details to the methods section, including the design of the study and the rationale for choosing the sample size (lines 124-130). We have provided the software that we used (SPSS) in the analysis description. There were no other tools/software used in this analysis.

2. The authors should carefully consider alternatives to the current use of parametric analyses where the n is small and the range of values is large.

Author Response: We have addressed a similar concern provided by reviewer #1. Given the evidence that shows that Pearson correlations and t-tests are robust against violations of the normal distribution of scores and given that this study is a secondary data analysis from one very small clinical trial which is meant to be exploratory and hypothesis-generating (and not a definitive answer to this research question), we have chosen not to change our analytic method. However, we added details about this rationale to the methods section and we added this as a limitation of this study in the discussion section.

Attachment

Submitted filename: Responses to Reviewers 1.16.24.docx

pone.0300501.s001.docx (20.5KB, docx)

Decision Letter 1

Herb Covington

29 Feb 2024

The therapeutic alliance between study participants and intervention facilitators is associated with acute effects and clinical outcomes in a psilocybin-assisted therapy trial for Major Depressive Disorder

PONE-D-23-21083R1

Dear Dr. Davis,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. We appreciate your careful consideration of the initial feedback by Reviewer 1 and myself. I am in line with your revisions & rationale for the originally chosen use of statistics provided to make assertions about the relationships between Therapeutic Alliance and Mystical or Insight Effects. Your study reads well and provides insightful considerations for a burgeoning therapeutic intervention.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Herb Covington, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Herb Covington

5 Mar 2024

PONE-D-23-21083R1

PLOS ONE

Dear Dr. Davis,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Herb Covington

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Responses to Reviewers 1.16.24.docx

    pone.0300501.s001.docx (20.5KB, docx)

    Data Availability Statement

    Data Availability: All relevant data are available on the Open Science Framework public repository at https://osf.io/speqc/?view_only=90add9a193b04fa9ba3c5865c3bc15fb Identifier: DOI 10.17605/OSF.IO/SPEQC.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES