Skip to main content
European Journal of Psychotraumatology logoLink to European Journal of Psychotraumatology
. 2016 Sep 6;7:10.3402/ejpt.v7.31712. doi: 10.3402/ejpt.v7.31712

Exposing therapists to trauma-focused treatment in psychosis: effects on credibility, expected burden, and harm expectancies

David P G van den Berg 1,*, Berber M van der Vleugel 2, Paul AJM de Bont 3, Gwen Thijssen 1, Carlijn de Roos 4, Rianne de Kleine 5,6, Tamar Kraan 1, Helga Ising 1, Ad de Jongh 7,8, Agnes van Minnen 5,6, Mark van der Gaag 1,9
PMCID: PMC5015638  PMID: 27606710

Abstract

Background

Despite robust empirical support for the efficacy of trauma-focused treatments, the dissemination proves difficult, especially in relation to patients with comorbid psychosis. Many therapists endorse negative beliefs about the credibility, burden, and harm of such treatment.

Objective

This feasibility study explores the impact of specialized training on therapists’ beliefs about trauma-focused treatment within a randomized controlled trial.

Method

Therapist-rated (n=16) credibility, expected burden, and harm expectancies of trauma-focused treatment were assessed at baseline, post-theoretical training, post-technical training, post-supervised practical training, and at 2-year follow-up. Credibility and burden beliefs of therapists concerning the treatment of every specific patient in the trial were also assessed.

Results

Over time, therapist-rated credibility of trauma-focused treatment showed a significant increase, whereas therapists’ expected burden and harm expectancies decreased significantly. In treating posttraumatic stress disorder (PTSD) in patients with psychotic disorders (n=79), pre-treatment symptom severity was not associated with therapist-rated credibility or expected burden of that specific treatment. Treatment outcome had no influence on patient-specific credibility or burden expectancies of therapists.

Conclusions

These findings support the notion that specialized training, including practical training with supervision, has long-term positive effects on therapists’ credibility, burden, and harm beliefs concerning trauma-focused treatment.

Highlights of the article

  • Specialized training improved therapists’ credibility, burden, and harm beliefs.

  • Patients’ symptom severity and treatment outcome did not affect these beliefs.

  • Replication of our findings in larger cohorts with a control group is warranted.

Keywords: PTSD, prolonged exposure, EMDR, training, dissemination


Because there is strong empirical support for the efficacy of trauma-focused treatments such as prolonged exposure therapy (PE), eye movement desensitization and reprocessing therapy (EMDR), and cognitive therapy (Bisson, Roberts, Andrew, Cooper, & Lewis, 2013; Bradley, Greene, Russ, Dutra, & Westen, 2005), these treatments are recommended worldwide in treatment guidelines for posttraumatic stress disorder (PTSD; Forbes et al., 2010; World Health Organization, 2013). In addition, most patients with PTSD seem to have a positive attitude toward evidence-based trauma-focused treatments such as PE (Becker, Darius, & Schaumberg, 2007) and prefer this to medication (Feeny, Zoellner, Mavissakalian, & Roy-Byrne, 2009; Polusny, Erbes, & Gerould, 2014; Reger et al., 2013). PTSD is highly prevalent in patients diagnosed with a psychotic disorder (Achim et al., 2011; De Bont et al., 2015), and several trauma-focused treatments are known to be effective and safe in patients with psychosis and other severe mental illnesses (De Bont, Van Minnen, & De Jongh, 2013; Frueh et al., 2009; Mueser et al., 2015, 2008; Van den Berg et al., 2015; Van den Berg & Van der Gaag, 2012).

Nevertheless, dissemination of evidence-based trauma-focused treatments remains highly problematic (Deacon & Farrell, 2013; Foa, Gillihan, & Bryant, 2013). For example, a study using clinical data of six specialized PTSD outpatient veteran units in the USA (n=1,924) found that only 6.3% of the patients received at least one session of evidence-based trauma-focused treatment during the first six months of their treatment (Shiner et al., 2013). In the presence of a comorbid psychotic disorder, the situation may be even more problematic, since most therapists are reluctant to use trauma-focused treatments in patients with psychosis (Becker, Zayfert, & Anderson, 2004; Frueh, Cusack, Grubaugh, Sauvageot, & Wells, 2006; Meyer, Farrell, Kemp, Blakey, & Deacon, 2014; Salyers, Evans, Bond, & Meyer, 2004).

Together with contextual factors (e.g., insufficient time) and patient factors (e.g., poor engagement), therapist characteristics and, more specifically, therapists’ beliefs about trauma-focused treatments appear to be an important cause of underutilization of evidence-based interventions for PTSD (Becker et al., 2007; Harned, Dimeff, Woodcock, & Contreras, 2013; Meyer et al., 2014). Some therapists hold negative beliefs about the tolerability, safety, and utility of evidence-based trauma-focused treatments (Farrell, Deacon, Dixon, & Lickel, 2013; Foa et al., 2013). Based on the literature, we distinguished three types of therapist beliefs related to trauma-focused treatment that may influence therapists’ behavior in clinical practice: credibility, expected burden, and harm expectancies of trauma-focused treatment.

Credibility refers to therapists’ beliefs about the efficacy and utility of that particular treatment. Some therapists consider that findings on the efficacy of evidence-based treatments (mainly cognitive behavior therapy) are of little value to their clinical practice (e.g., Barlow, Levitt, & Bufka, 1999; Foa et al., 2013; Shafran et al., 2009). This is supported by a survey of 2,607 USA and Canadian psychotherapists in which significant mentors, books, training received in graduate school and informal discussions with colleagues were the most highly endorsed factors influencing clinical behavior (Cook, Schnurr, Biyanova, & Coyne, 2009). Not surprisingly, the credibility of a certain trauma-focused treatment was found to be associated with a preference for using it (Van Minnen, Hendriks, & Olff, 2010).

Burden expectancy concerns therapists’ beliefs that a certain treatment is burdensome for patients and therapists. Conducting trauma-focused treatments can be burdensome for both patient and therapist, albeit patients generally consider it to be tolerable, are inclined to undergo treatment again, and tend to recommend it to a friend with similar problems (Devilly & Spence, 1999). Conversely, some therapists fear that the burden associated with trauma-focused treatment may result in secondary traumatization of therapists, even though research in this field is neither clear nor consistent; however, it does not appear to be a highly prevalent problem (Elwood, Mott, Lohr, & Galovski, 2011; Van Minnen et al., 2010). Nevertheless, the expected burden for both patient and therapist may be an important factor in therapists’ reluctance to adopt trauma-focused treatments.

Harm expectancy refers to therapists’ (often non-empirically supported) beliefs about the possible negative consequences of using trauma-focused treatments for their patients. The most important harm expectancy of therapists is that trauma-focused treatment will destabilize the patient and exacerbate symptoms, which could result in various adverse events, for example, crises, suicide attempts, hospitalization, revictimization, and dropout (Becker et al., 2004; Foa, Zoellner, Feeny, Hembree, & Alvarez-Conrad, 2002; Gairns, Alvarez-Jimenez, Hulbert, McGorry, & Bendall, 2015; Van Minnen et al., 2010). However, the reality is that the exacerbation of PTSD symptoms in trauma-focused treatment is rare and, when it does occur, is often temporary and unrelated to treatment response (Foa et al., 2002; Jayawickreme et al., 2014; Larsen, Wiltsey Stirman, Smith, & Resick, 2015; Taylor et al., 2003). A recent review of 18 trials of PE showed that, as a result of treatment, comorbid symptoms either decline along with the PTSD symptoms or do not change at all (Van Minnen, Zoellner, Harned, & Mills, 2015). Another review showed that trauma-focused treatment does not result in large-scale dropout (Hembree et al., 2003). Moreover, in the parent trial of this study, which tested PE and EMDR in patients with psychotic disorders, exacerbation of symptoms was rare and treatment in fact resulted in a significant reduction of adversities (Van den Berg et al., 2016). Nevertheless, many therapists are still reluctant to use trauma-focused treatments due to their harm expectancies.

It is generally assumed that training reduces the negative beliefs of therapists about trauma-focused treatment and, thereby, is helpful in efforts for dissemination. Suggestions for enhancing training effects have been made, for example, by providing information that balances empirical (e.g., data supporting the rationale, effectiveness, tolerability, and safety of trauma-focused treatments) and emotional appeals (e.g., case examples) and by using exercises that prompt both explicit and implicit learning (Farrell et al., 2013). Indeed, several cross-sectional studies reported an association between previous specialized training or having more experience, and the propensity to screen for trauma/PTSD and the use of trauma-focused treatments (Becker et al., 2004; Frueh et al., 2001; Sprang, Craig, & Clark, 2008). Van Minnen et al. (2010) found specific training and experience to be positively related to therapist-rated credibility of trauma-focused treatment. Conversely, lack of training and experience were indicated as important reasons for not using trauma-focused treatments (Becker et al., 2004; Salyers et al., 2004; Van Minnen et al., 2010). Worldwide, numerous steps have been taken to improve dissemination of evidence-based trauma-focused treatments. For example, the US Department of Veterans Affairs developed programs to train therapists in the delivery of these therapies (Karlin et al., 2010). A randomized controlled dissemination trial showed that an interactive online training improved therapists’ credibility beliefs concerning exposure techniques (Harned et al., 2014). Another study found that training positively influenced beliefs concerning PE (Ruzek et al., 2016).

However, little is known about the extent to which the different phases of specialized trauma-focused treatment training influence the beliefs of therapists without previous experience in trauma-focused treatment. Therefore, to test the differential influence of these phases on therapist-rated credibility, expected burden, and harm expectancies, the present feasibility study monitored therapists’ beliefs during theoretical training, technical training, supervised practical training, and at 2-year follow-up. Also examined was whether this training resulted in sustained usage of trauma-focused treatments on the long term.

Moreover, until now, studies concerning training effects have only assessed general beliefs of therapists concerning trauma-focused treatment, independent of the specific characteristics of individual patients. However, in clinical practice, these beliefs may be influenced by patient-specific factors, such as pre-treatment severity of the patients’ symptoms or treatment outcome. Therefore, to determine whether symptom severity or treatment outcome affects therapist-rated credibility and expected burden of trauma-focused treatment, we assessed these beliefs and symptom severity at pre-treatment and post-treatment for each individual patient.

Method

Design

The data of this feasibility study were obtained as part of a randomized controlled trial (RCT) that found both PE and EMDR to be effective and safe in participants diagnosed with both a PTSD and a psychotic disorder (Van den Berg et al., 2015, 2016). The medical Ethics Committee of the VU University Medical Centre approved the study protocol (NL 36649.029.12). Details on the design, procedures, and instruments of this trial are available elsewhere (De Bont, Van den Berg, Van der Vleugel, et al., 2013; Van den Berg et al., 2015).

First, we describe the results of a pretest–posttest design with five repeated measurements concerning therapists’ general beliefs regarding trauma-focused treatment. Second, we test the impact of pre-treatment symptom severity on therapists’ patient-specific credibility and expected burden of trauma-focused treatment in a cross-sectional design. Then, we report the results of a pre-treatment–post-treatment analysis of the influence of treatment outcome on therapists’ beliefs concerning patient-specific credibility and expected burden of trauma-focused treatment.

Participants

The inclusion criteria for this feasibility study were a) no previous training in PE or EMDR and b) consent to participate in monthly expert supervision sessions during the trial. The participants were 16 therapists (15 clinical psychologists and 1 psychiatrist) working at 13 mental healthcare organizations in the Netherlands. Twelve therapists were female and four were male. Their mean age was 37.1 (7.59) years, and on average, they had been working as a therapist for 8.6 (7.6) years. All therapists worked mainly with patients with psychotic disorders, were specialized in cognitive behavior therapy for psychosis, had no previous experience in trauma-focused treatment, and volunteered to participate in a trial for trauma-focused treatments in psychosis. To test the influence of symptom severity and treatment outcome on therapists’ beliefs, we included patients (with both a PTSD and a psychotic disorder; n=79) that received either PE or EMDR treatment during the trial from one of the 16 participating therapists.

Measures

Therapists’ general credibility of trauma-focused treatment was assessed with five statements (i.e., “This treatment seems logical to me”; “This treatment seems scientific to me”; “If I had a PTSD, I would choose this treatment”; “This treatment is effective for most people”; “If a close friend or relative had PTSD, I would recommend this therapy”). Therapists responded on a visual analog scale (VAS) ranging from 0 (“disagree strongly”) to 10 (“agree strongly”) with a higher score representing a higher level of credibility of trauma-focused treatment. The therapists’ credibility assessment was inspired by the Credibility/Expectancy Questionnaire, a short measure of patient-rated credibility of treatment that has shown high internal consistency and good test–retest reliability (Devilly & Borkovec, 2000). In this study, the internal consistency of the five credibility items at the different time points ranged from 0.79≥α≤0.90.

Therapists’ general burden and harm expectancies of trauma-focused treatment were measured in a similar way with seven statements on a VAS ranging from 0 (“disagree strongly”) to 10 (“agree strongly”). Two statements concerned burden expectancies (i.e., “This treatment is burdensome to the patient”; “This treatment is burdensome to the therapist”) and five statements concerned harm expectancies of trauma-focused treatment (i.e., “This treatment worsens PTSD symptoms”; “This treatment worsens psychotic symptoms”; “This treatment worsens other comorbid symptoms”; “This treatment induces dropout”; “This treatment induces crisis contacts with mental healthcare or admission to hospital”). These statements were inspired by the Distress/Endorsement Validations Scale (Devilly, 2004). The internal consistency of the two burden expectancy items ranged from 0.79≥α≤0.86 at the different time points; for the five harm expectancy items, this was 0.85≥α≤0.92.

Patient-specific credibility of trauma-focused treatment was assessed before session 2 (the first trauma-focused treatment session) with three statements (i.e., “This is a logical treatment for this patient”; “This is an effective treatment for this patient”; “If a colleague had a similar patient, I would recommend this treatment”). Again participating therapists responded on VAS (0–10). The ratings concerned the therapist's beliefs about the treatment for that specific client.

Patient-specific burden expectancy of trauma-focused treatment was assessed in the same way with two statements on a VAS (i.e., “Conducting this treatment with this patient is burdensome for me”; “I feel reluctant about using this treatment with this patient”).

Independent assessors, which were successfully blinded to treatment allocation, assessed pre-treatment symptom severity for the specific patients (Van den Berg et al., 2015). Severity of PTSD symptoms in patients was assessed with the Clinician Administered PTSD Scale (CAPS; Blake et al., 1995). The CAPS (range 0–136) has excellent psychometric properties in terms of reliability and validity (Weathers, Keane, & Davidson, 2001). The CAPS was found to be valid and reliable in patients with severe mental illness (Mueser et al., 2001); in this study, the intra-class correlation coefficient for the CAPS for all the assessors was 0.81.

The severity of paranoid ideation in patients was measured with the Green et al. Paranoid Thought Scales (GPTS; Green et al., 2008). The GPTS is a self-report measure of paranoia and consists of 32 items concerning persecutory ideation and ideas of reference, which are scored on a Likert scale ranging from 1 (not at all) to 5 (totally). The GPTS (range 32–160) is a valid and reliable questionnaire that is sensitive to change (Green et al., 2008).

Presence of auditory verbal hallucinations (AVH) was established with the Auditory Hallucination Rating Scale (AHRS; Haddock, McCarron, Tarrier, & Faragher, 1999). We used a dichotomous outcome of the AHRS since not all patients in the present trial were actively hearing voices at that moment, which resulted in an excess of zeros in the data. The AHRS has excellent inter-rater reliability (Haddock et al., 1999).

The presence of moderate-to-high suicide risk was assessed using the suicidality section of the Mini-International Neuropsychiatric Interview-Plus (MINI-plus; Sheehan et al., 1998). The MINI-plus is a valid and reliable clinical interview (Lecrubier et al., 1997; Sheehan et al., 1997). We dichotomized the outcome of the suicidality section of the MINI-plus (no, low, moderate, or high risk) into “no or low suicide risk” and “moderate-to-high suicide risk.”

The level of social functioning of the patients was assessed with the Personal and Social Performance scale (PSP; Morosini, Magliano, Brambilla, Ugolini, & Pioli, 2000). The PSP (range 0–100, with higher scores indicating better functioning) is an assessor-rated scale to measure personal and social functioning based on the scores on several social functioning domains. The PSP is a valid and reliable test and also sensitive to change (Kawata & Revicki, 2008; Nasrallah, Morosini, & Gagnon, 2008; Patrick et al., 2009).

Treatment outcome was determined by subtracting the post-treatment CAPS total severity score from the pre-treatment CAPS total severity score. Both patient-specific therapist-rated credibility and burden expectancies of trauma-focused treatment were assessed at post-treatment using the same items. The internal consistencies of pre-treatment and post-treatment were 0.86≥ and ≤0.90 for credibility and 0.67≥ and ≤0.81 for burden.

Procedures

Training phases

Therapists-rated credibility, expected burden, and harm expectancies of trauma-focused treatment in psychosis were assessed five times during the process of training, that is, at baseline (before the start of training), post-theoretical training, post-technical training, post-practical training, and at 2-year follow-up. Experts in the target treatments provided a 4-day training in PE (AVM and RDK) and a 4-day training in EMDR (ADJ). All therapists attended both trainings and all delivered both therapies during the trial. Standard protocols of these two guideline trauma-focused treatments were used (De Jongh & Ten Broeke, 2003; Foa, Hembree, & Rothbaum, 2007; Shapiro, 2001). Both trainings had a similar structure and took place between March and August 2011 and comprised four phases.

Theoretical training

The first 2 (consecutive) days of the PE and EMDR trainings were mainly theoretical, consisting of the following elements: (1) theoretical principles; (2) efficacy and safety of the treatment (also in complex patient groups); (3) treatment rationale and procedures; (4) specific techniques and skills; and (5) practicing techniques and skills in role play with peers.

Technical training

The third and fourth days of the two trainings were technical and were spread over a 5-month period. During this phase, the participants had to treat at least two patients with PE and two with EMDR. These sessions were videotaped, viewed, and (plenary) discussed focusing on the technical aspects of conducting the therapies.

Supervised practical training

Recruitment for the trial ran from September 2011 through April 2013. During this training phase, therapists treated patients and underwent monthly 4-h group supervision sessions (group size 6–8) that were led by experts (2 h by AVM in PE and 2 h by CDR or ADJ in EMDR). In these supervision sessions, video recordings of complicated treatment sessions were viewed and (plenary) discussed.

Two-year follow-up

At the end of the trial, the therapists resumed their regular function in clinical practice, mainly in cognitive behavior therapy for psychosis. Two years after the end of the trial, the participating therapists were surveyed about their use of PE and EMDR. The questions were “Are you still using trauma-focused treatments in patients with psychosis?”; “How many patients with a psychotic disorder did you treat with trauma-focused treatment since the closure of the trial?”; “In case you did not treat any patients with trauma-focused treatment, why not?”; and “What factor influenced your daily practice most (choices: theoretical training, technical training, supervised practical training, otherwise)?”

Symptom severity and treatment outcome

During the supervised practical training phase, the therapists treated patients included in the trial. In this study, the 79 participating patients were randomly assigned to receive eight weekly 90-min sessions of either PE (n=39) or EMDR (n=40). All sessions were videorecorded. Session one comprised psycho-education (concerning PTSD and the rationale for treatment) and the development of a hierarchy of the worst (and most re-experienced) trauma memories. No trauma-focused treatment was provided in this first session. Therapists rated their credibility and expected burden of the treatment of every specific patient at pre-treatment (after session 1) and at post-treatment (after the last therapy session). For each patient, the independent assessors assessed pre-treatment symptom severity and post-treatment severity of PTSD symptoms.

Analyses

Statistical analyses were conducted with SPSS 22 (IBM SPSS). In this study, we pooled the data on therapists’ beliefs of the trauma-focused treatments PE and EMDR because (1) the PE and EMDR trainings took place in the same period; (2) all therapists provided both treatments; (3) there was no difference in treatment allegiance of therapists to PE or EMDR (t18=0.000, p=0.999); and(4) there were no differences in efficacy (Van den Berg et al., 2015).

Influence of training on therapist-rated credibility, burden, and harm of trauma-focused treatment. Linear mixed models were performed to test if therapist-rated credibility, expected burden, and harm expectancies of trauma-focused treatment changed over time. Dummy variables (recodes of the time points) were used to investigate effects between the different time points, that is, during theoretical training, technical training, practical training, and the follow-up period.

Influence of symptom severity on patient-specific credibility and burden of trauma-focused treatment. We computed bivariate Pearson product–moment coefficients between the dependent therapist-rated variables “pre-treatment credibility of treatment” and “pre-treatment expected burden of treatment” and five independent variables representing pre-treatment symptom severity (severity of PTSD, severity of paranoid ideation, presence of AVH, presence of moderate-to-high suicide risk, and level of social functioning). Since these data are nested within therapists, we used linear mixed models with a correction for therapist level (i.e., random intercept and a random slope if that improved the model) to test these associations. The independent variables were entered (forced simultaneous entry) into two separate linear mixed models analyses (one for credibility and one for expected burden) to preserve degrees of freedom (Babyak, 2004).

Influence of treatment outcome on patient-specific credibility and burden of trauma-focused treatment. Paired-samples t-tests (completers) were used to analyze changes in the severity of PTSD symptoms and in therapist-rated credibility and burden of trauma-focused treatment, between pre-treatment and post-treatment. Then, bivariate Pearson product–moment coefficients were computed between change scores of PTSD and change in therapist-rated credibility and burden. We performed linear mixed models (intention-to-treat) with a correction for therapist level to test the relationship between the dependent variables “change in credibility” and “change in expected burden” and the independent variable “change in PTSD symptom severity.”

Results

Three participating therapists missed the post-practical training assessment and two missed the 2-year follow-up assessment due to pregnancy leave or prolonged illness (unrelated to work as clinician).

Influence of training on therapist-rated credibility, burden, and harm of trauma-focused treatment

Figure 1 shows the estimated marginal means (produced by the mixed models analyses) for therapist-rated credibility, expected burden, and harm expectancies of trauma-focused treatment. Therapist-rated credibility of trauma-focused treatment increased significantly over time (F(4, 33.65)=11.75, p<0.001). Credibility increased significantly during the theoretical training (Mdiff=0.77, t(34)=3.36, p=0.002, 95% CI [0.30, 1.23]). This effect was sustained during the subsequent phases with small non-significant increases in credibility in every training phase. Therapist-rated burden expectancies showed a significant decrease over time (F(4, 31.35)=9.20, p<0.001). Burden expectancies decreased significantly after theoretical training (Mdiff=−1.27, p=0.004, 95% CI [−2.09, −0.43]). This was followed by a small, non-significant increase (Mdiff=0.69, p=0.088, 95% CI [−0.11, 1.48]) during technical training. Thereafter, the level of expected burden was relatively stable, showing no significant changes during the subsequent phases. Therapist-rated harm expectancies of trauma-focused treatment significantly decreased over time (F(4, 34.19)=4.44, p=0.005). After an initial small, non-significant decrease after theoretical training (Mdiff=−0.41, p=0.147, 95% CI [−0.96, 0.15]), harm expectancies showed a significant, but limited, increase during technical training (Mdiff=0.48, p=0.048, 95% CI [0.01, 0.93]) and then a limited (border) significant decrease during the practical training phase (Mdiff=−0.48, p=0.050, 95% CI [−0.97, −0.01]).

Fig. 1.

Fig. 1

Estimated marginal means (SD) of therapist-rated credibility, expected burden, and harm expectancies of trauma-focused treatment at all time points (N=16). Range of mean scores is 0–10, with higher scores indicating higher therapist-rated credibility, greater expected burden, and more harm expectancies of trauma-focused treatment.

The 2-year follow-up survey (n=14) showed that 12 participating therapists (85.7%) still used trauma-focused treatments (PE or EMDR) in patients with psychotic disorders. In the last 2 years, the therapists had treated (on average) 12.3 (8.1) patients. The two participants that were no longer using trauma-focused treatments in psychosis had changed their job and were no longer working with this patient group. The majority of the participating therapists (78.6%) indicated that the supervised practical training had most strongly impacted their clinical behavior

Influence of symptom severity on patient-specific credibility and burden of trauma-focused treatment

Table 1 shows that therapist-rated pre-treatment credibility and expected burden of trauma-focused treatment were negatively correlated. However, the pre-treatment symptom severity indicators showed little relationship with the pre-treatment ratings of credibility and expected burden. Only severity of PTSD symptoms was positively correlated with credibility, while no factor was associated with expected burden. In the linear mixed models analyses, none of the pre-treatment patient characteristics was significantly associated with the variability in either credibility or expected burden of trauma-focused treatment.

Table 1.

Descriptive pre-treatment scores, Pearson product–moment coefficients, and linear mixed model results for the associations of patient characteristics with pre-treatment therapist-rated credibility and expected burden

Pre-treatment Post-treatment Association with pre-treatment credibility Association with pre-treatment burden
Total n=79 Total n=65
Credibility score, mean (SD) 7.4 (1.8) 7.5 (2.0)
 PPC NA −0.34**
Expected burden score, mean (SD) 3.9 (2.0) 3.7 (1.9)
 PPC −0.34** NA
Severity of PTSD (CAPS), mean (SD) 70.1 (15.8)
 PPC 0.22* −0.04
 LMM t73=1.68, (0.098) t73=−0.59, (0.552)
Severity of paranoid ideation (GPTS), mean (SD) 84.3 (32.5)
 PPC 0.11 0.12
 LMM t73=0.37, (0.709) t73=1.04, (0.303)
Presence of AVH (AHRS), n (%) 33 (41.8)
 PPC 0.12 −0.16
 LMM t73=0.66, (0.513) t73=−1.62, (0.110)
Presence of moderate-to-high suicide risk (MINI-plus), n (%) 36 (45.6)
 PPC 0.01 0.04
 LMM t73=−0.29, (0.773) t73=0.29, (0.768)
Level of social functioning (PSP), mean (SD) 52.5 (12.1)
 PPC 0.02 −0.18
 LMM t73=0.46, (0.644) t73=−1.19, (0.235)
**

Correlation is significant at the 0.01 level (two-tailed)

*

correlation is significant at the 0.05 level (two-tailed). AHRS, Auditory Hallucination Rating Scale; AVH, Auditory Verbal Hallucinations; CAPS, Clinician Administered PTSD Scale; GPTS, Green et al. Paranoid Thought Scales; LMM, Linear Mixed Models analyses; MINI-plus, Mini-International Neuropsychiatric Interview-Plus; PPC, Pearson product–moment coefficient; PSP, Personal and Social Performance Scale; PTSD, posttraumatic stress disorder; SD, standard deviation.

Influence of treatment outcome on patient-specific credibility and burden of trauma-focused treatment

Of the 79 patients treated by the 16 therapists, 8 (10.1%) did not attend the post-treatment assessment of severity of PTSD symptoms. Also, 14 patients (17.7%) had no post-treatment therapist ratings of credibility and expected burden, either because the patient dropped out of treatment or because the therapist became ill. For 63 patients (79.7%), all data were present. Although the mean CAPS severity score for these patients showed a significant change during treatment (mean change −34.7, t[62]=12.83, p<0.001), the results of the paired-samples t-tests showed no significant change in either therapist-rated credibility (t[62]=−0.16, p=0.880) or burden expectancies (t[62]=0.59, p=0.550) during treatment (see Table 1 for mean scores). Moreover, the magnitude of the change in PTSD symptom severity during treatment (i.e., treatment outcome) was not significantly correlated with the change in therapist-rated credibility (r=0.04, n=63, p=0.739) or burden (r=−0.12, n=63, p=0.347). The mixed model analyses with a correction for therapist level also showed results far from significance.

All the analyses in this section were repeated with the last observation carried forward (no change, n=79) as sensitivity analyses, and all yielded results similar to the original analyses.

Discussion

To our knowledge, this is one of the first studies to examine the differential impact of theoretical, technical, and supervised practical training on therapists’ general beliefs concerning trauma-focused treatments and also the first study to test the influence of symptom severity and treatment outcome on these beliefs. The results of this feasibility study show that specialized trauma-focused treatment training with a subsequent trajectory of technical and supervised practical training resulted in a significant increase in therapist-rated credibility and a decrease in the expected burden and harm expectancies of trauma-focused treatment. These effects were sustained up to 2-year follow-up, and all the therapists that were still working with patients with psychosis were still using trauma-focused treatments with these patients. During the supervised practical training phase, therapists’ patient-specific beliefs concerning credibility and expected burden were not affected by the severity of symptoms. Patient-specific credibility and expected burden of trauma-focused treatment did not change during treatment, regardless of the treatment outcome. Therefore, these findings lend support for the notion that specialized training has a long-term positive effect on therapists’ beliefs concerning trauma-focused treatment.

Therapists’ credibility of trauma-focused treatment showed an increasing trend over the course of training, with a significant increase during theoretical training. Ceiling effects may have influenced the slope, as the mean credibility score after theoretical training was relatively high. These effects are in line with a recent naturalistic study that found both training (large effect) and post-training telephone consultation (moderate effect) to increase credibility of PE (Ruzek et al., 2016). This study also reported associations between therapist-rated credibility of PE and actual usage of it (Ruzek et al., 2015), demonstrating the importance of this factor. These results underline the necessity of providing therapists with empirical information about the effects and rationale of trauma-focused treatments, and of familiarizing them with the basic procedures, techniques, and skills (Karlin et al., 2010).

There was a clear reduction in therapists’ expected burden of trauma-focused treatment during theoretical training and a partial (non-significant) rebound during the technical training when therapists started to treat patients. This partial recovery of burden expectancies and the fact that these showed no further significant decrease during the practical training phase or follow-up may be explained by the fact that a certain level of burden of trauma-focused treatment is probably realistic—especially when considering that the therapists (although experienced) were novices to trauma-focused treatment and immediately started treating a patient group characterized by severe PTSD, many comorbidities, and severe childhood traumas (Van den Berg et al., 2015). These findings are at odds with the study by Ruzek et al. (2016), in which burden beliefs significantly decreased during a 6- to 9-month telephone consultation phase, but not during theoretical training.

Interestingly, there was an increase in harm expectancies during the technical training phase and a decrease during the supervised practical training phase. Ruzek et al. (2016) found moderate reductions in harm expectancies during both (theoretical) training and post-training telephone consultation. It is difficult to compare these results, since their post-training consultation comprised both our technical and practical training phase. Moreover, our results are likely to have been influenced by floor effects, since the mean baseline score of therapists’ harm expectancies was rather low. This may be a specific sample characteristic since all the therapists in this study were experienced in working with complex and severe patients, and all agreed to participate in a trial for trauma-focused treatments in psychosis. This may have resulted in a sample of therapists that were less anxious than “average” therapists. Greater anxiety sensitivity has been associated with a tendency to exclude patients from exposure therapy (Meyer et al., 2014).

During the supervised practical training (within the context of a trial), the characteristics of specific patients (symptom severity and level of social functioning) and treatment outcome had no influence on therapists’ credibility and burden beliefs concerning trauma-focused treatment. The only significant association was a positive correlation between pre-treatment PTSD symptom severity and pre-treatment credibility of trauma-focused treatment which, in the multiple regression analysis, was lost after correction for the variability explained by the other pre-treatment patient characteristics. This positive correlation tentatively suggests that therapists, with high mean scores of credibility of trauma-focused treatment at that time, may have reasoned that with severe PTSD trauma-focused treatment was probably going to be effective. Greater severity of pre-treatment PTSD was indeed found to be related to a greater reduction in PTSD symptoms during treatment in participants with severe mental illness (Mueser et al., 2008) and in several general PTSD samples (Elliott, Biddle, Hawthorne, Forbes, & Creamer, 2005; Foa, Riggs, Massie, & Yarczower, 1995; Forbes, Creamer, Hawthorne, Allen, & McHugh, 2003; Karatzias et al., 2007; Rizvi, Vogt, & Resick, 2009; Thrasher, Power, Morant, Marks, & Dalgleish, 2010), but not in others (De Kleine, Hendriks, Smits, Broekman, & Van Minnen, 2014; Speckens, Ehlers, Hackmann, & Clark, 2006). The fact that, in this complex patient group, therapists were not influenced by specific patient characteristics gives cause for optimism; this indicates that extensive specialized training may have durable effects that are independent of specific sample characteristics.

The present results suggest that different elements of training may have a differential impact on therapists’ beliefs. Interestingly, at 2-year follow-up, most of the therapists indicated that the supervised practical training was the most important factor in shaping their clinical behavior. This is in accordance with the recommendations of Karlin et al. (2010), who also stressed the importance of ongoing consultation after training. It is possible that trauma-focused therapists are not so different from their patients; similar to their patients, they may benefit from a “coach” who knows the process, provides information that increases their credibility of the treatment, and relativizes burden expectancies based on research findings and extensive clinical experience. In other words, a guide who stimulates them to test new behaviors and falsify their harm expectancies (Craske, Treanor, Conway, Zbozinek, & Vervliet, 2014; Rief et al., 2015). Future training programs aimed at disseminating trauma-focused treatments would benefit from adopting these cognitive behavioral principles and practices, to actively expose therapists to using trauma-focused treatments with “difficult” patients, and to stimulate therapists to investigate and challenge their negative harm expectancies of trauma-focused treatment in patient groups with severe and complex symptoms (Farrell et al., 2013). In doing this, it is important to realize that although trauma-focused treatment is safe, perceiving a certain level of burden is probably realistic.

This feasibility study has several limitations. The most important limitations (related to the fact that the data were collected as part of a RCT) are the fact that participating therapists were not randomly selected, the lack of a control group, and the small sample size. A strength of this contextual factor is that fidelity to the protocol was high; however, this also limits the generalizability. Moreover, participating therapists voluntarily participated in a trial on trauma-focused treatment in psychosis, despite (at that time) limited empirical evidence regarding its efficacy and safety. This may have resulted in ceiling and floor effects. Furthermore, participating therapists concurrently received PE and EMDR training, which might have had a differential influence on their beliefs. The data for these two trauma-focused treatments were pooled as we could not isolate carry-over effects. Unfortunately, at the patient level we did not assess harm expectancies. Also, patient-specific burden expectancies (rated by the therapists) only concerned therapist-rated burden to the therapist and not to the patient. Future studies could include these latter assessments. Finally, we used non-validated measures to assess therapist's beliefs, although internal consistency scores were satisfactory.

In conclusion, the present findings support the notion that specialized trauma-focused treatment training, including acquisition of experience, increases credibility and reduces beliefs about burden and harm. This is underlined by the finding that the effects were sustained on the long term and were unaffected by specific patient characteristics and treatment outcome. Future studies could use a similar design with larger samples of frontline therapists in clinical practice. These studies should include a control group and may test whether the level of experience influences training effects. These studies could also compare theoretical and technical training with training that is augmented with an expert supervision trajectory. It is important to establish what beliefs are most strongly related to long-term clinical behavior and what elements of training have the strongest influence on these beliefs (Ruzek et al., 2015). With regard to dissemination efforts, future studies could also examine whether less intensive training programs produce similar results.

Acknowledgements

The authors thank all participating therapists and patients, the research assistants, and all others who contributed to this study. Special thanks go to Marion Bruns, BSc, and Daniëlle Tilburgs, MSc, Parnassia Psychiatric Institute, for their role in the organization and management of the data collection, the filing, and the double checks.

For the abstract or full text in other languages, please see Supplementary files under ‘Article Tools’

Authors’ contributions

De Bont, Van der Vleugel, De Roos, De Jongh, Van Minnen, Van der Gaag, & Van den Berg designed the study and wrote the protocol. All authors were involved in the acquisition of data and management of the study. Van den Berg and Van Minnen conducted the literature search. Van Minnen, De Jongh and De Kleine trained and supervised the participating therapists. Van den Berg conducted the statistical analyses and interpreted these with De Jongh, Van Minnen, & Van der Gaag. Van den Berg wrote the first draft of the manuscript. All authors contributed to and have approved the final manuscript.

Funding statement

The work was supported by the Dutch Support Foundation ‘Stichting tot Steun VCVGZ’, P.O. Box 9219, 6800 HZ Arnhem, +31(26) 38 98900, Email: info@stichtingtotsteunVCVGZ.nl (awarded to Dr van der Gaag). Stichting tot Steun VCVGZ had no involvement in the design, decision making, and conduct of the study and this report.

Conflict of interest and funding

Mark van der Gaag and David van den Berg receive income for published books on psychotic disorders, and for the training of postdoctoral professionals in the treatment of psychotic disorders. Ad de Jongh receives income for published books on EMDR therapy and for the training of postdoctoral professionals in this method. Agnes van Minnen receives income for published book chapters on PTSD and for the training of postdoctoral professionals in prolonged exposure. Carlijn de Roos receives income for the training of postdoctoral professionals in EMDR therapy. The other authors declare that they have nothing to disclose.

References

  1. Achim A.M, Maziade M, Raymond E, Olivier D, Mérette C, Roy M.A. How prevalent are anxiety disorders in schizophrenia? A meta-analysis and critical review on a significant association. Schizophrenia Bulletin. 2011;37(4):811–821. doi: 10.1093/schbul/sbp148. doi: http://dx.doi.org/10.1093/schbul/sbp148. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Babyak M.A. What you see may not be what you get: A brief, nontechnical introduction to overfitting in regression-type models. Psychosomatic Medicine. 2004;66(3):411–421. doi: 10.1097/01.psy.0000127692.23278.a9. [DOI] [PubMed] [Google Scholar]
  3. Barlow D.H, Levitt J.T, Bufka L.F. The dissemination of empirically supported treatments: A view to the future. Behaviour Research and Therapy. 1999;37:S147–S162. doi: 10.1016/s0005-7967(99)00054-6. [DOI] [PubMed] [Google Scholar]
  4. Becker C.B, Darius E, Schaumberg K. An analog study of patient preferences for exposure versus alternative treatments for posttraumatic stress disorder. Behaviour Research and Therapy. 2007;45(12):2861–2873. doi: 10.1016/j.brat.2007.05.006. doi: http://dx.doi.org/10.1016/j.brat.2007.05.006. [DOI] [PubMed] [Google Scholar]
  5. Becker C.B, Zayfert C, Anderson E. A survey of psychologists’ attitudes towards and utilization of exposure therapy for PTSD. Behaviour Research and Therapy. 2004;42(3):277–292. doi: 10.1016/S0005-7967(03)00138-4. doi: http://dx.doi.org/10.1016/s0005-7967(03)00138-4. [DOI] [PubMed] [Google Scholar]
  6. Bisson J.I, Roberts N.P, Andrew M, Cooper R, Lewis C. Psychological therapies for chronic posttraumatic stress disorder (PTSD) in adults. Cochrane Database Systematic Reviews. 2013;12(12):CD003388. doi: 10.1002/14651858.CD003388.pub4. doi: http://dx.doi.org/10.1002/14651858.CD003388.pub4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Blake D.D, Weathers F.W, Nagy L.M, Kaloupek D.G, Gusman F.D, Charney D.S, Keane T.M. The development of a clinician-administered PTSD scale. Journal of Traumatic Stress. 1995;8(1):75–90. doi: 10.1007/BF02105408. [DOI] [PubMed] [Google Scholar]
  8. Bradley R, Greene J, Russ E, Dutra L, Westen D. A multidimensional meta-analysis of psychotherapy for PTSD. The American Journal of Psychiatry. 2005;162(2):214–227. doi: 10.1176/appi.ajp.162.2.214. doi: http://dx.doi.org/10.1176/appi.ajp.162.2.214. [DOI] [PubMed] [Google Scholar]
  9. Cook J, Schnurr P, Biyanova T, Coyne J. Apples don't fall far from the tree: Influences on psychotherapists’ adoption and sustained use of new therapies. Psychiatric Services. 2009;60(5):671–676. doi: 10.1176/appi.ps.60.5.671. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Craske M.G, Treanor M, Conway C.C, Zbozinek T, Vervliet B. Maximizing exposure therapy: An inhibitory learning approach. Behaviour Research and Therapy. 2014;58:10–23. doi: 10.1016/j.brat.2014.04.006. doi: http://dx.doi.org/10.1016/j.brat.2014.04.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Deacon B.J, Farrell N.R. Therapist barriers to the dissemination of exposure therapy. In: Storch E. A, McKay D, editors. Handbook of treating variants and complications in anxiety disorders. New York: Springer; 2013. pp. 363–373. doi: http://dx.doi.org/10.1007/978-1-4614-6458-7_23. [Google Scholar]
  12. De Bont P.A, Van den Berg D.P, Van der Vleugel B.M, De Roos C, De Jongh A, Van der Gaag M, …. Van Minnen A. Predictive validity of the trauma screening questionnaire in detecting posttraumatic stress disorder in patients with psychotic disorders. The British Journal of Psychiatry. 2015;206(5):408–416. doi: 10.1192/bjp.bp.114.148486. doi: http://dx.doi.org/10.1192/bjp.bp.114.148486. [DOI] [PubMed] [Google Scholar]
  13. De Bont P.A, Van den Berg D.P, Van der Vleugel B.M, De Roos C, Mulder C.L, Becker E.S, …. Van Minnen A. A multi-site single blind clinical study to compare the effects of prolonged exposure, eye movement desensitization and reprocessing and waiting list on patients with a current diagnosis of psychosis and co morbid post traumatic stress disorder: Study protocol for the randomized controlled trial treating trauma in psychosis. Trials. 2013;14:151. doi: 10.1186/1745-6215-14-151. doi: http://dx.doi.org/10.1186/1745-6215-14-151. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. De Bont P.A, Van Minnen A, De Jongh A. Treating PTSD in patients with psychosis: A within-group controlled feasibility study examining the efficacy and safety of evidence-based PE and EMDR protocols. Behavior Therapy. 2013;44:717–730. doi: 10.1016/j.beth.2013.07.002. doi: http://dx.doi.org/10.1016/j.beth.2013.07.002. [DOI] [PubMed] [Google Scholar]
  15. De Jongh A, Ten Broeke E. Handboek EMDR: Een geprotocolleerde behandelmethode voor de gevolgen van psychotrauma. [Handbook of EMDR: A standardized treatment for the consequences of psychotrauma]. Amsterdam, Netherlands: Harcourt; 2003. [Google Scholar]
  16. De Kleine R.A, Hendriks G.J, Smits J.A, Broekman T.G, Van Minnen A. Prescriptive variables for d-cycloserine augmentation of exposure therapy for posttraumatic stress disorder. Journal of Psychiatric Research. 2014;48(1):40–46. doi: 10.1016/j.jpsychires.2013.10.008. doi: http://dx.doi.org/10.1016/j.jpsychires.2013.10.008. [DOI] [PubMed] [Google Scholar]
  17. Devilly, G.J. An approach to psychotherapy toleration: The distress/endorsement validation scale (DEVS) for clinical outcome studies. Journal of Behavior Therapy and Experimental Psychiatry. 2004;35(4):319–336. doi: 10.1016/j.jbtep.2004.08.001. doi: http://dx.doi.org/10.1016/j.jbtep.2004.08.001. [DOI] [PubMed] [Google Scholar]
  18. Devilly G.J, Borkovec T.D. Psychometric properties of the credibility/expectancy questionnaire. Journal of Behavior Therapy and Experimental Psychiatry. 2000;31(2):73–86. doi: 10.1016/s0005-7916(00)00012-4. [DOI] [PubMed] [Google Scholar]
  19. Devilly G.J, Spence S.H. The relative efficacy and treatment distress of EMDR and a cognitive-behavior trauma treatment protocol in the amelioration of posttraumatic stress disorder. Journal of Anxiety Disorders. 1999;13(1):131–157. doi: 10.1016/s0887-6185(98)00044-9. [DOI] [PubMed] [Google Scholar]
  20. Elliott P, Biddle D, Hawthorne G, Forbes D, Creamer M. Patterns of treatment response in chronic posttraumatic stress disorder: An application of latent growth mixture modeling. Journal of Traumatic Stress. 2005;18(4):303–311. doi: 10.1002/jts.20041. doi: http://dx.doi.org/10.1002/jts.20041. [DOI] [PubMed] [Google Scholar]
  21. Elwood L.S, Mott J, Lohr J.M, Galovski T.E. Secondary trauma symptoms in clinicians: A critical review of the construct, specificity, and implications for trauma-focused treatment. Clinical Psychology Review. 2011;31(1):25–36. doi: 10.1016/j.cpr.2010.09.004. doi: http://dx.doi.org/10.1016/j.cpr.2010.09.004. [DOI] [PubMed] [Google Scholar]
  22. Farrell N.R, Deacon B.J, Dixon L.J, Lickel J.J. Theory-based training strategies for modifying practitioner concerns about exposure therapy. Journal of Anxiety Disorders. 2013;27(8):781–787. doi: 10.1016/j.janxdis.2013.09.003. doi: http://dx.doi.org/10.1016/j.janxdis.2013.09.003. [DOI] [PubMed] [Google Scholar]
  23. Feeny N.C, Zoellner L.A, Mavissakalian M.R, Roy-Byrne P.P. What would you choose? Sertraline or prolonged exposure in community and PTSD treatment seeking women. Depression and Anxiety. 2009;26(8):724–731. doi: 10.1002/da.20588. doi: http://dx.doi.org/10.1002/da.20588. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Foa E.B, Gillihan S.J, Bryant R.A. Challenges and successes in dissemination of evidence-based treatments for posttraumatic stress: Lessons learned from prolonged exposure therapy for PTSD. Psychological Science in the Public Interest. 2013;14(2):65–111. doi: 10.1177/1529100612468841. doi: http://dx.doi.org/10.1177/1529100612468841. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Foa E.B, Hembree E.A, Rothbaum B.O. Prolonged exposure therapy for PTSD: Emotional processing of traumatic experiences: Therapist guide. Oxford: Oxford University Press; 2007. [Google Scholar]
  26. Foa E.B, Riggs D.S, Massie E.D, Yarczower M. The impact of fear activation and anger on the efficacy of exposure treatment for posttraumatic stress disorder. Behavioral Therapy. 1995;26(3):487–499. [Google Scholar]
  27. Foa E.B, Zoellner L.A, Feeny N.C, Hembree E.A, Alvarez-Conrad J. Does imaginal exposure exacerbate PTSD symptoms? Journal of Consulting and Clinical Psychology. 2002;70(4):1022–1028. doi: 10.1037//0022-006x.70.4.1022. doi: http://dx.doi.org/10.1037//0022-006X.70.4.1022. [DOI] [PubMed] [Google Scholar]
  28. Forbes D, Creamer M, Bisson J.I, Cohen J.A, Crow B.E, Foa E.B, … Ursano, R.J. (2010). A guide to guidelines for the treatment of PTSD and related conditions. Journal of Traumatic Stress. 23(5):537–552. doi: 10.1002/jts.20565. doi: http://dx.doi.org/10.1002/jts.20565. [DOI] [PubMed] [Google Scholar]
  29. Forbes D, Creamer M, Hawthorne G, Allen N, McHugh T. Comorbidity as a predictor of symptom change after treatment in combat-related posttraumatic stress disorder. The Journal of Nervous and Mental Disease. 2003;191(2):93–99. doi: 10.1097/01.NMD.0000051903.60517.98. doi: http://dx.doi.org/10.1097/01.NMD.0000051903.60517.98. [DOI] [PubMed] [Google Scholar]
  30. Frueh B.C, Cusack K.J, Grubaugh A.L, Sauvageot J.A, Wells C. Clinicians’ perspectives on cognitive-behavioral treatment for PTSD among persons with severe mental illness. Psychiatric Services. 2006;57(7):1027–31. doi: 10.1176/ps.2006.57.7.1027. doi: http://dx.doi.org/10.1176/appi.ps.57.7.1027. [DOI] [PubMed] [Google Scholar]
  31. Frueh B.C, Cusack K.J, Hiers T.G, Monogan S, Cousins V.C, Cavenaugh S.D. Improving public mental health services for trauma victims in South Carolina. Psychiatric Services. 2001;52(6):812–814. doi: 10.1176/appi.ps.52.6.812. [DOI] [PubMed] [Google Scholar]
  32. Frueh B.C, Grubaugh A.L, Cusack K.J, Kimble M.O, Elhai J.D, Knapp R.G. Exposure-based cognitive-behavioral treatment of PTSD in adults with schizophrenia or schizoaffective disorder: A pilot study. Journal of Anxiety Disorders. 2009;23(5):665–675. doi: 10.1016/j.janxdis.2009.02.005. doi: http://dx.doi.org/10.1016/j.janxdis.2009.02.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Gairns S, Alvarez-Jimenez M, Hulbert C, McGorry P, Bendall S. Perceptions of clinicians treating young people with first-episode psychosis for post-traumatic stress disorder. Early Intervention in Psychiatry. 2015;9(1):12–20. doi: 10.1111/eip.12065. doi: http://dx.doi.org/10.1111/eip.12065. [DOI] [PubMed] [Google Scholar]
  34. Green C.E, Freeman D, Kuipers E, Bebbington P, Fowler D, Dunn G, Garety P.A. Measuring ideas of persecution and social reference: The Green et al. Paranoid thought scales (GPTS) Psychological Medicine. 2008;38(1):101–111. doi: 10.1017/S0033291707001638. doi: http://dx.doi.org/10.1017/S0033291707001638. [DOI] [PubMed] [Google Scholar]
  35. Haddock G, McCarron J, Tarrier N, Faragher E.B. Scales to measure dimensions of hallucinations and delusions: The psychotic symptom rating scales (PSYRATS) Psychological Medicine. 1999;29(4):879–889. doi: 10.1017/s0033291799008661. [DOI] [PubMed] [Google Scholar]
  36. Harned M.S, Dimeff L.A, Woodcock E.A, Contreras I. Predicting adoption of exposure therapy in a randomized controlled dissemination trial. Journal of Anxiety Disorders. 2013;27(8):754–762. doi: 10.1016/j.janxdis.2013.02.006. doi: http://dx.doi.org/10.1016/j.janxdis.2013.02.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Harned M.S, Dimeff L.A, Woodcock E.A, Kelly T, Zavertnik J, Contreras I, Danner S.M. Exposing clinicians to exposure: A randomized controlled dissemination trial of exposure therapy for anxiety disorders. Behavior Therapy. 2014;45(6):731–744. doi: 10.1016/j.beth.2014.04.005. doi: http://dx.doi.org/10.1016/j.beth.2014.04.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Hembree E.A, Foa E.B, Dorfan N.M, Street G.P, Kowalski J, Tu X. Do patients drop out prematurely from exposure therapy for PTSD? Journal of Traumatic Stress. 2003;16(6):555–562. doi: 10.1023/B:JOTS.0000004078.93012.7d. doi: http://dx.doi.org/10.1023/B:JOTS.0000004078.93012.7d. [DOI] [PubMed] [Google Scholar]
  39. Jayawickreme N, Cahill S.P, Riggs D.S, Rauch S.A, Resick P.A, Rothbaum B.O, Foa E.B. Primum non nocere (first do no harm): Symptom worsening and improvement in female assault victims after prolonged exposure for PTSD. Depression and Anxiety. 2014;31(5):412–419. doi: 10.1002/da.22225. doi: http://dx.doi.org/10.1002/da.22225. [DOI] [PubMed] [Google Scholar]
  40. Karatzias A, Power K, McGoldrick T, Brown K, Buchanan R, Sharp D, Swanson V. Predicting treatment outcome on three measures for post-traumatic stress disorder. European Archives of Psychiatry and Clinical Neuroscience. 2007;257(1):40–46. doi: 10.1007/s00406-006-0682-2. doi: http://dx.doi.org/10.1007/s00406-006-0682-2. [DOI] [PubMed] [Google Scholar]
  41. Karlin B.E, Ruzek J.I, Chard K.M, Eftekhari A, Monson C.M, Hembree E.A, …. Foa E.B. Dissemination of evidence-based psychological treatments for posttraumatic stress disorder in the Veterans Health Administration. Journal of Traumatic Stress. 2010;23(6):663–673. doi: 10.1002/jts.20588. doi: http://dx.doi.org/10.1002/jts.20588. [DOI] [PubMed] [Google Scholar]
  42. Kawata A.K, Revicki D.A. Psychometric properties of the personal and social performance scale (PSP) among individuals with schizophrenia living in the community. Quality of Life Research. 2008;17(10):1247–1256. doi: 10.1007/s11136-008-9400-z. doi: http://dx.doi.org/10.1007/s11136-008-9400-z. [DOI] [PubMed] [Google Scholar]
  43. Kehle-Forbes S.M, Polusny M.A, Erbes C.R, Gerould H. Acceptability of prolonged exposure therapy among U.S. Iraq war veterans with PTSD symptomology. Journal of Traumatic Stress. 2014;27(4):483–487. doi: 10.1002/jts.21935. doi: http://dx.doi.org/10.1002/jts.21935. [DOI] [PubMed] [Google Scholar]
  44. Larsen S.E, Wiltsey Stirman S, Smith B.N, Resick P.A. Symptom exacerbations in trauma-focused treatments: Associations with treatment outcome and non-completion. Behaviour Research and Therapy. 2015;77:68–77. doi: 10.1016/j.brat.2015.12.009. doi: http://dx.doi.org/10.1016/j.brat.2015.12.009. [DOI] [PubMed] [Google Scholar]
  45. Lecrubier Y, Sheehan D.V, Weiller E, Amorim P, Bonora I, Harnett Sheehan K, Dunbar G.C. The mini international neuropsychiatric interview (MINI). A short diagnostic structured interview: Reliability and validity according to the CIDI. European Psychiatry. 1997;12(5):224–231. [Google Scholar]
  46. Meyer J.M, Farrell N.R, Kemp J.J, Blakey S.M, Deacon B.J. Why do clinicians exclude anxious clients from exposure therapy? Behaviour Research and Therapy. 2014;54:49–53. doi: 10.1016/j.brat.2014.01.004. doi: http://dx.doi.org/10.1016/j.brat.2014.01.004. [DOI] [PubMed] [Google Scholar]
  47. Morosini P.L, Magliano L, Brambilla L, Ugolini S, Pioli R. Development, reliability and acceptability of a new version of the DSM-IV social and occupational functioning assessment scale (SOFAS) to assess routine social functioning. Acta Psychiatrica Scandinavica. 2000;101(4):323–329. [PubMed] [Google Scholar]
  48. Mueser K.T, Gottlieb J.D, Xie H, Lu W, Yanos P.T, Rosenberg S.D, …. McHugo G.J. Evaluation of cognitive restructuring for post-traumatic stress disorder in people with severe mental illness. The British Journal of Psychiatry: The Journal of Mental Science. 2015;206(6):501–508. doi: 10.1192/bjp.bp.114.147926. doi: http://dx.doi.org/10.1192/bjp.bp.114.147926. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Mueser K.T, Rosenberg S.D, Fox L, Salyers M.P, Ford J.D, Carty P. Psychometric evaluation of trauma and posttraumatic stress disorder assessments in persons with severe mental illness. Psychological Assessment. 2001;13(1):110–117. doi: 10.1037//1040-3590.13.1.110. doi: http://dx.doi.org/10.1037//1040-3590.13.1.110. [DOI] [PubMed] [Google Scholar]
  50. Mueser K.T, Rosenberg S.D, Xie H, Jankowski M.K, Bolton E.E, Lu W, …. Wolfe R. A randomized controlled trial of cognitive-behavioral treatment for posttraumatic stress disorder in severe mental illness. Journal of Consulting and Clinical Psychology. 2008;76(2):259–271. doi: 10.1037/0022-006X.76.2.259. doi: http://dx.doi.org/10.1037/0022-006X.76.2.259. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Nasrallah H, Morosini P, Gagnon D.D. Reliability, validity and ability to detect change of the personal and social performance scale in patients with stable schizophrenia. Psychiatry Research. 2008;161(2):213–224. doi: 10.1016/j.psychres.2007.11.012. doi: http://dx.doi.org/10.1016/j.psychres.2007.11.012. [DOI] [PubMed] [Google Scholar]
  52. Patrick D.L, Burns T, Morosini P, Rothman M, Gagnon D.D, Wild D, Adriaenssen I. Reliability, validity and ability to detect change of the clinician-rated personal and social performance scale in patients with acute symptoms of schizophrenia. Current Medical Research and Opinion. 2009;25(2):325–338. doi: 10.1185/03007990802611919. [DOI] [PubMed] [Google Scholar]
  53. Reger G.M, Durham T.L, Tarantino K.A, Luxton D.D, Holloway K.M, Lee J.A. Deployed soldiers’ reactions to exposure and medication treatments for PTSD. Psychological Trauma: Theory, Research, Practice and Policy. 2013;5(4):309–316. doi: http://dx.doi.org/10.1037/a0028409. [Google Scholar]
  54. Rief W, Glombiewski J.A, Gollwitzer M, Schubö A, Schwarting R, Thorwart A. Expectancies as core features of mental disorders. Current Opinion in Psychiatry. 2015;28(5):378–385. doi: 10.1097/YCO.0000000000000184. doi: http://dx.doi.org/10.1097/YCO.0000000000000184. [DOI] [PubMed] [Google Scholar]
  55. Rizvi S.L, Vogt D.S, Resick P.A. Cognitive and affective predictors of treatment outcome in cognitive processing therapy and prolonged exposure for posttraumatic stress disorder. Behaviour Research and Therapy. 2009;47(9):737–743. doi: 10.1016/j.brat.2009.06.003. doi: http://dx.doi.org/10.1016/j.brat.2009.06.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Ruzek J.I, Eftekhari A, Crowley J, Kuhn E, Karlin B.E, Rosen C.S. Post-training beliefs, intentions, and use of prolonged exposure therapy by clinicians in the Veterans Health Administration. Administration and Policy in Mental Health. 2015 doi: 10.1007/s10488-015-0689-y. doi: http://dx.doi.org/10.1007/s10488-015-0689-y. [DOI] [PubMed] [Google Scholar]
  57. Ruzek J.I, Eftekhari A, Rosen C.S, Crowley J.J, Kuhn E, Foa E.B, …. Karlin B.E. Effects of a comprehensive training program on clinician beliefs about and intention to use prolonged exposure therapy for PTSD. Psychological Trauma: Theory, Research, Practice and Policy. 2016;8(3):348–355. doi: 10.1037/tra0000004. doi: http://dx.doi.org/10.1037/tra0000004. [DOI] [PubMed] [Google Scholar]
  58. Salyers M.P, Evans L.J, Bond G.R, Meyer P.S. Barriers to assessment and treatment of posttraumatic stress disorder and other trauma-related problems in people with severe mental illness: Clinician perspectives. Community Mental Health Journal. 2004;40(1):17–31. doi: 10.1023/b:comh.0000015215.45696.5f. [DOI] [PubMed] [Google Scholar]
  59. Shafran R, Clark D.M, Fairburn C.G, Arntz A, Barlow D.H, Ehlers A, … Wilson, G.T. (2009). Mind the gap: Improving the dissemination of CBT. Behaviour Research and Therapy. 47(11):902–909. doi: 10.1016/j.brat.2009.07.003. doi: http://dx.doi.org/10.1016/j.brat.2009.07.003. [DOI] [PubMed] [Google Scholar]
  60. Shapiro F. Eye movement desensitization and reprocessing (EMDR): Basic principles, protocols, and procedures. New York: Guilford Press; 2001. [Google Scholar]
  61. Sheehan D.V, Lecrubier Y, Harnett Sheehan K, Janavs J, Weiller E, Keskiner A, Dunbar G.C. The validity of the mini international neuropsychiatric interview (MINI) according to the SCID-P and its reliability. European Psychiatry. 1997;12(5):232–241. [Google Scholar]
  62. Sheehan D.V, Lecrubier Y, Sheehan K.H, Amorim P, Janavs J, Weiller E, Dunbar G.C. The mini-international neuropsychiatric interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. The Journal of Clinical Psychiatry. 1998;59(Suppl 20):22–33. [PubMed] [Google Scholar]
  63. Shiner B, D'Avolio L.W, Nguyen T.M, Zayed M.H, Young-Xu Y, Desai R.A, …. Watts B.V. Measuring use of evidence based psychotherapy for posttraumatic stress disorder. Administration and Policy in Mental Health. 2013;40(4):311–318. doi: 10.1007/s10488-012-0421-0. doi: http://dx.doi.org/10.1007/s10488-012-0421-0. [DOI] [PubMed] [Google Scholar]
  64. Speckens A.E, Ehlers A, Hackmann A, Clark D.M. Changes in intrusive memories associated with imaginal reliving in posttraumatic stress disorder. Journal of Anxiety Disorders. 2006;20(3):328–341. doi: 10.1016/j.janxdis.2005.02.004. doi: http://dx.doi.org/10.1016/j.janxdis.2005.02.004. [DOI] [PubMed] [Google Scholar]
  65. Sprang G, Craig C, Clark J. Factors impacting trauma treatment practice patterns: The convergence/divergence of science and practice. Journal of Anxiety Disorders. 2008;22(2):162–174. doi: 10.1016/j.janxdis.2007.02.003. doi: http://dx.doi.org/10.1016/j.janxdis.2007.02.003. [DOI] [PubMed] [Google Scholar]
  66. Taylor S, Thordarson D.S, Maxfield L, Fedoroff I.C, Lovell K, Ogrodniczuk J. Comparative efficacy, speed, and adverse effects of three PTSD treatments: Exposure therapy, EMDR, and relaxation training. Journal of Consulting and Clinical Psychology. 2003;71(2):330–338. doi: 10.1037/0022-006x.71.2.330. doi: http://dx.doi.org/10.1037/0022-006X.71.2.330. [DOI] [PubMed] [Google Scholar]
  67. Thrasher S, Power M, Morant N, Marks I, Dalgleish T. Social support moderates outcome in a randomized controlled trial of exposure therapy and (or) cognitive restructuring for chronic posttraumatic stress disorder. Canadian Journal of Psychiatry. 2010;55(3):187–190. doi: 10.1177/070674371005500311. [DOI] [PubMed] [Google Scholar]
  68. Van den Berg D.P, De Bont P.A, Van der Vleugel B.M, De Roos C, De Jongh A, Van Minnen A, Van der Gaag M. Prolonged exposure vs eye movement desensitization and reprocessing vs waiting list for posttraumatic stress disorder in patients with a psychotic disorder: A randomized clinical trial. JAMA Psychiatry. 2015;72(3):259–267. doi: 10.1001/jamapsychiatry.2014.2637. doi: http://dx.doi.org/10.1001/jamapsychiatry.2014.2637. [DOI] [PubMed] [Google Scholar]
  69. Van den Berg D.P, De Bont P.A, Van der Vleugel B.M, De Roos C, De Jongh A, Van Minnen A, Van der Gaag M. Trauma-focused treatment in PTSD patients with psychosis: Symptom exacerbation, adverse events, and revictimization. Schizophrenia Bulletin. 2016;42(3):693–702. doi: 10.1093/schbul/sbv172. doi: http://dx.doi.org/10.1093/schbul/sbv172. [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Van den Berg D.P, Van der Gaag M. Treating trauma in psychosis with EMDR: A pilot study. Journal of Behavior Therapy and Experimental Psychiatry. 2012;43(1):664–671. doi: 10.1016/j.jbtep.2011.09.011. doi: http://dx.doi.org/10.1016/j.jbtep.2011.09.011. [DOI] [PubMed] [Google Scholar]
  71. Van Minnen A, Hendriks L, Olff M. When do trauma experts choose exposure therapy for PTSD patients? A controlled study of therapist and patient factors. Behaviour Research and Therapy. 2010;48(4):312–320. doi: 10.1016/j.brat.2009.12.003. [DOI] [PubMed] [Google Scholar]
  72. Van Minnen A, Zoellner L.A, Harned M.S, Mills K. Changes in comorbid conditions after prolonged exposure for PTSD: A literature review. Current Psychiatry Reports. 2015;17(3):549. doi: 10.1007/s11920-015-0549-1. doi: http://dx.doi.org/10.1007/s11920-015-0549-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Weathers F.W, Keane T.M, Davidson J.R. Clinician-administered PTSD scale: A review of the first ten years of research. Depression and Anxiety. 2001;13(3):132–156. doi: 10.1002/da.1029. [DOI] [PubMed] [Google Scholar]
  74. World Health Organization. Guidelines for the management of conditions that are specifically related to stress. Geneva, Switzerland: World Health Organization; 2013. [PubMed] [Google Scholar]

Articles from European Journal of Psychotraumatology are provided here courtesy of Taylor & Francis

RESOURCES