Abstract
This study examined the relationship between therapist factors and child outcomes in anxious youth who received cognitive–behavioral therapy (CBT) as part of the Child–Adolescent Anxiety Multimodal Study (CAMS). Of the 488 youth who participated in the CAMS project, 279 were randomly assigned to one of the CBT conditions (CBT only or CBT plus sertraline). Participants included youth (ages 7–17; M = 10.76) who met criteria for a principal anxiety disorder. Therapists included 38 cognitive–behavioral therapists. Therapist style, treatment integrity, and therapist experience were examined in relation to child outcome. Child outcome was measured via child, parent, and independent evaluator report. Therapists who were more collaborative and empathic, followed the treatment manual, and implemented it in a developmentally appropriate way had youth with better treatment outcomes. Therapist “coach” style was a significant predictor of child-reported outcome, with the collaborative “coach” style predicting fewer child-reported symptoms. Higher levels of therapist prior clinical experience and lower levels of prior anxiety-specific experience were significant predictors of better treatment outcome. Findings suggest that although all therapists used the same manual-guided treatment, therapist style, experience, and clinical skills were related to differences in child outcome. Clinical implications and recommendations for future research are discussed.
Keywords: cognitive-behavioral therapy, child anxiety, therapist factors, collaboration, coach style
Anxiety disorders are common psychological disorders experienced by youth with reported rates of 10–20% in the general population and primary care settings (Chavira, Stein, Bailey, & Stein, 2004; Costello, Mustillo, Keeler, & Angold, 2004). Anxiety disorders in youth are highly comorbid with one another as well as with other disorders such as attention-deficit/hyperactivity disorder, major depression, and dysthymia (Costello, Egger, & Angold, 2005), and they are associated with impairments at home, in school, and with peers (Van Amerigen, Mancini, & Farvolden, 2003). Research indicates that most anxiety disorders do not abate with time, and if left untreated, youth are at a greater risk for anxiety disorders in adulthood (Pine, Cohen, Gurley, Brook, & Ma, 1998), future depression (Biederman, Faraone, Mick, & Lelon, 1995), and potential substance abuse (Kendall, Safford, Flannery-Schroeder, & Webb, 2004).
An advance in the area of anxiety in youth has been the development of empirically supported treatments and a focus on evidence-based practice (American Psychological Association, 2006). Randomized clinical trials (RCTs) support the efficacy of cognitive–behavioral therapy (CBT) for anxious youth (e.g., Barrett, Dadds, & Rapee, 1996; Kendall, Hudson, Gosch, Flannery-Schroeder, & Suveg, 2008; Walkup et al., 2008) and reviewers have concluded that CBT is an effective treatment for anxious youth (e.g., Cartwright-Hatton, Roberts, Chitsaben, Fothergill, & Harrington, 2004; Silverman, Pina, & Viswesvaran, 2008). Nevertheless, approximately one third of youth do not respond to treatment.
Among the topics examined to help explain differential treatment response are client diagnoses and comorbidities (e.g., Berman, Weems, Silverman, & Kurtines, 2000; Kendall, Brady, & Verduin, 2001), family variables (e.g., Crawford & Manassis, 2001;Hughes, Hedtke, & Kendall, 2008, Ginsburg, Siqueland, Masia-Warner, & Hedtke, 2004; Southam-Gerow, Kendall, & Weersing, 2001), and child in-session variables (e.g., Chu & Kendall, 2004; Shirk & Karver, 2003). A relatively neglected area is the relationship between therapist variables and child outcome. Although therapist variability may be somewhat attenuated by manual-guided therapy, in actuality, therapists’ flexibility, interpersonal style, level of experience, and overall competence does vary and may impact effective outcomes.
Therapist variables examined with adult patients include demographics (e.g., Bowman, Scogin, Floyd, & McKendree-Smith, 2001; Maramba, Nagayama, & Gordon, 2002; Zlotnick, Elkin, & Shea, 1998), training and experience (e.g., Blatt, Sanislow, Zuroff, & Pilkonis, 1996; Huppert et al., 2001), and empathy (e.g., Sexton, Ridley, & Kleiner, 2004; Shadish & Baldwin, 2002). For example, in a study of the relationship between therapist characteristics and outcome of in vivo exposure treatment for agoraphobics, Williams and Chambless (1990) found that clients who rated their therapists as more empathic, caring, and involved were significantly more likely to improve. Huppert et al. (2001) examined data from the Multicenter Collaborative Study for the Treatment of Panic Disorder in adults and reported significant therapist effects. Treatment was manualized, and therapists were trained and monitored for adherence. For patients who received CBT, Huppert et al. found that therapists with more general experience were more likely to have patients whose anxiety sensitivity decreased, and older therapists were associated with more change in overall patient panic severity.
Some studies of therapist factors have been conducted with youth samples. Huey, Henggeler, Brondino, and Pickrel (2000) examined multisystemic therapy for substance abusing adolescent offenders and found that therapist adherence to the protocol was associated with improved family relations and decreased delinquent peer affiliation. With substance-using adolescents, Hogue and colleagues (2008) examined treatment adherence and therapist competence, and found that stronger adherence predicted greater declines in drug use.
A prominent difference between youth and adult clients is the way each come to treatment: Youth typically do not refer themselves. The fact that children are sent for treatment suggests that therapists have to take special care to promote the youth’s involvement and collaboration on treatment goals. This highlights the importance of identifying specific therapist behaviors and interaction styles with child clients that lead to a good working relationship. Diamond, Liddle, Hogue, and Dakof (1999) measured therapist behaviors associated with improving initially poor therapist—adolescent alliance. Results suggested that by the third session, therapists attended to the adolescent’s experience, presented themselves as an ally, and helped the adolescent formulate personally meaningful goals more extensively in cases in which the alliance improved than in cases in which the alliance did not improve. Creed and Kendall (2005) identified specific therapist behaviors that contributed to the youths’ perception of a good therapeutic relationship. Sessions were rated for therapist behaviors and alliance was assessed via child, therapist, and observer ratings. Therapist “collaboration” positively predicted child ratings of a positive alliance and “pushing the child to talk” negatively predicted ratings of alliance. Certain therapist behavior (e.g., collaboration) may contribute to both the formation of a good alliance and enhanced outcome in youth. Is there a particular style that the therapist who works with youth with anxiety should employ to be optimally effective? In CBT for anxiety, the therapist is a coach (Kendall, 2012), where the coach is someone who is collaborative and does not tell the child what to do but helps him/her discover the skills that accomplish the collaborative goal. In contrast, a teacher may be more formal and didactic. One can posit that a collaborative “coach” style may be more effective than a didactic “teacher” style.
There is initial evidence to suggest that therapist flexibility may be related to increases in child engagement in therapy, which in turn can be linked to improvements. Chu and Kendall (2009) found that child involvement and therapist flexibility (in a sample of 63 anxious youth who received CBT) predicted improvement in post-treatment diagnostic status and levels of child impairment. Therapist flexibility, which was defined therein as therapist attempts to adapt treatment to a child’s needs, is also a hallmark feature of collaboration and the “coach” style. Research is needed to examine such therapy variables as related to outcomes.
Investigators searching for predictors of treatment response have appropriately examined outcomes from RCTs. In the Child–Adolescent Anxiety Multimodal Study (CAMS), Walkup et al., (2008) compared CBT (a modified version of the Coping Cat; Kendall, 1990), pharmacotherapy (sertraline), and their combination (COMB) to pill placebo in 488 youth (ages 7–17) who had a primary diagnosis of separation anxiety disorder (SAD), generalized anxiety disorder (GAD), or Social Phobia (SP). Results indicated that the combination of CBT and sertraline produced the highest responder rates, with a significant percentage of children (80.7%), found to be much or very much improved. CBT (60%) and sertraline (55%) were also effective and demonstrated greater improvement than placebo (24%). Remission rates reflected this same order of outcomes by conditon (Ginsburg et al., 2011). The present study examined the relationship between therapist factors and outcome in the sample of anxious youth who received CBT as part of CAMS.
It was hypothesized that higher ratings of therapist competence, treatment integrity, and experience would be positively correlated with outcome. It was also hypothesized that therapist competence, integrity, and style would be significant predictors of outcome above and beyond therapist general clinical and anxiety specific clinical experience. In addition, we explored the relationship between therapist professional degree, secondary theoretical orientation, caseload, and treatment outcome.
Method
The study used data from the CAMS multisite treatment evaluation (Walkup et al., 2008). The methods are described in Compton et al. (2009). In CAMS, 488 youth (ages 7 –17) (see Kendall et al., 2010 for detailed description of the participants) were randomly assigned to 12 weeks (14 sessions) of CBT (the Coping Cat for children, Kendall & Hedtke, 2006, and the corresponding C.A.T. Project for teens Kendall, Choudhury, Hudson & Webb, 2002), sertraline (at a dose of up to 200 mg per day), a combination of CBT and sertraline (COMB), or pill placebo. Youth who were assigned to CBT conditions participated in 14 sessions over 12 weeks.
CAMS used the age-appropriate Coping Cat protocol. Guidelines assisted the therapist in flexible applications (Compton et al., 2010). For example, the C.A.T. Project is the teen version of Coping Cat. Across both child and adolescent CBT protocols, the 14 sessions were scheduled over 12 weeks (to be consistent with 12 weeks of medication). The 14 sessions included twelve 60-min weekly individual (e.g., child/adolescent) sessions and two parent sessions (scheduled immediately after the individual session at weeks 3 and 5). The first six taught new skills (e.g., the FEAR plan), whereas the second six provided opportunities to practice newly learned skills (exposure tasks) within and outside of the sessions. The overall goal of CBT was to teach youth to recognize the signs of unwanted anxiety, let these signs serve as cues for the use of more effective anxiety management strategies, and face rather than avoid anxiety-provoking situations.
Procedure
Informed consent/assent for treatment/videotaping was obtained from parents and youth. All youth and parents completed self-reports and were interviewed by reliable diagnosticians (Independent Evaluators: IEs), blind to treatment condition. For youth in CBT and COMB, CBT supervisors rated therapist competency at the completion of the study. Quality assurance (QA) raters assessed therapist treatment integrity by examining the degree to which the therapists adhered to the content of the treatment manual and how they implemented that content throughout the study.
CAMS CBT
Youth received the age appropriate version of the Coping Cat program over 12 weeks. The program combines behavioral (e.g., relaxation, exposure tasks) and cognitive (e.g., problem-solving, change self-talk) strategies. Parents received two sessions (#s 4, 9). The first half focuses on psychoeducation, and the second on exposure tasks. Early sessions help the child identify anxiety and introduce strategies to ameliorate anxiety. In exposure tasks, the child approaches, rather than avoids, anxiety-provoking situations. Parents were included in exposure tasks as appropriate. Youth in COMB received identical CBT, along with pharmacotherapy (up to 200 mg of Sertraline). Youth in COMB met with psychiatrists weekly for 30-minute sessions (excluding CBT). Although manual-based, therapists were flexible and tailored the treatment to the youth’s developmental level and/or individual characteristics.
Therapist Training
Therapists (38) had a minimum of 2 years experience with anxious youth. Therapists (a) studied written materials (e.g., manual); (b) participated in CBT-supervisor-led workshops (i.e., didactics, role-plays, and videotape playback); (c) passed a CBT knowledge test; and (d) completed a supervised pilot case. Therapists participated in weekly cross-site group telephone supervision and, when appropriate, individual site-level supervision. Supervision was led by licensed clinical psychologists with at least 5 years experience with the treatment protocol.
Participants
Study participants included (a) CAMS youth who completed CBT, (b) the therapists who provided CBT, and (c) supervisors of the CBT therapists.
Client (youth) participants
Youth (279) were randomized to CBT or COMB (see Table 1).Youth represent diverse ethnic/minority backgrounds and came from clinics, schools, and local community organizations. Youth met criteria for a principal diagnosis of SAD, GAD, or SP based on the composite of the Anxiety Disorders Interview Schedule for DSM–IV, Child and Parent Version (Silverman & Albano, 1996). Children were excluded for an unstable medical condition, IQ <80, refusing to attend school due to anxiety, or had not had a response to two adequate trials of selective serotonin-reuptake inhibitors (SSRIs) or an adequate trial of CBT.
Table 1.
Baseline Characteristics of Child Participants
| Combination therapy (N = 140) |
Cognitive-Behavioral therapy (N = 139) |
All subjects receiving CBT (N = 279) |
|
|---|---|---|---|
| Child age in years (SD) | 10.8 (2.82) | 10.71 (2.76) | 10.76 (2.79) |
| Child’s gender (% female) | 72 (51.4) | 72 (51.8) | 144 (51.6) |
| Child’s race/ethnic group (%) | |||
| Caucasian | 116 (82.9) | 106 (76.3) | 222 (79.6) |
| Hispanic | 16 (11.4) | 21 (15.1) | 37 (13.3) |
| African American | 11 (7.9) | 14 (10.1) | 25 (9) |
| Asian | 6 (4.3) | 1 (0.7) | 7 (2.5) |
| Pacific Islander | 1 (0.7) | — | 1 (0.4) |
| American Indian | 1 (0.7) | 3 (2.2) | 4 (1.4) |
| Low socioeconomic status (%) | 35 (25) | 33 (23.7) | 68 (24.4) |
| Primary anxiety diagnosis (%) | |||
| Separation anxiety disorder | 3 (2.1) | 4 (2.9) | 7 (2.5) |
| Social phobia | 11 (7.9) | 14 (10.1) | 25 (9.0) |
| Generalized anxiety disorder | 8 (5.7) | 14 (10.1) | 22 (7.9) |
| SAD and SoP | 14 (10.0) | 9 (6.5) | 23 (8.2) |
| SAD and GAD | 12 (8.6) | 13 (9.4) | 25 (9 .0) |
| SoP and GAD | 41 (33.6) | 43 (30.9) | 90 (32.3) |
| SAD, Sop, GAD | 45 (32.1) | 42 (30.2) | 87 (31.2) |
Note. SD = Standard deviation; Low socioeconomic status was defined as a score of 3 or less on the Hollingshead Two-Factor Scale, which ranges from 1–5; SAD = separation anxiety disorder; SoP = social phobia; GAD = generalized anxiety disorder.
Therapist participants (see Table 2)
Table 2.
Descriptives of Study Therapists and Supervisors
| CBT Therapists (N = 38) |
CBT Supervisors (N = 10) |
|
|---|---|---|
| Age in years (M ± SD) | 30.08 (4.40) | 37.8 (7.44) |
| Gender (% female) | 32 (84.2) | 7 (70) |
| Race/Ethnic group (%) | ||
| Caucasian | 35 (92.1) | 10 (100) |
| Asian | 2 (5.3) | — |
| Other | 1 (2.6) | — |
| Professional Degree (%) | ||
| PhD | 22 (57.9) | 9 (90) |
| PsyD | 1 (2.6) | — |
| MA/MS | 14 (36.8) | − |
| LCSW | 1 (2.6) | 1 (10) |
| Prior clinical experience in years (M ± SD) |
5.59 (2.42) | 13.5 (6.17) |
| Prior # of anxious youth cases treated (M ± SD) |
14.71 (8.39) | 91.5 (59.35) |
Therapists (doctoral candidates, social workers, psychologists) were female (84%) and Caucasian (92%), and held either a PhD (58%) or a master’s degree in psychology (37%) (M age 30.08 year; SD = 4.4 years). The majority identified their primary theoretical orientation as cognitive–behavioral, with secondary theoretical orientations of behavioral, family systems, and eclectic. Therapists had an average of 5.59 (SD = 2.42) years of clinical experience and treated an average of 14.71 (SD = 8.39) anxious youth. The modal study caseload for therapists was eight youngsters.
Supervisor participants (see Table 1)
CBT supervisors included nine PhD psychologists and one LCSW (average clinical experience 13.5 years; average of 91.5 cases of youth anxiety). Supervisors had experience with the treatment manual and supervising its implementation.
Measures
Treatment outcome measures
(Clinical Global Impression-Severity and Improvement Scales (CGI-S and I; Guy, 1976). The CGI-S provides a global rating of baseline severity ranging from 1 (not at all ill) to 7 (extremely ill), and the CGI-I provides a global rating of improvement ranging from 1 (very much improved) to 7 (very much worse). The CGI-I was the primary categorical measure of treatment response: defined as 1 (very much improved) or 2 (much improved). Such scores (1 or 2) reflect substantial, meaningful improvement in anxiety severity (Walkup et al., 2008). Treatment responders were rated with CGI-I of a 1 or 2 by the IE.
Global Assessment Scale for Children (CGAS; Shaffer et al., 1983). The CGAS (1–100) measures global impairment and functioning over the previous month. The IE completed the CGAS at pre- and posttreatment based on child and parent input.
Pediatric Anxiety Rating Scale (PARS; Research Units on Pediatric Psychopharmacology Anxiety Study, 2002). The PARS is a clinician-administered anxiety severity scale. Scores are calculated by summing items assessing anxiety severity, frequency, distress, avoidance, and interference during the previous week. Total scores range from 0 to 30, with scores above 13 indicating clinically meaningful anxiety. The PARS has excellent interrater reliability (>0.97).
Child Behavior Checklist (CBCL; Achenbach, 1991; Achenbach & Edelbrock, 1991). The 118-item CBCL is a parent report of their youth’s behavioral problems and social competencies. CBCL items are rated 0 to 2. The CBCL has normative scores (Achenbach & Rescorla, 2001) and yields Internalizing and Externalizing scores, and narrowband subscales. The CBCL Internalizing and Anxiety/Depression subscales were used to measure parent-reported child symptomatology. Internal consistency on the subscales range from .54–.96. Retest reliability on the subscales range from .86–.89 (Achenbach & Rescorla, 2001).
Multidimensional Anxiety Scale for Children (MASC; March, Parker, Sullivan, Stallings, & Conners, 1997). The MASC is a 39-item self-report rating scale assessing anxious symptoms in youth ages 8–19. Items are rated on a 4-point scale (0 = Never true about me, 3 = Often true about me). The MASC provides a Total score and factor scores. The MASC has high internal consistency (e.g., r = .90 for Total score and r = .74–.85 for subscales; March et al., 1997; March, Sullivan, & Parker, 1999) and retest reliability in clinic samples (r = .79; March et al., 1997) and school samples (r = .88; March et al., 1999). The MASC discriminates anxiety-disordered and non-anxiety-disordered adolescents (Dierker et al., 2001; Villabø, Gere, Torgersen, March, & Kendall, 2012).
Therapist measures
Therapist Information Form (TIF; Podell & Kendall, 2008a). The 16-item TIF is a self-report questionnaire completed by therapists. The TIF assessed therapist demographics (age, gender, ethnicity), professional training, practice experience, primary and secondary theoretical orientations, and study caseload. The TIF (a) includes the therapist variables examined in the literature, (b) takes into account criticisms of how these variables have been measured in previous studies, and (c) includes new variables. Consistent with Beutler et al. (2004), therapists reported the number of years during which they conducted individual therapy and the number of anxious youth they have worked with (rather than time since they obtained their degree).
CBT Checklist (CBTC; Kendall, Gosch, Albano, Ginsburg, & Compton, 2001). The 24-item CBTC assessed therapist treatment integrity (adherence to the manual, treatment implementation, and overall CBT skill). Items were rated by independent quality assurance (QA) raters with extensive experience in the treatment of anxious youth (4-point scale ranging from superior to failed to attempt). Videotaped CBT sessions were rated by comparing therapist integrity against a checklist of session content, as well as examining therapist verbalizations to ensure that the protocol was being followed and delivered in a developmentally appropriate manner. This measure yields a total therapist integrity score. Item 19, which relates to the parent sessions, was excluded. The mean treatment integrity score was 33.40 (SD = 8.39).
Supervisor Rating Form (SRF; Podell & Kendall, 2008b). The SRF is a 30-item scale assessing the supervisor’s global impression of the therapist’s competence with CBT for anxious youth as well as the therapist’s in-session style. Supervisors at each site completed the SRF once the therapist completed treatment with his or her last client. Ratings ranged from 1 to 5 (1 = never, 2 = rarely, 3 = sometimes, 4 = often, 5 = always). Ratings of therapist competence were based on general therapist characteristics and qualities (e.g., levels of empathy, warmth) and clinical skills (e.g., case conceptualization, session structure); therapist style was rated on the therapists’ level of collaboration and flexibility used in session with the child. The SRF yields a total therapist competence score, and a therapist style score. Higher therapist style ratings indicate a more collaborative “coach” style; lower ratings indicate a more rigid style. The mean competence score was 119.44 (SD = 14.54); the mean style score was 30.72 (SD = 3.01).
Data Analysis
Using small to medium effect sizes, 279 participants, and alpha at .05, power was .94 (Cohen, 1988). Chi-square and t tests compared youth assigned to CBT and COMB on age, gender, and ethnicity. Multicollinearity was assessed and nonsignificant. Analyses were conducted using a generalized linear mixed model with patients nested within clinicians who were then nested within site. Estimates of fixed effects examined the relationship between therapist factors and outcome measures. Correlations were also calculated between therapist factors and outcome measures for all youth who completed 12 weeks of treatment.
Treatment outcome was measured using: (1) CGI-I; Responder Status Scores of 1 or 2 indicating “very much improved” or “much improved.” (2) CGAS; higher scores indicate better overall functioning. (3) PARS; lower PARS scores indicate less impairment from anxiety. (4) MASC; lower scores indicate less anxiety symptoms. (5) CBCL-Internalizing and Anxiety/Depression scores; lower scores indicate less symptomatology.
Results
Preliminary Analyses
Descriptive/preliminary analyses (e.g., chi square; t tests) assessed differences (age, diagnosis, symptom severity) between youth assigned to CBT and COMB. No significant differences were found, with the exception of previously reported outcomes (Walkup et al., 2008). Youth in both conditions experienced significant treatment gains. Due to differences in treatment outcome, treatment condition was controlled in all subsequent analyses. In addition, an interaction term between treatment condition and independent variables (style, integrity, experience) was examined and not found to be significant. Multicollinearity was not found.
Primary Analyses
Significant positive correlations (see Table 3) were found between therapist style and the following variables: therapist prior clinical experience, therapist study caseload, therapists with a master’s degree, and therapist age. Higher ratings of a therapist “coach” style were correlated with higher levels of clinical experience, higher study caseload, therapists with a master’s degree, and older therapist age. Therapist treatment integrity was correlated with lower number of prior anxiety experience. Therapist prior clinical experience was positively correlated with prior anxiety experience and therapist age and negatively correlated with degree.
Table 3.
Bivariate Correlations Among Therapist Variables
| 1 | 2 | 3 | 4 | 5 | 6 | 7 8 | |
|---|---|---|---|---|---|---|---|
| 1. Therapist style | — | ||||||
| 2. Therapist treatment integrity | .11 | — | |||||
| 3. Therapist prior clinical experience | .12* | .02 | — | ||||
| 4. Therapist prior anxiety cases | .04 | −.13* | .40** | — | |||
| 5. Therapist study caseload | .12* | −.10 | .04 | .43** | — | ||
| 6. Therapist degree† | .23** | −.04 | −.49** | .12 | .28** | — | |
| 7. Therapist age | −.20* | −.04 | .66** | .28** | −.19** | −.38** | — |
| 8. Therapist secondary theoretical orientation†† | .07 | −.09 | −.12 | .15* | .36** | .33** | −.10 |
Note.
= Therapist master’s degree.
= p < .05.
p < .01.
Therapist secondary theoretical orientation refers to a secondary orientation other than CBT
There were significant correlations between therapist variables and child treatment outcome (Table 4). High ratings of therapist style were correlated with lower MASC scores, high ratings of therapist treatment integrity were correlated with lower CBCL Internalizing and CBCL Anxiety/Depression scores. More prior clinical experience was correlated with lower CBCL Internalizing and CBCL Anxiety/Depression scores. Higher study caseloads were correlated with higher PARS scores and nonresponder status. Higher levels of therapist prior anxiety experience were correlated with higher PARS scores and nonresponder status.
Table 4.
Correlations Between Therapist Variables and Child Treatment Outcome
| Therapist variable | Responder | CGAS | PARS | MASC | CBCL Int | CBCL Anx/Dep |
|---|---|---|---|---|---|---|
| Therapist style | .07 | −.01 | −.02 | −.16* | −.04 | −.01 |
| Therapist treatment integrity | .05 | −.08 | −.01 | −.03 | −.16* | −.14* |
| Therapist prior clinical experience | .04 | .02 | −.10 | −.06 | −.15* | −.16* |
| Therapist prior anxiety cases | −.19** | −.03 | .13* | .07 | .05 | −.03 |
| Therapist study caseload | −.13* | −.05 | .14* | .12 | −.08 | −.05 |
| Therapist degree† | −.04 | .04 | .07 | .03 | .07 | .09 |
| Therapist age | .02 | .06 | −.10 | −.05 | −.10 | −.12 |
| Therapist secondary theoretical orientation†† | −.07 | −.05 | .10 | −.08 | .07 | .04 |
Note.
= p < .05.
p < .01.
= Therapist master’s degree.
Therapist secondary theoretical orientation refers to a secondary orientation other than CBT. Responder = CGI-I scores < 2; CGAS = Children’s Global Assessment Scale; PARS = Pediatric Anxiety Rating Scale; MASC = Multidimensional Anxiety Scale for Children; CBCL Int = Child Behavior Checklist Internalizing Scale; CBCL Anx/Dep = CBCL Anxiety/Depression Scale.
Tables 5 and 6 present estimates of fixed effects for the general linear hierarchical models. Analyses were conducted using HLM with patients nested within therapists who were in turn nested within site. Results indicate significant effects for therapist style and MASC scores, and significant effects for therapist treatment integrity and CBCL Internalizing and CBCL Anxiety/Depression. Results in Table 6 indicate significant effects for therapist prior anxiety experience and responder status.
Table 5.
Estimates of Fixed Effects: Therapist Style and Treatment Integrity
| Therapist style |
Therapist treatment integrity |
|||||||
|---|---|---|---|---|---|---|---|---|
| Estimate | SE | t | p | Estimate | SE | t | p | |
| Treatment responder | .00 | .01 | .30 | .76 | −.01 | .00 | −.18 | .86 |
| CGAS | −.09 | .28 | −.32 | .75 | −.14 | .08 | −1.7 | .09 |
| PARS | .11 | .18 | .60 | .55 | .04 | .05 | .83 | .41 |
| MASC | −.87 | .45 | −1.9 | .05 | −.03 | .13 | −.23 | .82 |
| CBCL Internalizing | .12 | .32 | .38 | .71 | −.18 | .09 | −2.1 | .03 |
| CBCL Anxiety/Depression | .24 | .24 | .99 | .33 | −.13 | .07 | −2.1 | .04 |
Note. Responder = CGI-I scores < 2; CGAS = Children’s Global Assessment Scale; PARS = Pediatric Anxiety Rating Scale; MASC = Multidimensional Anxiety Scale for Children; CBCL = Child Behavior Checklist- Internalizing and Anxiety Subscale.
Table 6.
Estimates of Fixed Effects: Therapist Prior Experience
| Therapist clinical experience |
Therapist anxiety experience |
|||||||
|---|---|---|---|---|---|---|---|---|
| Estimate | SE | t | p | Estimate | SE | t | p | |
| Treatment responder | .03 | .02 | 1.7 | .10 | −.01 | .00 | −3.0 | .00 |
| CGAS | .60 | .49 | 1.2 | .22 | −.19 | .10 | −1.8 | .07 |
| PARS | −.50 | .29 | 01.7 | .09 | .12 | .06 | 1.8 | .07 |
| MASC | −.40 | .77 | −.52 | .61 | .07 | .17 | .45 | .66 |
| CBCL Internalizing | −.88 | .52 | −1.7 | .09 | .19 | .16 | 1.6 | .11 |
| CBCL Anxiety/Depressioonon | −.74 | .40 | −1.9 | .07 | .05 | .09 | .56 | .58 |
Note. Responder = CGI-I scores < 2; CGAS = Children’s Global Assessment Scale; PARS = Pediatric Anxiety Rating Scale; MASC = Multidimensional Anxiety Scale for Children; CBCL = Child Behavior Checklist- Internalizing and Anxiety Subscale.
Discussion
Therapist treatment integrity, therapist style, and therapist prior clinical experience and anxiety-specific experience were significant predictors of child outcome. Therapists who followed the guidelines of the manual and implemented it in a developmentally appropriate and supportive manner had youth with better outcomes. Therapist “coach” style was a significant predictor of child-reported outcome, with the collaborative “coach” style predicting fewer child-reported symptoms. More years of prior clinical experience predicted better outcome whereas more anxiety-specific experience was, surprisingly, linked to less optimal outcomes. Although all therapists used the manual-guided treatment, therapist experience and clinical skills were related to child outcome. The findings of Walkup et al. (2008) support the efficacy of CBT for anxious youth, and the present findings suggest that therapist factors contribute to differences in child outcome.
Therapist treatment integrity was a significant predictor of outcome on parentrated measures. This finding indicates that the quality of the therapist’s implementation of the treatment (the adapted Coping Cat program) is related to the child’s outcome. Therapists who were knowledgeable of CBT principles, covered required session content, and did so collaboratively were more likely to have clients who responded favorably. These findings are consistent with data from adult depression samples (DeRubeis & Feeley, 1990; Huey et al., 2000; Shaw et al., 1999; Trepka, Rees, Shapiro, Hardy, & Barkham, 2004). Strunk, Brotman, DeRubeis, and Hollon (2010) examined therapist cognitive therapy competence as a predictor of symptom change and found that competence was a significant predictor of evaluator-rated end-of-treatment depression severity. Competence was also found to be more highly related to outcomes for patients with earlier age of onset and comorbid anxiety. Akin to the present results, the Strunk et al. (2010) results support the relationship between outcome and therapist competence in a specific treatment (cognitive therapy) with a specific population (adult depression).
A meta-analysis of therapist adherence/competence and treatment outcome found that neither the mean weighted adherence-outcome nor competence-outcome effect size estimates were significantly different from zero (Webb, DeRubeis, & Barber, 2010), suggesting that therapist adherence and competence do not contribute to meaningful differences in client outcome. However, these results require caution given the heterogeneity of treatments (e.g., dynamic, interpersonal, CBT), problems (e.g., depression, panic, bulimia), and adherence/competence measures. There are also issues related to a restricted range of competence and adherence scores. In RCTs, therapists are trained and monitored and competence and adherence are required. This reduces that range of competence and adherence scores, which in turn makes it difficult to examine the relationship between therapist competence and adherence to outcome. Therapist factors may nevertheless be associated with differential outcomes.
In line with our hypotheses, a more collaborative therapist style was a significant predictor of outcome. A higher “coach” style predicted fewer child-reported anxiety symptoms. Creed and Kendall (2005) found that higher ratings of collaboration (part of the “coach” style) were associated with better alliance ratings. It is interesting that therapist competence and style were related to child-reported outcome, but not parent- or IE-rated outcome. A more collaborative style was also predictive of better child-rated outcomes, and higher ratings of treatment integrity and therapist prior clinical experience were predictive of parent-rated outcomes.
Results indicated that clinical experience predicted improved outcome for youth as rated by parents and IEs. These findings are consistent with our hypothesis and with prior research. For example, in Huppert et al. (2001) where patients received CBT, those who had therapists with more clinical experience showed greater improvement on panic symptoms than those seen by less experienced therapists. In CAMS and other RCTs (Keijsers, Schaap, Hoogduin, & Lammers, 1995; Nauta, Scholing, Emmelkamp, & Minderaa, 2003; Ollendick, Hagopian, & Huntziger, 1991; Vocisano, Klein, & Arnow, 2004), therapists received the same training and followed session-by-session guidelines with ongoing supervision and adherence checks. This methodology probably reduces therapist variability. It remains, however, that therapists with more experience may have a deeper understanding of CBT principles and more skill in implementation, as well as more skill in developing an alliance. Knowledge of CBT and a strong therapeutic alliance were significant predictors of outcome for anxious and depressed samples (Shirk & Karver, 2003).
Prior clinical experience may be related to a comfort and familiarity with the use of manuals and structured treatments. More experienced therapists may have had more opportunities to implement manual-based treatments and may be able to implement these programs with more adaptive flexibility. Manuals are not cookbooks but guides that require “flexibility within fidelity” (Kendall & Beidas, 2007; Kendall, Gosch, Furr, & Sood, 2008). The Coping Cat program has specific content and strategies, but the manner in which they are implemented can vary across therapists. Therapists with more clinical experience may be better able to flexibly implement the treatment.
Surprisingly, therapist prior anxiety-specific experience significantly predicted poorer child outcomes (the more anxiety-specific experience the therapist had, the more anxiety symptoms and the lower functioning the child had at posttreatment). Although speculative, it is possible that therapists with more anxiety-specific experience may have felt that they “already know how to do the treatment” and therefore did not adhere to the manual as closely. It is also possible that the therapists with more anxiety-specific experience had cases that were more severe, so the finding is linked to client-specific factors. Additional investigation is needed to replicate and potentially better understand the unanticipated relationship.
Among the strengths of the study are the large well-characterized sample of anxious youth (Kendall et al., 2010), the use of a manualized treatment program, well-trained therapists, conditions with and without medication, and the monitoring of therapist adherence. Study limitations include the unequal number of clients assigned to each therapist and the lack of a measure of the therapeutic alliance. The present results may also be limited by the measures used to assess treatment integrity and therapist competence, since the psychometric properties of these measures have yet to be established.
The importance of high levels of treatment integrity and a collaborative therapist style have clinical implications. Given that youth do not self-refer to treatment, collaboration between the therapist and the client may be especially important. Anxious youth are self-critical and have frequent negative thoughts (Kendall & Treadwell, 2007). A collaborative style may allow the child the freedom to talk and become involved, and experiment without the fear of criticism. Although CBT for anxious youth is a manual-based efficacious treatment, it may be best delivered in a flexible and collaborative manner. The use of a “coach” style may be the ideal manner to implement this type of treatment.
Results from the present study help delineate therapist features related to treatment outcome. Specifically, therapists who were more collaborative and empathic, followed the treatment manual, and implemented it in a developmentally appropriate way had youth with better treatment outcomes. The findings highlight the importance of therapists using an individualized collaborative and flexible approach, while maintaining fidelity to the treatment manual. Some have emphasized the value of manuals to disseminate empirically supported treatments (Kendall & Beidas, 2007), but others are hesitant to use manual-based treatments (Cohen, Sargent, & Seachrest, 1986). One reason may be the perception that manuals must be followed rigidly and without concern for interpersonal processes. Our findings underscore the merits of “flexibility within fidelity” (Kendall, Gosch et al., 2008). Last, as highlighted by Chu and Kendall (2009), therapy process research may help bridge the gap between clinical research and clinical practice by documenting elements of how best empirically supported treatments can be delivered (Chu & Kendall, 2009).
Acknowledgments
This research was supported by grants U01 MH63747, to Dr. Kendall; U01 MH064003, to Dr. Compton; U01 MH64107, to Dr. March; U01 MH64092, to Dr. Albano; U01 MH064089, to Dr. Walkup; U01 MH64003, to Dr. Birmaher; and U01 MH64088, to Dr. Piacentini from the National Institute of Mental Health. Views expressed within this article represent those of the authors and are not intended to represent the position of NIMH, NIH, or DHHS.
Contributor Information
Jennifer L. Podell, University of California Los Angeles
Philip C. Kendall, Temple University
Elizabeth A. Gosch, Philadelphia College of Osteopathic Medicine
Scott N. Compton, Duke University Medical Center
John S. March, Duke University Medical Center
Anne-Marie Albano, Columbia University.
Moira A. Rynn, Columbia University
John T. Walkup, Weill Cornell Medical College
Joel T. Sherrill, National Institute of Mental Health
Golda S. Ginsburg, Johns Hopkins University School of Medicine
Courtney P. Keeton, Johns Hopkins University School of Medicine
Boris Birmaher, University of Pittsburgh.
John C. Piacentini, University of California Los Angeles
References
- Achenbach T. Integrative guide for the 1991 CBCL/4–18, YSR, and TRF. University of Vermont; Burlington, VT: 1991. [Google Scholar]
- Achenbach T, Elderbrack C. Manual for the CBCL and 1991 Profile. University of Vermont; Burlington, VT: 1991. [Google Scholar]
- Achenbach T, Rescorla L. Manual for the ASEBA school-age forms and profiles. University of Vermont; Burlington, VT: 2001. [Google Scholar]
- American Psychological Association (APA) Presidential Task Force on Evidence-Based Practice Evidence-based practice in psychology. American Psychologist. 2006;61:271–285. doi: 10.1037/0003-066X.61.4.271. doi:10.1037/0003-066X.61.4.271. [DOI] [PubMed] [Google Scholar]
- Barrett PM, Dadds MR, Rapee RM. Family treatment of childhood anxiety: A controlled trial. Journal of Consulting and Clinical Psychology. 1996;64:333–342. doi: 10.1037//0022-006x.64.2.333. doi:10.1037/0022-006X.64.2.333. [DOI] [PubMed] [Google Scholar]
- Berman SL, Weems CF, Silverman WK, Kurtines WM. Predictors of outcome in exposure-based cognitive and behavioral treatments for phobic and anxiety disorders in children. Behavior Therapy. 2000;31:713–731. doi:10.1016/S0005-7894(00)80040-4. [Google Scholar]
- Beutler LE, Malik M, Alinohamed S, Harwood TM, Talebi H, Noble S, Wong E. Therapist variables. In: Lambert MJ, editor. Bergin and Garfield’s handbook of psychotherapy and behavior change. 5th Wiley; New York, NY: 2004. pp. 227–306. [Google Scholar]
- Biederman J, Faraone S, Mick E, Lelon E. Psychiatric comorbidity among referred juveniles with major depression: Fact or artifact? Journal of the American Academy of Child & Adolescent Psychiatry. 1995;34:579–590. doi: 10.1097/00004583-199505000-00010. doi:10.1097/00004583-199505000-00010. [DOI] [PubMed] [Google Scholar]
- Blatt SJ, Sanislow CA, Zuroff DC, Pilkonis PA. Characteristics of effective therapists: Further analyses of data from the National Institute of Mental Health Treatment of Depression Collaborative Research Program. Journal of Consulting and Clinical Psychology. 1996;64:1276–1284. doi: 10.1037//0022-006x.64.6.1276. doi:10.1037/0022-006X.64.6.1276. [DOI] [PubMed] [Google Scholar]
- Bowman DG, Scogin F, Floyd M, McKendree-Smith N. Effect of therapist sex on outcome of psychotherapy: A meta-analysis. Psychotherapy: Theory, Research, Practice, Training. 2001;38:142–148. doi:10.1037/0033-3204.38.2.142. [Google Scholar]
- Cartwright-Hatton S, Roberts C, Chitsabesan P, Fothergill C, Harrington R. Systematic review of the efficacy of cognitive behaviour therapies for childhood and adolescent anxiety disorders. British Journal of Clinical Psychology. 2004;43:421–436. doi: 10.1348/0144665042388928. doi:10.1348/0144665042388928. [DOI] [PubMed] [Google Scholar]
- Chavira DA, Stein M, Bailey K, Stein M. Child anxiety in primary care: Prevalent but untreated. Depression and Anxiety. 2004;20:155–164. doi: 10.1002/da.20039. doi:10.1002/da.20039. [DOI] [PubMed] [Google Scholar]
- Chu BC, Kendall PC. Positive association of child involvement and treatment outcome within a manual-based cognitive-behavioral treatment for anxious youth. Journal of Consulting and Clinical Psychology. 2004;72:821–829. doi: 10.1037/0022-006X.72.5.821. doi:10.1037/0022-006X.72.5.821. [DOI] [PubMed] [Google Scholar]
- Chu BC, Kendall PC. Therapist responsiveness to child engagement: Flexibility with manual-based CBT for anxious youth. Journal of Clinical Psychology. 2009;65:736–754. doi: 10.1002/jclp.20582. doi:10.1002/jclp.20582. [DOI] [PubMed] [Google Scholar]
- Cohen J. Statistical power analyses for the behavioral sciences. 2nd Academic Press; New York, NY: 1988. [Google Scholar]
- Cohen L, Sargent M, Seachrest L. Use of psychotherapy research by professional psychologists. American Psychologist. 1986;41:198–206. doi: 10.1037//0003-066x.41.2.198. doi:10.1037/0003-066X.41.2.198. [DOI] [PubMed] [Google Scholar]
- Compton SN, Walkup JT, Albano AM, Piacentini JC, Birmaher B, Sherrill J, March JS. Child/Adolescent Anxiety Multimodal Study (CAMS); Rationale, design, and methods. Child and Adolescent Psychiatry and Mental Health. 2010;4:1–15. doi: 10.1186/1753-2000-4-1. doi:10.1186/1753-2000-4-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Costello EJ, Egger HL, Angold A. The developmental epidemiology of anxiety disorders: Phenomenology, prevalence, and comorbidity. Child and Adolescent Psychiatric Clinics of North America. 2005;14:631–648. doi: 10.1016/j.chc.2005.06.003. doi:10.1016/j.chc.2005.06.003. [DOI] [PubMed] [Google Scholar]
- Costello EJ, Mustillo S, Keeler G, Angold A. Prevalence of psychiatric disorders in children and adolescents. In: Levine B, Petrila J, Hennessey K, editors. Mental health services: A public health perspective. Oxford University Press; New York, NY: 2004. pp. 111–128. [Google Scholar]
- Crawford AM, Manassis K. Familial predictors of treatment outcome in childhood anxiety disorders. Journal of the American Academy of Child & Adolescent Psychiatry. 2001;40:1182–1189. doi: 10.1097/00004583-200110000-00012. doi:10.1097/00004583-200110000-00012. [DOI] [PubMed] [Google Scholar]
- Creed TA, Kendall PC. Therapist alliance-building behavior within a cognitive-behavioral treatment for anxiety in youth. Journal of Consulting and Clinical Psychology. 2005;73:498–505. doi: 10.1037/0022-006X.73.3.498. doi:10.1037/0022-006X.73.3.498. [DOI] [PubMed] [Google Scholar]
- DeRubeis RJ, Feeley M. Determinants of change in cognitive therapy for depression. Cognitive Therapy and Research. 1990;14:469–482. doi:10.1007/BF01172968. [Google Scholar]
- Diamond G, Liddle H, Hogue A, Dakof G. Alliance building interventions with adolescents in family therapy: A process study. Psychotherapy: Theory, Research, Practice, Training. 1999;36:355–368. doi: 10.1037/h0087729. [Google Scholar]
- Dierker L, Albano AM, Clarke G, Heimberg R, Kendall PC, Merikangas K, Kupfer D. Screening for anxiety and depression in early adolescence. Journal of the American Academy of Child and Adolescent Psychiatry. 2001;40:929–936. doi: 10.1097/00004583-200108000-00015. [DOI] [PubMed] [Google Scholar]
- Ginsburg G, Kendall PC, Sakolsky D, Compton S, Piacentini J, Albano AM, March J. Remission after acute treatment in children and adolescents with anxiety disorders: Findings from the CAMS. Journal of Consulting and Clinical Psychology. 2011;79:806–813. doi: 10.1037/a0025933. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ginsburg GS, Siqueland L, Masia-Warner C, Hedtke KA. Anxiety disorders in children: Family matters. Cognitive and Behavioral Practice. 2004;11:28–43. doi:10.1016/S1077-7229(04)80005-1. [Google Scholar]
- Guy W. Clinical global impressions. In: Guy W, editor. ECDEU assessment manual for psychopharmacology, revised. National Institute of Mental Health; Rockville, MD: 1976. pp. 217–222. [Google Scholar]
- Hogue A, Henderson CE, Dauber S, Barajas PC, Fried A, Liddle H. Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting and Clinical Psychology. 2008;76:544–555. doi: 10.1037/0022-006X.76.4.544. doi:10.1037/0022-006X.76.4.544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huey SJ, Henggeler S, Brondino M, Pickrel S. Mechanisms of change in multi-systemic therapy: Reduce delinquent behavior through therapist adherence and improved family/ peer functioning. Journal of Consulting and Clinical Psychology. 2000;68:451–467. doi: 10.1037/0022-006X.68.3.451. [PubMed] [Google Scholar]
- Hughes AA, Hedtke KA, Kendall PC. Family functioning in families of children with anxiety disorders. Journal of Family Psychology. 2008;22:325–328. doi: 10.1037/0893-3200.22.2.325. doi:10.1037/0893-3200.22.2.325. [DOI] [PubMed] [Google Scholar]
- Huppert JD, Bufka LF, Barlow DH, Gorman JM, Shear MK, Woods SW. Therapists, therapist variables, and cognitive behavioral therapy outcome in a multicenter trial for panic disorder. Journal of Consulting and Clinical Psychology. 2001;69:747–755. doi: 10.1037//0022-006x.69.5.747. doi: 10.1037/0022-006X.69.5.747. [DOI] [PubMed] [Google Scholar]
- Keijsers GPJ, Schaap CPDR, Hoogduin CAL, Lammers MW. Patient therapist interaction in the behavioral treatment of panic disorder with agoraphobia. Behavior Modification. 1995;19:491–517. doi: 10.1177/01454455950194005. doi:10.1177/01454455950194005. [DOI] [PubMed] [Google Scholar]
- Kendall P. Coping Cat workbook. Workbook Publishing; Ardmore, PA: 1990. [Google Scholar]
- Kendall PC. Guiding theory for therapy with children and adolescents. In: Kendall PC, editor. Child and adolescent therapy: Cognitive-behavioral procedures. 4th Guilford Press; New York, NY: 2012. pp. 3–30. [Google Scholar]
- Kendall PC, Beidas RS. Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology: Research and Practice. 2007;38:13–20. doi: 10.1037/0735-7028.38.1.13. [Google Scholar]
- Kendall PC, Brady EU, Verduin TL. Comorbidity in childhood anxiety disorders and treatment outcome. Journal of the American Academy of Child & Adolescent Psychiatry. 2001;40:787–794. doi: 10.1097/00004583-200107000-00013. doi:10.1097/00004583-200107000-00013. [DOI] [PubMed] [Google Scholar]
- Kendall PC, Choudhury M, Hudson J, Webb A. The C. A. T. Project manual for cognitive behavioral treatment of anxious adolescents. Workbook Publishing; Ardmore, PA: 2002. [Google Scholar]
- Kendall PC, Compton S, Walkup J, Birmaher B, Albano AM, Sherrill J, Piacentini J. Clinical characteristics of anxiety disordered youth. Journal of Anxiety Disorders. 2010;24:360–365. doi: 10.1016/j.janxdis.2010.01.009. doi: 10.1016/j.janxdis.2010.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kendall PC, Gosch E, Albano AM, Ginsburg G, Compton S. CBT for child anxiety: Therapist treatment integrity checklist. Temple University; 2001. Unpublished manuscript. [Google Scholar]
- Kendall PC, Gosch EA, Furr JM, Sood E. Flexibility within fidelity. Journal of the American Academy of Child & Adolescent Psychiatry. 2008;47:987–993. doi: 10.1097/CHI.0b013e31817eed2f. doi:10.1097/CHI.0b013e31817eed2f. [DOI] [PubMed] [Google Scholar]
- Kendall PC, Hedtke K. Cognitive-behavioral therapy for anxious children: Therapist manual. 3rd Work-book Publishing; Ardmore, PA: 2006. [Google Scholar]
- Kendall PC, Hudson J, Gosch E, Flannery-Schroeder E, Suveg C. Cognitive-behavioral therapy for anxiety disordered youth: A randomized clinical trial evaluating child and family modalities. Journal of Consulting and Clinical Psychology. 2008;76:282–297. doi: 10.1037/0022-006X.76.2.282. doi:10.1037/0022-006X.76.2.282. [DOI] [PubMed] [Google Scholar]
- Kendall PC, Safford S, Flannery-Schroeder E, Webb A. Child anxiety treatment: Outcomes in adolescence and impact on substance use and depression. Journal of Consulting and Clinical Psychology. 2004;72:276–287. doi: 10.1037/0022-006X.72.2.276. doi:10.1037/0022-006X.72.2.276. [DOI] [PubMed] [Google Scholar]
- Kendall PC, Treadwell KRH. The role of self-statements as a mediator in treatment for youth with anxiety disorders. Journal of Consulting and Clinical Psychology. 2007;75:380–389. doi: 10.1037/0022-006X.75.3.380. doi:10.1037/0022-006X.75.3.380. [DOI] [PubMed] [Google Scholar]
- Maramba GG, Nagayama H, Gordon C. Meta-analyses of ethnic match as a predictor of dropout, utilization, and level of functioning. Cultural Diversity and Ethnic Minority Psychology. 2002;8:290–297. doi: 10.1037/1099-9809.8.3.290. doi:10.1037/1099-9809.8.3.290. [DOI] [PubMed] [Google Scholar]
- March JS, Parker J, Sullivan K, Stallings P, Conners C. The multidimensional anxiety scale for children (MASC): Factor structure, reliability, and validity. Journal of the American Academy of Child & Adolescent Psychiatry. 1997;36:554–565. doi: 10.1097/00004583-199704000-00019. doi:10.1097/00004583-199704000-00019. [DOI] [PubMed] [Google Scholar]
- March JS, Sullivan K, Parker J. Test-retest reliability of the Multidimensional Anxiety Scale for Children. Journal of Anxiety Disorders. 1999;13:349–358. doi: 10.1016/s0887-6185(99)00009-2. doi:10.1016/S0887-6185(99)00009-2. [DOI] [PubMed] [Google Scholar]
- Nauta MH, Scholing A, Emmelkamp PMG, Minderaa RA. Cognitive-behavioral therapy for children with anxiety disorders in a clinical setting: No additional effect of a cognitive parent training. Journal of the American Academy of Child & Adolescent Psychiatry. 2003;42:1270–1278. doi: 10.1097/01.chi.0000085752.71002.93. doi:10.1097/01.chi.0000085752.71002.93. [DOI] [PubMed] [Google Scholar]
- Ollendick TH, Hagopian LP, Huntziger RM. Cognitive-behavior with nighttime fearful children. Journal of Behavior Therapy and Experimental Psychiatry. 1991;22:113–121. doi: 10.1016/0005-7916(91)90006-q. doi:10.1016/0005-7916(91)90006-Q. [DOI] [PubMed] [Google Scholar]
- Pine DS, Cohen P, Gurley D, Brook J, Ma Y. The risk for early-adulthood anxiety and depressive disorders in adolescents with anxiety and depressive disorders. Archives of General Psychiatry. 1998;55:56–64. doi: 10.1001/archpsyc.55.1.56. doi:10.1001/archpsyc.55.1.56. [DOI] [PubMed] [Google Scholar]
- Podell JL, Kendall PC. Therapist information form (TIF) Temple University; Philadelphia, PA: 2008a. Unpublished rating form. [Google Scholar]
- Podell JL, Kendall PC. Supervisor rating form (SRF) Temple University; Philadelphia, PA: 2008b. Unpublished rating form. [Google Scholar]
- Research Units on Pediatric Psychopharmacology Anxiety Study The Pediatric Anxiety Rating Scale (PARS): Development and psychometric properties. Journal of the American Academy of Child and Adolescent Psychiatry. 2002;41:1061–1069. doi: 10.1097/00004583-200209000-00006. [DOI] [PubMed] [Google Scholar]
- Sexton TL, Ridley CR, Kleiner AJ. Beyond common factors: Multilevel-process models of therapeutic change in marriage and family therapy. Journal of Marital and Family Therapy. 2004;30:131–149. doi: 10.1111/j.1752-0606.2004.tb01229.x. doi:10.1111/j.1752-0606.2004.tb01229.x. [DOI] [PubMed] [Google Scholar]
- Shadish WR, Baldwin SA. Meta-analysis of MFT interventions. In: Sprenkle DH, editor. Effectiveness research in marriage and family therapy. American Association for Marriage and Family Therapy; Alexandria, VA: 2002. pp. 339–370. [Google Scholar]
- Shaffer D, Gould MS, Brasic J, Ambrosini P, Fischer P, Bird H, Aluwahlia S. A Children’s Global Assessment Scale (CGAS) Archives of General Psychiatry. 1983;40:1228–1231. doi: 10.1001/archpsyc.1983.01790100074010. doi:10.1001/archpsyc.1983.01790100074010. [DOI] [PubMed] [Google Scholar]
- Shaw BF, Elkin I, Yamaguchi J, Olmstead M, Vallis TM, Dobson KS, Imber SD. Therapist competence ratings in relation to clinical outcome in cognitive therapy of depression. Journal of Consulting and Clinical Psychology. 1999;67:837–846. doi: 10.1037//0022-006x.67.6.837. doi:10.1037/0022-006X.67.6.837. [DOI] [PubMed] [Google Scholar]
- Shirk SR, Karver M. Prediction of treatment outcome from relationship variables in child and adolescent therapy: A meta-analytic review. Journal of Consulting and Clinical Psychology. 2003;71:452–464. doi: 10.1037/0022-006x.71.3.452. doi:10.1037/0022-006X.71.3.452. [DOI] [PubMed] [Google Scholar]
- Silverman WK, Albano AM. Manual for the anxiety disorders interview schedule for DSM-IV: Child version. Graywind Publications; Albany, NY: 1996. [Google Scholar]
- Silverman WK, Pina A, Viswesvaran C. Evidence-based psychosocial treatments for children and adolescents: A ten year update. Journal of Clinical Child and Adolescent Psychology. 2008;37:105–130. doi: 10.1080/15374410701817907. doi:10.1080/15374410701817907. [DOI] [PubMed] [Google Scholar]
- Southam-Gerow MA, Kendall PC, Weersing VR. Examining outcome variability: Correlates of treatment response in a child and adolescent anxiety clinic. Journal of Clinical Child Psychology. 2001;30:422–436. doi: 10.1207/S15374424JCCP3003_13. doi:10.1207/S15374424JCCP3003_13. [DOI] [PubMed] [Google Scholar]
- Strunk DR, Brotman MA, DeRubeis RJ, Hollon SD. Therapist competence in cognitive therapy for depression: Predicting subsequent symptom change. Journal of Consulting and Clinical Psychology. 2010;78:429–437. doi: 10.1037/a0019631. doi:10.1037/a0019631. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Trepka C, Rees A, Shapiro D, Hardy G, Barkham M. Therapist competence and outcome of cognitive therapy for depression. Cognitive Therapy and Research. 2004;28:143–157. doi:10.1023/B:COTR.0000021536.39173.66. [Google Scholar]
- Van Ameringen M, Mancini C, Farvolden P. The impact of anxiety disorders on educational achievement. Journal of Anxiety Disorders. 2003;17:561–571. doi: 10.1016/s0887-6185(02)00228-1. doi:10.1016/S0887-6185(02)00228-1. [DOI] [PubMed] [Google Scholar]
- Villabø M, Gere MK, Torgersen S, March JS, Kendall PC. Diagnostic efficiency of the child and parent versions of the Multidimensional Anxiety Scale for Children (MASC) Journal of Clinical Child and Adolescent Psychology. 2012;41:75–85. doi: 10.1080/15374416.2012.632350. [DOI] [PubMed] [Google Scholar]
- Vocisano C, Klein DN, Arnow B. Therapist variables that predict symptom change in psychotherapy with chronically depressed outpatients. Psychotherapy: Theory, Research, Practice, Training. 2004;41:255–265. doi:10.1037/0033-3204.41.3.255. [Google Scholar]
- Walkup JT, Albano AM, Piacentini J, Birmaher B, Compton SN, Sherrill JT, Kendall PC. Cognitive behavioral therapy, sertraline, or a combination in childhood anxiety. The New England Journal of Medicine. 2008;359:2753–2766. doi: 10.1056/NEJMoa0804633. doi:10.1056/NEJMoa0804633. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Webb CA, DeRubeis RJ, Barber JP. Therapist adherence/competence and treatment outcome: A meta-analytic review. Journal of Consulting and Clinical Psychology. 2010;78:200–211. doi: 10.1037/a0018912. doi:10.1037/ a0018912. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Williams KE, Chambless DL. The relationship between therapist characteristics and outcome of in vivo exposure treatment for agoraphobia. Behavior Therapy. 1990;21:111–116. doi:10.1016/S0005-7894(05)80192-3. [Google Scholar]
- Zlotnick C, Elkin I, Shea TM. Does the gender of a patient or the gender of a therapist affect the treatment of patients with major depression? Journal of Consulting and Clinical Psychology. 1998;66:655–659. doi: 10.1037//0022-006x.66.4.655. doi:10.1037/0022-006X.66.4.655. [DOI] [PubMed] [Google Scholar]
