Skip to main content
Canadian Journal of Psychiatry. Revue Canadienne de Psychiatrie logoLink to Canadian Journal of Psychiatry. Revue Canadienne de Psychiatrie
. 2021 Jun 23;67(5):391–402. doi: 10.1177/07067437211027319

Face-to-face versus Video Teleconference Group Cognitive Behavioural Therapy for Anxiety and Related Disorders: A Preliminary Comparison

Thérapie cognitivo-comportementale de groupe en personne contre par vidéo téléconférence pour l’anxiété et les troubles connexes: une comparaison préliminaire

Irena Milosevic 1,2,, Duncan H Cameron 1, Melissa Milanovic 1,3, Randi E McCabe 1,2, Karen Rowa 1,2
PMCID: PMC9065489  PMID: 34159838

Abstract

Objective:

Telehealth is being increasingly incorporated into the delivery of mental health care and has received widespread attention during the COVID-19 pandemic for its ability to facilitate care during physical distancing restrictions. Videoconferencing is a common telehealth modality for delivering psychotherapy and has demonstrated similar outcomes to those of face-to-face therapy. Cognitive behavioural therapy (CBT) is the most common psychotherapy evaluated across various telehealth modalities; however, studies on CBT delivered via videoconference, particularly in a group therapy format, are lacking. Further, little research exists on videoconference group CBT for anxiety disorders. Accordingly, the present study compared the outcomes of group CBT for anxiety and related disorders delivered via videoconference versus face-to-face.

Method:

Using a non-randomized design, data on attendance, dropout, clinical outcomes, and functional impairment were collected from 413 adult outpatients of a tertiary care anxiety disorders clinic who attended a CBT group for panic disorder/agoraphobia, social anxiety disorder, generalized anxiety disorder (GAD), or obsessive-compulsive disorder delivered either face-to-face (pre-COVID-19 pandemic) or via videoconference (since the onset of COVID-19 pandemic). Outcomes were assessed using well-validated self-report measures. Data were collected pre-treatment, across 12 weekly sessions, and post-treatment. Intent-to-treat analyses were applied to symptom outcome measures.

Results:

Face-to-face CBT conferred only a slight benefit over videoconference CBT for symptom outcomes across all groups, but when assessed individually, only the GAD group showed greater symptom improvement in the face-to-face format. Effect sizes for significant differences between the delivery formats were small. Participants in videoconference groups tended to have slightly higher attendance rates in some instances, whereas functional improvement and treatment dropout were comparable across the delivery formats.

Conclusions:

Results provide preliminary evidence that videoconference group CBT for anxiety and related disorders may be a promising and effective alternative to face-to-face CBT. Additional research is needed to establish equivalence between these delivery formats.

Keywords: telemedicine, videoconferencing, cognitive behavioural therapy, group psychotherapy, anxiety disorders, social phobia, panic disorder, agoraphobia, generalized anxiety disorder, obsessive-compulsive disorder

Introduction

As technology has become widely accessible to health-care consumers, with 99.3% of Canadian households subscribing to either mobile or Internet services, 1 telehealth is being increasingly incorporated into the delivery of health care. 2,3 The principal advantage of telehealth is its ability to reduce access-to-care barriers such as limited health services in remote communities, 3,4 travel costs, 5,6 patients’ functional limitations, 7,8 and stigma associated with certain types of care. 9,10 Since the outbreak of the COVID-19 pandemic, telehealth has additionally received widespread attention for its ability to facilitate an alternative avenue to care while reducing the risk of disease transmission. 1113 Indeed, recent reports highlight the explosive expansion of telehealth services during COVID-19, 1417 which has transformed health-care delivery across numerous systems. 17

Telehealth has been particularly actively adopted in the mental health field, 1821 where it is termed telemental health. A common modality in telemental health is videoconferencing, which facilitates real-time communication between users at different locations using both audio and video input. Telemental health has demonstrated feasibility and acceptability when used for diagnostic assessment and treatment services across diverse clinical presentations, populations, and age groups. 18,19,22 Furthermore, outcomes of various videoconference interventions (e.g., psychotropic medication, psychotherapy, combination treatment) have generally demonstrated symptom improvement comparable to face-to-face interventions for common clinical presentations (e.g., depression, anxiety, posttraumatic stress disorder [PTSD]). 2331 Similarly, treatment adherence, 25 attendance, 30 dropout, 30 and satisfaction 2426,30 have been shown to be comparable between videoconference and face-to-face interventions.

Evaluations of videoconference psychotherapy in particular have largely focused on cognitive behavioural therapy (CBT), 32 an evidence-based treatment for a wide range of disorders. 33 Consistent with the broader literature on videoconference interventions, studies of videoconference CBT support its feasibility, 34 and preliminary findings suggest similar clinical outcomes to those of face-to-face CBT for concerns such as anxiety and depressive disorders, 26,28,29 PTSD, 31,35 and bulimia nervosa. 36 Similarities in clinical outcomes have further been reported in systematic reviews. 3739

Although promising effects have thus far been reported, when compared to the volume of research on other telemental health modalities, considerably less literature has focused on videoconference CBT. 37,40,41 Furthermore, most work in this area has investigated individual rather than group CBT. 32 While evaluations of videoconference group CBT are scant, a recent systematic review demonstrated that generally, group-based psychotherapies are feasible and efficacious in a videoconference format. 42 The few studies that have more specifically evaluated videoconference group CBT have primarily focused on PTSD, with results demonstrating outcomes similar to face-to-face CBT groups. 30,4345

Surprisingly, there is little research on videoconference CBT groups for anxiety disorders, the most prevalent psychiatric disorders 46 with a high burden of illness. 47 CBT is the psychological treatment of choice for anxiety disorders, 48,49 and, in a face-to-face context, CBT groups for anxiety disorders are as efficacious as individual CBT. 50 To our knowledge, no studies have evaluated anxiety outcomes in videoconference group CBT for anxiety disorders, highlighting the need for further research to establish the effectiveness of this treatment modality for these common disorders.

Group therapy offered via videoconference has the potential to be resource efficient (e.g., more patients can be seen concurrently without the need for more physical space) while conferring additional benefits of telehealth. These potential benefits must be considered alongside any unique resource requirements for videoconferencing, such as technological equipment and the number of clinicians required to facilitate a videoconference group. The development of accessible mental health interventions is highly relevant during the COVID-19 pandemic, which has seen a marked rise in reported mental distress in both general 5153 and psychiatric 54 populations alongside access-to-care barriers associated with physical distancing. It is also important within the broader mental health care milieu, where numerous barriers to accessing mental health care have been identified. 55

The purpose of the current study was to conduct a preliminary analysis of outcomes from group CBT for anxiety and related disorders delivered via videoconference versus face-to-face. These treatments were compared within a tertiary care specialist anxiety disorders clinic, which, like many health services during COVID-19, rapidly pivoted from in-clinic face-to-face care to remote care via videoconference. Using a non-randomized design, data on clinical outcomes, attendance, dropout, and functional impairment were collected from groups delivered via videoconference in spring/summer 2020 and compared to respective data from face-to-face groups collected prior to the pandemic. Our goal was to contribute our findings to the telehealth literature during a time when various stakeholders are seeking novel ways to reduce barriers to mental health care. Based on the reviewed literature, we hypothesized that we would observe similar outcomes between group CBT delivered via these two modalities with respect to symptom change, treatment attendance, dropout, and functioning.

Methods

Participants

Participants were outpatients of a tertiary care anxiety disorders clinic in a public hospital in Hamilton, Ontario, who consented to the inclusion of their demographic and clinical information in a research database. Inclusion criteria for research participation paralleled the eligibility criteria for treatment, including age 18 or older, a current Diagnostic and Statistical Manual of Mental Disorders, fifth edition (DSM-5) anxiety or related disorder diagnosis for which group treatment was available, and English language proficiency. Exclusion criteria included other more pressing clinical issues (e.g., another disorder causing more distress/impairment, active suicidality, significant substance use). We elected to include individuals (n = 6) who completed two different courses of CBT (i.e., completed a group for one disorder followed by a group, later, for a different disorder) within the study period, resulting in a sample of 419 observations from 413 unique individuals.

Participants’ mean age was 34.94 years (SD = 12.27). The majority identified as female (68.4%), white (87.4%), in a relationship (62.9%), and had completed college or university (56.8%). All participants had a primary diagnosis of a DSM-5 anxiety or related disorder (panic disorder and/or agoraphobia [PDA], social anxiety disorder [SAD], generalized anxiety disorder [GAD], or obsessive-compulsive disorder [OCD]), as determined by a semi-structured psychodiagnostic interview 56 (73.0%) or psychiatric consultation (27.0%). Forty-nine percent of participants had at least two diagnoses, most commonly another anxiety or mood disorder. For additional sample characteristics, see Table 1.

Table 1.

Baseline Sample Characteristics.

Variable Face-to-face Videoconference P a
Age, M (SD) 35.02 (12.25) 34.69 (12.37) .815
Sex, % female 67.5 71.1 .499
Relationship status, % in relationship 59.9 72.2 .030
Education, % completed college/university 53.9 66.0 .040
Ethnicity, % white 89.2 81.8 .550
Employment, % employed part- or full-time 52.9 43.4 .104
DASS-21, M (SD)
 Depression 18.95 (11.71) 17.13 (9.88) .132
 Anxiety 16.00 (9.68) 15.82 (10.41) .871
 Stress 21.70 (9.61) 22.09 (9.61) .721
WHODAS
 Total 83.36 (27.78) 80.46 (22.73) .309
Comorbidities
 Major depressive disorderb 20.1% 8.6% .005
 Social anxiety disorder 15.8% 12.1% .330
 Generalized anxiety disorder 13.2% 6.9% .070
 Persistent depressive disorder 8.6% 8.6% .990
 Panic disorder 6.3% 4.3% .440
 Obsessive-compulsive disorder 3.3% 3.4% .940
 Posttraumatic stress disorder 4.0% 0.0% .030
 Cannabis use disorder 3.3% 1.7% .387
 Alcohol use disorder 2.0% .9% .424

Note. DASS-21 = Depression, Anxiety and Stress Scales-21; WHODAS = World Health Organization Disability Assessment Schedule 2.0.

a P values are independent samples t test for continuous variables and 2 × 2 Pearson chi-square for categorical variables; group by time interaction for 2 × 2 analysis of variance for pre/post-treatment Illness Intrusiveness Rating Scale outcomes are presented in the Results section.

b Given the significance of this result, we also assessed this variable between diagnostic subgroups. The only group to show a significant difference was social anxiety disorder, in which the videoconference group had significantly lower rates of major depressive disorder (8.7%) compared to the face-to-face group (31.6%; p < .05).

Treatment

Both face-to-face and videoconference CBT were facilitated using 12-session disorder-specific manualized CBT group protocols for SAD, PDA, GAD, and OCD. The treatment manuals were developed at our clinic based on existing widely used CBT protocols. 5766 The same manuals were used for both treatment modalities, but additional supplementary materials were developed for the videoconference groups detailing in-session exposures suitable for videoconferencing. To prepare for the delivery of the videoconference groups, we consulted other teams with experience in videoconference treatment, reviewed the literature on virtual treatments, and held numerous meetings to plan risk management, engagement, and in-session exposures. For both delivery formats, 2-hour weekly group sessions were facilitated by two therapists, including at least one experienced clinician (e.g., psychologist, social worker) and another clinician or a clinical learner. The same therapists facilitated treatment through both modalities. The mean number of participants per group was 9.79 (SD = 2.31).

Face-to-face groups were facilitated in conference rooms at the clinic, with participants seated around a large table. A whiteboard was used to deliver some of the treatment content. Videoconference groups were facilitated through a secure cloud-based platform, Zoom Video Communications Inc., 67 which participants accessed through their electronic medical record. Participants used a range of electronic devices to attend sessions, most commonly a laptop (55.4%) and a smart phone (15.4%), although only 56% of participants reported on this variable. Participants attended the videoconference sessions from their home or other private environment. They received extensive operational instructions for the videoconference platform and guidelines to ensure appropriate decorum and participation using this platform. Group norms were established to approximate face-to-face treatment (e.g., video on with face showing; “gallery view” to simultaneously see the therapists and other participants). Videoconference sessions were provided in real time. A screen share function was used to display a virtual whiteboard on which some of the treatment material was presented; content from the treatment manuals was additionally screen-shared.

Measures

Psychodiagnosis

Current diagnoses were determined with either a psychiatric interview or the Diagnostic Assessment Research Tool (DART), 56 a semi-structured diagnostic interview for assessing DSM-5 mental disorders. Preliminary findings demonstrate excellent construct validity of DART modules as well as good convergent and discriminant validity. 68

Baseline distress and functioning

Distress at pre-treatment was assessed with the Depression, Anxiety and Stress Scales-21 (DASS-21), 69 a psychometrically sound 70 self-report measure comprised of three 7-item scales assessing symptoms of depression, anxious arousal, and stress (tension/negative affect). Global functioning was assessed pre-treatment with the World Health Organization Disability Assessment Schedule-2.0, 71 a 36-item measure of self-reported disability secondary to psychiatric and medical illness.

Attendance and dropout

Group therapists recorded weekly treatment attendance on an attendance record. Dropout was conceptualized as attending <8 sessions and not attending the final three sessions.

Symptom change

Symptom change was assessed with disorder-specific, self-report measures, including the following: in the SAD groups, the Social Phobia Inventory (SPIN), 72 a 17-item measure of social anxiety symptoms; in the PDA groups, the Panic Disorder Severity Scale–Self-Report (PDSS-SR), 73,74 a 7-item measure of the frequency of panic attacks and associated distress, avoidance, and functional impairment; in the GAD groups, the Penn State Worry Questionnaire (PSWQ), 75 a 16-item measure of trait-like worry severity, and the Penn State Worry Questionnaire–Past Week (PSWQ-PW), 76 a 15-item measure adapted for weekly assessment of worry; and in the OCD groups, the Obsessive Compulsive Inventory–Revised (OCI-R), 77 an 18-item measure of the severity of OCD symptoms. These widely used measures have demonstrated sound psychometric properties in clinical samples (SPIN, 72,78 PDSS-SR, 74,79 PSWQ, 80,81 and OCI-R 82 ). The SPIN, PDSS-SR, and OCI-R were administered pre- and post-treatment and weekly for 12 sessions. The PSWQ was administered pre- and post-treatment, and the PSWQ-PW was administered weekly.

Change in functioning

Functional changes from pre- to post-treatment were assessed with the Illness Intrusiveness Rating Scale (IIRS), 83 a 13-item self-report measure of functional impairment secondary to illness assessed across Instrumental, Intimacy, and Relationships and Personal Development subscales. The IIRS has demonstrated sound psychometric properties in psychiatric populations. 84

Procedures

All procedures were approved by the Hamilton Integrated Research Ethics Board. Psychometric assessment was completed upon entry to the program. Participants were referred to group CBT if their principal concern matched the disorder treated in one of the available groups. Those who attended group CBT between May 2018 and December 2019 received the treatment face-to-face, and those who attended between May 2020 and September 2020 received the treatment via videoconference.

Self-report measures were administered electronically via a browser-based data collection software (Research Electronic Data Capture). 85 Participants received emailed links with a specified period to complete the measures. Group therapists completed the attendance record on a weekly basis.

Statistical Analysis

Hierarchical linear modelling (HLM) 86 was used to assess the effect of group (face-to-face vs. videoconference) on the trajectory of change in symptom severity over time. Primary outcomes were assessed with time (coded weekly) at Level 1 and group at Level 2. Single-level HLMs were also performed on each of the face-to-face and videoconference groups, individually, to assess the difference in effect size between treatment formats. An intent-to-treat approach was taken for symptom outcome measures to maximize sample size and external validity of results. Data were collected weekly from pre-treatment, through 12 weeks of treatment, to post-treatment (14 data points). Finally, a series of independent samples t tests and Pearson chi-squares were performed to assess attendance variables and pre-/post-change in IIRS scores. Given the sample-intensive nature of HLM analyses, we prioritized maximizing the total number of observations rather than ensuring equal group size between face-to-face and videoconference samples.

Z-scores were calculated for comparisons across groups. Given differences in methodology between validation studies for each of the respective questionnaires, z-scores were used for the full-sample analysis, whereas raw scores were used for individual group analyses. Where possible, sample means for non-anxious controls were used. All sample means were gathered from each questionnaire’s respective validation study. These were 48.80 (SD = 13.80) for the PSWQ, 75 18.82 (SD = 11.10) for the OCI-R, 77 and 6.10 (SD = 6.00) for the PDSS-SR. 87 No control sample was available, to our knowledge, for the PSWQ-PW. We elected to use a mid-treatment reference score of 45.43 (SD = 16.48). 76 The SPIN score for non-anxious controls is 12.10 (SD = 9.30). 72 Given this score is low relative to sample means for SAD, this value results in overly inflated z-scores relative to the other samples in the present study. Furthermore, some researchers also support a higher cut-off value of 30 on the SPIN. 88,89 Therefore, the sample mean of 22.70 (SD = 10.00) for the “mildly impaired” subsample was used. 72

Results

There were no baseline differences, as assessed by independent samples t tests, between the face-to-face and videoconference groups on any outcome variable (see Table 1).

Attendance and Dropout

Significantly more sessions were attended by participants in the videoconference versus face-to-face GAD groups, t(146) = −2.02, p = .045, d = .17. The difference in attendance between the two delivery formats approached significance for the full sample, t(371) = −1.94, p = .053, d = .10. Figure 1 shows the mean session attendance for all groups. Treatment dropout did not differ significantly between groups, with observed dropout rates of 24.5% for face-to-face and 15.3% for videoconference, χ2 (1, N = 371) = 3.18, P = 0.08, φ = .09.

Figure 1.

Figure 1.

Session attendance between face-to-face and videoconference group delivery (total 12 sessions). GAD = generalized anxiety disorder; OCD = obsessive-compulsive disorder; PDA = panic disorder and/or agoraphobia; SAD = social anxiety disorder. *P < 0.05.

Symptom Change over Time

There was a significant effect of group in the full-sample analysis, b = .05, SE = .01, t = 4.74, P < 0.001, d = .23, and in the GAD subsample, b = .69, SE = .01, t = 2.70, P = 0.008, d = .20. These results indicate a small but significant positive effect of face-to-face treatment on reduction in symptom severity over time, relative to videoconference treatment (see Table 2 and Figure 2). This effect was not significant for SAD (P = 0.11), PDA (P = 0.17), and OCD (P = 0.69) groups.

Table 2.

Hierarchical Linear Modelling Assessing the Change in Primary Outcome Variables over Time from Pre- to Post-treatment.

Effect b SE t df P d
Full-sample z-score
 Initial z-score (intercept) 1.55 0.07 21.26 417 <0.001
  Group −0.40 0.13 −3.21 417 0.003 −0.16
 Z-score over time (slope) −0.11 0.01 −18.08 417 <0.001 −0.89
  Group 0.05 0.01 4.74 417 <0.001 0.23
GAD PSWQ-PW scorea
 Initial PSWQ-PW (intercept) 65.76 1.31 50.36 178 <0.001
  Group −2.59 2.26 −1.15 178 0.252 −0.09
 PSWQ-PW over time (slope) −1.64 0.15 −10.93 178 <0.001 −0.82
  Group 0.69 0.26 2.66 178 0.008 0.20
OCD OCI-R score
 Initial OCI-R (intercept) 26.66 1.82 14.60 73 <0.001
  Group −0.05 2.86 −0.02 73 0.987 0.00
 OCI-R over time (slope) −0.82 0.13 −6.13 73 <0.001 −0.71
  Group −0.09 0.23 −0.40 73 0.690 −0.05
PDA PDSS-SR score
 Initial PDSS-SR (intercept) 13.72 0.95 14.93 60 <0.001
  Group −0.97 1.71 −0.57 60 0.572 −0.07
 PDSS-SR over time (slope) −0.42 0.07 −6.14 60 <0.001 −0.78
  Group 0.16 0.11 1.40 60 0.168 0.18
SAD SPIN score
 Initial SPIN (intercept) 47.85 1.16 41.12 100 <0.001
  Group −5.50 2.25 −2.45 100 0.016 −0.24
 SPIN over time (slope) −1.49 0.12 −12.80 100 <0.001 −1.27
  Group 0.29 0.18 1.59 100 0.114 0.16

Note. Group is coded as 0 = face-to-face, 1 = videoconference. GAD = generalized anxiety disorder; OCD = obsessive-compulsive disorder; OCI-R = Obsessive Compulsive Inventory–Revised; PDSS-SR = Panic Disorder Severity Scale–Self-Report; PSWQ-PW = Penn State Worry Questionnaire–Past Week; PDA = panic disorder and/or agoraphobia; SAD = social anxiety disorder; SPIN = Social Phobia Inventory.

aPSWQ-PW was only collected in-session, not at pre- and post-treatment; only 12 time points were used in the analysis rather than 14. The PSWQ and PSWQ-PW were converted to z-scores for the full-sample analysis in order to use all 14 time points.

Figure 2.

Figure 2.

Results of 2-level hierarchical linear modelling models with group (0 = face-to-face, 1 = videoconference) predicting trajectory of change in symptom severity over the course of treatment. (A) GAD PSWQ-PW scores over time. (B) OCD OCI-R scores over time. (C) PDA PDSS-SR scores over time. (D) SAD SPIN scores over time. (E) All groups z-scores over time. GAD = generalized anxiety disorder; OCD = obsessive-compulsive disorder; OCI-R = Obsessive Compulsive Inventory–Revised; PDA = panic disorder and/or agoraphobia; PDSS-SR = Panic Disorder Severity Scale–Self-Report; PSWQ-PW = Penn State Worry Questionnaire–Past Week; SAD = social anxiety disorder; SPIN = Social Phobia Inventory.

Of note, there was an effect of group on the intercept for the full sample. To assess whether baseline z-score had any effect, we performed a model including group, baseline z-score, and the group × z-score interaction at Level 2. Both group, b = .03, SE = .01, t = 3.48, P < 0.001, d = .19, and baseline z-score, b= −.04, SE = .01, t = -6.97, P < 0.001, d = −.37, were independently significant predictors of change in symptom severity over time, but the interaction was not, b = .01, SE = .01, t = .53, P = 0.60, d = .03. These results indicate that participants who received face-to-face treatment achieved greater symptom severity reductions regardless of baseline severity.

Effect sizes (Cohen’s d) for treatment were mostly comparable between face-to-face and videoconference delivery, with videoconferencing tending to have slightly lower effects than face-to-face. This was true for the full sample (videoconference = −.90, face-to-face = −1.04), GAD (videoconference = −.61, face-to-face = −.97), PDA (videoconference = −.67, face-to-face = −.95), and SAD (videoconference = −1.43, face-to-face = −1.44) but not OCD (videoconference = −1.11, face-to-face = −.82).

Given heterogeneous comorbidities throughout the sample, and the higher incidence of depression in the face-to-face vs. videoconference groups, we performed supplementary analyses observing the effect of group at Level 2 while controlling for comorbidities and DASS-21 depression scores at baseline at Level 1. Although DASS-21 depression was an independently significant predictor of the primary symptom outcome measure in each group and in the full sample (with greater depression scores indicating worse symptom severity, Ps < 0.001), this was not the case for overall comorbidities (Ps = 0.057 to 0.83). Most importantly, neither depression nor comorbidities significantly impacted the effects of group at Level 2. This finding was supported by nearly identical significance and deviance statistics between the models with and without comorbidity variables.

Change in Functioning

All IIRS scores (see Table 3) showed significant main effects of time (Ps < 0.001), indicating improved functional impairment over the course of treatment. Neither the main effects of group nor the group by time interactions were significant (Ps > 0.05) for the IIRS total or subscale scores.

Table 3.

2 × 2 Group × Time ANOVA for IIRS Total and Subscale Scores.

IIRS Subscales Time Point Face-to-face (n = 129) M (SD) Videoconference (n = 50) M (SD) Time P Group P Interaction P
RPD Pre 3.84 (1.29) 3.83 (1.16) <0.001 0.800 0.532
Post 3.33 (1.38) 3.43 (1.14)
Intimacy Pre 4.05 (1.99) 4.29 (1.82) 0.008 0.535 0.655
Post 3.73 (1.97) 3.76 (1.92)
Instrumental Pre 4.59 (1.44) 4.48 (1.42) <0.001 0.867 0.458
Post 3.88 (1.55) 3.92 (1.36)
Total Pre 54.39 (15.54) 53.84 (14.17) <0.001 0.884 0.631
Post 46.82 (17.35) 47.72 (14.87)

Note. IIRS = Illness Intrusiveness Rating Scale; RPD = Relationships and Personal Development; ANOVA = analysis of variance.

Discussion

This study compared outcomes in face-to-face and videoconference group CBT for anxiety and related disorders. When evaluating symptom outcomes across all groups, there were only slight differences between the treatment formats, conferring a small benefit for face-to-face delivery, although this was not the case for all groups. When assessed individually, only the GAD group showed greater symptom improvement in the face-to-face format. Furthermore, effect sizes for significant differences between formats were small (d = .20 to .23). It is possible, however, that subsample analyses were not adequately powered to detect differences between groups via HLM. Participants in videoconference groups tended to have slightly higher attendance rates in some instances, whereas the two treatment modalities evidenced comparable improvement in illness intrusiveness. Given the relatively small sample size of the videoconference groups, these results are preliminary; however, they point towards potentially promising similarities in outcomes between virtual and in-person treatment delivery.

Despite the distress and uncertainty associated with COVID-19, 5154,90 our findings demonstrate that group CBT for anxiety can be successfully delivered via videoconference even during a pandemic. Indeed, participants who received videoconference group therapy did so during a time when we might anticipate poorer anxiety treatment outcomes, irrespective of the mode of delivery. Further, the small effect sizes we observed between delivery formats on symptom measures are similar to those reported elsewhere, 26,91 and the medium-to-large effect sizes we observed in symptom changes over time are generally consistent with those reported in meta-analyses of CBT. 9294

The finding of greater GAD symptom improvement in face-to-face versus videoconference delivery warrants attention. GAD is characterized by intolerance of uncertainty, causing excessive worry about new situations. 9597 With telehealth care being unfamiliar to many individuals, videoconferencing might have provoked greater treatment-related anxiety among the GAD sample, hampering their outcomes. Additionally, symptom improvement might have been more difficult to achieve in this population via videoconference treatment during a global catastrophic event compared to that observed in the face-to-face treatment predating the pandemic. This is tempered with the observation that at least at baseline, both groups did not significantly differ in reported depression, anxiety, or stress.

Importantly, the results of this investigation support positive outcomes in CBT delivered via videoconference despite this treatment being rapidly adapted to a virtual context to continue service delivery during a pandemic. Although the shift necessitated quick action, important steps were nonetheless taken by our team to optimize treatment engagement, including research and preparation to apply this model of care; adaptation, where relevant, of treatment components; and extensive support to patients to increase the usability of the technology.

As this investigation has pioneered some of the first data comparing face-to-face versus videoconference group-based CBT for anxiety disorders, it has brought forth important limitations and considerations for future research. First, while this investigation is timely and contributes to the literature supporting videoconference group psychotherapy during a globally challenging period, our results may have been affected by important confounds that were not possible to control in the current study design. First, the face-to-face and videoconference groups were facilitated during different time periods. It is necessary to compare service delivery formats in an ongoing fashion to determine comparability as environmental and societal stressors change. This would additionally clarify whether the benefits to attendance we observed in videoconference relative to face-to-face treatment are better explained by the delivery format, other factors such as greater engagement in treatment offered during global distress, or other pandemic conditions that might have uniquely impacted the sample attending videoconference groups.

Second, with only those equipped with an electronic device participating in videoconferencing, self-selection bias may have influenced our results. Higher retention may have occurred due to a motivated and technologically adept cohort opting to enter treatment in this format. Moreover, the face-to-face versus videoconference groups significantly differed in education status, with more participants in the latter having a post-graduate degree. Whether this difference underlies self-selection, such that a cohort with higher socioeconomic status entered videoconference treatment, remains to be further investigated.

It is also notable that we implemented a treatment model with participants attending videoconference sessions from their homes, but various other models are possible (e.g., videoconference sessions attended from a local clinic, videoconference sessions augmented with prerecorded psychoeducational videos). The extent to which our findings are consistent with, or diverge from, those implementing other variations of videoconferencing is an important avenue for future research.

Although previous work has demonstrated similar treatment satisfaction between telepsychotherapy and in-person psychotherapy, 2426,29 this investigation is additionally limited in having not measured patient satisfaction with treatment. Future qualitative research may be valuable to elucidate patients’ experiences with videoconference group psychotherapy, particularly in a pandemic context. We also did not measure group process mechanisms (e.g., group cohesion), which warrant closer examination. A nascent literature suggests small reductions in cohesion in videoconference versus face-to-face groups but no significant impact on outcome. 42 Finally, in addition to benefits conferred by videoconferencing, there are limitations to consider (e.g., online or environmental distractions during sessions, requirement of an electronic device, type of device used to attend sessions).

The results of this preliminary investigation suggest that videoconference group CBT for anxiety disorders may be a reasonable alternative to face-to-face treatment, which is particularly valuable in the context of the COVID-19 pandemic but also holds broader potential to widen the accessibility of mental health services. Future research is critical to strengthen the emerging literature on group CBT for anxiety disorders via videoconference, with efforts to determine whether equivalence in modalities can be claimed (i.e., through randomized controlled trials).

Acknowledgements

We wish to acknowledge the clinicians at the Anxiety Treatment and Research Clinic at St. Joseph’s Healthcare Hamilton who facilitated the CBT groups, as well Ashleigh Elcock for her assistance with data collection.

Authors’ Note: For access to the data, please contact the corresponding author.

Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding: The author(s) received no financial support for the research, authorship, and/or publication of this article.

ORCID iDs: Irena Milosevic, PhD https://orcid.org/0000-0002-0953-7408

Duncan H. Cameron, PhD https://orcid.org/0000-0003-3249-7253

References

  • 1. The Canadian Radio-television and Telecommunications Commission. Communications monitoring report 2018; 2019. [accessed 2020 Oct 9]. https://crtc.gc.ca/pubs/cmr2018-en.pdf
  • 2. Canada’s Health Informatics Association. 2015 Canadian telehealth report; 2015. [accessed 2020 Oct 9]. https://livecare.ca/sites/default/files/2015%20TeleHealth-Public-eBook-Final-10-9-15-secured.pdf
  • 3. O’Gorman LD, Hogenbirk JC, Warry W. Clinical telemedicine utilization in Ontario over the Ontario telemedicine network. Telemed J E Health. 2016;22(6):473–479. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Jong M, Mendez I, Jong R. Enhancing access to care in northern rural communities via telehealth. Int J Circumpolar Health. 2019;78(2):1554174. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Saqui O, Chang A, McGonigle S, et al. Telehealth videoconferencing: improving home parenteral nutrition patient care to rural areas of Ontario, Canada. JPEN J Parenter Enteral Nutr. 2007;31(3):234–239. [DOI] [PubMed] [Google Scholar]
  • 6. Serhal E, Lazor T, Kurdyak P, et al. A cost analysis comparing telepsychiatry to in-person psychiatric outreach and patient travel reimbursement in Northern Ontario communities. J Telemed Telecare. 2020;26(10):607–618. [DOI] [PubMed] [Google Scholar]
  • 7. Gellis ZD, Kenaley B, McGinty J, Bardelli E, Davitt J, Have TH. Outcomes of a telehealth intervention for homebound older adults with heart or chronic respiratory failure: a randomized controlled trial. Gerontologist. 2012;52(4):541–552. [DOI] [PubMed] [Google Scholar]
  • 8. Choi NG, Marti CN, Wilson NL, et al. Effect of telehealth treatment by lay counselors vs by clinicians on depressive symptoms among older adults who are homebound: a randomized clinical trial. JAMA Netw Open. 2020;3(8):e2015648. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Obisike EE. The effectiveness of telemedicine on stigmatization and treatment burden in patients with health compromising lifestyles and chronic diseases: a critically appraised topic. Open Sci J. 2018;3(1). [Google Scholar]
  • 10. Shore P, Goranson A, Ward MF, Lu MW. Meeting veterans where they’re at: a VA home-based elemental health pilot program. Int J Psychiatry Med. 2014;48(1):5–17. [DOI] [PubMed] [Google Scholar]
  • 11. Monaghesh E, Hajizadeh A. The role of telehealth during COVID-19 outbreak: a systematic review based on current evidence. BMC Public Health. 2020;20:1193. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Poletti B, Tagini S, Brugnera A, et al. Telepsychotherapy: a leaflet for psychotherapists in the age of COVID-19. A review of the evidence. Couns Psychol Q. 2020;1–16. 10.1080/09515070.2020.1769557 [DOI] [Google Scholar]
  • 13. Wind TR, Rijkeboer M, Andersson G, Riper H. The COVID-19 pandemic: the ‘black swan’ for mental health care and a turning point for e-health. Internet Interv. 2020;20:100317. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Gratzer D, Torous J, Lam RW, et al. Our digital moment: innovations and opportunities in digital mental health care. Can J Psychiatry. 2021;66(1):5–8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Bokolo A. Jr. Use of telemedicine and virtual care for remote treatment in response to COVID-19 pandemic. J Med Syst. 2020;44:132. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Mann DM, Chen J, Chunara R, Testa PA, Nov O. COVID-19 transforms health care through telemedicine: evidence from the field. J Am Med Inform Assoc. 2020;27(7):1132–1135. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Wosik J, Fudim M, Cameron B, et al. Telehealth transformation: COVID-19 and the rise of virtual care. J Am Med Inform Assoc. 2020;27(6):957–962. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Bashshur RL, Shannon GW, Bashshur N, Yellowlees PM. The empirical evidence for telemedicine interventions in mental disorders. Telemed J E Health. 2016;22(2):87–113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Chakrabarti S. Usefulness of telepsychiatry: a critical evaluation of videoconferencing-based approaches. World J Psychiatry. 2015;5(3):286–304. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Francisco K, Archer N. The impact of telehealth on mental healthcare in Canada. Am J Med Res. 2016;3(2):59–83. [Google Scholar]
  • 21. Richardson LK, Frueh BC, Grubaugh AL, Egede L, Elhai JD. Current directions in videoconferencing tele-mental health research. Clin Psychol (New York). 2009;16(3):323–338. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Drago A, Winding TN, Antypa N. Videoconferencing in psychiatry, a meta-analysis of assessment and treatment. Euro Psychiatry. 2016;36:29–37. [DOI] [PubMed] [Google Scholar]
  • 23. Choi NG, Hegel MT, Marti N, Marinucci ML, Sirrianni L, Bruce ML. Telehealth problem-solving therapy for depressed low-income homebound older adults. Am J Geriatr Psychiatry. 2014;22:263–271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Luxton DD, Pruitt LD, Wagner A, Smolenski DJ, Jenkins-Guarnieri MA, Gahm G. Home-based telebehavioral health for U.S. military personnel and veterans with depression: a randomized controlled trial. J Consult Clin Psychol. 2016;84(11):923–934. [DOI] [PubMed] [Google Scholar]
  • 25. Ruskin PE, Silver-Aylaian M, Kling MA, et al. Treatment outcomes in depression: comparison of remote treatment through telepsychiatry to in-person treatment. Am J Psychiatry. 2004;161(8):1471–1476. [DOI] [PubMed] [Google Scholar]
  • 26. Stubbings DR, Rees CS, Roberts LD, Kane RT. Comparing in-person to videoconference-based cognitive behavioral therapy for mood and anxiety disorders: randomized controlled trial. J Med Internet Res. 2013;15(11):e258. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Tuerk PW, Keller SM, Acierno R. Treatment for anxiety and depression via clinical videoconferencing: evidence base and barriers to expanded access in practice. Focus (Am Psychiatr Publ). 2018;16(4):363–369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Bouchard S, Paquin B, Payeur R, et al. Delivering cognitive-behavior therapy for panic disorder with agoraphobia in videoconference. Telemed J E Health. 2004;10(1):13–25. [DOI] [PubMed] [Google Scholar]
  • 29. Bouchard S, Allard M, Robillard G, et al. Videoconferencing psychotherapy for panic disorder and agoraphobia: outcome and treatment processes from a non-randomized non-inferiority trial. Front Psychol. 2020;11:2164. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Frueh BC, Monnier J, Yim E, Grubaugh AL, Hamner MB, Knapp RG. A randomized trial of telepsychiatry for post-traumatic stress disorder. J Telemed Telecare. 2007;13(3):142–147. [DOI] [PubMed] [Google Scholar]
  • 31. Germain V, Marchand A, Bouchard S, Drouin M-C, Guay S. Effectiveness of cognitive behavioural therapy administered by videoconference for posttraumatic stress disorder. Cogn Behav Ther. 2009;38(1):42–53. [DOI] [PubMed] [Google Scholar]
  • 32. Backhaus A, Agha Z, Maglione ML, et al. Videoconferencing psychotherapy: a systematic review. Psychol Serv. 2012;9(2):111–131. [DOI] [PubMed] [Google Scholar]
  • 33. Hofmann SG, Asnaani A, Vonk IJ, Sawyer AT, Fang A. The efficacy of cognitive behavioral therapy: a review of meta-analyses. Cognit Ther Res. 2012;36(5):427–440. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Matsumoto K, Sutoh C, Asano K, et al. Internet-based cognitive behavioral therapy with real-time therapist support via videoconference for patients with obsessive-compulsive disorder, panic disorder, and social anxiety disorder: pilot single-arm trial. J Med Internet Res. 2018;20(12):e12091. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Liu L, Thorp SR, Moreno L, et al. Videoconferencing psychotherapy for veterans with PTSD: results from a randomized controlled non-inferiority trial. J Telemed Telecare. 2020;26(9):507–519. [DOI] [PubMed] [Google Scholar]
  • 36. Mitchell JE, Crosby RD, Wonderlich SA, et al. A randomized trial comparing the efficacy of cognitive-behavioral therapy for bulimia nervosa delivered via telemedicine versus face-to-face. Behav Res Ther. 2008;46(5):581–592. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Berryhill MB, Halli-Tierneyb A, Culmer N, et al. Videoconferencing psychological therapy and anxiety: a systematic review. Fam Pract. 2019;36(1):53–63. [DOI] [PubMed] [Google Scholar]
  • 38. Norwood C, Moghaddam NG, Malins S, Sabin-Farrell R. Working alliance and outcome effectiveness in videoconferencing psychotherapy: a systematic review and noninferiority meta-analysis. Clin Psychol Psychother. 2018;25(6):797–808. [DOI] [PubMed] [Google Scholar]
  • 39. Rees CS, Maclaine E. A systematic review of videoconference-delivered psychological treatment for anxiety disorders. Australian Psychologist. 2015;50(4):259–264. [Google Scholar]
  • 40. Lamb T, Pachana NA, Dissanayaka N. Update of recent literature on remotely delivered psychotherapy interventions for anxiety and depression. Telemed J E Health. 2019;25(8):671–677. [DOI] [PubMed] [Google Scholar]
  • 41. Luo C, Sanger N, Singhal N, et al. A comparison of electronically-delivered and face to face cognitive behavioural therapies in depressive disorders: a systematic review and meta-analysis. EClinicalMedicine. 2020;24:100442. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Gentry MT, Lapid MI, Clark MM, Rummans TA. Evidence for telehealth group-based treatment: a systematic review. J Telemed Telecare. 2019;25(6):327–342. [DOI] [PubMed] [Google Scholar]
  • 43. Morland LA, Greene CJ, Rosen CS, et al. Telemedicine for anger management therapy in a rural population of combat veterans with posttraumatic stress disorder: a randomized noninferiority trial. J Clin Psychiatry. 2010;71(7):855–863. [DOI] [PubMed] [Google Scholar]
  • 44. Morland LA, Hynes AK, Mackintosh MA, Resick PA, Chard KM. Group cognitive processing therapy delivered to veterans via telehealth: a pilot cohort. J Trauma Stress. 2011;24(4):465–469. [DOI] [PubMed] [Google Scholar]
  • 45. Morland LA, Mackintosh MA, Greene CJ, et al. Cognitive processing therapy for posttraumatic stress disorder delivered to rural veterans via telemental health: a randomized noninferiority clinical trial. J Clin Psychiatry. 2014;75(5):470–476. [DOI] [PubMed] [Google Scholar]
  • 46. Kessler RC, Berglund PA, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication (NCS-R). Arch Gen Psychiatry. 2005;62(6):593–602. [DOI] [PubMed] [Google Scholar]
  • 47. Whiteford HA, Degenhardt L, Rehm J, et al. Global burden of disease attributable to mental and substance use disorders: findings from the global burden of disease study 2010. Lancet. 2013;382(9904):1575–1586. [DOI] [PubMed] [Google Scholar]
  • 48. Olatunji BO, Cisler JM, Deacon BJ. Efficacy of cognitive behavioral therapy for anxiety disorders: a review of meta-analytic findings. Psychiatr Clin North Am. 2010;33(3):557–577. [DOI] [PubMed] [Google Scholar]
  • 49. Otte C. Cognitive behavioral therapy in anxiety disorders: current state of the evidence. Dialogues Clin Neurosci. 2011;13(4):413–421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Barkowski S, Schwartze D, Strauss B, Burlingame BM, Rosendahl J. Efficacy of group psychotherapy for anxiety disorders: a systematic review and meta-analysis. Psychother Res. 2020;30(8):965–982, [DOI] [PubMed] [Google Scholar]
  • 51. Mental Health Research Canada. Mental health during COVID-19 outbreak, wave 1; 2020. [accessed 2020 Dec 24]. https://static1.squarespace.com/static/5f31a311d93d0f2e28aaf04a/t/5f86800c5757437eb2b17f08/1602650133129.
  • 52. Mental Health Research Canada. Mental health during COVID-19 outbreak, poll 2; 2020. [accessed 2020 Oct 9]. https://static1.squarespace.com/static/5f31a311d93d0f2e28aaf04a/t/5f866fab9ec4b03a7a306890/1602645935216.
  • 53. Pierce M, Hope H, Ford T, et al. Mental health before and during the COVID-19 pandemic: a longitudinal probability sample survey of the UK population. Lancet Psychiatry. 2020;7(10):883–892. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54. Hao F, Tan W, Jiang L. Do psychiatric patients experience more psychiatric symptoms during COVID-19 pandemic and lockdown? A case-control study with service and research implications for immunopsychiatry. Brain Behav Immun. 2020;87:100–106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55. Moroz N, Moroz I, Slovinec D’Angelo M. Mental health services in Canada: barriers and cost-effective solutions to increase access. Healthc Manage Forum. 2020;33(6):282–287. [DOI] [PubMed] [Google Scholar]
  • 56. McCabe RE, Milosevic I, Rowa K, et al. Diagnostic Assessment Research Tool (DART). Hamilton (ON: ): St. Joseph’s Healthcare/McMaster University; 2017. [Google Scholar]
  • 57. Heimberg RG, Becker RE. Cognitive behavioral group therapy for social phobia: basic mechanisms and clinical strategies. New York (NY): Guilford Press; 2002. [Google Scholar]
  • 58. Craske MG, Barlow DH. Mastery of your anxiety and panic. Boulder (CO): Graywind; 2000. [Google Scholar]
  • 59. Clark DM. Cognitive therapy for panic disorder. In: Wolfe BE, Maser JD, editors. Treatment of panic disorder: a consensus development conference. Washington (DC: ): American Psychiatric Association; 1994. p. 121–132. [Google Scholar]
  • 60. Antony MM, McCabe RE. 10 Simple solutions to panic: how to overcome panic attacks, calm physical symptoms, and reclaim your life. Oakland (CA: ): New Harbinger Publications; 2004. [Google Scholar]
  • 61. Waters AM, Craske MG. Generalized anxiety disorder. In: Antony MM, Ledley DR, Heimberg RG, editors. Improving outcomes and preventing relapse in cognitive-behavorial therapy. New York (NY: ): Guilford Press; 2005. p. 77–127. [Google Scholar]
  • 62. Dugas MJ, Buhr K, Ladouceur R. The role of intolerance and uncertainty in etiology and maintenance. In: Heimberg RG, Turk CL, Mennin DS, editors. Generalized anxiety disorders: advances in research and practice. New York (NY: ): Guilford Press; 2004. p. 164–186. [Google Scholar]
  • 63. Heimberg RG, Turk CL, Mennin DS, editors. Generalized anxiety disorder: advances in research and practice. New York (NY): Guilford Press; 2004. [Google Scholar]
  • 64. Gyoerkoe K, Wiegartz P. 10 Simple solutions to worry. Oakland (CA): New Harbinger Publications; 2006. [Google Scholar]
  • 65. Borkovec TD, Costello E. Efficacy of applied relaxation and cognitive-behavioral therapy in the treatment of generalized anxiety disorder. J Consult Clin Psychol. 1993;61(4):611–619. [DOI] [PubMed] [Google Scholar]
  • 66. Foa EB, Yadin E, Lichner TB. Exposure and response (ritual) prevention for obsessive compulsive disorder: therapist guide. New York (NY): Oxford University Press; 2012. [Google Scholar]
  • 67. Zoom Video Communications Inc. Security guide. San Jose (CA): Zoom Video Communications Inc.; 2016. [accessed 2020 Oct 7]. https://d24cgw3uvb9a9h.cloudfront.net/static/81625/doc/Zoom-Security-White-Paper.pdf. [Google Scholar]
  • 68. Schneider LH, Pawluk EJ, Milosevic I, et al. The Diagnostic Assessment Research Tool (DART) in action: a preliminary evaluation of a semistructured diagnostic interview for DSM-5 disorders. Manuscript submitted for publication. 2021. [DOI] [PubMed]
  • 69. Lovibond SH, Lovibond PF. Manual for the Depression Anxiety Stress Scales. 2nd ed. Sydney (Australia; ): Psychology Foundation; 1995. [Google Scholar]
  • 70. Antony MM, Bieling PJ, Cox BJ, Enns MW, Swinson RP. Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychol Assess. 1998:10(2);176–181. [Google Scholar]
  • 71. Ustun TB, Kostanjesek N, Chatterji S, et al. Measuring health and disability: manual for WHO Disability Assessment Schedule (WHODAS 2.0). Geneva (Switzerland: ): World Health Organization; 2010. [Google Scholar]
  • 72. Connor KM, Davidson JR, Churchill LE, Sherwood A, Foa E, Weisler RH. Psychometric properties of the Social Phobia Inventory (SPIN): new self-rating scale. Br J Psychiatry. 2000;176(4):379–386. [DOI] [PubMed] [Google Scholar]
  • 73. Shear MK, Brown TA, Barlow DH, et al. Multicenter collaborative Panic Disorder Severity Scale. Am J Psychiatry. 1997;154(11):1571–1575. [DOI] [PubMed] [Google Scholar]
  • 74. Houck PD, Spiegel DA, Shear KM, Rucci P. Reliability of the self-report version of the Panic Disorder Severity Scale. Depress Anxiety. 2002;15(4):183–185. [DOI] [PubMed] [Google Scholar]
  • 75. Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the Penn State Worry Questionnaire. Behav Res Ther. 1990;28(6):487–495. [DOI] [PubMed] [Google Scholar]
  • 76. Stöber J, Bittencourt J. Weekly assessment of worry: an adaptation of the Penn State Worry Questionnaire for monitoring changes during treatment. Behav Res Ther. (1998);36(6):645–656. [DOI] [PubMed] [Google Scholar]
  • 77. Foa EB, Huppert JD, Leiberg S, et al. The Obsessive-Compulsive Inventory: development and validation of a short version. Psychol Assess. 2002;14(4):485–496. [PubMed] [Google Scholar]
  • 78. Antony MM, Coons MJ, McCabe RE, Ashbaugh A, Swinson RP. Psychometric properties of the Social Phobia Inventory: further evaluation. Behav Res Ther. 2006;44(8):1177–1185. [DOI] [PubMed] [Google Scholar]
  • 79. Lee E, Kim J, Yu B. Reliability and validity of the self-report version of the Panic Disorder Severity Scale in Korea. Depress Anxiety. 2009;26(8): E120–E123. [DOI] [PubMed] [Google Scholar]
  • 80. Brown TA, Antony MM, Barlow DH. Psychometric properties of the Penn State Worry Questionnaire in a clinical anxiety disorders sample. Behav Res Ther. 1992;30(1):33–37. [DOI] [PubMed] [Google Scholar]
  • 81. Wuthrich VM, Johnco C, Knight A. Comparison of the Penn State Worry Questionnaire (PSWQ) and abbreviated version (PSWQ-A) in a clinical and non-clinical population of older adults. J Anxiety Disord. 2014;28(7):657–663. [DOI] [PubMed] [Google Scholar]
  • 82. Abramowitz JS, Deacon BJ. Psychometric properties and construct validity of the Obsessive-Compulsive Inventory-Revised: replication and extension with a clinical sample. J Anxiety Disord. 2006;20(8):1016–1035. [DOI] [PubMed] [Google Scholar]
  • 83. Devins GM. Illness intrusiveness and the psychosocial impact of lifestyle disruptions in chronic life-threatening disease. Adv Ren Replace Ther. 1994;1(3):251–263. [DOI] [PubMed] [Google Scholar]
  • 84. Bieling PJ, Rowa K, Antony MM, Summerfeldt LJ, Swinson RP. Factor structure of the Illness Intrusiveness Rating Scale in patients diagnosed with anxiety disorders. J Psychopathol Behav Assess. 2001;23(4):223–230. [Google Scholar]
  • 85. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86. Raudenbush SW, Bryk AS. Hierarchical linear models: applications and data analysis methods. 2nd ed. Thousand Oaks (CA; ): Sage Publications; 2002. [Google Scholar]
  • 87. Shear MK, Rucci P, Williams J, et al. Reliability and validity of the Panic Disorder Severity Scale: replication and extension. J Psychiatr Res. 2001;35(5):293–296. [DOI] [PubMed] [Google Scholar]
  • 88. Moscovitch DA, Gavric DL, Merrifield C, Bielak T, Moscovitch M. Retrieval properties of negative vs. positive mental images and autobiographical memories in social anxiety: outcomes with a new measure. Behav Res Ther. 2011;49(8):505–517. [DOI] [PubMed] [Google Scholar]
  • 89. Moser JS, Hajcak G, Huppert JD, Foa EB, Simons RF. Interpretation bias in social anxiety as detected by event-related brain potentials. Emotion. 2008;8(5):693–700. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90. Rettie H, Daniels J. (2020). Coping and tolerance of uncertainty: predictors and mediators of mental health during the COVID-19 pandemic. Am Psychol. 2021;76(3):427–437. [DOI] [PubMed] [Google Scholar]
  • 91. Strachan M, Gros DF, Ruggiero KJ, Lejuez CW, Acierno R. An integrated approach to delivering exposure-based treatment for symptoms of PTSD and depression in OIF/OEF veterans: preliminary findings. Behav Ther. 2012;43(3):560–569. [DOI] [PubMed] [Google Scholar]
  • 92. Hofmann SG, Smits JAJ. Cognitive-behavioral therapy for adult anxiety disorders: a meta-analysis of randomized placebo-controlled trials. J Clin Psychiatry. 2008;69(4):621–632. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93. Norton PJ, Price EC. A meta-analytic review of adult cognitive-behavioral treatment outcome across the anxiety disorders. J Nerv Ment Dis. 2007;195(6):521–531. [DOI] [PubMed] [Google Scholar]
  • 94. Stewart RE, Chambless DL. Cognitive-behavioral therapy for adult anxiety disorders in clinical practice: a meta-analysis of effectiveness studies. J Consult Clin Psychol. 2009;77(4):595–606. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95. Dugas MJ, Freeston MH, Ladouceur R. Intolerance of uncertainty and problem orientation in worry. Cognit Ther Res. 1997;21:593–606. [Google Scholar]
  • 96. Ladouceur R, Talbot F, Dugas MJ. Behavioral expressions of intolerance of uncertainty in worry: experimental findings. Behav Modif. 1997;21(3):355–371. [DOI] [PubMed] [Google Scholar]
  • 97. Buhr K, Dugas MJ. The Intolerance of Uncertainty Scale: psychometric properties of the English version. Behav Res Ther. 2002;40(8):931–945. [DOI] [PubMed] [Google Scholar]

Articles from Canadian Journal of Psychiatry. Revue Canadienne de Psychiatrie are provided here courtesy of SAGE Publications

RESOURCES