Abstract
Introduction:
Emerging technological interventions for psychological disorders are being developed continually. Offering imaginal exposure exercises as a self-help intervention presents the opportunity to acquire foundational skills to address social anxiety. The current study evaluates the feasibility and effectiveness of a novel smartphone application for social interaction anxiety.
Methods:
Participants () were adults meeting criteria for social anxiety disorder. They were randomly assigned to imaginal exposure (IE; ) or self-monitoring () delivered multiple times daily via a smartphone application for a one-week trial. It was expected that participants using the IE exercises would demonstrate significantly greater declines in social anxiety in addition to increases in self-efficacy and that compliance would serve as a predictor of outcome. Mixed-effects models were utilized.
Results:
Participants using IE (vs. self-monitoring) evidenced significantly greater reductions in social anxiety from pre- to post-treatment and at 1-month follow-up. Similarly, IE (vs. self-monitoring) led to significantly greater increases in self-efficacy from pre- to post-treatment and 1-month follow-up. Further, more completed IE exercises predicted significantly greater changes in social anxiety and self-efficacy at subsequent timepoints compared with self-monitoring.
Conclusions:
Findings suggest that a brief IE self-help intervention was effective in targeting social interaction anxiety.
Keywords: anxiety, self-efficacy, exposure, smartphone
Social anxiety disorder (SAD) is highly prevalent among university undergraduates (Auerbach et al., 2016; Eisenberg et al., 2013). In individuals with SAD, social and performance situations may be avoided or experienced with severe distress (Harris et al., 2002). SAD has a 12-month prevalence of 7% in the United States and has displayed associations with elevated rates of school dropout, as well as decreased well-being, employment, productivity, and quality of life (American Psychiatric Association, 2013). Only about 20 to 40% of undergraduate students with SAD reported receiving mental health support (Eisenberg et al., 2011), leading to an estimated 4 million university undergraduates with untreated mental illnesses (Kazdin, 2017). Thus, finding ways to disseminate helpful treatments to this group is important.
Exposure has proven to be an efficacious and primary method of intervention for individuals with social anxiety disorder (SAD; Kaczkurkin & Foa, 2022; Mayo-Wilson et al., 2014; Ponniah & Hollon, 2009). Typically, such exposure has been completed in-vivo. Efforts to supplement in vivo exposure treatment with social skills training have displayed further clinical and skills-based benefits (Beidel et al., 2014). However, difficulties exist with in vivo exposure, including rarity of exposure opportunities, lack of access to anxiety provoking stimuli or situations, lack of practitioners trained in and willing to provide exposure, and lack of patient compliance with the exercises (Pittig et al., 2019). Virtual reality exposure (VRE) has been employed to offset some of these issues (Chesham et al., 2018; Kampmann et al., 2016; Zainal et al., 2021), However, VRE is not particularly accessible to most people. Also, standardized videos used in VRE and other types of video exposure do not allow for individualizing exposure hierarchies.
One solution to providing accessible individualized exposure is via imaginal exposure (IE). Drawing on the conceptual imagery model proposed by Lang (1977), creating successful IE has challenges. Specifically, important imagery skills in IE include the skill of the therapist leading the client through the exposure exercise, as well as skills of the individual engaged in the exposure to create imagery and produce an emotional response. Producing an emotional response from IE could also require presence. Presence is the ability to feel completely immersed and involved in what is being imagined as though the imagined events were actually happening. Although presence has been primarily studied in VRE (Schubert et al., 2001), it may be particularly relevant for IE wherein there are no tangible stimuli. To be efficacious, IE rests upon the efforts of the individual to do everything in imagery. Also, whereas presence has historically been considered to be a static phenomenon, a recent study found that it can increase across exposure sessions (Zainal et al., 2021). Thus, it may be possible to get better at it with practice. When all imagery skills are facilitated, the imagined situations in IE create a physiological response similar to in vivo exposure (Costanzo et al., 2014), while increasing engagement (Dinh et al., 1999). These physiological responses (e.g., electrodermal activity and heart rate variability) have been shown to be important activation indicators for individuals with SAD during exposure (Christian et al., 2022) and may be indicators of adequate activation during IE.
A means to increase the dissemination and ecological validity of IE would be to deliver it via a smartphone application. Many studies have been conducted delivering smartphone intervention packages to college students (Fitzsimmons-Craft et al., 2021; Newman et al., 2021a; Newman et al., 2021b). However, literature is lacking with respect to smartphone delivered IE as a stand-alone intervention in those with social anxiety disorder. Unfortunately, a package of multiple techniques does not tell us which treatment components led to observed improvements. In addition, it could be the case that one simple technique is sufficient to treat SAD. Further, focusing on only one technique provides more time to practice it, an important aspect of exposure treatment (Hope et al., 1993). If the smartphone delivery is done in a way to allow individuals to personalize their fear hierarchies it could also take full advantage of the benefits of IE as a self-help option.
Treatment focusing on one technique may also allows for greater efficiency if it is delivered across a short time period. Brief psychological interventions have been defined as treatments provided over a period of 14 days or less (Schumer et al., 2018). Though not administering IE, 10-day (LaFreniere & Newman, 2016) and 14-day (Zainal & Newman, 2023) ecological momentary interventions (EMI) that entailed one technique led to change compared to a self-monitoring control condition for generalized anxiety disorder. Also, fewer IE treatment sessions for post-traumatic stress disorder (PTSD) were not significantly less effective than full length IE (van Minnen & Foa, 2006). In addition, a one-session trial of IE for social anxiety led to changes in core beliefs (Romano et al., 2020). Pairing brevity and repetition could have beneficial impacts for social anxiety exposure and could also leverage the convenience of advanced technology. Also, using briefer smartphone interventions has been proposed as a way to increase usage and engagement (Fleming et al., 2018; Simblett et al., 2018).
Therefore, significant gaps in understanding treatment through IE remain within the SAD literature. Whereas VRE and in vivo exposure are commonly used, IE is an underutilized technique. Dissemination of IE could also be maximized by delivery via a self-help smartphone application. Additionally, IE has not typically been studied in isolation from other treatment techniques. Further, no studies exist involving a brief self-help smartphone app to deliver IE for SAD. Addressing each of these gaps may increase accessibility to exercises typically reserved for delivery during the course of traditional CBT.
The current study examined the efficacy and effectiveness of a 7-day self-help IE Intervention (vs. active control) on individuals with social anxiety. For this study, a neutral task involving self-monitoring was the active control condition, which did not lead individuals to address aspects of their social anxiety (i.e., avoidance) or their overall self-efficacy. It was expected that compared to the active control condition, anxious individuals randomly assigned to undergo the 7-day IE exercises would experience significantly greater reductions in social anxiety. Related to this hypothesis, IE (vs. self-monitoring) was expected to produce greater increases in self-efficacy. Also, individuals using IE who had higher exercise usage were expected to show greater changes in social anxiety and self-efficacy. Finally, we anticipated that presence and mental imagery would become stronger across IE exercises, viewing mental imagery as an adaptable skill.
Method
Participants
Participants were 82 persons meeting criteria for social anxiety disorder (SAD) who were randomized to either 7-day IE exercises () or a self-monitoring active control (). Participants were recruited from an undergraduate psychology subject pool mass testing, as well as from advertisements. To be eligible, participants had to be 18 years of age or older, be fluent in English, own an iPhone, and meet DSM-5 criteria (American Psychiatric Association, 2013) for social anxiety disorder (SAD). Diagnostic comorbidity with other psychological difficulties included depressive symptoms (17%), major depressive disorder (5%), and other anxiety disorders (23%) in the sample. Potential participants were excluded if they endorsed mania, psychosis, suicidality, alcohol or substance use disorders, or any medical or organic disorder that hindered their participation in the study. Additionally, this study excluded individuals currently in psychological or psychiatric treatment (including prescribed psychotropic medications) for anxiety or any other mental health issues to isolate and evaluate IE as a stand-alone technique. Of the 82 participants analyzed, 5 dropped out of the study prematurely (2 in IE and 3 in control), though they were retained in the analyses in line with the intent-to-treat principle (see Figure 1 for Consolidated Standards of Reporting Trials (CONSORT) Flowchart). Average age of participants was 19.40 years (SD = .64). There were 62 White participants, 4 African American participants, 2 Hispanic, 8 Asian, and 6 Middle Eastern participants. There were 38 males and 44 females. Please see Table 1 for participant demographics distributed by condition.
Figure 1.
CONSORT Flowchart Depicting Participant Recruitment, Selection, and Randomization, Post-assessment and Follow-up Completion, and Data Analysis
Note: CONSORT = Consolidated Standards of Reporting Trials; IE = imaginal exposure.
Table 1.
Demographic Characteristics by Condition
SM | IE | |||
---|---|---|---|---|
| ||||
% | % | |||
| ||||
Race | ||||
White | 32 | 74 | 30 | 77 |
African American | 2 | 5 | 2 | 5 |
Hispanic | 1 | 2 | 1 | 3 |
Asian | 5 | 12 | 3 | 8 |
Middle Eastern | 3 | 7 | 3 | 8 |
Gender | ||||
Male | 19 | 44 | 19 | 49 |
Female | 24 | 56 | 20 | 51 |
M | SD | M | SD | |
Age | 19.46 | 0.62 | 19.32 | 0.67 |
Note: . SM = self-monitoring control. IE = imaginal exposure therapy.
Measures
The Social Interaction Anxiety Scale (SIAS; Mattick & Clarke, 1998) is a 20-item measure of anxiety in interpersonal interactions. Following psychometric evidence suggesting the removal of the three negatively keyed items (Rodebaugh et al., 2011), only the 17 positively keyed items were used for study analyses. Items were rated on a 5-point Likert scale ranging from 0 (not at all characteristic or true of me) to 4 (extremely characteristic or true of me). The SIAS possesses very strong retest reliability of (Mattick & Clarke, 1998), strong internal consistency in the current study (), and good convergent and discriminant validity in diverse samples (Heimberg et al., 1992).
The Social Phobia Diagnostic Questionnaire (SPDQ; Newman et al., 2003) is a 29-item measure of of social anxiety related to fear and avoidance. The measure has adequate retest reliability (), good convergent validity and discriminant validity, and strong internal consistency in the current study (). Additionally, it has great sensitivity (82%) and specificity (85%; Newman et al., 2003).
Diagnostic Interview for DSM-5 Anxiety, Mood, and Obsessive-Compulsive and Related Disorders (DIAMOND; Tolin et al., 2018). The DIAMOND is a semi-structured interview based on the DSM-5. Interrater reliability ranged from to for all diagnoses and the retest reliability was generally high (). Convergent validity was verified for most of the diagnoses by higher scores on corresponding self-report measures (Tolin et al., 2018). Undergraduate research assistants highly trained by a clinical psychology doctoral student conducted the DIAMOND interviews and were supervised by a doctoral-level licensed clinical psychologist. Interviewers were uninformed of treatment allocation. Each interview was recorded and rated by a second blind rater. In the current study, interrater agreement was excellent (Cohen’s CI [.72,.93]) for the SAD diagnosis.
Avoidance.
After each exercise, participants self-reported the number of avoided situations occurring since the prior completed exercise. Participants were specifically asked “How many social situations/interactions did you engage in since your last response?” and “How many social situations/interactions did you avoid since your last response?”
The General Self-Efficacy Scale (Schwarzer & Jerusalem, 1995) is a 10-item measure of ability to persist and adapt in daily life. Participants rated items on a 4-point Likert scale from 1 (Not at all true) to 4 (Exactly true). The measure has displayed adequate retest reliability () and possesses high internal consistency ranging from .76 to .90 across 23 different samples (Schwarzer et al., 1999). The internal consistency was also high within the current study ().
The Igroup Presence Questionnaire (IPQ; Schubert et al., 2001) is a 14-item scale where participants endorse the extent to which the exercises they engaged with felt realistic following the exercise completion. Each response was provided on a 7-point Likert scale. High internal consistency was displayed in the current study (average of ) and construct validity has been demonstrated (Vasconcelos-Raposo et al., 2016).
The Questionnaire Upon Mental Imagery (Sheehan, 1967) is a 35-item measure using a 7-point Likert scale which asks participants to rate how vividly they can see imagery from 1 (perfectly clear and vivid) to 7 (no image present at all). This measure displays good internal consistency (Evans & Kamemoto, 1973) which was displayed in the current study (average of ) and adequate convergent validity (Sheehan, 1967).
The Post-exercise Imagery Questions (Borkovec & Sides, 1979) were 2 additional imagery vividness items added, also following the completion of each IE exercise. These two questions asked participants to “Please rate how vivid the imagery was during the exercise” and to “Please rate how much fear the imagery created during the exercise.”
Compliance.
Exposure compliance was calculated by dividing the total number of completed exercises by the requested number of prompts completed, per condition. Those in IE were asked to complete exercises at least thrice daily for a total of 21 prompts for compliance calculation. Those in self-monitoring were asked to complete exercises 8 times daily for a total 56 prompts for compliance calculation. This difference in daily exercise completion requests was due to the approximate length of each exercise (self-monitoring = 5 minutes; IE = 13 minutes), as well as a quiet, private place necessary for IE exercise completion.
Procedure
The study was approved by an Institutional Review Board at the participating university. All participants consented to the study. SAD diagnosis was screened using the SPDQ (Newman et al., 2003). Participants invited from screening provided verbal consent during an initial session, followed by the DIAMOND (Tolin et al., 2018) to confirm the diagnosis. If diagnosis was confirmed by the DIAMOND, eligible participants completed baseline symptom self-report measures which were counter-balanced to rule out order effects. See Figure 2 for an overview of participant flow throughout the study.
Figure 2.
Effect of Therapy Condition on Outcome
Note. Outcome (social anxiety or self-efficacy) composite scores are plotted on the y-axis. SM = Self-monitoring; IE = imaginal exposure. FU = follow-up.
Those invited to participate provided their written consent. A randomizer was used to determine treatment allocation for each participant (either IE or active control based), which is an established method in clinical trials (Padhye et al., 2009). Experimenters were blinded to treatment allocation. All participants underwent their assigned exercise condition for 7 days. The app prompted them 8 times daily to complete their assigned exercise. Participants in the IE condition completed questions immediately following each exercise to capture presence and imagery data. To assess intervention effects and maintenance of study gains, participants completed questionnaires at pre-treatment, post-treatment, and 1-month follow-up. The ImExpsoure application was removed from participants phones following their participation in the study at the post-treatment session to observe lasting effects of the intervention at subsequent follow-up. All study sessions were conducted remotely, as the trial was conducted during the active phase of the COVID-19 pandemic with inclusive dates of participation occuring between April 2020 and March 2022.
IE Therapy Condition.
The IE therapy condition provided participants with a therapeutic rationale that repeated practice of IE exercises would help them learn to tolerate anxious distress and overcome avoidance behaviors toward feared situations and increase self-confidence. IE exercises were completed using the ImExposure smartphone application on a participant’s personal smartphone. The application was available in the Apple App Store but was locked with a researcher code. Core features of the application involved engaging psychoeducation videos, a personalized fear hierarchy, imaginal exposure exercise audio, and post-exercise questions. Psychoeducation covered topics of anxiety, avoidance, exposure, imaginal exposure, fear hierarchies, and translating imaginal exposure into in vivo exposure. The personalized fear hierarchy provided participants the opportunity to order the social interaction situations they wanted to address and provide SUDS (Wolpe & Lazarus, 1967) ratings for each. The exercise audio provided a 13-minute imaginal exposure audio exercise which guided participants through a selected exposure from their hierarchy. Exercises were directed toward exposure to a variety of social speaking situations (e.g., talking with peers, talking with a teacher or boss, participating in class, a job interview, giving a public speech, interactions at a party or bar, attending a formal event, asking someone out on a date, etc.). Similar to VRE, the feared stimulus or situation was not physically present during the exercises. However, in IE without VR individuals created the mental imagery themselves in accordance with a series of guiding phrases, rather than viewing the imagery through a technological device. The imaginal exposure prompts were general enough to allow for applicability to any of their listed social speaking situations. Following the completion of each exercise, participants completed reflective pre, peak, and post SUDS ratings related to the imagined situation, Post-exercise Imagery Questions, the Igroup Presence Questionnaire, and follow-up questions about the number of situations avoided and any in vivo exposure they had engaged in since their last completed exercise. After each completed IE exercise, they were also asked to identify a situation from their fear hierarchy for which they would consider completing via an in vivo exposure before the next prompt. Participants in the IE condition were requested to complete imaginal exposure exercises at least three times daily and as many in vivo exposure exercises as they were willing to complete without specified requirements. If prompts were missed, participants were still able to complete an exercise whenever they opened the application at an available time. An excerpt from the IE exercise instructions (see Appendix A) and screenshot of the participant view of the smartphone application during an exercise (see Figure 3) are provided in the Supplemental Materials.
Self-Monitoring Control.
The self-monitoring condition provided participants with a therapeutic rationale that learning and implementing self-monitoring skills would help them manage and lower their anxiety by being able to better recognize anxious symptoms and negative emotions and adjust their avoidance behaviors toward fear and increase their self-confidence in response. This condition asked participants to observe and log their avoidance behaviors related to social situations via a survey link that was emailed to them at the time of each prompt. Participants were to log the date at the time of entry, the number of social speaking opportunities encountered since the last prompt, the number of avoidance behaviors since the last prompt, their average and peak levels of anxiety through subjective units of distress (SUDS) ratings, and the actual speaking situations themseleves. Each self-monitoring exercise prompt took approximately 5 minutes to complete. An excerpt from the self-montoring exercise instructions (see Appendix B) and screenshot of participants’ view of the self-monitoring exercise (see Figure 4) are provided in the Supplemental Materials.
Sample Size Estimation
We aimed to recruit at least 30 participants per treatment condition. A Monte Carlo simulation study with 500 simulations in the package SIMR (Green & MacLeod, 2016) suggested that the achieved sample of 82 participants provided 81.4% power to detect a small- to medium-sized (Cohen’s ) difference in symptom change from pretreatment to posttreatment across the treatment and control groups.
Data Analyses
Preliminary analyses were conducted to examine if there were any differences across the treatment groups in terms of demographic characteristics. Specifically, we used a Fisher’s exact test to compare treatment groups on race, a logistic regression to compare treatment groups on gender, and analysis of variance (ANOVA) to compare groups on age.
Each of the outcome measures collected at pre-treatment, post-treatment, and 1-month follow-up were standardized. The SIAS and SPDQ were standardized and combined to create a social anxiety outcome composite score which has been shown to increase reliability and validity of assessment (Nunnally & Bernstein, 1994) and lower experiment-wise Type I error rate relative to separate analyses for single measures (Horowitz et al., 1979). The change across exposure exercises in presence and imagery vividness in the IE condition, was examined using multilevel modeling in . Time (pre-treatment, post-treatment, or 1-month follow-up) was dummy-coded with pre-treatment as the reference group, to indicate each participant’s symptom change from pre-treatment at each time point. Models included fixed effects for each time contrast and each condition contrast, along with presence. Models also included all two-way interactions between time and condition, time and compliance, and treatment and compliance. Models also included all three-way interactions between time, condition, and compliance. Finally, models included fixed and random intercepts. Of particular interest were (1) the two-way interactions between condition and time, as well as (2) the three-way interactions between condition, time, and compliance. These parameters indicated (1) the association between condition and outcome and (2) whether compliance played a moderating role in the impact of condition. Significant interactions were probed with simple slope analysis. To facilitate interpretation, Cohen’s for each parameter was calculated as , where (Rosenthal & DiMatteo, 2001). Cohen’s of 0.2, 0.5, and 0.8 denoted small, moderate, and large effects, respectively. All analyses were intent to treat. Missing outcome data (3.6%) were handled with full information maximum likelihood (FIML).
Results
Preliminary Analyses
Fisher’s exact test revealed no significant difference in gender across conditions, , p = .462, and ANOVA indicated no significant difference in age across conditions, , p = .657. Descriptive statistics for pretreatment and posttreatment symptoms are presented in Table 2. At pretreatment, there were no significant differences between the treatment and control groups on any symptom measure (all were ). Descriptive statistics summarizing the anxiety composite score and self-efficacy data are presented in Table 3.
Table 2.
Summary of Pretreatment, Posttreatment, and Follow-up Measures by Condition
SM | IE | |||||
---|---|---|---|---|---|---|
|
||||||
Pretreatment | Posttreatment | Follow-up | Pretreatment | Posttreatment | Follow-up | |
| ||||||
Measure | M (SD) | M (SD) | M (SD) | M (SD) | M (SD) | M (SD) |
| ||||||
SIAS | 50.61 (13.59) | 47.50 (13.27) | 47.33 (13.30) | 51.77 (12.22) | 31.04 (10.03) | 30.82 (9.83) |
SPDQ | 19.03 (3.21) | 18.41 (3.66) | 18.74 (3.68) | 19.03 (3.21) | 11.55 (3.40) | 11.49 (3.47) |
GSES | 27.30 (3.71) | 27.63 (3.86) | 27.93 (4.11) | 27.22 (3.64) | 31.33 (3.97) | 31.36 (3.85) |
Note: . IE = imaginal exposure. SM = self-monitoring (control). M = mean. SD = standard deviation.
Table 3.
Summary of Means and Standard Deviations Among Anxiety Composite and Self-Efficacy Scores
Pretreatment | Posttreatment | Follow-up | ||
---|---|---|---|---|
| ||||
Anxiety | IE | 0.98 (0.26) | 0.32 (0.31) | 0.34 (0.29) |
SM | 0.95 (0.34) | 0.97 (0.30) | 0.95 (0.37) | |
Self-Efficacy | IE | 0.54 (0.19) | 0.79 (0.23) | 0.76 (0.19) |
SM | 0.58 (0.24) | 0.59 (0.20) | 0.58 (0.17) |
Note: . IE = imaginal exposure. SM = self-monitoring (control).
Descriptive Analyses
Calculated compliance rates were 59% for IE (requested thrice daily completion) and 62% for self-monitoring (requested 8 times daily completion), which were not significantly different from each other, , , , . There was no significant difference between self-monitoring (; ) and IE (; ), , , , in reported number of social situations engaged in between prompts. However, the reported number of social situations avoided between prompts differed significantly by condition such that self-monitoring (; ) had more avoided situations on average than imaginal exposure (; ), , , , .
Additional descriptive analyses were conducted on data specific to the IE smartphone application. Automated engagement metrics were also tracked through the average total time (in minutes) spent in the smartphone application (; ) and the average number of logins (; ) across the duration of the study. Related to SUDS, the average first peak (; ) and average highest peak across any exposure exercise (; ) were collected. Finally, examining pooled fear hierarchy data revealed that on average 76.39% of hierarchy items were completed over the course of the study.
Social Anxiety
Please see Table 4 for model results. There was a significant two-way interaction between treatment condition and time from pre-treatment to post-treatment, , , , , and pre-treatment to 1-month follow-up, , , , , showing significantly greater change in social anxiety from IE compared to self-monitoring (see Figure 2). Additionally, there was a significant three-way interaction involving condition, compliance, and time from pre-treatment to post-treatment, , , , , , and pre-treatment to follow-up, , , , , , indicating that more compliance during the treatment predicted greater change in social anxiety.
Table 4.
Effect of Therapy Condition and Compliance on Outcome
Social Anxiety Composite | Self-efficacy | |||||||
---|---|---|---|---|---|---|---|---|
|
|
|||||||
| ||||||||
Intercept | 0.96* | 0.11 | 8.73 | 0.21 | 0.55* | 0.09 | 6.11 | 0.19 |
Pre-Post | −0.74* | 0.22 | −3.36 | 0.24 | 0.63* | 0.08 | 7.88 | 0.22 |
Pre-FU | −0.71* | 0.20 | −3.55 | 0.23 | 0.56* | 0.09 | 6.22 | 0.21 |
Condition | −0.84** | 0.24 | −3.50 | 0.31 | 0.60* | 0.32 | 1.88 | 0.22 |
Compliance | 0.07 | 0.28 | 0.25 | 0.06 | 0.17 | 0.34 | 0.50 | 0.04 |
Condition*Pre-Post | −0.83* | 0.18 | −4.61 | 0.38 | 0.65* | 0.19 | 3.42 | 0.33 |
Conditi on*Pre-FU | −0.80* | 0.22 | −3.63 | 0.37 | 0.64* | 0.14 | 4.57 | 0.32 |
Compliance*Condition | −0.58** | 0.30 | −1.93 | 0.27 | 0.69* | 0.26 | 2.65 | 0.22 |
Compliance*Pre-Post | 0.19 | 0.26 | 0.73 | 0.05 | 0.12 | 0.12 | 1.00 | 0.04 |
Compliance*Pre-FU | 0.26 | 0.22 | 1.18 | 0.05 | 0.14 | 0.18 | 0.78 | 0.04 |
Compliance*Condition*Pre-Post | −0.98** | 0.32 | −3.06 | 0.52 | 0.78* | 0.25 | 3.12 | 0.35 |
Compliance*Condition*Pre-FU | −0.93** | 0.35 | −2.66 | 0.52 | 0.76* | 0.26 | 2.92 | 0.35 |
Note. . Condition = Self-monitoring vs IE. FU = follow-up.
p < .05
p < .01
p < .001.
Simple slope analysis indicated that in the IE condition, higher compliance was associated with significantly greater social anxiety symptom reduction from pre-treatment to post-treatment, , , , , , and from pre-treatment to 1-month follow-up, ., , , , . Unlike in the IE condition, in the self-monitoring condition, higher compliance was not associated with symptom change in social anxiety from pre-treatment to post-treatment, , , , , , or from pre-treatment to 1-month follow-up, , , , , .
Self-Efficacy
There was a significant two-way interaction involving condition and time from pre-treatment to post-treatment, , , , , , and pre-treatment to 1-month follow-up, , , , , , indicating that IE led to greater increased self-efficacy than the self-monitoring control condition (see Figure 2). Furthermore, there was also a significant three-way interaction involving condition, compliance, and time from pre-treatment to post-treatment , , , , , and pre-treatment to follow-up , , , , , indicating a moderating effect of compliance on self-efficacy during the treatment.
Similarly, simple slope analysis indicated that in the IE condition, higher compliance was associated with significantly greater improvements in self-efficacy from pre-treatment to post-treatment, , , , , , and from pre-treatment to 1-month follow-up, , , , , . Unlike in the IE condition, in the self-monitoring condition, higher compliance was not associated with changes in self-efficacy from pre-treatment to post-treatment, , , , , , or from pre-treatment to 1-month follow-up, , , , , . Thus, in alignment with our expectations, compliance was associated with greater pre-treatment to post-treatment and follow-up social anxiety symptom change and self-efficacy in the IE condition but predicted not in the self-monitoring control.
Additionally, for variables only assessed in the IE condition, there was a significant increase in presence across time, , , , , . Relatedly, imagery vividness also displayed a significant increase over time, , , , , . Thus, both presence and imagery vividness improved with practice.
Discussion
This study examined the efficacy and effectiveness of 7-day IE exercises (vs. active control) on individuals with social anxiety related to social interactions. For this study, a neutral task involving self-monitoring of participants’ social avoidance behavior served as the active control condition. Descriptive results showed IE (59%) and self-monitoring (62%) had compliance rates that were not significantly different. However, those using the IE smartphone application displayed greater reductions in social anxiety than did self-monitoring. Similar benefits were found when examining self-efficacy. IE users showed significant increases at subsequent timepoints. Further, more completed IE exercises produced significantly greater reductions in social anxiety and greater increases in self-efficacy at subsequent timepoints compared with self-monitoring.
Well-designed technological tools can be an exciting avenue for advancing psychological interventions for anxiety, but they require sufficient engagement to realize their potential influence. Engagement among the IE intervention was strong, as the 59% compliance rate far exceeded the reported average (36%) in a meta-analytic review of smartphone intervention studies for anxiety (Linardon & Fuller-Tyszkiewicz, 2020). Paired with encouraging total time spent in the smartphone application and frequency of logins, this study suggests compelling evidence for the feasibility and acceptability of offering a smartphone application-based IE intervention for individuals with SAD. Significant utility of the smartphone application also allowed for adequate investigation of the impact of the intervention.
Many technological treatment tools have been developed without examining their efficacy (Alyami et al., 2017). This is the first study to our knowledge to use personal devices to deliver application-based stand-alone self-help IE for the treatment of SAD. Recent investigations exhibited important efficacy findings using smartphone applications for social anxiety, although they involved a mental health coach (Stolz et al., 2018) or were not specific to IE (Boettcher et al., 2018). Therefore, the current study contributes novel findings related to brief (one-week) IE-specific self-help exercises delivered for SAD using an accessible, technological medium.
Self-help cognitive and behavioral technological interventions have been shown to be cost-effective methods of delivering empirically validated treatments for a variety of psychological problems (Lewis et al., 2012; Newman et al., 2011). These tools can be valuable resources for those not currently in treatment. Such self-reliant tools may be especially important in exposure. From an emotional processing theory perspective (Foa & Kozak, 1986), it has been proposed that fear extinction does not entirely eliminate prior pathological associations among stimuli and responses but instead creates new associations to be retrieved more frequently than the pathological ones (Bouton, 2000). To achieve engagement with such tools, brevity may be a vital piece of intervention design (Fleming et al., 2018; Simblett et al., 2018; Torous et al., 2018). It may be that shortening interventions allows exposure interventions to streamline the creation, strength, and retrieval of non-threatening associations within one’s memory through repetition, and core tenets of inhibitory learning theory (Tolin, 2019). Shortening of interventions has been successful in prior treatment utilizing IE, as a 30-minute IE session was not significantly different from a 60-minute IE (van Minnen & Foa, 2006). Of note, the exercises delivered in this study were significantly shorter (i.e., 13 minutes) to be more adaptive for repeated completion throughout the day and were delivered without administration by a therapist. Additionally, prompting individuals to practice in vivo exposure following self-help IE could provide further compliance and improved outcome.
Smartphone self-help treatment tools may be valuable at various points in individuals’ treatment seeking status. Such tools may serve as an engaging, self-paced transition into psychological treatment. However, multicomponent platforms and applications may be overwhelming and ineffective for individuals at initial stages. For individuals who are currently receiving treatment from a mental health professional, IE may support and advance skills learned in therapy and could also serve as homework outside of therapy sessions. Such homework practice is likely to help anxious individuals to feel more confident, competent, and flexible at encountering feared stimuli across different contexts (Newman et al., 1997a). For those who have successfully completed therapy, smartphone application-based IE exercises could replace booster sessions which are shown to be beneficial (Gearing et al., 2013). Unfortunately, a substantial number of individuals experience a return of fear following exposure (Craske et al., 2014). Following successful exposure, relapses can occur where after an elapsed amount of time or change in context, the anxiety associated with the stimuli or situation returns following fear extinction (Shin & Newman, 2018; Vervliet et al., 2013). Therefore, focusing on the generalizability of social anxiety exposure by employing IE in various contexts could be beneficial in preventing anxious relapse through the repetitive reinforcement of non-pathological response structures (Foa & McNally, 1996; Huppert et al., 2003). Tools like the one in this study may assist with maintaining gains, while encouraging autonomy and self-efficacy.
Relatedly, the relationship between social anxiety and self-efficacy could be better understood. The observed changes in self-efficacy were certainly encouraging. In the context of imagined skill building, such changes were expected based on prior literature noting the relationship between change in self-efficacy predicting change in anxiety (Bandura & Adams, 1977; Bandura et al., 1980). In future studies, such findings could be replicated by collecting self-efficacy measures through EMA.
The current study was the first one to test a technology-delivered IE exercise. Findings illuminate the rich opportunity that exists from a variety of technological mediums. Notably, presence was observed to increase over time, supporting a novel finding made in a recent study involving VRE (Zainal et al., 2021). Relatedly, imagery vividness also displayed significant increases over time. Additional investigation into the differences in presence during IE and VRE could be valuable, given that one involves imaginal, mental imagery and the latter involves virtual or video images. However, our finding preliminarily suggests that repeated exposure practice can increase the sense of involvement, realness, and spatial presence in IE. It has been noted that resulting symptom and behavior changes are dependent largely on the visceral sensory experience of the individual (Lang, 1977). Participants were encouraged to conduct in vivo exposure homework in addition to the use of their IE exercises. Since traditional exposure treatment encourages in vivo homework practice but most VRE studies do not, investigating the contribution of in vivo exposure in the success of the IE condition would be informative. These important findings may suggest a necessary revisiting of the constructs of presence and mental imagery ability as less static than previously understood. Further, there are implications for anxiety research and treatment. However, with repeated practice of imagery-related tasks, there is initial evidence to suggest individuals may have the ability to develop and improve their imagery skills.
There are several limitations to the current study. First, participants were limited to a diagnosis of SAD. Future studies utilizing exposure and IE techniques in advanced and personalized ways should investigate if our findings are replicated and extended to other disorders. In particular, it may be beneficial to target disorders that often utilize exposure-based practices, such as specific phobias or PTSD. Similarly, the current study examined comparisons between a smartphone-based exposure technique and an active, self-monitoring control. Thus, future studies should examine whether our findings are replicated and extended to comparisons of smartphone-based exposure interventions against more traditional delivery of exposure in the context of face to face therapy. From a technological standpoint, a direct comparison to VRE would also be useful. Another limitation was the short-term nature of the 1-month follow-up. Subsequent studies could test the limits of the current intervention’s lasting effects. Furthermore, our understanding of the findings could have been improved with addition of measures of app acceptability, as well as credibility and expectancy of the treatment. Though the findings are encouraging, diversity in the current study was limited within our sample and future studies should examine whether such techniques improve outcome in more diverse groups. Relatedly, the use of undergraduate students to comprise the sample may not be representativeness of general population. Therefore, a larger sample size could lead to more expansive demographic characteristics to better understand the generalizability of the findings. Finally, since the study was conducted during the COVID-19 pandemic, there were restrictions to opportunities to extend IE practice to consistent in vivo practice in social situations.
The IE smartphone application in the current study was isolated from face-to face therapy or other co-occurring treatment. Future studies could offer this self-help treatment tool or other advanced interventions to see if they augment therapies by increasing interest, compliance to assignments, promote skill building, and further improve outcome. It could be that blended therapy (i.e., a limited number of psychotherapy sessions with a therapist in addition to self-guided material) may be the optimal format and modality to integrate advancing technological treatment tools (e.g., Newman et al., 1997b; Newman et al., 2014). Because the study trial length was relatively brief, especially in comparison to typical CBT involving exposure, there may be a benefit in extending the access and use of the exercises.
When comparing IE exercises delivered via a novel smartphone application, we found that those individuals had greater reductions in social anxiety and avoidance, as well as increases in self-efficacy. Findings suggest that the self-help IE exercises delivered via a smartphone application are effective in targeting important aspects of social anxiety. There are clinical implications that may require revisiting the expected length of SAD exposure interventions. The current study was a brief yet, fairly intensive delivery of the treatment. Brief repeated interventions in routine clinical care may be able to produce similar benefits as would be found with standard length treatments. Importantly, developing an understanding of individual differences that contribute to or hinder improvements during exposure and IE could alter the course of exposure therapy.
Supplementary Material
Highlights.
Implemented a novel smartphone application treatment for social anxiety disorder
Participants using the application experienced greater reductions in social anxiety
Those using the application also experienced greater increases in self-efficacy
Higher treatment compliance was associated with greater changes in outcome
Acknowledgments
The study was supported in part by National Institute of Mental Health Research Grant MH-39172.
Conflicts of Interest
We have no conflicts of interest to disclose regarding the research or the manuscript provided. All authors have been credited for their contributions to the study and the manuscript.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Contributor Information
Jeremy T. Schwob, The Pennsylvania State University
Michelle G. Newman, The Pennsylvania State University
References
- Alyami M, Giri B, Alyami H, & Sundram F. (2017). Social anxiety apps: A systematic review and assessment of app descriptors across mobile store platforms. Evidence-Based Mental Health, 20(3), 65–70. 10.1136/eb-2017-102664 [DOI] [PMC free article] [PubMed] [Google Scholar]
- American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association. 10.1176/appi.books.9780890425596 [DOI] [Google Scholar]
- Auerbach RP, Alonso J, Axinn WG, Cuijpers P, Ebert DD, Green JG, . . . Bruffaerts R. (2016). Mental disorders among college students in the World Health Organization World Mental Health Surveys. Psychological Medicine, 46(14), 2955–2970. 10.1017/S0033291716001665 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bandura A, & Adams NE (1977). Analysis of self-efficacy theory of behavioral change. Cognitive Therapy and Research, 1(4), 287–310. 10.1007/BF01663995 [DOI] [Google Scholar]
- Bandura A, Adams NE, Hardy AB, & Howells GN (1980). Tests of the generality of self-efficacy theory. Cognitive Therapy and Research, 4(1), 39–66. 10.1007/Bf01173354 [DOI] [Google Scholar]
- Beidel DC, Alfano CA, Kofler MJ, Rao PA, Scharfstein L, & Wong Sarver N. (2014). The impact of social skills training for social anxiety disorder: A randomized controlled trial. Journal of Anxiety Disorders, 28(8), 908–918. 10.1016/j.janxdis.2014.09.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boettcher J, Magnusson K, Marklund A, Berglund E, Blomdahl R, Braun U, . . . Carlbring P. (2018). Adding a smartphone app to internet-based self-help for social anxiety: A randomized controlled trial. Computers in Human Behavior, 87, 98–108. 10.1016/j.chb.2018.04.052 [DOI] [Google Scholar]
- Borkovec TD, & Sides JK (1979). The contribution of relaxation and expectancy to fear reduction via graded, imaginal exposure to feared stimuli. Behaviour Research and Therapy, 17(6), 529–540. 10.1016/0005-7967(79)90096-2 [DOI] [PubMed] [Google Scholar]
- Bouton ME (2000). A learning theory perspective on lapse, relapse, and the maintenance of behavior change. Health Psychology, 19(1S), 57–63. 10.1037/0278-6133.19.Suppl1.57 [DOI] [PubMed] [Google Scholar]
- Chesham RK, Malouff JM, & Schutte NS (2018). Meta-analysis of the efficacy of virtual reality exposure therapy for social anxiety. Behaviour Change, 35(3), 152–166. 10.1017/bec.2018.15 [DOI] [Google Scholar]
- Christian C, Cash E, Cohen DA, Trombley CM, & Levinson CA (2022). Electrodermal activity and heart rate variability during exposure fear scripts predict trait-level and momentary social anxiety and eating-disorder symptoms in an analogue sample. . Clinical Psychological Science, 11(1), 134–148. 10.1177/21677026221083284 [DOI] [Google Scholar]
- Costanzo ME, Leaman S, Jovanovic T, Norrholm SD, Rizzo AA, Taylor P, & Roy MJ (2014). Psychophysiological response to virtual reality and subthreshold posttraumatic stress disorder symptoms in recently deployed military. Psychosomatic Medicine, 76(9), 670–677. 10.1097/PSY.0000000000000109 [DOI] [PubMed] [Google Scholar]
- Craske MG, Treanor M, Conway CC, Zbozinek T, & Vervliet B. (2014). Maximizing exposure therapy: An inhibitory learning approach. Behaviour Research and Therapy, 58, 10–23. 10.1016/j.brat.2014.04.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dinh H, Walker N, Hodges L, Song C, & Kobayashi A. (1999). Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. In: Proceedings of the Virtual Reality Annual International Symposium, 222–228. 10.1109/Vr.1999.756955 [DOI] [Google Scholar]
- Eisenberg D, Hunt J, & Speer N. (2013). Mental health in American colleges and universities: Variation across student subgroups and across campuses. Journal of Nervous and Mental Disease, 201(1), 60–67. 10.1097/NMD.0b013e31827ab077 [DOI] [PubMed] [Google Scholar]
- Eisenberg D, Hunt J, Speer N, & Zivin K. (2011). Mental health service utilization among college students in the United States. Journal of Nervous and Mental Disease, 199(5), 301–308. 10.1097/NMD.0b013e3182175123 [DOI] [PubMed] [Google Scholar]
- Evans IM, & Kamemoto WS (1973). Reliability of the short form of Betts’ Questionnaire on Mental Imagery: Replication. Psychological Reports, 33(1), 281–282. 10.2466/pr0.1973.33.1.281 [DOI] [Google Scholar]
- Fitzsimmons-Craft EE, Taylor CB, Newman MG, Zainal NH, Rojas-Ashe EE, Lipson SK, . . . Wilfley DE (2021). Harnessing mobile technology to reduce mental health disorders in college populations: A randomized controlled trial study protocol. Contemporary Clinical Trials, 103, 106320. 10.1016/j.cct.2021.106320 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, & Merry S. (2018). Beyond the trial: Systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. Journal of Medical Internet Research, 20(6), e199. 10.2196/jmir.9275 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Foa E, & McNally R. (1996). Mechanisms of change in exposure therapy. In Rapee RM (Ed.), Current controversies in the anxiety disorders (pp. 329–343). Guilford. [Google Scholar]
- Foa EB, & Kozak MJ (1986). Emotional processing of fear: Exposure to corrective information. Psychological Bulletin, 99(1), 20–35. 10.1037/0033-2909.99.1.20 [DOI] [PubMed] [Google Scholar]
- Gearing RE, Schwalbe CS, Lee R, & Hoagwood KE (2013). The effectiveness of booster sessions in CBT treatment for child and adolescent mood and anxiety disorders. Depression and Anxiety, 30(9), 800–808. 10.1002/da.22118 [DOI] [PubMed] [Google Scholar]
- Green P, & MacLeod CJ (2016). SIMR: an R package for power analysis of generalized linear mixed models by simulation. Methods in Ecology and Evolution, 7(4), 493–498. 10.1111/2041-210x.12504 [DOI] [Google Scholar]
- Harris SR, Kemmerling RL, & North MM (2002). Brief virtual reality therapy for public speaking anxiety. Cyberpsychology & Behavior, 5(6), 543–550. 10.1089/109493102321018187 [DOI] [PubMed] [Google Scholar]
- Heimberg RG, Mueller GP, Holt CS, Hope DA, & Liebowitz MR (1992). Assessment of anxiety in social interaction and being observed by others: The Social Interaction Anxiety Scale and the Social Phobia Scale. Behavior Therapy, 23(1), 53–73. 10.1016/S0005-7894(05)80308-9 [DOI] [Google Scholar]
- Hope DA, Holt CS, & Heimberg RG (1993). Social phobia. In Giles TR (Ed.), Handbook of effective psychotherapy (pp. 227–251). Plenum Press. 10.1007/978-1-4615-2914-9_10 [DOI] [Google Scholar]
- Horowitz LM, Inouye D, & Siegelman EY (1979). On averaging judges’ ratings to increase their correlation with an external criterion. Journal of Consulting and Clinical Psychology, 47(3), 453–458. 10.1037/0022-006x.47.3.453 [DOI] [PubMed] [Google Scholar]
- Huppert JD, Roth DA, & Foa EB (2003). Cognitive-behavioral treatment of social phobia: new advances. Current Psychiatry Reports, 5(4), 289–296. 10.1007/s11920-003-0058-5 [DOI] [PubMed] [Google Scholar]
- Kaczkurkin AN, & Foa EB (2022). Cognitive-behavioral therapy for anxiety disorders: An update on the empirical evidence. Dialogues in Clinical Neuroscience, 17(3), 337–346. 10.31887/DCNS.2015.17.3/akaczkurkin [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kampmann IL, Emmelkamp PM, & Morina N. (2016). Meta-analysis of technology-assisted interventions for social anxiety disorder. Journal of Anxiety Disorders, 42, 71–84. 10.1016/j.janxdis.2016.06.007 [DOI] [PubMed] [Google Scholar]
- Kazdin AE (2017). Addressing the treatment gap: A key challenge for extending evidence-based psychosocial interventions. Behaviour Research and Therapy, 88, 7–18. 10.1016/j.brat.2016.06.004 [DOI] [PubMed] [Google Scholar]
- LaFreniere LS, & Newman MG (2016). A brief ecological momentary intervention for generalized anxiety disorder: A randomized controlled trial of the worry outcome journal. Depression and Anxiety, 33(9), 829–839. 10.1002/da.22507 [DOI] [PubMed] [Google Scholar]
- Lang PJ (1977). Imagery in therapy: An information processing analysis of fear. Behavior Therapy, 8(5), 862–886. 10.1016/S0005-7894(77)80157-3 [DOI] [PubMed] [Google Scholar]
- Lewis C, Pearce J, & Bisson JI (2012). Efficacy, cost-effectiveness and acceptability of self-help interventions for anxiety disorders: Systematic review. British Journal of Psychiatry, 200(1), 15–21. 10.1192/bjp.bp.110.084756 [DOI] [PubMed] [Google Scholar]
- Linardon J, & Fuller-Tyszkiewicz M. (2020). Attrition and adherence in smartphone-delivered interventions for mental health problems: A systematic and meta-analytic review. Journal of Consulting and Clinical Psychology, 88(1), 1–13. 10.1037/ccp0000459 [DOI] [PubMed] [Google Scholar]
- Mattick RP, & Clarke JC (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36(4), 455–470. 10.1016/S0005-7967(97)10031-6 [DOI] [PubMed] [Google Scholar]
- Mayo-Wilson E, Dias S, Mavranezouli I, Kew K, Clark DM, Ades AE, & Pilling S. (2014). Psychological and pharmacological interventions for social anxiety disorder in adults: A systematic review and network meta-analysis. The Lancet Psychiatry, 1(5), 368–376. 10.1016/S2215-0366(14)70329-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Newman MG, Consoli A, & Taylor CB (1997a). Computers in assessment and cognitive behavioral treatment of clinical disorders: Anxiety as a case in point. Behavior Therapy, 28(2), 211–235. 10.1016/S0005-7894(97)80044-5 [DOI] [Google Scholar]
- Newman MG, Jacobson NC, Rackoff GN, Jones Bell M, & Taylor CB (2021a). A randomized controlled trial of a smartphone-based application for the treatment of anxiety. Psychotherapy Research, 31(4), 443–454. 10.1080/10503307.2020.1790688 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Newman MG, Kachin KE, Zuellig AR, Constantino MJ, & Cashman-McGrath L. (2003). The Social Phobia Diagnostic Questionnaire: Preliminary validation of a new self-report diagnostic measure of social phobia. Psychological Medicine, 33(4), 623–635. 10.1017/S0033291703007669 [DOI] [PubMed] [Google Scholar]
- Newman MG, Kanuri N, Rackoff GN, Jacobson NC, Bell MJ, & Taylor CB (2021b). A randomized controlled feasibility trial of internet-delivered guided self-help for generalized anxiety disorder (GAD) among university students in India. Psychotherapy, 58(4), 591–601. 10.1037/pst0000383 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Newman MG, Kenardy J, Herman S, & Taylor CB (1997b). Comparison of palmtop-computer-assisted brief cognitive-behavioral treatment to cognitive-behavioral treatment for panic disorder. Journal of Consulting and Clinical Psychology, 65(1), 178–183. 10.1037//0022-006X.65.1.178 [DOI] [PubMed] [Google Scholar]
- Newman MG, Przeworski A, Consoli AJ, & Taylor CB (2014). A randomized controlled trial of ecological momentary intervention plus brief group therapy for generalized anxiety disorder. Psychotherapy, 51(2), 198–206. 10.1037/a0032519 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Newman MG, Szkodny LE, Llera SJ, & Przeworski A. (2011). A review of technology-assisted self-help and minimal contact therapies for anxiety and depression: Is human contact necessary for therapeutic efficacy? Clinical Psychology Review, 31(1), 89–103. 10.1016/j.cpr.2010.09.008 [DOI] [PubMed] [Google Scholar]
- Nunnally JC, & Bernstein IH (1994). Psychometric theory (3rd ed.). McGraw-Hill. [Google Scholar]
- Padhye NS, Cron SG, Gusick GM, Hamlin SK, & Hanneman SK (2009). Randomization for clinical research: An easy-to-use spreadsheet method. Research in Nursing and Health, 32(5), 561–566. 10.1002/nur.20341 [DOI] [PubMed] [Google Scholar]
- Pittig A, Kotter R, & Hoyer J. (2019). The struggle of behavioral therapists with exposure: Self-reported practicability, negative beliefs, and therapist distress about exposure-based interventions. Behavior Therapy, 50(2), 353–366. 10.1016/j.beth.2018.07.003 [DOI] [PubMed] [Google Scholar]
- Ponniah K, & Hollon SD (2009). Empirically supported psychological treatments for adult acute stress disorder and posttraumatic stress disorder: a review. Depression and Anxiety, 26(12), 1086–1109. 10.1002/da.20635 [DOI] [PubMed] [Google Scholar]
- Rodebaugh TL, Heimberg RG, Brown PJ, Fernandez KC, Blanco C, Schneier FR, & Liebowitz MR (2011). More reasons to be straightforward: Findings and norms for two scales relevant to social anxiety. Journal of Anxiety Disorders, 25(5), 623–630. 10.1016/j.janxdis.2011.02.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Romano M, Moscovitch DA, Huppert JD, Reimer SG, & Moscovitch M. (2020). The effects of imagery rescripting on memory outcomes in social anxiety disorder. Journal of Anxiety Disorders, 69(102169), 102169. 10.1016/j.janxdis.2019.102169 [DOI] [PubMed] [Google Scholar]
- Rosenthal R, & DiMatteo MR (2001). Meta-analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology, 52, 59–82. 10.1146/annurev.psych.52.1.59 [DOI] [PubMed] [Google Scholar]
- Schubert T, Friedmann F, & Regenbrecht H. (2001). The experience of presence: Factor analytic insights. Presence: Teleoperators & Virtual Environments, 10(3), 266–281. 10.1162/105474601300343603 [DOI] [Google Scholar]
- Schumer MC, Lindsay EK, & Creswell JD (2018). Brief mindfulness training for negative affectivity: A systematic review and meta-analysis. Journal of Consulting and Clinical Psychology, 86(7), 569–583. 10.1037/ccp0000324 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schwarzer R, & Jerusalem M. (1995). Generalized Self-Efficacy scale. In Weinman J, Wright S, & Johnston M. (Eds.), Measures in health psychology: A user’s portfolio. Causal and control beliefs (pp. 35–37). NFER-NELSON. [Google Scholar]
- Schwarzer R, Mueller J, & Greenglass E. (1999). Assessment of perceived general self-efficacy on the Internet: data collection in cyberspace. Anxiety, stress and coping, 12(2), 145–161. 10.1080/10615809908248327 [DOI] [Google Scholar]
- Sheehan PW (1967). A Shortened Form of Betts’ Questionnaire Upon Mental Imagery. Journal of Clinical Psychology, 23(3), 386–389. [DOI] [PubMed] [Google Scholar]
- Shin KE, & Newman MG (2018). Using retrieval cues to attenuate return of fear in individuals with public speaking anxiety. Behavior Therapy, 49(2), 212–224. 10.1016/j.beth.2017.07.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Simblett S, Greer B, Matcham F, Curtis H, Polhemus A, Ferrão J, . . . Wykes T. (2018). Barriers to and facilitators of engagement with remote measurement technology for managing health: Systematic review and content analysis of findings. Journal of Medical Internet Research, 20(7), e10480. 10.2196/10480 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stolz T, Schulz A, Krieger T, Vincent A, Urech A, Moser C, . . . Berger T. (2018). A mobile app for social anxiety disorder: A three-arm randomized controlled trial comparing mobile and PC-based guided self-help interventions. Journal of Consulting and Clinical Psychology, 86(6), 493–504. 10.1037/ccp0000301 [DOI] [PubMed] [Google Scholar]
- Tolin DF (2019). Inhibitory learning for anxiety-related disorders. Cognitive and Behavioral Practice, 26(1), 225–236. 10.1016/j.cbpra.2018.07.008 [DOI] [Google Scholar]
- Tolin DF, Gilliam C, Wootton BM, Bowe W, Bragdon LB, Davis E, . . . Hallion LS (2018). Psychometric properties of a structured Diagnostic Interview for DSM-5 Anxiety, Mood, and Obsessive-Compulsive and Related Disorders. Assessment, 25(1), 3–13. 10.1177/1073191116638410 [DOI] [PubMed] [Google Scholar]
- Torous J, Nicholas J, Larsen ME, Firth J, & Christensen H. (2018). Clinical review of user engagement with mental health smartphone apps: Evidence, theory and improvements. Evidence-Based Mental Health, 21(3), 116–119. 10.1136/eb-2018-102891 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Minnen A, & Foa EB (2006). The effect of imaginal exposure length on outcome of treatment for PTSD. Journal of Traumatic Stress, 19(4), 427–438. 10.1002/jts.20146 [DOI] [PubMed] [Google Scholar]
- Vasconcelos-Raposo J, Bessa M, Melo M, Barbosa L, Rodrigues R, Teixeira CM, . . . Sousa AA (2016). Adaptation and validation of the Igroup Presence Questionnaire (IPQ) in a Portuguese sample. Presence, 25(3), 191–203. 10.1162/PRES_a_00261 [DOI] [Google Scholar]
- Vervliet B, Craske MG, & Hermans D. (2013). Fear extinction and relapse: State of the art. Annual Review of Clinical Psychology, 9, 215–248. 10.1146/annurev-clinpsy-050212-185542 [DOI] [PubMed] [Google Scholar]
- Wolpe J, & Lazarus AA (1967). Behavior therapy techniques: A guide to the treatment of neuroses. Pergamon Press. [Google Scholar]
- Zainal NH, Chan WW, Saxena AP, Taylor CB, & Newman MG (2021). Pilot randomized trial of self-guided virtual reality exposure therapy for social anxiety disorder. Behaviour Research and Therapy, 147, 103984. 10.1016/j.brat.2021.103984 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zainal NH, & Newman MG (2023). A randomized controlled trial of a 14-day mindfulness ecological momentary intervention (MEMI) for generalized anxiety disorder. European Psychiatry, 66(1), e12. 10.1192/j.eurpsy.2023.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.