Abstract
Background
Traditional one-session exposure therapy (OST) in which a patient is gradually exposed to feared stimuli for up to 3 h in a one-session format has been found effective for the treatment of specific phobias. However, many individuals with specific phobia are reluctant to seek help, and access to care is lacking due to logistic challenges of accessing, collecting, storing, and/or maintaining stimuli. Virtual reality (VR) exposure therapy may improve upon existing techniques by facilitating access, decreasing cost, and increasing acceptability and effectiveness. The aim of this study is to compare traditional OST with in vivo spiders and a human therapist with a newly developed single-session gamified VR exposure therapy application with modern VR hardware, virtual spiders, and a virtual therapist.
Methods/design
Participants with specific phobia to spiders (N = 100) will be recruited from the general public, screened, and randomized to either VR exposure therapy (n = 50) or traditional OST (n = 50). A behavioral approach test using in vivo spiders will serve as the primary outcome measure. Secondary outcome measures will include spider phobia questionnaires and self-reported anxiety, depression, and quality of life. Outcomes will be assessed using a non-inferiority design at baseline and at 1, 12, and 52 weeks after treatment.
Discussion
VR exposure therapy has previously been evaluated as a treatment for specific phobias, but there has been a lack of high-quality randomized controlled trials. A new generation of modern, consumer-ready VR devices is being released that are advancing existing technology and have the potential to improve clinical availability and treatment effectiveness. The VR medium is also particularly suitable for taking advantage of recent phobia treatment research emphasizing engagement and new learning, as opposed to physiological habituation. This study compares a market-ready, gamified VR spider phobia exposure application, delivered using consumer VR hardware, with the current gold standard treatment. Implications are discussed.
Trial registration
ClinicalTrials.gov identifier NCT02533310. Registered on 25 August 2015.
Keywords: Specific phobia, Exposure therapy, Spiders, Virtual reality, Serious games, Gamification
Background
Specific phobias are second only to major depression for lifetime prevalence of mental health disorders in the United States (16.6 % vs 15.6 %) [1]. The prevalence is somewhat reduced in older individuals (8.7 %) [2]. Estimates suggest 60–80 % of those with specific phobia are hesitant to seek help [3]. Some phobias are far more common than others [4], with half of reported phobias being fear of either heights or animals [5]. Spider phobia is among the most prevalent of animal phobias and is the most studied. The consequences of anxiety, worry, and avoidance behavior can have a large impact on quality of life, work, and leisure activities [6].
Exposure-based therapies in which an individual is systematically and repeatedly presented with a feared or avoided internal or external cue is highly effective in reducing anxiety disorders [7, 8]. Compared with imaginal exposure, evidence indicates that an in vivo (naturalistic setting) stimulus is the preferable exposure treatment method for specific phobia [6]. One-session therapy (OST) is considered the intervention of choice for in vivo specific phobia treatment in adults and children [9, 10]. OST sessions typically last up to 3 h and consist of graduated exposure to phobic stimuli, positive reinforcement, therapist modeling of non-phobic behavior, and cognitive restructuring of catastrophic beliefs [11].
The benefits of exposure therapy are limited by issues pertaining to both therapist and patient. Access to evidence-based treatments has been lacking [12], likely commensurate with the challenges of therapists locating appropriate material and/or stimuli, difficulties with conducting exposure work outside the clinic, and maintaining stimuli such as animals and insects. Even when these resources are available, participants may refuse to engage in therapy. Once explained, exposure therapy is turned down by 30 % of subjects [13], and this percentage is estimated to be significantly higher for OST if the endpoint is discussed beforehand [12]. Return of fear of the feared stimuli following treatment can also occur at a later date [14].
Virtual reality (VR) technology involving head-mounted, motion-tracked displays, accompanied by realistically rendered 3D computer-animated environments [15], offers researchers the opportunity to recreate phobic stimuli, manipulate and tailor key variables associated with stimulus presentation (color, size, and movement), context, scheduling, and intensity of exposure according to the patient’s needs, as well as to extract unprecedented amounts of data, such as gaze focus [16]. Previous generations of VR have already been used successfully in mental health treatments [17] for fear of flying, heights, public speaking, and spider phobia, among others [18]. VR thus has the potential to greatly increase accessibility and effectiveness of exposure treatments. In a survey of 777 undergraduate students who scored high in fear of spiders, more than 80 % expressed a preference for VR exposure treatment over in vivo treatment [19]. In recent studies, researchers have evaluated the unique opportunity of VR to inexpensively and relatively easily alter the context of exposure, an important moderator of treatment resurgence [20]. Participants treated using VR in multiple environments [21], and participants treated by exposure to spiders using video recordings of multiple areas of a house rather than a single area [22], were less likely to have return of fear following an aversive event.
Serious games designed for purposes other than entertainment and allowing users to experience situations impossible or dangerous in real life [23], with gamified elements such as points and goals to increase engagement [24], may provide a particularly promising advancement in exposure therapy. As reviewed by Botella et al. [25], game elements may reduce distress as compared with traditional exposure therapy [26]. Recommendations that patients continue to confront phobic stimuli posttreatment [12] may be facilitated by gamified VR content that can be played again and again [25].
The potential of VR notwithstanding, the quality of past VR exposure therapy research has historically been poor [27]. Well-designed randomized controlled trials are required before implementation in clinical practice can be recommended. Further, recent advances in VR technology have enabled unprecedented realistic stimuli to be rendered with less intrusive equipment, minimizing the risk of nausea and allowing longer sessions, though careful application design is still required [28]. A new generation of VR systems produced by some of the world’s largest technology companies, such as Sony (Project Morpheus), Microsoft (Hololens), HTC (Vive), and Facebook (Oculus Rift), promises to change VR from a professional niche product costing as much as $35,000 to a consumer product priced around $599 plus the cost of a competent computer [29]. Other developments in VR include the use of smartphone-based systems such as the Samsung Gear VR, used in the present study, the cost of which is negligible ($99 USD) if paired with a user’s preexisting smartphone [30]. From a research perspective, using VR can also reduce some of the complexity of carrying out exposure treatments, improve standardization of protocols and cost-effectiveness, and enable at-home self-care [31].
The parallel-group randomized controlled trial described in this protocol is designed to investigate non-inferiority of a novel, gamified VR OST program for spider phobia by comparison with traditional OST.
Methods/design
This randomized controlled trial is registered in the ClinicalTrials.gov database (NCT02533310) and has received ethical approval from the Stockholm Regional Ethical Review Board (Dnr 472-31). Written informed consent will be obtained from all participants at the premeasurement occasion.
Procedure
To recruit a diverse sample, multiple recruitment methods will be used, primarily postings in online forums and through coverage in national television, newspapers, and magazines [32]. Potential participants will be directed to the study website (www.vimse.se), where they will find more information about the study and can complete the online screening battery. Participants meeting inclusion criteria will travel to Stockholm University to complete the premeasurement, including self-rating scales, a diagnostic interview, and a Behavioral Approach Test (BAT). If suitable for inclusion, participants will be randomized and, approximately 1 week after the premeasurement occasion, will complete the allocated treatment session. Posttreatment measurements will take place approximately 1 week after the treatment session. Additional follow-up measurements are planned after 12 and 52 weeks. See Fig. 1 for the study flowchart.
Subjects will be randomized to treatment arms (using a true random number generator: www.random.org) after completing the premeasurement in preset blocks of 4, 6, 8, or 10 (randomly sized) with even group allocation in each block. Randomization will be performed by a research assistant not otherwise involved in the study, and allocation will be blinded to all but the treatment coordinator and the assigned therapist. As in most psychological research, blinding participants to treatment allocation is not feasible. For ethical reasons, subjects are informed at premeasurement of the two possible treatment allocations, and their preference (and strength thereof) is noted to enable investigation of mediating effects of treatment preference. The therapist administering the posttreatment assessment will be blinded to treatment allocation until all outcome measures have been completed.
All data gathered during the study will be stored anonymously. No contractual agreements limit access by other investigators to this data or to final datasets, and upon completion the dataset generated in this trial will be published in a data repository (e.g., Dryad or figshare), accompanied by the script files to reproduce the statistical analyses.
Sample
The sample will consist of 100 adults (age ≥18 years). To be included, participants need to reside in Sweden, be fluent in Swedish, and have the ability to travel to the study location on five separate occasions (pretest, treatment, posttest, and two follow-up occasions). Exclusion criteria include ongoing psychotherapy or psychotropic medication (unless on stable dosage for the previous 3 months and no changes planned during the study period), indications of suicidal ideation or other serious mental disorder (e.g., substance misuse, bipolar disorder, psychosis), and lack of stereoscopic vision or balance problems that would hinder experiencing the VR environment. To meet inclusion criteria, participants must score 9 or less on the BAT (see below) and meet the criteria set forth in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), for specific phobia, assessed using the Structured Clinical Interview for DSM Disorders [33] adapted for DSM-5 criteria [34].
Measures
Primary outcome measure
Change from baseline on the BAT will serve as the primary outcome measure. To study the real-world effects of VR therapy, all participants will complete the same BAT featuring a real spider. The BAT [35] will feature 13 steps (scored 0–12) corresponding to sequentially closer contact with the spider. See Table 1 for sequence details. The BAT will begin with participants standing outside a room (approximately 3 × 5 m large) where there will be a table placed farthest away from the door, on which a transparent container (about 40 × 30 × 19 cm large) will house the spider (medium-sized; see below). The participants will be informed that the objective of the exercise is to pick up and hold the spider in their hands for 20 seconds. They will be encouraged to do their best but will be told that they can abort the exercise at any time. A pretreatment score of 9 or less [36] will be required for study inclusion.
Table 1.
Score | Details |
---|---|
0 | Refusal to enter room |
1 | Enters room but stops before covering one-fifth of the distance to the container |
2 | Stops before covering two-fifths of the distance to the container |
3 | Stops before covering three-fifths of the distance to the container |
4 | Stops before covering four-fifths of the distance to the container |
5 | Stops before covering all of the distance to the container |
6 | Reaches the table with the container |
7 | Touches the container |
8 | Removes the lid of the container |
9 | Puts a hand inside the container |
10 | Touches the spider with at least one finger |
11 | Holds spider in hands for less than 20 seconds |
12 | Holds spider in hands for 20 seconds or more |
Secondary outcome measures
In addition to the BAT, subjects will complete two self-report measures of fear toward spiders: the Spider Phobia Questionnaire (SPQ) [37] and the Fear of Spiders Questionnaire (FSQ) [38]. The Generalized Anxiety Disorder 7-item scale (GAD-7) [39] will be used to measure generic anxiety symptoms, and the Patient Health Questionnaire-9 (PHQ-9) [40] will be used to evaluate depression symptoms. Subjective quality of life will be measured with the Brunnsviken Brief Quality of life scale (BBQ) [41]. Meeting diagnostic criteria for specific phobia in the 12- and 52-week follow-up measurements will also serve as a secondary outcome measure. Swedish translations of all the self-rating scales will be used.
Other measures
At premeasurement, all participants complete the treatment Credibility/Expectancy Questionnaire (CEQ) [42] for both the traditional OST and VR treatments (in quasi-randomized order). Participants also complete the CEQ at postmeasurement with re-phrased items that ask respondents to evaluate their completed treatment. A number of additional surveys will be used to determine the influence of moderating factors on VR treatment outcome. Immediately following treatment, VR-treated participants will answer the Simulator Sickness Questionnaire (SSQ) [43], a measure of participant discomfort during treatment. At postmeasurement, VR-treated participants will further complete the iGroup Presence Questionnaire (IPQ) [44], a measure of the sense of actually being in the virtual environment, and the System Usability Scale (SUS) [45], which assesses product complexity and ease of use. At postmeasurement, all participants will complete the Adverse Effects Questionnaire, a novel measurement tool used to assess side effects of psychological treatments, as proposed by Rozenthal et al. [46]. Finally, at 12-week and 52-week follow-up, patients will answer questions regarding frequency and type of interactions with spiders since their last visit, as well as other forms of treatment received.
Interventions
Traditional OST
Traditional OST treatment sessions will be held with participants on a one-to-one basis with clinical psychologists or clinical psychologists in their final year of training, all with past clinical cognitive behavioral therapy experience. All OST therapists will receive regular supervision from an experienced clinical psychologist and psychotherapist.
Traditional OST for spider phobia consists of a combination of gradated exposures to increasingly large, naturally occurring in vivo spiders and model learning of healthy, non-phobic behavior as demonstrated by the therapist [12]. Spiders used in traditional OST (and the BAT) will be harmless common varieties indigenous to the region, primarily of the genus Tegenaria (T. domestica and T. atrica). Spiders will be classified according to size: small (5–15 mm), medium (15–25 mm), or large (>25 mm).
The goal of OST is to bring patients a greater sense of control and a recognition that their feared catastrophic outcome will not occur (e.g., they will not have a heart attack). OST is performed for a maximum 3-h duration during a morning or afternoon. The patient is first explained the rationale and content of the treatment, then their catastrophic beliefs and safety behaviors are explored and avoidance activities are normalized. Participant modeling encourages careful observation by patients and that they not close their eyes or look away. Subjective units of distress (SUD) ratings are used to determine when to move on to a more challenging stage of treatment (100 % denotes the most anxiety-provoking situation experienced in relation to the phobia). Humor can be used to put the patient’s reactions into perspective and reduce the patient’s anxiety [47].
The initial graduated exposure step (featuring a small spider) teaches the patient to capture a spider with a glass with the intention of removing it from the building. The next exposure step has the patient touch various parts of the spider. Interactions with the spider are best organized as behavioral experiments in which the patient’s beliefs about what may occur are tested against reality. The exposure steps that follow have the spider crawl first on the patient’s hand then up to the elbow, and finally the spider is allowed to crawl on the patient’s body, from the knee to the waist and from the shirt up to the neck. These steps are then repeated using first a medium spider and then a large spider. The final stage has the patient handle two spiders, one in each hand, and an overlearning step can be added in which the spider crawls on the patient’s hair and cheek. The patient should have no or low anxiety in the last exposure stages and should no longer believe their catastrophic cognitions.
Virtual reality one-session therapy
VR OST was designed as a serious game [23] with game progression entailing gradually increased stimuli intensity. The application consists of a number of zones, each containing three types of gamified tasks for the user to complete: (1) looking at spiders, (2) interacting with spiders to complete rudimentary game mechanics, and (3) a task where the user is approached by a spider. With completion of tasks and progression through the zones, spider stimuli become increasingly more intense, from a cute, cartoonish spider through realistically depicted tarantulas. See Fig. 2 for a screenshot from the application. Two virtual environments will be used: a living room environment and an outdoor suburban backyard environment. User input is strictly gaze-derived and is used for the interactive game mechanics, reporting SUD and more. Once initiated, the application is fully automated (i.e., no therapist action required) and includes a system for saving and compiling SUD and other input, a virtual therapist providing instructions through voiceover, support and summaries of progress, and information about spiders. Unlike the OST treatment, participants in the VR condition will be seated throughout the duration of therapy, but both groups will be time-limited to 3-h duration. Although the VR treatment is automated, a clinical psychologist will be in attendance (one-to-one) with the participant in case of technical or other difficulties.
In this study, the Samsung Gear VR platform (powered by a Samsung Galaxy Note 4 or Galaxy S6, both running Android 5.0) will be used to create the VR environment. Availability of the VR application on other VR platforms (e.g., Oculus and Vive) is planned.
Analyses
Data will be analyzed on an intention-to-treat basis, using mixed effects models [48]. This trial was powered to detect a non-inferiority margin of a 2-point between-group difference, with a standard deviation of 4. The margin and standard deviation were based on previous research on traditional OST [36]. In accordance with the non-inferiority design, we hypothesize that the lower bound of the 95 % confidence interval of the between-group difference will not be larger than 2. On the basis of these parameters (and 80 % power), the study will require 50 participants assigned to each group (N = 100 total). In addition to the non-inferiority analyses, standard mixed models will be used to investigate effects of time and group on primary and secondary outcome measures. Within- and between-group effect sizes will be calculated using Cohen’s d. The influence on outcomes of demographic and other non-clinical variables (e.g., experience with gaming) will also be examined. All design, implementation, and reporting will be carried out in accordance with CONSORT and SPIRIT guidelines [49–51].
Discussion
The aim of this study is to evaluate the effectiveness of VR exposure therapy compared with traditional one-session exposure therapy using a randomized controlled design and subjects diagnosed with spider phobia. The introduction of modern VR headsets combined with powerful but relatively inexpensive computers capable of displaying realistic stimuli, in addition to the historical lack of high-quality randomized controlled trials [52], suggest that this is an opportune time to make use of this rapidly advancing technology and translate it into clinically validated mental health treatments. VR exposure therapy has already been theoretically and empirically evaluated to be well-suited for the treatment of specific phobias [53]. The authors of a recent meta-analysis [54] provided additional evidence based on behavioral assessment rather than self-report of internal states. VR exposure-treated subjects, in their review of 14 studies, improved significantly after treatment (g = 1.23) and compared with control subjects (g = 1.41). No significant differences were identified after treatment and in follow-up between in vivo and VR exposures.
Conducting VR exposure therapy using modern, commercially available VR equipment may prove even more powerful. In addition to the evaluation of modern VR hardware, our intent in this study is also to evaluate a newly developed, gamified exposure application for the treatment of specific phobias. The software includes advancements such as multiple open-ended exposure scenarios relying on gamification to improve engagement and interest; multiple stimulus intensity variables such as appearance (small to large spiders, cartoon-like to hairy), behavior (more or less predictable, static, and aggressive), a variable number of spiders, and changes in lighting and protective barriers (such as caged or not); a virtual therapist that guides the participant in the use of the application and provides psychoeducation and expert advice about spiders; and inclusion of a gaze direction trackpad to allow participants to interact with the stimuli.
Recent evidence indicates that treatment benefits of exposure therapy accrue as a result of new inhibitory learning and not habituation of the conditioned response to phobic stimuli [55]. Physiological habituation (viz., reduced heart rate and galvanic skin response) may serve as a safety signal alleviating fear in the short term but inhibiting long-term learning and extinction [56]. Serious game treatments in which there is a sense of play, interactivity, flow, and creative solutions have the potential to promote new learning [57]. In an exposure therapy context, these should create engagement (rather than avoidance) by producing a mismatch between expectancy and outcome and require flexible responding [55]. In a study in which a fear of heights group received random levels of exposure intensity and approached stimuli in multiple ways versus a steady intensity increase group, researchers found improved fear reduction in the former, without a need for physiological habituation [58].
Limitations of the present study include an exposure application that involves multiple unique design specifications, making disentangling of specific therapeutic factors difficult. Despite the complete automation of the VR application, psychologists will be in attendance to resolve technical difficulties and ensure treatment compliance and will be present to assist patients if needed. Future studies will benefit from having the patient administer VR treatment independently to ensure true isolation of treatment effects. In addition, physiological monitoring of subjects will not be possible during this study but may prove helpful in interpreting the results of future studies.
In sum, spider phobia is a common disorder [1] that has a negative impact on life, work, and leisure activities [6] but goes largely untreated [3]. VR exposure therapy may provide improvements in efficacy [15], access, standardization of protocols, and cost-effectiveness [31]. Although not evaluated in this study, virtual OST also has the potential to conveniently continue maintenance therapy once regular treatment has been completed. This study is, to our knowledge, the first to test the efficacy of a modern, market-ready VR application for the treatment of spider phobia, and it will assist in the development of a new method for the delivery of evidence-based treatments.
Trial status
At time of initial manuscript submission (August 2015), recruitment was ongoing. Enrolment and the active treatment period are expected to be completed in January 2016.
Acknowledgments
The present study was made possible in part by a grant from the Swedish Research Council (2011-2913) and Forte (2013-1107). The authors extend their gratitude to Katherine Cotter for assistance in executing the trial, and the following clinical psychologists: Daniel Attar, Stefan Deak, Maria Garke, Julia Heinsoo, Sofia Jägholm, Glenn Kristoffersson, Jonas Rafi, Kerstin Sindemark, Jessica Sjölund, Linnéa Törnhage, and Maria Zenger.
Abbreviations
- BAT
Behavioral Approach Test
- BBQ
Brunnsviken Brief Quality
- CEQ
Credibility/Expectancy Questionnaire
- DSM
Diagnostic and Statistical Manual of Mental Disorders
- FSQ
Fear of Spiders Questionnaire
- GAD-7
Generalized Anxiety Disorder 7
- IPQ
iGroup Presence Questionnaire
- OST
one-session therapy
- PHQ-9
Patient Health Questionnaire-9
- SPQ
Spider Phobia Questionnaire
- SSQ
Simulator Sickness Questionnaire
- SUD
subjective units of distress
- SUS
System Usability Scale
- VR
virtual reality
Footnotes
Competing interests
WH is the founder of Mimerse, the private company that developed the VR application used in the present study and which is intended for release on the open market. Hence, WH will not be involved in data analysis or any decisions related to the publication of findings. The other authors declare that they have no competing interests.
Authors’ contributions
AM drafted the manuscript. All coauthors made contributions to sections of the manuscript and provided critical review. PL, AM, PC, and LR designed the study. WH, GA, and PC made significant contributions to the conception of the study. LR provided clinical OST training and supervision. WH created the VR application. All authors read and approved the final manuscript.
Contributor Information
Alexander Miloff, Email: alexander.miloff@psychology.su.se.
Philip Lindner, Email: philip.lindner@ki.se.
William Hamilton, Email: william@mimerse.com.
Lena Reuterskiöld, Email: lsm@psychology.su.se.
Gerhard Andersson, Email: gerhard.andersson@liu.se.
Per Carlbring, Email: per@carlbring.se.
References
- 1.Kessler RC, Petukhova M, Sampson NA, Zaslavsky AM, Wittchen HU. Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. Int J Methods Psychiatr Res. 2012;21(3):169–84. doi: 10.1002/mpr.1359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Wolitzky-Taylor KB, Horowitz JD, Powers MB, Telch MJ. Psychological approaches in the treatment of specific phobias: a meta-analysis. Clin Psychol Rev. 2008;28(6):1021–37. doi: 10.1016/j.cpr.2008.02.007. [DOI] [PubMed] [Google Scholar]
- 3.Garcia-Palacios A, Botella C, Hoffman H, Fabregat S. Comparing acceptance and refusal rates of virtual reality exposure vs. in vivo exposure by patients with specific phobias. Cyberpsychol Behav. 2007;10(5):722–4. doi: 10.1089/cpb.2007.9962. [DOI] [PubMed] [Google Scholar]
- 4.Iancu I, Levin J, Dannon PN, Poreh A, Yehuda YB, Kotler M. Prevalence of self-reported specific phobia symptoms in an Israeli sample of young conscripts. J Anxiety Disord. 2007;21(5):762–9. doi: 10.1016/j.janxdis.2006.11.001. [DOI] [PubMed] [Google Scholar]
- 5.Stinson FS, Dawson DA, Chou SP, Smith S, Goldstein RB, Ruan WJ, et al. The epidemiology of DSM-IV specific phobia in the USA: results from the National Epidemiologic Survey on Alcohol and Related Conditions. Psychol Med. 2007;37(7):1047–59. doi: 10.1017/S0033291707000086. [DOI] [PubMed] [Google Scholar]
- 6.Choy Y, Fyer AJ, Lipsitz JD. Treatment of specific phobia in adults. Clin Psychol Rev. 2007;27(3):266–86. doi: 10.1016/j.cpr.2006.10.002. [DOI] [PubMed] [Google Scholar]
- 7.Norton PJ, Price EC. A meta-analytic review of adult cognitive-behavioral treatment outcome across the anxiety disorders. J Nerv Ment Dis. 2007;195(6):521–31. doi: 10.1097/01.nmd.0000253843.70149.9a. [DOI] [PubMed] [Google Scholar]
- 8.Ougrin D. Efficacy of exposure versus cognitive therapy in anxiety disorders: systematic review and meta-analysis. BMC Psychiatry. 2011;11:200. doi: 10.1186/1471-244X-11-200. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Ollendick TH, Davis TE. One-session treatment for specific phobias: a review of Ost’s single-session exposure with children and adolescents. Cogn Behav Ther. 2013;42(4):275–83. doi: 10.1080/16506073.2013.773062. [DOI] [PubMed] [Google Scholar]
- 10.Zlomke K, Davis TE., 3rd One-session treatment of specific phobias: a detailed description and review of treatment efficacy. Behav Ther. 2008;39(3):207–23. doi: 10.1016/j.beth.2007.07.003. [DOI] [PubMed] [Google Scholar]
- 11.Öst LG. One-session treatment for specific phobias. Behav Res Ther. 1989;27(1):1–7. doi: 10.1016/0005-7967(89)90113-7. [DOI] [PubMed] [Google Scholar]
- 12.Davis TE 3rd, Ollendick TH, Öst LG, editors. Intensive one-session treatment of specific phobias. New York: Springer; 2012. [Google Scholar]
- 13.Issakidis C, Andrews G. Pretreatment attrition and dropout in an outpatient clinic for anxiety disorders. Acta Psychiatr Scand. 2004;109(6):426–33. doi: 10.1111/j.1600-0047.2004.00264.x. [DOI] [PubMed] [Google Scholar]
- 14.Vervliet B, Craske MG, Hermans D. Fear extinction and relapse: state of the art. Annu Rev Clin Psychol. 2013;9:215–48. doi: 10.1146/annurev-clinpsy-050212-185542. [DOI] [PubMed] [Google Scholar]
- 15.Bush J. Viability of virtual reality exposure therapy as a treatment alternative. Comput Human Behav. 2008;24(3):1032–40. doi: 10.1016/j.chb.2007.03.006. [DOI] [Google Scholar]
- 16.Emmelkamp PM. Technological innovations in clinical assessment and psychotherapy. Psychother Psychosom. 2005;74(6):336–43. doi: 10.1159/000087780. [DOI] [PubMed] [Google Scholar]
- 17.Powers MB, Emmelkamp PM. Virtual reality exposure therapy for anxiety disorders: a meta-analysis. J Anxiety Disord. 2008;22(3):561–9. doi: 10.1016/j.janxdis.2007.04.006. [DOI] [PubMed] [Google Scholar]
- 18.Gregg L, Tarrier N. Virtual reality in mental health: a review of the literature. Soc Psychiatry Psychiatr Epidemiol. 2007;42(5):343–54. doi: 10.1007/s00127-007-0173-4. [DOI] [PubMed] [Google Scholar]
- 19.Garcia-Palacios A, Hoffman HG, Kwong See S, Tsai A, Botella C. Redefining therapeutic success with virtual reality exposure therapy. Cyberpsychol Behav. 2001;4(3):341–8. doi: 10.1089/109493101300210231. [DOI] [PubMed] [Google Scholar]
- 20.Mystkowski JL, Craske MG, Echiverri AM. Treatment context and return of fear in spider phobia. Behav Ther. 2002;33(3):399–416. doi: 10.1016/S0005-7894(02)80035-1. [DOI] [PubMed] [Google Scholar]
- 21.Dunsmoor JE, Ahs F, Zielinski DJ, LaBar KS. Extinction in multiple virtual reality contexts diminishes fear reinstatement in humans. Neurobiol Learn Mem. 2014;113:157–64. doi: 10.1016/j.nlm.2014.02.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Vansteenwegen D, Vervliet B, Iberico C, Baeyens F, Van den Bergh O, Hermans D. The repeated confrontation with videotapes of spiders in multiple contexts attenuates renewal of fear in spider-anxious students. Behav Res Ther. 2007;45(6):1169–79. doi: 10.1016/j.brat.2006.08.023. [DOI] [PubMed] [Google Scholar]
- 23.Susi T, Johannesson M, Backlund P. Serious games – an overview. Technical Report HS-IKI-TR-07-001. Skövde: University of Skövde, School of Humanities and Informatics; 2007. [Google Scholar]
- 24.Deterding S, Dixon D, Khaled R, Nacke L. From game design elements to gamefulness: Defining “gamification.” In MindTrek ’11: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments. New York: Association for Computing Machinery (ACM); 2011. p. 9–15. http://dl.acm.org/citation.cfm?id=2181037.2181040. Accessed 20 January 2016.
- 25.Botella C, Breton-López J, Quero S, Baños RM, García-Palacios A, Zaragoza I, et al. Treating cockroach phobia using a serious game on a mobile phone and augmented reality exposure: a single case study. Comput Human Behav. 2011;27(1):217–27. doi: 10.1016/j.chb.2010.07.043. [DOI] [Google Scholar]
- 26.Olatunji BO, Deacon BJ, Abramowitz JS. The cruelest cure? Ethical issues in the implementation of exposure-based treatments. Cogn Behav Pract. 2009;16(2):172–80. doi: 10.1016/j.cbpra.2008.07.003. [DOI] [Google Scholar]
- 27.McCann RA, Armstrong CM, Skopp NA, Edwards-Stewart A, Smolenski DJ, June JD, et al. Virtual reality exposure therapy for the treatment of anxiety disorders: an evaluation of research quality. J Anxiety Disord. 2014;28(6):625–31. doi: 10.1016/j.janxdis.2014.05.010. [DOI] [PubMed] [Google Scholar]
- 28.Davis S, Nesbitt K, Nalivaiko E. Comparing the onset of cybersickness using the Oculus Rift and two virtual roller coasters. In: Pisan Y, Nesbitt K, Blackmore K (eds). Proceedings of the 11th Australian Conference on Interactive Entertainment (IE 2015), Sydney, Australia, January 2015: Conferences in Research and Practice in Information Technology (CRPIT), Vol. 167. p. 3–14.
- 29.Hoffman HG, Meyer WJ, 3rd, Ramirez M, Roberts L, Seibel EJ, Atzori B, et al. Feasibility of articulated arm mounted Oculus Rift Virtual Reality goggles for adjunctive pain control during occupational therapy in pediatric burn patients. Cyberpsychol Behav Soc Netw. 2014;17(6):397–401. doi: 10.1089/cyber.2014.0058. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Oculus Rift. Samsung Gear VR powered by Oculus. https://www.oculus.com/en-us/gear-vr/. Accessed 20 January 2016.
- 31.Newman MG, Szkodny LE, Llera SJ, Przeworski A. A review of technology-assisted self-help and minimal contact therapies for anxiety and depression: is human contact necessary for therapeutic efficacy? Clin Psychol Rev. 2011;31(1):89–103. doi: 10.1016/j.cpr.2010.09.008. [DOI] [PubMed] [Google Scholar]
- 32.Lindner P, Nyström MBT, Hassmén P, Andersson G, Carlbring P. Who seeks ICBT for depression and how do they get there? Effects of recruitment source on patient demographics and clinical characteristics. Internet Interv. 2015;2(2):221–5. doi: 10.1016/j.invent.2015.04.002. [DOI] [Google Scholar]
- 33.First MB, Spitzer RL, Gibbon M, Williams JBW. Structured Clinical Interview for DSM-IV-TR, Axis I Disorders, Research Version, Patient Edition (SCID-I/P) New York: Biometrics Research, New York State Psychiatric Institute; 2002. [Google Scholar]
- 34.American Psychiatric Association . Diagnostic and statistical manual of mental disorders. 5. Washington, DC: Author; 2013. [Google Scholar]
- 35.Öst LG, Salkovskis PM, Hellström K. One-session therapist-directed exposure vs. self-exposure in the treatment of spider phobia. Behav Ther. 1991;22(3):407–22. doi: 10.1016/S0005-7894(05)80374-0. [DOI] [PubMed] [Google Scholar]
- 36.Andersson G, Waara J, Jonsson U, Malmaeus F, Carlbring P, Öst LG. Internet-based self-help versus one-session exposure in the treatment of spider phobia: a randomized controlled trial. Cogn Behav Ther. 2009;38(2):114–20. doi: 10.1080/16506070902931326. [DOI] [PubMed] [Google Scholar]
- 37.Klorman R, Weerts TC, Hastings JE, Melamed BG, Lang PJ. Psychometric description of some specific-fear questionnaires. Behav Ther. 1974;5(3):401–9. doi: 10.1016/S0005-7894(74)80008-0. [DOI] [Google Scholar]
- 38.Szymanski J, O’Donohue W. Fear of Spiders Questionnaire. J Behav Ther Exp Psychiatry. 1995;26(1):31–4. doi: 10.1016/0005-7916(94)00072-T. [DOI] [PubMed] [Google Scholar]
- 39.Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder. Arch Intern Med. 2006;166(10):1092–7. doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
- 40.Kroenke K, Spitzer RL. The PHQ-9: a new depression diagnostic and severity measure. Psychiatr Ann. 2002;32(9):1–7. doi: 10.3928/0048-5713-20020901-06. [DOI] [Google Scholar]
- 41.Lindner P, Frykheden O, Forsström D, Andersson E, Ljótsson B, Hedman E, et al. (In press). The Brunnsviken Brief Quality of life scale (BBQ): Development and psychometric evaluation. Cognitive Behaviour Therapy. doi: 10.1080/16506073.2016.1143526 [DOI] [PMC free article] [PubMed]
- 42.Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry. 2000;31(2):73–86. doi: 10.1016/S0005-7916(00)00012-4. [DOI] [PubMed] [Google Scholar]
- 43.Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator Sickness Questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviat Psychol. 1993;3(3):203–20. doi: 10.1207/s15327108ijap0303_3. [DOI] [Google Scholar]
- 44.Schubert T, Friedmann F, Regenbrecht H. The experience of presence: factor analytic insights. Presence. 2001;10(3):266–81. doi: 10.1162/105474601300343603. [DOI] [Google Scholar]
- 45.Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact. 2008;24(6):574–94. doi: 10.1080/10447310802205776. [DOI] [Google Scholar]
- 46.Rozental A, Andersson G, Boettcher J, Ebert DD, Cuijpers P, Knaevelsrud C, et al. Consensus statement on defining and measuring negative effects of internet interventions. Internet Interv. 2014;1(1):12–9. doi: 10.1016/j.invent.2014.02.001. [DOI] [Google Scholar]
- 47.Ventis LW, Higbee G, Murdock SA. Using humor in systematic desensitization to reduce fear. J Gen Psychol. 2001;128(2):241–53. doi: 10.1080/00221300109598911. [DOI] [PubMed] [Google Scholar]
- 48.Hesser H. Modeling individual differences in randomized experiments using growth models: recommendations for design, statistical analysis and reporting of results of internet interventions. Internet Interv. 2015;2(2):110–20. doi: 10.1016/j.invent.2015.02.003. [DOI] [Google Scholar]
- 49.Schulz KF, Altman DG, Moher D. CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010;63(8):834–40. doi: 10.1016/j.jclinepi.2010.02.005. [DOI] [PubMed] [Google Scholar]
- 50.Piaggio G, Elbourne DR, Pocock SJ, Evans SJW, Altman DG. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 Statement. JAMA. 2012;308(24):2594–604. doi: 10.1001/jama.2012.87802. [DOI] [PubMed] [Google Scholar]
- 51.Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7. doi: 10.7326/0003-4819-158-3-201302050-00583. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Parsons TD, Courtney CG, Dawson ME. Virtual reality Stroop task for assessment of supervisory attentional processing. J Clin Exp Neuropsychol. 2013;35(8):812–26. doi: 10.1080/13803395.2013.824556. [DOI] [PubMed] [Google Scholar]
- 53.Krijn M, Emmelkamp PMG, Biemond R, de Wilde de Ligny C, Schuemie MJ, van der Mast CAPG. Treatment of acrophobia in virtual reality: the role of immersion and presence. Behav Res Ther. 2004;42(2):229–39. doi: 10.1016/S0005-7967(03)00139-6. [DOI] [PubMed] [Google Scholar]
- 54.Morina N, Ijntema H, Meyerbröker K, Emmelkamp PM. Can virtual reality exposure therapy gains be generalized to real-life? A meta-analysis of studies applying behavioral assessments. Behav Res Ther. 2015;74:18–24. doi: 10.1016/j.brat.2015.08.010. [DOI] [PubMed] [Google Scholar]
- 55.Craske MG, Treanor M, Conway CC, Zbozinek T, Vervliet B. Maximizing exposure therapy: an inhibitory learning approach. Behav Res Ther. 2014;58:10–23. doi: 10.1016/j.brat.2014.04.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Craske MG, Kircanski K, Zelikowsky M, Mystkowski J, Chowdhury N, Baker A. Optimizing inhibitory learning during exposure therapy. Behav Res Ther. 2008;46(1):5–27. doi: 10.1016/j.brat.2007.10.003. [DOI] [PubMed] [Google Scholar]
- 57.Prensky M. Computer games and learning: digital game-based learning. In: Raessens J, Goldstein JH, editors. Handbook of computer game studies. Cambridge: MIT Press; 2005. pp. 97–122. [Google Scholar]
- 58.Lang AJ, Craske MG. Manipulations of exposure-based therapy to reduce return of fear: A replication. Behav Res Ther. 2000;38(1):1-12. [DOI] [PubMed]