Abstract
Background
Chronic pain is one of the most common and debilitating health conditions. Treatments for chronic low back pain typically focus on biomedical treatment approaches. While psychosocial treatments exist, multiple barriers prevent broad access. There is a significant unmet need for integrative, easily accessible, non-opioid solutions for chronic pain. Virtual reality (VR) is an immersive technology allowing innovation in the delivery of behavioral pain treatments. Behavioral skills-based VR is effective at facilitating pain management and reducing pain-related concerns. Continued research on these emerging approaches is needed.
Objective
In this randomized controlled trial, we seek to test the efficacy of a self-administered behavioral skills-based VR program as a nonpharmacological home-based pain management treatment for people with chronic low back pain (cLBP).
Methods
We will randomize 180 individuals with cLBP to 1 of 2 VR programs: (1) EaseVRx (8-week skills-based VR program); or (2) Sham VR (control condition). All participants will receive a VR headset to minimize any biases related to the technology’s novelty. The Sham VR group had 2D neutral content in a 3D theater-like environment. Our primary outcome is average pain intensity and pain-related interference with activity, stress, mood, and sleep. Our secondary outcomes include patient-reported physical function, sleep disturbance, pain self-efficacy, pain catastrophizing, pain acceptance, health utilization, medication use, and user satisfaction. We hypothesize superiority for the skills-based VR program in all of these measures compared to the control condition. Team statisticians blinded to treatment assignment will assess outcomes up to 6 months posttreatment using an approach suitable for the longitudinal nature of the data.
Results
The study was approved by the Western Institutional Review Board on July 2, 2020. The protocol (NCT04415177) was registered on May 27, 2020. Recruitment for this study was completed in July 2020, and data collection will remain active until March 2021. In total, 186 participants were recruited. Multiple manuscripts will be generated from this study. The primary manuscript will be submitted for publication in the winter of 2020.
Conclusions
Effectively delivering behavioral treatments in VR could overcome barriers to care and provide scalable solutions to chronic pain’s societal burden. Our study could help shape future research and development of these innovative approaches.
Trial Registration
ClinicalTrials.gov NCT04415177; https://clinicaltrials.gov/ct2/show/NCT04415177
International Registered Report Identifier (IRRID)
RR1-10.2196/25291
Keywords: chronic pain, virtual reality, behavioral medicine, behavioral health, pain treatment, randomized controlled trial
Introduction
Chronic pain is one of the most common reasons adults seek medical care [1]. Chronic pain affects between 50 and 116 million Americans, more than cancer, diabetes, and cardiovascular disease combined [1-4]. Other estimates suggest that 25 million American adults live with moderate to severe chronic pain (ie, pain scoring 4-7 on a visual analog scale and lasting over 3 months) that limits their activities and diminishes their quality of life [5,6]. Because of this great need, it is imperative to develop and test effective treatments for chronic pain.
Pain treatment and management often emphasize biomedical approaches, such as pharmacology or surgical procedures. Historically, opioids were commonly prescribed for pain treatment and management. These agents can yield both inconsistent and suboptimal results [7] and carry numerous personal and public health risks. The Centers for Disease Control and Prevention (CDC), the Centers for Medicare & Medicaid Services (CMS), and the Department of Health and Human Services recommended nonpharmacological modalities as first-line treatments for pain, including behavioral treatments [8,9]. Low-risk behavioral treatments may facilitate improved outcomes and analgesia while minimizing health risks.
Indeed, evidence-based behavioral treatments are effective for treating chronic pain. Therapies such as cognitive behavioral therapy for chronic pain, mindfulness-based stress reduction [10,11], and acceptance and commitment therapy [12] have been shown to modify cognitions and behaviors that influence the perception of pain. Although behavioral therapies show some promise, multiple barriers prevent chronic pain patients from accessing these behavioral treatment alternatives [13]. Strict reliance on skilled therapists that are in short supply, travel burdens, long durations of treatments, inadequate insurance coverage, and high costs can all contribute to a lack of treatment accessibility and patient engagement [14-16]. Furthermore, almost 85% of patients do not report meaningful analgesia from their pain medications (ie, they do not experience a long-term ≥50% reduction in their pain levels) [17]. Therefore, there is an urgent need for effective and comprehensive solutions for chronic pain and behavioral treatment delivery methods that are accessible to the entire spectrum of individuals affected by this concern.
Digital therapeutics for chronic pain are cost-effective, available on-demand, can be delivered in the home, and improve the risk–benefit profile well above the current standard of care. In particular, virtual reality (VR) therapeutics show promise as effective treatments for acute and chronic pain [18-24]. With the first pain reduction VR program, SnowWorld, patients with pediatric burn undergoing physical therapy noted a 27%-44% reduction in pain (P<.05) in comparison to within-subject control [25]. To date, VR has been used in numerous clinical settings to reduce pain and improve outcomes in complex regional pain syndrome [26], chronic headache/migraine pain [27], fibromyalgia [28,29], and chronic musculoskeletal pain [30]. Technology allows for an immersive, multisensory, and interactive virtual treatment experience. By stimulating the visual, auditory, and proprioception senses, VR facilitates distraction to limit the user’s processing of nociceptive stimuli, which has been shown in functional magnetic resonance imaging studies [31]. Most importantly, VR therapeutics have the potential to enhance pain education and effectively deliver evidence-based behavioral interventions.
A randomized clinical trial recently examined the effectiveness of a 21-day skills-based VR program for chronic pain compared to the same content delivered in audio form [32]. The VR skills-based program was superior in improving pain intensity and pain-related interference with activity, sleep, mood, and stress compared to the audio-based treatment, with results strengthening after 2 weeks. Results suggested that VR’s immersive components enhanced VR participants’ outcomes relative to those who completed an audio treatment [31]. Nevertheless, it is unclear to what extent these positive outcomes were due to the VR technology’s novelty and whether VR effects are durable. Therefore, this study seeks to conduct a randomized controlled trial to test the effectiveness of a comprehensive 56-day behavioral skills–based VR therapeutic program (skill-based VR) in chronic low back pain (cLBP). This study will elucidate the immediate and long-term effects of this proposed treatment while comparing it to a nontherapeutic control condition designed to account for this technology’s novelty.
We hypothesize that therapeutic VR will significantly benefit self-reported pain intensity and pain-related outcomes compared to our control condition throughout this 8-week treatment and follow-up period. This study will address the following 4 objectives:
The primary objective is to assess the impact of skills-based VR on changes in patient-reported pain and pain interference throughout an 8-week intervention and in comparison to a placebo VR condition.
The secondary objective is to assess the impact of skills-based VR on changes in patient-reported satisfaction (Patient’s Global Impression of Change [PGIC]) throughout an 8-week intervention and in comparison to a placebo VR condition.
The tertiary objective is to assess the impact of skills-based VR on changes in patient-reported opioid use, physical function, pain coping, and health outcomes immediately following the intervention relative to a preintervention baseline and in comparison to a placebo VR condition.
The exploratory objective is to assess the impact of skills-based VR on changes in patient-reported pain levels, opioid use, physical function, pain coping, health outcomes, and satisfaction for 6 months following intervention and in comparison to a placebo VR condition.
Methods
Overview
We will conduct a single-cohort, double-blinded (participant and analysts), cross-sectional, placebo-controlled randomized clinical trial in which 180 community-based individuals with cLBP will be randomly assigned to a 56-day skills-based VR therapeutic program (EaseVRx) and a 56-day control VR condition (Sham VR). Participants will be followed for 8.5 months after randomization. Participant eligibility will be assessed with an electronic screener survey. Once enrolled in the study, participants will complete a 2-week baseline assessment period, an 8-week VR program, a posttreatment assessment, and up to 4 posttreatment follow-ups over 6 months. During their 2-week baseline period, participants will be required to complete their baseline assessment and at least one of three pain surveys in order to progress to the treatment phase of the study in which they will receive a VR headset with their assigned treatment to be completed at home (Figure 1).
Team statisticians blinded to participant treatment assignment will examine outcomes immediately following treatment and after 1, 2, 3, and 6 months following treatment. The 6-month postintervention assessment is exploratory. Our primary outcome will be average pain intensity and pain interference on activity, sleep, mood, and stress. Our secondary outcomes include self-reported change in average pain intensity, physical function, sleep disturbance, pain catastrophizing, pain self-efficacy, pain acceptance, skills use, health utilization, medication use, and treatment usage and satisfaction.
The protocol for this trial has been approved by the Western Institutional Review Board. All participants will be required to give their informed consent during their online screening before enrollment in the study.
Study Sample, Setting, and Recruitment
Community-based individuals with cLBP will be recruited nationally through chronic pain organizations (eg, American Chronic Pain Association) and advertising on social media platforms such as Facebook and Twitter. Additionally, study advertisements will be emailed to professional contacts at several medical clinics with requests to forward among medical colleagues nationally. All advertisements will direct interested individuals to a landing page where detailed study information exists. Interested individuals will be directed to complete an online REDCap Cloud (nPhase, Inc.) screening form to assess their eligibility.
The online screening will automatically classify individuals as eligible or ineligible using survey logic based on our inclusion/exclusion criteria. Ineligible individuals will receive a message thanking them for their interest and participation in the screening process, inform them of their ineligibility, and be given a list of chronic pain resources. Eligible individuals will be redirected to an electronic consent form to provide their signature and complete enrollment.
Enrolled participants will progress to the study’s treatment phase if they complete a baseline survey and at least one of three pain surveys during the 2-week baseline period. Following the 2-week baseline period, participants will be randomized to a treatment group. The study will enroll 180 adults (age 18-85 years) with cLBP who meet study criteria (Textbox 1). This sample size accounts for expected attrition.
Inclusion and exclusion criteria. DVPRS: Defense and Veterans Pain Rating Scale; VR: virtual reality.
Inclusion criteria
Men and women aged 18-85.
Diagnosis of low back pain without radicular symptoms.
Pain duration of at least six months.
Average pain intensity of ≥4 on the 0-10 DVPRS Pain Scale for the past month at screening.
English fluency.
Willing to comply with study procedures/restrictions.
Access to Wi-Fi.
Exclusion criteria
Unable to understand the goals of the study due to cognitive difficulty.
Current or prior diagnosis of epilepsy, seizure disorder, dementia, migraines, or other neurological diseases that may prevent the use of VR.
Medical condition predisposing to nausea or dizziness.
Hypersensitivity to flashing light or motion.
No stereoscopic vision or severe hearing impairment.
Injury to eyes, face, or neck that prevents comfortable use of VR.
Cancer-related pain.
Moderate level of depressive symptoms (subclinical) as indicated by the Patient Health Questionnaire-2 (PHQ) [33,34] depression screen score of >2.
Previous use of EaseVRx for pain.
Current participation in any interventional research study or completed participation in the past 2 months.
Currently pregnant or planning to become pregnant during the study period.
Does not have access to Wi-Fi during participation in the study.
Currently works at or has an immediate family member who works for a digital health company or pharmaceutical company that provides treatments for acute or chronic pain.
Inclusion and Exclusion Criteria
Textbox 1 lists the inclusion and exclusion criteria. The reason that radicular symptoms were excluded was to create a degree of homogeneity within the population recruited. Chronic lower back pain with radicular symptoms is often treated differently from those that do have those symptoms. Additionally, we require that participants be willing and available to participate during the study (8.5 months). Participants were asked to complete biweekly surveys during the 56-day treatment to which they are assigned and complete the posttreatment follow-up assessments (1, 2, 3, and 6 months).
Randomization and Blinding
Enrolled participants will be randomized 1:1 and assigned to 1 of 2 treatment arms: a 56-day skills-based VR program (EaseVRx) and a 56-day control VR condition (Sham VR). Random assignment will rely on REDCap Cloud’s automatic program to ensure blinded randomization and equal numbers in both treatment arms. This will be a double-blinded study wherein participants and statisticians will be blinded to treatment. An independent research coordinator will label each group as Group A and Group B randomly before sending any data sets to the statistician. Three staff members (LG, IM, and BB) will be unblinded to the treatment groups and will not be involved in any data analyses.
Study Interventions
Participants in both the EaseVRx and Sham VR conditions will receive a Pico G2 4K headset with either EaseVRx or Sham VR condition. These devices will be mailed to the participant’s self-reported address. Study staff will monitor participant progress through twice-weekly surveys of device use and provide guided technical support. The following sections describe the components of the study interventions.
VR Headset and Software
This study will use a Pico G2 4K all in one head–mounted display that delivers VR images and sounds. We selected the Pico G2 4K because it is commercially available, widely used, inexpensive, has minimal visual latency, and is much easier for participants to use than many other devices. The user’s exhale, a major mechanic of the EaseVRx program, is measured by the microphone embedded in the Pico G2 hardware, offering biodata-enabled immersive therapeutics. This hardware allows for displaying 3D images (EaseVRx) and 2D images (Sham VR).
Skills-Based VR (EaseVRx)
Participants randomized and allocated to this treatment arm will receive a multimodal, skills-based, self-management VR program, called EaseVRx (AppliedVR), that incorporates evidence-based principles of cognitive behavioral therapy and mindfulness. Developed by AppliedVR in partnership with a pain psychology expert, the program provides pain neuroscience education and trains users on evidence-based pain and stress management strategies via immersive and enhanced biofeedback experiences. EaseVRx combines biopsychosocial pain education, diaphragmatic breathing training, relaxation exercises, and executive functioning games to provide a mind–body approach toward living better with chronic pain. The standardized 56-day program delivers a multifaceted combination of skills training through a prescribed sequence of daily virtual experiences. Each VR experience lasts between 2 and 16 minutes, with an average duration of 6 minutes of treatment time. The VR treatment modules were designed to minimize triggers of emotional distress or cybersickness. These modules include:
Interoceptive modules: biofeedback-like environments that shift in nature to reflect a progressively enhanced state of relaxation.
Education modules: visually guided lessons explain why the VR exercises are relevant to their pain and specific topics relevant to behavioral medicine for pain.
360 video modules: high-quality 360 videos with voiceovers, music, breathing effects, and sound effects that are designed to maximize relaxation and participant engagement.
Game modules: games are designed to maximize immersive distraction to decrease their perception of pain.
Dynamic breathing modules: interactive virtual worlds where the user experiences a gamified biofeedback session and is introduced to awareness of their breath via visualization. These modules become increasingly challenging to better train participants in the practice of diaphragmatic breathing.
Sham VR
VR-CORE guidelines suggest using an active control in VR clinical trials and promoting nonimmersive, 2D content within a VR headset as an optimal placebo [23]. Thus, participants in the Sham VR group will receive the same Pico G2 4K headset as participants in the immersive VR groups, but instead of 360-degree, 3D, interactive content specially selected for efficacy, they will only view 2D nature footage with neutral music layered on top that is selected to be neither overly relaxing nor distracting. The experience of Sham VR is similar to watching a large-screen TV. The content that is displayed in the VR sham will be viewed in a void theater. The void theater will consist of a solid black environment with the 2D content displayed on a “screen” in front of the user. The screen will take up a significant portion of the field of view of the participant, but appear to be distant enough to minimize any sense of immersion caused by viewing 3D content. The void theater screen will be fixed in place such that the user is capable of looking away from the screen if they so choose. The content for the VR sham will be 2D stock nature videos, all displayed in the void theater. The videos have been chosen to be more distracting than relaxing, and the majority of them contain animals engaging in play, grazing, grooming, or other inoffensive behaviors. There will be 20 videos that will be rotated over the 56 sessions, with a duration between 2.5 and 5 minutes, which corresponds directly with durations in the EaseVRx program. Figure 2 provides a visualization of the kinds of content each VR program would provide.
Technical Support
Participants will be provided with onboarding material as well as emails describing the study procedures and details. Instructional videos will be made available to participants, and access to remote technical support will be provided. VR usage data for both treatment groups will be surveyed twice a week for the intervention’s 8-week duration.
Survey data will be monitored for completion and technical support staff will be available. Participants will receive a telephone number and email address to contact support staff as needed. The technical support staff will also reach out if there is low adherence to the devices, lack of survey data, or low battery power detected on the headset’s remote monitoring dashboard. Twice weekly, the research staff will review the REDCap Cloud survey dashboard to assess if participants are completing the study. If a survey is missed, the REDCap Cloud system will send up to 2 reminders 24 hours apart. If the participant does not respond to the reminders, a research staff member will send an email or SMS text message to understand why there has been no response and encourage them to re-engage with the study. If the survey remains incomplete after 2 weeks of no data, the participant will be deemed lost to follow up. The participant could come back to the study at any time.
Study Measures
This section details the measurement and methods used to assess each variable. Table 1 outlines the categories, name, rank, and number of items for all measures. The time interval for collecting these measures is provided in Table 2.
Table 1.
Variable or Category | Measure | Number of items or units | |
Primary Outcome | |||
|
Pain intensity/Pain interference (activity, mood, sleep, stress) | DVPRS-Ia Pain Scale and DVPRS-II Pain Scale Measures [36] | 5 |
Secondary Outcomes | |||
|
Global impression of change | Patient’s Global Impression of Change (PGIC) [38] | 1 |
|
Physical function | PROMISb Physical Function [40] | 6 |
|
Sleep disturbance | PROMIS Sleep Disturbance [41] | 6 |
|
Acceptability | Custom Patient Satisfaction | 8 + 15 open-ended questions |
|
Adherence | Custom Device Utilization survey | 1 |
|
Adherence | VRc usage data | Seconds/week |
|
Pain self-efficacy | Pain Self-Efficacy Questionnaire (PSEQ) [51] (general) and Custom Pain Self-Efficacy Questionnaire with VR as a referent (inside the VR headset and outside the VR headset) | 2 in each |
|
Pain acceptance | Chronic Pain Acceptance Questionnaire (CPAQ) [52] | 8 |
|
Pain catastrophizing | Pain Catastrophizing Scale (PCSd) [49] | 4 |
|
Pain medication | Custom Analgesic Medication Use Survey | 3 with branching logic to additional 7 |
|
Health care utilization | Custom health care utilization survey for cLBPe | 5 at baseline and 6 at all other timepoints |
|
Other measures |
|
|
|
Assessment of affect | Positive and Negative Affect Schedule (PANAS) [55] | 20 |
|
Susceptibility to virtual reality treatment | Involvement subscale from the Immersive Tendency Questionnaire (ITQ – Involvement subscale) [54] | 7 |
|
Acceptability | System Usability Scale (SUS) [53] | 10 |
|
Perceived treatment assignment | Perceived Treatment Assignment survey | 1 |
aDVPRS: Defense and Veterans Pain Rating Scale.
bPROMIS: Physical Function and Sleep Disturbance.
cVR: virtual reality.
dThe 4 questions were selected from the PCS to decrease participant burden.
ecLBP: chronic lower back pain.
Table 2.
Measure | Pre-treatment (days –14 to 0) | Active treatment (days 1-56) | Postintervention (months 1-6 after the end of the study) | |||||
|
Baseline assessment (Day –14) | Pain surveys (Days –10, –7, –4, and 0) |
Biweekly surveys | End of treatment (day 56) | Follow up 1 month | Follow up 2 months | Follow up 3 months | Follow up 6 months |
DVPRS-Ia and DVPRS-II | X | X | X | X | X | X | X | X |
PGICb |
|
|
|
X | X | X | X | X |
PROMISc physical function | X |
|
|
X | X | X | X | X |
PROMIS sleep disturbance | X |
|
|
X | X | X | X | X |
Pain self-efficacy measures | X |
|
|
X | X | X | X | X |
PCSd | X |
|
|
X | X | X | X | X |
CPAQ-8e | X |
|
|
X | X | X | X | X |
Opioid use | X |
|
|
X | X | X | X | X |
Health care utilization | X |
|
|
X |
|
|
|
|
Patient satisfaction |
|
|
|
|
X | X | X | X |
Device utilization |
|
|
X | X |
|
|
|
|
VRf usage data |
|
|
X | X |
|
|
|
|
PANASg | X |
|
|
X |
|
|
|
|
SUSh |
|
|
|
X |
|
|
|
|
ITQi—involvement subscale | X |
|
|
|
|
|
|
|
Perceived treatment assignment |
|
|
|
|
|
|
|
X |
aDVPRS: Defense and Veterans Pain Rating Scale.
bPGIC: Patient’s Global Impression of Change.
cPROMIS: Physical Function and Sleep Disturbance.
dPCS: Pain Catastrophizing Scale.
eCPAQ-8: Chronic Pain Acceptance Questionnaire.
fVR: virtual reality.
gPANAS: Positive and Negative Affect Schedule.
hSUS: System Usability Scale.
iITQ: Immersive Tendencies Questionnaire.
Demographics
Demographic variables will include age, gender, level of education, race, ethnicity, employment status, annual household income, relationship status, duration of back pain (years since onset), state of residence, and zip code. In order to perform geospatial coding, rural–urban commuting area codes will be downloaded from a public data set provided by the United States Department of Agriculture Economic Research Service. Using MS Excel, participant zip codes will be matched to the rural–urban commuting area data set to classify participants living in rural or urban areas.
Average Pain Intensity
The Defense and Veterans Pain Rating Scale (DVPRS) [35] will be used to measure average pain intensity over the previous 24 hours using an 11-point numeric rating scale (0=no pain; 10=as bad as it could be; nothing else matters).
Pain Interference With Activity, Mood, Sleep, and Stress
The DVPRS interference scale (DVPRS-II) will be used to measure pain interference with activity, sleep, mood, and stress over the past 24 hours [36] (0=does not interfere; 10=completely interferes).
Patient Global Impression of Change
Aligning with IMMPACT (Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials) recommendations for pain research [37,38], Patient Global Impression of Change will be assessed using the question, “Since the beginning of VR treatment, how would you describe the changes (if any) in activity limitations, symptoms, emotions and overall quality of life-related to your low back pain?” on a 7-point scale ranging from 1 (No change or condition is worse) to 7 (A great deal better, and a considerable improvement that has made all the difference).
Physical Function and Sleep Disturbance (PROMIS)
The NIH Physical Function and Sleep Disturbance (PROMIS) [39] short-form measures will be used to assess physical function (version 6b [40]) and sleep disturbance (version 6a [41]) over the past 7 days. Higher scores on physical function signify greater function, whereas higher scores for sleep disturbance reflect greater symptom severity. The conversion table within the scoring manuals, made available from the Person-Centered Assessment Resource [39,42], will be used to calculate the individual short-form T scores using the Item Response Theory scoring algorithms. Specifically, based on published item parameters, T scores (latent trait estimates) will be computed for each individual’s response pattern using the Bayesian expected a posteriori method [43-45]. This has been widely applied within pain research [35-37,39-41,43-48].
Pain Catastrophizing
The 13-item Pain Catastrophizing Scale (PCS) [49] is a validated instrument widely used clinically and in pain research to assess patterns of negative cognition and emotion in the context of actual or anticipated pain. Despite having discrete subscales for rumination, magnification, and feelings of helplessness related to pain, prior work has shown that the PCS operates unidimensionally [50] and Cook et al (unpublished). Aligning with prior work [32] and the goal of brevity, the following 4 PCS items will be used: “It’s terrible and I think it’s never going to get any better,” “I become afraid that the pain will get worse,” “I can’t seem to keep it out of my mind,” and “I keep thinking about how badly I want the pain to stop.” Respondents rate the frequency with which they experience such thoughts on a scale from 0 (Not at all) to 4 (All the time). The 4 numerical ratings will be summed to create a total score and index for pain catastrophizing.
Pain Self-Efficacy
Pain Self-Efficacy was assessed in 2 ways. First, the 2-item Pain Self-Efficacy Questionnaire (PSEQ-2) will be administered as a validated instrument used to assess respondents’ confidence in their ability to engage in various daily activities despite their chronic pain [51]. The PSEQ-2 consists of the following 2 items: “I can still accomplish most of my goals in life, despite the pain”, and “I can live a normal lifestyle, despite the pain.” Respondents will use a 7-point scale to rate their response from 0 (Not at all confident) to 4 (Completely confident). Scores for the 2 items are summed to create a total score. Second, participants will be asked to rate their overall confidence in their ability to manage their pain on a 10-point scale with 1 (Not at all Confident) to 10 (Very Confident). Following the intervention, this section will be divided into 2 items measuring their overall confidence levels while inside of VR and outside of VR.
Chronic Pain Acceptance
The Chronic Pain Acceptance Questionnaire (CPAQ-8) short form is an 8-item validated instrument that assesses one’s engagement in personally meaningful activities despite pain, as well as efforts directed at controlling pain (example item: “I am getting on with the business of living no matter what my level of pain is”) [52]. Respondents rate each item using a 6-point scale ranging from 0 (never true) to 5 (always true).
Device Utilization
The custom device utilization survey is a single-item instrument that assesses the number of VR sessions completed since the last time it was asked. Respondents select either (1) 0, (2) 1, (3) 2, (4) 3, or (5) 4 or more. This survey is administered on a biweekly basis.
System Usability Scale
The System Usability Scale is a validated, 10-item attitude Likert scale giving a global view of subjective assessments of usability (example item: “I thought the system was easy to use.”) [53]. Participants rate each item using a 5-point response scale ranging from "Strongly Disagree" to "Strongly Agree." Some items are reverse scored, a multiplier is applied to the sum total, and total SUS scores range from 0-100.
Immersive Tendencies Questionnaire
The Immersive Tendencies Questionnaire (ITQ) is a 29-item survey that measures difference in tendencies of individuals to experience presence [54]. The involvement subscale was chosen by the coauthors to reduce participant burden with just 7 items that focus on propensity to be engaged with content such as reading a book or watching a movie.
Assessment of Affect
The Positive and Negative Affect Schedule (PANAS) is a validated 20-item survey to assess the affect of each participant [55]. They will be asked to the extent they have felt specific emotions on a Likert scale from 1 “Very Slightly or Not at All” to 5 “Extremely.”
Prescription Opioid and Analgesic Medication Use
A custom survey was also created to assess analgesic medication use. The medication survey consists of 3 main questions to assess for the use of the following: prescription medication, over-the-counter medication, or other medications. Prescription opioid data will be converted to a standardized morphine milligram equivalent daily dose using the Centers for Medicare & Medicaid Services “Opioid Oral Morphine Milligram Equivalent (MME) Conversion Table” [56]. Endorsement of prescription medications will prompt additional items to collect the type of medication, frequency of use, dose, happiness with one’s current prescribed medication regimen, and interest in changing one’s current prescribed medication regimen.
Health Care Utilization
We will also assess cLBP health care utilization in terms of frequency of steroid injections, lower back surgery, emergency department visits, hospital admissions, and unplanned physician visits over various periods.
Additional Custom Surveys
Several custom surveys were developed for the study, including one designed to assess satisfaction with each condition. Another assesses device usability, enjoyment or difficulties, and the likelihood to continue treatment. Additional items will assess pain knowledge and pain management skills use (eg, use of relaxation and controlled breathing during the previous 7 days). We will also assess patient perception of the study arm using a single item administered to both groups in the 6-month follow-up survey.
Data Collection, Quality Control, and Confidentiality
All questionnaires will be completed by participants electronically via the REDCap Cloud platform. We will collect information at every stage of recruitment, randomization, and treatment in accordance with the CONSORT (Consolidated Standards of Reporting Trials) guidelines [57]. The Western Institutional Review Board approved this study. Given the safety of the device seen in past studies [7,31], Western Institutional Review Board did not deem that this study would require Data Safety and Monitoring Board oversight.
Compensation
Participants will receive a total of US $150 (US $6 per completed survey) for their participation in the entire study. Two payments will be processed. The first payment will be distributed at the end of the 8-week program (US $126 possible; prorated) and upon return of their VR headset (prepaid shipping will be provided). The second payment will be distributed after the last follow-up survey (US $24 possible; prorated). All payments will be in the form of an Amazon eGift Card.
In addition to their monetary compensation, all participants will be eligible to receive a gift VR headset 6 months after their completion of treatment if they complete 16 or more of the 21 surveys administered during the active treatment phase, confirm their interest in receiving a VR headset, and return their VR treatment study headset.
Safety Monitoring
Participants were provided with contact information and encouraged to contact as needed. Safety will be monitored by following up with participants for any adverse events they communicate to the support staff. Additionally, adverse experiences with using VR will be assessed using the question, “Did you experience any motion sickness or nausea while using VR?” on 4-point with 0 (Never), 1 (Sometimes), 2 (Often), and 3 (Always). Similar to prior work, VR side effects will be assessed at the end of treatment [32].
Sample Size Determination
In terms of sample size considerations, a power analysis was performed using data from a recent at-home cLBP study that we conducted. DVPRS pain intensity scores were collected from 39 individuals at baseline, during, and immediately following a 21-day, skills-based VR intervention, and from 35 individuals at baseline, during, and immediately following an audio-only version of the 21-day program. The average difference score was 1.48 for the VR group and was 0.756 for the audio-only group (on an 11-point scale). Assuming an α level of .05 and 90% power, we would need 45 participants per group to observe a treatment × time interaction. In case of high attrition (40%), we will randomize at least 75 participants per group and if possible up to 90 participants per group.
Statistical Analyses
General Approach
Checks of assumptions underlying statistical procedures will be performed and all corrective procedures will be applied as necessary. All analyses will involve 2-sided hypothesis tests, with α=.05 and adjusted for any multiple comparisons within the family of tests as appropriate.
Group equivalence will be assessed through univariate tests of association between treatment groups (EaseVRx/Sham VR) for all baseline demographic and clinical variables with chi-square and Kruskal–Wallis tests applied as appropriate. If statistically significant differences between groups are found for any variables (P<.05), those will be controlled for in the mixed models.
The data will be analyzed in a mixed-model framework (PROC GLIMMIX in SAS) with 3 explanatory factors: treatment group, time, and time × treatment group. Treatment group, EaseVRx versus Sham VR, will be specified as a between-subjects factor. Time will be specified as a within-subjects factor. The effect of interest will be the time × treatment group effect which tests whether the treatment group influenced the trajectory of the key variables over time.
The analytic method used will not involve imputing missing data for estimating the significance of the effects specified in the model. However, the predicted values from the estimated model will be used for reporting the findings. Given the safety of this treatment, there is no plan to conduct interim analyses.
Primary Analyses
The primary endpoint will be the time course of DVPRS-I Pain scale rating at baseline (defined as the average of 3 DVPRS-I Pain Scale ratings obtained during the 2 weeks before enrollment/randomization), at 8 weekly time points (twice per week) across the 8-week intervention, and immediately following the intervention. We will use a linear mixed model as described above.
Secondary Analyses
Several analyses will be proposed.
First, we will compare the PGIC scale at end of treatment and follow-ups.
Second, we will repeat similar analyses as above for 2 time points, baseline and immediately following the 8-week intervention for opioid drug use, PROMIS physical function, PROMIS sleep disturbance, PSEQ-2, PCS, and CPAQ-8.
Finally, we will repeat similar analyses as above for 2 time points, the day immediately following the 8-week intervention and 1 month after the intervention for DVPRS Pain Rating, opioid drug use, PROMIS physical function, PROMIS sleep disturbance, PSEQ-2, PCS, and CPAQ-8.
Exploratory Analyses
A number of exploratory analyses will be conducted, all of which envisage the above linear mixed modeling strategy with time points and variables as specified below.
First, we will assess Intervention × Time effects for a number of health-related outcome metrics (eg, number of steroid injections, emergency department visits, hospital admissions) at 2 time points, Day 9 and immediately following the 8-week intervention.
Second, we will repeat the above analyses for the period comprising the end of the 8-week intervention and at 3 and 6 months after the intervention.
Third, we will assess Intervention × Time effects for DVPRS Pain Rating, opioid drug use, PROMIS physical function, PROMIS sleep disturbance, PSEQ-2, PCS, CPAQ-8, Patient satisfaction, and PANAS for the periods comprising the 8-week intervention and at 1, 2, 3, and 6 months after the intervention. We will use a 2-factor ANOVA with intervention (EaseVRx vs Sham VR) as an independent groups factor and time as a dependent groups factor. Two-sided post hoc t-tests (adjusted for multiple comparisons) will be utilized to isolate the locus of any effects.
Fourth, we will examine the time course of changes in pain skills (eg, controlled breathing, meditation) from baseline, at the end of the 8-week intervention, and at 1, 2, 3, and 6 months after the intervention only in the EaseVRx group. We will use a one-factor repeated-measures ANOVA. Two-sided post hoc t-tests (adjusted for multiple comparisons) will be utilized to isolate the locus of any effects. When appropriate, we will also utilize more robust statistical approaches that better address missing data and do not assume distributional normality, such as bootstrapping.
In subsequent manuscripts, we will explore potential covariants of treatment response and possible mechanisms of actions.
Results
The study was approved by the Western Institutional Review Board on July 2, 2020. The protocol (NCT04415177) was registered on May 27, 2020. Recruitment for this study was completed in July 2020 and data collection will remain active until March 2021. In total, 186 participants were recruited. Multiple manuscripts will be generated from this study. The primary manuscript will be submitted for publication in the winter of 2020.
Discussion
Protocol Overview
VR for chronic pain is an emerging area of behavioral medicine and science with heightened relevancy during the COVID-19 pandemic. Many people are environmentally isolated and in need of effective home-based pain care. This study protocol builds upon research that previously demonstrated that a 21-day behavioral medicine skills VR program effectively reduced chronic pain intensity and pain-related interference in activity, mood, sleep, and stress at the end of treatment. This study protocol addresses several unknowns that remain in the scientific literature for VR for chronic pain. First, the study will test a VR program of longer duration (56 days) and better aligns with the duration of current “gold-standard” behavioral medicine for chronic pain, typically over 8 weeks of treatment time. Second, the study will test treatment effects captured at the end of treatment and the durability of treatment effects measured at several distal posttreatment time points (months 1, 2, 3, 6). Third, the study will include a Sham VR, which will provide a visual treatment (2D nature scenes) that will control for the novelty of a headset device and visual stimuli while omitting active behavioral medicine skills training. The inclusion of the Sham VR group will also allow for exploration of the mechanisms of therapeutic VR. Fourth, a broad range of relevant metrics have been included to characterize the psychological response to VR and aid in the conduct of responder analyses and identification of subgroups; results could inform the development of future tailored immersive therapeutics or study designs. Fifth, all study headsets will capture participant use data, thereby allowing for the quantification of participant engagement and calculation of treatment dose thresholds associated with treatment effects. Sixth, the study will capture analgesic medication use and data on health care utilization specific to back pain; these data will allow for the conduct of exploratory analyses examining the impact of VR on these factors for the subset of participants using these treatments. Seventh, the study will occur within the context of the COVID-19 pandemic and will inform self-administration of home-based VR and engagement during COVID-19 specifically.
The study design’s strength is that it will be conducted remotely and untethered from the medical system. This design will increase the ecological validity of data derived from a home-based, national, pragmatic sample of people with cLBP who will self-treat in their home environment. Additional aspects of methodological rigor include participant blinding and randomization to the treatment group.
Limitations
The key limitations of this study protocol include the following. First, all data will be either self-reported by the study participant or collected by the device (eg, use data for frequency and duration). Because the study is pragmatic and will include a national sample, we will not verify medical diagnoses or prescribed pain medication types and doses. Second, the study is specific to cLBP and findings may not generalize to other pain conditions. However, we note that people with cLBP often report having 2 or more comorbid pain conditions (Darnall et al, unpublished). As such, chronic back pain is not often experienced in isolation.
Digital behavioral health treatment studies typically report relatively low treatment engagement rates among participants with rates ranging between 20% and 60% [32,58-60]. While prior research evidenced good engagement for therapeutic VR for chronic pain, engagement rates for a 2D Sham VR are unknown and we may risk disparate engagement rates between the 2 treatment groups. While the study team has endeavored to minimize such discrepancy by enhancing the Sham VR’s face validity, we anticipate some treatment group discrepancy would naturally occur if one treatment is experienced broadly as less rewarding or effective.
Our plan to enroll a national sample over the internet lends a mix of strengths and limitations. Participants recruited via the internet are likely to be more technologically savvy than the general population seeking medical care from a health care system. It could be argued that our study results may not generalize to people who are less likely to engage with the internet and technology. However, we also note that treatment studies that are conducted within traditional medical settings typically involve more in-person contacts and enhanced placebo effects (ie, halo effect) that would be likely to yield more positive treatment expectations and outcomes. We underscore that our study design will not benefit from medical setting placebo effects.
Finally, aligning with prior work, data on adverse effects will be collected at the end of the study. We acknowledge that these methods introduce the potential for recall bias. However, previous study participants reported easily recalling adverse experiences at the end of the study due to their specificity and salience (eg, cybersickness) [32].
Conclusions
This study will be one of the most rigorous in assessing the impact of self-administered VR therapy in community-based individuals with chronic lower back pain and the first to use a placebo VR therapy program. Its remote design will allow it to be completed during a global pandemic in a pragmatic and nationally representative sample. This will also be the first study to assess VR therapy’s durability for chronic pain over a 6-month posttreatment follow-up period. Results from this study will provide critical data on how individuals with chronic lower back pain may use self-administered VR therapy at home for symptom management and functional improvement.
Acknowledgments
This study was supported financially by AppliedVR, Inc.
Abbreviations
- CDC
Centers for Disease Control and Prevention
- cLBP
chronic lower back pain
- CMS
Centers for Medicare & Medicaid Services
- CPAQ
Chronic Pain Acceptance Questionnaire
- DVPRS
Defense and Veterans Pain Rating Scale
- ITQ
Immersive Tendencies Questionnaire
- MME
morphine milligram equivalent
- PANAS
Positive and Negative Affect Schedule
- PCS
Pain Catastrophizing Scale
- PGIC
Patient’s Global Impression of Change
- PHQ
Patient Health Questionnaire
- PROMIS
Physical Function and Sleep Disturbance
- PSEQ
Pain Self-Efficacy Questionnaire
- SUS
System Usability Scale
Footnotes
Conflicts of Interest: LG, TM, and IM are employees of AppliedVR, Inc. JS is the President of AppliedVR, Inc. BD is chief science advisor for AppliedVR. BB and PK are consultants to AppliedVR, Inc. RL has an advisory role with Applied VR, Inc.
References
- 1.Dahlhamer J, Lucas J, Zelaya C, Nahin R, Mackey S, DeBar L, Kerns R, Von Korff M, Porter L, Helmick C. Prevalence of Chronic Pain and High-Impact Chronic Pain Among Adults - United States, 2016. MMWR Morb Mortal Wkly Rep. 2018 Sep 14;67(36):1001–1006. doi: 10.15585/mmwr.mm6736a2. doi: 10.15585/mmwr.mm6736a2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Nahin RL. Estimates of pain prevalence and severity in adults: United States, 2012. J Pain. 2015 Aug;16(8):769–80. doi: 10.1016/j.jpain.2015.05.002. http://europepmc.org/abstract/MED/26028573. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Global Opioid Drugs Market: Share, Size, Trends and Analysis Report. [2020-09-29]. https://www.bccresearch.com/market-research/pharmaceuticals/opioid-drugs-global-markets.html.
- 4.Simon LS. Relieving pain in America: a blueprint for transforming prevention, care, education, and research. Journal of Pain & Palliative Care Pharmacotherapy. 2012 Jul 05;26(2):197–198. doi: 10.3109/15360288.2012.678473. [DOI] [Google Scholar]
- 5.Reuben DB, Alvanzo AA, Ashikaga T, Bogat GA, Callahan CM, Ruffing V, Steffens DC. National Institutes of Health Pathways to Prevention Workshop: The Role of Opioids in the Treatment of Chronic Pain. Ann Intern Med. 2015 Feb 17;162(4):295. doi: 10.7326/m14-2775. [DOI] [PubMed] [Google Scholar]
- 6.O'Brien EM, Staud RM, Hassinger AD, McCulloch RC, Craggs JG, Atchison JW, Price DD, Robinson ME. Patient-centered perspective on treatment outcomes in chronic pain. Pain Med. 2010 Jan 01;11(1):6–15. doi: 10.1111/j.1526-4637.2009.00685.x. [DOI] [PubMed] [Google Scholar]
- 7.Spiegel B, Fuller G, Lopez M, Dupuy T, Noah B, Howard A, Albert M, Tashjian V, Lam R, Ahn J, Dailey F, Rosen BT, Vrahas M, Little M, Garlich J, Dzubur E, IsHak W, Danovitch I. Virtual reality for management of pain in hospitalized patients: A randomized comparative effectiveness trial. PLoS One. 2019 Aug 14;14(8):e0219115. doi: 10.1371/journal.pone.0219115. https://dx.plos.org/10.1371/journal.pone.0219115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Dowell D, Haegerich TM, Chou R. CDC Guideline for Prescribing Opioids for Chronic Pain--United States, 2016. JAMA. 2016 Apr 19;315(15):1624–45. doi: 10.1001/jama.2016.1464. http://europepmc.org/abstract/MED/26977696. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.CMCS Informational Bulletin: Medicaid Strategies for Non-Opioid Pharmacologic and Non-Pharmacologic Chronic Pain Management. 2019. [2020-12-26]. https://www.opioidlibrary.org/document/cmcs-informational-bulletin-medicaid-strategies-for-non-opioid-pharmacologic-and-non-pharmacologic-chronic-pain-management/
- 10.Turner JA, Anderson ML, Balderson BH, Cook AJ, Sherman KJ, Cherkin DC. Mindfulness-based stress reduction and cognitive behavioral therapy for chronic low back pain: similar effects on mindfulness, catastrophizing, self-efficacy, and acceptance in a randomized controlled trial. Pain. 2016 Nov;157(11):2434–2444. doi: 10.1097/j.pain.0000000000000635. http://europepmc.org/abstract/MED/27257859. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Cherkin DC, Sherman KJ, Balderson BH, Cook AJ, Anderson ML, Hawkes RJ, Hansen KE, Turner JA. Effect of Mindfulness-Based Stress Reduction vs Cognitive Behavioral Therapy or Usual Care on Back Pain and Functional Limitations in Adults With Chronic Low Back Pain: A Randomized Clinical Trial. JAMA. 2016 Mar 22;315(12):1240–9. doi: 10.1001/jama.2016.2323. http://europepmc.org/abstract/MED/27002445. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Hughes LS, Clark J, Colclough JA, Dale E, McMillan D. Acceptance and Commitment Therapy (ACT) for Chronic Pain. The Clinical Journal of Pain. 2017;33(6):552–568. doi: 10.1097/ajp.0000000000000425. [DOI] [PubMed] [Google Scholar]
- 13.Darnall BD, Scheman J, Davin S, Burns JW, Murphy JL, Wilson AC, Kerns RD, Mackey SC. Pain Psychology: A Global Needs Assessment and National Call to Action. Pain Med. 2016 Feb 23;17(2):250–63. doi: 10.1093/pm/pnv095. http://europepmc.org/abstract/MED/26803844. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Bair MJ, Matthias MS, Nyland KA, Huffman MA, Stubbs DL, Kroenke K, Damush TM. Barriers and facilitators to chronic pain self-management: a qualitative study of primary care patients with comorbid musculoskeletal pain and depression. Pain Med. 2009 Oct 01;10(7):1280–90. doi: 10.1111/j.1526-4637.2009.00707.x. http://europepmc.org/abstract/MED/19818038. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Austrian J, Kerns R, Reid MC. Perceived barriers to trying self-management approaches for chronic pain in older persons. J Am Geriatr Soc. 2005 May;53(5):856–61. doi: 10.1111/j.1532-5415.2005.53268.x. [DOI] [PubMed] [Google Scholar]
- 16.Becker WC, Dorflinger L, Edmond SN, Islam L, Heapy AA, Fraenkel L. Barriers and facilitators to use of non-pharmacological treatments in chronic pain. BMC Fam Pract. 2017 Mar 20;18(1):41. doi: 10.1186/s12875-017-0608-2. https://bmcfampract.biomedcentral.com/articles/10.1186/s12875-017-0608-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Moore RA, Derry S, Simon LS, Emery P. Nonsteroidal anti-inflammatory drugs, gastroprotection, and benefit-risk. Pain Pract. 2014 Apr 14;14(4):378–95. doi: 10.1111/papr.12100. doi: 10.1111/papr.12100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Gold J, Mahrer N. Is Virtual Reality Ready for Prime Time in the Medical Space? A Randomized Control Trial of Pediatric Virtual Reality for Acute Procedural Pain Management. J Pediatr Psychol. 2018 Apr 01;43(3):266–275. doi: 10.1093/jpepsy/jsx129. [DOI] [PubMed] [Google Scholar]
- 19.Haisley KR, Straw OJ, Müller DT, Antiporda MA, Zihni AM, Reavis KM, Bradley DD, Dunst CM. Feasibility of implementing a virtual reality program as an adjuvant tool for peri-operative pain control; Results of a randomized controlled trial in minimally invasive foregut surgery. Complement Ther Med. 2020 Mar;49:102356. doi: 10.1016/j.ctim.2020.102356. [DOI] [PubMed] [Google Scholar]
- 20.Koç Özkan T, Polat F. The Effect of Virtual Reality and Kaleidoscope on Pain and Anxiety Levels During Venipuncture in Children. J Perianesth Nurs. 2020 Apr;35(2):206–211. doi: 10.1016/j.jopan.2019.08.010. [DOI] [PubMed] [Google Scholar]
- 21.Hoffman HG, Chambers GT, Meyer WJ, Arceneaux LL, Russell WJ, Seibel EJ, Richards TL, Sharar SR, Patterson DR. Virtual reality as an adjunctive non-pharmacologic analgesic for acute burn pain during medical procedures. Ann Behav Med. 2011 Apr 25;41(2):183–91. doi: 10.1007/s12160-010-9248-7. http://europepmc.org/abstract/MED/21264690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Khadra C, Ballard A, Déry J, Paquin D, Fortin J, Perreault I, Labbe D, Hoffman HG, Bouchard S, LeMay S. Projector-based virtual reality dome environment for procedural pain and anxiety in young children with burn injuries: a pilot study. JPR. 2018 Feb;11:343–353. doi: 10.2147/jpr.s151084. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Birckhead B, Khalil C, Liu X, Conovitz S, Rizzo A, Danovitch I, Bullock K, Spiegel B. Recommendations for Methodology of Virtual Reality Clinical Trials in Health Care by an International Working Group: Iterative Study. JMIR Ment Health. 2019 Jan 31;6(1):e11973. doi: 10.2196/11973. https://mental.jmir.org/2019/1/e11973/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Dascal J, Reid M, IsHak W, Spiegel B, Recacho J, Rosen B, Danovitch I. Virtual Reality and Medical Inpatients: A Systematic Review of Randomized, Controlled Trials. Innov Clin Neurosci. 2017;14(1-2):14–21. http://europepmc.org/abstract/MED/28386517. [PMC free article] [PubMed] [Google Scholar]
- 25.Schmitt YS, Hoffman HG, Blough DK, Patterson DR, Jensen MP, Soltani M, Carrougher GJ, Nakamura D, Sharar SR. A randomized, controlled trial of immersive virtual reality analgesia, during physical therapy for pediatric burns. Burns. 2011 Feb;37(1):61–8. doi: 10.1016/j.burns.2010.07.007. http://europepmc.org/abstract/MED/20692769. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Sato K, Fukumori S, Matsusaki T, Maruo T, Ishikawa S, Nishie H, Takata K, Mizuhara H, Mizobuchi S, Nakatsuka H, Matsumi M, Gofuku A, Yokoyama M, Morita K. Nonimmersive virtual reality mirror visual feedback therapy and its application for the treatment of complex regional pain syndrome: an open-label pilot study. Pain Med. 2010 Apr;11(4):622–9. doi: 10.1111/j.1526-4637.2010.00819.x. [DOI] [PubMed] [Google Scholar]
- 27.Shiri S, Feintuch U, Weiss N, Pustilnik A, Geffen T, Kay B, Meiner Z, Berger I. A virtual reality system combined with biofeedback for treating pediatric chronic headache—a pilot study. Pain Med. 2013 May;14(5):621–7. doi: 10.1111/pme.12083. [DOI] [PubMed] [Google Scholar]
- 28.Garcia-Palacios A, Herrero R, Vizcaíno Y, Belmonte MA, Castilla D, Molinari G, Baños RM, Botella C. Integrating virtual reality with activity management for the treatment of fibromyalgia: acceptability and preliminary efficacy. Clin J Pain. 2015 Jun;31(6):564–72. doi: 10.1097/AJP.0000000000000196. [DOI] [PubMed] [Google Scholar]
- 29.Botella C, Garcia-Palacios A, Vizcaíno Y, Herrero R, Baños RM, Belmonte MA. Virtual reality in the treatment of fibromyalgia: a pilot study. Cyberpsychol Behav Soc Netw. 2013 Mar;16(3):215–23. doi: 10.1089/cyber.2012.1572. [DOI] [PubMed] [Google Scholar]
- 30.Wiederhold BK, Gao K, Sulea C, Wiederhold MD. Virtual reality as a distraction technique in chronic pain patients. Cyberpsychol Behav Soc Netw. 2014 Jun;17(6):346–52. doi: 10.1089/cyber.2014.0207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Hoffman HG, Richards TL, Coda B, Bills AR, Blough D, Richards AL, Sharar SR. Modulation of thermal pain-related brain activity with virtual reality: evidence from fMRI. Neuroreport. 2004 Jun 07;15(8):1245–8. doi: 10.1097/01.wnr.0000127826.73576.91. [DOI] [PubMed] [Google Scholar]
- 32.Darnall BD, Krishnamurthy P, Tsuei J, Minor JD. Self-Administered Skills-Based Virtual Reality Intervention for Chronic Pain: Randomized Controlled Pilot Study. JMIR Form Res. 2020 Jul 07;4(7):e17293. doi: 10.2196/17293. https://formative.jmir.org/2020/7/e17293/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Kroenke K, Spitzer RL, Williams JBW. The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care. 2003 Nov;41(11):1284–92. doi: 10.1097/01.MLR.0000093487.78664.3C. [DOI] [PubMed] [Google Scholar]
- 34.Löwe B, Kroenke K, Gräfe K. Detecting and monitoring depression with a two-item questionnaire (PHQ-2) J Psychosom Res. 2005 Feb;58(2):163–71. doi: 10.1016/j.jpsychores.2004.09.006. [DOI] [PubMed] [Google Scholar]
- 35.Nassif TH, Hull A, Holliday SB, Sullivan P, Sandbrink F. Concurrent Validity of the Defense and Veterans Pain Rating Scale in VA Outpatients. Pain Med. 2015 Nov 01;16(11):2152–61. doi: 10.1111/pme.12866. [DOI] [PubMed] [Google Scholar]
- 36.Buckenmaier CC, Galloway KT, Polomano RC, McDuffie M, Kwon N, Gallagher RM. Preliminary validation of the Defense and Veterans Pain Rating Scale (DVPRS) in a military population. Pain Med. 2013 Jan 01;14(1):110–23. doi: 10.1111/j.1526-4637.2012.01516.x. [DOI] [PubMed] [Google Scholar]
- 37.Dworkin R, Turk D, Wyrwich K, Beaton D, Cleeland C, Farrar J, Haythornthwaite JA, Jensen MP, Kerns RD, Ader DN, Brandenburg N, Burke LB, Cella D, Chandler J, Cowan P-A, Dimitrova R, Dionne R, Hertz S, Jadad AR, Katz NP, Kehlet H, Kramer LD, Manning DC, McCormick C, McDermott MP, McQuay HJ, Patel S, Porter L, Quessy S, Rappaport BA, Rauschkolb C, Revicki DA, Rothman M, Schmader KE, Stacey BR, Stauffer JW, von Stein T, White RE, Witter J, Zavisic S. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. J Pain. 2008 Feb;9(2):105–21. doi: 10.1016/j.jpain.2007.09.005. [DOI] [PubMed] [Google Scholar]
- 38.Ferguson L, Scheman J. Patient global impression of change scores within the context of a chronic pain rehabilitation program. The Journal of Pain. 2009 Apr;10(4):S73. doi: 10.1016/j.jpain.2009.01.258. [DOI] [Google Scholar]
- 39.Amtmann D, Cook KF, Johnson KL, Cella D. The PROMIS initiative: involvement of rehabilitation stakeholders in development and examples of applications in rehabilitation research. Arch Phys Med Rehabil. 2011 Oct;92(10 Suppl):S12–9. doi: 10.1016/j.apmr.2011.04.025. http://europepmc.org/abstract/MED/21958918. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Fries JF, Krishnan E, Rose M, Lingala B, Bruce B. Improved responsiveness and reduced sample size requirements of PROMIS physical function scales with item response theory. Arthritis Res Ther. 2011;13(5):R147. doi: 10.1186/ar3461. https://arthritis-research.biomedcentral.com/articles/10.1186/ar3461. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Yu L, Buysse DJ, Germain A, Moul DE, Stover A, Dodds NE, Johnston KL, Pilkonis PA. Development of short forms from the PROMIS™ sleep disturbance and Sleep-Related Impairment item banks. Behav Sleep Med. 2011 Dec 28;10(1):6–24. doi: 10.1080/15402002.2012.636266. http://europepmc.org/abstract/MED/22250775. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.The Assessment Center. [2021-01-04]. https://www.assessmentcenter.net/
- 43.Varni JW, Magnus B, Stucky BD, Liu Y, Quinn H, Thissen D, Gross HE, Huang I, DeWalt DA. Psychometric properties of the PROMIS ® pediatric scales: precision, stability, and comparison of different scoring and administration options. Qual Life Res. 2014 May 2;23(4):1233–43. doi: 10.1007/s11136-013-0544-0. http://europepmc.org/abstract/MED/24085345. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Fischer HF, Rose M. Scoring Depression on a Common Metric: A Comparison of EAP Estimation, Plausible Value Imputation, and Full Bayesian IRT Modeling. Multivariate Behav Res. 2019 Sep 20;54(1):85–99. doi: 10.1080/00273171.2018.1491381. [DOI] [PubMed] [Google Scholar]
- 45.Gershon RC, Rothrock N, Hanrahan R, Bass M, Cella D. The use of PROMIS and assessment center to deliver patient-reported outcome measures in clinical research. J Appl Meas. 2010;11(3):304–14. http://europepmc.org/abstract/MED/20847477. [PMC free article] [PubMed] [Google Scholar]
- 46.Hung M, Hon SD, Franklin JD, Kendall RW, Lawrence BD, Neese A, Cheng C, Brodke DS. Psychometric Properties of the PROMIS Physical Function Item Bank in Patients With Spinal Disorders. Spine. 2014;39(2):158–163. doi: 10.1097/brs.0000000000000097. [DOI] [PubMed] [Google Scholar]
- 47.Sturgeon JA, Darnall BD, Kao MJ, Mackey SC. Physical and psychological correlates of fatigue and physical function: a Collaborative Health Outcomes Information Registry (CHOIR) study. J Pain. 2015 Mar;16(3):291–8.e1. doi: 10.1016/j.jpain.2014.12.004. http://europepmc.org/abstract/MED/25536536. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Sturgeon JA, Dixon EA, Darnall BD, Mackey SC. Contributions of physical function and satisfaction with social roles to emotional distress in chronic pain: a Collaborative Health Outcomes Information Registry (CHOIR) study. Pain. 2015 Dec;156(12):2627–33. doi: 10.1097/j.pain.0000000000000313. http://europepmc.org/abstract/MED/26230739. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Sullivan MJL, Bishop SR, Pivik J. The Pain Catastrophizing Scale: Development and validation. Psychological Assessment. 1995;7(4):524–532. doi: 10.1037/1040-3590.7.4.524. [DOI] [Google Scholar]
- 50.Darnall BD, Sturgeon JA, Cook KF, Taub CJ, Roy A, Burns JW, Sullivan M, Mackey SC. Development and Validation of a Daily Pain Catastrophizing Scale. J Pain. 2017 Sep;18(9):1139–1149. doi: 10.1016/j.jpain.2017.05.003. http://europepmc.org/abstract/MED/28528981. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Nicholas MK, McGuire BE, Asghari A. A 2-item short form of the Pain Self-efficacy Questionnaire: development and psychometric evaluation of PSEQ-2. J Pain. 2015 Feb;16(2):153–63. doi: 10.1016/j.jpain.2014.11.002. [DOI] [PubMed] [Google Scholar]
- 52.Fish RA, McGuire B, Hogan M, Morrison TG, Stewart I. Validation of the chronic pain acceptance questionnaire (CPAQ) in an Internet sample and development and preliminary validation of the CPAQ-8. Pain. 2010 Jun;149(3):435–43. doi: 10.1016/j.pain.2009.12.016. [DOI] [PubMed] [Google Scholar]
- 53.Bangor A, Kortum PT, Miller JT. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction. 2008 Jul 30;24(6):574–594. doi: 10.1080/10447310802205776. [DOI] [Google Scholar]
- 54.Witmer BG, Singer MJ. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence. 1998 Jun;7(3):225–240. doi: 10.1162/105474698565686. [DOI] [Google Scholar]
- 55.Crawford J, Henry J. The positive and negative affect schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample. Br J Clin Psychol. 2004 Sep;43(Pt 3):245–65. doi: 10.1348/0144665031752934. [DOI] [PubMed] [Google Scholar]
- 56.Opioid Oral Morphine Milligram Equivalent (MME) Conversion Factors. 2017. [2020-12-26]. https://www.cms.gov/Medicare/Prescription-Drug-Coverage/PrescriptionDrugCovContra/Downloads/Opioid-Morphine-EQ-Conversion-Factors-April-2017.pdf.
- 57.Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, CONSORT Group Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008 Feb 19;148(4):295–309. doi: 10.7326/0003-4819-148-4-200802190-00008. https://www.acpjournals.org/doi/10.7326/0003-4819-148-4-200802190-00008?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub%3dpubmed. [DOI] [PubMed] [Google Scholar]
- 58.Geraghty AWA, Torres LD, Leykin Y, Pérez-Stable EJ, Muñoz RF. Understanding attrition from international Internet health interventions: a step towards global eHealth. Health Promot Int. 2013 Sep 10;28(3):442–52. doi: 10.1093/heapro/das029. http://europepmc.org/abstract/MED/22786673. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Eysenbach G. The law of attrition. J Med Internet Res. 2005 Mar 31;7(1):e11. doi: 10.2196/jmir.7.1.e11. https://www.jmir.org/2005/1/e11/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Darnall B, Ziadni M, Krishnamurthy P, Flood P, Heathcote L, Mackey I, Taub CJ, Wheeler A. "My Surgical Success": Effect of a Digital Behavioral Pain Medicine Intervention on Time to Opioid Cessation After Breast Cancer Surgery-A Pilot Randomized Controlled Clinical Trial. Pain Med. 2019 Nov 01;20(11):2228–2237. doi: 10.1093/pm/pnz094. http://europepmc.org/abstract/MED/31087093. [DOI] [PMC free article] [PubMed] [Google Scholar]