Skip to main content
Journal of Medical Internet Research logoLink to Journal of Medical Internet Research
. 2020 Apr 16;22(4):e16939. doi: 10.2196/16939

Clinical Integration of a Smartphone App for Patients With Chronic Pain: Retrospective Analysis of Predictors of Benefits and Patient Engagement Between Clinic Visits

Edgar L Ross 1, Robert N Jamison 2,✉,#, Lance Nicholls 3,#, Barbara M Perry 3,#, Kim D Nolen 3,#
Editor: Gunther Eysenbach
Reviewed by: Tahir Janmohamed, Lisa Whitehead, Philippa Seaton
PMCID: PMC7193441  PMID: 32297871

Abstract

Background

Although many pain-related smartphone apps exist, little attention has been given to understanding how these apps are used over time and what factors contribute to greater compliance and patient engagement.

Objective

This retrospective analysis was designed to help identify factors that predicted the benefits and future use of a smartphone pain app among patients with chronic pain.

Methods

An app designed for both Android and iOS devices was developed by Brigham and Women’s Hospital Pain Management Center (BWH-PMC) for users with chronic pain to assess and monitor pain and communicate with their providers. The pain app offered chronic pain assessment, push notification reminders and communication, personalized goal setting, relaxation sound files, topics of interest with psychological and medical pain management strategies, and line graphs from daily assessments. BWH-PMC recruited 253 patients with chronic pain over time to use the pain app. All subjects completed baseline measures and were asked to record their progress every day using push notification daily assessments. After 3 months, participants completed follow-up questionnaires and answered satisfaction questions. We defined the number of completed daily assessments as a measure of patient engagement with the pain app.

Results

The average age of participants was 51.5 years (SD 13.7, range 18-92), 72.8% (182/253) were female, and 36.8% (78/212) reported the low back as their primary pain site. The number of daily assessments ranged from 1 to 426 (average 62.0, SD 49.9). The app was easy to introduce among patients, and it was well accepted. Those who completed more daily assessments (greater patient engagement) throughout the study were more likely to report higher pain intensity, more activity interference, and greater disability and were generally overweight compared with others. Patients with higher engagement with the app rated the app as offering greater benefit in coping with their pain and expressed more willingness to use the app in the future (P<.05) compared with patients showing lower engagement. Patients completing a small number of daily assessments reported less pain intensity, less daily activity interference, and less pain-related disability on average and were less likely to use the two-way messaging than those who were more engaged with the pain app (P<.05).

Conclusions

Patients with chronic pain who appeared to manage their pain better were less likely to report benefits of a smartphone pain app designed for chronic pain management. They demonstrated lower patient engagement in reporting their daily progress, in part, owing to the perceived burden of regularly using an app without a perceived benefit. An intrinsically different pain app designed and targeted for individuals based on early identification of user characteristics and adapted for each individual would likely improve compliance and app-related patient engagement.

Keywords: chronic pain, patient engagement, telemedicine, mHealth, pain measurement

Introduction

Background

Pain is a major reason that individuals seek health care treatment, and it is estimated that more than 25 million US adults are affected by daily pain [1]. Chronic pain is known to impose a tremendous burden on the quality of life of the affected individuals [2]. According to the Global Burden of Disease Study of the Institute for Health Metrics and Evaluation and the World Health Organization, chronic pain has consistently been ranked first in associated disability and overall burden between 1990 and 2017 [3]. It has been determined that chronic pain adversely affects individuals at a higher frequency than depression, substance abuse, and Alzheimer disease [4,5]. An influential report by the Institute of Medicine on Relieving Pain in America highlighted the urgent need for the development of better methods for tracking and treating pain because of the ever-increasing costs associated with this condition [6].

Innovative technology can be used by health care providers to track persons with chronic pain, engage the patients between clinic visits, and offer information and support to improve coping. There has been a rapid increase in smartphone apps used to monitor and record health data partly due to the increase in mobile device availability [7]. According to the Pew Research Center, about three-quarters of US adults (77%) stated that they owned a smartphone, and 46% of these owners said that their smartphone is something “they could not live without” [8,9]. Individuals living in both urban and rural communities are capable more than ever of monitoring their progress and sending information directly to their health care providers using sophisticated apps [10].

There is evidence that tracking real-time data using momentary ecological assessment is preferable to retrospective diary entry [11-14]. Apps using innovative time-stamped technology can be particularly helpful in tracking variations in pain intensity and other health-related symptoms between clinic visits [7,15,16]. Large datasets of daily pain assessment offer opportunities for the employment of computer-based classification and artificial intelligence [17]. Various available smartphone apps target people with both non–cancer- and cancer-related pain [18-21]. Although many of these apps are commercially accessible, most of them (approximately 86%) have been found to lack professional medical involvement in their development [22]. Lallo et al [23] reviewed 224 pain apps and found little evidence that health care professionals had been involved in creating the apps. The authors also found that only 2% of the apps they reviewed incorporated interactive social support and goal setting. None of the apps that were reviewed contained the recommended five main categories of functionality: the ability to self-monitor, set goals, build skills, educate, and provide social support.

In a more recent review, Bhatterai et al [22] examined 373 pain self-management apps; only 4 successfully met their inclusion criteria according to an established usability evaluation tool. In another recent review of 195 pain management apps, Portelli and Eldred [24] found only 6 apps that incorporated a specific psychological component. The authors concluded that existing pain apps were often constructed by software developers with little input from health care professionals and patients with pain. They also reported that the pain apps tend to contain minimal theoretical content for facilitating self-management or behavioral change. Unfortunately, the life expectancy of most smartphone apps is brief. Three-fourths (75%) of users discontinue using an app within 48 hours of downloading it, and 25% of apps are discarded after the first opening [25]. On the basis of anonymized data points from more than 125 million mobile phones, it is estimated that 80% of apps fade away in time frames as short as 72 hours, and 21% of users use an app only once [26,27].

Objective

The purpose of this analysis was to determine the long-term effects of using a smartphone pain app that offers pain management strategies and allows patients with chronic pain to assess, monitor, and communicate their condition to their health care providers. We were particularly interested in learning from quantitative and qualitative feedback from users about factors that might contribute to improved patient engagement and what might affect adherence to using a smartphone pain app between clinic visits. We were interested in identifying the type of user who would commit to continuing to use a pain app in the future. Finally, we examined qualitative feedback from the users to help identify ways to improve a smartphone pain app.

Methods

Design

This is a retrospective analysis of data gathered from a smartphone pain app designed by Brigham and Women’s Hospital Pain Management Center (BWH-PMC) to assess longitudinal combined information about satisfaction and compliance with the use of a smartphone pain app for persons with chronic pain over 3 months. The analysis plan was approved by the hospital’s internal review board. A team from the BWH-PMC helped develop and test multiple versions of a smartphone pain app used on iOS and Android devices. Initial input from 20 patients with chronic pain was obtained to assist in the development process of the first version of the app (PainApp Pilot; Figure 1). The pain app was tested for security, and all data were saved on a secure encrypted password-protected server. All versions of the pain app were tested and uploaded to the Apple iTunes Store and Google Play Store. A validated version of the app used for this analysis (BWH PainApp) could be downloaded for free and could be used to monitor progress and provide feedback to the user through two-way messaging (Figure 2).

Figure 1.

Figure 1

Key development highlights from each version of the pain app. BWH: Brigham and Women's Hospital; PMC: Pain Management Center.

Figure 2.

Figure 2

Pain app version 3 home page with links when scrolled down.

Data on the server were available only to BWH-PMC personnel through a secure password-protected administration portal. Components of the smartphone app included demographic and contact information, a comprehensive chronic pain assessment, 5-item daily assessments with push notification reminders (Figure 3), personalized goal setting, relaxation sound files, topics of interest with psychological and medical pain management strategies, and line graphs from the daily assessments that could be saved and placed on the patients’ electronic medical record (EMR).

Figure 3.

Figure 3

Pain app version 3 daily assessments and goal-setting tasks.

Data were collected by BWH-PMC from a series of studies using the third version of the smartphone pain app (BWH PainApp) between February 2015 and May 2018 among patients with noncancer-related chronic pain. Previously conducted study methods have been reported earlier by BWH-PMC [28-31]. Subjects were recruited either by invitation to participate in a randomized trial by their treating physician, or they responded to a flyer left in clinic waiting rooms. The trials were designed to investigate the efficacy of a pain app [28,29] and the efficacy of devices to help manage pain (eg, vibrating gloves and a transcutaneous electric nerve stimulation device) [30,31]. Interested and eligible participants signed a consent form and completed baseline measures through these previously conducted studies. Subjects were asked to complete a packet of questionnaires at baseline and again after a 3-month follow-up. The pre-post questionnaires were completed on paper, and data were transferred to an electronic database. Data were also captured from baseline and daily assessments from the pain app. All patients were asked to inform the investigators if any unforeseen medical changes occurred. Subjects were informed about how to find the app (either on the iTunes Store or Google Play Store) and were assisted in downloading the pain app if assistance was needed. Support was offered to address any technical problems that the subject might have encountered. Most of the on-boarding process was done live with a research assistant (RA), and additional assistance was offered with two-way messaging on the administrator portal. Subjects were also able to contact the RA if and when they encountered any technical problems.

All participants were encouraged to complete a 5-item daily assessment on the pain app about their pain, sleep, mood, activity interference, and whether they had gotten better or worse on a visual analog scale (Figure 3). Participants were instructed to complete the assessments around the same time each day for 3 months (although some participants continued to use the app beyond 3 months). Line graphs of the data were made available on the server for subjects. These reports could be copied and pasted onto the subject’s hospital EMR. The app would sometimes have a lag in transmitting data to the server, and as such, subjects did not always get to see their summarized data on these line graphs. Participants involved in a specific study received US $25 after completing the baseline packet of questionnaires, and US $50 after completing the 3-month assessments. Compensation was based on the completion of the follow-up questionnaires regardless of app usage.

Participants

BWH-PMC recruited patients with chronic pain to participate in 1 of 4 published studies [28-31]. Participants needed to be 18 years or older and own a compatible smartphone (iOS or Android device). Other inclusion criteria included (1) having chronic pain for more than 6 months, (2) averaging 4 or greater on a pain intensity scale of 0 to 10, and (3) able to speak and understand English. Patients were excluded if they had (1) any cognitive impairment that would prevent them from understanding the consent, study measures, or procedures, (2) any clinically unstable medical condition judged to interfere with study participation, (3) a pain condition requiring urgent surgery, (4) a present psychiatric condition (eg, Diagnostic and Statistical Manual of Mental Disorders diagnosis of schizophrenia, delusional disorder, psychotic disorder or dissociative disorder) that was judged to interfere with the study, (5) visual or motor impairment that would interfere with the use of a smartphone, and (6) an active addiction disorder over the past 6 months (positive on the Mini International Neuropsychiatric Interview, v.5.0) [32] that would interfere with study participation.

Measures

Acceptability, tolerability, feasibility, and effectiveness of the third version of the pain app were assessed by examining the number and frequency of daily assessments, the number of subjects who continued to use the app after the initial download, and the numeric and qualitative satisfaction ratings. Any reported safety issues were also documented. Overall outcome efficacy was determined through standardized paper-based measures administered at baseline and again after 3 months from this baseline assessment [28-31].

Pain intensity and pain description were assessed using the Brief Pain Inventory (BPI) [33]. This self-report questionnaire, formerly the Wisconsin Brief Pain Questionnaire [34], has shown sufficient reliability and validity. Scale (rated from 0=no pain to 10=worst pain possible) indicates the intensity of pain at its worst, least, average, and pain now. A figure representing the body was used for the patient to shade the area corresponding to his or her pain. Test-retest reliability for the BPI ratings of pain revealed high correlations of 0.93 for worst pain, 0.78 for usual pain, and 0.59 for pain now [33].

Activity interference and disability was assessed with items from the BPI and the Pain Disability Inventory (PDI) [35]. The PDI is a 7-item questionnaire rated from 0 to 10 on the level of disability of 7 areas of activity interference including family or home responsibilities, recreation, social activity, occupation, sexual behavior, self-care, and life-supporting behaviors. It has shown to have excellent test-retest reliability and validity and is sensitive to high levels of disability [35].

Mood, negative affect, and emotional distress were assessed using the Hospital Anxiety and Depression Scale (HADS) [36,37] and certain initial baseline questions on the pain app. The HADS is a 14-item scale that helps determine the presence and severity of anxiety and depression. Each item is coded from 0 to 3 (eg, not at all, most of the time) with 7 items assessing anxiety and 7 items measuring depression. The HADS has adequate reliability (Cronbach alpha=.83) and validity [37]. We also examined the construct of catastrophizing using the Pain Catastrophizing Scale (PCS) [38,39]. The PCS is a 13-item self-report measure that examines pain rumination, magnification of symptoms, and general helplessness. The responses range from not at all (0) to all the time (4) on a 5-point scale. The PCS is found to predict levels of pain and distress among clinical patients and has good psychometric properties with excellent reliability (Cronbach alpha=.87-.95) and validity [17,40]. Total scores of 30 or greater represent a clinically relevant level of catastrophizing (75th percentile).

After 3 months, participants were asked to respond to a 5-item paper-based satisfaction questionnaire designed to investigate the perceived benefit of how easy the pain app was to use and navigate, how useful the daily reminders were, how much the program helped them cope with their pain, and how willing they would be to use the pain app in the future. All items, which were developed in a previous study [29] and adapted from a previously validated measure [41], were rated on a 0 to 10 scale (0=worse/not at all helpful to 10=best/very helpful).

Statistical Analysis

This retrospective analysis was conducted by BWH-PMC. Univariate and multivariate descriptive analyses were performed on all the dependent variables at baseline and at follow-up. Chi-square, t tests, interitem correlations, exploratory factor analyses, and canonical discriminant function analyses were conducted as appropriate using SPSS (version 25.0, IBM Corporation) [42,43]. Subjective comments about the use of the pain app were also collected and summarized.

Results

Patient Demographic Characteristics

A total of 253 patients with chronic pain were engaged by BWH-PMC to use a revised third version of the smartphone pain app. The average age of patients was 51.4 years (SD 13.7, range 18-92); 73.1% (185/253) of patients were female and 82.9% (209/252) of patients were white (Table 1). Pain duration averaged 11.8 years (SD 10.7), and 36.8% (78/212) of patients reported having primary low back pain. Most of the patients (n=243) were taking prescription medication at the time of the study, and 39.9% (97/243) were prescribed opioids for pain. Most subjects were overweight with a BMI averaging 30.1 kg/m2 (SD 7.4). Most of the subjects (171/253, 67.6%) had iPhones, whereas 32.4% (82/253) of the subjects had Android smartphones.

Table 1.

Patient demographic characteristics (N=253).

Variable Value Range
Age (years), mean (SD) 51.5 (13.8) 18-92
Gender, female, n (%) 182 (72.7) N/Aa
Ethnicity, n (%)

White 206 (82.7) N/A

African American 16 (6.4) N/A

Hispanic 17 (6.8) N/A

Other 10 (4.0) N/A
Pain duration (years), mean (SD) 11.8 (10.7) 0.5-50
Pain site, n (%)b

Low back 78 (36.8) N/A

Multiple sites 77 (36.3) N/A

Cervical/upper extremity 31 (14.6) N/A

Lower extremity 11 (5.2) N/A

Abdominal/pelvic 13 (6.1) N/A

Head/face 2 (0.9) N/A
Pain intensityc, mean (SD)

Worst pain 7.7 (2.1) 1-10

Least pain 3.3 (2.3) 0-10

Average pain 5.4 (1.8) 1-10
Depth of pain, mean (SD) 203.3 (48.0) 0-270
Take opioid medication, n (%)d 97 (39.9) N/A
BMI (kg/m2), mean (SD) 30.1 (7.4) 12.2-54.7
Number of times wake during night, mean (SD) 2.6 (2.1) 0-10
Sleep hours, mean (SD) 6.3 (1.8) 1-12
Pain interference (total)e, mean (SD) 4.9 (2.7) 0-10
Pain Disability Index, mean (SD) 31.5 (17.7) 0-70
Hospital Anxiety and Depression Scale total, mean (SD) 14.9 (7.7) 0-36
Pain Catastrophizing Scale, mean (SD) 17.3 (12.2)) 0-50
Number of symptomsf (present or absent), mean (SD) 1.6 (2.4) 0-13
Number of pain descriptorsg (present or absent), mean (SD) 4.1 (1.9) 1-9
Number of daily assessments, mean (SD) 62.0 (49.9) 1-426

aN/A: not applicable.

bN=212.

c0=no pain; 10=pain as bad as you can imagine.

dN=243.

eDuring the past 24 hours, how much has your pain interfered with (1) general activity, (2) mood, (3) walking ability, (4) normal work, (5) relations with others, (6) sleep, and (7) enjoyment of life? 0=has not interfered; 10=completely interfered.

fSide effect symptoms: constipation, dizziness, dry mouth, headache, itching, memory lapse, confusion, nausea, nightmares, sneezing, sweating, visual problems, weakness, and other.

gPain descriptors: throbbing, stabbing, aching, burning, pricking, pulling, shooting, numbing, and other.

Patient Engagement Results

Of the 253 subjects considered for the analysis, 43 (18.1%) reported some type of technical problem with the app during the study period that briefly restricted their daily assessments. This did not significantly affect their engagement with the pain app. The total number of daily assessments from the pain app averaged 62.0 (SD 49.9). Comparisons between baseline measures and repeat measures at 3 months showed an overall decrease in average pain intensity on the BPI (5.3, SD 1.8 vs 4.9, SD 2.3; t185=4.0; P<.001) and a decrease in disability on the PDI (30.6, SD 17.7 vs 27.2, SD 18.2; t156=3.9; P<.001), but no differences in mood (mean HADS score 14.4, SD 8.1 vs 14.6, SD 8.3) and pain catastrophizing (mean PCS score 15.7, SD 1.3 vs 16.3, SD 12.8).

A total of 72.3% (183/253) users completed the satisfaction questionnaire after approximately 3 months. No significant differences in demographic characteristics were found between those who completed the satisfaction questionnaire and those who did not complete this questionnaire. Most users found the app easy to use (mean 8.7, SD 2.2) and easy to navigate (mean 8.5, SD 2.4; 0=not at all easy; 10=very easy). The majority of users also found the daily reminders to be useful (mean 6.7, SD 3.9; 0=not at all useful, 10=very useful). Some of the users, primarily the Android users, reported that the push notification reminders did not consistently work on their phone, and they were more likely to rate lower perceived usefulness of the daily reminders because they did not work. The users felt that the app offered some help in coping with their pain (mean 4.5, SD 3.7; 0=not at all helpful, 10=very helpful), whereas the majority of the users felt that they would be willing to use the app in the future (mean 7.1, SD 3.3; 0=not at all willing, 10=very willing).

No significant differences were found on demographic variables of age, gender, ethnicity, or pain duration on all outcome variables. Those who reported liking the pain app were more likely to use it often to submit more daily reports and reported greater pain intensity and more disability. Pearson product-moment correlations between the 5 satisfaction questions ranged between 0.21 and 0.58.

Factor analysis of the satisfaction questionnaire responses using principal component analysis with Varimax rotation found two factors above an eigenvalue of greater than 1.0: (1) easy to use, easy to navigate, useful reminders (correlation r=0.48; eigenvalue=2.47) and (2) helped to cope with pain and would use the app in the future (r=0.51; eigenvalue=1.01). The first factor, containing 3 of the satisfaction questions, was labeled easy to use. The second factor, containing the other two satisfaction questions, was labeled help with coping and future use. Those who felt that the app helped them in coping also were more likely to report that they would use the pain app in the future. Combined, these 2 factors accounted for 70.0% of the variance.

Pearson product-moment correlations were run between the combined satisfaction ratings of easy to use (satisfaction questions 1, 2 and 3) and help with coping and future use (questions 4 and 5) and the number of daily assessments, BPI activity interference, and PDI scores at 3 months (Table 2).

Table 2.

Pearson product-moment correlations among patient satisfaction questionnaire responses between those who found the pain app easy to use, and those who felt that the app helped them to cope and would be willing to use the pain app in the future (0=very satisfied; 10=very unsatisfied).

Variable Pearson product-moment correlations for easy to use Pearson product-moment correlations for helped cope and future use
Age (years) 0.20a −0.08
Brief Pain Inventory (0-10)

Worse pain −0.06 0.18a

Least pain 0.15 0.22b

Average pain 0.10 0.24b
BMI (kg/m2) 0.11 0.26b
Brief Pain Inventory activity interference (0-10) −0.03 0.24b
Pain Disability Inventory total (0-70) 0.00 0.19a
Side effect list total (0-14)a,c −0.18a 0.19a
Pain description total (0-9)b,d −0.23a 0.15
Number of daily assessments entered 0.09 0.15
Total number of messages sent and received −0.01 0.18a
Opioids (yes/no) 0.11 0.19a

aP<.05.

bP<.01.

cSide effect symptoms: constipation, dizziness, dry mouth, headache, itching, memory lapse, confusion, nausea, nightmares, sneezing, sweating, visual problems, weakness, and other.

dPain descriptors: throbbing, stabbing, aching, burning, pricking, pulling, shooting, numbing, and other.

Discriminant function analyses were run using those variables, which revealed significant differences between those with generally higher ratings on help with coping and future use, compared with those with lower ratings on these items. Three items were identified using stepwise entry: (1) total number of messages sent and received, (2) total PDI baseline scores, and (3) BMI score (Wilks Lambda=0.89; P<.001) and correctly classifying 69.4% of the cases entered. This means that, overall, these 3 variables would correctly classify someone approximately 70% of the time as to the app being helpful to cope with pain and used in the future.

Differences were examined on the baseline and outcome variables between those selected patients with pain who felt that the pain app both helped them cope with their pain and were willing to use the app in the future (n=84; >7/10) and those who reported that the pain app both did not help them cope and were less inclined to use it in the future (n=81; <7/10) based on the 3-month satisfaction questions (Table 3). No differences were found between groups in age, gender, pain site, ethnicity, or pain duration. Those who rated the pain app more favorably reported higher pain ratings (baseline and follow-up), more activity interference, more pain-related disability, used more words to describe their pain, reported more side effects, had higher BMI scores, and were more often taking opioids for their pain than those who were less favorable about the pain app (P<.05). Those who felt that the app helped them cope with their pain and would use the app in the future completed more daily assessments and used the two-way messaging service on the app more than those who felt that the app was not as helpful (P<.05).

Table 3.

Differences between patients with pain who felt that the pain app helped them cope with their pain and were willing to use the app in the future (n=84) and those who reported that the pain app did not help them cope and were less inclined to use it in the future (n=81).

Variablea Yes (n=84) No (n=81) t test (df) Chi-square (df)
BPIb pain (baseline, range 0-10), mean (SD) 5.7 (1.9) 5.1 (1.8) 2.3 (157)c N/Ad
BPI pain (3-month follow-up, range 0-10), mean (SD) 5.2 (2.4) 4.4 (2.0) 2.3 (155)c N/A
BPI activity interference (range 0-10), mean (SD) 5.0 (2.4) 3.9 (2.6) 2.7 (157)c N/A
BPI activity interference (3-month follow-up, range 0-10), mean (SD) 4.7 (2.8) 3.8 (2.8) Not significant N/A
PDIe total (baseline), mean (SD) 34.6 (16.9) 27.2 (17.0) 2.7 (145)f N/A
PDI total (3-month follow-up), mean (SD) 31.8 (18.3) 25.0 (17.0) 2.4 (150)c N/A
Pain description (range 0-9)g, mean (SD) 4.5 (2.1) 3.9 (1.6) 2.1 (160)c N/A
Side effects total (yes, range 0-14)h, mean (SD) 7.8 (15.6) 4.1 (8.6) Not significant N/A
BMI (kg/m2), mean (SD) 31.6 (7.8) 28.1 (6.5) 3.2 (160)f N/A
Opioids (% yes of total) 22.6 16.4 N/A 4.3 (1)c
Number of daily assessments entered, mean (SD) 83.6 (62.3) 65.9 (37.9) 2.2 (162)c N/A
Total messages, mean (SD) 13.1 (12.3) 8.9 (7.9) 2.6 (162)c N/A

aNo differences were found between groups on age, gender, pain site, ethnicity, or pain duration.

bBPI: Brief Pain Inventory.

cP<.05.

dN/A: not applicable.

ePDI: Pain Disability Inventory.

fP<.01.

gPain descriptors: throbbing, stabbing, aching, burning, pricking, pulling, shooting, numbing, and other.

hSide effect symptoms: constipation, dizziness, dry mouth, headache, itching, memory lapse, confusion, nausea, nightmares, sneezing, sweating, visual problems, weakness, and other.

Most of those who responded to the follow-up question Is there anything about the pain app that you would change? had no comments (eg, no, none, not really, not sure), and there were a number of positive comments (eg, I found it easy to use, Thanks for the opportunity to use the app). Examples of negative feedback and specific comments about difficulties encountered with the push notification and recommendations for improvements are included in Multimedia Appendix 1. Some users encountered a number of difficulties with the functionality of the app (slow, not accurate, problems with deleting password) and expressed difficulties in seeing past logs and concerns about being constantly reminded about their pain. Some pointed out the challenges they experienced when updating their phones or changing their phone carriers. Many expressed problems they encountered with daily push notification reminders. This was found to be particularly prevalent among Android device owners. Other requests included making the pain app more adaptive to each user’s specific condition, adding more instruction when starting to use the app, giving a clear indication when a daily assessment was completed, being able to continue to listen to the relaxation sound files even when the app is closed, and incorporating clearly designated areas to type in free text that can be sent to providers.

Discussion

Principal Findings

Although many pain-related apps exist, attention has been given recently to understanding how these apps are used over time and what factors contribute to greater compliance and patient engagement [44,45]. This study examined factors that contributed to increased patient engagement in using a smartphone pain app. Overall, the pain app was found to be usable and easily accepted among most of the users and, based on the 3-month follow-up assessments, most of the users reported improvement in pain intensity and activity interference. However, those rating the app as easy to use did not necessarily report that the app improved their ability to cope with the pain or that they would necessarily continue to use the app in the future. Demographic variables such as age, gender, or ethnicity were not found to play a role in predicting overall improvement, compliance or satisfaction with use of the pain app. Throughout the study, those persons with chronic pain who reported higher pain intensity and greater pain-related disability were found to like the app more, use the app more, and express greater willingness to use the app in the future compared with those who were less disabled because of their pain. This suggests that the ability to tailor the app to meet the needs of each user could have an important effect on improving compliance. These analyses also suggest that apps should be selectively assigned to those who may present with certain indicators signaling a greater likelihood of benefiting from a pain app to cope with their pain.

The challenge with mobile health (mHealth) technology is to encourage and motivate participants to continue to use an app to track behavior, maintain contact with their provider, and make improvements in their condition. This is particularly important among individuals with chronic illnesses. The goal of innovative mHealth technology is to offer medical and psychological assistance remotely to reduce health care utilization by reducing clinic and emergency room visits and unnecessary expensive tests. This is a future direction for health care technology, but engaging individuals in ways that increase use of this technology continues to represent a challenge among app developers. It may be no surprise that those patients with pain who used the app more were more satisfied with the pain-related software program. It is interesting to speculate why those with more pain, greater self-reported disability, greater weight, more use of opioids, and more pain descriptors were more satisfied with the smartphone pain app. Quite possibly, those who were busy throughout the day found the app to be more bothersome. Subjective feedback suggests that some preferred not to focus on their pain and found the frequent monitoring to be more of a bother than helpful. Those who reported more limitations owing to their pain might have been more focused on their pain and welcomed the opportunity to share their experience with their providers. Some may have also wanted to verify their disability and document their limitations for others.

There are many challenges with pain apps going forward. Few physicians recommend pain apps because of lack of time, lack of information about which apps are reliable, concerns of liability, and insufficient evidence that the use of an app will improve outcomes [46]. Even if a physician recommends an app to a patient, there is no guarantee that the patient will download it, use it, and continue to use it. Patients need to have the desire to self-manage, and the role of patient engagement is vitally important. Monitoring data with stand-alone apps that collect data but make it difficult to share with providers will reduce the chance that the apps will be used. In addition, physicians do not have time to wade through raw data, so analytics are needed to help make the data digestible. Providers will also not spend time to open a website to view data; thus, there needs to be an easy way to incorporate pain app data into an EMR system.

There are a number of limitations of this analysis that should be highlighted. As with any new technology, we encountered some software and hardware difficulties that may have adversely affected the use of the app and consequently affected the outcome data. Some subjects did not receive reminders or push notifications to complete their daily assessments, which seemed to be reported mostly by Android smartphone owners. In addition, some encountered difficulties when they upgraded their smartphones, including problems downloading the program to their new device. They also reported minor problems with the app when software updates were made to either the iPhone or Android devices. Corresponding changes were needed in the software code of the pain app every time these changes were made to the iOS and Android platforms. The BWH-PMC staff also needed to make periodic changes to the administrative portal and server, which caused delays in capturing patient data. Thus, factors other than patient noncompliance, including technical difficulties with the software and the devices, may have accounted for the perceived benefit from the pain app. Not all users were able to participate owing to the limitations of their phone capabilities or them not owning a smartphone. Thus, these results may have been affected by selection bias. Patients were encouraged to use the app as part of a study, which may have influenced the use of the app more than what might have been done if patients were not involved in a study. We also could not determine how the availability of RA support was an influencing factor in engagement. It should also be pointed out that the results are correlational in nature, and no causal relationships can be assumed.

Conclusions

This retrospective analysis demonstrates that a smartphone pain app for persons with chronic pain can be perceived to be easy to use, but certain factors, including greater pain and disability, might have an increased influence in motivating individuals to use the app. It also highlights potential challenges in using mHealth technology. Future improvements are needed to make pain apps more adaptive and engaging and directly tailored to the individual user. This would likely have a positive impact on adherence and may lead to increased improvements among persons with chronic pain.

Acknowledgments

A portion of the results of this analysis was presented at the American Medical Informatics Association’s (AMIA) annual symposium, San Francisco, California, November 6, 2018. The AMIA poster and this manuscript were funded by Pfizer to understand the importance of utilizing a pain app to communicate between patients and providers between clinic visits. The authors gratefully recognize Joseph C Cappelleri, Walter J McClain, Elizabeth Scanlan, Margarita Udall, Limeng Wan, and the patients and staff of BWH-PMC for their assistance and participation related to the development of this manuscript. Special thanks are also extended to the staff of Technogrounds Inc for helping to develop the different versions of the app.

This manuscript development was funded by Pfizer Inc. ER and RJ are employees of BWH-PMC, which received financial support from Pfizer for participation in this manuscript. LN, BP, and KN are Medical Affairs employees of Pfizer Inc.

Abbreviations

AMIA

American Medical Informatics Association

BPI

Brief Pain Inventory

BWH-PMC

Brigham and Women’s Hospital Pain Management Center

EMR

electronic medical record

HADS

Hospital Anxiety and Depression Scale

mHealth

mobile health

PCS

Pain Catastrophizing Scale

PDI

Pain Disability Inventory

RA

research assistant

Appendix

Multimedia Appendix 1

Comments regarding use of the pain app after a 3 month trial "Is there anything about the pain app that you would change.".

Footnotes

Authors' Contributions: ER and RJ conducted the retrospective analysis without any support or input from Pfizer Inc. RJ developed the initial draft of this manuscript. All other authors and contributors provided edits, suggestions, and revisions to the final manuscript.

Conflicts of Interest: LN, BP, and KN are employees of Pfizer Inc. ER and RJ declare no conflicts of interest.

References

  • 1.Nahin RL. Estimates of pain prevalence and severity in adults: United States, 2012. J Pain. 2015 Aug;16(8):769–80. doi: 10.1016/j.jpain.2015.05.002. http://europepmc.org/abstract/MED/26028573. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Koes BW, van Tulder MW, Ostelo R, Burton AK, Waddell G. Clinical guidelines for the management of low back pain in primary care: an international comparison. Spine (Phila Pa 1976) 2001 Nov 15;26(22):2504–13; discussion 2513. doi: 10.1097/00007632-200111150-00022. [DOI] [PubMed] [Google Scholar]
  • 3.Institute for Health Metrics and Evaluation. Seattle: IHME; 2019. [2020-02-22]. Findings from the Global Burden of Disease Study 2017 http://www.healthdata.org/policy-report/findings-global-burden-disease-study-2017. [Google Scholar]
  • 4.GBD 2013 DALYsHALE Collaborators. Murray CJ, Barber RM, Foreman KJ, Ozgoren AA, Abd-Allah F, Abera SF, Aboyans V, Abraham JP, Abubakar I, Abu-Raddad LJ, Abu-Rmeileh NM, Achoki T, Ackerman IN, Ademi Z, Adou AK, Adsuar JC, Afshin A, Agardh EE, Alam SS, Alasfoor D, Albittar MI, Alegretti MA, Alemu ZA, Alfonso-Cristancho R, Alhabib S, Ali R, Alla F, Allebeck P, Almazroa MA, Alsharif U, Alvarez E, Alvis-Guzman N, Amare AT, Ameh EA, Amini H, Ammar W, Anderson HR, Anderson BO, Antonio CA, Anwari P, Arnlöv J, Arsenijevic VS, Artaman A, Asghar RJ, Assadi R, Atkins LS, Avila MA, Awuah B, Bachman VF, Badawi A, Bahit MC, Balakrishnan K, Banerjee A, Barker-Collo SL, Barquera S, Barregard L, Barrero LH, Basu A, Basu S, Basulaiman MO, Beardsley J, Bedi N, Beghi E, Bekele T, Bell ML, Benjet C, Bennett DA, Bensenor IM, Benzian H, Bernabé E, Bertozzi-Villa A, Beyene TJ, Bhala N, Bhalla A, Bhutta ZA, Bienhoff K, Bikbov B, Biryukov S, Blore JD, Blosser CD, Blyth FM, Bohensky MA, Bolliger IW, Başara BB, Bornstein NM, Bose D, Boufous S, Bourne RR, Boyers LN, Brainin M, Brayne CE, Brazinova A, Breitborde NJ, Brenner H, Briggs AD, Brooks PM, Brown JC, Brugha TS, Buchbinder R, Buckle GC, Budke CM, Bulchis A, Bulloch AG, Campos-Nonato IR, Carabin H, Carapetis JR, Cárdenas R, Carpenter DO, Caso V, Castañeda-Orjuela CA, Castro RE, Catalá-López F, Cavalleri F, Çavlin A, Chadha VK, Chang JC, Charlson FJ, Chen H, Chen W, Chiang PP, Chimed-Ochir O, Chowdhury R, Christensen H, Christophi CA, Cirillo M, Coates MM, Coffeng LE, Coggeshall MS, Colistro V, Colquhoun SM, Cooke GS, Cooper C, Cooper LT, Coppola LM, Cortinovis M, Criqui MH, Crump JA, Cuevas-Nasu L, Danawi H, Dandona L, Dandona R, Dansereau E, Dargan PI, Davey G, Davis A, Davitoiu DV, Dayama A, de Leo D, Degenhardt L, Del Pozo-Cruz B, Dellavalle RP, Deribe K, Derrett S, Des Jarlais DC, Dessalegn M, Dharmaratne SD, Dherani MK, Diaz-Torné C, Dicker D, Ding EL, Dokova K, Dorsey ER, Driscoll TR, Duan L, Duber HC, Ebel BE, Edmond KM, Elshrek YM, Endres M, Ermakov SP, Erskine HE, Eshrati B, Esteghamati A, Estep K, Faraon EJ, Farzadfar F, Fay DF, Feigin VL, Felson DT, Fereshtehnejad SM, Fernandes JG, Ferrari AJ, Fitzmaurice C, Flaxman AD, Fleming TD, Foigt N, Forouzanfar MH, Fowkes FG, Paleo UF, Franklin RC, Fürst T, Gabbe B, Gaffikin L, Gankpé FG, Geleijnse JM, Gessner BD, Gething P, Gibney KB, Giroud M, Giussani G, Gomez Dantes H, Gona P, González-Medina D, Gosselin RA, Gotay CC, Goto A, Gouda HN, Graetz N, Gugnani HC, Gupta R, Gupta R, Gutiérrez RA, Haagsma J, Hafezi-Nejad N, Hagan H, Halasa YA, Hamadeh RR, Hamavid H, Hammami M, Hancock J, Hankey GJ, Hansen GM, Hao Y, Harb HL, Haro JM, Havmoeller R, Hay SI, Hay RJ, Heredia-Pi IB, Heuton KR, Heydarpour P, Higashi H, Hijar M, Hoek HW, Hoffman HJ, Hosgood HD, Hossain M, Hotez PJ, Hoy DG, Hsairi M, Hu G, Huang C, Huang JJ, Husseini A, Huynh C, Iannarone ML, Iburg KM, Innos K, Inoue M, Islami F, Jacobsen KH, Jarvis DL, Jassal SK, Jee SH, Jeemon P, Jensen PN, Jha V, Jiang G, Jiang Y, Jonas JB, Juel K, Kan H, Karch A, Karema CK, Karimkhani C, Karthikeyan G, Kassebaum NJ, Kaul A, Kawakami N, Kazanjan K, Kemp AH, Kengne AP, Keren A, Khader YS, Khalifa SE, Khan EA, Khan G, Khang YH, Kieling C, Kim D, Kim S, Kim Y, Kinfu Y, Kinge JM, Kivipelto M, Knibbs LD, Knudsen AK, Kokubo Y, Kosen S, Krishnaswami S, Defo BK, Bicer BK, Kuipers EJ, Kulkarni C, Kulkarni VS, Kumar GA, Kyu HH, Lai T, Lalloo R, Lallukka T, Lam H, Lan Q, Lansingh VC, Larsson A, Lawrynowicz AE, Leasher JL, Leigh J, Leung R, Levitz CE, Li B, Li Y, Li Y, Lim SS, Lind M, Lipshultz SE, Liu S, Liu Y, Lloyd BK, Lofgren KT, Logroscino G, Looker KJ, Lortet-Tieulent J, Lotufo PA, Lozano R, Lucas RM, Lunevicius R, Lyons RA, Ma S, Macintyre MF, Mackay MT, Majdan M, Malekzadeh R, Marcenes W, Margolis DJ, Margono C, Marzan MB, Masci JR, Mashal MT, Matzopoulos R, Mayosi BM, Mazorodze TT, Mcgill NW, Mcgrath JJ, Mckee M, Mclain A, Meaney PA, Medina C, Mehndiratta MM, Mekonnen W, Melaku YA, Meltzer M, Memish ZA, Mensah GA, Meretoja A, Mhimbira FA, Micha R, Miller TR, Mills EJ, Mitchell PB, Mock CN, Ibrahim NM, Mohammad KA, Mokdad AH, Mola GL, Monasta L, Hernandez JC, Montico M, Montine TJ, Mooney MD, Moore AR, Moradi-Lakeh M, Moran AE, Mori R, Moschandreas J, Moturi WN, Moyer ML, Mozaffarian D, Msemburi WT, Mueller UO, Mukaigawara M, Mullany EC, Murdoch ME, Murray J, Murthy KS, Naghavi M, Naheed A, Naidoo KS, Naldi L, Nand D, Nangia V, Narayan KM, Nejjari C, Neupane SP, Newton CR, Ng M, Ngalesoni FN, Nguyen G, Nisar MI, Nolte S, Norheim OF, Norman RE, Norrving B, Nyakarahuka L, Oh IH, Ohkubo T, Ohno SL, Olusanya BO, Opio JN, Ortblad K, Ortiz A, Pain AW, Pandian JD, Panelo CI, Papachristou C, Park EK, Park JH, Patten SB, Patton GC, Paul VK, Pavlin BI, Pearce N, Pereira DM, Perez-Padilla R, Perez-Ruiz F, Perico N, Pervaiz A, Pesudovs K, Peterson CB, Petzold M, Phillips MR, Phillips BK, Phillips DE, Piel FB, Plass D, Poenaru D, Polinder S, Pope D, Popova S, Poulton RG, Pourmalek F, Prabhakaran D, Prasad NM, Pullan RL, Qato DM, Quistberg DA, Rafay A, Rahimi K, Rahman SU, Raju M, Rana SM, Razavi H, Reddy KS, Refaat A, Remuzzi G, Resnikoff S, Ribeiro AL, Richardson L, Richardus JH, Roberts DA, Rojas-Rueda D, Ronfani L, Roth GA, Rothenbacher D, Rothstein DH, Rowley JT, Roy N, Ruhago GM, Saeedi MY, Saha S, Sahraian MA, Sampson UK, Sanabria JR, Sandar L, Santos IS, Satpathy M, Sawhney M, Scarborough P, Schneider IJ, Schöttker B, Schumacher AE, Schwebel DC, Scott JG, Seedat S, Sepanlou SG, Serina PT, Servan-Mori EE, Shackelford KA, Shaheen A, Shahraz S, Levy TS, Shangguan S, She J. doi: 10.1016/S0140-6736(15)61340-X. [DOI] [Google Scholar]
  • 5.Murray CJ, Atkinson C, Bhalla K, Birbeck G, Burstein R, Chou D, Dellavalle R, Danaei G, Ezzati M, Fahimi A, Flaxman D, Foreman. Gabriel S, Gakidou E, Kassebaum N, Khatibzadeh S, Lim S, Lipshultz SE, London S, Lopez. MacIntyre MF, Mokdad AH, Moran A, Moran AE, Mozaffarian D, Murphy T, Naghavi M, Pope C, Roberts T, Salomon J, Schwebel DC, Shahraz S, Sleet DA, Murray. Abraham J, Ali MK, Atkinson C, Bartels DH, Bhalla K, Birbeck G, Burstein R, Chen H, Criqui MH, Dahodwala. Jarlais. Ding EL, Dorsey ER, Ebel BE, Ezzati M, Fahami. Flaxman S, Flaxman AD, Gonzalez-Medina D, Grant B, Hagan H, Hoffman H, Kassebaum N, Khatibzadeh S, Leasher JL, Lin J, Lipshultz SE, Lozano R, Lu Y, Mallinger L, McDermott MM, Micha R, Miller TR, Mokdad AA, Mokdad AH, Mozaffarian D, Naghavi M, Narayan KM, Omer SB, Pelizzari PM, Phillips D, Ranganathan D, Rivara FP, Roberts T, Sampson U, Sanman E, Sapkota A, Schwebel DC, Sharaz S, Shivakoti R, Singh GM, Singh D, Tavakkoli M, Towbin JA, Wilkinson JD, Zabetian A, Murray. Abraham J, Ali MK, Alvardo M, Atkinson C, Baddour LM, Benjamin EJ, Bhalla K, Birbeck G, Bolliger I, Burstein R, Carnahan E, Chou D, Chugh SS, Cohen A, Colson KE, Cooper LT, Couser W, Criqui MH, Dabhadkar KC, Dellavalle RP, Jarlais. Dicker D, Dorsey ER, Duber H, Ebel BE, Engell RE, Ezzati M, Felson DT, Finucane MM, Flaxman S, Flaxman AD, Fleming T, Foreman. Forouzanfar MH, Freedman G, Freeman MK, Gakidou E, Gillum RF, Gonzalez-Medina D, Gosselin R, Gutierrez HR, Hagan H, Havmoeller R, Hoffman H, Jacobsen KH, James SL, Jasrasaria R, Jayarman S, Johns N, Kassebaum N, Khatibzadeh S, Lan Q, Leasher JL, Lim S, Lipshultz SE, London S, Lopez. Lozano R, Lu Y, Mallinger L, Meltzer M, Mensah GA, Michaud C, Miller TR, Mock C, Moffitt TE, Mokdad AA, Mokdad AH, Moran A, Naghavi M, Narayan KMV, Nelson RG, Olives C, Omer SB, Ortblad K, Ostro B, Pelizzari PM, Phillips D, Raju M, Razavi H, Ritz B, Roberts T, Sacco RL, Salomon J, Sampson U, Schwebel DC, Shahraz S, Shibuya K, Silberberg D, Singh JA, Steenland K, Taylor JA, Thurston GD, Vavilala MS, Vos T, Wagner GR, Weinstock MA, Weisskopf MG, Wulf S, Murray. US Burden of Disease Collaborators The state of US health, 1990-2010: burden of diseases, injuries, and risk factors. J Am Med Assoc. 2013 Aug 14;310(6):591–608. doi: 10.1001/jama.2013.13805. http://europepmc.org/abstract/MED/23842577. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Institute of Medicine (US) Committee on Advancing Pain Research, Care, and Education . NCBI - NIH. Washington, DC: National Academies Press (US); 2011. [2020-02-26]. Relieving Pain in America: A Blueprint for Transforming Prevention, Care, Education, and Research https://www.ncbi.nlm.nih.gov/pubmed/22553896. [Google Scholar]
  • 7.Sundararaman LV, Edwards RR, Ross EL, Jamison RN. Integration of mobile health technology in the treatment of chronic pain: a critical review. Reg Anesth Pain Med. 2017;42(4):488–98. doi: 10.1097/AAP.0000000000000621. [DOI] [PubMed] [Google Scholar]
  • 8.Smith A. Pew Research Center. 2015. Apr 1, [2020-02-02]. US Smartphone Use in 2015 https://www.pewresearch.org/internet/2015/04/01/us-smartphone-use-in-2015/
  • 9.Perrin A. The Pew Research Center, June 28. 2017. Jun 28, [2020-02-22]. 10 Facts About Smartphones as the iPhone Turns 10 http://www.pewresearch.org/fact-tank/2017/06/28/10-facts-about-smartphones.
  • 10.Singh K, Bates D. The Commonwealth Fund. 2016. Feb 18, [2018-08-09]. Developing a Framework for Evaluating the Patient Engagement, Quality, and Safety of Mobile Health Applications http://www.commonwealthfund.org/publications/issue-briefs/2016/feb/evaluating-mobile-health-apps.
  • 11.Blumenthal S, Somashekar G. The Huffington Post. 2015. Aug 10, [2019-08-09]. Advancing Health With Information Technology in the 21st Century http://www.huffingtonpost.com/susan-blumenthal/advancing-health-with-inf_b_7968190.html.
  • 12.Jamison RN, Raymond SA, Levine JG, Slawsby EA, Nedeljkovic SS, Katz NP. Electronic diaries for monitoring chronic pain: 1-year validation study. Pain. 2001 Apr;91(3):277–85. doi: 10.1016/s0304-3959(00)00450-4. [DOI] [PubMed] [Google Scholar]
  • 13.Jamison RN, Gracely RH, Raymond SA, Levine JG, Marino B, Herrmann TJ, Daly M, Fram D, Katz NP. Comparative study of electronic vs paper VAS ratings: a randomized, crossover trial using healthy volunteers. Pain. 2002 Sep;99(1-2):341–7. doi: 10.1016/s0304-3959(02)00178-1. [DOI] [PubMed] [Google Scholar]
  • 14.Palermo TM, Valenzuela D, Stork PP. A randomized trial of electronic versus paper pain diaries in children: impact on compliance, accuracy, and acceptability. Pain. 2004 Feb;107(3):213–9. doi: 10.1016/j.pain.2003.10.005. [DOI] [PubMed] [Google Scholar]
  • 15.Stone AA, Broderick JE. Real-time data collection for pain: appraisal and current status. Pain Med. 2007 Oct;8(Suppl 3):S85–93. doi: 10.1111/j.1526-4637.2007.00372.x. [DOI] [PubMed] [Google Scholar]
  • 16.Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. 2010 Feb;15(Pt 1):1–39. doi: 10.1348/135910709X466063. http://europepmc.org/abstract/MED/19646331. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Jamison RN, Xu X, Wan L, Edwards RR, Ross EL. Determining pain catastrophizing from daily pain app assessment data: role of computer-based classification. J Pain. 2019 Mar;20(3):278–87. doi: 10.1016/j.jpain.2018.09.005. [DOI] [PubMed] [Google Scholar]
  • 18.Hundert AS, Huguet A, McGrath PJ, Stinson JN, Wheaton M. Commercially available mobile phone headache diary apps: a systematic review. JMIR Mhealth Uhealth. 2014 Aug 19;2(3):e36. doi: 10.2196/mhealth.3452. https://mhealth.jmir.org/2014/3/e36/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Stinson JN, Jibb LA, Nguyen C, Nathan PC, Maloney AM, Dupuis LL, Gerstle JT, Alman B, Hopyan S, Strahlendorf C, Portwine C, Johnston DL, Orr M. Development and testing of a multidimensional iPhone pain assessment application for adolescents with cancer. J Med Internet Res. 2013 Mar 8;15(3):e51. doi: 10.2196/jmir.2350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Reynoldson C, Stones C, Allsop M, Gardner P, Bennett MI, Closs SJ, Jones R, Knapp P. Assessing the quality and usability of smartphone apps for pain self-management. Pain Med. 2014 Jun;15(6):898–909. doi: 10.1111/pme.12327. [DOI] [PubMed] [Google Scholar]
  • 21.de la Vega R, Roset R, Castarlenas E, Sánchez-Rodríguez E, Solé E, Miró J. Development and testing of painometer: a smartphone app to assess pain intensity. J Pain. 2014 Oct;15(10):1001–7. doi: 10.1016/j.jpain.2014.04.009. [DOI] [PubMed] [Google Scholar]
  • 22.Bhattarai P, Newton-John TR, Phillips JL. Quality and usability of arthritic pain self-management apps for older adults: a systematic review. Pain Med. 2018 Mar 1;19(3):471–84. doi: 10.1093/pm/pnx090. [DOI] [PubMed] [Google Scholar]
  • 23.Lalloo C, Jibb LA, Rivera J, Agarwal A, Stinson JN. 'There's a Pain App for That': review of patient-targeted smartphone applications for pain management. Clin J Pain. 2015 Jun;31(6):557–63. doi: 10.1097/AJP.0000000000000171. [DOI] [PubMed] [Google Scholar]
  • 24.Portelli P, Eldred C. A quality review of smartphone applications for the management of pain. Br J Pain. 2016 Aug;10(3):135–40. doi: 10.1177/2049463716638700. http://europepmc.org/abstract/MED/27583140. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Whitehead L, Seaton P. The effectiveness of self-management mobile phone and tablet apps in long-term condition management: a systematic review. J Med Internet Res. 2016 May 16;18(5):e97. doi: 10.2196/jmir.4883. https://www.jmir.org/2016/5/e97/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Perro J. Localytics. 2018. Mar 23, [2020-02-22]. Mobile Apps: What’s A Good Retention Rate? http://info.localytics.com/blog/mobile-apps-whats-a-good-retention-rate?_ga=2.90317082.1607914945.1575073756-556096695.1575073756.
  • 27.Chen A. AndrewChen. [2019-08-08]. New Data Shows Losing 80% of Mobile Users is Normal, and Why the Best Apps Do Better http://andrewchen.co/new-data-shows-why-losing-80-of-your-mobile-users-is-normal-and-that-the-best-apps-do.
  • 28.Jamison RN, Jurcik DC, Edwards RR, Huang C, Ross EL. A pilot comparison of a smartphone app with or without 2-way messaging among chronic pain patients: Who benefits from a pain app? Clin J Pain. 2017 Aug;33(8):676–86. doi: 10.1097/AJP.0000000000000455. http://europepmc.org/abstract/MED/27898460. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Jamison RN, Mei A, Ross EL. Longitudinal trial of a smartphone pain application for chronic pain patients: predictors of compliance and satisfaction. J Telemed Telecare. 2018 Feb;24(2):93–100. doi: 10.1177/1357633X16679049. [DOI] [PubMed] [Google Scholar]
  • 30.Jamison RN, Mei A, Edwards RR, Ross EL. Efficacy of vibrating gloves for chronic hand pain due to osteoarthritis. Pain Med. 2018 May 1;19(5):1044–57. doi: 10.1093/pm/pnx230. [DOI] [PubMed] [Google Scholar]
  • 31.Jamison RN, Wan L, Edwards RR, Mei A, Ross EL. Outcome of a high-frequency transcutaneous electrical nerve stimulator (hfTENS) device for low back pain: a randomized controlled trial. Pain Pract. 2019 Jun;19(5):466–75. doi: 10.1111/papr.12764. [DOI] [PubMed] [Google Scholar]
  • 32.Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC. The Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):22–33;quiz 34. http://www.psychiatrist.com/jcp/article/pages/1998/v59s20/v59s2005.aspx. [PubMed] [Google Scholar]
  • 33.Cleeland CS, Ryan KM. Pain assessment: global use of the Brief Pain Inventory. Ann Acad Med Singapore. 1994 Mar;23(2):129–38. [PubMed] [Google Scholar]
  • 34.Daut RL, Cleeland CS, Flanery RC. Development of the Wisconsin Brief Pain Questionnaire to assess pain in cancer and other diseases. Pain. 1983 Oct;17(2):197–210. doi: 10.1016/0304-3959(83)90143-4. [DOI] [PubMed] [Google Scholar]
  • 35.Tait RC, Pollard CA, Margolis RB, Duckro PN, Krause SJ. The Pain Disability Index: psychometric and validity data. Arch Phys Med Rehabil. 1987 Jul;68(7):438–41. [PubMed] [Google Scholar]
  • 36.Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983 Jun;67(6):361–70. doi: 10.1111/j.1600-0447.1983.tb09716.x. [DOI] [PubMed] [Google Scholar]
  • 37.Bjelland I, Dahl AA, Haug TT, Neckelmann D. The validity of the Hospital Anxiety and Depression Scale. An updated literature review. J Psychosom Res. 2002 Feb;52(2):69–77. doi: 10.1016/s0022-3999(01)00296-3. [DOI] [PubMed] [Google Scholar]
  • 38.Sullivan MJ, Bishop SR, Pivik J. The Pain Catastrophizing Scale: development and validation. Psychol Assess. 1995;7(4):524–32. doi: 10.1037/1040-3590.7.4.524. [DOI] [Google Scholar]
  • 39.Sullivan MJ, Stanish W, Waite H, Sullivan M, Tripp DA. Catastrophizing, pain, and disability in patients with soft-tissue injuries. Pain. 1998 Sep;77(3):253–60. doi: 10.1016/s0304-3959(98)00097-9. [DOI] [PubMed] [Google Scholar]
  • 40.Osman A, Barrios FX, Gutierrez PM, Kopper BA, Merrifield T, Grittmann L. The Pain Catastrophizing Scale: further psychometric evaluation with adult samples. J Behav Med. 2000 Aug;23(4):351–65. doi: 10.1023/a:1005548801037. [DOI] [PubMed] [Google Scholar]
  • 41.Chapman SL, Jamison RN, Sanders SH. Treatment Helpfulness Questionnaire: a measure of patient satisfaction with treatment modalities provided in chronic pain management programs. Pain. 1996 Dec;68(2-3):349–61. doi: 10.1016/s0304-3959(96)03217-4. [DOI] [PubMed] [Google Scholar]
  • 42.Rosner B. Fundamentals of Biostatistics. Boston, MA: Cengage Learning; 2016. [Google Scholar]
  • 43.Stevens JP. Applied Multivariate Statistics for the Social Sciences. Fifth Edition. New York, NY: Taylor and Francis Group; 2009. [Google Scholar]
  • 44.Boulos MN, Brewer AC, Karimkhani C, Buller DB, Dellavalle RP. Mobile medical and health apps: state of the art, concerns, regulatory control and certification. Online J Public Health Inform. 2014;5(3):229. doi: 10.5210/ojphi.v5i3.4814. http://europepmc.org/abstract/MED/24683442. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Leung K, Lu-McLean D, Kuziemsky C, Booth RG, Rossetti SC, Borycki E, Strudwick G. Using patient and family engagement strategies to improve outcomes of health information technology initiatives: scoping review. J Med Internet Res. 2019 Oct 8;21(10):e14683. doi: 10.2196/14683. https://www.jmir.org/2019/10/e14683/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Gruessner V. mHealthIntelligence. 2015. Jun 4, [2020-02-26]. Mobile Health Apps Lack Physician Trust Due to Few Regulations https://mhealthintelligence.com/news/mobile-health-apps-lack-physician-trust-due-to-few-regulations.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

Comments regarding use of the pain app after a 3 month trial "Is there anything about the pain app that you would change.".


Articles from Journal of Medical Internet Research are provided here courtesy of JMIR Publications Inc.

RESOURCES