Abstract
Background
In the outpatient setting, pain management is often inadequate in patients with cancer-related pain, because of patient- and professional-related barriers in communication and infrequent contacts. The internet may provide new opportunities for monitoring these patients.
Purpose
The purpose of this study was to investigate whether internet monitoring of cancer-related pain in outpatients was feasible.
Methods
We developed an internet application that contained a pain diary, eConsult, and patient pain education. In the pain diary, patients scored their pain intensity (0–10 Numeric Rating Scale) and analgesic use daily and their side effects twice a week. Feasibility was defined as the percentage of diaries patients completed during the first 6 weeks.
Results
We included 100 outpatients. Sixteen were not evaluable due to cognitive problems (2); withdrawal of participation (2); internet problems (2), or because they were too ill (10). During the first 6 weeks, 60% of 84 evaluable patients completed their diary for at least 65% of the days (median number of diaries, 21; range, 3–42) and asked for a median of five eConsults (range, 0–37). Patients most frequently used an eConsult for questions about pain or side effects, how to use their analgesics and to improve their self-management. Over the 6-week period, current pain intensity decreased from 3.3 (SD = 2) to 2.5 (SD = 1.6, p = 0.005), and worst pain intensity decreased from 5.7 (SD = 2) to 3.8 (SD = 2.0, p < 0.001).
Conclusion
Internet monitoring of pain is feasible in most outpatients with cancer-related pain. The frequent use of the pain diary in the majority of patients indicates that those patients felt confident with the regular assessment of pain.
Electronic supplementary material
The online version of this article (10.1007/s00520-017-3877-3) contains supplementary material, which is available to authorized users.
Keywords: Pain, Cancer, eHealth, Telemonitoring, Assessment, Self-management, Nursing
Introduction
In patients with cancer, pain is one of the most frequent and fearsome symptoms. In the ambulatory setting, half of the patients reported that they were in pain and approximately 20% that they had moderate to severe pain. Patients treated with a palliative intention reported significantly more frequent that they were in pain and that they had moderate to severe pain than patients treated with a curative intention [1, 2]. In addition, pain management was inadequate in half of the patients with cancer-related pain [3, 4]. This seems to be related to both professional- and patient-related barriers regarding communication [5]. Professionals do not always ask for pain and do not always have adequate knowledge of pain management. Patients have various concerns and misconceptions about pain and analgesics, and the communication about their pain to professionals is poor [5].
This is especially important in the ambulatory setting. Pain assessment takes place at the outpatient clinic and relies on retrospective patient recall. As a result, timely adjustment of pain management is delayed. When patients are at home, they have to take a more active role in monitoring and communicating about their pain. Thereby, patients do not always know when to contact a professional and which professional they have to call.
The internet enables the monitoring of patient-reported symptoms in real-time. There is evidence for the added value of eHealth on cancer patients’ knowledge and information competence [6]. However, the effect on other patient reported outcomes is inconsistent [6, 7]. Most studies only used the internet to collect patient data; they did not give feedback to the patient and therefore did not enable additional dialog between patients and health professionals nor did they provide supplementary education [7, 8]. Additionally, most interventions were not able to respond to patient concerns in real-time [8, 9].
In general, in patients with cancer-related pain, frequent monitoring of their pain, side effects, and analgesic intake with personalized feedback seems valuable [10]. In the last few years, new technical possibilities have been developed to improve patient support, like online education about pain and analgesics to decrease patient-related barriers, and an eConsult function, like a chat or email function within a secured environment, to enhance the communication between patients and health professionals [6–8]. It is possible to combine these functions into a web application; however, hardly any study ever used a multimodal application. We therefore developed an internet application in which a patient pain diary, a patient education module, and an eConsult module were integrated. The aim of this study was to investigate whether internet monitoring of cancer-related pain in outpatients using the integrated web application was feasible. Secondary, we studied the course of patients’ pain intensity during the first 6 weeks of the internet monitoring and evaluated patients’ opinion about the web application.
Methods
The current study is a prospective cohort study to evaluate the development and thereafter, the feasibility of a multimodal web application in outpatients with cancer-related pain.
Development of the web application
For this study, we established a multidisciplinary project group, consisting of a medical oncologist, palliative care nurse specialists, a palliative care nurse researcher, and a personal health record (PHR) developer (www.myhealthmonitor.eu). The chief medical information officer and a hospital ICT consultant were involved as advisors.
The project group decided to develop a web application (www.pijn-kanker.nl) that can be used on different electronic devices, thereby enabling patients to use what they prefer, e.g., a PC, a laptop, a tablet, or a smartphone [11].
Based on the experiences in our earlier studies [1, 10, 12] and after unstructured conversations with both health professionals and patients to evaluate their experiences with pain management in daily practice at the day care clinic, the project group decided that the web application should contain at least three components: (1) pain diary to monitor patients’ pain, side effects, and analgesic intake, (2) pain education module to enhance patients’ knowledge, and (3) eConsult module to enhance the communication between the patient and the health professional.
Diary
As patients gave us the feedback that they did not want to be remembered that they had cancer when they were at home, the premise was that the diary should be as short as possible, but contained enough information to be able to monitor these patients [13]. In the pain diary, patients scored their pain intensity and their analgesic use daily and their side effects twice a week (Table 1). The diary was accessible the whole day, so patients were free when to complete their diary. Pain intensity was measured with a numeric rating scale (NRS) from 0 (no pain) to 10 (worst pain imaginable) [14]. The nurse specialist entered the prescribed analgesics as recorded in the electronic patient record, into the web application. Hereby, patients saw a personalized schedule of their prescribed analgesics in their diary. Every day, patients could register whether they had used their around-the-clock analgesics in the last 24 h and how many of the as-needed analgesics they had taken in these 24 h (Table 1). To make sure that the prescribed analgesics were kept up to date, the last question in the diary was “Has a physician changed your prescription for analgesics in the last 24 h?” When this question was answered positive, they got a message to send an eConsult with the details. The experienced opioid-related side effects were assessed using a categorical scale (none, mild, moderate, severe) (Table 1). All data were summarized in a table and also made visible in a composite graph.
Table 1.
Every day | |
---|---|
1. Please rate your pain by cycling the one number that tells how much pain you have right now? | |
0 ǀ 1 ǀ 2 ǀ 3 ǀ 4 ǀ 5 ǀ 6 ǀ 7 ǀ 8 ǀ 9 ǀ 10 ǀ | |
2. Please rate your pain by cycling the one number that best describes your pain at its worst in the last 24 h? | |
0 ǀ 1 ǀ 2 ǀ 3 ǀ 4 ǀ 5 ǀ 6 ǀ 7 ǀ 8 ǀ 9 ǀ 10 ǀ | |
3. Did you experience any new pain in the last 24 h? | |
Yes ǀ No | |
4. Did you use your around-the-clock analgesics in the past 24 h? | |
e.g., Paracetamol, 1000 mg, 4 times daily | Yes ǀ No |
e.g., Oxycodone, 20 mg, 2 times daily | Yes ǀ No |
5. How many times did you use your analgesic in the past 24 h? | |
e.g., Oxycodone IR, 10 mg, as needed | Choose:… |
6. Was your pain relief sufficient? | |
Yes ǀ No | |
7. Has a physician changed your prescription for analgesics in the last 24 h? | |
Yes ǀ No | |
8. Do you like to make a note for yourself? | |
Yes ǀ No | |
Only on Monday and Thursday | |
Did you experience any side effects? Please score below to what extent you suffer from: | |
Drowsiness | none ǀ mild ǀ moderate ǀ severe |
Nausea | none ǀ mild ǀ moderate ǀ severe |
Vomiting | none ǀ mild ǀ moderate ǀ severe |
Constipation | none ǀ mild ǀ moderate ǀ severe |
Confusion | none ǀ mild ǀ moderate ǀ severe |
See or hear things that are not real | none ǀ mild ǀ moderate ǀ severe |
Shocks in your arms or legs | none ǀ mild ǀ moderate ǀ severe |
Sweating | none ǀ mild ǀ moderate ǀ severe |
Dry mouth | none ǀ mild ǀ moderate ǀ severe |
Patient education module
Tailored web-based patient pain education was made available for all patients [1, 10]. The main topics of this patient pain education were information about underlying reasons for pain, how to use the prescribed pharmacological pain treatment, side effects, and concerns and misconceptions related to pain and pain treatment (www.erasmusmc.nl/pijnbijkanker).
eConsult module
To enhance the communication between patients and health care professionals, we developed a secured email-like functionality within the web application. Nurse specialists could remind patients to complete their diaries or ask questions in response to the information in the diary. Patients could further explain their symptoms; but more importantly, in case of questions or uncertainties, patients could contact the nurse specialist via the eConsult. The nurse specialists answered these messages within one working day. All patients were informed that in case of an emergency they had to call their general practitioner or the hospital.
All the patient data were saved on secured servers conform the National regulations and with permission of our hospital chief medical information officer. The web application contained thresholds that generated alerts. Nurse specialists monitored the data based on an algorithm. When patients gave answers outside a predefined acceptable range: scored their pain a 5 or higher, [15] scored their side effects moderate or severe, indicated that they did not use the prescribed analgesics, and answered that they had a new pain or when patients sent an eConsult, an email alert was sent to the nurse specialist who monitored that patient. Also when a health professional sent an eConsult to the patient, that patient got an email. The nurse specialist monitored all patients based on the email alerts; furthermore, they analyzed patients’ situation once a week, using the weekly overview, a composite graph and summary table. When patients’ pain management was inadequate, the nurse specialist contacted the patients via the eConsult, when more information was needed. First, they explained to patients how to deal with their pain and analgesics in their daily life. When necessary, the nurse specialists consulted the patient’s own oncologist for advice.
Preparation
The web application was pilot tested in three steps, and after every step, it was possible to adjust the application according to the guidance of the Medical Research Council [16]. First, we tested the application within the project group: to test whether the content of the application was as planned. Thereafter, three colleagues tested the application. As a result, we adapted the alerts. At first, the alerts were only visible within the web application. Based on this pilot, the alerts were emailed to the nurse practitioner who monitored that patient. Secondly, three chronic pain patients tested the application to study whether daily monitoring was possible; the content was clear to them and whether it was possible to login from home. As a result, we simplified the login. Patients’ email address was used as their username, and patients had to create a password that adhered to the highest level of safety. Finally, we tested the web application in five patients with cancer-related pain. The central questions here were whether it was possible to include patients from the outpatient clinic and whether it was possible to monitor the patients as intended (Fig. 1). Based on this pilot, we concluded that it was possible to include patients with cancer-related pain for this study and that the logistics worked well.
Cohort study
After the pilot study, we planned a cohort study to investigate whether it was feasible to monitor patients’ pain using the web application in daily practice. Between August 2013 and August 2015, patients were recruited via the outpatient oncology clinic of the Erasmus University Medical Center. Patients were eligible when they had a diagnosis of cancer, had cancer-related pain, were living at home, understood enough Dutch to use the web application, had access to the internet, and provided informed consent. When patient’s care was transferred to their general practitioner or a local hospital, patients were asked to stop using the web application.
Recruitment was conducted through the medical oncologists and the nurses working at the oncology day care unit. Informed consent was obtained from all individual participants included in the study. The investigator explained patients how to use the application, after which they were given a paper-copy user manual with screenshots. Patients were informed that their data would be used for this feasibility study. They could use the system for as long as they preferred, unless care was transferred to another setting. During the study, patients were monitored by nurse specialists’ palliative care. When necessary, they contacted patient’s own oncologist to discuss whether changes in pain treatment were required.
Various data were collected from the web application for this study: the percentage of diaries patients completed (feasibility), pain assessments, the frequency in which analgesics were changed, and the number of eConsult conservations. A random sample of 11 patients was semi-structured interviewed after 6 weeks, to get an insight in the usability of the web application and patients’ satisfaction.
Data analysis
For this study, we considered the internet application feasible when 70% of the patients completed the diary for at least 65% of the days, as measured during the actual follow-up in the first 6 weeks. Based on this, with a power of 0.90 and an α = 0.05, a total sample of 81 evaluable patients was required. When patients were admitted to the hospital, the data gathered during hospital stay were excluded from the analysis.
Data were analyzed using Statistical Package SPSS version 22. The data during the first 6 weeks were used for the study of the feasibility; additionally, we studied the total period patients used the application. Descriptive statistics and frequency distributions were generated for patients’ demographic and diary-related characteristics. To determine the differences in the pain intensities between baseline and 6 weeks, we used non-parametric tests (Wilcoxen Signed Rank test). A p value of < 0.05 (two-sided) was considered statistically significant.
All interviews were audiotaped and were transcribed verbatim. We performed the analyses using the constant comparative method. The themes were independently derived from the interviews by two researchers independently.
Results
In total, we included 100 patients. Sixteen of them (16%) were not evaluable because they were too ill to start the study (n = 10), withdrew participation (n = 2), had language/cognitive problems (n = 2), or internet problems (n = 2; Fig. 1). Characteristics of the 84 evaluable patients are summarized in Table 2. The median age was 61 years (range, 25–76 years) and 48% was male. Most patients (84%) had advanced cancer, predominantly breast (25%), gastrointestinal (26%), or urogenital carcinoma (16%). Ninety percent used strong opioids around-the-clock, 95% had a prescription for as-needed opioids, 87% had a prescription for non-opioids, and a third also used an adjuvant analgesic (Table 2).
Table 2.
Evaluable patients N = 84 | |
---|---|
Sex, male | 40 (48%) |
Age, years, mean (SD, range) | 59 (11, 25–76) |
Tumor | |
Breast | 21 (25%) |
Gastrointestinal | 22 (26%) |
Urogenital | 13 (16%) |
Sarcoma | 8 (10%) |
Head and neck | 4 (5%) |
Lung | 2 (2%) |
Gynecological | 3 (4%) |
Others | 11 (13%) |
Metastasis (yes) | 70 (84%) |
Current pain intensity, mean (SD) Worst pain intensity, mean (SD) |
3.4 (2.0) 5.8 (2.1) |
WHO step 1 Paracetamol NSAID |
73 (87%) 68 32 |
WHO step 2 | 0 |
WHO 3 opioid Morphine Fentanyl Oxycodone Hydromorphone |
76 (90%) 8 38 26 4 |
WHO 3 rescue medication Morphine Oxycodone IR Hydromorphone IR Fentanyl (nasal) Fentanyl (sublingual) |
80 (95%) 13 55 3 2 7 |
Adjuvant analgesics Gabapentin Pregabalin Amitriptyline Carbamazepine Esketamine |
27 (32%) 4 19 2 1 1 |
MEDD, mg, median (range) | 90 (15–540) |
SD standard deviation, MEDD morphine equivalent daily dose, mg milligram
During the first 6 weeks, patients completed a median of 72% of the diaries (range, 18–100%). Sixty percent of the patients (confidence interval (CI) 45–69%) completed their diary for at least 65% of the days. Patients did not complete their diaries every day. The main reasons for this were that they forgot it, had no or not so much pain, or were out for a day trip. In this period, 40 patients stopped using the web application due to several reasons: physical deterioration or death (n = 26), cognitive problems (n = 5), no pain anymore (n = 4), transition of care (n = 3), and refusal (n = 2; Fig. 1). Patients completed a median of 21 diaries (range, 3–42) and asked for a median of five eConsults (range, 0–37). Patients most frequently used an eConsult for questions about pain, side effects, how to use their analgesics, and how to improve their self-management. Analgesics were changed twice (range, 1–8).
In the 48 patients with both a pain registration at baseline and at 6 weeks, current pain intensity decreased from 3.3 (SD = 2) to 2.5 (SD = 1.6; p = 0.005), and worst pain intensity decreased from 5.7 (SD = 2) to 3.8 (SD = 2.0; p < 0.001; Fig. 2).
Overall, patients used the web application during a median of 45 days (range, 1–545; Fig. 1), in which they completed a median of 29 diaries (range, 1–396). Patients asked for a median of five eConsults (range, 0–58). Analgesics were changed thrice (range, 1–11).
Patients were very satisfied using the web application (Table 3). Almost all patients were able to use the web application by themselves. Especially when patients became very ill, some spouses used the web application for the patients.
Table 3.
Web application |
–All patients were positive about the web application |
–Preference for different electronic devices: elderly patients preferred to use a PC or tablet (easier to read), while younger patients preferred a smartphone |
–1 patient had occasional difficulties log in due to technical problems |
–None of the patients had suggestions for adjustments |
Content |
–Home screen was very clear |
–User manual gave confidence to use the web application |
–Satisfied with the time needed to complete the pain diary (< 3 min) |
–Inconvenient that it was not possible to complete the pain diary afterwards |
–eConsult module had an added value |
–eConsult module had a lower threshold than a phone |
–Web application gained better support and communication |
Discussion
In daily practice, internet monitoring of pain seems to be feasible in most patients with cancer-related pain. Although we did not meet our primary endpoint of 60%, instead of the predefined 70%, the patients completed the diary for at least 65% of the days. The frequent use of the pain diary in the majority of patients indicates that those patients did not perceive barriers for the frequent assessment of pain and side effects. Especially eConsults were frequently asked, probably enhancing patients’ self-management. Moreover, during the first 6 weeks, patients’ pain intensity decreased significantly. However, in daily practice, patients did not complete their diaries every day. In the first 6 weeks, patients completed a median of 72% of the diaries, calculated over the actual period of patient follow-up. Patients were very positive about the web application and were satisfied with the time needed to complete the diary.
A multimodal web application is recommended for daily practice, because patients have different needs in supporting their self-management [17, 18]. Patients may decide for themselves which kind of support they prefer to use at a specific moment. Some patients of the current study preferred the eConsult, to have a direct connection with a health professional. Other patients used the diary for a prolonged period (396 days). They also used the composite graph and summary table to have an overview over the last period to enhance their self-management. For example, after having a look at the summary table, one of the patients asked himself why he needed extra as-needed analgesics every Tuesday. He realized himself that the Tuesdays were too busy, and after adjusting his daily activities, his pain decreased and he did not need any extra analgesics anymore. Therefore, the web application seems feasible in daily practice, although not all patients completed their diaries every day.
Despite the fact that our included patients scored their pain as mild at baseline, their pain intensity decreased significantly during the first 6 weeks of the monitoring. Although this study was primary conducted to investigate the feasibility of the web application in patients with cancer-related pain, it is important that we also were able to show a significant change in a patient-reported outcome measurement such as pain. Most studies concerning eHealth and (web) applications did not measure any patient-reported outcome, or when they did, they did not find any difference [6–8].
We have chosen to develop a web application which can be used on multiple devices interchangeably (e.g., PC, laptop, tablet, or smartphone), allowing patients to use the device they prefer. In this study, elderly patients mainly used a tablet and younger patients (< 35 years) preferred a smartphone. Most other studies concerning electronic symptom monitoring used a single device, mostly a PC or laptop [7, 8, 11]. Taylor et al. were the first who tested participants’ preferences for the different modes in healthy volunteers [11]. Most people preferred the PC although it is less portable than the other devices. Short messaging service (SMS) was scored less appealing due to the costs and the inability to enter free text. Scrolling through the questions was cumbersome on particular smartphones and to a lesser extent on tablet computers [11]. They concluded that persons’ preference for a particular device may be situation dependent, and therefore, future systems should enable various devices to be used exchangeable [11], as we did in our study.
Strengths and limitations
As all studies, this study has several limitations. We do realize ourselves that this kind of symptom monitoring is not possible for all patients, because not everyone has access to the internet. However, in the Netherlands, 97% of the citizens and 85% of the people > 65 years have access to the internet [19]. Although we intended to include a representative sample of our ambulatory patients with cancer-related pain, we actually included a group of patients in the palliative phase of their disease with a short life expectancy, as is evident from the reasons why patients dropped out during follow-up. In addition, we only interviewed a random sample of the included patients to evaluate their opinion on the web application. In future studies, all patients should be evaluated structurally about their views. Besides this, in future studies, the feasibility should also be structurally evaluated in professionals. Furthermore, it is questionable whether only the questions from the diary are enough to monitor these patients. However, as shown in this study, the eConsult module has an added value to further personalize patients’ monitoring. We showed a decrease in patients’ pain intensity in the cohort study. A future RCT should demonstrate whether this reduction in pain intensity persists when compared with a control group.
Conclusion
Monitoring of pain via the internet is feasible in patients with cancer-related pain. In the future, it is important to investigate the efficacy and the cost-effectiveness of the web application in a randomized controlled trial.
Electronic supplementary material
Source of Funding
This work was financially supported by a grant from the NutsOhra Foundation, Amsterdam, the Netherlands, and the Coolsingel Foundation, Rotterdam, the Netherlands, without any influence on study design, analysis, interpretation, or presentation.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflicts of interest.
Ethical approval
The study protocol was approved by the Institutional Review Board of the Erasmus MC (MEC-2012-254).
Footnotes
Electronic supplementary material
The online version of this article (10.1007/s00520-017-3877-3) contains supplementary material, which is available to authorized users.
References
- 1.Oldenmenger WH, Witkamp FE, Bromberg JEC, Jongen JLM, Lieverse PJ, Huygen FJPM, Van Zuijlen L, Van der Rijt CCD. To be in pain (or not): a computer enables outpatients to inform their physician. Ann Oncol. 2016;27(9):1776–1781. doi: 10.1093/annonc/mdw250. [DOI] [PubMed] [Google Scholar]
- 2.van den Beuken-van Everdingen MH, Hochstenbach LM, Joosten EA, Tjan-Heijnen VC, Janssen DJ. Update on prevalence of pain in patients with cancer: systematic review and meta-analysis. J Pain Symptom Manage. 2016;51(6):1070–1090 e1079. doi: 10.1016/j.jpainsymman.2015.12.340. [DOI] [PubMed] [Google Scholar]
- 3.Enting RH, Oldenmenger WH, Van Gool AR, van der Rijt CC, Sillevis Smitt PA. The effects of analgesic prescription and patient adherence on pain in a dutch outpatient cancer population. J Pain Symptom Manag. 2007;34(5):523–531. doi: 10.1016/j.jpainsymman.2007.01.007. [DOI] [PubMed] [Google Scholar]
- 4.Deandrea S, Montanari M, Moja L, Apolone G. Prevalence of undertreatment in cancer pain. A review of published literature. Ann Oncol. 2008;19(12):1985–1991. doi: 10.1093/annonc/mdn419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Oldenmenger WH, Sillevis Smitt PA, van Dooren S, Stoter G, van der Rijt CC. A systematic review on barriers hindering adequate cancer pain management and interventions to reduce them: a critical appraisal. Eur J Cancer. 2009;45(8):1370–1380. doi: 10.1016/j.ejca.2009.01.007. [DOI] [PubMed] [Google Scholar]
- 6.Slev VN, Mistiaen P, Pasman HR, Verdonck-de Leeuw IM, van Uden-Kraan CF, Francke AL. Effects of eHealth for patients and informal caregivers confronted with cancer: a meta-review. Int J Med Inform. 2016;87:54–67. doi: 10.1016/j.ijmedinf.2015.12.013. [DOI] [PubMed] [Google Scholar]
- 7.Dickinson R, Hall S, Sinclair JE, Bond C, Murchie P. Using technology to deliver cancer follow-up: a systematic review. BMC Cancer. 2014;14:311. doi: 10.1186/1471-2407-14-311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Allsop MJ, Taylor S, Mulvey MR, Bennett MI, Bewick BM. Information and communication technology for managing pain in palliative care: a review of the literature. BMJ Support Palliat Care. 2016;5:481–489. doi: 10.1136/bmjspcare-2013-000625. [DOI] [PubMed] [Google Scholar]
- 9.Strasser F, Blum D, von Moos R, Cathomas R, Ribi K, Aebi S, Betticher D, Hayoz S, Klingbiel D, Brauchli P, Haefner M, Mauri S, Kaasa S, Koeberle D, Swiss Group for Clinical Cancer R The effect of real-time electronic monitoring of patient-reported symptoms and clinical syndromes in outpatient workflow of medical oncologists: E-MOSAIC, a multicenter cluster-randomized phase III study (SAKK 95/06) Ann Oncol. 2016;27(2):324–332. doi: 10.1093/annonc/mdv576. [DOI] [PubMed] [Google Scholar]
- 10.Oldenmenger WH, Sillevis Smitt PA, van Montfort CA, de Raaf PJ, van der Rijt CC. A combined pain consultation and pain education program decreases average and current pain and decreases interference in daily life by pain in oncology outpatients: a randomized controlled trial. Pain. 2011;152(11):2632–2639. doi: 10.1016/j.pain.2011.08.009. [DOI] [PubMed] [Google Scholar]
- 11.Taylor S, Allsop MJ, Shaw J, Bennett MI, Jones R, Bewick BM. The feasibility of collecting patient reported pain data using a system delivered across four modes of technology. Pain Med. 2015;16(11):2212–2213. doi: 10.1111/pme.12811. [DOI] [PubMed] [Google Scholar]
- 12.de Raaf PJ, de Klerk C, Timman R, Busschbach JJ, Oldenmenger WH, van der Rijt CC. Systematic monitoring and treatment of physical symptoms to alleviate fatigue in patients with advanced cancer: a randomized controlled trial. J Clin Oncol. 2013;31(6):716–723. doi: 10.1200/JCO.2012.44.4216. [DOI] [PubMed] [Google Scholar]
- 13.Rolstad S, Adler J, Ryden A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14(8):1101–1108. doi: 10.1016/j.jval.2011.06.003. [DOI] [PubMed] [Google Scholar]
- 14.Cleeland CS, Ryan KM. Pain assessment: global use of the brief pain inventory. Ann Acad Med Singap. 1994;23(2):129–138. [PubMed] [Google Scholar]
- 15.Vissers KC, Besse TC, Groot CM, Raats CJI, Rosenbrand CJGM, Vonk SY, Huibers MJW (2008) Richtlijn diagnostiek en behandeling van pijn bij patiënten met kanker. van Zuiden Communications B.V., Alphen aan den Rijn
- 16.Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Int J Nurs Stud. 2013;50(5):587–592. doi: 10.1016/j.ijnurstu.2012.09.010. [DOI] [PubMed] [Google Scholar]
- 17.Hochstenbach LM, Zwakhalen SM, Courtens AM, van Kleef M, de Witte LP. Feasibility of a mobile and web-based intervention to support self-management in outpatients with cancer pain. Eur J Oncol Nurs. 2016;23:97–105. doi: 10.1016/j.ejon.2016.03.009. [DOI] [PubMed] [Google Scholar]
- 18.van Houtum L, Rijken M, Heijmans M, Groenewegen P. Self-management support needs of patients with chronic illness: do needs for support differ according to the course of illness? Patient Educ Couns. 2013;93(3):626–632. doi: 10.1016/j.pec.2013.08.021. [DOI] [PubMed] [Google Scholar]
- 19.Netherlands S (2016) ICT gebruik van personen. Accessed 28–09-2016 2016 http://statline.cbs.nl/Statweb/publication/?DM=SLNL&PA=71098ned&D1=33,55-59,93-95,97-100,102-104,106-109,112-113,119,124-133&D2=0,6&D3=0,l&HDR=G2,G1&STB=T&VW=T
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.