Abstract
Background
Carers experience unique needs while caring for someone with cancer. Interventions that address carers’ needs and well-being have been developed and tested; however, the use of smartphone apps to support adult carers looking after another adult with cancer has not been assessed.
Objective
The objective of this study was to test the feasibility, usability, and acceptability of a smartphone app, called the Carer Guide App, for carers of people with colorectal cancer.
Methods
We recruited carers of people with colorectal cancer from outpatient day oncology units and provided them with access to the smartphone app for 30 days. Carers had access to video instructions and email contact details for technical support. Carers received 2 email messages per week that directed them to resources available within the app. Carers completed demographic questions at baseline and questions related to feasibility and usability at 30 days post app download. We used recruitment and attrition rates to determine feasibility and relevance of content to carers’ needs as self-reported by carers. We assessed usability through the ease of navigation and design and use of technical support or instructional videos. Acceptability was measured through self-reported usage, usage statistics provided by Google Analytics, and comments for improvement.
Results
We recruited 31% (26/85) eligible carers into the trial. Of the 26 carers, the majority were female (19, 73%), on average 57 years of age, were caring for a spouse with cancer (19, 73%), and held a university degree (19, 73%). Regarding feasibility, carers perceived the content of the Carer Guide App as relevant to the information they were seeking. Regarding usability, carers perceived the navigation and design of the app as easy to use. Of the 26 carers, 4 (15%) viewed the downloading and navigation video and 7 (27%) used the contact email address for queries and comments. Acceptability: On average, carers used the smartphone app for 22 minutes (SD 21 minutes) over the 30-day trial. Of 26 participants, 19 completed a follow-up questionnaire. Of 19 carers, 7 (37%) logged on 3 to 4 times during the 30 days and 5 (26%) logged on more than 5 times. The majority (16/19, 84%) of carers stated that they would recommend the app be available for all carers. Comments for improvement included individualized requests for specific content.
Conclusions
The Carer Guide App was feasible and usable among carers of people with colorectal cancer. Acceptability can be improved through the inclusion of a variety of information and resources. A randomized controlled trial is required to assess the impact of the Carer Guide App on carers’ health and well-being.
Keywords: cancer, carer, mobile app, smartphone, technology, mobile phone
Introduction
In Australia, there are over 2.86 million informal carers who are not paid for the care they provide [1] and who often perform caring duties with limited training or guidance [2]. Many people with cancer rely on carers, such as family members or friends, for support during their illness trajectory [3] and for management of the side effects of treatment [3]. Carers looking after someone with cancer may experience unique needs related to their own health and well-being while in the caring period [4] and for as long as 5 years after the caring period [5].
A systematic review highlighted that Web-based interventions were feasible for use among cancer carers [6]; however, carers’ preference for information delivery varies across the disease trajectory. Smartphone apps can support carers by providing access to information, support, and resources from any place where an individual has internet connection [7]. Smartphone ownership continues to increase worldwide [8], creating an opportunity for apps to deliver health care content to large audiences [9]. Previous studies have assessed the use of smartphone apps among carers looking after a child with cancer [10] and looking after people with a variety of chronic illnesses [11]. Smartphone apps have been shown to improve participation in self-management of chronic illness [11], improve communication with health professionals [11], and promote detection of changes in cancer-related pain in children [10]. Further, several studies have evaluated the development of smartphone apps for carers of people with diabetes [12], adults looking after a child with cancer [13], and people living with back and spinal cord anomalies and their carers [14] and have described positive attitudes toward receiving support through smartphone apps. To our knowledge, no smartphone app has been trialed among carers looking after another adult with cancer [6]. In this study, we aimed to test the feasibility, usability, and acceptability of a smartphone app, called the Carer Guide App, in addressing the unmet needs of cancer carers.
Methods
Design
This study was a 30-day, single-arm pilot trial involving carers supporting people diagnosed with cancer. We chose colorectal cancer as it affects both men and women and is the third most common cancer worldwide [15,16].
We recruited carers of colorectal cancer patients from the second largest public health service and the largest not-for-profit private health service in Victoria, Australia. During 6 months, the public health service treated 105 people with colorectal cancer and the private health service had 273 admissions. Between October 2017 and May 2018, we approached carers during the patients’ chemotherapy appointment and provided them with an overview of the study. Patients nominated carers as being their main support person at home. Interested carers were provided with a recruitment pack (participant information sheet, consent form, and demographic questionnaire) to take home. When carers were unavailable at appointments, we approached patients, gave them an overview of the study, and asked whether their carer would be willing to participate. We asked the patients to take home the carer recruitment pack and sought initial consent via telephone to the carer within 48 hours to confirm participation. All carers provided written informed consent.
Adult carers of adult patients with colorectal cancer who were receiving chemotherapy or radiation treatment as day patients, either initial, recurrent, or secondary to surgery, were invited to participate. Carers were required to be in possession of a smartphone or tablet device and have internet access. At the end of the 30-day trial, carers received 2 reminder phone calls to return follow-up questionnaires. Follow-up occurred between November 2017 and May 2018. We obtained ethics approval from Deakin University (2017-218), Eastern Health (HREC/17/EH/24), and Epworth HealthCare (EH2016-169).
Intervention
We developed the Carer Guide App using a codesign approach to address needs that carers identified in previous research [6,17,18]. A full description of the development process of the Carer Guide App is currently under review. The Carer Guide App was organized into 7 sections, each providing detailed information to address carers’ needs: Cancer Information, Carer Information, Well-being, My Social Network, Financial and Legal, Hospital Information, and Medical Terminology. In addition, two resources were provided: a Notepad and Contacts, which contained contact details for national information and support organizations and allowed carers to enter personal contact information. All carers had access to the Carer Guide App for 30 days and received 2 email messages each week directing them to information and services available within the app. Email messages related to carer health and well-being and support were available to carers. Messages were developed for each section of the Carer Guide App and provided information or reminders about the support that was available and where to locate this information within the Carer Guide App.
Upon enrollment in the study, carers provided a contact email address. We entered the nominated email address into the Carer Guide App system, which sent an automatically generated welcome email to carers. The welcome email included a link to download the Carer Guide App, a user identification number, password, and links to videos with instructions on how to download and navigate the Carer Guide App on both Android and iOS devices. Carers were provided with an email address to contact the research team for further technical support if required.
Measures
Demographic Characteristics
We collected information on carers’ age, gender, living situation, relationship to the patient, level of education, and device type used for the study. Likert scales were developed to measure elements of feasibility, usability, and acceptability.
Feasibility
Feasibility included carers’ perception of the relevance of app content and accompanying email messages. We measured app content on a scale from extremely unuseful (1) to extremely useful (5). The helpfulness of email reminders was measured on a scale of extremely unhelpful (1) to extremely helpful (5). For the relevance of the content and usefulness of messages, carers could also respond with option 6, which represented “I did not use this icon” and “did not apply to me,” respectively. We developed Likert scales for the purpose of informing the relevance of each section of the Carer Guide App to inform future iterations. This follows guidelines where testing evaluation procedures can occur during feasibility studies [19]. A similar process has been used in the development of Web-based interventions, where scales have been validated during subsequent trials [20].
Usability
Usability included the navigation and readability of the app and was measured from strongly disagree (1) to strongly agree (5). We included open-ended questions to allow carers to provide comments for improving the Carer Guide app. We also measured usability by the number of people who accessed the instructional videos and who emailed the research team for technical support.
Acceptability
Acceptability included responses about carers’ use of the Carer Guide App for information and support, their desire to continue to use the app after the 30-day trial, and their feelings toward the Carer Guide App being made available to all carers. We measured items from strongly disagree (1) to strongly agree (5). App usage was measured quantitatively through self-reported usage and through Google Analytics records. Google Analytics tracked the number of log-ins, the duration of log-in, and the pages accessed.
Statistical Analysis
We analyzed data using IBM SPSS (Version 25; IBM Corp). Feasibility, usability, and acceptability were analyzed by the frequency of agree (4) and strongly agree (5) responses. Demographic data and app usage from Google Analytics were analyzed using descriptive statistics.
Results
Demographic Characteristics
Of 85, a total of 26 (31%) carers consented to participate in the study, of which 20 (77%) used the Carer Guide App and 19 (73%) completed the follow-up questionnaires (attrition rate 7/26, 27%). Of the 7 carers who did not complete the follow-up questionnaire, 1 used the app and 6 did not use the app. There was 1 person who completed the follow-up questionnaire but did not use the app as he or she was not in need of it at the time. Figure 1 outlines the recruitment process.
Figure 1.
Flowchart of the recruitment process.
The mean age of carers was 57 (SD 12; range 30-79) years. Of the 26 carers, the majority were female (19, 73%), caring for a spouse (26, 73%), and held a tertiary-level qualification (19, 73%); furthermore, the main device type used by carers was smartphones (15, 58%). There were 2 carers who accessed the Carer Guide App on their desktop computers (Web app version). Table 1 outlines the full demographic characteristics of the sample.
Table 1.
Demographic characteristics of the recruited carer participants (N=19).
| Characteristics | Participants, n (%) | ||
| Device used | |||
|
|
Android mobile phone | 5 (19) | |
|
|
iOS mobile phone | 10 (38) | |
|
|
iOS tablet | 3 (12) | |
|
|
Computer desktop | 2 (8) | |
| Gender | |||
|
|
Female | 19 (73) | |
|
|
Male | 7 (26) | |
| Relationship status | |||
|
|
Spouse | 19 (73) | |
|
|
Other (parent, adult child, or sibling) | 7 (27) | |
| Living with patient full time | |||
|
|
Yes | 21 (81) | |
|
|
No | 5 (19) | |
| Education level | |||
|
|
Secondary | 7 (27) | |
|
|
Tertiary | 19 (73) | |
Feasibility
Appropriateness of App Content
Of 19, the majority of carers rated Cancer Information (13, 68%), Carer Information (12, 63%), and Medical Terminology (12, 63%) as somewhat or extremely useful; the sections with the lowest agreement rate for usefulness were My Social Network (3, 16%) and Financial and Legal (4, 21%). Overall, the vast majority (16/19, 84%) of carers agreed or strongly agreed that the built-in links went to relevant websites. Table 2 provides detailed information on the usefulness of each section of the Carer Guide App.
Table 2.
Carers’ responses of the usefulness of each section of the Carer Guide App (N=19).
| App section | Mediana | Agree or strongly agree responses (n=19), n (%) |
| Cancer Information | 4 | 13 (68) |
| Carer Information | 4 | 12 (63) |
| Medical Terminology | 4 | 12 (63) |
| Well-being | 4 | 9 (47) |
| Email messages | 4 | 8 (42) |
| Contacts | 3 | 8 (42) |
| Hospital Information | 3 | 7 (37) |
| Notepad | 3 | 6 (32) |
| Financial and Legal | 3 | 4 (21) |
| My Social Network | 3 | 3 (16) |
aResults from a 5-point Likert scale (1=extremely unuseful to 5=extremely useful).
Reminder Emails
Reminder emails were perceived as helpful by one-third of carers. The prompt to take time out for yourself related to well-being and was rated as helpful by the majority of carers (12/19, 63%), followed by Contact reminders for information on holiday house programs (10/19, 53%) and Carer Information reminders to stay physically active (10/19, 53%).
Usability
The appearance and function of the Carer Guide App were reported as usable by the majority of carers; 17/19 (89%) found the font size appropriate, 13/19 (68%) found it easy to move between pages, and 11/19 (58%) stated that required information was easy to find. There were 4 carers who viewed the video instructions on how to download and navigate the Carer Guide App. The Carer Guide App’s email address was used by 7 carers to contact the research team with questions related to setting up the app on their phone or to provide comments in response to reminder emails sent.
Acceptability
The majority of carers (16/19, 84%) agreed that the Carer Guide App should be available for all carers. Furthermore, 42% (8/19) stated that they used the app when they wanted more information and 42% (8/19) stated that they would like to continue using the app, while only 11% (2/19) reported that they used the app for support.
Usage
Findings from Google Analytics showed that over the 30-day trial period, a total of 71 log-ins occurred on the app. Of 19, more than one-third of carers (7, 37%) logged in 3-4 times during the 30 days and one-quarter (5, 26%) of carers logged in more than 5 times. On average, carers used the Carer Guide App twice (range 0-11), and median use was 17 minutes (interquartile range 4-35). Nearly half, 8/19 (42%) of carers used the Carer Guide app for longer than 30 minutes. According to self-reported usage, one-quarter (5/19, 26%) of carers used the Carer Guide App once a week. The top three most frequently used sections of the Carer Guide App were Cancer Information, Notepad, and Well-being, which were accessed 33, 33, and 31 times, respectively. Table 3 provides details of usage statistics.
Table 3.
Carer Guide App usage including frequency of log-ins, duration of log-ins, and sections visited (N=19).
| Characteristic | Value | |
| Frequency of log-ins (n=19), n (%) | ||
|
|
1-2 log-ins in 30 days | 7 (37) |
|
|
3-4 log-ins in 30 days | 7 (37) |
|
|
>5 log-ins in 30 days | 5 (26) |
| Duration of use per log-in (minutes) | ||
|
|
Mean (SD) | 22 (21) |
|
|
Range | 0-68 |
|
|
Total duration of use over 30 days | 403 |
| Total number of visits per Carer Guide App section (n=207), n (%) | ||
|
|
Cancer information | 33 (16) |
|
|
Carer information | 26 (13) |
|
|
Well-being | 31 (15) |
|
|
My social network | 19 (9) |
|
|
Financial and legal | 16 (8) |
|
|
Contacts | 14 (6) |
|
|
Hospital information | 20 (10) |
|
|
Notepad | 33 (16) |
|
|
Medical terminology | 15 (7) |
Qualitative Feedback
Of 19, 11 (58%) carers provided comments for improvements to the Carer Guide App. The majority of comments related to additions of items to the content, including the ability to journal events and symptoms, record a medical history and medical alerts, send to others for their use, and print off information sheets for the patient. Other comments related to content included more specific information about “red flags” for patients and carers; when to call the doctor; symptom information and management; medication information; contact details of doctors, nurses, and oncology wards; and information in different languages. Other comments included discrepancies in the tone of language used in medical terminology definitions, that the app should be delivered earlier in the caring period, and that the role of the carer needs to be more clearly highlighted, in particular, that the role varies across the illness trajectory.
Of all carers, 2 noted that the Carer Guide App gave them the confidence to deal with cancer-related issues and that it was the first time they felt someone cared about their needs.
Discussion
Principal Findings
The Carer Guide App was developed in collaboration with carers to improve their access to information and support while looking after another adult with cancer. Overall, the Carer Guide App was a feasible option given the feedback received from participants. Carers perceived the content to be appropriate, and the links within the Carer Guide App led to relevant information. Certain sections of the app were perceived as more useful than others. However, all sections of the app received positive responses. These findings are comparable with Web-based interventions among people living with prostate cancer, where 47% of the people were satisfied with the program [21]. Differences in the perceived usefulness of the app sections may have several explanations. The type and amount of unmet needs experienced by carers constantly change [5]; therefore, a 30-day period to assess the appropriateness of content in addressing carers’ needs may not be long enough. Similarly, carers may experience different types of needs during different stages of the illness trajectory [22-25]. The static information provided in the Carer Guide App may not support needs as they evolve. Further, carers who had been in the carer role for a prolonged period may already have sourced the information and support required. It is possible that the Carer Guide App provided carers with information and resources that they were previously unaware of; however, more research is required to assess this. Despite these findings, 85% (16/26) of carers stated that the Carer Guide App should be available to all carers, and this is comparable to other studies evaluating the feasibility of cancer-related Web-based interventions [21].
Generally, carers found the email messages helpful in highlighting resources available within the Carer Guide App. Carers perceived the structure of the Carer Guide App as easy to navigate and locate information. Email support was used by several carers to enhance their experience and provide further instruction on using the app. These findings confirm the usefulness of technical support to aid the use of technology-based interventions for carers previously reported in the literature [6].
With a total of 71 log-ins and an average usage of 22 minutes over the 30-day trial period, the Carer Guide App was assessed to be acceptable to carers. Users often disengaged from sites within 10-20 seconds if they were unable to locate information [26]. As the average use in our sample was 22 minutes, this suggests that the Carer Guide App was acceptable for the information and resources provided within it. App usage varied greatly depending on the purpose of the app, and previous research has required participants to log in a specific number of times [10]. In another study involving a smartphone app providing static information for dementia, usage was on average 5 minutes for the duration of the 4-week period [27]. Further, findings of previous research suggested that smartphone apps did not impose a time burden on participants, and they could be incorporated into a daily routine from anywhere between 3 days to 1 year [10,11]. Carers reported that the Carer Guide App should be available to all carers, and suggestions for further improvements were mainly individual requests for specific information, resources, or design changes.
The recruitment rate of the study was modest (26/85, 31%); however, this is consistent with findings from previous research, where recruitment among this population can vary from 20% to 60% for technology-based intervention studies [6].
Future Research Directions
Carers’ willingness to use smartphone apps and their need for this type of support may be impacted by patients’ stage of illness, carers’ knowledge of support available, and carers’ current support network. Future research may consider assessing smartphone app support at a certain stage of patients’ illness, for example, at diagnosis, to test its potential impact. This may provide information about the relevance of content to carers’ current and future needs, the ability of a smartphone app to meet needs, and carers’ likelihood of using a smartphone app during this stressful period. Future studies may also consider measuring carers’ knowledge of alternative support available and the presence and strength of their support network.
Limitations
The sample was largely homogenous, with the majority of participants being female and highly educated, with all participants speaking English. In the general population in Australia, 31% has tertiary-level educational qualifications, [28] compared with 73% (19/26) of our sample, and 21% speak a language other than English at home [29]. Future studies should include larger samples to gain insights into feasibility, usability, and acceptability among a more heterogeneous sample. The duration of the caring period and patients’ stage of illness were not collected, which further limited the ability to determine whether the Carer Guide App was more feasible during specific stages of the caring or illness trajectory.
Conclusions
A smartphone app may be appropriate for providing carers with more information and resources if the content is specific to their needs and provided at an optimal time during the caring period. The Carer Guide App is a feasible and acceptable method for delivering information and support to carers of people with colorectal cancer. Future iterations should include more specific information to enhance the acceptability of the App. Further research, including a randomized controlled trial, is recommended to assess whether a smartphone app has the potential to improve health and well-being outcomes and reduce unmet needs among carers.
Acknowledgments
This research was supported by scholarships from the School of Nursing and Midwifery, Deakin University, and the Eastern Health Foundation. We thank the participants who contributed to this study.
Footnotes
Conflicts of Interest: None declared.
References
- 1.Deloitte. 2015. The economic value of informal care in Australia in 2015 https://www2.deloitte.com/au/en/pages/economics/articles/economic-value-informal-care-Australia-2015.html .
- 2.Adelman RD, Tmanova LL, Delgado D, Dion S, Lachs MS. Caregiver burden: a clinical review. JAMA. 2014 Mar 12;311(10):1052–60. doi: 10.1001/jama.2014.304.1840211 [DOI] [PubMed] [Google Scholar]
- 3.Ockerby C, Livingston P, O'Connell B, Gaskin CJ. The role of informal caregivers during cancer patients' recovery from chemotherapy. Scand J Caring Sci. 2013 Mar;27(1):147–55. doi: 10.1111/j.1471-6712.2012.01015.x. [DOI] [PubMed] [Google Scholar]
- 4.Lambert S, Levesque J, Girgis A. The impact of cancer and chronic conditions on caregivers and family members. In: Koczwara B, editor. Cancer and chronic conditions: addressing the problem of multimorbidity in cancer patients and survivors. Singapore: Springer; 2016. pp. 159–203. [Google Scholar]
- 5.Lambert SD, Hulbert-Williams N, Belzile E, Ciampi A, Girgis A. Beyond using composite measures to analyze the effect of unmet supportive care needs on caregivers' anxiety and depression. Psychooncology. 2018 Jun;27(6):1572–1579. doi: 10.1002/pon.4696. [DOI] [PubMed] [Google Scholar]
- 6.Heynsbergh N, Heckel L, Botti M, Livingston PM. Feasibility, useability and acceptability of technology-based interventions for informal cancer carers: a systematic review. BMC Cancer. 2018 Dec 02;18(1):244. doi: 10.1186/s12885-018-4160-9. https://bmccancer.biomedcentral.com/articles/10.1186/s12885-018-4160-9 .10.1186/s12885-018-4160-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Deloitte. 2016. [2018-08-02]. Mobile Consumer Survey 2016: The Australian Cut http://landing.deloitte.com.au/rs/761-IBL-328/images/tmt-mobile-consumer-2016-final-report-101116.pdf .
- 8.Ericsson. 2015. Jun 03, [2018-03-30]. Ericsson Mobility Report: 70 percent of world's population using smartphones by 2020 https://www.ericsson.com/en/press-releases/2015/6/ericsson-mobility-report-70-percent-of-worlds-population-using-smartphones-by-2020 .
- 9.Australian Communications and Media Authority. 2017. [2018-08-02]. Communications report 2016-17 https://www.acma.gov.au/theACMA/communications-report .
- 10.Stinson JN, Jibb LA, Nguyen C, Nathan PC, Maloney AM, Dupuis LL, Gerstle JT, Alman B, Hopyan S, Strahlendorf C, Portwine C, Johnston DL, Orr M. Development and testing of a multidimensional iPhone pain assessment application for adolescents with cancer. J Med Internet Res. 2013 Mar 08;15(3):e51. doi: 10.2196/jmir.2350. http://www.jmir.org/2013/3/e51/ v15i3e51 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Wang J, Wang Y, Wei C, Yao NA, Yuan A, Shan Y, Yuan C. Smartphone interventions for long-term health management of chronic diseases: an integrative review. Telemed J E Health. 2014 Jun;20(6):570–83. doi: 10.1089/tmj.2013.0243. [DOI] [PubMed] [Google Scholar]
- 12.Holtz BE, Murray KM, Hershey DD, Dunneback JK, Cotten SR, Holmstrom AJ, Vyas A, Kaiser MK, Wood MA. Developing a Patient-Centered mHealth App: A Tool for Adolescents With Type 1 Diabetes and Their Parents. JMIR Mhealth Uhealth. 2017 Apr 19;5(4):e53. doi: 10.2196/mhealth.6654. http://mhealth.jmir.org/2017/4/e53/ v5i4e53 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Wang J, Yao N, Wang Y, Zhou F, Liu Y, Geng Z, Yuan C. Developing "Care Assistant": A smartphone application to support caregivers of children with acute lymphoblastic leukaemia. J Telemed Telecare. 2016 Apr;22(3):163–71. doi: 10.1177/1357633X15594753.1357633X15594753 [DOI] [PubMed] [Google Scholar]
- 14.Bendixen RM, Fairman AD, Karavolis M, Sullivan C, Parmanto B. A User-Centered Approach: Understanding Client and Caregiver Needs and Preferences in the Development of mHealth Apps for Self-Management. JMIR Mhealth Uhealth. 2017 Sep 26;5(9):e141. doi: 10.2196/mhealth.7136. http://mhealth.jmir.org/2017/9/e141/ v5i9e141 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Australian Institute of Health and Welfare. Canberra: AIHW; 2014. Dec 18, [2018-12-04]. Cancer in Australia:an overview 2014 https://www.aihw.gov.au/reports/cancer/cancer-in-australia-an-overview-2014/data . [Google Scholar]
- 16.World Health Organization Global Cancer Observatory. 2012. [2018-08-02]. Cancers Fact Sheets: Colorectal Cancer http://gco.iarc.fr/today/data/factsheets/cancers/10_8_9-Colorectum-fact-sheet.pdf .
- 17.Heynsbergh N, Botti M, Heckel L, Livingston PM. Caring for the person with cancer: Information and support needs and the role of technology. Psychooncology. 2018 Jun;27(6):1650–1655. doi: 10.1002/pon.4722. http://europepmc.org/abstract/MED/29624783 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Heynsbergh N, Botti M, Heckel L, Livingston PM. Caring for the person with cancer and the role of digital technology in supporting carers. Support Care Cancer. 2018 Oct 11; doi: 10.1007/s00520-018-4503-8.10.1007/s00520-018-4503-8 [DOI] [PubMed] [Google Scholar]
- 19.Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, Robson R, Thabane M, Giangregorio L, Goldsmith CH. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010 Jan 06;10:1. doi: 10.1186/1471-2288-10-1. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-10-1 .1471-2288-10-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Ondersma SJ, Chase SK, Svikis DS, Schuster CR. Computer-based brief motivational intervention for perinatal drug use. J Subst Abuse Treat. 2005 Jun;28(4):305–12. doi: 10.1016/j.jsat.2005.02.004. http://europepmc.org/abstract/MED/15925264 .S0740-5472(05)00044-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Wootten AC, Abbott JM, Chisholm K, Austin DW, Klein B, McCabe M, Murphy DG, Costello AJ. Development, feasibility and usability of an online psychological intervention for men with prostate cancer: My Road Ahead. Internet Interventions. 2014 Oct;1(4):188–195. doi: 10.1016/j.invent.2014.10.001. https://www.sciencedirect.com/science/article/pii/S2214782914000281?via%3Dihub . [DOI] [Google Scholar]
- 22.Girgis A, Lambert SD, McElduff P, Bonevski B, Lecathelinais C, Boyes A, Stacey F. Some things change, some things stay the same: a longitudinal analysis of cancer caregivers' unmet supportive care needs. Psychooncology. 2013 Jul;22(7):1557–64. doi: 10.1002/pon.3166. [DOI] [PubMed] [Google Scholar]
- 23.Janda M, Steginga S, Dunn J, Langbecker D, Walker D, Eakin E. Unmet supportive care needs and interest in services among patients with a brain tumour and their carers. Patient Educ Couns. 2008 May;71(2):251–8. doi: 10.1016/j.pec.2008.01.020.S0738-3991(08)00070-0 [DOI] [PubMed] [Google Scholar]
- 24.Teixeira RJ, Pereira MG. Psychological morbidity, burden, and the mediating effect of social support in adult children caregivers of oncological patients undergoing chemotherapy. Psychooncology. 2013 Jul;22(7):1587–93. doi: 10.1002/pon.3173. [DOI] [PubMed] [Google Scholar]
- 25.Turner D, Adams E, Boulton M, Harrison S, Khan N, Rose P, Ward A, Watson EK. Partners and close family members of long-term cancer survivors: health status, psychosocial well-being and unmet supportive care needs. Psychooncology. 2013 Jan;22(1):12–9. doi: 10.1002/pon.2050. [DOI] [PubMed] [Google Scholar]
- 26.Nielsen J. Nielsen Norman Group. 2011. Sep 12, [2018-09-12]. How Long Do Users Stay on Web Pages? https://www.nngroup.com/articles/how-long-do-users-stay-on-web-pages/
- 27.O'Connor E, Farrow M, Hatherly C. Randomized Comparison of Mobile and Web-Tools to Provide Dementia Risk Reduction Education: Use, Engagement and Participant Satisfaction. JMIR Ment Health. 2014;1(1):e4. doi: 10.2196/mental.3654. http://mental.jmir.org/2014/1/e4/ v1i1e4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Australian Bureau of Statistics. 2017. [2018-11-10]. 6227.0-Education and Work, Australia, May 2018 http://www.abs.gov.au/ausstats/abs@.nsf/mf/6227.0 .
- 29.Australian Bureau of Statistics. 2017. Jun 27, [2018-11-10]. 2016 Census: Multicultural http://www.abs.gov.au/ausstats/abs@.nsf/lookup/Media%20Release3 .