1. Background
A majority of U.S. adults own smartphones (77%), with similar ownership rates between gender and racial/ethnic groups.1 mHealth has been gaining in popularity as scalable, personalized opportunities to provide effective behavioral change strategies for health promotion among cancer survivors.2 A systematic review found digital interventions for cancer survivors resulted in improved moderate-vigorous physical activity behaviors and body weight; data was mixed for diet behaviors.2 However, key questions remain in terms of how mHealth interventions should be optimally designed for breast cancer survivors from underserved populations based on their cultural and literacy differences3 and the cancer-related disparities they face.4 Obesity disproportionally affects underserved populations and excess weight is associated with increased risk of recurrence and decreased survival among breast cancer survivors.4 Reviewing the Behavior Change Techniques (BCTs) present in previous efficacious trials for weight loss among cancer survivors may provide a useful starting point to design mHealth interventions. We examined perceptions of evidenced-based features breast cancer survivors from underserved health disparity-facing populations would find important to include in an mHealth weight management app and to examine the usability of app prototypes.
2. Methods
2.1. Participants
We recruited female breast cancer survivors from a large urban safety net hospital. Recruitment methods included a hospital-based registry, a hospital-based breast cancer support group, flyers, and direct letters from a clinician. Interested patients were screened for self-reported eligibility criteria: reading/speaking English; female; ≥18 years old; ≥2 years post-breast cancer diagnosis of stage 0-3; ≥6 months since receiving cancer treatment including surgery, radiation, or chemotherapy; overweight or obese; and ownership of Android- or iOS-platform smartphone. This study (H-36585) was approved by the Boston University Medical Campus/Boston Medical Center IRB; informed consent was obtained from all participants.
2.2. Design
We examined a systematic review5 and identified 19 techniques (BCT Taxonomy version 1)6 present ≥2 times in interventions shown to be effective in weight-related trials among cancer survivors. We then developed a PowerPoint presentation with pictures that displayed how each BCT could be incorporated into an mHealth app. In phase 1, we held both individual and small group discussions during which participants completed a socio-demographic survey, were shown the presentation, and were asked to rate the importance of each BCT from 1 (not at all important) to 9 (very important). During each session, we then collected the participants’ individual rating forms and added the mean ratings from previous participants. Now considering their first rating compared to the group rating, each participant was asked to re-rate the features. The goal was to come closer to achieving consensus on which features to include through this modified Delphi method. The moderator also asked participants open-ended questions to explore: topics that stood out as most useful/least useful, how to brand apps for breast cancer survivors, and if there are any other features we should include. Lastly, participants were asked if they would like to be re-contacted for phase 2 of the study.
Based on the findings from phase 1, we identified the techniques deemed highly important and developed app wireframes exemplars using Balsamiq software. In phase 2, we showed the wireframes to participants on an iPad; participants assessed their usability by completing the 10-item System Usability Scale.7
2.3. Analysis
Quantitative rating data was examined descriptively. The audio-recorded sessions from phase 1 were transcribed verbatim. Using a content analysis approach8 assisted by NVivo 12 qualitative data management software, we created inductive codes to capture ideas pertaining to perceptions of mHealth apps. Two investigators independently coded several transcripts and met on multiple occasions to discuss and refine codes. The final codes were applied to the entire set of transcripts. In phase 2, System Usability Scores >68 were deemed ‘acceptable’.7
3. Results
In total, 13 women participated in seven Phase 1 small group discussion or interview sessions and nine women (7 from Phase 1 plus 2 new women) participated in Phase 2 wireframe usability evaluations. Among these 15 participants, mean age was 60.7 (SD=5.38) years; the majority belonged to a racial/ethnic minority group (African American (67%), Hispanic (14%)); had some college or less (54%); had Medicaid or Medicare (60%); and a mean BMI of 34.0 (SD=6.62). Most used their smartphone for email or Internet at least once a day (87%) and had ever downloaded an app (87%); but fewer had downloaded a health-related app (33%) or received text updates or alerts about health (40%). Mean years since diagnosis was 11.4 (SD=6.83) and mean years since the end of treatment was 5.9 (SD=6.15). Ratings of the 19 BCT behavior change techniques are presented in Table 1.
Table 1.
Modified Delphi ratings of the importance of selected Behaviour Change Techniques
| Behavior change technique† | Round 1‡ mean (SD) range | Round 2‡ mean (SD) range |
|---|---|---|
| Feedback on behavior | 8.6(1.08) 5-9 | 8.6(1.08) 5-9 |
| Self-monitoring of the outcome behavior | 8.5(0.75) 7-9 | 8.6(1.08) 7-9 |
| Self-monitoring of the behavior | 8.2(1.41) 6-9 | 8.5(0.75) 7-9 |
| Reducing negative emotions | 8.2(1.41) 6-9 | 8.5(0.75) 6-9 |
| Instruction on how to perform the behavior | 8.5(0.75) 5-9 | 8.5(0.75) 5-9 |
| Review of outcome goals | 8.1(1.69) 5-9 | 8.4(0.84) 7-9 |
| Demonstration of the behavior | 8.3(1.14) 5-9 | 8.3(1.14) 5-9 |
| Review of behavior goals | 8.2(1.41) 5-9 | 8.3(1.14) 5-9 |
| Discrepancy between current behavior and goals | 8.2(1.41) 5-9 | 8.2(1.41) 5-9 |
| Goal setting | 8.2(1.41) 5-9 | 8.2(1.41) 5-9 |
| Biofeedback | 7.7(1.98) 3-9 | 8.1(1.69) 3-9 |
| Graded tasks | 7.7(2.13) 1-9 | 7.8(2.08) 1-9 |
| Problem solving | 7.6(1.50) 5-9 | 7.7(1.49) 5-9 |
| Action planning | 7.2(1.62) 5-9 | 7.5(1.45) 5-9 |
| Adding objects to the environment | 7.2(2.32) 2-9 | 7.4(2.24) 2-9 |
| Behavior practice and rehearsal | 7.2(1.62) 5-9 | 7.4(1.39) 5-9 |
| Nonspecific reward | 7.2(2.68) 1-9 | 7.2(2.68) 1-9 |
| Social support | 6.4(2.37) 2-9 | 6.8(2.15) 2-9 |
| Credible source | 5.8(2.20) 2-9 | 6.2(2.14) 2-9 |
The Behaviour Change Technique Taxonomy version 1 (BCTTv1)
Ratings followed a scale of 1[not at all important] to 9[very important].
In the open-ended discussion, we inductively coded three main topics: technology design, wellness, and targeting for breast cancer survivors (see online supplemental materials). For technology design, the ideas of simplicity and burden came up most frequently, along with preference for new/engaging information. For the second topic, wellness, participants noted the app should be inclusive of multiple wellness topics, including stress reduction and social relationships. For third topic, targeting the app to breast cancer survivors, the majority of participants wanted the app to include features geared towards survivorship issues, for example, coordinating with and showcasing local breast cancer-related events.
In phase 2, the mean SUS percentile score of the wireframe exemplars (Figure 1) was acceptable at 79.
Figure 1.

Screen shot of goals wireframe pertaining to goal setting and action planning behavior change techniques
4. Discussion and Conclusions
Breast cancer survivors from underserved populations rated most BCTs highly, with techniques related to feedback and monitoring, goals and planning, reducing negative emotions, and instruction/demonstration of behavior being most highly rated. Some techniques, such as social support, commonly included in trials for weight management5 had wide ranges of perceived importance; bringing down the mean rating in our small sample. This could be because social support features can take many shapes in mHealth interventions (e.g., Facebook group, coaching calls, message boards), which have varying levels of appeal.9 Future research should further explore which types of social support are most valued by breast cancer survivors from underserved populations. Open-ended discussion revealed women desire an mHealth app that is technologically simple, has low burden, and is engaging, which have implications for design features. For example, self-monitoring could rely on automatic uploading of data (e.g., steps, weight) when possible, or use less burdensome methods of self-monitoring of diet behaviors, such as monitoring food groups (vs. entering specific foods). These results share similarities with cancer survivors’ preferences for physical activity apps, in which survivors also desired less burdensome tracking methods and advice tailored to cancer experience, but perhaps had less emphasis overall on the need for low burden/technologically simple apps.10 Based on the high acceptability rating of the wireframe exemplars, future development, usability testing, and field testing of a complete app package are next research steps. Future quantitative study could examine patterns between participant characteristics and preferences for BCTs.
4.1. Study limitations
Although the modified Delphi process aimed to achieve consensus among participants’ ratings, the small sample size suggests the absolute mean rating should be viewed with caution. Future Delphi studies via online discussion panels may decrease potential for social desirability bias.
4.2. Clinical implications
Clinicians should encourage breast cancer survivors from underserved groups to utilize mobile apps targeted to survivorship issues, that are simple-to-use, engaging, and that contain evidenced-based features of behavior change.
Supplementary Material
mHealth intervention features for cancer survivors from underserved populations have not been well specified
We examined perceptions of Behaviour Change Techniques in apps
Most Behaviour Change Techniques were rated highly, including self-monitoring and feedback
Participants valued technologically simple apps that incorporated wellness and focused on breast cancer survivors
Given good/excellent perceived acceptability, future research will involve complete app development and testing
Acknowledgements
Financial support was provided by the Boston University Mobile and Electronic Health Affinity Research Collaborative, which is funded by the Evans Center for Interdisciplinary Biomedical Research at Boston University. This project was also supported by the National Center for Advancing Translational Sciences, National Institutes of Health, through BU-CTSI Grant Number 1UL1TR001430.
Footnotes
Conflict of Interest Statement
The authors have no conflict of interest to declare.
Data Availability Statement
The data that support the findings of this study are available from the corresponding author upon reasonable request.
Contributor Information
Lisa M. Quintiliani, Boston University, General Internal Medicine
Marva Foster, U.S. Department of Veterans Affairs Boston.
Lauren J. Oshry, Boston University, Hematology and Medical Oncology
References
- 1.Pew Research Center. Mobile Fact Sheet [Internet]. 2018. Available from: http://www.pewinternet.org/fact-sheet/mobile/
- 2.Roberts AL, Fisher A, Smith L, Heinrich M, Potts HWW. Digital health behaviour change interventions targeting physical activity and diet in cancer survivors: a systematic review and meta-analysis. J Cancer Surviv. 2017. December;11(6):704–719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Anderson-Lewis C, Darville G, Mercado RE, Howell S, Di Maggio S. mHealth Technology Use and Implications in Historically Underserved and Minority Populations in the United States: Systematic Literature Review. JMIR Mhealth Uhealth. 2018. June 18;6(6):e128. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.American Cancer Society. Cancer Treatment & Survivorship. Facts & Figures 2019–2021. Atlanta: American Cancer Society; 2019. [Google Scholar]
- 5.Hoedjes M, van Stralen MM, Joe STA, Rookus M, van Leeuwen F, Michie S, Seidell JC, Kampman E. Toward the optimal strategy for sustained weight loss in overweight cancer survivors: a systematic review of the literature. J Cancer Surviv. 2017. June;11(3):360–385. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013. August;46(1):81–95. [DOI] [PubMed] [Google Scholar]
- 7.Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability STudies. 2009;4(3):114–123. [Google Scholar]
- 8.Patton MQ. Qualitative Research and Evaluation Methods. 4th Edition Sage Publications; 2015. [Google Scholar]
- 9.Lloyd GR, Hoffman SA, Welch WA, Blanch-Hartigan D, Gavin KL, Cottrell A, Cadmus-Bertram L, Spring B, Penedo F, Courneya KS, Phillips SM. Breast cancer survivors’ preferences for social support features in technology-supported physical activity interventions: findings from a mixed methods evaluation. Transl Behav Med. 2018. November 16; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Robertson MC, Tsai E, Lyons EJ, Srinivasan S, Swartz MC, Baum ML, Basen-Engquist KM. Mobile Health Physical Activity Intervention Preferences in Cancer Survivors: A Qualitative Study. JMIR mHealth and uHealth. 2017;5(1):e3. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
