Abstract
Chronic disease now affects approximately half of the US population, causes 7 in 10 deaths, and accounts for roughly 80% of US health care expenditure. Because the root causes of chronic diseases are largely behavioral, effective therapies require frequent, individualized interventions that extend beyond the hospital and clinic to reach patients in their day-to-day lives. However, a mismatch currently exists between what the health care system is equipped to provide and the interventions necessary to effectively address the chronic disease burden. To remedy this health crisis, we present an individualized, data-driven digital approach for chronic disease management and prevention through precision behavior change. The rapid growth of information, biological, and communication technologies makes this an opportune time to develop digital tools that deliver precision interventions for health behavior change to address the chronic disease crisis. Building on this rapid growth, we propose a framework that includes the precise targeting of risk-producing behaviors using real-time sensing technology, machine learning data analysis to identify the most effective intervention, and delivery of that intervention with health-reinforcing feedback to provide real-time, individualized support to empower sustainable health behavior change.
Keywords: precision medicine, digital therapeutics, behavior change, mobile health (mHealth), machine learning
‘Because the root causes of chronic diseases are largely behavioral, effective therapies require frequent, individualized interventions that extend beyond the hospital and clinic to reach patients in their day-to-day lives.’
Introduction
Despite medical advancements of the 21st century, a major health crisis remains unsolved. Although improved sanitation, antibiotics, vaccines, and other medical interventions have reduced the US population’s burden from acute diseases, chronic disease now affects approximately half of the US population, causes 7 in 10 deaths, and accounts for roughly 80% of US health care expenditure.1 Because the root causes of chronic diseases are largely behavioral, effective therapies require frequent, individualized interventions that extend beyond the hospital and clinic to reach patients in their day-to-day lives.1 However, a mismatch currently exists between what the health care system is equipped to provide and the interventions necessary to effectively address the chronic disease burden.1 To remedy this health crisis, we present an individualized, data-driven digital approach for chronic disease management and prevention through precision behavior change, as shown in Figure 1. The rapid growth of information, biological, and communication technologies makes this an opportune time to develop digital tools that deliver precision interventions for health behavior change to address the chronic disease crisis.1-6 Building on this rapid growth, we propose a framework that includes the precise targeting of the risk-producing behavior using real-time sensing technology, predictive data analysis to identify the most effective intervention, and delivery of that intervention with health-reinforcing feedback to provide real-time, individualized support to empower sustainable health behavior change.
Figure 1.
An individualized, data-driven digital approach for precision behavior change. This approach consists of 3 main components: (1) real-time sensor data about behaviors and health states; (2) learning from data through methods such as machine learning; and (3) the delivery of tailored behavior change strategies based on algorithms that adapt to the unique characteristics of each individual. Each component is essential in this continuous cycle of data collection, learning, and increased individualization of support for health behavior change.
Imprecise Interventions in the Era of Precision Medicine
Chronic disease management in many health care systems consists of 15- to 30-minute visits to the doctor’s office every few months, pharmacological treatment, and healthy lifestyle recommendations that are disease oriented, nonspecific, and have low patient compliance.7 This generic, episodic approach to chronic disease management has failed to improve individual and population health.1
In 2015, the Precision Medicine Initiative was launched with the goal of creating a “new era of medicine—one that delivers the right treatment at the right time.”8 Although the vision is to take into account “individuals’ health history, genes, environments, and lifestyles,”8 thus far, the major investments in precision medicine have primarily been within the realm of genetic medicine.9 In contrast, the use of diverse data sources regarding lifestyle, environmental, cultural, socioeconomic, and behavioral factors to individualize prevention and treatment has not progressed at the same rate.10-14
Framework for Precision Behavior Change
Today’s sensor technology, personal health devices, and mobile health (mHealth) applications enable the collection of highly relevant, real-time data and provide the opportunity to deliver more precise behavior change interventions to individuals in their daily lives in the “right context at the right time.” Big data from wearable technologies combined with advancements in computing power, statistical methods, and machine learning (ML) algorithms enable the development of individualized, data-driven, digital behavioral interventions. However, numerous open questions require investigation: How do we optimize interventions given a patient’s characteristics?, What are the elements of interventions that best promote healthy behaviors? How do we determine the optimal timing of interventions? and How can we maintain user engagement in health behavior change? Here, we present a framework and a set of novel tools for data-driven approaches to optimize the delivery of precision behavior change interventions through digital health technology.
Tools for the Design and Delivery of Precision Digital Therapeutics
Despite the abundance of mHealth applications, the majority are not customized to the individual user and have not been evaluated for validity and efficacy.15-17 As a result, digital health technology can benefit from the integration of evidence-based adaptive design.
Learning About Behaviors and Health States from Sensor Data
To tailor behavioral interventions, validated measures of the individual’s health-related behaviors and health status are essential. Requiring manual data input is not practical; the burden is likely to result in incorrect and/or incomplete data entry. Thus, automatic ascertainment of behaviors and health states through the use of nonintrusive sensors is preferred.5,18 The advancement in sensor technology and novel ML algorithms are enabling the development of behavior and health state estimation techniques from sensors for a range of measures from disease severity to mood and sociability. For example, ML can now be used to derive intraday and long-term disease state fluctuations in neurodegenerative disorders.19 Additionally, mobile phone sensors and ML enable the detection of high-risk drinking and the triggered delivery of mHealth interventions to reduce alcohol consumption and alcohol-related injuries.20
Increasing the Precision of mHealth Interventions Through Machine Learning
Combining mHealth intervention designs with ML enables real-time behavior and disease assessment to guide interventions. Currently, adaptive and in-the-moment interventions are primarily based on preprogrammed decision rules developed from domain knowledge.16-18 Rather than using predefined rules to dictate the delivery of interventions, the precision of behavior change technologies can be improved with ML. For example, a smoking cessation program may trigger an intervention when wrist sensors detect that the patient is smoking. Additionally, preemptive messages could also be delivered based on learning the predictors of smoking for that individual and prompting an intervention when the individual is at high risk of relapse (eg, deliver a smoking cessation message when the patient is approaching his or her typical smoking location). Similarly, to encourage physical activity, the context of the patient can be detected from accelerometer data and GPS location as well as calendar and weather information. This real-time detection can inform the content and design of interventions using techniques proven to be beneficial in controlled trials. With ML built into the app, the ideal times to trigger the delivery of interventions could also be learned from the collected data. For instance, patterns in the patient’s sedentary behavior can be learned and used to predict when the user may benefit most from interventions to promote physical activity. Microrandomized trials (MRTs) and online personalization algorithms are methods to optimize the delivery and content of interventions through the modeling of causal effects and time-varying effects.21
Developing Data-Driven Tailoring Strategies
The MRT is an experimental design that can generate the data required to optimize the decision rules and interventions. Each time an intervention might be delivered to the individual, the individual is randomized among the different options for the intervention. Suppose the intervention consists of multiple components—for example, to promote physical activity—the application can include both an “evening component” aimed at helping the user plan next-day physical activity as well as a “throughout the day component” involving brief, tailored physical activity suggestions.16 The evening component might be randomized each evening between 2 intervention options: a message to prompt physical activity planning for the following day and no message. The day component might be randomized multiple times per day between a tailored activity suggestion and no message. In MRTs, individuals may be randomized hundreds or thousands of times during the study. Three key reasons make MRTs well suited for constructing mHealth interventions. MRTs enable (1) estimation of the causal effect of each intervention component and the component’s time-varying effects; (2) assessment of whether the dynamic context, current predictions, and detections modify the effect of the intervention; and (3) highly efficient within-person and between-person comparisons that require far fewer participants than traditional randomized controlled trials.21 Furthermore, the use of MRTs provides a bridge to the implementation of reinforcement learning algorithms in mHealth intervention development. In reinforcement learning, the randomization probabilities are gradually moved toward the best performing treatment as data accumulate for an individual. These algorithms are commonly used in online advertising and provide promising approaches to develop novel tailoring strategies in real time because data are collected on the responses of the user to the delivered treatments.22 Furthermore, both individual- and group-level data can be used to enable tailoring between and within individuals to enable the optimal delivery of the intervention in the right context and at the appropriate time. Overall, these ML approaches allow for development of tailored interventions that are learned in a data-driven manner.
From Research to Real-World Impact: Addressing Current Challenges
Although there is growing excitement for the potential of digital therapeutics to support health behavior change, numerous challenges must be addressed before the real-world impact of this technology can be realized on a large scale. One major concern is the quality of these digital health technologies. To address this concern, the Food and Drug Administration has started the Software Precertification (Pre-Cert) pilot program in the Digital Health Innovation Action Plan to develop a company-focused approach for the regulation of digital health and software technologies by ensuring quality development processes.23
Additionally, there is increasing recognition of the importance of involving a multidisciplinary team that collectively can address the nuances of end-to-end development and deployment of digital health technologies in clinical care to improve health outcomes. Although current behavioral theories are based largely on static snapshots of behavior, mHealth provides the technology to capture and contextualize behavioral data in real time.24 As a result, there is a growing need for data analysis approaches that can inform the development of dynamic health behavior theories. Methods are currently being developed for assessing treatment effects from longitudinal data in which treatment, response, and potential moderators are time varying.25-27 Adaptive and ML technologies are also in development to enable continuous learning and refinement of algorithms to support health behavior change in a manner that is responsive to real-world settings.27 Overall, combined effort from experts in medicine, nursing, public health, behavioral science, business, engineering, statistics, and computer science are required to translate these research developments into useful tools that are tailored to the individual’s unique personality and factors driving health behaviors.
Acknowledgments
This work was supported by the Johns Hopkins School of Medicine Medical Scientist Training Program (National Institutes of Health: Institutional Predoctoral Training Grant T32), the National Institutes of Health (Ruth L. Kirschstein Individual Predoctoral NRSA for MD/PhD: F30 Training Grant), and the Johns Hopkins Individualized Health (inHealth) Initiative.
Footnotes
Declaration of Conflicting Interests: The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: SW, SLZ, and SAM declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article. SSM serves on the scientific advisory boards of Amgen, Sanofi, Regeneron, Esperion, Novo Nordisk, Quest Diagnostics, and Akcea Therapeutics and reports grants from Apple, Google, iHealth, Nokia, Maryland Innovation Initiative, American Heart Association, Aetna Foundation, P J Schafer Memorial Fund, and David and June Trone Family Foundation. SSM reports a patent pending filed by Johns Hopkins as a co-inventor for a method of LDL-C estimation. SSM is a founder of and holds equity in Corrie Health, which intends to further develop the platform. This arrangement has been reviewed and approved by the Johns Hopkins University in accordance with its conflict of interest policies. SS is a founder of and holds equity in Bayesian Health. SS also serves on their board. The results of the study discussed in this publication could affect the value of Bayesian Health. This arrangement has been reviewed and approved by the Johns Hopkins University in accordance with its conflict of interest policies.
Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: SW is supported by the Johns Hopkins School of Medicine Medical Scientist Training Program (National Institutes of Health: Institutional Predoctoral Training Grant - T32), National Institutes of Health: Ruth L. Kirschstein Individual Predoctoral NRSA for MD/PhD: F30 Training Grant, and the Johns Hopkins Individualized Health (inHealth) Initiative.
Ethical Approval: Not applicable, because this article does not contain any studies with human or animal subjects.
Informed Consent: Not applicable, because this article does not contain any studies with human or animal subjects.
Trial Registration: Not applicable, because this article does not contain any clinical trials.
ORCID iD: Shannon Wongvibulsin,
https://orcid.org/0000-0002-1390-7440.
References
- 1. Kvedar JC, Fogel AL, Elenko E, Zohar D. Digital medicine’s march on chronic disease. Nat Biotechnol. 2016;34:239-246. doi: 10.1038/nbt.3495 [DOI] [PubMed] [Google Scholar]
- 2. Topol EJ. Individualized medicine from prewomb to tomb. Cell. 2014;157:241-253. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Torkamani A, Andersen KG, Steinhubl SR, Topol EJ. High-definition medicine. Cell. 2017;170:828-843. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Steinhubl SR, Muse ED, Topol EJ. The emerging field of mobile health. Sci Transl Med. 2015;7:283rv3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Muse ED, Steinhubl SR. Interventions for increasing physical activity: from “ingenious toys” to mHealth. J Am Coll Cardiol. 2016;67:2464-2466. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Steinhubl SR, Muse ED, Topol EJ. Can mobile health technologies transform health care? JAMA. 2013;310:2395-2396. [DOI] [PubMed] [Google Scholar]
- 7. Middleton KR, Anton SD, Perri MG. Long-term adherence to health behavior change. Am J Lifestyle Med. 2013;7:395-404. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. The White House. Fact sheet: Obama administration announces key actions to accelerate precision medicine initiative. https://obamawhitehouse.archives.gov/the-press-office/2016/02/25/fact-sheet-obama-administration-announces-key-actions-accelerate. Published February 25, 2016. Accessed March 27, 2019.
- 9. Ashley EA. The precision medicine initiative: a new national effort. JAMA. 2015;313:2119-2120. [DOI] [PubMed] [Google Scholar]
- 10. Flores M, Glusman G, Brogaard K, Price ND, Hood L. P4 medicine: how systems medicine will transform the healthcare sector and society. Pers Med. 2013;10:565-576. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Schulam P, Saria S. Integrative analysis using coupled latent variable models for individualizing prognoses. J Mach Learn Res. 2016;17:1-35. [Google Scholar]
- 12. Coley RY, Fisher AJ, Mamawala M, Carter HB, Pienta KJ, Zeger SL. A Bayesian hierarchical model for prediction of latent health states from multiple data sources with application to active surveillance of prostate cancer. Biometrics. 2017;73:625-634. [DOI] [PubMed] [Google Scholar]
- 13. Hekler EB, Klasnja P, Riley WT, et al. Agile science: creating useful products for behavior change in the real world. Transl Behav Med. 2016;6:317-328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Price ND, Magis AT, Earls JC, et al. A wellness study of 108 individuals using personal, dense, dynamic data clouds. Nat Biotechnol. 2017;35:747-756. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Iacoviello BM, Steinerman JR, Klein DB, et al. Clickotine, a personalized smartphone app for smoking cessation: initial evaluation. JMIR Mhealth Uhealth. 2017;5:e56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Liao P, Klasnja P, Tewari A, Murphy SA. Micro-randomized trials in mHealth. https://arxiv.org/abs/1504.00238. Published April 1, 2015. Accessed March 27, 2019. [DOI] [PMC free article] [PubMed]
- 17. Nilsen W, Kumar S, Shar A, et al. Advancing the science of mHealth. J Health Commun. 2012;17(suppl 1):5-10. [DOI] [PubMed] [Google Scholar]
- 18. Rabbi M, Pfammatter A, Zhang M, Spring B, Choudhury T. Automated personalized feedback for physical activity and dietary behavior change with mobile phones: a randomized controlled trial on adults. JMIR Mhealth Uhealth. 2015;3:e42. doi: 10.2196/mhealth.4160 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Zhan A, Mohan S, Tarolli C, et al. Using smartphones and machine learning to quantify Parkinson disease severity: the mobile Parkinson disease score. JAMA Neurol. 2018;75:876-880. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Bae S, Chung T, Ferreira D, Dey AK, Suffoletto B. Mobile phone sensors and supervised machine learning to identify alcohol use events in young adults: implications for just-in-time adaptive interventions. Addict Behav. 2018;83:42-47. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Klasnja P, Hekler EB, Shiffman S, et al. Micro-randomized trials: an experimental design for developing just-in-time adaptive interventions. Health Psychol. 2015;34S:1220-1228. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Dempsey W, Liao P, Klasnja P, Nahum-Shani I, Murphy SA. Randomised trials for the Fitbit generation. Signif (Oxf). 2015;12:20-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. US Food and Drug Administration. Digital Health Software Precertification (Pre-Cert) program. https://www.fda.gov/MedicalDevices/DigitalHealth/DigitalHealthPreCertProgram/default.htm. Accessed March 27, 2019.
- 24. Spruijt-Metz D, Nilsen W. Dynamic models of behavior for just-in-time adaptive interventions. IEEE Pervasive Comput. 2014;13:13-17. [Google Scholar]
- 25. Boruvka A, Almirall D, Witkiewitz K, Murphy SA. Assessing time-varying causal effect moderation in mobile health. http://arxiv.org/abs/1601.00237. Published January 3, 2016. Published March 27, 2019. [DOI] [PMC free article] [PubMed]
- 26. Soleimani H, Subbaswamy A, Saria S. Treatment-response models for counterfactual reasoning with continuous-time, continuous-valued interventions. http://arxiv.org/abs/1704.02038. Accessed April 4, 2019.
- 27. Xu Y, Xu Y, Saria S. A Bayesian nonparametric approach for estimating individualized treatment-response curves. J Mach Learn Res. 2016;56:282-300. [Google Scholar]