Skip to main content
Frontiers in Big Data logoLink to Frontiers in Big Data
editorial
. 2023 Jul 4;6:1242482. doi: 10.3389/fdata.2023.1242482

Editorial: Multimodal digital approaches to personalized medicine

Ieuan Clay 1,*, Valeria De Luca 2, Akane Sano 3
PMCID: PMC10352833  PMID: 37469442

Introduction

Digital health is rapidly evolving and expanding, powering a paradigm shift in evidence generation for clinical development and care delivery (Marra et al., 2020). Driven by advances in cutting-edge biosensors and multi-sensor wearable devices, increasing maturity and acceptance of remote clinical trial models (Izmailova et al., 2021) and digital therapeutics (Stern et al., 2022) and huge growth in computational approaches to processing and interpreting this digital health data, there is great excitement in the field about the possible applications of multimodal digital approaches (Clay et al., 2022). Multimodal data has particular relevance to addressing complex measurement concepts and to development of better personalized treatment, incorporating digital and behavioral phenotyping with molecular endotyping.

New insights enabled by the continuous capture of multimodal data have the potential to drive a deeper understanding of patients' daily life experience (Clay et al., 2023) and more personalized medicines. Novel data science approaches and machine learning applications are pioneering the conversion of multimodal data on physical activity (Lu et al., 2018; Bahej et al., 2019; Mueller et al., 2019; Van Blarigan et al., 2022), sleep (Zhang et al., 2021), vital signs (Jacobsen et al., 2021), cognitive status as well as contextual information, into measures for symptoms and factors associated with health-related quality of life factors such as fatigue (Luo et al., 2020), stress (Sano et al., 2018; Jacobson et al., 2019, 2020), and depression (Jacobson and Nemesure, 2021; Makhmutova et al., 2022). The applications of these measures are diverse ranging from COVID-19 monitoring (Shapiro et al., 2021) to prediction of recovery from orthopedic surgery (Karas et al., 2020).

Objectives of the Research Topic

Through this Research Topic, we wanted to highlight advancements and challenges specifically related to multimodal digital health data, particularly as applied to developing novel outcomes, patient stratification or predictive models of disease progression. Ultimately, by sharing methodologies, results and data, we aim to lower the remaining barriers to real world adoption of digital health solution.

Further advances

In this Research Topic, we observed that this early progress is being continued.

Several papers focused on applications of multimodal digital approaches in mental health. Moukaddam et al. presented a mini-review and roadmap, outlining how concepts from computer science and clinical psychiatry can be intersected to highlight a path forward for using digital sensor data to improve how we understand and treat mental illness. Two clinical case studies discussed in the paper proposed and explored specific areas of opportunity. Additionally, two original research papers detailed approaches for detecting and forecasting changes in mental health (Saito et al.; Kathan et al.). Interestingly, both of these papers combined behavioral data from sensors with other inputs (clinical input from medical records and subjective patient input from ecological momentary assessments). The detection of mental health state changes is potentially game changing, particularly in conditions that are often heavily stigmatized as well as being chronic, as knowing when to reach out to someone is hugely powerful.

Continuing with this theme, the Research Topic also contains several other papers focusing on assessing risk through multimodal digital approaches in chronic conditions. For people living with diabetes, physical activity has been shown repeatedly to be beneficial, yet it also carries the risk of inducing hypoglycemic events. Prasanna et al. explored the association of different types and volumes of physical activity, measured through real-world digital measures, with continuous glucose monitoring, laying the foundation for better understanding this phenomenon, reducing risk for diabetes patients and enabling them to better manage their condition. Li et al. presented their work on a clinical data resource focused on enabling the detection and prediction of sudden unexpected death in poorly controlled epilepsy. These rare, but catastrophic, events are the primary cause of mortality in such patients, thus the resource aims to again provide a basis for real-world multimodal digital approaches which could help predict risk and empower patients to better manage their daily lives (Li et al.). The scalability of digital multimodal approaches make them particularly suitable for large scale monitoring, which is important when studying rare events or conditions.

Both Li et al. and Prasanna et al. build on preliminary evidence that alerting systems based on digital measures (i.e., remote monitoring) can help reduce hospitalization in some cohorts (Iqbal et al., 2021). This is an interesting new direction for multimodal digital approaches, with a stronger focus on care delivery than clinical evidence generation (i.e., digital biomarker and COA development; Goldsack et al., 2021).

Challenges and a path forward

Finally Kristiansen et al. addressed a key challenge in any digital multimodal approach: maintaining data quality as our ability to collect increasing volumes and diversity of data across increasingly uncontrolled settings. Increasing data quality and effectively integrating this data (Clay et al., 2021) will be central to increasing the impact of these approaches, and the growing focus on these issues should be taken as a positive sign that digital multimodal approaches are increasingly being intended for non-exploratory application.

Taken together, we feel that the progress presented in this Research Topic, and elsewhere in the field, is highly encouraging. Continued exploration of what is possible and meaningful to measure through multimodal digital data, further investment into validation and the overcoming of key challenges will expand the boundaries of our ability to assess complex measurement concepts and personalize treatments.

Author contributions

IC, VD, and AS conceived and wrote the Research Topic concept and this editorial. All authors contributed to the article and approved the submitted version.

Acknowledgments

We would like to thank all the submitting authors and the reviewers for making this Research Topic possible.

Conflict of interest

IC is employed by VivoSense Inc., United States. VD is employed by Novartis Institutes for BioMedical Research, Switzerland. The remaining author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  1. Bahej I., Clay I., Jaggi M., De Luca V. (2019). “Prediction of patient-reported physical activity scores from wearable accelerometer data: a feasibility study,” in Converging Clinical and Engineering Research on Neurorehabilitation III, eds L. Masia, S. Micera, M. Akay, and J. L. Pons (Cham: Springer International Publishing; ), 668–672. 10.1007/978-3-030-01845-0_133 [DOI] [Google Scholar]
  2. Clay I., Angelopoulos C., Bailey A. L., Blocker A., Carini S., Carvajal R., et al. (2021). Sensor data integration: a new cross-industry collaboration to articulate value, define needs, and advance a framework for best practices. J. Med. Internet Res. 23, e34493. 10.2196/34493 [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Clay I., Cormack F., Fedor S., Foschini L., Gentile G., van Hoof C., et al. (2022). Measuring health-related quality of life with multimodal data: viewpoint. J. Med. Internet Res. 24, e35951. 10.2196/35951 [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Clay I., Peerenboom N., Connors D. E., Bourke S., Keogh A., Wac K., et al. (2023). Reverse engineering of digital measures: inviting patients to the conversation. Digit. Biomark 7, 28–44. 10.1159/000530413 [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Goldsack J. C., Dowling A. V., Samuelson D., Patrick-Lake B., Clay I. (2021). Evaluation, acceptance, and qualification of digital measures: from proof of concept to endpoint. Digit. Biomark 5, 53–64. 10.1159/000514730 [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Iqbal F. M., Lam K., Joshi M., Khan S., Ashrafian H., Darzi A. (2021). Clinical outcomes of digital sensor alerting systems in remote monitoring: a systematic review and meta-analysis. NPJ Digit. Med. 4, 1–12. 10.1038/s41746-020-00378-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Izmailova E. S., Wagner J. A., Ammour N., Amondikar N., Bell-Vlasov A., Berman S., et al. (2021). Remote digital monitoring for medical product development. Clin. Transl. Sci. 14, 94–101. 10.1111/cts.12851 [DOI] [Google Scholar]
  8. Jacobsen M., Dembek T. A., Kobbe G., Gaidzik P. W., Heinemann L. (2021). Noninvasive continuous monitoring of vital signs with wearables: fit for medical use? J. Diabetes Sci. Technol. 15, 34–43. 10.1177/1932296820904947 [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Jacobson N. C., Nemesure M. D. (2021). Using artificial intelligence to predict change in depression and anxiety symptoms in a digital intervention: evidence from a transdiagnostic randomized controlled trial. Psychiatry Res. 295, 113618. 10.1016/j.psychres.2020.113618 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Jacobson N. C., Summers B., Wilhelm S. (2020). Digital biomarkers of social anxiety severity: digital phenotyping using passive smartphone sensors. J. Med. Internet Res. 22, e16875. 10.2196/16875 [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Jacobson N. C., Weingarden H., Wilhelm S. (2019). Digital biomarkers of mood disorders and symptom change. NPJ Digit. Med. 2, 3. 10.1038/s41746-019-0078-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Karas M., Marinsek N., Goldhahn J., Foschini L., Ramirez E., Clay I. (2020). Predicting subjective recovery from lower limb surgery using consumer wearables. Digit. Biomark 4(Suppl. 1), 73–86. 10.1159/000511531 [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Lu Z., Harris T. B., Shiroma E. J., Leung J., Kwok T. (2018). Patterns of physical activity and sedentary behavior for older adults with Alzheimer's disease, mild cognitive impairment, and cognitively normal in Hong Kong. J. Alzheimers Dis. 66, 1453–1462. 10.3233/JAD-180805 [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Luo H., Lee P.-A., Clay I., Jaggi M., De Luca V. (2020). Assessment of fatigue using wearable sensors: a pilot study. Digit. Biomark 4(Suppl 1), 59–72. 10.1159/000512166 [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Makhmutova M., Kainkaryam R., Ferreira M., Min J., Jaggi M., Clay I. (2022). Predicting changes in depression severity using the PSYCHE-D (prediction of severity change-depression) model involving person-generated health data: longitudinal case-control observational study. JMIR mHealth uHealth 10, e34148. 10.2196/34148 [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Marra C., Chen J. L., Coravos A., Stern A. D. (2020). Quantifying the use of connected digital products in clinical research. NPJ Digit. Med. 3, 50. 10.1038/s41746-020-0259-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Mueller A., Alfons Hoefling H., Muaremi A., Praestgaard J., Walsh L. C., Bunte O., et al. (2019). Continuous digital monitoring of walking speed in frail elderly patients: noninterventional validation study and longitudinal clinical trial. JMIR mHealth uHealth 7, e15191. 10.2196/15191 [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Sano A., Taylor S., McHill A. W., Phillips A. J. K., Barger L. K., Klerman E., et al. (2018). Identifying objective physiological markers and modifiable behaviors for self-reported stress and mental health status using wearable sensors and mobile phones: observational study. J. Med. Internet Res. 20, e210. 10.2196/jmir.9410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Shapiro A., Marinsek N., Clay I., Bradshaw B., Ramirez E., Min J., et al. (2021). Characterizing COVID-19 and influenza illnesses in the real world via person-generated health data. Patterns 2, 100188. 10.1016/j.patter.2020.100188 [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Stern A. D., Brönneke J., Debatin J. F., Hagen J., Matthies H., Patel S., et al. (2022). Advancing digital health applications: priorities for innovation in real-world evidence generation. Lancet Digit. Health 4, e200–206. 10.1016/S2589-7500(21)00292-2 [DOI] [PubMed] [Google Scholar]
  21. Van Blarigan E. L., Dhruva A., Atreya C. E., Kenfield S. A., Chan J. M., Milloy A., et al. (2022). Feasibility and acceptability of a physical activity tracker and text messages to promote physical activity during chemotherapy for colorectal cancer: pilot randomized controlled trial (Smart Pace II). JMIR Cancer 8, e31576. 10.2196/31576 [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Zhang Y., Folarin A. A., Sun S., Cummins N., Bendayan R., Ranjan Y., et al. (2021). Relationship between major depression symptom severity and sleep collected using a wristband wearable device: multicenter longitudinal observational study. JMIR mHealth uHealth 9, e24604. 10.2196/24604 [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Frontiers in Big Data are provided here courtesy of Frontiers Media SA

RESOURCES