Abstract
Electronic communication is becoming increasingly popular worldwide, as evidenced by its widespread and rapidly growing use. In medicine, however, it remains a novel approach to reach out to patients. Yet, they have the potential for further improving current health care. Electronic platforms could support therapy adherence and communication between physicians and patients. The power of social media as well as other electronic devices can improve adherence as evidenced by the development of the app bant. Additionally, systemic analysis of social media content by Screenome can identify health events not always captured by regular health care. By better identifying these healthcare events we can improve our current healthcare system as we will be able to better tailor to the patients’ needs. All these techniques are a valuable component of modern health care and will help us into the future of increasingly digital health care.
Electronic communication refers to the exchange of information by technological means, including the World Wide Web, text and instant messaging, and social networking.1 It is becoming increasingly popular, as evidenced by its widespread and rapidly growing use. As of March 31, 2017, world internet usage and population statistics were at 4,346,561,853 internet users. It is also estimated that 15,220,700 texts are sent every minute of every day worldwide, with a median number of 60–100 daily texts per person,2 and, as of 2017, daily social media usage of global internet users amounted to 135 minutes per day and global social networking audiences surpassed 2 billion users in 2016.2, 3
Despite worldwide usage of electronic communications technology, it remains a novel approach used in medicine to reach out to patients. With so many of us constantly connected to the internet, electronic communications could be a great opportunity to tap into a popular mode of communication and connect with patients. For example, social media could be used to improve medication adherence, or to identify health problems and adverse drug reactions that never reach regulatory bodies or the physician's office. Electronic platforms could support therapy adherence and communication between physicians and patients. In this paper, we will discuss the challenges and opportunities in utilizing various forms of electronic communications for health care, including research that has been done to date.
Social Media and Electronic Platforms for Treatment Adherence: Opportunities for Patient Engagement and Patient Care
Adherence is the extent to which a patient follows medical advice. Poor adherence to treatment regimens is a significant problem across pediatric and adult populations. In fact, ~ 50% of children and adults with a chronic illness are not taking enough of their prescribed medication.4 Nonadherence carries considerable implications for morbidity and mortality, cost‐effectiveness of medical care, and disease management decisions by healthcare providers. Poor adherence is also associated with significantly poorer quality of life, impairments in psychosocial and physical functioning, greater absenteeism from daily activities, and greater healthcare utilization.4, 5 Many efforts have been spent toward developing multicomponent interventions to promote better adherence in patients, with significant improvements in patient adherence. Yet, there is a paucity of information regarding social media use to monitor or improve medication adherence.
Social media may be a particularly appealing forum to target patient adherence. It capitalizes on a medium that many patients already use and are familiar with, and has potential to reach patients with limited healthcare access. Among the few that have evaluated social media for patient adherence is Scalzi et al.6 They evaluated an intervention aimed at improving medication adherence in adolescents with systemic lupus. Participants were randomized to either answer questions about the intervention in a journal or on a social media site, where adolescents could discuss content of the educational site with other adolescents with systemic lupus. Medication adherence improved in both control and social media groups, but the proportion of adherent patients improved significantly only in the social media group. Similarly, an app called bant was developed to improve self‐management among adolescents with type 1 diabetes. This app allows youths to wirelessly transfer glucose readings, engage in a social community with peers, and earn rewards for blood glucose readings. A pilot test revealed that the daily average frequency of blood glucose readings increased by 50% using the bant app.7 A randomized clinical trial further confirmed a positive association between blood glucose readings and hemoglobin A1c control using the app.8
Text messaging is another emerging electronic communication for enhancing treatment adherence. To date, texting has been shown to increase attendance at medical appointments and to prompt administration of prescribed treatments. A meta‐analysis regarding the use of text messaging for improving medication adherence found a 20% increase in patient adherence with 2‐way text messaging (sending reminders and requesting replies), but no effect with 1‐way text messaging (sending reminders only) highlighting specifically the advantage and the power of interactive electronic platforms similar to social media.5
Other technical advances outside the use of social media have contributed to better adherence as well. Electronic platform monitors, devices that capture objective adherence data, can provide more valid measures of adherence compared with self‐reported estimates by patients. Electronic monitors record the date and time a medication is removed from the electronic device, and some have options for setting prompts when a medication is to be administered (e.g., alarms and text reminders). Electronic monitors are viewed favorably by patients and have been used to provide feedback to patients about their medication‐taking behaviors, with noted significant improvements in adherence.9, 10, 11, 12
Social Media as a Tool to Capture Adverse Drug Reactions
Adverse drug reactions sit between the fourth and sixth leading cause of death in the United States. According to a systematic review of 25 observational studies, including 106,586 patients who were hospitalized, ~ 5.3% of all hospital admissions around the world are associated with adverse drug reactions (ADRs), with higher rates (a median of 10.7%) reported for elderly patients.13 An earlier review of 39 studies had similar findings, calculating the overall incidence of serious ADRs at 6.7% of all hospital admissions in the United States, with fatal ADRs at 0.32%.14 Thus, the study estimated 106,000 fatal ADRs nationally in 1994.
Due to the limitations of pre‐approval clinical trials, it is not possible to assess all of the ADRs associated with the use of a particular drug before it is released, and spontaneous reporting of suspected ADRs by the public and health professionals is essential for triggering signals of drug safety.15 Research has exposed the inadequacies of spontaneous reporting systems, particularly under‐reporting; it is estimated that only 6% of all ADRs are reported,16 which delays the triggering of signals and, if necessary, the corresponding action. The inadequacies of self‐reporting systems has prompted researchers and regulatory agencies in charge of drug safety to explore additional data sources for more effective ADR monitoring, such as electronic health records, claim forms, and, relatively recently, social media.17
A systematic review from a pharmacology perspective confirmed that reports of adverse events are identifiable within social media and that the reports are generally consistent with what is known about the drugs in other sources (such as drug labels or published trials). Some studies reported a higher frequency of adverse events in social media, particularly for “symptom‐related” and “mild” adverse events.18
Whether the differences found between adverse events reported in social media and those in traditional sources genuinely reflect new adverse effects/reactions or more accurate frequencies of adverse effects/reactions is unknown. What is clear is that social media can provide more complete information on adverse effects/reactions considered important by patients, and aid researchers in understanding patient perceptions.
Although there are still challenges, work in automatic extraction of these data from social media and processing methods relevant to pharmacovigilance has advanced, and it is indeed possible to extract these reports automatically.19 The potential for using social media for pharmacovigilance was envisioned relatively recently, with the first pilot study published in 2010,20 with publications in social media mining for pharmacovigilance growing significantly since around 2013. All the published studies between 2010 and 2014 took a lexicon‐based approach to finding adverse event expressions, a method that is inherently limited given that the variety of expressions present in colloquial text are not typically present in lexicons. More flexible approaches for extraction (machine‐learning or pattern based), such as ADRMine21 and Recurrent Neural Network,22 are able to capture expressions not present in a lexicon, but require an additional task to be addressed in the aftermath of extraction of such expressions: normalization. Mapping them to standard terms so “my head is being crushed by an elephant” is adequately identified as a report of “migraine.”
Traditional approaches to the normalization problem used in other health‐related text miss relevant information when applied to the colloquial language used in social media,23 given the amount of noise in the data and its unique level of creative license.24 Normalization models of user‐generated content (text messages) have proposed the use of various error models, such as Hidden Markov Models25 and noisy channel models.26
Purely lexical normalization of social media texts, such as those from Twitter, have used similar approaches,27, 28, 29 focusing on correcting the irregularities of the text (misspellings, abbreviations, and such) to match to the lexicon. However, normalization of social media text is more complex than correcting irregularities in the text. For example, ADRMine21 can find expressions, such as “make my heart rate soar,” “I feel like my heart is gonna beat out of my chest,” “heart‐racy,” “heart rate off the charts,” “heart beeping,” and “heart racing,” among the collected postings and it can indicate that they are adverse effects of albuterol. A lexical or dictionary match approach would have missed all but “heart racing,” which is a concept listed in the Unified Medical Language System (concept ID C1868917). Mapping (normalizing) all of the other expressions to the Unified Medical Language System concept palpitations (C0030252) or the related heart racing (C1868917) or heart pounding (C1868917) is a challenging problem, and more creative normalization techniques that synergize with the nature of social media (unsupervised and semi‐supervised approaches that “learn” from the context of a mention) are needed. This can be highly significant in enabling pharmacovigilance and public health research from social media.
Social media data used with other established sources (the US Food and Drug Administration (FDA) adverse event registration system data and drug insert data) can significantly help clinicians, regulators, and researchers identify potential adverse effects that pose a threat to the public, stimulate in‐depth studies, and promote deeper understanding of the potential harms and public behaviors regarding the use of prescription drugs.
The Screenome: Inferring Health Behaviors from Computer Screen Activity
Prior to the invention of the internet and the proliferation of smartphones, an individual's interaction with the healthcare system was primarily limited to the clinical setting. The advent of more mobile and accessible technologies has disrupted the clinical paradigm, with individuals having unprecedented access to health information at the tip of their fingers. That access can take many forms: search engines, forums, and smartphone applications. Despite the broad shift in how individuals manage their health in the modern age, there has been limited work to characterize these interactions, with most of the literature primarily focused on social media platforms, Facebook and Twitter, or patient chatrooms. An ideal data set for studying digital behavior needs to be high frequency, as the modern human‐device interaction lasts from ~ 10 seconds to 2 minutes, and passively/unobtrusively observed to avoid compliance and activity disruption issues.30, 31
The primary means of communication between an individual and their device is through the device screen, thus screenshots represent a natural unit for data collection. Screenomics is a framework for passive high frequency collection of digital device activity through screenshots.30 To date, several cohorts have been recruited and installed applications on their smartphones and laptop computers that recorded screenshots and metadata at 5‐second intervals. A key benefit of using screenshots as the unit of observation is the ability to capture pan‐application activity, rather than having observation limited to a single platform, as with other data sources. These screenshots were then encrypted and uploaded to a cloud database and processed to extract text via optical character recognition and assign activity labels and other features.31
This framework results in a data set that preserves temporal information and contains rich high‐resolution feature content for further analysis. Thus, the Screenome captures previously unobservable interactions between individuals and digital health resources. Sequences of images within the data demonstrate the nature of the modern digital health landscape, especially the dynamic and heterogeneous nature of a user's device interactions. Users are observed accessing many different sources of information and/or avenues of communication related to health, even during a single interaction with the device. These interactions highlight the potential of Screenome data to enable prevention, treatment, and management of various aspects of an individual's health.
The initial work using the Screenome has focused on identifying human‐device interaction sessions related to health, the characterization of the health data sources used by the public, and the interplay between drug and disease interaction sessions. Future work with these data could lead to methods for early detection of health‐related risks, passive postmarket surveillance for adverse drug events and/or drug efficacy, and opportunities for precision interventions. There are many challenges posed by these data, including reliable detection of health‐related content and determination of whether detected content is indicative of the user's health (vs. friends, family, or personal interest).
The initial analysis focuses on using the extracted text to identify sessions related to diseases and drugs.30 Disease and drug word groups were defined using word vectors trained on a publicly available Reddit comment corpus. We selected sets of two to three seed words for each category, such as “diabetes” or “metformin.” The word groups were then defined as the 200 semantically closest word (cosine distance) for diseases and 50 closest words for drugs.31
After removing stop‐words and non‐words from the text content of each screenshot, we computed counts of relevant words for each disease and drug category of interest. Arranged with respect to time (Figure 1), these counts indicate when users interact with specific health‐related content. Using eight initial drug and disease categories, pain, diabetes, cancer, depression, and their associated drug classes, we identified over 100,000 screenshots (of ~ 6 million) with non‐zero scores for either drugs, diseases, or both.
This initial analysis demonstrates the presence of drug and disease‐related signals within Screenomes. Analysis of these health‐oriented device interaction sessions has the potential to further our understanding of health information seeking behavior in the digital age, across a heterogenous collection of applications and websites, which is not possible with other data types.
Conclusion
For many years, the medical field has been struggling to improve adherence and reduce adverse health events. As discussed above, it is possible to harness the popularity and the power of social media and related, interactive, electronic devices to improve adherence by not only reminding patients to take their medication but to also give them actionable feedback in real time, opening a direct line of communication among the patient, healthcare provider, and other peers facing similar obstacles in treatment adherence. Additionally, systematic analysis of social media content (e.g., by Screenome) can identify adverse health events that are not always captured by regulatory agencies and represent real‐life patient experience that are relevant to health outcomes, behaviors, and generalizable to public health. Beyond current technologies, research into the development of other digital health tools through techniques like Screenome will continue to add to the momentum behind the digital health movement. In conclusion, electronic communications is declaring itself as a valuable component of modern health care in this digital age.
Funding
The Screenomics Project was initially developed at the Center for Advanced Study of Behavioral Science at Stanford University, and is directly funded by grants from the Stanford University Cyber Social Initiative, the Knight Foundation, the Stanford Child Health Research Institute, the Stanford University Precision Health and Integrated Diagnostics Center (PHIND), and the Pennsylvania State University Colleges of Health & Human Development and Information Science & Technology. A.L. is supported by a National Science Foundation Graduate Research Fellowship, grant number, DGE‐1656518.
Conflict of Interest
As an Associate Editor for Clinical and Translational Science, Valentina Shakhnovich was not involved in the review or decision process for this paper. All other authors declared no competing interests for this work.
References
- 1. Iannarelli, J.G. & O'Shaughnessy, M. The Technical Side. Information Governance and Security: Protecting and Managing Your Company's Proprietary Information. (Elsevier, Oxford, UK, 2015). [Google Scholar]
- 2. Domo . New Report Finds that Social Media Habits of Fortune 500 CEOs are Sputtering; Only 40% Have a Social Media Presence. GlobeNewswire News Room (2017). <https://www.globenewswire.com/news-release/2017/05/31/1004999/0/en/New-Report-Finds-that-Social-Media-Habits-of-Fortune-500-CEOs-are-Sputtering-Only-40-Have-a-Social-Media-Presence.html>. Accessed May 4, 2019.
- 3. Global time spent on social media daily 2017 . Statista. <https://www.statista.com/statistics/433871/daily-social-media-usage-worldwide/>. Accessed May 4, 2019.
- 4. DiMatteo, M.R. Variations in patients’ adherence to medical recommendations: a quantitative review of 50 years of research. Med. Care 42, 200–209 (2004). [DOI] [PubMed] [Google Scholar]
- 5. Wu, Y.P. & Hommel, K.A. Using technology to assess and promote adherence to medical regimens in pediatric chronic illness. J. Pediatr. 164, 922–927 (2014). [DOI] [PubMed] [Google Scholar]
- 6. Scalzi, L.V. , Hollenbeak, C.S. , Mascuilli, E. & Olsen, N. Improvement of medication adherence in adolescents and young adults with SLE using web‐based education with and without a social media intervention, a pilot study. Pediatr. Rheumatol. Online J. 16, 18 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Cafazzo, J.A. , Casselman, M. , Hamming, N. , Katzman, D.K. & Palmert, M.R. Design of an mHealth app for the self‐management of adolescent type 1 diabetes: a pilot study. J. Med. Internet Res. 14, e70 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Goyal, S . Influencing behaviour to improve diabetes self‐management: the design and evaluation of mobile health applications. <https://tspace.library.utoronto.ca/bitstream/1807/82381/3/Goyal_Shivani_201711_PhD_thesis.pdf> (2017).
- 9. Maddux, M. , Ricks, S. , Delurgio, S. & Hommel, K. A pilot study evaluating the impact of an adherence‐promoting intervention among nonadherent youth with inflammatory bowel disease. J. Pediatr. Nurs. 35, 72–77 (2017). [DOI] [PubMed] [Google Scholar]
- 10. Herzer, M. , Ramey, C. , Rohan, J. & Cortina, S. Incorporating electronic monitoring feedback into clinical care: a novel and promising adherence promotion approach. Clin. Child Psychol. Psychiatry 17, 505–518 (2012). [DOI] [PubMed] [Google Scholar]
- 11. de Bruin, M. et al Self‐regulatory processes mediate the intention‐behavior relation for adherence and exercise behaviors. Health Psychol. 31, 695–703 (2012). [DOI] [PubMed] [Google Scholar]
- 12. Otsuki, M. et al Adherence feedback to improve asthma outcomes among inner‐city children: a randomized trial. Pediatrics 124, 1513–1521 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Kongkaew, C. , Noyce, P.R. & Ashcroft, D.M. Hospital admissions associated with adverse drug reactions: a systematic review of prospective observational studies. Ann. Pharmacother. 42, 1017–1025 (2008). [DOI] [PubMed] [Google Scholar]
- 14. Lazarou, J. , Pomeranz, B.H. & Corey, P.N. Incidence of adverse drug reactions in hospitalized patients: a meta‐analysis of prospective studies. JAMA 279, 1200–1205 (1998). [DOI] [PubMed] [Google Scholar]
- 15. Gonzalez‐Gonzalez, C. , Lopez‐Gonzalez, E. , Herdeiro, M.T. & Figueiras, A. Strategies to improve adverse drug reaction reporting: a critical and systematic review. Drug Saf. 36, 317–328 (2013). [DOI] [PubMed] [Google Scholar]
- 16. Hazell, L. & Shakir, S.A.W. Under‐reporting of adverse drug reactions: a systematic review. Drug Saf. 29, 385–396 (2006). [DOI] [PubMed] [Google Scholar]
- 17. Harpaz, R. et al Combing signals from spontaneous reports and electronic health records for detection of adverse drug reactions. J. Am. Med. Inform. Assoc. 20, 413–419 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Golder, S. , Norman, G. & Loke, Y.K. Systematic review on the prevalence, frequency and comparative value of adverse events data in social media. Br. J. Clin. Pharmacol. 80, 878–888 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Sarker, A. , Mollá, D. & Paris, C. Query‐oriented evidence extraction to support evidence‐based medicine practice. J. Biomed. Inform. 59, 169–184 (2016). [DOI] [PubMed] [Google Scholar]
- 20. Leaman, R. et al Towards Internet‐Age Pharmacovigilance: Extracting Adverse Drug Reactions from User Posts in Health‐Related Social Networks. In Proceedings of the 2010 Workshop on Biomedical Natural Language Processing, Association for Computational Linguistics, Uppsala, Sweden, July 15, 2010.
- 21. Nikfarjam, A. , Sarker, A. , O'Connor, K. , Ginn, R. & Gonzalez, G. Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features. J. Am. Med. Inform. Assoc. 22, 671–681 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Cocos, A. , Fiks, A.G. & Masino, A.J. Deep learning for pharmacovigilance: recurrent neural network architectures for labeling adverse drug reactions in Twitter posts. J. Am. Med. Inform. Assoc. 24, 813–821 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Denecke, K. Sublanguage analysis of medical weblogs. Stud. Health Technol. Inform. 205, 565–569 (2014). [PubMed] [Google Scholar]
- 24. Han, B. , Cook, P. & Baldwin, T. Lexical normalization for social media text. ACM Trans. Intell. Syst. Technol. 4, 5:1–5:27 (2013). [Google Scholar]
- 25. Choudhury, M. et al Investigation and modeling of the structure of texting language. Int. J. Doc. Anal. Recognit. 10, 157–174 (2007). [Google Scholar]
- 26. Cook, C. & Keator, P . Automatic Noise Profile Generation Google Patents. US Patent App 14 997 8. (2016).
- 27. Xue, Z. , Yin, D. & Davison, B. D. Normalizing microtext. In Proceedings of 25th AAAI‐11 Workshop, San Francisco, CA, August 8, 2011.
- 28. Liu, F. , Weng, F. & Jiang, X . A broad‐coverage normalization system for social media language In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 1035–1044. (Association for Computational Linguistics, Beijing, China, 2012). [Google Scholar]
- 29. Khoury, R . Microtext normalization using probably‐phonetically‐similar word discovery In 2015 IEEE 11th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob) 384–391 (2015). < 10.1109/wimob.2015.7347988>. [DOI] [Google Scholar]
- 30. Reeves, B. et al Screenomics: a framework to capture and analyze personal life experiences and the ways that technology shapes them. Human‐Computer Interact. 1–52 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Chiatti, A. et al Text extraction from smartphone screenshots to archive in situ media behavior In Proceedings of the Knowledge Capture Conference 40:1–40:4 (ACM, 2017). < 10.1145/3148011.3154468>. [DOI] [Google Scholar]