Nationally, patients experience multiple barriers to receiving mental health care. In many parts of the US, access to mental health providers is limited [1]. For many patients, getting an appointment with a psychiatrist is difficult [2] and often takes weeks [3]. When patients are able to schedule appointments with a psychiatrist, the visits are usually short and aimed mostly at prescribing medications [4]. For patients with serious conditions like schizophrenia or major depression, the consequences of unattended emergence or worsening of symptoms during those time intervals can be severe. Thus, technology to provide clinicians with additional information between patient visits—what Coppersmith and colleagues have dubbed the “clinical whitespace”—could be a valuable tool. Technological tools cannot, and should not, replace the all-important physician-patient relationship, but they may help physicians utilize all the available data to provide the best possible care.
The language of patients offers a key opportunity to gain insight into their condition between appointments. A growing body of research indicates that language use contains valuable evidence for the evaluation and monitoring of mental health symptoms [5–7]. For example, some aspects of language use commonly seen in patients diagnosed with schizophrenia [8–14] can help predict which high-risk patients are likely to develop psychosis [15]. Aspects of language use have also been related to illness and illness severity in patients with depression [16–19].
The widespread use of social media provides an opportunity to access everyday language in people with schizophrenia and depression. Notwithstanding the continuing evolution of new platforms, Facebook remains a prime example: recent data shows that 69% of all U.S. adults are Facebook users with 74% of U.S. adults visiting the site at least once a day [20]. Those with severe mental illness also utilize social media frequently, with over 50% of people with schizophrenia using social media in the past week [21]. Furthermore, studies indicate that people are frequently willing to consent to use their private social media data for research [22–24], and are open to the idea of opt-in use of social media under clinical supervision [24,25]. This suggests that patient acceptance would not be a significant barrier for social media-based technological tools assisting their clinicians in their care.
Taking advantage of this data requires connecting evidence from language use in social media to mental health conditions and biomedical outcomes. Growing evidence shows that it is possible to connect the dots in this way. De Choudhury and colleagues [26,27] and Coppersmith and colleagues [28–30] pioneered early work using social media data to evaluate depression and other conditions, with an energetic community of researchers further developing methods of social media data analysis for depressive disorders and schizophrenia using Twitter [31–35], detection of depression using Facebook data [36–40], and identification of crisis or self-harm risk via social media activity on multiple platforms [30,41,42]. Increasingly comprehensive reviews on this topic have begun to emerge [43–49].
Some of our own recent work has also contributed to understanding the potential of social media data in mental health care, by focusing on clinically valid evidence about psychiatric symptoms in social media posts–that is, the connection between evidence available in social media and standard clinical measures used in traditional in-person assessments. This complements a larger body of work in which proxy variables, such as an individual posting in a relevant mental health forum or self-reporting a diagnosis, are used in lieu of actual clinical diagnoses and ratings, the latter often being much more difficult to obtain; this is important given an increased understanding of the limitations from this proxy approach [49,50]. In a pilot study [51], we had a group of psychiatrists and other clinicians provide symptom ratings for individuals based only on reading their Facebook posts, and these were compared with independent clinical ratings of the same individuals generated via in-person interviews with trained clinicians. The trends in our between-groups comparison indicate that the posts do indeed contain predictive signal about standard assessment constructs, an essential step toward technologies that can present useful information to clinicians. Prediction of outcomes has shown significant promise in work by Coppersmith et al. [30] predicting suicide attempts from Facebook and Twitter data, Birnbaum et al. [52] predicting relapse and hospitalizations in first-episode-psychosis patients using Facebook data contributed by patients, and Corcoran et al. [15], predicting transitions to psychosis using language in people at high risk for psychosis.
Moving from this promising start to deployed technologies that harness social media signal for characterizing illness will require further research, careful testing, and close engagement between technologists and clinicians. It will also require careful consideration of ethical issues and barriers to acceptance, particularly in light of concerns about privacy and use of social media content by tech giants and those to whom they provide users’ data [53–55], as well as fairness and bias in automated systems [56,57]. Significant energy is being devoted to sorting out these issues and developing appropriate guidelines [49,58], and secure data enclaves have begun to address data privacy concerns by bringing researchers to the data rather than vice versa [59]. It is crucial to remember that proper ethical consideration involves both risks and benefits. We have argued in previous work [60] that although the lack of careful ethical review for technological work on mental health is obviously unacceptable, “rejecting technology-driven research … out of anxiety regarding potential ethical concerns, without carefully considering relevant guidelines or standards in this area, is, in itself, a breach in ethics. It is discriminatory–a condition-based form of bias analogous to the neglect of women in cardiology research … or underrepresentation of minority populations in clinical trials”. With that in mind, a related and important consideration for using this type of technology in the future to assist mental health care is the extent of availability of social media data. Despite increasingly wide access, not all populations have access to the internet in the same capacity, and even when it is available, different populations may use technology in different ways. Minority groups, elderly, illiterate people, homeless, and incarcerated populations may have less opportunity to provide this type of information and data, and this issue will require careful attention in the development and introduction of new technologies supporting complementary care.
Fully consented opt-in data donation has emerged as one valuable tool for balancing the data requirements of machine learning systems with the ethical acquisition and use of individuals’ clinical and social media data [22,30]. The work by Coppersmith et al. [30] on the prediction of suicide risk makes use of data from OurDataHelps.org, a platform for the consented donation of online data that as of this writing (January 2021) has collected self-report mental health data and social media content from more than 4000 individuals. Using a variant of the OurDataHelps platform at UMD.OurDataHelps. org, our own similar data collection efforts in connection with schizophrenia and depression have enrolled more than 4500 data donors to date, where 82% of individuals who began the process have completed enrollment, not withdrawn from research, completed mental health questionnaires, and contributed social media data.1
Conclusion
From the provider perspective, technological analysis of language in social media offers the potential for a more comprehensive picture of the patient, foregrounding clinically valid signals about patients’ mental state and experiences by using social media to provide a window into the clinical whitespace, in order to facilitate management and intervention for mental health conditions [61,62]. New information that was previously unavailable to physicians can provide a window into daily life by using language in the virtual world to aid in decision making, dosing adjustments, medication changes, identification of symptom changes, and, more generally, understanding the patient’s lived experience–providing essential information in real time at the point when patient worsening or relapse may become evident.
From the patient perspective, the same technologies offer the potential for better understanding of their own mental state, more informed decision making, and more effective partnership with their providers. Evidence suggests that people who identify as having mental illness are receptive to the introduction of technologies of this kind [24,25], including delivery of mental health programs through social media [63].
Achieving this potential requires careful consideration of clinical, ethical, and practical issues, and above all it requires an increased level of understanding and partnership between technologists and clinicians. But if done well, technologically supported analysis of social media is a powerful new source of information that can be developed and used ethically and effectively to improve outcomes and the lives of the patients that we treat.
Funding
This paper was supported in part by a UMCP/UMB Innovation Seed Grant (Kelly and Resnik PIs), a UMCP/UMB - AI+Medicine for High Impact (AIM-HI) Challenge Award (Kelly and Resnik), and an Amazon AWS Machine Learning Research Award (Resnik). Additionally, the initial collaboration was created with funding from NIMH R56 (MH105571–01 (Kelly and Ghodssi).
Footnotes
Our IRB-approved data collection includes secure website enrollment, participant consent, and permission to access and collect data by a third-party technology solutions company with appropriate steps to ensure the data is anonymous and secure. Similar approaches can be found elsewhere, as well (e.g. [41]).
References
- 1.US Department of Health and Human Services. Designated Health Professional Shortage Areas Statistics. 2020.
- 2.Bishop TF, Press MJ, Keyhani S, Pincus HA. Acceptance of insurance by psychiatrists and the implications for access to mental health care. JAMA Psychiatry. 2014February1;71(2):176–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Dampier C Mental health care appointments often come with a long wait. 3 ways to cope while help is delayed. Chicago Tribune. 2018October25.
- 4.Olfson M, Marcus SC, Pincus HA. Trends in office-based psychiatric practice. American Journal of Psychiatry. 1999March1;156(3):451–7. [DOI] [PubMed] [Google Scholar]
- 5.Arevian AC, Bone D, Malandrakis N, Martinez VR, Wells KB, Miklowitz DJ, et al. Clinical state tracking in serious mental illness through computational analysis of speech. PloS One. 2020January15;15(1):e0225695. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Mundt JC, Snyder PJ, Cannizzaro MS, Chappie K, Geralts DS. Voice acoustic measures of depression severity and treatment response collected via interactive voice response (IVR) technology. Journal of Neurolinguistics. 2007January1;20(1):50–64. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Ozdas A, Shiavi RG, Silverman SE, Silverman MK, Wilkes DM. Investigation of vocal jitter and glottal flow spectrum as possible cues for depression and near-term suicidal risk. IEEE Transactions on Biomedical Engineering. 2004August24;51(9):1530–40. [DOI] [PubMed] [Google Scholar]
- 8.Buck B, Penn DL. Lexical characteristics of emotional narratives in schizophrenia: relationships with symptoms, functioning, and social cognition. The Journal of Nervous and Mental Disease. 2015September;203(9):702. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.de Boer JN, Brederoo SG, Voppel AE, Sommer IE. Anomalies in language as a biomarker for schizophrenia. Current Opinion In Psychiatry. 2020May1;33(3):212–8. [DOI] [PubMed] [Google Scholar]
- 10.Iter D, Yoon J, Jurafsky D. Automatic detection of incoherent speech for diagnosing schizophrenia. In Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic2018 Jun (pp. 136–146). [Google Scholar]
- 11.Minor KS, Bonfils KA, Luther L, Firmin RL, Kukla M, MacLain VR, et al. Lexical analysis in schizophrenia: how emotion and social word use informs our understanding of clinical presentation. Journal of Psychiatric Research. 2015May1;64:74–8. [DOI] [PubMed] [Google Scholar]
- 12.Moro A, Bambini V, Bosia M, Anselmetti S, Riccaboni R, Cappa SF, et al. Detecting syntactic and semantic anomalies in schizophrenia. Neuropsychologia. 2015December1;79:147–57. [DOI] [PubMed] [Google Scholar]
- 13.Stephane M, Kuskowski M, Gundel J. Abnormal dynamics of language in schizophrenia. Psychiatry Research. 2014May30;216(3):320–4. [DOI] [PubMed] [Google Scholar]
- 14.Strous RD, Koppel M, Fine J, Nachliel S, Shaked G, Zivotofsky AZ. Automated characterization and identification of schizophrenia in writing. The Journal of Nervous and Mental Disease. 2009August1;197(8):585–8. [DOI] [PubMed] [Google Scholar]
- 15.Corcoran CM, Carrillo F, Fernández‐Slezak D, Bedi G, Klim C, et al. Prediction of psychosis across protocols and risk cohorts using automated language analysis. World Psychiatry. 2018February;17(1):67–75. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Klumpp H, Deldin P. Review of brain functioning in depression for semantic processing and verbal fluency. International Journal of Psychophysiology. 2010February1;75(2):77–85. [DOI] [PubMed] [Google Scholar]
- 17.Steinau S, Stegmayer K, Lang FU, Jäger M, Strik W, Walther S. Comparison of psychopathological dimensions between major depressive disorder and schizophrenia spectrum disorders focusing on language, affectivity and motor behavior. Psychiatry Research. 2017April1;250:169–76. [DOI] [PubMed] [Google Scholar]
- 18.Merchant RM, Asch DA, Crutchley P, Ungar LH, Guntuku SC, Eichstaedt JC, et al. Evaluating the predictability of medical conditions from social media posts. PloS One. 2019June17;14(6):e0215476. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Rude S, Gortner EM, Pennebaker J. Language use of depressed and depression-vulnerable college students. Cognition & Emotion. 2004December1;18(8):1121–33. [Google Scholar]
- 20.Perrin A, Anderson M. Share of US Adults Using Social Media. Including Facebook, Is Mostly Unchanged Since. 2018.
- 21.Rekhi G, Ang MS, Lee J. Clinical determinants of social media use in individuals with schizophrenia. Plos One. 2019November20;14(11):e0225370. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Padrez KA, Ungar L, Schwartz HA, Smith RJ, Hill S, Antanavicius T, et al. Linking social media and medical record data: a study of adults presenting to an academic, urban emergency department. BMJ Quality & Safety. 2016June1;25(6):414–23. [DOI] [PubMed] [Google Scholar]
- 23.Michaels S Surveys of Facebook Users vs. Integrating Facebook in a Population Based Survey: Enhancing Survey Research on Social Networks. In: American Association for Public Opinion Research Conference. 2014. Anaheim, CA. [Google Scholar]
- 24.Mikal J, Hurst S, Conway M. Investigating patient attitudes towards the use of social media data to augment depression diagnosis and treatment: a qualitative study. In Proceedings of the fourth workshop on computational linguistics and clinical psychology—from linguistic signal to clinical reality2017 Aug (pp. 41–47). [Google Scholar]
- 25.Rieger A, Gaines A, Barnett I, Baldassano CF, Gibbons MB, Crits-Christoph P. Psychiatry outpatients’ willingness to share social media posts and smartphone data for research and clinical purposes: Survey study. JMIR Formative Research. 2019;3(3):e14329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.De Choudhury M, Counts S, Horvitz EJ, Hoff A. Characterizing and predicting postpartum depression from shared facebook data. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing2014 Feb 15 (pp. 626–638). [Google Scholar]
- 27.De Choudhury M, Gamon M, Counts S, Horvitz E. Predicting depression via social media. In Proceedings of the International AAAI Conference on Web and Social Media2013 Jun 28 (Vol. 7, No. 1). [Google Scholar]
- 28.Coppersmith G, Dredze M, Harman C. Quantifying mental health signals in Twitter. In Proceedings of the workshop on computational linguistics and clinical psychology: From linguistic signal to clinical reality2014 Jun (pp. 51–60). [Google Scholar]
- 29.Coppersmith G, Harman C, Dredze M. Measuring post traumatic stress disorder in Twitter. In Proceedings of the International AAAI Conference on Web and Social Media2014 May 16 (Vol. 8, No. 1). [Google Scholar]
- 30.Coppersmith G, Leary R, Crutchley P, Fine A. Natural language processing of social media as screening for suicide risk. Biomedical Informatics Insights. 2018August;10:1178222618792860. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Kayi ES, Diab M, Pauselli L, Compton M, Coppersmith G. Predictive linguistic features of schizophrenia. Arxiv Preprint Arxiv:1810.09377. 2018October22.
- 32.Mitchell M, Hollingshead K, Coppersmith G. Quantifying the language of schizophrenia in social media. In Proceedings of the 2nd workshop on Computational linguistics and clinical psychology: From linguistic signal to clinical reality2015. (pp. 11–20). [Google Scholar]
- 33.Cole DA, Nick EA, Varga G, Smith D, Zelkowitz RL, Ford MA, et al. Are aspects of Twitter use associated with reduced depressive symptoms? The moderating role of in-person social support. Cyberpsychology, Behavior, and Social Networking. 2019November1;22(11):692–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Leis A, Ronzano F, Mayer MA, Furlong LI, Sanz F. Detecting signs of depression in tweets in Spanish: behavioral and linguistic analysis. Journal of Medical Internet Research. 2019;21(6):e14199. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Resnik P, Armstrong W, Claudino L, Nguyen T, Nguyen VA, Boyd-Graber J. Beyond LDA: exploring supervised topic modeling for depression-related language in Twitter. In Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality2015. (pp. 99–107). [Google Scholar]
- 36.Mowery D, Bryan C, Conway M. Feature studies to inform the classification of depressive symptoms from Twitter data for population health. Arxiv Preprint Arxiv:1701.08229. 2017January28.
- 37.Eichstaedt JC, Smith RJ, Merchant RM, Ungar LH, Crutchley P, Preoţiuc-Pietro D, et al. Facebook language predicts depression in medical records. Proceedings of the National Academy of Sciences. 2018October30;115(44):11203–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Moreno MA, Jelenchick LA, Egan KG, Cox E, Young H, Gannon KE, et al. Feeling bad on Facebook: Depression disclosures by college students on a social networking site. Depression and Anxiety. 2011June;28(6):447–55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Park S, Lee SW, Kwak J, Cha M, Jeong B. Activities on Facebook reveal the depressive state of users. Journal of Medical Internet Research. 2013;15(10):e217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Ophir Y, Asterhan CS, Schwarz BB. The digital footprints of adolescent depression, social rejection and victimization of bullying on Facebook. Computers In Human Behavior. 2019February1;91:62–71. [Google Scholar]
- 41.Ophir Y, Tikochinski R, Asterhan CS, Sisso I, Reichart R. Deep neural networks detect suicide risk from textual facebook posts. Scientific Reports. 2020Oct 7;10(1):1–0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Bryan CJ, Butner JE, Sinclair S, Bryan AB, Hesse CM, Rose AE. Predictors of emerging suicide death among military personnel on social media networks. Suicide and Life‐Threatening Behavior. 2018August;48(4):413–30. [DOI] [PubMed] [Google Scholar]
- 43.Guntuku SC, Yaden DB, Kern ML, Ungar LH, Eichstaedt JC. Detecting depression and mental illness on social media: an integrative review. Current Opinion In Behavioral Sciences. 2017December1;18:43–9. [Google Scholar]
- 44.Alonso SG, de la Torre-Díez I, Hamrioui S, López-Coronado M, Barreno DC, Nozaleda LM, et al. Data mining algorithms and techniques in mental health: A systematic review. Journal of Medical Systems. 2018September;42(9):1–5. [DOI] [PubMed] [Google Scholar]
- 45.Calvo RA, Milne DN, Hussain MS, Christensen H. Natural language processing in mental health applications using non-clinical texts. Natural Language Engineering. 2017September;23(5):649–85. [Google Scholar]
- 46.dos Santos BS, Steiner MT, Fenerich AT, Lima RH. Data mining and machine learning techniques applied to public health problems: A bibliometric analysis from 2009 to 2018. Computers & Industrial Engineering. 2019December1;138:106120. [Google Scholar]
- 47.Chen X Social media mental health analysis framework through applied computational approaches (Doctoral dissertation, Loughborough University).
- 48.D’Hotman D, Loh E. AI enabled suicide prediction tools: a qualitative narrative review. BMJ Health & Care Informatics. 2020;27(3). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Chancellor S, De Choudhury M. Methods in predictive techniques for mental health status on social media: a critical review. NPJ Digital Medicine. 2020March24;3(1):1–1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Ernala SK, Birnbaum ML, Candan KA, Rizvi AF, Sterling WA, Kane JM, et al. Methodological gaps in predicting mental health states from social media: triangulating diagnostic signals. In Proceedings of the 2019 CHI conference on human factors in computing systems2019 May 2 (pp. 1–16). [Google Scholar]
- 51.Kelly DL, Spaderna M, Hodzic V, Nair S, Kitchen C, Werkheiser AE, et al. Blinded Clinical Ratings of Social Media Data are Correlated with In-Person Clinical Ratings in Participants Diagnosed with Either Depression, Schizophrenia, or Healthy Controls. Psychiatry Research. 2020December1;294:113496. [DOI] [PubMed] [Google Scholar]
- 52.Birnbaum ML, Ernala SK, Rizvi AF, Arenare E, Van Meter AR, De Choudhury M, et al. Detecting relapse in youth with psychotic disorders utilizing patient-generated and patient-contributed digital data from Facebook. NPJ Schizophrenia. 2019October7;5(1):1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Dance GJ, LaForgia M, Confessore N. As Facebook raised a privacy wall, it carved an opening for tech giants. The New York Times. 2018December18;18. [Google Scholar]
- 54.Naslund JA, Aschbrenner KA. Risks to privacy with use of social media: understanding the views of social media users with serious mental illness. Psychiatric Services. 2019July1;70(7):561–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Isaak J, Hanna MJ. User data privacy: Facebook, Cambridge Analytica, and privacy protection. Computer. 2018August14;51(8):56–9. [Google Scholar]
- 56.Gebru T, Morgenstern J, Vecchione B, Vaughan JW, Wallach H, Daumé H III, et al. Datasheets for datasets. Arxiv Preprint Arxiv:1803.09010. 2018March23.
- 57.Abebe R, Barocas S, Kleinberg J, Levy K, Raghavan M, Robinson DG. Roles for computing in social change. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency2020 Jan 27 (pp. 252–260). [Google Scholar]
- 58.Benton A, Coppersmith G, Dredze M. Ethical research protocols for social media health research. In Proceedings of the First ACL Workshop on Ethics in Natural Language Processing2017 Apr (pp. 94–102). [Google Scholar]
- 59.Lane J, Schur C. Balancing access to health data and privacy: a review of the issues and approaches for the future. Health Services Research. 2010October;45(5p2):1456–67. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Resnik P, Foreman A, Kuchuk M, Musacchio Schafer K, Pinkham B. Naturally occurring language as a source of evidence in suicide prevention. Suicide and Life‐Threatening Behavior. 2020September10. [DOI] [PubMed] [Google Scholar]
- 61.Triantafyllidis AK, Tsanas A. Applications of machine learning in real-life digital health interventions: review of the literature. Journal of Medical Internet Research. 2019;21(4):e12286. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Chivilgina O, Wangmo T, Elger BS, Heinrich T, Jotterand F. mHealth for schizophrenia spectrum disorders management: A systematic review. International Journal of Social Psychiatry. 2020November;66(7):642–65. [DOI] [PubMed] [Google Scholar]
- 63.Naslund JA, Aschbrenner KA, McHugo GJ, Unützer J, Marsch LA, Bartels SJ. Exploring opportunities to support mental health care using social media: A survey of social media users with mental illness. Early Intervention In Psychiatry. 2019June;13(3):405–13. [DOI] [PMC free article] [PubMed] [Google Scholar]