Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 May 1.
Published in final edited form as: J Affect Disord. 2019 Mar 6;250:163–169. doi: 10.1016/j.jad.2019.03.044

Short-term prediction of suicidal thoughts and behaviors in adolescents: Can recent developments in technology and computational science provide a breakthrough?

Nicholas B Allen 1, Benjamin W Nelson 2, David Brent 3, Randy P Auerbach 4
PMCID: PMC6481940  NIHMSID: NIHMS1523626  PMID: 30856493

Abstract

Background

Suicide is one of the leading causes of death among adolescents, and developing effective methods to improve short-term prediction of suicidal thoughts and behaviors (STBs) is critical. Currently, the most robust predictors of STBs are demographic or clinical indicators that have relatively weak predictive value. However, there is an emerging literature on short-term prediction of suicide risk that has identified a number of promising candidates, including (but not limited to) rapid escalation of: (a) emotional distress, (b) social dysfunction (e.g., bullying, rejection), and (c) sleep disturbance. However, these prior studies are limited in two critical ways. First, they rely almost entirely on self-report. Second, most studies have not focused on assessment of these risk factors using intensive longitudinal assessment techniques that are able to capture the dynamics of changes in risk states at the individual level.

Method

In this paper we explore how to capitalize on recent developments in real-time monitoring methods and computational analysis in order to address these fundamental problems.

Results

We now have the capacity to use: (a) smartphone, wearable computing, and smart home technology to conduct intensive longitudinal assessments monitoring of putative risk factors with minimal participant burden and (b) modern computational techniques to develop predictive algorithms for STBs. Current research and theory on short-term risk processes for STBs, combined with the emergent capabilities of new technologies, suggest that this is an important research agenda for the future.

Limitations

Although these approaches have enormous potential to create new knowledge, the current empirical literature is limited. Moreover, passive monitoring of risk for STBs raises complex ethical issues that will need to be resolved before large scale clinical applications are feasible.

Conclusions

Smartphone, wearable, and smart home technology may provide one point of access that might facilitate both early identification and intervention implementation, and thus, represents a key area for future STB research.

Keywords: Suicide prediction, Suicide prevention, Smart phones, Wearable computing, Smart home technology, Machine Learning


Suicide is a leading cause of death across all age groups (Turecki & Brent, 2016) and is the second leading cause of death among adolescents (CDC, 2017). This is likely to be an underestimate as many cases are not reported or do not present for care. In addition to deaths, 16% of high school students report seriously considering suicide each year, and 8% make one or more suicide attempt (CDC, 2017). Despite these alarming statistics, little is known about factors that confer imminent risk for suicide in this (or any other) age group. A recent meta-analysis showed that in the past 50 years, we have not appreciably improved our ability to predict which individuals are most likely to die by suicide (Franklin et al., 2017), and the question of when they might be at greatest risk is even more challenging (Millner, Lee, & Nock, 2017). Doubtlessly, part of the problem stems from the fact that research has continuously tested variants of the same risk indicators with a heavy reliance on medical records, demographics, clinical interviews, and patient self-report questionnaires. Furthermore, much of this research has tested these measures in isolation, rather than incorporating multiple risk variables that may have additive and interacting effects (Walsh, Ribeiro, & Franklin, 2017). Only a few studies have focused on imminent suicide risk (Glenn & Nock, 2014), and moreover, these studies are often conducted with group level data, which may not generalize to the individual (Fisher, Medagliab, & Jeronimusd, 2018). This is a particular challenge given the fact that risk processes for suicide are likely to be highly idiosyncratic. Taken together, it is clear that there is a critical need to improve the short-term prediction of suicide risk, and to develop innovative approaches and techniques in order break out of our pattern of stasis.

The ability to intervene precisely at critical moments in a person’s life—such as during acute risk for suicidal actions—could dramatically reduce loss of life from suicide. Much of what we do in the clinical consulting room is designed to equip patients with the coping skills necessary to face crises that occur outside of the clinician’s presence. Indeed, many of the most effective suicide prevention programs are effective exactly because they provide barriers to harmful behaviors at the critical moment of action (Yip et al., 2012). Moreover, even if attempts are not fully prevented, interrupting attempts before actions become lethal can also have life-saving benefits. An example is the use of blister packaging for medications commonly used in suicide attempts, where placing a minor barrier to lethal action at the moment of action can divert people away from the attempt and save lives (Yip et al., 2012). “Just-in-time” adaptive interventions delivered via mobile health applications have also demonstrated the potential benefit of low-intensity, high-impact interventions when they are delivered in a timely fashion (Nahum-shani et al., 2014; Nahum-Shani et al., 2016). However, to apply such techniques to suicide, we need to solve the prediction problem—to determine not only who may need an intervention, but also when an intervention would be ideally timed.

In order to have a real public health impact, methods of predicting short-term suicide risk must be reliable, feasible, scalable, and affordable. Given the large proportion of individuals experiencing mental health crises who do not receive treatment (Thornicroft et al., 2016), prediction methods should ideally have the potential to reach those not currently in traditional mental health care. Current methods for predicting suicidal thoughts and behaviors (STBs), such as clinical monitoring and screening usually fail on most, if not all, of these criteria. Currently, our most common predictors of STBs are general demographic or clinical indicators with relatively weak predictive value that are of little use in short-term prediction (Glenn & Nock, 2014). The goal of this paper is to explore the potential of new consumer technology (i.e., mobile, wearable, and smart home computing) for moving past traditional methods to identify new real-time predictors of STBs in high-risk individuals.

Theories of Suicidal Thoughts and Behaviors: Relevance to Short-Term Prediction

Despite the existence of a number of well-supported theoretical approaches that delineate risk for STBs across all age groups, they have not yet translated into improved short-term prediction of STBs. That said, promising risk factors from Shneidman’s Psychache Theory (e.g., emotional distress; Shneidman, 1993), Joiner’s Interpersonal Theory of Suicide (Van Orden et al., 2010), and Mann’s Diathesis-Stress Theory of Suicidal Behavior (Mann, Waternaux, Haas, & Malone, 1999) offer frameworks within which to make predictions regarding proximal risk processes for STBs – including in youth populations. Specifically, Shneidman proposed that Psychache, or mental pain (i.e., emotional distress), is a transdiagnostic predictor of suicidal behavior (Shneidman, 1993; Troister, Davis, Lowndes, & Holden, 2013; Troister & Holden, 2012; Verrocchio et al., 2016) and may provide a strong motivation to engage in suicidal behavior (Ma, Batterham, Calear, & Han, 2016). Consistent with this, a recent study used a timeline follow-back approach to assess near-term affect prior to suicide attempts and found that acute emotional distress—namely feelings of self-dissatisfaction, hostility, loneliness, or fear—increased in the 6 hours preceding a suicide attempt (Bagge, Littlefield, & Glenn, 2017; Millner, Lee, & Nock, 2017). Moreover, the findings highlighted acute peaks in distress 1-2 hours prior to the attempt, which provides important preliminary empirical support for the link between rapid increases in emotional distress and suicide attempts. Similarly, Ecological Momentary Assessment (EMA) research in high-risk groups has found that emotional distress (e.g., loneliness, hopelessness) covaried with suicidal ideation (Kleiman, Turner, Fedor, Beale, Huffman, & Nock, 2017). These studies are broadly consistent with previous studies linking increases in negative affect with suicidal thoughts (Nock, Prinstein, & Sterba, 2009) and suicide deaths (Hendin, Maltsberger, Lipschitz, Haas, & Kyle, 2001). Therefore, Shneidman’s theoretical model and the extant literature strongly suggest that real time monitoring of emotional distress is likely to be important for any approach to short-term prediction of STBs as one of the motivations for suicide has been proposed to relate to an attempt to escape distress (Klonsky, May, & Saffer, 2016).

Joiner’s Interpersonal Theory of Suicide (Van Orden et al., 2010) posits that suicidal acts result from interactions among acquired capacity for suicide, thwarted belongingness, and perceived burdensomeness (Ma et al., 2016). In a test of this theory, Bagge & colleagues (2013) also used a timeline follow-back approach and found that increased risk of attempting suicide was associated with the occurrence of a negative life events in the 48 hours prior to the attempt—particularly interpersonal life events involving a romantic partner. This is consistent with prior research that found 78% of patients with a recent suicide attempt reported a conflict with a spouse, lover, or family member preceding their attempt (Hall et al., 2011). Among youth, Stewart and colleagues (2017a) recently demonstrated that when comparing the occurrence of stress among suicide ideators and attempters, interpersonal stress, but not non-interpersonal domains, differentiated the groups, further highlighting the importance of probing the association between interpersonal processes and suicide attempts (Stewart et al., In Press). Among psychiatrically hospitalized youth, Stewart and colleagues (2017a) also showed that peer victimization (e.g., reputational and overt victimization) was associated with past suicide attempts. Integrating these findings with Joiner’s interpersonal theory underscore the importance of probing disturbances in social relationships to improve the short-term prediction of STBs.

Finally, Mann’s Diathesis-Stress Theory of Suicidal Behavior (Mann et al., 1999) views suicidal behavior as a convergence between the experience of distress and the tendency to act. Although Mann refers to a wide range of biologically-based diatheses, one potential diathesis that shows dynamic change across time is sleep disturbance. Furthermore, sleep disturbance is a well-established risk factor for STBs itself, and also potentiates the effect other risk factors (e.g., emotional distress, social dysfunction; Goldstein & Walker, 2014; Tarokh, Saletin, & Carskadon, 2016). In prior research, Goldstein and colleagues found that sleep disturbance, particularly insomnia in the previous week, was associated with adolescent suicide, even after controlling for depression severity (Goldstein, Bridge, & Brent, 2008). Similarly, Hall and colleages (1999) found that insomnia was associated with severe suicide attempts, again highlighting the link between sleep disturbance and suicide. In a recent study using EMA techniques, Littlewood et al. (2018) found that daily measures of short sleep duration and poor sleep quality predicted next day suicidal ideation. In regards to treatment, a more recent study of veterans with insomnia, found that after treatment with cognitive behavioral therapy for insomnia, there was a 65% reduction in participants’ odds for suicidal ideation (Trockel, Karlin, Taylor, Brown, & Manber, 2015). As we note below, there is an opportunity to move beyond traditional self-report based sleep disturbance assessments by using digital technology sensing methods to assess sleep patterns to determine whether the detection of real-time fluctuations in sleep improves short-term STB prediction.

Real-Time Monitoring and Short-Term Prediction of Suicidal Thoughts and Behaviors with Mobile and Wearable Computing

While the onset of suicidal ideation and selection of suicide methods often occur years prior to an attempt, the proximal steps to suicide often occur within a week, and mostly within hours, prior to the attempt (Millner et al., 2017). Thus, it is imperative to probe risk processes that occur over the day preceding a suicide attempt, as this may afford key insights about why individuals plan and attempt suicide. Presently, existing research aimed at detecting short-term risk for STBs is limited in a number of critical ways. First, it relies almost entirely on self-report data, and moreover, often uses retrospective recall techniques, which may not be sensitive to psychological and behavioral processes that are rapidly changing, may be poorly recalled when not in an acute state of risk, and may even be outside of one’s conscious awareness (e.g., Stewart, et al., 2017b). Second, most studies have not focused on assessment of these risk factors using intensive longitudinal assessment methods, which is a major fundamental limitation of extant STB research. Those that have used real time assessment techniques such as EMA, involve considerable participant burden (thereby limiting the scalability and application in clinical assessment), and still rely primarily on self-report data.

Intensive longitudinal assessment, using mobile computing (Harari et al., 2016; Insel, 2017; Lind et al., 2018) and wrist-worn smart watches and fitness monitors (i.e., wearables) (Sano et al., 2018) may be transformative technologies that can improve our short-term prediction of suicidal behavior and thus, our capacity to provide timely and effective intervention at scale to high-risk individuals (Torous et al., 2018; Vahabzadeh, Sahin, & Kalali, 2016; See Lind et al., 2018, for detailed description of the type of data that can be collected using smart phone based passive sensing methods). The temporal precision with which these data can be collected provide unprecedented opportunities to evaluate processes derived from key theoretical models and prior empirical research; especially as they apply to youth. Current mobile technologies are able to passively record key variables that are plausibly related to risk domains drawn from theoretical models of suicide, including communicative language (e.g., in social media communications; Jashinsky et al., 2014), social withdrawal, and sleep (Bernert, Kim, Iwata, & Perlis, 2015). Also, and perhaps most critically, these technologies provide continuous, unobtrusive, and ecologically valid measurement of these variables, allowing for the assessment of individualized baselines and sensitive detection of deviations from these baselines that may clarify the pathway to suicide. This is critical for the short-term prediction of STBs, as very often suicidal acts are impulsive (Auerbach, Stewart, & Johnson, 2017; Rimkeviciene, Ogorman, & De Leo, 2015) and represent a response to rapid changes in the person’s internal or external environment that can be easily missed by less frequent assessments (such as those associated with clinical or outreach consultations—which are presently the gold-standard of care) or even more frequent EMA methods.

Theoretical models of STBs, such as those described above, and recent empirical findings, suggest ways in which passive mobile sensing technology may be used to: (1) differentiate suicide attempters and suicide ideators (thereby more objectively and accurately identifying high-risk individuals) (Auerbach, Millner, Stewart, & Esposito, 2015; Stewart et al., 2017c), (2) improve short-term prediction of youth STBs, (3) inform testing and refinement of leading theoretical models, (4) collect intensive longitudinal data using current consumer mobile devices, and (5) provide additional services at critical moments of action. Table 1 describes domains of variables that can be collected by mobile and wearable computing devices that relate to theoretical models and mobile sensing data and features extracted from mobile sensing.

Table 1.

Continuity among Theoretical Constructs, Risk Domains, and Passive Sensing

Theoretical Model Risk Domain Digital Sensing Data Example Features
Psychache Theory (Shneidman) Emotional distress Acoustic voice; Sentiment in communicative language (e.g., via social media, text messaging); Facial expression (selfies); Music choice. Fundamental frequency of voice; Positive or negative sentiment in language; Sad or anxious facial expression; Change in music selection.
Interpersonal Theory of Suicide (Joiner) Social dysfunction (e.g., thwarted belongingness, perceived burdensomeness) Self-relevant and social content in communicate language; Patterns of online communication (frequency, diversity of online contacts); Geographic movement. Negative self-sentiment in language; Bullying or social rejection; Reduction in frequency of social contacts; Reduction in diversity of social contacts; Decrease in time spent outside of home.
Diathesis-Stress Model of Suicide (Mann) Sleep disturbance (biological diathesis) Actigraphy; Light Sensor, Diurnal Patterns of phone Use. Time in bed; Total sleep time; Sleep onset latency; Wake after sleep onset; Morningness/Evening ness.

Note. Digital sensing data can be collected from a range of devices (e.g., smart phones) and methods (e.g., keyboard input, voice input, GPS location data, photography, etc.)

For example, Emotional distress can be measured using acoustic voice data, communicative language (e.g., via social media, text messaging), heart rate, facial expression, and music choice. Social dysfunction can be measured through natural language processing of the content of online communication, patterns (i.e., frequency, duration) of online communication, and geographic movement. Sleep patterns can be quantified through mobile and wearable sensing using actigraphy, heart rate, light sensors, and diurnal patterns of device use.

Adolescents and Digital Technology: A Special Opportunity?

We have already made clear that adolescence is a critical phase of life for the emergence of suicidal thoughts and behaviors, and indeed for mental disorders more generally (Kessler et al., 2005). There are also reasons suggesting that the opportunity to apply mobile and wearable technology to understanding short-term risk factors for STBs is particularly propitious amongst adolescents. Technological innovations, especially smartphones and online social networks, are especially influential in the daily lives of adolescents (Bell et al, 2015; Madden et al., 2013; Shapiro & Margolin, 2014). The current cohort of adolescents are often referred to as “digital natives”— and they use digital communication extensively to enhance their social relationships by sharing intimacy, displaying affection and arranging social activities (Yau & Reich, 2018). Moreover, the ways in which current technologies facilitate social communication mesh with the primary developmental tasks of adolescence, which include exploring and learning about peer, romantic, and sexual relationships (Dahl, Allen, Wilbrecht, & Suleiman, 2018). Social media in particular provides almost ubiquitous access to peer interaction (Shapiro & Margolin, 2014), and does so in a way that is relatively free of parental monitoring (another appealing aspect of social media for adolescents; Smetana et al, 2006). This creates unprecedented opportunities for positive social connection and support, but it also intensifies adolescents’ exposure to negative social encounters. Indeed, in a recent review, Odgers proposed that the use of social media acts as an “amplifier” of offline strengths and vulnerabilities—often enhancing the lives of those who are popular and confident, and increasing vulnerability amongst those who are at risk (Odgers, 2018). Not surprisingly young people experiencing mental health problems highly value accessing mental health information and support online (Lai et al., 2018). In short, adolescents use digital technology in ways that are distinct from older people. In particular they are more likely to use these technologies for intimate and socially risky forms of communication, which may include direct request for support during mental health and other crises. As such, the behavior that can be accessed via mobile phone sensors may well be more reflective of psychological states and interpersonal needs during adolescence than they are at other phases of life, creating a particular opportunity to utilize these approaches to track psychologically significant processes, especially those related to distress (psychache) and interpersonal models of vulnerability.

Smart Home Devices in the Prediction of STBs

Another promising avenue afforded by recent developments in consumer technology is the potential use of smart home technology (i.e., internet connect devices in the home including cameras, “smart” speakers, and internet connected home appliances; sometimes also referred to as “internet of things” or IOT devices), for furthering our understanding of risk processes that typically occur in the home (Nelson & Allen, 2018). Like mobile and wearable computing, collection of behavioral data via smart home technology also provides a set of tools that can create unique opportunities. For example, similar to mobile and wearable computing devices, smart home methods collect data in a way that is continuous, passive, intensively longitudinal, and multimodal (e.g., facial expression, acoustical qualities of voice, interpersonal behaviors, language). However, smart home approaches have some unique advantages that are distinct from those associated with mobile and wearable approaches, including that they provide data from a third-person observational perspective (i.e., they can observe behavior from a vantage point away from the person themselves, such as with cameras) that preserves ecological validity by taking place outside of the laboratory and within participants’ own homes (Nelson & Allen, 2018). Moreover, smart home approaches can connect to home devices (i.e., a gun safe, medicine cabinet, or refrigerator) that may provide information about risky behaviors, which are known contributors to suicide behaviors (Stewart et al., 2017). As the majority of suicide attempts occur in the home (Kellermann et al., 1992), home based monitoring technology may have particular relevance for addressing this issue. Utilizing smart home technologies in tandem with EMA methods (Kleiman, Turner, Fedor, Beale, Huffman, & Nock, 2017) would allow for the collection of observed facial, speech, and behavioral data as well as experiential data on affective states that could allow for a greater understanding of short-term risk processes and have great clinical significance by detecting those who are likely to attempt suicide, thereby facilitating timely intervention at moments of greatest risk. Given the significance of home environments for close interpersonal relationships, and salience of interpersonal processes in risk for STBs, smart home assessment may be especially relevant to understanding interpersonal risk processes—particularly those linked to STBs.

Although it is likely that smart home data collection is relevant to many age groups, some aspects of these methodologies may be particularly applicable to adolescents. For example, adolescence is a period of life associated with increases in family conflict (Collins & Laursen, 2004; Laursen et al., 1998) and family conflict is also associated with suicide risk (Pineda & Dadds, 2013). Prior efforts to study interpersonal behaviors in families have used designs such as laboratory conflict resolution paradigms, questionnaires, and recruiting families to stay in specially designed research homes equipped with recording devices (Gottman, 1979; Gottman, 2011; Sheeber, Allen, Davis, & Sorensen, 2000). In a recent paper, Nelson and Allen (2018) have described how smart home technology could be applied to understanding interpersonal dynamics in the home, including family conflict, in ways that have a number of methodological advantages over prior approaches. Given the salience of family conflict during adolescence, and its relevance to STBs, these techniques may provide unique, developmentally targeted, opportunities to study these processes in real time, and in real contexts amongst families of at-risk adolescents.

As noted above, sleep disturbance is related to risk for STBs and is another example of a salient set of home-based behaviors that may be tracked and potentially modified using smart home technology. As with family conflict, there are developmental issues that make sleep a particularly salient target during adolescence, as biological, environmental, and behavioral aspects of adolescent development often result in compromised sleep, and poor sleep has in turn shown strong associations with depression, anxiety, and suicide (Blake, Trinder & Allen, 2018; Kearns et al., 2018). Consumer wearable devices such as actigraphy sensors are now commonly used to capture behavioral sleep data (Marino et al., 2013). While smart home technologies cannot yet capture all physiological data that can be acquired in a full sleep polysomnograph, new methods utilizing RF signals via WiFi can now be used to index respiration, heart rate (Adib, Mao, Kabelac, Katabi, & Miller, 2015; Zhao, Adib, & Katabi, 2016), and sleep stages (Zhao, Yue, Katabi, Jaakkola, & Bianchi, 2017) even in the absence of wearable sensors, therefore providing novel data that could be used to advance understanding of STBs.

Collectively, the use of passive sensing data holds enormous promise to improve the short-term prediction of STBs. Doubtlessly, identifying when an individual will make a suicide attempt represents the holy grail of suicide research. However, by leveraging the native technology that people are using every day, it affords a unique opportunity to assess risk states, and ultimately, provides a critical window to intervene.

Using Machine Learning to Analyze Digital Health Data

Smartphone, wearable, and smart home technologies all provide multimodal longitudinal data that may offer the possibility of discovering new predictors though data driven techniques such as machine learning (ML). This is particularly relevant to the high volume, and high dimensionality, of data that can be obtained using digital sensing of behavior, which lends itself to ML approaches. For example, past studies have utilized ML on retrospective data to predict suicide attempts (Delgado-Gomez, Blasco-Fontecilla, Sukno, Socorro Ramos-Plasencia, & Baca-Garcia, 2012; Mann et al., 2008). More recently, research has applied ML techniques to improve suicide prediction. Specifically, ML analyses of military administrative data and medical records identified about half of all post-Army discharge suicide deaths (Kessler et al., 2017); yet, the fact that accurately detecting only half the cases constitutes an impressive achievement is testament to the challenges inherent in prediction of suicide risk. In another recent study, ML was used to analyze functional magnetic resonance imaging neural signatures of death- related and life-related concepts amongst suicide ideators and controls and found that they were able to predict which ideators went to have an attempt with 94% classification accuracy (Just et al., 2017). In addition, recent research has applied ML techniques to electronic health records and researchers were able to predict future suicide attempts with 79% precision (Walsh et al., 2017). In the realm of digital data, recent research has utilized ML approaches on public Twitter posts in order to classify “unique linguistic profiles” that may signal suicide risk (Burnap, Colombo, Amery, Hodorog, & Scourfield, 2017; O’Dea, Larsen, Batterham, Calear, & Christensen, 2017), and more recently Du et al (2018) found that deep learning models of Twitter data performed better than more traditional ML approaches (e.g., Support Vector Machine, Extra Trees) in identifying suicide related Tweets. Despite these promising findings, attempts to apply ML techniques to suicide prediction are still in their infancy, and most do not utilize the kinds of data that will facilitate short-term prediction of suicidal thoughts and behaviors (i.e., those that predict not only who might be at risk, but when a suicide attempt is likely to occur).

Ethical Considerations for Technological Measurement of Suicide Risk

The collection of behavioral data through mobile, wearable, and smart home based technologies—particularly among adolescents—is an especially complex issue because of the personal and highly identifiable nature of the data being collected (e.g., Carter, Liddle, Hall, & Chenery, 2015; Kelly et al., 2013; Nebeker et al., 2016; Nelson & Allen, 2018; Pisani et al., 2016; Torous & Nebeker, 2017; Torous & Roberts, 2017), which creates unique ethical and legal issues that should proactively be taken into consideration. For example, a recent study found that research participants can be uniquely identified with only four smartphone location data points (De Montjoye, Hidalgo, Verleysen, & Blondel, 2013). Therefore, due to the highly identifiable characteristics of digital health data, these data will require novel methods to protect not only participant data, but also that of third-parties (Nebeker et al., 2016; Torous & Nebeker, 2017). It is important to note that simply removing subject names, dates of birth, addresses, and other common variables that are de-identified in research settings will be insufficient to anonymize participants when digital health data is being used. For example, in an anonymized dataset of medical billing records of 2.9 million individuals released by the Australian government, researchers were able to de-anonymize and find individual health history by integrating the anonymized dataset with public information (Culnane, Rubinstein, & Teague, 2017). Similarly, researchers have been able to correctly identify Twitter users in a large database with 96.7% accuracy solely based on applying ML to users’ metadata (Perez, Musolesi, & Stringhini, 2018).

There are a number of potential methods for data encryption and automated identity recognition via facial or voice data that would allow for achieving greater confidentiality of participant and third-party data. For example, prior to data storage, highly identifiable data such as video, picture, and voice data could be scanned by automated facial and speech recognition software in order to match collected data with participants facial and audio samples (Hansen & Hasan, 2015; Jain, & Li, 2011; Turk & Pentland, 1991). Prior to humans viewing this data, any data that did not match that of the target participant would be automatically deleted prior to being saved to an encrypted and HIPAA protected cloud service. Lastly, the collection of highly identifiable digital health data creates some challenges when trying to adhere to Open Science guidelines, particularly those surrounding open datasets. In a simple scenario, only data that participants have specifically authorized to be shared on open data repositories would be made available to other researchers. Another option might be to provide an open science database that researchers could only access through an interface that precludes the ability to look at raw data in order to preserve participant data protections, while allowing for research findings to be reproducible.

An ethical challenge that is particularly relevant to studies of those at risk for suicide is to establish appropriate balance between privacy and safety when a life-threatening event is at stake (Coppersmith et al., 2018). For example, what kind of duty of care should be afforded to participants who provide data that may indicate risk, and what threshold of certainty in prediction should be applied to such a response? Given the ubiquitous and intensive nature of the data collection there are a number of somewhat unique challenges here. First, research has not yet provided us with algorithms that can use passive sensor data to predict suicide risk with acceptable sensitivity and specificity to engender a clinical response. For example, phrases that may be considered to indicate high risk on face value but that are often used colloquially, such as entering the words “I can’t stand it anymore” or “I want to kill myself” into one’s mobile phone, are likely to result in a large number of false positives until research can provide decision rules that clarify the cases when this is, and is not, likely to be indicative of risk. Such false positive could result in clinical responses that take resources from more genuinely urgent cases. A second challenge is the time frame of the response, as few research studies have the systems required to process and respond to such indices in real time (in part because, as outlined above, accurate prediction algorithms do not yet exist). Finally, if a study is geographically diverse (as might be required to obtain the number to participants to provide adequate power to conduct prospective prediction study of STBs) the task of mounting an effective response to a high-risk situation might be especially challenging in locations that are distal to the study team and/or have limited local resources. Although these challenges are not insurmountable, they do need to be carefully considered by teams planning this type of research.

One resource for researchers, IRBs, and industry partners dealing with the myriad ethical issues surrounding the collection and use of digital health data comes from the Connected and Open Research Ethics (CORE) initiative that was recently designed and launched to develop ethical practices in digital research (Torous & Nebeker, 2017). This initiative, launched in 2016, contains members from over 10 countries with expertise spanning bioethics, privacy, technology, and research ethics and provides a digital platform of shared knowledge and resources (e.g., approved IRBs and consents) regarding the use of passive sensing technology in research studies (The Regents of the University of California, 2016), while also providing a means for researchers to ask and answer questions related to the ethics of digital health data. In other words, CORE encourages sound digital health research practices by tapping into a transdisciplinary network of researchers to crowdsources resources to help guide research design and implementation.

Future Directions

The ultimate goal of this work is to translate these findings into actionable steps that clinicians and patients can take to reduce distress and save lives. In this review, we wish to highlight the opportunity to develop robust, automated, and scalable methods for predicting transitions in clinical status that are associated with increased suicidal risk—especially proximal to the suicide attempt. However, before we can achieve this goal, a number of critical research agendas must be addressed. Each of these are complex and demanding topics that will require considerable investment of effort and funding. These include (but are not limited to):

  1. Can we use technology assisted methods to predict short term (i.e., over days, hours, or minutes) changes in suicide risk status? If so, can this be achieved with sufficient sensitivity and specificity to be clinically useful?

  2. In what populations is this possible (e.g., general population, psychiatric populations, those at high risk for STBs such as previous attempters or those in current treatment for STBs)?

  3. Can we develop normative models of prediction that can be applied to individuals, or do we need to develop individual specific (ideographic) models to achieve adequate prediction? If ideographic models are necessary, how can we collect enough baseline data on each person to develop such models?

  4. How do we balance duty of care against privacy given the intrusive nature of the data collection permitted by digital technology?

  5. If we are able to track behavior and predict changes in risk status, what kinds of “just-in-time” interventions and helpful (and not harmful) during psychologically sensitive states such as periods of high risk for suicidal behavior? (see Noterdame et al., 2018 for a description of such a system). How can such interventions be tailored to individuals?

As noted, these questions are complex and will require considerable interdisciplinary research efforts from teams with expertise in a variety of disciplines including psychiatry, psychology, computer and biomedical engineering, data science, human computer interaction, behavior change, and public health. Indeed, the aspiration to predict suicidal thoughts and behaviors specifically may ultimately turn out to be less tractable than the prediction of a broader category of events associated with mental health crisis states (e.g., increases in symptoms and or disability, and decreases in functioning). Thus, we may have to design automated clinical response systems that remain relatively broad in their focus until careful assessment of the individual can be conducted. Another important future direction will be conducting focus groups with patients, parents, and clinicians to find out how they would prefer to be notified of risk and what actions they would find useful and acceptable in response to this change in risk status. For example, signatures associated with changes in risk status could be identified during an initial period of care, after which the clinician could provide feedback to the patient on triggers and early warning signs. The clinician and patient can then discuss the time course and talk about actions that can be taken so that resources and support can be matched to the patent’s individual needs. Perhaps a young person who is experiencing a lot of emotional pain, might get pushed prompts to use distress tolerance skills (e.g., Kennard et al., In Press). Alternatively, a teen feeling socially disconnected or rejected might benefit from a text or phone call to help manage the crisis. Such person-centered—or precision medicine-oriented interventions—would revolutionize clinical care. In this review wish aim to highlight the fact that smartphone, wearable, and smart home technology may provide the opportunity for important innovations that may facilitate both early identification and intervention, and thus, represents a key area for future STB research.

Highlights.

  • Accurate methods for short-term prediction of suicidal risk are not yet established.

  • Developments in digital sensing and computational analysis provide new methodological capabilities that are relevant to this challenge.

  • Smartphone, wearable, and smart home technology have been shown to measure putative risk factors, including emotional distress, interpersonal behavior, and sleep disturbance.

  • Although significant ethical challenges remain, there are promising approaches to address these.

  • Digital sensing represents a promising agenda for future research on suicide risk.

Acknowledgments

Role of Funding Source

The project was supported through funding from the National Institute of Mental Health (NIMH) U01 MH116923-01 (NBA, RPA, DB). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or NIMH.

Dr. Auerbach is member of the American Foundation for Suicide Prevention Advisory Board.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Conflict of Interest

The authors report no conflict in interest.

Contributor Information

Nicholas B. Allen, Department of Psychology, University of Oregon, Center for Digital Mental Health, University of Oregon

Benjamin W. Nelson, Department of Psychology, University of Oregon, Center for Digital Mental Health, University of Oregon

David Brent, Department of Psychiatry, University of Pittsburgh.

Randy P. Auerbach, Department of Psychiatry, College of Physicians and Surgeons, Columbia University; Division of Clinical Developmental Neuroscience, Sackler Institute

References

  1. Adib F, Mao H, Kabelac Z, Katabi D, & Miller RC (2015, April). Smart homes that monitor breathing and heart rate. In Proceedings of the 33rd annual ACM conference on human factors in computing systems (pp. 837–846). ACM. [Google Scholar]
  2. Auerbach RP, Millner AJ, Stewart JG, & Esposito EC (2015). Identifying differences between depressed adolescent suicide ideators and attempters. Journal of Affective Disorders, 186, 127–133. 10.1016/j.jad.2015.06.031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Auerbach RP, Stewart JG, & Johnson SL (2017). Impulsivity and Suicidality in Adolescent Inpatients. Journal of abnormal child psychology, 45(1), 91–103. 10.1007/s10802-016-0146-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bagge CL, Glenn CR, & Lee H-J (2013). Quantifying the impact of recent negative life events on suicide attempts. Journal of Abnormal Psychology, 122(2), 359–368. 10.1037/a0030371 [DOI] [PubMed] [Google Scholar]
  5. Bagge CL, Littlefield AK, & Glenn CR (2017). Trajectories of Affective Response as Warning Signs for Suicide Attempts. Clinical Psychological Science, 5(2), 259–271. 10.1177/2167702616681628 [DOI] [Google Scholar]
  6. Bell V, Bishop DV, & Przybylski AK (2015). The debate over digital technology and young people. BMJ: British Medical Journal (Online), 351. [DOI] [PubMed] [Google Scholar]
  7. Bernert RA, Kim JS, Iwata NG, & Perlis ML (2015). Sleep Disturbances as an Evidence-Based Suicide Risk Factor. Current Psychiatry Reports, 17(3), 15 10.1007/s11920-015-0554-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Blake MJ, Trinder JA, & Allen NB (2018). Mechanisms underlying the association between insomnia, anxiety, and depression in adolescence: Implications for behavioral sleep interventions. Clinical Psychology Review, 63, 25–40. 10.1016/j.cpr.2018.05.006 [DOI] [PubMed] [Google Scholar]
  9. Burnap P, Colombo G, Amery R, Hodorog A, & Scourfield J (2017). Multi-class machine classification of suicide-related communication on Twitter. Online Social Networks and Media, 2, 32–44. 10.1016/j.osnem.2017.08.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Carter A, Liddle J, Hall W, & Chenery H (2015). Mobile Phones in Research and Treatment: Ethical Guidelines and Future Directions. JMIR MHealth and UHealth, 3(4), e95 10.2196/mhealth.4538 [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. CDC. (2015). Suicide Risk and Protective Factors. Retrieved from https://www.cdc.gov/healthcommunication/toolstemplates/entertainmented/tips/SuicideYouth.html
  12. Collins W, & Laursen B (2004). Changing relationships, changing youth. Journal of Early Adolescence, 24, 55–62. 10.1177/0272431603260882 [DOI] [Google Scholar]
  13. Coppersmith G, Leary R, Crutchley P, & Fine A (2018). Natural language processing of social media as screening for suicide risk. Biomedical informatics insights, 10, 1178222618792860. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Culnane C, Rubinstein BIP, & Teague V (2017). Health Data in an Open World. Retrieved from http://arxiv.org/abs/1712.05627
  15. Dahl RE, Allen NB, Wilbrecht L, & Suleiman AB (2018). Importance of investing in Nadolescence from a developmental science perspective. Nature, 554(7693), 441–450. [DOI] [PubMed] [Google Scholar]
  16. De Montjoye YA, Hidalgo CA, Verleysen M, & Blondel VD (2013). Unique in the Crowd: The privacy bounds of human mobility. Scientific Reports, 3, 1–5. 10.1038/srep01376 [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Delgado-Gomez D, Blasco-Fontecilla H, Sukno F, Socorro Ramos-Plasencia M, & Baca-Garcia E (2012). Suicide attempters classification: Toward predictive models of suicidal behavior. Neurocomputing, 92, 3–8. 10.1016/j.neucom.2011.08.033 [DOI] [Google Scholar]
  18. Du J, Zhang Y, Luo J, Jia Y, Wei Q, Tao C, & Xu H (2018). Extracting psychiatric stressors for suicide from social media using deep learning. BMC medical informatics and decision making, 18(2), 43. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Fisher AJ, Medagliab JD, & Jeronimusd BF (2018). Lack of group-to-individual generalizability is a threat to human subjects research. Proceedings of the National Academy of Sciences, 201711978. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Franklin JC, Ribeiro JD, Fox KR, Bentley KH, Kleiman EM, Huang X, … Nock MK (2017). Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychological Bulletin, 143(2), 187–232. 10.1037/bul0000084 [DOI] [PubMed] [Google Scholar]
  21. Glenn CR, & Nock MK (2014). Improving the short-term prediction of suicidal behavior. American Journal of Preventive Medicine, 47(3), S176–S180. 10.1016/j.amepre.2014.06.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Goldstein AN, & Walker MP (2014). The Role of Sleep in Emotional Brain Function. Annual Review of Clinical Psychology, 10, 679–708. 10.1146/annurev-clinpsy-032813-153716 [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Goldstein TR, Bridge JA, & Brent DA (2008). Sleep Disturbance Preceding Completed Suicide in Adolescents. Journal of Consulting and Clinical Psychology, 76(1), 84–91. 10.1037/0022-006X.76.1.84 [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Gottman J (1979). Marital Interaction: Experimental Investigations. New York, New York: Academic Press. [Google Scholar]
  25. Gottman J (2011). The Science of Trust: Emotional Attunement for Couples. W. W. Norton & Company. [Google Scholar]
  26. Hall RCW, Platt DE, & Hall RCW (1999). Suicide Risk Assessment: A Review of Risk Factors for Suicide in 100 Patients Who Made Severe Suicide Attempts: Evaluation of Suicide Risk in a Time of Managed Care. Psychosomatics, 40(1), 18–27 10.1016/S0033-3182(99)71267-3 [DOI] [PubMed] [Google Scholar]
  27. Hansen JHL, & Hasan T (2015). Speaker Recognition by Machines and Humans: A tutorial review. IEEE Signal Processing Magazine, 32(6), 74–99. [Google Scholar]
  28. Harari GM, Lane ND, Wang R, Crosier BS, Campbell AT, & Gosling SD (2016). Using smartphones to collect behavioral data in psychological science: Opportunities, practical considerations, and challenges. Perspectives on Psychological Science, 11(6), 838–854. 10.1177/1745691616650285 [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Hendin H, Maltsberger JT, Lipschitz a, Haas a P., & Kyle J. (2001). Recognizing and responding to a suicide crisis. Suicide & Life-Threatening Behavior, 31(2), 115–128. 10.1111/j.1749-6632.2001.tb05805.x [DOI] [PubMed] [Google Scholar]
  30. Insel TR (2017). Digital Phenotyping: Technology for a New Science of Behavior. JAMA, 318(13), 1215–1216. 10.1001/JAMA.2017.11295 [DOI] [PubMed] [Google Scholar]
  31. Jain AK, & Li SZ (2011). Handbook of face recognition. New York: Springer. [Google Scholar]
  32. Jashinsky J, Burton SH, Hanson CL, West J, Giraud-Carrier C, Barnes MD, & Argyle T (2014). Tracking suicide risk factors through Twitter in the US. Crisis, 35(1), 51–59. 10.1027/0227-5910/a000234 [DOI] [PubMed] [Google Scholar]
  33. Just MA, Pan L, Cherkassky VL, McMakin DL, Cha C, Nock MK, & Brent D (2017). Machine learning of neural representations of suicide and emotion concepts identifies suicidal youth. Nature Human Behaviour, 1(12), 911–919. 10.1038/s41562-017-0234-y [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
  34. Kearns JC, Coppersmith DD, Santee AC, Insel C, Pigeon WR, & Glenn CR (2018). Sleep problems and suicide risk in youth: A systematic review, developmental framework, and implications for hospital treatment. General Hospital Psychiatry. [DOI] [PubMed] [Google Scholar]
  35. Kellermann AL, Rivara FP, Somes G, Reay DT, Francisco J, Banton JG, … Hackman BB (1992). Suicide in the Home in Relation to Gun Ownership. New England Journal of Medicine, 327(7), 467–472. 10.1056/NEJM199208133270705 [DOI] [PubMed] [Google Scholar]
  36. Kelly P, Marshall SJ, Badland H, Kerr J, Oliver M, Doherty AR, & Foster C (2013). An Ethical Framework for Automated, Wearable Cameras in Health Behavior Research. American Journal of Preventive Medicine, 44(3), 314–319. 10.1016/j.amepre.2012.11.006 [DOI] [PubMed] [Google Scholar]
  37. Kennard BD, Goldstein T, Foxwell AA, McMakin DL, Wolfe K, Biernesser C, … Brent D (In Press). As Safe As Possible (ASAP): A brief app-supported inpatient intervention to prevent post-discharge suicidal behavior in hospitalized, suicidal adolescents American Journal of Psychiatry. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, & Walters EE (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of general psychiatry, 62(6), 593–602. [DOI] [PubMed] [Google Scholar]
  39. Kessler RC, Stein MB, Petukhova MV, Bliese P, Bossarte RM, Bromet EJ, … & Bell AM. (2017). Predicting suicides after outpatient mental health visits in the Army Study to Assess Risk and Resilience in Service members (Army STARRS). Molecular Psychiatry, 22(4), 544. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Kleiman EM, Turner BJ, Fedor S, Beale EE, Huffman JC, & Nock MK (2017). Examination of Real-Time Fluctuations in Suicidal Ideation and Its Risk Factors: Results From Two Ecological Momentary Assessment Studies. Journal of Abnormal Psychology, 126(6), 726–738. [DOI] [PubMed] [Google Scholar]
  41. Klonsky ED, May AM, & Saffer BY (2016). Suicide, Suicide Attempts, and Suicidal Ideation. Annual Review of Clinical Psychology, 12, 307–330. 10.1146/annurev-clinpsy-021815-093204 [DOI] [PubMed] [Google Scholar]
  42. Lal S, Nguyen V, & Theriault J (2016). Seeking mental health information and support online: experiences and perspectives of young people receiving treatment for first-episode psychosis. Early Intervention in Psychiatry, 12(3), 324–330. 10.1111/eip.12317 [DOI] [PubMed] [Google Scholar]
  43. Laursen B, Coy KC, & Collins WA (1998). Reconsidering changes in parent-child conflict across adolescence: A meta-analysis. Child Development, 69, 817–832. 10.2307/1132206 [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Lind MN, Byrne ML, Wicks G, Smidt AM, & Allen NB (2018). The Effortless Assessment of Risk States (EARS) Tool: An Interpersonal Approach to Mobile Sensing. JMIR Mental Health, 5(3), e10334–10. 10.2196/10334 [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Littlewood DL, Kyle SD, Carter LA, Peters S, Pratt D, & Gooding P (2018). Short sleep duration and poor sleep quality predict next-day suicidal ideation: an ecological momentary assessment study. Psychological Medicine, 1–9. 10.1017/S0033291718001009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Ma J, Batterham PJ, Calear AL, & Han J (2016). A systematic review of the predictions of the Interpersonal-Psychological Theory of Suicidal Behavior. Clinical Psychology Review, 46, 34–45. 10.1016/j.cpr.2016.04.008 [DOI] [PubMed] [Google Scholar]
  47. Madden M, Lenhart A, Duggan M, Cortesi S, & Gasser U (2005). Teens and technology 2013. Pew Internet & American Life Project. [Google Scholar]
  48. Mann JJ, Ellis SP, Waternaux CM, Liu X, Oquendo MA, Malone KM, … Currier D (2008). Classification trees distinguish suicide attempters in major psychiatric disorders: a model of clinical decision making. The Journal of Clinical Psychiatry, 69(1), 23–31. 10.4088/JCP.v69n0104 [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Mann JJ, Waternaux C, Haas GL, & Malone KM (1999). Toward a clinical model of suicidal behavior in psychiatric patients. The American Journal of Psychiatry, 156(2), 181–189. 10.1176/ajp.156.2.181;pageGroup:string:Publication [DOI] [PubMed] [Google Scholar]
  50. Marino M, Li Y, Rueschman MN, Winkelman JW, Ellenbogen JM, Solet JM, … Buxton OM (2013). Measuring sleep: accuracy, sensitivity, and specificity of wrist actigraphy compared to polysomnography. Sleep, 36(11), 1747–55. 10.5665/sleep.3142 [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Millner AJ, Lee MD, & Nock MK (2017). Describing and Measuring the Pathway to Suicide Attempts: A Preliminary Study. Suicide and Life-Threatening Behavior, 47(3), 353–369. 10.1111/sltb.12284 [DOI] [PubMed] [Google Scholar]
  52. Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, & Murphy SA (2016). Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: Key Components and Design Principles for Ongoing Health Behavior Support. Annals of Behavioral Medicine, 52(6), 446–462. 10.1007/s12160-016-9830-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Nahum-shani I, Smith SN, Witkiewitz K, Collins LM, Spring B, & Murphy SA (2014). Just-in-time adaptive interventions (JITAIs): An organizing framework for ongoing health behavior support. The Methodology Center Technical Report, 2014, 14–126. [Google Scholar]
  54. Nebeker C, Lagare T, Takemoto M, Lewars B, Crist K, Bloss CS, & Kerr J (2016). Engaging research participants to inform the ethical conduct of mobile imaging, pervasive sensing, and location tracking research. Translational Behavioral Medicine, 6(4), 577–586. 10.1007/s13142-016-0426-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Nelson BW, & Allen N (2018). Extending the Passive Sensing Toolbox: Utilizing Smart Home Technology in Psychological Science. Perspectives on Psychological Science, 13, 718–733. [DOI] [PubMed] [Google Scholar]
  56. Nock MK, Prinstein MJ, & Sterba SK (2009). Revealing the Form and Function of Self-Injurious Thoughts and Behaviors: A Real-Time Ecological Assessment Study Among Adolescents and Young Adults. Journal of Abnormal Psychology, 118(4), 816–827. 10.1037/a0016948 [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Notredame CE, Grandgenèvre P, Pauwels N, Morgiève M, Wathelet M, Vaiva G, & Seguin M (2018). Leveraging the Web and social media to promote access to care among suicidal individuals. Frontiers in psychology, 9, 1338. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. O’Dea B, Larsen ME, Batterham PJ, Calear AL, & Christensen H (2017). A Linguistic analysis of suicide-related Twitter posts. Crisis. 10.1027/0227-5910/a000443 [DOI] [PubMed]
  59. Odgers CL (2018). Smartphones are bad for some adolescents, not all. Nature, 554(7693), 432–434. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Perez B, Musolesi M, & Stringhini G (2018). You are your Metadata: Identification and Obfuscation of Social Media Users using Metadata Information. Retrieved from http://arxiv.org/abs/1803.10133
  61. Pineda J, & Dadds MR (2013). Family intervention for adolescents with suicidal behavior: a randomized controlled trial and mediation analysis. Journal of the American Academy of Child & Adolescent Psychiatry, 52(8), 851–862. [DOI] [PubMed] [Google Scholar]
  62. Pisani AR, Wyman PA, Mohr DC, Perrino T, Gallo C, Villamar J, … Brown CH (2016). Human Subjects Protection and Technology in Prevention Science: Selected Opportunities and Challenges. Prevention Science, 17(6), 765–778. 10.1007/s11121-016-0664-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. Rimkeviciene J, Ogorman J, & De Leo D (2015). Impulsive suicide attempts: A systematic literature review of definitions, characteristics and risk factors. Journal of Affective Disorders, 171, 93–104. 10.1016/j.jad.2014.08.044 [DOI] [PubMed] [Google Scholar]
  64. Sano A, Taylor S, McHill A, Phillips A, Barger L, Klerman B, & Picard R (2018). Identifying Objective Physiological Markers and Modifiable Behaviors for Self-Reported Stress and Mental Health Status Using Wearable Sensors and Mobile Phones. Journal of Medical Internet Research, 20(6), e210 10.2196/preprints.9410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Shapiro LAS, & Margolin G (2014). Growing up wired: Social networking sites and adolescent psychosocial development. Clinical child and family psychology review, 17(1), 1–18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Sheeber L, Allen N, Davis B, & Sorensen E (2000). Regulation of negative affect during mother–child problem-solving interactions: Adolescent depressive status and family processes. Journal of abnormal child psychology, 28(5), 467–479. [DOI] [PubMed] [Google Scholar]
  67. Shneidman ES (1993). Suicide as psychache: A clinical approach to self-destructive behavior. The Journal of Nervous and Mental Disease, 181(3), 145–147. 10.1097/00005053-199303000-00001 [DOI] [PubMed] [Google Scholar]
  68. Smetana JG, Metzger A, Gettman DC, & Campione-Barr N (2006). Disclosure and secrecy in adolescent–parent relationships. Child Development, 77(1), 201–217. [DOI] [PubMed] [Google Scholar]
  69. Stewart JG, Esposito EC, Glenn CR, Gilman SE, Pridgen B, Gold J, & Auerbach RP (2017c). Adolescent self-injurers: Comparing non-ideators, suicide ideators, and suicide attempters. Journal of Psychiatric Research, 84, 105–112. 10.1016/j.jpsychires.2016.09.031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Stewart JG, Glenn CR, Esposito EC, Cha CB, Nock MK, & Auerbach RP (2017b). Cognitive control deficits differentiate adolescent suicide ideators from attempters. Journal of Clinical Psychiatry, 78(6), e614–e621. 10.4088/JCP.16m10647 [DOI] [PubMed] [Google Scholar]
  71. Stewart JG, Shields GS, Esposito EC, Cosby E,A, Allen NB, Slavich GM, & Auerbach RP. (In press). Life stress and suicide in adolescents. Journal of Abnormal Child Psychology. [DOI] [PMC free article] [PubMed] [Google Scholar]
  72. Stewart JG, Valeri L, Esposito EC, & Auerbach RP (2017a). Peer Victimization and Suicidal Thoughts and Behaviors in Depressed Adolescents. Journal of Abnormal Child Psychology, 46(3), 581–596. 10.1007/s10802-017-0304-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Tarokh L, Saletin JM, & Carskadon MA (2016). Sleep in adolescence: Physiology, cognition and mental health. Neuroscience and Biobehavioral Reviews, 70, 182–188. 10.1016/j.neubiorev.2016.08.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  74. The Regents of the University of California; (2016). Connected and Open Research Ethics (CORE) Platform. Retrieved from https://thecore.ucsd.edu/ [Google Scholar]
  75. Thornicroft G, Chatterji S, Evans-Lacko S, Gruber M, Sampson N, Aguilar-Gaxiola S, … Kessler RC (2016). Undertreatment of people with major depressive disorder in 21 countries. The British Journal of Psychiatry, 210(2), 119–124. 10.1192/bjp.bp.116.188078 [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Torous J, Larsen ME, Depp C, Cosco TD, Barnett I, Nock MK & Firth J (2018). Smartphones, Sensors, and Machine Learning to Advance Real-Time Prediction and Interventions for Suicide Prevention: a Review of Current Progress and Next Steps. Current Psychiatry Reports, 20(7), 4–9. 10.1007/s11920-018-0914-y [DOI] [PubMed] [Google Scholar]
  77. Torous J, & Nebeker C (2017). Navigating ethics in the digital age: Introducing connected and open research ethics (CORE), a tool for researchers and institutional review boards. Journal of Medical Internet Research, 19(2), 1–5. 10.2196/jmir.6793 [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. Torous J, & Roberts LW (2017). The Ethical Use of Mobile Health Technology in Clinical Psychiatry. The Journal of Nervous and Mental Disease, 205(1), 4–8. 10.1097/NMD.0000000000000596 [DOI] [PubMed] [Google Scholar]
  79. Trockel M, Karlin BE, Taylor CB, Brown GK, & Manber R (2015). Effects of Cognitive Behavioral Therapy for Insomnia on Suicidal Ideation in Veterans. Sleep, 38(2), 259–265. 10.5665/sleep.4410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  80. Troister T, Davis MP, Lowndes A, & Holden RR (2013). A five-month longitudinal study of psychache and suicide ideation: Replication in general and high-risk university students. Suicide and Life-Threatening Behavior, 43(6), 611–620. 10.1111/sltb.12043 [DOI] [PubMed] [Google Scholar]
  81. Troister T, & Holden RR (2012). A Two-Year Prospective Study of Psychache and its Relationship to Suicidality Among High-Risk Undergraduates. Journal of Clinical Psychology, 68(9), 1019–1027. 10.1002/jclp.21869 [DOI] [PubMed] [Google Scholar]
  82. Turecki G, & Brent DA (2016). Suicide and suicidal behaviour. The Lancet, 387(10024) 1227–1239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  83. Turk M a M., & Pentland AAP. (1991). Face Recognition Using Eigenfaces. Journal of Cognitive Neuroscience, 3(1), 72–86. 10.1109/CVPR.1991.139758 [DOI] [PubMed] [Google Scholar]
  84. Vahabzadeh A, Sahin N, & Kalali A (2016). Digital Suicide Prevention: Can Technology Become a Game-changer? Innovations in Clinical Neuroscience, 13(5), 16–20. [PMC free article] [PubMed] [Google Scholar]
  85. Van Orden KA, Witte TK, Cukrowicz KC, Braithwaite SR, Selby EA, & Joiner TE (2010). The Interpersonal Theory of Suicide. Psychological Review, 117(2), 575–600. 10.1037/a0018697 [DOI] [PMC free article] [PubMed] [Google Scholar]
  86. Verrocchio MC, Carrozzino D, Marchetti D, Andreasson K, Fulcheri M, & Bech P (2016). Mental pain and suicide: A systematic review of the literature. Frontiers in Psychiatry, 7, 108 10.3389/fpsyt.2016.00108 [DOI] [PMC free article] [PubMed] [Google Scholar]
  87. Walsh CG, Ribeiro JD, & Franklin JC (2017). Predicting Risk of Suicide Attempts Over Time Through Machine Learning. Clinical Psychological Science, 5(3), 457–469. 10.1177/2167702617691560 [DOI] [Google Scholar]
  88. Yip PSF, Caine E, Yousuf S, Chang S Sen Wu, K CC., & Chen YY (2012). Means restriction for suicide prevention. The Lancet, 379(9834), 2393–2399. 10.1016/S0140-6736(12)60521-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  89. Yau JC, & Reich SM (2018). Are the qualities of adolescents’ offline friendships present in digital interactions?. Adolescent Research Review, 3(3), 339–355. [Google Scholar]
  90. Zhao M, Adib F, & Katabi D (2016). Emotion recognition using wireless signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (pp. 95–108). ACM 10.1145/2973750.2973762 [DOI] [Google Scholar]
  91. Zhao M, Yue S, Katabi D, Jaakkola TS, & Bianchi MT (2017). Learning Sleep Stages from Radio Signals : A Conditional Adversarial Architecture. In International Conference on Machine Learning (pp. 4100–4109). [Google Scholar]

RESOURCES