Abstract
Digital phenotyping has potential to quantify the lived experience of mental illness and generate real-time, actionable results related to recovery, such as the case of social rhythms in individuals with bipolar disorder. However, passive data features for social rhythm clinical targets in individuals with schizophrenia have yet to be studied. In this paper, we explore the relationship between active and passive data by focusing on temporal stability and variance at an individual level as well as large-scale associations on a population level to gain clinically actionable information regarding social rhythms. From individual data clustering, we found a 19% cluster overlap between specific active and passive data features for participants with schizophrenia. In the same clinical population, two passive data features in particular associated with social rhythms, “Circadian Routine” and “Weekend Day Routine,” and were negatively associated with symptoms of anxiety, depression, psychosis, and poor sleep (Spearman ρ ranged from −0.23 to −0.30, p < 0.001). Conversely, in healthy controls, more stable social rhythms were positively correlated with symptomatology (Spearman ρ ranged from 0.20 to 0.44, p < 0.05). Our results suggest that digital phenotyping in schizophrenia may offer clinically relevant information for understanding how daily routines affect symptomatology. Specifically, negative correlations between smartphone reported anxiety, depression, psychosis, and poor sleep in individuals with schizophrenia, but not in healthy controls, offer an actionable clinical target and area for further investigation.
Subject terms: Biomarkers, Schizophrenia
Introduction
Schizophrenia affects nearly 20 million people worldwide and presents substantial health, social, and economic burdens due to the presence of comorbidities, long duration of illness, ever-present risk of relapse, and excess early mortality1–3. Recently, the World Health Organization created the Mental Health Gap Action Program to address this global burden of disease and provide better access to care to those in need4. Technology has shown promise in its utility toward healthcare access, but in order to meet the growing need, there is an urgent need for new treatments that do not merely offer a digital translation of existing therapies but instead provide novel synergies5.
The potential of technology to drive mental health innovation is fueled by the increased prevalence of smartphones and recent advances in mobile technology. Sensors on phones are now capable of collecting, storing, and processing vast amounts of health data, with new tools constantly emerging to help track, monitor, and augment clinical interventions. These innovations bring with them the opportunity for real-time assessment of behavior and cognition, which are important among individuals with schizophrenia where the risk of relapse is ever-present yet remains challenging to identify6. Using such data to inform just-in-time adaptive interventions for mental health7 may increase access to evidence-based care, although to date, research and products have focused primarily on mood disorders8. Fortunately, the same principles of real-time active monitoring of symptoms conducted through ecological momentary assessment and passive monitoring via automatically collected phone data (e.g. daily distance traveled) may offer potential for similar adaptive interventions for psychotic spectrum illnesses like schizophrenia.
Passive data collection, also known as digital phenotyping, holds clear potential to capture the lived experience of patients with mental health conditions. For example sleep disturbance is a warning sign for relapse in schizophrenia and can be captured through passive data signals such as smartphone accelerometers to capture phone movement and wearable sensors to inform duration and quality of sleep9 The potential of passive data to understand functional outcomes in schizophrenia is reflected in numerous ongoing studies collecting a range of sensor data from participants10,11 and others identifying specific correlations between phone use patterns, persecutory delusions12, and relapse13. Using these data to inform care and improve outcomes requires first that its validity be established and second that clinically actionable insights be offered to both clinicians and patients.
In bipolar disorder, social rhythm therapy14 offers a useful example of how smartphone active and passive data can be utilized to improve outcomes. The social zeitgeber model of bipolar disorder proposes that “changes in daily social rhythms or schedules lead to disruption of circadian rhythms and, in turn, onset of bipolar mood episodes”15,16 with research supporting that “low social rhythm regularity is a vulnerability factor for bipolar spectrum disorders”16. Data from smartphones (Fig. 1) can help inform social rhythms in patients with mental illness, as seen from ongoing research17, and commercial efforts18, although to date the validity of these findings for schizophrenia has not been explored. While social rhythm therapy is not itself designed for schizophrenia, understanding the feasibility of capturing these rhythms and comparing results to research in bipolar and depressive disorders offers a first step in exploring how new smartphone data streams may inform a new generation of therapies.
The ability to gather both passive and active data from smartphones often belies the complexity of these data and issues surrounding its validity. Thus, any attempt to make smartphone data clinically actionable must assess results compared to prior work and offer others the ability to replicate results. A recent systematic review on studies that collected sensor data and depression symptoms identified 85 different features (e.g. amount of home stay, sleep duration, phone calls received) across 46 studies19. While not all features showed consistent significance across studies, some features like sleep duration and distance traveled showed strong but opposite associations when comparing clinical and non-clinical populations. To date, there are no studies that investigate social rhythm disruption via smartphone in individuals with schizophrenia. In our prior research we have shown it is feasible to collect both active and passive data in schizophrenia including those metrics outlined above as well as measures of social rhythm via circadian routine and weekend routine derived from geolocation data20.
Understanding how passive data relates to active data and patient reported outcomes is a first step in assessing the utility of these data. A recent review of passive data studies across neuropsychiatric illness also noted that it is not clear if passive data are directly picking up symptomatology separate from behavioral or lifestyle changes11. While several studies have explored the correlations between active and passive data in sleep in schizophrenia21,22, results have yet to be replicated. A further challenge is that many studies with passive data have not featured a control group which makes it challenging to determine if any resulting digital signal is specific to a mental health condition or rather a broader signal associated with daily life.
To explore this relationship between active and passive data in schizophrenia and understand its potential towards social rhythm therapy, we focus on temporal stability and variance at an individual level as well as large-scale associations on a population level. We hypothesize that, as in bipolar disorder, increased stability in social rhythm (via circadian routine and weekend routine) will be associated with improved symptom scores in schizophrenia and that trends in smartphone passive data related to sociability, mobility, and physical activity in patients versus controls will align with prior research.
Results
Clustering
We modeled the graphical output of our k-means clustering results on a similar analysis on suicidal thoughts reported via an app23 using various colors to denote specific clinical clusters. Figure 2 shows an example comparing active data mean and variance (psychosis score) with passive data mean and variance (Hometime) within subjects. Only SZ participants with more than 5 days’ worth of combined passive and active data were chosen for analysis. The clusters were distinguished by color and increasing mean/variance, from yellow (lowest mean/variance) to green to blue to purple (highest mean/variance). 19% of participants (4 out of 21) were in the same cluster for active and passive and there was no overlap among participants in the cluster with the greatest mean/variance (purple).
Correlation matrix
For a broader perspective of the interaction between active and passive data, a correlation matrix was created for all the data features24 with the goal of identifying correlation patterns both within and between SZ and HC groups. Spearman correlation coefficients were calculated as were FDR-adjusted p-values. Figure 3 shows a portion of the matrix directly comparing active and passive data features for all 88 participants. Only correlations with an adjusted p-value of < 0.05 (FDR corrected) are shown. Multiple significant correlations were found in both groups with many more significant associations among features in SZ than HC. Also, significant correlations that were shared between the groups often displayed reversed polarity. A focus on the social rhythm features “Circadian Routine” and “Weekend Day Routine” in 3c and 3d shows an area of statistically significant correlation for both SZ and HC with Spearman ρ values ranging from −0.23 to −0.30 in SZ (p < 0.001) and from 0.20 to 0.44 in HC (p < 0.05).
As a secondary analysis, we performed hierarchical clustering on all passive data features to visualize clusters and compare those between SZ and HC. Results are shown in Supplementary Methods.
Discussion
Smartphone digital phenotyping is able to detect changes in social rhythms that separate those with schizophrenia from controls. Greater dysregulation in social rhythms, suggesting less routine, correlated with higher severity of self-reported depression, anxiety, psychosis, and sleep symptoms in schizophrenia but not controls. These results suggest clinical utility of passive data in schizophrenia with actionable to set therapeutic goals and monitor recovery as well as relapse.
Our results suggest how digital phenotyping data in mental health must be guided by theory. We found that correlations between active and passive data were heterogeneous among individuals with schizophrenia (19% agreement), suggesting that passive data are not always a direct proxy for mental health symptoms. Understanding the mechanism of action and theories relating patient behaviors to symptoms offers a roadmap to approaching these complex data as demonstrated by our results around circadian routine informed by social rhythm therapy in bipolar disorder.
Potential clinical applications of our results include population level screening to identify psychosis risk based on early detection of passive data irregularities, such as circadian routine disturbances, as well as individual level monitoring around improving social rhythms towards reducing symptom severity. While the ability to detect correlations between social rhythms and patient reported outcomes does not imply social rhythm therapy will itself be effective, it does offer the potential of applying both new and existing therapies in an outcome-driven manner where objective data can be used to understand efficacy. Already interventions like supported employment and family education/support that inherently stabilize social rhythms have proven effective in all phases of schizophrenia, meaning that digital phenotyping could at least offer a new tool to quantify patient’s response and help titrate these multifaceted psychosocial interventions.
The correlations between passive and active data identified in our study also offer a potentially useful tool to monitor healthy populations at risk for schizophrenia, as any flipping in correlations could represent a unique digital biomarker during the high risk/prodromal phase. Our results also suggest that certain digital phenotypes may emerge on the population level via clustering analysis, based on the unique patterns of clustering in SZ as compared to HC. While the clinical utility of these clusters is less clear today, they may represent digital biotypes that are useful markers to stratify current definitions of schizophrenia, much in the same way the Bipolar—Schizophrenia Network on Intermediate Phenotypes has defined three biotypes based of EEG, neuroimaging, genetic, and clinical profiles25.
Our results are in line with prior research as negative correlations between circadian movement (i.e. stability in circadian rhythm) and depression symptoms (p < 0.05, FDR corrected) have been reported previously in both clinical and non-clinical populations26,27, while associations between anxiety or depression and mobility features have generally been insignificant28–30. We are also identifying differences between incoming and outgoing calls with respect to symptomatology in SZ, which is consistent with the literature19, although our results suggest different directions of correlation. This could be due to the underlying complexity in completely capturing social behavior, as many methods of social communication (e.g. third-party chat applications and social media) are not observed by current methods. Figure 3c, d in our results suggests that passive data can pick up on social rhythm differences between clinical and non-clinical populations, and a recent systematic review has found similar flipping with respect to sleep duration and distance traveled, other markers of mobility and social rhythm19.
There are several limitations with the study. First, data quality and missingness could have a significant effect on the results, and could be a result of poor engagement, technical issues with the smartphone or study app, third-party apps for messaging leading to uncaptured sociability features, or smartphones being turned off or left home for long periods of time. Missingness in the passive data may reduce the chance of capturing behavior that matches the active data and low engagement in self-report reduces possible connections back to clinical symptoms. Second, the finding that there were more significant correlations in SZ than HC could be due to the fact that the smartphone app was originally designed for individuals with schizophrenia, who have more severe and variable symptoms, and may be more sensitive to picking up on behavior and symptomatology in SZ than HC. In addition, SZ and HC were not matched for age, race, and education, potentially introducing confounding factors especially with regards to the effect of age on circadian rhythm31. Despite the limitations, our study represents one of the largest digital phenotyping studies in schizophrenia in terms of sample size and duration32.
Today’s smartphones are capable of collecting, storing, and processing vast quantities of data reflecting real-time mobility and sociability behaviors—although utilizing that data to improve clinical outcomes has remained nascent. Using this data to assess social rhythms in schizophrenia offers a practical application that provides clinicians a potentially useful metric to assess recovery or relapse and patients a means to self-monitor and understand how their daily routines may impact their symptoms.
Methods
Data collection platforms
In this paper, we define two types of collected data as being either active or passive. Active data are directly entered by participants and includes survey responses and cognitive task results. Passive data are collected either entirely in the background or with limited user input, and includes GPS, accelerometer, screen on/off, and call/text logs. Two research applications were installed on participants’ smartphones as part of an Institutional Review Board-approved study (2017P-000359, “An Observational study of Digital Technology for Monitoring of Serious Mental Illness, 9/27/2019) to assist in active and passive data collection, respectively, mindLAMP and Beiwe, which have been previously reported on33,34.
Participants and data collection protocol
Smartphone-owning adults (≥18 years old) were recruited from the greater Boston area through the Massachusetts Mental Health Center in Boston, MA and general public advertising. The recruitment goal of 80 participants (40 with schizophrenia and 40 healthy controls) was established from the conclusion of a successful pilot study with 17 participants and prior studies using smartphones for digital phenotyping in schizophrenia35. A total of 92 participants from August 22, 2018 to February 13, 2019 were enrolled after signing written informed consent and 88 completed both first and second in-person visits. Of those 88, 45 had a clinical diagnosis of schizophrenia or schizoaffective disorder confirmed by their medical record (SZ) and 43 were healthy controls (HC). All patients in the study were in active treatment. There were no exclusion criteria related to co-morbid diagnoses. All participants owned a smartphone and were given a smartwatch for the duration of the study to assist in data collection. Demographic information can be found in Table 1.
Table 1.
HC (n = 43) | SZ (n = 45) | p | |
---|---|---|---|
Age | 30.49 (15.69) | 37.45 (14.57) | 0.044 |
Gender | 1 | ||
Male | 22 (51.2%) | 23 (51.1%) | |
Female | 21 (48.8%) | 22 (48.9%) | |
Race | <0.001 | ||
American Indian or Alaskan Native | 0 (0.0%) | 4 (9.3%) | |
Asian | 30 (69.8%) | 1 (2.3%) | |
Black or African-American | 4 (9.3%) | 12 (27.9%) | |
Multiracial or Other | 2 (4.7%) | 2 (4.7%) | |
White Caucasian | 7 (16.3%) | 24 (55.8%) | |
Education | <0.001 | ||
4-year college graduate or higher | 36 (83.7%) | 16 (35.6%) | |
High school graduate/GED | 3 (7.0%) | 12 (26.7%) | |
Some college | 4 (9.3%) | 14 (31.1%) | |
Some high school | 0 (0.0%) | 3 (6.7%) |
88 smartphone-owning study participants from the greater Boston area participated in this three-month smartphone study.
Data collection protocol
Data were collected over a three-month period with two in-person visits at the beginning and end of the study. At the first study visit, participants are explained the types of data collected, sign informed consent, and complete several paper and pencil tests. Participants then install both apps on their smartphones for active and passive data collection. No study compensation was provided for app use or engagement. After three months, participants return for a final visit where they repeat the assessments and receive an overview of their collected data.
During the three-month data collection period, participants were prompted on their smartphones to take 10 surveys per week: two each of mood (PHQ-936), anxiety (GAD-737), psychosis symptoms, sleep, and sociability. Throughout the study passive data were constantly collected via multiple passive data streams (GPS, accelerometer, screen on/off, and call/text logs) simultaneously (Fig. 4). Overall completion rates for smartphone surveys over the three months were 50% for SZ and 53% for HC. Missingness was assessed for GPS and accelerometer based on sampling rates and was found to be 72 and 60%, respectively.
Data quality analysis
All data quality and subsequent analyses were performed using the R programming language (version 3.4, https://www.r-project.org/). Active data were analyzed to investigate survey completion rates and passive data were analyzed to calculate missingness based on a theoretical maximum number of data points generated from hardware sampling rates.
Active vs passive data analysis
Active data were analyzed for mean and variance. Passive data were processed into interpretable features (e.g. time spent at home, number of incoming texts, etc.) for which individual-specific means and variances were computed. We used a statistical clustering method on both active and passive data variance as previously used in psychiatry research to categorize subjects based on large and/or complex data streams25,38. In this analysis, we used the standard method of k-means clustering to categorize SZ based on active data mean/variance and passive data mean/variance, then compared the clusters. The value for k was determined by using the Silhouette Method39 and the R packages “factoextra” and “Nbclust”40. In addition to clustering, we investigated associations between passive and active data features by creating a correlation matrix with every data stream. Correlations were conducted using the spearman method and corrected for multiple comparisons using FDR.
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Supplementary information
Acknowledgements
Dr. Torous is supported by a career development award from the NIMH: K23- MH116130-02 and a NARSAD career development award from the Brain and Behavior Foundation.
Author contributions
P.H. and J.T. conceived of the study. P.H. and J.T. wrote the initial draft, I.B. verified the analytical methods, and J.T. and M.K. helped shape the clinical interpretations. All authors participated in interpretation of the data, revisions, and have given final approval for publication.
Data availability
The data used in this study may be considered individually identifiable. Thus, it can only be shared with an ethics/IRB approved plan to ensure its deidentification and consent of the participants whom it was collected from.
Code availability
Analysis code is available from the authors by request. Standard packages were used to generate results with no custom algorithms necessary for conclusions or replication.
Competing interests
The authors declare the following competing interests: Dr. Torous disclosed unrelated research funding from Otsuka. The other authors declare no competing interests.
Footnotes
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary information is available for this paper at 10.1038/s41537-020-0100-1.
References
- 1.James SL, et al. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2018;392:1789–1858. doi: 10.1016/S0140-6736(18)32279-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Schizophrenia. National Institute of Mental Healthhttps://www.nimh.nih.gov/health/statistics/schizophrenia.shtml (2018).
- 3.Laursen TM, Nordentoft M, Mortensen PB. Excess early mortality in schizophrenia. Annu. Rev. Clin. Psychol. 2014;10:425–448. doi: 10.1146/annurev-clinpsy-032813-153657. [DOI] [PubMed] [Google Scholar]
- 4.WmhGAP. WHO Mental Health Gap Action Programme (mhGAP) (World Health Organization, 2019). [PubMed]
- 5.Torous J, Hsin H. Empowering the digital therapeutic relationship: virtual clinics for digital health interventions. npj Digit. Med. 2018;1:16. doi: 10.1038/s41746-018-0028-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Emsley R, Chiliza B, Asmal L, Harvey BH. The nature of relapse in schizophrenia. BioMed. Cent. Psychiatry. 2013;13:50. doi: 10.1186/1471-244X-13-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Nahum-Shani I, et al. Just-in-Time Adaptive Interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Ann. Behav. Med. 2018;52:446–462. doi: 10.1007/s12160-016-9830-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Weisel KK, et al. Standalone smartphone apps for mental health—a systematic review and meta-analysis. . npj Digit. Med. 2019;2:118. doi: 10.1038/s41746-019-0188-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Aledavood T, et al. Smartphone-based tracking of sleep in depression, anxiety, and psychotic disorders. Curr. Psychiatry Rep. 2019;21:49. doi: 10.1007/s11920-019-1043-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Alonso-Solís A, et al. Mobile therapeutic attention for treatment-resistant schizophrenia (m-RESIST): a prospective multicentre feasibility study protocol in patients and their caregivers. BMJ Open. 2018;8:e021346. doi: 10.1136/bmjopen-2017-021346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Reinertsen E, Clifford GD. A review of physiological and behavioral monitoring with digital sensors for neuropsychiatric illnesses. Physiol. Meas. 2018;39:05TR01. doi: 10.1088/1361-6579/aabf64. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Buck B, et al. Capturing behavioral indicators of persecutory ideation using mobile technology. J. Psychiatr. Res. 2019;116:112–117. doi: 10.1016/j.jpsychires.2019.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Buck B, et al. Relationships between smartphone social behavior and relapse in schizophrenia: a preliminary report. Schizophr. Res. 2019;208:167–172. doi: 10.1016/j.schres.2019.03.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Matthews M, et al. Development and evaluation of a smartphone-based measure of social rhythms for bipolar disorder. Assessment. 2016;23:472–483. doi: 10.1177/1073191116656794. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Ehlers CL, Frank E, Kupfer DJ. Social zeitgebers and biological rhythms: a unified approach to understanding the etiology of depression. Arch. Gen. Psychiatry. 1988;45:948–952. doi: 10.1001/archpsyc.1988.01800340076012. [DOI] [PubMed] [Google Scholar]
- 16.Alloy LB, Boland EM, Ng TH, Whitehouse WG, Abramson LY. Low social rhythm regularity predicts first onset of bipolar spectrum disorders among at-risk individuals with reward hypersensitivity. J. Abnorm. Psychol. 2015;124:944–952. doi: 10.1037/abn0000107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Crowe, M., Inder, M., Swartz, H. A., Murray, G. & Porter, R. Social rhythm therapy—a potentially translatable psychosocial intervention for bipolar disorder. Bipolar Disord. (2019) 10.1111/bdi.12840. [DOI] [PubMed]
- 18.HealthRhythms. https://www.healthrhythms.com.
- 19.Rohani DA, Faurholt-Jepsen M, Kessing LV, Bardram JE. Correlations between objective behavioral features collected from mobile and wearable devices and depressive mood symptoms in patients with affective disorders: systematic review. JMIR mHealth uHealth. 2018;6:e165. doi: 10.2196/mhealth.9691. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Barnett, I. et al. Relapse prediction in schizophrenia through digital phenotyping: a pilot study. Neuropsychopharmacology (2018) 10.1038/s41386-018-0030-z. [DOI] [PMC free article] [PubMed]
- 21.Wang, R. et al. CrossCheck: toward passive sensing and detection of mental health changes in people with schizophrenia. In Proc 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing 886–897 (ACM, 2016). 10.1145/2971648.2971740.
- 22.Staples P, et al. A comparison of passive and active estimates of sleep in a cohort with schizophrenia. NPJ Schizophr. 2017;3:37. doi: 10.1038/s41537-017-0038-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Kleiman EM, et al. Digital phenotyping of suicidal thoughts. Depress Anxiety. 2018;35:601–608. doi: 10.1002/da.22730. [DOI] [PubMed] [Google Scholar]
- 24.Barnett, I. & Onnela, J.-P. Inferring mobility measures from GPS traces with missing data. Biostatistics (2018) 10.1093/biostatistics/kxy059. [DOI] [PMC free article] [PubMed]
- 25.Clementz BA, et al. Identification of distinct psychosis biotypes using brain-based biomarkers. Am. J. Psychiatry. 2016;173:373–384. doi: 10.1176/appi.ajp.2015.14091200. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Malkoff-Schwartz S, et al. Stressful life events and social rhythm disruption in the onset of manic and depressive bipolar episodes: a preliminary investigation. Arch. Gen. Psychiatry. 1998;55:702–707. doi: 10.1001/archpsyc.55.8.702. [DOI] [PubMed] [Google Scholar]
- 27.Saeb S, et al. Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study. J. Med. Internet Res. 2015;17:e175. doi: 10.2196/jmir.4273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Faherty LJ, et al. Movement patterns in women at risk for perinatal depression: use of a mood-monitoring mobile application in pregnancy. J. Am. Med. Informatics Assoc. 2017;24:746–753. doi: 10.1093/jamia/ocx005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Renn BN, Pratap A, Atkins DC, Mooney SD, Arean PA. Smartphone-based passive assessment of mobility in depression: challenges and opportunities. Ment. Health Phys. Act. 2018;14:136–139. doi: 10.1016/j.mhpa.2018.04.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Pratap A, et al. The accuracy of passive phone sensors in predicting daily mood. Depress Anxiety. 2019;36:72–81. doi: 10.1002/da.22822. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Duffy JF, Zitting K-M, Chinoy ED. Aging and circadian rhythms. Sleep. Med. Clin. 2015;10:423–434. doi: 10.1016/j.jsmc.2015.08.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Trifan A, Oliveira M, Oliveira JL. Passive sensing of health outcomes through smartphones: systematic review of current solutions and possible limitations. JMIR mHealth uHealth. 2019;7:e12649. doi: 10.2196/12649. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Torous, J. et al. Creating a digital health smartphone app and digital phenotyping platform for mental health and diverse healthcare needs: an interdisciplinary and collaborative approach. J. Technol. Behav. Sci. (2019) 10.1007/s41347-019-00095-w.
- 34.Torous J, Kiang MV, Lorme J, Onnela J-P. New tools for new research in psychiatry: a scalable and customizable platform to empower data driven smartphone. Res. J. Med. Internet Res. Ment. Heal. 2016;3:e16. doi: 10.2196/mental.5165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Torous J, Firth J, Mueller N, Onnela JP, Baker JT. Methodology and reporting of mobile health and smartphone application studies for schizophrenia: Erratum. Harv. Rev. Psychiatry. 2017;25:194. doi: 10.1097/HRP.0000000000000133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J. Gen. Intern. Med. 2001;16:606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Lowe B, et al. Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Med. Care. 2008;46:266–274. doi: 10.1097/MLR.0b013e318160d093. [DOI] [PubMed] [Google Scholar]
- 38.Fuente-Tomas Ldela, et al. Classification of patients with bipolar disorder using k-means clustering. Public Lib. Sci. One. 2019;14:e0210314. doi: 10.1371/journal.pone.0210314. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Rousseeuw PJ. Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 1987;20:53–65. doi: 10.1016/0377-0427(87)90125-7. [DOI] [Google Scholar]
- 40.Charrad, M., Ghazzali, N., Boiteau, V. & Niknafs, A. NbClust: An R Package for Determining the Relevant Number of Clusters in a Data Set. J. Stat. Software1, (2014).
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data used in this study may be considered individually identifiable. Thus, it can only be shared with an ethics/IRB approved plan to ensure its deidentification and consent of the participants whom it was collected from.
Analysis code is available from the authors by request. Standard packages were used to generate results with no custom algorithms necessary for conclusions or replication.