Abstract
Clinical depression affects 17.3 million adults in the U.S. However, 37% of these adults receive no treatment, and many symptoms remain unmanaged. Mobile health apps may complement in-person treatment and address barriers to treatment, yet their quality has not been systematically appraised. We conducted a systematic review of apps for depression by searching in three major app stores. Apps were selected using specific inclusion and exclusion criteria. The final apps were downloaded and independently evaluated using the Mobile Application Rating Scale (MARS), IMS Institute for Healthcare Informatics functionality score, and six features specific to depression self-management. Mobile health apps for depression self-management exhibit a wide range of quality, but more than half (74%) of the apps had acceptable quality, with 32% having MARS scores ≥ 4.0 out of 5.0. These high scoring apps indicate that mobile apps have the potential to improve patient self-management, treatment engagement, and mental health outcomes.
Introduction
Clinical depression— defined as a prolonged period of sadness, loss of interest, and impairment in daily functioning— is highly prevalent in the U.S.; it affects more than 17.3 million adults including 13.1% of young adults between the ages of 18 and 25 and 13.3% of adolescents between ages 12 and 17.1 Approximately 35% of adults with depression and over half of adolescents do not receive any form of treatment.1 Patients face numerous barriers to accessing professional treatment for depression, including social stigma, lack of financial resources and health insurance, lack of appropriate transportation and time, not even knowing where to receive treatment, and lack of faith in the efficacy of treatment.2 Lack of treatment for depression leads to several consequences such as worsening symptom severity, societal burdens such as higher healthcare costs, and suicide.3,4
Mobile health (mHealth) technology presents exciting opportunities to address barriers to access and delivery of depression treatment. Currently, 96% of American adults own a cellphone and 81% own smartphones.5 In 2018, 95% of adolescents reported that they use smartphones daily.6 Further, younger adults spend an average of three hours a day on their smartphones.7 As such, mHealth applications (apps) on smartphones can be leveraged to offer a convenient, affordable, and accessible option for the self-management of depression, especially as many adults and adolescents with depression do not formally engage in mental health treatment.8 Specifically, mHealth apps offer low-cost, in-home treatment by reducing travel to in-person psychiatric care, concerns about cost, stigma, and time associated with seeking depression treatment may be mitigated. Apps may also offer a broader set of self-management tools for depression including promoting mindfulness, social support, healthy sleep and eating habits, appointment and therapy adherence, and diet, nutrition and/or exercise. While some in-person care is clinically necessary for many patients, apps may be a complementary solution to in-person care that reduces the burden of depression treatment for patients.
Several studies have shown that the use of mHealth apps can effectively reduce symptoms of depression.9-11 In one study of 96 individuals with severe symptoms of depression and anxiety, participants reported a reduction in depressive symptoms by 50% after the mHealth intervention.9 Another study measured the effectiveness of a mobile app for reducing depressive symptoms in the workplace and found that after five weeks of use, depressive symptoms were significantly lower, self-reported job performance was higher, and more than 90% claimed that it helped improve their mental fitness.10 A 2019 study that reviewed 19 RCTs focused on mHealth apps for mental health disorders including depression found that individuals using apps targeting overall depression had significant pooled effects on improvements in self-reported symptoms using validated surveys compared to control groups.12
While these literature reviews have appraised the effectiveness of a small number of mental health apps, many of which are used only in academic research settings, they do not address the abundance of commercially available depression apps that consumers are more likely to find and use without adequate clinical guidance or recommendation. In particular, one of the existing challenges consumers face when considering mHealth apps for self-management of depressive symptoms is uncertainty around app quality, which can be defined as the caliber of an app’s technical functioning (navigation, aesthetics, usability) and content (evidence-based information, useful features).13 In previous systematic reviews of mHealth apps for mental health, the lack of clinical guidelines and efficacy have limited widespread adoption and use.14-16 Mobile interventions that are not rigorously evaluated may provide unhelpful or even harmful mental health information for consumers. Further, apps that are perceived as ineffective may reinforce the belief that there are no efficacious treatments or self-management tools for mental health. This study aimed to systematically review commercially available apps for depression self-management, including a thorough assessment of quality, functionality, and features using a validated review methodology.
Methods
We followed a previously established methodology for systematically searching and reviewing commercially available apps.17 From February to March 2019, a systematic review of mobile apps for depression was conducted by entering six relevant search terms across three major mobile app marketplaces: Android Google Play Store, Apple App Store, and the Amazon Appstore. Search terms were: "depression," "mood improvement," "mental health self-management," "depression monitoring," "depression screening," and "depression self-management." Four rounds of reviews were completed to account for the pre- specified exclusion criteria (Figure 1). During the first round, most of the excluded apps were unrelated to depression or were games or books. During the second round, apps were excluded if they were educational (for students) or diagnostic only, or only tracked mood using a diary feature. In the third round, apps that were targeted for anxiety only, no longer available, or required a health system login were also excluded. The final apps were downloaded and screened to ensure that they were functioning and not duplicative, ending with a final list of 31 evaluable apps. Each app was reviewed by at least two reviewers using either iOS on an iPhone, or Android OS on a Samsung phone, depending on where the app was available; some apps were only available in one app store.
Figure 1.
PRISMA flowchart of screening process
The final apps were independently reviewed and rated according to the Mobile Application Rating Scale (MARS), IMS Institute for Healthcare Informatics functionality score, and six specific depression self-management features. The MARS evaluates apps on four objective quality scales: engagement, functionality, aesthetics, and information quality.18 MARS also includes behavior change (anticipated effect of the app on the user’s behaviors) and subjective quality (overall satisfaction with the app) scales. All MARS scales are scored using a 5-point Likert scale, with 1 being inadequate and 5 being excellent quality.
The IMS functionality score consists of seven functionality criteria, including the ability to communicate, display and record data, and guide, inform, instruct, and remind users.19 The record criteria includes four sub-criteria: collect, share, evaluate, and intervene upon data. These functionality criteria delineate specific app functions, compared to the MARS functionality scale which evaluates how well the app functions overall.
Finally, each app was evaluated on six specific self-management behaviors for depression: treatment adherence, social support, exercise/nutrition, sleep, and mindfulness. These behaviors were selected based on reviews of existing mental health app features, in the absence of an official guideline of mHealth app features for depression.20-22
Data were also extracted from the app stores including average star rating, number of downloads, version number, and cost. Each reviewer first rated the same four apps to evaluate inter-rater reliability (IRR) using the kappa statistic, with κ ≥ 0.7 indicating good reliability. All subsequent apps were reviewed by at least two independent reviewers.
Results
Out of the 1,198 potentially relevant apps retrieved from the initial searches using the six search terms, 31 apps met the final inclusion criteria. The selection process and exclusion criteria are shown in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram (Figure 1). Most apps were excluded because they were unrelated to depression (n= 394), were games, books, videos, etc. (n=154), were designed for educational purposes (for students) only or diagnostic purposes only (n= 117).
Table 1 provides the full list of the included apps and their characteristics. Among the 31 included apps, 77% (n=24) were free to download, but 23% (n=7) ranged in cost from $4.99 to $99 per month. All of them offered at least a three-day free trial for users to experience before purchasing. The vast majority of apps (84%, n=26) were updated within the past year, and most of the apps were updated within the past three months (73%, n=19). The average consumer star rating across the apps was 4.36 out of 5. Overall, among the 18 apps with accessible rating information, 67% (n=12) had fewer than 5,000 ratings, and 33% (n=6) had 5,000 to 500,000 ratings. Over 90% (n=28) of the apps had in-app privacy policies, though interpretability of these policies and the use of lay language was not evaluated.
Table 1.
Descriptive Characteristics of Included Apps
App Name | Platform(s) | Star Rating | Installs | Version | Cost | Privacy Policy |
Total IMS Funct Score▪ |
Pacifica (now Sanvello) | Apple, Google | 4.8 | N/A | 7.1.3 | Free | Yes | 10 |
Snapclarity: Online Therapy | Apple, Google | 4.9 | 1,000+ | 1.5.2 | $39.99/w | Yes | 10 |
Joyable | Apple, Google | 4.3 | N/A | 3.6.4 | $99/m | Yes | 9 |
BetterHelp: Online Counseling | Apple, Google | 4.4 | 100,000+ | 7 | $35/w | Yes | 9 |
Wysa: Anxiety and Depression Bot | Apple, Google | 4.4 | N/A | 4.4.4 | Free | Yes | 8 |
Youper: AIMindfulness | Apple, Google | 5 | 500,000+ | 6.06.008 | Free | Yes | 8 |
HelloJoy | Apple | 5 | N/A | 1.4.5 | Free | Yes | 8 |
InnerHour: Live Happier | Apple, Google | 4.4 | N/A | 3.04 | Free | Yes | 8 |
DBT Daily | Apple, Google | 4.6 | 5,000+ | 2.0.5 | Free | Yes | 8 |
Depression Manager | Apple | N/R | N/A | 10.3.1 | Free | Yes | 8 |
Talkspace: Online Therapy | Apple. Google | 4.1 | N/A | 8.48.06 | Free | Yes | 7 |
Woebot: Your Self-Care Expert | Apple, Google | 4.6 | N/A | 3.2.5 | Free | Yes | 7 |
Elevatr | Apple | 4.8 | N/A | 1.7.6 | $4.99/m | Yes | 7 |
Moodpath: Depression and Anxiety | Apple, Google | 4.7 | N/A | 3.0.0 | Free | Yes | 7 |
CBT Mental Health Application | Apple, Google | N/R | N/A | 1.01 | Free | No | 7 |
GG Depression | Apple, Google | 5 | 100+ | 1.3 | Free | Yes | 6 |
iPrevail | Apple, Google | 3.5 | N/A | 3.6.5 | Free | Yes | 6 |
Lift: Depression and Anxiety | Apple, Google | 2.5 | 100+ | 1.0.2 | Free | Yes | 6 |
Mental Health Intervention | Apple, Google | 4.2 | 1,000+ | 1.6.1 | $9.99/m | Yes | 6 |
AkiliHealth | 5 | 10+ | 1.3 | Free | No | 5 | |
BoosterBuddy | Apple, Google | 4.25 | 100,000+ | 1.6 | Free | Yes | 5 |
feel better: Moods & Goals | Apple, Google | 4.4 | 5,000+ | 1.0.2 | Free | Yes | 5 |
Depression Support | Apple, Google | 4.3 | 1,000+ | 11.7.0 | Free | Yes | 4 |
dew.: Mental Health Navigator | 3.8 | 100+ | 1.0.2 | Free | Yes | 4 | |
Psychologist: Anxiety, Depression, Stress, Couples | 4.2 | 50,000+ | 1.59 | $24.99/w | Yes | 4 | |
Unthink: CBT and Mental Health | Apple, Google | N/R | N/A | 1.0.3 | Free | Yes | 4 |
PsyHeal | 5 | 100+ | 1.0.7 | $8.40/m | Yes | 3 | |
What’s Up?: A Mental Health App | Apple, Google | 4.6 | 100,000+ | 2.3.1 | Free | Yes | 2 |
LightExistence: Depression Aid | 4.5 | 500+ | 1.2 | Free | No | 2 | |
Life Reboot: Fight Depression | 3.9 | 10,000+ | 1.6 | Free | Yes | 1 | |
Depression Group Therapy | 3 | 100+ | 02.2019 | Free | Yes | 0 |
Abbreviations: m= monthly, N/A: not applicable; N/R: not reported, w= weekly, Star rating: 0-5
This total functionality score refers to the IMS Functionality ranging from 0-11 (including the four sub-criteria for the “record” criteria).
Functionality
Figure 2 displays the functionalities of the included apps based on their IMS Institute for Health Informatics functionality scores. Across the 31 apps, the average number of functionalities was six out of a possible 11 (including the four sub-criteria for the “record” criteria). Most (71%, n=22) had seven or fewer functions, and 32% of apps (n=10) had four or fewer functions. Almost all of the apps had a record function (90%, n=28), and inform function (87%), n=27). Twenty-two had functions to remind or alert (71%), 16 to display (52%), 14 to instruct (45%), 13 to communicate (42%), and 11 to guide (35%). Pacifica and Snapclarity had the highest scores for functionality, both offering 10 of the 11 functionalities (Table 1).
Figure 2.
Functionality of apps based on IMS scores
Among the 28 apps that had a record function, 96% (n=27) could collect data but only 25% (n=7) had the option to share the data with healthcare providers. Eight apps (29%) could evaluate the entered data, but only 7% (n=2) had a function to intervene by sending text alerts based on the self-reported data collected. Most of the apps focused on recording and collecting data for daily mood, sleep, and physical activity. They also provided educational information about understanding and managing depressive symptoms. However, personal data analysis and feedback was not always provided within the apps.
There were interactive features within some apps, including either communicating with an automated chatbot, or contacting licensed therapists or counselors. For example, Woebot, Wysa Anxiety and Depression Bot, and Youper offer real-time interactions with an artificial intelligence (AI) enabled chatbot to collect and record daily mood. Snapclarity, Talkspace, and Betterhelp offer users the option to talk one-on-one with licensed therapists and counselors. Further, Snapclarity provides users with shareable personalized mental health strategies, and connects them with qualified professionals who specialize in their areas of concern based on an initial in-app assessment. Users can connect to a therapist at any time through text or video chat. Pacifica has a feature that allows users to share their mood, goals, stress, and personal experiences to a peer support community designed to share daily accomplishments, anecdotes, and inspiration. Users also have the option to create or join specific chat groups such as an “anxiety” group or “afraid to fly” group to connect with other users going through the same experiences.
MARS App Quality Scores
Table 2 presents the overall MARS quality scores for the included 31 apps, and the four subscale scores (engagement, functionality, aesthetics, and information quality). The IRR between reviewers was considered high across the four MARS quality factors (κ=0.75 – 0.83). The overall MARS scores ranged from 1.6 to 4.6, and the average was 3.5 out of 5. More than half of the apps (74%, n=23) had acceptable MARS scores (≥3.0) and among those, 32% (n=10) had MARS scores ≥ 4.0. The functionality subscale had the highest average (4.1 out of 5), and the satisfaction subscale had the lowest (2.8 out of 5). Pacifica had the highest average total MARS score (4.6 out of 5), followed by Wysa Anxiety & Depression Bot (4.2), Youper – AIMindfulness (4.1), InnerHour- Live Happier (4.1), Elevatr (4.1), and GG Depression (4.1).
Table 2.
Top Rated Apps based on the Mobile Application Rating Scale (MARS)*
App Name | Engage | Function | Aesthetic | Info | Satisfaction | Behavior Change | Overall Score |
Pacifica (now Sanvello) | 4.8 | 4.6 | 4.5 | 4.2 | 4.6 | 4.8 | 4.6 |
Wysa: Anxiety and Depression Bot | 4.5 | 4.6 | 4.6 | 3.9 | 3.6 | 4.3 | 4.2 |
Youper: AIMindfulness | 4.4 | 4.4 | 4.3 | 3.9 | 3.8 | 4.2 | 4.1 |
InnerHour: Live Happier | 4.2 | 4.8 | 4.1 | 3.6 | 4.0 | 4.1 | 4.1 |
Elevatr | 4.3 | 4.5 | 4.5 | 3.4 | 3.6 | 4.4 | 4.1 |
GG Depression | 4.3 | 4.4 | 3.6 | 3.6 | 3.6 | 4.3 | 4.1 |
Woebot: Your Self-Care Expert | 3.8 | 4.4 | 4.2 | 4.2 | 3.8 | 3.8 | 4.0 |
Talkspace: Online Therapy | 3.8 | 4.8 | 4.2 | 3.7 | 3.4 | 4.1 | 4.0 |
Joyable | 3.7 | 4.3 | 4.4 | 4.0 | 3.4 | 3.9 | 4.0 |
Moodpath: Depression and Anxiety | 4.2 | 4.4 | 4.7 | 3.8 | 3.8 | 3.8 | 4.0 |
MARS scales are scored using a 5-point scale, with 1 being inadequate and 5 being excellent quality.
Behavior Change
Using the MARS behavior change score, the average score for behavior change was 3.5 out of 5. More than half of the apps (81%, n=25) had acceptable behavior change scores (≥3.0). Pacifica had the highest score for behavior change (4.8), followed by Elevatr (4.4), Wysa Anxiety & Depression Bot (4.3), and GG Depression (4.3).
Depression Self-Management Features
Table 3 includes the six depression self-management features. The most common feature addressed within the apps was promoting mindfulness and a positive attitude (81%, n=25), followed by social support (52%, n=16), healthy sleep habits (45%, n=14), treatment adherence (42%, n=13), nutrition and/or exercise (32%, n=10) and medication adherence (13%, n=4). The highest performing apps were AkiliHealth, Booster Buddy, InnerHour-Live Happier, Depression Manager, and Lift, which addressed five of the six depression self-management features.
Table 3.
Top Rated Apps based on Depression Self-Management Features Included
App Name | Medication Adherence | Social Support | Treatment Adherence | Exercise/Nutrition | Sleep Habits | Mindfulness | Overall Score |
AkiliHealth | ✓ | ✓ | ✓ | ✓ | ✓ | 5 | |
BoosterBuddy | ✓ | ✓ | ✓ | ✓ | ✓ | 5 | |
Depression Manager | ✓ | ✓ | ✓ | ✓ | ✓ | 5 | |
InnerHour: Live Happier | ✓ | ✓ | ✓ | ✓ | ✓ | 5 | |
Lift: Depression and Anxiety | ✓ | ✓ | ✓ | ✓ | ✓ | 5 | |
Pacifica (now Sanvello) | ✓ | ✓ | ✓ | ✓ | 4 | ||
Woebot: Your Self-Care Expert | ✓ | ✓ | ✓ | ✓ | 4 | ||
Youper: AIMindfulness | ✓ | ✓ | ✓ | ✓ | 4 | ||
DBT Daily | ✓ | ✓ | ✓ | 3 | |||
feel better: Moods & Goals | ✓ | ✓ | ✓ | 3 | |||
iPrevail | ✓ | ✓ | ✓ | 3 | |||
Joyable | ✓ | ✓ | ✓ | 3 | |||
Wysa: Anxiety and Depression Bot | ✓ | ✓ | ✓ | 3 |
Overall App Quality
After factoring in the MARS score, IMS Institute for Healthcare Informatics functionality score, and depression self- management features, the highest performing apps included Pacifica, Youper, Innerhour-Live Happier, Wysa, Joyable, and Woebot.
Discussion
The purpose of this study was to systematically evaluate the quality and functionality of mHealth apps for depression self-management. Based on our review, there was a wide variation in quality when evaluating apps using the MARS and IMS Functionality Score. While evidence suggests mHealth apps hold significant promise in delivering treatment for depression more broadly, our review highlights key areas of improvement for commercially available apps.
In the past five years, research on the effects of mobile apps included in this review has grown and are showing positive outcomes. Results from a RCT using Woebot found that participants who used the app for two weeks showed a greater reduction in depressive symptoms compared to participants who received an informational e-Book on depression.23 Another recent study encouraged adults with depressive symptoms to use Pacifica as a self-management tool and found that participants who used Pacifica consistently had improved Patient Health Questionnaire-9 scores compared to infrequent users.24 Regarding apps that provide mobile therapy and counseling, a pilot trial found that adults who engaged in Talkspace found the app to be effective, convenient, and affordable.25 Another recent feasibility study found that the use of Betterhelp reduced depressive symptom severity in individuals who have not previously engaged in psychotherapy.26 Further, there has been growing research focusing on the effectiveness of chatbots, which were available in three apps in this review. Chatbots, driven by AI, are programmed to mimic human interactions, interpret the text and emoticons that the user shares and offer responsive conversations, guidance, and helpful advice.27 While talking with the Chatbot, users may also have access to educational information, training courses, and diagnostic test results.
However, our review also highlighted issues with existing commercially available apps that require further attention. First, consumers may have difficulty locating salient applications for depression treatment. In a study looking at the process of identifying an appropriate app for depression, the authors found that significant barriers exist for users to find an appropriate app in the three marketplaces.28 Overall, irrelevant apps outnumbered relevant apps by 3:1. Furthermore, 27.7% of the apps did not include depression in their names, 65% failed to describe their organizational affiliations, and 61.7% did not cite their content sources, making it very difficult for users to assess credibility and reliability. Our search process encountered these challenges, and from our initial list of 1,198 apps, a majority were irrelevant to depression. Many of the apps that were evaluated had questionable quality of information without any clear or reliable source. Since prior reviews of depression mHealth apps were completed, the number of available apps has greatly increased and is apparent by comparing the 243 apps identified in a previous systematic review28 to our initial list of 1,198 apps. This rapidly changing landscape reinforces the need for more streamlined and efficient methods to support patients in locating relevant apps for depression.
Once downloaded, we noted tradeoffs in the apps between cost, quality, and functionality. Specifically, of the seven out of 31 apps we reviewed that cost money, four scored above a 3.0 on the MARS, and two scored a 4.0 or higher on the MARS. Notably, there were several high-quality apps that were free, with seven free apps scoring 4.0 or higher on the MARS. However, there was also discordance between quality and functionality within apps; many of the apps that scored high on overall quality had limited features, and those that had many features had poorer quality. These findings are concordant with other literature reviews of apps for depression. Another study of apps that offered evidence-based methods for cognitive behavioral therapy conducted in 2016 found a high variance in functionality and quality, and almost all of the apps lacked a privacy or safety policy statement.14 We found a similarly high level of variance in quality and usability, but in contrast, we found that only three apps lacked a privacy policy. While we did not study the policies in-depth, this general trend would suggest the app developers are more aware of app user and data privacy issues.
mHealth technologies could play a significant role in addressing the current knowledge gaps that exist within depression self-management. As stated, many adults and adolescents do not receive any treatment for their depression. mHealth technologies could help bridge the gap by increasing access to care and accurate depression screening and help determine if this untreated population can benefit from mobile technology self-management approaches. mHealth also has the ability to generate vast amounts of data to help us understand how depression affects our population, and what self-management approaches produce beneficial outcomes. Further, the data generated could be rebuilt into apps as informatics-driven health interventions. For example, a certain event recorded in the app could automatically notify a provider when a patient is having a serious depressive episode or is at immediate risk for suicide. mHealth apps can enable research into the population who suffer without options for treatment and self-management, lead to more cost- effective methods of managing depression, and reduce the overall burden on our health system. This vision for use of depression apps in practice is supported by a recent systematic review examining mental health apps in RCTs, which found significant positive effects for the apps tailored to depression.12 Nonetheless, these apps are not recommended to act as standalone mental health treatment at this time.
In order for the promise of mHealth apps for depression to be realized, significant future research and app development efforts are needed. Specifically, there is a need to support consumers in appraising the quality of commercially available apps. Moreover, building on the early positive results of RCTs of depression apps, implementation science studies on the integration of these apps into clinical workflows as a complement to in-person clinical care are needed. Moreover, more multilingual apps and inclusion of telehealth features would expand access and use by a greater segment of the population, particularly disadvantaged individuals. Furthermore, future research on depression mobile app quality could classify the apps into categories based on their intended functionality. The various therapeutic approaches should not be evaluated as equal, given that their features and goals differ significantly ranging from chatbots to social support networks. A challenge to such a sub-analysis is that many of the apps reviewed incorporated a variety of approaches to self-management. For instance, an app might include a combination of video-based therapy, mood tracking, and education on therapeutic concepts. Meta-analyses to evaluate improvements in depressive symptoms and other health outcomes based on different app features, or combinations of features, could be valuable in understanding which features are most beneficial.
Limitations
A challenge to this study is the subjective nature and risk of bias when reviewing mHealth apps designed for mental health. The standardized methodology of the MARS and the usage of IRR to ensure agreement helps mitigate subjectivity. The authors were limited in the scope of apps that were available to evaluate, since a few promising apps were only accessible for institutional users, and non-English apps were excluded. Another limitation of this study is the lack of validated guidelines for mHealth interventions specifically for depression self-management. The depression-management app features were based on a previous literature review16 and the authors’ judgment of which features would be incorporated into a comprehensive set of approaches for depressive symptom management. Ideally, an authoritative body of mental health and mHealth experts would establish standard, evidence-based criteria for beneficial self-management features for depression.
Conclusion
Apps designed to help manage depressive symptoms hold great potential for individuals living with depression. However existing tradeoffs in app quality and functionality, and lack of guidelines for incorporating evidence-based behavior change for depression management into mHealth, limit the full potential of these apps from being realized. As such, there is an urgent need for peer-reviewed research on mHealth interventions for depression to strengthen our understanding of what features and approaches are efficacious in reducing symptoms and improving quality of life and long-term patient outcomes.
Acknowledgements
The authors would like to thank Lingchen Lou who assisted with app reviews and evaluations. This work was funded in part by funding from NIH R01MH105384, R01MH119177, R01MH121922, P50MH113838, and R00NR016275.
Figures & Table
References
- 1.National Institute of Mental Health Major depression. https://www.nimh.nih.gov/health/statistics/major- depression.shtml . Published 2019. Accessed.
- 2.Chekroud AM, Foster D, Zheutlin AB, et al. Predicting barriers to treatment for depression in a U.S. national sample: A cross-sectional, proof-of-concept study. Psychiatric services (Washington, DC) 2018;69(8):927–934. doi: 10.1176/appi.ps.201800094. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.van Beljouw IM, Verhaak PF, Cuijpers P, van Marwijk HW, Penninx BW. The course of untreated anxiety and depression, and determinants of poor one-year outcome: a one-year cohort study. BMC Psychiatry. 2010;10:86–86. doi: 10.1186/1471-244X-10-86. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Donohue JM, Pincus HA. Reducing the societal burden of depression. PharmacoEconomics. 2007;25(1):7–24. doi: 10.2165/00019053-200725010-00003. [DOI] [PubMed] [Google Scholar]
- 5.Pew Research Center Demographics of mobile device ownership and adoption in the United States. https://www.pewinternet.org/fact-sheet/mobile/ . Published 2019. Accessed.
- 6.Anderson M. JJ. Teens, social media & technology 2018. https://www.pewinternet.org/2018/05/31/teens- social-media-technology-2018/ . Published 2018. Accessed.
- 7.ComScore, Inc The 2017 U.S. mobile app report. https://www.comscore.com/Insights/Presentations-and- Whitepapers/2017/The-2017-US-Mobile-App-Report . Published 2017. Accessed.
- 8.Henderson C, Evans-Lacko S, Thornicroft G. Mental illness stigma, help seeking, and public health programs. Am J Public Health. 2013;103(5):777–780. doi: 10.2105/AJPH.2012.301056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Mohr DC, Ho J, Duffecy J, et al. Perceived barriers to psychological treatments and their relationship to depression. Journal of clinical psychology. 2010;66(4):394–409. doi: 10.1002/jclp.20659. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Deady M, Johnston D, Milne D, et al. Preliminary Effectiveness of a smartphone app to reduce depressive symptoms in the workplace: Feasibility and acceptability study. JMIR mHealth and uHealth. 2018;6(12):e11661. doi: 10.2196/11661. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Firth J, Torous J, Nicholas J, Carney R, Rosenbaum S, Sarris J. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. Journal of affective disorders. 2017;218:15–22. doi: 10.1016/j.jad.2017.04.046. [DOI] [PubMed] [Google Scholar]
- 12.Weisel KK, Fuhrmann LM, Berking M, Baumeister H, Cuijpers P, Ebert DD. Standalone smartphone apps for mental health—a systematic review and meta-analysis. npj Digital Medicine. 2019;2(1):118. doi: 10.1038/s41746-019-0188-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth and uHealth. 2015;3(1):e27–e27. doi: 10.2196/mhealth.3422. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Huguet A, Rao S, McGrath PJ, et al. A systematic review of cognitive behavioral therapy and behavioral activation apps for depression. PLoS One. 2016;11(5):e0154248. doi: 10.1371/journal.pone.0154248. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Callan JA, Wright J, Siegle GJ, Howland RH, Kepler BB. Use of computer and mobile technologies in the treatment of depression. Archives of psychiatric nursing. 2017;31(3):311–318. doi: 10.1016/j.apnu.2016.10.002. [DOI] [PubMed] [Google Scholar]
- 16.Wang K, Varma DS, Prosperi M. A systematic review of the effectiveness of mobile apps for monitoring and management of mental health symptoms or disorders. Journal of psychiatric research. 2018;107:73–78. doi: 10.1016/j.jpsychires.2018.10.006. [DOI] [PubMed] [Google Scholar]
- 17.Masterson Creber RM, Maurer MS, Reading M, Hiraldo G, Hickey KT, Iribarren S. Review and analysis of existing mobile phone apps to support heart failure symptom monitoring and self-care management using the mobile application rating scale (MARS) JMIR Mhealth Uhealth. 2016;4(2):e74. doi: 10.2196/mhealth.5882. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth and uHealth. 2015;3(1):e27. doi: 10.2196/mhealth.3422. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.IMS Insitute for Health Informatics. Patient apps for improved healthcare: From novely to mainstream. 2013.
- 20.Nicholas J, Larsen ME, Proudfoot J, Christensen H. Mobile apps for bipolar disorder: A systematic review of features and content quality. Journal of medical Internet research. 2015;17(8):e198. doi: 10.2196/jmir.4581. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Caldeira C, Chen Y, Chan L, Pham V, Chen Y, Zheng K. Mobile apps for mood tracking: an analysis of features and user reviews. AMIA Annual Symposium proceedings AMIA Symposium. 2017;2017:495–504. [PMC free article] [PubMed] [Google Scholar]
- 22.Stawarz K, Preist C, Tallon D, Wiles N, Coyle D. User experience of cognitive behavioral therapy apps for depression: An analysis of app functionality and user reviews. Journal of medical Internet research. 2018;20(6):e10120. doi: 10.2196/10120. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): A randomized controlled trial. JMIR mental health. 2017;4(2):e19. doi: 10.2196/mental.7785. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Ventura J, Chung J. The lighten your life program: An educational support group intervention that used a mobile app for managing depressive symptoms and chronic pain. Journal of psychosocial nursing and mental health services. 2019;57(7):39–47. doi: 10.3928/02793695-20190221-01. [DOI] [PubMed] [Google Scholar]
- 25.Hull TD, Mahan K. A study of asynchronous mobile-enabled SMS text psychotherapy. Telemedicine journal and e-health : the official journal of the American Telemedicine Association. 2017;23(3):240–247. doi: 10.1089/tmj.2016.0114. [DOI] [PubMed] [Google Scholar]
- 26.Marcelle ET, Nolting L, Hinshaw SP, Aguilera A. Effectiveness of a multimodal digital psychotherapy platform for adult depression: A naturalistic feasibility study. JMIR mHealth and uHealth. 2019;7(1):e10948. doi: 10.2196/10948. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Kretzschmar K, Tyroll H, Pavarini G, Manzini A, Singh I. Can your phone be your therapist? Young people’s ethical perspectives on the use of fully automated conversational agents (chatbots) in mental health support. Biomedical informatics insights. 2019;11:1178222619829083. doi: 10.1177/1178222619829083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Shen N, Levitan MJ, Johnson A, et al. Finding a depression app: a review and content analysis of the depression app marketplace. JMIR Mhealth Uhealth. 2015;3(1):e16. doi: 10.2196/mhealth.3713. [DOI] [PMC free article] [PubMed] [Google Scholar]