Abstract
Background
Digital technology has the potential to transform psychiatry, but its adoption has been limited. The proliferation of telepsychiatry during the COVID-19 pandemic has increased the urgency of optimizing technology for clinical practice. Understanding clinician attitudes and preferences is crucial to effective implementation and patient benefit.
Objective
Our objective was to elicit clinician perspectives on emerging digital technology.
Methods
Clinicians in a large psychiatry department (inpatient and outpatient) were invited to complete a web-based survey about their attitudes toward digital technology in practice, focusing on implementation, clinical benefits, and expectations about patients’ attitudes. The survey consisted of 23 questions that could be answered on either a 3-point or 5-point Likert scale. We report the frequencies and percentages of responses.
Results
In total, 139 clinicians completed the survey—they represent a variety of years of experience, credentials, and diagnostic subspecialties (response rate 69.5%). Overall, 83.4% (n=116) of them stated that digital data could improve their practice, and 23.0% (n=32) of responders reported that they had viewed patients’ profiles on social media. Among anticipated benefits, clinicians rated symptom self-tracking (n=101, 72.7%) as well as clinical intervention support (n=90, 64.7%) as most promising. Among anticipated challenges, clinicians mostly expressed concerns over greater time demand (n=123, 88.5%) and whether digital data would be actionable (n=107, 77%). Furthermore, 95.0% (n=132) of clinicians expected their patients to share digital data.
Conclusions
Overall, clinicians reported a positive attitude toward the use of digital data to not only improve patient outcomes but also highlight significant barriers that implementation would need to overcome. Although clinicians’ self-reported attitudes about digital technology may not necessarily translate into behavior, our results suggest that technologies that reduce clinician burden and are easily interpretable have the greatest likelihood of uptake.
Keywords: digital psychiatry, passive monitoring technology, digital phenotype, psychiatry, mental health, clinicians, clinician perspectives, digital health, physicians, psychiatrists
Introduction
Digital technology is a central feature of modern life and is becoming an increasingly prominent component of modern medical practice. In psychiatry, there is established evidence that digital data can be used to monitor multiple health outcomes. Metrics including the frequency of web-based activity, the content and language uploaded to social media, and smartphone sensing of biometrics including sleep and physical activity have strong predictive value for medication compliance, current mental status, or risk of relapse and can be used to guide treatment decisions effectively [1-5]. Mental health apps show broad applications across many patient demographics and diagnostic categories [6]. The integration of digital data into clinical practice represents not only a new means of interacting with patients—allowing clinicians to monitor dynamic symptoms in real time, providing patients and clinicians alike early notice of relapse and reducing latency during intervention—but also, indeed, a new way of understanding patients, thus synthesizing symptoms data into individualized profiles for each unique patient who uses the technology—a digital phenotype [7]. However, while academic research has explored patients’ digital phenotypes, this work has not yet fully integrated multiple streams of digital data, nor has it been deployed systematically in actual clinical settings [8].
Clinician attitudes toward the use of digital data in psychiatry—in terms of benefits to clinical care, barriers to effective implementation, understanding of the capabilities of current technology, and willingness to change current practice—are a key factor in the development and adoption of future technological platforms, but they remain underexplored and underappreciated [9-11]. Indeed, clinician enthusiasm has been shown to be a vital factor to successful implementation of new digital platforms in clinical settings [12]. Studies of telepsychiatry suggest that successful implementation of digital technology into clinical settings depends on clinician enthusiasm and confidence in the safety and efficacy of the new platform, as well as access to proper training [13-15]. Previous studies of clinicians’ attitudes toward digital data in psychiatry indicate some enthusiasm regarding administrative improvements that technology could provide—including ease of scheduling and monitoring patients between sessions—but strong concerns about privacy, and limited understanding of the capabilities of digital platforms has been demonstrated previously [16]. Elsewhere, surveys of clinicians have demonstrated a negative correlation between professional experience and clinicians’ attitudes toward the use digital data in psychiatry [17]. To develop a successful platform for clinicians to use digital data in practice, researchers must determine not only clinicians’ attitudes toward the technology but also their literacy about its efficacy and potential as a clinical aid.
Although digital mental health data have been researched for over a decade, their development has recently become urgent owing to the COVID-10 pandemic. Clinical practices worldwide experienced a massive shift toward remote assessment as a result of COVID-19 restrictions, and clinicians were rapidly introduced to telepsychiatry, who under, normal circumstances may never have been exposed to it. This shift in practice highlighted not only the need for increased clinical services for individuals without access but also the reluctance of many clinicians to engage with telehealth technologies owing to concerns about its efficacy and compromised privacy [18,19]. As future clinical practice in psychiatry may continue to rely on remote assessment, understanding clinician perspectives on this technology remains crucial to optimizing service and user experience.
The aim of our study was to capture clinician attitudes and expectations regarding emerging digital technology in psychiatry, in light of the unprecedented shift in clinician experience that the COVID-19 pandemic represents. Previously reluctant or unfamiliar clinicians will now have had significant experience of telehealth practice, and attitudes toward digital data in psychiatry may have shifted. Understanding clinician attitudes and preferences is necessary to overcome implementation challenges and achieve patient benefits.
Methods
Methods Overview
The survey was developed for the purpose of this study by the Digital Clinic research group, which is composed of clinicians working in outpatient and inpatient settings as well as dedicated research staff familiar with emerging digital technology in psychiatry, working on the implementation of digital technology in clinical settings across our health system. The survey was designed to study clinician attitudes toward the use of digital technology in psychiatry in a variety of dimensions using varied Likert scales. Questions were written on the basis of expert research group members’ existing knowledge of digital technology in psychiatry as described in current literature, and in anticipation of developing a digital data platform for use in our campus’ outpatient clinic (see attached survey in Multimedia Appendix 1).
Survey items included (1) an assessment of whether clinicians thought digital data about patients could inform their practice (using a 5-point Likert scale: 0%=”No,” 25%=“I’m not sure, I need to know more,” 50%=“I think so, but would need to try it out,” 75%=“Yes,” and 100%=“Definitely, I incorporate this data already”), (2) ratings of perceived relative usefulness of different types of digital patient data (such as sleep, physical activity, location, web-based search activity, etc, using a 3-point Likert scale: 0%=“Low,” 50%=“Medium,” and 100%=“High”), (3) anticipated barriers to using digital data in clinical practice (such as “Patient participation,” “Increased time demands tending to flagged digital events,” “Volume of data created by digital monitoring,” etc, using a 3-point Likert scale: 0%=“Not a barrier,” 50%=“Somewhat of a barrier,” and 100%=“A significant barrier”), (4) anticipated benefits to using digital data in clinical practice (such as “Having a consistent source of collateral data,” “Helping patients feel better understood,” “As an alert system when patient activities change,” etc, using a 3-point Likert scale: 0%=“Not a benefit,” 50%=“Somewhat of a benefit,” and 100%=“A significant benefit”), (5) clinicians’ expectations of whether patients would be willing to share digital data in a clinical setting and experience using digital patient data from social media (using multiple-choice questions about how data were used and free-text responses to allow responders to elaborate), (6) rating level of agreement with statements about the incorporation of digital data into psychiatric practice (such as “Having access to information collected in a Digital Clinic will... Lead to more frequent patient encounters,” “...Improve clinical outcomes,” or “...Increase the amount of documentation to complete,” using a 5-point Likert scale: 0%=“Strongly disagree,” 25%=“Disagree,” 50%=“Neither agree nor disagree,” 75%=“Agree,” and 100%=“Strongly agree”), (7) assessment of if or how clinician attitudes toward digital data in psychiatry had changed in response to the COVID-19 pandemic and the changes in practice that many of the surveyed participants had experienced (using free-text responses), and (8) demographic characteristics (including age, years in practice, nature of practice, and role in clinic).
The survey was administered to all clinicians on the campus of an academic psychiatric treatment facility. The facility surveyed here is in a demographically diverse section of a major urban area, with high access to mental health services. The survey was written in Survey Monkey and administered during a Grand Rounds event. It was subsequently emailed to all clinicians on campus. A total of 200 clinicians were surveyed—150 outpatients and 50 inpatients. The survey was open for 6 months from May to November 2020. Participation in the survey was voluntary. There was no compensation for completing the survey. Responders were given the option to share their contact information (deanonymizing themselves) to participate in a possible focus group, but owing to the COVID-19 pandemic, this focus group was not held.
Ethical Considerations
The survey was reviewed by the Northwell institutional review board and granted an exemption (#19-0958).
Statistical Analysis
Descriptive statistics were used to report survey results. Chi-square tests were used to compare categorical variables. First, omnibus comparisons were conducted by prescribing status (yes/no). If significant differences were detected, we then tested the individual interactions of interest post hoc. Wilcoxon tests for nonnormally distributed, continuous variables (age), as determined by a Shapiro–Wilk W test, were conducted. All analyses were conducted using JMP, (version 13; SAS Institute Inc, 1989-2019).
Results
Overview
We received a total of 139 completed survey responses (response rate 69.5%). The median age of responders was 42 (IQR 34-70) years, with a median 12 (IQR 4-33) years of clinical experience. In total, 50 (36.0%) responders were psychiatrists, 27 (27.0%) were residents, 20 (14.4%) were psychologists, 14 (10.1%) were social workers, 3 (2.2%) were nurse practitioners, and 25 (16.5%) were nurses or other clinical staff. Furthermore, 79 (56.8%) responders provided medication management and 82 (59.0%) provided individual psychotherapy (Table 1).
Table 1.
Characteristics of responders (N=139).
| Characteristics | Value | |
| Age (years), median (IQR) | 42 (34-70) | |
| Years in practice, median (IQR) | 12 (4-33) | |
| Gender, n (%) | ||
|
|
Male | 53 (38.1) |
|
|
Female | 74 (53.2) |
|
|
Declined to answer | 12 (8.7) |
| Role in clinic, n (%) | ||
|
|
Psychiatrist | 50 (36.0) |
|
|
Resident or intern | 27 (19.4) |
|
|
Psychologist | 20 (14.4) |
|
|
Nurse practitioner | 3 (2.2) |
|
|
Nurse | 2 (1.4) |
|
|
Social worker | 14 (10.1) |
|
|
Other | 23 (16.6) |
| Type of practice (allowed to select more than one), n (%) | ||
|
|
Medication Management | 79 (56.8) |
|
|
Individual Psychotherapy | 82 (59.0) |
|
|
Group Therapy | 30 (21.6) |
|
|
Neuromodulation | 5 (3.6) |
|
|
Administration | 26 (18.7) |
|
|
Research | 3 (2.2) |
Attitudes Toward Digital Data in Psychiatry
Out of 139 responders, 116 (83.4%) stated that digital data could improve their clinical practice. Among different categories of digital data, responders rated data on Sleep (n=100, 72.0%), treatment adherence (n=101, 79.5%), substance use (n=105, 76.0%), self-reported symptom ratings (n=90, 70.0%), and physical activity (n=73, 53%) as having the highest potential utility in practice. Responders rated location (n=33, 26.0%), screen time (n=34, 24.0%), and criminal justice data (inmate registries, WebCrims, etc; n=25, 18.0%) as having the lowest potential use in practice (Table 2).
Table 2.
Attitudes toward digital data in psychiatry.
| Rating of the relative level of perceived usefulness that each category has for individuals’ practice | Low, n (%) | Medium, n, (%) | High, n (%) |
| Sleep | 3 (2.2) | 27 (19.4) | 100 (71.9) |
| Physical activity | 4 (2.9) | 59 (42.2) | 73 (52.5) |
| Social media activity (frequency of posts or content of posts concerning symptoms of mental illness) | 13 (9.4) | 69 (49.6) | 57 (41.0) |
| Web-based search activity (content of which concerns symptoms of mental illness) | 19 (13.7) | 58 (41.7) | 62 (44.6) |
| Mobility (time spent away from home versus at home) | 14 (10.1) | 59 (42.4) | 66 (47.5) |
| Location | 36 (25.9) | 65 (46.8) | 33 (23.7) |
| Substance use | 10 (7.2) | 20 (14.4) | 105 (75.5) |
| Screen time | 34 (24.5) | 66 (47.5) | 38 (27.3) |
| Treatment adherence | 7 (5.0) | 22 (15.8) | 110 (79.1) |
| Homework completion | 26 (18.7) | 63 (45.3) | 48 (34.5) |
| Criminal justice data (inmate registries, WebCrims, etc) | 25 (18.0) | 59 (42.4) | 55 (39.6) |
Among anticipated benefits, responders rated “Helping patients track their activities and symptoms” (n=101, 72.7%), “As a support for clinical intervention” (n=90, 64.7%), and “Having a consistent source of collateral data” (n=86, 62.5%) as offering the most significant benefit. Responders rated “Helping patients feel better understood” as the least potentially beneficial aspect of using digital data in psychiatry (“Not a benefit” n=14, 10.1%; Figure 1). Among anticipated barriers to the use of digital data, responders rated “Increased time demands tending to flagged digital events” (n=54, 38.8%), “Volume of data created by digital monitoring” (n=52, 37.4%), “Increased documentation” (n=57, 41%), “Patient participation” (n=46, 33.8%), and “Increased time demands tending to digital data during clinic visits” (n=54, 38.8%) as the most likely barriers. Responders rated “Lack of trust in digital data” (n=51, 36.7%), “Interference with alliance” (n=46, 33.1%), and “Uncertainty about how to integrate digital data into practice” (n=45, 32.4%) as the least likely barriers (Figure 2). Overall, 74.1% (n=103) of responders stated that they would consult a dashboard of patient digital data prior to a clinic visit, and 85.6% (n=119) of them stated that they thought it would be beneficial for patients to have access to an app-based dashboard with information about their digital data.
Figure 1.
Clinicians' responses to the question, "What do you anticipate would be the greatest benefits of digital data?".
Figure 2.
Clinicians' responses to the question, "What do you anticipate would be the greatest barriers against your use of digital data?".
Expectations From Digital Technology in Psychiatry
Responses skewed negatively regarding whether or not the introduction of digital technology into psychiatry would change the frequency of patient encounters (“...lead to more frequent patient encounters”: 39, 28.1% respondents either disagreed or strongly disagreed; “...lead to less frequent patient encounters”: 44, 31.7% either disagreed or strongly disagreed). Responders expressed agreement that digital technology could “...Increase the amount of documentation to complete” and “...Create more responsibility for clinicians” (n=102, 73.4% and n=110, 79.2%, respectively; Figure 3).
Figure 3.
Clinicians' responses to the following statement: "Please rate your level of agreement with the following statements: Having access to information collected in a digital clinic will…".
Regarding past use of digital data in psychiatric practice, 32 (23.0%) participants responded affirmatively that they had viewed a patient’s social media accounts (Facebook, Twitter, Instagram, and other social media accounts) while delivering care. A total of 21 (33.9%) of those who answered yes cited gaining collateral information as the rationale, while others reported viewing social media to evaluate the clinical significance of the posts, to evaluate patients’ interpretations of posts, or for use in psychoeducation or therapeutic skill-building. In total, 120 (94.5%) responders stated that they thought their patients would be willing to share at least some digital data. Furthermore, 79 (63.2%) responders expressed agreement that digital technology in psychiatry could improve medication adherence.
Additional analyses were completed to assess differences in response patterns based on age and prescriber versus nonprescriber status (prescriber: MD physician, resident, or nurse practitioner; nonprescriber: nurse or social worker). There were overall few significant differences between groups, but younger responders expressed greater willingness to consult a digital dashboard (P=.01) and greater concern about increased time demands from digital data (P=.04) and expected greater patient satisfaction from a digital clinic (P=.04), and prescribers expressed greater interest in monitoring social media activity for posts concerning mental illness (P=.02) and greater uncertainty about how to respond to flagged digital events (P=.03). Younger responders were likelier to report having looked up a patient’s social media accounts (P=.005).
Changes in Opinion After the COVID-19 Pandemic
When asked if the COVID-19 pandemic had affected their attitudes toward digital technology in psychiatry, 79 (56.8%) responders answered “yes.” Regarding how their attitudes had changed, responders provided a variety of responses in a free-text portion of the survey. Many were optimistic about digital technology in psychiatry after having had a positive initial experience with telepsychiatry: “More positive, more interest, greater comfort with telepsychiatry that makes me appreciate how digital data could inform my practice”; “It has normalized the use of technology in routine encounters”; “COVID is a disaster but I hope that a silver lining is that Telepsychiatry and digital psychiatry becomes more the accepted norm. Wider use of telepsychiatry is an excellent way to address the national shortage of psychiatrists available to deliver care”; and “Working from home greatly improves my work-life balance as a clinician. I find that patients feel the same way as they no longer have to travel to clinic, take time off work, or wait to see the doctor -- appointments start on time. For the stable, relatively high functioning outpatients that comprise my (very small) patient panel, telemedicine is equivalent to, and in many ways better than, in person psychiatry.” Some expressed skepticism, stating that “less interaction with the patient; not the same as in person visits.”
Discussion
Principal Findings
The purpose of our study was to examine clinician attitudes toward the use of digital data in mental health care via a survey of clinicians on the campus of an academic psychiatric hospital. We collected 139 survey responses. Overall, 83.4% (n=116) of responders reported positive expectations about digital data in clinical practice. Responders reported the highest enthusiasm for patient self-monitoring technologies and the strongest concern about potential increases in workload and actionability of digital data. As the use of digital data continues to gain prominence in mental health care, the results of our survey serve as a useful indicator of clinician expectations and concerns regarding this new technology in mental health. This study examined clinician attitudes toward the usefulness of different forms of digital data in clinical practice, clinicians’ anticipated benefits and barriers to employing digital technology in clinical practice, expectations of the ways in which clinical practice will change with the inclusion of digital data in psychiatry, experiences using patients’ social media data in practice, and the ways in which clinician perspectives on digital data in psychiatry have changed in response to the COVID-19 pandemic and the wide-scale shift to telehealth practice in medicine. Overall, the surveyed clinicians expressed enthusiasm to include digital data in their clinical practice and confidence that patients would be willing to share data; however, they expressed strong concern about increases in workload related to the inclusion of new technology in clinical practice.
Comparison to Prior Work
While much attention has been paid to research developments, expert consensus, and patient expectations on digital data in psychiatry, clinician attitudes remain under-reported [8,9,11,20,21]. Our study offers a unique contribution to the literature on this rapidly developing area of mental health care, detailing clinician expectations of forthcoming digital technology in psychiatry, attitudes regarding how digital data can both help and hinder their practice, and current clinician behaviors regarding patients’ digital information (via web-based or social media search) at a unique point in time. These results will be useful in designing future digital clinics and be instructive for those disseminating digital data research as to which technologies clinicians are ready to embrace or remain reluctant.
Survey responders reported largely high expectations that digital data could improve their clinical practice, and more than half of them reported a shift in attitude after the onset of the COVID-19 pandemic, when most clinical practices had transitioned to a telehealth model. Providers also expressed high willingness to consult a digital dashboard and have patients do the same. These findings are consistent with the broader literature on the topic but higher than clinician expectation statistics reported elsewhere [20,22,23]. It may be that this enthusiasm reflected changing attitudes related to the COVID-19 pandemic or could be a reflection of the relatively young age of the group surveyed. Similarly, responders reported high confidence that patients would be willing to share digital data, consistent with other similar studies [23]. Our findings indicate that enthusiasm for the use of digital data in psychiatry and high expectations among clinicians that patients will feel the same way. Although there is a known gap between research enthusiasm and clinician enthusiasm [8,11], our data indicate that clinicians remain enthusiastic about digital data in psychiatry. This study should serve as encouragement for those seeking to implement digital technology into clinical practice.
Regarding the anticipated usefulness of different types of digital data in psychiatry, responders ranked items including sleep, substance use, patient-rated symptom scales, and physical activity as having high utility, but they rated location, internet search activity, and criminal data as having substantially less utility. One interpretation of this finding is that clinicians favor monitoring actionable metrics that could allow for discrete intervention over other types of digital measurement. This sentiment would appear echoed in the finding that clinicians rated “Helping patients track their activities and symptoms” and “As a support for clinical intervention” as the two most prominent benefits of using digital monitoring in mental health care. Previous work on digital technology in psychiatry has acknowledged a gap between what is notable in research versus what is readily adopted in clinical practice [8,11]. Our results indicate something similar and underscore the need to demonstrate clinical utility to encourage clinician adoption. Similarly, survey responders expressed concern about increases in documentation with the adoption of digital technology in clinical practice. In addition to demonstrating the actionability of digital data, designers of future clinical platforms will have to streamline the modes in which data are presented to clinicians to minimize the documentation burden.
The response to the question, “Have you ever viewed a patient’s social media (Facebook page, Twitter account, Instagram account etc)?” is a notable finding in itself because this behavior is extremely underreported in the literature [24,25]. Based on available research, our results are consistent with those of other studies [26]. Although not a strict equivalent to consulting a digital dashboard in the clinical setting (for both practical and ethical reasons), looking up patients on social media can be viewed as somewhat of a proxy for current use of digital data in clinical practice among those whom we surveyed. By that standard, despite their enthusiasm for new technology, our responders’ use of social media data was low. Given the controversy regarding this practice, it is plausible that our responders underreported how often they viewed patients’ social media accounts. Future research of other psychiatric clinicians in other settings could help to further elucidate how clinicians incorporate patient social media data into their assessments.
Limitations
This study had several limitations. The first and most significant limitation is that it was conducted on a campus on which psychiatric digital technology research has had high visibility for several years. Although few responders identified themselves as researchers, many had likely had exposure to emerging digital technology and may have been predisposed to a positive response regarding potential benefits and lower trepidation about potential barriers of this technology in practice. This limits the generalizability of our data, when compared to clinician attitudes in community or nonacademic settings. Second, the survey was composed largely of closed-ended questions. Though there were opportunities for free-text responses where responders could express thoughts or feelings not captured in the survey questions, this mode of surveying may have left some attitudes unaccounted for.
A third limitation of our survey is timing, and the limitation is 2-fold. First, clinicians completed the survey beginning in May 2020, several months after a wide-scale shift to telehealth on our campus. In their free-text responses, many mentioned positive experiences with telepsychiatry but less specifically any of the digital technology described in the survey. It is possible that some responders conflated their experience with telepsychiatry with the technology described as part of the hypothetical digital clinic and provided contrived, more positive responses as a result. Future research must investigate how clinicians’ attitudes toward technology have continued to evolve in the postpandemic world. The second issue is that emerging technology is a dynamic, ever-shifting field, and that the generalizability of survey results, such as that of our survey, is limited to the moment in time the survey was administered. This limits the generalizability of our study or rather any study that discusses this topic. Lastly, the dimensions of our survey were not calculated, and specific validity and reliability tests were not conducted. Studies similar to this one will remain useful for understanding clinicians’ perspectives on these issues, but so will studies that measure the safety and efficacy of how these technologies are implemented in clinical practice.
Conclusions
Our survey results indicate that clinicians’ attitudes toward the implementation of digital data in psychiatry are largely positive. However, responders voiced some trepidation about the actionability of digital data and increased time demands from addressing or documenting data. Overall, 23.0% (n=32) of responders reported having looked up patients on social media. More than half of the responders reported a change in attitude toward digital data in psychiatry following the COVID-19–related transition to telepsychiatry service models. Our survey results underscore the need for clinician engagement and education as digital data platforms are developed for clinical use in psychiatry.
Acknowledgments
We thank the clinicians who took the time to participate in our study despite their busy schedule in such challenging times. We would also like to thank Lillian Smith for her guidance in creating the initial drafts of our survey.
Sample of the digital clinic clinician survey.
Footnotes
Conflicts of Interest: DG has been a consultant for or has received speaker honoraria from Otsuka America Pharmaceuticals and Janssen Pharmaceuticals. JMR has received honoraria from Teva and Lundbeck, royalties from UpToDate, and grant funding from Alkermes and the National Institute of Mental Health. JMK has been a consultant or advisor for or has received honoraria from Alkermes, Allergan, LB Pharmaceuticals, H Lundbeck, Intracellular Therapies, Janssen Pharmaceuticals, Johnson and Johnson, Merck, Minerva, Neurocrine, Newron, Otsuka, Pierre Fabre, Reviva, Roche, Sumitomo Dainippon, Sunovion, Takeda, Teva, and UpToDate, and is a shareholder in LB Pharmaceuticals and Vanguard Research Group. MLB receives equity from NorthShore Therapeutics and serves as a consultant for HearMe. WAS, MS, and AVM report no conflicts of interest.
References
- 1.Ben-Zeev D, Brian R, Wang R, Wang W, Campbell AT, Aung MSH, Merrill M, Tseng VWS, Choudhury T, Hauser M, Kane JM, Scherer EA. CrossCheck: integrating self-report, behavioral sensing, and smartphone use to identify digital indicators of psychotic relapse. Psychiatr Rehabil J. 2017 Sep;40(3):266–275. doi: 10.1037/prj0000243. https://europepmc.org/abstract/MED/28368138 .2017-14914-001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Buck B, Scherer E, Brian R, Wang R, Wang W, Campbell A, Choudhury T, Hauser M, Kane JM, Ben-Zeev D. Relationships between smartphone social behavior and relapse in schizophrenia: a preliminary report. Schizophr Res. 2019 Jun;208:167–172. doi: 10.1016/j.schres.2019.03.014. https://europepmc.org/abstract/MED/30940400 .S0920-9964(19)30108-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Birnbaum ML, Wen H, Van Meter A, Ernala SK, Rizvi AF, Arenare E, Estrin D, De Choudhury M, Kane JM. Identifying emerging mental illness utilizing search engine activity: a feasibility study. PLoS One. 2020 Oct 16;15(10):e0240820. doi: 10.1371/journal.pone.0240820. https://dx.plos.org/10.1371/journal.pone.0240820 .PONE-D-20-00540 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Lewis S, Ainsworth J, Sanders C, Stockton-Powdrell C, Machin M, Whelan P, Hopkins R, He Z, Applegate E, Drake R, Bamford C, Roberts C, Wykes T. Smartphone-enhanced symptom management in psychosis: open, randomized controlled trial. J Med Internet Res. 2020 Aug 13;22(8):e17019. doi: 10.2196/17019. https://www.jmir.org/2020/8/e17019/ v22i8e17019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Hirschtritt ME, Insel TR. Digital technologies in psychiatry: present and future. Focus (Am Psychiatr Publ) 2018 Jul;16(3):251–258. doi: 10.1176/appi.focus.20180001. https://europepmc.org/abstract/MED/31975919 .FOC_20180001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Beard C, Silverman AL, Forgeard M, Wilmer MT, Torous J, Björgvinsson T. Smartphone, social media, and mental health app use in an acute transdiagnostic psychiatric sample. JMIR Mhealth Uhealth. 2019 Jun 07;7(6):e13364. doi: 10.2196/13364. https://mhealth.jmir.org/2019/6/e13364/ v7i6e13364 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Insel TR. Digital phenotyping: technology for a new science of behavior. JAMA. 2017 Oct 03;318(13):1215–1216. doi: 10.1001/jama.2017.11295.2654782 [DOI] [PubMed] [Google Scholar]
- 8.Mohr DC, Lyon AR, Lattie EG, Reddy M, Schueller SM. Accelerating digital mental health research from early design and creation to successful implementation and sustainment. J Med Internet Res. 2017 May 10;19(5):e153. doi: 10.2196/jmir.7725. https://www.jmir.org/2017/5/e153/ v19i5e153 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bhugra D, Tasman A, Pathare S, Priebe S, Smith S, Torous J, Arbuckle MR, Langford A, Alarcón RD, Chiu HFK, First MB, Kay J, Sunkel C, Thapar A, Udomratn P, Baingana FK, Kestel D, Ng RMK, Patel A, Picker LD, McKenzie KJ, Moussaoui D, Muijen M, Bartlett P, Davison S, Exworthy T, Loza N, Rose D, Torales J, Brown M, Christensen H, Firth J, Keshavan M, Li A, Onnela J, Wykes T, Elkholy H, Kalra G, Lovett KF, Travis MJ, Ventriglio A. The WPA-Lancet Psychiatry Commission on the future of psychiatry. Lancet Psychiat. 2017 Oct;4(10):775–818. doi: 10.1016/s2215-0366(17)30333-4. [DOI] [PubMed] [Google Scholar]
- 10.Tonn P, Reuter SC, Kuchler I, Reinke B, Hinkelmann L, Stöckigt S, Siemoneit H, Schulze N. Development of a questionnaire to measure the attitudes of laypeople, physicians, and psychotherapists toward telemedicine in mental health. JMIR Ment Health. 2017 Oct 03;4(4):e39. doi: 10.2196/mental.6802. https://mental.jmir.org/2017/4/e39/ v4i4e39 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Mohr DC, Weingardt KR, Reddy M, Schueller SM. Three problems with current digital mental health research . . . and three things we can do about them. Psychiatr Serv. 2017 May 01;68(5):427–429. doi: 10.1176/appi.ps.201600541. https://europepmc.org/abstract/MED/28412890 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, Hinder S, Fahy N, Procter R, Shaw S. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017 Nov 01;19(11):e367. doi: 10.2196/jmir.8775. https://www.jmir.org/2017/11/e367/ v19i11e367 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Wade VA, Eliott JA, Hiller JE. Clinician acceptance is the key factor for sustainable telehealth services. Qual Health Res. 2014 May 31;24(5):682–694. doi: 10.1177/1049732314528809.1049732314528809 [DOI] [PubMed] [Google Scholar]
- 14.Cowan KE, McKean AJ, Gentry MT, Hilty DM. Barriers to use of telepsychiatry: clinicians as gatekeepers. Mayo Clin Proc. 2019 Dec;94(12):2510–2523. doi: 10.1016/j.mayocp.2019.04.018.S0025-6196(19)30400-8 [DOI] [PubMed] [Google Scholar]
- 15.Guinart D, Marcy P, Hauser M, Dwyer M, Kane JM. Mental health care providers' attitudes toward telepsychiatry: a systemwide, multisite survey during the COVID-19 pandemic. Psychiatr Serv. 2021 Jun;72(6):704–707. doi: 10.1176/appi.ps.202000441. [DOI] [PubMed] [Google Scholar]
- 16.Schueller SM, Washburn JJ, Price M. Exploring mental health providers' interest in using web and mobile-based tools in their practices. Internet Interv. 2016 May;4(2):145–151. doi: 10.1016/j.invent.2016.06.004. https://europepmc.org/abstract/MED/28090438 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Mayer G, Gronewold N, Alvarez S, Bruns B, Hilbel T, Schultz J. Acceptance and expectations of medical experts, students, and patients toward electronic mental health apps: cross-sectional quantitative and qualitative survey study. JMIR Ment Health. 2019 Nov 25;6(11):e14018. doi: 10.2196/14018. https://mental.jmir.org/2019/11/e14018/ v6i11e14018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Rodriguez-Villa E, Rauseo-Ricupero N, Camacho E, Wisniewski H, Keshavan M, Torous J. The digital clinic: implementing technology and augmenting care for mental health. Gen Hosp Psychiatry. 2020 Sep;66:59–66. doi: 10.1016/j.genhosppsych.2020.06.009. https://europepmc.org/abstract/MED/32688094 .S0163-8343(20)30085-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Uscher-Pines L, Sousa J, Raja P, Mehrotra A, Barnett ML, Huskamp HA. Suddenly becoming a "Virtual Doctor": experiences of psychiatrists transitioning to telemedicine during the COVID-19 pandemic. Psychiatr Serv. 2020 Nov 01;71(11):1143–1150. doi: 10.1176/appi.ps.202000250. https://europepmc.org/abstract/MED/32933411 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Hatch A, Hoffman JE, Ross R, Docherty JP. Expert consensus survey on digital health tools for patients with serious mental illness: optimizing for user characteristics and user support. JMIR Ment Health. 2018 Jun 12;5(2):e46. doi: 10.2196/mental.9777. https://mental.jmir.org/2018/2/e46/ v5i2e46 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Jacob C, Sanchez-Vazquez A, Ivory C. Social, organizational, and technological factors impacting clinicians’ adoption of mobile health tools: systematic literature review. JMIR Mhealth Uhealth. 2020 Feb 20;8(2):e15935. doi: 10.2196/15935. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Bauer R, Glenn T, Monteith S, Whybrow PC, Bauer M. Survey of psychiatrist use of digital technology in clinical practice. Int J Bipolar Disord. 2020 Oct 03;8(1):29. doi: 10.1186/s40345-020-00194-1. https://europepmc.org/abstract/MED/33009954 .10.1186/s40345-020-00194-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Armstrong CC, Odukoya EJ, Sundaramurthy K, Darrow SM. Youth and provider perspectives on behavior-tracking mobile apps: qualitative analysis. JMIR Ment Health. 2021 Apr 22;8(4):e24482. doi: 10.2196/24482. https://mental.jmir.org/2021/4/e24482/ v8i4e24482 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Ashby GA, O'Brien A, Bowman D, Hooper C, Stevens T, Lousada E. Should psychiatrists 'Google' their patients? BJPsych Bull. 2015 Dec 02;39(6):278–283. doi: 10.1192/pb.bp.114.047555. https://www.cambridge.org/core/product/identifier/S2056469400001121/type/journal_article .S2056469400001121 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Clinton B, Silverman BC, Brendel DH. Patient-targeted googling: the ethics of searching online for patient information. Harv Rev Psychiatry. 2010;18(2):103–112. doi: 10.3109/10673221003683861. [DOI] [PubMed] [Google Scholar]
- 26.Bosslet GT, Torke AM, Hickman SE, Terry CL, Helft PR. The patient-doctor relationship and online social networks: results of a national survey. J Gen Intern Med. 2011 Oct 25;26(10):1168–1174. doi: 10.1007/s11606-011-1761-2. https://europepmc.org/abstract/MED/21706268 . [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Sample of the digital clinic clinician survey.