Abstract
Background
Depression and anxiety are highly prevalent conditions in the United States. Despite the availability of suitable therapeutic options, limited access to high-quality psychiatrists represents a major barrier to treatment. Although telepsychiatry has the potential to improve access to psychiatrists, treatment efficacy in the telepsychiatry model remains unclear.
Objective
Our primary objective was to determine whether there was a clinically meaningful change in 1 of 2 validated outcome measures of depression and anxiety—the Patient Health Questionnaire–8 (PHQ-8) or the Generalized Anxiety Disorder–7 (GAD-7)—after receiving at least 8 weeks of treatment in an outpatient telepsychiatry setting.
Methods
We included treatment-seeking patients enrolled in a large outpatient telepsychiatry service that accepts commercial insurance. All analyzed patients completed the GAD-7 and PHQ-8 prior to their first appointment and at least once after 8 weeks of treatment. Treatments included comprehensive diagnostic evaluation, supportive psychotherapy, and medication management.
Results
In total, 1826 treatment-seeking patients were evaluated for clinically meaningful changes in GAD-7 and PHQ-8 scores during treatment. Mean treatment duration was 103 (SD 34) days. At baseline, 58.8% (1074/1826) and 60.1% (1097/1826) of patients exhibited at least moderate anxiety and depression, respectively. In response to treatment, mean change for GAD-7 was –6.71 (95% CI –7.03 to –6.40) and for PHQ-8 was –6.85 (95% CI –7.18 to –6.52). Patients with at least moderate symptoms at baseline showed a 45.7% reduction in GAD-7 scores and a 43.1% reduction in PHQ-8 scores. Effect sizes for GAD-7 and PHQ-8, as measured by Cohen d for paired samples, were d=1.30 (P<.001) and d=1.23 (P<.001), respectively. Changes in GAD-7 and PHQ-8 scores correlated with the type of insurance held by the patients. Greatest reductions in scores were observed among patients with commercial insurance (45% and 43.9% reductions in GAD-7 and PHQ-8 scores, respectively). Although patients with Medicare did exhibit statistically significant reductions in GAD-7 and PHQ-8 scores from baseline (P<.001), these improvements were attenuated compared to those in patients with commercial insurance (29.2% and 27.6% reduction in GAD-7 and PHQ-8 scores, respectively). Pairwise comparison tests revealed significant differences in treatment responses in patients with Medicare versus commercial insurance (P<.001). Responses were independent of patient geographic classification (urban vs rural; P=.48 for GAD-7 and P=.07 for PHQ-8). The finding that treatment efficacy was comparable among rural and urban patients indicated that telepsychiatry is a promising approach to overcome treatment disparities that stem from geographical constraints.
Conclusions
In this large retrospective data analysis of treatment-seeking patients using a telepsychiatry platform, we found robust and clinically significant improvement in depression and anxiety symptoms during treatment. The results provide further evidence that telepsychiatry is highly effective and has the potential to improve access to psychiatric care.
Keywords: telepsychiatry, PHQ-8, GAD-7, clinical outcomes, rural, commercial insurance, telehealth, depression, anxiety, telemental health, psychiatry, Generalized Anxiety Disorder-7, Patient Health Questionnaire-8
Introduction
Background
Depression and anxiety are the 2 most common mental health conditions in the United States and worldwide, ranking second and eighth, respectively, in the list of causes for disability [1]. The chronicity and prevalence of these illnesses have an enormous economic impact and have worsened the quality of life in countries across the globe. A recent health economics review found that depression alone accounts for roughly 16% of the loss of work-related productivity [2]. Those who have depression and anxiety have worse health outcomes if left untreated [3-5].
Although effective treatment is available for both these chronic conditions, access to these treatments can be a challenge, which has led to significant gaps in treatment [6-8]. Difficulties in access to treatment can stem from physical distances from a treatment site, difficulties with arranging for time away from home or work to attend clinical appointments, prohibitive treatment costs, and the paucity of specialist care [9,10]. Remarkably, 27% of the counties in the United States are characterized by the complete absence of psychiatrists [11]. Rural residents are noteworthy for having limited access to in-person psychiatric care [9,11]. Even more troubling, it appears that issues of access occur independently of the patients’ health insurance status. A recent survey found that 31% of US adults reported the inability to access mental health services despite being insured [12]. Further, the medical specialty least likely to participate in health insurance plans is psychiatry [13]. Consequently, the total cost for outpatient psychiatric care is often not mitigated by health insurance. Not only is outpatient psychiatric care without insurance often cost prohibitive, the potential paucity of in-network psychiatrists may further delay access to treatment. These delays in access to mental health treatment are burdensome to patients and frequently worsen other associated medical conditions [14,15].
The aforementioned obstacles are especially disconcerting given the efficacy of treatments for both depression and anxiety. Antidepressants and psychotherapy have long been recognized as being beneficial for treating these conditions [16,17]. Given that modern technology permits the delivery of evidence-based treatments remotely and that psychiatry as a practice does not require the presence of patients and psychiatrists in the same physical space, telepsychiatry is a valuable tool for overcoming these persistent barriers. Indeed, the recent easing of regulatory obstacles to the implementation of telepsychiatry platforms has led to a vast expansion in the ease of access to mental health services. Encouragingly, a growing body of literature indicates that patients receiving telehealth treatments exhibit improvements that are comparable to those seen in patients receiving in-person care [18-20]. Others have demonstrated that a combination of flexibly implemented psychotherapy and medication management is effective for the management of anxiety disorders [21]. Presently, the potential efficacy of telepsychiatry services for patients who elect a fully virtual telepsychiatry service remains unknown.
In this study, we examined the outcomes of a large private outpatient telepsychiatry practice. Talkiatry is a fully virtual, nationwide outpatient private psychiatry practice that accepts commercial health insurance. This practice employs over 300 psychiatrists and more than 50 therapists across the United States. Although virtual, Talkiatry uses the traditional psychiatric model of care—an initial comprehensive evaluation, followed by the development of a treatment plan that revolves around patient preferences. This type of patient-centric approach comprised of partnerships between physicians and patients that are built on the foundation of effective communication and health promotion has been found to improve medical outcomes and forms the basis of effective outpatient psychiatric care [22].
The concept of therapeutic alliance—the collaborative relationship between the patient and physician—is another core element of psychiatric care that has been described as one of the most valuable aspects of treatment effectiveness with strong positive impact on outcomes in psychotherapy [23-25]. In fact, a patient’s adherence to treatment is often motivated by a strong therapeutic alliance [26]. Further, recent studies have suggested that therapeutic alliance is the mediator of change in psychotherapy studies across a broad range of modalities and conditions [27]. The efficacy of therapeutic alliance depends on the ability of the physician to convey empathy and friendliness, to understand a patient’s unique set of motivations and interests, and to implement an individualized treatment that is personalized to that patient’s preferences [28]. Not surprisingly, it takes time to build a therapeutic alliance. Therefore, the establishment of therapeutic alliance is difficult in the common and increasingly dominant 15-minute medication checks that characterize current psychiatric practice [29,30]. Here, we examined whether the Talkiatry telepsychiatry model, which has time set aside specifically for the establishment of a strong therapeutic alliance, led to improved clinical outcomes for patients with anxiety or depression.
Objectives
The primary objective of this study was to determine whether there was a clinically meaningful change in 1 of 2 validated outcome measures—the Patient Health Questionnaire–8 (PHQ-8) or the Generalized Anxiety Disorder–7 (GAD-7)—after receiving treatment in the outpatient telepsychiatry practice for a minimum of 8 weeks. This retrospective data analysis reflects real-world treatment conditions where the combination of therapy and medication management remains the primary modality of treatment. Our secondary objectives were to determine if patient demographic characteristics (sex, urban or rural, initial GAD-7 or PHQ-8 severity score, age, and insurance status) correlated with statistically significant changes in treatment outcomes.
Methods
Study Cohort and Treatment Strategy
This study’s population was composed of treatment-seeking individuals who had enrolled in an outpatient telepsychiatry practice. Patients sought enrollment in services through several commercially available booking platforms or the company website, and they were required to complete of a brief web-based questionnaire. Enrollment was restricted to individuals who did not present with primary psychotic disorder, primary substance use disorder, recent psychiatric hospitalization, current suicidal ideation, and insurance types not accepted by the practice. Once screening was completed, patients were provided several psychiatrists’ profiles to help them choose the provider that met their unique preferences (gender, condition specialty, and availability outside of business hours). From that curated group, each patient selected a psychiatrist and scheduled a new patient evaluation. All patients were requested to complete the GAD-7 and PHQ-8 measures up to 7 days prior to their first appointment and approximately every month thereafter. This study’s sample was composed of patients who (1) were 18 years of age or older, (2) had two sequential appointments with a treating psychiatrist at least 8 weeks apart, and (3) had completed either one or both GAD-7 and PHQ-8 measures twice (prior to each appointment). This study’s timeframe was the completion of initial visit between February 2023 and June 2023, with a subsequent visit completed at least 8 weeks later but before September 2023. If a patient completed multiple measures, the last completed measure was selected for analysis.
Therapy and medication management were provided in an audiovisual format that used a commercially available telehealth platform. Psychiatrists conducted comprehensive psychiatric evaluations and, in collaboration with the patient, developed appropriate treatment plans. Ongoing treatments, which included supportive psychotherapy, developing therapeutic alliance, and medication management, were embedded within the appointments. On average, psychiatrists spent 26 minutes of each patient visit on therapy. Each patient included in this study was seen by a psychiatrist at least twice.
Ethical Considerations
All data in this study were routinely collected as part of standard clinical practice. This study was reviewed and granted exempt status by the institutional review board of Advarra (Pro00073660). A full waiver of Health Insurance Portability and Accountability Act (HIPAA) authorization was granted under expedited review process. All data were deidentified by the data privacy team prior to all subsequent analyses.
Measures
The PHQ-8 is an 8-item self-reporting questionnaire that quantifies the symptoms of depression and measures progress in patient outcomes over time [31]. The scale performs similarly to the PHQ-9 and is routinely used in telehealth research and clinical practice settings [32]. For the PHQ-8, the standard cutoff scores were used to categorize patients into minimal (0-4), mild (5-9), moderate (10-14), moderately severe (15-19), and severe (20-24) depression. The GAD-7 is a 7-item self-reporting questionnaire that quantifies symptoms of generalized anxiety disorder and tracks progress of patient outcomes over time [33]. For the GAD-7, the standard cutoff scores were used to categorize patients into minimal (0-4), mild (5-9), moderate (10-14), and severe (15-21) anxiety. Initial PHQ-8 and GAD-7 scores were collected within 7 days of the first appointment and at approximately 1-month intervals during treatment. Demographic variables that were analyzed included age, sex, type of health insurance (commercial insurance, Medicare, or self-pay), and urban or rural classification. Self-pay was assigned to patients who were initially insured but changed or lost insurance during the course of treatment.
Statistical Analysis
Primary outcomes of interest in this study were anxiety and depressive symptoms measured by the GAD-7 and PHQ-8, respectively, assessed at the last visit. Changes in GAD-7 and PHQ-8 scores were calculated by subtracting the last scores from baseline scores for each patient. In order to examine clinically relevant samples, only patients with at least mild symptoms at baseline (ie, GAD-7 score≥5 or PHQ-8 score≥5) were included in the analyses. We use paired sample Wilcoxon tests to examine whether statistically significant changes in GAD-7 and PHQ-8 scores were observed over time (from baseline to last visit) among all patients. Effect sizes for paired 2-tailed t tests were also calculated using the SD of the differences. These analyses were repeated with subsamples including patients with at least moderate baseline symptoms (ie, baseline GAD-7 score≥10 and baseline PHQ-8 score≥10).
We examined whether changes in anxiety and depressive symptom scores varied by sex, age group (18-24 years, 25-64 years, and 65+ years), baseline symptoms-severity category, insurance type (ie, commercial insurance, Medicare, and self-pay), and geographical classification (ie, urban vs rural) using Wilcoxon, Kruskal-Wallis, or chi-square tests. Binary outcomes indicating patients that showed clinically significant symptom improvement were 1 for patients with 50% or greater symptoms improvement and 0 for patients not at goal. For these outcomes, we chose to include only those patients with at least moderate baseline symptoms (ie, baseline GAD-7 score≥10 and PHQ-8 score≥10).
We determined the fraction of patients with >50% symptom improvement, including those that exhibited remission (final score<5). Using the chi-square test, we asked whether the fraction of patients with symptom improvement varied as a function of the category of baseline symptom severity. In these analyses, we included patients with at least moderate baseline symptoms because GAD-7 and PHQ-8 scores ≥10 represent a high probability of clinically significant symptoms [31]. Statistical analyses were performed using R (R Foundation for Statistical Computing) and Prism (version 10.0.02; GraphPad).
Results
Overview
The demographic and baseline characteristics of the patients are presented in Table 1. During this study’s timeframe, which was between February 2023 and September 2023, a total of 6465 patients enrolled in outpatient care and had available baseline measures. Of those, 1826 participants, representing 28.2% of the initial sample, completed a second measure and were included in the analysis. A total of 1826 participants had data available for analyses and had a mean age of 39.4 (SD 13.5; range 18-89) years. Of those who reported sex (n=1479, 81%; n=347, 19% did not report sex), 1084 (73.3%) were female. The mean number of days between baseline and last visit was 103 (SD 34) days. Of those 1826 patients, 1602 (87.7%) reported at least mild anxiety symptoms (GAD-7 score≥5), while 1572 (86.1%) reported at least mild depressive symptoms (PHQ-8 score≥5) at baseline. Further, 58.8% (1074/1826) of the sample reported at least moderate anxiety symptoms and 60.1% (1097/1826) of the sample reported at least moderate depressive symptoms. Of the original sample, 4639 (71.8%) out of 6465 patients did not complete the second measure. Compared to patients who were noncompleters, those who completed repeated measures were older, more likely to be insured with Medicare, and more likely to be classified as rural. Importantly, they did not differ on baseline severity for either depressive or anxiety symptoms (Table 1).
Table 1.
Baseline variables | Patients with repeat measures (n=1826), n (%) | Patients with 1 measure (n=4639, n (%) | P valuea | |||||
Sex | .06 | |||||||
|
Female | 1084 (59.36) | 2620 (56.48) |
|
||||
|
Male | 395 (21.63) | 1086 (23.41) |
|
||||
|
Undisclosed | 347 (19) | 933 (20.11) |
|
||||
Age (y), mean (SD) | 39.38 (13.53) | 33.32 (10.05) | <.001 | |||||
Insurance type | <.001 | |||||||
|
Commercial insurance | 1618 (88.61) | 4409 (95.04) |
|
||||
|
Medicare | 138 (7.56) | 84 (1.81) |
|
||||
|
Self-pay | 70 (3.83) | 146 (3.15) |
|
||||
Baseline GAD-7b | .90 | |||||||
|
Minimal anxiety | 224 (12.27) | 544 (11.73) |
|
||||
|
Mild anxiety | 528 (28.92) | 1332 (28.71) |
|
||||
|
Moderate anxiety | 541 (29.63) | 1376 (29.66) |
|
||||
|
Severe anxiety | 533 (29.19) | 1387 (29.9) |
|
||||
Baseline PHQ-8c | .49 | |||||||
|
Minimal depression | 254 (13.91) | 567 (12.22) |
|
||||
|
Mild depression | 475 (26.01) | 1260 (27.16) |
|
||||
|
Moderate depression | 530 (29.03) | 1383 (29.81) |
|
||||
|
Moderately severe depression | 394 (31.58) | 1032 (22.25) |
|
||||
|
Severe depression | 173 (9.47) | 397 (8.56) |
|
||||
Geographic classification | .01 | |||||||
|
Urban | 1710 (93.65) | 4420 (95.28) |
|
||||
|
Rural | 116 (6.35) | 218 (4.7) |
|
||||
|
Number of days between visits | 102.63 (34.15) | N/Ad |
|
aP values obtained from chi-square tests comparing the group that completed repeated measurements and the group that completed 1 measurement.
bGAD-7: Generalized Anxiety Disorder–7.
cPHQ-8: Patient Health Questionnaire–8.
dN/A: not available as second measurement not completed.
Changes in Anxiety and Depressive Symptoms
Overview
Results from paired sample Wilcoxon tests showed that among patients with at least mild baseline symptoms (GAD-7 or PHQ-8 scores≥5), both anxiety (GAD-7 scores) and depressive symptoms (PHQ-8 scores) decreased significantly from the first to last visit. The effect sizes for the GAD-7 and PHQ-8, as measured by Cohen d for paired samples, were d=1.05 (P<.001) and d=0.98 (P<.001), respectively. These findings indicated large effects (43.7% reductions in GAD-7, 42.7% reductions in PHQ-8). Furthermore, these findings were replicated when the analyses were conducted with the subsample of patients that exhibited at least moderate baseline symptoms (GAD-7 or PHQ-8 scores≥10). We observed larger effect sizes of d=1.30 (P<.001) for GAD-7 (45.7% reductions) and d=1.23 (P<.001) for PHQ-8 (45.1% reductions) in the subsample. These data indicated that greater reductions in anxiety and depressive symptoms occurred among patients with more severe symptoms at baseline (Table 2).
Table 2.
Measure and sample | Responses, n |
Baseline score, mean (SD) |
Last score, mean (SD) | Changes from baseline (%) |
Mean difference (95% CI) |
Effect size (Cohen d) | Baseline score, median |
Last score, median | Paired sample Wilcoxon test |
P value |
|
GAD-7 | |||||||||||
|
Baseline GAD-7 score≥5 | 1602 | 12.20 (4.55) | 6.87 (4.82) | 43.69 | –5.34 (–5.59 to –5.09) | 1.05 | 12 | 6 | V=1099198 | <.001 |
|
Baseline GAD-7 score≥10 | 1074 | 14.72 (3.27) | 8.00 (5.00) | 45.65 | –6.71 (–7.03 to –6.40) | 1.30 | 14 | 7 | V=1039814 | <.001 |
PHQ-8 | |||||||||||
|
Baseline PHQ-8 score≥5 | 1572 | 12.78 (4.90) | 7.33 (5.47) | 42.64 | –5.45 (–5.73 to –5.18) | 0.98 | 12 | 6 | V=519504 | <.001 |
|
Baseline PHQ-8 score≥10 | 1097 | 15.22 (3.74) | 8.37 (5.69) | 45.01 | –6.85 (–7.18 to –6.52) | 1.23 | 15 | 8 | V=482402 | <.001 |
aGAD-7: Generalized Anxiety Disorder–7.
bPHQ-8: Patient Health Questionnaire–8.
Sex
Kruskal-Wallis tests showed that the overall fraction of patients with 50% or greater reductions in either GAD-7 or PHQ-8 scores did not differ by sex (GAD-7: P=.33; PHQ-8: P=.10).
Baseline Symptom Severity
Using Kruskal-Wallis tests to examine whether change in GAD-7 and PHQ-8 scores differed across baseline symptom severity category, we found greater reductions among those with more severe baseline symptoms. The greatest reductions were among patients with severe baseline symptoms (GAD-7 score≥15 and PHQ-8 score≥20). The smallest reductions were among patients with mild baseline symptoms (GAD-7 or PHQ-8 scores=5-9; Table 3). Pairwise comparisons using Wilcoxon test with continuity correction revealed that significant differences in change in GAD-7 and PHQ-8 scores were observed between all comparison pairs (all P<.01). Therefore, groups with more severe baseline symptoms showed significantly greater reductions in anxiety and depressive symptoms compared to any of the groups with lower baseline severity.
Table 3.
Measure and baseline severity | Responses, n (%) | Baseline score, mean (SD) | Last score, mean (SD) | Changes from baseline (%) | Mean difference (95% CI) | Baseline score, median | Last score median | Kruskal-Wallis (df) | P value | ||||||||||||
GAD-7 (n=1602) | 336.85 (2) | <.001 | |||||||||||||||||||
|
Mild anxiety (5-9) | 528 (32.96) | 7.09 (1.39) | 4.55 (3.42) | 35.83 | –2.54 (–2.84 to –0.24) | 7 | 4 |
|
|
|||||||||||
|
Moderate anxiety (10-14) | 541 (33.77) | 11.91 (1.37) | 6.79 (4.08) | 42.99 | –5.12 (–5.47 to –4.77) | 12 | 6 |
|
|
|||||||||||
|
Severe anxiety (≥15) | 533 (33.27) | 17.57 (1.88) | 9.24 (5.51) | 47.41 | –8.33 (–0.81 to –7.86) | 17 | 8 |
|
|
|||||||||||
| |||||||||||||||||||||
PHQ-8 (n=1572) | 304.6 (3) | <.001 | |||||||||||||||||||
|
Mild depression (5-9) | 475 (30.22) | 7.15 (1.34) | 4.93 (4.01) | 31.05 | –2.22 (–2.59 to –1.86) | 7 | 4 |
|
|
|||||||||||
|
Moderate depression (10-14) | 530 (33.72) | 11.97 (1.40) | 6.68 (4.61) | 44.19 | –5.29 (–5.80 to –4.90) | 12 | 6 |
|
|
|||||||||||
|
Moderately severe depression (15-19) | 394 (25.06) | 16.91 (1.39) | 9.08 (5.94) | 46.30 | –8.83 (–8.41 to –7.24) | 17 | 8 |
|
|
|||||||||||
|
Severe depression (≥20) | 173 (11.01) | 21.36 (1.31) | 11.95 (6.13) | 44.05 | –9.41 (–10.31 to –8.51) | 21 | 12 |
|
|
aGAD-7: Generalized Anxiety Disorder–7.
bPHQ-8: Patient Health Questionnaire–8.
Insurance Type
Insurance types (ie, commercial insurance, Medicare, and self-pay) also predicted change scores of both anxiety symptoms (GAD-7) and depressive symptoms (PHQ-8). Greatest reductions were observed among those with commercial insurance (a 45% reduction for GAD-7 scores and a 43.9% reduction in PHQ-8 scores), followed by those with self-pay (a 40.8% reduction for GAD-7 scores and a 40.1% reduction in PHQ-8 scores) and Medicare (a 29.2% reduction for GAD-7 scores and a 27.6% reduction in PHQ-8 scores). Pairwise comparison tests revealed that significant differences in change scores were found between Medicare and commercial insurance (P<.001) and Medicare and self-pay (P<.01), but not commercial insurance and self-pay (P=.74; Table 4).
Table 4.
Measure and insurance type | Responses, n (%) | Baseline score, mean (SD) | Last score, mean (SD) | Changes from baseline (%) |
Mean difference (95% CI) | Baseline score, median |
Last score, median | Kruskal-Wallis (df) |
P value |
||||||||||
GAD-7b (n=1602) | 14.04 (2) | <.001 | |||||||||||||||||
|
Commercial insurance | 1424 (88.9) | 12.21 (4.54) | 6.72 (4.72) | 44.96 | –5.50 (–5.76 to –5.23) | 12 | 6 |
|
|
|||||||||
|
Medicare | 115 (7.2) | 11.61 (4.36) | 8.22 (5.41) | 29.20 | –3.39 (–4.31 to –2.47) | 11 | 7 |
|
|
|||||||||
|
Self-pay | 63 (3.9) | 13.11 (5.02) | 7.76 (5.44) | 40.81 | –5.35 (–6.54 to –4.16) | 14 | 6 |
|
|
|||||||||
PHQ-8c (n=1572) | 20.46 (2) | <.001 | |||||||||||||||||
|
Commercial insurance | 1405 (89.3) | 12.76 (4.92) | 7.16 (5.40) | 43.89 | –5.60 (–5.89 to –5.31) | 12 | 6 |
|
|
|||||||||
|
Medicare | 107 (6.8) | 12.62 (4.930) | 9.14 (5.70) | 27.58 | –3.48 (–4.55 to –2.40) | 12 | 8 |
|
|
|||||||||
|
Self-pay | 60 (3.8) | 13.60 (4.43) | 8.15 (6.13) | 40.07 | –5.45 (–6.77 to –4.13) | 13 | 6.5 |
|
|
aPatients with at least mild baseline symptoms (baseline GAD-7 or PHQ-8 scores≥5) are included in the analyses.
bGAD-7: Generalized Anxiety Disorder–7.
cPHQ-8: Patient Health Questionnaire–8.
Age Group
In the unadjusted model, age groups predicted differences in the fraction of patients with 50% or greater reductions in both GAD-7 (χ22=11.44, n=1826, P=.003) and PHQ-8 scores (χ22=9.57, n=1826, P=.008).
Geographic Classification (Urban vs Rural)
No differences in change in either GAD-7 or PHQ-8 scores were found across geographic classification (ie, urban vs rural), indicating that similar reductions in symptoms were observed across patients’ geographic location (Table 5).
Table 5.
Measure and geographic classification | Responses, n (%) | Baseline score, mean (SD) | Last score, mean (SD) | Changes from baseline (%) | Mean difference (95% CI) | Baseline score, median |
Last score, median |
Wilcoxon rank sum test (df) |
P value |
|||
GAD-7b (n=1602) | W=80435 (1) | .48 | ||||||||||
|
Urban | 1499 (93.58) | 12.19 (4.57) | 7.45 (4.88) | 38.88 | –5.36 (–5.62 to –5.11) | 12 | 6 |
|
|
||
|
Rural | 103 (6.43) | 12.41 (4.26) | 6.83 (4.81) | 44.96 | –4.96 (–5.92 to –4.00) | 12 | 6 |
|
|
||
PHQ-8c (n=1572) | W=70020 (1) | .07 | ||||||||||
|
Urban | 1465 (93.19) | 12.74 (4.90) | 7.35 (5.47) | 42.31 | –5.29 (–5.67 to –5.10) | 12 | 6 |
|
|
||
|
Rural | 107 (6.80) | 13.47 (4.95) | 7.12 (5.62) | 47.14 | –6.35 (–7.39 to –5.30) | 13 | 5 |
|
|
aPatients with at least mild baseline symptoms (baseline GAD-7 or PHQ-8 scores≥5) are included in the analyses.
bGAD-7: Generalized Anxiety Disorder–7.
cPHQ-8: Patient Health Questionnaire–8.
Clinically Significant Symptom Improvement (50% or Greater Reductions in GAD-7 and PHQ-8 Scores)
Overview
Of the 1074 patients who reported at least moderate anxiety symptoms at baseline (GAD-7 score≥10), 574 (53.45%) showed clinically significant improvement of anxiety symptoms (50% or greater reductions in GAD-7 scores). This included 31% (n=86) of the patients in the moderate category and 21% (n=62) of patients in the severe category that achieved remission. Among the 1097 patients who reported at least moderate depressive symptoms at baseline (PHQ-8 scores≥10), 562 (51.23%) patients showed clinically significant symptoms improvement for depressive symptoms (50% or greater reductions in PHQ-8 scores). This included 37% (n=101), 27% (n=56), and 13% (n=10) of patients in the moderate, moderately severe, and severe categories who achieved remission. Of the 1074 patients who reported at least moderate anxiety symptoms at baseline, 724 (67.41%) showed only minimal or mild symptoms at last visit. Of the 1097 patients who reported moderate or greater depressive symptoms at baseline, 685 (62.44%) reported only mild or minimal symptoms at last visit (Table 6).
Table 6.
Measure | Responses, n | Patients with 50% or greater symptom improvement, n (%) | Patients with final score of minimal or mild symptomsb, n (%) |
GAD-7c | 1074 | 574 (53.45) | 724 (67.41) |
PHQ-8d | 1097 | 562 (51.23) | 685 (62.44) |
aPatients with at least moderate baseline symptoms (baseline GAD-7 or PHQ-8 scores≥10) are included in the analyses.
bMinimal or mild symptoms: PHQ-8 or GAD-7<10.
cGAD-7: Generalized Anxiety Disorder–7.
dPHQ-8: Patient Health Questionnaire–8.
Baseline Symptom Severity
Among those with at least moderate baseline symptoms, the rates of patients with 50% or greater reductions in either anxiety symptoms (GAD-7) or depressive symptoms (PHQ-8) did not differ across baseline symptom severity category (P=.17 and P=.34 respectively). This indicates that fractions of patients who showed clinically significant symptom improvement were similar across patients with moderate and severe baseline symptoms (Table 7).
Table 7.
Measure and baseline severity | Responses (GAD-7: n=1074; PHQ-8: n=1097), n (%) | Patients with 50% or greater symptom improvement, n (%)c | χ2 (df) | P value | ||
GAD-7 | 1.8 (1, n=1074) | .17 | ||||
Moderate anxiety (10-14) | 541 (50.37) | 278 (51.38) |
|
|
||
|
Severe anxiety (≥15) | 533 (49.63) | 296 (55.53) |
|
|
|
PHQ-8 | 2.1 (2, n=1097) | .34 | ||||
|
Moderate depression (10-14) | 530 (48.31) | 274 (51.70) |
|
|
|
|
Moderately severe depression (15-19) | 394 (35.92) | 208 (52.79) |
|
|
|
|
Severe depression (≥20) | 173 (15.77) | 80 (46.24) |
|
|
aGAD-7: Generalized Anxiety Disorder–7.
bPHQ-8: Patient Health Questionnaire–8.
cThe denominators are the values in the “Responses” column.
Discussion
Principal Findings
In this retrospective study, we found that telepsychiatry treatment outcomes for depression and anxiety were statistically and clinically significant. Telepsychiatry treatment led to average reductions of 45.7% for anxiety symptoms and 45.1% for depressive symptoms. Patients with baseline anxiety or depression with severity in the moderate to severe ranges exhibited improved outcomes at the last visit—67.41% (724/1074) of patients with anxiety and 62.44% (685/1097) of patients with depression reported minimal or mild symptoms in response to an average of 103 days of treatment. Further, mean difference between initial and final scores were from 42% to 45%, which points to robust clinical responses. Interestingly, the extent of improvement was not a function of baseline severity indicating that the efficacy of treatment was comparable among patients that exhibited either moderate or severe symptoms at the start of treatment.
Our findings are consistent with prior research on efficacy of therapeutic alliance in treatment and provide evidence in support of the notion that therapeutic alliance can be achieved in a telepsychiatry setting. Unique aspects of this psychiatric model include longer visits to allow for the development of effective therapeutic alliance, as well as allowing patients to use their health insurance, which increases access to treatment and reduces the total cost of care. Improving access by reducing cost, reducing delays in seeking treatment, and having confidence in the working relationship with the psychiatrist are important components that improve clinical outcomes in a telepsychiatry platform.
We also found that among individuals using telepsychiatry, rural patients benefitted to the same extent as did urban patients. This finding is promising because it is known that rural patients frequently struggle with access to care due to difficulties with either internet connectivity or geographical constraints [34]. While this study does not address the issue of internet connectivity, our findings argue that in the presence of acceptable internet quality, rural patients were able to access telepsychiatry treatments and showed improvements that were comparable to those seen in their urban counterparts.
Another demographic feature we examined was insurance type. While patients with Medicare insurance in the telepsychiatry practice did exhibit symptom improvements over the course of treatment, the extent of improvement was lower than that observed in patients with commercial insurance or self-pay. This finding is consistent with prior reports that Medicare beneficiaries typically take a longer time to respond to treatment and have more overall disease burden, which impacts improvement [35,36].
Limitations
This study has some limitations. Using data from a private practice and using telepsychiatry as the exclusive mode of treatment, we did not have access to a control group that received in-person treatment. This precludes a direct comparison to in-person studies. That being said, we have found that our depression and anxiety outcomes are similar to other such studies [18,37]. A second limitation in this study is that our sample had a comparatively small number of Medicare beneficiaries and a small number of patients older than 65 years. Due to this limitation, we were unable to determine which of these variables (age, Medicare status, or both) impacted the mean improvement scores. Further, there were more rural residents who completed both measures, and while rural residents did not differ in treatment outcomes from urban residents, they may have differed from rural residents who only completed 1 measure. Another limitation is that other psychiatric conditions that were excluded, such as primary substance use disorder, primary psychotic disorder, and primary eating disorder, may limit generalizability of the results. As there is considerable comorbidity with other psychiatric illnesses, these treatment outcomes may not be fully representative of all patients who have depression and anxiety. Lastly, although our data are consistent with the establishment of an effective therapeutic alliance, this retrospective analysis lacks quantitative measures of therapeutic alliance. Incorporating measures of therapeutic alliance into routine clinical practice could allow direct evaluation of this relationship in the future.
Comparison With Prior Work
This study adds to the emerging body of literature that is showing that telepsychiatry can be an effective treatment modality for many mental health conditions [37,38].
Conclusions
In this large real-world retrospective data analysis of patients using a telepsychiatry platform, we found robust and clinically significant improvement in their depression and anxiety symptoms during the course of treatment. For patients with moderate to severe symptoms of either anxiety or depression, the improvements are similar and confirm that patients with severe illness can be effectively treated in a telepsychiatry practice. This adds to the growing body of medical literature that telepsychiatry can be effective.
Acknowledgments
We would like to thank the psychiatrists at Talkiatry who are transforming psychiatry with accessible, human, and responsible care. We also thank Haruka Minami for assistance with statistical analyses and Jared Camins for extensive data support and paper review. This study was sponsored by Talkiatry.
Abbreviations
- GAD-7
Generalized Anxiety Disorder–7
- HIPAA
Health Insurance Portability and Accountability Act
- PHQ-8
Patient Health Questionnaire–8
Data Availability
The data are available from the corresponding author upon reasonable request. Only deidentified data will be made available.
Footnotes
Authors' Contributions: CP, NO, LK, and KV analyzed the data. CP and GG conceived this study. CP and KV wrote this paper.
Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form. Talkiatry supported the research and CP, NO, and LK were employees of the company during the completion of this study. GG is cofounder and CMO of Talkiatry and has ownership interests in Talkiatry. KV has no conflicts.
References
- 1.GBD 2019 Mental Disorders Collaborators Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet Psychiatry. 2022;9(2):137–150. doi: 10.1016/S2215-0366(21)00395-3. https://linkinghub.elsevier.com/retrieve/pii/S2215-0366(21)00395-3 .S2215-0366(21)00395-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Rojanasarot S, Bhattacharyya SK, Edwards N. Productivity loss and productivity loss costs to United States employers due to priority conditions: a systematic review. J Med Econ. 2023;26(1):262–270. doi: 10.1080/13696998.2023.2172282. https://www.tandfonline.com/doi/full/10.1080/13696998.2023.2172282 . [DOI] [PubMed] [Google Scholar]
- 3.Vyas A, Desai R, Patel V, Bansal P, Jain A, Gupta T, Priyadarshni S, Shalaby M, Khalife W. Rising burden of cardiovascular disease risk factors and acute cardiac events in young adults with comorbid depression: a comparison nationwide US cohorts hospitalized 10-years apart. Curr Probl Cardiol. 2023;48(8):101755. doi: 10.1016/j.cpcardiol.2023.101755.S0146-2806(23)00172-X [DOI] [PubMed] [Google Scholar]
- 4.Hare DL, Toukhsati SR, Johansson P, Jaarsma T. Depression and cardiovascular disease: a clinical review. Eur Heart J. 2014;35(21):1365–1372. doi: 10.1093/eurheartj/eht462. http://liu.diva-portal.org/smash/get/diva2:737331/FULLTEXT01.pdf .eht462 [DOI] [PubMed] [Google Scholar]
- 5.Manolis TA, Manolis AA, Melita H, Manolis AS. Neuropsychiatric disorders in patients with heart failure: not to be ignored. Heart Fail Rev. 2023;28(4):821–858. doi: 10.1007/s10741-022-10290-2.10.1007/s10741-022-10290-2 [DOI] [PubMed] [Google Scholar]
- 6.Maeng D, Cornell AE, Nasra GS. Utilization of an employee behavioral health program and its effects on outcomes for depression and anxiety disorders. J Occup Environ Med. 2019;61(10):812–817. doi: 10.1097/JOM.0000000000001678. [DOI] [PubMed] [Google Scholar]
- 7.Alonso J, Liu Z, Evans-Lacko S, Sadikova E, Sampson N, Chatterji S, Abdulmalik J, Aguilar-Gaxiola S, Al-Hamzawi A, Andrade LH, Bruffaerts R, Cardoso G, Cia A, Florescu S, de Girolamo G, Gureje O, Haro JM, He Y, de Jonge P, Karam EG, Kawakami N, Kovess-Masfety V, Lee S, Levinson D, Medina-Mora ME, Navarro-Mateu F, Pennell BE, Piazza M, Posada-Villa J, Ten Have M, Zarkov Z, Kessler RC, Thornicroft G. Treatment gap for anxiety disorders is global: results of the World Mental Health surveys in 21 countries. Depress Anxiety. 2018;35(3):195–208. doi: 10.1002/da.22711. http://hdl.handle.net/2027.42/142890 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Cipriani A, Furukawa TA, Salanti G, Chaimani A, Atkinson LZ, Ogawa Y, Leucht S, Ruhe HG, Turner EH, Higgins JPT, Egger M, Takeshima N, Hayasaka Y, Imai H, Shinohara K, Tajika A, Ioannidis JPA, Geddes JR. Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis. Focus (Am Psychiatr Publ) 2018;16(4):420–429. doi: 10.1176/appi.focus.16407. https://europepmc.org/abstract/MED/32021580 .FOC_16407 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Eaton EF, Burgan K, McCollum G, Levy S, Willig J, Mugavero MJ, Reddy S, Wallace E, Creger T, Baral S, Fogger S, Cropsey K. Expanding access to substance use services and mental health care for people with HIV in Alabama, a technology readiness assessment using a mixed methods approach. BMC Health Serv Res. 2022;22(1):919. doi: 10.1186/s12913-022-08280-z. https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-022-08280-z .10.1186/s12913-022-08280-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Van Alsten SC, Harris JK. Cost-related nonadherence and mortality in patients with chronic disease: a multiyear investigation, National Health Interview Survey, 2000-2014. Prev Chronic Dis. 2020;17:E151. doi: 10.5888/pcd17.200244. https://europepmc.org/abstract/MED/33274701 .E151 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Andrilla CHA, Patterson DG, Garberson LA, Coulthard C, Larson EH. Geographic variation in the supply of selected behavioral health providers. Am J Prev Med. 2018;54(6 Suppl 3):S199–S207. doi: 10.1016/j.amepre.2018.01.004. https://linkinghub.elsevier.com/retrieve/pii/S0749-3797(18)30005-9 .S0749-3797(18)30005-9 [DOI] [PubMed] [Google Scholar]
- 12.Lopes L, Kirzinger A, Sparks G, Stokes M, Brodie M. Kaiser Family Foundation. San Francisco: 2022. [2023-09-25]. KFF survey of consumer experiences with health insurance. https://www.kff.org/report-section/kff-cnn-mental-health-in-america-survey-findings . [Google Scholar]
- 13.Bishop TF, Press MJ, Keyhani S, Pincus HA. Acceptance of insurance by psychiatrists and the implications for access to mental health care. JAMA Psychiatry. 2014;71(2):176–181. doi: 10.1001/jamapsychiatry.2013.2862. https://europepmc.org/abstract/MED/24337499 .1785174 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Tamblyn R, Laprise R, Hanley JA, Abrahamowicz M, Scott S, Mayo N, Hurley J, Grad R, Latimer E, Perreault R, McLeod P, Huang A, Larochelle P, Mallet L. Adverse events associated with prescription drug cost-sharing among poor and elderly persons. JAMA. 2001;285(4):421–429. doi: 10.1001/jama.285.4.421. https://jamanetwork.com/journals/jama/fullarticle/1108322 .joc00341 [DOI] [PubMed] [Google Scholar]
- 15.Habib S, Sangaraju SL, Yepez D, Grandes XA, Manjunatha RT. The nexus between diabetes and depression: a narrative review. Cureus. 2022;14(6):e25611. doi: 10.7759/cureus.25611. https://europepmc.org/abstract/MED/35784974 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Forand NR, Feinberg JE, Barnett JG, Strunk DR. Guided internet CBT versus "gold standard" depression treatments: an individual patient analysis. J Clin Psychol. 2019;75(4):581–593. doi: 10.1002/jclp.22733. [DOI] [PubMed] [Google Scholar]
- 17.Gonçalves DC, Byrne GJ. Interventions for generalized anxiety disorder in older adults: systematic review and meta-analysis. J Anxiety Disord. 2012;26(1):1–11. doi: 10.1016/j.janxdis.2011.08.010.S0887-6185(11)00145-9 [DOI] [PubMed] [Google Scholar]
- 18.Giovanetti AK, Punt SEW, Nelson EL, Ilardi SS. Teletherapy versus in-person psychotherapy for depression: a meta-analysis of randomized controlled trials. Telemed J E Health. 2022;28(8):1077–1089. doi: 10.1089/tmj.2021.0294. [DOI] [PubMed] [Google Scholar]
- 19.Shaker AA, Austin SF, Sørensen JA, Storebø OJ, Simonsen E. Psychiatric treatment conducted via telemedicine versus in-person consultations in mood, anxiety and personality disorders: a protocol for a systematic review and meta-analysis. BMJ Open. 2022;12(9):e060690. doi: 10.1136/bmjopen-2021-060690. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=36171023 .bmjopen-2021-060690 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Krzyzaniak N, Greenwood H, Scott AM, Peiris R, Cardona M, Clark J, Glasziou P. The effectiveness of telehealth versus face-to face interventions for anxiety disorders: a systematic review and meta-analysis. J Telemed Telecare. 2021 doi: 10.1177/1357633X211053738. [DOI] [PubMed] [Google Scholar]
- 21.Roy-Byrne P, Craske MG, Sullivan G, Rose RD, Edlund MJ, Lang AJ, Bystritsky A, Welch SS, Chavira DA, Golinelli D, Campbell-Sills L, Sherbourne CD, Stein MB. Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. JAMA. 2010;303(19):1921–1928. doi: 10.1001/jama.2010.608. https://europepmc.org/abstract/MED/20483968 .303/19/1921 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Constand MK, MacDermid JC, Dal Bello-Haas V, Law M. Scoping review of patient-centered care approaches in healthcare. BMC Health Serv Res. 2014;14:271. doi: 10.1186/1472-6963-14-271. https://bmchealthservres.biomedcentral.com/articles/10.1186/1472-6963-14-271 .1472-6963-14-271 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Flückiger C, Del Re AC, Wampold BE, Horvath AO. The alliance in adult psychotherapy: a meta-analytic synthesis. Psychotherapy (Chic) 2018;55(4):316–340. doi: 10.5167/uzh-157613. doi: 10.5167/uzh-157613.2018-23951-001 [DOI] [PubMed] [Google Scholar]
- 24.Johansson H, Jansson JA. Therapeutic alliance and outcome in routine psychiatric out-patient treatment: patient factors and outcome. Psychol Psychother. 2010;83(Pt 2):193–206. doi: 10.1348/147608309X472081.pptrp456 [DOI] [PubMed] [Google Scholar]
- 25.Horvath AO, Luborsky L. The role of the therapeutic alliance in psychotherapy. J Consult Clin Psychol. 1993;61(4):561–573. doi: 10.1037//0022-006x.61.4.561. [DOI] [PubMed] [Google Scholar]
- 26.Murphy ST, Garcia RA, Cheavens JS, Strunk DR. The therapeutic alliance and dropout in cognitive behavioral therapy of depression. Psychother Res. 2022;32(8):995–1002. doi: 10.1080/10503307.2021.2025277. [DOI] [PubMed] [Google Scholar]
- 27.Baier AL, Kline AC, Feeny NC. Therapeutic alliance as a mediator of change: a systematic review and evaluation of research. Clin Psychol Rev. 2020;82:101921. doi: 10.1016/j.cpr.2020.101921.S0272-7358(20)30109-4 [DOI] [PubMed] [Google Scholar]
- 28.McHugh RK, Whitton SW, Peckham AD, Welge JA, Otto MW. Patient preference for psychological vs pharmacologic treatment of psychiatric disorders: a meta-analytic review. J Clin Psychiatry. 2013;74(6):595–602. doi: 10.4088/JCP.12r07757. https://europepmc.org/abstract/MED/23842011 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Olfson M, Marcus SC, Pincus HA. Trends in office-based psychiatric practice. Am J Psychiatry. 1999;156(3):451–457. doi: 10.1176/ajp.156.3.451. https://ajp.psychiatryonline.org/doi/10.1176/ajp.156.3.451 . [DOI] [PubMed] [Google Scholar]
- 30.Castillo EG, Pincus HA, Wieland M, Roter D, Larson S, Houck P, Reynolds CF, Cruz M. Communication profiles of psychiatric residents and attending physicians in medication-management appointments: a quantitative pilot study. Acad Psychiatry. 2012;36(2):96–103. doi: 10.1176/appi.ap.10120030. https://europepmc.org/abstract/MED/22532197 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Kroenke K, Strine TW, Spitzer RL, Williams JBW, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord. 2009;114(1-3):163–173. doi: 10.1016/j.jad.2008.06.026.S0165-0327(08)00282-6 [DOI] [PubMed] [Google Scholar]
- 32.Wu Y, Levis B, Riehm KE, Saadat N, Levis AW, Azar M, Rice DB, Boruff J, Cuijpers P, Gilbody S, Ioannidis JPA, Kloda LA, McMillan D, Patten SB, Shrier I, Ziegelstein RC, Akena DH, Arroll B, Ayalon L, Baradaran HR, Baron M, Bombardier CH, Butterworth P, Carter G, Chagas MH, Chan JCN, Cholera R, Conwell Y, de Man-van Ginkel JM, Fann JR, Fischer FH, Fung D, Gelaye B, Goodyear-Smith F, Greeno CG, Hall BJ, Harrison PA, Härter M, Hegerl U, Hides L, Hobfoll SE, Hudson M, Hyphantis T, Inagaki M, Jetté N, Khamseh ME, Kiely KM, Kwan Y, Lamers F, Liu SI, Lotrakul M, Loureiro SR, Löwe B, McGuire A, Mohd-Sidik S, Munhoz TN, Muramatsu K, Osório FL, Patel V, Pence BW, Persoons P, Picardi A, Reuter K, Rooney AG, Santos IS, Shaaban J, Sidebottom A, Simning A, Stafford L, Sung S, Tan PLL, Turner A, van Weert HC, White J, Whooley MA, Winkley K, Yamada M, Benedetti A, Thombs BD. Equivalency of the diagnostic accuracy of the PHQ-8 and PHQ-9: a systematic review and individual participant data meta-analysis. Psychol Med. 2020;50(8):1368–1380. doi: 10.1017/S0033291719001314. https://europepmc.org/abstract/MED/31298180 .S0033291719001314 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–1097. doi: 10.1001/archinte.166.10.1092. https://jamanetwork.com/journals/jamainternalmedicine/fullarticle/410326 .166/10/1092 [DOI] [PubMed] [Google Scholar]
- 34.Hirko KA, Kerver JM, Ford S, Szafranski C, Beckett J, Kitchen C, Wendling AL. Telehealth in response to the COVID-19 pandemic: implications for rural health disparities. J Am Med Inform Assoc. 2020;27(11):1816–1818. doi: 10.1093/jamia/ocaa156. https://europepmc.org/abstract/MED/32589735 .5863253 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Mylona EK, Benitez G, Shehadeh F, Fleury E, Mylonakis SC, Kalligeros M, Mylonakis E. The association of obesity with health insurance coverage and demographic characteristics: a statewide cross-sectional study. Medicine (Baltimore) 2020;99(27):e21016. doi: 10.1097/MD.0000000000021016. https://europepmc.org/abstract/MED/32629722 .00005792-202007020-00101 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Abe T, Seino S, Nofuji Y, Yokoyama Y, Amano H, Yamashita M, Shinkai S, Kitamura A, Fujiwara Y. Modifiable healthy behaviours and incident disability in older adults: analysis of combined data from two cohort studies in Japan. Exp Gerontol. 2023;173:112094. doi: 10.1016/j.exger.2023.112094. https://linkinghub.elsevier.com/retrieve/pii/S0531-5565(23)00015-3 .S0531-5565(23)00015-3 [DOI] [PubMed] [Google Scholar]
- 37.Shih YH, Wang JY, Chou PH, Lin KH. The effects of treatment via telemedicine interventions for patients with depression on depressive symptoms and quality of life: a systematic review and meta-ranalysis. Ann Med. 2023;55(1):1092–1101. doi: 10.1080/07853890.2023.2187078. https://europepmc.org/abstract/MED/36920229 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.McCord C, Ullrich F, Merchant KAS, Bhagianadh D, Carter KD, Nelson E, Marcin JP, Law KB, Neufeld J, Giovanetti A, Ward MM. Comparison of in-person vs. telebehavioral health outcomes from rural populations across America. BMC Psychiatry. 2022;22(1):778. doi: 10.1186/s12888-022-04421-0. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-022-04421-0 .10.1186/s12888-022-04421-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data are available from the corresponding author upon reasonable request. Only deidentified data will be made available.