Table 2.

Population, virtual intervention, nonvirtual comparison, outcomes and results relevant to the scope of this review for the included nonreview articles.

Authors (year)	Population	Intervention (virtual)	Comparison (nonvirtual)	Outcomes and results
Amirsadri et al (2017) [15]	1 patient; United States; comorbid schizophrenia	Videoconferencing with a telepsychiatrist; home visits by a social worker and a nurse	None	Diagnosis: Detecting undiagnosed depression. Treatment: Development of a treatment plan. Function: Improved. Quality of life: Improved. Longitudinal history: Discovery of trauma history. Patient satisfaction: Very happy with the service. Wanted it to be available for others. Caregiver satisfaction: Very convenient. Good care.
Barrera-Valencia et al (2017) [12]	106 patients; Colombia; inmates	2 interventions: asynchronous care by the telepsychiatrist, who receives clinical information from the general practitioner’s evaluation; synchronous care by the telepsychiatrist through videoconferencing	None	Depression severity: Significant improvement in the Hamilton Depression Rating Scale scores for both telepsychiatry modalities. Higher effectiveness for the asynchronous modality. Consultation time: No difference between the two telepsychiatry modalities. Consultation costs: Higher for the synchronous modality. Cost-effectiveness: Higher for the asynchronous modality. Patient satisfaction: A dependent variable for the prediction of the cost of care.
Choi Yoo et al (2014) [11]	309 patients; United States; patients with cancer	INCPADa trial; centralized telecare management; automated home-based symptom monitoring; collaborative care by an oncologist, a nurse depression-pain care manager, and a supervising psychiatrist	Treatment as usual; screening results provided to their oncologist	DFDsb: 227.38 for the intervention group during the 12-month follow-up compared with 167.08 for the usual care group. This is an increase of 60.30 DFDs (P<.01) compared to the usual-care group. QALYsc: With 0.2 to 0.4 QALYs per additional DFD, there was a gain of between 0.033 and 0.066 QALYs. By other metrics, the intervention resulted in a gain of between 0.013 and 0.088 QALYs. Physician time costd: $43,226 total and $281 per patient. Nurse care manager costs: $61,906 total and $402 per patient. Automated monitoring system cost: $506 per patient. Sum of the physician, nurse care manager and monitoring cost: $1189 per patient. Post–start-up automated monitoring maintenance cost over the 3 years of the trial: $20,000 total and $813 per patient. Cost per DFD: Between $19.72 and $26.95. Cost per QALY: $10,826 to $73,286. Post–start-up incremental cost per DFD gained: $13.48. Post–start-up incremental cost per QALY gained: Between $7564 and $51,199.
Chong and Moreno (2012) [13]	167 patients; United States; Hispanic participants; low-income, uninsured, and underinsured	Videoconferencing with a telepsychiatrist	Treatment as usual; primary care setting	Appointment keeping: Same for both groups. Visit satisfaction: Higher for the intervention group Patient rating of the working alliance with their provider: Higher for the intervention group Use of antidepressant medication: Higher for the intervention group. Depression severity: Both groups showed a decrease in symptoms. Depression severity improvement rate: Higher for the intervention group. Number of days in which their symptoms rendered them less productive or worse, unable to carry out their normal responsibilities: Decrease for both groups. Whether the project helped or made them better: 84% of both groups indicated that it did help them or make them better. Satisfaction with provided support: 50% of both groups indicated that the project and staff provided much-appreciated support. Satisfaction with session length: 12% of the intervention group patients wanted longer sessions. Satisfaction with session quantity: 12% of the comparison group wanted more sessions. Satisfaction with the webcam sessions: 22% of the intervention group patients mentioned that they liked the webcam sessions. Need for time to adapt: 14% of the intervention group patients reported that they needed some time to adapt. Willingness to pay for mental health services: High for both groups. Depression care satisfaction rating: High for both groups. Satisfaction with the randomized assignment they received: High for both groups.
Christensen et al (2020) [22]	199 patients; 11 European countries; mild to moderate depression.	MasterMind program; videoconferencing facilitating collaborative care interventions; telepsychiatrists, general practitioners, and other health care professionals	None	Patient satisfaction: High. Scores varied significantly between regions, but there was no correlation with age and gender.
Emery-Tiburcio et al (2017) [16]	131 patients; United States; aged ≥60 years	BRIGHTENe program; telepsychiatrists and other health care professionals	None	Depression severity: Significant improvements in Geriatric Depression Scale rating and 12-Item Short Form Survey Mental Health Composite at 6-month follow-up. Equal benefit from the program for individuals with different ethnic, educational, and income characteristics. 12-Item Short Form Survey Physical Health Composite: No differences observed at 6-month follow-up.
Hilty et al (2007) [10]	121 patients; United States; rural	Intensive disease management module; videoconferencing with a telepsychiatrist; training for the primary care physician	Usual care; disease management module	Depression severity: Significant reduction at 3, 6, and 12 months for both groups, with no significant difference between the groups. According to a post-hoc analysis, the score for one depression subscale score was nearly significantly higher in the intervention group when those in the comparison group with an initial telepsychiatric consultation were removed from the analysis. There was a relationship between depression and health functioning scores. No relationship was found between depression scores and satisfaction. Health functioning: No significant change or significant difference between groups. There was a relationship between depression and health functioning scores. No relationship was found between satisfaction and health functioning. Patient satisfaction: Significantly higher in the intervention group at 6 and 12 months. No relationship between depression scores and satisfaction; no relationship between satisfaction and health functioning. Study retention: Significantly higher in the intervention group; higher in older patients. Comorbid somatization, phobia, and anxiety: Significantly higher improvement in the intervention group
Hungerbuehler et al (2016) [14]	107 patients; Brazil; 3 hours of mean traveling time to psychiatric hospital	Videoconferencing with a telepsychiatrist; significantly higher baseline depression severity	Treatment as usual; in-person consultations with a psychiatrist	Depression severity: Significant decrease in severity for both groups. No significant difference in severity between groups at 6 and 12 months. Significant interaction between treatment and time regarding severity. Medication: Most of the participants continued taking antidepressants at 6 and 12 months within the recommended dosages, often combined with sedatives. No significant difference between groups for the type and dosage of medication at 6 and 12 months. Low adherence in both groups. No significant difference in adherence between groups. Treatment adherence validated by the number of missed appointments and dropouts: Significantly more dropouts in the nonvirtual group at 6 months, but no significant difference at 12 months. More missed appointments in the nonvirtual group. Patient satisfaction: No significant difference between groups at 6 and 12 months. A significant increase was observed during the first 6 months and then remained stable until the end of the study. No significant changes over the entire study period. No significant interaction between group assignment and time. Working alliance: Significant increase over 12 months for both groups. No significant difference between groups
Moreno et al (2012) [20]	167 patients; United States; Hispanic	Videoconferencing with a telepsychiatrist	Treatment as usual; community health center	Depression symptoms: Significant reduction in both groups. Significantly higher reduction in the virtual group. Significant effect of time. Depression response (50% or greater decrease in severity ratings): More than half of the study population. No significant difference between groups, but tendency for higher rate in the virtual group. Depression remission (75% or greater decrease in severity ratings): Less than half of the study population. No significant difference between groups, but tendency for a higher rate in the virtual group. Quality of life: Significant increase for both groups. Significantly higher increase in the virtual group. Significant effect of time. Health-related functional ability: Significant increase for both groups. Significantly higher increase in the virtual group. Significant effect of time.
Norden et al (2020) [21]	114 visits; United States; Stanford’s Accountable Care Organization’s patient population (younger, healthier, more tech-savvy)	Stanford ClickWell Care, a novel virtual primary care clinic; videoconferencing or telephone visits with a primary care provider	In-person visits at the Stanford ClickWell Care clinic with a primary care provider	Number of visits: Significantly higher in the virtual setting than in-person. Number of labs ordered: No significant difference between groups. Number of images ordered: No significant difference between groups.
Ruskin et al (1998) [17]	30 patients; United States; psychiatric inpatients	1 in-person consultation with a psychiatrist; 1 videoconferencing consultation with a telepsychiatrist	2 in-person consultations with a psychiatrist	Interrater reliability for results from the Structured Clinical Interview for DSM-III-Rf: High for both groups. No significant difference between groups. Patient satisfaction: High for both groups. No significant difference between groups. For the intervention group, “Overall, which did you prefer?”: Most preferred the in-person consultation. For the intervention group, “Would you rather have a video examination with a psychiatrist or an in-person examination by a general practitioner who might know a little less about psychiatry?”: Most preferred the virtual consultation. For the intervention group, “If you lived two hours away from the hospital, would you rather travel to the hospital to see the psychiatrist in person or go to a place close to your home and see the psychiatrist by video?”: Most preferred the virtual consultation.
Ruskin et al (2004) [19]	119 patients; United States; veterans	Videoconferencing with a telepsychiatrist	In-person consultations with a psychiatrist	Depression severity: Significant reduction in both groups. No significant difference between groups. Depression response (50% improvement from the first to the last visit): Similar rate in both groups. Depression remission (17-item Hamilton Depression Rating Scale score ≤7): Similar rate in both groups. Treatment adherence in terms of dropout rates, time course of dropouts, number of session appointments kept, and pill counts: No significant difference between groups. Patient satisfaction: High for both groups. No significant difference between groups. Psychiatrist satisfaction: High for both modalities of care. Significantly higher for nonvirtual care. Resource consumption or “cost effects” through per-session cost with or without factoring psychiatrist travel time and total Veterans Affairs health care resource consumption: $86.16 for a telepsychiatry session and $63.25 for an in-person session. Equal cost if the psychiatrist had to travel 22 miles to the clinic. Modality of care was not associated with significantly different consumption of health care.
Yeung et al (2016) [18]	190 patients; United States; monolingual Chinese American immigrants	T-CSCTg; T-CSCT involving culturally sensitive psychiatric assessment, and collaborative care; videoconferencing with a bilingual telepsychiatrist; primary care provider, bilingual telepsychiatrist, and bilingual care manager	Treatment as usual; in-person consultations with a primary care provider; a single videoconferencing evaluation with a telepsychiatrist; treatment recommendations from the telepsychiatrist	Depression severity: Significantly higher reduction for the intervention group. Depression response rate (Hamilton Depression Rating Scale score improvement of ≥50%): Significantly higher for the intervention group. Depression remission rate (Hamilton Depression Rating Scale score ≤7): Significantly higher for the intervention group. Quality of life: No significant difference between groups.

^aINCPAD: Indiana Cancer Pain and Depression.

^bDFD: depression-free day.

^cQALY: quality-adjusted life year.

^dAll monetary values are reported in US dollars.

^eBRIGHTEN: Bridging Resources of an Interdisciplinary Geriatric Health Team via Electronic Networking.

^fDSM-III-R: Diagnostic and Statistical Manual of Mental Disorders (Third Edition, Revised).

^gT-CSCT: Telepsychiatry-based culturally sensitive collaborative treatment.