Abstract
Background:
A key barrier to adoption of telemedicine is patient preference for in-person consultations. To address this, an immersive 3-dimensional (3D) telemedicine system was codeveloped with patients to improve the realism, quality, and patient experience of remote consultations, and the benefits were assessed in this randomized trial.
Methods:
Eighty patients were recruited from the Canniesburn Plastic Surgery Unit, UK to a randomized crossover trial of 3D versus 2-dimensional (2D) telemedicine consultations in 2022 and 2023. The primary outcome was presence using the Presence scale, which measured how closely a remote consultation resembled an in-person consultation. Secondary outcomes included the validated Telehealth Usability Questionnaire (TUQ), the Mental Effort Rating Scale, and satisfaction scales.
Results:
The Presence score for 3D telemedicine was significantly higher than that for 2D telemedicine (P < 0.001). Secondary outcomes also were superior for 3D telemedicine, including TUQ score (P < 0.001), mental effort (P < 0.001), and satisfaction (P < 0.001). Age, deprivation, education, sex, and technology familiarity were not associated with any outcome measures, indicating inclusivity of the 3D technology. Subjective interviews indicated that 3D telemedicine, by virtue of allowing annotation and drawing on the patients’ own 3D model, aided understanding of complex surgery, allowing a more personalized medicine approach in the consent process.
Conclusions:
3D telemedicine improves the realism, interaction quality, and experience of remote consultations relative to 2D telemedicine, with significantly higher presence and TUQ scores. Three-dimensional telemedicine more closely mimics reality, which may help overcome barriers to adoption related to patients’ preference for in-person consultations.
The COVID-19 pandemic led to an acceleration in innovations focusing on remote medical consultations,1 providing the impetus for our research group to codevelop the world’s first real-time 3-dimensional (3D) telemedicine system, in conjunction with patient and clinician stakeholders, using Microsoft’s Holoportation technology.2 This was developed to address one of the key barriers to adoption of telemedicine—patients’ preference for in-person consultations—with the goal of using 3D technology to improve the realism, immersion, and experience of remote consultations to more closely align with features of an in-person visit.3 Although our preliminary data suggested that there is value in the use of a real-time 3D system—with improvements in realism, quality, and satisfaction over 2-dimensional (2D) telemedicine systems—conclusive trial data are lacking.
DEVELOPING NOVEL DIGITAL HEALTH TECHNOLOGIES WITHIN A STANDARDIZED FRAMEWORK
No real-time, 360-degree 3D telemedicine systems are commercially available. Previous 3D systems have been predominantly used in research settings only, without participatory patient development, clinical validation, or real-world use.4,5 We sought to address these shortcomings in the development process using the Virtual Reality Clinical Outcomes Research Experts (VR CORE) international guidelines, which aim to improve the methodologic quality of digital health trials.6 A cornerstone of these guidelines is the inclusion of participatory development to place patients at the heart of the development process, as “lack of patient involvement, poor requirement definitions, and nonadaptation to user feedback are some of the common factors that explain failures of digital interventions.”6 Participatory development is the first of 3 phases, followed by early clinical trials and randomized clinical trials (RCTs).
3D TELEMEDICINE MAY IMPROVE THE REALISM, QUALITY, AND IMMERSION OF REMOTE CONSULTATIONS
An international collaboration among the United Kingdom, Ghana, and the United States (Microsoft Corporation) initially sought to develop and deploy a low-cost 3D telemedicine system to increase access to specialized reconstructive surgical care in lower- to middle-income countries.7 The first phase of the VR CORE guidelines, including participatory codevelopment, was completed in 2021, with multiple iterations resulting in significant improvements in patient and clinician usability, satisfaction, and quality.2 This was followed by a second phase, consisting of several studies centering on safety, clinical concordance with in-person consultations, protocol optimization, study design, and outcome instrument evaluation.2 The final phase—RCT testing—aimed to provide evidence of clinical efficacy and benefits of the 3D telemedicine system in comparison with 2D telemedicine in a cohort of reconstructive plastic surgery patients.
One of the fundamental goals of telemedicine is to improve realism and immersion, to more closely mimic an in-person consultation. This trial therefore aimed to assess whether 3D telemedicine outperforms 2D telemedicine in this regard, using psychometric properties of realism and immersion deemed “presence.” This was supported by the Telehealth Usability Questionnaire (TUQ),8 one of the most widely used validated outcome instruments in telemedicine research,9–11 which examines usefulness, ease of use, effectiveness, reliability, interaction quality, and satisfaction, providing additional insights into the clinical efficacy of 3D versus 2D telemedicine systems. The hypothesis of this trial was that 3D telemedicine provides a more realistic and immersive consultation (measured by presence) than 2D telemedicine, which translates to improved overall clinical quality (measured by TUQ).
PATIENTS AND METHODS
Ethics
This study was approved by National Health Service Greater Glasgow and Clyde Research and Innovation (approval no. INGN22SG035). The trial is registered at ClinicalTrials.gov (identification no. NCT05227235). The project was monitored by biannual governance reviews. Participants consented in writing, with patient data controlled by National Health Service Greater Glasgow and Clyde. CONSORT (Consolidated Standards of Reporting Trials) guidelines were followed for reporting of randomized trials.12
Study Design
Prestudy Protocol Optimization
Focus group and codesign with patients was conducted from 2019 through 2021, to allow protocol optimization and testing of outcome instruments before the RCT as per VR CORE guidelines.2 This consisted of 3 studies: a clinician feedback study (n = 23), a patient feedback study (n = 26), and a cohort study focusing on safety and reliability (n = 40). “Lose,” “keep,” or “change” feedback prompts were used to guide development. Codevelopment is covered in detail in our previously published participatory development study2 (Fig. 1).
Fig. 1.
Illustration of the 3 phases of the VR CORE guidelines on digital health trials. The project began in 2020 with the VR phase 1 participatory codevelopment phase. This was followed by VR phase 2, incorporating early clinical trials focusing on safety, reliability, and clinical concordance, and establishing parameters for the following RCT. VR phase 3 is the RCT comparing 3D with 2D telemedicine.
Randomized Crossover Design
A randomized 2-group crossover trial design randomized patients to either 3D or 2D telemedicine consultation first. As the included plastic surgery patients were heterogenous (with differing operations and anatomical sites), a crossover design accounted for confounding better than a between-subjects design, with patients acting as their own controls. Patients were assessed using the 2 systems by the same clinician, with standardization of the consultation and examination with each system (recorded separately). A washout period was not mandatory for tests of perception (such as presence) as opposed to tests of knowledge, as has been used in other digital research trials.13 Nonetheless, carryover effects were analyzed in this study. To further address potential concerns about carryover effects, the study design also included a prespecified sensitivity analysis that examined between-subjects analysis for the first telemedicine system used by participants. (See Figure, Supplemental Digital Content 1, which shows the study design [within-subjects randomized crossover design]. Primary analyses used a randomized crossover design, https://links.lww.com/PRS/I452. See Figure, Supplemental Digital Content 2, which shows the sensitivity analysis [between-subjects randomized design]. This removes the crossover component and analyses the first telemedicine system to which participants were randomized, https://links.lww.com/PRS/I453.) Because the interventions involved telemedicine, it was not possible to blind participants or investigators. Data analysis was performed by investigators blinded to intervention allocation.
Telemedicine Systems
The 3D system consisted of an array of 10 Azure Kinect cameras that fused depth and video output to create a 360-degree 3D model of the patient.2 This was linked to a separate “viewer” room where the patient could be viewed remotely over the existing hospital network, using an interface that is intuitive and easy to use, with the 3D patient model manipulated with a mouse in a similar manner to 3D computed tomography image manipulation (Figs. 2 and 3). (See Video [online], which shows the 3D telemedicine system in use. The clinician is “co-present” with the patient in the same virtual clinic space. The patient’s 3D model can be annotated and drawn on. This helps the clinician illustrate complex 3D reconstructive surgery and facilitates patient understanding. The patient can be viewed in 360 degrees in real time, facilitating body part assessment, and, if desired, supporting remote physiotherapy.) The 2D system used a Logitech Brio 4K webcam running Microsoft Teams. Both telemedicine systems were set up in the same clinic room to minimize variability. The clinician “viewer” room was set up in a remote clinic room in the same hospital (West Glasgow Ambulatory Care Hospital).
Fig. 2.
Schematic of the 3D telemedicine system. Ten Kinect cameras are connected to Fusion and Render PCs, which create a fused 3D spatial model that is overlaid in real time with RGB camera output. This processing is performed locally at the remote clinic, and the output can be delivered through a standard Internet connection to the clinician viewing room. In this trial, the viewing room was in a remote location separate from the patient clinic room, but within the same hospital (West Glasgow Ambulatory Care Hospital).
Fig. 3.
The 3D telemedicine viewing screen. The patient can be seen in 3 dimensions in real-time and viewed in 360 degrees. The system also allows annotation of the 3D model to illustrate surgical procedures and anatomy for the patient. The clinician is visible in the same clinical space as the patient and can point to areas of interest using their hands.
Video. This video shows the 3D telemedicine system in use. The clinician is “co-present” with the patient in the same virtual clinic space. The patient’s 3D model can be annotated and drawn on. This helps the clinician illustrate complex 3D reconstructive surgery and facilitates patient understanding. The patient can be viewed in 360 degrees in real time, facilitating body part assessment, and, if desired, supporting remote physiotherapy.
Outcome Instruments
Multiple outcome instruments were tested during the prestudy participatory development phase.2 Presence was deemed to be the primary research outcome, as it indicates how closely a remote consultation mimics an in-person consultation. Many scales measuring presence were too lengthy and confusing for patients,14,15 and not suitable for literacy levels of the general UK population.16 The validated single-item presence question “To which extent did you feel present in the virtual clinic, as if you were really there?” was clear and simple, and resonated strongly with patients.17 The main secondary outcome measure was the TUQ, a validated 21-item questionnaire measuring subdomains of usefulness, ease of use, effectiveness, reliability, and satisfaction, giving a metric of the overall quality of the telemedicine system.8 Additional secondary outcome measures included the Mental Effort Rating Scale, a 9-point Likert scale that assesses extraneous cognitive load (ease of understanding),18 and satisfaction, measured with a 0 to 100 visual analog scale.19
Outcome Measures
The primary outcome measure was the single-item Presence scale score. Secondary outcome measures included TUQ, Mental Effort Rating Scale, and satisfaction scores.
Study Hypotheses
We hypothesized that 3D telemedicine outperforms 2D telemedicine for presence, providing improved realism and immersion closer to an in-person consultation, which may translate into improvements in the overall quality and experience as evaluated by the TUQ score.
Statistical Analysis
Sample sizes were calculated using prestudy data from a pilot trial.2 For the primary outcome (Presence scale score), assuming an ⍺ of 0.05 and 80% power, a sample size of 9 participants per group was needed. For the secondary outcome (TUQ), a sample size of 40 participants per group was needed. The study was powered to allow assessment of primary and secondary outcomes for a randomized 2-group crossover and between-subjects sensitivity analysis. The total sample size was 80 patients. Ancillary analyses included effect sizes for outcome measures, descriptive analyses of TUQ subdomains, correlation of equality and diversity measures with outcome measures, and inductive thematic analysis of subjective patient interviews.
Randomization was provided by a university statistical service using 1:1 computer-generated allocation with a block size of unknown length. Allocation concealment was with a remote, password-protected website (Sealed Envelope Ltd.). Assignment was performed by a research assistant after participants completed study consent. Statistical analysis was performed by an independent statistical service using Minitab (version 18) at 5% significance. Outcome measures were tested for normality (Anderson-Darling tests) before appropriate parametric and nonparametric tests. Crossover effects were tested with the Mann-Whitney U test. There were no missing data in this study.
Patient Identification
Patients were recruited consecutively from clinics at Canniesburn Plastic Surgery Unit, Glasgow. Inclusion criteria included age 16 through 95 years, having undergone a plastic surgery procedure (free/pedicled flap, skin graft, major cancer, trauma, or burn surgery), and capacity to consent. Exclusion criteria included registered blindness or deafness, having undergone a minor procedure (primary closure or minor local flap), or perineal reconstruction (ie, a sensitive area of examination).
Code Availability
The 3D telemedicine code has been open sourced by Microsoft and is available on request.
RESULTS
Participants
Eighty patients were recruited from the Canniesburn Plastic Surgery Unit from December of 2022 through October of 2023 (Fig. 4). The mean age was 51 years; 35% of participants were female; body parts undergoing surgery included the upper limb (15%), lower limb (45%), head and neck (10%), or thoracoabdominal region (30%) (Table 1).
Fig. 4.
Recruitment flowchart.
Table 1.
Patient Demographicsa
| Demographics | Values (Total n = 80) |
|---|---|
| Sex, F/M | 28 (35)/52 (65) |
| Age, yrs | 51 (18 to 78) |
| Deprivation level by postal codeb | |
| 1 | 10 (12.5) |
| 2 | 13 (16.3) |
| 3 | 5 (6.3) |
| 4 | 7 (8.8) |
| 5 | 8 (10) |
| 6 | 3 (3.8) |
| 7 | 10 (12.5) |
| 8 | 8 (10) |
| 9 | 10 (12.5) |
| 10 | 8 (10) |
| Education level (highest level reached) | |
| None | 0 |
| Primary school | 0 |
| High school | 30 (37.5) |
| College | 24 (30) |
| University | 20 (25) |
| Postgraduate | 6 (7.5) |
| Diagnosis | |
| Cancer reconstruction | 68 (85) |
| Benign tumor | 5 (6.3) |
| Trauma | 7 (8.8) |
| Body part examined | |
| Upper limb | 12 (15) (5 arm, 4 hand, 3 shoulder) |
| Lower limb | 36 (45) (30 leg, 6 thigh) |
| Head and neck | 8 (10) (5 face, 3 neck) |
| Thoraco-abdominal | 24 (30) (13 chest, 5 back, 3 groin, 3 abdomen) |
| Technologic familiarity (can independently use video calls) | 64/80 (80) |
Data are presented as n (%) or mean (range).
Decile 1 through 10, where 1 indicates greatest deprivation.
Descriptive Statistics
Differences between groups in presence, satisfaction, mental effort, and TUQ were not normally distributed, and comparisons therefore used Wilcoxon tests (Table 2). Mann-Whitney tests found no evidence of significant carryover effects for any outcome.
Table 2.
Summary Outcome Dataa
| Group | No. | Minimum | Q1 | Median | Q3 | Maximum |
|---|---|---|---|---|---|---|
| Presence | ||||||
| 3D | 80 | 34.00 | 70.00 | 83.00 | 90.00 | 100.00 |
| 2D | 80 | 12.00 | 44.50 | 61.00 | 79.50 | 100.00 |
| Satisfaction | ||||||
| 3D | 80 | 50.00 | 78.00 | 90.00 | 96.00 | 100.00 |
| 2D | 80 | 2.00 | 50.00 | 66.00 | 80.00 | 100.00 |
| Mental effort | ||||||
| 3D | 80 | 1.000 | 1.000 | 1.000 | 2.000 | 6.000 |
| 2D | 80 | 1.000 | 1.000 | 2.000 | 3.000 | 8.000 |
| TUQ | ||||||
| 3D | 80 | 72.00 | 116.50 | 128.00 | 136.00 | 147.00 |
| 2D | 80 | 44.00 | 99.00 | 112.00 | 122.00 | 145.00 |
Median and interquartile range are presented for nonnormally distributed data.
Primary Outcome
The median presence score for 3D telemedicine was significantly higher (better) than that for 2D telemedicine (P < 0.001; difference 17; 95% CI, 12, 24).
Secondary Outcomes
The median TUQ score for 3D telemedicine was significantly higher (better) than for 2D telemedicine (P < 0.001; difference 13.5; 95% CI, 10.5, 17.5). The median Mental Effort Rating Scale score for 3D telemedicine was significantly lower (better) than for 2D telemedicine (P < 0.001; difference −0.5; 95% CI, −1, 0]). The median satisfaction score for 3D telemedicine was significantly higher (better) than for 2D telemedicine (P < 0.001; difference 20; 95% CI, 14, 24) (Fig. 5).
Fig. 5.
Outcome measures comparing 3D with 2D telemedicine. Median values of primary and secondary outcome measures are shown. For the mental effort rating scale, a lower score is better; for the other outcome measures, a higher score is better.
Between-Subjects Sensitivity Analyses of 3D versus Traditional Telemedicine
This study used only outcome data from the first telemedicine system that participants used, thereby excluding the crossover component. For all outcome measures, 3D telemedicine scored significantly better than 2D telemedicine. (See Table, Supplemental Digital Content 3, which shows between-subjects analyses of primary and secondary outcomes. Only data from the first system were included [n = 40]; data from the second system used by participants were not included, https://links.lww.com/PRS/I454.)
Ancillary Analyses
Subdomain Analyses of TUQ
Descriptive statistics are presented for 6 subdomains of TUQ; 3D telemedicine was rated better than 2D telemedicine for 4 of 6 domains, with no overlapping 95% confidence intervals (CIs) for usefulness, interface, interaction quality, or satisfaction/future use (Table 3 and Fig. 6).
Table 3.
TUQ Subdomainsa
| TUQ Subdomain | 3D Telemedicine | 2D Telemedicine | ||||||
|---|---|---|---|---|---|---|---|---|
| Median | Q1 | Q3 | 95% CIb | Median | Q1 | Q3 | 95% CIb | |
| Usefulness | 19 | 17 | 21 | 18, 20 | 16 | 13 | 18.75 | 15, 17 |
| Ease of use/learnability | 20 | 17.25 | 21 | 18, 21 | 18 | 13 | 19 | 16, 19 |
| Interface | 27 | 24 | 28 | 25, 27 | 22 | 18.25 | 24 | 21, 23 |
| Interaction quality | 27 | 24 | 28 | 26, 27 | 24 | 21 | 26 | 23, 25 |
| Reliability | 13 | 7 | 16 | 11, 14 | 11 | 7 | 13 | 8, 12 |
| Satisfaction/future use | 27 | 25 | 28 | 26, 28 | 23 | 19.25 | 26 | 22, 24 |
P values were not calculated to reduce multiple comparisons. Descriptive statistics present the median, interquartile range (Q1, first quartile; Q3, third quartile), and 95% CIs (with exact CI for the median calculated at 96.7% for all subdomains), with 4 out of 6 domains showing no overlap in 95% CI in favor of 3D over 2D telemedicine.
Exact CI of median 96.7%.
Fig. 6.
TUQ subdomains. Box plot of median (central line), 25th and 75th percentile (box), and 5th and 95th percentile (whiskers). *Subdomains with nonoverlapping 95% CI of the medians (exact CI, 96.7%).
Effect Sizes
Effect sizes of 3D compared with 2D telemedicine included presence (Cohen d = 0.82), TUQ (d = 0.84), and satisfaction (d = 0.93).
Effect of Clinician Conducting Consultation
Consultations were equally distributed among consultants (n = 26), nurse specialists (n = 27), and surgical trainees (n = 27), with no difference in median presence scores among clinicians (3D telemedicine, Kruskal-Wallis P = 0.60; 2D telemedicine, P = 0.17).
Association of Equality and Diversity Measures with Outcomes
Subgroup analyses of age, deprivation level, education level, sex, and technology familiarity did not statistically correlate with any outcome measures for 3D telemedicine. (See Table, Supplemental Digital Content 4, which shows a univariate analysis of equality and diversity variables with 3D telemedicine outcome measures. Linear regression was used for age and deprivation level, correlation for education level, and logistic regression for sex and technological familiarity. P values are presented without corrections for multiple testing, https://links.lww.com/PRS/I455.)
Subjective Interview
Standardized patient interviews were conducted on completion of both telemedicine consultations. Inductive thematic analysis was performed using the Braun and Clarke approach,20 involving data familiarization, code generation, combining codes into themes, reviewing, determining, and reporting. (See Table, Supplemental Digital Content 5, which shows a thematic analysis of subjective patient interviews. Inductive thematic analysis was performed using the Braun and Clarke 6-step approach, including data familiarization, code generation, combining codes into themes, reviewing, determining, and reporting, https://links.lww.com/PRS/I456.) Patients found that body part positioning was easier and more comfortable with the 3D system, as it avoided the need to maintain uncomfortable poses for prolonged periods of time. The 3D system also improved visualization (with its 360-degree view), ease of manipulation of the picture, and, most notably, the opportunity for the clinician to annotate the 3D images in real time. This allowed patients to visualize surgery on their own body, allowing for personalization of the consultation. This may translate to additional benefits pertaining to informed consent and understanding of complex operations, as patients better understood their surgical operation after the 3D consultation; 3D telemedicine also afforded an increased feeling of realism similar to that of an in-person consultation, with patients considering it a viable future alternative.
Harms
No harms were noted.
DISCUSSION
Holographic communication and the concept of a being co-present—as if the clinician and patient were actually together in person—has captured the public imagination through science fiction and popular media over the decades. Although intuitively it would seem that applying this concept in 3D telemedicine may provide significant benefits over conventional 2D video calls, particularly in a complex spatial surgical specialty such as plastic surgery, these benefits have been purely speculative. Previous studies have been conducted in nonclinical research settings or without true 360-degree, real-time 3D coverage.21,22 The current study provides the first compelling evidence from a randomized trial of improved realism, interaction quality, and experience with 3D telemedicine over current standard of care 2D telemedicine.
One of the fundamental goals of telemedicine is to bring the remote consultation closer to the experience of a face-to-face consultation, which may be assessed through measures of presence or realism. This therefore formed the primary outcome measure in this trial, with the single item Presence scale asking the question “To which extent did you feel present in the virtual clinic, as if you were really there?” This strongly favored the 3D system (P < 0.001), with a large effect size (Cohen d = 0.82), compared with 2D telemedicine. Presence is clinically relevant, as it strongly correlates with satisfaction of the clinical consultation,2 and is associated with improved task-related human performance.23
The TUQ,8 one of the most widely used and accepted outcome instruments in telemedicine research,9–11 provides an overall metric of the clinical quality of the telemedicine system. This favored 3D telemedicine in the current study (P < 0.001), with a large effect size (Cohen d = 0.84). Subdomain analyses of the TUQ score allowed more nuanced insights into the benefits of 3D telemedicine, with significant improvements over 2D telemedicine seen with usefulness, interface, interaction quality, satisfaction, and potential for future use. Together, this points not only to improved quality of consultation with 3D telemedicine, but also to a more immersive interaction and experience that increases patient satisfaction and, therefore, the likelihood of future patient adoption. These are key drivers in the implementation of novel technologies and quality in health care systems.24 In addition, the Mental Effort Rating Scale was used to evaluate patients’ extraneous cognitive load (or ease of comprehension),18 and indicated that 3D visualization decreases the mental effort required by patients to comprehend complex spatial surgery.
This randomized trial focused on psychosocial, quality, and usability metrics. How these translate into tangible clinical benefits in diagnostic accuracy, health care outcomes, and cost savings was not the focus of this trial, although we have previously demonstrated in a comparative cohort study that diagnostic accuracy and concordance of 3D telemedicine with an in-person consultation (95%) exceed those seen with conventional 2D telemedicine (estimated at 91% to 92%).25,26 The further potential benefits of 3D over 2D telemedicine noted in this trial are numerous, and directly address many issues relating to barriers to adoption. These include barriers to adoption relating to difficulties with camera and body part positioning, with the 3D system making it easier and more comfortable for patients to position themselves, particularly for awkward areas, such as the legs or back.3,27 3D visualization also appeared to positively affect patients’ understanding of complex 3D concepts, with the ability to draw on the patient’s 3D model allowing the clinician to more accurately explain an operation on the actual patient’s body. This moves toward a more personalized medicine approach rather than generic explanations using diagrams or leaflets,13 and may provide tangible benefits in critical areas, such as consent. The 3D system was developed with patient input and has a simple, intuitive interface.28 Diversity and equality measures demonstrated that the system was inclusive regardless of educational level, deprivation level, technology use level, age, and sex. Linear regression showed no differences in ease of use (through TUQ scores) with increasing age. Usability has previously been noted as one of the main barriers to adoption in older individuals.3
The 3D system was initially developed to increase access to remote reconstructive care in lower- to middle-income countries, on a philanthropic rather than commercial basis. Off-the-shelf components were therefore used to provide a relatively low-cost system (approximately $8000 in 2025), with a significantly lower cost than any other real-time 3D imaging system. The project has been implemented in our concurrent test bed in Ghana,7 and is already in use on a real-world basis to facilitate international discussions on the care of patients needing complex reconstruction, and surgical planning of cases before overseas surgical visits. To enable South-South development, Microsoft open-sourced the code and partnered with a technology company in Ghana to promote local ownership, development, and health framework adoption.
Limitations of this trial include selection of a specific patient group for whom 3D visualization is particularly relevant: those undergoing reconstructive plastic surgery.29 As such, these data may not be generalizable across general medicine. However, the 3D system may prove of merit in fields such as orthopedics, physiotherapy, neurologic conditions, and psychiatry, where nonverbal bodily cues and body movements are of key importance. Although the primary outcome was a single-item scale, this was supported by secondary outcomes from the multiple-item, validated TUQ questionnaire.
The data presented here provide the first evidence from a randomized trial that 3D telemedicine provides a significantly more immersive, realistic remote consultation, which more closely mimics an in-person consultation than conventional 2D telemedicine. The validated TUQ showed additional nuanced benefits in subdomains of usefulness, interaction quality, satisfaction, and likelihood of future use. Together, this suggests that 3D visualization may help overcome one of the key barriers to adoption of telemedicine—patients’ preference for in-person consultations—and thereby increase acceptability of remote consultations as a viable future alternative.
DISCLOSURE
The authors have no financial disclosures to declare.
ACKNOWLEDGMENTS
The authors thank Ruchi Lalwani, Jonny Johnson, Amber Hoak, and David Tittsworth. This project was supported by the West of Scotland Innovations Hub. This study was funded by the NHS Greater Glasgow and Clyde Endowments Fund; the Chief Scientist Office, Scotland; and the Canniesburn Research Trust, Glasgow.
Supplementary Material
Footnotes
This trial is registered under the name “Clinical Trial of 3D Telemedicine,” Clinical Trials.gov identification no. NCT05227235 (https://clinicaltrials.gov/study/NCT05227235).
Disclosure statements are at the end of this article, following the correspondence information.
Related digital media are available in the full-text version of the article on www.PRSJournal.com.
A Video Discussion by Ash Patel, MD, accompanies this article. Go to PRSJournal.com and click on “Video Discussions” in the “Digital Media” tab to watch.
REFERENCES
- 1.McCabe HM, Smrke A, Cowie F, et al. What matters to us: impact of telemedicine during the pandemic in the care of patients with sarcoma across Scotland. JCO Glob Oncol. 2021;7:1067–1073. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Lo S, Fowers S, Darko K, et al.; 3DTM (3D Telemedicine) Collaborative Research Group. Participatory development of a 3D telemedicine system during COVID: the future of remote consultations. J Plast Reconstr Aesthet Surg. 2023;87:479–490. [DOI] [PubMed] [Google Scholar]
- 3.Almathami HKY, Win KT, Vlahu-Gjorgievska E. Barriers and facilitators that influence telemedicine-based, real-time, online consultation at patients’ homes: systematic literature review. J Med Internet Res. 2020;22:e16407. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Wang G, Xiang W, Pickering M. A cross-platform solution for light field based 3D telemedicine. Comput Methods Programs Biomed. 2016;125:103–116. [DOI] [PubMed] [Google Scholar]
- 5.Stranieri A, Collmann R, Borda A. High definition 3D telemedicine: the next frontier? Stud Health Technol Inform. 2012;182:133–141. [PubMed] [Google Scholar]
- 6.Birckhead B, Khalil C, Liu X, et al. Recommendations for methodology of virtual reality clinical trials in health care by an international working group: iterative study. JMIR Ment Health 2019;6:e11973. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Lo S, Rose A, Fowers S, et al.; 3DTM (3D Telemedicine) Collaborative Research Group. Ghana 3D telemedicine international MDT: a proof-of-concept study. J Plast Reconstr Aesthet Surg. 2024;88:425–435. [DOI] [PubMed] [Google Scholar]
- 8.Parmanto B, Lewis AN, Jr, Graham KM, Bertolet MH. Development of the Telehealth Usability Questionnaire (TUQ). Int J Telerehabil. 2016;8:3–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Hajesmaeel-Gohari S, Bahaadinbeigy K. The most used questionnaires for evaluating telemedicine services. BMC Med Inform Decis Mak. 2021;21:36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Finn MTM, Brown HR, Friedman ER, Kelly AG, Hansen K. Preference for telehealth sustained over three months at an outpatient center for integrative medicine. Glob Adv Health Med. 2021;10:2164956121997361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Hirunwiwatkul P, Pongpanich P, Tulvatana W, et al. Evaluation of psychometric properties of Thai version Telehealth Usability Questionnaire (T-TUQ). Int J Telerehabil. 2023;15:e6577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Vandenbroucke JP, von Elm E, Altman DG, et al.; STROBE Initiative. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Int J Surg. 2014;12:1500–1524. [DOI] [PubMed] [Google Scholar]
- 13.Lo SJ, Chapman P, Young D, Drake D, Devlin M, Russell C. The Cleft Lip Education with Augmented Reality (CLEAR) VR phase 2 trial: a pilot randomized crossover trial of a novel patient information leaflet. Cleft Palate Craniofac J. 2022;60:179–188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Witmer B, Jerome C, Singer M. The factor structure of the presence questionnaire. Presence 2005;14:298–312. [Google Scholar]
- 15.Slater M, Usoh M, Steed A. Depth of presence in virtual environments. Presence 1994;3:130–144. [Google Scholar]
- 16.National Literacy Trust. Adult literacy. Available at: https://literacytrust.org.uk/parents-and-families/adult-literacy/. Accessed June 5, 2021.
- 17.Bouchard S, Robillard G, St-Jacques J, Dumoulin S, Patry MJ, Renaud P. Reliability and validity of a single-item measure of presence in VR. Presented at the 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications; October 2, 2004; Ottawa, Canada. [Google Scholar]
- 18.Paas F. Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive-load approach. J Educ Psychol. 1992;84:429–434. [Google Scholar]
- 19.Voutilainen A, Pitkaaho T, Kvist T, Vehvilainen-Julkunen K. How to ask about patient satisfaction? The visual analogue scale is less vulnerable to confounding factors and ceiling effect than a symmetric Likert scale. J Adv Nurs. 2016;72:946–957. [DOI] [PubMed] [Google Scholar]
- 20.Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101. [Google Scholar]
- 21.Sekimoto S, Oyama G, Chiba S, Nuermaimaiti M, Sasaki F, Hattori N. Holomedicine: proof of the concept of interactive three-dimensional telemedicine. Mov Disord. 2020;35:1719–1720. [DOI] [PubMed] [Google Scholar]
- 22.Garcia M. Innovative 3D telemedicine to help keep astronauts healthy. Published April 8, 2018. Available at: https://www.nasa.gov/feature/innovative-3d-telemedicine-to-help-keep-astronauts-healthy. Accessed May 29, 2022.
- 23.Stevens JA, Kincaid JP. The relationship between presence and performance in virtual simulation training. Open J Modell Simulation 2015;03:41–48. [Google Scholar]
- 24.Manary MP, Boulding W, Staelin R, Glickman SW. The patient experience and health outcomes. N Engl J Med. 2013;368:201–203. [DOI] [PubMed] [Google Scholar]
- 25.Lo S, Fowers S, Darko K, et al. Participatory development of a 3D telemedicine system during COVID: the future of remote consultations. J Plast Reconstr Aesthet Surg. 2022;87:479–490. [DOI] [PubMed] [Google Scholar]
- 26.Buvik A, Bugge E, Knutsen G, Smabrekke A, Wilsgaard T. Quality of care for remote orthopaedic consultations using telemedicine: a randomised controlled trial. BMC Health Serv Res. 2016;16:483. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Wu G, Keyes LM. Group tele-exercise for improving balance in elders. Telemed J E Health 2006;12:561–570. [DOI] [PubMed] [Google Scholar]
- 28.Hernandez K, Roberts T. Leaving no one behind in a digital world. Institute of Development Studies. Published November 2018. Available at: https://assets.publishing.service.gov.uk/media/5c178371ed915d0b8a31a404/Emerging_Issues_LNOBDW_final.pdf. [Google Scholar]
- 29.Lo S, Ampomah O, Ankrah L, Darko K, Bertozzi-Villa A. Quantifying inequitable access to rapid burn and reconstructive care through geospatial mapping. Plast Reconstr Surg Glob Open 2020;8:e3069. [DOI] [PMC free article] [PubMed] [Google Scholar]






