Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Mar 31;17(3):e0266255. doi: 10.1371/journal.pone.0266255

Usability of augmented reality technology in tele-mentorship for managing clinical scenarios—A study protocol

Dung T Bui 1,*, Tony Barnett 1, Ha Hoang 1, Winyu Chinthammit 2
Editor: Dylan A Mordaunt3
PMCID: PMC8970358  PMID: 35358249

Abstract

Background

Tele-mentorship is considered to offer a solution to training and providing professional assistance at a distance. Tele-mentoring is a method in which a mentor interactively guides a mentee at a different geographic location in real time using a technological communication device. During a healthcare procedure, tele-mentoring can support a medical expert, remote from the treatment site, to guide a less-experienced practitioner at a different geographic location. Augmented Reality (AR) technology has been incorporated in tele-mentoring systems in healthcare environments globally. However, evidence is absent about the usability of AR technology in tele-mentoring clinical healthcare professionals in managing clinical scenarios.

Aim

This study aims to evaluate the usability of Augmented Reality (AR) technology in tele-mentorship for managing clinical scenarios.

Methods

This study uses a quasi-experimental design. Four experienced health professionals and a minimum of twelve novice health practitioners will be recruited for the roles of mentors and mentees, respectively. In the experiment, each mentee wearing the AR headset performs a maximum of four different clinical scenarios in a simulated learning environment. A mentor who stays in a separate room and uses a laptop will provide the mentee remote instruction and guidance following the standard protocols for the treatment proposed for each scenario. The scenarios of Acute Coronary Syndrome, Acute Myocardial Infarction, Pneumonia Severe Reaction to Antibiotics, and Hypoglycaemic Emergency are selected, and the corresponding clinical management protocols developed. Outcome measures include the mentors and mentees’ perception of the AR’s usability, mentorship effectiveness, and the mentees’ self-confidence and skill performance.

Ethics

The protocol was approved by the Tasmania Health and Medical Human Research Ethics Committee (Project ID: 23343). The complete pre-registration of our study can be found at https://osf.io/q8c3u/.

Introduction

Many rural and remote areas of Australia suffer from an inadequate number of care professionals due to the maldistribution of the health workforce and the difficulties in attracting skilled health practitioners to work rurally [13]. The ability of the health services to support rural and remote health practitioners has been hampered by several issues, such as the high clinical loads, particularly for sole practitioners [4]; limited access to clinical supervisor [4]; difficulty accessing professional development activities or continuing education [5]; limited or no dedicated work time allocated for professional study [6]; and new graduates and sole practitioners possessing limited skills [7]. Noticeably, the national survey on non-metropolitan GPs in Australia reported that professional support was consistently ranked by rural doctors as one of their top three issues [8].

Tele-mentorship is considered to offer a solution to training and providing professional assistance at a distance. Tele-mentoring is a method in which a mentor interactively guides a mentee at a different geographic location using a technological communication device [9]. During a healthcare procedure, tele-mentorship supports an expert, remote from the treatment site, to guide a less-experienced practitioner at a different geographic location in real-time. Petridou [10] suggested that technologies can aid mentoring in rural and remote settings where geographical isolation can make communication more difficult. Advanced telecommunication technologies could enhance the effectiveness of tele-mentorships as they support the remote expert receiving all relevant information as if they were present at the remote site, and the local practitioner receiving the remote expert’s instructions or guidance as if the expert was physically present.

Augmented Reality (AR) is an emerging human-computer interface and telecommunication technology. Augmented Reality is a form of immersive experience in which the real world is augmented by computer-generated three-dimensional content tied to specific locations and/or activities [11, 12]. A systematic review [13] was conducted to identify how tele-mentoring systems that incorporated AR technology have been used in healthcare environments, including its benefits and limitations. Evidence from this review supported the use of AR technology in enhancing the performance of tele-mentoring systems in healthcare environments. The benefits of AR tele-mentoring systems included a reduction in skill errors and focus shifts, improvement in task completion time and task accuracy, and positive feedback from users. The review identified weaknesses of the AR tele-mentoring systems, including not being trialled under entirely real clinical conditions or for a complete and more complex clinical scenario, and many reported only small sample sizes. Further studies that may address such weaknesses are recommended.

Research aims and objectives

This study aims to evaluate the usability of Augmented Reality (AR) technology in tele-mentorship for managing clinical scenarios.

The study objectives are to:

  • Assess mentors’ and mentees’ perceptions of the Augmented Reality’s usability for a tele-mentorship in the management of clinical scenarios.

  • Assess mentors’ and mentees’ scores of the effectiveness of the tele-mentorship using AR technology in the management of clinical scenarios.

  • Evaluate the changes in the scores of mentees’ self-confidence through the tele-mentorship using Augmented Reality technology in the management of clinical scenarios.

  • Evaluate the scores of mentees’ skill performance through the tele-mentorship using Augmented Reality technology in the management of clinical.

Methods

Study design

Due to limited research in this area, this study will test the usability of AR technology in tele-mentorship for managing clinical scenarios using a quasi-experimental design in a simulated learning environment. An overview of the study design is illustrated in Fig 1.

Fig 1. Study design.

Fig 1

Study setting

This study will be conducted at the Simulation and Clinical Education Centre, University of Tasmania (UTAS). Fig 2 illustrates the setting, which comprises a High-Fidelity (Hi-Fi) room (mentee station), a separate room (mentor station), and a control room.

Fig 2. Study setting.

Fig 2

In the Hi-Fi room, a manikin is dressed in male clothing and lying on the bed (item 13 on Fig 2). A secure identification band with the patient’s name, date of birth, and medical record number is wrapped around the manikin’s wrist. Medical equipment, such as infusion pump, nebulizer pump and automated external defibrillator (AED), and medications necessary in the scenarios are also prepared. An intravenous cannula (IVC) is available to the manikin’s right arm. The three leads of the electrocardiogram (ECG) are also attached to the manikin’s chest and connected to the monitor mounted on the wall near the head of the patient bed. A HoloLens device, the newest version of an AR headset, is available ready (item 9 on Fig 2). Two cameras mounted on the ceiling and an Internet protocol camera located at the corner of the room will record all actions of the mentee during scenarios.

Adjacent to the Hi-Fi room is the mentor station. A laptop is available in the room for use by the mentor. The mentors and mentees will not see or hear each other with all connected doors closed.

In the control room, the operator controls the manikin’s physiological parameters and supplies a voice dialogue of the (conscious) patient using a live microphone or pre-programmed audio and the speakers in the Hi-Fi room. The control room is separated from the Hi-Fi room by a one-way mirror so the operator can see the mentee’s actions in the Hi-Fi room.

Participants

Two groups of participants for the study are mentors and mentees.

Eligible mentors are experienced-health professionals, such as medical doctors, registered nurses, or paramedics who are familiar with the clinical scenarios selected in this study. They may or may not have been previously involved in teaching and tutoring students in simulated learning environments. They do not necessarily need to have previous experience with AR technology, as AR devices are not widely used in health care practices.

Eligible mentees will be health practitioners or soon to be registered practitioners, such as registered nurses or paramedics who are less experienced than the mentors and less familiar with the clinical scenarios. No restrictions are established for their practical experience or previous use of AR devices. To compensate for the mentees’ time to participate in the study, they will be remunerated with a gift card.

Four mentors and at least twelve mentees will be recruited to participate in the study. The mentors and mentees do not need to know each other before joining the study. Participation is voluntary. They will be asked to complete a consent form after they accept to join the study. Participants are free to withdraw from the study at any time without any consequence.

Participants have an option on whether they would like to be notified of the results of this study at enrolment to the study. If so, any publications arising from the study will be forwarded to them.

Participant recruitment

A flyer will be placed in public media, including the university website, newspapers, and Facebook pages of the university and professional career groups to recruit participants. Interested participants will be invited to contact the student researcher, who will determine their eligibility based on the inclusion criteria. If the criteria are met, the student researcher will provide them with an information package.

The Snowball sampling method will also be used for the recruitment. Participants can recommend others to participate in the study.

Selection of clinical scenarios

Clinical scenarios were drawn from 20 patient cases that make up the Australian and New Zealand Nursing Education scenarios which have been developed by Laerdal Australia, National League for Nursing and the Council of Deans of Nursing and Midwifery (Australia and New Zealand) [14]. The 20 scenarios have been programmed on the SimMan 3G simulators in the Hi-Fi lab, UTAS School of Nursing.

From these, four have been chosen that provided an opportunity to demonstrate unique features of the HoloLens device, such as entirely hands-free operations, real-time annotations in 3D space, and document sharing. Additional criteria for the selection of scenarios were acuity level, complexity and need for the mentee to require assistance from a remote expert to manage the scenario.

The selected scenarios (acute coronary syndrome, acute myocardial infarction, diabetic hypoglycaemic emergency, and pneumonia severe reaction to antibiotics) have been revised in accordance with the current national protocols of advanced life support [15] and Ambulance Tasmania Clinical Practice guidelines [16]. They will be programmed on the SimMan 3G simulators and then tested in the Hi-Fi lab room before use in the experiment.

Experimental procedure

Due to the anticipated difficulties in the recruitment process and limited availability of participants due to COVID-19 restrictions, a pragmatic approach will be used in the experiment. Each mentee will be paired up with one mentor and perform all four scenarios. The multiple sessions will allow the mentor and mentee to build a mentor/mentee relationship. The sequence of scenarios will be random for each mentee. They will be asked to select one of the envelopes containing the names of the four scenarios. The selected envelop will be removed from the following selection.

Before the experiment, mentors and mentees will attend a training session individually with the same training content. The training session conducted by the first author will provide the participants with information and requisite skills regarding the study and HoloLens technology. This will include the aim and the study settings, the roles and activities of the participants, the brief of clinical scenarios, and the use of medical equipment in the Hi-Fi room. The AR technology training will brief the AR tele-mentorship setup, the use of HoloLens, and other related equipment. The mentors and mentees will familiarise themselves with the AR technology and the setup and then practice providing or receiving remote assistance via the setup.

During the experiment, each mentee will conduct primary patient observations and assessments before donning the HoloLens to connect to the mentor. The mentee will inform the mentor of the situation happening in the Hi-Fi room and as needed, request instructions from the mentor (Fig 3B). The mentor will use the laptop with a touchable screen (Fig 3A) and a video conferencing headset to communicate with the mentee in real-time, observe the situation in the Hi-Fi room and use HoloLens functionalities, such as annotation on the captured video. The mentor’s instructions will adhere standard protocols for the management of each scenario. The HoloLens built-in camera, located at the front of the AR headset, will capture the real-time activities as seen by the mentee.

Fig 3. Augmented reality tele-mentorship setup.

Fig 3

A—Mentor setup, B—Mentee setup.

Safe work procedure during COVID-19

Participants will be provided with the COVID-19 information sheet produced by UTAS College of Health and Medicine. According to the sheet, participants must be fully vaccinated with a vaccination certificate. Participants must also meet the health screening requirement with a measured temperature less than 37.5 degrees Celsius to access the Newnham campus building during the study’s participation. The COVID participant screening form will be applied for all participants. They will be asked to comply with the COVID-safe plan, including the personal cleaning and physical distancing while are on campus according to the guidelines provided by the School of Health Science, UTAS.

Outcomes

Measures

Different instruments will be used to evaluate the usability of the AR technology, mentorship effectiveness, self-confidence, and skill performance.

The usability of the AR setup, which is the capacity of a setup to provide a condition for its users to perform the tasks while enjoying the experience, is assessed using the scale developed by Ingrassia et al. [17]. The scale includes two parts. In the first part, the setup usability scale by Brooke et al. [18] is adopted by this study, and it is based on the ISO 9241–400 guidance on ergonomic factors (17 items). Bangor et al. [19] reported that the setup usability scale is a highly robust and versatile tool for usability professionals (Cronbach’s α of 0.911). The second part of the evaluation is designed to assess setup input (15 items), setup output (7 items), fidelity (8 items), immersion (4 items), and likeability (9 items). Likert scale is used to grade each item from 1 (strongly disagree) to 5 (strongly agree). Mentors will complete 36 items because they work on a laptop instead of wearing an AR device. As mentees use the AR device, they will complete 43 items.

The effectiveness of the mentorship between mentors and mentees will be assessed in the view of mentees using the scale by Berk et al. [20] as its items seem most appropriate to evaluate responses to a wide range of mentorships as well as appropriate with the objective of the study in assessing the effectiveness of the tele-mentorship. This scale was constructed by an Ad Hoc Faculty Mentoring Committee, Johns Hopkins University School of Nursing, as an efficient, comprehensive, and standardised tool for rating the mentorship experience and, especially, the effectiveness of the mentor. The lead author of the scale granted the research team permission to use and modify the scale. The scale includes 12 items generated from the pool of positive or desirable characteristics and responsibilities of the mentor and then reviewed by the committee for their psychometric forms to determine evidence of content-related validity. The items are graded in a six-point agree-disagree continuum Likert scale from 0 (strongly disagree) to 5 (strongly agree). An item was added by the research team to get the overall perspective of the mentees. Although the mentorship effectiveness scale did not report psychometric evidence, it was cited widely and used by medical and nursing teachers [21]. This may be due to its high face and content validity or that no other psychometrically sound scale exists in medicine and the allied health field [22]. Moreover, Chen et al. [22] noticed that although some mentorship measurement tools reported its psychometric properties, the most frequently tested reliability measure was that of is internal consistency reliability. No studies included test-retest reliability or inter-rater reliability; this may imply that mentorship assessment is still in the exploration and development stage.

While the mentorship effectiveness scale developed by Berk et al. [20] is used to assess the mentees’ perceptions, Dimitriadis et al. [21] modified that scale to investigate the mentors’ perceptions of the mentoring relationship. This modified scale has five items. A six-point agree-disagree continuum Likert scale from 0 (strongly disagree) to 5 (strongly agree) is applied for grading these items. An item was added by the research team to get the overall perspective of the mentors. At the end of the questionnaire, three questions allow each mentor to provide personal feedback about the mentoring relationship. The research team obtained permission to use this scale granted by the lead author.

An instrument to measure self-confidence is developed with items reflecting the skills proposed for the correct treatment in each scenario. Self-confidence refers to participants (mentees)’ judgments of their capabilities to achieve successful performance [23]. People with high confidence levels for a particular task are more likely to be ready and able to perform the task successfully, whereas those low in self-confidence are more likely to avoid or abandon the task. The design of the self-confidence instrument is based on similar tools used in the literature [2426]. The self-confidence instrument requires that the participant rates his or her confidence before and after performing clinical skills in each clinical scenario. The participant uses a scale of 1 to 5 to rate his or her confidence. A score of 1 indicates no confidence at all, and a 5 indicates very high confidence.

In order to assess the mentees’ skill performance, a checklist is adapted from the assessment approach of Friedman et al. [27]. The content in the checklist is taken from the proposed management of the clinical scenarios. Each item will be graded as follows grade 0 equals ‘did not perform’; grade 1 equals ‘inadequately performed’; and grade 2 equals ‘adequately performed’.

Data collection

There are three points for data collection, consisting of ‘before each experiment’ (mentee only), ‘after each experiment’ (mentee only), and ‘after all experiments’ (mentors only). Each mentee will perform all four clinical scenarios with one assigned mentor. Each mentor will attend different experiments with different mentees. Details of the data collection process are illustrated in Table 1.

Table 1. Data collection.
Variable/measure Who When
Self confidence Mentees Baseline
Mentorship effectiveness [20] Mentees On completion of 4 scenarios
Mentors On completion of the experiment
AR usability [17] Mentees On completion of 4 scenarios
Mentors On completion of the experiment
Skill performance/checklist Mentors On completion of the experiment

Data analysis

During the data collection period, the research team will number each retrieved dataset and manually examine each dataset for potential concern issues. All data are then entered into the computer and analysed using SPSS software version 23.0. Descriptive statistics of frequency, percentage, mean, and standard deviation are performed to access demographic information, survey distribution, AR usability, mentorship effectiveness, self-confidence, and skill performance. The subgroups of novice/ experienced clinical practice are defined in accordance with the participants recruited to analyse the impact of tele-mentoring with respect to the participants’ practical levels. The mean differences in each score are compared within a group and between groups using an independent measure t-test for parametric data, Chi-square test and Mann-Whitney U-test for non-parametric data. A two-tailed p < 0.05 is considered significant. Manifest content analysis is employed to analyse narrative comments in each survey.

Data management

Hard copy data will be stored in a locked, secure location at the university for five (5) years after publication. Electronic data, including recorded videos and images, will be stored in a restricted folder accessible only by the chief investigators and the designated Archives Officer. Whilst the experiments are being conducted, the researchers will secure data, and electronic data will be password protected. The designated Archives Officer shall destroy the data after five (5) years. Hard copy materials will be shredded and recycled, and electronic data will be deleted from the secure servers after five years.

Ethics approval and registration

The protocol was approved by the Tasmania Health and Medical Human Research Ethics Committee (Project ID: 23343) (See S1 File). The complete pre-registration of our study can be found at https://osf.io/q8c3u/.

Study benefits and risks

Benefits

The study will provide evidence on the usability and acceptability of AR technology in tele-mentorship for managing clinical scenarios. If successful and well-accepted, findings from this study may have the potentiality for applications primarily in rural and remote areas where healthcare staff may need to call upon a distant procedural expert in emergency situations. Consequently, residents living in rural and remote communities will benefit from this study. The study will also promote an understanding of using Augmented Reality technology in remote assistance between urban and suburban healthcare facilities.

Healthcare facilities that apply the recommended approach and practices derived from the findings of this study will also get benefits. On one side, metro healthcare facilities may not need to rotate as much experienced staff to rural facilities. On the other hand, rural health facilities can keep their staff on-site for specialized training instead of travelling to a metro hospital.

This study will examine critical areas in the remote assistance process lacking in the existing literature. Potentially, a new framework on tele-mentorship could be developed.

Risks

The foreseeable risk in the studies is discomfort when participants wear the AR headset. This study will use HoloLens 2, the newest version of an AR headset [28]. According to a recently published article, this headset has been reported to be comfortable by its users [29]. However, potential discomfort is still a possibility. The headband and the adjustment wheel on the device are designed to make participants’ heads fit into the device comfortably. Participants will have a chance to familiarize themselves with the headset before the experiment. Participants are to proceed with the experiments only when comfortable with the headset. Participants will be offered breaks by taking off the headset after completing each scenario and whenever requested. The contact details of the Chief Investigator and the first author will be provided if the participants need further information or assistance.

Supporting information

S1 File

(PDF)

Acknowledgments

The authors would like to thank Christine Low, Darren Grattidge at the Centre for Rural Health, and Mark Zasadny, Annette Saunders, Kevin Wilmore, and Margaretha Yam in the Simulation and Clinical Education Centre for preliminary discussions and expressing interest in supporting and engaging with this study.

Funding Statement

The authors acknowledge the support received from the University of Tasmania and the Commonwealth Government Department of Health Rural Health Multidisciplinary Training program. The funders had and will not have a role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Department of Health. Scoping framework for the national medical workforce strategy. 2019.
  • 2.Elkin K, Spittal MJ, Studdert DM. Risks of complaints and adverse disciplinary findings against international medical graduates in Victoria and Western Australia. Med J Aust. 2012;197(8):448–52. doi: 10.5694/mja12.10632 edsbas.D60FC6D0. [DOI] [PubMed] [Google Scholar]
  • 3.Flannery J, Hawthorne M. IMGs leaving rural practice after failing exams. Australian Medicine. 2018;30(13):6. [Google Scholar]
  • 4.O’Toole K, Schoo AM. Retention policies for allied health professionals in rural areas: a survey of private practitioners. Rural Remote Health. 2010;10(2):1–12. [PubMed] [Google Scholar]
  • 5.O’Toole K, Schoo A, Hernan A. Why did they leave and what can they tell us? Allied health professionals leaving rural settings. Aust Health Rev. 2010;34(1):66–72. doi: 10.1071/AH09711 [DOI] [PubMed] [Google Scholar]
  • 6.Shanahan M. Radiographers and the internet: an Australian perspective. Radiol Technol. 2010;81(3):223–32. [PubMed] [Google Scholar]
  • 7.Stagnitti K, Schoo A, Dunbar J, Reid C. An exploration of issues of management and intention to stay: allied health professionals in South West Victoria, Australia. J Allied Health. 2006;35(4):226–32. [PubMed] [Google Scholar]
  • 8.Humphreys J, Jones M, Jones J, Mara P. Workforce retention in rural and remote Australia: determining the factors that influence length of practice. Med J Aust. 2002;176(10):472–6. Epub 2002/06/18. doi: 10.5694/j.1326-5377.2002.tb04518.x . [DOI] [PubMed] [Google Scholar]
  • 9.Agarwal R, Levinson AW, Allaf M, Makarov DV, Nason A, Su L-M. The Robo Consultant: Tele-mentoring and remote presence in the operating room during minimally invasive urologic surgeries using a novel mobile robotic interface. Urology. 2007;70(5):970–4. doi: 10.1016/j.urology.2007.09.053 [DOI] [PubMed] [Google Scholar]
  • 10.Petridou E. E-mentoring women entrepreneurs: Discussing participants’ reactions. Gend Manag. 2009;24:523–42. doi: 10.1108/17542410910991809 [DOI] [Google Scholar]
  • 11.Azuma RT. A survey of Augmented Reality. Presence: Teleoperators Virtual Environ. 1997;6(4):355–85. [Google Scholar]
  • 12.Zhou F, Duh HB-L, Billinghurst M, editors. Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. 7th IEEE/ACM International Symposium on Mixed and Augmented Reality; 2008; Cambridge, UK: IEEE Computer Society.
  • 13.Bui DT, Barnett T, Hoang H, Chinthammit W. Tele-mentoring using augmented reality technology in healthcare: A systematic review. Australas J Educ Technol. 2021;37(4):68–88. doi: 10.14742/ajet.6243 [DOI] [Google Scholar]
  • 14.Laerdal. NLN simulation in nursing education. SimMan® scenarios 2010 [cited 2020 Aug 20]. Available from: https://www.laerdal.com/distributors/doc/236/NLN-Simulation-Scenarios.
  • 15.Australian Resuscitation Council. Advanced Life Support Level 2. 3 ed. Gale M, Grantham H, Morley P, PaRR M, editors. East Melbourne, VIC: ARC; 2016. [Google Scholar]
  • 16.Ambulance Tasmania. Clinical practice guidelines for paramedics and intensive care paramedics. In: Do Health, editor. Hobart, TAS: Ambulance Tasmania; 2012. [Google Scholar]
  • 17.Ingrassia PL, Mormando G, Giudici E, Strada F, Carfagna F, Lamberti F, et al. Augmented Reality Learning Environment for Basic Life Support and Defibrillation Training: Usability Study. J Med Internet Res. 2020;22(5):e14910. doi: 10.2196/14910 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Brooke J. SUS-A quick and dirty usability scale. In: Patrick W. Jordan BT, Ian Lyall McClelland, Bernard Weerdmeester, editor. Usability evaluation in industry. 1st ed. London: CRC Press; 1996. p. 6. [Google Scholar]
  • 19.Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum–Comput Int. 2008;24(6):574–94. doi: 10.1080/10447310802205776 [DOI] [Google Scholar]
  • 20.Berk RA, Berg J, Mortimer R, Walton-Moss B, Yeo TP. Measuring the effectiveness of faculty mentoring relationships. Acad Med. 2005;80(1):66–71. doi: 10.1097/00001888-200501000-00017 [DOI] [PubMed] [Google Scholar]
  • 21.Dimitriadis K, von der Borch P, Störmann S, Meinel FG, Moder S, Reincke M, et al. Characteristics of mentoring relationships formed by medical students and faculty. Med Educ Online. 2012;17(1):17242. doi: 10.3402/meo.v17i0.17242 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Chen Y, Watson R, Hilton A. A review of mentorship measurement tools. Nurse Educ Today. 2016;40:20–8. doi: 10.1016/j.nedt.2016.01.020 [DOI] [PubMed] [Google Scholar]
  • 23.Bandura A. Social foundations of thought and action. In: William M. Kurtines JG, Jacob L. Lamb, editor. Englewood Cliffs, NJ. 1st ed. New York: Psychology Press; 1991. p. 60. [Google Scholar]
  • 24.De Witt Jansen B, Brazil K, Passmore P, Buchanan H, Maxwell D, McIlfatrick SJ, et al. Evaluation of the impact of telementoring using ECHO© technology on healthcare professionals’ knowledge and self-efficacy in assessing and managing pain for people with advanced dementia nearing the end of life. BMC Health Serv Res. 2018;18(1):228. doi: 10.1186/s12913-018-3032-y . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Jacobs LM, Burns KJ, Kaban JM, Gross RI, Cortes V, Brautigam RT, et al. Development and evaluation of the advanced trauma operative management course. J Trauma Acute Care. 2003;55(3). doi: 10.1097/01.TA.0000059445.84105.26 [DOI] [PubMed] [Google Scholar]
  • 26.Kuhls DA, Risucci DA, Bowyer MW, Luchette FA. Advanced surgical skills for exposure in trauma: A new surgical skills cadaver course for surgery residents and fellows. J Trauma Acute Care. 2013;74(2). doi: 10.1097/TA.0b013e31827d5e20 [DOI] [PubMed] [Google Scholar]
  • 27.Friedman Z, You-Ten KE, Bould MD, Naik V. Teaching lifesaving procedures: The Impact of model fidelity on acquisition and transfer of cricothyrotomy skills to performance on cadavers. Anesth Analg. 2008;107(5). doi: 10.1213/ane.0b013e3181841efe [DOI] [PubMed] [Google Scholar]
  • 28.Microsoft. HoloLens 2 hardware 2020 [updated Oct 20; cited 2020 Nov 25]. Available from: https://docs.microsoft.com/en-us/hololens/hololens2-hardware.
  • 29.Martin G, Koizia L, Kooner A, Cafferkey J, Ross C, Purkayastha S, et al. Use of the HoloLens2 Mixed Reality Headset for Protecting Health Care Workers During the COVID-19 Pandemic: Prospective, Observational Evaluation. J Med Internet Res. 2020;22(8):e21486. doi: 10.2196/21486 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Dylan A Mordaunt

17 Mar 2022

Usability of augmented reality technology in tele-mentorship for managing clinical scenarios - A study protocol

PONE-D-22-04739

Dear Dr. Bui,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Dylan A Mordaunt, MB ChB, MPH, MHLM, FRACP, FAIDH

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Thank you for your submission. This meets the criteria for publication.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #1: Yes

**********

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #1: Yes

**********

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #1: Yes

**********

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors propose an up-to-date technology, AR to support the professional development of health professionals in remote or rural areas. They address a relevant problem, especially in big countries with low population. The suggested method looks promising.

The description of the study protocol is detailed and sound. The authors selected validated questionnaires for data collection.

As I am not a health professional, I might be interested in more details about the clinical scenarios and the interventions to be performed by the mentees. If the other reviewers or the editor ask for a revision, you might also consider adding some examples. Otherwise, the paper can be published as it is.

Note: a Word comment is left on page 14.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Acceptance letter

Dylan A Mordaunt

21 Mar 2022

PONE-D-22-04739

Usability of augmented reality technology in tele-mentorship for managing clinical scenarios - A study protocol

Dear Dr. Bui:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Dylan A Mordaunt

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (PDF)


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES