Abstract
Effective communication is vital for patient safety, yet failures are common, often due to outdated methods. This study aimed to assess whether in-ear communication devices improve communication in orthopedic surgery simulations compared to traditional loud voice methods. Fifteen participants underwent simulations using both in-ear wireless devices and standard communication. Results showed significant improvements with in-ear devices in correctly identifying phrases (78.6% vs 44%), effectiveness (7.9/10 vs 4.9/10), and clarity (8/10 vs 4/10), all P < .001. Participants also favored in-ear devices in usability assessments. Sound levels recorded were comparable between groups. In conclusion, in-ear communication is safe and effective in orthopedic settings, potentially enhancing efficiency and safety. These devices can mitigate loud noises, benefiting surgeon well-being and patient outcomes.
Keywords: Arthroplasty, In-ear communication, Orthopaedic surgery noise, OR communication
Introduction
Communication breakdown plays a significant role in the occurrence of adverse events across many healthcare domains. In its examination of 4000 adverse events, the Joint Commission specifically pinpointed communication breakdown as the most common contributing factor to these incidents [1]. In the operating room (OR), communication failure contributes to 43% of errors [2]. In spite of this, OR communication is an area that has not been deeply studied [3]. Moreover, the importance of rapid, efficient and effective communication within surgical teams is a cornerstone for successful outcomes [4,5]. In the high-stakes environment of the OR, miscommunication or breakdowns in information exchange can lead to a cascade of adverse events. Surgical errors, procedural delays, and compromised patient safety are among the immediate consequences that may arise [6]. In addition to immediate consequences, such breakdowns can have long-term impacts on OR efficiency, cost, and increase tension between surgical teams [[7], [8], [9]].
Orthopaedic surgery, a field with heavy use of saws, hammers, and whole-body sterile suits is a field where communication can be hampered by the noises of the surgery and the processes within it [[10], [11], [12]]. Improving conversational efficiency within teams has the potential to improve OR efficiency, resident education, and most importantly, patient outcomes. Nonetheless, this area of orthopaedics has been less studied and has lacked innovation that could potentially alleviate miscommunication within the teams. Additionally, communication tools that facilitate quick team interaction can also hamper the loud noises in arthroplasty surgery. Numerous studies have indicated that the significant noise levels experienced by orthopaedic surgeons puts them at a higher risk of noise-induced hearing loss [[13], [14], [15]]. A previous study by Kwan et al. demonstrated that orthopaedic surgeons are exposed to noise-induced hearing loss with daily levels above 85 decibels and that arthroplasty surgeons were the ones with the highest dose and highest projected dose among orthopaedic subspecialties. Furthermore, a recent study from Germany demonstrated that surgeons exposed to robotic arthroplasty are exposed to sound levels above the recommended dose from the National Institute for Occupational Safety and Health [16]. These high sound levels were further validated by the Noise Evaluation of Arthroplasty Theaters study which demonstrated that surgeons in the United Kingdom exceeded noise level recommendations from their national regulating agency when performing total hip arthroplasty [17]. Some have even recommended that surgeons be included in a hearing loss prevention program [10,14]. Therefore, the objective of this study was to assess whether the utilization of in-ear communication devices during simulated orthopaedic surgery procedures can enhance communication efficiency, dampen the level of sound exposure with in-ear technology, and determine the practicality of implementing such a system.
Material and methods
Demographics
A total of 15 volunteers participated in the study. Most participants were women (9/15, 66%). The mean age of participants was 29 years (standard deviation [SD] 2.9). No participants had a history of hearing problems, and all were either residents or medical students.
Simulation design
To emulate the OR environment, a simulation of total joint arthroplasty was orchestrated (Fig. 1). This simulation, conducted at the mock OR of the Center for Applied Learning at Atrium Health Wake Forest Baptist Hospital, encompassed the essential elements of a real OR, incorporating saw bones (Sawbones USA, Vashon, WA), requisite instruments, standard procedures, draping, setup, and conditions specific to TJA. Furthermore, the simulation emulated the authentic OR experience, incorporating gowning with sterile suits and the utilization of the anesthesia machine and suction device in simulation mode, reproducing typical OR ambient noise. The level of noise was confirmed prior to the initiation of the simulations based on previous studies [18]. The Center for Applied Learning system served as the cornerstone for the study's simulations, where different phases of the TJA case were examined. Critical procedural stages where loud noises are encountered were targeted for comparison including pin placement into cutting blocks and bone cuts in saw bones using a standard oscillating saw. The use of the oscillating saws was targeted as the loudest portion of the procedure and thus chosen to be compared. Volunteer residents and medical students were recruited to participate in the simulations.
Center for Applied Learning case simulations
Participants were randomly tested in 2 different case simulations:
-
1)
OR simulation without in-ear communication: Participants used verbal communication to interact with standard OR noise while cutting a bone saw model wearing hooded protective OR suits with the helmet fan engaged (Flyte Personal Protection System, Stryker Corp. Portage, MI).
-
2)
OR simulation with in-ear communication: Participants used in-ear communication devices to interact with standard OR noise while cutting a bone saw model wearing again personal protective suit.
Data acquisition
The primary outcomes assessed were communication effectiveness and sound level exposure. Communication evaluation was based on the study by Thomas et al. [18] and was determined by the subjects' ability to execute tasks as instructed by the moderator without the need for task repetition. To capture sound data during simulation, in ear devices with decibel recording and wireless communication capabilities were used. A set of current generation Apple AirPods (Apple, Cupertino, CA) were used as the in-ear device. For the purposes of this study, 2 current generation iPhones (Apple, Cupertino, CA) were used. These were connected to the hospital's non-password-protected guest WIFI network and the Discord app (Discord Inc, San Francisco, CA) was downloaded in both phones. The app allows the creation of private communication rooms of users that have a profile within the app and are online. The creation of a connectivity channel allows the users to speak "over the phone" to each other through a secure network. The internet protocol addresses of each user are securely protected online by being routed through a Discord server. Creation of a profile within the app takes less than a minute. The app Decibel: dB sound level meter (Vlad Polyanskiy, iOS App Store) on an Apple iPhone 12 (Apple, Cupertino, CA) was used. Sound recordings were analyzed within the sterile suite and through the in-ear device while in use. Peak values and cumulative noise exposure levels were quantified, analyzed, and compared across case simulations.
The critical portion of the procedure evaluated was the cutting of the distal femur with an oscillating saw (System 7, Stryker, Portage, MI) and 1.27 mm blade (Stryker, Portage, MI). Femur Saw Bones were used (Sawbones USA, Vashon, WA). The distal cutting guide for a total knee arthroplasty was used with smooth pins drilled in place (Depuy Attune, Johnson & Johnson, Warsaw, IN).
Secondary outcomes included participants' clarity and effectiveness ratings following each simulation. Clarity was defined as the amount of static, interference, or the quality of transmission between the moderator and participant. Effectiveness was defined as whether participants thought the modality was practical to use in the OR. Ratings for clarity and effectiveness were assigned on a visual analog scale ranging from 1 to 10, with 1 denoting the worst and 10 signifying the best [19]. Finally, following completion of a participant’s final case simulation, participants completed a System Usability Scale (SUS) [20] to determine satisfaction with each type of communication. The SUS is a questionnaire consisting of 10 items that evaluate the perceived usability of a system. Participants rated the 10-item SUS questionnaire (Fig. 2) on a scale from 1 to 5, with responses corresponding to the following values: Strongly Disagree (1 point), Disagree (2 points), Neutral (3 points), Agree (4 points), and Strongly Agree (5 points). Additionally, participants were given a questionnaire evaluating opinions regarding ease of use, preferred method, problems encountered, possible barriers in implementation of intraear communication devices, and whether they anticipate a future transition to in-ear devices. Finally, an open question on “thoughts” on the experience was offered to further capture user experience.
Phrases used
To make the simulations as close to the operating room as possible, phrases that are typically used within a TJA procedure were printed onto sheets that participants were blinded to until the simulation took place. They are presented on Table 1. Phrases no longer than 5 words were used to avoid adding more variables to the study. Enough phrases were made available, so the participants did not have to repeat phrases when performing the second case simulation to prevent recollection bias.
Table 1.
Option number | Phrases |
---|---|
1 |
|
2 |
|
3 |
|
4 |
|
Data analyses
Descriptive analysis was performed followed by qualitative. Initial analysis of data parametricity was evaluated with the Kolmogorov-Smirnov test. Based on normality testing the variables were compared later using t-tests, while chi-squared tests were used for the comparison of qualitative variables, with a significance level set at P < .05. The data collected from the simulations were compared to determine the effectiveness of in-ear communication and sound level exposure in the OR. Qualitative recording of participants' comments after the study was also saved and presented herein.
Source of funding
No outside funding was provided for this study. All Sawbones used for the study were provided by the Atrium Health Wake Forest Baptist Orthopaedic Surgery Research Department. Institutional review board approval was obtained for this study and each participant signed an informed consent form. Michael McCann helped provide the instruments needed for the simulation and Dr Johnson and his team provided assistance with the set-up of the Center of Experiential and Applied Learning and we greatly thank them.
Results
Communication effectiveness
There were 5 phrases spoken to each participant in each simulation. There was a significant difference in percent of correctly identified.
Both effectiveness and clarity were ranked significantly higher for the in-ear communication device simulations. The mean effectiveness for the in-ear communication simulation was 7.9/10 (SD 1.94) compared to 4.9/10 (SD 2.12) for the traditional communication simulation (P < .05). The mean clarity for the in-ear communication simulation was 8.0/10 (SD 1.85) compared to 4.0/10 (SD 2.29) for the traditional communication simulation (P < .05).
Regarding the SUS questionnaire, significant differences were observed in the means for 4/10 of the SUS questions (Table 2). Ten participants filled out the additional survey at the end of their final simulation. Of these, 9 preferred and anticipated a future transition to an in-ear communication system. The most positive and negative open response comments are shown in Table 3.
Table 2.
Headphone |
No headphone |
P value | ||
---|---|---|---|---|
Mean | SD | Mean | SD | |
4.53 | 0.83 | 3.00 | 1.18 | .000 |
1.79 | 0.89 | 2.36 | 1.45 | .220 |
4.27 | 0.96 | 3.36 | 1.22 | .033 |
1.8 | 1.01 | 2.00 | 1.52 | .678 |
3.87 | 1.13 | 2.86 | 1.17 | .025 |
2.2 | 1.08 | 3.43 | 1.40 | .013 |
4.47 | 1.06 | 4.14 | 1.03 | .411 |
1.73 | 0.88 | 2.64 | 1.34 | .038 |
4.13 | 0.92 | 3.43 | 1.22 | .089 |
1.6 | 0.63 | 1.93 | 1.44 | .428 |
Table 3.
Most-positive aspects | Most-negative aspects |
---|---|
“Reliable” | “Intolerance of headphones” |
“Noise Canceling” | “Delayed voice transmission” |
“Great idea” | “Headphones dying” |
“Could see the OR having a complete audio system for the whole team” | “AirPods could fall off in hood and would be hard to retrieve” |
“Effective” | “Connectivity trouble and Cutting out” |
OR, operating room.
Sound level exposure
Mean level of sound recorded was 86 dB in the in-ear device and 87.6 dB in the control group which demonstrated no difference (P = .680).The peak level of sound was recorded at 99 dB across all the simulations.
Discussion
Despite effective communication being critical for outcomes in the OR [1,2,4], there has been a notable lack of innovation in this area. Specifically in orthopaedic, power tools that emit loud noises are utilized and personal protective suits with fans are common that can inhibit effective team communication [[10], [11], [12],21]. Wireless in-ear communication systems have been proposed as a potential solution to this problem. In this study, we present the first randomized simulation study evaluating an in-ear communication system in orthopaedic surgery.
With a sample of 15 participants, the results indicate that in-ear wireless communication under OR conditions appears to be safe and effective. Participants in the in-ear simulation demonstrated a significantly higher number of accurately identified phrases, along with improved effectiveness and clarity. Additionally, feedback from the SUS questionnaire and survey indicated that participants found the system to be effective and easy to implement.
These findings do not come as a surprise given the demonstrated benefit of in-ear communication systems in aviation [22], professional sports teams, and healthcare teams [3,23]. In regard to OR communication, previous studies have shown benefit with wireless communication systems yet none in the setting of TJA [8,18,24,25]. In a prospective blinded study, Thomas et al. [18] conducted a comparison between communication efficiency using the standard Da Vinci Si speaker system and a wireless, hands-free audio system. The evaluation involved subjects hearing 960 surgical phrases and transcribing them onto a data sheet. The findings indicated that the wireless, hands-free system led to increased communication accuracy, clarity, and effectiveness. Ortega et al. conducted an evaluation of paging communication using an in-ear communication device. In a randomized approach, the orthopaedic surgeon was paged during procedures both with and without this device. The study revealed noteworthy improvements in meantime intervals for response time, correct patient identification, and total communication time. Additionally, there were enhanced satisfaction ratings from floor nurses and a reduction in intraoperative case interruptions [8].
Furthermore, wireless communication systems bypass personal protective equipment, a known barrier to effective communication, resulting in improved speech discrimination and decreasing listening effort [24,25]. These systems also provide valuable protection from the high noise levels in the OR, a significant concern in the field of orthopaedics where noise levels can exceed 100 decibels (dBA) for more than 40% of the time during procedures [26]. Additionally, equipment-related noises, such as the use of electric or air-powered surgical instruments and hammers, can reach up to 120 dB [26]. In our study, the mean sound level recorded in the in-ear device was 86 dB and peaked at 99 db.
This study has many potential implications. First, an in-ear communication system can improve efficiency in the OR by decreasing operative times, intraoperative interruptions, surgical delays, and resource utilization [[7], [8], [9]]. Most importantly, the implementation of such a system has the potential to enhance patient outcomes by reducing errors, preventing near misses, and ultimately leading to improved patient safety.
This study is the first of its kind in the field of TJA to demonstrate the effectiveness of in-ear OR communication; however, it is not without limitations. First, the in-ear simulation accurately identified 78.6% of phrases, indicating there is still considerable room for improvement in the system. The in-ear communication system relied on internet connectivity in the operating room, and some participants reported issues such as connectivity problems and interruptions in the in-ear system, potentially accounting for the approximately one-fifth of incorrect responses. Addressing these concerns could be a focus for future in-ear communication systems designed for the operating room. Second, our experimental model used a simulated OR, which may not completely replicate every noise and distraction encountered in a real OR. Third, we focused on testing a single type of orthopaedic procedure in our simulation. Furthermore, participants had a relatively low mean age, potentially underestimating the influence of presbycusis with the increasing age of the surgeon population. While this study has shown that in-ear communication can be more effective than traditional methods, it is crucial to undertake future research involving various procedures and surgical specialties to fully validate this finding. Another limitation of our study was that the study subjects used were medical students and residents of all training years which translates into limited experience performing arthroplasty surgery. As such some of the phrases used in the study may not been familiar to the study subjects. We aim for future studies to include Attending Surgeons and OR staff including circulators and scrub technicians so our findings can be further explored. Finally, another limitation to our study is that our simulations were made to match as closely as we could most joint arthroplasty surgeries done in the United States. Most surgeons use protective hoods that would hold the headphones outside of the surgical field if they were to fall but we did not perform simulations of the cases where protective hoods are not used. Despite these limitations, this study emphasizes the gap of innovation in OR communication and the increased concern for noise induced hearing loss among surgeons who are projected to perform even higher numbers of arthroplasty cases and growing trend in robotic use. Given the demonstrated negative impact on patient outcomes associated with inadequate communication, it is paramount for enhanced innovation in this realm, particularly within the field of orthopaedics.
Conclusions
Successful communication in the operating room is critical for favorable outcomes and stands as a primary factor influencing patient outcomes. This study highlights a significant enhancement in communication through the implementation of an in-ear communication system, suggesting its potential to reduce errors, instances of miscommunication, and OR efficiency resulting in improved patient safety.
Conflicts of interest
The authors declare there are no conflicts of interest.
For full disclosure statements refer to https://doi.org/10.1016/j.artd.2024.101481.
CRediT authorship contribution statement
Blake Dunson: Writing – review & editing, Writing – original draft, Data curation. Alexus M. Cooper: Writing – review & editing, Data curation. Bryce W. Polascik: Writing – review & editing, Investigation, Data curation. Taylor Ranae Wood: Writing – review & editing, Project administration, Investigation, Data curation. Maxwell K. Langfitt: Writing – review & editing, Supervision, Resources, Funding acquisition. Johannes F. Plate: Writing – review & editing, Supervision, Conceptualization. Samuel Rosas: Writing – original draft, Project administration, Methodology, Investigation, Formal analysis, Conceptualization.
Acknowledgments
We would like to specifically thank the Center for Applied Learning staff and directors for the help in organizing the simulation to the best of their abilities, our operating room staff for help finding the instruments needed and to Michael McCann who provided us the specific tools needed to perform the simulation. Finally, we would like to thank the participants of the study who took time to help participate in a research project without reimbursement.
Appendix A. Supplementary data
References
- 1.The Joint Commission Sentinel events statistics. http://www.jointcommission.org/sentinelevent/statistics/
- 2.Gawande A.A., Zinner M.J., Studdert D.M., Brennan T.A. Analysis of errors reported by surgeons at three teaching hospitals. Surgery. 2003;133:614–621. doi: 10.1067/msy.2003.169. [DOI] [PubMed] [Google Scholar]
- 3.West G.F., Lustik M.B., Hopkinson S.G. Usability of and satisfaction with Vocera wireless communication. Comput Inform Nurs. 2019;37:229–234. doi: 10.1097/CIN.0000000000000509. [DOI] [PubMed] [Google Scholar]
- 4.Greenberg C.C., Regenbogen S.E., Studdert D.M., et al. Patterns of communication breakdowns resulting in injury to surgical patients. J Am Coll Surg. 2007;204:533–540. doi: 10.1016/J.JAMCOLLSURG.2007.01.010. [DOI] [PubMed] [Google Scholar]
- 5.Stringer B., Haines T.A., Oudyk J.D. Noisiness in operating theatres: nurses’ perceptions and potential difficulty communicating. J Perioper Pract. 2008;18:384. doi: 10.1177/175045890801800903. 386-91. [DOI] [PubMed] [Google Scholar]
- 6.Catchpole K., Perkins C., Bresee C., et al. Safety, efficiency and learning curves in robotic surgery: a human factors analysis. Surg Endosc. 2016;30:3749–3761. doi: 10.1007/S00464-015-4671-2. [DOI] [PubMed] [Google Scholar]
- 7.Lingard L., Epsin S., Whyte S., et al. Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Saf Health Care. 2004;13:330–334. doi: 10.1136/QHC.13.5.330. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Ortega G.R., Taksali S., Smart R., Baumgaertner M.R. Direct cellular vs. indirect pager communication during orthopaedic surgical procedures: a prospective study. Technol Health Care. 2009;17:149–157. doi: 10.3233/THC-2009-0540. [DOI] [PubMed] [Google Scholar]
- 9.Christian C.K., Gustafson M.L., Roth E.M., et al. A prospective study of patient safety in the operating room. Surgery. 2006;139:159–173. doi: 10.1016/J.SURG.2005.07.037. [DOI] [PubMed] [Google Scholar]
- 10.Kwan S.A., Lynch J.C., Defrance M., Ciesielka K.A., Rivlin M., Daniel J.N. Risk of noise-induced hearing loss for orthopaedic surgeons. J Bone Joint Surg Am. 2022;104:2053–2058. doi: 10.2106/JBJS.22.00582. [DOI] [PubMed] [Google Scholar]
- 11.Noise exposure and risk of noise induced hearing loss to the adult reconstruction surgeon: recommendations for prevention and monitoring – JSOA online. https://www.jsoaonline.com/archive/2020/winter-2020/noise-exposure-and-risk-of-noise-induced-hearing-loss-to-the-adult-reconstruction-surgeon-recommendations-for-prevention-and-monitoring/ [PubMed]
- 12.Love H. Noise exposure in the orthopaedic operating theatre: a significant health hazard. ANZ J Surg. 2003;73:836–838. doi: 10.1046/j.1445-2197.2003.02776.x. [DOI] [PubMed] [Google Scholar]
- 13.Peters M.P., Feczko P.Z., Tsang K., van Rietbergen B., Arts J.J., Emans P.J. Noise exposure in TKA surgery; oscillating tip saw systems vs oscillating blade saw systems. J Arthroplasty. 2016;31:2773–2777. doi: 10.1016/J.ARTH.2016.05.030. [DOI] [PubMed] [Google Scholar]
- 14.Siegel M. The risk of noise-induced hearing loss performing knee replacement surgery. Noise Health. 2019;21:183–188. doi: 10.4103/NAH.NAH_22_19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Simpson J.P., Hamer A.J. How noisy are total knee and hip replacements? J Perioper Pract. 2017;27:292–295. doi: 10.1177/175045891702701204. [DOI] [PubMed] [Google Scholar]
- 16.Hönecke T., Schwarze M., Wangenheim M., Savov P., Windhagen H., Ettinger M. Noise exposure during robot-assisted total knee arthroplasty. Arch Orthop Trauma Surg. 2023;143:2813–2819. doi: 10.1007/S00402-022-04454-W. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Palmer J.S., Fraig H.H., Wilson C.J., Garrett S.J.W. Noise evaluation of arthroplasty theaters: results from the NEAT study. J Arthroplasty. 2021;36:1819–1822. doi: 10.1016/J.ARTH.2020.11.026. [DOI] [PubMed] [Google Scholar]
- 18.Thomas A., Campwala Z., Keheila M., et al. Impact of a wireless system upon verbal communication in a simulated robotic operating theater. Urology. 2019;123:151–156. doi: 10.1016/J.UROLOGY.2018.07.059. [DOI] [PubMed] [Google Scholar]
- 19.McCormack H.M., Horne D.J., Sheather S. Clinical applications of visual analogue scales: a critical review. Psychol Med. 1988;18:1007–1019. doi: 10.1017/S0033291700009934. [DOI] [PubMed] [Google Scholar]
- 20.Lewis J., Sauro J. Item benchmarks for the system usability scale. J User Exp. 2018;13:158–167. [Google Scholar]
- 21.Adams N., Ludwigsen D., Baes T., Srivastava A., Atkinson P., Atkinson T. Orthopedic surgical helmet systems significantly impair speech intelligibility. Orthopedics. 2021;44:208–214. doi: 10.3928/01477447-20210621-07. [DOI] [PubMed] [Google Scholar]
- 22.Gibbs B., Maluski hoare lea S., Gibbs B.M., Maluski S. Handbook of noise and vibration control. 2007. https://books.google.com/books?hl=en&lr=&id=46NvrvpHIxEC&oi=fnd&pg=PR15&dq=Active+noise+control.+In:+Crocker,M.,+Handbook+of+Noise+and+Vibration+Control&ots=O-7tIsRjm-&sig=y6ZRgBgdswD27-LUUZOfyzWVLEE
- 23.Breslin S., Greskovich W., Turisco F. Wireless technology improves nursing workflow and communications. Comput Inform Nurs. 2004;22:275–281. doi: 10.1097/00024665-200409000-00007. [DOI] [PubMed] [Google Scholar]
- 24.Hall A.C., Silver B.H., Ellis W., et al. The impact of personal protective equipment on speech discrimination and verbal communication in the operating room and the role of audio communication devices. Simul Healthc. 2023;18:64–70. doi: 10.1097/SIH.0000000000000646. [DOI] [PubMed] [Google Scholar]
- 25.Nguyen D.L., Kay-Rivest E., Tewfik M.A., Hier M., Lehmann A. Association of in-ear device use with communication quality among individuals wearing personal protective equipment in a simulated operating room. JAMA Netw Open. 2021;4 doi: 10.1001/JAMANETWORKOPEN.2021.6857. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Katz J.D. Noise in the operating room. Anesthesiology. 2014;121:894–898. doi: 10.1097/ALN.0000000000000319. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.