Skip to main content
Journal of Experimental Orthopaedics logoLink to Journal of Experimental Orthopaedics
. 2024 Nov 10;11(4):e70084. doi: 10.1002/jeo2.70084

Leveraging digital twins for improved orthopaedic evaluation and treatment

Michael C Dean 1, Jacob F Oeding 2, Pedro Diniz 3, Romain Seil 3, Kristian Samuelsson 2,; ESSKA Artificial Intelligence Working Group
PMCID: PMC11551062  PMID: 39530111

Abstract

Purpose

The purpose of this article is to explore the potential of digital twin technologies in orthopaedics and to evaluate how their integration with artificial intelligence (AI) and deep learning (DL) can improve orthopaedic evaluation and treatment. This review addresses key applications of digital twins, including surgical planning, patient‐specific outcome prediction, augmented reality‐assisted surgery and simulation‐based surgical training.

Methods

Existing studies on digital twins in various domains, including engineering, biomedical and orthopaedics are reviewed. We also reviewed advancements in AI and DL relevant to digital twins. We focused on identifying key benefits, challenges and future directions for the implementation of digital twins in orthopaedic practice.

Results

The review highlights that digital twins offer significant potential to revolutionise orthopaedic care by enabling precise surgical planning, real‐time outcome prediction and enhanced training. Digital twins can model patient‐specific anatomy using advanced imaging techniques and dynamically update with real‐time data, providing valuable insights during surgery and postoperative care. However, challenges such as the need for large‐scale data sets, technological limitations and integration issues must be addressed to fully realise these benefits.

Conclusion

Digital twins represent a promising frontier in orthopaedic research and practice, with the potential to improve patient outcomes and enhance surgical precision. To enable widespread adoption, future research must focus on overcoming current challenges and further refining the integration of digital twins with AI and DL technologies.

Level of Evidence

Level V.

Keywords: artificial intelligence, augmented reality, deep learning, digital twin, orthopaedics


Abbreviations

AI

artificial intelligence

AR

augmented reality

CT

computed tomography

DL

deep learning

MRI

magnetic resonance imaging

PET

positron emission tomography

RPM

remote patient monitoring

VR

virtual reality

INTRODUCTION

Recent developments in artificial intelligence (AI) and deep learning (DL) have enabled several advancements within orthopaedics, including outcome forecasting with predictive modelling [14, 15, 23], automated annotation of imaging studies [19, 24, 26], compilation of synthetic data using generative AI [16] and establishment of rich registries via efficient data mining [25, 30]. Another promising application of AI is the use and analysis of digital twins. Although digital twin technologies have been widely deployed in engineering, industrial and biomedical domains, their implementation in orthopaedics remains relatively limited.

Digital twins are virtual models of physical entities that are continuously updated with real‐time data. They integrate various technologies—including real‐time data collection, simulation and predictive analytics—to create accurate and dynamic representations of physical objects, systems or processes. For example, the Apollo 13 mission is famously cited as the first application of digital twin technologies [10]. Following an in‐flight explosion damaging the spacecraft's main engine, NASA mission controllers used data from the compromised spacecraft to modify and dynamically evolve earth‐bound simulators, ultimately enabling the astronauts to return home safely. This example highlights an important distinction between digital twins and traditional model simulations: rather than existing as static models, digital twins are iteratively updated with real‐time data from their physical counterparts, enabling more nuanced predictive insights.

Digital twins hold significant potential in addressing orthopaedic research questions and improving patient care and surgical outcomes, particularly when combined with novel AI developments discussed previously. In this review, we discuss four promising applications of digital twins in orthopaedics: surgical planning and simulation, patient‐specific prediction of postoperative outcomes, augmented reality (AR)‐assisted surgery and simulation‐based surgical training. Finally, we conclude with current challenges hindering the implementation of digital twins in orthopaedics, as well as future directions that may enable widespread deployment of these technologies.

SURGICAL PLANNING AND SIMULATION

Leveraging advanced imaging studies such as magnetic resonance imaging (MRI) and computed tomography (CT) scans, digital twins can be constructed to precisely model a patient's specific anatomy, which can then be used to plan particularly complex procedures. For example, a proof‐of‐concept study employed digital twins to model and analyse the atria of patients with persistent atrial fibrillation and fibrosis. Specifically, Boyle and colleagues synthesised heart structure, fibrosis and inflammation identified through MRI and positron emission tomography scans and electrophysiology studies to create personalised virtual models to identify catheter ablation targets [3]. In the context of orthopaedics, multidisciplinary teams could similarly integrate MRI and CT scans to create digital twins that capture a patient's specific bony morphology and soft tissue pathology to plan complex multiligamentous knee injuries, for example. Indeed, in a systematic review by Bjelland et al., the authors propose a conceptual digital twin system that integrates patient‐specific MRI data, real‐time intraoperative sensor information and advanced biomechanical modelling to simulate arthroscopic knee surgery with high accuracy [2]. These digital twins hold potential for orthopaedic surgeons at various levels of expertise. For junior residents, they offer a safe, realistic platform to practice technically challenging procedures through repeated simulations of patient‐specific cases. For more experienced surgeons, they serve as a valuable tool for preoperative planning and rehearsal of particularly complex or rare cases. Furthermore, instead of merely allowing the execution of a single preplanned procedure, these digital twin models can be refined and repeated with different surgical approaches, graft choices and fixation techniques, thus revealing the safest and most effective surgical plan for the patient. Notably, this surgical planning approach could be further enhanced by recent DL‐based pipelines capable of generating accurate 3D bony reconstructions using MRI alone, eliminating the need for multiple imaging studies [13, 29].

PATIENT‐SPECIFIC PREDICTION OF POSTOPERATIVE OUTCOMES

The creation of preoperative digital twins incorporating patient demographics, specific anatomy and surgical intervention represents the first step in optimising postoperative outcomes; however, these virtual models would fail to reach their full potential without continuous integration of postoperative data. Specifically, each preoperative digital twin could be dynamically updated with patient‐specific, real‐time data from the recovery process, including patient‐reported outcome measures, rehabilitation adherence and sensor data from wearable devices. Such remote patient monitoring (RPM) programmes have received growing attention within orthopaedics, particularly following total hip and knee arthroplasty [18, 21, 22, 28]. Of note, existing literature on RPM programmes in orthopaedics have primarily relied on patient surveys and simple range‐of‐motion measurements. However, RPM protocols could be significantly enhanced by adopting digital twin technologies widely applied in other industries, such as aerospace and automotive engineering.

A notable example is the use of digital twins in the aerospace industry for predictive maintenance. For instance, aircraft manufacturers such as Boeing and Rolls‐Royce have implemented digital twins to monitor the performance of engines and other components in real time, using sensor data and machine‐learning algorithms to predict wear and tear or potential malfunctions before they occur [1, 12]. By continuously updating the digital model with real‐time data from the physical system, they can foresee maintenance needs and optimise operational performance, preventing costly failures.

This predictive maintenance approach could be translated into orthopaedic surgery and postoperative care. Just as aerospace engineers use digital twins to prevent in‐flight engine failures, orthopaedic surgeons could leverage digital twins to monitor joint implants or surgical outcomes in real time. Recently, hospitals such as the Hospital for Special Surgery and Mayo Clinic have begun to implement smart orthopaedic implants for knee replacements [9, 11]. These implants use embedded sensors to capture patient‐specific data—such as movement patterns, load distribution, range of motion and other gait‐related metrics—which are transmitted to the care team in real time. This real‐time data allows orthopaedic surgeons to customise postoperative care and adjust rehabilitation protocols based on objective feedback from the smart implant, potentially enhancing recovery outcomes. However, while these pilot studies demonstrate the safety and feasibility of this technology, further research is needed to evaluate RPM's potential to predict outcomes and guide targeted intervention that prevent complications before they arise.

AR ASSISTED SURGERY

Digital twins can also be utilised in AR‐assisted surgery by providing real‐time, precise visualisations of a patient's anatomy during procedures [2, 7]. Leveraging technologies discussed previously, MRI with or without CT can be used to generate patient‐specific anatomical models, including bony morphology, soft tissues and notable neurovascular structures [13, 29]. This digital twin is then superimposed onto the surgeon's view of the operative field using an AR headset, enabling ultraprecise implant placement and safe navigation around critical structures. For example, in a recent cadaveric study evaluating the use of AR navigation in total shoulder arthroplasty, Sanchez‐Sotelo et al. demonstrated high accuracy and precision of placement of the glenoid axis pin employing CT‐generated 3D reconstructions and an AR headset [27]. Another study implementing AR guidance on real patients similarly found improved accuracy and precision of glenoid positioning compared to standard instrumentation (i.e., placement of guide pin using anatomic landmarks), highlighting clinical feasibility of AR technology [17]. Although not necessary in these two applications, the utility of AR assistance could be further augmented via continuous updating of the virtual model, for example, during acetabular reaming in hip arthroplasty. This dynamic feedback loop would allow surgeons to adjust instrument placement in real time, improving outcomes and minimising complications.

SIMULATION‐BASED SURGICAL TRAINING

The landscape of orthopaedic surgery resident education is constantly evolving, with growing use of surgical simulation and procedural skills laboratories to complement supervised surgery in the operating room. Several studies have demonstrated the effectiveness of virtual reality (VR) simulators to improve residents' performance of knee arthroscopy, total shoulder arthroplasty and shoulder arthroscopy [5, 6, 8, 20]. Studies comparing skill acquisition with cadaver laboratories versus VR simulators remain mixed, with Camp and colleagues revealing faster improvement with cadaveric specimens and Crockatt et al. finding no significant difference [5, 8]. It seems plausible that one advantage of cadaver training is representation of anatomical variations and unique pathologies, as opposed to a standardised model. However, implementation of digital twins may help bridge this gap. Specifically, the standardised models currently employed by VR simulators could be updated with real‐life, patient‐specific MRI and/or CT scans, more accurately capturing anatomical variations and pathological conditions. Moreover, use of digital twin technologies would provide the additional benefit of enabling residents to complete the same case in both the virtual and physical world. Although future research is needed to rigorously test this hypothesis, we speculate that performing the case in both environments would both improve execution of the real‐life surgery and enhance transferability of skills from the training setting to live surgery.

CONCLUSIONS

The implementation of digital twins in orthopaedics offers significant potential for enhancing surgical planning, predicting postoperative outcomes, optimising AR‐assisted surgery and advancing resident education through simulation‐based training. Despite these promising applications, several challenges must be addressed before they are fully realised. Perhaps most importantly, each advancement relies on high‐quality, large‐scale data sets to train and test the underlying AI models. Continuing the multiligamentous knee injury example described previously, simulation of different surgical approaches, graft choices and fixation techniques on a given virtual twin would require an accurate risk calculator developed using rich clinical data, similar to a recently published risk calculator predicting dislocation risk following hip arthroplasty [15]. In fact, supporting efforts to curate comprehensive data sets—including pre‐ and postoperative imaging and patient outcomes—may represent the single most impactful opportunity for orthopaedic surgeons to promote further development of digital twin technologies. Moreover, continued optimisation of AR‐assisted surgery and VR‐based training depends upon technological advancements, such as improved accuracy and reliability of AR systems in diverse settings and incorporation of realistic haptic feedback to VR simulators [4, 27]. As digital twin technologies continue to progress, their widespread adoption holds the potential to both enable innovative orthoepic research and promote the delivery of safer, individualised treatments.

AUTHOR CONTRIBUTIONS

Michael C. Dean: Study design; data acquisition; data analysis; data interpretation; manuscript drafting; critical revision. Jacob F. Oeding: Study design; data acquisition; data analysis; data interpretation; manuscript drafting; critical revision. Pedro Diniz: Study design; data acquisition; data analysis; data interpretation; manuscript drafting; critical revision. Romain Seil: Study design; data acquisition; data analysis; data interpretation; manuscript drafting; critical revision. Kristian Samuelsson: Study design; data acquisition; data analysis; data interpretation; manuscript drafting; critical revision.

CONFLICT OF INTEREST STATEMENT

The authors declare no conflict of interest.

ETHICS STATEMENT

The authors have nothing to report.

Dean, M. C. , Oeding, J. F. , Diniz, P. , Seil, R. , Samuelsson, K. & ESSKA Artificial Intelligence Working Group . (2024) Leveraging digital twins for improved orthopaedic evaluation and treatment. Journal of Experimental Orthopaedics, 11, e70084. 10.1002/jeo2.70084

REFERENCES

  • 1. Mikkelsen, D. Boeing leads the way in Digital Transformation, pioneering a new era in aerospace. Defense and Security Middle East. Accessed 8 Nov 2024. https://www.defsecme.com/defence/tech/boeing-leads-the-way-in-digital-transformation-pioneering-a-new-era-in-aerospace#:~:text=Analysis%2C%20Business%2C%20Defence-,Boeing%20leads%20the%20way%20in%20Digital%20Transformation,a%20new%20era%20in%20aerospace&text=In%20an%20industry%20as%20complex,bold%20leaps%20into%20the%20future
  • 2. Bjelland, O. , Rasheed, B. , Schaathun, H.G. , Pedersen, M.D. , Steinert, M. , Hellevik, A.I. et al. (2022) Toward a digital twin for arthroscopic knee surgery: a systematic review. IEEE Access, 10, 45029–45052. Available from: 10.1109/ACCESS.2022.3170108 [DOI] [Google Scholar]
  • 3. Boyle, P.M. , Zghaib, T. , Zahid, S. , Ali, R.L. , Deng, D. , Franceschi, W.H. et al. (2019) Computationally guided personalized targeted ablation of persistent atrial fibrillation. Nature Biomedical Engineering, 3(11), 870–879. Available from: 10.1038/s41551-019-0437-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Brockmeyer, P. , Wiechens, B. & Schliephake, H. (2023) The role of augmented reality in the advancement of minimally invasive surgery procedures: a scoping review. Bioengineering, 10(4), 501. Available from: 10.3390/bioengineering10040501 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Camp, C.L. , Krych, A.J. , Stuart, M.J. , Regnier, T.D. , Mills, K.M. & Turner, N.S. (2016) Improving resident performance in knee arthroscopy: a prospective value assessment of simulators and cadaveric skills laboratories. Journal of Bone and Joint Surgery, 98(3), 220–225. Available from: 10.2106/JBJS.O.00440 [DOI] [PubMed] [Google Scholar]
  • 6. Cannon, W.D. , Garrett, W.E. , Hunter, R.E. , Sweeney, H.J. , Eckhoff, D.G. , Nicandri, G.T. et al. (2014) Improving residency training in arthroscopic knee surgery with use of a virtual‐reality simulator. A randomized blinded study. The Journal of Bone and Joint Surgery‐American Volume, 96(21), 1798–1806. Available from: 10.2106/JBJS.N.00058 [DOI] [PubMed] [Google Scholar]
  • 7. Casari, F.A. , Navab, N. , Hruby, L.A. , Kriechling, P. , Nakamura, R. , Tori, R. et al. (2021) Augmented reality in orthopedic surgery is emerging from proof of concept towards clinical studies: a literature review explaining the technology and current state of the art. Current Reviews in Musculoskeletal Medicine, 14(2), 192–203. Available from: 10.1007/s12178-021-09699-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Crockatt, W.K. , Confino, J.E. , Kopydlowski, N.J. , Jobin, C.M. & Levine, W.N. (2023) Comparing skill acquisition and validity of immersive virtual reality with cadaver laboratory sessions in training for reverse total shoulder arthroplasty. JBJS Open Access, 8(3), e22.00141. Available from: 10.2106/JBJS.OA.22.00141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Dyslin, A. (2024) Smart knee technology allows care team to remotely monitor patients’ recovery. Mayo Clinic News Network.
  • 10. Ferguson, S. (2020) Apollo 13: The first digital twin.
  • 11. First Ever Knee Replacement with “Smart” Implant Enables Remote Patient Monitoring. Hospital for Special Surgery. Accessed 8 Nov 2024. https://news.hss.edu/first-ever-knee-replacement-with-smart-implant-enables-remote-patient-monitoring/
  • 12. How Digital Twin technology can enhance Aviation. Rolls‐Royce. Accessed 8 Nov 2024. https://www.rolls-royce.com/media/our-stories/discover/2019/how-digital-twin-technology-can-enhance-aviation.aspx
  • 13. Iwasaka‐Neder, J. , Bedoya, M.A. , Connors, J. , Warfield, S. & Bixby, S.D. (2024) Morphometric and clinical comparison of MRI‐based synthetic CT to conventional CT of the hip in children. Pediatric Radiology, 54(5), 743–757. Available from: 10.1007/s00247-024-05888-7 [DOI] [PubMed] [Google Scholar]
  • 14. Jang, S.J. , Rosenstadt, J. , Lee, E. & Kunze, K.N. (2024) Artificial intelligence for clinically meaningful outcome prediction in orthopedic research: current applications and limitations. Current Reviews in Musculoskeletal Medicine, 17(6), 185–206. Available from: 10.1007/s12178-024-09893-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Khosravi, B. , Rouzrokh, P. , Maradit Kremers, H. , Larson, D.R. , Johnson, Q.J. & Faghani, S. et al. (2022) Patient‐specific hip arthroplasty dislocation risk calculator: an explainable multimodal machine learning‐based approach. Radiology: Artificial Intelligence, 4(6), e220067. Available from: 10.1148/ryai.220067 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Khosravi, B. , Rouzrokh, P. , Mickley, J.P. , Faghani, S. , Larson, A.N. & Garner, H.W. et al. (2023) Creating high fidelity synthetic pelvis radiographs using generative adversarial networks: unlocking the potential of deep learning models without patient privacy concerns. The Journal of Arthroplasty, 38(10), 2037–2043.e1. Available from: 10.1016/j.arth.2022.12.013 [DOI] [PubMed] [Google Scholar]
  • 17. Kopriva, J.M. , McKissack, H.M. , Griswold, B.G. , Hussain, Z.B. , Cooke, H.L. , Gottschalk, M.B. et al. (2024) Mixed‐reality improves execution of templated glenoid component positioning in shoulder arthroplasty: a CT imaging analysis. Journal of Shoulder and Elbow Surgery, 33(8), 1789–1798. Available from: 10.1016/j.jse.2023.12.019 [DOI] [PubMed] [Google Scholar]
  • 18. Mehta, S.J. , Hume, E. , Troxel, A.B. , Reitz, C. , Norton, L. , Lacko, H. et al. (2020) Effect of remote monitoring on discharge to home, return to activity, and rehospitalization after hip and knee arthroplasty: a randomized clinical trial. JAMA Network Open, 3(12), e2028328. Available from: 10.1001/jamanetworkopen.2020.28328. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Mulford, K.L. , Johnson, Q.J. , Mujahed, T. , Khosravi, B. , Rouzrokh, P. & Mickley, J.P. et al. (2023) A deep learning tool for automated landmark annotation on hip and pelvis radiographs. The Journal of Arthroplasty, 38(10), 2024–2031.e1. Available from: 10.1016/j.arth.2023.05.036 [DOI] [PubMed] [Google Scholar]
  • 20. Rahm, S. , Wieser, K. , Bauer, D.E. , Waibel, F.W. , Meyer, D.C. , Gerber, C. et al. (2018) Efficacy of standardized training on a virtual reality simulator to advance knee and shoulder arthroscopic motor skills. BMC Musculoskeletal Disorders, 19(1), 150. Available from: 10.1186/s12891-018-2072-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Ramkumar, P.N. , Haeberle, H.S. , Ramanathan, D. , Cantrell, W.A. , Navarro, S.M. , Mont, M.A. et al. (2019) Remote patient monitoring using mobile health for total knee arthroplasty: validation of a wearable and machine learning–based surveillance platform. The Journal of Arthroplasty, 34(10), 2253–2259. Available from: 10.1016/j.arth.2019.05.021 [DOI] [PubMed] [Google Scholar]
  • 22. Ramkumar, P.N. , Haeberle, H.S. , Bloomfield, M.R. , Schaffer, J.L. , Kamath, A.F. , Patterson, B.M. et al. (2019) Artificial intelligence and arthroplasty at a single institution: real‐world applications of machine learning to big data, value‐based care, mobile health, and remote patient monitoring. The Journal of Arthroplasty, 34(10), 2204–2209. Available from: 10.1016/j.arth.2019.06.018 [DOI] [PubMed] [Google Scholar]
  • 23. Rouzrokh, P. , Ramazanian, T. , Wyles, C.C. , Philbrick, K.A. , Cai, J.C. & Taunton, M.J. et al. (2021) Deep learning artificial intelligence model for assessment of hip dislocation risk following primary total hip arthroplasty from postoperative radiographs. The Journal of Arthroplasty, 36(6), 2197–2203.e3. Available from: 10.1016/j.arth.2021.02.028 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Rouzrokh, P. , Wyles, C.C. , Philbrick, K.A. , Ramazanian, T. , Weston, A.D. & Cai, J.C. et al. (2021) A deep learning tool for automated radiographic measurement of acetabular component inclination and version after total hip arthroplasty. The Journal of Arthroplasty, 36(7), 2510–2517.e6. Available from: 10.1016/j.arth.2021.02.026 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Rouzrokh, P. , Khosravi, B. , Johnson, Q.J. , Faghani, S. , Vera Garcia, D.V. , Erickson, B.J. et al. (2022) Applying deep learning to establish a total hip arthroplasty radiography registry: a stepwise approach. Journal of Bone and Joint Surgery, 104(18), 1649–1658. Available from: 10.2106/JBJS.21.01229 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Rouzrokh, P. , Mickley, J.P. , Khosravi, B. , Faghani, S. , Moassefi, M. & Schulz, W.R. et al. (2024) THA‐AID: Deep learning tool for total hip arthroplasty automatic implant detection with uncertainty and outlier quantification. The Journal of Arthroplasty, 39(4), 966–973.e17. Available from: 10.1016/j.arth.2023.09.025 [DOI] [PubMed] [Google Scholar]
  • 27. Sanchez‐Sotelo, J. , Berhouet, J. , Chaoui, J. , Freehill, M.T. , Collin, P. , Warner, J. et al. (2024) Validation of mixed‐reality surgical navigation for glenoid axis pin placement in shoulder arthroplasty using a cadaveric model. Journal of Shoulder and Elbow Surgery, 33(5), 1177–1184. Available from: 10.1016/j.jse.2023.09.027 [DOI] [PubMed] [Google Scholar]
  • 28. Toogood, P.A. , Abdel, M.P. , Spear, J.A. , Cook, S.M. , Cook, D.J. & Taunton, M.J. (2016) The monitoring of activity at home after total hip arthroplasty. The Bone & Joint Journal, 98–B(11), 1450–1454. Available from: 10.1302/0301-620X.98B11.BJJ-2016-0194.R1 [DOI] [PubMed] [Google Scholar]
  • 29. Wong, V. , Calivá, F. , Su, F. , Pedoia, V. & Lansdown, D. (2023) Comparing bone shape models from deep learning processing of magnetic resonance imaging to computed tomography‐based models. JSES International, 7(5), 861–867. Available from: 10.1016/j.jseint.2023.05.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Yang, L. , Oeding, J.F. , de Marinis, R. , Marigi, E. & Sanchez‐Sotelo, J. (2024) Deep learning to automatically classify very large sets of preoperative and postoperative shoulder arthroplasty radiographs. Journal of Shoulder and Elbow Surgery, 33(4), 773–780. Available from: 10.1016/j.jse.2023.09.021 [DOI] [PubMed] [Google Scholar]

Articles from Journal of Experimental Orthopaedics are provided here courtesy of Wiley

RESOURCES