Abstract
Background
Three-dimensional view in laparoscopic general, gynaecologic and urologic surgery is an efficient, safe and sustainable innovation. The present paper is an extract taken from a full health technology assessment report on three-dimensional vision technology compared with standard two-dimensional laparoscopic systems.
Methods
A health technology assessment approach was implemented in order to investigate all the economic, social, ethical and organisational implications related to the adoption of the innovative three-dimensional view. With the support of a multi-disciplinary team, composed of eight experts working in Italian hospitals and Universities, qualitative and quantitative data were collected, by means of literature evidence, validated questionnaire and self-reported interviews, applying a final MCDA quantitative approach, and considering the dimensions resulting from the EUnetHTA Core Model.
Results
From systematic search of literature, we retrieved the following studies: 9 on general surgery, 35 on gynaecology and urology, both concerning clinical setting. Considering simulated setting we included: 8 studies regarding pitfalls and drawbacks, 44 on teaching, 12 on surgeons’ confidence and comfort and 34 on surgeons’ performances. Three-dimensional laparoscopy was shown to have advantages for both the patients and the surgeons, and is confirmed to be a safe, efficacious and sustainable vision technology.
Conclusions
The objective of the present paper, under the patronage of Italian Society of Endoscopic Surgery, was achieved in that there has now been produced a scientific report, based on a HTA approach, that may be placed in the hands of surgeons and used to support the decision-making process of the health providers.
Electronic supplementary material
The online version of this article (10.1007/s00464-017-6006-y) contains supplementary material, which is available to authorized users.
Keywords: Three-dimensional vision, Laparoscopy, Surgery, Health technology assessment, Systematic review
The introduction of new technologies into the healthcare systems should be guided frequently by qualitative approaches, since the relation between manufactures/suppliers and physicians is not economically sustainable [1] without an empirical and scientific investigation of all the possible benefits and disadvantages related to implementation of the innovation. As recommended by evidence-based medicine issues, efficacy and safety information are mandatory for the introduction of a new technology [2]. In recent years, other dimensions have acquired great importance, since a technology assessment could not consist only of cost-effectiveness aspects [3]. This is the reason for the growing attention on health technology assessment (HTA), an instrument useful in guiding the introduction of all healthcare technologies, related to the evaluation of economic, ethical, social, legal and organisational dimensions consistent with clinical governance tools. Health technology assessment (HTA) is a part of decision-making process in health system and could be considered as a form of policy research and as a source of good evidence and at the meantime that is embedded in further public and professional policy process.
HTA may also be considered as a support in the dialogue between clinicians and healthcare providers [4] and has been verified in the surgical context, where innovation plays a key role; in particular, minimally invasive surgery where, although it requires technological advancement and costly devices to be performed [5], it has proven to be effective in many fields of general, urologic and gynaecologic surgery. One such new technology in laparoscopy uses a new vision method, three-dimensional viewing (3D) that responds to the exigency of improving two-dimensional systems (2D), advancing towards a more realistic standard and closer to “open surgery” vision. However, while 3D systems are now emerging in the surgical market, as an improvement on 2D systems, they are still not widely disseminated, even though they are used in other non-medical fields.
Moving on from these premises, SICE (Società Italiana di Chirurgia Endoscopica e nuove tecnologie—Italian Society of Endoscopic Surgery and new technologies, which is affiliated to the European Society of Endoscopic Surgery—EAES), has focused its attention on 3D laparoscopic technologies within the Italian surgical setting, by means of a specific survey devoted to SICE affiliates. Sixty-two practices (university and community hospitals, with a private and public ownership) reported that 3D laparoscopy could be a favourable surgical strategy both for surgeons and for patients (65% of responders) and 82% of the surgeons involved in the survey reported that 3D could be considered the “future” of laparoscopy.
As a result, the SICE directory created a multi-disciplinary team (composed of surgeons selected by SICE, operating theatre nurses selected by Italian Association of Operating Theater Nurses—AICO, healthcare sector researchers from LIUC Cattaneo University, managerial engineers from Milan Politecnico, HTA experts from Lombardy Region, methodology experts and statisticians from Mario Negri Institute for Research), with the aim of producing a scientific report based on a HTA approach.
The objective of the present paper is the evaluation of the 3D technology compared with that of the 2D technology in the settings of general, urologic and gynaecologic surgery, and in various procedures, using a full HTA evaluation.
Methods
To achieve the above-mentioned objective, a health technology assessment was implemented. The evaluation was based on the generally accepted “Core Model” developed by the EUnetHTA Consortium [6], deploying 9 dimensions (version 2.1, April 2015) and considering the related criteria of evaluation derived from the Lombardy Region technologies assessment institutional approach [7].
The following dimensions were examined: general relevance of the pathologies (description of the diseases in which the technology could influence the outcome) and technologies (comparison of the characteristics of the existing 2D and 3D systems), safety issues (morbidity, intraoperative blood loss, safety and drawbacks of surgeons), efficacy, economic impact (activity-based cost analysis and budget impact analysis), equity, ethical and social impact, legal issues, and organisational impact (hospital stay, comfort for the surgeons, operating time and learning curve). This process was conducted considering the following setting: general surgery, gynaecology, urology, ongoing studies, teaching, pitfalls and drawbacks, surgical skills and comfort of the surgeon.
Ad hoc questionnaires were created and administered to a pool of Italian “surgical opinion” leaders (N = 8) in order to investigate their perceptions concerning equity, ethical, social, organisational and legal implications comparing 2D and 3D systems. The questionnaires were structured in accordance with a 7-item Likert scale ranging from − 3 (worse impact) to + 3 (better impact).
To obtain safety, efficacy and organisational dimensions, a systematic review of the literature evidence was carried out for each clinical or simulated, respectively, using PICO [9], PRISMA [10] and Cochrane methodologies [11]. PubMed, Scopus and Cochrane databases were systematically searched up to July 2016 for published randomised clinical trials, observational studies and meta-analyses of the selected setting and interventions.
We used the following terms and also their MESH term(s), if available: 3D, three-dimensional, 2D, two-dimensional, surgery, laparoscopy. We combined this search with each relevant setting (clinical or simulated) and their specific terms for the following categories: general surgery, gynaecology and urology, surgeons’ confidence and comfort, pitfalls and drawbacks, surgeons’ performances and teaching.
We also systematically searched the following registries up to May 2016: http://www.clinicaltrials.gov, http://www.clinicaltrialsregister.eu, http://www.anzctr.org.au, to detect ongoing studies aimed to compare 3D vs. 2D approaches.
All studies were classified using the table ‘Levels of Evidence Oxford Centre for Evidence-Based Medicine 2011’ to assess the role of each publication in terms of evidence generated.
After the medical database and registry searches, two reviewers, one surgeon and one methodologist, independently screened abstracts and full texts, and separately proceeded with data extraction. Discrepancies were solved by consensus.
Results
Comparison of the technologies under assessment
A comparative analysis of technologies between 2D and 3D systems used in the Italian market was undertaken using the technical characteristics provided by manufacturers/suppliers. Four different providers of the new 3D technology were contacted and, upon request, made available data on the standard 2D and the new 3D equipment. No significant differences were found between the various 2D systems. All the 3D technologies utilised full-HD 3D (≥ 1920 × 1080 pixels) with a 26″–32″ monitor. All systems were provided with “light and comfortable” passively polarized glasses and did not require synchronisation with the video images (as with earlier 3D systems [33]). The main characteristics of 2D and 3D systems (visual resolution, images distribution and optics) were comparable and superimposable. The systems consisted of a camera, monitor, light source and image processor: no collateral accessories were considered in the comparative cost and performance analysis. Data on median costs of the laparoscopic columns (based on the industries’ sales catalogues) were 64,774.36 euro for the 2D column and 107,577.54 euro for the 3D column. Data on dissemination of the 3D systems in Italy showed a penetration in Italian surgical units of around 15% (from a total of 876 surgical units, data extracted from an Italian national database [34]). Also considered was that the potential penetration of the new technology could reach approximately 100%, since all surgical units in Italy have a 2D laparoscopic column in their operating theatres.
Efficacy, safety and organisational results: evidence from the literature review
Seven systematic reviews were accomplished, each supported by 8–44 papers (comprehending systematic reviews, randomised controlled studies, comparative studies or prospective–retrospective cohort studies) after a selection by titles and abstract, removal of duplicates and exclusion of non-pertinent studies after full-text retrieval, as shown by Prisma flow diagrams in Online Appendix 1. Summary of findings and results for each selected study have been drafted and the data were summarised for each EuNetHTA dimension.
General relevance of the pathology
The relevance of the health problem was determined by comparing articles related to different operations for 3D vs. 2D laparoscopy in the three settings of general, urologic and gynaecologic surgery. The analysed operations were cholecystectomy, colectomy, adrenalectomy, hepatic resection, pulmonary resection, obesity surgery in the context of general surgery; hysterectomy and pelvic lymphectomy for gynaecological surgery; radical transperitoneal and retroperitoneal prostatectomy, pyeloplasty, urethroplasty and radical cystectomy for urologic surgery. A hypothetical representative pool of patients, who had undergone these surgical procedures, was defined as a general case mix of a standard and generic Italian hospital. The hypothesised case mix was derived from a recent survey performed in Campania Region [18]. In this specific setting, in the year 2014, 8566 patients underwent some kind of general, gynaecologic or urologic surgery. Out of these, 3544 patients (41.38%) underwent one of the laparoscopic operations described (Table 1).
Table 1.
Surgical field | No. of patients (%) |
---|---|
General surgery | 2567 (72.4%) |
Gynaecology | 163 (4.6%) |
Urology | 814 (23.0%) |
Total | 3544 (100%) |
Evaluation of outcomes
Two clinical settings and 4 simulated settings were explored:
3D vs. 2D in the clinical setting of general surgery: 9 comparative studies (4 randomised controlled studies—RCTs) out of 235 screened papers;
3D vs. 2D in the clinical setting of gynaecology and urology: 35 comparative studies (1 systematic review—SR and 12 RCTs) out of 667 screened papers;
3D vs. 2D, pitfalls and drawbacks in simulated settings: 8 comparative studies (5 RCTs) out of 56 screened papers;
3D vs. 2D, value in teaching for simulated settings: 44 comparative studies (1 SR and 36 RCTs) out of 267 screened papers;
3D vs. 2D, surgeons’ confidence and comfort: 12 comparative studies out of 187 screened papers;
3D vs. 2D, surgeons’ performances in the simulated setting: 34 studies (1 SR and 26 RCTs) out of 149 screened papers.
Significativity was investigated with Excel’s descriptive Statistics tool (Microsoft®).
Results in clinical settings concerning morbidity reported a significant difference in urinary continence favouring 3D in radical prostatectomy and cystectomy (p < 0.02 and 0.05), and a substantial overlap in safety issues for other surgeries.
Haemorrhages were significantly lower for 3D pelvic lymphectomy (38 vs. 65 ml, p = 0.033) and radical prostatectomy (p < 0.05), though similar in other surgical contexts.
The surgeons’ safety and comfort in the clinical setting had been examined only by three Italian studies [12–15] and demonstrated a significant advantage in terms of less visual fatigue and neck pain in 3D laparoscopy. Simulated settings failed to show statistically significant differences in the surgeons’ perspective between the two visual systems, even if results seemed inverse favouring the 2D setting but with a discomfort (in particular, related to dizziness and physical discomfort, worse in the 3D setting in 2 out of 19 studies [16, 17]) that was described as “tolerable”.
The efficacy value used in the analysis was the operating time, related to the two comparators. No significant differences emerged in the clinical setting of general surgery, even if 3D seemed to shorten the median time. This was particularly evident in laparoscopic cholecystectomy and when isolating the subgroup of “non-expert” or novice surgeons, in which the operating time significantly shortened.
To evaluate the organisational impact for general surgery, the differences in operating time were recalculated in terms of median values, considering only the articles with a significant difference between 2D and 3D (Tables 2 and 3). Tables 2 and 3 show a significant advantage in implementing the 3D technologies, both in general surgery and urology. However, no significant differences were found within the ob-gyn setting. These results, deriving from the literature evidence, were the differential values (if reported) used in the budget impact analysis in order to estimate the overall economic savings assuming the hospital point of view.
Table 2.
Table 3.
Hospitalisation
No significant differences were found between 2D and 3D technologies considering the hospital stay.
Surgeons’ comfort
Significant differences were observed in depth perception [16, 19–22] and eye–hand coordination [23, 24], favouring the 3D approach.
Surgeons’ performance
The experimental setting reported better performances (speed, accuracy) with 3D vision, both in the expert and in the novice surgeons [19, 21, 25–29]. The reduction in time was related to various tasks at the simulator (peg transfer, shape, and paper cutting, suturing, rope passing, needle capping), all statistically significant, and some studies evidenced a reduction of the error rate [31]. This is particularly significant for the novice surgeons [20, 32] who are able to perform difficult tasks more easily and feel more comfortable, and reflects on learning curves with a significant advantage in the performance of the surgical practices overall. Collateral effects (nausea, eye fatigue, visual disturbances) did not show any statistical difference between the two technologies.
Economic dimension
Since no evidence was found concerning the economic impact of 3D technology (from 42 records screened, 27 articles assessed, 27 articles excluded), this dimension was investigated through the implementation of an activity-based cost analysis (ABC) [35–37], considering a 12-month time horizon and assuming the hospital point of view. In particular, the economic evaluation of each patient undergoing a surgical procedure considered both the “surgical pathway” and the “medical pathway” in terms of length of stay, laboratory tests and other diagnostic procedures. Data included direct costs of personnel working in the operating theatre (surgeons, nurses, anaesthetists, auxiliary personnel and technical staff).
The median cost of the surgical pathway (divided in operating room costs and personnel costs) and of medical pathway is summarised in Table 4. It had been established that the median life of a laparoscopic column is approximately 8 years that provided a cost per year of 8.096,80 euro for the 2D system, and 13.447,19 euro for the 3D system. A patient’s related cost for the two technologies is shown in Table 5. The ABC, in the analysed/optimised context, reported savings ranging from 1.173 to 1.341% per year, in urology and general surgery, while an increase of 0.232% of cost per year was realised in gynaecology.
Table 4.
Surgical field | Surgical pathway (devices) | Surgical pathway (human resources) | Medical pathway | Total |
---|---|---|---|---|
General surgery | €3294.57 | €357.64 | €2148.00 | €5800.21 |
Gynaecology | €1505.63 | €283.79 | €2685.00 | €4474.42 |
Urology | €3229.72 | €320.72 | €2416.50 | €5966.94 |
Table 5.
Surgical field | No. of patients | 2D system | 3D system |
---|---|---|---|
General surgery | 2567 | €1.00 | €1.67 |
Gynaecology | 163 | €15.78 | €26.21 |
Urology | 814 | €3.16 | €5.25 |
From a budget impact point of view, the introduction of a new health technology in a specific setting needs a budget impact analysis (BIA) to support the policy makers’ decisions, in different contexts, from health system regulation to the hospital sustainability, both settings with limited economic resources [38]. In this case, laparoscopic operations were compared, presuming that they would all be performed using either 2D or 3D technology, in the same context (high-volume hospital with all medical specialties) as analysed previously. Over 1 year of activity of the three surgical branches, the adoption of a 3D system of vision would lead to an economic saving of 255,035.05 euro (− 12,451%), based on a reduction in the operating time.
To ensure the robustness of the results, a sensitivity analysis was performed, by changing the data on the reduction of the operating time using 3D technology, based on the level of evidence and recommendation of the literature data. In particular, data extracted from articles regarding general surgery, general and gynaecologic surgeries were classified with a strength between 1 and 2 (randomised controlled studies and meta-analysis [12, 13, 39, 40]), and general and gynaecologic surgery classified between 3 and 4 (comparative non-randomised or case series [42–46]). Results of the budget impact sensitivity analysis confirmed the convenience of the 3D systems, with economic advantages ranging from 1.14 to 1.37%.
Organisational, equity, ethical, social and legal impacts: evidence from the professionals’ perceptions
These dimensions were investigated with the support of qualitative questionnaires administered to experts in the field of surgery. The results are summarised in Table 6.
Table 6.
Item | 3D system | |
---|---|---|
Organisational aspects | Additional staff required | 0.857 |
Staff training | − 0.571 | |
Support staff training | − 0.429 | |
Investment in additional areas | 0.571 | |
Investment in additional equipment | 0 | |
Impact on the purchasing processes | 0.286 | |
Organisational changes | 0.429 | |
Product manageability | 1.714 | |
Improvement in the learning curve | 1.714 | |
Average value | 0.508 | |
Equity aspects | Acceptability of the technology | 1.875 |
Knowledge of the technology | 0 | |
Hospital waiting list | − 0.5 | |
Accessibility | 0.375 | |
Health migration phenomena | 1 | |
Average value | 0.55 | |
Ethical and social aspects | Patients’ autonomy preservation | 0.5 |
Impact on social costs | 0.88 | |
Impact on post-operative pain | 0.5 | |
Impact on the patients’ satisfaction | 0.88 | |
Impact on the development of surgical complications | 1.63 | |
Average value | 0.875 |
With regard to the qualitative assessment of the organisational dimension, it emerged that, over a time horizon of 12 months, the introduction of the innovative technology required the institutionalisation of specific training courses devoted to the healthcare professionals and support staff directly involved in the procedure. These had a positive impact on both the internal and the purchasing processes. Furthermore, the innovative technology could be considered as the preferable surgical strategy, in particular for its ability to accelerate the learning curve of the operators involved and its manageability, thus positively affecting the operating theatre time.
From an equity point of view, the adoption of the innovative technology would generate health migration phenomena and would lead to a significant decrease in waiting lists, thus improving access to care in order to meet the citizens’ health needs.
With regard to the ethical and social impact, clinicians declared that patients were able to experience a positive impact from the use of the innovative technology due to a decrease in the post-surgical pain procedure and to a lower risk in developing future complications.
The analysis of the legal implications reported that the two technologies under assessment could be considered superimposable in their measurement, both considering the indication of use for all the surgical procedures and for all the categories of patients, and the presence of authorisations for use.
Discussion and conclusions
The development of laparoscopic surgery, over the past 20 years, has improved the outcomes of patients by reducing surgical trauma, hospital stay, post-operative pain and performance status. However, laparoscopy is more difficult to perform and to apprehend, mainly due to two-dimensional vision, limited movements and instrumentation, and impaired tactile feedback.
To bypass some of these problems, research has turned to three-dimensional vision, applied per se or associated to robotic platforms. To date, there have been few clinical trials as 3D platforms are poorly disseminated in surgical practices, mainly due to cost-containment reasons. Clinical guidelines and consensus conferences are not sufficient in order to validate the introduction of a new surgical technology: the sustainability and the economic impact, associated with the evidence of a clinical improvement (related both to the patients and the operators) requires an in depth examination.
A strategic tool that could overcome the above-mentioned limitations is the health technology assessment (HTA). However, it would require a new common language to be shared between physicians, engineers, managers and healthcare providers.
The present paper may be considered as the first attempt to produce a complete HTA report within the surgical field, as a multi-disciplinary exercise involving all the professionals, under the patronage of the Italian Society of Endoscopic Surgery and new technologies (SICE), an affiliate of the European Association of Endoscopic Surgery (EAES).
Results of the clinical trials favour 3D vision in terms of blood loss, operative time and hospital stay (though the main results, regarding comfort for the surgeon, have been investigated in simulated settings that have shown a better depth perception, hands–eyes coordination and accuracy). The performances, in particular for novice surgeons, appear to be improved using 3D vision, with faster and more precise resolution of laparoscopic tasks. Sensations of neck and back pain, physical fatigue, nausea and dizziness have different rates between the clinical setting (in which they appear to be worse for 3D vision) and the simulated setting (in which they ameliorate for 3D vision), even if the worse results seem to be associated with earlier 3D systems and lose significance in the later ones.
All this suggested that there was a need for further studies and investigation in order to better point out such drawbacks.
In this view, literature reported 14 ongoing clinical trials related to this topic (http://www.clinicaltrials.gov, https://www.clinicaltrialsregister.eu, http://www.anzctr.org.au), 12 of which are RCTs, starting between January 2010 to March 2015 and that are distributed throughout Europe (5), America (2) and Asia (7). Of these, five have been completed but their results have not yet published, seven are still recruiting and two are not yet recruiting. Their research is focused on laparoscopic cholecystectomy (4), hernia repair (2), colectomy (1), pancreatectomy (1), gastric surgery (1), transanal endoscopic microsurgery (1), gynaecologic–urologic pelvic surgery (2) and laparoscopy in general (2). Results are expected by 2020.
The multi-dimensional evaluation suggested, as perceived by Italian surgeons in the ex-ante survey, some advantages of the implementation of the new technology, without the need of significant economic additional investment for the Healthcare Systems. The economic assessment, in fact, reports how the implementation of the new technology, in particular if considered whenever a renewal of the laparoscopic instrumentation is programmed, would not require additional investment, thus resulting in a substantial economic neutrality and sustainability. Furthermore, 3D vision could be considered not only a privilege for centres of excellence, but instead the norm, applicable in most different realities of public or private healthcare contexts.
Finally, it should be mentioned that the present study has limitations; for example, the surveys and the consensus were related specifically to surgical experts, without participation of other subjects who nowadays also take part in health decisions, such as patients’ associations [8, 30].
Electronic supplementary material
Below is the link to the electronic supplementary material.
Acknowledgements
Politecnico di Milano, IRCCS-Istituto di Ricerche Farmacologiche Mario Negri, Regione Lombardia, LIUC-Università Cattaneo, Associazione Italiana Ingegneri Clinici, Associazione Infermieri di Camera Operatoria, Federazione Italiana Aziende Sanitarie e Ospedaliere, Bbraun Italia, Conmed Italia, Olympus Italia, Storz Italia. Thanks also to the rest of the scientific committee: Ferdinando Agresta, Valentino Fiscon, Carlo Bergamini, Gaspare Gullotta, Marco Ettore Allaix, Gianandrea Baldazzi, Fabio Cesare Campanile, Giovanni Sgroi, Sarah Molfino, Gian Paolo Zanchi, Tommaso Fontana, Pietro Barbieri, Angelo Iossa, Giuseppe Navarra, Enrico Restini, Luigi Boni, Ugo Elmore, Gianluca Garulli, Mario Guerrieri, Wanda Luisa Petz, Alessandro Puzziello, Simone Vita.
Compliance with ethical standards
Disclosures
Dr. Foglia reports grants from Gilead Sciences Srl, grants from Fondazione Cariplo, non-financial support from ACOI/SIC/SICE/SICU Surgery Societies, personal fees from Formazione Peperosso Srl, outside the submitted work. Dr. Morino reports personal fees from Karl Storz Endoscopie, outside the submitted work. Dr. Tringali reports personal fees and non-financial support from ALTEMS—Catholic University Roma, personal fees and non-financial support from Innovative Medicines Joint Undertaking 2 (IMI2 JU), Bruxelles, personal fees and non-financial support from Ist. Sup. Studi Sanitari G. Cannarella, Roma, personal fees from Universita’ Piemonte Orientale, Novara, personal fees from AGENAS (Italian Agency Health Care Quality and Research), Roma, personal fees from MA Provider SrL, Milano, non-financial support from SIFO (Italian Society Hospital Pharmacysts), non-financial support from SHIRE, Milano, non-financial support from Italian Ministry of Health, Roma, non-financial support from ACOI/SIC/SICE/SICU Surgery Societies, outside the submitted work. Dr. Vettoretto reports personal fees from BBraun, outside the submitted work. Drs Anania, Arezzo, Cirocchi, Cocorullo, Currò, Ferrario, Gerardi, Lettieri, Marchi, Nocco, Piccoli, Portale, Silecchia, Valeri have no conflicts of interest or financial ties to disclose.
Footnotes
Electronic supplementary material
The online version of this article (10.1007/s00464-017-6006-y) contains supplementary material, which is available to authorized users.
References
- 1.Stefanidis D, Fanelli RD, Price R, Richardson W. SAGES Guidelines Committee. SAGES guidelines for the introduction of new technology and techniques. Surg Endosc. 2014;28(8):2257–2271. doi: 10.1007/s00464-014-3587-6. [DOI] [PubMed] [Google Scholar]
- 2.McPeek B, Mosteller F, McKneally M. Randomized clinical trials in surgery. Int J Technol Assess Health Care. 1989;5(3):317–332. doi: 10.1017/S026646230000739X. [DOI] [PubMed] [Google Scholar]
- 3.Marshall DA, Hux M. Design and analysis issues for economic analysis alongside clinical trials. Med Care. 2009;47(7 Suppl 1):S14–S20. doi: 10.1097/MLR.0b013e3181a31971. [DOI] [PubMed] [Google Scholar]
- 4.Institute of Medicine (US) Committee on Quality of Health Care in America . Crossing the quality chasm: a new health system for the 21st century. Washington (DC): National Academies Press (US); 2001. [PubMed] [Google Scholar]
- 5.Chao TE, Mandigo M, Opoku-Anane J, Maine R. Systematic review of laparoscopic surgery in low- and middle-income countries: benefits, challenges, and strategies. Surg Endosc. 2016;30(1):1–10. doi: 10.1007/s00464-015-4201-2. [DOI] [PubMed] [Google Scholar]
- 6.EuroScan International Network . A toolkit for the identification and assessment of new and emerging health technologies. EuroScan International Network: Birmingham; 2014. [Google Scholar]
- 7.Radaelli G, Lettieri E, Masella C, Merlino L, Strada A, Tringali M. Implementation of EUnetHTA core Model® in Lombardia: the VTS framework. Int J Technol Assess Health Care. 2014;30(1):105–112. doi: 10.1017/S0266462313000639. [DOI] [PubMed] [Google Scholar]
- 8.Thokala P, Duenas A. Multiple criteria decision analysis for health technology assessment. Value Health. 2012;15(8):1172–1181. doi: 10.1016/j.jval.2012.06.015. [DOI] [PubMed] [Google Scholar]
- 9.Schardt C, Adams MB, Owens T, Keitz S, Fontelo P. Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Med Inform Decis Mak. 2007;7:16. doi: 10.1186/1472-6947-7-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009;62(10):e1–e34. doi: 10.1016/j.jclinepi.2009.06.006. [DOI] [PubMed] [Google Scholar]
- 11.Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series Edited by Julian PT Higgins and Sally Green 2008 The Cochrane Collaboration. ISBN: 978–0-470-69951-5
- 12.Currò G, La Malfa G, Lazzara S, Caizzone A, Fortugno A, Navarra G. Three-dimensional versus two-dimensional laparoscopic cholecystectomy: is surgeon experience relevant. J Laparoendosc Adv Surg Tech A. 2015;25(7):566–570. doi: 10.1089/lap.2014.0641. [DOI] [PubMed] [Google Scholar]
- 13.Currò G, La Malfa G, Caizzone A, Rampulla V, Navarra G. Three-dimensional (3D) versus two-dimensional (2D) laparoscopic bariatric surgery: a single-surgeon prospective randomized comparative study. Obes Surg. 2015;25(11):2120–2124. doi: 10.1007/s11695-015-1674-y. [DOI] [PubMed] [Google Scholar]
- 14.Currò G, Cogliandolo A, Bartolotta M, Navarra G. Three-dimensional versus two-dimensional laparoscopic right hemicolectomy. J Laparoendosc Adv Surg Tech A. 2016;26(3):213–217. doi: 10.1089/lap.2015.0557. [DOI] [PubMed] [Google Scholar]
- 15.Agrusa A, di Buono G, Chianetta D, Sorce V, Citarrella R, Galia M, Vernuccio L, Romano G, Gulotta G. Three-dimensional (3D) versus two-dimensional (2D) laparoscopic adrenalectomy: a case-control study. Int J Surg. 2016;28(Suppl1):S114–S117. doi: 10.1016/j.ijsu.2015.12.055. [DOI] [PubMed] [Google Scholar]
- 16.Usta TA, Ozkaynak A, Kovalak E, Ergul E, Naki MM, Kaya E. An assessment of the new generation three-dimensional high definition laparoscopic vision system on surgical skills: a randomized prospective study. Surg Endosc. 2015;29(8):2305–2313. doi: 10.1007/s00464-014-3949-0. [DOI] [PubMed] [Google Scholar]
- 17.Ko JK, Li RH, Cheung VY. Two-dimensional versus three-dimensional laparoscopy: evaluation of physicians’ performance and preference using a pelvic trainer. J Minim Invasive Gynecol. 2015;22(3):421–427. doi: 10.1016/j.jmig.2014.11.007. [DOI] [PubMed] [Google Scholar]
- 18.Assessorato alla Sanità di Regione Campania (2015) Sorveglianza delle infezioni del sito chirurgico in Campania
- 19.Feng X, Morandi A, Boehne M, Imvised T, Ure BM, Kuebler JF, Lacher M. 3-Dimensional (3D) laparoscopy improves operating time in small spaces without impact on hemodynamics and psychomental stress parameters of the surgeon. Surg Endosc. 2015;29(5):1231–1239. doi: 10.1007/s00464-015-4083-3. [DOI] [PubMed] [Google Scholar]
- 20.Özsoy M, Kallidonis P, Kyriazis I, Panagopoulos V, Vasilas M, Sakellaropoulos GC, Liatsikos E. Novice surgeons: do they benefit from 3D laparoscopy? Lasers Med Sci. 2015;30(4):1325–1333. doi: 10.1007/s10103-015-1739-0. [DOI] [PubMed] [Google Scholar]
- 21.Lusch A, Bucur PL, Menhadji AD, Okhunov Z, Liss MA, Perez-Lanzac A, McDougal EM, Landman J. Evaluation of the impact of three-dimensional vision on laparoscopic performance. J Endourol. 2014;28(2):261–266. doi: 10.1089/end.2013.0344. [DOI] [PubMed] [Google Scholar]
- 22.Kong SH, Oh BM, Yoon H, Ahn HS, Lee HJ, Chung SG, Shiraishi N, Kitano S, Yang HK. Comparison of two- and three-dimensional camera systems in laparoscopic performance: a novel 3D system with one camera. Surg Endosc. 2010;24(5):1132–1143. doi: 10.1007/s00464-009-0740-8. [DOI] [PubMed] [Google Scholar]
- 23.Chiu CJ, Lobo Prabhu K, Tan-Tam CC, Panton ON, Meneghetti A. Using three-dimensional laparoscopy as a novel training tool for novice trainees compared with two-dimensional laparoscopy. Am J Surg. 2015;209(5):824–827. doi: 10.1016/j.amjsurg.2015.01.007. [DOI] [PubMed] [Google Scholar]
- 24.Cicione A, Autorino R, Laguna MP, De Sio M, Micali S, Turna B, Sanchez-Salas R, Quattrone C, Dias E, Mota P, Bianchi G, Damano R, Rassweiler J, Lima E. Three-dimensional technology facilitates surgical performance of novice laparoscopy surgeons: a quantitative assessment on a porcine kidney model. Urology. 2015;85(6):1252–1256. doi: 10.1016/j.urology.2015.03.009. [DOI] [PubMed] [Google Scholar]
- 25.Peitgen K, Walz MV, Walz MV, Holtmann G, Eigler FW. A prospective randomized experimental evaluation of three-dimensional imaging in laparoscopy. Gastrointest Endosc. 1996;44(3):262–267. doi: 10.1016/S0016-5107(96)70162-1. [DOI] [PubMed] [Google Scholar]
- 26.van Bergen P, Kunert W, Bessell J, Buess GF. Comparative study of two-dimensional and three-dimensional vision systems for minimally invasive surgery. Surg Endosc. 1998;12(7):948–954. doi: 10.1007/s004649900754. [DOI] [PubMed] [Google Scholar]
- 27.Tevaearai HT, Mueller XM, von Segesser LK. 3-D vision improves performance in a pelvic trainer. Endoscopy. 2000;32(6):464–468. doi: 10.1055/s-2000-643. [DOI] [PubMed] [Google Scholar]
- 28.Patel HR, Ribal MJ, Arya M, Nauth-Misir R, Joseph JV. Is it worth revisiting laparoscopic three-dimensional visualization? A validated assessment. Urology. 2007;70(1):47–49. doi: 10.1016/j.urology.2007.03.014. [DOI] [PubMed] [Google Scholar]
- 29.Wilhelm D, Reiser S, Kohn N, Witte M, Leiner U, Mühlbach L, Ruschin D, Reiner W, Feussner H. Comparative evaluation of HD 2D/3D laparoscopic monitors and benchmarking to a theoretically ideal 3D pseudodisplay: even well-experienced laparoscopists perform better with 3D. Surg Endosc. 2014;28(8):2387–2397. doi: 10.1007/s00464-014-3487-9. [DOI] [PubMed] [Google Scholar]
- 30.Mashiach R, Mezhybovsky V, Nevler A, Gutman M, Ziv A, Khaikin M. Three-dimensional imaging improves surgical skill performance in a laparoscopic test model for both experienced and novice laparoscopic surgeons. Surg Endosc. 2014;28(12):3489–3493. doi: 10.1007/s00464-014-3635-2. [DOI] [PubMed] [Google Scholar]
- 31.Smith R, Day A, Rockall T, Ballard K, Bailey M, Jourdan I. Advanced stereoscopic projection technology significantly improves novice performance of minimally invasive surgical skills. Surg Endosc. 2012;26(6):1522–1527. doi: 10.1007/s00464-011-2080-8. [DOI] [PubMed] [Google Scholar]
- 32.Ashraf A, Collins D, Whelan M, O’Sullivan R, Balfe P. Three-dimensional (3D) simulation versus two-dimensional (2D) enhances surgical skills acquisition in standardised laparoscopic tasks: a before and after study. Int J Surg. 2015;14:12–16. doi: 10.1016/j.ijsu.2014.12.020. [DOI] [PubMed] [Google Scholar]
- 33.Hanna GB, Drew T, Clinch P, Hunter B, Cuschieri A. Computer-controlled endoscopic performance assessment system. Surg Endosc. 1998;12(7):997–1000. doi: 10.1007/s004649900765. [DOI] [PubMed] [Google Scholar]
- 34.http://95.110.213.190/PNEed15/
- 35.Raffish N, Turney P. Glossary of activity-based management. J Cost Manag. 1991;5:53–63. [Google Scholar]
- 36.Drucker P. The information executives truly need. Harvard Bus Rev. 1995;73:54–64. [Google Scholar]
- 37.Vagnoni E, Potena G. L’activity based costing in sanità: il caso dell’ossigeno-terapia. Mecosan. 2003;47:149–161. [Google Scholar]
- 38.Mauskopf JA, Sullivans SD, Annemans L, et al. Principles of good practice for budget impact analysis: report of the ISPOR task force on good research practices-budget impact analysis. Value Health. 2007;10:336–347. doi: 10.1111/j.1524-4733.2007.00187.x. [DOI] [PubMed] [Google Scholar]
- 39.Bilgen K, Ustün M, Karakahya M, Işik S, Sengül S, Cetinkünar S, Küçükpinar TH. Comparison of 3D imaging and 2D imaging for performance time of laparoscopic cholecystectomy. Surg Laparosc Endosc Percutan Tech. 2013;23(2):180–183. doi: 10.1097/SLE.0b013e3182827e17. [DOI] [PubMed] [Google Scholar]
- 40.Bove P, Iacovelli V, Celestino F, De Carlo F, Vespasiani G, Agrò EF. 3D vs 2D laparoscopic radical prostatectomy in organ-confined prostate cancer: comparison of operative data and pentafecta rates: a single cohort study. BMC Urol. 2015;15:12. doi: 10.1186/s12894-015-0006-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Tang FJ, Qi L, Jiang HC, Tong SY, Li Y. Comparison of the clinical effectivness of 3D and 2D imaging systems for laparoscopic radical cystectomy with pelvic lymph node dissection. J Int Med Res. 2016;44(3):613–619. doi: 10.1177/0300060515621445. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Velayutham V, Fuks D, Nomi T, Kawaguchi Y, Gayet B. 3D visualization reduces operating time when compared to high-definition 2D in laparoscopic liver resection: a case-matched study. Surg Endosc. 2016;30(1):147–153. doi: 10.1007/s00464-015-4174-1. [DOI] [PubMed] [Google Scholar]
- 43.Sahu D, Mathew MJ, Reddy PK. 3D laparoscopy—help or hype; initial experience of a tertiary health centre. J Clin Diagn Res. 2014;8(7):NC01–NC03. doi: 10.7860/JCDR/2014/8234.4543. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Yang CL, Wang W, Mo LL, Zhang L, Peng GL, Yu ZW, Liu YY, He JX. Short-term outcome of three-dimensional versus two-dimensional video-assisted thoracic surgery for benign pulmonary diseases. Ann Thorac Surg. 2016;101(4):1297–1302. doi: 10.1016/j.athoracsur.2015.10.042. [DOI] [PubMed] [Google Scholar]
- 45.Aykan S, Singhal P, Nguyen DP, Yigit A, Tuken M, Yakut E, Colakerol A, Sulejman S, Semercioz A. Perioperative, pathologic, and early continence outcomes comparing three-dimensional and two-dimensional display systems for laparoscopic radical prostatectomy—a retrospective, single-surgeon study. J Endourol. 2014;28(5):539–543. doi: 10.1089/end.2013.0630. [DOI] [PubMed] [Google Scholar]
- 46.Xu W, Li H, Ji Z, Zhang X, Zhang Y, Xiao H, Liu G. Comparison of three dimensional and two dimentional laparoscopic pyeloplasty for ureteropelvic junction obstruction. Zhonghua Wai Ke Za Zhi. 2014;52(10):771–774. [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.