Abstract
The aim of this study is to evaluate the accuracy of outcome reporting after elective visceral surgery in a low volume district hospital. Outcome measurement as well as transparent reporting of surgical complications becomes more and more important. In the future, financial and personal resources may be distributed due to reported quality and thus, it is in the main interest of healthcare providers that outcome data are accurately collected. Between 10/2020 and 09/2021 postoperative complications during the hospitalisation were recorded using the Clavien–Dindo classification (CDC) and comprehensive complication index by residents of a surgical department in a district hospital. After one year of prospective data collection, data were retrospectively analyzed and re-evaluated for accuracy by senior consultant surgeons. In 575 patients undergoing elective general or visceral surgery interns and residents reported an overall rate of patients with complications of 7.3% (n = 42) during the hospitalization phase, whereas a rate of 18.3% (n = 105) was revealed after retrospective analysis by senior consultant surgeons. Thus, residents failed to report patients with postoperative complications in 60% of cases (63/105). In the 42 cases, in which complications were initially reported, the grading of complications was correct only in 33.3% of cases (n = 14). Complication grades that were most missed were CDC grade I and II. Quality of outcome measurement in a district hospital is poor if done by unexperienced residents and significantly underestimates the true complication rate. Outcome measurement must be done or supervised by experienced surgeons to ensure correct and reliable outcome data.
Subject terms: Health services, Outcomes research
Introduction
Complications following surgical interventions were identified as a global medical problem by the World Health Organisation (WHO) already in 20081. They cause individual suffering and dissatisfaction, reduce the quality of life of those affected and are associated with enormous costs2,3. Today, more and more surgical centres are assessing and comparing the quality of their services on the basis of the results obtained using the Clavien–Dindo classification. The Clavien–Dindo classification (CDC), first published in 19924 and substantially revised and validated in 20045, consists of 5 grades based on the therapeutic consequences of a postoperative complication. In 2014, the same research group complemented the CDC with the comprehensive complication index (CCI®), which reflects an overall postoperative morbidity based on the ranking of all reported CDC complications in a case6. The CDC is now the most widely used classification of postoperative complications and the most commonly used tool to assess and compare quality in surgery7–10.
In times of limited resources and increasing competition between different healthcare providers, it is not only important to collect this data, but also to make the collection as accurate and reliable as possible. It is well highlighted in the medical literature that consistent reporting of surgical outcome data is often lacking or of poor quality11.
Thus, the aim of this study was to evaluate the accuracy and reliability of the intern and resident-reported CDC and CCI® scores for postoperative complications in elective general and visceral surgery in a district hospital with predominantly low risk cases.
Methods
This retrospective, single-institution study included a prospective database collection from October 2020 to September 2021. All adult patients undergoing elective surgical treatment at the Department of General Surgery at Maennedorf Hospital, Switzerland, were included. All patients gave informed consent to use their data for research purposes via a general consent. The Cantonal Ethics Committee of Zurich concluded this study did not fall under the scope of the Swiss Human Research Act; thus, ethical approval was not required (Human Research Ordinance HRO; RS 810.301). The study was conducted in accordance to local legislation and the Declaration of Helsinki.
The project was initiated in October 2020 to test the quality of outcome reporting using CDC (the highest score) and CCI® Score for all operated patients during their hospitalization. The recording of post-operative complications based on the CDC was carried out by residents, who received a one-hour introduction on the CDC prior to the implementation. The CDC grade for each patient was determined by a ward intern or a first-year resident, and the CCI®score was automatically calculated using a predetermined formula6.
One year after the implementation of the CDC, senior consultant surgeons (I.R. and T.M.) conducted a thorough data audit, which included reviewing discharge summaries, electronic inpatient and outpatient medical records, blood test results, hospital medication lists, hospital notes, and diagnostic tests to confirm or refute the initial CDC grade and CCI® scores reported by the interns and first-year residents. All complications that occurred postoperatively during the hospitalization were carefully investigated.
Surgical procedures were divided into the following five specialties: bariatric surgery (BS), cholecystectomies (CHE), abdominal wall surgery (AWS), colorectal surgery (CRS), and Varia. The Varia group consisted mainly of local excision or surgical wound-conditioning procedures and laparoscopic hiatoplasty.
Statistical analysis
All data were subjected to statistical analysis and data visualisation using Statistical Package for the Social Sciences (SPSS) Version 28.0.1.1 for Mac/Windows (SPSS Inc., Chicago, IL, USA). Descriptive data are reported as numbers and percentages with mean and standard deviation.
Ethical approval
The Cantonal Ethics Committee of Zurich concluded this study did not fall under the scope of the Swiss Human Research Act; thus, ethical approval was not required. All patients gave informed consent to use their data for research purposes via a general consent.
Results
In total, 575 patients received an elective general or visceral surgical operation between 10/2020 and 09/2021 and were included in the analysis. There were 47% female patients, and mean age was 55.0 ± 16.8 years. The mean body mass index (BMI) of the study population was 29.7 ± 7.8 kg/m2. In terms of comorbidities, the majority of the study population was healthy, with 68.4% of patients having a Charlson comorbidity index score of 0 and 14.4% having a score of 1. The mean American Society of Anesthesiologists (ASA) score was 2, with 75% of patients being classified as ASA I (14%) or ASA II (61%) preoperatively. The surgical case mix consisted of 42% (n = 241) abdominal wall surgery, 23% (n = 132) bariatric surgery, 14% (n = 81) colorectal surgery, 13% (n = 76) cholecystectomy, and 8% (n = 45) Varia. Demographic and pre-operative clinical data are summarized in Table 1.
Table 1.
Patient`s characteristics.
| Patient`s characteristics | Total (n = 575) M (± SD) or N (%) |
|---|---|
| Gender (male/female) |
306/269 (53%/47%) |
| Age (years) | 55.03 ± 16.77 |
| BMI (kg/m) | 29.68 ± 7.81 |
| ≤ 18 | 7 (1.2%) |
| 18.5–24.9 | 172 (29.9%) |
| 25.0–29.9 | 178 (31.0%) |
| 30.0–34.9 | 60 (10.4%) |
| 35.0–39.9 | 66 (11.5%) |
| ≥ 40 | 87 (15.1%) |
| NA | 5 (0.9%) |
| ASA | |
| ASA 1 | 80 (14%) |
| ASA 2 | 350 (61%) |
| ASA 3 | 144 (25%) |
| ASA 4 | 1 (0%) |
| Charlson comorbidity index | |
| 0 | 393 (68.35%) |
| 1 | 83 (14.43%) |
| 2 | 66 (11.48%) |
| 3 | 19 (3.30%) |
| ≥ 4 | 14 (2.43%) |
| Smoking habits | |
| Current | 147 (25.6%) |
| Former | 32 (5.6%) |
| Never | 226 (39.3%) |
| NA | 170 (29.6%) |
| Surgical procedures | |
| BS | 132 (23%) |
| CHE | 76 (13%) |
| AWS | 241 (42%) |
| CRS | 81 (14%) |
| Varia | 45 (8%) |
M mean, N number, SD standard deviation, BMI body mass index, ASA American Society of Anesthesiologists, NA not available data.
Differences in outcome reporting before and after revision
The interns and first-year residents of the department reported postoperative complications in 7.3% of patients (42/575), while the retrospective review of the cases by senior consultant surgeons revealed a complication rate of 18.3% (105/575). Thus, interns and first-year residents failed to detect 60% (63/105) of patients with complications that occurred during hospitalization. In the 42 cases, in which complications were initially reported, the grading of complications was correct only in 14 cases (33.3%) (Tables 2 and 3). Among the remaining 28 cases with incorrect complication reports, 32% (9/28) showed revised CCI® scores that were almost 20 points higher as previously reported (Fig. 1). The total number of complications in these 9 cases was 51, of which only 13 were initially reported: 100% of grade I complications (17/17), 62% of grade II complications (13/21), 37.5% of grade IIIa complications (3/8), and all grade IVa complications (5/5) were not reported.
Table 2.
Characteristics of Clavien–Dindo classification (CDC) reporting: reported versus revised cases.
| Recorded data | Revised data | |
|---|---|---|
| Cases with complications | 42 (7.3%) | 105 (18.3%) |
| Cases with no complications | 530 (92.2%) | 470 (81.7%) |
| NA | 3 (0.5%) | – |
NA not available data.
Table 3.
Accuracy of complication-reporting.
| Accuracy of cases with complications (n = 105) | |||
|---|---|---|---|
| Correct reported (n, %) | False reported (n, %) | Not reported (n, %) | NA (N, %) |
| 14 (13.3%) | 28 (26.7%) | 60 (57.2%) | 3 (2.8%) |
NA no available data.
Figure 1.
Distribution of 9 cases with a CCI® score almost 20 points higher after revision. One line = one case. CCI®, comprehensive complications index.
The 105 patients who had a complicated course after the review showed a total of 217 complications of varying degrees according to CDC (grade I: 101, grade II: 79, grade IIIa: 9, grade IIIb: 15, grade IVa: 12, grade IVb: 0, grade V: 1). The review of the Clavien–Dindo grades demonstrated that 94% (95/101) of grade I complications, 63.3% (50/79) of grade II complications, 11.1% (1/9) of grade IIIa complications, 26.6% (4/15) of grade IIIb complications, and 50% (6/12) of grade IVa complications were missed. The single grade V complication was correctly reported (Fig. 2). The mean reported CCI® score of the 42 cases with complications as reported by residents was 30.9 ± 18.1, whereas the mean revised CCI® score of these 42 cases was 39.4 ± 21.1 (Table 4).
Figure 2.
Number of reported and revised grades (according to Clavien Dindo Classification).
Table 4.
Comparison of reported CDC Grades before and after control.
| Outcomes | Reported N | Revised N |
|---|---|---|
| Patients with reported postoperative complications (N) | 42 | 42 |
| Type of CDC grade | ||
| I | 6 | 41 |
| II | 29 | 55 |
| IIIa | 8 | 7 |
| IIIb | 11 | 15 |
| IVa | 6 | 12 |
| IVb | 0 | 0 |
| V | 1 | 1 |
| NA | 3 | 0 |
| CCI® score (mean, ± SD) | 30.9 ± 18.1 | 39.4 ± 21.1 |
CDC Clavien–Dindo classification, CCI® Comprehensive Complication Index, NA not available data.
When comparing the mean CCI® scores among the 105 patients who experienced complications, it was observed that the score was 12.1 (± 18.9) before revision and increased to 23.8 (± 18.6) after revision. The change in CCI® scores after control and revision by experienced surgeons for each individual patient is graphically demonstrated in Fig. 3.
Figure 3.
All patients with complications (n = 105) and their consecutive CCI® scores before and after control. One line = one patient. CCI®, comprehensive complications index.
Corrected postoperative morbidity related to surgical specialties
Overall, a total of 217 complications occurred in 105 of the 575 patients; 180 (83%) were minor (≤ grade II) complications (46.5% grade I and 36.5% grade II); 37 (17%) were major (≥ grade III) complications, which occurred in 27 patients.
The highest rate of postoperative complications was found in the colorectal surgery (CRS) group. 43.2% (35/81) of this population showed complications in the postoperative course with 10 out of all 15 grade IIIb complications and 5 out of all 12 grade IVa complications, respectively, assigned to CRS patients.
The varia surgery group had the highest CCI® score of all complicated cases (35.8 ± 28.2) due to one death. The overall CCI® score of all surgical cases was 4.4 ± 12.2, whereas the overall CCI® score of all cases with complications in all surgical subgroups was 23.8 ± 18.6. The analysis of CDC complication and its CCI® score based on case mix subgroups is shown in Table 5.
Table 5.
Characteristic of surgical procedures according to CDC and CCI®
| Surgical groups | Number | Complication rate (N, %) | CDC Grade | CCI® of all cases (M, ± SD) | CCI® of all cases with complications (M, ± SD) |
|---|---|---|---|---|---|
| BS | 132 | 12 (9.1%) | 12 × I, 9 × II, 2 × IIIa, 3 × IVa | 2.3 ± 9.1 | 25.1 ± 19.1 |
| CHE | 76 | 7 (9.2%) | 2 × I, 3 × II, 2 × IIIa | 1.7 ± 5.9 | 18.9 ± 7.4 |
| AWR | 241 | 40 (16.6%) | 34 × I, 23 × II, 1 × IIIa, 4 × IIIb, 2 × IVa | 3.2 ± 8.7 | 19.2 ± 12.6 |
| CRS | 81 | 35 (43.2%) | 40 × I, 34 × II, 1 × IIIa, 10 × IIIb, 5 × IVa | 11.3 ± 18.9 | 26.1 ± 21.1 |
| Varia | 45 | 11 (24%) | 14 × I, 10 × II, 3 × IIIa, 1 × IIIb, 2 × IVa, 1 × V | 8.6 ± 20.3 | 35.8 ± 28.2 |
CDC Clavien–Dindo classification, CCI® Comprehensive Complication Index.
Discussion
The results of the present study suggest that reporting of postoperative complications using the CDC and CCI® by inexperienced interns and residents is neither reliable nor accurate in a low volume district hospital.
Consistent and accurate classification of postoperative complications is critical for the comparison of surgical procedures and outcomes, leading to continuous improvements in patient care2,12,13. Currently, the CDC and CCI® are widely used as benchmark tools in surgery to establish a baseline for assessing and evaluating the quality of surgical care and outcomes14–18. Initially, the CDC was validated 30 days postoperatively. However, both the CDC and the CCI® have now been clinically and economically validated for 90 postoperatively19,20.
Improving the quality of healthcare and reducing its costs are essential components of modern medicine. The need for high quality healthcare has influenced surgical practice, the reporting of surgical outcomes, and the establishment of benchmarks for surgical treatments21. Patients and insurers now have greater access to medical information and expect surgeons to be up to date, competent, empathetic, and to provide high-quality care in an efficient manner22,23. The purpose of reporting and classifying adverse surgical outcomes is to investigate the underlying factors that contribute to them and to identify measures to prevent their recurrence in the future. This, in turn, will improve the quality of care and reduce the cost of complications. It also allows surgeons to objectively assess their surgical skills, improve surgical outcomes to the best possible result, reduce patient mortality rates, and improve patients’ postoperative quality of life.
In our study the review of data on postoperative complications reported by residents has shown a significantly high number of unreported complications, with a true overall complication rate of 18.3% (105/575) compared to 7.8% (42/575) before revision by senior consultants. More than 60% of patients with postoperative complications were not reported, and the accuracy of reported complications was only 33.3%. According to the literature, under-reporting of postoperative complications is a well-documented problem in surgery24–28. Several studies have shown that the true incidence of postoperative complications is often higher compared to the numbers reported in medical records and published studies29,30. Such under-reporting can have serious consequences for patient care, as it can obscure the true prevalence and impact of complications and hinder efforts to improve quality and develop evidence-based practice. To address this issue, many researchers have called for better standardization and documentation of postoperative complications, as well as improved education and awareness among healthcare providers. The use of standardized reporting systems, such as the Clavien–Dindo classification, has also been shown to be effective in improving the accuracy and completeness of outcome reporting. But not only the use of a standardized reporting system but also the use of an optimal data source for assessing postoperative complications is crucial. Current data show that the combination of different documentation levels, such as medical documentation, nursing documentation and the use of special morbidity forms, leads to a significant increase in data reliability with regard to the recording of postoperative complications31.
The most commonly missed postoperative complications in our study were Clavien–Dindo grades I (94.1%) and II (63.3%). Due to their relatively mild nature, the incidence of Clavien–Dindo grade I and grade II complications is often underreported32,33. These factors include a lack of standardization in reporting systems, inadequate documentation, limited communication between healthcare providers, a tendency to focus on more serious complications, and ignorance of the impact of minor complications on outcomes, quality of life and healthcare costs. To improve the accuracy and completeness of surgical outcome reporting, it is critical that all postoperative complications, including grade I and grade II complications, are documented and reported. This not only allows for a more accurate assessment of surgical outcomes, but it also identifies areas for improvement and ensures optimal patient care.
Despite training and additional surveillance by ward consultants during the first three months, there was no difference in the accuracy of the reported data compared to the rest of the study period. This shows, firstly, that even experienced surgeons may be insensitive to the accurate assessment of minor complications (those of grade II or lower) and, thus, need to be trained regularly (train the trainer). Secondly, constant monitoring of the documented outcome reporting is needed to secure the necessary data quality.
To our knowledge, our study is one of the first to compare the accuracy and completeness of outcome reporting using the CDC and CCI® in a low volume hospital setting. Dindo et al. found comparable results comparing resident surgical outcome reporting in a university hospital setting33. The authors showed that the training of inexperienced residents in using the CDC did not improve the overall reliability of outcome reporting using the CDC. However, these results do not argue against the use of such a valid outcome reporting system as CDC grading. Rather, it suggests that the importance of recording outcomes has not been equally understood by all protagonists of the healthcare system. There is no doubt that the recording of outcomes is associated with an additional expenditure of time due to the necessity of documentation. However, this should not have a negative impact on the correct outcome recording. In the end, it is necessary to create a culture in which the recording of outcomes is recognized as an essential parameter of an optimized healthcare system and implemented accordingly.
The overall CCI® score of the group of 42 patients with complications initially identified by the interns and junior residents was 30.9 and increased to 39.4 after review by the senior consultants. This relatively high CCI® already demonstrates that more severe complications were preferentially recognized and documented, but that the minor complications were obviously neglected. The average CCI® of all 105 patients who had a more or less severe complicative course after review by senior surgeons was 23.8. This value appears relatively high, considering the low complicative patient collective. However, considering the fact that in this collective every single deviation from the expected postoperative course, no matter how small, was actually evaluated as a CCI®—relevant complication, these data appear to be reliable and robust.
When looking at the average CCI® of all patients divided into the individual surgical subgroups, the extent of postoperative complications largely corresponds to the data in the scientific literature16,34–38.
This study supports previous evidence that the poor quality of data collection by surgical interns and residents is often neglected33. This may be due to the lack of time, lack of incentives, and lack of recognition of proper CDC reporting as a professional responsibility to assess both individual and institutional performance quality. Most of the interns and residents in this study were in their first and second year of training, which may lead to unfamiliarity with the normal, uncomplicated course of surgical treatment and a lack of awareness of minor complications.
Obviously, it is necessary to point out the importance of correct recording of surgical outcomes to interns and junior residents from the very beginning and to familiarize them with the instruments of outcome reporting in the long term. It seems mandatory to point out the importance of correct outcome reporting already in medical school education. If this has not taken place, as is common in Switzerland and Germany, consistent training in the classification and repetitive monitoring of the correct application of the classification during the residency seems sensible and necessary, respectively. In our view, transferring this activity to non-medical staff is not a solution, as experience has shown that the quality of the data recorded correlates with the degree of medical background knowledge.
Limitations
The present study has several limitations. First, the study was conducted in a single surgical institution with a predominance of low-risk surgical cases. Therefore, the generalizability of the findings to other institutions and higher-risk surgical cases may be limited. Future research should aim to evaluate the reliability of the database according to the CDC in a more diverse range of surgical settings.
Second, readmissions were not considered. Thus, only complications that occurred during the hospital admission were taken into account. This also means that complications 30 or 90 days after discharge are not included in this study.
Third, the retrospective design of the study prevented us from establishing causality, and only associations could be inferred from the data.
Forth, although organized teaching was provided to the interns and residents on two occasions, the effectiveness of this intervention was not formally evaluated. Although both interns and residents reported understanding the CDC, it is uncertain whether they were able to accurately apply this knowledge in practice. Further evaluation of educational interventions and their impact on the accuracy of complication reporting may be warranted.
Conclusion
Following their introduction in the early twenty-first century, the CDC and CCI® have been widely adopted by the research community for assessing outcome of surgical interventions. However, the accuracy and reliability of intern and resident reported CDC and CCI® may be suboptimal, potentially leading to inaccurate measures of quality performance. Therefore, it is recommended that qualified personnel verify the accuracy of complication data prior to dissemination for quality assessment purposes.
Date availability
The data set used for this study is available from the corresponding author upon reasonable request. The manuscript was prepared using the STROBE checklist as guidance.
Author contributions
I.R., T.M., C.vA.: data collection and evaluation, preparation of manuscript, P.C.: data review, manuscript revision, M.B., A.T.: study design, preparation and revision of manuscript.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
These authors contributed equally: Ivana Raguz and Thomas Meissner.
References
- 1.WHO. WHO Guidelines for Safe Surgery (WHO, 2009). [PubMed] [Google Scholar]
- 2.Vonlanthen, R. et al. The impact of complications on costs of major surgical procedures: A cost analysis of 1200 patients. Ann. Surg.254, 907–913 (2011). 10.1097/SLA.0b013e31821d4a43 [DOI] [PubMed] [Google Scholar]
- 3.Birkmeyer, J. D. et al. Hospital quality and the cost of inpatient surgery in the United States. Ann. Surg.255, 1–5 (2012). 10.1097/SLA.0b013e3182402c17 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Clavien, P. A., Sanabria, J. R. & Strasberg, S. M. Proposed classification of complications of surgery with examples of utility in cholecystectomy. Surgery111, 518–526 (1992). [PubMed] [Google Scholar]
- 5.Dindo, D., Demartines, N. & Clavien, P. A. Classification of surgical complications: A new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann. Surg.240, 205–213 (2004). 10.1097/01.sla.0000133083.54934.ae [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Slankamenac, K. et al. The comprehensive complication index: a novel and more sensitive endpoint for assessing outcome and reducing sample size in randomized controlled trials. Ann Surg260, 757–762 (2014) (discussion 762–753). 10.1097/SLA.0000000000000948 [DOI] [PubMed] [Google Scholar]
- 7.Wolters Kluwer, A. M. Classification of Surgical Complications Overview of attention for article published in Annals of Surgery, August 2004. In.
- 8.Katayama, H. et al. Extended Clavien–Dindo classification of surgical complications: Japan clinical oncology group postoperative complications criteria. Surg. Today46, 668–685 (2016). 10.1007/s00595-015-1236-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bolliger, M. et al. Experiences with the standardized classification of surgical complications (Clavien–Dindo) in general surgery patients. Eur. Surg.50, 256–261 (2018). 10.1007/s10353-018-0551-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Lian, B. et al. Risk factors and Clavien–Dindo classification of postoperative complications after laparoscopic and open gastrectomies for gastric cancer: A single-center, large sample, retrospective cohort study. Cancer Manag. Res.12, 12029–12039 (2020). 10.2147/CMAR.S275621 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Martin, R. C. 2nd., Brennan, M. F. & Jaques, D. P. Quality of complication reporting in the surgical literature. Ann. Surg.235, 803–813 (2002). 10.1097/00000658-200206000-00007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Staiger, R. D. et al. The comprehensive complication index (CCI®) is a novel cost assessment tool for surgical procedures. Ann. Surg.268, 784–791 (2018). 10.1097/SLA.0000000000002902 [DOI] [PubMed] [Google Scholar]
- 13.Clavien, P. A. et al. The Clavien–Dindo classification of surgical complications: Five-year experience. Ann. Surg.250, 187–196 (2009). 10.1097/SLA.0b013e3181b13ca2 [DOI] [PubMed] [Google Scholar]
- 14.Rössler, F. et al. Defining benchmarks for major liver surgery: A multicenter analysis of 5202 living liver donors. Ann. Surg.264, 492–500 (2016). 10.1097/SLA.0000000000001849 [DOI] [PubMed] [Google Scholar]
- 15.Schmidt, H. M. et al. Defining benchmarks for transthoracic esophagectomy: A multicenter analysis of total minimally invasive esophagectomy in low risk patients. Ann. Surg.266, 814–821 (2017). 10.1097/SLA.0000000000002445 [DOI] [PubMed] [Google Scholar]
- 16.Gero, D. et al. Defining global benchmarks in bariatric surgery: A retrospective multicenter analysis of minimally invasive Roux-en-Y gastric bypass and sleeve gastrectomy. Ann. Surg.270, 859–867 (2019). 10.1097/SLA.0000000000003512 [DOI] [PubMed] [Google Scholar]
- 17.Raptis, D. A. et al. Defining benchmark outcomes for ALPPS. Ann. Surg.270, 835–841 (2019). 10.1097/SLA.0000000000003539 [DOI] [PubMed] [Google Scholar]
- 18.Staiger, R. D., Schwandt, H., Puhan, M. A. & Clavien, P. A. Improving surgical outcomes through benchmarking. Br. J. Surg.106, 59–64 (2019). 10.1002/bjs.10976 [DOI] [PubMed] [Google Scholar]
- 19.de la Plaza, L. R. et al. The cost of postoperative complications and economic validation of the comprehensive complication index: Prospective study. Ann. Surg.273, 112–120 (2021). 10.1097/SLA.0000000000003308 [DOI] [PubMed] [Google Scholar]
- 20.de la Plaza, L. R. et al. Clinical validation of the comprehensive complication index as a measure of postoperative morbidity at a surgical department: A prospective study. Ann. Surg.268, 838–844 (2018). 10.1097/SLA.0000000000002839 [DOI] [PubMed] [Google Scholar]
- 21.Domenghino, A. et al. Consensus recommendations on how to assess the quality of surgical interventions. Nat. Med.29, 811–822 (2023). 10.1038/s41591-023-02237-3 [DOI] [PubMed] [Google Scholar]
- 22.Santos, R., Gravelle, H. & Propper, C. Does quality affect patients’ choice of doctor? Evidence from England. Econ. J. (London)127, 445–494 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.de Cruppé, W. & Geraedts, M. Hospital choice in Germany from the patient’s perspective: A cross-sectional study. BMC Health Serv. Res.17, 720 (2017). 10.1186/s12913-017-2712-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Parikh, R. P. et al. Quality of surgical outcomes reporting in plastic surgery: A 15-year analysis of complication data. Plast. Reconstr. Surg.141, 1332–1340 (2018). 10.1097/PRS.0000000000004362 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Sathianathen, N. J. et al. Emergence of triplet therapy for metastatic castration-sensitive prostate cancer: An updated systematic review and network meta-analysis. Urol. Oncol.10.1016/j.urolonc.2022.10.016 (2022). 10.1016/j.urolonc.2022.10.016 [DOI] [PubMed] [Google Scholar]
- 26.Soliman, C. et al. A systematic review of intra- and postoperative complication reporting and grading in urological surgery: Understanding the pitfalls and a path forward. Eur. Urol. Oncol.10.1016/j.euo.2023.01.002 (2023). 10.1016/j.euo.2023.01.002 [DOI] [PubMed] [Google Scholar]
- 27.Awad, M. I. et al. Accuracy of administrative and clinical registry data in reporting postoperative complications after surgery for oral cavity squamous cell carcinoma. Head Neck37, 851–861 (2015). 10.1002/hed.23682 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Singh, S. et al. Challenges in reporting surgical site infections to the national surgical site infection surveillance and suggestions for improvement. Ann. R Coll. Surg. Engl.97, 460–465 (2015). 10.1308/rcsann.2015.0027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Woodfield, J. et al. Patient reporting of complications after surgery: What impact does documenting postoperative problems from the perspective of the patient using telephone interview and postal questionnaires have on the identification of complications after surgery?. BMJ Open9, e028561 (2019). 10.1136/bmjopen-2018-028561 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Rutegård, M., Kverneng Hultberg, D., Angenete, E. & Lydrup, M. L. Substantial underreporting of anastomotic leakage after anterior resection for rectal cancer in the Swedish colorectal cancer registry. Acta Oncol.56, 1741–1745 (2017). 10.1080/0284186X.2017.1332423 [DOI] [PubMed] [Google Scholar]
- 31.de la Plaza Llamas, R. et al. Comparison and combination of three data sources from patient medical records to determine optimal quantification of postoperative morbidity according to the Clavien Dindo classification and the comprehensive complication index. A prospective study. Cir. Esp. (Engl. Ed.)10.1016/j.cireng.2024.05.001 (2024). 10.1016/j.cireng.2024.05.001 [DOI] [PubMed] [Google Scholar]
- 32.De la Plaza, L. R. & Ramia, J. M. Postoperative complications in gastrointestinal surgery: A “hidden” basic quality indicator. World J. Gastroenterol.25, 2833–2838 (2019). 10.3748/wjg.v25.i23.2833 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Dindo, D., Hahnloser, D. & Clavien, P. A. Quality assessment in surgery: Riding a lame horse. Ann. Surg.251, 766–771 (2010). 10.1097/SLA.0b013e3181d0d211 [DOI] [PubMed] [Google Scholar]
- 34.Flum, D. R. et al. Perioperative safety in the longitudinal assessment of bariatric surgery. N. Engl. J. Med.361, 445–454 (2009). 10.1056/NEJMoa0901836 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Chang, S. H. et al. The effectiveness and risks of bariatric surgery: An updated systematic review and meta-analysis, 2003–2012. JAMA Surg.149, 275–287 (2014). 10.1001/jamasurg.2013.3654 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Nilsson, H., Nilsson, E., Angerås, U. & Nordin, P. Mortality after groin hernia surgery: Delay of treatment and cause of death. Hernia15, 301–307 (2011). 10.1007/s10029-011-0782-4 [DOI] [PubMed] [Google Scholar]
- 37.Ely, S. et al. Modern elective laparoscopic cholecystectomy carries extremely low postoperative infection risk. J. Surg. Res.246, 506–511 (2020). 10.1016/j.jss.2019.09.038 [DOI] [PubMed] [Google Scholar]
- 38.Bittner, R. et al. Update of Guidelines for laparoscopic treatment of ventral and incisional abdominal wall hernias (International Endohernia Society (IEHS)): Part B. Surg. Endosc.33, 3511–3549 (2019). 10.1007/s00464-019-06908-6 [DOI] [PMC free article] [PubMed] [Google Scholar]