In Reply We read with great interest the letter by Polok et al regarding our article1 and appreciate their insightful comments, which highlight several challenges in the use of retrospective databases for quality monitoring. However, several key factors deserve further consideration.
The initial question prompting our study was whether recent innovations in research and technology translated into actual improvements in patient outcomes from 2005 to 2014. To objectively answer this question, we used the largest longitudinally collected and validated surgical database in the United States, the American College of Surgeons National Surgical Quality Improvement Program.2 However, as surgical practice has evolved over time, so too have methods of data collection. For example, our study covered trends from 2005 to 2014, during which time the definition of postoperative myocardial infarction was modified twice.3 In our study,1 definitions for events were standardized per National Surgical Quality Improvement Program registry definitions and protocols, which is itself constantly evolving to optimize modeling and adjust for complex patient and procedural risk profiles.4 We acknowledge the challenges in maintaining consistency of myocardial infarction definition across the study period. Yet this point leads to one of our highlighted findings: the Myocardial Infarction and Cardiac Arrest calculator, initially developed and validated prior to the most recent revision of the myocardial infarction definition,5was found to consistently underestimate myocardial infarction risk.1 We agree with Polok et al that higher-quality cohort data with uniform characterization of patient characteristics and adjudication of postoperative events would be ideal for developing and validating future risk assessment tools.
Polok et al alluded to the potential prognostic implications of minor troponin elevations. While recent studies may indicate an association between troponin elevations and mortality,6 the specificity of this biomarker elevation remains an issue of contention. Other conditions, such as congestive heart failure, pulmonary embolism, myocarditis, and sepsis, have all been associatedwithelevatedtroponinlevels.3Currentlyavailableevidence does not support the routine use of high-sensitivity troponin panel in the postoperative period because it does not necessarily produce management-altering information.
In conclusion, shifting practice norms in our rapidly changing surgical environment inevitably lead to evolving disease definitions in clinical data repositories. This will continue to be an important consideration when evaluating evidence from retrospective studies. Nonetheless, in the whirlwind of disruptive technologies and publications, objectively collected outcomes data remain the best measure by which to evaluate whether actual progress is being made in the delivery of health care, the ultimate goal of all modern medicine.
Footnotes
Conflict of Interest Disclosures: None reported.
References
- 1.Juo Y-Y, Mantha A, Ebrahimi R, Ziaeian B, Benharash P. Incidence of myocardial infarction after high-risk vascular operations in adults. JAMA Surg. 2017;152(11):e173360. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Mansmann U, Rieger A, Strahwald B, Crispin A. Risk calculators: methods, development, implementation, and validation. Int J Colorectal Dis. 2016;31(6): 1111–1116. [DOI] [PubMed] [Google Scholar]
- 3.Royo MB, Fleisher LA. Chasing myocardial outcomes: perioperative myocardial infarction and cardiac troponin. Can J Anaesth. 2016;63(2):227–232. [DOI] [PubMed] [Google Scholar]
- 4.Cohen ME, Ko CY, Bilimoria KY, et al. Optimizing ACS NSQIP modeling for evaluation of surgical quality and risk: patient risk adjustment, procedure mix adjustment, shrinkage adjustment, and surgical focus. J Am Coll Surg. 2013;217(2):336–346.e1. [DOI] [PubMed] [Google Scholar]
- 5.Gupta PK, Gupta H, Sundaram A, et al. Development and validation of a risk calculator for prediction of cardiac risk after surgery. Circulation. 2011;124(4): 381–387. [DOI] [PubMed] [Google Scholar]
- 6.Gillmann H-J, Meinders A, Grohennig A, et al. Perioperative levels and changes of high-sensitivity troponin T are associated with cardiovascular events in vascular surgery patients. Crit Care Med. 2014;42(6):1498–1506. [DOI] [PubMed] [Google Scholar]