Skip to main content
NCBI home page
Quality & Safety in Health Care logoLink to Quality & Safety in Health Care
. 2005 Dec;14(6):408–413. doi: 10.1136/qshc.2004.011973

Overestimation of clinical diagnostic performance caused by low necropsy rates

K Shojania 1, E Burton 1, K McDonald 1, L Goldman 1
PMCID: PMC1744091  PMID: 16326784

Abstract

Background: Diagnostic sensitivity is calculated as the number of correct diagnoses divided by the sum of correct diagnoses plus the number of missed or false negative diagnoses. Because missed diagnoses are generally detected during clinical follow up or at necropsy, the low necropsy rates seen in current practice may result in overestimates of diagnostic performance. Using three target conditions (aortic dissection, pulmonary embolism, and active tuberculosis), the prevalence of clinically missed cases among necropsied and non-necropsied deaths was estimated and the impact of low necropsy rates on the apparent sensitivity of antemortem diagnosis determined.

Methods: After reviewing case series for each target condition, the most recent study that included cases first detected at necropsy was selected and the reported sensitivity of clinical diagnosis adjusted by estimating the total number of cases that would have been detected had all decedents undergone necropsy. These estimates were based on available data for necropsy rates, time period, country (US v non-US), and case mix.

Results: For all three target diagnoses, adjusting for the estimated prevalence of clinically missed cases among non-necropsied deaths produced sensitivity values outside the 95% confidence interval for the originally reported values, and well below sensitivities reported for the diagnostic tests that are usually used to detect these conditions. For active tuberculosis the sensitivity of antemortem diagnosis decreased from an apparent value of 96% to a corrected value of 83%, with a plausible range of 42–91%; for aortic dissection the sensitivity decreased from 86% to 74%; and for pulmonary embolism the reduction fell only modestly from 97% to 91% but was still lower than generally reported values of 98% or more.

Conclusions: Failure to adjust for the prevalence of missed cases among non-necropsied deaths may substantially overstate the performance of diagnostic tests and antemortem diagnosis in general, especially for conditions with high early case fatality.

Full Text

The Full Text of this article is available as a PDF (88.8 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Baker P. B., Zarbo R. J., Howanitz P. J. Quality assurance of autopsy face sheet reporting, final autopsy report turnaround time, and autopsy rates: a College of American Pathologists Q-Probes study of 10003 autopsies from 418 institutions. Arch Pathol Lab Med. 1996 Nov;120(11):1003–1008. [PubMed] [Google Scholar]
  2. Battle R. M., Pathak D., Humble C. G., Key C. R., Vanatta P. R., Hill R. B., Anderson R. E. Factors influencing discrepancies between premortem and postmortem diagnoses. JAMA. 1987 Jul 17;258(3):339–344. [PubMed] [Google Scholar]
  3. Bedell S. E., Fulton E. J. Unexpected findings and complications at autopsy after cardiopulmonary resuscitation (CPR). Arch Intern Med. 1986 Sep;146(9):1725–1728. [PubMed] [Google Scholar]
  4. Bernicker E. H., Atmar R. L., Schaffner D. L., Greenberg S. B. Unanticipated diagnoses found at autopsy in an urban public teaching hospital. Am J Med Sci. 1996 May;311(5):215–220. doi: 10.1097/00000441-199605000-00004. [DOI] [PubMed] [Google Scholar]
  5. Bobrowitz I. D. Active tuberculosis undiagnosed until autopsy. Am J Med. 1982 Apr;72(4):650–658. doi: 10.1016/0002-9343(82)90476-4. [DOI] [PubMed] [Google Scholar]
  6. Boers M., Nieuwenhuyzen Kruseman A. C., Eulderink F., Hermans J., Thompson J. Value of autopsy in internal medicine: a 1-year prospective study of hospital deaths. Eur J Clin Invest. 1988 Jun;18(3):314–320. doi: 10.1111/j.1365-2362.1988.tb01265.x. [DOI] [PubMed] [Google Scholar]
  7. Britton M. Diagnostic errors discovered at autopsy. Acta Med Scand. 1974 Sep;196(3):203–210. doi: 10.1111/j.0954-6820.1974.tb00996.x. [DOI] [PubMed] [Google Scholar]
  8. Burke M. C., Aghababian R. V., Blackbourne B. Use of autopsy results in the emergency department quality assurance plan. Ann Emerg Med. 1990 Apr;19(4):363–366. doi: 10.1016/s0196-0644(05)82334-0. [DOI] [PubMed] [Google Scholar]
  9. Burton E. C., Nemetz P. N. Medical error and outcomes measures: where have all the autopsies gone? MedGenMed. 2000 Apr 28;2(2):E8–E8. [PubMed] [Google Scholar]
  10. Burton J. L., Underwood J. C. E. Necropsy practice after the "organ retention scandal": requests, performance, and tissue retention. J Clin Pathol. 2003 Jul;56(7):537–541. doi: 10.1136/jcp.56.7.537. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Butler J., Ormerod O. J., Giannopoulos N., Pillai R., Westaby S. Diagnostic delay and outcome in surgery for type A aortic dissection. Q J Med. 1991 May;79(289):391–396. [PubMed] [Google Scholar]
  12. Cameron H. M., McGoogan E. A prospective study of 1152 hospital autopsies: I. Inaccuracies in death certification. J Pathol. 1981 Apr;133(4):273–283. doi: 10.1002/path.1711330402. [DOI] [PubMed] [Google Scholar]
  13. Cameron H. M., McGoogan E. A prospective study of 1152 hospital autopsies: II. Analysis of inaccuracies in clinical diagnoses and their significance. J Pathol. 1981 Apr;133(4):285–300. doi: 10.1002/path.1711330403. [DOI] [PubMed] [Google Scholar]
  14. Cameron H. M., McGoogan E., Watson H. Necropsy: a yardstick for clinical diagnoses. Br Med J. 1980 Oct 11;281(6246):985–988. doi: 10.1136/bmj.281.6246.985. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Chariot P., Witt K., Pautot V., Porcher R., Thomas G., Zafrani E. S., Lemaire F. Declining autopsy rate in a French hospital: physician's attitudes to the autopsy and use of autopsy material in research publications. Arch Pathol Lab Med. 2000 May;124(5):739–745. doi: 10.5858/2000-124-0739-DARIAF. [DOI] [PubMed] [Google Scholar]
  16. Combes Alain, Mokhtari Mourad, Couvelard Anne, Trouillet Jean-Louis, Baudot Jérôme, Hénin Dominique, Gibert Claude, Chastre Jean. Clinical and autopsy diagnoses in the intensive care unit: a prospective study. Arch Intern Med. 2004 Feb 23;164(4):389–392. doi: 10.1001/archinte.164.4.389. [DOI] [PubMed] [Google Scholar]
  17. DeRiemer K., Rudoy I., Schecter G. F., Hopewell P. C., Daley C. L. The epidemiology of tuberculosis diagnosed after death in San Francisco, 1986-1995. Int J Tuberc Lung Dis. 1999 Jun;3(6):488–493. [PubMed] [Google Scholar]
  18. Espinosa J. A., Nolan T. W. Reducing errors made by emergency physicians in interpreting radiographs: longitudinal study. BMJ. 2000 Mar 18;320(7237):737–740. doi: 10.1136/bmj.320.7237.737. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Flum D. R., Morris A., Koepsell T., Dellinger E. P. Has misdiagnosis of appendicitis decreased over time? A population-based analysis. JAMA. 2001 Oct 10;286(14):1748–1753. doi: 10.1001/jama.286.14.1748. [DOI] [PubMed] [Google Scholar]
  20. Goldhaber S. Z., Visani L., De Rosa M. Acute pulmonary embolism: clinical outcomes in the International Cooperative Pulmonary Embolism Registry (ICOPER) Lancet. 1999 Apr 24;353(9162):1386–1389. doi: 10.1016/s0140-6736(98)07534-5. [DOI] [PubMed] [Google Scholar]
  21. Goldman L., Sayson R., Robbins S., Cohn L. H., Bettmann M., Weisberg M. The value of the autopsy in three medical eras. N Engl J Med. 1983 Apr 28;308(17):1000–1005. doi: 10.1056/NEJM198304283081704. [DOI] [PubMed] [Google Scholar]
  22. Gordin F. M., Slutkin G., Schecter G., Goodman P. C., Hopewell P. C. Presumptive diagnosis and treatment of pulmonary tuberculosis based on radiographic findings. Am Rev Respir Dis. 1989 May;139(5):1090–1093. doi: 10.1164/ajrccm/139.5.1090. [DOI] [PubMed] [Google Scholar]
  23. Gould D. A., Birkmeyer J. D. Efficacy versus effectiveness of carotid endarterectomy. Eff Clin Pract. 1999 Jan-Feb;2(1):30–36. [PubMed] [Google Scholar]
  24. Graber Mark. Metacognitive training to reduce diagnostic errors: ready for prime time? Acad Med. 2003 Aug;78(8):781–781. doi: 10.1097/00001888-200308000-00004. [DOI] [PubMed] [Google Scholar]
  25. Greenaway Christina, Menzies Dick, Fanning Anne, Grewal Raj, Yuan Lilian, FitzGerald J. Mark, Canadian Collaborative Group in nosocomial Transmission of Tuberculosis Delay in diagnosis among hospitalized patients with active tuberculosis--predictors and outcomes. Am J Respir Crit Care Med. 2002 Apr 1;165(7):927–933. doi: 10.1164/ajrccm.165.7.2107040. [DOI] [PubMed] [Google Scholar]
  26. Hartveit F. Clinical and post-mortem assessment of the cause of death. J Pathol. 1977 Dec;123(4):193–210. doi: 10.1002/path.1711230402. [DOI] [PubMed] [Google Scholar]
  27. Kirch W., Schafii C. Misdiagnosis at a university hospital in 4 medical eras. Medicine (Baltimore) 1996 Jan;75(1):29–40. doi: 10.1097/00005792-199601000-00004. [DOI] [PubMed] [Google Scholar]
  28. Landefeld C. S., Chren M. M., Myers A., Geller R., Robbins S., Goldman L. Diagnostic yield of the autopsy in a university hospital and a community hospital. N Engl J Med. 1988 May 12;318(19):1249–1254. doi: 10.1056/NEJM198805123181906. [DOI] [PubMed] [Google Scholar]
  29. Lee J. K., Ng T. H. Undiagnosed tuberculosis in hospitalized patients--an autopsy survey. J R Soc Health. 1990 Aug;110(4):141–143. doi: 10.1177/146642409011000411. [DOI] [PubMed] [Google Scholar]
  30. Margo C. E. A pilot study in ophthalmology of inter-rater reliability in classifying diagnostic errors: an underinvestigated area of medical error. Qual Saf Health Care. 2003 Dec;12(6):416–420. doi: 10.1136/qhc.12.6.416. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Mathur P., Sacks L., Auten G., Sall R., Levy C., Gordin F. Delayed diagnosis of pulmonary tuberculosis in city hospitals. Arch Intern Med. 1994 Feb 14;154(3):306–310. [PubMed] [Google Scholar]
  32. Matsubara O., Sato T., Kitagawa M., Kasuga T. Pulmonary thromboembolism: frequency, site, and vascular change in 103 autopsy cases. Am J Cardiovasc Pathol. 1989;2(4):321–328. [PubMed] [Google Scholar]
  33. Mehta Rajendra H., O'Gara Patrick T., Bossone Eduardo, Nienaber Christoph A., Myrmel Truls, Cooper Jeanna V., Smith Dean E., Armstrong William F., Isselbacher Eric M., Pape Linda A. Acute type A aortic dissection in the elderly: clinical characteristics, management, and outcomes in the current era. J Am Coll Cardiol. 2002 Aug 21;40(4):685–692. doi: 10.1016/s0735-1097(02)02005-3. [DOI] [PubMed] [Google Scholar]
  34. Mitchell M. L. Interdepartmental quality assurance using coded autopsy results. Mod Pathol. 1993 Jan;6(1):48–52. [PubMed] [Google Scholar]
  35. Morrell M. T., Dunnill M. S. The post-mortem incdence of pulmonary embolism in a hospital population. Br J Surg. 1968 May;55(5):347–352. doi: 10.1002/bjs.1800550506. [DOI] [PubMed] [Google Scholar]
  36. Mulherin Stephanie A., Miller William C. Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med. 2002 Oct 1;137(7):598–602. doi: 10.7326/0003-4819-137-7-200210010-00011. [DOI] [PubMed] [Google Scholar]
  37. Nichols L., Aronica P., Babe C. Are autopsies obsolete? Am J Clin Pathol. 1998 Aug;110(2):210–218. doi: 10.1093/ajcp/110.2.210. [DOI] [PubMed] [Google Scholar]
  38. Papadakis M. A., Mangione C. M., Lee K. K., Kristof M. Treatable abdominal pathologic conditions and unsuspected malignant neoplasms at autopsy in veterans who received mechanical ventilation. JAMA. 1991 Feb 20;265(7):885–887. [PubMed] [Google Scholar]
  39. Perkins Gavin D., McAuley Danny F., Davies Sarah, Gao Fang. Discrepancies between clinical and postmortem diagnoses in critically ill patients: an observational study. Crit Care. 2003 Sep 5;7(6):R129–R132. doi: 10.1186/cc2359. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Pineda L. A., Hathwar V. S., Grant B. J. Clinical suspicion of fatal pulmonary embolism. Chest. 2001 Sep;120(3):791–795. doi: 10.1378/chest.120.3.791. [DOI] [PubMed] [Google Scholar]
  41. Quiroz Rene, Kucher Nils, Zou Kelly H., Kipfmueller Florian, Costello Philip, Goldhaber Samuel Z., Schoepf U. Joseph. Clinical validity of a negative computed tomography scan in patients with suspected pulmonary embolism: a systematic review. JAMA. 2005 Apr 27;293(16):2012–2017. doi: 10.1001/jama.293.16.2012. [DOI] [PubMed] [Google Scholar]
  42. Ransohoff D. F., Feinstein A. R. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med. 1978 Oct 26;299(17):926–930. doi: 10.1056/NEJM197810262991705. [DOI] [PubMed] [Google Scholar]
  43. Rao P. M., Rhea J. T., Novelline R. A., Mostafavi A. A., McCabe C. J. Effect of computed tomography of the appendix on treatment of patients and use of hospital resources. N Engl J Med. 1998 Jan 15;338(3):141–146. doi: 10.1056/NEJM199801153380301. [DOI] [PubMed] [Google Scholar]
  44. Rieder H. L., Kelly G. D., Bloch A. B., Cauthen G. M., Snider D. E., Jr Tuberculosis diagnosed at death in the United States. Chest. 1991 Sep;100(3):678–681. doi: 10.1378/chest.100.3.678. [DOI] [PubMed] [Google Scholar]
  45. Ro Ayako, Kageyama Norimasa, Tanifuji Takanobu, Kobayashi Masahiko, Takada Aya, Saito Kazuyuki, Murai Tatsuya. Histopathological study of pulmonary arteries in 14 autopsy cases with massive pulmonary thromboembolism. Leg Med (Tokyo) 2003 Mar;5 (Suppl 1):S315–S317. doi: 10.1016/s1344-6223(02)00159-1. [DOI] [PubMed] [Google Scholar]
  46. Roosen J., Frans E., Wilmer A., Knockaert D. C., Bobbaers H. Comparison of premortem clinical diagnoses in critically iII patients and subsequent autopsy findings. Mayo Clin Proc. 2000 Jun;75(6):562–567. doi: 10.4065/75.6.562. [DOI] [PubMed] [Google Scholar]
  47. Rosman H. S., Patel S., Borzak S., Paone G., Retter K. Quality of history taking in patients with aortic dissection. Chest. 1998 Sep;114(3):793–795. doi: 10.1378/chest.114.3.793. [DOI] [PubMed] [Google Scholar]
  48. Ryu J. H., Olson E. J., Pellikka P. A. Clinical recognition of pulmonary embolism: problem of unrecognized and asymptomatic cases. Mayo Clin Proc. 1998 Sep;73(9):873–879. doi: 10.4065/73.9.873. [DOI] [PubMed] [Google Scholar]
  49. Saracci R. Is necropsy a valid monitor of clinical diagnosis performance? BMJ. 1991 Oct 12;303(6807):898–900. doi: 10.1136/bmj.303.6807.898. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Sherman L. F., Fujiwara P. I., Cook S. V., Bazerman L. B., Frieden T. R. Patient and health care system delays in the diagnosis and treatment of tuberculosis. Int J Tuberc Lung Dis. 1999 Dec;3(12):1088–1095. [PubMed] [Google Scholar]
  51. Shojania Kaveh G., Burton Elizabeth C., McDonald Kathryn M., Goldman Lee. Changes in rates of autopsy-detected diagnostic errors over time: a systematic review. JAMA. 2003 Jun 4;289(21):2849–2856. doi: 10.1001/jama.289.21.2849. [DOI] [PubMed] [Google Scholar]
  52. Sonderegger-Iseli K., Burger S., Muntwyler J., Salomon F. Diagnostic errors in three medical eras: a necropsy study. Lancet. 2000 Jun 10;355(9220):2027–2031. doi: 10.1016/s0140-6736(00)02349-7. [DOI] [PubMed] [Google Scholar]
  53. Soumerai Stephen B., McLaughlin Thomas J., Ross-Degnan Dennis, Christiansen Cindy L., Gurwitz Jerry H. Effectiveness of thrombolytic therapy for acute myocardial infarction in the elderly: cause for concern in the old-old. Arch Intern Med. 2002 Mar 11;162(5):561–568. doi: 10.1001/archinte.162.5.561. [DOI] [PubMed] [Google Scholar]
  54. Spittell P. C., Spittell J. A., Jr, Joyce J. W., Tajik A. J., Edwards W. D., Schaff H. V., Stanson A. W. Clinical features and differential diagnosis of aortic dissection: experience with 236 cases (1980 through 1990). Mayo Clin Proc. 1993 Jul;68(7):642–651. doi: 10.1016/s0025-6196(12)60599-0. [DOI] [PubMed] [Google Scholar]
  55. Stein P. D., Henry J. W. Prevalence of acute pulmonary embolism among patients in a general hospital and at autopsy. Chest. 1995 Oct;108(4):978–981. doi: 10.1378/chest.108.4.978. [DOI] [PubMed] [Google Scholar]
  56. Sullivan P. R., Wolfson A. B., Leckey R. D., Burke J. L. Diagnosis of acute thoracic aortic dissection in the emergency department. Am J Emerg Med. 2000 Jan;18(1):46–50. doi: 10.1016/s0735-6757(00)90047-0. [DOI] [PubMed] [Google Scholar]
  57. Tai D. Y., El-Bilbeisi H., Tewari S., Mascha E. J., Wiedemann H. P., Arroliga A. C. A study of consecutive autopsies in a medical ICU : a comparison of clinical cause of death and autopsy diagnosis. Chest. 2001 Feb;119(2):530–536. doi: 10.1378/chest.119.2.530. [DOI] [PubMed] [Google Scholar]
  58. Trowbridge Robert L., Araoz Philip A., Gotway Michael B., Bailey Richard A., Auerbach Andrew D. The effect of helical computed tomography on diagnostic and treatment strategies in patients with suspected pulmonary embolism. Am J Med. 2004 Jan 15;116(2):84–90. doi: 10.1016/j.amjmed.2003.07.004. [DOI] [PubMed] [Google Scholar]
  59. Tse G. M., Lee J. C. A 12-month review of autopsies performed at a university-affiliated teaching hospital in Hong Kong. Hong Kong Med J. 2000 Jun;6(2):190–194. [PubMed] [Google Scholar]
  60. Twigg S. J., McCrirrick A., Sanderson P. M. A comparison of post mortem findings with post hoc estimated clinical diagnoses of patients who die in a United Kingdom intensive care unit. Intensive Care Med. 2001 Apr;27(4):706–710. doi: 10.1007/s001340100903. [DOI] [PubMed] [Google Scholar]
  61. Veress B., Gadaleanu V., Nennesmo I., Wikström B. M. The reliability of autopsy diagnostics: inter-observer variation between pathologists, a preliminary report. Qual Assur Health Care. 1993 Dec;5(4):333–337. doi: 10.1093/intqhc/5.4.333. [DOI] [PubMed] [Google Scholar]
  62. Wells P. S., Ginsberg J. S., Anderson D. R., Kearon C., Gent M., Turpie A. G., Bormanis J., Weitz J., Chamberlain M., Bowie D. Use of a clinical model for safe management of patients with suspected pulmonary embolism. Ann Intern Med. 1998 Dec 15;129(12):997–1005. doi: 10.7326/0003-4819-129-12-199812150-00002. [DOI] [PubMed] [Google Scholar]
  63. Yokoe D. S., Subramanyan G. S., Nardell E., Sharnprapai S., McCray E., Platt R. Supplementing tuberculosis surveillance with automated data from health maintenance organizations. Emerg Infect Dis. 1999 Nov-Dec;5(6):779–787. doi: 10.3201/eid0506.9906. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Quality & safety in health care are provided here courtesy of BMJ Publishing Group

RESOURCES