Skip to main content
PMC home page
Thorax logoLink to Thorax
. 2004 Jun;59(6):500–505. doi: 10.1136/thx.2003.011734

Inter-observer variation between pathologists in diffuse parenchymal lung disease

A Nicholson 1, B Addis 1, H Bharucha 1, C Clelland 1, B Corrin 1, A Gibbs 1, P Hasleton 1, K Kerr 1, N Ibrahim 1, S Stewart 1, W Wallace 1, A Wells 1
PMCID: PMC1747021  PMID: 15170033

Abstract

Background: There have been few inter-observer studies of diffuse parenchymal lung disease (DPLD), but the recent ATS/ERS consensus classification provides a basis for such a study.

Methods: A method for categorising numerically the percentage likelihood of these differential diagnoses was developed, and the diagnostic confidence of pathologists using this classification and the reproducibility of their diagnoses were assessed.

Results: The overall kappa coefficient of agreement for the first choice diagnosis was 0.38 (n = 133 biopsies), increasing to 0.43 for patients (n = 83) with multiple biopsies. Weighted kappa coefficients of agreement, quantifying the level of probability of individual diagnoses, were moderate to good (mean 0.58, range 0.40–0.75). However, in 18% of biopsy specimens the diagnosis was given with low confidence. Over 50% of inter-observer variation related to the diagnosis of non-specific interstitial pneumonia and, in particular, its distinction from usual interstitial pneumonia.

Conclusion: These results show that the ATS/ERS classification can be applied reproducibly by pathologists who evaluate DPLD routinely, and support the practice of taking multiple biopsy specimens.

Full Text

The Full Text of this article is available as a PDF (102.9 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Bjoraker J. A., Ryu J. H., Edwin M. K., Myers J. L., Tazelaar H. D., Schroeder D. R., Offord K. P. Prognostic significance of histopathologic subsets in idiopathic pulmonary fibrosis. Am J Respir Crit Care Med. 1998 Jan;157(1):199–203. doi: 10.1164/ajrccm.157.1.9704130. [DOI] [PubMed] [Google Scholar]
  2. Bouros Demosthenes, Wells Athol U., Nicholson Andrew G., Colby Thomas V., Polychronopoulos Vlasis, Pantelidis Panos, Haslam Patricia L., Vassilakis Dimitris A., Black Carol M., du Bois Roland M. Histopathologic subsets of fibrosing alveolitis in patients with systemic sclerosis and their relationship to outcome. Am J Respir Crit Care Med. 2002 Jun 15;165(12):1581–1586. doi: 10.1164/rccm.2106012. [DOI] [PubMed] [Google Scholar]
  3. Campobasso O., Andrion A., Ribotta M., Ronco G. The value of the 1981 WHO histological classification in inter-observer reproducibility and changing pattern of lung cancer. Int J Cancer. 1993 Jan 21;53(2):205–208. doi: 10.1002/ijc.2910530205. [DOI] [PubMed] [Google Scholar]
  4. Colby Thomas V., Tazelaar Henry D., Travis William D., Bergstralh Erik J., Jett James R. Pathologic review of the Mayo Lung Project cancers [corrected]. Is there a case for misdiagnosis or overdiagnosis of lung carcinoma in the screened group? Cancer. 2002 Dec 1;95(11):2361–2365. doi: 10.1002/cncr.10930. [DOI] [PubMed] [Google Scholar]
  5. Collins C. D., Wells A. U., Hansell D. M., Morgan R. A., MacSweeney J. E., du Bois R. M., Rubens M. B. Observer variation in pattern type and extent of disease in fibrosing alveolitis on thin section computed tomography and chest radiography. Clin Radiol. 1994 Apr;49(4):236–240. doi: 10.1016/s0009-9260(05)81847-1. [DOI] [PubMed] [Google Scholar]
  6. Daniil Z. D., Gilchrist F. C., Nicholson A. G., Hansell D. M., Harris J., Colby T. V., du Bois R. M. A histologic pattern of nonspecific interstitial pneumonia is associated with a better prognosis than usual interstitial pneumonia in patients with cryptogenic fibrosing alveolitis. Am J Respir Crit Care Med. 1999 Sep;160(3):899–905. doi: 10.1164/ajrccm.160.3.9903021. [DOI] [PubMed] [Google Scholar]
  7. Flaherty K. R., Thwaite E. L., Kazerooni E. A., Gross B. H., Toews G. B., Colby T. V., Travis W. D., Mumford J. A., Murray S., Flint A. Radiological versus histological diagnosis in UIP and NSIP: survival implications. Thorax. 2003 Feb;58(2):143–148. doi: 10.1136/thorax.58.2.143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Flaherty K. R., Toews G. B., Travis W. D., Colby T. V., Kazerooni E. A., Gross B. H., Jain A., Strawderman R. L., 3rd, Paine R., Flint A. Clinical significance of histological classification of idiopathic interstitial pneumonia. Eur Respir J. 2002 Feb;19(2):275–283. doi: 10.1183/09031936.02.00182002. [DOI] [PubMed] [Google Scholar]
  9. Flaherty K. R., Travis W. D., Colby T. V., Toews G. B., Kazerooni E. A., Gross B. H., Jain A., Strawderman R. L., Flint A., Lynch J. P. Histopathologic variability in usual and nonspecific interstitial pneumonias. Am J Respir Crit Care Med. 2001 Nov 1;164(9):1722–1727. doi: 10.1164/ajrccm.164.9.2103074. [DOI] [PubMed] [Google Scholar]
  10. Kung I. T., Lam W. K., Lam T. H. Observer variability studies of the WHO classification of lung cancer. Cancer Treat Res. 1989;45:53–69. doi: 10.1007/978-1-4613-1593-3_4. [DOI] [PubMed] [Google Scholar]
  11. Nagai S., Kitaichi M., Itoh H., Nishimura K., Izumi T., Colby T. V. Idiopathic nonspecific interstitial pneumonia/fibrosis: comparison with idiopathic pulmonary fibrosis and BOOP. Eur Respir J. 1998 Nov;12(5):1010–1019. doi: 10.1183/09031936.98.12051010. [DOI] [PubMed] [Google Scholar]
  12. Nicholson A. G., Colby T. V., du Bois R. M., Hansell D. M., Wells A. U. The prognostic significance of the histologic pattern of interstitial pneumonia in patients presenting with the clinical entity of cryptogenic fibrosing alveolitis. Am J Respir Crit Care Med. 2000 Dec;162(6):2213–2217. doi: 10.1164/ajrccm.162.6.2003049. [DOI] [PubMed] [Google Scholar]
  13. Nicholson A. G., Perry L. J., Cury P. M., Jackson P., McCormick C. M., Corrin B., Wells A. U. Reproducibility of the WHO/IASLC grading system for pre-invasive squamous lesions of the bronchus: a study of inter-observer and intra-observer variation. Histopathology. 2001 Mar;38(3):202–208. doi: 10.1046/j.1365-2559.2001.01078.x. [DOI] [PubMed] [Google Scholar]
  14. Nicholson A. G., Wells A. U. Nonspecific interstitial pneumonia-nobody said it's perfect. Am J Respir Crit Care Med. 2001 Nov 1;164(9):1553–1554. doi: 10.1164/ajrccm.164.9.2108099a. [DOI] [PubMed] [Google Scholar]
  15. Nicholson Andrew G., Fulford Laura G., Colby Thomas V., du Bois Roland M., Hansell David M., Wells Athol U. The relationship between individual histologic features and disease progression in idiopathic pulmonary fibrosis. Am J Respir Crit Care Med. 2002 Jul 15;166(2):173–177. doi: 10.1164/rccm.2109039. [DOI] [PubMed] [Google Scholar]
  16. Raab S. S., Thomas P. A., Lenel J. C., Bottles K., Fitzsimmons K. M., Zaleski M. S., Wittchow R. J., McPhaul L. W., Slagel D. D., Cohen M. B. Pathology and probability. Likelihood ratios and receiver operating characteristic curves in the interpretation of bronchial brush specimens. Am J Clin Pathol. 1995 May;103(5):588–593. doi: 10.1093/ajcp/103.5.588. [DOI] [PubMed] [Google Scholar]
  17. Skov B. G., Braendstrup O., Hirsch F. R., Lauritzen A. F., Nielsen H. W., Skov T. Are pathologists biased by clinical information?: A blinded cross-over study of the histopathological diagnosis of mesothelial tumours versus pulmonary adenocarcinoma. Lung Cancer. 1994 Dec;11(5-6):365–372. doi: 10.1016/0169-5002(94)92165-2. [DOI] [PubMed] [Google Scholar]
  18. Skov B. G., Lauritzen A. F., Hirsch F., Nielsen H. W. The histopathological diagnosis of malignant mesothelioma v. pulmonary adenocarcinoma: reproducibility of the histopathological diagnosis. Histopathology. 1994 Jun;24(6):553–557. doi: 10.1111/j.1365-2559.1994.tb00575.x. [DOI] [PubMed] [Google Scholar]
  19. Travis W. D., Matsui K., Moss J., Ferrans V. J. Idiopathic nonspecific interstitial pneumonia: prognostic significance of cellular and fibrosing patterns: survival comparison with usual interstitial pneumonia and desquamative interstitial pneumonia. Am J Surg Pathol. 2000 Jan;24(1):19–33. doi: 10.1097/00000478-200001000-00003. [DOI] [PubMed] [Google Scholar]
  20. Yousem Samuel A., Dacic Sanja. Idiopathic bronchiolocentric interstitial pneumonia. Mod Pathol. 2002 Nov;15(11):1148–1153. doi: 10.1097/01.MP.0000037309.04985.B4. [DOI] [PubMed] [Google Scholar]

Articles from Thorax are provided here courtesy of BMJ Publishing Group

RESOURCES