Skip to main content
NCBI home page
Thorax logoLink to Thorax
. 2004 Jun;59(6):506–511. doi: 10.1136/thx.2003.020396

HRCT diagnosis of diffuse parenchymal lung disease: inter-observer variation

Z Aziz 1, A Wells 1, D Hansell 1, G Bain 1, S Copley 1, S Desai 1, S Ellis 1, F Gleeson 1, S Grubnic 1, A Nicholson 1, S Padley 1, K Pointon 1, J Reynolds 1, R Robertson 1, M Rubens 1
PMCID: PMC1747041  PMID: 15170034

Abstract

Background: This study was designed to measure inter-observer variation between thoracic radiologists in the diagnosis of diffuse parenchymal lung disease (DPLD) using high resolution computed tomography (HRCT) and to identify areas of difficulty where expertise, in the form of national panels, would be of particular value.

Methods: HRCT images of 131 patients with DPLD (from a tertiary referral hospital (n = 66) and regional teaching centres (n = 65)) were reviewed by 11 thoracic radiologists. Inter-observer variation for the first choice diagnosis was quantified using the unadjusted kappa coefficient of agreement. Observers stated differential diagnoses and assigned a percentage likelihood to each. A weighted kappa was calculated for the likelihood of each of the six most frequently diagnosed disease entities.

Results: Observer agreement on the first choice diagnosis was moderate for the entire cohort (κ = 0.48) and was higher for cases from regional centres (κ = 0.60) than for cases from the tertiary referral centre (κ = 0.34). 62% of cases from regional teaching centres were diagnosed with high confidence and good observer agreement (κ = 0.77). Non-specific interstitial pneumonia (NSIP) was in the differential diagnosis in most disagreements (55%). Weighted kappa values quantifying the likelihood of specific diseases were moderate to good (mean 0.57, range 0.49–0.70).

Conclusion: There is good agreement between thoracic radiologists for the HRCT diagnosis of DPLD encountered in regional teaching centres. However, cases diagnosed with low confidence, particularly where NSIP is considered as a differential diagnosis, may benefit from the expertise of a reference panel.

Full Text

The Full Text of this article is available as a PDF (76.2 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. American Thoracic Society. European Respiratory Society American Thoracic Society/European Respiratory Society International Multidisciplinary Consensus Classification of the Idiopathic Interstitial Pneumonias. This joint statement of the American Thoracic Society (ATS), and the European Respiratory Society (ERS) was adopted by the ATS board of directors, June 2001 and by the ERS Executive Committee, June 2001. Am J Respir Crit Care Med. 2002 Jan 15;165(2):277–304. doi: 10.1164/ajrccm.165.2.ats01. [DOI] [PubMed] [Google Scholar]
  2. Brauner M. W., Lenoir S., Grenier P., Cluzel P., Battesti J. P., Valeyre D. Pulmonary sarcoidosis: CT assessment of lesion reversibility. Radiology. 1992 Feb;182(2):349–354. doi: 10.1148/radiology.182.2.1732948. [DOI] [PubMed] [Google Scholar]
  3. Coblentz C. L., Babcook C. J., Alton D., Riley B. J., Norman G. Observer variation in detecting the radiologic features associated with bronchiolitis. Invest Radiol. 1991 Feb;26(2):115–118. doi: 10.1097/00004424-199102000-00004. [DOI] [PubMed] [Google Scholar]
  4. Collins C. D., Wells A. U., Hansell D. M., Morgan R. A., MacSweeney J. E., du Bois R. M., Rubens M. B. Observer variation in pattern type and extent of disease in fibrosing alveolitis on thin section computed tomography and chest radiography. Clin Radiol. 1994 Apr;49(4):236–240. doi: 10.1016/s0009-9260(05)81847-1. [DOI] [PubMed] [Google Scholar]
  5. Cottin V., Donsbeck A. V., Revel D., Loire R., Cordier J. F. Nonspecific interstitial pneumonia. Individualization of a clinicopathologic entity in a series of 12 patients. Am J Respir Crit Care Med. 1998 Oct;158(4):1286–1293. doi: 10.1164/ajrccm.158.4.9802119. [DOI] [PubMed] [Google Scholar]
  6. Flaherty K. R., Thwaite E. L., Kazerooni E. A., Gross B. H., Toews G. B., Colby T. V., Travis W. D., Mumford J. A., Murray S., Flint A. Radiological versus histological diagnosis in UIP and NSIP: survival implications. Thorax. 2003 Feb;58(2):143–148. doi: 10.1136/thorax.58.2.143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Grenier P., Valeyre D., Cluzel P., Brauner M. W., Lenoir S., Chastang C. Chronic diffuse interstitial lung disease: diagnostic value of chest radiography and high-resolution CT. Radiology. 1991 Apr;179(1):123–132. doi: 10.1148/radiology.179.1.2006262. [DOI] [PubMed] [Google Scholar]
  8. Hansell D. M., Coleman R., du Bois R. M., Carr D. H., Goodman L. R., Kerr I. H., Pearson M. C., Rubens M. B. Advanced multiple beam equalization radiography (AMBER) in the detection of diffuse lung disease. Clin Radiol. 1991 Oct;44(4):227–231. doi: 10.1016/s0009-9260(05)80184-9. [DOI] [PubMed] [Google Scholar]
  9. Hansell D. M., Wells A. U. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clin Radiol. 2003 Aug;58(8):573–574. doi: 10.1016/s0009-9260(03)00259-9. [DOI] [PubMed] [Google Scholar]
  10. Hartman T. E., Swensen S. J., Hansell D. M., Colby T. V., Myers J. L., Tazelaar H. D., Nicholson A. G., Wells A. U., Ryu J. H., Midthun D. E. Nonspecific interstitial pneumonia: variable appearance at high-resolution chest CT. Radiology. 2000 Dec;217(3):701–705. doi: 10.1148/radiology.217.3.r00nv31701. [DOI] [PubMed] [Google Scholar]
  11. Hommeyer S. H., Godwin J. D., Takasugi J. E. Computed tomography of air-space disease. Radiol Clin North Am. 1991 Sep;29(5):1065–1084. [PubMed] [Google Scholar]
  12. Hunninghake G. W., Zimmerman M. B., Schwartz D. A., King T. E., Jr, Lynch J., Hegele R., Waldron J., Colby T., Müller N., Lynch D. Utility of a lung biopsy for the diagnosis of idiopathic pulmonary fibrosis. Am J Respir Crit Care Med. 2001 Jul 15;164(2):193–196. doi: 10.1164/ajrccm.164.2.2101090. [DOI] [PubMed] [Google Scholar]
  13. Johkoh T., Müller N. L., Cartier Y., Kavanagh P. V., Hartman T. E., Akira M., Ichikado K., Ando M., Nakamura H. Idiopathic interstitial pneumonias: diagnostic accuracy of thin-section CT in 129 patients. Radiology. 1999 May;211(2):555–560. doi: 10.1148/radiology.211.2.r99ma01555. [DOI] [PubMed] [Google Scholar]
  14. Kazerooni E. A. High-resolution CT of the lungs. AJR Am J Roentgenol. 2001 Sep;177(3):501–519. doi: 10.2214/ajr.177.3.1770501. [DOI] [PubMed] [Google Scholar]
  15. Kong A., Barnett G. O., Mosteller F., Youtz C. How medical professionals evaluate expressions of probability. N Engl J Med. 1986 Sep 18;315(12):740–744. doi: 10.1056/NEJM198609183151206. [DOI] [PubMed] [Google Scholar]
  16. Kundel H. L., Polansky M. Mixture distribution and receiver operating characteristic analysis of bedside chest imaging with screen-film and computed radiography. Acad Radiol. 1997 Jan;4(1):1–7. doi: 10.1016/s1076-6332(97)80152-3. [DOI] [PubMed] [Google Scholar]
  17. Kundel Harold L., Polansky Marcia. Measurement of observer agreement. Radiology. 2003 Jun 20;228(2):303–308. doi: 10.1148/radiol.2282011860. [DOI] [PubMed] [Google Scholar]
  18. Lee K. S., Primack S. L., Staples C. A., Mayo J. R., Aldrich J. E., Müller N. L. Chronic infiltrative lung disease: comparison of diagnostic accuracies of radiography and low- and conventional-dose thin-section CT. Radiology. 1994 Jun;191(3):669–673. doi: 10.1148/radiology.191.3.8184044. [DOI] [PubMed] [Google Scholar]
  19. MacDonald S. L., Rubens M. B., Hansell D. M., Copley S. J., Desai S. R., du Bois R. M., Nicholson A. G., Colby T. V., Wells A. U. Nonspecific interstitial pneumonia and usual interstitial pneumonia: comparative appearances at and diagnostic accuracy of thin-section CT. Radiology. 2001 Dec;221(3):600–605. doi: 10.1148/radiol.2213010158. [DOI] [PubMed] [Google Scholar]
  20. MacDonald Sharyn, Müller Nestor L. Insights from HRCT: how they affect the management of diffuse parenchymal lung disease. Semin Respir Crit Care Med. 2003 Aug;24(4):357–364. doi: 10.1055/s-2003-42372. [DOI] [PubMed] [Google Scholar]
  21. Mathieson J. R., Mayo J. R., Staples C. A., Müller N. L. Chronic diffuse infiltrative lung disease: comparison of diagnostic accuracy of CT and chest radiography. Radiology. 1989 Apr;171(1):111–116. doi: 10.1148/radiology.171.1.2928513. [DOI] [PubMed] [Google Scholar]
  22. Müller N. L., Staples C. A., Miller R. R., Vedal S., Thurlbeck W. M., Ostrow D. N. Disease activity in idiopathic pulmonary fibrosis: CT and pathologic correlation. Radiology. 1987 Dec;165(3):731–734. doi: 10.1148/radiology.165.3.3685351. [DOI] [PubMed] [Google Scholar]
  23. Nagai S., Kitaichi M., Itoh H., Nishimura K., Izumi T., Colby T. V. Idiopathic nonspecific interstitial pneumonia/fibrosis: comparison with idiopathic pulmonary fibrosis and BOOP. Eur Respir J. 1998 Nov;12(5):1010–1019. doi: 10.1183/09031936.98.12051010. [DOI] [PubMed] [Google Scholar]
  24. Park J. S., Lee K. S., Kim J. S., Park C. S., Suh Y. L., Choi D. L., Kim K. J. Nonspecific interstitial pneumonia with fibrosis: radiographic and CT findings in seven patients. Radiology. 1995 Jun;195(3):645–648. doi: 10.1148/radiology.195.3.7753988. [DOI] [PubMed] [Google Scholar]
  25. Remy-Jardin M., Giraud F., Remy J., Copin M. C., Gosselin B., Duhamel A. Importance of ground-glass attenuation in chronic diffuse infiltrative lung disease: pathologic-CT correlation. Radiology. 1993 Dec;189(3):693–698. doi: 10.1148/radiology.189.3.8234692. [DOI] [PubMed] [Google Scholar]
  26. Remy-Jardin M., Remy J., Wallaert B., Müller N. L. Subacute and chronic bird breeder hypersensitivity pneumonitis: sequential evaluation with CT and correlation with lung function tests and bronchoalveolar lavage. Radiology. 1993 Oct;189(1):111–118. doi: 10.1148/radiology.189.1.8372179. [DOI] [PubMed] [Google Scholar]
  27. Soler P., Bergeron A., Kambouchner M., Groussard O., Brauner M., Grenier P., Crestani B., Mal H., Tazi A., Battesti J. P. Is high-resolution computed tomography a reliable tool to predict the histopathological activity of pulmonary Langerhans cell histiocytosis? Am J Respir Crit Care Med. 2000 Jul;162(1):264–270. doi: 10.1164/ajrccm.162.1.9906010. [DOI] [PubMed] [Google Scholar]
  28. Walsh Edward E., Peterson Derick R., Falsey Ann R. Risk factors for severe respiratory syncytial virus infection in elderly persons. J Infect Dis. 2004 Jan 9;189(2):233–238. doi: 10.1086/380907. [DOI] [PubMed] [Google Scholar]
  29. Wells A. U., Hansell D. M., Rubens M. B., Cullinan P., Black C. M., du Bois R. M. The predictive value of appearances on thin-section computed tomography in fibrosing alveolitis. Am Rev Respir Dis. 1993 Oct;148(4 Pt 1):1076–1082. doi: 10.1164/ajrccm/148.4_Pt_1.1076. [DOI] [PubMed] [Google Scholar]

Articles from Thorax are provided here courtesy of BMJ Publishing Group

RESOURCES