Abstract
OBJECTIVE—The radiographic diagnosis of osteoarthritis (OA) in the peripheral skeleton is dependent on the skilled examination of several morphological characteristics of the condition as visualised on plain radiographs. However, the process is perceptual and generally enhanced by comparison against photographic standards. This study assessed the intra-rater and inter-rater reliability of radiologists experienced in reporting hand, hip and knee films derived from a community-based sample when using the photographic atlas recently developed by Burnett et al. METHODS—This study was part of a multifaceted diagnostics protocol, evaluating methodological issues, in the conduct of genetic research in osteoarthritis. From a cohort of 118 twin pairs, registered with the Australian Twins Registry (ATR), standard clinical examinations were performed on 74 complete and 11 incomplete pairs of twins over age 50 years, followed by standard AP hand, AP pelvis and AP standing radiographs of the knees. The pairs were selected both to represent twin pairs who had previously self reported a diagnosis of OA, as well as those who had not. Radiologists read the films blind to the original self reported diagnosis and without reference to their pairing. The films were read by comparison against photographic standards and were scored according to specific features. All films were read independently by two consultant radiologists blind to one another's assessments, and selected films were thereafter assigned for rereading. Inter-rater and intra-rater agreement were different for different features, different anatomic areas, and, for the former, were different for the two radiologists. RESULTS—Inter-rater agreement was different for different anatomic areas, different radiographic features, and the two radiologists. Intra-rater agreement for the presence or absence of OA was as follows: actual observed agreement = 0.79 to 0.97 and 0.83 to 0.98; adjusted κ statistic = 0.58 to 0.94 and 0.67 to 0.96; inter-rater agreement was as follows: actual observed agreement = 0.77 to 0.97; adjusted κ statistic = 0.54 to 0.94. Agreement was generally high in most of the principal target joints for OA: DIP, PIP, 1st CMC, hip and knee. CONCLUSIONS—Although assessor agreement was not perfect, it is concluded that for genetic epidemiology purposes, while duplicate assessments may be advantageous, it is possible for radiographs to be examined accurately by a single experienced assessor. However, for less experienced assessors independent examinations should be made by at least two assessors and either a consensus reached on disparate examinations or an algorithm developed to adjudicate any discrepancies.
Full Text
The Full Text of this article is available as a PDF (65.1 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Altman R. D., Hochberg M., Murphy W. A., Jr, Wolfe F., Lequesne M. Atlas of individual radiographic features in osteoarthritis. Osteoarthritis Cartilage. 1995 Sep;3 (Suppl A):3–70. [PubMed] [Google Scholar]
- Byrt T., Bishop J., Carlin J. B. Bias, prevalence and kappa. J Clin Epidemiol. 1993 May;46(5):423–429. doi: 10.1016/0895-4356(93)90018-v. [DOI] [PubMed] [Google Scholar]
- Cooper C., Cushnaghan J., Kirwan J. R., Dieppe P. A., Rogers J., McAlindon T., McCrae F. Radiographic assessment of the knee joint in osteoarthritis. Ann Rheum Dis. 1992 Jan;51(1):80–82. doi: 10.1136/ard.51.1.80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hart D. J., Spector T. D., Brown P., Wilson P., Doyle D. V., Silman A. J. Clinical signs of early osteoarthritis: reproducibility and relation to x ray changes in 541 women in the general population. Ann Rheum Dis. 1991 Jul;50(7):467–470. doi: 10.1136/ard.50.7.467. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hart D. J., Spector T. D. Radiographic criteria for epidemiologic studies of osteoarthritis. J Rheumatol Suppl. 1995 Feb;43:46–48. [PubMed] [Google Scholar]
- KELLGREN J. H., LAWRENCE J. S. Radiological assessment of osteo-arthrosis. Ann Rheum Dis. 1957 Dec;16(4):494–502. doi: 10.1136/ard.16.4.494. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Scott W. W., Jr, Lethbridge-Cejku M., Reichle R., Wigley F. M., Tobin J. D., Hochberg M. C. Reliability of grading scales for individual radiographic features of osteoarthritis of the knee. The Baltimore longitudinal study of aging atlas of knee osteoarthritis. Invest Radiol. 1993 Jun;28(6):497–501. [PubMed] [Google Scholar]
- Spector T. D., Hart D. J., Byrne J., Harris P. A., Dacre J. E., Doyle D. V. Definition of osteoarthritis of the knee for epidemiological studies. Ann Rheum Dis. 1993 Nov;52(11):790–794. doi: 10.1136/ard.52.11.790. [DOI] [PMC free article] [PubMed] [Google Scholar]