Abstract
Two physicians and two lay readers were trained according to a detailed protocol in the grading of 17 lesions found in diabetic retinopathy by evaluation of stereo fundus photographs according to a modified Airlie House classification. Intraobserver and interobserver variability of these readers was assessed by two methods: weighted kappa, and frequency of agreement within one grade. In general, physician readers were found to be less variable on replicate readings than were lay leaders, and had slightly better agreement with each other than with the lay readers. The physiological significance of the direction and magnitude of the difference between physician and lay reader variability for individual lesions was often uncertain. Assessment of contribution to disagreement by individual readers was possible and permits future training directed at reducing disagreement to acceptable values.
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Ganley J. P., Comstock G. W. Benign nevi and malignant melanomas of the choroid. Am J Ophthalmol. 1973 Jul;76(1):19–25. doi: 10.1016/0002-9394(73)90003-2. [DOI] [PubMed] [Google Scholar]
- Kahn H. A. An extraordinary opportunity. Am J Ophthalmol. 1973 Jul;76(1):164–165. doi: 10.1016/0002-9394(73)90029-9. [DOI] [PubMed] [Google Scholar]
- Kahn H. A., Leibowitz H., Ganley J. P., Kini M., Colton T., Nickerson R., Dawber T. R. Randomized controlled clinical trial. National Eye Institute workshop for ophthalmologists. Standardizing diagnostic procedures. Am J Ophthalmol. 1975 May;79(5):768–775. [PubMed] [Google Scholar]
- Koran L. M. The reliability of clinical methods, data and judgments (first of two parts). N Engl J Med. 1975 Sep 25;293(13):642–646. doi: 10.1056/NEJM197509252931307. [DOI] [PubMed] [Google Scholar]
- Koran L. M. The reliability of clinical methods, data and judgments (second of two parts). N Engl J Med. 1975 Oct 2;293(14):695–701. doi: 10.1056/NEJM197510022931405. [DOI] [PubMed] [Google Scholar]
- Kupfer C. Evaluation of the treatment of diabetic retinopathy. A research project. Sight Sav Rev. 1973 Spring;43(1):17–28. [PubMed] [Google Scholar]
- Rogot E., Goldberg I. D. A proposed index for measuring agreement in test-retest studies. J Chronic Dis. 1966 Sep;19(9):991–1006. doi: 10.1016/0021-9681(66)90032-4. [DOI] [PubMed] [Google Scholar]