Abstract
PURPOSE: An analysis of data from the Advanced Glaucoma Intervention Study (AGIS) has found eyes reported to have partial optic disc rim notching (not to the edge) at baseline to have less risk of subsequent visual field loss than eyes with no notching. Because this is counterintuitive and because classification of notching had not been defined in the AGIS protocol, we have assessed AGIS ophthalmologists interobserver and intraobserver agreement on notching. METHODS: Fourteen glaucoma subspecialists classified notching in 26 pairs of stereoscopic disc photographs of eyes with mild to severe glaucomatous optic neuropathy. They classified images as showing either no notching, notching not to the edge, or notching to the edge. Several hours later, 10 of them classified the same images a second time. RESULTS: In an analysis of interobserver agreement, of 26 stereoscopic images, a plurality of ophthalmologists classified notching as absent in 9 (35%), as present but not to the edge in 7 (27%), and as present and not to the edge in 10 (38%). All 14 ophthalmologists (100%) agreed on the classification of 7 (27%) of the images, and 13 of the 14 ophthalmologists (93%) agreed on the classification of 4 additional images (15%). Of these 11 images with at least 93% agreement, notching was reported as absent in 3 (27%) and to the edge in 8 (73%). In the remaining 15 images, there was substantial disagreement about whether notching was present and, if so, whether it was to the edge. In an analysis of intraobserver agreement, none of the 10 ophthalmologists who completed the viewing a second time classified all eyes exactly the same as the first time, though 5 ophthalmologists made 4 or fewer reclassifications. Overall, 80% of the original classifications were reproduced on second reading. Of the initial classifications that were not reproduced, slightly more than half were first classified as having notching not to the edge. CONCLUSION: Without definitions or examples of optic disc rim notching, the glaucoma subspecialists had relatively high intraobserver agreement but were likely to disagree with each other in characterizing the degree of disc rim notching. We recommend development of a standard photographic classification of disc rim notching. The classification should be tested for inter- and intra-observer agreement.
Full Text
The Full Text of this article is available as a PDF (186.7 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Chylack L. T., Jr, Leske M. C., McCarthy D., Khu P., Kashiwagi T., Sperduto R. Lens opacities classification system II (LOCS II) Arch Ophthalmol. 1989 Jul;107(7):991–997. doi: 10.1001/archopht.1989.01070020053028. [DOI] [PubMed] [Google Scholar]
- Ederer F., Gaasterland D. E., Sullivan E. K., AGIS Investigators The Advanced Glaucoma Intervention Study (AGIS): 1. Study design and methods and baseline characteristics of study patients. Control Clin Trials. 1994 Aug;15(4):299–325. doi: 10.1016/0197-2456(94)90046-9. [DOI] [PubMed] [Google Scholar]
- Hitchings R. A., Spaeth G. L. The optic disc in glaucoma. I: Classification. Br J Ophthalmol. 1976 Nov;60(11):778–785. doi: 10.1136/bjo.60.11.778. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kahn H. A., Leibowitz H., Ganley J. P., Kini M., Colton T., Nickerson R., Dawber T. R. Randomized controlled clinical trial. National Eye Institute workshop for ophthalmologists. Standardizing diagnostic procedures. Am J Ophthalmol. 1975 May;79(5):768–775. [PubMed] [Google Scholar]
- Lichter P. R. Variability of expert observers in evaluating the optic disc. Trans Am Ophthalmol Soc. 1976;74:532–572. [PMC free article] [PubMed] [Google Scholar]
- Lichter P. R. Variability of expert observers in evaluating the optic disc. Trans Am Ophthalmol Soc. 1976;74:532–572. [PMC free article] [PubMed] [Google Scholar]
- Seigel D. G., Podgor M. J., Remaley N. A. Acceptable values of kappa for comparison of two groups. Am J Epidemiol. 1992 Mar 1;135(5):571–578. doi: 10.1093/oxfordjournals.aje.a116324. [DOI] [PubMed] [Google Scholar]
- Tielsch J. M., Katz J., Quigley H. A., Miller N. R., Sommer A. Intraobserver and interobserver agreement in measurement of optic disc characteristics. Ophthalmology. 1988 Mar;95(3):350–356. doi: 10.1016/s0161-6420(88)33177-5. [DOI] [PubMed] [Google Scholar]
- Varma R., Spaeth G. L., Steinmann W. C., Katz L. J. Agreement between clinicians and an image analyzer in estimating cup-to-disc ratios. Arch Ophthalmol. 1989 Apr;107(4):526–529. doi: 10.1001/archopht.1989.01070010540027. [DOI] [PubMed] [Google Scholar]
- Varma R., Steinmann W. C., Scott I. U. Expert agreement in evaluating the optic disc for glaucoma. Ophthalmology. 1992 Feb;99(2):215–221. doi: 10.1016/s0161-6420(92)31990-6. [DOI] [PubMed] [Google Scholar]
- Zangwill L., Shakiba S., Caprioli J., Weinreb R. N. Agreement between clinicians and a confocal scanning laser ophthalmoscope in estimating cup/disk ratios. Am J Ophthalmol. 1995 Apr;119(4):415–421. doi: 10.1016/s0002-9394(14)71226-7. [DOI] [PubMed] [Google Scholar]