Abstract
Observer variation in the grading of dysplasia in 100 colorectal adenomas has been analysed by kappa statistics. Intraobserver agreement was only 70% and 67% for the two principal observers, and, as would be expected, interobserver agreement was even lower at 59% and 66%. Although the kappa values were significantly different from chance at the 0.1% level, there were substantial disagreements. When the study was extended to four observers, agreement between observer pairings was considerably worse (as low as 34%), and in four pairings the kappa values did not differ significantly from those expected by chance alone even at the 5% level. In an endeavour to improve agreement we adopted a percentage estimation grading method; but this failed to achieve any improvement when comparing overall grades. The percentage estimates of the two observers, however, showed a highly significant correlation. To identify the cytological features given most weight by the principal observers in assessing dysplasia we undertook morphometry on 30 adenomas using an image analysis computer. The nuclear to cytoplasmic ratio, variation in nuclear area, and variation in nuclear height above the basement membrane showed significant differences between mild, moderate, and severely dysplastic epithelia. While evaluation of these parameters therefore appears to be most important in the subjective interpretation of dysplasia, this study has shown that such evaluation is poorly standardised between observers and poorly reproduced within observers. Our findings of poor agreement in the grading of dysplasia in colorectal adenomas has serious implications for the assessment of dysplasia in inflammatory bowel disease, where the added problem of reactive cellular atypia brings greater complexity to these subjective judgments.
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Ekelund G., Lindström C. Histopathological analysis of benign polyps in patients with carcinoma of the colon and rectum. Gut. 1974 Aug;15(8):654–663. doi: 10.1136/gut.15.8.654. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Elias H., Hyde D. M., Mullens R. S., Lambert F. C. Colonic adenomas: stereology and growth mechanisms. Dis Colon Rectum. 1981 Jul-Aug;24(5):331–342. doi: 10.1007/BF02603412. [DOI] [PubMed] [Google Scholar]
- Franklin C. D., Smith C. J. Stereological analysis of histological parameters in experimental premalignant hamster cheek pouch epithelium. J Pathol. 1980 Mar;130(3):201–215. doi: 10.1002/path.1711300309. [DOI] [PubMed] [Google Scholar]
- Jass J. R. A classification of gastric dysplasia. Histopathology. 1983 Mar;7(2):181–193. doi: 10.1111/j.1365-2559.1983.tb02234.x. [DOI] [PubMed] [Google Scholar]
- Konishi F., Morson B. C. Pathology of colorectal adenomas: a colonoscopic survey. J Clin Pathol. 1982 Aug;35(8):830–841. doi: 10.1136/jcp.35.8.830. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kozuka S. Premalignancy of the mucosal polyp in the large intestine: I. Histologic gradation of the polyp on the basis of epithelial pseudostratification and glandular branching. Dis Colon Rectum. 1975 Sep;18(6):483–493. doi: 10.1007/BF02587217. [DOI] [PubMed] [Google Scholar]
- Landis J. R., Koch G. G. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–174. [PubMed] [Google Scholar]
- Riddell R. H., Goldman H., Ransohoff D. F., Appelman H. D., Fenoglio C. M., Haggitt R. C., Ahren C., Correa P., Hamilton S. R., Morson B. C. Dysplasia in inflammatory bowel disease: standardized classification with provisional clinical applications. Hum Pathol. 1983 Nov;14(11):931–968. doi: 10.1016/s0046-8177(83)80175-0. [DOI] [PubMed] [Google Scholar]
- Sato E., Goto M., Nakamura T. Nuclear ultrastructure in carcinoma, adenoma, Peutz-Jeghers polyp and dysplasia of the large bowel: a morphometric analysis. Gan. 1981 Apr;72(2):245–253. [PubMed] [Google Scholar]
- Silcocks P. B. Measuring repeatability and validity of histological diagnosis--a brief review with some practical examples. J Clin Pathol. 1983 Nov;36(11):1269–1275. doi: 10.1136/jcp.36.11.1269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thomas G. D., Dixon M. F., Smeeton N. C., Williams N. S. Observer variation in the histological grading of rectal carcinoma. J Clin Pathol. 1983 Apr;36(4):385–391. doi: 10.1136/jcp.36.4.385. [DOI] [PMC free article] [PubMed] [Google Scholar]