Skip to main content
NCBI home page
Journal of Clinical Pathology logoLink to Journal of Clinical Pathology
. 1983 Nov;36(11):1269–1275. doi: 10.1136/jcp.36.11.1269

Measuring repeatability and validity of histological diagnosis--a brief review with some practical examples.

P B Silcocks
PMCID: PMC498544  PMID: 6313770

Abstract

Evaluation of histological diagnosis requires an index of agreement (to measure repeatability and validity) together with a method of assessing bias. Cohen's kappa statistic appears to be the most suitable tool for measuring levels of agreement, which if unsatisfactory may be caused by bias. Further study of bias is possible by examining levels of agreement for each diagnostic category or by searching for categories of disagreement in which more observations occur than would be expected by chance alone. This article gives reasons for choosing the kappa statistic, with examples illustrating its calculation and the investigation of bias.

Full text

PDF
1269

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Barr W. T. Technical quality control in histopathology. J Clin Pathol. 1978 Oct;31(10):996–998. doi: 10.1136/jcp.31.10.996. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Barr W. T., Williams E. D. Value of external quality assessment of the technical aspects of histopathology. J Clin Pathol. 1982 Oct;35(10):1050–1056. doi: 10.1136/jcp.35.10.1050. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Blenkinsopp W. K., Stewart-Brown S., Blesovsky L., Kearney G., Fielding L. P. Histopathology reporting in large bowel cancer. J Clin Pathol. 1981 May;34(5):509–513. doi: 10.1136/jcp.34.5.509. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bulpitt C. J., Dollery C. T., Carne S. Change in symptoms of hypertensive patients after referral to hospital clinic. Br Heart J. 1976 Feb;38(2):121–128. doi: 10.1136/hrt.38.2.121. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Cocker J., Fox H., Langley F. A. Consistency in the histological diagnosis of epithelial abnormalities of the cervix uteri. J Clin Pathol. 1968 Jan;21(1):67–70. doi: 10.1136/jcp.21.1.67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Corson J. M., Pinkus G. S. Mesothelioma: profile of keratin proteins and carcinoembryonic antigen: an immunoperoxidase study of 20 cases and comparison with pulmonary adenocarcinomas. Am J Pathol. 1982 Jul;108(1):80–88. [PMC free article] [PubMed] [Google Scholar]
  7. Ellis P. S., Whitehead R. Mitosis counting--a need for reappraisal. Hum Pathol. 1981 Jan;12(1):3–4. doi: 10.1016/s0046-8177(81)80235-3. [DOI] [PubMed] [Google Scholar]
  8. Feinstein A. R., Gelfman N. A., Yesner R. Observer variability in the histopathologic diagnosis of lung cancer. Am Rev Respir Dis. 1970 May;101(5):671–684. doi: 10.1164/arrd.1970.101.5.671. [DOI] [PubMed] [Google Scholar]
  9. Fisher E. R., Redmond C., Fisher B. Histologic grading of breast cancer. Pathol Annu. 1980;15(Pt 1):239–251. [PubMed] [Google Scholar]
  10. Holman C. D., James I. R., Heenan P. J., Matz L. R., Blackwell J. B., Kelsall G. R., Singh A., ten Seldam R. E. An improved method of analysis of observer variation between pathologists. Histopathology. 1982 Sep;6(5):581–589. doi: 10.1111/j.1365-2559.1982.tb02752.x. [DOI] [PubMed] [Google Scholar]
  11. Iversen O. H., Sandnes K. The reliability of pathologists. A study of some cases of lymph node biopsies showing giant follicular hyperplasia or lymphoma. Acta Pathol Microbiol Scand A. 1971;79(4):330–334. [PubMed] [Google Scholar]
  12. Kramer I. R. Computer-aided analyses in diagnostic histopathology. Postgrad Med J. 1975 Oct;51(600):690–694. doi: 10.1136/pgmj.51.600.690. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Kwee W. S., Veldhuizen R. W., Golding R. P., Mullink H., Stam J., Donner R., Boon M. E. Histologic distinction between malignant mesothelioma, benign pleural lesion and carcinoma metastasis. Evaluation of the application of morphometry combined with histochemistry and immunostaining. Virchows Arch A Pathol Anat Histol. 1982;397(3):287–299. doi: 10.1007/BF00496570. [DOI] [PubMed] [Google Scholar]
  14. Lambourne A., Lederer H. Effects of observer variation in population screening for cervical carcinoma. J Clin Pathol. 1973 Aug;26(8):564–569. doi: 10.1136/jcp.26.8.564. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Landis J. R., Koch G. G. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–174. [PubMed] [Google Scholar]
  16. Macartney J. C., Henson D. E., Codling B. W. Quality assurance in anatomic pathology. Am J Clin Pathol. 1981 Mar;75(3 Suppl):467–475. [PubMed] [Google Scholar]
  17. Owen D. A., Tighe J. R. Letter: Quality evaluation in histopathology. Br Med J. 1975 Jan 18;1(5950):149–150. doi: 10.1136/bmj.1.5950.149-a. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Rogot E., Goldberg I. D. A proposed index for measuring agreement in test-retest studies. J Chronic Dis. 1966 Sep;19(9):991–1006. doi: 10.1016/0021-9681(66)90032-4. [DOI] [PubMed] [Google Scholar]
  19. Sissons H. A. Agreement and disagreement between pathologists in histological diagnosis. Postgrad Med J. 1975 Oct;51(600):685–689. doi: 10.1136/pgmj.51.600.685. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Spitzer R. L., Cohen J., Fleiss J. L., Endicott J. Quantification of agreement in psychiatric diagnosis. A new approach. Arch Gen Psychiatry. 1967 Jul;17(1):83–87. doi: 10.1001/archpsyc.1967.01730250085012. [DOI] [PubMed] [Google Scholar]
  21. Stanley K. E., Matthews M. J. Analysis of a pathology review of patients with lung tumors. J Natl Cancer Inst. 1981 Jun;66(6):989–992. doi: 10.1093/jnci/66.6.989. [DOI] [PubMed] [Google Scholar]
  22. Stenkvist B., Bengtsson E., Eriksson O., Jarkrans T., Nordin B., Westman-Naeser S. Histopathological systems of breast cancer classification: reproducibility and clinical significance. J Clin Pathol. 1983 Apr;36(4):392–398. doi: 10.1136/jcp.36.4.392. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Stenkvist B., Westman-Naeser S., Vegelius J., Holmquist J., Nordin B., Bengtsson E., Eriksson O. Analysis of reproducibility of subjective grading systems for breast carcinoma. J Clin Pathol. 1979 Oct;32(10):979–985. doi: 10.1136/jcp.32.10.979. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Thomas G. D., Dixon M. F., Smeeton N. C., Williams N. S. Observer variation in the histological grading of rectal carcinoma. J Clin Pathol. 1983 Apr;36(4):385–391. doi: 10.1136/jcp.36.4.385. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Wright E. A. Quality control in histopathology. Proc R Soc Med. 1975 Oct;68(10):619–622. [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Clinical Pathology are provided here courtesy of BMJ Publishing Group

RESOURCES