Skip to main content
Proceedings of the AMIA Symposium logoLink to Proceedings of the AMIA Symposium
. 1998:882–886.

Towards knowledge-based retrieval of medical images. The role of semantic indexing, image content representation and knowledge-based retrieval.

H J Lowe 1, I Antipov 1, W Hersh 1, C A Smith 1
PMCID: PMC2232296  PMID: 9929345

Abstract

Medicine is increasingly image-intensive. The central importance of imaging technologies such as computerized tomography and magnetic resonance imaging in clinical decision making, combined with the trend to store many "traditional" clinical images such as conventional radiographs, microscopic pathology and dermatology images in digital format present both challenges and an opportunities for the designers of clinical information systems. The emergence of Multimedia Electronic Medical Record Systems (MEMRS), architectures that integrate medical images with text-based clinical data, will further hasten this trend. The development of these systems, storing a large and diverse set of medical images, suggests that in the future MEMRS will become important digital libraries supporting patient care, research and education. The representation and retrieval of clinical images within these systems is problematic as conventional database architectures and information retrieval models have, until recently, focused largely on text-based data. Medical imaging data differs in many ways from text-based medical data but perhaps the most important difference is that the information contained within imaging data is fundamentally knowledge-based. New representational and retrieval models for clinical images will be required to address this issue. Within the Image Engine multimedia medical record system project at the University of Pittsburgh we are evolving an approach to representation and retrieval of medical images which combines semantic indexing using the UMLS Metathesuarus, image content-based representation and knowledge-based image analysis.

Full text

PDF
882

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Betal D., Roberts N., Whitehouse G. H. Segmentation and numerical analysis of microcalcifications on mammograms using mathematical morphology. Br J Radiol. 1997 Sep;70(837):903–917. doi: 10.1259/bjr.70.837.9486066. [DOI] [PubMed] [Google Scholar]
  2. Bidgood W. D., Jr, Horii S. C., Prior F. W., Van Syckle D. E. Understanding and using DICOM, the data interchange standard for biomedical imaging. J Am Med Inform Assoc. 1997 May-Jun;4(3):199–212. doi: 10.1136/jamia.1997.0040199. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Honeyman J. C., Frost M. M., Huda W., Loeffler W., Ott M., Staab E. V. Picture archiving and communications systems (PACS). Curr Probl Diagn Radiol. 1994 Jul-Aug;23(4):101–158. doi: 10.1016/0363-0188(94)90004-3. [DOI] [PubMed] [Google Scholar]
  4. Kenet R. D. Digital imaging in dermatology. Clin Dermatol. 1995 Jul-Aug;13(4):381–392. doi: 10.1016/0738-081x(95)00081-p. [DOI] [PubMed] [Google Scholar]
  5. McCray A. T., Razi A. M., Bangalore A. K., Browne A. C., Stavri P. Z. The UMLS Knowledge Source Server: a versatile Internet-based research tool. Proc AMIA Annu Fall Symp. 1996:164–168. [PMC free article] [PubMed] [Google Scholar]
  6. O'Brien M. J., Sotnikov A. V. Digital imaging in anatomic pathology. Am J Clin Pathol. 1996 Oct;106(4 Suppl 1):S25–S32. [PubMed] [Google Scholar]
  7. Robinson G. P., Tagare H. D., Duncan J. S., Jaffe C. C. Medical image collection indexing: shape-based retrieval using KD-trees. Comput Med Imaging Graph. 1996 Jul-Aug;20(4):209–217. doi: 10.1016/s0895-6111(96)00014-6. [DOI] [PubMed] [Google Scholar]
  8. Saiviroonporn P., Robatino A., Zahajszky J., Kikinis R., Jolesz F. A. Real-time interactive three-dimensional segmentation. Acad Radiol. 1998 Jan;5(1):49–56. doi: 10.1016/s1076-6332(98)80011-1. [DOI] [PubMed] [Google Scholar]
  9. Thomas J. D., Nissen S. E. Digital storage and transmission of cardiovascular images: what are the costs, benefits and timetable for conversion? Heart. 1996 Jul;76(1):13–17. doi: 10.1136/hrt.76.1.13. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Proceedings of the AMIA Symposium are provided here courtesy of American Medical Informatics Association

RESOURCES