Abstract
The Menelas project aimed to produce a normalized conceptual representation from natural language patient discharge summaries. Because of the complex and detailed nature of conceptual representations, evaluating the quality of output of such a system is difficult. We present the method designed to measure the quality of Menelas output, and its application to the state of the French Menelas prototype as of the end of the project. We examine this method in the framework recently proposed by Friedman and Hripcsak. We also propose two conditions which enable to reduce the evaluation preparation workload.
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Delamarre D., Burgun A., Seka L. P., Le Beux P. Automated coding of patient discharge summaries using conceptual graphs. Methods Inf Med. 1995 Sep;34(4):345–351. [PubMed] [Google Scholar]
- Hahn U., Schnattinger K., Romacker M. Automatic knowledge acquisition from medical texts. Proc AMIA Annu Fall Symp. 1996:383–387. [PMC free article] [PubMed] [Google Scholar]
- Nangle B., Keane M. T. Effective retrieval in Hospital Information Systems: the use of context in answering queries to Patient Discharge Summaries. Artif Intell Med. 1994 Jun;6(3):207–227. doi: 10.1016/0933-3657(94)90063-9. [DOI] [PubMed] [Google Scholar]
- Rassinoux A. M., Wagner J. C., Lovis C., Baud R. H., Rector A., Scherrer J. R. Analysis of medical texts based on a sound medical model. Proc Annu Symp Comput Appl Med Care. 1995:27–31. [PMC free article] [PubMed] [Google Scholar]
- Rector A. L., Bechhofer S., Goble C. A., Horrocks I., Nowlan W. A., Solomon W. D. The GRAIL concept modelling language for medical terminology. Artif Intell Med. 1997 Feb;9(2):139–171. doi: 10.1016/s0933-3657(96)00369-7. [DOI] [PubMed] [Google Scholar]
- Zweigenbaum P., Bachimont B., Bouaud J., Charlet J., Boisvieux J. F. Issues in the structuring and acquisition of an ontology for medical language understanding. Methods Inf Med. 1995 Mar;34(1-2):15–24. [PubMed] [Google Scholar]
- Zweigenbaum P. MENELAS: an access system for medical records using natural language. Comput Methods Programs Biomed. 1994 Oct;45(1-2):117–120. doi: 10.1016/0169-2607(94)90029-9. [DOI] [PubMed] [Google Scholar]