Skip to main content
Proceedings of the Annual Symposium on Computer Application in Medical Care logoLink to Proceedings of the Annual Symposium on Computer Application in Medical Care
. 1988 Nov 9:220–224.

Confronting Subjective Criteria in the Evaluation of Computer-Based Critiquing Advice

Michael A Rothschild, Perry L Miller, Paul R Fisher, Gregory G Weltin, Henry A Swett
PMCID: PMC2245237

Abstract

There is a need for formal evaluation in the development of any computer-based expert systems. This may be quite difficult when judging a critiquing system, that is, a system which responds to a proposed management strategy with an explanatory prose discussion of the advisability of that approach. DxCON is an expert system which produces prose critiques discussing the radiologic workup of obstructive jaundice. This paper briefly describes DxCON, and then focuses on a study performed to validate its knowledge. The need to confront subjective as well as objective criteria in the evaluation of expert critiquing systems is explored.

Full text

PDF
220

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Hickam D. H., Shortliffe E. H., Bischoff M. B., Scott A. C., Jacobs C. D. The treatment advice of a computer-based cancer chemotherapy protocol advisor. Ann Intern Med. 1985 Dec;103(6 ):928–936. doi: 10.7326/0003-4819-103-6-928. [DOI] [PubMed] [Google Scholar]
  2. Miller P. L., Blumenfrucht S. J., Black H. R. An expert system which critiques patient workup: modeling conflicting expertise. Comput Biomed Res. 1984 Dec;17(6):554–569. doi: 10.1016/0010-4809(84)90020-x. [DOI] [PubMed] [Google Scholar]
  3. Miller P. L. Critiquing anesthetic management: the "ATTENDING" computer system. Anesthesiology. 1983 Apr;58(4):362–369. doi: 10.1097/00000542-198304000-00011. [DOI] [PubMed] [Google Scholar]
  4. Miller R. A., Pople H. E., Jr, Myers J. D. Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med. 1982 Aug 19;307(8):468–476. doi: 10.1056/NEJM198208193070803. [DOI] [PubMed] [Google Scholar]
  5. Yu V. L., Fagan L. M., Wraith S. M., Clancey W. J., Scott A. C., Hannigan J., Blum R. L., Buchanan B. G., Cohen S. N. Antimicrobial selection by a computer. A blinded evaluation by infectious diseases experts. JAMA. 1979 Sep 21;242(12):1279–1282. [PubMed] [Google Scholar]

Articles from Proceedings of the Annual Symposium on Computer Application in Medical Care are provided here courtesy of American Medical Informatics Association

RESOURCES