Skip to main content
PMC home page
Proceedings of the Annual Symposium on Computer Application in Medical Care logoLink to Proceedings of the Annual Symposium on Computer Application in Medical Care
. 1991:3–7.

Field trials of medical decision-aids: potential problems and solutions.

J Wyatt 1, D Spiegelhalter 1
PMCID: PMC2247484  PMID: 1807610

Abstract

Only clinical trials can assess the impact of prototype medical decision-aids, but they are seldom performed before dissemination. Many problems are encountered when designing such studies, including ensuring generality, deciding what to measure, feasible study designs, correcting for biases caused by the trial itself and by the decision-aid, resolving the "Evaluation Paradox", and potential legal and ethical doubts. These are discussed in this paper.

Full text

PDF
3

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Adams I. D., Chan M., Clifford P. C., Cooke W. M., Dallos V., de Dombal F. T., Edwards M. H., Hancock D. M., Hewett D. J., McIntyre N. Computer aided diagnosis of acute abdominal pain: a multicentre study. Br Med J (Clin Res Ed) 1986 Sep 27;293(6550):800–804. doi: 10.1136/bmj.293.6550.800. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Brahams D., Wyatt J. Decision aids and the law. Lancet. 1989 Sep 9;2(8663):632–634. doi: 10.1016/s0140-6736(89)90765-4. [DOI] [PubMed] [Google Scholar]
  3. Buck C., Donner A. The design of controlled experiments in the evaluation of non-therapeutic interventions. J Chronic Dis. 1982;35(7):531–538. doi: 10.1016/0021-9681(82)90072-8. [DOI] [PubMed] [Google Scholar]
  4. Cornfield J. Randomization by group: a formal analysis. Am J Epidemiol. 1978 Aug;108(2):100–102. doi: 10.1093/oxfordjournals.aje.a112592. [DOI] [PubMed] [Google Scholar]
  5. Donabedian A. Evaluating the quality of medical care. Milbank Mem Fund Q. 1966 Jul;44(3 Suppl):166–206. [PubMed] [Google Scholar]
  6. Fenyö G. Routine use of a scoring system for decision-making in suspected acute appendicitis in adults. Acta Chir Scand. 1987 Sep;153(9):545–551. [PubMed] [Google Scholar]
  7. Hart A., Wyatt J. Evaluating black-boxes as medical decision aids: issues arising from a study of neural networks. Med Inform (Lond) 1990 Jul-Sep;15(3):229–236. doi: 10.3109/14639239009025270. [DOI] [PubMed] [Google Scholar]
  8. Lundsgaarde H. P. Evaluating medical expert systems. Soc Sci Med. 1987;24(10):805–819. doi: 10.1016/0277-9536(87)90182-1. [DOI] [PubMed] [Google Scholar]
  9. Miller P. L. The evaluation of artificial intelligence systems in medicine. Comput Methods Programs Biomed. 1986 Mar;22(1):5–11. [PubMed] [Google Scholar]
  10. Pozen M. W., D'Agostino R. B., Selker H. P., Sytkowski P. A., Hood W. B., Jr A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. A prospective multicenter clinical trial. N Engl J Med. 1984 May 17;310(20):1273–1278. doi: 10.1056/NEJM198405173102001. [DOI] [PubMed] [Google Scholar]
  11. Shortliffe E. H. Computer programs to support clinical decision making. JAMA. 1987 Jul 3;258(1):61–66. [PubMed] [Google Scholar]
  12. Spiegelhalter D. J. Evaluation of clinical decision-aids, with an application to a system for dyspepsia. Stat Med. 1983 Apr-Jun;2(2):207–216. doi: 10.1002/sim.4780020215. [DOI] [PubMed] [Google Scholar]
  13. Wyatt J., Spiegelhalter D. Evaluating medical expert systems: what to test and how? Med Inform (Lond) 1990 Jul-Sep;15(3):205–217. doi: 10.3109/14639239009025268. [DOI] [PubMed] [Google Scholar]

Articles from Proceedings of the Annual Symposium on Computer Application in Medical Care are provided here courtesy of American Medical Informatics Association

RESOURCES