Abstract
OBJECTIVE: To understand better the trade-offs of not incorporating explicit time in Quick Medical Reference (QMR), a diagnostic system in the domain of general internal medicine, along the dimensions of expressive power and diagnostic accuracy. DESIGN: The study was conducted in two phases. Phase I was a descriptive analysis of the temporal abstractions incorporated in QMR's terms. Phase II was a pseudo-prospective controlled experiment, measuring the effect of history and physical examination temporal content on the diagnostic accuracy of QMR. MEASUREMENTS: For each QMR finding that would fit our operational definition of temporal finding, several parameters describing the temporal nature of the finding were assessed, the most important ones being: temporal primitives, time units, temporal uncertainty, processes, and patterns. The history, physical examination, and initial laboratory results of 105 consecutive patients admitted to the Pittsburgh University Presbyterian Hospital were analyzed for temporal content and factors that could potentially influence diagnostic accuracy (these included: rareness of primary diagnosis, case length, uncertainty, spatial/causal information, and multiple diseases). RESULTS: 776 findings were identified as temporal. The authors developed an ontology describing the terms utilized by QMR developers to express temporal knowledge. The authors classified the temporal abstractions found in QMR in 116 temporal types, 11 temporal templates, and a temporal hierarchy. The odds of QMR's making a correct diagnosis in high temporal complexity cases is 0.7 the odds when the temporal complexity is lower, but this result is not statistically significant (95% confidence interval = 0.27-1.83). CONCLUSIONS: QMR contains extensive implicit time modeling. These results support the conclusion that the abstracted encoding of time in the medical knowledge of QMR does not induce a diagnostic performance penalty.
Full Text
The Full Text of this article is available as a PDF (1.4 MB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Aliferis C. F., Miller R. A. On the heuristic nature of medical decision-support systems. Methods Inf Med. 1995 Mar;34(1-2):5–14. [PubMed] [Google Scholar]
- Berner E. S., Webster G. D., Shugerman A. A., Jackson J. R., Algina J., Baker A. L., Ball E. V., Cobbs C. G., Dennis V. W., Frenkel E. P. Performance of four computer-based diagnostic systems. N Engl J Med. 1994 Jun 23;330(25):1792–1796. doi: 10.1056/NEJM199406233302506. [DOI] [PubMed] [Google Scholar]
- Das A. K., Tu S. W., Purcell G. P., Musen M. A. An extended SQL for temporal data management in clinical decision-support systems. Proc Annu Symp Comput Appl Med Care. 1992:128–132. [PMC free article] [PubMed] [Google Scholar]
- Goodman S. N., Berlin J. A. The use of predicted confidence intervals when planning experiments and the misuse of power when interpreting results. Ann Intern Med. 1994 Aug 1;121(3):200–206. doi: 10.7326/0003-4819-121-3-199408010-00008. [DOI] [PubMed] [Google Scholar]
- Kahn M. G. Modeling time in medical decision-support programs. Med Decis Making. 1991 Oct-Dec;11(4):249–264. doi: 10.1177/0272989X9101100403. [DOI] [PubMed] [Google Scholar]
- Long W. J., Naimi S., Criscitiello M. G. Development of a knowledge base for diagnostic reasoning in cardiology. Comput Biomed Res. 1992 Jun;25(3):292–311. doi: 10.1016/0010-4809(92)90044-b. [DOI] [PubMed] [Google Scholar]
- Miller R. A., McNeil M. A., Challinor S. M., Masarie F. E., Jr, Myers J. D. The INTERNIST-1/QUICK MEDICAL REFERENCE project--status report. West J Med. 1986 Dec;145(6):816–822. [PMC free article] [PubMed] [Google Scholar]
- Miller R. A. Medical diagnostic decision support systems--past, present, and future: a threaded bibliography and brief commentary. J Am Med Inform Assoc. 1994 Jan-Feb;1(1):8–27. doi: 10.1136/jamia.1994.95236141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller R. A., Pople H. E., Jr, Myers J. D. Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med. 1982 Aug 19;307(8):468–476. doi: 10.1056/NEJM198208193070803. [DOI] [PubMed] [Google Scholar]
- Miller R., Masarie F. E., Myers J. D. Quick medical reference (QMR) for diagnostic assistance. MD Comput. 1986 Sep-Oct;3(5):34–48. [PubMed] [Google Scholar]
- Parker R. C., Miller R. A. Creation of realistic appearing simulated patient cases using the INTERNIST-1/QMR knowledge base and interrelationship properties of manifestations. Methods Inf Med. 1989 Nov;28(4):346–351. [PubMed] [Google Scholar]
- Shahar Y., Musen M. A. RESUME: a temporal-abstraction system for patient monitoring. Comput Biomed Res. 1993 Jun;26(3):255–273. doi: 10.1006/cbmr.1993.1018. [DOI] [PubMed] [Google Scholar]