Abstract
OBJECTIVE: To evaluate the performance of a computerized decision support system that combines two different decision support methodologies (a Bayesian network and a natural language understanding system) for the diagnosis of patients with pneumonia. DESIGN: Evaluation study using data from a prospective, clinical study. PATIENTS: All patients 18 years and older who presented to the emergency department of a tertiary care setting and whose chest x-ray report was available during the encounter. METHODS: The computerized decision support system calculated a probability of pneumonia using information provided by the two systems. Outcome measures were the area under the receiver operating characteristic curve, sensitivity, specificity, predictive values, likelihood ratios, and test effectiveness. RESULTS: During the 3-month study period there were 742 patients (45 with pneumonia). The area under the receiver operating characteristic curve was 0.881 (95% CI: 0.822, 0.925) for the Bayesian network alone and 0.916 (95% CI: 0.869, 0.949) for the Bayesian network combined with the natural language understanding system (p=0.01). CONCLUSION: Combining decision support methodologies that process information stored in different data formats can increase the performance of a computerized decision support system.
Full text
PDF




Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Balas E. A., Austin S. M., Mitchell J. A., Ewigman B. G., Bopp K. D., Brown G. D. The clinical value of computerized information services. A review of 98 randomized clinical trials. Arch Fam Med. 1996 May;5(5):271–278. doi: 10.1001/archfami.5.5.271. [DOI] [PubMed] [Google Scholar]
- Barnett G. O., Winickoff R. N. Quality assurance and computer-based patient records. Am J Public Health. 1990 May;80(5):527–528. doi: 10.2105/ajph.80.5.527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blakeley D. D., Oddone E. Z., Hasselblad V., Simel D. L., Matchar D. B. Noninvasive carotid artery testing. A meta-analytic review. Ann Intern Med. 1995 Mar 1;122(5):360–367. doi: 10.7326/0003-4819-122-5-199503010-00007. [DOI] [PubMed] [Google Scholar]
- Chapman W. W., Aronsky D., Fiszman M., Haug P. J. Contribution of a speech recognition system to a computerized pneumonia guideline in the emergency department. Proc AMIA Symp. 2000:131–135. [PMC free article] [PubMed] [Google Scholar]
- Fine M. J., Auble T. E., Yealy D. M., Hanusa B. H., Weissfeld L. A., Singer D. E., Coley C. M., Marrie T. J., Kapoor W. N. A prediction rule to identify low-risk patients with community-acquired pneumonia. N Engl J Med. 1997 Jan 23;336(4):243–250. doi: 10.1056/NEJM199701233360402. [DOI] [PubMed] [Google Scholar]
- Fiszman M., Haug P. J. Using medical language processing to support real-time evaluation of pneumonia guidelines. Proc AMIA Symp. 2000:235–239. [PMC free article] [PubMed] [Google Scholar]
- Gardner R. M., Pryor T. A., Warner H. R. The HELP hospital information system: update 1998. Int J Med Inform. 1999 Jun;54(3):169–182. doi: 10.1016/s1386-5056(99)00013-1. [DOI] [PubMed] [Google Scholar]
- Hanley J. A., McNeil B. J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982 Apr;143(1):29–36. doi: 10.1148/radiology.143.1.7063747. [DOI] [PubMed] [Google Scholar]
- Haug P. J., Koehler S., Lau L. M., Wang P., Rocha R., Huff S. M. Experience with a mixed semantic/syntactic parser. Proc Annu Symp Comput Appl Med Care. 1995:284–288. [PMC free article] [PubMed] [Google Scholar]
- Hunt D. L., Haynes R. B., Hanna S. E., Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998 Oct 21;280(15):1339–1346. doi: 10.1001/jama.280.15.1339. [DOI] [PubMed] [Google Scholar]
- Metz C. E. Basic principles of ROC analysis. Semin Nucl Med. 1978 Oct;8(4):283–298. doi: 10.1016/s0001-2998(78)80014-2. [DOI] [PubMed] [Google Scholar]