Abstract
We describe a prospective clinical evaluation of a computer program to assist with the diagnosis of heart disease. The Heart Disease Program (HDP) is a large diagnostic program covering most areas of heart disease and some related areas of general medicine. The program's output is a set of differential diagnoses with explanations and it can be deployed in a clinical setting using a web interface. A framework for assessing the complex diagnostic summaries generated by the HDP was developed and the program's diagnostic accuracy in a clinical setting was assessed. The diagnoses used for comparison came from the physician entering the case, a "gold standard" assigned by review of patient charts and investigations, and the opinions of expert cardiologists. The data collection, methods of comparison, example analyses and results on 114 cases are presented here. The HDP had a significantly higher sensitivity for both the gold standard (60%) and the cardiologist's diagnoses (58%) than the physicians did (39%, 34%). These findings were consistent in the 2 collection cohorts and for the more serious diagnoses alone. The significance of these findings and the many challenges in comparing these different diagnoses and minimizing bias are discussed.
Full text
PDF
Images in this article
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Bankowitz R. A., McNeil M. A., Challinor S. M., Parker R. C., Kapoor W. N., Miller R. A. A computer-assisted medical diagnostic consultation service. Implementation and prospective evaluation of a prototype. Ann Intern Med. 1989 May 15;110(10):824–832. doi: 10.7326/0003-4819-110-10-824. [DOI] [PubMed] [Google Scholar]
- Berner E. S., Webster G. D., Shugerman A. A., Jackson J. R., Algina J., Baker A. L., Ball E. V., Cobbs C. G., Dennis V. W., Frenkel E. P. Performance of four computer-based diagnostic systems. N Engl J Med. 1994 Jun 23;330(25):1792–1796. doi: 10.1056/NEJM199406233302506. [DOI] [PubMed] [Google Scholar]
- Long W. J., Fraser H., Naimi S. Reasoning requirements for diagnosis of heart disease. Artif Intell Med. 1997 May;10(1):5–24. doi: 10.1016/s0933-3657(97)00381-3. [DOI] [PubMed] [Google Scholar]
- Long W. J., Fraser H., Naimi S. Web interface for the Heart Disease Program. Proc AMIA Annu Fall Symp. 1996:762–766. [PMC free article] [PubMed] [Google Scholar]
- Long W. J., Naimi S., Criscitiello M. G. Development of a knowledge base for diagnostic reasoning in cardiology. Comput Biomed Res. 1992 Jun;25(3):292–311. doi: 10.1016/0010-4809(92)90044-b. [DOI] [PubMed] [Google Scholar]
- Long W. J., Naimi S., Criscitiello M. G. Evaluation of a new method for cardiovascular reasoning. J Am Med Inform Assoc. 1994 Mar-Apr;1(2):127–141. doi: 10.1136/jamia.1994.95236144. [DOI] [PMC free article] [PubMed] [Google Scholar]