Abstract
Systematic, through testing of decision support systems (DSSs) prior to release to general users is a critical aspect of high quality software design. Omission of this step may lead to the dangerous, and potentially fatal, condition of relying on a system with outputs of uncertain quality. Thorough testing requires a great deal of effort and is a difficult job because tools necessary to facilitate testing are not well developed. Testing is a job ill-suited to humans because it requires tireless attention to a large number of details. For these reasons, the majority of DSSs available are probably not well tested prior to release. We have successfully implemented a software design and testing plan which has helped us meet our goal of continuously improving the quality of our DSS software prior to release. While requiring large amounts of effort, we feel that the process of documenting and standardizing our testing methods are important steps toward meeting recognized national and international quality standards. Our testing methodology includes both functional and structural testing and requires input from all levels of development. Our system does not focus solely on meeting design requirements but also addresses the robustness of the system and the completeness of testing.
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Miller P. L., Sittig D. F. The evaluation of clinical decision support systems: what is necessary versus what is interesting. Med Inform (Lond) 1990 Jul-Sep;15(3):185–190. doi: 10.3109/14639239009025266. [DOI] [PubMed] [Google Scholar]
- Ohayon M. M. Validation of expert systems: examples and considerations. Medinfo. 1995;8(Pt 2):1071–1075. [PubMed] [Google Scholar]
- Rossi-Mori A., Pisanelli D. M., Ricci F. L. Evaluation stages and design steps for knowledge-based systems in medicine. Med Inform (Lond) 1990 Jul-Sep;15(3):191–204. doi: 10.3109/14639239009025267. [DOI] [PubMed] [Google Scholar]
- Sailors R. M., East T. D. A model-based simulator for testing rule-based decision support systems for mechanical ventilation of ARDS patients. Proc Annu Symp Comput Appl Med Care. 1994:1007–1007. [PMC free article] [PubMed] [Google Scholar]
- Wasson J. H., Sox H. C., Neff R. K., Goldman L. Clinical prediction rules. Applications and methodological standards. N Engl J Med. 1985 Sep 26;313(13):793–799. doi: 10.1056/NEJM198509263131306. [DOI] [PubMed] [Google Scholar]