Abstract
This article examines the reliability and validity of direct observation of patient-provider encounters, interviews with providers, and use of patients simulating sexually transmitted diseases (STD) as methods for assessing the quality of STD case management in developing countries. Data were collected during an STD health facility survey in Malawi; the performance of 49 providers was observed, and the providers were also interviewed; 20 of them were visited by a simulated patient complaining of urethral discharge. Agreement (based on the kappa statistic) was generally poor between direct observation and provider-interview data, and also between direct observation and simulated-patient data. In contrast, percentage agreements between direct observation and simulated-patient data were often high. Multiple observations on providers indicated that a provider's behaviour is not consistent across several patients. Simulated-patient data are probably the best in reflecting normal performance, but their feasibility for routine quality assessment is limited because the provider's behaviour is not consistent and would require multiple data points. Direct observation data are the best option for assessing quality if the results are assumed to reflect better than normal levels of quality of care. Data from interviews with providers should be viewed with caution, because they may reflect provider knowledge and not necessarily performance.
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Begum S., Salahuddin A. K. Study on quality assessment of neonatal tetanus cases admitted in the Infectious Diseases Hospital, Dhaka. J Acad Hosp Adm. 1991 Jul;3(2):25–28. [PubMed] [Google Scholar]
- Bryce J., Vernon A., Brathwaite A. R., Perry S., Figueroa J. P., Emerson R. B. Quality of sexually transmitted disease services in Jamaica: evaluation of a clinic-based approach. Collaborative Working Group on Indicators of STD Case Management. Bull World Health Organ. 1994;72(2):239–247. [PMC free article] [PubMed] [Google Scholar]
- Chilongozi D. A., Daly C. C., Franco L., Liomba N. G., Dallabetta G. Sexually transmitted diseases: a survey of case management in Malawi. Int J STD AIDS. 1996 Jul;7(4):269–275. doi: 10.1258/0956462961917951. [DOI] [PubMed] [Google Scholar]
- Kim Y. M., Rimon J., Winnard K., Corso C., Mako I. V., Lawal S., Babalola S., Huntington D. Improving the quality of service delivery in Nigeria. Stud Fam Plann. 1992 Mar-Apr;23(2):118–127. [PubMed] [Google Scholar]
- Mertens T., Caraël M., Sato P., Cleland J., Ward H., Smith G. D. Prevention indicators for evaluating the progress of national AIDS programmes. AIDS. 1994 Oct;8(10):1359–1369. doi: 10.1097/00002030-199410000-00002. [DOI] [PubMed] [Google Scholar]
- Nicholas D. D., Heiby J. R., Hatzell T. A. The Quality Assurance Project: introducing quality improvement to primary health care in less developed countries. Qual Assur Health Care. 1991;3(3):147–165. doi: 10.1093/intqhc/3.3.147. [DOI] [PubMed] [Google Scholar]