Abstract
BACKGROUND: Over the last 5 years, primary care telephone triage systems have been introduced in the United Kingdom, United States, Australia, and most recently in New Zealand. Evaluation of the clinical safety of such systems poses a challenge for health planners and researchers. AIM: To evaluate the use of simulated patients in the assessment of aspects of clinical safety in a pilot New Zealand primary care telephone triage service. DESIGN OF STUDY: 'Mystery shopping', an evaluation strategy commonly used in market research, was adapted by using simulated patients for telephone triage service evaluation. SETTING: New Zealand. METHODS: Four scripted clinical scenarios were developed by academic general practitioners, validated in student teaching situations, and then used by simulated patients to make 101 telephone calls. The scenarios were designed to necessitate a referral to a medical practitioner for further investigation. The documentation kept by the callers was compared with the call records from the telephone triage company, and both were analysed for capture and handling of the clinical safety features of each scenario. In cases where the endpoint was not a medical assessment, possible reasons for this were explored. RESULTS: Records were retrieved for 85 telephone calls. Considerable triage variability was discovered. There were discrepancies between expected and actual triage outcomes with 51% of analysed calls resulting in a self-care recommendation. A number of reasons were identified both for the triage variability and the unpredicted outcomes. Audiotaping of consultations would have enhanced the credibility of the evaluation but it would have carried ethical constraints. CONCLUSION: Simulated patients can be used to evaluate the limitations of health services and to identify areas that could be addressed to improve patient safety. Evaluation of patient satisfaction with services is not sufficient alone to evaluate safety.
Full Text
The Full Text of this article is available as a PDF (316.2 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Aitken M. E., Carey M. J., Kool B. Telephone advice about an infant given by after-hours clinics and emergency departments. N Z Med J. 1995 Aug 11;108(1005):315–317. [PubMed] [Google Scholar]
- Barrows H. S. An overview of the uses of standardized patients for teaching and evaluating clinical skills. AAMC. Acad Med. 1993 Jun;68(6):443–453. doi: 10.1097/00001888-199306000-00002. [DOI] [PubMed] [Google Scholar]
- Grant Clare, Nicholas Ruth, Moore Laurence, Salisbury Chris. An observational study comparing quality of care in walk-in centres with general practice and NHS Direct using standardised patients. BMJ. 2002 Jun 29;324(7353):1556–1556. doi: 10.1136/bmj.324.7353.1556. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Norris Pauline. Which sorts of pharmacies provide more patient counselling? J Health Serv Res Policy. 2002 Jul;7 (Suppl 1):S23–S28. doi: 10.1258/135581902320176430. [DOI] [PubMed] [Google Scholar]
- Rethans J. J., Saebu L. Do general practitioners act consistently in real practice when they meet the same patient twice? Examination of intradoctor variation using standardised (simulated) patients. BMJ. 1997 Apr 19;314(7088):1170–1173. doi: 10.1136/bmj.314.7088.1170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roland Martin. Nurse-led telephone advice. Med J Aust. 2002 Feb 4;176(3):96–96. doi: 10.5694/j.1326-5377.2002.tb04310.x. [DOI] [PubMed] [Google Scholar]
- Walker Jane, Mathers Nigel. The impact of a general practice group intervention on prescribing costs and patterns. Br J Gen Pract. 2002 Mar;52(476):181–186. [PMC free article] [PubMed] [Google Scholar]