Abstract
BACKGROUND. 1996 will see the introduction of summative assessment of general practitioner registrars (trainees). One part of this assessment is the written submission of practical work. In the west of Scotland, audit projects have been chosen as the format for practical work. A valid and reliable marking schedule for such projects is needed. AIM. A study was undertaken to develop a criterion-referenced marking schedule for assessing registrars' audit projects for summative assessment. METHOD. Medical and non-medical professionals, in a series of workshops, compiled a list of essential elements of good audit. These features were tested and refined using registrars' audit projects. All trainers in the west of Scotland were then sent a list of 14 criteria and asked to indicate whether each criterion was an essential or desirable component of a registrar's audit project for summative assessment. A final workshop was held to develop an audit marking schedule. RESULTS. Of 155 trainers in the west of Scotland, 135 replied to the list of criteria for registrar audit projects (87%). Ten criteria were deemed essential or desirable by 80% or more of the respondents. Participants in the final workshop selected five criteria which would form the audit project marking schedule for registrars undergoing summative assessment. These were: defined reason for choice of audit project, relevance of criteria chosen, appropriate preparation and planning, appropriate interpretation of relevant data and detailed proposals for change. For an audit project to pass assessment all five criteria must be present. CONCLUSION. A criterion-referenced approach to assessing registrars' audit projects, developed from their trainers' opinions of essential or desirable criteria for good audit, is described. Further evaluation of the criterion-referenced marking schedule is required.
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Baker R. Audit in person: Problem solving with audit in general practice. BMJ. 1990 Feb 10;300(6721):378–380. doi: 10.1136/bmj.300.6721.378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Benett I. J., Hayden J. Audit as part of summative assessment of vocational training. Br J Gen Pract. 1995 Jan;45(390):47–49. [PMC free article] [PubMed] [Google Scholar]
- Bhopal R. S., Thomson R. A form to help learn and teach about assessing medical audit papers. BMJ. 1991 Dec 14;303(6816):1520–1522. doi: 10.1136/bmj.303.6816.1520. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Campbell L. M., Howie J. G., Murray T. S. Summative assessment: a pilot project in the west of Scotland. Br J Gen Pract. 1993 Oct;43(375):430–434. [PMC free article] [PubMed] [Google Scholar]
- Coles C. Self assessment and medical audit: an educational approach. BMJ. 1989 Sep 30;299(6703):807–808. doi: 10.1136/bmj.299.6703.807. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crombie I. K., Davies H. T. Towards good audit. 1992 Jul 29-Sep 1Br J Hosp Med. 48(3-4):182–185. [PubMed] [Google Scholar]
- Lough J. R., Mckay J., Murray T. S. Audit: trainers' and trainees' attitudes and experiences. Med Educ. 1995 Jan;29(1):85–90. doi: 10.1111/j.1365-2923.1995.tb02807.x. [DOI] [PubMed] [Google Scholar]
- Walshe K., Tomalin D. Rain check ... selecting, planning, implementing and evaluating audit projects. Health Serv J. 1993 Apr 29;103(5350):28–29. [PubMed] [Google Scholar]