Skip to main content
NCBI home page
Quality in Health Care : QHC logoLink to Quality in Health Care : QHC
. 2001 Dec;10(Suppl 2):ii64–ii69. doi: 10.1136/qhc.0100064..

Assessment of surgical competence

A Darzi, S Mackay
PMCID: PMC1765754  PMID: 11700382

Abstract

This paper examines the issues that arise in the broad area of competence assessment in surgical practice, with particular reference to the objective assessment of technical skill which has historically been the weakest aspect of assessment in surgical training. To facilitate a thorough appraisal of competence, a simple model of surgical practice is advanced, followed by a review of both current and experimental methods of assessing technical skill. The review comprises not only the published literature, but also work (both from the authors' and other groups) that is in progress or under consideration for publication. Significant issues in the implementation of these new technologies, especially the necessary further validation, and the imperative to demonstrate that the process introduced does indeed improve the outcomes are discussed.

Key Words: competence assessment; surgery; learning

Full Text

The Full Text of this article is available as a PDF (95.0 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Chaudhry A., Sutton C., Wood J., Stone R., McCloy R. Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human-computer interface. Ann R Coll Surg Engl. 1999 Jul;81(4):281–286. [PMC free article] [PubMed] [Google Scholar]
  2. Cuschieri A., Gleeson F. A., Harden R. M., Wood R. A. A new approach to a final examination in surgery. Use of the objective structured clinical examination. Ann R Coll Surg Engl. 1979 Sep;61(5):400–405. [PMC free article] [PubMed] [Google Scholar]
  3. Darzi A., Datta V., Mackay S. The challenge of objective assessment of surgical skill. Am J Surg. 2001 Jun;181(6):484–486. doi: 10.1016/s0002-9610(01)00624-9. [DOI] [PubMed] [Google Scholar]
  4. Darzi A., Smith S., Taffinder N. Assessing operative skill. Needs to become more objective. BMJ. 1999 Apr 3;318(7188):887–888. doi: 10.1136/bmj.318.7188.887. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Faulkner H., Regehr G., Martin J., Reznick R. Validation of an objective structured assessment of technical skill for surgical residents. Acad Med. 1996 Dec;71(12):1363–1365. doi: 10.1097/00001888-199612000-00023. [DOI] [PubMed] [Google Scholar]
  6. Gallagher A. G., McClure N., McGuigan J., Crothers I., Browning J. Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST VR). Endoscopy. 1999 May;31(4):310–313. doi: 10.1055/s-1999-15. [DOI] [PubMed] [Google Scholar]
  7. MacRae H. M., Cohen R., Regehr G., Reznick R., Burnstein M. A new assessment tool: the patient assessment and management examination. Surgery. 1997 Aug;122(2):335–344. doi: 10.1016/s0039-6060(97)90025-8. [DOI] [PubMed] [Google Scholar]
  8. MacRae H., Regehr G., Leadbetter W., Reznick R. K. A comprehensive examination for senior surgical residents. Am J Surg. 2000 Mar;179(3):190–193. doi: 10.1016/s0002-9610(00)00304-4. [DOI] [PubMed] [Google Scholar]
  9. Martin J. A., Regehr G., Reznick R., MacRae H., Murnaghan J., Hutchison C., Brown M. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997 Feb;84(2):273–278. doi: 10.1046/j.1365-2168.1997.02502.x. [DOI] [PubMed] [Google Scholar]
  10. Regehr G., MacRae H., Reznick R. K., Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med. 1998 Sep;73(9):993–997. doi: 10.1097/00001888-199809000-00020. [DOI] [PubMed] [Google Scholar]
  11. Reznick R. K., Smee S., Baumber J. S., Cohen R., Rothman A., Blackmore D., Bérard M. Guidelines for estimating the real cost of an objective structured clinical examination. Acad Med. 1993 Jul;68(7):513–517. doi: 10.1097/00001888-199307000-00001. [DOI] [PubMed] [Google Scholar]
  12. Reznick R. K. Teaching and testing technical skills. Am J Surg. 1993 Mar;165(3):358–361. doi: 10.1016/s0002-9610(05)80843-8. [DOI] [PubMed] [Google Scholar]
  13. Reznick R., Regehr G., MacRae H., Martin J., McCulloch W. Testing technical skill via an innovative "bench station" examination. Am J Surg. 1997 Mar;173(3):226–230. doi: 10.1016/s0002-9610(97)89597-9. [DOI] [PubMed] [Google Scholar]
  14. Sloan D. A., Donnelly M. B., Schwartz R. W., Strodel W. E. The Objective Structured Clinical Examination. The new gold standard for evaluating postgraduate clinical performance. Ann Surg. 1995 Dec;222(6):735–742. doi: 10.1097/00000658-199512000-00007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Smith S. G., Torkington J., Darzi A. Objective assessment of surgical dexterity using simulators. Hosp Med. 1999 Sep;60(9):672–675. doi: 10.12968/hosp.1999.60.9.1201. [DOI] [PubMed] [Google Scholar]
  16. Smith S., Wan A., Taffinder N., Read S., Emery R., Darzi A. Early experience and validation work with Procedicus VA--the Prosolvia virtual reality shoulder arthroscopy trainer. Stud Health Technol Inform. 1999;62:337–343. [PubMed] [Google Scholar]
  17. Sutton C., McCloy R., Middlebrook A., Chater P., Wilson M., Stone R. MIST VR. A laparoscopic surgery procedures trainer and evaluator. Stud Health Technol Inform. 1997;39:598–607. [PubMed] [Google Scholar]
  18. Taffinder N., Smith S. G., Huber J., Russell R. C., Darzi A. The effect of a second-generation 3D endoscope on the laparoscopic precision of novices and experienced surgeons. Surg Endosc. 1999 Nov;13(11):1087–1092. doi: 10.1007/s004649901179. [DOI] [PubMed] [Google Scholar]
  19. Taffinder N., Sutton C., Fishwick R. J., McManus I. C., Darzi A. Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inform. 1998;50:124–130. [PubMed] [Google Scholar]
  20. Torkington J., Smith S. G., Rees B. I., Darzi A. The role of simulation in surgical training. Ann R Coll Surg Engl. 2000 Mar;82(2):88–94. [PMC free article] [PubMed] [Google Scholar]
  21. Wilson M. S., Middlebrook A., Sutton C., Stone R., McCloy R. F. MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance. Ann R Coll Surg Engl. 1997 Nov;79(6):403–404. [PMC free article] [PubMed] [Google Scholar]

Articles from Quality in Health Care : QHC are provided here courtesy of BMJ Publishing Group

RESOURCES