Skip to main content
PMC home page
Occupational and Environmental Medicine logoLink to Occupational and Environmental Medicine
. 1998 Jun;55(6):375–382. doi: 10.1136/oem.55.6.375

Development and evaluation of a quality assessment instrument for occupational physicians

W E van der Weide, J H Verbeek, F J van Dijk, C T Hulshof
PMCID: PMC1757593  PMID: 9764096

Abstract

OBJECTIVES: To develop and apply a method for assessing the quality of the process of occupational health care for individual patients. METHODS: The scientific literature was studied to develop a method to assess the quality of the process of occupational rehabilitation for workers with low back pain. The method was applied to health care and university workers with low back pain who were rehabilitated by their occupational physicians. RESULTS: Assessment of quality of care is regarded as a four step approach. Firstly, guidelines should be developed and implemented. Secondly, indicators for quality and criteria to demarcate good and deviant quality were derived from the guidelines. Thirdly, a method for data collection was chosen. Finally, quality was scored. For occupational rehabilitation, there was some deviance from the guidelines for most cases, especially in continuity of care with a deviant rate of 47%. Other indicators deviated from 1.4%- 17.4%. Occupational physicians agreed on the relevance of the indicators and criteria, but for three indicators they evaluated the criteria as too rigid. They did not agree with their own performance scores in 66% of the deviant cases. CONCLUSION: Assessing the quality of the process of occupational health care with this method is an asset to present methods, but more specific criteria are needed for a more sensitive assessment.

 

Full Text

The Full Text of this article is available as a PDF (136.8 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Agius R. M., Lee R. J., Symington I. S., Riddle H. F., Seaton A. An audit of occupational medicine consultation records. Occup Med (Lond) 1994 Jul;44(3):151–157. doi: 10.1093/occmed/44.3.151. [DOI] [PubMed] [Google Scholar]
  2. Agius R. M. Peer review audit in occupational medicine. J Soc Occup Med. 1990 Autumn;40(3):87–88. doi: 10.1093/occmed/40.3.87. [DOI] [PubMed] [Google Scholar]
  3. Agius R. M., Seaton A., Lee R. J. Audit of sickness absence and fitness-for-work referrals. Occup Med (Lond) 1995 Jun;45(3):125–130. doi: 10.1093/occmed/45.3.125. [DOI] [PubMed] [Google Scholar]
  4. Antti-Poika M. Implementation of a quality system for the examination of occupational diseases. Occup Med (Lond) 1995 Dec;45(6):298–304. doi: 10.1093/occmed/45.6.298. [DOI] [PubMed] [Google Scholar]
  5. Ashton C. M., Kuykendall D. H., Johnson M. L., Wun C. C., Wray N. P., Carr M. J., Slater C. H., Wu L., Bush G. R. A method of developing and weighting explicit process of care criteria for quality assessment. Med Care. 1994 Aug;32(8):755–770. doi: 10.1097/00005650-199408000-00001. [DOI] [PubMed] [Google Scholar]
  6. Berwick D. M. Health services research and quality of care. Assignments for the 1990s. Med Care. 1989 Aug;27(8):763–771. doi: 10.1097/00005650-198908000-00001. [DOI] [PubMed] [Google Scholar]
  7. Bigos S. J., Battié M. C. Acute care to prevent back disability. Ten years of progress. Clin Orthop Relat Res. 1987 Aug;(221):121–130. [PubMed] [Google Scholar]
  8. Brook R. H., McGlynn E. A., Cleary P. D. Quality of health care. Part 2: measuring quality of care. N Engl J Med. 1996 Sep 26;335(13):966–970. doi: 10.1056/NEJM199609263351311. [DOI] [PubMed] [Google Scholar]
  9. Buckle P., Stubbs D. The contribution of ergonomics to the rehabilitation of back pain patients. J Soc Occup Med. 1989 Summer;39(2):56–60. doi: 10.1093/occmed/39.2.56. [DOI] [PubMed] [Google Scholar]
  10. Casparie A. F. Medical audit in The Netherlands: experience over 22 years. J Epidemiol Community Health. 1995 Dec;49(6):557–558. doi: 10.1136/jech.49.6.557-a. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Coste J., Delecoeuillerie G., Cohen de Lara A., Le Parc J. M., Paolaggi J. B. Clinical course and prognostic factors in acute low back pain: an inception cohort study in primary care practice. BMJ. 1994 Feb 26;308(6928):577–580. doi: 10.1136/bmj.308.6928.577. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Davies H. T., Crombie I. K. Assessing the quality of care. BMJ. 1995 Sep 23;311(7008):766–766. doi: 10.1136/bmj.311.7008.766. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Davis D. A., Thomson M. A., Oxman A. D., Haynes R. B. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995 Sep 6;274(9):700–705. doi: 10.1001/jama.274.9.700. [DOI] [PubMed] [Google Scholar]
  14. Deyo R. A., Diehl A. K. Psychosocial predictors of disability in patients with low back pain. J Rheumatol. 1988 Oct;15(10):1557–1564. [PubMed] [Google Scholar]
  15. Donabedian A. The quality of care. How can it be assessed? JAMA. 1988 Sep 23;260(12):1743–1748. doi: 10.1001/jama.260.12.1743. [DOI] [PubMed] [Google Scholar]
  16. Fardy H. J., Jeffs D. Focus groups: a method for developing consensus guidelines in general practice. Fam Pract. 1994 Sep;11(3):325–329. doi: 10.1093/fampra/11.3.325. [DOI] [PubMed] [Google Scholar]
  17. Frank A. Low back pain. BMJ. 1993 Apr 3;306(6882):901–909. doi: 10.1136/bmj.306.6882.901. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Gerbert B., Hargreaves W. A. Measuring physician behavior. Med Care. 1986 Sep;24(9):838–847. doi: 10.1097/00005650-198609000-00005. [DOI] [PubMed] [Google Scholar]
  19. Goertz M. N. Prognostic indicators for acute low-back pain. Spine (Phila Pa 1976) 1990 Dec;15(12):1307–1310. doi: 10.1097/00007632-199012000-00013. [DOI] [PubMed] [Google Scholar]
  20. Greenfield S., Cretin S., Worthman L. G., Dorey F. J., Soloman N. E., Goldberg G. A. Comparison of a criteria map to a criteria list in quality-of-care assessment for patients with chest pain: the relation of each to outcome. Med Care. 1981 Mar;19(3):255–272. doi: 10.1097/00005650-198103000-00002. [DOI] [PubMed] [Google Scholar]
  21. Greenfield S., Lewis C. E., Kaplan S. H., Davidson M. B. Peer review by criteria mapping: criteria for diabetes mellitus. The use of decision-making in chart audit. Ann Intern Med. 1975 Dec;83(6):761–770. doi: 10.7326/0003-4819-83-6-761. [DOI] [PubMed] [Google Scholar]
  22. Grimshaw J. M., Russell I. T. Achieving health gain through clinical guidelines II: Ensuring guidelines change medical practice. Qual Health Care. 1994 Mar;3(1):45–52. doi: 10.1136/qshc.3.1.45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Grimshaw J. M., Russell I. T. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993 Nov 27;342(8883):1317–1322. doi: 10.1016/0140-6736(93)92244-n. [DOI] [PubMed] [Google Scholar]
  24. Grol R. Development of guidelines for general practice care. Br J Gen Pract. 1993 Apr;43(369):146–151. [PMC free article] [PubMed] [Google Scholar]
  25. Hopkins A. Approaches to medical audit. J Epidemiol Community Health. 1991 Mar;45(1):1–3. doi: 10.1136/jech.45.1.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Jones J., Hunter D. Consensus methods for medical and health services research. BMJ. 1995 Aug 5;311(7001):376–380. doi: 10.1136/bmj.311.7001.376. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Kemeny M. E., Hargreaves W. A., Gerbert B., Stone G. C., Gullion D. S. Measuring adequacy of physician performance. A preliminary comparison of four methods in ambulatory care of chronic obstructive pulmonary disease. Med Care. 1984 Jul;22(7):620–631. [PubMed] [Google Scholar]
  28. Kemper K. J., Fink H. D., McCarthy P. L. The reliability and validity of the pediatric appropriateness evaluation protocol. QRB Qual Rev Bull. 1989 Mar;15(3):77–80. doi: 10.1016/s0097-5990(16)30269-x. [DOI] [PubMed] [Google Scholar]
  29. Klazinga N. Compliance with practice guidelines: clinical autonomy revisited. Health Policy. 1994 Mar;28(1):51–66. doi: 10.1016/0168-8510(94)90020-5. [DOI] [PubMed] [Google Scholar]
  30. Koes B. W., van Tulder M. W., van der Windt W. M., Bouter L. M. The efficacy of back schools: a review of randomized clinical trials. J Clin Epidemiol. 1994 Aug;47(8):851–862. doi: 10.1016/0895-4356(94)90188-0. [DOI] [PubMed] [Google Scholar]
  31. Law M., Ryan B., Townsend E., O'Shea B. Criteria mapping: a method of quality assurance. Am J Occup Ther. 1989 Feb;43(2):104–109. doi: 10.5014/ajot.43.2.104. [DOI] [PubMed] [Google Scholar]
  32. Lawthers A. G., Palmer R. H., Edwards J. E., Fowles J., Garnick D. W., Weiner J. P. Developing and evaluating performance measures for ambulatory care quality: a preliminary report of the DEMPAQ project. Jt Comm J Qual Improv. 1993 Dec;19(12):552–565. doi: 10.1016/s1070-3241(16)30036-0. [DOI] [PubMed] [Google Scholar]
  33. Lomas J., Haynes R. B. A taxonomy and critical review of tested strategies for the application of clinical practice recommendations: from "official" to "individual" clinical policy. Am J Prev Med. 1988;4(4 Suppl):77–97. [PubMed] [Google Scholar]
  34. Marras W. S., Lavender S. A., Leurgans S. E., Fathallah F. A., Ferguson S. A., Allread W. G., Rajulu S. L. Biomechanical risk factors for occupationally related low back disorders. Ergonomics. 1995 Feb;38(2):377–410. doi: 10.1080/00140139508925111. [DOI] [PubMed] [Google Scholar]
  35. McNeill T. W., Sinkora G., Leavitt F. Psychologic classification of low-back pain patients: a prognostic tool. Spine (Phila Pa 1976) 1986 Nov;11(9):955–959. doi: 10.1097/00007632-198611000-00018. [DOI] [PubMed] [Google Scholar]
  36. Palmer R. H., Louis T. A., Hsu L. N., Peterson H. F., Rothrock J. K., Strain R., Thompson M. S., Wright E. A. A randomized controlled trial of quality assurance in sixteen ambulatory care practices. Med Care. 1985 Jun;23(6):751–770. doi: 10.1097/00005650-198506000-00001. [DOI] [PubMed] [Google Scholar]
  37. Palmer R. H., Nesson H. R. A review of methods for ambulatory medical care evaluations. Med Care. 1982 Aug;20(8):758–781. doi: 10.1097/00005650-198208000-00002. [DOI] [PubMed] [Google Scholar]
  38. Palmer R. H., Strain R., Maurer J. V., Thompson M. S. A method for evaluating performance of ambulatory pediatric tasks. Pediatrics. 1984 Mar;73(3):269–277. [PubMed] [Google Scholar]
  39. Robinson M. B. Evaluation of medical audit. J Epidemiol Community Health. 1994 Oct;48(5):435–440. doi: 10.1136/jech.48.5.435. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Roche N., Durieux P. Clinical practice guidelines: from methodological to practical issues. Intensive Care Med. 1994 Nov;20(8):593–601. doi: 10.1007/BF01705730. [DOI] [PubMed] [Google Scholar]
  41. Roland M., Morris R. A study of the natural history of low-back pain. Part II: development of guidelines for trials of treatment in primary care. Spine (Phila Pa 1976) 1983 Mar;8(2):145–150. doi: 10.1097/00007632-198303000-00005. [DOI] [PubMed] [Google Scholar]
  42. Schellevis F. G., van Eijk J. T., van den Lisdonk E. H., vd Velden J., van Weel C. Implementing guidelines in general practice. Evaluation of process and outcome of care in chronic diseases. Int J Qual Health Care. 1994 Sep;6(3):257–266. doi: 10.1093/intqhc/6.3.257. [DOI] [PubMed] [Google Scholar]
  43. Soter N. A., Wasserman S. I., Austen K. F. Cold urticaria: release into the circulation of histamine and eosinophil chemotactic factor of anaphylaxis during cold challenge. N Engl J Med. 1976 Mar 25;294(13):687–690. doi: 10.1056/NEJM197603252941302. [DOI] [PubMed] [Google Scholar]
  44. Thomson R., Lavender M., Madhok R. How to ensure that guidelines are effective. BMJ. 1995 Jul 22;311(6999):237–242. doi: 10.1136/bmj.311.6999.237. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Vlaeyen J. W., Kole-Snijders A. M., Boeren R. G., van Eek H. Fear of movement/(re)injury in chronic low back pain and its relation to behavioral performance. Pain. 1995 Sep;62(3):363–372. doi: 10.1016/0304-3959(94)00279-N. [DOI] [PubMed] [Google Scholar]
  46. Von Korff M., Deyo R. A., Cherkin D., Barlow W. Back pain in primary care. Outcomes at 1 year. Spine (Phila Pa 1976) 1993 Jun 1;18(7):855–862. doi: 10.1097/00007632-199306000-00008. [DOI] [PubMed] [Google Scholar]
  47. Von Korff M., Ormel J., Keefe F. J., Dworkin S. F. Grading the severity of chronic pain. Pain. 1992 Aug;50(2):133–149. doi: 10.1016/0304-3959(92)90154-4. [DOI] [PubMed] [Google Scholar]
  48. Waddell G., Newton M., Henderson I., Somerville D., Main C. J. A Fear-Avoidance Beliefs Questionnaire (FABQ) and the role of fear-avoidance beliefs in chronic low back pain and disability. Pain. 1993 Feb;52(2):157–168. doi: 10.1016/0304-3959(93)90127-B. [DOI] [PubMed] [Google Scholar]
  49. Wensing M., Grol R. Single and combined strategies for implementing changes in primary care: a literature review. Int J Qual Health Care. 1994 Jun;6(2):115–132. doi: 10.1093/intqhc/6.2.115. [DOI] [PubMed] [Google Scholar]
  50. Wilson A., McDonald P. Comparison of patient questionnaire, medical record, and audio tape in assessment of health promotion in general practice consultations. BMJ. 1994 Dec 3;309(6967):1483–1485. doi: 10.1136/bmj.309.6967.1483. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Young J. M. The Fifth Report of the Joint National Committee on Detection, Evaluation, and Treatment of High Blood Pressure: a resource for occupational health. AAOHN J. 1995 Jun;43(6):301–305. [PubMed] [Google Scholar]
  52. van Dijk F. J., de Kort W. L., Verbeek J. H. Quality assessment of occupational health services instruments. Occup Med (Lond) 1993;43 (Suppl 1):S28–S33. [PubMed] [Google Scholar]
  53. van der Weide W. E., Verbeek J. H., van Dijk F. J., Doef J. An audit of occupational health care for employees with low-back pain. Occup Med (Lond) 1997 Jul;47(5):294–300. doi: 10.1093/occmed/47.5.294. [DOI] [PubMed] [Google Scholar]
  54. van der Weide W. E., Verbeek J. H., van Tulder M. W. Vocational outcome of intervention for low-back pain. Scand J Work Environ Health. 1997 Jun;23(3):165–178. doi: 10.5271/sjweh.195. [DOI] [PubMed] [Google Scholar]

Articles from Occupational and Environmental Medicine are provided here courtesy of BMJ Publishing Group

RESOURCES