Both internationally and nationally, the introduction of clinical guidelines is seen as a means of improving healthcare outcomes and reducing costs.1 In the NHS primary care professionals, hospital trusts, and health authorities are becoming increasingly involved in disseminating, implementing, and evaluating local clinical guidelines.2,3 Though evaluations of the most effective strategies by which to implement guidelines have been undertaken,4,5 few studies have evaluated the impact of such guidelines on both patient outcomes and health service costs.
Two evaluations of similar sets of clinical guidelines on the management of infertile couples (one of them in this week's BMJ) have now shown improvement in general practitioners' performance. Following the use of the guidelines their performance in obtaining the clinical history and performing appropriate examination and investigations before referring patients to hospital had improved (p 1282).6,7 Compared with the earlier study in Aberdeen,7 the Glasgow study reported this week showed a more modest improvement in the proportion of referrals that had been appropriately managed.6 This difference in findings between the two studies seems to reinforce the importance of taking local factors into account when developing and implementing guidelines. Local factors suggested in the Glasgow study include the larger number of referral centres and a greater number of couples where partners were registered with different general practitioners, thereby making investigations more problematic.
Also, in the Glasgow study effective implementation strategies, such as educational interactive meetings and practice visits,8 were taken up by only a minority of general practitioners in the intervention group. The use of such strategies was not mentioned in the Aberdeen study, though there was a strong history of research collaboration across the primary-secondary interface.
The novel message of the comparison between the two studies, however, is that a more comprehensive evaluation of the guidelines questions the underlying assumptions about improvements in terms of patient outcomes and reduced costs. Unlike the Aberdeen study, the Glasgow study also measured clinical behaviour in the secondary sector. Despite the increase in the rate of appropriate investigations carried out by the intervention practices, a high proportion of tests were repeated in hospital, even though the results were normal before referral.6 There was also no demonstrable difference between control and intervention practices in the number of hospital outpatient appointments needed before the management plan was agreed in secondary care for couples. This lack of the expected changes in clinicians' behaviour in secondary care may also explain the lack of reduction in direct NHS costs.
This disappointing finding might have been avoided if the secondary care professionals had taken part in developing the guidelines. Common clinical problems require shared management between primary care and the hospital teams. The importance of identifying all groups of professionals who may be affected by or who may influence the desired changes in practice cannot be overemphasised.5 These groups and individuals must be actively engaged, and specific individual and organisational barriers must be identified and addressed. The Glasgow authors suggest that hospital clinicians may repeat investigations with normal results because they mistrust results from unfamiliar laboratories. This problem could be eased by computerised access to the results of laboratory investigations and the use of high quality standardised laboratory procedures.
More studies are needed that evaluate guidelines in terms of changes in the behaviour of both primary and secondary care professionals. If guidelines on common problems are to deliver cost effective care, appropriate clinical management in primary care needs to substitute for and not to be in addition to traditional hospital management. The Glasgow study suggests that, perversely, implementing guidelines may lead to a higher overall direct NHS costs per patient referred. Increased venesection and requests for specimens are also likely to have psychological costs for the patients. If the authors had not invested in evaluating these guidelines wider dissemination of the guidelines could have increased NHS costs. Clearly it cannot be assumed that well formulated and implemented guidelines will lead to lower expenditure in the NHS.
The national service frameworks and organisations such as the National Institute of Clinical Excellence (NICE) are leading an increasing tendency to formulate and disseminate national guidance throughout the NHS. If these national initiatives are to lead to improved patient care and more cost effective use of resources, then local implementation and evaluation are required. For common clinical conditions this requires the collaboration of both primary and secondary care health professionals. Increasingly these professionals will include not only doctors but also nurses, physiotherapists, occupational therapists, dieticians, laboratory technicians, and others. Local research expertise should be harnessed to demonstrate changes in practice, and NHS managers need to ensure that these initiatives are properly resourced to ensure rigorous implementation and evaluation of the impact.
General practice p 1282
References
- 1.Woolf SH, Grol R, Hutchinson A, Eccles MP, Grimshaw JM. Clinical practice guidelines: the potential benefits, limitations and harms of recommending how to care for patients. BMJ. 1999;318:527–530. doi: 10.1136/bmj.318.7182.527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Secretary of State for Health. The NHS plan. London: Stationery Office; 2000. [Google Scholar]
- 3.Secretary of State for Health. A first class service: quality in the new NHS. London: Stationery Office; 1997. [Google Scholar]
- 4.Effective Health Care. Implementing clinical guidelines: can guidelines be used to improve clinical practice? Leeds: University of Leeds; 1994. [Google Scholar]
- 5.Effective Health Care. Getting evidence into practice. York: University of York; 1999. [Google Scholar]
- 6.Morrison J, Carroll L, Twaddle S, Cameron I, Grimshaw J, Leyland A, et al. Pragmatic randomised controlled trial to evaluate guidelines for the management of infertility across the primary-secondary care interface. BMJ. 2001;322:1282–1284. doi: 10.1136/bmj.322.7297.1282. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Emslie C, Grimshaw J, Templeton A. Do clinical guidelines improve general practice management and referral of infertile couples? BMJ. 1993;306:1728–1731. doi: 10.1136/bmj.306.6894.1728. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Bero LA, Grilli R, Grimshaw J, Harvey E, Oxman A, Thomson MA. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998;317:465–468. doi: 10.1136/bmj.317.7156.465. [DOI] [PMC free article] [PubMed] [Google Scholar]