In this series we have discussed the advantages and disadvantages of clinical guidelines, methods of guideline development, and the legal, political, and emotional aspects of guidelines. Assuming that the overriding purpose of clinical guidelines is to improve the quality of care for patients, in this final article we discuss how healthcare organisations (hospitals, general practices, etc) and individual clinicians can use clinical guidelines to improve clinical effectiveness.
The development of good guidelines does not ensure their use in practice. Systematic reviews of strategies for changing professional behaviour show that relatively passive methods of disseminating and implementing guidelines—by publication in professional journals or mailing to targeted healthcare professionals—rarely lead to changes in professional behaviour.1,2 Lomas observed that the failure of passive dissemination strategies is unsurprising given that many factors influence healthcare professionals’ behaviour,3 and this has led to increased recognition of factors that help or hinder implementation at various levels: the organisation, peer group, and individual clinician. Therefore, to maximise the likelihood of a clinical guideline being used we need coherent dissemination and implementation strategies to capitalise on known positive factors and to deal with obstacles to implementation that have already been identified.
Summary points
The implementation of clinical guidelines within a clinical governance setting requires time, enthusiasm, and resources
Local groups should adopt pre-existing valid guidelines
Implementation activity should draw on the available evidence
Clinical guidelines can also be used within continuing medical education or to answer specific clinical questions
Using clinical guidelines within healthcare organisations
In the same way as topics for guideline development need to be prioritised,4 organisations need a process by which they can set and pursue their clinical priorities. These can reflect national priorities or can be set at a local level by health authorities, trusts, primary care groups, or individual general practices. Whatever the level at which priorities are set, explicit criteria can help guide a rational choice. Criteria for prioritising clinical topics usually reflect considerations such as avoidable morbidity and mortality, inappropriate variation in performance, and expenditure on health services.5 Such criteria then inform questions such as, “Is there a problem in healthcare provision or in health outcomes (informed by the availability of audit data), and are there guidelines that cover this problem?”
When clinical guidelines to improve patient care are introduced, several characteristics of the organisation will be important. An organisation that can adapt to frequent change will offer different barriers and facilitators than will one that is oriented towards maintaining the status quo. At the simplest level, the size and complexity of the organisation will affect the feasibility of different strategies. Strategies for a primary care group or a single general practice may be inappropriate in a large acute trust. For example, a strategy that involves face to face contact between a guidelines facilitator and all clinicians may be realistic for general practices but more difficult, if not impossible, within a large acute trust.
The introduction of clinical guidelines requires resources. These include the costs of producing the guidelines—but this is dwarfed by the time of the appropriately skilled and experienced people who will disseminate and implement them. The skills needed at an organisational level are: knowledge of the theoretical basis of behaviour change among healthcare professionals and the empirical evidence about the effectiveness of different dissemination and implementation strategies2; good interpersonal skills; and knowledge of methods of guideline development and appraisal. Specific skills for monitoring the use of guidelines—data processing skills for audit and feedback data or data collection skills for non-routine clinical data—may also be needed.
Finding valid guidelines to use
Most healthcare organisations do not have the resources and skills to develop valid guidelines from scratch.4,6 They should try to identify previously developed rigorous guidelines and adapt these for local use.6
Identifying published clinical guidelines is problematic. Many guidelines are not indexed in the commonly available bibliographic databases. Some clinical guidelines are catalogued on the internet (box), and such sites may become the best source for identifying guidelines. An increasing number include full text versions or abstracts.
Identifying guidelines
Search terms for common bibliographic databases:
Medline and Healthstar—“guideline” (publication type) and “consensus development conference” (publication type). Healthstar includes journals not referenced in Medline and grey literature such as AHCPR guidelines
cinahl—“practice guidelines” (publication type). Includes full text version of some guidelines, including AHCPR guidelines
embase—“practice guidelines” (subject heading). This is used for articles about guidelines and for those that contain practice guidelines; the term was introduced in 1994
Useful websites:
Agency for Health Care Policy and Research guidelines—full text versions of guidelines, quick reference guides, and versions for patients can be downloaded from http://text.nlm.nih.gov/ftrs/dbaccess/ahcpr or ordered from the AHCPR website (http://www.ahcpr.gov/cgi-bin/gilssrch.pl)
Canadian Medical Association Clinical Practice Guidelines Infobase—index of clinical practice guidelines includes downloadable full text versions or abstracts for most guidelines (http://www.cma.ca/cpgs/)
Scottish Intercollegiate Guidelines Network—full text versions of guidelines and quick reference guides (http://pc47.cee.hw.ac.uk/sign/home.htm)
If organisations cannot find published valid guidelines relevant to their identified priorities they can amend their priorities or develop a guideline themselves. If they decide to develop a guideline, they should use as rigorous a method as possible within the resources available4 and be explicit about the method of development and its potential limitations. The increasing availability of high quality systematic reviews in the Cochrane database of systematic reviews and the Cochrane controlled trials register (both available in the Cochrane Library7) makes this task slightly less daunting than previously.
Appraising guidelines
When an organisation has identified relevant guidelines, it should appraise their validity before deciding whether to adopt their recommendations.8 Adopting recommendations from guidelines of questionable validity may lead to harm to patients or waste of resources on ineffective interventions.9 Within the United Kingdom, appraising the validity of existing guidelines will be facilitated by the recently established NHS Appraisal Centre for Clinical Guidelines and by the establishment of guideline development programmes which use rigorous methods and include formal appraisal within the programmes—for example, the Scottish Intercollegiate Guidelines Network10 and the work proposed under the auspices of the National Institute for Clinical Excellence in England and Wales.
If appraised guidelines are not available from these sources, organisations should undertake their own appraisal. Cluzeau and colleagues have developed and validated a critical appraisal tool for guidelines in Britain,8 and other appraisal criteria are available.11 Healthcare organisations should consider only those guidelines that include a methods section within the guideline or supporting papers.12,13 Although this filter would exclude most current British guidelines, without such information it is impossible to appraise the validity of guidelines and have confidence in a guideline’s recommendations.
Adapting valid guidelines
Once a group has identified guidelines of acceptable quality these need to be adapted for use within the local healthcare setting. For most clinical conditions good health care depends on a multidisciplinary team, so guideline implementation should be planned from this perspective. The composition and function of this multidisciplinary group will parallel that of the original guideline development group,4 but members will not need systematic reviewing and evidence summarising skills. The task of the group is to adapt the guideline and then plan the presentation, use, and evaluation of the guideline within the local setting and its services. Adapting the guideline involves reformatting the recommendations in terms of measurable criteria and targets for quality improvement.14 Local adaptation groups may want to change recommendations that are based on weak evidence. If recommendations based on good evidence are changed, the reasons for this should be explicitly stated.
Coherent guideline strategy
Guidelines can be presented as the full version, summary sheets of all or part of the guideline, or reminder sheets in patient records. Prompts such as guideline related logos on mugs, pens, or Post-it pads will overlap with use of the guideline when reminder sheets or computer templates are embedded within the patient record15 or when the forms used for ordering tests are redesigned to encourage the gathering of appropriate clinical data.
Dissemination and implementation
Since there is no single effective way to ensure the use of guidelines in practice,16–18 organisations should use multifaceted interventions to disseminate and implement guidelines. The choice of strategies should be informed by available resources, perceived barriers to care, and research evidence about the effectiveness and efficiency of different strategies.19 The best evidence about effectiveness and efficiency comes from systematic reviews of rigorous evaluations of dissemination and implementation strategies, such as those by the Cochrane Effective Practice and Organisation of Care Group,2 which undertakes systematic reviews of interventions designed to improve quality of care, including professional interventions (continuing medical education, audit and feedback, reminders, etc), organisational interventions (for example, the expanded role of pharmacists), financial interventions (for example, professional incentives), and regulatory interventions.
Various professional and organisational strategies can be used to overcome different barriers. For example, educational approaches (seminars and workshops) may be useful where barriers relate to healthcare professionals’ knowledge. Audit and feedback may be useful when healthcare professionals are unaware of suboptimal practice. Social influence approaches (local consensus processes, educational outreach, opinion leaders, marketing, etc) may be useful when barriers relate to the existing culture, routines, and practices of healthcare professionals. Reminders and patient mediated interventions may be useful when healthcare professionals have problems processing information within consultations. Information about existing barriers can be collected by interviews with individual patients or clinicians, in group interviews, or during direct observation.
The presence of organisational barriers may require specific interventions. For example, in east London, the development of guidelines on dyspepsia in primary care led to general practitioners having direct access to testing for Helicobacter pylori.
Evaluation
Evaluation ensures that the process of care reflects guideline recommendations. The data needed for this should be specified at the outset and should be linked to areas of strong evidence within the guideline.20 Reminder or prompt sheets can be designed to encourage the recording of specific data items.15,21
Medical or clinical audit advisory groups for general practice and clinical audit/clinical effectiveness departments in trusts have a key role to play in collecting, analysing, and feeding back these data. Clinical governance—a central concept in a recent policy paper on the health service22—will depend on accurate and meaningful data about quality of care. We believe that criteria for clinical governance should be derived, at least in part, from the recommendations framed in evidence based clinical guidelines.
Use of guidelines by clinicians
Outside a formal structure for the implementation of clinical guidelines within an organisation, individual clinicians may use guidelines as an information source for continuing professional education. Valid clinical guidelines provide an overview of the management of a condition or the use of an intervention. They usually have a broader scope than systematic reviews, which tend to focus on an individual problem or intervention. They may also provide a more coherent integrated view on how to manage a condition. Guidelines can also be used as instruments for self assessment or peer review, to learn about gaps in performance. This is particularly relevant when the recommendations have been turned into specific measurable criteria,
Clinicians may also use guidelines to answer specific clinical questions arising out of their day to day practice. A key step is to frame the clinical question of interest in such a way that it can be answered by specifying the patient or problem, the intervention of interest, and possible comparison interventions, and the outcomes of interest (see Sackett et al for a further discussion of this23). This allows the clinician to identify what sort of evidence to search for. Under these circumstances clinical guidelines are only one type of relevant evidence—along with systematic reviews, individual trials, and expert advice.
Conclusions
Clinical guidelines are increasingly part of current practice and will become more common over the next decade. Great care needs to be taken both to maximise the validity of guidelines and to ensure their use within clinical practice. The latter requires adaptation for a local setting and tailoring evidence based implementation strategies to local factors. However, guidelines will not address all the uncertainties of current clinical practice and should be seen as only one strategy that can help improve the quality of care that patients receive.
Footnotes
Series editors: Martin Eccles, Jeremy Grimshaw
References
- 1.Freemantle N, Harvey E, Grimshaw JM, Wolf F, Bero L, Grilli R, et al. The effectiveness of printed educational materials in changing the behaviour of health care professionals. In: Cochrane Collaboration. Cochrane Library. Issue 3. Oxford: Update Software, 1996.
- 2.Bero L, Grilli R, Grimshaw JM, Oxman AD, editors. Oxford: Update Software; 1998. The Cochrane Effective Practice and Organisation of Care Review Group. The Cochrane Database of Systematic Reviews. Issue 3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Lomas J. Teaching old (and not so old) docs new tricks: effective ways to implement research findings. In: Dunn EV, Norton PG, Stewart M, Tudiver F, Bass MJ, editors. Disseminating research/changing practice. Research methods for primary care. Vol. 6. Thousand Oaks, CA: Sage; 1994. [Google Scholar]
- 4.Griffiths C, Feder G. Using clinical guidelines in a general practitioner consultation. In: Risdale L, editor. Evidence-based practice in primary health care. London: Churchill Livingstone; 1998. [Google Scholar]
- 5.Grimshaw J, Eccles M. Clinical practice guidelines. In: Silagy C, Haines A, editors. Evidence based practice in primary care. London: BMJ Publishing; 1998. [Google Scholar]
- 6.Shekelle PG, Woolf SH, Eccles M, Grimshaw J. Clinical guidelines: developing guidelines. BMJ. 1999;318:593–596. doi: 10.1136/bmj.318.7183.593. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.NHS Executive. Clinical guidelines: using clinical guidelines to improve patient care within the NHS. Leeds: NHS Executive; 1996. [Google Scholar]
- 8.Royal College of General Practitioners. The development and implementation of clinical guidelines: report of the Clinical Guidelines Working Group. Exeter: Royal College of General Practitioners; 1996. (Report from practice 26.) [Google Scholar]
- 9.Cochrane Collaboration. The Cochrane Library [CD Rom]. Issue 3. Oxford: Update Software; 1998. [Google Scholar]
- 10.Cluzeau F, Littlejohns P, Grimshaw JM. Appraising clinical guidelines—towards a “Which” guide for purchasers. Quality in Health Care. 1994;3:121–122. doi: 10.1136/qshc.3.3.121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: the potential benefits, limitations, and harms of clinical guidelines. BMJ. 1998;318:000–000. doi: 10.1136/bmj.318.7182.527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Petrie JC, Grimshaw JM, Bryson A. The Scottish Intercollegiate Guidelines Network initiative: getting validated guidelines into local practice. Health Bull. 1995;53:345–348. [PubMed] [Google Scholar]
- 13.Hayward RSA, Wilson MC, Tunis SR, Bass EB, Guyatt G. Users’ guides to the medical literature. VII. How to use clinical practice guidelines. A: are the recommendations valid? JAMA. 1995;274:570–574. doi: 10.1001/jama.274.7.570. [DOI] [PubMed] [Google Scholar]
- 14.Eccles MP, Clapp Z, Grimshaw JM, Adams PC, Higgins B, Purves I, et al. North of England evidence based guideline development project: methods of guideline development. BMJ. 1996;312:760–761. doi: 10.1136/bmj.312.7033.760. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.North of England evidence based guidelines development project: methods of developing guidelines for efficient drug use in primary care. BMJ. 1998;316:1232–1235. doi: 10.1136/bmj.316.7139.1232. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Eccles M, Freemantle N, Mason J.for the North of England ACE-inhibitor Guideline Development Group. North of England evidence based guideline development project: guideline for the use of angiotensin converting enzyme inhibitors in the primary care management of adults with symptomatic heart failure BMJ 19983161369–1375. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Feder G, Griffiths C, Highton C, Eldridge S, Spence M, Southgate L. Do clinical guidelines introduced with practice based education improve care of asthmatic and diabetic patients? A randomised controlled trial in general practices in east London. BMJ. 1995;311:1473–1478. doi: 10.1136/bmj.311.7018.1473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Implementing clinical practice guidelines. Effective Health Care 1994; No 8.
- 19.Oxman AD, Thomson MA, Davis DA, Haynes RB. No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995;153:1423–1431. [PMC free article] [PubMed] [Google Scholar]
- 20.Wensing M, Grol R. Single and combined strategies for implementing changes in primary care: a literature review. Int J Qual Health Care. 1994;6:115–132. doi: 10.1093/intqhc/6.2.115. [DOI] [PubMed] [Google Scholar]
- 21.Grol R. Beliefs and evidence in changing clinical practice. BMJ. 1997;315:418–421. doi: 10.1136/bmj.315.7105.418. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Agency for Health Care Policy and Research. Using clinical guidelines to evaluate quality of care. 1. Issues. Rockville, MD: US Departmentt of Health and Human Services, Public Health Service; 1995. (AHCPR publication No 95-0045.) [Google Scholar]
- 23.Emslie C, Grimshaw J, Templeton A. Do clinical guidelines improve general practice management and referral of infertile couples? BMJ. 1993;306:1728–1731. doi: 10.1136/bmj.306.6894.1728. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.NHS Executive. A first class service: quality in the new NHS. Leeds: NHS Executive; 1998. [Google Scholar]
- 25.Sackett DL, Richardson WS, Rosenberg W, Haynes RB. Evidence based medicine. How to practice and teach EBM. New York: Churchill Livingstone; 1996. [Google Scholar]