Abstract
Objectives
To identify and explore strategies that English NHS commissioning organizations implemented to improve antimicrobial stewardship (AMS) within primary care.
Methods
Questionnaire sent to the medicines management teams (MMTs) of all 209 clinical commissioning groups (CCGs) in England, in 2017.
Results
A total of 89% (187/209) of all English CCGs responded to the questionnaire; 74% of responding CCGs (123/167) had a prescribing incentive/engagement scheme, with MMTs representing 88% (90/102) considering incentive schemes successful or very successful for prioritizing AMS in primary care, especially when linked to prescribing NHS Quality Premium indicators. AMS audits were considered successful or very successful by 91% (126/138) of responding CCGs, as they identify reasons for inappropriate prescribing and opportunities for future improvement. All responding MMTs (169/169 CCGs) reported feeding back local/national antimicrobial prescribing data to the general practices they commission, 85% (142/168) to their CCG/Commissioning Support Unit (CSU) board and only 33% (56/169) to out-of-hours services. Benchmarking prescribing data was reported as a powerful tool to engage practices, facilitating an element of competition and peer pressure.
Conclusions
National antimicrobial resistance improvement schemes, in particular the NHS England Quality Premium, have influenced CCG improvement priorities. Most CCGs now report successful improvement strategies including the use of both local and national antibiotic prescribing data to motivate improvements; these should be continued and extended to out-of-hours providers. As local audit data have helped to identify reasons for inappropriate prescribing and inform improvement planning, all organizations should adopt this strategy and include it in local quality improvement schemes, ensuring performance reporting to organizational board level.
Introduction
In 2017, 81% of antibiotic prescribing occurred in primary care in England.1 No single or simple strategy will suffice to fully contain the emergence and spread of antimicrobial-resistant infections.2,3 In recognition of the national importance of controlling the global antimicrobial resistance (AMR) challenge,4 since 2015 the NHS in England has included ‘improving antibiotic prescribing in primary care’ as one of its Quality Premium (QP) improvement measures.5 An NHS QP rewards clinical commissioning groups (CCGs) for improvements in the quality of the services that they commission and for associated improvements in health outcomes.5 CCGs are clinically led statutory NHS bodies responsible for the planning and commissioning of healthcare services for their local area. Appropriate antimicrobial prescribing is promoted and facilitated by medicines management teams (MMTs). MMTs sit within CCGs or commissioning support units (CSUs) and support one or more CCGs. MMTs are generally teams of pharmacists and pharmacy technicians who work closely with GPs and local health providers to help get the best out of medicines for local people. There are between 5 and 120 GP practices in each CCG.
NICE antimicrobial stewardship (AMS) guidance (NG15)6 encourages commissioning organizations to develop and implement AMS programmes. Such programmes include: local incentive/reward schemes; guidance for the management of common infections; AMS education/training; benchmarking and feedback of antimicrobial prescribing data; and AMS audits. National resources such as the TARGET (Treat Antibiotics Responsibly, Guidance, Education, Tools) toolkit7 and Antibiotic Guardian8 help facilitate these AMS programmes. Primary care commissioners and practitioners have many competing priorities and may find it difficult to implement the NICE AMS guidance.9 To support implementation of the QP, NHS England and PHE established AMS hubs, PrescQIPP10 and Fingertips,11 providing open access to antibiotic prescribing and infection data at the CCG and GP practice level, and signposting to resources such as TARGET.7
Our aim was to identify and explore strategies English NHS commissioning organizations have implemented to improve AMS within primary care.
Methods
This research is part of a larger work programme to identify and describe AMS strategies in primary care in England. The learning will provide data for both national and local healthcare organizations, to inform interventions to optimize antimicrobial prescribing within the UK’s five-year action plan for AMR (2019–24)3 and the NHS Long Term Plan.12
Design
Qualitative interviews were first undertaken with MMT AMS leads, representing CCGs with a range of antimicrobial prescribing, based on 2016 data. Interview findings informed development of a questionnaire, which was cascaded to MMTs via email.
The AMS implementation questionnaire (Appendix S1, available as Supplementary data at JAC-AMR Online) comprised both open and closed questions and explored MMTs’ local implementation and views of the success of:
the NHS QP for AMR
benchmarking and feedback of antimicrobial prescribing data to general practices, out-of-hours (OOH) services and the CCG/CSU board
AMS audits of community antibiotic prescribing
locally developed incentive/reward schemes to encourage AMS
Chief Medical Officer’s (CMO’s) letter: behavioural intervention where the most senior doctor in the government wrote to CCGs with higher antibiotic prescribing rates13
barriers and facilitators to AMS
other AMS initiatives and resources
Setting
Commissioning organizations for English primary care, including both CCGs and CSUs.
Participants
In 2016, the heads of medicines management responsible for all 209 CCGs were contacted and asked to nominate a staff member who would be able to discuss antimicrobial prescribing in their geographical area (AMS lead, usually a pharmacist). A subset of these individuals were invited to participate in qualitative interviews and all were electronically mailed the study questionnaire later. The methodology has been described in full elsewhere.14
Ethics
This study was registered with the PHE Research Support and Governance Office (RSGO) and approved by the PHE Research Ethics and Governance Group (REGG) (R&D Reference: R&D 277) and the Health Research Association (HRA) (IRAS project ID: 213816; REC reference: 16/HRA/4152). All participants gave informed consent for interviews to be recorded and transcribed and for anonymized quotes to be used in publications. Questionnaire responses were anonymized before analysis.
Results
Qualitative interviews to inform questionnaire development
Eleven medicines management AMS leads participated in interviews. See Appendix S2 for example quotes from the qualitative interviews.
Questionnaire responses
Overall, medicines management AMS leads representing 89% (187/209) of all English CCGs responded to the questionnaire. Of these, 90% (169/187) provided responses to the benchmarking and feedback of antimicrobial prescribing data section; 89% (167/187) to both the audit and incentive schemes sections; and 89% (166/187) to the barriers and facilitators section. Not all respondents answered all questions; therefore, results are represented as a percentage of CCGs that responded to each question. See Appendix S3 for a full breakdown of responses.
Success of the QP in supporting AMS in primary care
AMS leads commented in free-text questions that the AMR QP provided a structural focus to their organization and highlighted the importance of AMS at the senior management level.
‘Including in the Quality Premium means that senior (non-clinical) managers take notice and don’t prioritise other workload instead.’ (CCG-82—Questionnaire)
The financial incentive attached to achieving QP indicators was reported as the main driving factor for prioritization and implementation of AMS initiatives (n = 23).
‘In the current difficult financial climate anything that will bring funding into a CCG will be prioritised.’ (CSU-2—Questionnaire)
Although the national QP was important, AMS leads commented that it did not necessarily motivate GP staff to become engaged as the funding goes to the CCG rather than directly to general practices; therefore, many GPs would be unaware of the QP (n = 25).
‘Some practices won’t engage too much as the funding comes into the CCG if we achieve targets rather than straight to GPs.’ (CCG-101—Questionnaire)
Success of benchmarking and feedback of antimicrobial prescribing data in supporting AMS in primary care
All responding MMTs (169/169 CCGs) reported feeding back local/national antimicrobial prescribing data to the general practices they commission; only 33% (56/169 CCGs) fed back to OOH services. A total of 85% (142/168) of CCGs reported feeding this data upward to their CCG/CSU board. Reasons for not feeding upwards included: AMS not being a concern as the CCG had usage lower than the national average; data not requested by the board; and data already shared at senior meetings.
Sources of antimicrobial prescribing data
Interfaces for accessing antimicrobial prescribing data, reported by MMTs, were:
NHS BSA ePACT website15 (87%; 145/167 responding CCGs)
PrescQIPP AMS hub10 (57%; 95/167 responding CCGs)
NHS BSA Information Service Portal16 (39%; 65/167 responding CCGs)
PHE portal (Fingertips)11 (37%; 61/167 responding CCGs)
CSU reporting (25%; 42/167 responding CCGs)
OpenPrescribing17 (8%; 14/167 responding CCGs)
MMTs representing 25 CCGs reported using ‘other’ sources to obtain their prescribing data, such as in-house or local analysts, and directly from GP clinical systems.
Feeding back antimicrobial prescribing data to primary care practitioners
Of those that responded, 94% (159/169) fed back data aligned with national AMS initiatives, such as the CCG QP and Improvement Assessment Framework.18 Ninety-nine percent (168/169) fed back GP practice-level data; 86% (145/169) CCG-level data; and 23% (39/169) individual prescriber-level data. Eighty-five percent (144/169) reported feeding back both GP- and CCG-level data.
Frequency of feeding back antimicrobial prescribing data to primary care practitioners
MMTs representing 91% of responding CCGs (152/167) reported feeding back antimicrobial prescribing data to primary care practitioners at least quarterly and 44% (74/167) monthly. Fourteen percent (24/167) reported feeding back antimicrobial prescribing data differently to antibiotic prescribing outliers. This was generally more frequently than the norm; one reported:
‘We work with outliers on a targeted approach so use more detailed data when required, especially to send well done messaging!’ (CCG-87—Questionnaire)
Benchmarking
Eighty-seven percent of CCGs (146/168) that completed the benchmarking question reported feeding back local benchmarking data against the national average; 78% (112/144) reported that this was successful (51%; 73/144) or very successful (27%; 39/144) at prioritizing AMS activity for these healthcare staff (Figure 1).
Figure 1.
Success of AMS initiatives in supporting AMS in primary care (n = 187).
In free-text responses, benchmarking prescribing data was mentioned as a very powerful tool to engage practices (n = 9) as no one wants to be an outlier, facilitating an element of competition and peer pressure (n = 26), encouraging practitioners to start asking questions about their own prescribing of antimicrobials and managing of patients, and resulting in more appropriate prescribing behaviour (n = 28).
‘It generates questions within practices and across the wider health economy. It also generates competition between practices. I’m frequently asked to drill down further from practice level data to prescriber level data. Practices then use this as a tool to challenge individual prescribers prescribing practice - it’s used as an educational tool to promote learning.’ (CCG-85—Questionnaire)
‘Having this data available regularly keeps AMS on ‘the agenda’. I believe GPs are inundated and it is important to keep AMS in the consciousness of GP practice staff.’ (CCG-77—Questionnaire)
Seventy-eight percent of responding CCGs (101/129) reported that monitoring and feeding back primary care antimicrobial prescribing data to the CCG/CSU board was successful (44%; 57/129) or very successful (34%; 44/129) for prioritizing AMS. AMS leads commented that the prescribing data: ensures there is a constant priority and focus on AMS (n = 20); facilitates monitoring (n = 4); can demonstrate a change in prescribing (n = 7); and is important for forward planning (n = 7).
‘Can be a real wake-up call when your CCG realises they are very high prescribers compared to other areas.’ (CSU-23—Questionnaire)
Success of audits in supporting AMS in primary care
AMS audits were reported to be undertaken in 81% (136/167) of responding CCGs: 59% of these (80/136) were undertaken by practice staff and MMTs undertook AMS audits on behalf of their practices for half of all CCGs that responded to this question (50%; 68/136). In free-text responses, it was also mentioned that the practice-based medicines management staff sometimes undertake the AMS audits for the practice (n = 6).
Over the last 2 years, responding MMTs reported that they had promoted/undertaken audits for: urinary tract infections (66%; 82/124); upper respiratory tract infections (51%; 63/124); lower respiratory tract infections (31%; 39/124); and skin infections (13%; 16/124). Respondents also commented that they undertook audits based on antimicrobial agent rather than condition (n = 12) including: broad-spectrum agents (n = 26); total volume (n = 25); and long-term prophylactic use (n = 4).
MMTs reported discussing audit findings in the GP practices (89%; 119/133 of responding CCGs): 72% of these (96/133) with the prescribers and 46% (61/133) with as many primary care practitioners as possible. Some respondents commented that they send a report for discussion within practice meetings (n = 6).
Approximately half of CCGs that completed the question (51%; 68/133) reported audit findings to the CCG/CSU, but only 17% (23/133) reported audit findings to the CCG/CSU board.
Over half (54/102) of responding CCGs reported that more than 75% of their practices completed an AMS audit in 2016/17. Free-text responses regarding methods for monitoring audit completion included:
submission to MMT as part of prescribing incentive scheme or GP quality contract (n = 49)
the MMT was involved in organizing the audit (n = 12)
practices were asked to return GP practice-based audit action plans (n = 6)
Ninety-one percent of responding CCGs (126/138) reported that AMS audits were successful (61%; 84/138) or very successful (30%; 42/138) in supporting AMS in primary care (Figure 1). Respondents commented that audits show potential avenues for antimicrobial prescribing improvements (n = 23) and allow peer review (n = 18) and self-reflection (n = 14) (Figure 2). However, AMS leads commented that there was sometimes a lack of practice engagement (n = 10) and MMT staff resource to optimize practice audits (n = 5).
Figure 2.
Free-text responses relating to audit.
Success of locally developed incentive/reward schemes for general practices in supporting AMS in primary care
Seventy-four percent (123/167) of responding CCGs indicated that they had a prescribing incentive and/or engagement scheme, of which antimicrobial prescribing formed a part. Participants noted that incentive schemes were usually linked to prescribing targets associated with the QP indicators (n = 86) and resulted in a practice financial reward, if reached (n = 59).
‘Practices would be given a payment based on the local prescribing incentive scheme if they met the target for the quality premium.’ (CCG-118—Questionnaire)
The main components of the local schemes included: AMS audits (46%; 57/123); practitioners encouraged to become antibiotic guardians (32%; 39/123); compulsory AMS/AMR education/learning (25%; 31/123); and completion of a self-assessment checklist (8%; 10/123).
Eighty-eight percent (90/102) of responding CCGs reported incentive/reward schemes as successful (51%; 52/102) or very successful (37%, 38/102) at prioritizing AMS activity for primary care practitioners (Figure 1). Respondents commented that financial incentivization works (n = 20) and it raises practitioners’ awareness as it is seen as a priority and a focus (n = 18).
‘Inclusion of any subject in the local incentive scheme ensures it is discussed and prioritised by GP practices. It isn’t merely the financial reward as that is relatively small but it is seen as the CCGs prescribing priorities.’ (CSU-2—Questionnaire)
Sixty-seven percent (64/95) of responding CCGs reported that over 75% of their practices achieved the targets set in their local AMS incentive/reward scheme.
Success of behavioural intervention through letter from CMO in supporting AMS in primary care
AMS leads representing 131 CCGs reported knowledge of one or more of their practices having received a CMO letter in either January 2016 and/or April 2017 (115 CCGs each year, but not the same ones). However, 40 and 36 CCGs, respectively, did not know whether their practice(s) had received a letter. Although CCGs reported that the CMO letter raised awareness about antibiotic use and encouraged the practices to reflect on their practice prescribing and modify their prescribing behaviour (n = 27), they viewed it as less successful than other initiatives at raising AMS awareness (Figure 1 and Figure 3).
Figure 3.
Free-text responses relating to the CMO’s letter.
Some AMS leads commented that the prescribing data used to select the high-prescribing practices (n = 22) did not reflect current prescribing behaviour (n = 14) and was skewed by walk-in centres (n = 2).
Some respondents commented that there was an opportunity to improve the impact of the CMO letter, by closer collaboration with local MMTs using the latest prescribing data and local knowledge to select practices.
Facilitators and barriers for primary care practitioners
Eighty-four percent (124/147) of responding CCGs reported that primary care practitioners’ awareness of AMS activities promoted in their CCG was good or excellent, but fewer prioritized AMS (68%; 98/145 of responding CCGs) or implemented initiatives (61%; 86/140 of responding CCGs).
‘I think that awareness amongst primary care practitioners is good. However, implementation of AMS initiatives without the CCG supporting or taking charge is poor.’ (CCG-32—Questionnaire)
AMS leads were presented with a list of potential barriers for primary care practitioners, collated from the qualitative phase of the study, and asked ‘how big a barrier are the following characteristics for your primary care practitioners?’ (Figure 4). Eighty-three percent (138/166) of responding CCGs perceived that public/patient pressure was a big or very big barrier, with some commenting that overprescribing in secondary care (n = 4) and patients accessing other healthcare to obtain an antibiotic (n = 3) exacerbated this (Figure 5).
Figure 4.
Respondents’ perceived impact of barriers to AMS for primary care practitioners (n = 187).
Figure 5.
Free-text responses relating to AMS barriers for primary care practitioners.
Sixty-four percent (104/163) of responding CCGs perceived that ‘clinicians don’t want to make the wrong decision and therefore give antibiotics when they are not always needed’ was a big or very big barrier.
One-fifth (32/164) of respondents perceived that ‘AMR/AMS is not a top priority in primary care’ was a big or very big barrier, commenting that this was due to time, competing messages and other priorities (n = 14). Other suggested barriers for primary care practitioners are reported in Appendix S4.
Respondents indicated that practice pharmacists are seen as important facilitators, but MMTs preferred CCG-funded staff as this gave CCGs greater control over their workplans. See Appendix S5 for other facilitators.
Facilitators and barriers for MMTs
Ninety-eight percent of responding CCGs (162/166) reported that their MMTs’ awareness of AMS was good or excellent.
AMS leads were presented with a list of potential barriers for MMTs, collated from the qualitative phase of the study, and asked ‘how big a barrier are the following characteristics for your medicines management team?’ (Figure 6).
Figure 6.
Respondents’ perceived impact of barriers to AMS for MMTs (n = 187).
In regards to the potential barrier ‘within medicines management, one of our priorities is cost-saving and antimicrobial prescribing is not seen as a huge expense’, 29% (48/164) of responding CCGs reported that it was not a barrier; 15% (24/164) a very small barrier; 18% (29/164) a small barrier; 27% (45/164) a big barrier; and 11% (18/164) a very big barrier.
There were many other barriers for MMTs suggested by respondents that would influence antimicrobial prescribing and AMS (Appendix S6).
All suggested facilitators for AMS, collated from the qualitative phase, were generally rated important or very important (Figure 7). Ninety-five percent (155/164) of responding CCGs reported that a ‘joined up approach between all sectors involved in AMS’ was important or very important.
Figure 7.
Respondents’ perceived importance of primary care AMS facilitators (n = 187). **Indicates personal information has been removed.
Sixty-six percent (108/163) of responding CCGs reported that dedicated staff within the MMT who are solely responsible for AMS is an important or very important facilitator for AMS (Figure 8).
Figure 8.
Free-text responses relating to AMS barriers and facilitators for NHS commissioning organizations.
Other noted barriers related to other roles in primary care included: locums (n = 13); OOHs (n = 3); care homes (n = 3); trainee GPs overprescribing due to inexperience (n = 2); and community pharmacy (n = 1) (Figure 9).
Figure 9.
Free-text responses relating to other AMS barriers.
Discussion
Findings suggest that, while awareness of AMS is high, this has not always translated into action. However, our study confirms that the QP has the greatest influence on prioritization of AMS by medicines management staff due to its national focus and financial incentive for CCGs. The antibiotic QP in primary care has been very effective, with an overall 7.3% (2015–17) reduction of antibiotic prescription items across 96% (201/209) of CCGs.19 As the national financial incentive goes to the CCG rather than the GP practices, many CCGs provide local practice incentive schemes, often based on the QP indicators, which facilitated monitoring of resource uptake and increased the priority of AMS for practitioners. Cochrane review findings indicate that financial incentives may be effective in changing healthcare professional behaviours and, in turn, patient outcomes.20
The QP has also had an impact on feedback of antibiotic prescribing data, as QP indicators are now the main focus for reporting. All MMTs reported providing antibiotic prescribing data for general practices, which is promising, as feedback suggests this keeps it on the agenda within the GP setting and motivates outliers to audit their personal prescribing. Feeding back of prescribing data is reported as a benefit, but this is only provided to 33% (56/169) of all OOH providers. It is recommended that accurately collecting and reporting OOH prescribing is explored.
Recent antimicrobial audits were undertaken by most CCGs (81%; 136/167) in the last 2 years (2015–17), which is encouraging, as AMS leads’ feedback indicated that audits were an important catalyst in motivating behaviour change for overprescribers. Audit templates currently exist for a range of conditions;7 however, as findings suggest audits are often undertaken for specific antimicrobials, audit tools to support this should also be produced. The provision of national audit templates could facilitate MMTs and primary care staff to undertake audits and could be promoted for revalidation and for trainee GPs, as these were the least utilized avenues.21 Research suggests that audit feedback, comparison with peers, discussion and action planning are essential for onward behaviour change.22–26 Furthermore, the benefits of audit and feedback measures are most likely to occur for prescribing outliers, when feedback is more intensive27 and when a full audit cycle is undertaken (audit and re-audit).23 Audit training and greater feedback about antimicrobial audit results to the board may increase effectiveness of the strategy.
The CMO letter to practices, providing social norm feedback, substantially reduced antibiotic prescribing at low cost and at national scale.13 Participants suggested that the letter influenced prescribers by indicating that their prescribing is under scrutiny, but would be even more effective if the CMO letter were sent collaboratively with local MMTs, using the most recent prescribing data available.
AMS leads reported that practice pharmacists could be a major facilitator for AMS. Antimicrobial pharmacists have been found to be effective in secondary care and could be used more in the GP setting,28 to increase awareness and implementation of AMS strategies such as audit and feedback.
Strengths and limitations
MMTs representing 89% (187/209) of all CCGs responded to the research questionnaire; 79% (166/209) completed the questionnaire in full.
MMT AMS leads completed the survey and consequently the responses to questions about barriers and facilitators for primary care practitioners are reported as perceptions. This should be acknowledged as it appeared that patient expectation is still a major barrier; however, this was reported by the AMS leads rather than primary care practitioners themselves. Nonetheless, in free-text comment boxes, respondents took the opportunity to pass on feedback from primary care practitioners.
The qualitative text enriches the data, obtaining a wide range of views, but as respondents did not always comment, it may not be completely generalizable, like the quantitative data.
Recommendations
Successful CCG improvement strategies include the use of both local and national antibiotic prescribing data and continued use should be encouraged, within improvement schemes and extended to OOH services.
As audit data identify reasons for inappropriate prescribing and inform improvement planning, all organizations should adopt this strategy and include audits within local quality improvement schemes, ensuring reporting of performance to the organizational board level. Training provision on effective auditing, emphasizing feedback and discussions with as many staff as possible to support a whole-practice approach, should be considered as there was not a consistent approach.
Local improvement schemes should be encouraged to engage primary care practitioners and act as a means of monitoring uptake of initiatives promoted. Such schemes could include:
completion of full audit cycle (audit with feedback and re-audit)
completion of self-assessment checklist
attendance/completion of AMS education/training with action planning
use of TARGET leaflets to share with patients, with Read coding to facilitate monitoring and audit, ideally with computer prompts from the clinical systems
displaying posters and videos in waiting areas
Supplementary Material
Acknowledgements
We wish to thank all AMR/AMS leads within MMTs for participating in our qualitative interviews and/or completing the in-depth questionnaire. We wish to thank the wider TARGET team for administrative support to enable the high response rate to the questionnaire.
Funding
This study was supported by PHE.
Transparency declarations
C.C. is funded through a personal National Institute for Health Research fellowship (CDF-2016-09-015). C.A.M.M., D.M.L. and R.A. are employed by PHE and work on the TARGET (Treat Antibiotics Responsibly, Guidance, Education, Tools) programme. C.A.M.M. is the lead for development of the PHE Managing Common Infections guidance. D.A.-O. is the pharmacist lead for AMR in PHE. No other authors declare competing interests.
Supplementary data
Appendices S1–S6 and Reviewer reports 1 and 2 are available as Supplementary data at JAC-AMR Online.
References
- 1.PHE. English Surveillance Programme for Antimicrobial Utilisation and Resistance (ESPAUR): Report 2018. PHE, 2018.
- 2.WHO. Antimicrobial Resistance: Global Report on Surveillance. WHO, 2014.
- 3.Department of Health and Social Care. Tackling antimicrobial resistance 2019–2024: the UK’s five-year national action plan. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/773130/uk-amr-5-year-national-action-plan.pdf. [DOI] [PubMed]
- 4.Department of Health, Department for Environment Food and Rural Affairs. UK Five Year Antimicrobial Resistance Strategy: 2013 to 2018. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/244058/20130902_UK_5_year_AMR_strategy.pdf.
- 5.NHS England. Quality Premium guidance 2013–19. https://www.england.nhs.uk/resources/resources-for-ccgs/ccg-out-tool/ccg-ois/qual-prem/.
- 6.NICE. Antimicrobial Stewardship: Systems and Processes for Effective Antimicrobial Medicine Use [NG15]. https://www.nice.org.uk/guidance/ng15. [DOI] [PMC free article] [PubMed]
- 7.PHE, Royal College of General Practitioners. The TARGET Antibiotics Toolkit. http://www.rcgp.org.uk/targetantibiotics.
- 8.Public Health England. Antibiotic Guardian. http://antibioticguardian.com/.
- 9. Butler CC, Hillier S, Roberts Z. et al. Antibiotic resistant infections in primary care are symptomatic for longer and increase workload: outcomes for patients with E. coli urinary tract infection. Br J Gen Pract 2006; 56: 686–92. [PMC free article] [PubMed] [Google Scholar]
- 10.PrescQIPP, NHS Improvement. Antimicrobial Stewardship (AMS) Hub. https://www.prescqipp.info/antimicrobial-stewardship/projects/antimicrobial-stewardship.
- 11.PHE. Fingertips: AMR Local Indicators. https://fingertips.phe.org.uk/profile/amr-local-indicators.
- 12.NHS. The NHS Long Term Plan. https://www.longtermplan.nhs.uk/wp-content/uploads/2019/08/nhs-long-term-plan-version-1.2.pdf.
- 13. Hallsworth M, Chadborn T, Sallis A. et al. Provision of social norm feedback to high prescribers of antibiotics in general practice: a pragmatic national randomised controlled trial. Lancet 2016; 387: 1743–52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Allison R, Lecky DM, Beech E. et al. Local implementation of national guidance on management of common infections in primary care in England: findings of a mixed-methods national questionnaire. Pharm J 2020; 15: 44.
- 15.NHS Business Services Authority (BSA). NHS BSA ePACT. https://www.nhsbsa.nhs.uk/epact2.
- 16.NHS Business Services Authority (BSA). Information Service Portal (ISP). https://www.nhsbsa.nhs.uk/information-services-portal-isp.
- 17.OpenPrescribing.net. EBM DataLab. https://openprescribing.net.
- 18.NHS England. CCG Improvement and Assessment framework (CCG IAF). https://www.england.nhs.uk/commissioning/regulation/ccg-assess/.
- 19. Beech E. Does a national NHS England incentive scheme to reduce inappropriate antibiotic prescribing in primary care deliver improvement? Public Health England Annual Conference, Warwick, UK, 2018. Abstract 221168.
- 20. Flodgren G, Eccles MP, Shepperd S. et al. An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Database Syst Rev 2011: issue 7: CD009255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Royal College of General Practitioners. Unlocking the potential: Supporting doctors to use national clinical audit to drive improvement. https://www.rcplondon.ac.uk/projects/outputs/unlocking-potential-supporting-doctors-use-national-clinical-audit-drive.
- 22. Esposito P, Dal Canton A.. Clinical audit, a valuable tool to improve quality of care: general methodology and applications in nephrology. World J Nephrol 2014; 3: 249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Ivers N, Jamtvedt G, Flottorp S. et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012; issue 6: CD000259. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Travaglia J, Debono D. Clinical audit: a comprehensive review of the literature. https://www2.health.vic.gov.au/Api/downloadmedia/%7B99C92572-B20F-4C81-8507-58E0F14FCBF0%7D.
- 25. Tonkin-Crine S, Yardley L, Coenen S. et al. GPs’ views in five European countries of interventions to promote prudent antibiotic use. Br J Gen Pract 2011; 61: e252–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Wiley E, Smith C, Thakerar J. et al. Preventing Escherichia coli bacteraemia through improved community urinary tract infection (UTI) management–use of the TARGET uncomplicated UTI audit tool in primary care. J Hosp Infect 2019; 103: 172–3. [DOI] [PubMed] [Google Scholar]
- 27. Flottorp SA, Jamtvedt G, Gibis B. et al. Using audit and feedback to health professionals to improve the quality and safety of health care. http://www.euro.who.int/en/data-and-evidence/evidence-informed-policy-making/publications/2010/using-audit-and-feedback-to-health-professionals-to-improve-the-quality-and-safety-of-health-care.
- 28. Carreno JJ, Kenney RM, Bloome M. et al. Evaluation of pharmacy generalists performing antimicrobial stewardship services. Am J Health Sys Pharm 2015; 72: 1298–303. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.









