Skip to main content
NCBI home page
Medline Book to support NIHPA logoLink to Medline Book to support NIHPA
. 2023 Dec;27(32):1–110. doi: 10.3310/UCTH3411

A multifaceted intervention to reduce antibiotic prescribing among CHIldren with acute COugh and respiratory tract infection: the CHICO cluster RCT.

Peter S Blair, Grace J Young, Clare Clement, Padraig Dixon, Penny Seume, Jenny Ingram, Jodi Taylor, Jeremy Horwood, Patricia J Lucas, Christie Cabral, Nick A Francis, Elizabeth Beech, Martin Gulliford, Sam Creavin, Janet A Lane, Scott Bevan, Alastair D Hay
PMCID: PMC11017154  PMID: 38204218

Abstract

BACKGROUND

Clinical uncertainty in primary care regarding the prognosis of children with respiratory tract infections contributes to the unnecessary use of antibiotics. Improved identification of children at low risk of future hospitalisation might reduce clinical uncertainty. A National Institute for Health and Care Research-funded 5-year programme (RP-PG-0608-10018) was used to develop and feasibility test an intervention.

OBJECTIVES

The aim of the children with acute cough randomised controlled trial was to reduce antibiotic prescribing among children presenting with acute cough and respiratory tract infection without increasing hospital admission.

DESIGN

An efficient, pragmatic open-label, two-arm trial (with embedded qualitative and health economic analyses) using practice-level randomisation using routinely collected data as the primary outcome.

SETTING

General practitioner practices in England.

PARTICIPANTS

General practitioner practices using the Egton Medical Information Systems® patient-record system for children aged 0-9 years presenting with a cough or upper respiratory tract infection. Recruited by Clinical Research Networks and Clinical Commissioning Groups.

INTERVENTION

Comprised: (1) elicitation of parental concerns during consultation; (2) a clinician-focused prognostic algorithm to identify children with acute cough and respiratory tract infection at low, average or elevated risk of hospitalisation in the next 30 days accompanied by prescribing guidance, (3) provision of a printout for carers including safety-netting advice.

MAIN OUTCOME MEASURES

Co-primaries using the practice list-size for children aged 0-9 years as the denominator: rate of dispensed amoxicillin and macrolide items at each practice (superiority comparison) from NHS Business Services Authority ePACT2 and rate of hospital admission for respiratory tract infection (non-inferiority comparison) from Clinical Commissioning Groups, both routinely collected over 12 months.

RESULTS

Of the 310 practices required, 294 (95%) were recruited (144 intervention and 150 controls) with 336,496 registered 0-9-year-olds (5% of all 0-9-year-old children in England) from 47 Clinical Commissioning Groups. Included practices were slightly larger than those not included, had slightly lower baseline dispensing rates and were located in more deprived areas (reflecting the distribution for practice postcodes nationally). Twelve practices (4%) subsequently withdrew (six related to the pandemic). The median number of times the intervention was used was 70 per practice (by a median of 9 clinicians) over 12 months. There was no evidence that the antibiotic dispensing rate in the intervention practices [0.155 (95% confidence interval 0.135 to 0.179)] differed to controls [0.154 (95% confidence interval 0.130 to 0.182), relative risk= 1.011 (95% confidence interval 0.992 to 1.029); p = 0.253]. There was, overall, a reduction in dispensing levels and intervention usage during the pandemic. The rate of hospitalisation for respiratory tract infection in the intervention practices [0.019 (95% confidence interval 0.014 to 0.026)] compared to the controls [0.021 (95% confidence interval 0.014 to 0.029)] was non-inferior [relative risk = 0.952 (95% confidence interval 0.905 to 1.003)]. The qualitative evaluation found the clinicians liked the intervention, used it as a supportive aid, especially with borderline cases but that it, did not always integrate well within the consultation flow and was used less over time. The economic evaluation found no evidence of a difference in mean National Health Service costs between arms; mean difference -£1999 (95% confidence interval -£6627 to 2630).

CONCLUSIONS

The intervention was feasible and subjectively useful to practitioners, with no evidence of harm in terms of hospitalisations, but did not impact on antibiotic prescribing rates.

FUTURE WORK AND LIMITATIONS

Although the intervention does not appear to change prescribing behaviour, elements of the approach may be used in the design of future interventions.

TRIAL REGISTRATION

This trial is registered as ISRCTN11405239 (date assigned 20 April 2018) at www.controlled-trials.com (accessed 5 September 2022). Version 4.0 of the protocol is available at: https://www.journalslibrary.nihr.ac.uk/ (accessed 5 September 2022).

FUNDING

This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment (NIHR award ref: 16/31/98) programme and is published in full in Health Technology Assessment; Vol. 27, No. 32. See the NIHR Funding and Awards website for further award information.

Plain language summary

Coughs and colds (also known as respiratory tract infections) are the most common reason that children are taken to family doctors and nurses in primary care. These clinicians are not always sure how best to treat them and often use antibiotics ‘just in case’. There are now concerns that clinicians are using antibiotics too often, and that this is increasing the number of resistant bugs (bacteria that cannot be killed by antibiotics). We wanted to see if using a scoring system of symptoms and signs of illness to help clinicians identify children very unlikely to need hospital care as well as listening to parents’ concerns and giving them a personalised leaflet with care and safety advice, reduced antibiotic use. We recruited practices rather than patients, so did not need individual patient consent. The two main outcomes were the rate of antibiotics dispensed for children and number of children admitted to hospital for respiratory tract infections, using routinely collected data for 0–9-year-olds. We recruited 294 general practitioner practices, which was 95% of the total needed; 144 were asked to use the intervention and 150 to continue providing usual care (controls); only 12 practices subsequently withdrew (6 related to the pandemic). The average number of times the intervention was used was 70 per practice (by an average of 9 clinicians) over 12 months. There was no evidence that the antibiotic dispensing rate in the intervention practices differed from control practices. Further analyses showed an overall reduction in dispensing levels and intervention usage during the pandemic. The rate of hospitalisation for respiratory tract infection in the intervention practices was similar to the control practices. In the interviews, we found that clinicians liked the intervention and used it as a supportive aid during consultations, especially for borderline cases, rather than a tool to change prescribing behaviour.

Full text of this article can be found in Bookshelf.

References

  1. Hay AD, Heron J, Ness A, The ALSPAC Study Team. The prevalence of symptoms and consultations in pre-school children in the Avon Longitudinal Study of Parents and Children (ALSPAC): a prospective cohort study. Fam Pract 2005;22(4):367–74. doi: 10.1093/fampra/cmi035. [DOI] [PubMed]
  2. Hollinghurst S, Gorst C, Fahey T, Hay A. Measuring the financial burden of acute cough in pre-school children: a cost of illness study. BMC Fam Pract 2008;9(1):10. doi: 10.1186/1471-2296-9-10. [DOI] [PMC free article] [PubMed]
  3. Ferech M, Coenen S, Malhotra-Kumar S, Dvorakova K, Hendrickx E, Suetens C, et al. European Surveillance of Antimicrobial Consumption (ESAC): outpatient antibiotic use in Europe. J Antimicrob Chemother 2006;58(2):401–7. doi: 10.1093/jac/dkl188. [DOI] [PubMed]
  4. Ashworth M, Charlton J, Ballard K, Latinovic R, Gulliford M. Variations in antibiotic prescribing and consultation rates for acute respiratory infection in UK practices 1995–2000. Br J Gen Pract 2005;55:603–8. [PMC free article] [PubMed]
  5. Howie JG. Clinical judgement and antibiotic use in general practice. BMJ 1976;2(6043):1061–4. doi: 10.1136/bmj.2.6043.1061. [DOI] [PMC free article] [PubMed]
  6. Goossens H, Ferech M, van der Stichele R, Elseviers M; ESAC Project Group. Outpatient antibiotic use in Europe and association with resistance: a cross-national database study. Lancet 2005;365(9459):579–87. doi: 10.1016/S0140-6736(05)17907-0. [DOI] [PubMed]
  7. Sharland M, Kendall H, Yeates D, Randall A, Hughes G, Glasziou P, et al. Antibiotic prescribing in general practice and hospital admissions for peritonsillar abscess, mastoiditis, and rheumatic fever in children: time trend analysis. BMJ 2005;331(7512):328–9. doi: 10.1136/bmj.38503.706887.AE1. [DOI] [PMC free article] [PubMed]
  8. Little P, Watson L, Morgan S, Williamson I. Antibiotic prescribing and admissions with major suppurative complications of respiratory tract infections: a data linkage study. Br J Gen Pract 2002;52(476):187–93. [PMC free article] [PubMed]
  9. Priest P, Yudkin P, McNulty C, Mant D, Wise R. Antibacterial prescribing and antibacterial resistance in English general practice: cross sectional study commentary: antibiotic resistance is a dynamic process. BMJ 2001;323(7320):1037–41. doi: 10.1136/bmj.323.7320.1037. [DOI] [PMC free article] [PubMed]
  10. Costelloe C, Metcalfe C, Lovering A, Mant D, Hay AD. Effect of antibiotic prescribing in primary care on antimicrobial resistance in individual patients: systematic review and meta-analysis. BMJ 2010;340(2):c2096. doi: 10.1136/bmj.c2096. [DOI] [PubMed]
  11. Little P, Gould C, Williamson I, Warner G, Gantley M, Kinmonth AL. Reattendance and complications in a randomised trial of prescribing strategies for sore throat: the medicalising effect of prescribing antibiotics. BMJ 1997;315(7104):350–52. doi: 10.1136/bmj.315.7104.350. [DOI] [PMC free article] [PubMed]
  12. Standing Medical Advisory Committee. The Path of Least Resistance. London: Department of Health; 1998.
  13. NICE. Respiratory Tract Infections: Prescribing of Antibiotics for Self-limiting Respiratory Tract Infections in Adults and Children in Primary Care. London: NICE; 2008. [PubMed]
  14. Pearson GA (editor). Why Children Die: A Pilot Study (2006). London: CEMACH; 2008.
  15. Andrews T, Thompson M, Buckley DI, Heneghan C, Deyol R, Redmond N, et al. Interventions to influence consulting and antibiotic use for acute respiratory tract infections in children: a systematic review and meta-analysis. PLOS ONE 2012;7(1):e30334. doi: 10.1371/journal.pone.0030334. [DOI] [PMC free article] [PubMed]
  16. Vodicka TA, Thompson M, Lucas P, Heneghan C, Blair PS, Buckley DI, et al. Reducing antibiotic prescribing for children with respiratory tract infections in primary care: a systematic review. Br J Gen Pract 2013;63(612):445–54. doi: 10.3399/bjgp13X669167. [DOI] [PMC free article] [PubMed]
  17. Thompson M, Vodicka TA, Blair PS, Buckley DI, Heneghan C, Hay AD. Duration of symptoms of respiratory tract infections in children: a systematic review. BMJ 2013;347:f7027. doi: 10.1136/bmj.f7027. [DOI] [PMC free article] [PubMed]
  18. Cabral C, Horwood J, Hay AD, Lucas PJ. How communication affects prescription decisions in consultations for acute illness in children: a systematic review and meta-ethnography. BMC Fam Pract 2014;15:63. doi: 10.1186/1471-2296-15-63. [DOI] [PMC free article] [PubMed]
  19. Lucas PJ, Cabral C, Hay AD, Horwood J. A systematic review of parent and clinician views and perceptions that influence prescribing decisions in relation to acute childhood infections in primary care. Scand J Prim Health Care 2015;33(1):11–20. doi: 10.3109/02813432.2015.1001942. [DOI] [PMC free article] [PubMed]
  20. Redmond NM, Davies R, Christensen H, Blair PS, et al. The TARGET cohort study protocol: a prospective primary care cohort study to derive and validate a clinical prediction rule to improve the targeting of antibiotics in children with respiratory tract illnesses. BMC Health Serv Res 2013;13(1):322. doi: 10.1186/1472-6963-13-322. [DOI] [PMC free article] [PubMed]
  21. Hay AD, Redmond NM, Turnbull S, Christensen H, Thornton H, Little P, et al. Development and internal validation of a clinical rule to improve antibiotic use in children presenting to primary care with acute respiratory tract infection and cough: a prognostic cohort study. Lancet Respir Med 2016;4(11):902–10. doi: 10.1016/S2213-2600(16)30223-5. [DOI] [PMC free article] [PubMed]
  22. Lucas P, Ingram J, Redmond NM, Cabral C, Turnbull S, Hay A. Development of an intervention to reduce antibiotic use for childhood coughs in UK primary care using critical synthesis of multi-method research. BMC Med Res Methodol 2017;17:1–10. doi: 10.1186/s12874-017-0455-9. [DOI] [PMC free article] [PubMed]
  23. Turnbull SL, Redmond NM, Lucas P, Cabral C, Ingram J, Hollinghurst S, et al. The CHICO (Children’s Cough) Trial protocol: a feasibility randomised controlled trial investigating the clinical and cost-effectiveness of a complex intervention to improve the management of children presenting to primary care with acute respiratory tract infection. BMJ Open 2015;5(9):e008615. doi: 10.1136/bmjopen-2015-008615. [DOI] [PMC free article] [PubMed]
  24. Blair PS, Turnbull S, Ingram J, Redmond N, Lucas PJ, Cabral C, et al. Feasibility cluster randomised controlled trial of a within-consultation intervention to reduce antibiotic prescribing for children presenting to primary care with acute respiratory tract infection and cough. BMJ Open 2017;7(5):e014506. doi: 10.1136/bmjopen-2016-014506. [DOI] [PMC free article] [PubMed]
  25. Green, LW, Kreuter MW. Health promotion as a public health strategy for the 1990s. Ann Rev Public Health 1990;11:319–34. doi: 10.1146/annurev.pu.11.050190.001535. [DOI] [PubMed]
  26. Cabral C, Lucas PJ, Ingram J, Hay AD, Horwood J. ‘It’s safer to …’ parent consulting and clinician antibiotic prescribing decisions for children with respiratory tract infections: an analysis across four qualitative studies. Soc Sci Med 2015;136–137:156–64. doi: 10.1016/j.socscimed.2015.05.027. [DOI] [PubMed]
  27. National Institute for Clinical Excellence (NICE): Department of Health. Respiratory Tract Infections: Prescribing of Antibiotics for Self-limiting Respiratory Tract Infections in Adults and Children in Primary Care. CG69. London: National Institute for Clinical Excellence; 2008. [PubMed]
  28. Ingram J, Cabral C, Hay AD, Lucas PJ, Horwood J, TARGET Team. Parents’ information needs, self-efficacy and influences on consulting for childhood respiratory tract infections: a qualitative study. BMC Fam Pract 2013;14:106. doi: 10.1186/1471-2296-14-106. [DOI] [PMC free article] [PubMed]
  29. Horwood J, Cabral C, Hay AD, Ingram J. Primary care clinician antibiotic prescribing decisions in consultations for children with RTIs: a qualitative interview study. Br J Gen Pract 2016;66(644):e207–13. doi: 10.3399/bjgp16X683821. [DOI] [PMC free article] [PubMed]
  30. The EPACT Website. URL: www.nhsbsa.nhs.uk/epact2 (accessed 5 September 2022).
  31. Public Health England. English Surveillance Programme for Antimicrobial Utilisation and Resistance (ESPAUR). 2016.
  32. Fleming-Dutra KE, Hersh AL, Shapiro DJ, et al. Prevalence of inappropriate antibiotic prescriptions among US ambulatory care visits, 2010–2011. JAMA 2016;315(17):1864–73. doi: 10.1001/jama.2016.4151. [DOI] [PubMed]
  33. Gulliford MC, Moore MV, Little P, Hay AD, Fox R, Prevost AT, et al. Safety of reduced antibiotic prescribing for self limiting respiratory tract infections in primary care: cohort study using electronic health records. BMJ 2016;354:i3410. doi: 10.1136/bmj.i3410. [DOI] [PMC free article] [PubMed]
  34. Gulliford MC, van Staa T, Dregan A, McDermott L, McCann G, Ashworth M, et al. Electronic health records for intervention research: a cluster randomized trial to reduce antibiotic prescribing in primary care (eCRT study). Ann Fam Med 2014;12(4):344–51. doi: 10.1370/afm.1659. [DOI] [PMC free article] [PubMed]
  35. Gulliford MC, van Staa TP, McDermott L, McCann G, Charlton J, Dregan A, eCRT Research Team. Cluster randomized trials utilizing primary care electronic health records: methodological issues in design, conduct, and analysis (eCRT study). Trials 2014;15:220. doi: 10.1186/1745-6215-15-220. [DOI] [PMC free article] [PubMed]
  36. Avent ML, Hansen MP, Gilks C, Del Mar C, Halton K, Sidjabat H, et al. General Practitioner Antimicrobial Stewardship Programme Study (GAPS): protocol for a cluster randomised controlled trial. BMC Fam Pract 2016;17(1):48. doi: 10.1186/s12875-016-0446-7. [DOI] [PMC free article] [PubMed]
  37. Juszczyk D, Charlton J, McDermott L, Soames J, Sultana K, Ashworth M, et al. Electronically delivered, multicomponent intervention to reduce unnecessary antibiotic prescribing for respiratory infections in primary care: a cluster randomised trial using electronic health records – REDUCE Trial study original protocol. BMJ Open 2016;6(8):e010892. doi: 10.1136/bmjopen-2015-010892. [DOI] [PMC free article] [PubMed]
  38. Horwood, J. Cabral, C. Hay, A. Ingram, J. Primary healthcare practitioners’ diagnostic and antibiotic prescribing decisions in children’s consultations for respiratory tract infections. Br J Gen Pract 2016;66(644):e207–13. doi: 10.3399/bjgp16X683821. [DOI] [PMC free article] [PubMed]
  39. May CR, Mair F, Finch T, et al. Development of a theory of implementation and integration: normalization process theory. Implement Sci 2009;4:29. doi: 10.1186/1748-5908-4-29. [DOI] [PMC free article] [PubMed]
  40. Seume P, Bevan S, Young G, Ingram J, Clement C, Cabral C, et al. Protocol for an ‘efficient design’ cluster randomised controlled trial to evaluate a complex intervention to improve antibiotic prescribing for CHIldren presenting to primary care with acute COugh and respiratory tract infection: the CHICO study. BMJ Open 2021;11(3):e041769. doi: 10.1136/bmjopen-2020-041769. [DOI] [PMC free article] [PubMed]
  41. Kontopantelis E, Stevens RJ, Helms PJ, Edwards D, Doran T, Ashcroft DM. Spatial distribution of clinical computer systems in primary care in England in 2016 and implications for primary care electronic medical record databases: a cross-sectional population study. BMJ Open 2018;8(2):e020738. doi: 10.1136/bmjopen-2017-020738. [DOI] [PMC free article] [PubMed]
  42. Clinical Research Network. URL: www.nihr.ac.uk/explore-nihr/support/clinical-research-network.htm (accessed 5 September 2022).
  43. Bower P, Grigoroglou C, Anselmi L, Kontopantelis E, Sutton M, Ashworth M, et al. Is health research undertaken where the burden of disease is greatest? Observational study of geographical inequalities in recruitment to research in England 2013–2018. BMC Med 2020;18(1):133. doi: 10.1186/s12916-020-01555-4. [DOI] [PMC free article] [PubMed]
  44. Cabral C, Ingram J, Redmond N, Horwood J, Blair P, Hollinghurst S, et al. Caring for Children with Coughs: Information for Parents. Bristol: Centre for Academic Primary Care, University of Bristol; 2016.
  45. Practice List Size via the NHS Digital Website. URL: https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/general-practice-data-hub/patients-registered-at-a-gp-practice (accessed 5 September 2022).
  46. CHICO Statistical Analysis Plan. URL: https://research-information.bris.ac.uk/ws/portalfiles/portal/278667871/CHICO_SAP_draft_v1.0_26.05.21_SIGNED.pdf.pdf (accessed 5 September 2022).
  47. IMD Postcodes. URL: https://imd-by-postcode.opendatacommunities.org/imd/2019 (accessed 5 September 2022).
  48. IDACI Measures. URL: https://opendatacommunities.org/def/concept/general-concepts/imd/idaci#:~:text=The%20Income%20Deprivation%20Affecting%20Children,deprivation%20relating%20to%20low%20income (accessed 5 September 2022).
  49. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med 2010;8:63. doi: 10.1186/1741-7015-8-63. [DOI] [PMC free article] [PubMed]
  50. Sandelowski M. Sample size in qualitative research. Res Nurs Health 1995;18(2):179–83. doi: 10.1002/nur.4770180211. [DOI] [PubMed]
  51. QSR International. What is NVivo? | NVivo. 2019. URL: www.qsrinternational.com/nvivo/what-is-nvivo (accessed 5 September 2022).
  52. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3(2):77–101.
  53. Tracy SJ. Qualitative quality: eight ‘big-tent’ criteria for excellent qualitative research. Qual Inq 2010;16(10):837–51.
  54. Husereau D, Drummond M, Augustovski F, de Bekker-Grob E, Briggs A H, Carswell C, et al. Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations BMJ 2022;376:e067975. doi: 10.1136/bmj-2021-067975. [DOI] [PMC free article] [PubMed]
  55. NHS Employers, Annual Pay Scales 2020/21. URL: www.nhsemployers.org/articles/annual-pay-scales-202021 (accessed 1 February 2022).
  56. NHS. 2019/20 National Cost Collection Data Publication. 2021. URL: www.england.nhs.uk/publication/2019-20-national-cost-collection-data-publication/ (accessed 15 January 2022).
  57. Nixon RM, Wonderling D, Grieve RD. Non-parametric methods for cost-effectiveness analysis: the central limit theorem and the bootstrap compared. Health Econ 2010;19(3):316–33. https://onlinelibrary.wiley.com/doi/abs/10.1002/hec.1477?casa_token=bWPOoMTRWOgAAAAA:BZi2CJKW76Ewgy9jvcbSGiq8dDe7_zTHGO26sINKlu1Duq9t-73TmErbOQ1WTt-CR3H3rhpCTAwt (accessed 14 September 2022). doi: 10.1002/hec.1477. [DOI] [PubMed]
  58. Ramsey SD, Willke RJ, Glick H, Reed SD, Augustovski F, Jonsson B, et al. Cost-effectiveness analysis alongside clinical trials II: an ISPOR Good Research Practices Task Force report. Value Health 2015;18(2):161–72. www.sciencedirect.com/science/article/pii/S1098301515000169 (accessed 14 September 2022). doi: 10.1016/j.jval.2015.02.001. [DOI] [PubMed]
  59. Ngune I, Jiwa M, Dadich A, Lotriet J, Sriram D. Effective recruitment strategies in primary care research: a systematic review. Qual Prim Care 2012;20(2):115–23. [PubMed]
  60. Foster JM, Sawyer SM, Smith L, Reddel HK, Usherwood T. Barriers and facilitators to patient recruitment to a cluster randomized controlled trial in primary care: lessons for future trials. BMC Med Res Methodol 2015;15:18. doi: 10.1186/s12874-015-0012-3. [DOI] [PMC free article] [PubMed]
  61. Allcott H. Site selection bias in program evaluation. Q J Econ 2015;130(3):1117–65.
  62. Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In Bryman A, Burgess RG, editors. Analyzing Qualitative Data. London: Routledge; 1994. pp. 173–94.
  63. NIHR Annual Report 2019/20. Department of Health & Social Care. URL: www.nihr.ac.uk/documents/annual-report-20192020/26565 (accessed 5 September 2022).
  64. Ellis SD, Bertoni AG, Bonds DE, Randall Clinch C, Balasubramanyam A, Blackwell C, et al. Value of recruitment strategies used in a primary care practice-based trial. Contemp Clin Trials 2007;28(3):258–67. doi: 10.1016/j.cct.2006.08.009. [DOI] [PMC free article] [PubMed]
  65. Irving G, Neves AL, Dambha-Miller H, Oishi A, Tagashira H, Verho A, Holden J. International variations in primary care physician consultation time: a systematic review of 67 countries. BMJ Open 2017;7(10):e017902. doi: 10.1136/bmjopen-2017-017902. [DOI] [PMC free article] [PubMed]
  66. NIHR. Annual Efficient Studies Funding Calls for CTU Projects. URL: www.nihr.ac.uk/documents/ad-hoc-funding-calls-for-ctu-projects/20141 (accessed 5 September 2022).
  67. Practices Closing or Merging. URL: https://digital.nhs.uk/data-and-information/find-data-and-publications/supplementary-information/2018-supplementary-information-files/number-of-gp-practices-closed-or-merged-in-england-between-1-july-2016-and-31-december-2017-by-nhs-geographies (accessed 5 September 2022).
  68. Hammersley V, Donaghy E, Parker R, McNeilly H, Atherton H, Bikker A, et al. Comparing the content and quality of video, telephone, and face-to-face consultations: a non-randomised, quasi-experimental, exploratory study in UK primary care. Br J Gen Pract 2019;69(686):e595–604. doi: 10.3399/bjgp19X704573. [DOI] [PMC free article] [PubMed]
  69. Checkland K, McDermott I, Coleman A, Perkins N. Complexity in the new NHS: longitudinal case studies of CCGs in England. BMJ Open 2016;6(1):e010199. doi: 10.1136/bmjopen-2015-010199. [DOI] [PMC free article] [PubMed]
  70. McDonagh M, Peterson K, Winthrop K, et al. Improving Antibiotic Prescribing for Uncomplicated Acute Respiratory Tract Infections (Comparative Effectiveness Reviews, No. 163.). Rockville, MD: Agency for Healthcare Research and Quality (US); 2016. URL: www.ncbi.nlm.nih.gov/books/NBK344270/ (accessed 5 September 2022). [PubMed]
  71. Gulliford MC, Prevost AT, Charlton J, et al. Effectiveness and safety of electronically delivered prescribing feedback and decision support on antibiotic use for respiratory illness in primary care: REDUCE cluster randomised trial. BMJ 2019;364:l236. doi: 10.1136/bmj.l236. [DOI] [PMC free article] [PubMed]
  72. Andrews A, Bou-Antoun S, Guy R, Brown CS, Hopkins S, Gerver S. Respiratory antibacterial prescribing in primary care and the COVID-19 pandemic in England, winter season 2020-21. J Antimicrob Chemother 2022;77(3):799–802. doi: 10.1093/jac/dkab443. [DOI] [PMC free article] [PubMed]
  73. Khouja T, Mitsantisuk K, Tadrous M, Suda KJ. Global consumption of antimicrobials: impact of the WHO Global Action Plan on Antimicrobial Resistance and 2019 coronavirus pandemic (COVID-19). J Antimicrob Chemother 2022;77(5):1491–9. doi: 10.1093/jac/dkac028. [DOI] [PubMed]
  74. Rezel-Potts E, L’Esperance V, Gulliford MC. Antimicrobial stewardship in the UK during the COVID-19 pandemic: a population-based cohort study and interrupted time-series analysis. Br J Gen Pract 2021;71(706):e331–8. doi: 10.3399/BJGP.2020.1051. [DOI] [PMC free article] [PubMed]
  75. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) – a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377–81. https://doi.org/10.1016/j.jbi.2008.08.010 doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed]

RESOURCES