Skip to main content
JAC-Antimicrobial Resistance logoLink to JAC-Antimicrobial Resistance
. 2026 Oct 16;8(5):dlag219. doi: 10.1093/jacamr/dlag219

Impact of a multifaceted intervention programme on antibiotic prescribing in out-of-hours primary care in five European countries: secondary analyses of the HAPPY PATIENT project

Ingrid Keilegavlen Rebnord 1,2,✉, Carl Llor 3,4,5, Fabiana Raynal Floriano 6, Malene Plejdrup Hansen 7,8, Jesper Lykkegaard 9, Jonas Olsen 10, Pia Touboul-Lundgren 11, Pascale Bruno 12, Anna Kowalczyk 13, Christos Lionis 14,15, Ruta Radzeviciene 16, Lina Jaruseviciene 17, Lars Bjerrum 18, Ana Garcia-Sangenis 19, Bent Håkan Lindberg 20,21
PMCID: PMC13673263  PMID: 42891077

Abstract

Background

Antimicrobial resistance is a major global health threat, driven mainly by excessive and inappropriate antibiotic use. As most antibiotics are prescribed outside hospitals, primary care measures are crucial for reducing use. The study aimed to investigate diagnostic coding and antibiotic prescribing for respiratory tract (RTI) and urinary tract (UTI) infections treated in out-of-hours clinics before and after a multifaceted intervention.

Methods

Audit and feedback with analyses of prescription data from five out-of-hours clinics in Europe before and after a multifaceted intervention. The intervention consisted of an audit with reports and feedback to the prescriber, participation in workshops, communication and e-learning courses, and distribution of information materials to patients.

Results

A total of 67 physicians recorded 1786 cases in the first period and 1820 in the second. Common cold/influenza was the most frequent diagnosis, increasing from 19.4% (95% CI 18–21) in the first to 28.7% (95% CI 27–31) in the second period. COVID-19 declined by 65.7% (P < 0.001), while pharyngotonsillitis increased by 31.7% (P = 0.001). The intervention did not alter the overall antibiotic prescribing rate for RTIs (49.3% versus 48.7%, P = 0.748), and more than three-quarters of RTI prescriptions were judged unnecessary or inappropriate. For UTIs, the use of first-line antibiotics increased significantly from 70.0% to 79.5% (P = 0.027).

Conclusions

The study provided important insights into which RTIs are potentially inappropriately treated with antibiotics, although the intervention did not produce a statistically significant reduction in antibiotic prescribing. Positively, the use of first-line antibiotics for UTIs increased significantly.

Introduction

Antibiotic resistance is a significant threat to public health worldwide, and antibiotic use is one of the main drivers.1 A significant proportion of total human antibiotic consumption is prescribed in primary healthcare; however, there is considerable variation between countries.2 Physician-, patient- and healthcare system–related factors influence prescribing decisions, and several antibiotic stewardship programmes have been introduced to reduce inappropriate antibiotic use.3 Hence, interventions to reduce inappropriate antibiotic prescribing, targeting healthcare personnel and the public, are pertinent, necessary and wanted.4,5

Out-of-hours (OOH) primary care is essential for a well-functioning healthcare system, as people’s perceived need for health assessment can arise at any time. The European Union (EU) and other Organisation for Economic Co-operation and Development countries organize their OOH services in different ways, and there are several models within countries.6,7 General practitioners’ (GPs) cooperatives are the most common model in the EU.7 Most countries’ OOH clinics serve all age groups, while some countries offer dedicated paediatric services.

Despite organizational differences, there is a high consistency in the OOH epidemiology across European countries, with high attendance for acute respiratory tract infections (RTIs).8 These highly prevalent infections are typically self-limiting and seldom benefit from antibiotic treatment.9 European national guidelines recommend restricted prescribing practices, and RTIs are essential targets for interventions to reduce inappropriate antibiotic prescribing.10

Symptoms of urinary tract infections (UTIs) are unpleasant and tend to appear abruptly, which may explain why these infections are frequently managed in OOH primary care. Antibiotics are indicated for UTIs; however, prescribers should select narrow-spectrum antibiotics, taking local antimicrobial resistance patterns into account.10

The OOH setting differs from the daytime general practice setting in that patients are unknown, consultations occur at irregular hours and referral options are usually fewer. These factors influence how physicians perceive their work and prescribe antibiotics.11,12 Whether RTI OOH populations across different healthcare systems have higher acuity and more antibiotic-demanding infections than regular-hours patients remains unresolved.11,13,14

Multifaceted interventions have been more effective than single interventions in reducing unnecessary antibiotic prescribing.15,16 Audit Project Odense (APO) is an internationally accepted approach for quality improvement, built on audit and feedback for participating healthcare personnel.17,18 Interventions using the APO method have led to marked reductions in antibiotic prescribing within different countries across several continents.19–21

The project Health Alliance for Prudent Prescribing and Yield of Antibiotics in a patient-centred Perspective (HAPPY PATIENT) was a prospective, non-randomized, multifaceted intervention conducted in five countries: France, Greece, Lithuania, Poland and Spain. It investigated, for the first time, the effect of the APO method on antibiotic prescribing for RTIs and UTIs in OOH primary care and found potentially unnecessary antibiotic prescribing in 52% of the contacts.21–23

This study aims to provide an in-depth analysis of how an intervention built on the APO methodology influenced diagnostic coding and antibiotic treatment of common infections in the OOH setting in five European countries.

Methods

Study design

The participating countries organize their OOH services in various ways. The main differences were whether the services were organized within primary or secondary care, the physicians’ specialities and the availability of point-of-care tests. Despite these differences, all included clinics were the first point of contact for patients who perceived a need for OOH medical assessment. A pilot test of the registration material was conducted in November 2021 to confirm that the registration chart was relevant to their practice and readily comprehensible. According to the study protocol, we aimed to recruit at least 25 OOH physicians per country. The calculation assumed a baseline antibiotic prescribing rate of 40%, a reduction to 25%, an intracluster correlation coefficient of 0.1, α = 0.05 and 80% power, requiring 25 healthcare professionals per audit cycle.23 The present analysis included all eligible cases recorded in the five participating OOH clinics during the two study periods: the pre-intervention registration from February to April 2022 and the post-intervention registration from February to April 2023 with no separate post hoc sample size calculation.

Registrations and variables

The participants used APO paper-based registration forms with predefined categories (Figure S1, available as Supplementary data at JAC-AMR Online). For each patient, we recorded patient age, sex, duration of symptoms, predefined categories of symptoms and clinical findings, use of point-of-care tests, diagnosis, whether antibiotic treatment was initiated and, if so, which type and whether admitted to the hospital.

The primary outcome was whether antibiotics were prescribed. We then dichotomized antibiotics into first- and second-line, according to each country's national guidelines (Figure S2). Second-line antibiotics were defined as inappropriate for all infections.

Unnecessary antibiotic prescriptions were defined using an algorithm developed for this study (Figure S2). For common cold/influenza, COVID-19 and acute bronchitis/bronchiolitis, all prescriptions were deemed unnecessary. For rhinosinusitis, a symptom duration of <7 days deemed a prescription unnecessary. For acute otitis media, symptom duration and patient age were decisive, while sore throat and at least two CENTOR criteria defined the basis for assessing diagnoses and treatment for acute pharyngotonsillitis. If multiple diagnoses were present, the prescription was deemed necessary if one of the diagnosis met the criteria.

Only physicians who participated in both registration periods were included in this study.

Intervention

The pragmatic intervention took place from October 2022 to February 2023 and had the following elements:

  1. An individual report of the results from the first registration with feedback on the prescribing of the individual and the national group, facilitating reflections on their results with peer-to-peer feedback and group discussions about any quality issues.

  2. Participation in a workshop to discuss strategies for quality development and knowledge exchange on antibiotic prescribing.

  3. A 2-h training session on communication skills, held online in France, while the other countries had both physical and online meetings.

  4. Distribution of written patient information materials, prepared and adjusted to the local setting by the HAPPY PATIENT team, based on the project’s Delphi study.24 It included patient brochures and handouts to identify and address misconceptions and knowledge gaps about antibiotic use.

  5. Access to an e-learning platform with clinically relevant cases for the out-of-hours setting, focusing on appropriate use of antibiotics for common infections, updated guidelines and evidence-based recommendations for diagnosis and treatment.

All participants were provided with the complete set of information materials and feedback. They were encouraged to participate in workshops and training sessions, but those not participating were also included. How these meetings were offered per country is described in Supplementary data (Table S1).

Statistical analyses

We summarized descriptive statistics using averages for continuous variables and percentages for categorical variables.

To compare the percentages of different variables between physicians, we used χ2 tests for categorical variables and Student’s t-tests for continuous variables. We assessed comparability between the two registration periods by comparing patient characteristics and prescription rates across the two registration rounds to determine whether significant differences existed between the samples. We analysed prescribing using generalized estimating equations (GEEs) with a binomial distribution, a logit link function, and an independent working correlation structure. Physician (participant number) was specified as the clustering variable to account for correlation among patients treated by the same physician. The model was adjusted for patient age and the eight RTI diagnoses with common cold/influenza as the reference category. Effect estimates are reported as odds ratios (OR) with 95% Wald CIs. We then ran separate GEE models to estimate diagnosis-stratified adjusted OR for prescribing before and after the intervention. The significance level was set at P < 0.05.

IBM SPSS Statistics (Version 29.0.2.0 (20)) was used for the statistical analyses.

Ethics

The ethics committee boards of the five participating countries assessed the study. The boards of Greece and Spain approved the project, while the boards in Lithuania, Poland and France deemed it did not require approval. Participants signed consent after being informed about the study and that they could withdraw at any time. All information about patients was non-identifiable.

Results

A total of 67 physicians participated in both registration periods (19 physicians dropped out after the first registration). They registered 1786 cases in the first period and 1820 cases in the second. The patients’ median age was 36 years [interquartile range (IQR) 20–60] in the first registration period and 32 years (IQR 14–55) in the second (Table 1). The most frequent diagnosis was common cold/influenza in both periods. The diagnostic distribution shifted between the two periods, with a 65.7% reduction in COVID-19 cases (P < 0.001) and a 31.7% increase in pharyngotonsillitis cases (P = 0.001). The admission rate was statistically significantly lower in the second period, with a 30.1% decrease (P < 0.001) and was significant for pneumonia (from 71.9% to 56.4%; P = 0.003) and COVID-19 (from 40.7% to 18.0%; P < 0.001).

Table 1.

Patient characteristics, diagnoses, antibiotics prescribed and hospital admittance in the two registration periods

Variables Before After P value
(n = 1786) (n = 1820)
n % n %
Sexa
 Female 1000 56 1044 57.4 0.385
 Male 786 44 774 42.6
Age groupsa
 0–17 years 383 21.7 506 27.9 <0.001
 18–64 years 1003 56.8 993 54.8
 >65 years 381 21.6 313 17.3
Duration of symptomsb Mean 3.71 Median 3.0 SD 4.14 Mean 3.36 Median 3.0 SD 3.17 0.005
Symptom and signsa
Fever 889 49.8 995 54.7 0.003
 Sore throat 664 37.2 726 39.9 0.094
 Cough 877 49.1 895 49.2 0.966
 Purulent sputum increased 183 10.2 183 10.1 0.849
 Ear pain 111 6.2 126 6.9 0.391
 Tonsillar exudate 149 8.3 217 11.9 <0.001
 Tender cervical adenopathy 109 6.1 181 9.9 <0.001
 Tachypnoea 176 9.9 140 7.7 0.022
 Abnormal lung auscultation 350 19.6 308 16.9 0.038
 Dysuria 285 16.0 293 16.1 0.908
 Flank pain 172 9.6 127 7.0 0.004
 Poor general condition 316 17.7 264 14.5 0.009
Tests performeda
 Strep-A test 98 5.5 165 9.1 <0.001
 C-reactive protein test 695 38.9 720 39.6 0.691
 COVID-19 test 861 48.2 483 26.5 <0.001
 Urinary dipstick 316 17.7 346 19.0 0.307
Diagnosesa
 Common cold/influenza 347 19.4 522 28.7 <0.001
 COVID-19 317 17.8 111 6.1 <0.001
 Acute pharyngotonsillitis 226 12.6 302 16.6 0.001
 Pneumonia 185 10.4 163 9.0 0.154
 Acute bronchitis/bronchiolitis 149 8.3 175 9.6 0.181
 Acute otitis media 69 3.9 89 4.9 0.132
 Acute rhinosinusitis 59 3.3 57 3.1 0.770
 Exacerbation of COPD 39 2.2 34 1.9 0.501
 Urinary tract infection 237 13.3 213 11.7 0.155
 Pyelonephritis 120 6.7 99 5.4 0.108
 None of the above 146 8.2 118 6.5 0.051
Antibiotics prescribeda 880 49.3 887 48.7 0.748
First-line antibiotics 359 20.1 371 20.4 0.832
Second-line antibiotics 386 21.6 365 20.1 0.249
NAc 135 151
Admittance to hospitala 332 18.6 236 13.0 <0.001

aχ2  P value.

bStudent’s t-test, P value.

cNot available (NA) for categorizing, either ticked of ‘other antibiotics’ or double prescription.

Overall antibiotic prescribing rates declined by 1.2% (P = 0.748). The use of first-line antibiotics increased by 1.5% (P = 0.832), while second-line antibiotic prescribing decreased by 6.9% (P = 0.249). Symptom duration prior to clinical contact was 3.4 in the first period compared with 3.7 days in the second, a significant but not clinically relevant reduction of 0.3 days (P = 0.005).

Respiratory tract infections

A total of 2499 patients were diagnosed with an RTI. The proportion of patients prescribed antibiotics did not differ significantly before and after the intervention (OR = 1.06; 95% CI 0.74–1.55; P = 0.764; Table 2). Increasing age was associated with a higher probability of a prescription (OR = 1.01 per year; 95% CI 1.00–1.02; P = 0.004). Diagnosis strongly predicted prescribing: compared with common cold/influenza (reference), patients with all other diagnoses had significantly higher odds of being prescribed antibiotics. Because a period × diagnosis interaction term added to the adjusted model was statistically significant (Wald χ2 = 267.4, df = 14, P < 0.001), indicating that the effect of the intervention on prescribing differed by diagnosis, separate GEE models (period and age, physician as clustering variable) were subsequently fitted within each diagnosis category. Prescribing decreased statistically significantly after the intervention for COVID-19 (OR = 6.80, 95% CI 2.35–19.65; P < 0.001), whereas it increased for pneumonia (OR = 0.21; 95% CI 0.10–0.46; P < 0.001). No before–after difference was found for the remaining diagnoses. The total number of unnecessary and inappropriate prescriptions was not statistically significantly reduced for any RTI diagnosis following the intervention (Table 3). In contrast, it increased between the two periods for acute pharyngotonsillitis and exacerbation of COPD, and 88% of the RTI prescriptions were possibly unnecessary or inappropriate.

Table 2.

Adjusted odds ratios for antibiotic prescribing (GEE, binomial/logit and physician as clustering variable)

Variable ORa 95% CI P value
Period: before intervention (ref. = after) 1.06 0.74–1.55 0.764
Age (per year) 1.01 1.00–1.02 0.004
Diagnosis
 COVID-19 5.95 1.84–19.22 0.003
 Acute otitis media 108.20 40.61–288.59 <0.001
 Acute rhinosinusitis 52.30 22.49–121.63 <0.001
 Acute pharyngotonsillitis 130.19 51.32–329.97 <0.001
 Acute bronchitis/bronchiolitis 28.50 11.46–70.81 <0.001
 Pneumonia 272.87 103.03–723.43 <0.001
 Exacerbation of COPD 82.85 30.02–228.61 <0.001
 Common cold/influenza (reference) 1.00 — —
Diagnosis-stratified odds ratios for prescribing before versus after interventionb
 COVID-19 6.80 2.35–19.65 <0.001
 Common cold/influenza 0.56 0.25–1.27 0.167
 Acute otitis media 1.47 0.62–3.49 0.389
 Acute rhinosinusitis 0.68 0.27–1.73 0.419
 Acute pharyngotonsillitis 0.76 0.45–1.30 0.318
 Acute bronchitis/bronchiolitis 1.57 0.86–2.86 0.140
 Pneumonia 0.21 0.10–0.46 <0.001
 Exacerbation of COPD 0.97 0.31–3.06 0.958

OR, odds ratio; CI, confidence interval.

aThe reference category is ‘not prescribed’. The model is adjusted simultaneously for period, age and diagnosis.

bOR for the period before relative to after (ref. = after). OR > 1 indicates higher prescribing before the intervention. OR < 1 indicates higher prescribing after.

Table 3.

Unnecessary and/or inappropriate antibiotic prescription

Diagnoses Prescription before number Unnecessary and inappropriate % Prescription after number Unnecessary and inappropriate % P value
Unnecessary Inappropriate decision Total prescription Unnecessary Inappropriate decision Total prescription
Common cold/influenza 6 1 7 100.0 18 1 19 100.0 NA
COVID-19a 56 32 90 93.6 5 1 6 100.0 0.712
Acute pharyngotonsillitis 53 73 156 80.8 84 117 226 88.9 0.025
Pneumonia 57 77 147 91.2 81 54 153 88.2 0.406
Acute bronchitis/bronchiolitisa 65 3 68 100.0 57 4 63 96.8 0.139
Acute otitis media 41 7 54 88.9 38 11 62 79.0 0.152
Acute rhinosinusitis 28 4 33 97.0 22 10 36 88.9 0.196
Exacerbation of COPD 7 7 31 45.2 11 12 27 85.2 0.002
Sum 313 204 586 88.2 316 210 592 88.9 0.437

aMultiple diagnoses present, the prescription was deemed necessary if one of the dignoses fulfilled the criteria.

In the group diagnosed with acute pharyngotonsillitis, the sum of CENTOR criteria increased slightly among patients who received a prescription, from 2.58 to 2.82 (P = 0.024), but unnecessary/inappropriate prescriptions still increased. In the first period, 23.5% of patients had 0 or 1 CENTOR criteria fulfilled, and in the second period, 19.2%, indicating a high number of probably unnecessary prescriptions in addition to the high share of second-line antibiotics prescribed for this diagnosis. Fever, lack of cough and tonsillar exudate were the most frequent criteria but only 11.9% had all four criteria fulfilled in the first period and 19.2% in the second period (Table S4).

For acute otitis media and rhinosinusitis, short symptom duration and few cases with fever or poor general condition were the main reasons prescriptions were deemed unnecessary (Tables S7, S8).

Prescriptions for pneumonia increased statistically significantly, while inappropriate prescriptions showed a non-significant decrease. On the other hand, inappropriate prescriptions increased significantly for COPD exacerbations.

Urinary tract infections

A total of 592 patients were diagnosed with either cystitis or pyelonephritis; 11 patients were diagnosed with both UTI diagnoses and 66 with both RTI and UTI diagnoses. Table 4 shows the distribution of gender, symptoms and clinical findings and the use of relevant tests for those with only one UTI diagnosis. Significantly more patients underwent urinary dipstick testing after the intervention, from 66.2% to 80.0% (P = 0.002), and first-line antibiotic use in the cystitis group increased significantly from 70.0% to 79.5% (P = 0.027).

Table 4.

Patients diagnosed with only one UTI diagnosis

Before After P value
n = 302 n = 290
Agea Mean 43.44 Median 38.00 SD
23.65
Mean 44.86 Median 40.00 SD
23.83
0.470
n % n %
Sexb
 Female 239 79.1 233 80.3 0.715
Symptomb
 Dysuria 234 77.5 248 85.5 0.012
 Flank pain 87 28.8 67 23.1 0.114
 Fever 91 30.1 87 30.0 0.972
 Poor general condition 52 13.9 54 18.6 0.120
Testb
 Urinary dip stick 209 69.2 239 82.4 <0.001
 C-reactive protein test 104 34.4 127 43.8 0.020
Antibioticb
Cystitis n = 210 n = 200
 First-line antibiotics 147 70.0 159 79.5 0.027
 Second-line antibiotics 63 30.0 41 20.5
Pyelonephritis n = 92 n = 90
 First-line antibiotics 2 2.2 7 7.7 0.081
 Second-line antibiotics 90 97.8 83 92.2
Admitted to hospital 40 13.2 52 17.9 0.116

aStudent’s t-test, P value.

bχ2  P value.

Discussion

Main findings

After adjustment for age, diagnostic case-mix and physician-level clustering, we found no evidence of an overall change in antibiotic prescribing following the intervention. However, first-line antibiotic use for cystitis increased in the second period. The study provided valuable information on patients’ reported symptoms when visiting participating physicians in European out-of-hours clinics, the diagnostic tools used and the factors that influenced decisions to prescribe antibiotics.

Strengths and limitations

This study employed a pre–post design without a control group, limiting causal inference. Recruitment in the OOH setting was challenging, and the target of 25 physicians per country, each registering 25 cases across two periods (totalling 3125 infections), was not achieved. Participation was particularly low in France and Greece, with only Lithuania meeting the recruitment goal.

These challenges reflect the heterogeneous organization of OOH services across countries, ranging from hospital-based to private or public primary care clinics.7 Overall prescription rates are difficult to compare across countries due to variations in prescribing culture and the organization of OOH services. Many physicians work OOH shifts in addition to other roles, often for short periods, complicating consistent participation. Because the APO methodology requires the same physicians to register cases before and after the intervention, we included only those who participated in both registration periods in the analyses.

A central feature of the APO methodology is the standardized registration template, in which participants tick predefined variables. The limited number of variables and the simplicity of the form, which allows only binary (yes/no) responses, facilitate ease of use during busy clinical hours and ensure consistent data collection, both of which are strengths. However, this simplicity also restricts the depth of information, particularly regarding cultural or non-biomedical factors such as perceived pressure to prescribe antibiotics. The small number of variables also posed challenges in capturing both RTIs and UTIs, which differ in symptoms and clinical findings. Laboratory test variables were especially limited, as only the test performance could be recorded, not the result, thereby reducing their analytical value.

Participation was voluntary, which may introduce selection bias. Those who chose to participate may have had a greater interest in antibiotic stewardship and quality improvement and may have been more inclined to change prescribing habits.25 While self-registration could potentially influence prescribing behaviour, previous studies have shown that the APO methodology correlates well with actual prescribing practices.18 Self-registration carries risks of error and selective reporting. Treatment choices may also influence diagnostic decisions, although this bias likely affected both periods equally, thereby minimizing its effect on the measured impact of the intervention.26

The study’s multinational scope, spanning five countries with diverse healthcare systems, antibiotic use patterns and patient expectations, enhances generalizability. However, external factors such as the COVID-19 pandemic, a rise in invasive group A streptococcal infections and an increase in influenza epidemics in 2023 may have influenced both participation and prescribing behaviour. Additionally, shortages of first-line antibiotics in Lithuania and Poland may have affected the expected reduction in second-line antibiotic use.

Discussion of results/implications for practice

The study population differed notably between the two periods. In the latter period, a higher proportion of children aged 0–17 years was observed. This likely reflects the increase in cases of invasive group A streptococcal infections, which may also explain the significant rise in the use of streptococcal tests and the greater prevalence of typical throat symptoms associated with this diagnosis.27 A decline in COVID-19 cases was noted, alongside an increase in presentations of common cold and influenza, consistent with the epidemiological trends during the respective data collection periods.28 This shift was accompanied by reduced use of COVID-19 rapid tests and a significant decrease in clinical findings, such as abnormal lung auscultation, tachypnoea and poor general condition. The reduction in hospital admissions and increased antibiotic prescribing for pneumonia during the second period aligns with the lower incidence of severe respiratory findings and overall clinical severity, as well as with more patients being treated at home.

The proportion of patients diagnosed with cystitis who presented with dysuria, as well as the proportion treated with first-line antibiotics, was significantly higher following the intervention. The use of narrow-spectrum first-line antibiotics for UTI was explicitly emphasized in the intervention materials, suggesting that these observed changes in UTIs may be attributable to the intervention.

Few studies have been conducted in the OOH setting, and prescription patterns often differ from those in regular-hours general practice.29–31 While many studies focus on prescription rates for RTIs, fewer address prescription rates per diagnosis, thereby limiting opportunities for direct comparison. Compared to a European OOH study, the prescription rate found in this study is at the higher end.32 Post-intervention, there appears to be a shift in aetiological labelling, with more pneumonia patients receiving antibiotics, and fewer with acute bronchitis receiving antibiotics. This may indicate increased antibiotic awareness.

The COVID-19 pandemic largely influenced the intervention, with a high proportion of antibiotic prescriptions related to COVID-19 infections before the intervention. After the intervention, this prescription rate decreased significantly. During the early stages of the COVID-19 pandemic, antibiotic prescribing was common because of limited knowledge about the virus and concerns about bacterial co-infections and may have been partly driven by patient pressure on physicians’ performance. A UK study reported a 20% prescription rate in 2020, decreasing to 12% during the third wave in 2022.33 In comparison, our study found a 28% prescription rate in 2022, which is relatively high given the availability of diagnostic tests and established knowledge about the virus. However, prescribing decreased significantly from 2022 to 2023. This decline may be attributed to the intervention, increased clinical experience with COVID-19, and possibly the impact of vaccination, as demonstrated in other countries.34

Sore throat is a common symptom for different upper respiratory infections of both viral and bacterial aetiology, and a lot of efforts have been made to guide doctors in diagnosing and prescribing only for possible bacterial infections, using CENTOR criteria and/or Strep-A test.35–37 Our finding of a mean Centor score <3 also among those who got a prescription indicates a substantial room for improvement of appropriate prescribing. Tonsillar exudate was a more common sign than tender cervical adenopathy. This pattern is inconsistent with the Centor criteria, which weigh all four components equally.35 Previous studies have likewise demonstrated that tonsillar exudate exerts a substantial influence on clinicians’ decisions to prescribe, despite the absence of symptoms or clinical signs that reliably differentiate bacterial from non-bacterial pharyngitis.38–40 There seems to be a widespread belief that tonsillar exudate is synonymous with bacterial infection, and this belief is likely to be reinforced during streptococcal epidemics among both physicians and patients. This important finding should be implemented in future educational programmes.

Antibiotic prescriptions were considered unnecessary when the infection was likely viral, the duration of symptoms was too short or symptom burden was minimal. There is clear potential for reduction, particularly in rhinosinusitis and otitis media, where antibiotics were prescribed after a few days of symptoms. However, the implemented intervention did not significantly influence prescribing practices for any of the infections included. The reason for this limited effect is likely multifactorial and it is unclear to what extent the COVID-19 pandemic contributed. Earlier studies have shown that many factors affect prescribing habits, including diagnostic uncertainty, pressure from patients, habits, limited time in busy OOH settings, high workload and the national and workplace culture.3,37,38,41 Relatively few multinational intervention studies in primary care focus on antibiotic use, and even fewer have been conducted in out-of-hours primary care settings. Researchers from both low-prescribing countries and the countries in which the study was implemented designed the present study. One potential limitation is that the intervention design may not have been fully aligned with local cultural and organizational contexts, which could partly explain why the observed effect was smaller than anticipated.

At the same time, the same intervention, implemented concurrently in general practice settings, demonstrated a greater effect.22 We, therefore, hypothesize that part of the explanation lies in the more heterogeneous composition of physicians working in out-of-hours care, also shown in other studies.42,43 This workforce includes GPs, hospital physicians and less experienced junior doctors. Furthermore, the frequent staff rotation and the limited number of permanently employed physicians make it challenging to establish consistent educational initiatives and a shared prescribing culture. Consequently, prescribing practices in out-of-hours care are likely influenced primarily by attitudes and habits acquired in physicians’ regular workplace settings.

Changing prescribing culture is also a gradual process.44,45 Such changes require sustained efforts over time, targeting not only physicians and healthcare professionals but also the general population. We therefore believe that studies such as ours contribute to a long-term shift in prescribing culture, although measurable effects may take time to emerge. Moreover, improvements achieved in general practice may subsequently influence prescribing behaviour in out-of-hours care, thereby facilitating gradual changes in that setting as well. Future studies should therefore continue to adopt broad, multifaceted intervention strategies while also striving to align more closely with local cultural and organizational contexts.

Conclusions

The multifaceted intervention did not reduce overall antibiotic use for RTI but was associated with a statistically significant increase in first-line antibiotic use for cystitis. The proportion of potentially unnecessary antibiotic prescriptions remained high, indicating considerable scope for improvement. Future interventions should place greater emphasis on more clearly delineating clinical scenarios in which infections can be safely and appropriately managed without antibiotics.

Supplementary Material

dlag219_Supplementary_Data

Acknowledgements

We wish to acknowledge the 67 healthcare professionals who voluntarily participated in the study.

Contributor Information

Ingrid Keilegavlen Rebnord, Department of Global Public Health and Primary Care, University of Bergen, Bergen, Norway; NORCE Norwegian Research Centre AS, Bergen, Norway.

Carl Llor, University Institute in Primary Care Research Jordi Gol, Barcelona, Spain; CIBER de Enfermedades Infecciosas, Instituto de Salud Carlos III, Madrid, Spain; Department of Public Health, Research Unit for General Practice, University of Southern Denmark, Odense, Denmark.

Fabiana Raynal Floriano, Quantitative Methods for Economics and Management, University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain.

Malene Plejdrup Hansen, Department of Public Health, Research Unit for General Practice, University of Southern Denmark, Odense, Denmark; Center for General Practice at Aalborg University, Aalborg, Denmark.

Jesper Lykkegaard, Department of Public Health, Research Unit for General Practice, University of Southern Denmark, Odense, Denmark.

Jonas Olsen, Department of Public Health, Research Unit for General Practice, University of Southern Denmark, Odense, Denmark.

Pia Touboul-Lundgren, Department of Public Health, Nice University Hospital, Nice, France.

Pascale Bruno, Department of Public Health, Nice University Hospital, Nice, France.

Anna Kowalczyk, Centre for Family and Community Medicine, Faculty of Health Sciences, Medical University of Lodz, Lodz, Poland.

Christos Lionis, Clinic of Social and Family Medicine, School of Medicine, University of Crete, Heraklion, Greece; Department of Psychology, School of Social Sciences and Humanities, University of Limassol, Limassol, Cyprus.

Ruta Radzeviciene, Ltd Mano Seimos Gydytojas (My Family Doctor), Klapeida, Lithuania.

Lina Jaruseviciene, Department of Family Medicine, Lithuanian University of Health Sciences, Kaunas, Lithuania.

Lars Bjerrum, Section of General Practice, Department of Public Health, University of Copenhagen, Copenhagen, Denmark.

Ana Garcia-Sangenis, University Institute in Primary Care Research Jordi Gol, Barcelona, Spain.

Bent Håkan Lindberg, NORCE Norwegian Research Centre AS, Bergen, Norway; Department of General Practice, Institute of Health and Society, University of Oslo, Oslo, Norway.

Funding

This project was co-funded by the European Commision (3rd EU Health Programme) (2014–20), grant number 900024. The content of this manuscript represents the views of the authors only and is their sole responsibility; it cannot be considered to reflect the views of the European Commission and/or the Health and Digital Executive Agency (HaDEA), replacing the former CHAFEA since 1 April 2021 or any other body of the European Union. The European Commission and the Agency do not accept any responsibility for the use that may be made of the information it contains.

Transparency declarations

None to declare.

Supplementary data

Figures S1 and S2 and Tables S1, S4, S7 and S8 are available as Supplementary data at JAC-AMR Online.

References

  • 1. Goossens  H, Ferech  M, Vander Stichele  R  et al.  Outpatient antibiotic use in Europe and association with resistance: a cross-national database study. Lancet  2005; 365: 579–87. 10.1016/S0140-6736(05)17907-0 [DOI] [PubMed] [Google Scholar]
  • 2. WHO report on surveillance of antibiotic consumption: 2016-2018 early implementation. World Health Organization, 2018. Licence: CC BY-NC-SA 3.0 IGO.
  • 3. Kasse  GE, Humphries  J, Cosh  SM  et al.  Factors contributing to the variation in antibiotic prescribing among primary health care physicians: a systematic review. BMC Prim Care  2024; 25: 8. 10.1186/s12875-023-02223-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Tonkin-Crine  SKG, Tan  PS, van Hecke  O  et al.  Clinician-targeted interventions to influence antibiotic prescribing behaviour for acute respiratory infections in primary care: an overview of systematic reviews. Cochrane Database Syst Rev  2017; 9: CD012252. 10.1002/14651858.CD012252.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Cross  ELA, Tolfree  R, Kipping  R. Systematic review of public-targeted communication interventions to improve antibiotic use. J Antimicrob Chemother  2017; 72: 975–87. 10.1093/jac/dkw520 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Berchet  C, Nader  C. The organisation of out-of-hours primary care in OECD countries. OECD Health Working Papers. Vol. 89. OECD Publishing, 2016.
  • 7. Steeman  L, Uijen  M, Plat  E  et al.  Out-of-hours primary care in 26 European countries: an overview of organisational models. Fam Pract  2020; 37: 744–50. 10.1093/fampra/cmaa064 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Huibers  LAMJ, Moth  G, Bondevik  GT  et al.  Diagnostic scope in out-of-hours primary care services in eight European countries: an observational study. BMC Fam Pract  2011; 12: 30. 10.1186/1471-2296-12-30 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Spurling  GK, Del Mar  CB, Dooley  L  et al.  Delayed antibiotic prescriptions for respiratory infections. Cochrane Database Syst Rev  2017; 9: CD004417. 10.1002/14651858.CD004417.pub5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. European Centre for Disease Prevention and Control . Proposals for EU Guidelines on the Prudent use of Antimicrobials in Humans. ECDC, 2017. https://www.ecdc.europa.eu/sites/default/files/media/en/publications/Publications/EU-guidelines-prudent-use-antimicrobials.pdf [Google Scholar]
  • 11. Colliers  A, Adriaenssens  N, Anthierens  S  et al.  Antibiotic prescribing quality in out-of-hours primary care and critical appraisal of disease-specific quality indicators. Antibiotics  2019; 8: 79. 10.3390/antibiotics8020079 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Colliers  A, Coenen  S, Bombeke  K  et al.  Understanding general practitioners’ antibiotic prescribing decisions in out-of-hours primary care: a video-elicitation interview study. Antibiotics  2020; 9: 115. 10.3390/antibiotics9030115 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Cronberg  O, Tyrstrup  M, Ekblom  K  et al.  Diagnosis-linked antibiotic prescribing in Swedish primary care—a comparison between in-hours and out-of-hours. BMC Infect Dis  2020; 20: 616. 10.1186/s12879-020-05334-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Lindberg  BH, Gjelstad  S, Foshaug  M  et al.  Antibiotic prescribing for acute respiratory tract infections in Norwegian primary care out-of-hours service. Scand J Prim Health Care  2017; 35: 178–85. 10.1080/02813432.2017.1333301 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Lum  EPM, Page  K, Whitty  JA  et al.  Antibiotic prescribing in primary healthcare: dominant factors and trade-offs in decision-making. Infect Dis Health  2018; 23: 74–86. 10.1016/j.idh.2017.12.002 [DOI] [PubMed] [Google Scholar]
  • 16. Rose  J, Crosbie  M, Stewart  A. A qualitative literature review exploring the drivers influencing antibiotic over-prescribing by GPs in primary care and recommendations to reduce unnecessary prescribing. Perspect Public Health  2021; 141: 19–27. 10.1177/1757913919879183 [DOI] [PubMed] [Google Scholar]
  • 17. Munck  A, Damsgaard  J, Hansen  D  et al.  The Nordic method for quality improvement in general practice. Qual Prim Care  2003; 11: 73–8. Available from: https://pure.au.dk/ portal/en/publications/the-nordic-method-for-quality-improvement-in-general-practice/. [Google Scholar]
  • 18. Hansen  MP, Lykkegaard  J, Søndergaard  J  et al.  How to improve practice by means of the Audit Project Odense method. Br J Gen Pract  2022; 72: 235–6. 10.3399/bjgp22X719417 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Bjerrum  L, Munck  A, Gahrn-Hansen  B  et al.  Health alliance for prudent antibiotic prescribing in patients with respiratory tract infections (HAPPY AUDIT) -impact of a non-randomised multifaceted intervention programme. BMC Fam Pract  2011; 12: 52. 10.1186/1471-2296-12-52 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Llor  C, Cots  JM, López-Valcárcel  BG  et al.  Interventions to reduce antibiotic prescription for lower respiratory tract infections: Happy Audit study. Eur Respir J  2012; 40: 436–41. 10.1183/09031936.00093211 [DOI] [PubMed] [Google Scholar]
  • 21. Bjerrum  L, Munck  A, Gahrn-Hansen  B  et al.  Health alliance for prudent prescribing, yield and use of antimicrobial drugs in the treatment of respiratory tract infections (HAPPY AUDIT). BMC Fam Pract  2010; 11: 29. 10.1186/1471-2296-11-29 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Garcia-Sangenis  A, Lykkegaard  J, Hansen  MP  et al.  Impact of a multifaceted intervention programme on antibiotic prescribing and dispensing in four patient-centred settings in five European countries. The HAPPY PATIENT project. Fam Pract  2025; 42: cmae064. 10.1093/fampra/cmae064 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Bjerrum  A, Garcia-Sangenis  A, Modena  D  et al.  Health alliance for prudent prescribing and yield of antibiotics in a patient-centred perspective (HAPPY PATIENT): a before-and-after intervention and implementation study protocol. BMC Prim Care  2022; 23: 102. 10.1186/s12875-022-01710-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Chalkidou  A, Lambert  M, Cordoba  G  et al.  Misconceptions and knowledge gaps on antibiotic use and resistance in four healthcare settings and five European countries—a modified Delphi study. Antibiotics  2023; 12: 1435. 10.3390/antibiotics12091435 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Baker  R, Robertson  N, Farooqi  A. Audit in general practice: factors influencing participation. BMJ  1995; 311: 31–4. 10.1136/bmj.311.6996.31 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Advani  SD, Claeys  K. Behavioral strategies in diagnostic stewardship. Infect Dis Clin North Am  2023; 37: 729–47. 10.1016/j.idc.2023.06.004 [DOI] [PubMed] [Google Scholar]
  • 27. Vieira  A, Wan  Y, Ryan  Y  et al.  Rapid expansion and international spread of M1UK in the post-pandemic UK upsurge of Streptococcus pyogenes. Nat Commun  2024; 15: 3916. 10.1038/s41467-024-47929-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. WHO COVID-19 CASES dashboard . WHO Health Emergencies Programme. https://data.who.int/dashboards/covid19/cases
  • 29. Hayward  GN, Fisher  RFR, Spence  GT  et al.  Increase in antibiotic prescriptions in out-of-hours primary care in contrast to in-hours primary care prescriptions: service evaluation in a population of 600 000 patients. J Antimicrob Chemother  2016; 71: 2612–9. 10.1093/jac/dkw189 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Debets  VE, Verheij  TJ, van der Velden  AW  et al.  Antibiotic prescribing during office hours and out-of-hours: a comparison of quality and quantity in primary care in The Netherlands. Br J Gen Pract  2017; 67: e178–86. 10.3399/bjgp17X689641 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Vellinga  A, Luke-Currier  A, Garzon-Orjuela  N  et al.  Disease-specific quality indicators for outpatient antibiotic prescribing for respiratory infections (ESAC quality indicators) applied to point prevalence audit surveys in general practices in 13 European countries. Antibiotics  2023; 12: 572. 10.3390/antibiotics12030572 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. van der Velden  AW, van de Pol  AC, Bongard  E  et al.  Point-of-care testing, antibiotic prescribing, and prescribing confidence for respiratory tract infections in primary care: a prospective audit in 18 European countries. BJGP Open  2022; 6: BJGPO.2021.0212. 10.3399/BJGPO.2021.0212 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Ciaccio  L, Donnan  PT, Parcell  BJ  et al.  Community antibiotic prescribing in patients with COVID-19 across three pandemic waves: a population-based study in Scotland, UK. BMJ Open  2024; 14: e081930. 10.1136/bmjopen-2023-081930 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Jorgensen  SCJ, Brown  K, Clarke  AE  et al.  The effect of COVID-19 vaccination on outpatient antibiotic prescribing in older adults: a self-controlled risk-interval study. Clin Infect Dis  2024; 79: 375–81. 10.1093/cid/ciae182 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Centor  RM, Witherspoon  JM, Dalton  HP  et al.  The diagnosis of strep throat in adults in the emergency room. Med Decis Making  1981; 1: 239–46. 10.1177/0272989X8100100304 [DOI] [PubMed] [Google Scholar]
  • 36. Thai  TN, Dale  AP, Ebell  MH. Signs and symptoms of group A versus non-group A strep throat: a meta-analysis. Fam Pract  2018; 35: 231–8. 10.1093/fampra/cmx072 [DOI] [PubMed] [Google Scholar]
  • 37. Cohen  JF, Cohen  R, Bidet  P  et al.  Efficiency of a clinical prediction model for selective rapid testing in children with pharyngitis: a prospective, multicenter study. PLoS One  2017; 12: e0172871. 10.1371/journal.pone.0172871 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Domen  J, Aabenhus  R, Balan  A  et al.  The effect of a GP's perception of a patient request for antibiotics on antibiotic prescribing for respiratory tract infections: secondary analysis of a point-prevalence audit survey in 18 European countries. BJGP Open  2025; 9: BJGPO.2024.0166. 10.3399/BJGPO.2024.0166 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Freer  J, Ally  T, Brugha  R. Impact of centor scores on determining antibiotic prescribing in children. Int J Health Care Qual Assur  2017; 30: 319–26. 10.1108/IJHCQA-08-2016-0114 [DOI] [PubMed] [Google Scholar]
  • 40. Sijbom  M, Buchner  FL, Saadah  NH  et al.  Determinants of inappropriate antibiotic prescription in primary care in developed countries with general practitioners as gatekeepers: a systematic review and construction of a framework. BMJ Open  2023; 13: e065006. 10.1136/bmjopen-2022-065006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Cronberg  O, Tyrstrup  M, Ekblom  K  et al.  Factors influencing antibiotic prescribing for respiratory tract infections in primary care—a comparison of physicians with different antibiotic prescribing rates. Scand J Prim Health Care  2024; 42: 424–34. 10.1080/02813432.2024.2332757 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42. Suttels  V, Van Singer  M, Clack  LC  et al.  Factors influencing the implementation of antimicrobial stewardship in primary care: a narrative review. Antibiotics  2023; 12: 30. 10.3390/antibiotics12010030 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Zay Ya  K, Win  PTN, Bielicki  J  et al.  Association between antimicrobial stewardship programs and antibiotic use globally: a systematic review and meta-analysis. JAMA Netw Open  2023; 6: e2253806. 10.1001/jamanetworkopen.2022.53806 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Soler Wenglein  J, Bornemann  R, Hartmann  J  et al.  Changing antibiotic prescribing cultures: a comprehensive review of social factors in outpatient antimicrobial stewardship and lessons learned from the local initiative AnTiB. Antibiotics  2025; 14: 1068. 10.3390/antibiotics14111068 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Borek  AJ, Wanat  M, Atkins  L  et al.  Optimising antimicrobial stewardship interventions in English primary care: a behavioural analysis of qualitative and intervention studies. BMJ Open  2020; 10: e039284. 10.1136/bmjopen-2020-039284 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

dlag219_Supplementary_Data

Articles from JAC-Antimicrobial Resistance are provided here courtesy of British Society for Antimicrobial Chemotherapy and Oxford University Press

RESOURCES