Skip to main content
MDM Policy & Practice logoLink to MDM Policy & Practice
. 2023 Feb 4;8(1):23814683231152885. doi: 10.1177/23814683231152885

Developing a Modeling Framework for Quantifying the Health and Cost Implications of Antibiotic Resistance for Surgical Procedures

Heather Davies 1,, Joel Russell 2, Angel Varghese 3, Hayden Holmes 4, Marta O Soares 5, B Woods 6, Ruth Puig-Peiro 7, Stephanie Evans 8, Rory Tierney 9, Stuart Mealing 10, Mark Sculpher 11, Julie V Robotham 12
PMCID: PMC9900655  PMID: 36755742

Abstract

Background. Antimicrobial resistance (AMR) is a global public health threat. The wider implications of AMR, such as the impact of antibiotic resistance (ABR) on surgical procedures, are yet to be quantified. The objective of this study was to produce a conceptual modeling framework to provide a basis for estimating the current and potential future consequences of ABR for surgical procedures in England. Design. A framework was developed using literature-based evidence and structured expert elicitation. This was applied to populations undergoing emergency repair of the neck of the femur and elective colorectal resection surgery. Results. The framework captures the implications of increasing ABR by allowing for higher rates of surgical site infection (SSI) as the effectiveness of antibiotic prophylaxis wanes and worsened outcomes following SSIs to reflect reduced antibiotic treatment effectiveness. The expert elicitation highlights the uncertainty in quantifying the impact of ABR, reflected in the results. A hypothetical SSI rate increase of 14% in a person undergoing emergency repair of the femur could increase costs by 39% (−2% to 108% credible interval [CI]) and decrease quality-adjusted life-years by 11% (0.4% to 62% CI) over 15 y. Conclusions. The modeling framework is a starting point for addressing the implication of ABR on the outcomes and costs of surgeries. Due to clinical uncertainty highlighted in the expert elicitation process, the numerical outputs of the case studies should not be focused on but rather the framework itself, illustration of the evidence gaps, the benefit of expert elicitation in quantifying parameters with limited data, and the potential magnitude of the impact of ABR on surgical procedures. Implications. The framework can be used to support research surrounding the health and cost burden of ABR in England.

Highlights

  • The modeling framework is a starting point for assessing the health and cost impacts of antibiotic resistance on surgeries in England.

  • Formulating a framework and synthesizing evidence to parameterize data gaps provides targets for future research.

  • Once data gaps are addressed, this modeling framework can be used to feed into overall estimates of the health and cost burden of antibiotic resistance and evaluate control policies.

Keywords: antibiotic resistance, modelling framework, Surgical site infection, expert elicitation


Antimicrobial resistance (AMR), the ability of microbes to survive treatment with antimicrobial agents, is recognized as one of the top 10 global public health threats by the World Health Organization.1 With an estimated 4.95 million global deaths associated with bacterial AMR alone in 2019, AMR poses a large health burden and we may benefit from policies to mitigate the emergence and spread of resistant organisms.2 Worldwide, it is estimated that up to 100 trillion USD of economic output could be lost by 2050 if AMR continues to rise.3 To address these challenges, the UK government has set aims around reducing both resistant infections and antibiotic use.4,5

Antibiotic resistance (ABR) is a subset of AMR: the resistance of bacteria to antibiotics. Antibiotic-resistant bacteria can be found in multiple environments and continue to evolve.6 In the context of surgery, antibiotics are used preventatively (prophylaxis) or as treatments for patients who develop bacterial infections. One of the direct effects of ABR is the difficulty in treating infections caused by resistant bacteria. Indirectly, the emergence of ABR threatens the viability of medical and surgical interventions that have a high risk of infectious complications in the absence of effective prophylaxis. These challenges are exacerbated by the stagnation in the discovery of new antibiotics in recent decades, leading to fewer treatment options to manage antibiotic-resistant infections,7 as well as other complications due to ABR being infectious and thus having onward consequences for other patients, hospitals, and populations.

Surgical site infections (SSIs) are postoperative infections caused by the presence of bacteria in the surgical site during or after invasive surgeries.8 While the risk and severity of an SSI are influenced by a variety of factors,9,10 ABR acts through 2 mechanisms:

  1. it reduces the effectiveness of prophylactic antibiotics, increasing the occurrence of SSIs

  2. it reduces the effectiveness of empirical and targeted antibiotics, leading to unresolved and more serious SSIs9,10 and thus worse health outcomes.

Ultimately, rising ABR may lead to restrictions in current routine surgical procedures.11 SSIs that are adequately treated with antibiotics alone today may need adjunctive invasive treatment if caused by resistant bacteria in the future. Other infections may be refractory to treatment, causing long-term morbidity or death from sepsis.12

Despite the potential costs of ABR on surgical procedures, the cost and health impacts of this are, to date, largely unknown. There is a lack of empirical data to suitably estimate the magnitude of these impacts and a lack of studies that have collected relevant outcomes.13 To develop appropriate policies to efficiently tackle the threat of ABR on surgical procedures, the potential costs and health impacts need to be better understood.

The main objective is to produce an economic modeling framework that could be used to enable the estimation of the cost and health burden of ABR on surgical procedures through the 2 mechanisms explained above. We demonstrate the utility of this framework on specific surgical procedures as a proof of concept. The framework focuses on the average impact at a cohort level from a National Health Service (NHS) perspective. Any onward consequences from increased resistance, changes in transmission risks, and subsequent population effects are not captured within the framework. However, exploring the simplified impact is a key prerequisite for further research on the wider impact of ABR and the evaluation of policies targeted to reduce ABR infections. While the framework can be used to provide quantitative estimates of the impact of ABR, the numerical outputs have an illustrative purpose only, with the focus being on the framework itself.

Methods

We constructed an economic modeling framework to assess the aggregate impact of increasing ABR rates on surgical procedures for a simulated cohort. We developed a model structure that could address the following: 1) the implications of ABR on the effectiveness of both prophylaxis (to avoid SSIs) and treatment of SSIs when they occur and 2) the likely short- and long-term implications of ABR for health and cost outcomes for a wide range of surgeries.

The development of the framework had 3 key components:

  1. In consultation with experts on ABR and SSIs, we developed a conceptual map to quantify the impact of rising ABR on surgical procedures (see Supplementary Material A).

  2. By using the available empirical evidence identified while developing the conceptual map and assessing the quality and applicability of these data, we developed a model structure reflecting the prophylactic and infection treatment care pathway, making simplifying assumptions where necessary (Figure 1).

  3. We applied the final framework to 2 case studies (emergency fractured neck of femur procedure and elective colorectal resection due to cancer), which formed the development of 2 economic models. The procedures were chosen after conducting a targeted literature review and a discussion with experts on ABR and SSIs to identify 2 surgical procedures where increasing rates of ABR could have a large detrimental impact on population health and NHS costs. However, the framework was developed for it to be applied to any procedure providing data are available. We developed a formal approach to elicit judgments from clinical experts to support the estimation of model parameters for which available evidence was absent, sparse, or of limited relevance to the context of interest.

Figure 1.

Figure 1

Conceptual framework structure. SSI, surgical site infection. *Thirty-day postoperative mortality. **Surgical site infection treated with antibiotics alone or a salvage procedure with antibiotics. ***Length of time horizon varies with case study (15-y emergency repair of neck of femur and 30-y for elective colorectal resection). One-year cycle length. Dotted line = the split between the decision tree and the Markov structure. SSIs include both deep and superficial infections. People can die immediately after the procedure from postoperative mortality and, following that, as a consequence of SSI or background mortality if no SSI.

Developing the Modeling Framework

Treatment Pathway

The modeling framework was based on the treatment pathway for SSIs. Treatment is dependent on whether the infection is superficial (at the incision) or deep (below the incision; see Supplementary Material B for full definitions):

  • If a superficial infection is suspected, or if a deep infection is misidentified as a superficial infection, patients are treated with antibiotics and drainage alone. Patients then require 1 or more salvage procedures (defined as surgical procedures to cut away infection) if the antibiotics do not work or if a deep infection is suspected.

  • If a deep infection is suspected patients are simultaneously treated with antibiotics and 1 or more salvage procedures.

If the antibiotic treatment and/or salvage procedure do not resolve the SSI, then the patient eventually exhausts pharmacologic and surgical treatment options and would have a chronic infection and/or die.

Model Structure

The modeling framework (Figure 1) consists of 2 parts:

  • An initial 90-d decision tree (left side of Figure 1), which determines the number of individuals who have no SSI, a resolved SSI (with no salvage procedure), a resolved SSI (with a salvage procedure), or a chronic infection. This starts with an index procedure, from which patients who survive the procedure either contract an SSI or do not. The SSI rate is partly influenced by the prophylactic antibiotic efficacy.

  • This is followed by a Markov model (right side of Figure 1), capturing the lifetime consequences based on outcomes at 90 d (no SSI or with resolved/unresolved SSI).

People who are alive after the 90-d decision tree move into the Markov model. The Markov model captures 5 health states that are associated with different clinical management following the index surgery, long-term morbidity, and potential mortality:

  • (1) Patients who do not contract an SSI following the index surgery are assumed to be alive without SSI-related complications for the remainder of their lifetime.

  • People who do contract an SSI either have a resolved or unresolved infection after the 90 d following the index surgery.
    • Infections may be resolved either from antibiotics alone (2) or after a salvage procedure (3). Different health-related quality of life (HRQoL) scores are applied depending on how the infection is resolved (salvage procedures may have lasting effects that are associated with long-term HRQoL decrements).
    • (4) If unresolved, a person is assumed to be chronically infected for the remaining duration of life.
  • (5) Finally, all people in all health states face a risk of death in the model.

The model simultaneously captures the implications of ABR by allowing for higher rates of SSIs as the effectiveness of antibiotic prophylaxis wanes and by allowing for worsened outcomes following SSIs to reflect reduced antibiotic treatment effectiveness.

A multidisciplinary steering group chosen on the basis of their expertise in the topic of ABR and/or surgery (clinicians, microbiologists, hospital pharmacists, mathematical modelers, epidemiologists, and health economists, among others) validated both stages of the economic model. The focus of the validation was to ensure that the impact of rising ABR rates would be captured in the model structure, especially under worst-case scenario conditions.

Use of Structured Expert Elicitation

To model ABR, we need to predict both how ABR rates may change in the future and how this might influence the effectiveness of antibiotic prophylaxis and treatment. However, there is a lack of empirical evidence to inform these, complicated further by multiple treatment lines and heterogeneity in antibiotics used. To address these uncertainties, we developed a formal approach to elicit judgments from clinical experts on the implications of ABR for SSI risk and SSI outcomes.

To inform model parameters included in the framework, we elicited expert opinions using a structured process to reduce the potential for bias.14 We also captured the uncertainty associated with the estimated values to parameterize the uncertainty within the economic model. As the elicited estimates related to clinical practice and treatment outcomes, we targeted orthopedic and colorectal consultants and surgeons for this exercise.

Clinical experts were asked for their estimates of:

  1. current and future (in 10 y) SSI rates resulting from prophylactic antibiotic failure, and

  2. current and future (in 10 y) 90-d outcomes resulting from SSIs (mortality, chronic infection rates, and the use or not of salvage surgeries), and

  3. how i) and ii) might change due to rising levels of ABR.

These estimates were provided assuming all else remained equal (e.g., no new antibiotics, procedures, or protocols). The elicitation is not designed to be a forecast or a prediction but a hypothetical scenario of what could happen in approximately 10 y absent any change in practice. Further details of the methods of the elicitation process can be found in Supplementary Material C.

Equivalent Loss in Health Care Expenditure

To measure the impact of ABR, we developed the concept of the equivalent loss in health care expenditure (ELHE). The ELHE is a variation of the net monetary benefit concept15 and estimates both health care costs or savings and the monetary equivalent of net health lost or gained based on an assumed opportunity cost of £20,000 per quality-adjusted life-year (QALY; representing the opportunity cost to the NHS) plus any additional costs.16

We considered the ELHE to be more appropriate than the net monetary benefit or loss, as we are estimating the loss in expenditure that would be equivalent to both the loss in health and the increase in costs to the NHS. This means that, all else being equal, the decision maker would be willing to pay up to the ELHE for intervention(s), or policies, that can avoid this scenario. Different policies or interventions were not being compared in this analysis, and so incremental cost-effectiveness ratios were not calculated.

In a real-world context, the ELHE would indicate the estimated limit the NHS could spend on an intervention aimed at reducing the risk of ABR, based on a £20,000 per QALY opportunity cost. See Supplementary Material D for a worked example.

Applying the Modeling Framework

We applied the modeling framework to 2 surgical case study examples. These were emergency repair of neck of femur surgery (neck of femur) and elective colorectal resection surgery due to cancer, representing distinct populations and surgery types (old v. young, emergency v. elective surgeries). The procedures were selected based on a targeted review of the literature and clinical opinion from the Steering Group, who thought that increasing ABR in these 2 procedures would have a particularly detrimental impact on population health and NHS costs. For simplicity, only the neck of femur case study is presented here to provide an example of applying the framework itself. See the Supplementary Material for further details on colorectal resection case study.

The model takes the perspective of the English NHS and includes a hypothetical cohort with a starting age of 84 y, representing the average age of a person undergoing a neck of femur procedure.17 Short-term outcomes (contracting an SSI, antibiotic treatment, salvage procedures, SSI-related mortality) are assumed to occur within 90 d (decision tree component). A lifetime horizon of 15 y is applied because this is assumed to be the maximum life expectancy for this population. The cycle length of the Markov model is 1 y, deemed sufficient due to people staying in the same health state until death. We apply discount rates of 3.5% and 1.5% to costs and QALYs, respectively, to align with the Green Book recommendations (typically used in public health models).18

Evidence Used to Inform the Model

The structured elicitation process was used to derive the SSI rates and 90-d outcomes. These were compared with the estimated outcomes of SSIs (caused by ABR) currently (Table 1).

Table 1.

Expert Elicitation Outputs (Mean with 80% Credible Interval Where Available)

Increased ABR-Related SSI Scenario Emergency Repair of Neck of Femur
Current Hypothetical Scenario
SSI rate, % 5.7 (1–13) 20.1a
90-d outcomes
Proportion who survive an SSI but have an unresolved infection (chronic infection), % 35 (8–65) 45 (14–76)
Proportion with a resolved infection who had a salvage procedure, % 52 (2–99) 52 (2–99)
Proportion with an unresolved infection who had a salvage procedure, % 44 (9–82) 47 (10–86)
SSI-related mortality (having survived index surgery), % 37 (20–56) 54 (34–72)
Absolute difference in mortality between those who experience an SSI and those who do not, % 12.5 (12–39) 12.5 (12–39)

ABR, antibiotic resistance; SSI, surgical site infection.

a

Calculated by adding the increase in SSI elicited (14.4%) to the current SSI rate. The 80% credible interval estimated for the increase in SSI rate from the current parameter was 0% to 37% for the emergency neck of femur procedure. Confidence intervals were elicited from each expert during the expert elicitation process. We then fit a beta distribution to represent uncertainty across the experts.

We conducted a targeted review of the literature for costs and resource use, effectiveness data, mortality, and HRQoL values. See Table 2 for details on the key inputs used, with further details in Supplementary Material E and F.

Table 2.

Other Key Case Study Inputs for Emergency Repair of Neck of Femura

Length of Stay Data Source
No infection, d 10 19
Infection treated with antibiotics, d 29
Infection treated with salvage procedure, d 39
Utility decrements
 SSI decrement 0.08 20
 Neck of femur repair 90-d decrement 0.10 21
 Salvage procedure 90-d decrementb 0.03 22
 Salvage procedure annual decrementb 0.13
 Chronic infection annual decrement 0.33 23
Key costs
 Index procedure cost £8,851 24
 Salvage procedure cost £10,600
 SSI unit cost £13,096 19
 Chronic infection annual cost £13,686 25
Mortality
 Proportion of people who died as a direct result of index surgery 6.1% 26

SSI, surgical site infection

a

The cost of hospital stay was not applied to length of stay, as this is expected to be captured in the cost of an SSI applied in the model. Length of stay is included only to calculate differences in hospital stay as a consequence of different health outcomes following surgery.

b

A Girdlestone procedure was the salvage procedure used in the neck of femur case study.

Main Model Outcomes

The main model outcomes are incremental costs, incremental QALYs, and ELHE.

We used the £20,000 threshold instead of the £60,000 per QALY threshold seen in the Green Book (often used in public health models) as all the costs and benefits measured in the model accrue in the health system and not widely across other sectors.

Description of Sensitivity Analysis

Univariate and Probabilistic Sensitivity Analysis:

We conducted univariate deterministic sensitivity analysis in the form of a tornado plot. The parameters of the expert elicitation outputs were varied between the upper and lower values of the 80% credible intervals from the expert elicitation process (see Supplementary Material G and Table 1), with a cap introduced to avoid increased ABR scenarios resulting in counterintuitive outcomes (e.g., increased ABR leading to lower chronic infection rates or lower mortality). Where upper and lower parameter values could not be sourced, they were assumed to be ±25% of the base case.

A probabilistic sensitivity analysis was also conducted in which the model was run for 1,000 iterations to calculate average estimates. All inputs for the probabilistic sensitivity analysis and deterministic sensitivity analysis can be found in Supplementary Material H.

Further Sensitivity Analyses

We ran 2 further sensitivity analyses. In the first analysis, the inputs derived from the expert elicitation were changed to the lower or upper values of the 80% credible intervals (CIs) to represent optimistic (all lower CIs) and pessimistic (all higher CIs) scenarios. The CIs were used for the following current and hypothetical 10-y scenario parameters: the increase in SSI rate (10-y parameter only), chronic infection rates, and mortality (see Table 1 for the CIs). Furthermore, the inputs representing the current SSI rates caused by ABR were altered to reflect the SSI rates reported in the Public Health England (now UKHSA) SSI report (1%).27

Another sensitivity analysis using 3.5% discount rates for both costs and QALYs was also conducted.

Funding

Financial support for this study was provided entirely by Public Health England Funding from both the Health Economics Commissioning Framework, for undertaking the analysis, and the Statistics, Modelling and Economics Department for publication of this manuscript.

Case Study Results

Summary

The full results are presented in Supplementary Material I for both case studies. For the emergency repair of neck of femur procedure, using the scenario inputs presented in Table 1, total QALYs could decrease by 11% (reduction of 0.34 QALYs), and total costs could increase by 39% (from £11,000 to £15,000), per patient, over their remaining lifetime (assumed to be 15 y). These results come with high levels of uncertainty. The 95% CI for the incremental QALYs is −62% to −0.4%, and the 95% CI for the incremental costs is −2% to 108%. The −2% lower bound is explained by the population being elderly, saving costs due to an increase in SSI-related mortality (and so fewer have the chance to go on to have a chronic infection).

The reduction in QALYs reflects a higher proportion of people acquiring an SSI, with subsequent chronic infections or salvage procedures reducing long-term quality of life. The cost increases are also driven by a higher proportion of chronic infections along with the increase in SSI rate.

The monetary impact to the NHS of these projected changes could be an ELHE per person of £11,000 (CI £250 to £42,000). This represents the maximum the NHS could usefully spend on a new intervention per patient to reduce the risk of ABR. These losses are driven evenly by health losses and additional costs.

Univariate Sensitivity Analysis

The results of the univariate sensitivity analysis show that the SSI rate increase caused by ABR, the cohort age, the proportion of patients with a chronic infection, and the 90-d mortality risk are key drivers of the results (Figure 2). Cohort age is a key driver due to younger individuals accumulating increased costs and health losses by naturally living longer with the consequences of an SSI when compared with someone older.

Figure 2.

Figure 2

Key drivers of the case study results: univariate sensitivity analysis. ABR, antibiotic resistance; SSI, surgical site infection. All mortality risks are absolute. Parameters labeled “baseline” represent the currently estimated situation. Parameters labeled “scenario” represent a future hypothetical scenario.

Further Sensitivity Analyses

The optimistic and pessimistic analyses using the upper and lower credible estimates from the expert elicitation interview (Table 1) are shown in Figure 3. The upper and lower bars represent where the base case value would move if the upper and lower credible limits, estimated via the expert elicitation process, represented the average value for SSI rate increase and 90-d outcomes.

Figure 3.

Figure 3

Further sensitivity analysis—equivalent loss in health care expenditure (ELHE): optimistic and pessimistic analysis.

The ELHE ranged from approximately £31,000 (pessimistic) to £600 (optimistic) per person over 15 y in the neck of femur population. The wide range in results of this scenario analysis highlight the uncertainty the experts had faced when estimating SSI rate changes and outcomes.

Discussion

Brief Synopsis of Key Findings

This research presents a novel economic modeling framework that captures the impact of ABR on surgical procedures in terms of health outcomes and economic costs. We applied the framework to 2 case studies: emergency repair of neck of femur procedures and elective colorectal resection, using evidence from the literature and experts’ opinion. These case studies provide examples of how the framework can be applied to generate insights into the potential impacts of ABR for surgical procedures and what may be observed if no new practices to combat ABR are implemented through the scenarios conducted. There is substantial uncertainty associated with the numerical outputs of the case studies, but they are able to indicate the possible magnitude of the impact of increasing ABR levels.

Through the modeling framework, it was estimated that as the SSI rate increases due to ABR (affecting the antibiotic efficacy of both prophylaxis and treatment), total costs increase while the health benefits decrease for both case studies. In a real-world context, this could generate large economic and health losses. Simple estimates for neck of femur indicate that, per 10,000 people, over the patient’s assumed remaining lifetime (15 y), a 14% increase in SSI rate may lead to an ELHE (the loss in health care expenditure as defined previously) of approximately £111 million (CI £2.6 million to £418 million). Effectively, this suggests that the NHS could spend up to £111 million in new policies to avoid the health and cost losses per 10,000 people undergoing neck of femur procedures. With more than 70,000 hip fracture procedures conducted each year across England, Wales, and Northern Ireland,17 this could mean substantial increases in costs and health loss, although not all hip fracture procedures would relate to the neck of the femur. Similarly, for colorectal resection, per 10,000 people, over 30 y, a 12% increase in SSI rate is estimated to result in an ELHE of £134 million (CI 33 million to £299 million). These analyses highlight the large impact of increased SSI rates and the variability of impact between different surgeries.

Explanations for the Findings

The framework highlights the issues with both reduced prophylaxis and reduced treatment efficacies. In addition, it has been useful in identifying key parameters that impact the results, particularly those affecting both populations considered. The SSI rate increase, 90-d mortality with an SSI, and proportion with chronic infection at 90 d are the key drivers of the results in both case studies (see Figure 2). However, there are differences between the patient populations. Ninety-day outcomes, such as the proportion with chronic infection and SSI-related mortality, had a greater effect on the ELHE in the colorectal population than the neck of femur population. This was due to the colorectal population being less frail and having longer life expectancy, which in turn increased the long-term consequences from SSIs associated with ABR. Patients developing chronic infections faced the associated costs and quality-of-life impacts over a longer life expectancy. In addition, SSI-related mortality had a larger impact on colorectal patients, as these patients were younger with a lower associated rate of background mortality.

Although effectiveness of prophylaxis is a key concern across populations, treatment effectiveness against SSIs increases in importance in populations who are likely to live longer after surgery.

Comparing Results with Published Work

This work presents the first attempt to quantify the health and economic impacts of ABR, using 2 case studies, in England. Teillant et al.11 previously estimated the potential consequences of ABR on surgery in the United States but did not estimate the economic impacts nor study the impact of reduced antibiotic treatment effectiveness (only prophylaxis). In the study, the authors estimated that a 30% reduction in antibiotic prophylaxis efficacy could lead to more than 20,000 additional infections per year in colorectal surgery. They used scenarios of differing prophylactic antibiotic efficacy due to the absence of evidence of the correlation between ABR rates and SSIs. A benefit of the expert elicitation we conducted is that it helps fill these data gaps.

Key Considerations of the Study

The implication of ABR is captured in the framework by allowing for higher SSI rates and worsened outcomes following SSI. Wider consequences, such as altered clinical management (with subsequent downstream impact) and spread of resistance between individuals (both in the hospital and community), are not captured in this framework. However, this framework could potentially be used to facilitate further work to explore these outcomes.

Limitations of this study included the inability to estimate ABR rates for specific pathogens and drugs and link these to clinical outcomes and the assumption that there would be no changes in clinical practice. Evidence gaps were also apparent. These are described below.

Estimating ABR rates for specific pathogens and drugs

We could not estimate the impact of individual pathogen resistance to a specific antibiotic. If increases in pathogen resistance could be modeled, by considering surgery-specific pathogens and pathogen-specific resistance rates, this would allow a more accurate estimation of current ABR and potentially ABR trends over time. However, this remains a challenging exercise due to geographical variation in pathogen resistance rates across England and the associated variation in choice of antibiotic prophylaxis and treatment across England. It is also difficult to find an appropriate method to link the direct effect of ABR on SSI rates and outcomes.

No changes in clinical practice

We assumed that there would be no changes in clinical practice as ABR increased, which could lead to an overestimation of the impact of ABR on surgeries. This was done to enable us to model the causal impact of ABR on surgical procedures. However, this may not be the case, with decision varying by surgical area.

Clinical opinion deemed that emergency repair of neck of femur procedures would go ahead regardless of a rise in ABR, primarily due to the high mortality risk in this population if left untreated. For colorectal resection, one clinical expert outlined potentially changing practices. Reduction in antibiotic efficacy could lead to alternatives being used so that surgery can proceed, such as using irrigation devices (as in orthopedic surgery) to wash out pathogens in a colorectal setting28 or using bacteriophages.29,30 Alternatively, ABR may lead to certain procedures being forgone to avoid the development of SSIs and potentially untreatable infections.

A recent study by Naylor et al.31 highlighted how existing data on AMR’s health impacts in England could be combined with expert elicitation to explore how AMR could affect treatment pathways for individuals requiring surgery. The modeling framework developed here is intended to be a building block to support future evaluations of the cost-effectiveness of alternative policies to reduce the impact of ABR on surgeries. It could also support research in estimating the point at which forgoing surgery may be considered, by estimating the health and cost impact of 2 different pathways, capturing the continuation of standard practice with the given SSI rate compared with the consequences of providing nonsurgical management.

Evidence gaps

A 2019 literature review of studies evaluating the economic burden of SSIs due to AMR, conducted across countries, highlighted various methodological gaps.32 These include gaps in epidemiological data, inconsistency in SSI definitions and differences in SSI surveillance across locations. Overall, the authors recommended choosing appropriate methodologies for both surveillance and quantifying the burden of SSI. We came across similar issues when designing and conducting our study. As this is a modeling framework, there is scope for further development should data to inform the evidence gaps become available. The main evidence gaps are described below.

  1. Empirical and targeted treatment success rates could not be accurately estimated due to evidence gaps in pathogen-antibiotic combination data separated by line of treatment and data linking the line-specific effectiveness to patient outcomes. To overcome this, we evaluated an overall 90-d success rate of SSI treatment (combining both empirical and targeted treatment). This single value embodied the range of ways in which patients could be treated (including single or multiple lines of antibiotics, with or without salvage procedures). However, the 90-d outcomes were largely informed by the expert elicitation. The elicitation results highlighted the large uncertainty clinical experts have with regard to quantifying the impact of ABR on surgical procedures and how these may change over time (as shown in Table 1 and Figure 3).

  2. Data on long-term chronic infection outcomes were literature based and limited to costs and morbidity impacts, since evidence on mortality was not identified. Where costs could be sourced, these were not always procedure specific (e.g., for chronic infection; Table 2).

Future research directions

Estimating the health and economic implications of ABR on surgical procedures is complex and largely underexplored. However, the patient costs and benefits are important to consider given the consequences if left unaddressed and could be an informative tool for clinicians, hospital managers, and policy makers (among many other stakeholders). In the future, it would be important to investigate the implications of wider effects of increasing ABR at the individual level, such as increased spread of infections in the hospital and community. This framework could be a useful tool in supporting further research that could help inform decision making to address ABR.

The robustness of the evidence base could be improved by designing long-term studies for those undergoing salvage procedures due to SSI and those who are untreatable (remain with chronic infection). This would allow a more accurate mapping of the full care pathway and would enable more granular estimates of the cost and consequences of ABR.

Conclusion

With improved data, the modeling framework could be applied to further case studies. This could help inform clinicians about the potential consequences of increasing ABR if no measures are put in place. Future modeling work could integrate emerging evidence into the framework and explore how estimates of the link between ABR and SSI burden can be incorporated into the overall estimates of ABR burden. As it stands, this framework can be used as a key starting point to evaluate interventions that reduce the threat of ABR for surgeries.

Supplemental Material

sj-docx-1-mpp-10.1177_23814683231152885 – Supplemental material for Developing a Modeling Framework for Quantifying the Health and Cost Implications of Antibiotic Resistance for Surgical Procedures

Supplemental material, sj-docx-1-mpp-10.1177_23814683231152885 for Developing a Modeling Framework for Quantifying the Health and Cost Implications of Antibiotic Resistance for Surgical Procedures by Heather Davies, Joel Russell, Angel Varghese, Hayden Holmes, Marta O. Soares, B. Woods, Ruth Puig-Peiro, Stephanie Evans, Rory Tierney, Stuart Mealing, Mark Sculpher and Julie V. Robotham in MDM Policy & Practice

Acknowledgments

We thank the following people who provided valuable input into the piece of work: Abtin Alvand, Nuffield Orthopaedic Centre, Oxford University Hospitals; Annalisa Belloni, World Health Organization and formally Public Health England (at the time the work was conducted); Antony Palmer, Nuffield Orthopaedic Centre, Oxford University Hospitals; Brian Ferguson, National Institute for Health Research; Charalambos P. Charalambous, Blackpool Teaching Hospitals NHS Foundation Trust and School of Medicine, University of Central Lancashire; David Dodwell, University of Oxford; David Jenkins, University Hospitals of Leicester NHS Trust; Koen Pouwels, University of Oxford; Lisa Pickering, Royal Marsden NHS Foundation Trust; Louise Dunsmure, Oxford University Hospitals; Michael Fleming, Department of Health and Social Care; Neil Hawkins, University of Glasgow; Alicia Demirjian, UK Health Security Agency; Farhan Alvi, Glan Clwyd Hospital, Bodelwyddan; Mirza Baig, Western Sussex Hospitals NHS Foundation Trust; Mohammad Mobasheri, Western Sussex Hospitals NHS Trust; Pavel Akimau, Worcestershire Acute Hospitals NHS Trust; Shaun Donaghy, Office for Health Improvement and Disparities; Syed Hassan, King’s College Hospital NHS Foundation; Theresa Lamagni, UK Health Security Agency; Catherine Bowe, York Health Economics Consortium (assisted in proofreading the manuscript following the draft). Any data or other study materials will be made available upon request to Stephanie Evans at Stephanie.Evans@ukhsa.gov.uk

Footnotes

The authors declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: YHEC was commissioned by Public Health England to create the economic framework and write the manuscript. UoY was subcontracted by YHEC for assistance with this work. Beth Woods sits on the Board of Directors for YHEC. There are no further conflicts of interest. The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Financial support for this study was provided entirely by Public Health England Funding from both the Health Economics Commissioning Framework, for undertaking the analysis, and the Statistics, Modelling and Economics Department for publication of this manuscript. The funding agreement ensured the authors’ independence in designing the study, interpreting the data, writing, and publishing the report. Almost all was conducted remotely except one meeting. Work leading up to this publication was presented at ISPOR 2020 (poster), International Health Economics Association (IHEA) 2021, European Health Economics Association (EuHEA) 2022 (oral presentation), and Spanish Health Economics Association 2022 (oral presentation).

Supplemental Material: Supplementary material for this article is available on the MDM Policy & Practice website at https://journals.sagepub.com/home/mpp.

Contributor Information

Heather Davies, York Health Economics Consortium Ltd (YHEC), York, North Yorkshire, UK.

Joel Russell, York Health Economics Consortium Ltd (YHEC), York, North Yorkshire, UK.

Angel Varghese, York Health Economics Consortium Ltd (YHEC), York, North Yorkshire, UK.

Hayden Holmes, York Health Economics Consortium Ltd (YHEC), York, North Yorkshire, UK.

Marta O. Soares, Centre for Health Economics, University of York, York. North Yorkshire, UK

B. Woods, Centre for Health Economics, University of York, York. North Yorkshire, UK

Ruth Puig-Peiro, Office for Health Improvement and Disparities, Department of Health and Social Care, UK.

Stephanie Evans, Modelling and Evaluations Unit, HCAI & AMR, UK Health Security Agency.

Rory Tierney, Office for Health Improvement and Disparities, Department of Health and Social Care, UK.

Stuart Mealing, York Health Economics Consortium Ltd (YHEC), York, North Yorkshire, UK.

Mark Sculpher, Centre for Health Economics, University of York, York. North Yorkshire, UK.

Julie V. Robotham, Modelling and Evaluations Unit, HCAI & AMR, UK Health Security Agency

References

  • 1. World Health Organization. Antimicrobial resistance. 2020. Available from: https://www.who.int/news-room/fact-sheets/detail/antimicrobial-resistance
  • 2. Antimicrobial Resistance Collaborators. Global burden of bacterial antimicrobial resistance in 2019: a systematic analysis. Lancet. 2022;399(10325):629–55. DOI: 10.1016/S0140-6736(21)02724-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. O’Neill J. Antimicrobial Resistance: Tackling a Crisis for the Health and Wealth of Nations. 2014.
  • 4. HM Government. Tackling Antimicrobial Resistance 2019–2024. The UK’s Five-Year National Action Plan. 2019. [DOI] [PubMed]
  • 5. HM Government. UK 20-Year Vision for Antimicrobial Resistance. 2019.
  • 6. Munita JM, Arias CA. Mechanisms of antibiotic resistance. Microbiol Spectr. 2016;4(2). DOI: 10.1128/microbiolspec [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Luepke KH, Mohr JF, III. The antibiotic pipeline: reviving research and development and speeding drugs to market. Exp Rev Anti Infect Ther. 2017;15:425–433. DOI: 10.1080/14787210.2017.1308251 [DOI] [PubMed] [Google Scholar]
  • 8. Centers for Disease Control and Prevention. Surgical site infection (SSI). 2021. Available from: https://www.cdc.gov/hai/ssi/ssi.html. [Accessed April, 2021].
  • 9. Gibbons C, Bruce J, Carpenter J, et al. Identification of risk factors by systematic review and development of risk-adjusted models for surgical site infection. Health Technol Assess. 2011;15:1–156, iii–iv. DOI: 10.3310/hta15300 [DOI] [PubMed] [Google Scholar]
  • 10. National Institute of Health and Care Excellence. Surgical Site Infections: Prevention and Treatment (NG125). London: National Institute of Health and Care Excellence; 2020. [PubMed] [Google Scholar]
  • 11. Teillant A, Gandra S, Barter D, et al. Potential burden of antibiotic resistance on surgery and cancer chemotherapy antibiotic prophylaxis in the USA: a literature review and modelling study. Lancet Infect Dis. 2015;15:1429–37. DOI: 10.1016/S1473-3099(15)00270-4 [DOI] [PubMed] [Google Scholar]
  • 12. Adedeji WA. The treasure called antibiotics. Ann Ibadan Postgrad Med. 2016;14:56–57. [PMC free article] [PubMed] [Google Scholar]
  • 13. Jit M, Ng DHL, Luangasanatip N, et al. Quantifying the economic cost of antibiotic resistance and the impact of related interventions: rapid methodological review, conceptual framework and recommendations for future studies. BMC Med. 2020;18:38. DOI: 10.1186/s12916-020-1507-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. O’Hagan A. Expert knowledge elicitation: subjective but scientific. Am Stat 2019;73:69–81. DOI: 10.1080/00031305.2018.1518265. [DOI] [Google Scholar]
  • 15. York Health Economics Consortium. Net monetary benefit. 2016. Available from: https://yhec.co.uk/glossary/net-monetary-benefit/. [Accessed April, 2021].
  • 16. National Institute of Health and Care Excellence. Guide to the Methods of Technology Appraisal 2013. London: National Institute of Health and Care Excellence; 2013. [PubMed] [Google Scholar]
  • 17. National Institute of Health and Care Excellence. Hip Fracture: Management (CG124). London: National Institute of Health and Care Excellence; 2020. [PubMed] [Google Scholar]
  • 18. HM Treasury. The Green Book. London: HM Treasury; 2020. [Google Scholar]
  • 19. Jenks PJ, Laurent M, McQuarry S, et al. Clinical and economic burden of surgical site infection (SSI) and predicted financial consequences of elimination of SSI from an English hospital. J Hosp Infect. 2014;86:24–33. DOI: 10.1016/j.jhin.2013.09.012 [DOI] [PubMed] [Google Scholar]
  • 20. Gheorghe A, Moran G, Duffy H, et al. Health utility values associated with surgical site infection: a systematic review. Value Health. 2015;18:1126–37. DOI: 10.1016/j.jval.2015.08.004 [DOI] [PubMed] [Google Scholar]
  • 21. Parsons N, Griffin XL, Achten J, et al. Outcome assessment after hip fracture. Bone Joint Res. 2014;3:69–75. DOI: 10.1302/2046-3758.33.2000250 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Vincenten CM, Den Oudsten BL, Bos PK, et al. Quality of life and health status after Girdlestone resection arthroplasty in patients with an infected total hip prosthesis. J Bone Joint Infect. 2019;4:10–15. DOI: 10.7150/jbji.28390 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Tidermark J. Quality of life and femoral neck fractures. Acta Orthop Scand. 2003;74:1–62. DOI: 10.1080/03008820310014127 [DOI] [PubMed] [Google Scholar]
  • 24. National Health Service. National cost collection for the NHS. Available from: 2018-2019. https://www.england.nhs.uk/national-cost-collection/.
  • 25. Guest JF, Fuller GW, Vowden P. Costs and outcomes in evaluating management of unhealed surgical wounds in the community in clinical practice in the UK: a cohort study. BMJ Open. 2018;8:e022591. DOI: 10.1136/bmjopen-2018-022591 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Royal College of Physicians. National Hip Fracture Database (NHFD) Annual Report 2019. London: Royal College of Physicians; 2019. [Google Scholar]
  • 27. Public Health England. Surveillance of Surgical Site Infections in NHS Hospitals in England—April 2018 to March 2019. London: Public Health England; 2019. [Google Scholar]
  • 28. Kavolus JJ, Schwarzkopf R, Rajaee SS, et al. Irrigation fluids used for the prevention and treatment of orthopaedic infections. J Bone Joint Surg Am. 2020;102(1):76–84. [DOI] [PubMed] [Google Scholar]
  • 29. Romero-Calle D, Guimarães Benevides R, Góes-Neto A, et al. Bacteriophages as alternatives to antibiotics in clinical care. Antibiotics. 2019;8:138. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Zhabiz G, Omar B, Donald Gene P. Bacteriophage therapy: a potential solution for the antibiotic resistance crisis. J Infect Dev Ctries. 2014;8(2):129–36. DOI: 10.3855/jidc.3573 [DOI] [PubMed] [Google Scholar]
  • 31. Naylor NR, Evans S, Pouwels KB, et al. Quantifying the primary and secondary effects of antimicrobial resistance on surgery patients: methods and data sources for empirical estimation in England. Front Public Health. 2022;10:803943. DOI: 10.5210.3389/fpubh.2022.803943 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Iskandar K, Sartelli M, Tabbal M, et al. Highlighting the gaps in quantifying the economic burden of surgical site infections associated with antimicrobial-resistant bacteria. World J Emerg Surg. 2019;14:50. DOI: 10.1186/s13017-019-0266-x [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

sj-docx-1-mpp-10.1177_23814683231152885 – Supplemental material for Developing a Modeling Framework for Quantifying the Health and Cost Implications of Antibiotic Resistance for Surgical Procedures

Supplemental material, sj-docx-1-mpp-10.1177_23814683231152885 for Developing a Modeling Framework for Quantifying the Health and Cost Implications of Antibiotic Resistance for Surgical Procedures by Heather Davies, Joel Russell, Angel Varghese, Hayden Holmes, Marta O. Soares, B. Woods, Ruth Puig-Peiro, Stephanie Evans, Rory Tierney, Stuart Mealing, Mark Sculpher and Julie V. Robotham in MDM Policy & Practice


Articles from MDM Policy & Practice are provided here courtesy of SAGE Publications

RESOURCES