Skip to main content
Journal of Health Economics and Outcomes Research logoLink to Journal of Health Economics and Outcomes Research
. 2022 Jun 6;9(1):140–150. doi: 10.36469/001c.34721

Assessing the Health and Economic Outcomes of a 9-Valent HPV Vaccination Program in the United Kingdom

Kwame Owusu-Edusei 1,, Cody Palmer 1, Olga Ovcinnikova 2, Giampiero Favato 3, Vincent Daniels 1
PMCID: PMC9170517  PMID: 35795155

Abstract

Background: The United Kingdom (UK) switched from using the 4-valent human papillomavirus (HPV) vaccine (Gardasil®) to the 9-valent vaccine (Gardasil 9®) in 2021.

Objective: To estimate and compare the health and economic outcomes of 2 HPV vaccination programs in the UK targeting girls and boys aged 12-13 years from the perspective of the UK National Health Service. The 2 vaccination strategies were (1) universal vaccination 4-valent (UV4V), using the 4-valent HPV vaccine (4vHPV), and (2) universal vaccination 9-valent (UV9V), using the 9-valent HPV vaccine (9vHPV).

Methods: A deterministic heterosexual compartmental disease transmission model was used to track health and economic outcomes over a 100-year time horizon. Outcomes were discounted at an annual rate of 3.5% and 1.5%. All costs were adjusted to 2020 British pounds (£). Health outcomes were measured in quality-adjusted life-years (QALYs), and the summary results were presented as incremental cost-effectiveness ratios (£/QALY gained) when comparing UV4V with UV9V.

Results: Using the same vaccine coverage for both programs, the total cumulative cases of HPV-related health outcomes tracked over the 100-year horizon indicated that the relative number of cases averted (UV9V vs UV4V) ranged from 4% (anal male cancers and deaths) to 56% (cervical intraepithelial neoplasia [CIN1]). Assuming that 9vHPV cost £15.18 more than 4vHPV (a cost differential based on discounted list prices), the estimated incremental cost-effectiveness ratio was £8600/QALY gained when discounted at 3.5%, and £3300/QALY gained when discounted at 1.5%. The estimated incremental cost-effectiveness ratios from the sensitivity analyses remained <£28000/QALY over a wide range of parameter inputs and demonstrated that disease utilities, discount rate, and vaccine efficacy were the 3 most influential parameters.

Discussion: Consistent with other published studies, the results from this study found that the 9vHPV vaccine prevented a substantial number of cases when compared with the 4vHPV vaccine and was highly cost-effective.

Conclusions: These results demonstrate that replacing universal 4vHPV with 9vHPV can prevent a substantial additional number of HPV-related cases/deaths (in both women and men) and remain cost-effective over a range of 9vHPV price premiums.

Keywords: HPV, universal vaccination, cost-effectiveness analysis, 4-valent HPV vaccine, 9-valent HPV vaccine

BACKGROUND

Known to infect approximately 8 out of every 10 people at some point in their lives, human papillomavirus (HPV) is one of the most prevalent sexually transmitted infections (STIs) in the world.1,2 HPV is transmitted through sexual contact (vaginal, anal, and oral), although there is evidence of vertical transmission from mother to child during pregnancy or delivery.3–5 HPV infects the epithelial tissues of the cervix, anus, penis, mouth, and throat.6–8 Over 100 types of HPV have been identified. Among the 9 types (6, 11, 16, 18, 31, 33, 45, 52, and 58) against which vaccines are directed, 7 (16, 18, 31, 33, 45, 52, and 58) are considered high-risk HPV types because they are known to increase the risk of developing cancers. Types 16 and 18 are known to account for 70% of high-grade cervical intraepithelial neoplasia (CIN) and invasive cervical cancer. Types 6 and 11 affect the genital area and cause 85% of genital warts cases9,10 but do not cause cervical cancer. As a result, they are considered low-risk HPV among the 9 vaccine types. A recently published report indicated that HPV causes virtually all cervical cancers, over 90% of anal cancers, 70% of oropharyngeal cancers (OPC), 75% of vaginal cancers, 70% of vulvar cancers, and 60% of penile cancers.11

In the United Kingdom (UK), estimates from 2018 indicated that cervical cancer ranks as the second most common female cancer among women aged 15-44 years (13th among women of all ages), with an annual incidence of 3430 new cases and over 1000 cervical cancer–associated deaths.12 In addition, there were 3049 new cases of OPC and 872 OPC-associated deaths, although the majority of OPC cases are likely associated with high tobacco and alcohol consumption.12

One effective prevention and control strategy is the use of HPV vaccines designed to prevent HPV infection and HPV-related diseases. As a result, in 2008 the Joint Committee on Vaccination and Immunisation (JCVI) recommended that routine immunization against HPV should be introduced for girls aged 12-13 years in the UK. These recommendations were revised in March 2014 (3-dose to 2-dose schedule) and November 2015 (including men who have sex with men).13,14 In July 2018, the JCVI concluded that extending the HPV vaccination program to boys aged 12-13 years is “highly likely to be cost-effective.”15 Consequently, for the 2019-2020 school year, boys and girls aged 12-13 years in school year 8 were eligible for HPV vaccination.16 In July 2021, Public Health England released a statement announcing the switch from the 4-valent HPV vaccine (Gardasil®, [Merck & Co, Inc; 4vHPV]) to the 9-valent HPV vaccine (Gardasil 9® [Merck & Co, Inc; 9vHPV]) during the 2021-2022 academic year.17

Several studies have assessed the cost-effectiveness of HPV vaccination in the UK.18–22 However, the most recent that examined the 9-valent vaccine concluded that vaccinating girls is cost-effective but less so for both girls and boys, because boys are already protected due to herd effect conferred by the vaccinated girls. Furthermore, their results confirmed that almost all the health gains would be erased within 15 years if vaccination were halted.23 Their results were consistent with studies conducted for other settings.24–26

Study Objectives

Given the recent developments in the vaccine used in the UK HPV vaccination program, it is important to assess the health and economic impact at the national level. Specifically, this study focused on the switch from 4vHPV to 9vHPV. Therefore, the objective of this study is twofold:

  1. Estimate the cumulative population-level HPV-related health outcomes for 2 vaccination strategies, ie, universal use of 4vHPV and 9vHPV.

  2. Compare the health and economic outcomes of the 2 vaccination strategies (universal use of 4vHPV vs. 9vHPV).

The qualitative and quantitative results from this study can provide important information on the assessment of current and future HPV vaccination programs in the UK. In addition, they can provide relevant information that can be used in the decision-making process regarding current and/or future changes to HPV vaccination programs in the UK.

METHODS AND DATA

Analytical Design and Scope

To account for herd effects associated with infectious diseases, an age-structured, deterministic, heterosexual, compartmental disease transmission model was used. The disease transmission model was adapted from the most recent model,27,28 which is an updated version of the original model developed by Elbasha et al29 and Dasbach et al.18 In the updated version of the original model, infections and diseases attributable to HPV genotypes 31, 33, 45, 52, and 58 have been added in the form of additional compartments and associated differential equations. In all, the model accounted for the transmission dynamics of all 9 HPV types covered by the 9vHPV vaccine. Additional information is provided in the Supplementary Online Material, Section 3.

Due to a lack of data (on HPV genotype coinfections and associated HPV comorbidities) and to keep the model simple, the known HPV-related cancers and precancers (cervical, penile, vaginal, vulvar, anal, and oropharyngeal) and HPV genotypes were modeled separately and independently. In addition, separate models were used for recurrent respiratory papillomavirus (RRP), genital warts, and premalignant cervical lesions due to HPV-6 and 11. Each disease model included HPV acquisition, transmission, persistent infection, reinfection, natural immunity, progression to precancerous lesions, and cancer, as well as treatment, regression, screening (where applicable), and vaccination. Full details of the model structure can be found in the Supplementary Online Material, Section 3.30,31

Strategies Examined

For the purpose of this study, 2 national vaccination programs were examined: a universal vaccination (girls and boys) 4-valent (4vHPV, protective against HPV types 6, 11, 16, and 18) vaccination program, and a universal 9-valent (9vHPV, protective against HPV types 6, 11, 16, 18, 31, 33, 45, 52, and 58) vaccination program. We assumed the same vaccination coverage for both scenarios, that both scenarios included the impact of the historical vaccination program in the UK from 2008 through 2019, and that the health and economic comparisons between scenarios begun in 2019. Hereafter, the 2 strategies are referred to as follows:

  1. Universal vaccination 4-valent (UV4V), using the 4-valent HPV vaccine (4vHPV)

  2. Universal vaccination 9-valent (UV9V), using the 9-valent HPV vaccine (9vHPV)

Target Population, Time Horizon, Discounting, and Study Perspective

Individuals 12-13 years of age were the target of the vaccination programs. As a result, those who turned 12-13 years old each year were vaccinated and followed over a 100-year time horizon starting in 2019. The model assumed a closed UK population, ie, individuals entered and exited the model population as a result of births and deaths only, respectively. Cost and effects were discounted at a rate of 3.5% and 1.5% based on the JCVI recommendation15 and determined from the UK National Health Service perspective.

Data

The input parameter values used in the models were obtained from the published literature. Table 1 shows the overall all-cause mortality rates by gender used in the model. Sexual activity was categorized as low, medium, and high. The distribution and associated mean number of partners for each category, by age group and gender, together with the mixing proportions among members of different age cohorts, are presented in Table 1. The type-specific vaccine efficacies and assumptions for all the HPV-related cancers and/or infections are presented in Table 2. Table 3 shows the vaccine coverage rate used in the model for both genders. Total costs associated with diagnosing and treating diseases caused by HPV infections and their utilities are presented in Table 4. A comprehensive list of the inputs can be found in the Supplementary Online Material, Section 3.3. To be consistent and comparable, all costs (obtained from different sources and from different cost-years) were adjusted to 2020 British pounds (£).

Table 1. Mortality Rate, Sexual Activity, and Mixing Parameters.

All-Cause Mortality Rates for the General Public (%)
Age Group (Years) Males Females
<1 0.00441 0.00349
1-8 0.00014 0.00012
9-11 0.00008 0.00008
12 0.00009 0.00007
13 0.00013 0.00010
14-17 0.00021 0.00012
18 0.00039 0.00018
19 0.00046 0.00017
20-24 0.00046 0.00021
25-26 0.00058 0.00025
27-29 0.00061 0.00031
30-34 0.00079 0.00043
35-39 0.00119 0.00066
40-44 0.00172 0.00103
45-49 0.00248 0.00156
50-54 0.00368 0.00248
55-59 0.00592 0.00396
60-64 0.00961 0.00614
65-69 0.01434 0.00944
70-74 0.02448 0.01605
75-79 0.04074 0.02809
80-84 0.07318 0.05326
>85 0.16238 0.14371
Mean No. of sexual partners by age group32
13-14* 0.0001 0.0001
15*-19 1.70 1.40
20-24 2.00 1.60
25-29 1.70 1.30
30-34 1.50 1.20
35-39 1.20 1.00
40-44 1.10 1.50
45-49 1.10 1.00
50-54 1.10 0.90
55-59 1.00 0.70
60-64 0.90 0.60
65-69 0.80 0.50
70-74 0.50 0.30
75+* 0.5 0.30
Sexual activity categories and percent population sizes (mean number of sexual partners)32
Low (mean number of sexual partners/year, ≤1) 85.1 (0.79) 90.7 (0.75)
Medium (mean number of sexual partners/year, 2-4) 11.9 (2.54) 7.6 (2.52)
High (mean number of sexual partners/year, ≥5) 3 (9.80) 1.7 (9.66)
Sexual mixing parameters31
Between debut and cessation 0.40
After cessation 0.10
Among members of different sexual activity groups 0.50

Table 2. Vaccine Efficacy Estimates and Assumptions Used in the Model.

Vaccine Assumptions HPV-16 HPV-18 HPV-31, 33, 45, 52, and 58
Cervical cancer
Malea 0.411 0.411 0.411
Female 0.76 0.76 0.76
Protection against cervical HPV infections becoming persistent 0.988 0.988 0.988
Protection against HPV-related CIN 0.97 0.97 0.97
Vaginal and vulvar cancers
Malea 0.411 0.621 0.621
Female 0.76 0.963 0.963
Protection against vaginal/vulvar HPV infections becoming persistent 0.988 0.984 0.984
Protection against HPV-related /VaIN/VIN 1 1 1
Anal cancers
Male 0.762 1 0.762
Female 0.762 1 0.762
Protection against anal HPV infections becoming persistent
Male 0.938 0.999 0.938
Female 0.938 0.999 0.938
Protection against HPV-related AIN 0.655 1 0.655
H&N cancers
Male 0.411 0.621 0.621
Female 0.760 0.963 0.963
Protection against H&N infections becoming persistent
Male 0.787 0.96 0.96
Female 0.988 0.984 0.984
Protection against HPV-related H&N neoplasia 0 0 0
Penile cancer
Male 0.411 0.621 0.621
Femaleb 0.760 0.963 0.963
Protection against penile HPV-16/18 infections becoming persistent
Protection against HPV-related PIN 0.787 0.960 0.960
Vaccine efficacy against HPV-6/11 infection HPV-6 HPV-11
Females 0.761 0.761
Males 0.49 0.57
Protection against HPV-6/11–related genital warts
Females 0.989 1
Males 0.843 0.909
Protection against HPV-6/11–related CIN1 1 1

Abbreviations: AIN, anal intraepithelial neoplasia; CIN, cervical intraepithelial neoplasia; H&N, head and neck; HPV, human papillomavirus; PIN, penile intraepithelial neoplasia; VaIN, vaginal intraepithelial neoplasia; VIN, vulval intraepithelial neoplasia.

aPreventing male genital infections through male vaccination is assumed to prevent transmission of genital infections to females.

bPreventing female genital infections through vaccination is assumed to prevent transmission of genital infections to males.

Giuliano et al33 for males; Garland et al34 and Palefsky et al35 for females.

Table 3. Vaccine Coverage Assumption for Boys and Girls.

Age (years)
Year Vaccine Routine Uptake (%) 13 14 15 16 17
2008-2009 Bivalent 80.9 0 0 0 0 47.4
2009-2010 Bivalent 77.5 0 68.5 68.6 41.7 38.9
2010-2011 Bivalent 83.8 4.5 0.3 7.2 2.2 6.4
2011-2012 Quadrivalent 87.0 0 0 0 0 0
2012-2013 Quadrivalent 85.8 0 0 0 0 0
2013-2014 Quadrivalent 88.1 0 0 0 0 0
2014-2015 Quadrivalent 87.5 0 0 0 0 0
2015-2016 Quadrivalent 85.1 0 0 0 0 0

Table 4. Costs and Utility Values Used in the Model.

Costs (£)
Male Female
Disease
CIN1/2/3 and CIS21,36,37 406
Cervical cancer, local disease38 20 701
Cervical cancer, regional disease38 25 594
Cervical cancer, distant disease38 27 239
VaIN1/2/3 and CIS21,36 406
Vaginal cancer, all stages21 15 893
Vulval cancer, all stages21 15 893
Penile cancer, all stages39 10 482
Anal cancer, all stages40 18 292
H&N cancer,a all stages21 17 465
Genital warts41 292
Recurrent respiratory papillomatosis42 18 981
Age-specific healthy state utilities
1-17 0.93 0.93
18-34 0.92 0.91
35-44 0.90 0.89
45-54 0.87 0.86
55-64 0.81 0.80
65-74 0.76 0.78
75+ 0.69 0.70
HPV-related disease utilities
CIN1, VaIN1, VIN1 0.91
CIN2+, CIS, VaIN2+, VIN2+ 0.87
Cervical/vaginal/vulvar/anal/H&Na/penile cancer, local 0.76
Cervical/vaginal/vulvar/anal/H&Na/penile cancer, regional 0.67
Cervical/vaginal/vulvar/anal/H&Na/penile cancer, distant 0.48
Cervical/vaginal/vulvar/anal/H&Na/penile cancer, survivor 0.76
Genital warts 0.91
RRP 0.79

Abbreviations: CIN, cervical intraepithelial neoplasia; CIS, carcinoma in situ; H&N, head and neck; HPV, human papillomavirus; RRP, recurrent respiratory papillomatosis; VaIN, vaginal intraepithelial neoplasia.

aComprises cancers of the oral cavity, oropharynx, and larynx.

Model Verification and Validation

Model validity was assessed and confirmed by comparing its structure with previously validated and published models of HPV infections.18,29 In addition, a number of tests were built into the model to ensure internal validity and verify the results.43 In particular, tests were used to check for all 3 major types of mathematical disease modeling errors: logic, mechanical, and omission.43 For example, to verify the model logic, the total number of persons in each compartment for each age group was ensured to be equal to the size of the population for that age group, after accounting for deaths. Given the large number of inputs, mechanical tests were also included to ensure that the correct inputs (eg, from the right tables, rows, and/or columns) were used in all calculations. Omission tests were used to ensure that the theoretical model structure and its components/compartments were fully represented in the model equations and calculations.43

Model Calibration

Model calibration was performed using the maximum likelihood estimation approach with the assumption that the observed incidence and/or prevalence have reached equilibrium, and the errors were normally distributed around the true burden (incidence/prevalence). The calibration targets were type-specific HPV prevalence, and incidence of HPV-related precancers, cancers, and genital warts. Details on the calibration process and results can be found in the Supplementary Online Material, Section 10.

Software Used

The models were expressed as systems of ordinary differential equations representing the contents and continuous movements from and to applicable compartments to simulate the natural history of HPV infection and disease progression over the time horizon (100 years). The “NDSolve” function in Mathematica® 12 (Wolfram Research, Champaign, Illinois) was used to derive the numerical solutions.

Outcome Measures of Interest

Based on the specified objectives of this study, the outcomes of interest were as follows:

  1. The cumulative health outcomes (ie, diseases and deaths) resulting from each of the 2 strategies listed above.

  2. Discounted health outcomes (in quality-adjusted life-years [QALYs]) and costs compared between the strategies and presented as incremental cost-effectiveness ratios (ICERs), reported as pounds per QALYs gained.

Sensitivity Analyses

One-way sensitivity analyses using the extreme values (upper and lower bounds) were conducted on select inputs: vaccine efficacy, duration of protection, disease and healthy utilities, discount rate, and costs. However, due to the substantial number of inputs for some of the categories (utilities and costs), a modified one-way (one-category) sensitivity analysis was adopted in which the changes in the values were applied to all the inputs in that category. In particular, keeping all other inputs at their base case values, inputs for costs of disease, disease utility, healthy utility categories were varied (ie, all inputs for each category, one category at a time) from low (-20%) to high (+20%); all vaccine efficacies were varied from low (25% reduction) to full (100%); discount rate was varied from 1.5% to 5%; duration of protection was reduced to 30 years; and vaccine coverage rate was varied from low (75%) to high (95%).

Finally, a comprehensive threshold analysis was conducted on the relative price of 9vHPV vs 4vHPV using the estimated UV9V-UV4V ICERs. Then, using the estimated price premiums from the one-way (one-category) sensitivity analysis, tornado diagrams were used to depict the changes in the estimated base case price premium for the specified ranges by setting the willingness-to-pay (WTP) thresholds to £20 000 and then repeated for £30 000.44

RESULTS

Base-Case Health Outcomes

Table 5 shows the base case results for the health outcomes. Overall, the number of cases estimated for the 2 strategies showed that a substantial number of cases (ranging from 4% to 56%) were prevented when comparing the UV9V with the UV4V strategy based on the inputs and assumptions used in the model. The estimated number of cases for the 2 interventions over a 100-year time horizon indicated 4.1 million and 2.0 million cases of intraepithelial neoplasia (CIN1, CIN2/3, VaIN1, VaIN2/3) for the UV4V and UV9V strategies, respectively (a 53% reduction). The numbers of estimated cancer cases were 314 709 (female, 220 173; male, 94 537) for UV4V and 274 301 (female, 185 661; male, 88 640) for UV9V, representing a 13% reduction in the number of cases (Table 5). However, the percent reduction was higher for females than for males (16% vs 6%).

Table 5. Estimated Cumulative HPV-Related Health Outcomes for the UV4V and UV9V Vaccination Strategies Over a 100-Year Time Horizona.

Clinical Outcomes UV4V UV9V Cases Averted, No.b (%)
CIN1 2 386 845 1 057 643 1 329 202 (56)
CIN2/3 1 615 718 808 398 807 320 (50)
VaIN1 46 928 33 590 13 338 (28)
VaIN2/3 67 449 50 556 16 894 (25)
Total cancers 314 709 274 301 40 409 (13)
Female cancers 220 173 185 661 34 512 (16)
Cervical 106 963 82 500 24 463 (16)
Other 113 209 103 161 10 048 (9)
Anal 34 819 32 932 1887 (5)
Vaginal 14 311 12 873 1437 (10)
Vulvar 54 000 48 069 5931 (11)
H&Nc 10 080 9286 794 (8)
Male cancers 94 537 88 640 5897 (6)
Anal 27 280 26 104 1176 (4)
H&Nc 22 932 21 212 1720 (7)
Penile 44 325 41 323 3001 (7)
Total deaths 59 149 53 440 5708 (9)
Female deaths 38 346 33 862 4483 (11)
Cervical 22 821 19 568 3253 (14)
Vaginal 3433 3146 287 (8)
Vulvar 6742 6120 621 (9)
Anal 2505 2376 129 (5)
H&Nc 2845 2652 193 (7)
Male deaths 20 803 19 578 1225 (6)
Penile 11 133 10 478 654 (6)
Anal 2538 2438 100 (4)
H&Nc 7132 6662 470 (7)

Abbreviations: CIN, cervical intraepithelial neoplasia; H&N, head and neck; HPV, human papillomavirus; RRP, recurrent respiratory papillomatosis; UV4V, universal vaccination 4-valent; UV9V, universal vaccination 9-valent; VaIN, vaginal intraepithelial neoplasia.

aDue to rounding, some of the row/column totals may not match the presented numbers.

bUV4V cases minus UV9V cases.

cComprises cancers of the oral cavity, oropharynx, and larynx. The details of how this was derived can be found in the Supplementary Online Material, Section 10.1.

The UV9V strategy prevented approximately 9% more of the HPV-attributable deaths when compared with the UV4V strategy (53 440 vs 59 149), although most of the deaths in both strategies (>63%) occurred in females (Table 5). The model estimated that among females, the leading cause of HPV-attributable deaths was cervical cancer (>57%), followed by vulvar cancer (>17%), in both strategies. On the other hand, among males, the model estimated that penile cancer was the leading cause of HPV-attributable deaths (>53%) followed by head and neck, which caused about a third (>34%) of the HPV-attributable deaths in males.

Base Case Cost-Effectiveness Analyses

Table 6 shows the total discounted QALYs and costs for each strategy examined accumulated over 100 years. When applying a discount rate of 3.5%, the total QALYs estimated were 2 412 029 and 2 412 093 for the UV4V and GNV69 strategies respectively, and the associated costs using a base case price differential of £15.18 (9vHPV over 4vHPV) were estimated at £17.3 million (UV4V) and £17.8 million (UV9V). Based on these estimated QALYs and costs, the ICER was £8600/QALY gained when comparing the UV9V to the UV4V strategy. However, when applying a discount rate of 1.5%, the total QALYs estimated were 4 459 040 and 4 459 242 for the UV4V and GNV69 strategies, respectively, and the associated costs were estimated at £30.5 (GVNG4) million and £31.2 million (UV9V), respectively. Based on these estimated QALYs and costs, the ICER was £3300/QALY gained when comparing the UV9V with the UV4V strategy. Figure 1 depicts the price-ICER chart for the base case estimates when a 3.5% discount rate was applied and shows that the value-based price premiums were ≈£27 and ≈£37.5 when the WTP thresholds were set to £20 000 and £30 000, respectively. When a 1.5% discount rate was applied, the value-based price premiums were ≈£45 and ≈£63 using the £20 000 and £30 000 WTP thresholds, respectively (not shown in chart). In addition, the cost-neutral price premium was £6.10.

Table 6. Summary Costs, Effectiveness, and ICERsa.

Vaccination Strategy QALYs Cost (£)b Incremental QALY Incremental Cost (£)b ICER (£/QALY)b
Discounted at 3.5%
UV4V 2 412 029 17 285 700
UV9V 2 412 093 17 834 600 64 548 900 8 600
Discounted at 1.5%
UV4V 4 459 040 30 514 200
UV9V 4 459 242 31 184 000 202 669 800 3 300

Abbreviations: ICER, incremental cost-effectiveness ratio; QALYs, quality-adjusted life years; UV4V, universal vaccination 4-valent; UV9V, universal vaccination 9-valent.

aAll costs are reported in 2020 British pounds (£). All costs and QALYs are for the whole population and accumulated over 100 years.

bRounded to the nearest 100.

Figure 1. Base Case ICER and Associated Premium Prices With £20 000 and £30 000 Willingness-to-Pay Thresholds.

Figure 1.

Abbreviations: ICER, incremental cost-effectiveness ratio; QALY, quality-adjusted life-year.

Sensitivity Analyses (ICER)

Figure 2 shows the estimated ICERs for each of the inputs (or categories of inputs) used in the one-way (one-category) sensitivity analysis. The ICERs ranged from a low of ≈£3300 (when discount rate was 1.5%) to a high of ≈£27 900 (when disease utility was +20%). Based on the estimated ICERs for the low and high inputs, the change in the base case ICER ranged from ≈-£5300 to ≈£19 300. Figure 2 depicts the base case ICER for the select inputs (and the ranges used) in a tornado diagram. As illustrated in Figure 2, the 3 most influential parameters were disease utility, followed by discount rate and vaccine efficacy.

Figure 2. Tornado Diagram Showing Impact of Key Input Parameters on Base Case ICERa.

Figure 2.

Abbreviations: ICER, incremental cost-effectiveness ratio; QALY, quality-adjusted life-year; VCR, vaccine coverage rate.

aThe labels associated with each bar are the actual absolute estimated ICERs.

Using the estimated ICERs from the sensitivity analyses presented in Figure 2, the associated changes in the value-based price premium were estimated and presented in tornado diagrams (Figures 3a and 3b). When the WTP is £20 000, the price premium ranged from £12.7 (ie, £27.0 – £14.3) to £48.5 (ie, £27 + £21.5). For a WTP threshold of £30 000, the price premium ranged from £15.9 (ie, £37.5 – £21.6) to £69.9 (ie, £37.5 + £32.4).

Figure 3. Tornado Diagram Showing Change in Price Premium With Willingness-to-Pay Thresholds of (a) £20 000 and (b) £30 000.

Figure 3.

Abbreviation: VCR, vaccine coverage rate.

DISCUSSION

In this study, an age-structured, deterministic, heterosexual compartmental disease transmission model was used to determine and compare the health and economic outcomes of 2 HPV vaccination programs targeting individuals aged 12-13 years in the UK: universal vaccination 4-valent (UV4V), using the 4vHPV vaccine, and universal vaccination 9-valent (UV9V), using the 9vHPV vaccine. The model predicted a substantial reduction (up to 56%) in the overall total number of clinical outcomes (cancers, precancers, genital warts, and RRP cases) over a 100-year time horizon when comparing the UV9V with the UV4V program. There were substantial reductions in the burden of HPV-related diseases and deaths (attributable to HPV) among males and females, although the relative reduction in females was substantially higher. Based on the health and economic outcomes, the estimated base case ICER was highly favorable for the UV9V program as the ICERs are low (<£9000/QALY gained). These results were robust when the uncertainties around influential input parameters were incorporated: all the estimated ICERs from the sensitivity analyses were <£28 000. In addition, this study determined that the price premium of 9vHPV (over 4vHPV) can be as high as £70 per dose and remain cost-effective.

The results reported in this study are generally consistent with those of previously published studies on the relative health and economic outcomes of the 9-valent vaccine when compared with the 4-valent vaccines in different settings.24–26 Datta et al23 used an individual-based model to assess girls only and universal vaccination strategies using 2vHPV (bivalent HPV vaccine), 4vHPV, and 9vHPV vaccines in the UK setting. Although these investigators23 included and examined threshold prices for both 4vHPV and 9vHPV vaccines, their results were reported relative to “halted” and “girls-only” vaccination programs. As a result, the direct comparison of 9vHPV with 4vHPV price was not assessed and reported. Thus, comparing the price premium estimates obtained from this study to that of Datta et al is not possible.

Limitations

There are several notable limitations of this study. First, being a mathematical model, it has all the applicable inherent limitations of models in general, which are simplifications of real-world events. Because of the complex nature of HPV infections and lack of data, several simplifying assumptions were made. For example, dependencies between and among HPV genotype infections and/or diseases were ignored as the 7 disease areas and 9 types were modeled individually (and independent of) each other. Consequently, the potential impact of coinfection and comorbidity was not captured. However, because the impact of coinfection and comorbidity is largely dependent on the type of interaction between and among the infections/diseases (either synergistic or competitive) and there are no data on these phenomena, it is difficult to assess how these omissions impacted the final results. Additional model limitations are discussed elsewhere.29–31 Besides the lack of data, there were substantial uncertainties around the available data. However, the comprehensive sensitivity analyses conducted and presented on key data inputs addressed some of the uncertainties around the inputs and their qualitative and quantitative impact on the results.

This study focused on heterosexual transmission. Thus, specific information on the impact of vaccination on same-sex transmission and burden was ignored. Including same-sex transmission dynamics would have introduced additional dimensions of complexity. Nonetheless, given that the model was calibrated to the overall HPV burden (which included the transmission and burden of HPV for the same-sex subpopulations), the population-level impact from same-sex transmission was captured in the overall results. It is expected that because of the higher burden in certain subpopulations, the impact of vaccination would be substantially higher than in the general population. Given the unique transmission dynamics and burden of STIs among the same-sex population (particularly among men who have sex with men), more analysis focusing on this population is recommended. For most STI prevention and control efforts, there is the potential for perverse effect from the intervention on sexual risk behavior (ie, increased sexual activity and/or reduced preventive measures) as a result of perceived risk reduction. However, recently published studies on vaccination and sexual behavior from different settings suggest that vaccination does not affect sexual behavior.45–47 In addition, it is difficult to predict the time, direction, and magnitude of the changes in sexual behavior, if any. For these reasons, sexual behavior was assumed to be constant over time.

Strengths

Despite the above limitations, there are numerous noteworthy strengths in this study. First, dynamic transmission models that account for herd effects are preferred to cohort or static models when assessing the impact of interventions for infectious diseases, particularly vaccination programs.48–51 Second, this model was adapted from earlier validated and published modeling efforts in the HPV area.18,27,29 The model accounted for all 9 vaccine HPV types (6, 11, 16, 18, 31, 33, 45, 52, and 58) and their associated health outcomes (cervical, penile, vaginal, vulvar, anal, head and neck, RRP, genital warts, premalignant cervical lesions, and deaths).

Because of the complexity of the model, with its increased potential for errors, several tests and checks were built in to ensure internal and external validity and verify the model components and associated calculations. For the purpose of complete transparency and replicability of this study and its results, all the associated study information (ie, model equations, assumptions, parameter inputs, and their sources) have been made publicly available. Finally, to our knowledge, this is the first study that has directly compared the health and economic outcomes of using 9vHPV with that of 4vHPV in the UK setting.

CONCLUSION

An analysis of the health and economic outcomes of 2 universal vaccination strategies, comparing the 9vHPV with the 4vHPV vaccine, targeting young girls and boys in the UK, showed that using 9vHPV can prevent as much as 56% of the number of cases predicted under the 4vHPV program and was highly cost-effective. In addition, the results remained favorable under a wide range of uncertainties around the major drivers (influential parameter inputs) of the results. These results suggest that switching from using 4vHPV to 9vHPV vaccine in the national vaccination programs can have substantial health and economic benefits. Given the high incremental health benefits and associated treatment cost savings, including the 9vHPV vaccine in the decision-making process for current and future HPV vaccination programs can result in substantial individual- and population-level benefits.

Disclosures

This study was performed by Merck Sharp & Dohme Corp., a subsidiary of Merck & Co, Inc, Kenilworth, New Jersey. KOE, CP, OO, and VD are employees of Merck Sharp & Dohme Corp, a subsidiary of Merck & Co, Inc, Kenilworth, New Jersey, and may hold stock or stock options in Merck & Co, Inc, Kenilworth, New Jersey.

Author Contributions

KOE, CP, VD, OO, and GF conceptualized and determined the scope of the study. CP and VD performed the model calibration and study analyses. KOE prepared the first draft. KOE, CP, VD, OO, and GF reviewed the data, results and the interpretation of the results. KOE, CP, VD, OO, and GF critically reviewed and revised the manuscript for intellectual content.

Supplementary Material

Online Supplementary Material
Online Supplementary Material

References

  1. Cancer Research UK Does HPV cause cancer? Cancer Research UK. [2020-1-13]. https://www.cancerresearchuk.org/about-cancer/causes-of-cancer/infections-eg-hpv-and-cancer/does-hpv-cause-cancer
  2. Centers for Disease Control and Prevention Human papillomavirus (HPV): HPV vaccine schedule and dosing. [2019-12-14]. https://www.cdc.gov/hpv/hcp/schedules-recommendations.html
  3. Genital HPV infection: CDC fact sheet. Vol. 2014. http://www.cdc.gov/std/hpv/stdfact-hpv.htm
  4. Evidence for vertical transmission of HPV from mothers to infants. Smith Elaine M., Parker Michael A., Rubenstein Linda M., Haugen Thomas H., Hamsikova Eva, Turek Lubomir P. 2010Infectious Diseases in Obstetrics and Gynecology. 2010:326369. doi: 10.1155/2010/326369. doi: 10.1155/2010/326369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Risk of vertical transmission of human papillomavirus throughout pregnancy: a prospective study. Lee Seung Mi, Park Joong Shin, Norwitz Errol R., Koo Ja Nam, Oh Ig Hwan, Park Jeong Woo, Kim Sun Min, Kim Yun Hwan, Park Chan-Wook, Song Yong Sang. Jun 13;2013 PLoS One. 8(6):e66368. doi: 10.1371/journal.pone.0066368. doi: 10.1371/journal.pone.0066368. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Longworth Michelle S., Laimins Laimonis A. Microbiology and Molecular Biology Reviews. 2. Vol. 68. American Society for Microbiology; Pathogenesis of human papillomaviruses in differentiating epithelia; pp. 362–372. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. National Health Service Genital warts. [2020-2-15]. http://www.nhs.uk/conditions/genital_warts/pages/introduction.aspx
  8. Current understanding of the mechanism of HPV infection. Schiller John T., Day Patricia M., Kines Rhonda C. Jun;2010 Gynecologic Oncology. 118(1Suppl):S12–S17. doi: 10.1016/j.ygyno.2010.04.004. doi: 10.1016/j.ygyno.2010.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Human papillomavirus genotype distribution in external acuminata condylomata: a Large French National Study (EDiTH IV) Aubin François, Prétet Jean Luc, Jacquard Anne Carole, Saunier Maelle, Carcopino Xavier, Jaroud Fatiha, Pradat Pierre, Soubeyrand Benoît, Leocmach Yann, Mougin Christiane, Riethmuller Didier, EDiTH Study Group Sep;2008 Clinical Infectious Diseases. 47(5):610–615. doi: 10.1086/590560. doi: 10.1086/590560. [DOI] [PubMed] [Google Scholar]
  10. Molecular epidemiology of sexually transmitted human papillomavirus in a self referred group of women in Ireland. Menton John F, Cremin Suzanne M, Canier Lydie, Horgan Mary, Fanning Liam J. Jul 23;2009 Virology Journal. 6:112. doi: 10.1186/1743-422x-6-112. doi: 10.1186/1743-422x-6-112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. National Cancer Institute HPV and cancer. [2020-1-13]. https://www.cancer.gov/about-cancer/causes-prevention/risk/infectious-agents/hpv-and-cancer
  12. Bruni L., Albero G., Serrano B., et al. Human Papillomavirus and Related Diseases in United Kingdom. Summary Report. June 17, 2019. ICO/IARC Information Centre on HPV and Cancer (HPV Information Centre); [2020-1-9]. https://hpvcentre.net/statistics/reports/GBR.pdf [Google Scholar]
  13. Public Health England Human papillomavirus (HPV) vaccination coverage in adolescent females and males in England: 2020 to 2021. [2021-1-21]. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1040436/hpr2021_hpv-vc.pdf
  14. Public Health England HPV vaccination programme: change from 3 to 2 doses. [2020-1-20]. https://www.gov.uk/government/publications/schedule-change-from-3-to-2-doses-in-the-hpv-vaccination-programme
  15. Joint Committee on Vaccination and Immunisation Statement on HPV vaccination. [2020-2-20]. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/726319/JCVI_Statement_on_HPV_vaccination_2018.pdf
  16. National Health Service HPV vaccine overview. England, UK. [2020-1-13]. https://www.nhs.uk/conditions/vaccinations/hpv-human-papillomavirus-vaccine/ Accessed January 13, 2020.
  17. Public Health England. National Health Service Changes to the vaccine of the HPV immunisation programme. [2021-1-15]. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1005943/HPV_letter_changes_to_the_vaccine_of_the_HPV_immunisation_programme__July_2021.pdf
  18. The epidemiological and economic impact of a quadrivalent human papillomavirus vaccine (6/11/16/18) in the UK. Dasbach E.J., Insinga R.P., Elbasha E.H. Jul;2008 BJOG: An International Journal of Obstetrics & Gynaecology. 115(8):947–956. doi: 10.1111/j.1471-0528.2008.01743.x. doi: 10.1111/j.1471-0528.2008.01743.x. [DOI] [PubMed] [Google Scholar]
  19. Choi Yoon Hong, Jit Mark, Gay Nigel, Cox Andrew, Garnett Geoff P., Edmunds William John. Vaccine. 24. Vol. 28. Elsevier BV; Transmission dynamic modelling of the impact of human papillomavirus vaccination in the United Kingdom; pp. 4091–4102. [DOI] [PubMed] [Google Scholar]
  20. Comparison of two dose and three dose human papillomavirus vaccine schedules: cost effectiveness analysis based on transmission model. Jit M., Brisson M., Laprise J.-F., Choi Y. H. Jan 6;2015 BMJ. 350:g7584. doi: 10.1136/bmj.g7584. doi: 10.1136/bmj.g7584. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Comparing bivalent and quadrivalent human papillomavirus vaccines: economic evaluation based on transmission model. Jit M., Chapman R., Hughes O., Choi Y. H. Sep 27;2011 BMJ. 343:d5775. doi: 10.1136/bmj.d5775. doi: 10.1136/bmj.d5775. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Economic evaluation of human papillomavirus vaccination in the United Kingdom. Jit M., Choi Y. H., Edmunds W J. Jul 17;2008 BMJ. 337:a769. doi: 10.1136/bmj.a769. doi: 10.1136/bmj.a769. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Assessing the cost-effectiveness of HPV vaccination strategies for adolescent girls and boys in the UK. Datta Samik, Pink Joshua, Medley Graham F., Petrou Stavros, Staniszewska Sophie, Underwood Martin, Sonnenberg Pam, Keeling Matt J. Jun 24;2019 BMC Infectious Diseases. 19(1):552. doi: 10.1186/s12879-019-4108-y. doi: 10.1186/s12879-019-4108-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Cost-effectiveness evaluations of the 9-Valent human papillomavirus (HPV) vaccine: evidence from a systematic review. Mahumud Rashidul Alam, Alam Khorshed, Keramat Syed Afroz, Ormsby Gail M., Dunn Jeff, Gow Jeff. Jun 2;2020 PLoS One. 15(6):e0233499. doi: 10.1371/journal.pone.0233499. doi: 10.1371/journal.pone.0233499. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. An estimate of the public health impact and cost-effectiveness of universal vaccination with a 9-valent HPV vaccine in Germany. Largeron Nathalie, Petry Karl Ulrich, Jacob Jorge, Bianic Florence, Anger Delphine, Uhart Mathieu. 2017Expert Review of Pharmacoeconomics & Outcomes Research. 17(1):85–98. doi: 10.1080/14737167.2016.1208087. doi: 10.1080/14737167.2016.1208087. [DOI] [PubMed] [Google Scholar]
  26. Ng Siok Shen, Hutubessy Raymond, Chaiyakunapruk Nathorn. Vaccine. 19. Vol. 36. Elsevier BV; Systematic review of cost-effectiveness studies of human papillomavirus (HPV) vaccination: 9-Valent vaccine, gender-neutral and multiple age cohort vaccination; pp. 2529–2544. [DOI] [PubMed] [Google Scholar]
  27. Public health impact and cost-effectiveness of catch-up 9-valent HPV vaccination of individuals through age 45 years in the United States. Daniels Vincent, Prabhu Vimalanand S., Palmer Cody, Samant Salome, Kothari Smita, Roberts Craig, Elbasha Elamin. Jan 10;2021 Human Vaccines & Immunotherapeutics. 17(7):1943–1951. doi: 10.1080/21645515.2020.1852870. doi: 10.1080/21645515.2020.1852870. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Majed Laureen, Bresse Xavier, El Mouaddin Nadia, Schmidt Aurélie, Daniels Vincent J., Pavelyev Andrew, Levy-Bachelot Laurie, Elbasha Elamin. Vaccine. 2. Vol. 39. Elsevier BV; Public health impact and cost-effectiveness of a nine-valent gender-neutral HPV vaccination program in France; pp. 438–446. [DOI] [PubMed] [Google Scholar]
  29. Elbasha Elamin H., Dasbach Erik J., Insinga Ralph P. Emerging Infectious Diseases. 1. Vol. 13. Centers for Disease Control and Prevention (CDC); Model for assessing human papillomavirus vaccination strategies; pp. 28–41. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. An integrated economic evaluation and HPV disease transmission models: technical report accompanying the manuscript “Impact of vaccinating boys and men against HPV in the United States. Elbasha Elamin H., Dasbach Erik J. Oct;2010 Vaccine. 28(42):6858–6867. doi: 10.1016/j.vaccine.2010.08.030. doi: 10.1016/j.vaccine.2010.08.030. [DOI] [PubMed] [Google Scholar]
  31. Elbasha Elamin H., Dasbach Erik J. Vaccine. 42. Vol. 28. Elsevier BV; Impact of vaccinating boys and men against HPV in the United States; pp. 6858–6867. [DOI] [PubMed] [Google Scholar]
  32. The epidemiological and control implications of HIV transmission probabilities within partnerships. Rottingen JOHN-ARNE, Garnett GEOFFREY P. Dec;2002 Sexually Transmitted Diseases. 29(12):818–827. doi: 10.1097/00007435-200212000-00014. doi: 10.1097/00007435-200212000-00014. [DOI] [PubMed] [Google Scholar]
  33. Efficacy of quadrivalent HPV vaccine against HPV infection and disease in males. Giuliano Anna R., Palefsky Joel M., Goldstone Stephen, Moreira Edson D., Jr., Penny Mary E., Aranda Carlos, Vardas Eftyhia, Moi Harald, Jessen Heiko, Hillman Richard, Chang Yen-Hwa, Ferris Daron, Rouleau Danielle, Bryan Janine, Marshall J. Brooke, Vuocolo Scott, Barr Eliav, Radley David, Haupt Richard M., Guris Dalya. Feb 3;2011 New England Journal of Medicine. 364(5):401–411. doi: 10.1056/nejmoa0909537. doi: 10.1056/nejmoa0909537. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Garland Suzanne M., Hernandez-Avila Mauricio, Wheeler Cosette M., Perez Gonzalo, Harper Diane M., Leodolter Sepp, Tang Grace W.K., Ferris Daron G., Steben Marc, Bryan Janine, Taddeo Frank J., Railkar Radha, Esser Mark T., Sings Heather L., Nelson Micki, Boslego John, Sattler Carlos, Barr Eliav, Koutsky Laura A. New England Journal of Medicine. 19. Vol. 356. Massachusetts Medical Society; Quadrivalent vaccine against human papillomavirus to prevent anogenital diseases; pp. 1928–1943. [DOI] [PubMed] [Google Scholar]
  35. Palefsky Joel M., Giuliano Anna R., Goldstone Stephen, Moreira Edson D. Jr., Aranda Carlos, Jessen Heiko, Hillman Richard, Ferris Daron, Coutlee Francois, Stoler Mark H., Marshall J. Brooke, Radley David, Vuocolo Scott, Haupt Richard M., Guris Dalya, Garner Elizabeth I.O. New England Journal of Medicine. 17. Vol. 365. Massachusetts Medical Society; HPV vaccine against anal HPV infection and anal intraepithelial neoplasia; pp. 1576–1585. [DOI] [PubMed] [Google Scholar]
  36. Management of women with abnormal cervical cytology: treatment patterns and associated costs in England and Wales. Martin-Hirsch P., Rash B., Martin A., Standaert B. 2007BJOG. 114(4):408–415. doi: 10.1111/j.1471-0528.2007.01261.x. [DOI] [PubMed] [Google Scholar]
  37. Costs of detection and treatment of cervical cancer, cervical dysplasia and genital warts in the UK. Brown R. E., Breugelmans J. G., Theodoratou D., Bénard S. Mar;2006 Current Medical Research and Opinion. 22(4):663–670. doi: 10.1185/030079906x99972. doi: 10.1185/030079906x99972. [DOI] [PubMed] [Google Scholar]
  38. Wade R., Spackman E., Corbett M. Adjunctive colposcopy technologies for assessing suspected cervical abnormalities: the DYSIS colposcope with DYSISmap and the ZedScan. [2020-9-14]. https://www.nice.org.uk/guidance/dg32
  39. Keeping S.T., Tempest M.J. The broader burden of human papillomavirus: estimates of the cost of treating penile cancer in secondary care in England; Public Health England Conference; University of Warwick, Coventry, UK. [Google Scholar]
  40. The cost of anal cancer in England: retrospective hospital data analysis and Markov model. Keeping Sam T, Tempest Michael J, Stephens Stephanie J, Carroll Stuart M, Nugent Karen P, O'Dwyer Sarah T. Oct 31;2014 BMC Public Health. 14:1123. doi: 10.1186/1471-2458-14-1123. doi: 10.1186/1471-2458-14-1123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Coles VAH, Chapman R, Lanitis T, Carroll SM. International Journal of STD & AIDS. 1. Vol. 27. SAGE Publications; England, Scotland, Wales and Northern Ireland: The costs of managing genital warts in the UK by devolved nation: England, Scotland, Wales and Northern Ireland; pp. 51–57. [DOI] [PubMed] [Google Scholar]
  42. Hughes O.R., Tsikoudas A., Barr G.D. The burden of recurrent respiratory papillomatosis in the United Kingdom: results from the BAPO and ENT-UK National Survey; ORS Spring Meeting; London, UK. [Google Scholar]
  43. Verification of decision-analytic models for health economic evaluations: an overview. Dasbach Erik J., Elbasha Elamin H. Apr 29;2017 Pharmacoeconomics. 35(7):673–683. doi: 10.1007/s40273-017-0508-2. doi: 10.1007/s40273-017-0508-2. [DOI] [PubMed] [Google Scholar]
  44. National Institute for Health and Care Excellence NICE health technology evaluations: the manual. [2022-3-20]. https://www.nice.org.uk/process/pmg36/resources/nice-health-technology-evaluations-the-manual-pdf-72286779244741 Accessed March 20, 2022.
  45. Human papillomavirus vaccination and sexual behavior in young women. Rysavy Mary B., Kresowik Jessica D., Liu Dawei, Mains Lindsay, Lessard Megan, Ryan Ginny L. Apr;2014 Journal of Pediatric and Adolescent Gynecology. 27(2):67–71. doi: 10.1016/j.jpag.2013.08.009. doi: 10.1016/j.jpag.2013.08.009. [DOI] [PubMed] [Google Scholar]
  46. Marchand Erica, Glenn Beth A., Bastani Roshan. Journal of Community Health. 6. Vol. 38. Springer Science and Business Media LLC; HPV vaccination and sexual behavior in a community college sample; pp. 1010–1014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. HPV vaccination has not increased sexual activity or accelerated sexual debut in a college-aged cohort of men and women. Brouwer A.F., Delinger R.L., Eisenberg M.C., et al. 2019BMC Public Health. 19(1):821. doi: 10.1186/s12889-019-7134-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Economic analysis of vaccination programs: an ISPOR Good Practices for Outcomes Research Task Force Report. Mauskopf Josephine, Standaert Baudouin, Connolly Mark P., Culyer Anthony J., Garrison Louis P., Hutubessy Raymond, Jit Mark, Pitman Richard, Revill Paul, Severens Johan L. Oct;2018 Value in Health. 21(10):1133–1149. doi: 10.1016/j.jval.2018.08.005. doi: 10.1016/j.jval.2018.08.005. [DOI] [PubMed] [Google Scholar]
  49. Methods for health economic evaluation of vaccines and immunization decision frameworks: a consensus framework from a European vaccine economics community. Ultsch Bernhard, Damm Oliver, Beutels Philippe, Bilcke Joke, Brüggenjürgen Bernd, Gerber-Grote Andreas, Greiner Wolfgang, Hanquet Germaine, Hutubessy Raymond, Jit Mark, Knol Mirjam, von Kries Rüdiger, Kuhlmann Alexander, Levy-Bruhl Daniel, Perleth Matthias, Postma Maarten, Salo Heini, Siebert Uwe, Wasem Jürgen, Wichmann Ole. 2016Pharmacoeconomics. 34(3):227–244. doi: 10.1007/s40273-015-0335-2. doi: 10.1007/s40273-015-0335-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Walker Damian G., Hutubessy Raymond, Beutels Philippe. Vaccine. 11. Vol. 28. Elsevier BV; WHO guide for standardisation of economic evaluations of immunization programmes; pp. 2356–2359. [DOI] [PubMed] [Google Scholar]
  51. World Health Organisation WHO guide for standardisation of economic evaluations of immunization programmes. [2020-10]. https://apps.who.int/iris/bitstream/handle/10665/329389/WHO-IVB-19.10-eng.pdf [DOI] [PubMed]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Online Supplementary Material
Online Supplementary Material

Articles from Journal of Health Economics and Outcomes Research are provided here courtesy of Columbia Data Analytics, LLC

RESOURCES