Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Jun 2;15(6):e0233499. doi: 10.1371/journal.pone.0233499

Cost-effectiveness evaluations of the 9-Valent human papillomavirus (HPV) vaccine: Evidence from a systematic review

Rashidul Alam Mahumud 1,2,3,4,5,*, Khorshed Alam 1,2, Syed Afroz Keramat 1,2,6, Gail M Ormsby 7, Jeff Dunn 1,8,9, Jeff Gow 1,2,10
Editor: Magdalena Grce11
PMCID: PMC7266321  PMID: 32484811

Abstract

Introduction

The World Health Organization (WHO) recommends that human papillomavirus (HPV) vaccination programs are established to be cost-effective before implementation. WHO recommends HPV vaccination for girls aged 9–13 years to tackle the high burden of cervical cancer. This review examined the existing evidence on the cost-effectiveness of the 9-valent HPV vaccine within a global context.

Methods

The literature search covering a period of January 2000 to 31 July 2019 was conducted in PubMed and Scopus bibliographic databases. A combined checklist (i.e., WHO, Drummond and CHEERS) was used to examine the quality of eligible studies. A total of 12 studies were eligible for this review and most of them were conducted in developed countries.

Results

Despite some heterogeneity in approaches to measure cost-effectiveness, ten studies concluded that 9vHPV vaccination was cost-effective and two did not. The addition of adolescent boys into immunisation programs was cost effective when vaccine price and coverage was comparatively low. When vaccination coverage for females was more than 75%, gender neutral HPV vaccination was less cost-effective than vaccination targeting only girls aged 9–18 years. Multi cohort immunization approach was found cost-effective in the age range of 9–14 years. However, the upper age limit at which vaccination was found not cost-effective requires further evaluation. This review identified duration of vaccine protection, time horizon, vaccine price, coverage, healthcare costs, efficacy and discounting rates as the most dominating parameters in determining cost-effectiveness.

Conclusions

These findings have implications in extending HPV immunization programs whether switching to the 9-valent vaccine or the inclusion of adolescent boys’ vaccination or extending the age of vaccination. Further, this review also supports extending vaccination programs to low-resource settings where vaccine prices are competitive, donor funding is available, burden of cervical cancer is high and screening options are limited.

Introduction

Cervical cancer (CC) is the third most common cancer and the leading cause of cancer-related deaths in women worldwide [1]. Approximately 570,000 new cases of CC were diagnosed in 2018, composing 6.6% of all cancers in women [1]. The burden of CC is an alarming issue across the globe, especially in low-and middle-income countries (LMICs). Approximately 85% of CC cases and 90% of deaths from CC occur in LMICs [1]. Persistent infections with human papillomavirus (HPV) are a key cause of CC and is an established carcinogen of CC [2]. HPV is predominantly transmitted to women of reproductive age through sexual contact [3]. Most HPV infections are transient and can be cleared up within a short period, usually a few months after their acquisition. However, untreated HPV infections can continue and evolve into cancer in some cases. There are more than 100 types of HPV infections, and high-risk types develop into CC [4]. Thirteen high-risk HPV genotypes are known to be predominantly responsible for malignant and premalignant lesions of the anogenital area [5], and these are the leading causes of most aggressive CC [6]. Further, HPV is also responsible for the majority of anogenital cervical cancers, including anal cancers (88%), vulvar cancers (43%), invasive vaginal carcinomas (70%), and all penile cancers (50%) globally [4].

The burden of CC (i.e., high incidence and mortality rates) globally is preventable through the implementation of a primary prevention strategy such as vaccination [1]. There are vaccines that can protect common cancer-causing types of HPV and reduce the risk of CC significantly. Three types of HPV vaccines, namely bivalent (Cervarix), quadrivalent (Gardasil) and 9-valent vaccine (Gardasil-9), are currently available in the market. Unfortunately, as of March 2017, only 71 countries (37% of all countries) have included HPV vaccines in their national immunization programs for girls, and 11 countries (6%) included for both sexes [2]. The first global recommendation on HPV vaccination was proposed by the World Health Organization’s Strategic Advisory Group of Experts on Immunization in October 2008 [7], where HPV vaccination was recommended for girls aged 9–13 years. This recommendation was updated in April 2014 [8], with the emphasis to include extended 2-dose HPV immunization for girls aged 9–14 years, who were not immune compromised. With the recent licensing of the 9-valent vaccine and the introduction of various HPV vaccination strategies, an update on the current recommendations of HPV vaccination are inevitable. The goals of the immunisation program are to combat the acquisition and spread of HPV infections, and achieving optimum coverage through effective delivery systems. According to the underlying distribution of HPV infection types of CC, the 9vHPV vaccine builds population-level strong immunity against HPV-6, 11, 16, 18, 31, 33, 45, 52, and 58 infections [5] that cumulatively contributed approximately 89% of all CCs globally [9]. With respect to the primary prevention of HPV infection, it is expected that the 9vHPV vaccine can reduce the lifetime risk of diagnosis with CC by an additional 10% in immunised cohorts compared with the 4vHPV vaccine and by an additional 52% in non-vaccinated cohorts [10].

This review aims to update the current evidence on the economic viability of HPV vaccination. In addition, this study aims to examine the cost-effectiveness of the 9-valent vaccine when boys are included and when age cohorts are varied, from the global context. This review may be used as comprehensive evidence of general trends on the ongoing cost-effectiveness evaluation of HPV vaccine.

Materials and methods

Study design

Published original academic literature that examined the cost-effectiveness of 9vHPV vaccination were included in this systematic review. A wide type of study perspectives including societal and health systems perspectives were employed. A search strategy was adopted considering all countries regardless of perspective or vaccine delivery strategy. A combined WHO [11], Drummond [12] and CHEERS [13] checklist was used to evaluate the quality of included studies.

Search strategy and sources

A literature search for the period of January 2000 to 31 July 2019 was conducted using PubMed and Scopus bibliographic databases. This study searched for articles with no language restrictions. The literature search was performed by searching Scopus and PubMed databases to identify relevant articles following the inclusion criteria. Search inclusion terms included ‘economic evaluation’, ‘cost-effectiveness’, ‘analysis’, ‘human papillomavirus’, ‘HPV’, ‘vaccine’, ‘vaccinated’, ‘vaccination’, ‘cervical cancer’, ‘non-valent’, ‘9 or nine-valent’ (Appendix A). Reference lists for selected studies were checked to identify relevant studies for inclusion.

Study selection

Three authors (RAM, SAK and GMO) of the review team independently examined the titles and abstracts of the articles that met the selection criteria. The existing academic literature in the cost-effectiveness of 9vHPV vaccination was searched. Language restrictions were not applied. The eligibility of studies for inclusion was determined following a three-stage screening process. The first stage involved screening studies by title to eliminate duplicates. The second stage required the reading of abstracts to determine their relevance to this study. The third stage necessitated the reading of full texts of the retained studies as reflected in Fig 1. RAM carried out and recorded the above process, and shared the record with SAK and GMO for verification. Discrepancies were discussed and resolved by consensus.

Fig 1. PRISMA flow-chart for systematic review of studies.

Fig 1

Data checking

The study strategy followed a number of checks to ensure consistency of approach, including a discussion about discrepancies within the study team. For each outcome and model input parameters, the authors identified the proportion of missing observations. Datasets were combined to form a new master dataset where model input assumptions and outcome-related parameters used in the original studies were included. Further, three authors independently assessed the analytical quality of the preliminary selected studies using appropriate tools for examining risk of bias. Disagreements on inclusions were resolved by discussion with a third review author.

Data extraction (selection and coding)

The study selection process was conducted following the PRISMA guidelines [14]. Data were extracted to develop a comprehensive data matrix which summarises the study characteristics such as authors, settings, perspective, threshold, outcome-related parameters and other necessary information.

Strategy for data synthesis

Three authors (RAM, SAK and GMO) independently reviewed the titles and abstract. Data from all eligible studies were extracted by the same two authors using a standardized data collection form. A matrix was developed to summarise the characteristics and findings of the studies. Studies were characterized by incorporating four themes: (i) study used 9vHPV vaccine to examine the cost-effectiveness, (ii) target population demographic characteristics (e.g., gender-neutral and multiple age cohort immunisation), (iii) study perspectives, model and economic level of each country, and (iv) model input and outcome-related parameters.

To compare findings across the selected studies, incremental cost-effectiveness ratios (ICERs) and standardized cost-effectiveness were outlined. In terms of standardized cost-effectiveness scenarios, these studies used the heuristic cost-effectiveness threshold guided by the WHO [15], wherein an intervention or program was evaluated to be cost-effective if the ICER/DALYs averted was less than three times a country’s annual per capita Gross Domestic Product (GDP). Further, the WHO constructed three broad decision rules: (i) an intervention or program was recommended as very cost-effective if ICER/DALYs averted <1 time GDP threshold; (ii) cost-effective if ICER/DALYs averted ≥ 1 time GDP threshold and ≤ 3 times GDP threshold; and (iii) not cost-effective if ICER/DALYs averted >3 times GDP threshold [16]. Examining whether an ICER offered by any strategy signifies value for money requires comparison to a cost-effectiveness threshold (CET). The CET refers to the health effects foregone (i.e., opportunity costs) related to resources being devoted to an intervention and consequentially being unavailable for other health-care priorities. Policy makers should be willing to invest their limited resources in the strategy offering the greatest health gains. The review may serve as an important evidence with respect to methodological and current practices of cost-effectiveness evaluation studies such as determination of study research questions; the study perspective adopted, the duration of vaccine protection, time horizon and discount rate; explanation of model performed for data analysis; model input assumptions behind the estimation of associated costs and outcome parameters; reporting of ICERs; most dominant parameters of sensitivity analysis; examination of study conclusions and recommendations as well as financial disclosure of the selected studies.

Study characteristics

Four hundred and eighty-one articles were yielded through the primary search, of which 78 articles were discarded because of duplication. Fifty-one articles were considered for full-text review after screening by title and abstract. Of these, 12 articles were eligible for the final review (Table 1). Three hundred fifty-two articles were excluded from this study following the inclusion criteria. The reasons for exclusion were: conference abstract (n = 58), reviews or editorials or commentary (n = 160), not cost-effectiveness evaluations (n = 60), did not use 9-valent vaccine (4v-HPV, 2v-HPV; n = 72) and insufficient information (n = 2). Finally, 12 articles were included in this review (Fig 1).

Table 1. Characteristics of twelve included cost-effectiveness studies of 9vHPV vaccination.

Characteristics Number of studies (n) Percentage (%)
Selected articles 12 100
Year of publication
    2014 2 17
    2016 7 58
    2017 2 17
    2018 1 8
Name of Journal
    BMC Infectious Diseases 2 17
    Cost Effectiveness and Resource Allocation 1 8
    Expert Review of Pharmacoeconomics & Outcomes Research 1 8
    Human Vaccines & Immunotherapeutics 1 8
    International Journal of Cancer 1 8
    The Lancet Public Health 1 8
    PLoS ONE 1 8
    The Journal of Infectious Diseases 2 17
    Vaccine 1 8
    Journal of the National Cancer Institute 1 8
Study setting
    Australia 1 8
    Austria 1 8
    Canada 1 8
    China 1 8
    Germany 1 8
    Italy 1 8
    Kenya and Uganda 1 8
    United States 5 42
Main location of first author
    Research institute 8 67
    Research group 1 8
    Hospital or University 3 25
Conflict of interest
    Yes 6 50
    No 6 50

Settings and funding

Single country studies mostly focused on high-income settings [4,17,2628,1825] (Table 2). However, a single study was found that covered two low-income countries (e.g., Kenya and Uganda) [29]. Eight studies were funded by research organisations [4,17,19,2124,29], while two studies did not state funding sources [20,27]. The Bill and Melinda Gates Foundation was the sole funder of one study [29] and three studies were funded by the Centre for Disease Control (CDC) [21,24,27]. Further, five studies were conducted in United States [20,22,24,27,28], one study was conducted in each of Germany [23], Italy [4], China [18], Australia [25], Austria [17], and Canada [19]. Low resource countries mostly depend on external funding agency for HPV vaccine programs, hence these countries may have less impetus for cost-effectiveness studies to inform local decision making as priorities are driven by external considerations.

Table 2. Characteristics of the selected studies.

Author Study settings Economic category Target age cohort Sex of cohort Vaccine delivery route No of doses Type of model Threshold Perspective Time horizon (year) Discount rate Sensitivity analysis Most sensitive parameter
Kiatpongsan et al. [29] Kenya and Uganda LMIC 9 years Female NIP 3 Static GDP and WTP Societal ns 3% One-way Discount rate
Laprise et al. [22] United States HI 9–14 years Female NIP 2 & 3 Dynamic WTP Societal 100 3% One-way Vaccine efficacy, screening method, and healthcare costs, vaccine coverage
Largeron et al. [23] Germany HI 12–17 years Female SHI plans 2 Dynamic WTP Societal 100 3% One-way Discounted rate, vaccine price
Mennini et al. [4] Italy HI 12 years Female NIP 2 Dynamic WTP Health system 100 3% One-way Vaccine price
Mo et al. [18] China MI 12 years Female NIP 3 Markov GDP and WTP Health system 3% One-way
Simms et al. [25] Australia HI 12 years Female NIP 2 Dynamic WTP Health system 20 5% One-way Vaccine price and vaccine duration of
protection
Boiron et al. [17] Austria HI 9 years Gender-neutral Universal 2 Dynamic WTP & GDP Health system 100 3% One-way Discount rates and duration of protection
Brisson et al. [24] United States HI 9 years Gender-neutral Universal 3 Dynamic WTP Societal 70 3% One-way Vaccine price
Chesson et al. [27] United States HI Female: 12 to 26 years, and male:12 to 21 years Gender-neutral NIP 3 Dynamic WTP Societal 100 3% One-way Vaccine price, Time horizon
Chesson et al. [28] United States HI Female:13-18years female NIP 3 Dynamic WTP Societal 100 3% One-way, Multi-way Vaccine price
Chesson et al. [20] United States HI Female: 12 to 26 years, and male:12 to 21 years Gender-neutral NIP 3 Dynamic WTP Health system 100 3% One-way, Multi-way Vaccine price
Drolet et al. [19] Canada HI 10 years Female NIP 3 Static GDP Societal 70 3% One-way, Multi-way Duration of protection, vaccine efficacy, vaccine price, discount rate

SHI = Statutory health insurance plans, NIP = National Immunisation Program, WTP = Willingness to pay

Study questions

Most studies (8 out of 12 studies) investigated the cost-effectiveness of introducing 9vHPV vaccination to preadolescent girls aged 12 or younger [4,1719,22,2426,29]. Four studies assessed vaccinating 12 years or older girls [20,23,27,28]. All studies investigated vaccination either as an addition to existing screening programs or (more commonly) as opportunistic preventive programs or none at all. Further, most studies considered a range of vaccination and screening options to find the most cost-effective combination.

Analytical model

Nine studies used a dynamic economic model for examining the cost-effectiveness of HPV vaccination programs [4,17,27,28,18,2026], two studies used a static model [19,29], and one study used a Markov model for analytical exploration [18] (Table 2). However, some studies did not explicitly account for the pathologic transition from HPV-acquisition to HPV-associated disease [4,18,25,27,28], pathologic transition [4,23] and herd immunity [17,19,20,24,27,28].

Thresholds and perspectives

In terms of the cost-effectiveness scenario, four studies used the heuristic cost-effectiveness threshold proposed by the WHO. These studies used either one or three times GDP per capita [18,19,24,29]. The majority of studies adopted local thresholds (e.g., willingness to pay) while three studies considered both thresholds of GDP per capita and willingness to pay [18,24,29]. Apart from these studies, seven studies undertook an evaluation from a societal perspective [19,2224,2729], and four studies utilised the health system perspective [4,18,20,25]. Several studies used the societal perspective and included all vaccination costs, relevant direct medical costs, and gains in quality and length of life without considering who incurred the costs or who received the benefits (Table 2). However, these selected studies reported little about the indirect costs and productivity losses which are significant from the societal perspective.

Vaccine coverage

The assumptions on vaccine coverage are significant in influencing the potential impact of HPV vaccine on HPV related diseases. Four selected studies assumed a vaccination coverage rate of 90% or above [18,22,23,29]. The vaccine coverage might be varied in terms of study settings as well as from a gender point of view. Among the selected studies, three studies considered vaccine coverage rates of 26–60% for females and 25–40% for males [17,27,28], and three studies considered a 46–80% vaccine coverage rate [19,20,25]. Three studies grouped vaccination coverage rate by gender, assumed 25–60% for females and 11–40% for males [24,27,28]. The remaining studies did not specify the vaccination coverage rate [24].

Vaccine efficacy

Most studies considered a vaccine efficacy rate ranged from 95–100% against HPV infections except the study of Simms et al. (2016) [25], which considered a vaccine efficacy rate of only 59%. The study conducted in two East African countries (Kenya and Uganda) used a 100% vaccine efficacy rate in case of 9vHPV [29]. Most studies (n = 10/12) used a 95% vaccine efficacy rate [4,17,27,28,1824,26].

Number of vaccine dose and delivery route

Eight studies used a three-dose schedule of 9vHPV vaccine. Most studies were conducted in developed countries [1821,24,2729] and the other two studies were conducted in low- and middle-income countries (LMICs) [18,29]. Further, one study conducted in the United States [21] used both 2- and 3-dose vaccines. Diverse vaccine delivery routes were evidenced across the selected studies. Nine studies used the vaccine delivery route of a national immunisation program for the target population [4,1821,25,2729]. Two studies conducted in Austria [17] and United States [24], used a universal immunisation strategy to deliver the vaccine. Only one cost-effectiveness exploration of 9vHPV vaccine was conducted in Germany [23] and it used a vaccine delivery route through social health insurance.

Duration of vaccine protection, herd immunity effect, and discounting rate

Most studies (11/12) assumed lifelong vaccine protection while only one study assumed a shorter duration of protection of 20 years [19]. Half of the studies specified herd immunity due to vaccination [17,19,20,24,27,28]. The remaining six studies did not consider the indirect effect of vaccination. Regarding the discount rate, majority of the studies (11/12) used 3% discount rate, while one study considered a 5% discount rate to adjust for future values in terms of economic value and health outcome [25].

Quality of included studies

The quality scores were assigned using the Consensus Health Economic Criteria (CHEC) list, a checklist that can be used to critically evaluate published economic evaluations [30]. Table 3 showed the extent to which the reviewed studies followed the standards of reporting economic evaluations based on the WHO guidance [11], Drummond [12] and the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) [13]. All studies clearly identified the study question, intervention(s), comparator(s) perspectives, time horizon and discounting rates. Most studies performed sensitivity analyses (11/12; 92%) to assess the robustness of concerned study findings. Most studies clearly described the measurements and the assumptions for measuring the costs (11/12, 92%). The choice of model used was justified in all studies, where dynamic transmission model was adopted to capture herd immunity. The currency and price data were also reported in all studies. 10 (83%) out 12 studies disclosed the funding sources. However, only 8 studies (67%) reported the measurement of effectiveness from synthesis-based estimates, either through the combination of several randomized trials or the use of systematic reviews.

Table 3. Extent to which included studies met standard reporting recommendations.

Explained recommendations Number of studies fulfilling Percentage (%)
Research question or objective clearly stated 10/12 83
Described intervention and comparator 10/12 83
Exploration of effectiveness reported 11/12 92
    Single study-based estimates 8/12 67
    Synthesis-based estimates 10/12 83
Assumption of costs and outcomes specified 11/12 92
Currency and price data reported 12 100
Choice of model justified 12 100
Perspective specified 12 100
Time horizon specified 12 100
Discounting rates specified 12 100
Calculated and reported ICER or cost-saving 12 100
Sensitivity analysis performed 11/12 92
Conclusions follow from the data reported 12 100
Disclosed funding source(s) 10/12 83

Results

Ten studies concluded that their evaluation of 9vHPV vaccination was found to be cost-effective (Table 4) while the remaining two studies did not find cost-effectiveness [27,28]. Further, five studies exhibited a ‘very cost-effective’ decision [4,18,19,23,29] and four studies found ‘cost-savings’ [17,22,24,27]. In the context of high-income countries (e.g., Canada and Austria), introduction of 9vHPV vaccination was a cost-effective decision to prevent cervical cancer in adolescent girls, as the incremental cost of vaccine was less than US$23-US$47. However, in low and middle-income countries (e.g., Kenya and Uganda), the ICER of 9vHPV vaccine must not be priced over US$8.40-US$9.80 [19,29]. Two US based studies concluded that the cost-effectiveness exploration of 9vHPV vaccine was more likely to be ‘cost-saving’ regardless of cross-protection assumption [24,27]. Most studies used ‘quality-adjusted life year’ (QALYs) as the unit of measurement. In addition, selected studies explored the cost-effectiveness decision using WTP thresholds that depend on country settings. Cost-effectiveness decision differs with country specific vaccine prices. For example, two studies conducted in the US, considered two different vaccine prices per dose, US$162.74 and US$174, respectively. However, both studies confirmed that the introduction of 9vHPV vaccine was not cost-effective. Four studies reported cost-effectiveness of 9vHPV vaccine for gender-neutral approaches [17,20,24,27] and three studies found it a ‘cost-effective’ or ‘cost-saving’ decision [17,24,27]. The remaining eight studies suggested vaccinating girls only. In terms of key drivers of cost-effectiveness, this review identified duration of vaccine protection [17,19,25], time horizon [28], vaccine price [4,19,20,2325,27,28], healthcare costs [22], vaccine efficacy [19,22], vaccine coverage [19,22] and discounting rates [17,19,23,29] as the most influential parameters.

Table 4. Summary of the results of the selected studies.

Author Vaccine efficacy Vaccine coverage Duration of vaccine protection Herd effect Vaccine price per dose Unit of cost-effectiveness GDP per capita Incremental cost-effectiveness ration (ICER) Conclusion or recommendation Study funder
Kiatpongsan et al. [29] 100% 100% Lifetime No US$ 90.25 QALYs Kenya = $1,349.97, Uganda = $ 674.05 Very cost-effective if additional cost of 9vHPV vaccine per course ≤ $9.8 in Kenya & ≤ 8.4 in Uganda Very cost-effective for both countries (Kenya & Uganda) The Bill and Melinda Gates Foundation
Laprise et al. [22] 95% 90% Lifetime No US$ 158 QALYs   Cost saving to US$ 500 Cost saving CDC
Largeron et al. [23] 96% 90% Lifetime No € 140 QALYs £30,000 € 329 / QALY Highly cost-effective Sanofi Pasteur MSD (SPMSD).
Mennini et al. [4] 96% 90% lifelong No € 80.00 QALYs € 40,000 € 10,463 / QALY Highly cost-effective Sanofi Pasteur MSD
Mo et al. [18] 96.7% 20% lifetime No USD 149.03 QALYs USD 23,880 US$ 5,768 / QALY Highly cost-effective with screening 1 + 9vHPV,—Cost-effective with screening 2 + 9vHPV The Japan Society for the Promotion of Sciences, the National Centre for Child Health and Development, and the Chinese Natural Sciences Foundation
Simms et al. [25] 59% 70% lifelong No ns QALYs AUD 30,000 Cost-effectiveness if the additional cost per dose is US$18–28 Cost-effective National Health and Medical Research Council, Australia
Boiron et al. [17] 98% Female: 60% Male: 40% Lifelong Yes US$ 147.15 QALYs US$ 44,767.35 Cost-saving at vaccine price up to US$ 166.77 Cost-saving Sanofi Pasteur MSD
Brisson et al. [24] 95.0% Not stated Lifelong Yes US$ 158 QALYs US$ 48,373.88 Cost-saving regardless of cross-protection assumptions Cost-saving if additional cost of vaccine per dose < US$ 13 CDC, Canadian Research Chair Program
Chesson et al. [27] 95.0% Female: 25.8% Male: 11.7% Lifelong Yes US$ 162.74 QALYs US$ 52,787.03 Cost-saving regardless of cross-protection assumptions (<$0) Cost-saving Not stated
Chesson et al. [28] 95.0% Female: 46% Male: 25% Lifelong Yes US$ 162.74 QALYs US$ 52,787.03 US$ 111,446 / QALY Not cost-effective CDC, Canada Research Chair Program, Canadian Institute for Health Research
Chesson et al. [20] 95.0% 46% Lifelong Yes US$ 174 QALYs US$ 52,787.03  US$ 228,800 / QALY Not cost-effective Not stated
Drolet et al. [19] 95.0% 80% 20years Yes US$ 90.25 QALYs US$ 50,440.44 US$ 11,593 /QALY Very cost-effective if additional cost of vaccine per dose ≤ US$ 22.80 Canadian Research Chair Program

Discussion

The HPV vaccination is one of the cornerstones of CC prevention worldwide. This study explored the cost-effectiveness of 9vHPV vaccination by reviewing 12 cost-effectiveness evaluations in order to inform and expand knowledge on the cost-effectiveness of 9vHPV vaccines. Most studies were conducted from a developed country perspective and two studies were performed from a LMIC perspective. However, a higher incidence of cervical cancer in LMICs is a serious public health concern, which warrants more evidence for effective decision making [31]. The economic viability of gender-neutral 9vHPV vaccination was confirmed by three studies [17,24,27]. Cost-effectiveness exploration depends on the coverage of vaccination from the perspective of gender. For example, if the vaccine coverage for female recipients is 80% or above, the majority of the anogenital CC including vulvar cancers, invasive vaginal carcinomas cancers in females could be prevented. As a result, introduction of 9vHPV vaccination for boys is relatively less important compared with girls as high economic costs are involved without additional benefits gained, both from the societal and health system perspectives. Therefore, achieving optimal coverage of vaccination in females should remain a priority. This is of primary significance for LMICs settings since it is more effective and economically viable to prevent CC in females. However, it is also important to note that past studies paid little attention to the broader benefits of vaccination among male cohorts to prevent penile, anal, and oropharyngeal cancers. Exclusion of these diseases related to males may undermine the effectiveness of reducing CC. Gender-neutral vaccination might have several benefits including herd protection for boys. Moreover, it may provide indirect protection to unvaccinated women and direct protection to homosexual men. Therefore, this vaccination strategy should be further considered in country-level immunization programs by underlining other parameters including disease burden, sexual behaviour in a country (e.g., homosexual intercourse), equity, budget impact, and affordability.

Despite different methodologies and various assumptions, most studies were consistent in their conclusion that multiple age cohort vaccination was economically viable. Nevertheless, there was an upper age limit at which HPV vaccination was no longer cost-effective, and should be interpreted cautiously as several studies evaluated the cost-effectiveness in a single age range only and did not compare to the next age range in a progressive manner. Subsequently, this could result in an overestimation of the cut-off age range for vaccination. The protection duration from vaccination has a large impact on the cost-effectiveness of multi-cohort vaccination, with most studies assuming life-long protection. Therefore, the use of ICERs based on the conventional evaluation of 10-year protection may be more representative of real-life effectiveness rather than the use of ICER based on lifetime protection. The cost-effectiveness of HPV vaccination is also dependent upon the levels of vaccine coverage, compliance, and vaccine price.

Most studies presumed a high rate of vaccination coverage, e.g., assumed that 70% of the target population will receive full doses of vaccination. However, not everyone completed full doses (i.e., two or three doses) within the recommended time frame. Therefore, cost-effectiveness evaluation may underestimate or overestimate the actual costs and benefits. The analytical model outcomes in terms of herd immunity is only hypothetical unless the coverage level increases among the study cohort. Further, it is also indeterminate how non-compliance may consequently influence vaccine efficacy, effectiveness and duration of protection. Model input assumptions regarding the 9vHPV vaccine price also influence the observed cost-effectiveness outcomes. Prices for 9vHPV vaccine are currently not specified, particularly, in lower-income countries. Hence, the cost-effectiveness of 9vHPV vaccine is still indeterminate and there is no exclusive evidence of greater cost-effectiveness than the older licensed HPV vaccines.

Therefore, once the 9-valent vaccine price is fixed, including support by the GAVI vaccine-alliance, reassessment of cost-effectiveness of 9vHPV vaccine is necessary. Another model input assumption that may influence the cost-effectiveness is the inclusion or exclusion of herd immunity effects based on the type of model acceptance. Two studies [19,29] constituted the static model as an analytical exploration which did not confirm herd immunity effects. Generally, the cost-effectiveness evaluations of HPV vaccine should use a dynamic model for exploration because economic evaluations for primary prevention strategy should be determined by societal benefits (e.g., indirect impacts on population not immunised) rather than individual demands [32]. However, the application of a static model in these two studies may underestimate or overestimate the benefits of vaccination. If an HPV vaccination program is exhibited to be cost-effective considering a static model for analytical exploration, it is anticipated to be even very cost-effective when a dynamic model is considered [32].

There are several types of cost-effectiveness threshold. The majority of the studies used the cost-effectiveness demand side-threshold (e.g. willingness-to-pay). In health-related explorations, a willingness-to-pay threshold signifies an evaluation of what a consumer of health care might be prepared to pay for the health benefit–given other competing demands on that consumer’s resources. There are also supply-side thresholds that resource allocation mechanism takes into account. For example, estimates of health status are predetermined since when an insurance company or other provider spends some of its available budget on a new intervention it is therefore required to decrease its funding of previous interventions. In considering the choice of the type of cost-effectiveness threshold to use, the concept of opportunity cost may be the one most relevant to providers who are primarily concerned with using available resources to maximise improvements in health status. In response to the implementation of a new intervention, decision-makers need estimates of both the health that might be gained elsewhere through the alternative use of the resources needed for the new intervention and the health that is likely to be lost if the new intervention is not used.

This review has some limitations. The cost-effectiveness evaluation based on GDP based thresholds of 1–3 times of GDP per capita might be misleading for country-level decision making due to a lack of country specific thresholds [33]. It is uncertain whether this threshold truly reflects the country’s affordability or societal willingness to pay for additional health gains. Additionally, GDP is originally intended to measure the experience of people residing in urban areas and thus it may not actually reflect the experience of the entire population in a country, especially those living in rural areas. Apart from an economic standpoint, other factors should be considered for the national immunization program, such as budget availability, political issues, cultural influences and availability of healthcare workforce.

Conclusions

There are a limited number of studies that showed conclusive evidence of cost-effectiveness of the 9vHPV vaccine. The inclusion of adolescent males in HPV vaccination programs is cost-effective subject to vaccine price or coverage of females being low and HPV-associated male diseases are taken into account. Multiple age cohort vaccination strategy is likely to be cost-effective in the age range of 9–14 years, but the upper age limit at which HPV vaccination is no longer cost-effective requires further investigation. Vaccine coverage, price, duration of protection and discount rates are important parameters for considering the uptake of HPV vaccination. Nonetheless, the present study findings may serve as useful evidence for health policy-makers and healthcare providers in taking decision about HPV national immunization programs using the new 9vHPV vaccine or inclusion of adolescent boys’ for vaccination or extending the age of immunization.

Supporting information

S1 Checklist

(DOC)

S1 Appendix

(DOCX)

S1 Data

(DTA)

Acknowledgments

We would like to gratefully acknowledge the study participants and reviewers and editors of our manuscript.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.World Health Organization (WHO). National cancer contro programmes: Cervical cancer statistics. 2019 [cited 29 Aug 2019]. Available: https://www.who.int/cancer/prevention/diagnosis-screening/cervical-cancer/en/
  • 2.Forman D, Lortet-Tieulent J, de Martel C, Ferlay J, Franceschi S, Plummer M, et al. Global burden of human papillomavirus and related diseases. Vaccine. 2012;30: F12–F23. 10.1016/j.vaccine.2012.07.055 [DOI] [PubMed] [Google Scholar]
  • 3.Centers for Disease Control (CDC). Genital HPV infection—fact sheet. Centers for disease control and prevention. 2015 [cited 14 Feb 2019]. Available: http://www.cdc.gov/std/hpv/stdfact-hpv.htm
  • 4.Mennini FS, Bonanni P, Bianic F, Waure C, Baio G, Plazzotta G, et al. Cost-effectiveness analysis of the nine-valent HPV vaccine in Italy. Cost Eff Resour Alloc. 2017;15: 1–14. 10.1186/s12962-017-0063-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Guan P, Howell-Jones R, Li N, Bruni L, De Sanjosé S, Franceschi S, et al. Human papillomavirus types in 115,789 HPV-positive women: A meta-analysis from cervical infection to cancer. Int J Cancer. 2012;131: 2349–2359. 10.1002/ijc.27485 [DOI] [PubMed] [Google Scholar]
  • 6.Li N, Franceschi S, Howell-Jones R, Snijders PJF, Clifford GM. Human papillomavirus type distribution in 30,848 invasive cervical cancers worldwide: Variation by geographical region, histological type and year of publication. Int J Cancer. 2011;128: 927–935. 10.1002/ijc.25396 [DOI] [PubMed] [Google Scholar]
  • 7.World Health Organization (WHO). Human papillomavirus vaccines: WHO position paper. Wkly Epidemiol Rec. 2009;84: 118–131. [PubMed] [Google Scholar]
  • 8.World Health Organization (WHO). Human papillomavirus vaccines: WHO position paper, October 2014. Wkly Epidemiol Rec. 2014;89: 465–491. [PubMed] [Google Scholar]
  • 9.Serrano B, Alemany L, Tous S, Bruni L, Clifford GM, Weiss T, et al. Potential impact of a nine-valent vaccine in human papillomavirus related cervical disease. Infect Agent Cancer. 2012;7: 1–13. 10.1186/1750-9378-7-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Simms KT, Laprise JF, Smith MA, Lew J Bin, Caruana M, Brisson M, et al. Cost-effectiveness of the next generation nonavalent human papillomavirus vaccine in the context of primary human papillomavirus screening in Australia: A comparative modelling analysis. Lancet Public Heal. 2016;1: e66–e75. 10.1016/S2468-2667(16)30019-6 [DOI] [PubMed] [Google Scholar]
  • 11.Walker DG, Hutubessy R, Beutels P. WHO Guide for standardisation of economic evaluations of immunization programmes. Vaccine. 2010;28: 2356–2359. 10.1016/j.vaccine.2009.06.035 [DOI] [PubMed] [Google Scholar]
  • 12.Drummond MF, Jefferson T. Guidelines for authors and peer reviewers of economic submissions to the BMJ. The BMJ economic evaluation working party. BMJ. 1996;313: 275–83. 10.1136/bmj.313.7052.275 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated health economic evaluation reporting standards (CHEERS)-explanation and elaboration: A report of the ISPOR health economic evaluation publication guidelines good reporting practices task force. Value Heal. 2013;16: 231–250. 10.1016/j.jval.2013.02.002 [DOI] [PubMed] [Google Scholar]
  • 14.Moher Bd, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009;6: e1000097 10.1371/journal.pmed.1000097 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.WHO Commission on Macroeconomics and Health. Macroeconomics and health: Investing in health for economic development. Report of the Commission on Macroeconomics and Health. 20 Avenue Appia, 1211 Geneva 27, Switzerland; 2001. Available: http://whqlibdoc.who.int/publications/2001/924154550x.pdf
  • 16.Edejer TT-T, Baltussen R, Adam T, Hutubessy R, Acharya A, Evans D., et al. Making choices in health: WHO guide to cost-effective analysis. 20 Avenue Appia, 1211 Geneva 27, Switzerland; 2003. Report No.: 9241546018.
  • 17.Boiron L, Joura E, Largeron N, Prager B, Uhart M. Estimating the cost-effectiveness profile of a universal vaccination programme with a nine-valent HPV vaccine in Austria. BMC Infect Dis. 2016;16: 1–15. 10.1186/s12879-015-1330-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Mo X, Gai Tobe R, Wang L, Liu X, Wu B, Luo H, et al. Cost-effectiveness analysis of different types of human papillomavirus vaccination combined with a cervical cancer screening program in mainland China. BMC Infect Dis. 2017;17: 1–12. 10.1186/s12879-016-2122-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Drolet M, Laprise JF, Boily MC, Franco EL, Brisson M. Potential cost-effectiveness of the nonavalent human papillomavirus (HPV) vaccine. Int J Cancer. 2014;134: 2264–2268. 10.1002/ijc.28541 [DOI] [PubMed] [Google Scholar]
  • 20.Chesson HW, Meites E, Ekwueme DU, Saraiya M, Markowitz LE. Cost-effectiveness of nonavalent HPV vaccination among males aged 22 through 26 years in the United States. Vaccine. 2018;36: 4362–4368. 10.1016/j.vaccine.2018.04.071 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Laprise JF, Drolet M, Boily MC, Jit M, Sauvageau C, Franco EL, et al. Comparing the cost-effectiveness of two- and three-dose schedules of human papillomavirus vaccination: A transmission-dynamic modelling study. Vaccine. 2014;32: 5845–5853. 10.1016/j.vaccine.2014.07.099 [DOI] [PubMed] [Google Scholar]
  • 22.Laprise JF, Markowitz LE, Chesson HW, Drolet M, Brisson M. Comparison of 2-dose and 3-dose 9-valent human papillomavirus vaccine schedules in the United States: A cost-effectiveness analysis. J Infect Dis. 2016;214: 685–688. 10.1093/infdis/jiw227 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Largeron N, Petry KU, Jacob J, Bianic F, Anger D, Uhart M. An estimate of the public health impact and cost-effectiveness of universal vaccination with a 9-valent HPV vaccine in Germany. Expert Rev Pharmacoeconomics Outcomes Res. 2017;17: 85–98. 10.1080/14737167.2016.1208087 [DOI] [PubMed] [Google Scholar]
  • 24.Brisson M, Laprise JF, Chesson HW, Drolet M, Malagón T, Boily MC, et al. Health and economic impact of switching from a 4-Valent to a 9-valent HPV vaccination program in the United States. J Natl Cancer Inst. 2016;108: 1–9. 10.1093/jnci/djv282 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Simms KT, Laprise JF, Smith MA, Lew J Bin, Caruana M, Brisson M, et al. Cost-effectiveness of the next generation nonavalent human papillomavirus vaccine in the context of primary human papillomavirus screening in Australia: a comparative modelling analysis. Lancet Public Heal. 2016;1: e66–e75. 10.1016/S2468-2667(16)30019-6 [DOI] [PubMed] [Google Scholar]
  • 26.Franco A, Barrull C, Perulero N, Torné A, San-Martin M, López N, et al. Epidemiologic and economic burden of HPV diseases in Spain: implication of additional 5 types from the 9-valent vaccine. Infect Agent Cancer. 2018;13: 1–10. 10.1186/s13027-017-0172-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Chesson HW, Markowitz LE, Hariri S, Ekwueme DU, Saraiya M. The impact and cost-effectiveness of nonavalent HPV vaccination in the United States: Estimates from a simplified transmission model. Hum Vaccines Immunother. 2016;12: 1363–1372. 10.1080/21645515.2016.1140288 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Chesson HW, Laprise JF, Brisson M, Markowitz LE. Impact and cost-effectiveness of 3 doses of 9-valent human papillomavirus (HPV) vaccine among US females previously vaccinated with 4-valent hpv vaccine. J Infect Dis. 2016;213: 1694–1700. 10.1093/infdis/jiw046 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Kiatpongsan S, Kim JJ. Costs and cost-effectiveness of 9-valent human papillomavirus (HPV) vaccination in two east african countries. PLoS One. 2014;9: 1–6. 10.1371/journal.pone.0106836 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Evers S, Goossens M, de Vet H, van Tulder M, Ament A. Criteria list for assessment of methodological quality of economic evaluations: Consensus on Health Economic Criteria. Int J Technol Assess Health Care. 2005;21: 240–245. 10.1017/s0266462305050324 [DOI] [PubMed] [Google Scholar]
  • 31.Thiboonboon K, Santatiwongchai B, Chantarastapornchit V, Rattanavipapong W, Teerawattananon Y. A systematic review of economic evaluation methodologies between resource-limited and resource-rich countries: A case of rotavirus vaccines. Appl Health Econ Health Policy. 2016;14: 659–672. 10.1007/s40258-016-0265-y [DOI] [PubMed] [Google Scholar]
  • 32.Ng SS, Hutubessy R, Chaiyakunapruk N. Systematic review of cost-effectiveness studies of human papillomavirus (HPV) vaccination: 9-Valent vaccine, gender-neutral and multiple age cohort vaccination. Vaccine. 2018;36: 2529–2544. 10.1016/j.vaccine.2018.03.024 [DOI] [PubMed] [Google Scholar]
  • 33.Bertram MY, Lauer JA, De Joncheere K, Edejer T, Hutubessy R, Kieny MP, et al. Cost-effectiveness thresholds: Pros and cons. Bull World Health Organ. 2016;94: 925–930. 10.2471/BLT.15.164418 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Magdalena Grce

8 Apr 2020

PONE-D-19-28575

Mapping of cost-effectiveness evaluations of the 9-Valent human papillomavirus (HPV) vaccine: Evidence from a systematic review

PLOS ONE

Dear Dr Alam Mahumud,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by June 8th, 2020. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Magdalena Grce, PhD

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements:

1.    Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. At this time, we ask that you please provide the full search strategy and full search terms for at least one database used as Supplementary information. In addition, please state whether a third database was included in your search strategy.

Thank you for including the statement that "Searches were performed until 31 July 2019". Please revise this statement to clarify whether all databases were searched from inception, or if there were any limits placed on the publication dates in your search. In addition, please include this statement in the Methods (rather solely in the abstract).

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

4. Thank you for stating the following in the Acknowledgments Section of your manuscript:

"The study is part of the first author’s PhD research works. The PhD program was funded by the University of Southern Queensland, Australia."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

"The author(s) received no specific funding for this work."

5. Please amend your list of authors on the manuscript to ensure that each author is linked to an affiliation. Authors’ affiliations should reflect the institution where the work was done (if authors moved subsequently, you can also list the new affiliation stating “current affiliation:….” as necessary).

6. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate "supporting information" files.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript is scientifically sound and justice has been made into the writing only minor changes have to be made.

Reviewer #2: This is a useful and interesting paper that is generally well presented.

There are a number of areas in which it could however be improved.

Major issue:

Discuss the role choice of comparator has in the reported ICER and report same in the Tables.

Minor issues

First, clarify why only Scopus and Pubmed were searched.

Second, ensure the exclusion criteria detailed in study selection align with those detailed in the study characteristics subsection (or back reference the earlier mentioned criteria to avoid confusion as an alternative configuration).

Third, page 5 line 17 - what constitutes reasonable and how was this determined?

Fourth, page 5, line 16 ff. identify by initial which authors did what.

Page 5, line 20 reference CHEC as the risk of bias tool

Fifth, page 6 line 19-22. I'm unclear what the text related to CET adds and indeed may serve to confuse matters.

Sixth, page 7 line 6-10, clarify the distinction between national immunization program and universal immunization strategy and in what sense is social health insurance a delivery as opposed to a funding mechanism?

Page 9, line 24 ff. majority suggests some did not report perspective etc. whereas 100% means "all".

Page 10, line 4, find an alternative sub-heading title as the preceding material also cover results.

Page 10, line 15 - QALY is an outcome measure not cost-effectiveness

Page 11, line 3, the study examined 2 LMICs not "an LMIC".

Page 12 line 1-2, ICER is also heavily dependent on the choice of comparator - see above.

Page 12, line 6, under/over-estimate costs and benefits

Page 12, line 14/15 - the assumption of lowest price of 9 valent vaccine. I was unclear as to what exactly the authors meant here. Is this context specific?

Page 12/13 Paragraph beginning "A cost-effectiveness threshold....if the new intervention is not used." Suggest you remove this as it adds little and may serve to confuse.

Page 13, line 13 - the suggestion that country specific GDPs lack country specificity seems odd.

Page 13, line 22/23 - the opening line of the conclusion seems overly pessimistic regarding the potential cost-effectiveness of the vaccine.

Tables - carefully proof - e.g. Table 4 "vaccine prince"

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Akim Tafadzwa Lukwa

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-19-28575_reviewer A.T.L.pdf

PLoS One. 2020 Jun 2;15(6):e0233499. doi: 10.1371/journal.pone.0233499.r002

Author response to Decision Letter 0


4 May 2020

Cover Letter

Date: April 28, 2020

Dear Editor and Reviewer’s,

Thank you for giving us an opportunity to revise our manuscript entitled “Cost-effectiveness evaluations of the 9-Valent human papillomavirus (HPV) vaccine: Evidence from a systematic review”. We found the reviewers’ comments/feedback very helpful in improving the manuscript and we have revised the manuscript accordingly. Please find attached the revised manuscript. We declare that all authors have no conflicts of interest. The manuscript has not been published in any other journal. Our point-by-point comments on the suggested revisions are below.

Best regards,

Rashidul Alam Mahumud (corresponding author)

PhD Candidate, MPH, MSc

On behalf of all of the co-authors

Health Economics Research,

Health Systems and Population Studies Division,

International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b),

Dhaka-1212, Bangladesh.

Journal requirements:

When submitting your revision, we need you to address these additional requirements:

Requirement 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Author’s response: The manuscript has been revised according to the PLoS ONE’s requirements. We hope that the revisions made have met PLoS ONE’s style requirements.

Requirement 2. At this time, we ask that you please provide the full search strategy and full search terms for at least one database used as Supplementary information. In addition, please state whether a third database was included in your search strategy. Thank you for including the statement that "Searches were performed until 31 July 2019". Please revise this statement to clarify whether all databases were searched from inception, or if there were any limits placed on the publication dates in your search. In addition, please include this statement in the Methods (rather solely in the abstract).

Author’s response: We have already uploaded the full search terms for PubMed and Scopus databases. The text has been updated now. A literature search covering a period of January 2000 to 31 July 2019 was conducted in PubMed and Scopus bibliographic databases. We searched for articles with no language restrictions.

Requirement 3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Author’s response: We have uploaded underlying data set as a supporting information files.

Requirement 4. Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access. We will update your Data Availability statement to reflect the information you provide in your cover letter.

Author’s response: We have updated the data availability statement in the submission system.

Requirement 5. Thank you for stating the following in the Acknowledgments Section of your manuscript: "The study is part of the first author’s PhD research works. The PhD program was funded by the University of Southern Queensland, Australia." We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: "The author(s) received no specific funding for this work."

Author’s response: We have revised the acknowledgement section to remove the sentence “The PhD program was funded by the University of Southern Queensland, Australia”. Please see the revised manuscript.

Requirement 6. Please amend your list of authors on the manuscript to ensure that each author is linked to an affiliation. Authors’ affiliations should reflect the institution where the work was done (if authors moved subsequently, you can also list the new affiliation stating “current affiliation:.” as necessary).

Author’s response: Authors’ affiliations have been corrected now.

Requirement 7. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate "supporting information" files.

Author’s response: We have included all tables in the revised main manuscript. The individual Tables have been removed from the submission system.

Response to the reviewer’s comments

Response to Reviewer #1 comments:

Comment-1: Reviewer #1: The manuscript is scientifically sound and justice has been made into the writing only minor changes have to be made.

Response: Authors express gratitude to the reviewer for positive comments regarding the manuscript. The manuscript has been revised now. We hope that our revisions meet this journal’s standards.

Response to Reviewer #2 comments:

Comment 1. This is a useful and interesting paper that is generally well presented.

Author’s Response: Authors express gratitude to the reviewer for their appreciation.

Comment 2. There are a number of areas in which it could however be improved.

Author’s Response: The manuscript has been revised extensively now. We hope that our revisions meet this journal’s standards. Please see the revised manuscript.

Comment 3. Discuss the role choice of comparator has in the reported ICER and report same in the Tables.

Author’s Response: The text has been revised now to remove the term ‘comparator’ from the revised version of the manuscript. Please see page 10 (line 1).

Comment 4. First, clarify why only Scopus and Pubmed were searched.

Author’s Response: We would like to thank the reviewer for asking this clarification. The present study was conducted without any financial supports. This study was a part of the first author’s PhD research works, which was explained in the acknowledgement section. We have considered (e.g., Scopus and PubMed) search engines due to the limited resources and time constraints. It would have been scientifically more robust if the authors were able to consider other search engines. However, most of the publishers in medical and public health journals are indexed in Scopus (14,000 of Journals) and PubMed (30,000 of Journals). Databases, such as Scopus and PubMed, utilise search interfaces that offer a greater variety of advanced features. Furthermore, PubMed delivers a publicly available search interface for MEDLINE as well as other NLM resources, making it the premier source for biomedical literature and one of the most widely accessible resources in the world. Health sciences practitioners, researchers, faculty, and students have been repeatedly reported PubMed and MEDLINE.

Comment 5. Second, ensure the exclusion criteria detailed in study selection align with those detailed in the study characteristics subsection (or back reference the earlier mentioned criteria to avoid confusion as an alternative configuration).

Author’s Response: We have revised the study selection section to remove the exclusion criteria. We hope that the revisions made addressed the concerns raised by the reviewer. Please see page 5 (lines 7-9).

Comment 6. Third, page 5 line 17 - what constitutes reasonable and how was this determined?

Author’s Response: The text has been removed from the revised version of the manuscript. Please see page 5 (lines 21-23).

Comment 7. Fourth, page 5, line 16 ff. identify by initial which authors did what.

Author’s Response: The sentence has been revised now. Please see page 5 (lines 21-23).

Comment 8. Page 5, line 20 reference CHEC as the risk of bias tool

Author’s Response: The text has been revised now. Please page 12 (lines 1-2).

Comment 9. Fifth, page 6 line 19-22. I'm unclear what the text related to CET adds and indeed may serve to confuse matters.

Author’s Response: Thank you for the reviewer’s valuable concern. The sentence has been removed now. Please see on page 6 (lines 24-27).

Comment 10. Sixth, page 7 line 6-10, clarify the distinction between national immunization program and universal immunization strategy and in what sense is social health insurance a delivery as opposed to a funding mechanism?

Author’s Response: Thank you. We have reported the vaccine delivery strategies based on the original studies. The distinctive nature of the national immunization program and universal immunization strategy is out of scope of this study.

Comment 11. Page 9, line 24 ff. majority suggests some did not report perspective etc. whereas 100% means "all".

Author’s Response: The text has been revised now accordingly. Please see page 12 (lines 8-15).

Comment 12. Page 10, line 4, find an alternative sub-heading title as the preceding material also cover results.

Author’s Response: Thank for the reviewer’s advice. We explained the study characteristics which was captured in the methods and materials sections. In the results section, we have considered the main findings in terms of economic viability of 9-valent HPV vaccination and associated dominating model parameters.

Comment 13. Page 10, line 15 - QALY is an outcome measure not cost-effectiveness

Author’s Response: We agree with the observation. The text has been revised now (please see page 13 (lines 13-14).

Comment 14. Page 11, line 3, the study examined 2 LMICs not "an LMIC".

Author’s Response: Corrected. Please see page 16 (lines 6-7).

Comment 15. Page 12 line 1-2, ICER is also heavily dependent on the choice of comparator - see above.

Author’s Response: Thank you. The text has been removed now. Please see page 18 (line 3-4).

Comment 16. Page 12, line 6, under/over-estimate costs and benefits

Author’s Response: Corrected. Please see page 17 (line 14).

Comment 17. Page 12, line 14/15 - the assumption of lowest price of 9 valent vaccine. I was unclear as to what exactly the authors meant here. Is this context specific?

Author’s Response: Thank you for the reviewer’s concern. The sentence has been removed from the revised version of the manuscript. Please see page 17 (lines 22-23).

Comment 18. Page 12/13 Paragraph beginning "A cost-effectiveness threshold....if the new intervention is not used." Suggest you remove this as it adds little and may serve to confuse.

Author’s Response: The text has been removed now. Please see page 18 (lines 3-4).

Comment 19. Page 13, line 13 - the suggestion that country specific GDPs lack country specificity seems odd.

Author’s Response: Corrected and Revised. Please see page 18 (lines 19-22).

Comment 20. Page 13, line 22/23 - the opening line of the conclusion seems overly pessimistic regarding the potential cost-effectiveness of the vaccine.

Author’s Response: Corrected and Revised. Please see page 18 (line 30-32).

Comment 21. Tables - carefully proof - e.g. Table 4 "vaccine prince"

Author’s Response: Thank you for the reviewer’s valuable concern. The text has been corrected now. Please see Table 4.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Magdalena Grce

7 May 2020

Cost-effectiveness evaluations of the 9-Valent human papillomavirus (HPV) vaccine: Evidence from a systematic review

PONE-D-19-28575R1

Dear Dr. Mahumud,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Magdalena Grce, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Magdalena Grce

11 May 2020

PONE-D-19-28575R1

Cost-effectiveness evaluations of the 9-Valent human papillomavirus (HPV) vaccine: Evidence from a systematic review

Dear Dr. Mahumud:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Magdalena Grce

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Checklist

    (DOC)

    S1 Appendix

    (DOCX)

    S1 Data

    (DTA)

    Attachment

    Submitted filename: PONE-D-19-28575_reviewer A.T.L.pdf

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES