Abstract
Background
Uptake of human papillomavirus (HPV) vaccine remains low in many countries, although the bivalent and quadrivalent HPV vaccines given as a three‐dose schedule are effective in the prevention of precancerous lesions of the cervix in women. Simpler immunisation schedules, such as those with fewer doses, might reduce barriers to vaccination, as may programmes that include males.
Objectives
To evaluate the efficacy, immunogenicity, and harms of different dose schedules and different types of HPV vaccines in females and males.
Search methods
We conducted electronic searches on 27 September 2018 in Ovid MEDLINE, the Cochrane Central Register of Controlled Trials (CENTRAL) (in the Cochrane Library), and Ovid Embase. We also searched the WHO International Clinical Trials Registry Platform, and ClinicalTrials.gov (both 27 September 2018), vaccine manufacturer websites, and checked reference lists from an index of HPV studies and other relevant systematic reviews.
Selection criteria
We included randomised controlled trials (RCTs) with no language restriction. We considered studies if they enrolled HIV‐negative males or females aged 9 to 26 years, or HIV‐positive males or females of any age.
Data collection and analysis
We used methods recommended by Cochrane. We use the term 'control' to refer to comparator products containing an adjuvant or active vaccine and 'placebo' to refer to products that contain no adjuvant or active vaccine. Most primary outcomes in this review were clinical outcomes. However, for comparisons comparing dose schedules, the included RCTs were designed to measure antibody responses (i.e. immunogenicity) as the primary outcome, rather than clinical outcomes, since it is unethical to collect cervical samples from girls under 16 years of age. We analysed immunogenicity outcomes (i.e. geometric mean titres) with ratios of means, clinical outcomes (e.g. cancer and intraepithelial neoplasia) with risk ratios or rate ratios and, for serious adverse events and deaths, we calculated odds ratios. We rated the certainty of evidence with GRADE.
Main results
We included 20 RCTs with 31,940 participants. The length of follow‐up in the included studies ranged from seven months to five years.
Two doses versus three doses of HPV vaccine in 9‐ to 15‐year‐old females
Antibody responses after two‐dose and three‐dose HPV vaccine schedules were similar after up to five years of follow‐up (4 RCTs, moderate‐ to high‐certainty evidence). No RCTs collected clinical outcome data. Evidence about serious adverse events in studies comparing dose schedules was of very low‐certainty owing to imprecision and indirectness (three doses 35/1159; two doses 36/1158; 4 RCTs). One death was reported in the three‐dose group (1/898) and none in the two‐dose group (0/899) (low‐certainty evidence).
Interval between doses of HPV vaccine in 9‐ to 14‐year‐old females and males
Antibody responses were stronger with a longer interval (6 or 12 months) between the first two doses of HPV vaccine than a shorter interval (2 or 6 months) at up to three years of follow‐up (4 RCTs, moderate‐ to high‐certainty evidence). No RCTs collected data about clinical outcomes. Evidence about serious adverse events in studies comparing intervals was of very low‐certainty, owing to imprecision and indirectness. No deaths were reported in any of the studies (0/1898, 3 RCTs, low‐certainty evidence).
HPV vaccination of 10‐ to 26‐year‐old males
In one RCT there was moderate‐certainty evidence that quadrivalent HPV vaccine, compared with control, reduced the incidence of external genital lesions (control 36 per 3081 person‐years; quadrivalent 6 per 3173 person‐years; rate ratio 0.16, 95% CI 0.07 to 0.38; 6254 person‐years) and anogenital warts (control 28 per 2814 person‐years; quadrivalent 3 per 2831 person‐years; rate ratio 0.11, 95% CI 0.03 to 0.38; 5645 person‐years). The quadrivalent vaccine resulted in more injection‐site adverse events, such as pain or redness, than control (537 versus 601 per 1000; risk ratio (RR) 1.12, 95% CI 1.06 to 1.18, 3895 participants, high‐certainty evidence). There was very low‐certainty evidence from two RCTs about serious adverse events with quadrivalent vaccine (control 12/2588; quadrivalent 8/2574), and about deaths (control 11/2591; quadrivalent 3/2582), owing to imprecision and indirectness.
Nonavalent versus quadrivalent vaccine in 9‐ to 26‐year‐old females and males
Three RCTs were included; one in females aged 9‐ to 15‐years (n = 600), one in females aged 16‐ to 26‐years (n = 14,215), and one in males aged 16‐ to 26‐years (n = 500). The RCT in 16‐ to 26‐year‐old females reported clinical outcomes. There was little to no difference in the incidence of the combined outcome of high‐grade cervical epithelial neoplasia, adenocarcinoma in situ, or cervical cancer between the HPV vaccines (quadrivalent 325/6882, nonavalent 326/6871; OR 1.00, 95% CI 0.85 to 1.16; 13,753 participants; high‐certainty evidence). The other two RCTs did not collect data about clinical outcomes. There were slightly more local adverse events with the nonavalent vaccine (905 per 1000) than the quadrivalent vaccine (846 per 1000) (RR 1.07, 95% CI 1.05 to 1.08; 3 RCTs, 15,863 participants; high‐certainty evidence). Comparative evidence about serious adverse events in the three RCTs (nonavalent 243/8234, quadrivalent 192/7629; OR 0.60, 95% CI 0.14 to 2.61) was of low certainty, owing to imprecision and indirectness.
HPV vaccination for people living with HIV
Seven RCTs reported on HPV vaccines in people with HIV, with two small trials that collected data about clinical outcomes. Antibody responses were higher following vaccination with either bivalent or quadrivalent HPV vaccine than with control, and these responses could be demonstrated to have been maintained for up to 24 months in children living with HIV (low‐certainty evidence). The evidence about clinical outcomes and harms for HPV vaccines in people with HIV is very uncertain (low‐ to very low‐certainty evidence), owing to imprecision and indirectness.
Authors' conclusions
The immunogenicity of two‐dose and three‐dose HPV vaccine schedules, measured using antibody responses in young females, is comparable. The quadrivalent vaccine probably reduces external genital lesions and anogenital warts in males compared with control. The nonavalent and quadrivalent vaccines offer similar protection against a combined outcome of cervical, vaginal, and vulval precancer lesions or cancer. In people living with HIV, both the bivalent and quadrivalent HPV vaccines result in high antibody responses. For all comparisons of alternative HPV vaccine schedules, the certainty of the body of evidence about serious adverse events reported during the study periods was low or very low, either because the number of events was low, or the evidence was indirect, or both. Post‐marketing surveillance is needed to continue monitoring harms that might be associated with HPV vaccines in the population, and this evidence will be incorporated in future updates of this review. Long‐term observational studies are needed to determine the effectiveness of reduced‐dose schedules against HPV‐related cancer endpoints, and whether adopting these schedules improves vaccine coverage rates.
Plain language summary
Comparison of different human papillomavirus (HPV) vaccines and the number of doses administered to prevent HPV‐related disease in females and males
Human papillomaviruses (HPV) are a group of viruses that infect the skin and mucous membranes. Some types of HPV are sexually transmitted and are common in young people. Most infections will be cleared by the immune system, but some people will experience persistent infection with certain HPV types that go on to cause abnormalities in infected cells. These changes are called 'precancerous' because they can develop into cancers of the cervix, vagina, vulva, anal canal, penis, and head and neck. Infection with other HPV types causes warts in the genital area or around the anus.
Vaccination aims to prevent future HPV infections. Three HPV vaccines are in use – a bivalent one (protects against two HPV types), a quadrivalent one (protects against four HPV types), and a nonavalent one (protects against nine HPV types). In women, three doses of the bivalent or the quadrivalent HPV vaccines protect against precancer of the cervix caused by the HPV types contained in the vaccine. Evidence about the nonavalent vaccine, about the effects of the quadrivalent vaccine in males, and about the effects of HPV vaccines in people with HIV infection, has not yet been reviewed thoroughly. Uptake of HPV vaccines remains low in many countries. Simpler vaccine schedules, or giving the vaccine to both girls and boys, could increase the number of people being vaccinated.
Trials of HPV vaccines are not always designed to collect data about precancer and cancer, for several reasons. Firstly, HPV vaccine is routinely given before girls become sexually active, and it is not ethical to take specimens from the cervix of girls who have not had sex. Secondly, HPV‐related precancer and cancer are rare and do not develop until years after HPV infection has occurred. Thirdly, participants in a trial will be offered treatment if precancer develops, so progression to cervical cancer would be even rarer, even without vaccination. An international committee of experts states that, in some circumstances, antibody levels (i.e. showing a strong immune system response), can be used to demonstrate protection against cervical and anal cancer. The antibody levels following vaccination in a trial should not be lower than those found in other studies on adults in whom the vaccine has been shown to protect against severe HPV‐related cervical or anal disease.
Review question(s)
How effective or harmful are different HPV vaccine schedules (i.e. number and timing of doses) and different HPV vaccines in females and males?
Main results
These results are based on research evidence to 27 September 2018. We analysed 20 studies involving 31,940 people.
Studies comparing two doses of HPV vaccine to three doses, or comparing the time interval between doses, focus on immune system responses rather than infection or disease outcomes. Two doses of HPV vaccine result in similar immune system responses to three doses, and a longer interval (up to 12 months) between doses gives a stronger immune system response than a shorter interval. There is insufficient evidence to determine whether there was a difference between the vaccine schedules for serious adverse events and death.
In 16‐ to 26‐year‐old men, one study showed evidence of moderate certainty that a quadrivalent HPV vaccine provides better protection against external genital lesions and genital warts than a dummy treatment (control). In 16‐ to 26‐year‐old women, one study showed that the nonavalent and quadrivalent vaccines provide the same levels of protection against cervical, vaginal, and vulval precancer lesions and cancer (high‐certainty evidence).
There was evidence that the quadrivalent vaccine resulted in more local adverse events (such as pain, swelling, and redness at the injection site) than a control treatment in males, and that the nonavalent vaccine resulted in more local adverse events than the quadrivalent vaccine in males and females. Evidence about serious adverse events and deaths from studies comparing different HPV vaccine types or dose schedules was of low or very low‐certainty.
In people living with HIV, HPV vaccines result in reasonable levels of immune system response, but evidence about their effects on persistent HPV infection or HPV‐related disease outcomes and harms is limited.
Certainty of the evidence
No major issues were identified with the methodological quality of the studies for the measurements of infection and disease outcomes, or for immune system responses. Our certainty in the evidence about serious harms and deaths across all the studies comparing different HPV vaccines and vaccine schedules is low, either because of their low frequency, or because the evidence is indirect, or both. Evidence graded as high certainty means that we were confident that further research is unlikely to change our findings. Moderate‐certainty evidence means that there is a possibility that further research may have an important effect on our findings, whilst low‐certainty evidence means that our confidence was limited and further research may have an important impact on our findings. Very low‐certainty evidence means that we were uncertain about the result.
Conclusion
A two‐dose schedule of HPV vaccines in young females results in immune system responses that are comparable with a three‐dose schedule. In males, the quadrivalent HPV vaccine appears to be effective in the prevention of external genital lesions and genital warts. Quadrivalent and nonavalent HPV vaccines in young women result in similar levels of protection against cervical, vaginal, and vulval precancer lesions and cancer. Evidence about the efficacy and harms in people living with HIV is limited. Further long‐term population‐level studies are needed to continue monitoring safety of these vaccines, to determine for how long two doses of vaccine can provide protection against HPV‐related disease, the effect against HPV‐related cancer, and whether a two‐dose immunisation schedule will increase vaccine coverage.
Summary of findings
Summary of findings for the main comparison. Two doses of HPV vaccine compared with three doses of HPV vaccine in 9‐ to 15‐year‐old females.
| Two doses of HPV vaccine compared with three doses of HPV vaccine in 9‐ to 15‐year‐old females | ||||||
| Patient or population: 9‐ to 15‐year‐old females Setting: community health centres in Africa, Asia Pacific, Europe, Latin America, North America Intervention: two doses of HPV vaccine (bivalent, quadrivalent, or nonavalent) administered in months 0 and 2, 0 and 6, or 0 and 12 Comparison: three doses of HPV vaccine (bivalent, quadrivalent, or nonavalent) administered in months 0, 2, and 6, or 0, 1, and 6 | ||||||
| Clinical and harms outcomes* | Anticipated absolute effects** (95% CI) | Relative effect (95% CI) | № of participants (studies) | Certainty of the evidence (GRADE) | Comments | |
| Risk with three doses of HPV vaccine | Risk with two doses of HPV vaccine | |||||
| Antibody response (immunogenicity) | Two doses were non‐inferior to, or had higher GMTs than, three doses for all HPV vaccine genotypes (bivalent, quadrivalent, and nonavalent vaccines), except HPV 45 (where non‐inferiority was inconclusive), at short‐term follow‐up (4 studies, number of participants ranged from 132 to 1833 depending on HPV type and vaccine; see Appendix 5). | MODERATE/ HIGH* |
Short‐term results (follow‐up 1 month after final dose) | |||
| Two doses of bivalent vaccine had inconclusive non‐inferiority for GMTs of HPV 16 and HPV 18 compared with three doses at 60‐month follow‐up (1 study, 93 participants; see Appendix 5). | LOW* | Long‐term results (follow‐up 36 to 60 months) | ||||
| Two doses of quadrivalent vaccine resulted in non‐inferior GMTs for HPV 6, HPV 11 and HPV 16 compared with three doses, while results were inconclusive for HPV 18 at 60‐month follow‐up (1 study, 101 participants; see Appendix 5). | LOW* | |||||
| Two doses of nonavalent vaccine resulted in non‐inferior GMTs for all HPV genotypes measured except HPV 45 and HPV 52 where non‐inferiority was inconclusive, compared with three doses, at 36‐month follow‐up (1 study, 476 to 511 participants depending on HPV type; see Appendix 5). | HIGH* | |||||
| High‐grade cervical intraepithelial neoplasia, adenocarcinoma in situ, and cervical cancer | No studies were identified that reported on this outcome. | |||||
| High‐grade cervical, vulval, and vaginal disease | No studies were identified that reported on this outcome. | |||||
| Overall local/injection site adverse events | No studies were identified that reported on this outcome. Data for specific local adverse events (pain/swelling/redness at injection site) are presented in the analysis section. | |||||
| Overall systemic events and general symptoms | No studies were identified that reported on this outcome. | |||||
| Serious adverse events at up to 5‐year follow‐up |
30 per 1000 | 31 per 1000 (20 to 49) | OR 1.03 (0.64 to 1.66) | 2317 (4 RCTs) | ⊕⊝⊝⊝ VERY LOW 1,2 | Please see Table 2 for a list of events in each RCT. |
| Mortality at up to 5‐year follow‐up |
1 per 1000 | 0 per 1000 (0 to 9) | OR 0.33 (0.01 to 8.19) | 1797 (3 RCTs) | ⊕⊕⊝⊝ LOW 1 | One death was reported in the three‐dose group (nonavalent vaccine). |
| *Certainty of the evidence (GRADE) for immunogenicity outcomes are presented in detail in Appendix 5. **The risk in the intervention group (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval; GMT: geometric mean titre; HPV: human papillomavirus; OR: odds ratio; RCT: randomised controlled trial | ||||||
| GRADE Working Group grades of evidence High certainty: we are very confident that the true effect lies close to that of the estimate of the effect Moderate certainty: we are moderately confident in the effect estimate: the true effect is likely to be close to the estimate of the effect, but there is a possibility that it is substantially different Low certainty: our confidence in the effect estimate is limited: the true effect may be substantially different from the estimate of the effect Very low certainty: we have very little confidence in the effect estimate: the true effect is likely to be substantially different from the estimate of effect | ||||||
1Downgraded two levels for serious imprecision: few events and a wide 95% confidence interval that incorporated a potential large beneficial effect and a potential large harmful effect.
2Downgraded one level for indirectness: this outcome is a composite measure of events which may or may not be clinically relevant, may or may not be related to the vaccine and may occur outside a biologically plausible time frame relative to vaccine exposure. This outcome is considered to provide indirect evidence about vaccine safety.
1. Serious adverse events.
| Study | Group | Number of participants with serious adverse events | Details of serious adverse events* |
| Denny 2013 | Vaccine (bivalent) | 3/61 | Gastroenteritis, bacterial pneumonia, migraine |
| Control | 2/59 | Lobar pneumonia, skull fracture | |
| Dobson 2013 | Vaccine (quadrivalent; 2‐dose) | 0/259 | |
| Vaccine (quadrivalent; 3‐dose) | 0/261 | ||
| Giuliano 2011 | Vaccine (quadrivalent) | 8/2020 | 8 participants with 12 events: cardiac arrest, non‐cardiac chest pain, hypersensitivity, appendicitis, cellulitis, varicella infection, cervical vertebral fracture, gunshot wound, road traffic accident, traumatic brain injury, traumatic intracranial haemorrhage, convulsion |
| Control | 11/2033 | 11 participants with 13 events: myocardial ischaemia, pericardial haemorrhage, accidental overdose, chemical poisoning, contusion, gunshot wound (3), head injury, multiple drug overdose, road traffic accident, completed suicide (2) | |
| NCT01031069 2017 | Vaccine (bivalent) | 9/167 | 9 participants with 10 events: immune thrombocytopenic purpura, gastritis, meningitis tuberculous, pneumonia, pneumonia mycoplasmal, tonsillitis, viral infection, road traffic accident, miscarriage, renal failure |
| Vaccine (quadrivalent) | 9/165 | 9 participants with 10 events: appendicitis (2), pneumonia bacterial, pulmonary tuberculosis, tonsillitis, urinary tract infection, monoarthritis, abortion spontaneous complete, pre‐eclampsia, suicide attempt | |
| NCT01862874 2018 | Vaccine (quadrivalent) | 0/554 | |
| Control | 1/559 | Completed suicide | |
| Hidalgo‐Tenorio 2017 | Vaccine (quadrivalent) | 0/66 | |
| Control | 0/63 | ||
| Iversen 2016 | Vaccine (nonavalent; 2‐dose, 6‐month interval in females) | 6/301 | 6 participants with 7 events: abdominal pain (2), appendicitis, dengue fever, pharyngitis, foreign body injury, ovarian cyst |
| Vaccine (nonavalent; 2‐dose, 6‐month interval in males) | 9/301 | 9 participants with 10 events: Wolff‐Parkinson‐White syndrome, diarrhoea, animal bite, appendicitis, rotavirus gastroenteritis, Chikungunya virus infection, bacterial meningitis, pneumonia, concussion, epilepsy | |
| Vaccine (nonavalent; 2‐dose, 12‐month interval in males and females) | 3(6)/301 | 1 female participant with atopic dermatitis 2 male participants with appendicitis, forearm fracture At 37 month follow‐up there were 3 additional serious adverse events: gastritis, oral herpes, radiculopathy (disaggregated data by sex were not available) |
|
| Vaccine (nonavalent; 3‐dose in females) | 6/301 | 6 participants with 8 events: cardiac arrest, appendicitis, subcutaneous abscess, papillary thyroid cancer, encephalitis autoimmune, status epilepticus, depression, ovarian cyst | |
| Joura 2015 | Vaccine (nonavalent) | 242/7686 | 242 participants with 269 events: Anaemia, aortic valve incompetence, postural orthostatic tachycardia syndrome, vertigo positional, anal fistula, coeliac disease, Crohn's disease, diarrhoea, gastritis, haemorrhoids, inguinal hernia, irritable bowel syndrome, pyrexia, sudden death, cholangitis, cholecystitis, cholelithiasis, allergy to vaccine, anaphylactic reaction, hypersensitivity, sarcoidosis, jaw abscess, appendicitis (10), cholecystitis infective, chronic tonsillitis, dengue fever, infectious enteritis (2), gastroenteritis, viral gastroenteritis, haemorrhagic fever, infectious mononucleosis, influenza, pharyngitis, pyelonephritis (2), pyelonephritis acute, septic shock, tonsillitis, tonsillitis streptococcal, urinary tract infection (3), urosepsis, wound infection, bladder injury, burns second degree, craniocerebral injury, femur fracture, humerus fracture (2), ligament rupture, lower limb fracture, multiple injuries (2), pubis fracture, road traffic accident, spinal compression fracture, hyperglycaemia, myalgia, osteoarthritis, acute lymphocytic leukaemia, acute promyelocytic leukaemia, adenocarcinoma of the cervix, brain neoplasm, ependymoma, leukaemic infiltration brain, malignant melanoma (2), malignant melanoma in situ, nasal cavity cancer, ovarian neoplasm, diabetic coma, epilepsy, hypersomnia, Intracranial venous sinus thrombosis, migraine, multiple sclerosis (2), presyncope, sciatica, sensory disturbance, syncope (2), tension headache, abortion spontaneous (40), abortion spontaneous incomplete, blighted ovum, cephalo‐pelvic disproportion (4), cervix dystocia, false labour, foetal death (2), foetal distress syndrome (5), labour complication, pre‐eclampsia (2), premature labour, premature rupture of membranes (4), prolonged labour (2), uterine contractions during pregnancy, anorexia and bulimia syndrome, bipolar disorder (3), completed suicide, major depression, calculus ureteric, calculus urinary, nephrolithiasis, renal failure (2), bartholinitis, cervical dysplasia (5), cervix haemorrhage uterine, endometriosis (2), ovarian cyst, pelvic pain, asthmatic crisis, pneumonia aspiration, pneumothorax, respiratory failure, vocal cord polyp, abortion induced (79), deep vein thrombosis, hypovolaemic shock (2) |
| Vaccine (quadrivalent) | 184/7078 | 184 participants with 197 events: Anaemia, cleft lip and palate, Meckel's diverticulum, abdominal pain (2), abdominal pain lower, colitis ulcerative, enterocolitis, gastritis, inguinal hernia, omental infarction, cholecystitis , cholelithiasis (2), appendicitis (16), bronchitis (2), cellulitis, conjunctivitis, gastroenteritis (2), influenza, pelvic inflammatory disease, post abortion infection, pyelonephritis, pyelonephritis acute (2), urinary tract infection (2), viral pharyngitis, foreign body in eye, fracture displacement, hand fracture, head injury, joint dislocation (2), neck injury, poisoning, post procedural haemorrhage (2), spinal cord injury, spinal cord injury cervical, fibromyalgia (2), adenocarcinoma gastric, malignant palate neoplasm, pituitary tumour benign, respiratory papilloma, thyroid cancer, benign intracranial hypertension, cerebral haemorrhage, epilepsy, facial paresis, headache, hydrocephalus, hypoesthesia, multiple sclerosis, neuritis, orthostatic intolerance, spondylitic myelopathy, tension headache, abortion spontaneous (28), abortion spontaneous complete (2), blighted ovum, cephalo‐pelvic disproportion (6), cervix dystocia, ectopic pregnancy, foetal distress syndrome, foetal malposition, foetal malpresentation, gestational diabetes, oligohydramnios, pre‐eclampsia, premature labour, premature rupture of membranes (2), prolonged labour, anorexia nervosa, bipolar disorder, depression, cystitis haemorrhagic, renal failure acute, cervical dysplasia (3), dysmenorrhoea, endometriosis, fallopian tube cyst, ovarian cyst (2), dyspnoea, nasal polyps, abortion induced (53), axillary vein thrombosis | |
| Lehtinen 2018 | Vaccine (quadrivalent) | 58/2436 | 58 participants with 62 events: Splenomegaly, vitello‐intestinal duct remnant, abdominal pain (2), colitis ulcerative, constipation, food poisoning, chest pain, pyrexia, cholesystitis, appendicitis (5), appendicitis perforated, infectious mononucleosis (4), peritonsillar abscess, pneumonia (2), pneumonia bacterial, salmonellosis, tonsillitis (4), alcohol poisoning (3), cervical vertebral fracture, concussion (4), contusion (2), forearm fracture, hand fracture (2), limb injury, lower limb fracture, muscle rupture, neck injury, radius fracture (2), upper limb fracture (2), type 1 diabetes mellitus, exostosis, juvenile idiopathic arthritis, syncope (2), anxiety, disturbance in social behaviour, emotional disorder of childhood, psychotic disorder, testicular torsion, acne, dermatitis |
| Vaccine (control, HBV) | 25/1267 | 25 participants with 25 events: Appendicitis (3), appendicitis perforated, bronchitis, gastroenteritis bacterial, infectious mononucleosis, peritonsillar abscess, sinusitis, sinusitis bacterial, alcohol poisoning, foot fracture (2), forearm fracture, hand fracture, joint dislocation, splenic rupture, tibia fracture, traumatic renal injury, type 1 diabetes mellitus, astrocytoma low grade, depression, panic disorder, suicide attempt, dyspnoea | |
| Leung 2015 | Vaccine (bivalent; 2‐dose) | 11/358 | 11 participants with 13 events: Abdominal pain lower, mouth cyst, appendicitis, gastroenteritis viral, lung abscess, peritonitis, viral infection, joint dislocation, teratoma, epilepsy, seizure, asthma, eczema |
| Vaccine (bivalent; 3‐dose) | 14/358 | 14 participants with 16 events: Lymphadenitis, vertigo positional, abdominal pain, anaphylactic shock, upper respiratory tract infection, pneumonia, influenza, vulval ulceration, ankle fracture, overdose, tendon injury, presyncope, tension headache, abortion spontaneous incomplete, completed suicide, depression, menorrhagia | |
| Levin 2010 | Vaccine (quadrivalent) | 0/96 | |
| Control | 0/30 | ||
| Lin 2014 | Vaccine (quadrivalent; 10‐month interval) | 0/111 | |
| Vaccine (quadrivalent; 4‐month interval) | 0/109 | ||
| NCT00941889 2016 | Vaccine (quadrivalent) | Not reported | Not reported |
| Control | Not reported | Not reported | |
| Wilkin 2018 | Vaccine (quadrivalent) | 33/288 | 33 participants with 40 events: Pericardial effusion, abdominal mass, abdominal pain, anal fistula, colitis, chest pain (2), death, appendicitis, cellulitis, chlamydial infection, gastroenteritis viral, influenza (2), meningitis viral, peritonsillar abscess, pneumonia, pneumonia pneumococcal, pseudomembranous colitis, sepsis, lower limb fracture, multiple injuries, stab wound, anal cancer, basal cell carcinoma, Hodgkin's disease, prostate cancer, transitional cell carcinoma, cerebrovascular accident, seizure, acute psychosis, alcohol withdrawal syndrome, depression, suicide attempt, acute respiratory failure, alveolitis allergic, asthma, pleural effusion, intervertebral disc operation |
| Control | 46/287 | 46 participants with 79 events: Acute myocardial infarction (2), coronary artery disease, myocardial infarction, abdominal pain, gastrointestinal haemorrhage, large intestine perforation, pancreatitis, pancreatitis acute (2), pancreatitis chronic, small intestinal obstruction (3), chest pain (5), pyrexia, cholelithiasis, bronchitis (2), diverticulitis (2), gastroenteritis (2), gastroenteritis viral, influenza (2), orchitis, perirectal abscess, pneumonia (3), pneumonia streptococcal, primary syphilis, pyelonephritis, scrotal abscess, sepsis (3), viral infection, fall, foot fracture, overdose, radius fracture, road traffic accident, weight decreased, dehydration, osteoarthritis, anal cancer, anal squamous cell carcinoma, B‐cell lymphoma, basal cell carcinoma, follicle centre lymphoma diffuse small cell lymphoma, oesophageal adenocarcinoma, pancreatic carcinoma metastatic, prostate cancer, renal cell carcinoma, squamous cell carcinoma of head and neck, haemorrhagic stroke, syncope (2), alcohol withdrawal syndrome, completed suicide, mental status changes, psychotic disorder, substance abuse, suicide attempt, genital ulceration, chronic obstructive pulmonary disease (4), dyspnoea, pleural effusion, pulmonary hypertension, hypotension | |
| Petaja 2009 | Vaccine (bivalent) | 3/181 | Crohn’s disease, appendicitis, epilepsy |
| Control (HBV) | 1/89 | Osteochondrosis | |
| Puthanakit 2016 | Vaccine (bivalent; 2‐dose, 6‐month interval) | 20/550 | 20 participants with 34 events: Lymphadenitis, autoimmune thyroiditis, strabismus, abdominal strangulated hernia, abdominal pain, anal haemorrhage, gastritis, nausea, chronic gastritis, anaphylactic reaction, cholelithiasis, infections and infestations (13), injury, poisoning and procedural complications (4), type 1 diabetes mellitus, cholesteatoma, convulsion, seizure, IgA nephropathy, respiratory disorder |
| Vaccine (bivalent; 2‐dose, 12‐month interval) | 24/415 | 24 participants with 38 events: Lymphadenitis, supraventricular tachycardia, abdominal pain lower, constipation, dyspepsia, faecaloma, drug hypersensitivity, infections and infestations (25), injury, poisoning and procedural complications, hypovolaemia, systemic lupus erythematosus, VIIth nerve paralysis, tonsillar hypertrophy, circulatory collapse | |
| Vaccine (bivalent; 3‐dose) | 28/482 | 28 participants with 53 events: Infections and infestations (32), injury, poisoning and procedural complications (3), hypovolaemia (2), synovial cyst, medulloblastoma, synovial sarcoma, uterine leiomyoma, hyperemesis gravidarum, premature baby, abortion threatened, postpartum haemorrhage, stillbirth, schizoaffective disorder (3), psychotic disorder, ovarian cyst ruptured, transient tachypnoea of the newborn, ectopic pregnancy termination | |
| Romanowski 2011 | Vaccine (bivalent; 3‐dose) | 15/239 | 15 participants with 20 events: Basedow’s disease, abdominal pain, appendix disorder, gastroenteritis, appendicitis, pharyngitis streptococcal, tonsillitis (2), urinary tract infection, ligament rupture, multiple injuries, ligament laxity, polyarthritis, migraine with aura, abortion spontaneous incomplete, abnormal behaviour, depression, renal colic, renal disorder, erythema multiforme |
| Vaccine (bivalent; 2‐dose) | 16/241 | 16 participants with 26 events: Abdominal pain, umbilical hernia (2), obstructive vomiting, gastroenteritis viral, cholecystitis acute, acute tonsillitis, appendicitis (2), endometritis decidual, vestibular neuronitis, tibia fracture, contusion, fall, fibroma, fibrosarcoma, pre‐eclampsia, premature baby, abortion missed, depression, major depression, psychotic disorder, suicide attempt, cystitis haemorrhagic, hyperventilation, circulatory collapse | |
| Vaccine (bivalent; 2‐dose, 6‐month interval) | 19/240 | 19 participants with 23 events: Atrial septal defect, spina bifida, bile duct stone, appendicitis (4), tonsillitis bacterial, humerus fracture, road traffic accident, tibia fracture, upper limb fracture, malignant melanoma stage IV, basilar artery thrombosis, cerebrovascular accident, abortion spontaneous, abortion spontaneous incomplete (2), foetal distress syndrome, anorexia nervosa, bulimia nervosa, depression, circulatory collapse | |
| Vaccine (bivalent; 2‐dose, 2‐month interval) | 14/240 | 14 participants with 16 events: Abdominal pain (3), hepatomegaly, pilonidal cyst, urinary tract infection, vestibular neuronitis, concussion, stab wound, coccydynia, uterine leiomyoma, benign hydatidiform mole, abortion spontaneous, ectopic pregnancy, adenomyosis, ovarian cyst | |
| Toft 2014 | Vaccine (bivalent) | 0/46 | |
| Vaccine (quadrivalent) | 0/46 | ||
| van Damme 2016 | Vaccine (nonavalent) | 0/249 | |
| Vaccine (quadrivalent) | 6/251 | Joint dislocation, ligament injury, ligament rupture, foot fracture, concussion, cytomegalovirus infection | |
| Vesikari 2015 | Vaccine (nonavalent) | 1/299 | One participant with two events: Anaemia and pulmonary vasculitis |
| Vaccine (quadrivalent) | 2/300 | Complex partial seizures, Henoch‐Schonlein purpura |
Abbreviations
*For each event, n = 1 unless otherwise stated.
HBV: hepatitis B vaccine
Summary of findings 2. Two doses of HPV vaccine with longer interval compared with two doses of HPV vaccine with shorter interval in 9‐ to 14‐year‐old females and males.
| Two doses of HPV vaccine with longer interval compared with two doses of HPV vaccine with shorter interval in 9‐ to 14‐year‐old females and males | ||||||
| Patient or population: 9‐ to 14‐year‐old females and males Setting: community health centres in Africa, Asia Pacific, Europe, Latin America, North America Intervention: two doses of bivalent or nonavalent HPV vaccine with longer interval (months 0 and 6 or 12) Comparison: two doses of bivalent or nonavalent HPV vaccine with shorter interval (months 0 and 2 or 6) | ||||||
| Clinical and harms outcomes* | Anticipated absolute effects** (95% CI) | Relative effect (95% CI) | № of participants (studies) | Certainty of the evidence (GRADE) | Comments | |
| Risk with two doses of HPV vaccine with shorter interval | Risk with two doses of HPV vaccine with longer interval | |||||
| Antibody response (geometric mean titre) | Longer intervals between the first two doses of bivalent vaccine resulted in higher and non‐inferior GMTs for HPV 16 (n = 971) and HPV 18 (n = 986) compared with shorter intervals in 9‐ to 14‐year‐old females at short‐term follow‐up (2 studies; moderate‐ to high‐certainty evidence, see Appendix 6). | MODERATE/ HIGH* |
Short‐term results (follow‐up one month after final dose) | |||
| A longer interval between the first two doses of nonavalent vaccine resulted in higher and non‐inferior GMTs than a shorter interval for all HPV vaccine genotypes in girls and boys at short‐term follow‐up (1 study, number of participants ranged from 778 to 815 depending on HPV type; high‐certainty evidence, see Appendix 6). | HIGH* | |||||
| Longer intervals between the first two doses of bivalent vaccine resulted in higher and non‐inferior GMTs for HPV 16 (n=817) and HPV 18 (n=794) compared with shorter intervals in 9‐ to 14‐year‐old females at 36 months follow‐up (1 study; high‐certainty evidence, see Appendix 6). | HIGH* | Long‐term results (follow‐up 36 months) | ||||
| A longer interval between the first two doses of nonavalent vaccine resulted in higher and non‐inferior GMTs than a shorter interval for all HPV vaccine genotypes in girls and boys at seven and 36 months follow‐up (1 study, number of participants ranged from 236 to 263 depending on HPV type; high‐certainty evidence, see Appendix 6). | HIGH* | |||||
| Invasive cervical, vaginal, vulval, anal, or penile cancer | No studies were identified that reported on this outcome. | |||||
| High‐grade cervical, vulval, vaginal, penile, or anal intraepithelial neoplasia | No studies were identified that reported on this outcome. | |||||
| Overall local/injection site adverse events | No studies were identified that reported on this outcome. Data for specific local adverse events (pain/swelling/redness at injection site) are presented in the analysis section. | |||||
| Overall systemic events and general symptoms | No studies were identified that reported on this outcome. | |||||
| Serious adverse events at up to 5‐year follow‐up |
Bivalent vaccine (0 and 2 months) 58 per 1000 |
Bivalent vaccine (0 and 6 months) 67 per 1000 (33 to 130) |
OR 1.15 (0.55 to 2.41) | 481 (1 RCT) | ⊕⊝⊝⊝ VERY LOW 1,2 | Please see Table 2 for list of events in each RCT. Data for nonavalent vaccine include males and females; fully disaggregated data were not available. |
| Bivalent vaccine (0 and 6 months) 36 per 1000 |
Bivalent vaccine (0 and 12 months) 58 per 1000 (32 to 101) |
OR 1.63 (0.89 to 2.99) | 965 (1 RCT) |
⊕⊝⊝⊝ VERY LOW 1,2 | ||
| Nonavalent vaccine (0 and 6 months) 25 per 1000 |
Nonavalent vaccine (0 and 12 months) 20 per 1000 (8 to 52) |
OR 0.80 (0.31 to 2.07) |
903 (1 RCT) |
⊕⊝⊝⊝ VERY LOW 1,2 | ||
| Mortality at up to 5‐year follow‐up |
Bivalent vaccine (0 and 2 months) 0 per 1000 |
Bivalent vaccine (0 and 6 months) 0 per 1000 (0 to 0) |
Not estimable | 481 (1 RCT) | ⊕⊕⊝⊝ LOW 3 | No deaths were reported in the trial. |
| Bivalent vaccine (0 and 6 months) 0 per 1000 |
Bivalent vaccine (0 and 12 months) 0 per 1000 (0 to 0) |
Not estimable | 965 (1 RCT) |
⊕⊕⊝⊝ LOW 3 | No deaths were reported in the trial. | |
| Nonavalent vaccine (0 and 6 months) 0 per 1000 |
Nonavalent vaccine (0 and 12 months) 0 per 1000 (0 to 0) |
Not estimable | 452 (1 RCT) |
⊕⊕⊝⊝ LOW 3 | No deaths were reported in the trial. | |
| *Certainty of the evidence (GRADE) for immunogenicity outcomes are presented in detail in Appendix 6. **The risk in the intervention group (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval; GMT: geometric mean titre; HPV: human papillomavirus; OR: odds ratio; RCT: randomised controlled trial | ||||||
| GRADE Working Group grades of evidence High certainty: we are very confident that the true effect lies close to that of the estimate of the effect Moderate certainty: we are moderately confident in the effect estimate: the true effect is likely to be close to the estimate of the effect, but there is a possibility that it is substantially different Low certainty: our confidence in the effect estimate is limited: the true effect may be substantially different from the estimate of the effect Very low certainty: we have very little confidence in the effect estimate: the true effect is likely to be substantially different from the estimate of effect | ||||||
1Downgraded two levels for serious imprecision: few events and a wide 95% confidence interval that incorporates a potential large beneficial effect and a potential small harmful effect.
2Downgraded one level for indirectness: this outcome is a composite measure of events which may or may not be clinically relevant, may or may not be related to the vaccine and may occur outside a biologically plausible time frame relative to vaccine exposure. This outcome is considered to provide indirect evidence about vaccine safety.
3Downgraded two levels for serious imprecision: no events reported, the studies were not powered to detect a difference in mortality.
Summary of findings 3. Three doses HPV vaccine compared with control in 10‐ to 26‐year‐old males.
| Three doses HPV vaccine compared with control in 10‐ to 26‐year‐old males | ||||||
| Patient or population: 10‐ to 26‐year‐old males Setting: 18 countries in five regions (Africa, Asia‐Pacific, Europe, Latin America, North America) Intervention: quadrivalent HPV vaccine, 3 doses at months 0, 2, and 6; or bivalent HPV vaccine, 3 doses at months 0, 1, and 6 Comparison: control (vaccine adjuvant‐containing placebo), 3 doses at months 0, 2, and 6 or hepatitis B vaccine, 3 doses at months 0, 1, and 6 | ||||||
| Outcomes | Anticipated absolute effects* (95% CI) | Relative effect (95% CI) | № of participants (studies) | Certainty of the evidence (GRADE) | Comments | |
| Risk/rate with control | Risk/rate with HPV vaccine | |||||
| Invasive anal or penile cancer | No studies were identified that reported on this outcome | |||||
| Penile or anal intraepithelial neoplasia at up to 3‐year follow‐up |
3/2824 person‐years | 0/2833 person‐years | Rate ratio 0.17 (0.01 to 3.27) | 2805 participants (5657 person‐years) (1 RCT) |
⊕⊕⊝⊝ LOW 2 | |
| External genital lesions (any genotype) at up to 3‐year follow‐up |
36/3081 person‐years | 6/3173 person‐years | Rate ratio 0.16 (0.07 to 0.38) | 2545 participants (6254 person‐years) (1 RCT) |
⊕⊕⊕⊝ MODERATE 1 | |
| Anogenital warts at up to 3‐year follow‐up |
28/2814 person‐years | 3/2831 person‐years | Rate ratio 0.11 (0.03 to 0.38) | 2805 participants (5645 person‐years) (1 RCT) |
⊕⊕⊕⊝ MODERATE 1 | |
| Overall local/injection site adverse events at 15‐day follow‐up |
537 per 1000 | 601 per 1000 (569 to 634) | RR 1.12 (1.06 to 1.18) | 3895 (1 RCT) | ⊕⊕⊕⊕ HIGH3 | Data for specific local adverse events (pain, swelling, redness at injection site) are presented in the analysis section. |
| Overall systemic events and general symptoms at 15‐day follow‐up |
248 per 1000 | 245 per 1000 (223 to 268) | RR 0.99 (0.90 to 1.08) | 5008 (2 RCTs) | ⊕⊕⊕⊝ MODERATE4 | |
| Serious adverse events at up to 3‐year follow‐up |
Control: 11 per 1000 |
Bivalent vaccine: 17 per 1000 (2 to 141) | OR 1.48 (0.15 to 14.46) | 270 (1 RCT) |
⊕⊝⊝⊝ VERY LOW 2,4 | In a subgroup from Lehtinen 2018, a cluster‐RCT, 58/2436 HPV vaccine recipients (2.4%) and 25/1267 control HBV vaccine recipients (2.0%) experienced serious adverse events. This was also considered very low‐certainty evidence2,4 Please see Table 2 for list of events in each RCT. |
| Control: 4 per 1000 | Quadrivalent vaccine: 3 per 1000 (1 to 7) | OR 0.69 (0.29 to 1.66) | 5162 (2 RCTs) | ⊕⊝⊝⊝ VERY LOW 2,4 | Please see Table 2 for list of events in each RCT. | |
| Mortality at up to 3‐year follow‐up |
Control: see comment | Bivalent vaccine: see comment | OR not estimable: see comment | 270 (1 RCT) |
⊕⊕⊝⊝ LOW 5 | No events were reported |
| Control: 4 per 1000 | Quadrivalent vaccine: 1 per 1000 (0 to 4) | OR 0.30 (0.09 to 1.01) | 5173 (2 RCTs) | ⊕⊕⊝⊝ LOW 2 | ||
| *The risk in the intervention group (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval; HPV: human papillomavirus; OR: odds ratio; RCT: randomised controlled trial; RR: risk ratio | ||||||
| GRADE Working Group grades of evidence High certainty: we are very confident that the true effect lies close to that of the estimate of the effect Moderate certainty: we are moderately confident in the effect estimate: the true effect is likely to be close to the estimate of the effect, but there is a possibility that it is substantially different Low certainty: our confidence in the effect estimate is limited: the true effect may be substantially different from the estimate of the effect Very low certainty: we have very little confidence in the effect estimate: the true effect is likely to be substantially different from the estimate of effect | ||||||
1Downgraded one level for imprecision: few events.
2Downgraded two levels for serious imprecision: few events and a wide 95% confidence interval that incorporates a potential large beneficial effect as well as a potential large harmful effect.
3Evidence for this outcome was not downgraded: the trial was a large multi‐national trial with low risk of bias and precise estimates.
4Downgraded one level for indirectness: this outcome is a composite measure of events which may or may not be clinically relevant, may or may not be related to the vaccine and may occur outside a biologically plausible time frame relative to vaccine exposure. This outcome is considered to provide indirect evidence about vaccine safety.
5Downgraded two levels for serious imprecision: no events reported.
Summary of findings 4. Nonavalent HPV vaccine compared with quadrivalent HPV vaccine in 9‐ to 26‐year‐old females and males.
| Nonavalent HPV vaccine compared with quadrivalent HPV vaccine in 9‐ to 26‐year‐old females and males | ||||||
| Patient or population: 9‐ to 26‐year‐old females and males Setting: community health centres in Asia‐Pacific, Europe, Latin America, North America Intervention: nonavalent HPV vaccine, 3 doses administered at months 0, 2, and 6 Comparison: quadrivalent HPV vaccine, 3 doses administered at months 0, 2, and 6 | ||||||
| Outcomes | Anticipated absolute effects* (95% CI) | Relative effect (95% CI) | № of participants (studies) | Certainty of the evidence (GRADE) | Comments | |
| Risk with quadrivalent HPV vaccine | Risk with nonavalent HPV vaccine | |||||
| High‐grade cervical intraepithelial neoplasia, adenocarcinoma in situ, and cervical cancer at up to 4.5‐year follow‐up |
47 per 1000 | 47 per 1000 (41 to 55) | OR 1.00 (0.85 to 1.16) | 13,753 (1 RCT) | ⊕⊕⊕⊕ HIGH1 | No studies were identified which reported on invasive anal or penile cancer in males |
| High‐grade cervical, vulval, and vaginal disease at up to 4.5‐year follow‐up |
49 per 1000 | 48 per 1000 (42 to 56) | OR 0.99 (0.85 to 1.15) | 14,054 (1 RCT) | ⊕⊕⊕⊕ HIGH1 | No studies were identified which reported on penile or anal intraepithelial neoplasia in males |
| Overall local/injection site adverse events at 15‐day follow‐up |
846 per 1000 | 905 per 1000 (888 to 914) | RR 1.07 (1.05 to 1.08) | 15,863 (3 RCTs) | ⊕⊕⊕⊕ HIGH | Data for specific local adverse events (pain, swelling, redness at injection site) are presented in the analysis section. |
| Overall systemic events and general symptoms at 15‐day follow‐up |
543 per 1000 | 548 per 1000 (532 to 565) | RR 1.01 (0.98 to 1.04) | 15,863 (3 RCTs) | ⊕⊕⊕⊝ MODERATE3 | |
| Serious adverse events at up to 4.5‐year follow‐up |
25 per 1000 | 15 per 1000 (4 to 63) | OR 0.60 (0.14 to 2.61) | 15,863 (3 RCTs) | ⊕⊕⊝⊝ LOW 2,3 | Please see Table 2 for list of events in each RCT. Numbers of events/number of participants (%) were: in 16‐ to 26‐year‐old females receiving nonavalent vaccine, 242/7686 (3.1%) vs quadrivalent vaccine, 184/7078 (2.6%) over a period of 4.5 years follow‐up; in 16‐ to 26‐year‐old males receiving nonavalent vaccine, 0/249 (0%) vs quadrivalent vaccine, 6/251 (2.4%) over 7 months follow‐up; in 9‐ to 15‐year‐old females receiving nonavalent vaccine, 1/299 (0.3%) vs quadrivalent vaccine, 2/300 (0.7%) over 7 months follow‐up. |
| Mortality at up to 4.5‐year follow‐up |
1 per 1000 | 1 per 1000 (0 to 3) | OR 1.20 (0.37 to 3.94) | 15,248 (3 RCTs) | ⊕⊕⊝⊝ LOW 4 | |
| *The risk in the intervention group (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval; HPV: human papillomavirus; OR: odds ratio; RCT: randomised controlled trial; RR: risk ratio; SAE: serious adverse event | ||||||
| GRADE Working Group grades of evidence High certainty: we are very confident that the true effect lies close to that of the estimate of the effect Moderate certainty: we are moderately confident in the effect estimate: the true effect is likely to be close to the estimate of the effect, but there is a possibility that it is substantially different Low certainty: our confidence in the effect estimate is limited: the true effect may be substantially different from the estimate of the effect Very low certainty: we have very little confidence in the effect estimate: the true effect is likely to be substantially different from the estimate of effect | ||||||
1Evidence from this outcome was not downgraded: the included trial was a large multi‐national trial with low risk of bias and precise estimates.
2Downgraded one level for imprecision: pooled estimate has a wide 95% confidence interval that incorporates a potential large beneficial effect and a potential large harmful effect.
3Downgraded one level for indirectness: this outcome is a composite measure of events which may or may not be clinically relevant, may or may not be related to the vaccine and may occur outside a biologically plausible time frame relative to vaccine exposure. This outcome is considered to provide indirect evidence about vaccine safety.
4Downgraded two levels for serious imprecision: few events and a wide 95% confidence interval that incorporates a potential large beneficial effect and a potential large harmful effect.
Background
Description of the condition
Human papillomavirus (HPV) is the most common viral infection of the reproductive tract in women and men (WHO 2017). Although most HPV infections resolve spontaneously, persistent infections can lead to precancerous lesions and cancer of the cervix, vagina, vulva, anus, penis, and head and neck. HPV‐related cancers accounted for an estimated 4.5% of all cancers worldwide in 2012 (de Martel 2017). When stratified by sex, these represent 8.6% of cancers in women and 0.8% of cancers in men, and by development status, 6.7% of all cancers in low‐ and middle‐income countries and 2.8% in high‐income countries (de Martel 2017). In 2012, of an estimated 636,000 HPV‐related cancers worldwide, 530,000 were cervical cancer, 35,000 anal cancer, 8500 vulval cancer, 13,000 penile cancer, and 37,000 head and neck cancers (de Martel 2017).
Amongst women with normal cytological findings, the worldwide prevalence of infection with any HPV genotype has been estimated in a meta‐analysis to be 11.7%, with higher prevalence in sub‐Saharan Africa, Latin America, the Caribbean, south‐east Asia and eastern Europe (Bruni 2010). Amongst heterosexual men assessed at baseline in a multicentre trial in 18 countries in Africa, Asia‐Pacific, Europe, Latin America and North America, penile infection with any HPV genotype was found in 18.7%, scrotal infection in 13.1%, perianal infection in 7.9% and infection at any site in 21.0%. Prevalence was highest in Africa and lowest in the Asia‐Pacific region (Vardas 2011). Prevalence of HPV infections in general is higher in men with HIV infection, men who have sex with men (MSM), and highest in MSM with HIV infection (Schim van der Loeff 2014; Smith 2011).
The main types of lesions associated with anogenital HPV infection are anogenital warts (condylomata acuminata) and intraepithelial neoplasia of the cervix (cervical intraepithelial neoplasia, CIN), vulva, vagina, anal canal/perianal area, and penis. Intraepithelial neoplasia is a precursor of some of these cancers, although it can regress at earlier stages and does not progress to invasive cancer in most affected people. A study that followed up women with inadequately treated CIN3 found that 31.3% (95% CI 22.7 to 42.3) developed invasive cancer after 30 years (McCredie 2008). HPV is also associated with squamous cell cancer of the head and neck (HNSCC). Of all head and neck cancers globally in 2012 (534,000), about 7% (37,000) were attributable to HPV, including 29,000 of 96,000 (31%) cases of oropharyngeal cancer (de Martel 2017). The incidence of cancers of the oropharynx has increased over time, more amongst men than women (Gillison 2015). It is likely that HPV is a main contributor to the increase in men, whilst smoking dominates the rise in women (Gillison 2015).
The International Agency for Research on Cancer classifies HPV genotypes according to oncogenic potential, with HPV genotypes 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, and 59 considered as high‐risk genotypes (Bouvard 2009). HPV 16 and 18 are the most common genotypes in women worldwide and are associated with most cases of invasive cervical cancer; combined, HPV 16, 18, 31, 33, 45, 52 and 58 cause approximately 90% of all HPV‐positive squamous cell carcinomas of the cervix (Alemany 2014; Bruni 2010; de Sanjose 2010). HPV 16 and 18 are also the cause of 90% of all anal cancers (Bosch 2002). HPV 16 is found in around 80% of HPV‐related anal squamous cell cancers, in 52% of invasive penile squamous cell carcinoma, and in 90% of penile intraepithelial neoplasia (Krustrup 2009; Schim van der Loeff 2014). In a meta‐analysis, HPV was detected in 22% of HNSCC, with 86.7% of those being attributed to HPV 16, although HPV 6 and 11 were also detected in a minority of cases (Syrjänen 2010). HPV 6 and 11 account for up to 90% of anogenital warts (Greer 1995; Sturegard 2013).
Description of the intervention
Three prophylactic HPV vaccines, given by intramuscular injection, are available. All three vaccines are made by genetic technologies and are non‐infectious because they do not contain viral DNA. They are made from purified L1 capsid proteins, which form virus‐like particles that resemble the structure of specific genotypes of HPV. Each vaccine is directed against two or more high‐risk HPV genotypes. All three vaccines contain L1 proteins of HPV genotypes 16 and 18 (WHO 2017), because these cause about 70% of cervical cancer globally. The vaccines are commonly known by the number of different genotypes that they contain (i.e. the valency, Table 6). The bivalent vaccine contains L1 proteins of two HPV genotypes; 16 and 18. The quadrivalent vaccine contains L1 proteins of four HPV genotypes; 16 and 18, plus HPV 6 and 11, which cause genital warts. The nonavalent vaccine is the most recent vaccine and contains L1 proteins of nine HPV genotypes; 16, 18, 31, 33, 45, 52 and 58, plus HPV 6 and 11. All three vaccines contain adjuvants (Table 6). In addition to the licensed vaccines, as of September 2018, there are three vaccines in stage 2 to 3 development, two bivalent vaccines manufactured by Innovax and Walvax in China, and a quadrivalent vaccine manufactured by the Serum Institute of India (LaMontagne 2017).
2. Characteristic of licensed prophylactic HPV vaccines.
| Bivalent vaccine | Quadrivalent vaccine | Nonavalent vaccine | |
| Manufacturer | GlaxoSmithKline (GSK, Rixensart, Belgium) | Merck, Sharp & Dome (Merck & Co, Whitehouse Station, NJ, USA) | Merck, Sharp & Dome (Merck & Co, Whitehouse Station, NJ, USA) |
| Antigens | L1 VLPs of HPV16 (20 μg) and HPV18 (20 μg) | L1 VLPs of HPV6 (20 μg), HPV11 (40 μg), HPV16 (40 μg) and HPV18 (20 mg) | L1 VLPs of HPV6 (30 μg), HPV11 (40 μg), HPV16 (60 μg), HPV18 (40 mg),HPV31 (20 μg), HPV33 (20 μg), HPV45 (20 μg), HPV52 (20 μg)and HPV58 (20 μg) |
| Vaccination schedule | 3 doses: at day 1, month 1, and month 6 | 3 doses: at day 1, month 2, and month 6 | 3 doses: at day 1, month 2, and month 6 |
| Adjuvant | AS04: 500 μg aluminium hydroxide, 50 μg 3‐deacylated monophosphoryl lipid A (MPL) | 225 μg amorphous aluminium hydroxyl‐phosphate sulphate | 500 μg amorphous aluminium hydroxyl‐phosphate sulphate |
| Trade name | Cervarix | Gardasil, Silgard | Gardasil‐9 |
| Produced by recombinant technology using | Baculovirus in Trichoplusia in insect cells | Saccharomyces cerevisae (Baker’s yeast) | Saccharomyces cerevisae (Baker’s yeast) |
Abbreviations
HPV: human papillomavirus MPL: monophosphoryl lipid VLP: virus‐like particle
To prevent HPV infection, all HPV vaccines are intended to be administered, where possible, before the first exposure to HPV, that is, before onset of sexual activity. All national HPV vaccination programmes involve girls, and some countries have extended their programme to boys. According to most modelling studies, HPV vaccination programmes for preadolescent girls will be cost‐effective for the prevention of cervical cancer, particularly in settings in which infrastructure for cervical cancer screening is poor (WHO 2017). HPV vaccination of females gives indirect protection to males. These so‐called herd effects mean that, at the population level, female‐only vaccination programmes have resulted in reductions in HPV infections in both men and women (Drolet 2019). However, herd effects from female‐only vaccination do not affect MSM, who experience a high burden of anal cancer and anogenital warts. Modelling studies also indicate that female‐only HPV vaccination, even at high levels of coverage, will not prevent all HPV‐related cancers in heterosexual men (Bogaards 2015). The cost‐effectiveness of vaccinating boys depends on vaccination coverage in girls, the epidemiology of HPV‐related disease, and the costs of the vaccine and the programme (WHO 2017).
The uptake of HPV vaccination varies widely between countries that have introduced it as part of their national immunisation programmes. In 2017, across 82 countries coverage rates ranged from 8% to 98% (Brotherton 2018). To date, few countries in Africa and Asia have introduced HPV vaccine. Whilst there is evidence from some low‐ and middle‐income countries (LMICs) that HPV vaccine can be effectively introduced, countries with challenges have also been reported. For example, Uganda reported coverage of more than 80% for the first dose of a two‐dose vaccine schedule, but this was not sustained for the second dose (Brotherton 2018). In high‐income countries, such as England, Scotland, and Australia, school‐based programmes have reached 70% to 80% of girls for all doses. In other high‐income countries, such as France, USA, Japan and Denmark, coverage has either not reached, or has fallen below 50%. The reasons for low coverage differ between countries, but include organisation of programme implementation, resistance from healthcare providers, adverse media coverage, and concerns about safety (Gallagher 2018).
How the intervention might work
HPV vaccines containing virus‐like particles of the L1 protein are prophylactic, meaning that they prevent infection and the development of intraepithelial lesions caused by HPV genotypes that are present in the vaccine (Stanley 2006). The virus‐like particles in the vaccines produce very high levels of antibodies in serum, but the exact mechanisms by which the vaccines prevent HPV infection are not completely understood. The levels of antibodies needed to provide protection against clinical disease caused by HPV (known as the immunological correlate of protection) have not been established because the number of breakthrough infections after vaccination has been too low. The International Agency for Research on Cancer regards persistent HPV infection with HPV types 16 and 18, measured with standardised and validated tests, as an accurate surrogate marker for the precancerous lesions of the cervix and anus (IARC 2014). Post‐licensure data from national immunisation programmes show reductions in high‐grade lesions of the cervix and anus with three‐dose regimens of the bivalent and quadrivalent vaccines (Markowitz 2018). Since precancer is on the causal pathway to invasive cancer, it is assumed that prevention of precancerous lesions will also be shown to prevent cancer when sufficient follow‐up time has accrued in post‐licensure studies. Less is known about the prognostic value of persistent HPV infection in the development of vaginal, vulval and oropharyngeal cancers (IARC 2014).
All of the randomised controlled trials (RCTs) that established the efficacy of HPV vaccines in the prevention of high‐grade precancerous lesions of the cervix used a three‐dose vaccination schedule (Arbyn 2018). Because of low HPV exposure and ethical constraints in conducting research that requires genital examination and specimen collection in adolescent populations (under 15 years of age), randomised efficacy trials of vaccines have typically been first conducted in women aged 15 to 25 or 26 years (Arbyn 2018). Once immunogenicity and harms have been evaluated, non‐inferiority of immunological outcomes in 9‐ to 15‐year‐olds is assessed in non‐randomised bridging studies (e.g. Block 2006; Dobson 2013). The International Agency for Research on Cancer regards bridging studies that demonstrate non‐inferiority as a sufficient endpoint for individuals under 16 years of age (IARC 2014).
Vaccine schedules are designed to produce a strong and long‐lasting antibody response so that, when challenged by exposure to the real pathogen, the immune system prevents infection. A three‐dose vaccine schedule is typical for inactivated protein vaccines for infants; the second dose is given one or two months after the first dose and a third dose six months after the first dose. The first two vaccine doses are called 'prime' doses that generate immune memory via B‐lymphocytes produced in the bone marrow (Stanley 2014). The second dose results in higher levels of antibodies than the first and increases the binding affinity of the antibody to the antigen, in a process that lasts several months. As a result of this process (affinity maturation), B cells with very high levels of affinity, differentiate in the bone marrow into memory B cells that respond rapidly to produce antibodies on exposure to antigen and long‐lived plasma cells that continuously produce antibody at low levels. A third vaccine dose given at least four months after the prime doses 'boosts' these responses maximally to provide long‐lasting protection (Stanley 2014).
Simplified HPV vaccination schedules with fewer doses should allow more people to receive the vaccine. Preadolescents and adolescents (age 9 to 15 years) produce stronger antibody responses to virus‐like protein HPV vaccines than older adolescents and adults (Block 2006; Dobson 2013), even after a single dose (Sankaranarayanan 2016). It appears that multiple repeated doses of these vaccines are not required for affinity maturation and that long‐lived plasma cells are more important than memory B cells in the immune response (Schiller 2018). It is thought that structural characteristics of the virus‐like particles allow efficient production of the long‐lived plasma cells, which continuously produce antigen‐specific antibodies, resulting in strong long‐lasting immune responses with reduced dose schedules (Schiller 2018).
Evidence of the likely efficacy of a two‐dose schedule of virus‐like particle HPV vaccines in preventing incident vaccine‐type HPV infection comes from studies in which data from RCTs were analysed as cohort studies according to the number of doses of HPV vaccine received (Kreimer 2011; Sankaranarayanan 2016). Kreimer and colleagues conducted a secondary analysis of data from an RCT of the bivalent vaccine amongst 18‐ to 25‐year‐old women in Costa Rica (Kreimer 2011). In that trial, 20% of women did not receive all three doses of the vaccine. Women were grouped according to the number of HPV vaccine doses that they received. The proportions of women with incident HPV 16/18 infection that persisted for 12 months or more was similar amongst women who received one, two and three doses (Kreimer 2011). An updated analysis combined data from this Costa Rica vaccine trial and a pivotal trial of the bivalent vaccine, Paavonen 2007, according to number of doses received after four years of follow‐up (Kreimer 2015). In the modified total vaccinated cohort, vaccine efficacy against HPV 16/18 incident infection that persisted for 12 months or more was 83.7% (95% CI 35.7 to 97.5%) with two doses, and 92.6% (95% CI 89.2 to 95.1%) with three doses. Sankaranarayanan and colleagues analysed an RCT of the quadrivalent vaccine in 10‐ to 18‐year‐olds in India (which was stopped before enrolment was completed) according to the number of HPV vaccine doses received (Sankaranarayanan 2016). Incidence of HPV 16/18 was 0.8% (95% CI 0.2 to 1.9%, 4/526) amongst participants who received two doses, and 0.4% (95% CI 0.0 to 1.3%, 2/536) amongst those who received three doses (Sankaranarayanan 2016). Additional data from a systematic review of post‐licensure studies in national HPV vaccination programmes, show the receipt of two doses of HPV vaccine was associated with a reduction in the incidence of vaccine‐type HPV prevalence, anogenital warts and cervical abnormalities in some, but not all, studies (Markowitz 2018).
Why it is important to do this review
In practice, HPV vaccination rates in many countries remain low.
Simpler HPV immunisation schedules have been identified as a potential strategy to increase the coverage of vaccination (Walling 2016). The World Health Organization (WHO) recommended a two‐dose HPV vaccine schedule in 2014, based on a systematic review of studies with immunogenicity as the end‐point (D'Addario 2017; WHO 2017). As of 30 December 2017, 80 countries had fully introduced HPV vaccination and four countries had partially introduced HPV vaccination into their national immunisation programmes, with 65 countries having implemented a two‐dose schedule in girls 9 to 14 years old (www.who.int/immunization/monitoring_surveillance/data/en).
In 2018, a Cochrane Review concluded that the licensed three‐dose schedules of the bivalent and quadrivalent HPV vaccines result in limited adverse events and are effective against precancerous cervical lesions in females (Arbyn 2018). Since the 2014 WHO recommendation and original systematic review of two‐dose HPV vaccination schedules (D'Addario 2017; WHO 2017), the evidence base from RCTs about alternative vaccination schedules has expanded to include more data about the nonavalent HPV vaccine (Iversen 2016), about HPV vaccination in males, including MSM (Giuliano 2011), and amongst people living with HIV infection (Toft 2014). This review was initially commissioned in 2016 by the WHO Initiative for Vaccine Research to update the evidence for the two‐dose recommendation and is an update of D'Addario 2017. We produced a revised protocol for this update (Bergman 2017).
Cochrane Reviews usually include only RCTs with major clinical disease endpoints because RCTs provide the highest level of certainty about critical outcomes of interventions. However, precancer and cancer do not develop until many years after the acquisition of HPV infection, so it is difficult to determine the efficacy of vaccines against these outcomes. Persistent HPV infection is considered by the International Agency for Research on Cancer to be sufficient as a surrogate marker for cervical and anal cancer and non‐inferiority of immunogenicity is sufficient to bridge results to under‐16‐year‐olds. It is therefore important to document all infection and immunological outcomes measured in RCTs of HPV vaccines, even if the intended use of the vaccine is to prevent cancer.
This review aims to extend the evidence base on the efficacy and harms of HPV vaccines by including and evaluating RCTs of different HPV vaccines and different dose schedules in adolescent and adult females and males, as well as women and men living with HIV infection.
While RCTs can identify adverse events that take place during the study period, post‐marketing surveillance is needed to continue monitoring harms associated with HPV vaccines in the population, and will be incorporated in future updates of this review.
Objectives
To evaluate the efficacy, immunogenicity, and harms of different dose schedules and different types of HPV vaccines in females and males.
Methods
Criteria for considering studies for this review
Types of studies
We included RCTs with no language restrictions. We included unpublished studies, studies in press, and abstracts without a full‐text publication, if they met the inclusion criteria.
Types of participants
Females or males aged 9 to 26 years, including MSM. For the comparisons among people living with HIV, we included all age groups.
Types of interventions
Prophylactic administration of licensed bivalent (Cervarix, GlaxoSmithKline), quadrivalent (Gardasil, Merck), or nonavalent (Gardasil 9, Merck) HPV vaccines. We excluded studies if they assessed monovalent or plasmid vaccines, or assessed non‐prophylactic uses of bivalent, quadrivalent or nonavalent vaccines. In addition, we considered for inclusion any trials reporting on the efficacy, immunogenicity, or adverse events in vaccines currently in phase 2 or 3 development. Studies comparing bivalent versus quadrivalent vaccines were excluded, as these will be included in an update of a separate Cochrane Review (Arbyn 2018).
For males and people living with HIV, we included comparisons of HPV vaccines to placebo containing no adjuvant or only the adjuvant of the HPV vaccine, or another HPV vaccine.
In this review, we use the term 'control' to refer to comparator products that contain another vaccine or only vaccine adjuvants, regardless of the terminology used in individual study reports. We use the term 'placebo' only to refer to comparator products containing no adjuvant or active vaccine. In Characteristics of included studies we have reported full details of the type of comparison group compound.
The focus of the review was on different dose schedules and comparisons between different types of HPV vaccine. Where possible we stratified data by participant characteristics of age, gender, and HIV status. Specifically, we aimed to investigate the efficacy, immunogenicity, and harms of:
fewer than three doses of HPV vaccine in females and males;
different intervals between doses in a two‐dose schedule in females and males;
HPV vaccination compared to control for males (a Cochrane Review for females has been published (Arbyn 2018));
nonavalent HPV vaccine compared to the other HPV vaccines in females and males;
HPV vaccination in people living with HIV.
Types of outcome measures
Primary outcomes
Unless otherwise stated, primary outcomes were assessed at the longest follow‐up time reported by the included studies.
Invasive cervical, vaginal, vulval, anal, or penile cancer
In females, histologically‐confirmed high‐grade cervical (CIN2, CIN3, and adenocarcinoma in situ), vaginal, vulval, or anal intraepithelial neoplasia, irrespective of HPV genotype, or any lesions associated with the HPV genotypes included in the vaccine
In males, histologically‐confirmed anal, or penile, perianal or perineal intraepithelial neoplasia of any grade, irrespective of HPV genotype, or any lesions associated with the HPV genotypes included in the vaccine
Anogenital warts
Adverse events related to the vaccines: local adverse events (overall local/injection site adverse events, redness, swelling, pain at the injection site), assessed at the follow‐up times reported in the trials (usually up to seven days); overall systemic events and general symptoms assessed at the follow‐up times reported in the trials (usually up to 15 days)
Serious adverse events and mortality: any events that are fatal, life‐threatening, or result in hospitalisation and mortality. We collected information from each trial about whether these events were considered to be vaccine‐related and the methods of adverse events data monitoring and collection, including mode of data collection, timing, attribution methods, intensity of ascertainment, harms‐related monitoring and stopping rules, and reporting based on event frequency (i.e. frequency‐based filter), based on the CONSORT statement extension for reporting harms (Ioannidis 2004; Lineberry 2016).
Secondary outcomes
Unless otherwise stated, secondary outcomes were assessed at the longest follow‐up time reported by the included studies.
Incident infection with vaccine HPV genotypes (HPV 16 and HPV 18 jointly; HPV 6, HPV 11, HPV 16 and HPV 18 jointly; and HPV 31, HPV 33, HPV 45, HPV 52, and HPV 58 jointly)
Persistent infection (persisting for at least six months or at least 12 months) with vaccine HPV genotypes
Immunological outcomes (geometric mean titre (GMT) and seropositivity), assessed at one month following the last dose and at the longest‐term follow‐up
For the comparisons of dose schedules (i.e. number of doses and longer or shorter interval(s) between doses) we considered immunological outcomes as primary outcomes because these trials were designed to show non‐inferiority of immunogenicity. While these trials were not designed to evaluate efficacy or safety of the vaccines, we have included clinical outcomes when reported and comparative estimates of harms associated with the different dose schedules.
Search methods for identification of studies
We attempted to identify all relevant studies regardless of language or publication status (published, unpublished, in press and in progress).
Electronic searches
All searches were conducted on 27 September 2018. We searched the following electronic databases:
the Cochrane Central Register of Controlled Trials (CENTRAL, Issue 9, 2018) (published in the Cochrane Library)
Ovid MEDLINE (1946 to September week 2 2018);
Ovid Embase (1980 to 2018 week 39).
The search terms used are detailed in Appendix 1, Appendix 2, and Appendix 3. We also searched ClinicalTrials.gov and the WHO International Clinical Trials Registry Platform (ICTRP) to identify ongoing trials using 'genital warts', 'condyloma', 'anogenital warts', 'venereal warts', 'human papilloma virus vaccine', and 'HPV vaccine' as search terms.
Searching other resources
We searched the reference lists of all included studies, as well as the reference lists of any relevant systematic reviews published within the search dates. We searched vaccine manufacturer web sites for relevant clinical trial reports (GlaxoSmithKline; Merck). In addition, we screened a list of HPV vaccine studies (Jørgensen 2018a), that was constructed through enquiries to HPV vaccine manufacturers and regulators, as well as searches of trial registers and journal publication databases. For each included study, where available, we identified and screened study governance documents (protocols, trial registration listings and results, manufacturers' clinical study reports) for relevant data and outcomes. We also contacted the vaccine manufacturers through the WHO Initiative for Vaccine Research for any additional, potentially relevant studies.
Data collection and analysis
Selection of studies
Two experienced systematic reviewers independently screened citations and abstracts of studies identified from the electronic searches for potential inclusion. A third reviewer resolved any disagreements. We obtained full‐text reports for all potentially eligible studies. Two independent reviewers determined the eligibility of studies for inclusion in the review from the full reports according to predefined criteria. A third reviewer resolved any disagreements.
Data extraction and management
For the purpose of the review, we named studies on the basis of the first‐named study author and year of publication. Many studies have more than one document associated with them: journal publications (main study reports, reports of long‐term follow‐up, secondary outcomes and post‐hoc analyses), conference abstracts, and study governance documents (protocols, trial registration listings and results, manufacturers' clinical study reports). For each study we grouped these documents together and designated one report as the primary reference for the study; the study name is derived from the name of the first author and year of publication of this particular report.
In cases where study reports emanate from the same parent study, but are planned or reported, or both, as distinct, discrete studies, we have named and handled these separately.
Two reviewers carried out data extraction independently using pretested data extraction forms. We resolved any differences by discussion between the two reviewers and referral to the study reports.
We cross‐checked data for the efficacy outcomes and adverse events between the primary trial publications, trial registries, and clinical study reports. We used the data derived from these sources with the longest follow‐up time for the primary analysis.
Assessment of risk of bias in included studies
Two reviewers independently carried out 'Risk of bias' assessments using the Cochrane 'Risk of bias' tool for all included studies (Higgins 2011b). We judged the risk of bias for each domain as 'low risk', 'unclear risk' or 'high risk'. We resolved differences by discussion between the two reviewers and if necessary we referred to a third reviewer for arbitration.
Measures of treatment effect
We calculated risk ratios (RR) with 95% confidence intervals (CI) for dichotomous outcomes. We calculated rate ratios with 95% CIs for dichotomous clinical outcomes reported as incidence rates. For outcomes with rare events (i.e. an event rate of < 10%), serious adverse events, and deaths, we calculated Mantel‐Haenszel odds ratios (OR) for dichotomous outcomes. We assessed the robustness of the primary analysis for very rare events with alternative statistical methods (see Sensitivity analysis).
For continuous geometric mean titre (GMT) data, we calculated inverse variance (IV) ratios of GMTs with 95% CIs. Initially, we transformed the point estimates as well as the lower and upper bound of the 95% CI of GMT for each group into the logarithmic scale in order to obtain statistically correct standard deviations. Then we calculated the mean difference of the compared group and back‐transformed the results (point estimate and 95% CIs) to the original scale through exponentiation. Non‐inferiority margins for immunological outcomes were derived from the individual trials (all trials used 0.5 for the GMT ratio). For GMT ratios non‐inferiority is demonstrated if the lower 95% CI is greater than 0.5. If the lower confidence interval was below the non‐inferiority margin, but the point estimate was within the margin, we considered the result to be inconclusive (Piaggio 2012).
For adverse events and efficacy outcomes we carried out a complete‐case analysis (the number analysed) and an intention‐to‐treat analysis when data were available. For immunogenicity outcomes assessed in non‐inferiority trials, we favoured data from per‐protocol analyses, in which all participants were HPV‐seronegative at baseline. We did not pool studies with participants who were HPV‐seropositive at baseline with studies with participants who were HPV‐seronegative at baseline.
Unit of analysis issues
If a single trial compared two or more vaccine arms (with or without a control arm), we labelled the arms separately in analyses. We grouped suitable multiple treatment arms (e.g. arms that evaluated different vaccine lots) and excluded irrelevant trial arms. We did not pool data from cluster RCTs with those from individually randomised studies.
Dealing with missing data
If data on specific outcomes or population groups were missing, we attempted to contact study authors or data owners to request this data. We did not impute missing outcome data. Where data were missing or losses to follow‐up were substantial, we downgraded the certainty of study evidence due to risk of bias according to GRADE criteria (Guyatt 2011a).
Assessment of heterogeneity
We described potential sources of clinical heterogeneity, and downgraded the certainty of the evidence according to GRADE criteria due to inconsistency where appropriate (Guyatt 2011b). When pooling of studies was feasible (i.e. at least two studies included), we inspected forest plots visually for potential outlying studies and variability in the estimated effects across studies. We assessed statistical heterogeneity using the I2 statistic. This statistic quantifies the percentage of inconsistency in the treatment effects across studies beyond simple chance. We regarded heterogeneity as potentially unimportant if the I2 was 0% to 40%; that values of 30% to 60% might represent moderate heterogeneity; values between 50% to 90% might represent substantial heterogeneity; and that values between 75% to 100% would represent considerable heterogeneity (Higgins 2011a). Where considerable heterogeneity existed (>75%), we did not pool study data.
Assessment of reporting biases
We had planned to use funnel plots to investigate the possible presence of small‐study effects for each outcome. However, we did not produce funnel plots, due to the limited number of studies per outcome (i.e. fewer than 10) (Guyatt 2011c).
Data synthesis
When pooling was considered feasible, we employed a random‐effects meta‐analysis using the DerSimonian and Laird method (DerSimonian 1986), as it was assumed that effect size might vary across studies and settings. We used data from the last available follow‐up for clinical and adverse event outcomes, with the number of participants (rather than the number of events) used in the analysis. For immunological outcomes, we extracted data from one month after the last HPV dose and at the longest‐term follow‐up.
To assess the harms associated with the HPV vaccine comparisons in this review, we recorded the methods used in each included study to collect adverse event data, and extracted data on common events that we determined a priori as: pain, swelling, redness at the injection site and overall systemic adverse events. For all serious adverse events reported in the included studies, we extracted the number of participants, participants with events and a description of the events. We also extracted information on whether the serious adverse events were considered to be related to the vaccines. We did not conduct statistical hypothesis testing because our protocol did not prespecify hypotheses about differences in the occurrence of any specific serious adverse event.
We prepared 'Summary of findings' tables for each comparison for which data were available for the following outcomes that were assessed as critical or important according to GRADE guidelines (Guyatt 2011d):
for females: high‐grade cervical intraepithelial neoplasia, adenocarcinoma in situ, or cervical cancer; high‐grade vulval and vaginal disease;
for males: invasive anal or penile cancer, external genital lesions;
for all populations: anogenital warts, overall local/injection site adverse events, overall systemic events and general symptoms, serious adverse events, deaths;
for comparisons of dose schedules (i.e. number of doses and longer or shorter interval between doses): immunological outcomes.
We assessed the certainty of evidence in the review through discussion between review authors using the GRADE approach using GRADEpro online software (GRADEpro GDT). We assessed only the primary outcomes reported in the 'Summary of findings' tables and appendices using GRADE. We considered the following factors for downgrading: limitations in the study design (risk of bias); inconsistency of results (heterogeneity); indirectness of evidence (applicability); imprecision (few events and wide confidence intervals); and publication bias (Guyatt 2011a). When evidence was downgraded, we detailed the reasons in footnotes of the 'Summary of findings' tables and summarised these in the Quality of the evidence section. Depending on whether evidence was downgraded or not, we rated the certainty of the evidence for each outcome as follows:
high‐certainty evidence indicates that we are very confident that the true effect lies close to that of the estimate of the effect (evidence was not downgraded);
moderate‐certainty evidence indicates that we are moderately confident in the effect estimate: the true effect is likely to be close to the estimate of the effect, but there is a possibility that it is substantially different (evidence was downgraded one step for any of the factors described above);
low‐certainty evidence indicates that our confidence in the effect estimate is limited: the true effect may be substantially different from the estimate of the effect (evidence was downgraded two steps for any of the factors described above);
very low‐certainty evidence indicates that we have very little confidence in the effect estimate: the true effect is likely to be substantially different from the estimate of effect (evidence was downgraded three steps for any of the factors described above).
We reported relative risks (ORs or RRs) in the Effects of interventions section for all relevant outcomes, but where the evidence was of very low‐certainty we reported the number of events in each group only.
Subgroup analysis and investigation of heterogeneity
We performed subgroup meta‐analyses where possible, using vaccine type, gender, and age group (9 to 15 years; 16 to 26 years) as stratifying variables.
Sensitivity analysis
We carried out one post‐hoc sensitivity analysis for outcomes using a Mantel‐Haenszel odds ratio where events were very rare (i.e. an event rate of < 1% across both trial arms). We compared the results of the primary analysis calculated with Mantel‐Haenzsel methods against those with Peto methods (Bradburn 2007). We also planned to conduct sensitivity analyses for the primary outcomes according to allocation concealment (high risk of bias, low risk of bias, and unclear risk of bias) for outcomes for which data could not be pooled because of considerable heterogeneity (I2 > 75%).
Results
Description of studies
Overall, 20 RCTs were included for analysis in this review (Figure 1). The characteristics of individual studies and assessment of risk of bias are presented in the Characteristics of included studies section and Figure 2.
1.

Study flow diagram.
2.

Risk of bias summary: review authors' judgements about each risk of bias item for each included study.
Results of the search
The search identified a total of 3852 records; 3298 from electronic databases and 554 from other sources (systematic reviews, vaccine manufacturers, online trial registrations, WHO IVR department, HPV study index (Jørgensen 2018a)). After de‐duplication, 3291 records remained. After excluding irrelevant abstracts, we assessed 528 full texts. We excluded 438 full texts and included 20 RCTs (reported in 69 published and unpublished reports) in this review for analysis (Denny 2013; Dobson 2013; Giuliano 2011; Hidalgo‐Tenorio 2017; Iversen 2016; Joura 2015; Lehtinen 2018; Leung 2015; Levin 2010; Lin 2014; NCT00941889 2016; NCT01031069 2017; NCT01862874 2018; Petaja 2009; Puthanakit 2016; Romanowski 2011; Toft 2014; van Damme 2016; Vesikari 2015; Wilkin 2018). We identified 15 ongoing studies (reported in 16 records) and two studies (reported in five references) are awaiting classification.
Included studies
We found 20 RCTs that contained data on vaccine efficacy or harms, or both, and enrolled a total of 31,940 men, women, and children. Ten studies were multi‐national and were carried out in two to 18 countries in Africa, Asia, Asia‐Pacific, Europe, Latin America, North America, and South America. The other 10 studies were carried out in one country only (USA, including Puerto Rico (3 studies), Finland (2), Canada (1), Denmark (1), Japan (1), Spain (1), South Africa (1)). Owing to differences in the protocols of the included trials, the maximum age for inclusion was either 25 or 26 years.
Description of studies
Four RCTs evaluated the effects of reduced dose schedules (Dobson 2013; Iversen 2016; Leung 2015; Romanowski 2011). All these trials were designed as non‐inferiority trials of antibody responses. They reported on immunogenicity as the primary outcome and on adverse events. None of these trials collected data on clinical events. These four RCTs evaluated the effects of two doses of HPV vaccine versus three doses of HPV vaccine in adolescent girls (9 to 15 years). We did not identify any RCTs that evaluated the efficacy or harms of one dose of HPV vaccine.
Four RCTs compared different intervals between doses. Two RCTs compared a longer interval two‐dose schedule with a shorter schedule (0 and 6 months versus 0 and 2 months; or 0 and 12 months versus 0 and 6 months) of bivalent HPV vaccine in 9‐ to 14‐year‐old females (Puthanakit 2016; Romanowski 2011). One RCT of nonavalent HPV vaccine compared a two‐dose schedule with a longer interval (0 and 12 months) and a shorter interval (0 and 6 months) in 9‐ to 14‐year‐old females and males (Iversen 2016). One RCT compared a longer interval three‐dose schedule (administered at 0, 2 and 12 months) with a shorter schedule (administered at 0, 2 and 6 months) of quadrivalent HPV vaccine in 18‐ to 25‐year‐old males (Lin 2014).
Two RCTs compared quadrivalent HPV vaccine versus control in 5189 males aged 16 to 26 years (Giuliano 2011; NCT01862874 2018). A subgroup analysis of Giuliano 2011 also reported on the efficacy and harms of the quadrivalent HPV vaccine compared with control vaccine in MSM. Giuliano 2011 reported on clinical, adverse event, and immunogenicity outcomes, and NCT01862874 2018 reported on clinical outcomes and adverse events. One RCT compared bivalent HPV vaccine versus control hepatitis B virus (HBV) vaccine in 270 boys aged 10 to 18 years and reported on immunogenicity and harms (Petaja 2009). In addition, a cluster‐RCT investigating both direct and indirect effects of HPV vaccination of girls and boys (gender‐neutral) and girls‐only vaccination reported on adverse events in a subgroup of 3703 12‐ to 15‐year‐old males vaccinated with the bivalent vaccine or control HBV vaccine (Lehtinen 2018). We identified no studies investigating the clinical efficacy of the nonavalent vaccine in males.
Three RCTs compared three doses of nonavalent vaccine with three doses of quadrivalent vaccine: one in 9‐ to 15‐year‐old females (Vesikari 2015), one in 16‐ to 26‐year‐old females (Joura 2015), and one in males aged 16 to 26 years (van Damme 2016). Joura 2015 reported clinical outcomes for the 16‐ to 26‐year‐old population. All three studies reported on adverse event and immunogenicity outcomes.
Studies including participants living with HIV
We identified seven RCTs that examined HPV vaccines in 1723 people living with HIV (Denny 2013; Hidalgo‐Tenorio 2017; Levin 2010; NCT00941889 2016; NCT01031069 2017; Toft 2014; Wilkin 2018):
Toft 2014 compared bivalent with quadrivalent vaccine in females and males ≥ 18‐years old;
NCT01031069 2017 compared bivalent with quadrivalent vaccine in 15‐ to 25‐year‐old females;
Denny 2013 compared bivalent vaccine with control in women aged 18 to 25 years;
Hidalgo‐Tenorio 2017 compared quadrivalent vaccine with control in MSM ≥ 18‐years old;
Wilkin 2018 compared quadrivalent vaccine with control in females and males ≥ 27‐years old;
NCT00941889 2016 compared quadrivalent vaccine with control in females and males ≥ 18‐years old that had been treated for anogenital warts;
Levin 2010 compared three doses of quadrivalent vaccine with control in 126 children aged 7 to 12 years, and four versus three doses of quadrivalent vaccine in the same participants.
The studies were carried out in Brazil, Denmark, Estonia, India, South Africa, Spain, Thailand, and the USA, including Puerto Rico. Of these, only two reported on clinical outcomes (NCT00941889 2016; Wilkin 2018), as most were designed as non‐inferiority trials of antibody responses.
Adverse events
Appendix 4 lists the methods used to collect adverse event data. The mode of data collection was reported in 16 of the 20 studies and was passive in two studies (e.g. patients recording symptoms on diary cards); proactive in three (e.g. investigators observing participants after vaccine administration, or field workers visiting or calling participants in their homes); both passive and proactive in nine studies; and in two studies, the details were insufficient for us to categorise as passive or proactive. Time frame (duration of follow‐up) was reported for all but three studies; for two studies it was unclear, and one study did not report on adverse events (NCT00941889 2016). Methods to determine the relationship between vaccination and adverse events were reported by 10 studies: attribution was done by study investigators in nine studies and by a study co‐ordinator in one study. Where the attribution method was not reported, we assumed this role was performed by study investigators. Fourteen studies (74%) provided definitions for the adverse events outcomes. Withdrawals due to adverse events were reported in 14 (70%) studies, but most studies (95%) did not report on how withdrawals would be handled in the analysis. Only one study reported harms‐related monitoring and stopping rules (Hidalgo‐Tenorio 2017). Seventeen studies reported on all adverse events regardless of frequency (i.e. they did not use a frequency‐based filter); NCT01862874 2018 used a 5% threshold for other adverse events; it was unclear whether Dobson 2013 used a filter, and one study did not report on adverse events (NCT00941889 2016).
The length of follow‐up for serious adverse events in the included studies ranged from seven months to five years. Table 2 lists the serious adverse events reported in each study. In all studies, the individual serious events were listed for each study arm. In five of the 20 RCTs, 50 or more serious adverse events were reported (Joura 2015, Lehtinen 2018; Puthanakit 2016; Romanowski 2011; Wilkin 2018). Information on whether serious adverse events were considered to be related to the vaccine is reported in the section Effects of interventions.
Studies awaiting classification
We identified two studies that included both males and females randomised to HPV vaccine and control (Li 2012; Reisinger 2007). The male population in these studies would qualify for inclusion in our review, but at the time of preparing this review we were not able to access data for males only. We have requested this information from the study investigators and, should these data become available, they will be included in a future update of this review.
Li 2012 and Reisinger 2007 both compared quadrivalent HPV vaccine to vaccine adjuvant‐containing control in 9‐ to 15‐year‐old males. The studies reported on the comparison of males with females for immunogenicity outcomes and adverse events for males and females as one group. Li 2012 was carried out in China, and Reisinger 2007 was carried out in 10 countries in North America, Latin America, Europe and Asia. See Characteristics of studies awaiting classification for further details.
Ongoing studies
We identified 15 potentially relevant ongoing studies that have not been completed, but might be relevant for inclusion in future updates of this review. All studies are RCTs and studies may appear in more than one category of the list below:
eight include healthy females (NCT01735006; NCT02009800; NCT02405520; NCT02562508; NCT02733068; NCT02740777; NCT02834637; NCT03180034);
four include healthy males and females (NCT01824537; NCT02567955; NCT02710851; NCT02888418);
one includes HIV‐positive MSM (NCT02087384);
one includes males and females cured of genital warts (NCT03296397);
one includes females with genital warts (NCT02750202);
seven are evaluating new vaccines in development in China (NCT01735006; NCT02405520; NCT02562508; NCT02710851; NCT02733068; NCT02740777; NCT02888418);
four are evaluating the quadrivalent vaccine (NCT02009800; NCT02087384; NCT02750202; NCT03296397);
one is evaluating the nonavalent vaccine (NCT01824537); and
three are comparing the bivalent to the nonavalent vaccine (NCT02567955; NCT02834637; NCT03180034).
In addition to the seven studies ongoing in China, three of these studies are ongoing in Canada, and one study each in Costa Rica, France, the Netherlands, South Africa, and Tanzania. See Characteristics of ongoing studies for further details.
Excluded studies
We excluded 438 full texts. Twenty‐two of these were potentially relevant studies, and the reasons for their exclusion are included in the Characteristics of excluded studies table. We excluded six studies because they were not RCTs, and two studies because they included females over 26 years of age. Most of the excluded studies contained no comparison of relevance to the review: seven studies compared HPV‐vaccinated to HPV‐unvaccinated females, five compared different intervals in three‐dose schedules in females, one compared three‐dose schedules of the bivalent and quadrivalent vaccine in young females, and one evaluated the effect of a booster dose of HPV vaccine.
Risk of bias in included studies
The risk of bias for each included study is detailed in Characteristics of included studies and an overview is presented in Figure 2. Overall risk of bias for each comparison is discussed in each results section below.
Allocation
We assessed most studies as being at low risk of selection bias, as they reported adequate randomisation sequence generation (15/20 = 75%) and allocation concealment procedures (15/20 = 75%). Five studies did not report their methods to conceal allocation adequately (Levin 2010; Lin 2014; NCT01031069 2017; NCT00941889 2016; NCT01862874 2018), and five did not report the method of sequence generation adequately (Levin 2010; NCT01031069 2017; NCT00941889 2016; NCT01862874 2018; Wilkin 2018); we assessed them as being at unclear risk of bias.
Blinding
Blinding of participants and providers was explicitly reported by less than half of the included studies (7/20 = 35%), we assessed those studies that did as being at low risk of performance bias. We assessed eight studies as being at unclear risk of performance bias as they did not report blinding status of participants and personnel clearly (Denny 2013; Hidalgo‐Tenorio 2017; Levin 2010; NCT00941889 2016; NCT01031069 2017; NCT01862874 2018; Romanowski 2011; Wilkin 2018), and five studies as being at high risk of performance bias due to no, or partial blinding, of participants, personnel, or both (Dobson 2013; Lehtinen 2018; Puthanakit 2016; Iversen 2016; Lin 2014).
Less than half of the studies reported adequate blinding of outcome assessors (9/20 = 45%); we considered those that did to be at low risk of detection bias. Eight studies did not report details regarding blinding of outcome assessment and we assessed them as being at unclear risk of bias (Denny 2013; Hidalgo‐Tenorio 2017; Levin 2010; Lin 2014; NCT01031069 2017; NCT00941889 2016; NCT01862874 2018; Wilkin 2018), and three studies did not blind outcome assessment and were assessed as being at high risk of detection bias (Iversen 2016; Lehtinen 2018; Puthanakit 2016).
Incomplete outcome data
We assessed most included studies (18/20 = 90%) as having a low risk of attrition bias, as they reported withdrawals and provided adequate reasons for dropouts. We assessed one study as having a high risk of attrition bias because only a subgroup of included participants were analysed (Lehtinen 2018). We assessed another study as having a high risk of attrition bias because data for 62.5% (20/32) of the participants enrolled were missing due to early withdrawals from the study (NCT00941889 2016).
Selective reporting
For the majority of studies (16/20 = 80%) either a study protocol or clinical trial registry entry was available to determine that selective reporting was unlikely; we assessed these studies as having a low risk of reporting bias. We assessed four studies as having a high risk of selective reporting bias; Lehtinen 2018 because most outcomes were not reported separately for boys and girls, indeed, only adverse events were reported separately in boys, but in a selected subset; NCT00941889 2016 because predetermined outcomes, including serious adverse events, were not reported; NCT01031069 2017 because not all outcomes listed in the online trial record were reported in the trial result summary report; and NCT01862874 2018 because HPV disease was not reported as a separate outcome, but were reported as an outcome combined with persistent HPV infection.
Other potential sources of bias
All included studies provided a statement of the funding source for the trial. Thirteen studies were funded by the vaccine manufacturers (GSK, Merck or Sanofi Pasteur) and we rated them as having an unclear risk of other bias. Industry sponsored studies are associated with favourable efficacy results and conclusions (Lundh 2017) which may be mediated by factors other than those assessed by the Cochrane 'Risk of bias' tool. We also rated a further two studies as having an unclear risk of other bias because no published report was identified for either (NCT00941889 2016; NCT01031069 2017), and we extracted data from the clinical trials records, which provided insufficient information to establish whether there was a risk of other bias. We assessed the remaining five studies as being at low risk of other bias (Dobson 2013; Toft 2014; Hidalgo‐Tenorio 2017; Levin 2010; Wilkin 2018).
Effects of interventions
See: Table 1; Table 3; Table 4; Table 5
1. Two doses of HPV vaccine versus three doses of HPV vaccine in 9‐ to 15‐year‐old females or males
The results for this comparison are presented in Table 1 and Appendix 5. We analysed four studies in females that compared two doses (months 0 and 2, or 0 and 6, or 0 and 12) versus three doses (months 0, 1, and 6; or 0, 2, and 6) of HPV vaccine (Dobson 2013; Iversen 2016; Leung 2015; Romanowski 2011), and reported immunogenicity outcomes (seven months to five years) for all vaccine types and adverse event outcomes throughout the study period (one to five years). No studies included for this comparison collected data about clinical outcomes. No evidence was found from RCTs making this comparison in males.
Immunogenicity results comparing two doses with three doses of HPV vaccine are reported in Appendix 5. Briefly, two doses were non‐inferior to or had higher GMTs than three doses for all nine HPV genotypes measured except HPV 45 (where non‐inferiority was inconclusive) one month after the last dose (moderate‐ to high‐certainty evidence). For seroconversion one month after the last dose, there was evidence of little to no difference between groups for all nine HPV genotypes measured (high‐certainty evidence). At 60‐month follow‐up after the first dose, non‐inferiority of two doses of bivalent vaccine was inconclusive for GMTs of HPV 16 and HPV 18 (low‐certainty evidence). Two doses of quadrivalent vaccine resulted in non‐inferior GMTs for HPV 6, HPV 11 and HPV 16, while results were inconclusive for HPV 18 (low‐certainty evidence). At 36‐month follow‐up after the first dose, two doses of nonavalent vaccine resulted in non‐inferior GMTs for all HPV genotypes measured except HPV 45 and HPV 52 where non‐inferiority was inconclusive (high‐certainty evidence).
Two studies found that two doses of HPV vaccine resulted in little to no difference in pain at the injection site compared with three doses of HPV vaccine (RR 0.96, 95% CI 0.91 to 1.03; 2 studies; 1189 participants; Analysis 1.1), but reduced swelling (RR 0.76, 95% CI 0.65 to 0.89; 2 studies; 1189 participants; Analysis 1.2) and redness (RR 0.85, 95% CI 0.75 to 0.96; 2 studies; 1189 participants; Analysis 1.3) at the injection site at up to seven days follow‐up. The comparative evidence about serious adverse events was considered to be of very low‐certainty (risk with two doses 36/1158, risk with three doses 35/1159; 4 studies; 2317 participants; Analysis 1.4). We downgraded certainty for imprecision and indirectness of the composite measure of all serious adverse events, which may or may not be clinically relevant, may or may not be related to the vaccine, and may occur outside a biologically plausible time frame relative to vaccine exposure. Two of the studies reported on withdrawals from the study and reported that no participants had withdrawn because of adverse events. One death was reported in the three‐dose group (1/898) and no deaths (0/899) in the two‐dose group (OR 0.33, 95% CI 0.01 to 8.19; 3 studies; 1797 participants; low‐certainty evidence; Analysis 1.5).
1.1. Analysis.

Comparison 1 Two versus three doses of HPV vaccines in 9‐ to 15‐year‐old females, Outcome 1 Pain at injection site.
1.2. Analysis.

Comparison 1 Two versus three doses of HPV vaccines in 9‐ to 15‐year‐old females, Outcome 2 Swelling at injection site.
1.3. Analysis.

Comparison 1 Two versus three doses of HPV vaccines in 9‐ to 15‐year‐old females, Outcome 3 Redness at injection site.
1.4. Analysis.

Comparison 1 Two versus three doses of HPV vaccines in 9‐ to 15‐year‐old females, Outcome 4 Serious adverse events (overall).
1.5. Analysis.

Comparison 1 Two versus three doses of HPV vaccines in 9‐ to 15‐year‐old females, Outcome 5 Deaths.
2. Two doses of HPV vaccine with longer interval compared with two doses of HPV vaccine with shorter interval in 9‐ to 14‐year‐old females or males
The results for this comparison are presented in Table 3 and Appendix 6. We included three studies in females that compared two doses with a longer interval between the first and second doses (months 0 and 6 or 12) with a shorter interval between the first and second doses (months 0 and 2 or 6) for immunogenicity outcomes at seven months for all vaccine types and adverse event outcomes throughout the study period (one to five years) (Iversen 2016; Puthanakit 2016; Romanowski 2011). One of these studies compared a longer interval (months 0 and 12) with a shorter interval (months 0 and 6) in males (Iversen 2016). No studies included for this comparison collected data about clinical outcomes. As each study compared different intervals, we did not pool the results in the meta‐analysis.
Immunogenicity results are reported in Appendix 6. At one month after the final dose, there was evidence of higher (and non‐inferior) GMTs for HPV 16 and HPV 18 with the longer interval schedules compared with the shorter intervals in 9‐ to 14‐year‐old females who received bivalent HPV vaccine (moderate‐ to high‐certainty evidence). There was also evidence of higher GMTs for HPV 16 and HPV 18 at 36 months with the longer interval schedules compared with the shorter intervals in 9‐ to 14‐year‐old females who received bivalent HPV vaccine (high‐certainty evidence). For seroconversion to HPV 16 and HPV 18, there was evidence of no difference between groups one month after the final dose (high‐certainty evidence). For the nonavalent vaccine in girls and boys, there was evidence that a longer interval produced higher and non‐inferior GMTs than a shorter interval for all HPV genotypes (high‐certainty evidence).
In Romanowski 2011 there was little to no difference in pain (RR 1.01, 95% CI 0.96 to 1.06; 1 study; 477 participants; Analysis 2.1), swelling (RR 0.95, 95% CI 0.76 to 1.20; 1 study; 477 participants; Analysis 2.2), or redness at the injection site (RR 1.02, 95% CI 0.84 to 1.24; 1 study; 477 participants; Analysis 2.3) when comparing a two‐month interval between doses to a six‐month interval. In Puthanakit 2016 there was also little to no difference in pain (RR 1.02, 95% CI 0.98 to 1.06; 1 study; 963 participants; Analysis 2.1), swelling (RR 1.01, 95% CI 0.87 to 1.18; 1 study; 963 participants; Analysis 2.2), or redness at the injection site (RR 1.06, 95% CI 0.93 to 1.22; 1 study; 963 participants; Analysis 2.3) when comparing a six‐month interval between doses to a 12‐month interval.
2.1. Analysis.

Comparison 2 Two doses of HPV vaccine with longer interval versus two doses of HPV vaccine with shorter interval in 9‐ to 14‐year‐olds, Outcome 1 Pain at injection site.
2.2. Analysis.

Comparison 2 Two doses of HPV vaccine with longer interval versus two doses of HPV vaccine with shorter interval in 9‐ to 14‐year‐olds, Outcome 2 Swelling at injection site.
2.3. Analysis.

Comparison 2 Two doses of HPV vaccine with longer interval versus two doses of HPV vaccine with shorter interval in 9‐ to 14‐year‐olds, Outcome 3 Redness at injection site.
The evidence about serious adverse events was considered to be of very low‐certainty, due to imprecision and indirectness, for comparisons of a two‐month (14/240) versus a six‐month (16/241) interval (1 study; 481 participants; Analysis 2.4) (Romanowski 2011), and of a six‐month (20/550) versus a 12‐month (24/415) interval (1 study; 965 participants; Analysis 2.4) (Puthanakit 2016). The evidence about serious adverse events was also considered to be of very low‐certainty for the comparison of an interval of six months (15/602) versus 12 months (6/301) between doses of the nonavalent vaccine (1 study; 903 participants; Analysis 2.4) (Iversen 2016). The Iversen 2016 study reported on serious adverse events in males and females, but disaggregated data were not available by sex (Table 2). One of the reported serious adverse events (one case of systemic lupus erythematosus) in the 12‐month interval group (Puthanakit 2016), was considered by the study investigators to be related to the vaccine and was the only withdrawal from the studies because of adverse events. No deaths were reported in any of the included trials (Analysis 2.5).
2.4. Analysis.

Comparison 2 Two doses of HPV vaccine with longer interval versus two doses of HPV vaccine with shorter interval in 9‐ to 14‐year‐olds, Outcome 4 Serious adverse events (overall).
2.5. Analysis.

Comparison 2 Two doses of HPV vaccine with longer interval versus two doses of HPV vaccine with shorter interval in 9‐ to 14‐year‐olds, Outcome 5 Deaths.
3. Longer interval versus shorter interval between second and third doses of quadrivalent HPV vaccine in 18‐ to 25‐year‐old males
The results for this comparison are presented in Appendix 7. We included one study that compared three doses of quadrivalent HPV vaccine with a longer interval between the second and third doses (doses administered at months 0, 2, and 12) against a shorter interval between the second and third doses (doses administered at months 0, 2, and 6) (Lin 2014). For the immunogenicity outcomes (Appendix 8), there was evidence of higher GMTs for HPV 11 with the longer interval schedule compared with the shorter schedule at one month (2 to 6 weeks test window allowed) after the last dose. For GMTs for HPV 6, 16, and 18, there was evidence of little to no difference between groups. The study did not collect data about clinical outcomes.
This study reported local, general, and serious adverse events. No usable data were available for analysis of local and general adverse events so we summarised the results in Analysis 3.1. Briefly, among all study participants 172 local and general reactions were reported. The authors reported no significant difference between groups (P = 0.26). No serious adverse events were reported (120 participants; Analysis 3.2).
3.1. Analysis.
Comparison 3 Three doses of HPV vaccine with longer interval versus three doses of HPV vaccine with shorter interval in 18‐ to 25‐year‐old males, Outcome 1 Adverse events.
| Adverse events | |
|---|---|
| Study | |
| Lin 2014 | Adverse events data not reported separately for each arm. "Participants reported side effects following 646 separate vaccinations; 172 local and general reactions were reported, with no difference in proportion of side effects reported between Standard (24.4%) and Alternate (28.9%) schedule groups (P = 0.26). The majority of side effects were pain and redness at the injection site (86%; n = 148), with the remainder composed of fever (3.5%; n = 6), and miscellaneous symptoms (10.5%; n = 18). There were no reports of any serious side effects." |
3.2. Analysis.

Comparison 3 Three doses of HPV vaccine with longer interval versus three doses of HPV vaccine with shorter interval in 18‐ to 25‐year‐old males, Outcome 2 Serious adverse events (overall).
4. HPV vaccines versus control in 10‐ to 26‐year‐old males
The results for this comparison are presented in Table 4. Two studies compared quadrivalent HPV vaccine with control (vaccine adjuvant only) (three doses administered at months 0, 2, and 6) in males (Giuliano 2011, NCT01862874 2018), and two studies compared bivalent vaccine with HBV vaccine (Lehtinen 2018; Petaja 2009). Lehtinen 2018, a cluster‐randomised trial, was designed to investigate direct and indirect effects of vaccinating boys and girls (gender‐neutral) compared with girls‐only HPV vaccination. They reported that gender‐neutral vaccination was associated with herd effects and cross‐protection against a number of non‐vaccine HPV types. Clinical outcomes in girls are presented in another Cochrane Review (Arbyn 2018), which covers comparison of bivalent and quadrivalent HPV vaccine with a control HBV vaccine in females; no clinical outcomes in boys were reported.
One study reported clinical outcomes at a median of 2.9 years (Giuliano 2011). There were fewer outcomes of external genital lesions (any genotype) (rate ratio 0.16, 95% CI 0.07 to 0.38; 1 study; 2545 participants; 6254 person‐years; moderate‐certainty evidence; Analysis 4.1), external genital lesions (HPV 6, 11, 16, 18) (rate ratio 0.10, 95% CI 0.03 to 0.31; 1 study; 2805 participants; 5643 person‐years; Analysis 4.2), and anogenital warts (rate ratio 0.11, 95% CI 0.03 to 0.38; 1 study; 2805 participants; 5645 person‐years; moderate‐certainty evidence; Analysis 4.3) with the quadrivalent HPV vaccine than the control, in both intention‐to‐treat and per‐protocol analyses (per‐protocol analyses not shown). There was evidence in favour of quadrivalent HPV vaccine for the outcomes of all penile, perianal, or perineal intraepithelial neoplasia (PIN) lesions (rate ratio 0.17, 95% CI 0.01 to 3.27; 1 study; 2805 participants; 5657 person‐years; Analysis 4.4), PIN grade 1 (rate ratio 0.25, 95% CI 0.01 to 6.22; 1 study; 2805 participants; 5659 person‐years; Analysis 4.5), or PIN grade 2 or 3 (rate ratio 0.50, 95% CI 0.02 to 14.80; 1 study; 2805 participants; 5658 person‐years; Analysis 4.6), with confidence intervals that included the possibility of both fewer and more events with the quadrivalent vaccine (low‐certainty evidence for all outcomes).
4.1. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 1 External genital lesions (any type).
4.2. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 2 External genital lesions (HPV 6, 11, 16, or 18).
4.3. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 3 Anogenital warts.
4.4. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 4 All penile, perianal, or perineal intraepithelial neoplasia lesions.
4.5. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 5 Penile, perianal, or perineal intraepithelial neoplasia grade 1.
4.6. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 6 Penile, perianal, or perineal intraepithelial neoplasia grade 2 or 3.
In the quadrivalent vaccine group, there were more overall local/injection site adverse events than with the control (RR 1.12, 95% CI 1.06 to 1.18; 1 study; 3895 participants; high‐certainty evidence; Analysis 4.7); the events included pain at injection site (RR 1.13, 95% CI 1.07 to 1.19; 2 studies; 5162 participants; Analysis 4.8), swelling at injection site (RR 1.29, 95% CI 1.04 to 1.60; 2 studies; 5162 participants; Analysis 4.9), and redness at injection site (RR 1.12, 95% CI 0.99 to 1.27; 2 studies; 5162 participants; Analysis 4.10). There was little to no difference in overall systemic events and general symptoms (RR 0.99, 95% CI 0.90 to 1.08; 2 studies; 5008 participants; moderate‐certainty evidence; Analysis 4.11) at 15‐day follow‐up. The bivalent HPV vaccine resulted in more pain (RR 1.99, 95% CI 1.57 to 2.53; 1 study; 268 participants; Analysis 4.8), swelling (RR 2.51, 95% CI 1.17 to 5.42; 1 study; 268 participants; Analysis 4.9), and redness (RR 1.66, 95% CI 0.99 to 2.79; 1 study; 268 participants; Analysis 4.10) at the injection site than the HBV vaccine (Petaja 2009).
4.7. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 7 Overall local/injection site adverse events.
4.8. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 8 Pain at injection site.
4.9. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 9 Swelling at injection site.
4.10. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 10 Redness at injection site.
4.11. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 11 Overall systemic events and general symptoms.
Evidence about serious adverse events in the Giuliano 2011 study was of very low‐certainty due to imprecision and indirectness (8/2574 participants (0.3%) in the quadrivalent vaccine group and 12/2588 participants (0.5%) in the control group; 2 studies; Analysis 4.12). None of the reported serious adverse events was considered by the study investigators to be vaccine‐related. Two participants from the quadrivalent group and seven participants from the control group discontinued participation in the studies because of adverse events. There were fewer deaths in the group that received quadrivalent vaccine (3 deaths in quadrivalent group; 11 deaths in control group), but confidence intervals for the difference were compatible with no effect (OR 0.30, 95% CI 0.09 to 1.01; 2 studies; 5173 participants; low‐certainty evidence; Analysis 4.13) at up to three years of follow‐up (Giuliano 2011). Lehtinen 2018 reported on serious adverse events for a selected subset of males (data not shown). Fifty‐eight of the 2436 subset participants (2.4%) who received the HPV vaccine and 25/1267 subset participants (2.0%) who received the control HBV vaccine experienced serious adverse events (very low‐certainty evidence). The investigators reported that four serious adverse events among the males who received the HPV vaccine (abdominal pain, ulcerative colitis, type 1 diabetes mellitus, juvenile idiopathic arthritis) could possibly be vaccine‐related and one event among the males who received the control (type 1 diabetes mellitus) could possibly be vaccine‐related. In the study on bivalent vaccine (Petaja 2009), three serious adverse events were reported in the bivalent vaccine group (3/181) and one in the control group (1/89) (Analysis 4.12; very low‐certainty evidence). The study investigators did not consider these to be related to the vaccine, and no deaths were reported in either group.
4.12. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 12 Serious adverse events (overall).
4.13. Analysis.

Comparison 4 HPV vaccine versus control in males, Outcome 13 Deaths.
For the secondary outcome of persistent HPV infection, there was evidence that quadrivalent HPV vaccine reduced persistent infection caused by HPV 6, 11, 16 or 18 combined, or by each HPV genotype individually, in 16‐ to 26‐year‐old males compared with control (Appendix 9).
The Giuliano 2011 study also reported immunogenicity outcomes (data not shown). Briefly, there was evidence that quadrivalent vaccine increased GMTs for HPV 6, 11, 16 and 18 when compared with control at 7, 24 and 36 months. There was a trend towards GMTs levelling off after reaching a peak at month seven. Comparative data between quadrivalent vaccine and control were not available for the seropositivity outcomes (control group data not reported), but seropositivity for HPV 6, 11, 16 and 18 at seven months was above 97%. Petaja 2009 also reported immunogenicity outcomes seven months after the first dose of bivalent vaccine were higher than the HBV vaccine (Appendix 10).
5. Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐old females and males
The results of this comparison are presented in Table 5. We included three RCTs that compared nonavalent with quadrivalent HPV vaccine (three doses administered at months 0, 2, and 6): two in females (Joura 2015; Vesikari 2015), and one in males (van Damme 2016). The Joura 2015 study collected data on clinical outcomes in females at up to 4.5 years follow‐up. All three trials reported adverse event outcomes throughout the study period and immunogenicity outcomes at seven months for all vaccine types. We did not identify any studies that collected data about clinical outcomes in males.
In females there was little to no difference between nonavalent and quadrivalent HPV vaccines in the incidence of the combined outcome of high‐grade cervical epithelial neoplasia, adenocarcinoma in situ, or cervical cancer (OR 1.00, 95% CI 0.85 to 1.16; 1 study; 13,753 participants; high‐certainty evidence; Analysis 5.1), or high‐grade cervical, vulval, or vaginal disease (OR 0.99, 95% CI 0.85 to 1.15; 1 study; 14,054 participants; high‐certainty evidence; Analysis 5.2) at up to 4.5 years follow‐up. For high grade cervical disease related to HPV 31, 33, 45, 52, or 58 (i.e. genotypes covered by the nonavalent vaccine but not the quadrivalent vaccine), the effect was in favour of the nonavalent vaccine (OR 0.03, 95% CI 0.00 to 0.21; 1 study; 11,892 participants; Analysis 5.5), but few cases were reported (1/5949 women in the nonavalent vaccine group and 35/5943 women in the quadrivalent vaccine group).
5.1. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 1 High‐grade cervical epithelial neoplasia, adenocarcinoma in situ, and cervical cancer.
5.2. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 2 High‐grade cervical, vulval, and vaginal disease.
5.5. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 5 High‐grade cervical disease related to HPV 31, 33, 45, 52, or 58.
Nonavalent HPV vaccine resulted in slightly more local/injection site adverse events than the quadrivalent vaccine (RR 1.07, 95% CI 1.05 to 1.08; 3 studies; 15,863 participants; high‐certainty evidence; Analysis 5.11). There was little to no difference between the vaccines for overall systemic events and general symptoms at 15‐day follow‐up (RR 1.01, 95% CI 0.98 to 1.04; 3 studies; 15,863 participants; moderate‐certainty evidence, Analysis 5.15). For serious adverse events overall, the evidence was considered to be of low‐certainty due to imprecision and indirectness (OR 0.60, 95% CI 0.14 to 2.61; 3 studies; 15,863 participants; I2 = 51%; Analysis 5.16). One study reported similar numbers of events (1/299 with the nonavalent vaccine, 2/300 with the quadrivalent vaccine) in females aged 9 to 15 years over a period of 7 months follow‐up (Vesikari 2015). In males, there were no events in 249 participants receiving the nonavalent vaccine and 6/251 with the quadrivalent vaccine over a period of 7 months follow‐up (van Damme 2016). In the largest study, in 16‐ to 26‐year‐old females, 3.1% (242/7686) of those who received the nonavalent vaccine and 2.6% (184/7078) of those who received the quadrivalent vaccine experienced any serious adverse event after up to 4.5 years of follow‐up (Joura 2015). No serious adverse events, when analysed by system organ class, were more common with the nonavalent than with the quadrivalent vaccine. The study authors examined 2269 pregnancy‐related events in 2321 women and found no differences between the nonavalent and quadrivalent vaccine arms. The study investigators considered seven serious adverse events to be related to the vaccines, four in the nonavalent group (allergic reaction; fever, body pain, and headache; hypersomnia; postural orthostatic tachycardia syndrome) and three in the quadrivalent group (headache; paraesthesia and burning sensation; orthostatic intolerance). Thirteen participants who received nonavalent vaccine and six who received quadrivalent vaccine discontinued participation because of adverse events. There was little to no difference in the number of deaths between nonavalent (6/7370) and quadrivalent (5/7378) HPV vaccine groups (OR 1.20, 95% CI 0.37 to 3.94; 2 studies; 15,248 participants; low‐certainty evidence; Analysis 5.17) at up to 4.5 years follow‐up. The study investigators considered none of the deaths reported to be related to the vaccine.
5.11. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 11 Overall local/injection site adverse events.
5.15. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 15 Overall systemic events and general symptoms.
5.16. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 16 Serious adverse events (overall).
5.17. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 17 Deaths.
Secondary outcomes (persistent infection and immunogenicity) are presented in Appendix 11 and Appendix 12. Briefly, there was evidence of decreased rates of persistent infection with HPV 31, 33, 45, 52, and 58 at six and 12 months with nonavalent vaccine compared with quadrivalent vaccine (Joura 2015). There was little to no difference in immunogenicity between the nonavalent and quadrivalent HPV vaccines and GMTs were non‐inferior for HPV 6, 11, 16, and 18 at up to 42 months. The nonavalent HPV vaccine resulted in substantially higher GMTs for HPV 31, 33, 45, 52, and 58 than the quadrivalent HPV vaccine. For seroconversion to HPV 6, 11, 16, and 18 up to 24 months follow‐up, 100% of participants seroconverted in both the nonavalent and quadrivalent HPV vaccine groups. The data for GMTs and seroconversion to HPV 31, 33, 45, 52, and 58 were not reported in full (Joura 2015; Vesikari 2015).
6. HPV vaccination in HIV‐positive females, males and MSM
Seven RCTs reported on the effects of bivalent and quadrivalent HPV vaccines in females, males, or children living with HIV (Denny 2013; Hidalgo‐Tenorio 2017; Levin 2010; NCT00941889 2016; NCT01031069 2017; Toft 2014; Wilkin 2018). Two of the studies collected data about clinical outcomes such as anal intraepithelial neoplasia, anogenital warts or persistent infection (NCT00941889 2016; Wilkin 2018). These results are summarised in Table 7; Table 8; and Table 9.
3. Summary of findings: Quadrivalent HPV vaccine compared with control in children, adults, and MSM with HIV.
| Quadrivalent HPV vaccine compared with control in children, adults, and MSM with HIV | ||||||
|
Patient or population: children (7 to 12 years old) with HIV, adults (≥ 18 years old) with HIV, and MSM (≥ 18 years old) with HIV Settings: Brazil, Puerto Rico, Spain, the USA Intervention: quadrivalent HPV vaccine (3 doses at 0, 2, and 6 months) Comparison: control (3 doses at 0, 2 and 6 months; not specified whether placebo contained vaccine adjuvant) | ||||||
| Outcomes | Population | Anticipated absolute effects* (95% CI) | Relative effect (95% CI) | No of Participants (studies) | Quality of the evidence (GRADE) | |
| Risk with control | Risk with quadrivalent HPV vaccine | |||||
| High‐grade anal intraepithelial neoplasia at 4‐year follow‐up | Females and males with HIV (≥ 27 years) | 157 per 1000 | 160 per 1000 (110 to 233) | RR 1.02 (0.70 to 1.48) | 574 (1 study) | ⊕⊝⊝⊝ VERY LOW1,2 |
| Recurrence of anogenital warts at 18‐month follow‐up | Females and males with HIV treated for anogenital warts (18‐65 years) | 200 per 1000 | 143 per 1000 (7 to 778) | RR 0.71 (0.06 to 8.90) | 12 (1 study) | ⊕⊝⊝⊝ VERY LOW2,3 |
| Abnormal anal cytology at 4‐year follow‐up | Females and males with HIV (≥ 27 years) | 545 per 1000 | 447 per 1000 (349 to 573) | RR 0.82 (0.64 to 1.05) | 262 (1 study) | ⊕⊝⊝⊝ VERY LOW1,4 |
| Overall local/injection site adverse events at 15‐day follow‐up |
Children with HIV (7‐12 years) | 100 per 1000 | 219 per 1000 (70 to 683) | RR 2.19 (0.70 to 6.83) | 126 (1 study) | ⊕⊝⊝⊝ VERY LOW1,2 |
| Overall systemic events and general symptoms at 15‐day follow‐up |
Children with HIV (7‐12 years) | 33 per 1000 | 21 per 1000 (2 to 235) | RR 0.62 (0.05 to 7.05) | 126 (1 study) | ⊕⊝⊝⊝ VERY LOW1,2,6 |
| Serious adverse events at 4‐year follow‐up (adults) or 7‐month follow‐up (MSM) |
Females and males with HIV (≥ 27 years) | 160 per 1000 | 115 per 1000 (74 to 174) | OR 0.68 (0.42 to 1.10) | 575 (1 study) | ⊕⊝⊝⊝ VERY LOW1,4,6,7 |
| MSM with HIV (≥ 18 years) | 0 per 1000 | 0 per 1000 (0 to 0) | Not estimable, no events were reported | 129 (1 study) | ⊕⊝⊝⊝ VERY LOW5,6,7 | |
| Mortality at 4‐year follow‐up (adults) or 7‐month follow‐up (MSM) |
Females and males with HIV (≥ 27 years) | 21 per 1000 | 10 per 1000 (3 to 41) | OR 0.49 (0.12 to 1.99) | 575 (1 study) | ⊕⊝⊝⊝ VERY LOW1,2 |
| MSM with HIV (≥ 18 years) | 0 per 1000 | 0 per 1000 (0 to 0) | Not estimable, no events were reported | 129 (1 study) | ⊕⊕⊝⊝ LOW5 | |
| *The risk in the intervention group (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval; HIV: human immunodeficiency virus; HPV: human papillomavirus; MSM: men who have sex with men; OR: odds ratio; RR: risk ratio | ||||||
| GRADE Working Group grades of evidence High quality: Further research is very unlikely to change our confidence in the estimate of effect. Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate. Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate. Very low quality: We are very uncertain about the estimate. | ||||||
1Downgraded one level for risk of bias: details about how randomisation sequence was generated or how blinding was achieved were not reported.
2Downgraded two levels for serious imprecision: few events and a wide 95% confidence interval that incorporated a potentially beneficial effect and a potentially harmful effect.
3Downgraded two levels for serious risk of bias: data for 62.5% (20/32) of the participants enrolled were missing due to lack of follow‐up. In addition, details about how randomisation, allocation concealment, and blinding were achieved were not reported.
4Downgraded two levels for imprecision: few events and wide 95% confidence interval that incorporated a potential beneficial effect and no effect.
5Downgraded two levels for serious imprecision: no events reported, the study was not powered to detect a difference in serious adverse events or mortality.
6Downgraded one level for indirectness: This outcome is a composite measure of events which may or may not be clinically relevant, may or may not be related to the vaccine and may occur outside a biologically plausible time frame relative to vaccine exposure. This outcome is considered to provide indirect evidence about vaccine safety.
7See Table 2 for details of each serious event.
4. Summary of findings: Bivalent HPV vaccine compared with control in 18‐ to 25‐year‐old females with HIV.
| Bivalent HPV vaccine compared with control in 18‐ to 25‐year‐old females with HIV | |||||
|
Patient or population: 18‐ to 25‐year‐old females with HIV Settings: South Africa Intervention: bivalent HPV vaccine (3 doses at 0, 1, and 6 months) Comparison: control (vaccine adjuvant‐containing placebo) (3 doses at 0, 1 and 6 months) | |||||
| Outcomes | Anticipated absolute effects* (95% CI) | Relative effect (95% CI) | No of Participants (studies) | Quality of the evidence (GRADE) | |
| Risk with control | Risk with bivalent HPV vaccine | ||||
| High‐grade cervical epithelial neoplasia, adenocarcinoma in situ, and cervical cancer | No studies were identified that reported on this outcome. | ||||
| High‐grade cervical, vulval, and vaginal disease | No studies were identified that reported on this outcome. | ||||
| Overall local/injection site adverse events | No studies were identified that reported on this outcome. Data for specific local adverse events (pain and swelling at injection site) are presented in the Data and analyses and Effects of interventions sections. | ||||
| Overall systemic events and general symptoms | No studies were identified that reported on this outcome. | ||||
| Serious adverse events at 12‐month follow‐up | 34 per 1000 | 49 per 1000 (8 to 243) | OR 1.47 (0.24 to 9.15) | 120 (1 study) | ⊕⊝⊝⊝ VERY LOW1,3,4 |
| Mortality at 12‐month follow‐up | 0 per 1000 | 0 per 1000 (0 to 0) | Not estimable, no events were reported | 120 (1 study) | ⊕⊕⊝⊝ LOW2 |
| *The risk in the intervention group (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval; HIV: human immunodeficiency virus; HPV: human papillomavirus; OR: odds ratio | |||||
| GRADE Working Group grades of evidence High quality: Further research is very unlikely to change our confidence in the estimate of effect. Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate. Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate. Very low quality: We are very uncertain about the estimate. | |||||
1Downgraded two levels for serious imprecision: few events and a wide 95% confidence interval that incorporated a potentially large beneficial effect and a potentially large harmful effect.
2Downgraded two levels for serious imprecision: no events reported, the study was not powered to detect a difference in mortality.
3Downgraded one level for indirectness: This outcome is a composite measure of events which may or may not be clinically relevant, may or may not be related to the vaccine and may occur outside a biologically plausible time frame relative to vaccine exposure. This outcome is considered to provide indirect evidence about vaccine safety.
4See Table 2 for details of each serious event.
5. Summary of findings: Bivalent HPV vaccine compared with quadrivalent HPV vaccine in adults with HIV.
| Bivalent HPV vaccine compared with quadrivalent HPV vaccine in adults with HIV | ||||||
|
Patient or population: adults and adolescents (combined male and female) with HIV, ≥ 15 years old Settings: Brazil, Denmark, Estonia, India, and Thailand Intervention: bivalent HPV vaccine (3 doses at 0, 1.5, and 6 months) Comparison: quadrivalent HPV vaccine (3 doses at 0, 1.5, and 6 months) | ||||||
| Outcomes | Population | Anticipated absolute effects* (95% CI) | Relative effect (95% CI) | No of Participants (studies) | Quality of the evidence (GRADE) | |
| Risk with quadrivalent HPV vaccine | Risk with bivalent HPV vaccine | |||||
| High‐grade neoplasia, cancer | No studies were identified that reported on this outcome. | |||||
| Overall local/injection site adverse events at 4‐day follow‐up |
Females and males with HIV (≥ 18 years) | 696 per 1000 | 911 per 1000 (737 to 1000) | RR 1.31 (1.06 to 1.62) | 92 (1 study) | ⊕⊕⊝⊝ LOW1 |
| Overall systemic events and general symptoms | No studies were identified that reported on this outcome. | |||||
| Serious adverse events at 6‐month follow‐up (adults) and 7‐month follow‐up (females) | Females and males with HIV (≥ 18 years) | 0 per 1000 | 0 per 1000 (0 to 0) | Not estimable, no events were reported | 92 (1 study) | ⊕⊝⊝⊝ VERY LOW2,5,6 |
| Females with HIV (15‐25 years) | 55 per 1000 | 54 per 1000 (21 to 128) | OR 0.99 (0.38 to 2.55) | 332 (1 study) | ⊕⊝⊝⊝ VERY LOW3,4,5,6 |
|
| Mortality | No studies were identified that reported on this outcome. | |||||
| *The risk in the intervention group (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval; HIV: human immunodeficiency virus; HPV: human papillomavirus; OR: odds ratio; RR: risk ratio | ||||||
| GRADE Working Group grades of evidence High quality: Further research is very unlikely to change our confidence in the estimate of effect. Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate. Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate. Very low quality: We are very uncertain about the estimate. | ||||||
1Downgraded two levels for serious imprecision: few events reported.
2Downgraded two levels for serious imprecision: no events reported, the study was not powered to detect a difference in serious adverse events or mortality.
3Downgraded one level for risk of bias: details on how randomisation, allocation concealment, and blinding was achieved was not reported.
4Downgraded two levels for serious imprecision: few events and a wide 95% confidence interval that incorporate a potentially large beneficial effect and a potentially large harmful effect.
5Downgraded one level for indirectness: This outcome is a composite measure of events which may or may not be clinically relevant, may or may not be related to the vaccine and may occur outside a biologically plausible time frame relative to vaccine exposure. This outcome is considered to provide indirect evidence about vaccine safety.
6See Table 2 for details of each serious event.
6.1 Quadrivalent HPV vaccine compared with control
6.1.1 Quadrivalent HPV vaccine compared with control in children living with HIV
Levin 2010 included 7‐ to 12‐year‐old girls and boys with HIV. The study reported immunogenicity outcomes at seven months (Appendix 13). GMTs for HPV 6, 11, 16 and 18 were 123.8 to 935.8‐fold higher at seven months, and 29.6 to 189.4‐fold higher at 24 months, than in the control group (described as 'identical placebo', the study did not specify the contents of the placebo) (low‐certainty evidence). Seroconversion for the four HPV genotypes was over 97% at seven months (low‐certainty evidence). Injection site adverse events were more common with quadrivalent vaccine (21/96) than control (3/30) (1 study; 126 participants; very low‐certainty evidence; Analysis 6.4). Three systemic adverse events were reported, two in the quadrivalent group (2/96) and one in the control group (1/30) (1 study; 126 participants; very low‐certainty evidence; Analysis 6.5) at 14‐day follow‐up (three doses administered at months 0, 2, and 6). The study did not report on serious adverse events, but reported that 5/96 (5.2%) children in the quadrivalent vaccine group and 2/30 (6.7%) children in the control group experienced adverse events of grade 3 or 4 severity (OR 0.77, 95% CI 0.14 to 4.18, analysis not shown).
6.4. Analysis.

Comparison 6 Quadrivalent HPV vaccine versus control in people living with HIV, Outcome 4 Overall local/injection site adverse events.
6.5. Analysis.

Comparison 6 Quadrivalent HPV vaccine versus control in people living with HIV, Outcome 5 Overall systemic event and general symptoms.
6.1.2 Quadrivalent HPV vaccine compared with control in MSM living with HIV
Hidalgo‐Tenorio 2017 included HIV‐positive MSM of 18 years of age and above, and compared quadrivalent HPV vaccine with control (saline placebo) (three doses administered at months 0, 2, and 6). This trial reported that 76% of the HPV vaccinated participants were seropositive for at least one of HPV 6, 11, 16, or 18 genotype at seven months compared with 30.2% in the control group (moderate‐certainty evidence; Appendix 13). No serious adverse events (1 study; 129 participants; Analysis 6.6) or deaths (1 study; 129 participants; Analysis 6.7) were reported in either group at seven‐month follow‐up (Table 7).
6.6. Analysis.

Comparison 6 Quadrivalent HPV vaccine versus control in people living with HIV, Outcome 6 Serious adverse events (overall).
6.7. Analysis.

Comparison 6 Quadrivalent HPV vaccine versus control in people living with HIV, Outcome 7 Deaths.
6.1.3 Quadrivalent HPV vaccine compared with control in adults living with HIV
Two studies included HIV‐positive males and females of 18 years of age and above and compared quadrivalent HPV vaccine with control (saline placebo in NCT00941889 2016 and 'placebo vaccine' in Wilkin 2018 ‐ the contents of the placebo were not specified). There was only very low‐certainty evidence on high‐grade anal intraepithelial neoplasia (46/288 in the quadrivalent group, 45/286 in the control group; 1 study; Analysis 6.1), recurrence of anogenital warts in participants treated for anogenital warts (1/7 in the quadrivalent group, 1/5 in the control group; 1 study; Analysis 6.2), or abnormal anal cytology (58/130 in the quadrivalent group, 72/132 in the control group; 1 study; Analysis 6.3). There was limited evidence for serious adverse events (quadrivalent 33/288 events; control 46/287 events; Analysis 6.6) or deaths (quadrivalent 3/288 deaths; control 6/287 deaths; Analysis 6.7) between the groups. The study investigators considered no serious adverse events to be related to vaccination, and no withdrawals from the studies due to adverse events were reported (Table 7).
6.1. Analysis.

Comparison 6 Quadrivalent HPV vaccine versus control in people living with HIV, Outcome 1 High‐grade anal intraepithelial neoplasia.
6.2. Analysis.

Comparison 6 Quadrivalent HPV vaccine versus control in people living with HIV, Outcome 2 Recurrence of anogenital warts.
6.3. Analysis.

Comparison 6 Quadrivalent HPV vaccine versus control in people living with HIV, Outcome 3 Abnormal anal cytology.
6.2 Bivalent HPV vaccine compared with control in females living with HIV
Denny 2013 included HIV‐positive 18‐ to 25‐year‐old females and reported that, irrespective of baseline HPV serostatus, all participants who received the bivalent HPV vaccine were seropositive for both HPV 16 and HPV 18 after the second vaccine dose (month two), and remained seropositive at month 12 (moderate‐certainty evidence). Pain at injection site (RR 1.86, 95% CI 1.38 to 2.51; 1 study; 120 participants; Analysis 7.1) and swelling at injection site (RR 9.19, 95% CI 2.24 to 37.73; 1 study; 120 participants; Analysis 7.2) were more common in the bivalent group than in the control group (vaccine adjuvant only) at seven‐day follow‐up. The study reported 3/61 serious adverse events in the bivalent vaccine group and 2/59 events in the control group (OR 1.47, 95% CI 0.24 to 9.15; 1 study; 120 participants; low‐certainty evidence; Analysis 7.3). No deaths were reported (Analysis 7.4). The study investigators considered no serious adverse events to be related to vaccination, and no withdrawals from the study due to adverse events were reported (Table 8).
7.1. Analysis.

Comparison 7 Bivalent HPV vaccine versus control in 18‐ to 25‐year‐old females with HIV, Outcome 1 Pain at injection site.
7.2. Analysis.

Comparison 7 Bivalent HPV vaccine versus control in 18‐ to 25‐year‐old females with HIV, Outcome 2 Swelling at injection site.
7.3. Analysis.

Comparison 7 Bivalent HPV vaccine versus control in 18‐ to 25‐year‐old females with HIV, Outcome 3 Serious adverse events (overall).
7.4. Analysis.

Comparison 7 Bivalent HPV vaccine versus control in 18‐ to 25‐year‐old females with HIV, Outcome 4 Deaths.
6.3 Bivalent HPV vaccine compared with quadrivalent HPV vaccine
6.3.1 Bivalent HPV vaccine compared with quadrivalent HPV vaccine in adults living with HIV
Toft 2014 included 92 HIV‐positive females and males of 18 years of age and above, and compared bivalent with quadrivalent HPV vaccine (3 doses administered at months 0, 1.5, and 6). There was evidence of no difference, and inconclusive non‐inferiority, in GMTs for HPV 16 between the bivalent and quadrivalent HPV vaccines at seven‐ and 12‐month follow‐up (moderate‐ to low‐certainty evidence; Appendix 13). There was evidence that the quadrivalent vaccine was inferior to bivalent vaccine for GMTs for HPV 18 at seven months (ratio of GMTs 0.13, 95% CI 0.04 to 0.41; moderate‐certainty evidence). Injection site reactions were more common in the bivalent group than in the quadrivalent group (RR 1.31, 95% CI 1.06 to 1.62; 1 study; 92 participants; low‐certainty evidence; Analysis 8.1) at four‐day follow‐up. No serious adverse events at six‐month follow‐up were reported (Analysis 8.2; Table 9).
8.1. Analysis.

Comparison 8 Bivalent HPV vaccine versus quadrivalent HPV vaccine in people living with HIV, Outcome 1 Overall local/injection site adverse events.
8.2. Analysis.

Comparison 8 Bivalent HPV vaccine versus quadrivalent HPV vaccine in people living with HIV, Outcome 2 Serious adverse events (overall).
6.3.2 Bivalent HPV vaccine compared with quadrivalent HPV vaccine in 15‐ to 25‐year‐old females living with HIV
One study reported on serious adverse events in 15‐ to 25‐year‐old females with HIV who were randomised to receive bivalent or quadrivalent HPV vaccine (NCT01031069 2017). Data for this study were only available through the clinical trials registry, so full details on the methods and other outcome measures were not available. There were nine serious adverse events in 167 female participants with HIV in the bivalent vaccine group and nine in 165 participants in the quadrivalent group (1 study; 332 participants; very low‐certainty evidence; Analysis 8.2; Table 9). One participant in the quadrivalent group withdrew due to an adverse event. One serious adverse event (immune thrombocytopenic purpura) was considered by study investigators to be related to the bivalent HPV vaccine.
Sensitivity analysis
We compared the results from the primary analysis with a sensitivity analysis using Peto odds ratios for outcomes with very low event rates (< 1%; Bradburn 2007). This did not change the size of effect for most of the analyses, with the exception of some clinical outcomes in the comparison of nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐old females (Appendix 14).
Changes were seen in the effect sizes and 95% CIs for the following outcomes:
high‐grade cervical disease related to HPV 31, 33, 45, 52, or 58 (Analysis 5.5) changed from OR 0.03 (0.00 to 0.21) to Peto OR 0.15 (0.08 to 0.29) (Appendix 14);
cervical intraepithelial neoplasia 2 (CIN2) related to HPV 6, 11, 16, or 18 (Analysis 5.7) changed from OR 3.00 (0.12 to 73.77) to Peto OR 7.40 (0.15 to 373.90) (Appendix 14);
CIN2 related to HPV 31, 33, 45, 52, or 58 (Analysis 5.8) changed from OR 0.03 (0.00 to 0.23) to Peto OR 0.15 (0.08 to 0.30) (Appendix 14);
CIN3, adenocarcinoma in situ, and cervical cancer related to HPV 6, 11, 16, or 18 (Analysis 5.9) changed from OR 0.33 (0.01 to 8.19) to Peto OR 0.14 (0.00 to 6.83) (Appendix 14);
CIN3, adenocarcinoma in situ, and cervical cancer related to HPV 31, 33, 45, 52, or 58 (Analysis 5.10) changed from OR 0.07 (0.00 to 1.16) to Peto OR 0.14 (0.03 to 0.59) (Appendix 14).
5.7. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 7 Cervical intraepithelial neoplasia 2 related to HPV 6, 11, 16, or 18.
5.8. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 8 Cervical intraepithelial neoplasia 2 related to HPV 31, 33, 45, 52, or 58.
5.9. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 9 Cervical intraepithelial neoplasia 3, adenocarcinoma in situ, and cervical cancer related to HPV 6, 11, 16, or 18.
5.10. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 10 Cervical intraepithelial neoplasia 3, adenocarcinoma in situ, and cervical cancer related to HPV 31, 33, 45, 52, or 58.
Discussion
This review reports on evidence about the efficacy, immunogenicity, and adverse events following reduced dose or alternative vaccine schedules in females and males, HPV vaccination compared to control for males, and effects of HPV vaccines in people with HIV infection.
Summary of main results
Immunogenicity, efficacy and adverse events with fewer than three doses of HPV vaccine in females
In adolescent girls (9 to 15 years) a two‐dose schedule was non‐inferior to a three‐dose schedule of any HPV vaccine. There was some evidence that GMTs decrease over time following both two‐dose and three‐dose schedules, and that a two‐dose schedule is non‐inferior to a three‐dose schedule after five years. There was no difference in seroconversion between two‐dose and three‐dose schedules at all time points reported; almost all participants seroconverted in both intervention groups. We identified no studies that collected data about efficacy against clinical outcomes. There was very low‐certainty evidence of little to no difference in serious adverse events or deaths between dose schedules. No RCTs that evaluated the efficacy or harms of one dose of HPV vaccine were identified.
Immunogenicity, efficacy and adverse events with different intervals between doses of HPV vaccine in females and males
In both females and males, for all HPV vaccines evaluated, a schedule with a longer interval between doses resulted in higher GMTs than a shorter interval. There was very low certainty evidence on the comparative risk of serious adverse events with different intervals between two‐doses of HPV vaccine, owing to the very low number of events and indirectness. Results from single studies were consistent with lower or higher rates of serious adverse events with the different intervals tested in the studies.
Efficacy, immunogenicity and adverse events with HPV vaccines in males
Three doses of quadrivalent HPV vaccine reduced the incidence of external genital lesions, anogenital warts, and persistent infection by HPV 6, 11, 16 or 18 compared with control among 16‐ to 26‐year‐old males over a median follow‐up of 2.9 years (moderate‐certainty evidence). The quadrivalent vaccine resulted in more injection‐site adverse events, such as pain or redness, than control (high‐certainty evidence). There was very low certainty evidence on the comparative risk of serious adverse events and low certainty evidence on the comparative risk of deaths between quadrivalent vaccine and control among 10‐ to 26‐year old males. Limited data were available regarding the efficacy and adverse events with bivalent HPV vaccine in males. We identified no RCTs that evaluated the efficacy of nonavalent vaccine compared with control in males.
Efficacy, immunogenicity and adverse events with the nonavalent HPV vaccine compared with other HPV vaccines in females and males
Among 16‐ to 26‐year‐old women, three doses of nonavalent vaccine or of quadrivalent vaccine resulted in a similar incidence of clinical outcomes regardless of HPV genotype at up to 4.5‐year follow‐up (one RCT, high certainty evidence). The nonavalent vaccine resulted in reduced incidence of persistent HPV infections, CIN1, CIN 2/3, vulval or vaginal intraepithelial neoplasia (grade 1) related to the HPV genotypes unique to the nonavalent vaccine (HPV 31, 33, 45, 52, and 58) compared with the quadrivalent vaccine. Immunogenicity outcomes for nonavalent and quadrivalent HPV vaccines were similar for males and females. There was high‐certainty evidence that the nonavalent vaccine resulted in slightly more local or injection site events but little to no difference in overall systemic events. The evidence comparing serious adverse events was of low‐certainty. There was low‐certainty evidence of no difference in mortality between these vaccines. There were few vaccine‐related serious adverse events reported (seven participants in total) in the included studies.
Efficacy, immunogenicity and adverse events with HPV vaccines in people living with HIV
In children living with HIV, the quadrivalent HPV vaccine results in higher GMTs than control at seven months, but there was only very low‐certainty evidence about local or systemic adverse events. In adults living with HIV, the evidence about clinical outcomes and harms of quadrivalent HPV vaccine compared with control or other HPV vaccines, was of very low‐certainty. One RCT in adults living with HIV reported that the bivalent vaccine had similar immunogenicity outcomes for HPV 16 to the quadrivalent vaccine, but resulted in higher GMTs and greater rate of seroconversion to HPV 18.
Overall completeness and applicability of evidence
This review collated evidence about the efficacy ‐ in terms of clinical and immunological endpoints ‐ and harms of different HPV vaccines and different dose schedules in females and males. The information sources searched include electronic databases, websites of the vaccine manufacturers, and a published index of HPV studies (Jørgensen 2018a), so the level of completeness is high. The applicability of the evidence to determine clinical efficacy and harms is, however, limited by the nature of HPV‐related disease, as well as the design and outcomes of the studies. The evidence from RCTs about efficacy against severe HPV‐related disease, including cancer, is limited for three main reasons. First, it is unethical to collect specimens from the cervix of girls who have not had sexual intercourse. Second, few severe clinical outcome events related to HPV infection occur during the study follow‐up periods because they take a number of years to develop following HPV infection. Third, trial participants are offered treatment when HPV‐related precancer is found, so progression to cervical cancer would be expected to be very low, even without vaccination.
The focus of this review was on clinical outcomes and harms. Immunogenicity is the primary outcome for many trials of alternative HPV vaccine schedules, however, as noted in the Background, randomised efficacy trials of HPV vaccines were first conducted in women aged 15 to 25 or 26 years (Arbyn 2018). Once efficacy, immunogenicity and safety were established in this age group, non‐randomised bridging studies assessed non‐inferiority of immunogenicity outcomes in 9‐ to 15‐year‐old girls (e.g. Block 2006, Dobson 2013). The International Agency for Research on Cancer regards bridging studies that demonstrate non‐inferiority as a sufficient endpoint for individuals under 16 years of age (IARC 2014). Bridging studies have also demonstrated non‐inferiority of immunogenicity outcomes of a two‐dose schedule in boys aged 9‐ to 14‐years compared to three doses in young women aged 15 to 26 years (Iversen 2016). Use of immunogenicity outcomes has limitations because the immunological correlate of protection and the duration of protection remain unknown (Donken 2015). These studies provide lower certainty of evidence, because estimates of clinical outcomes are imprecise and indirect.
The nonavalent HPV vaccine was introduced more recently than the bivalent and quadrivalent HPV vaccines. This review included all studies that compared the nonavalent HPV vaccine with other HPV vaccines; two RCTs were identified in females (Joura 2015; Vesikari 2015), and one in males (van Damme 2016). A separate Cochrane Review of completed RCTs of three‐dose schedules with bivalent and quadrivalent HPV vaccines in women aged 16 to 26 years shows protection against lesions of grade CIN3, but not invasive cervical cancer (Arbyn 2018). Further comparisons between the different HPV vaccines in women will be included in an update of the Arbyn 2018 review. Observational studies in countries that have licensed more than one HPV vaccine will also provide important information on the comparative efficacy and harms of the different HPV vaccines.
With regard to serious adverse events, there is a large degree of uncertainty in the evidence comparing different HPV vaccines and different dose schedules. The 'Summary of findings' tables show low numbers of serious adverse events and deaths in most included studies. Even when the total number of events is high (e.g. Joura 2015), specific events of clinical relevance are still too rare for meaningful comparative analyses. In this review, we used a composite outcome, that is, the overall frequency of serious adverse events, for each comparison, however, analyses based on a composite outcome can produce results that are difficult to interpret for several reasons. This outcome can include events that are not clinically relevant or are not biologically related to the vaccine (Lineberry 2016), occur outside a plausible time frame relative to vaccine exposure (Huang 2011), or are not based on standardised definitions (Bonhoeffer 2002). In addition, trials measure serious adverse events at different time points and there is a large variation in duration of follow‐up, which could produce misleading summary estimates (Huang 2011). Finally, there is heterogeneity among trials with regard to the age and gender of participants and clinical measurements of serious adverse events (Appendix 4). Meta‐analyses of serious adverse events, such as those presented in this review, should be considered exploratory rather than confirmatory as the analyses are not planned in advance (i.e. when the included studies were designed) (Huang 2011). Despite the uncertainty in the evidence about harms when comparing different HPV vaccines and dose schedules, a previous systematic review reported similar rates of serious adverse events when HPV vaccines were compared to control (Arbyn 2018).
Quality of the evidence
The risk of bias of the included studies in this review is generally low. We rated studies that received funding from the vaccine manufacturer as 'unclear' for the 'other risk of bias' domain. This judgement was based on the results of a systematic review which showed more favourable efficacy results and conclusions in studies sponsored by manufacturing companies (Lundh 2017). It has been suggested that industry sponsorship of studies results in overly positive results through a variety of choices in the design and conduct of the trials that leads to bias. Based on the low risk of bias in other methodological domains and adequate reporting in the trials, we did not downgrade the certainty of the evidence using GRADE for this factor. In accordance with Higgins 2017, information on industry sponsorship and other funding sources is captured in the Characteristics of included studies tables.
In studies where participants received a control injection ‐ specifically for the comparisons of HPV vaccines with control in males and people living with HIV, and different interval schedules ‐ many of the included studies used an adjuvant (either aluminium hydroxide or another aluminium compound) as the control rather than a 'true' placebo (NCT00941889 2016 used a saline placebo; Levin 2010 and Wilkin 2018 did not specify the type of placebo). Aluminium adjuvants have been used in vaccines for many years as they are thought to enhance the immune response (HogenEsch 2018), but their suitability as control vaccines in RCTs has been questioned (Jørgensen 2018b). A previous systematic review found no evidence that aluminium adjuvants in diptheria, tetanus, and pertussis vaccines cause any serious or long‐lasting adverse events (Jefferson 2004). The rate of serious adverse events was low for both vaccine and control groups in the studies included in the current review. However, the benefits and harms of aluminium‐containing adjuvants are being further assessed in a Cochrane Review (Djurisic 2017), and research is underway to determine how suitable they are as control vaccines for RCTs.
For a number of outcomes presented in the 'Summary of findings' tables, especially serious adverse events and deaths, we downgraded the certainty of the evidence for imprecision. In most cases the sample size of the included RCTs was too small to be able to detect an effect between groups for these outcomes ‐ especially for rare outcomes such as death. This is another limitation of RCTs in determining the harms associated with HPV vaccines, and lends further weight to the future use of large observational studies. We also downgraded the evidence on serious adverse events for indirectness because of the limitations to the use of a composite outcome measure of events, as described in the section on applicability.
Potential biases in the review process
We made great efforts to identify relevant published and unpublished data, through a sensitive electronic database search and screening of vaccine manufacturer websites. By linking clinical trial registry entries with published database searches, and by cross‐checking the studies included and excluded from our review against a published index of HPV studies (Jørgensen 2018a), we attempted to minimise the risk of missed studies, though relevant data may remain unregistered or unpublished (Jørgensen 2018a).
We used a priori categories of common adverse events ‐ such as pain or swelling at the injection site ‐ or important outcomes such as serious adverse events and deaths when extracting data from included studies. This method of data extraction could have been limited by the reporting in the included studies, as composite outcomes, such as 'overall injection site/local adverse events', could not be calculated by reports of all events within the study populations. The range of different adverse events reported in the included studies, as well as the range of methods used to assess these in the studies, makes it unfeasible to extract all adverse events for the purpose of meta‐analysis.
We analysed and reported on all serious adverse events in the included studies. Serious adverse events are any events that result in hospitalisation and life‐threatening illness. This means that any serious injury or illness is included, even if it is unlikely to be related to the vaccine. We also reported on results and attribution methods used to determine whether serious adverse events were related to the vaccine. We did not analyse these results or report them in the ‘Summary of findings’ tables because attribution methods were either not transparent, or not independent of the study investigators (Appendix 4). These results are reported narratively in the Effects of interventions section.
We restricted the sensitivity analysis of very rare events to alternative statistical methods available in Review Manager 5 software. We applied a sensitivity analysis to a number of outcomes where there were studies with zero events in both arms, but they did not contribute information when either method was used. It is possible that other methods could yield different results where there are zero events in both trial arms (Sharma 2017).
Agreements and disagreements with other studies or reviews
The results of this systematic review are in agreement with other published reviews on the efficacy of fewer than three doses of HPV vaccine (D'Addario 2017; Markowitz 2018). The current review aimed to provide further information on clinical outcomes and adverse events. This review provides evidence about other comparisons, such as vaccination of boys and comparisons across types of HPV vaccine, which have not previously been assessed.
Authors' conclusions
Implications for practice.
In general, the bivalent, quadrivalent and nonavalent human papillomavirus (HPV) vaccines appear to be efficacious in eliciting immunogenic responses in both males and females for the targeted HPV genotypes and, typically, conversion to seropositivity is almost 100% amongst recipients. A two‐dose HPV vaccination schedule is simpler to administer than a three‐dose schedule. Immunogenicity data show non‐inferior results for a two‐dose when compared with a three‐dose schedule of bivalent, quadrivalent and nonavalent HPV vaccine. The World Health Organization (WHO) strategic advisory group of experts on vaccination recommends a two‐dose schedule with at least six months between the first and second dose, irrespective of sex, if the first dose is given before 15 years of age (WHO 2017). In practice, 65 countries worldwide have adopted two‐dose HPV vaccination schedules for girls, as of 31 December 2017. Amongst high‐income countries that recommend HPV vaccination for boys, Australia, Switzerland and the USA recommend a two‐dose schedule. Given the decision of the International Agency for Research on Cancer that immunogenicity is a surrogate endpoint for individuals under 16 years of age, randomised controlled trials (RCTs) with clinical endpoints in this age group are unlikely.
For males, including men who have sex with men (MSM), the quadrivalent HPV vaccine probably reduces the incidence of external genital lesions and anogenital warts (condylomata acuminata) compared with control. There were slightly more injection‐site adverse events with the quadrivalent vaccine compared to control, but insufficient evidence to determine the effects of HPV vaccine on serious adverse events or deaths when compared with control.
The nonavalent vaccine and quadrivalent vaccines offer similar protection levels against cervical, vaginal, and vulval precancer lesions and cancer in young women and similar levels of immunogenicity for the four HPV genotypes included in both vaccines in females and males. For high‐grade disease related to HPV 31, 33, 45, 52, or 58 (i.e. those genotypes covered by the nonavalent vaccine and not the quadrivalent vaccine) in women, the effect favours the nonavalent vaccine. No studies that compared nonavalent and quadrivalent HPV vaccines reported on clinical outcomes in males. The nonavalent vaccine was associated with an increase in local adverse events compared to the quadrivalent vaccine. Comparative evidence about serious adverse events was limited by imprecision and indirectness. Most of the evidence for this comparison comes from the 16 to 26 year‐old age group in females, and there are far fewer data for younger females and males.
Evidence about the efficacy and harms of HPV vaccines in people living with HIV is limited because very few trials measured clinical outcomes. In children living with HIV, quadrivalent HPV vaccine probably results in higher GMTs than control at seven months. In adults living with HIV the evidence about clinical outcomes and harms of quadrivalent HPV vaccine, compared with control or other HPV vaccines, was of very low‐certainty. The duration of protection of HPV vaccines in people with HIV infection and the effect of declining immunity on protection are unknown.
We identified no studies for any new HPV vaccines in phase 2 or 3 development that plan to report on the comparisons of interest in this review.
Implications for research.
Further long‐term post‐licensure studies are needed to determine the duration of protection of one‐dose and two‐dose schedules, as well as the efficacy against HPV‐related cancer endpoints in women, men, MSM, and people with HIV infection. RCTs of the effects of virus‐like particle HPV vaccines on cervical and anal cancer are likely to study surrogate endpoints such as immunogenicity and persistent HPV infection. For vulval and vaginal cancer, clinical disease is still recommended as an endpoint because of insufficient knowledge about persistent infection (IARC 2014). The natural history of HPV‐associated oropharyngeal cancer is even less well understood. RCTs of the effects of HPV vaccines will be needed, but might rely on persistent HPV infection as an outcome. The elucidation of the immune correlate of protection for HPV vaccines would be extremely valuable.
Further RCTs to compare different vaccine schedules are needed to determine the most cost‐effective strategy to reduce the incidence of persistent HPV infection and related cancers. Evidence about the effectiveness of a two‐dose HPV vaccine schedule on clinical HPV‐related disease still relies on non‐randomised comparisons of RCTs (Kreimer 2015; Sankaranarayanan 2016), and on data from national immunisation programmes (Markowitz 2018). These studies provide essential ongoing data, but cannot fully overcome confounding effects of differences between groups that receive a certain number of doses. In immunisation programme data in particular, those receiving two doses as part of a three‐dose schedule might only have received the first two doses with a one or two month gap and might be beyond the recommended age for vaccination. In this situation, these studies might actually underestimate the effectiveness of a recommended two‐dose schedule with at least six months between doses (Markowitz 2018).
An RCT that commenced in August 2018 will provide information about the non‐inferiority of one and two doses of bivalent and nonavalent HPV vaccines against incident HPV genotype 16/18 infections that persist for six months or more in young women (NCT03180034). In addition, long‐term surveillance and registry‐based studies, such as linking vaccination databases with disease‐ and population‐based registries, are needed to establish vaccine effectiveness and harms over time.
This review included a wide range of comparisons of alternative HPV vaccine schedules. In future, studies of the efficacy of different types of HPV vaccine, studies of alternative dose schedules, and studies of the effectiveness of HPV vaccines in people living with HIV infection could be examined in separate systematic reviews. This review has highlighted the limitations of data about harms collected in RCTs, especially imprecision, owing to the low frequency of serious adverse events. Longer‐term follow‐up is needed to investigate links with specific adverse events, such as new chronic diseases or adverse pregnancy outcomes. Post‐marketing surveillance allows continued monitoring and reports events following HPV vaccination in the population beyond the duration of follow‐up in RCTs. Surveillance studies of large registry‐based data from real‐world vaccination programmes can also provide more precise estimates of the incidence of specific adverse events and investigate prespecified hypotheses. In these studies, attribution of whether serious adverse events and deaths are related to the vaccine can be performed independently of study investigators and potential conflicts of interest. Future updates of this review will include observational long‐term post‐licensure studies to allow more detailed investigation of specific harms associated with HPV vaccines, long‐term data on the effectiveness of HPV vaccines, and the value of different dose schedules in increasing vaccine coverage. Future reviews should also consider the synthesis of evidence from vaccination programmes in the context of gender‐neutral HPV vaccination, where consideration of indirect effects of HPV vaccination is needed to provide more relevant estimates of vaccine effectiveness for public health stakeholders.
Acknowledgements
The authors would like to acknowledge the contribution of systematic reviewers from Cochrane Response for their assistance in screening abstracts and full‐texts for this review.
We would also like to thank Sarah Hodgkinson and Helen Wakeford for their editorial comments and support, Elizabeth Royle for copy‐editing, and all those providing referee comments, including: Simon Beddows, Jesse Berlin, Maggie Cruickshank, Nicole Fusco, Henry Kitchener, Yoon Loke and Mary Lunnen.
We thank Jo Morrison for her clinical and editorial advice, Jo Platt for assistance with the searches and and Gail Quinn, Clare Jess for their contribution to the editorial process.
The World Health Organization retains copyright and all other rights in the manuscript of this review as submitted for publication, including any revisions or updates to the manuscript which WHO may make from time to time.
Appendices
Appendix 1. Ovid MEDLINE search strategy
1. exp Papillomavirus Infections/
2. exp PAPILLOMAVIRIDAE/
3. (human papilloma virus or human papillomavirus).tw.
4. 1 or 2 or 3
5. exp Immunization/
6. (vaccin* or immuni*).tw.
7. 5 or 6
8. 4 and 7
9. exp Papillomavirus Vaccines/
10. (human papilloma virus adj (vaccin* or immuni*)).tw.
11. (human papillomavirus adj (vaccin* or immuni*)).tw.
12. HPV vaccin*.tw.
13. (cervarix or gardasil).tw.
14. 9 or 10 or 11 or 12 or 13
15. 8 or 14
16. randomised controlled trial.pt.
17. controlled clinical trial.pt.
18. randomized.ab.
19. placebo.ab.
20. clinical trials as topic.sh.
21. randomly.ab.
22. trial.ti.
23. 16 or 17 or 18 or 19 or 20 or 21 or 22
24. (animals not (humans and animals)).sh.
25. 23 not 24
26. 15 and 25
Appendix 2. Ovid Embase search strategy
1. exp papillomavirus infection/
2. exp Papillomaviridae/
3. (human papilloma virus or human papillomavirus).tw.
4. 1 or 2 or 3
5. exp immunization/
6. (vaccin* or immuni*).tw.
7. 5 or 6
8. 4 and 7
9. exp Wart virus vaccine/
10. (human papilloma virus adj (vaccin* or immuni*)).tw.
11. (human papillomavirus adj (vaccin* or immuni*)).tw.
12. HPV vaccin*.tw.
13. (cervarix or gardasil).tw.
14. 9 or 10 or 11 or 12 or 13
15. 8 or 14
16. crossover procedure/
17. double‐blind procedure/
18. randomised controlled trial/
19. single‐blind procedure/
20. random*.mp.
21. factorial*.mp.
22. (crossover* or cross over* or cross‐over*).mp.
23. placebo*.mp.
24. (double* adj blind*).mp.
25. (singl* adj blind*).mp.
26. assign*.mp.
27. allocat*.mp.
28. volunteer*.mp.
29. 16 or 17 or 18 or 19 or 20 or 21 or 22 or 23 or 24 or 25 or 26 or 27 or 28
30. 15 and 29
Appendix 3. The Cochrane Library search strategy
#1 MeSH descriptor: [Papillomavirus Infections] explode all trees
#2 MeSH descriptor: [Papillomaviridae] explode all trees
#3 ("human papilloma virus" or "human papillomavirus").ti,ab,kw
#4 #1 or #2 or #3
#5 MeSH descriptor: [Immunization] explode all trees
#6 (vaccin* or immuni*):ti,ab,kw
#7 #5 or #6
#8 #4 and #7
#9 MeSH descriptor: [Papillomavirus Vaccines] explode all trees
#10 (human papilloma virus NEAR (vaccin* or immuni*)):ti,ab,kw
#11 (human papillomavirus NEAR (vaccin* or immuni*)):ti,ab,kw
#12 (HPV NEXT vaccin*):ti,ab,kw
#13 (cervarix or gardasil):ti,ab,kw
#14 {or #9‐#13}
#15 #8 or #14
Appendix 4. Methods used to collect adverse event data
| Study | Mode of data collection | Time frame | Attribution methods | Intensity of ascertainment | Harms‐related monitoring and stopping rules | Frequency‐based filter |
| Denny 2013 | Proactive: trained field workers to visit subjects or instruct subjects to come back to a field station for the recording of solicited and unsolicited symptoms. Case report forms were used. | Time frame was specified. (Solicited AEs were recorded for 7 days after each vaccination. Unsolicited AEs were recorded for 30 days after each vaccination. SAEs, medically significant AEs, new‐onset chronic diseases (NOCDs), pregnancies and their outcome were recorded up to month 12). | Not reported | Information relative to premature discontinuation of the investigational product was documented. The investigator was to document whether the decision to discontinue further vaccination was made by the subject or the investigator and which of the following possible reasons was responsible for withdrawal: SAE, non‐serious AE, other (specified). No woman withdrew from the study due to AEs, however information on how withdrawals would have been handled in the analysis was not reported. | Stopping rules not reported | No filter used (“For the analysis of unsolicited AEs/ SAEs/ Medically significant conditions/ NOCDs/ concomitant medication, all vaccinated subjects will be considered and subjects who did not report an event will be considered as subjects without an event”). |
| Dobson 2013 | Passive: “information on AEs was collected at the next visit or if the participant called with concerns” | Time frame was specified (“Because this was a post‐licensure study, data were only collected on SAEs occurring within 30 days of each vaccination”). | Not reported | Not reported | Stopping rules not reported | Unclear. Results were reported narratively only (“Scheduled vaccine doses were received by 98.6% of study participants with no SAEs reported"). |
| Giuliano 2011 | Proactive and passive: subjects recorded AEs on vaccination report cards. SAEs were recorded by investigators, including all deaths. | Time frame was specified ("any AEs occurring at the injection site on days 1 through 5 after receiving each dose of vaccine or placebo"). They also recorded systemic AEs and all SAEs that occurred on days 1 to 15 after receiving each dose. All SAEs that investigators believed to be associated with the vaccine or the study procedure and all deaths were recorded during the entire study period) | Attribution made by investigators (“Vaccine‐related AEs were those determined by the investigator to be possibly, probably, or definitely related to the vaccine”). | Number of withdrawals were reported, but without reasons. No information on how withdrawals were handled presented in the analysis. |
Stopping rules not reported | Filter not used. AEs were reported as n/N. Study also reported number of participants with no event, and number with at least 1 event, but did not distinguish between participants with 1 or multiple AEs. |
| Hidalgo‐Tenorio 2017 | Proactive for local reactions: “Questionnaire that included the most frequent local reactions” Rare occurrences were also recorded, but mode of data collection is unclear. |
Time frame is unclear (possibly at 2 and 6 months). | Attribution and blinding not reported. Definition used was provided (“Frequent local reactions included fever, nausea, vomiting, dizziness, syncope, headache and others such as allergic reaction, pruritus, difficulty breathing and/or wheezing. Rare occurrences included lymphadenopathies, chest and lower‐limb pain, confusion, chills, muscle pain", but it is unclear if they were predefined. "The AEs were graded on a scale of 1–4”) |
Reasons for discontinuation were separated by arm. No information on how withdrawals were handled in the analysis. Attribution was not reported. |
Monitoring stopping rules were reported (“In case of AE grade 4, the blind of the vial administered was broken and, if the code identified the vaccine, the reaction was communicated immediately to the relevant drug‐vigilance authorities”) | No filter used |
| Iversen 2016 | Proactive and passive: immediate reactions were proactively collected: “Participants were observed for 30 mins after each injection for any immediate reaction”. Non‐serious injection site and systemic events “were not actively solicited”. |
Time frame was specified (“SAEs were to be reported irrespective of causality from day 1 (month 0) through 6 months after the last vaccination”). | Attribution made by investigators (“Investigators were instructed to assign causality to adverse events on the basis of exposure, time course, likely cause, and consistency with the vaccine’s known safety profile”). Blinding was not reported. No definition given for non‐serious AEs. SAEs were predefined (“those events that resulted in death, were deemed life‐threatening, led to a persistent or significant disability, required hospitalization, or were associated with a congenital anomaly, cancer, or other important medical event”). |
Reasons for discontinuation were separated by arm, and after each dose administration. Attribution was not reported. No information on how withdrawals were handled in the analysis. |
Stopping rules not reported | No filter used |
| Joura 2015 | Mode of data collection was not reported. | Time frame was specified (“Deaths and serious vaccine‐related AEs were reported throughout the study. Other SAEs were reported from day 1 to 6 months following the last vaccination; events of fetal loss were reported as SAEs for any pregnancy with a last menstrual period before 6 months following the last vaccination”). | Attribution was made by the investigator (“were deemed by the investigator”). Blinding was not reported. SAEs were predefined (“any AE that resulted in death, were deemed by the investigator to be life‐threatening, resulted in a persistent or significant disability or incapacity, resulted in or prolonged an existing inpatient hospital stay, or were congenital anomalies, cancers, or other so‐called important medical events”). |
Attribution was made by the safety monitoring committee (“The external data and safety monitoring committee whose members were aware of the group assignments assessed safety findings throughout the study”). No information on how withdrawals were handled in the analysis. |
Stopping rules not reported | No filter used. AEs were reported as n/N. Study also reported number of participants with at least 1 event, but did not distinguish between participants with 1 or multiple AEs. |
| Lehtinen 2018 | Proactive and passive: for active safety surveillance, a small subset of male adolescents receiving either vaccine were selected to use diary cards. Serious adverse events were actively monitored in the diary card subset and in other male participants in one cluster (90% HPV, 10% HBV) from month 1 to month 12. Passive monitoring of SAEs and new‐onset autoimmune diseases continued for all study participants during the whole follow‐up period by linkage to inpatient and outpatient health care use recorded in the Care Register for Social Welfare and Health Care. |
Active surveillance:
Passive SAE and new‐onset autoimmune disease surveillance:
|
Attribution by investigator, blinded to treatment. | Active surveillance of SAEs, non‐serious AEs and other events was only conducted for a small subset of male participants. Reasons for discontinuation were separated by arm and reported for withdrawals due to SAEs, non‐serious AEs and other reasons. | Stopping rules not reported | No filter used |
| Leung 2015 | Passive for solicited local and general symptoms: “diary cards” | Time frame was specified (“Solicited local and general symptoms were recorded for 7 days after each vaccination”; “Unsolicited symptoms were recorded for 30 days after each vaccination"; “SAEs, medically significant AEs, pIMDs and pregnancy were reported throughout the study”; “SAEs up to month 36”) | Attribution and blinding were not reported. Only Grade 3 symptoms were defined (“redness or swelling > 50 mm in diameter, fever > 39C”) |
No information on how withdrawals would have been handled in the analysis, however “no subject was withdrawn from the study due to an AE” Attribution was not reported. |
Stopping rules not reported | No filter used. Results reported as percentage of participants with symptoms, therefore did not distinguish between participants with 1 or multiple AEs. |
| Levin 2010 | Proactive: “Subjects were observed in clinic for 30 minutes post vaccination. A report card of relevant signs and symptoms was maintained by the caregiver for 15 days after each injection. Body temperature was recorded for 5 days beginning after the injection. Telephone contact with the caregiver was made on the third day after each injection to inquire about reactions. The caregiver was instructed to immediately report unusual injection site reactions”; “Routine hematologic and chemistry screens were performed at the study site's laboratory at entry, 4 weeks after the first dose, and just before and 4 weeks after the next 2 doses. CD4% and CD4 number were determined at entry, 8 weeks after the first dose, 4 weeks after the second dose, and just before and 4 weeks after the third dose”. | Time frame was specified (see methods of data collection). | Attribution was made by the study co‐ordinator. Blinding not reported. The severity of AEs was done using the “Division of AIDS Table for Grading the Severity of Adverse Events”. |
No information on how withdrawals were handled in the analysis. | Unclear. “A clinic visit was required within 24 hours whenever the study coordinator considered that a reaction might be ≥ grade 3”. However, clear rules regarding termination of the study were not reported. | No filter used |
| Lin 2014 | Unclear: “Following each vaccination visit, participants were screened for adverse events”. | Time frame is unclear. | Not reported | Reasons for discontinuation were separated by arm, and after each dose administration. Attribution was not reported. No information on how withdrawals were handled in the analysis. |
Stopping rules not reported | No filter used. However, results were only reported narratively as proportions. P‐value only reported for overall occurrence of AEs. Specific AEs were not reported separately by group. |
| NCT00941889 2016 | Not applicable, serious and/or other non‐serious adverse events were not collected or assessed. | Not applicable | Not applicable | Not applicable | Not applicable | Not applicable |
| NCT01031069 2017 | Mode of data collection was not reported. | Solicited local and general symptoms within 7 days after each and any vaccination; unsolicited symptoms within 30 days (days 0‐29) after any vaccination; SAEs, medically significant conditions, pregnancy outcomes, clinically relevant abnormalities in haematological and biochemical parameters up to 30 days after the last dose of vaccine. | Attribution, blinding or definitions were not reported. | Reasons for discontinuation were separated by arm. All vaccinated subjects for whom data were available were included in the analysis. Attribution was not reported. |
Stopping rules not reported | No filter used |
| NCT01862874 2018 | Mode of data collection was not reported, except that a vaccination report card was used. | Serious and other adverse events followed up for 36 months; injection‐site AEs were reported up to 5 days after any vaccination; systemic AEs were reported up to 15 days after any vaccination. | Attribution, blinding or definitions were not reported. | Reasons for discontinuation were separated by arm. All vaccinated subjects for whom data were available were included in the analysis. Attribution was not reported. |
Stopping rules not reported | Threshold above which other adverse events are reported: 5% |
| Wilkin 2018 | Mode of data collection was not reported. | Grade 3 or 4 AEs that were possibly, probably, or definitely related to the vaccine: to participant's last study visit, for up to 4 years. | Attribution determined by the local investigator, blinding not reported. Grade 3 or 4 adverse events were defined using the DAIDS Table for Grading the Severity of Adult and Pediatric Adverse Events. |
Reasons for discontinuation were separated by arm. All vaccinated subjects for whom data were available were included in the analysis. Attribution was made by the local investigator. |
Stopping rules not reported | No filter used |
| Petaja 2009 | Proactive and passive: “Participants used diary cards to report solicited local and general symptoms during a 7‐day follow‐up period after each vaccine dose”; “Unsolicited signs and symptoms were reported within 30 days after each dose”. Data collection forms available from GSK report. |
Time frame was specified: 7‐day follow‐up for local and general symptoms; 30 days for unsolicited signs and symptoms; SAEs, NOCDs and other medically significant conditions (MSCs) were reported throughout the study period (up to month 12). |
Attribution method not explicitly described in methods section. However, it seems it was done by the investigator “Neither of the SAEs were fatal, and both events were considered by the investigator to be unrelated to study vaccination”; “the determination of whether a chronic disease is considered to be of new onset will be based on review of the subject's pre‐vaccination medical history”. Blinding was not reported. Outcome definition:
|
Reasons for discontinuation were separated by arm. Attribution was not reported. No information on how withdrawals were handled in the analysis. |
Stopping rules not fully described, “Your participation in the study may be stopped the study doctor decides it is in the best interest of your health and welfare to discontinue participation in the study” | Filter not used. AEs were reported as n/N. GSK report lists all symptoms individually. Study did not distinguish between participants with 1 or multiple AEs. |
| Puthanakit 2016 | Proactive and passive: “Solicited local and general symptoms were recorded on diary cards for 7 days after each vaccination. Unsolicited symptoms were recorded for 30 days after each vaccination. Pregnancies and outcomes, serious adverse events, medically significant adverse events, and potential immune‐mediated diseases were reported throughout the study”. | Time frame was specified (see methods of data collection). | Attribution and blinding not reported. Grade 3 symptoms were defined (“as redness or swelling >50 mm in diameter, fever >39°C, urticaria distributed on ≥4 body areas, and, for other symptoms, as preventing normal activity”). |
Reasons for discontinuation were separated by arm, and after each dose administration. Attribution was not reported. No information on how withdrawals were handled in the analysis. |
Stopping rules not reported | No filter used, however, results were provided as number of participants with at least 1 event, therefore did not distinguish between participants with 1 or multiple AEs. |
| Romanowski 2011 | Proactive and passive: “Solicited local symptoms (pain, redness or swelling at injection site) and general symptoms (fever, headache, fatigue, gastrointestinal symptoms, arthralgia, myalgia, rash or urticaria) occurring within 7 d after each vaccination were recorded by the subject or her parent/legally acceptable representative using a diary card. Investigators documented the presence or absence of urticaria/rash within 30 min after each vaccine. dose. Unsolicited AEs occurring within one month of each vaccine dose were documented by the investigator. "SAEs and other medically significant conditions were reported in all subjects regardless of causal relationship to vaccination and intensity." |
Time frame was specified (see methods of data collection). | Attribution and blinding not reported. Outcome definition reported (“Medically significant condition = AE prompting emergency room or physician visits that was not related to common diseases. New onset autoimmune diseases (which excluded allergy‐related events or isolated signs and symptoms) were identified by comparing all reported AEs with a pre‐defined list of potential chronic autoimmune events derived from the Medical Dictionary for Regulatory Activities”). |
Attribution was not reported. No information on how withdrawals would have been handled in the analysis, however “no subject was withdrawn from the study due to an AE or a SAE” |
Stopping rules not reported | No filter used. However, for many of the AEs, results were provided as number of participants with at least 1 event, therefore did not distinguish between participants with 1 or multiple AEs. |
| Toft 2014 | Proactive and passive: “Participants were observed for 30 minutes after each immunization to evaluate immediate AEs. Solicited AEs occurring during the first 4 days after each immunization (injection site pain, swelling, erythema, fever, headache, nausea, myalgia, arthralgia and rash) and other signs of illness and/or changes in medication occurring within 15 days after immunization were recorded on diary cards”. | Time frame was specified (see methods of data collection). | Attribution was unclear (see below). Blinding was not reported. Outcome definition was reported (“Solicited and unsolicited AEs, as well as laboratory tests, were graded according to the common toxicity criteria version 2.0. All solicited local (injection site) and influenza‐like (fever, arthralgia, chills, and fatigue) reactions were considered causally related to vaccination. Other AEs were evaluated by the primary investigator and graded as “unlikely” or “probably” related to the study vaccines”). |
Withdrawals were not reported by group. No information on how withdrawals were handled in the analysis was provided. Attribution was not reported. |
Stopping rules not reported | Filter not used. Solicited AEs reported as n/N. Study also reported number of participants with at least 1 event, but did not distinguish between participants with 1 or multiple AEs. |
| van Damme 2016 | Proactive and passive: “Following each vaccination, participants were observed for 30 min for any untoward effects, including allergic reactions. All participants received a vaccination report card (VRC) at each vaccination visit. They were asked to record their oral temperature on the VRC from day 1 to day 5 after each vaccination (starting on the evening after vaccination), and any injection‐site and systemic AEs) for a total of 15 days including the day of vaccination … SAEs were collected for the entire duration of the study irrespective of cause”. | Time frame was specified (see methods of data collection). | Attribution was made by investigators based on the information provided by the patients (“The study site personnel reviewed the VRC for completeness and could not alter the original information recorded by the participants on the VRC. The investigator determined the causality of systemic AEs reported on the VRC, and classified each AE reported on the VRC as a serious or non‐serious AE”). Blinding was not reported. Outcome definition was reported (“An oral temperature 37.8 C during the follow‐up period was considered an elevated temperature (fever). For each AE, participants were asked to rate the symptom as mild (awareness of signor symptom but easily tolerated), moderate (discomfort enough to cause interference with usual activities), or severe (incapacitating with inability to work or do usual activity); injection‐site AEs of swelling and erythema were rated by size. Investigators were instructed to assign causality to AEs on the basis of exposure, time course, likely cause, and consistency with the vaccine’s known profile. Serious AEs (SAEs) were predefined as any AE that resulted in death, deemed by the investigator to be life‐threatening, or that resulted in a persistent or significant disability or incapacity, resulted in or prolonged an existing in‐patient hospitalization, or was a congenital anomaly, a cancer, or an ‘other important medical event"). |
Reasons for discontinuation were separated by arm. Attribution was not reported. No information provided about how withdrawals were handled in the analysis. |
Stopping rules not reported | Filter not used. AEs were reported as n/N. Study also reported number of participants with no event, and number with at least 1 event, but did not distinguish between participants with 1 or multiple AEs. |
| Vesikari 2015 | Proactive and passive: “Participants were observed for 30 mins after each vaccination for any immediate reaction. All subjects received a vaccination report card at the day 1, month 2 and month 6 study vaccination visits. Oral temperature was reported from day 1 to day 5 after any vaccination, and injection‐site reactions and systemic AEs were recorded on the vaccination report card from day 1 to day 15 after any vaccination. SAEs were monitored throughout the study regardless of cause”. | Time frame was specified (see methods of data collection). | Attribution was made by the investigator (“Investigators assigned causality to AEs based on exposure, time course, likely cause and consistency with the vaccine’s known profile. Vaccine‐related AEs were determined by the investigator to be possibly, probably or definitely vaccine‐related”). Blinding was not reported. Outcome definition was reported (“An elevated temperature (fever) was defined as maximum temperature ≥37.8°C. For each AE, participants rated the symptom as mild (awareness of symptom but easily tolerated), moderate (discomfort enough to cause interference with usual activities) or severe (incapacitating with inability to work or do usual activity); injection‐site AEs of swelling and erythema were rated by size. SAEs were predefined as any AE that resulted in death, were deemed by the investigator to be life‐threatening, resulted in a persistent or significant disability or incapacity, resulted in or prolonged an existing in‐patient hospitalization or was a congenital anomaly, a cancer or an “other important medical event”. |
Reasons for discontinuation were separated by arm, and after each dose administration. Attribution was not reported. No information provided about how withdrawals were handled in the analysis. |
Stopping rules not reported | Filter not used. AEs were reported as n/N. Study also reported number of participants with no event, and number with at least 1 event, but did not distinguish between participants with 1 or multiple AEs. |
Abbreviations
AE: adverse event HBV: hepatitis B vaccine HPV: human papillomavirus NOCD: new onset chronic disease pIMD: potentially immune mediated diseases SAE: serious adverse event VRC: vaccination report card
Appendix 5. Two versus three doses of HPV vaccine in 9‐ to 15‐year old females ‐ immunogenicity outcomes
| Outcome or subgroup* | Follow‐up | Studies | Participants | Statistical method | Effect estimate (95% CI) | Certainty of the evidence (GRADE) |
| 1.1 GMT of HPV 6 (mMU/mL) | 1 month after last dose | 2 (Dobson 2013; Iversen 2016) | 1001 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.13 (0.99 to 1.29) | ⊕⊕⊕⊕ HIGH |
| 1.1.1 Quadrivalent vaccine | 1 month after last dose | 1 (Dobson 2013) | 489 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.18 (0.93 to 1.49) | |
| 1.1.2 Nonavalent vaccine | 1 month after last dose | 1 (Iversen 2016) | 512 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.11 (0.94 to 1.30) | |
| 1.2 GMT of HPV 11 (mMU/mL) | 1 month after last dose | 2 (Dobson 2013; Iversen 2016) | 1006 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.09 (0.97 to 1.22) | ⊕⊕⊕⊕ HIGH |
| 1.2.1 Quadrivalent vaccine | 1 month after last dose | 1 (Dobson 2013) | 494 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.12 (0.95 to 1.32) | |
| 1.2.2 Nonavalent vaccine | 1 month after last dose | 1 (Iversen 2016) | 512 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.06 (0.91 to 1.25) | |
| 1.3 GMT of HPV 16 | Not pooled due to considerable heterogeneity across studies (I2 = 89%) | |||||
| 1.3.1 Bivalent vaccine | 1 month after last dose | 1 (Romanowski 2011) | 132 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.50 (0.38 to 0.66) | ⊕⊕⊕⊝ MODERATE1,4 |
| 1.3.2 Quadrivalent vaccine | 1 month after last dose | 2 (Dobson 2013; Leung 2015) | 1143 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.03 (0.92 to 1.15) | ⊕⊕⊕⊕ HIGH |
| 1.3.3 Nonavalent vaccine | 1 month after last dose | 1 (Iversen 2016) | 541 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.14 (0.98 to 1.34) | ⊕⊕⊕⊕ HIGH |
| 1.4 GMT of HPV 18 | 1 month after last dose | 4 (Romanowski 2011; Dobson 2013; Iversen 2016; Leung 2015) | 1833 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.77 (0.69 to 0.87) | ⊕⊕⊕⊝ MODERATE2 |
| 1.4.1 Bivalent vaccine | 1 month after last dose | 1 (Romanowski 2011) | 132 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.74 (0.57 to 0.97) | |
| 1.4.2 Quadrivalent vaccine | 1 month after last dose | 2 (Dobson 2013; Leung 2015) | 1159 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.72 (0.64 to 0.81) | |
| 1.4.3 Nonavalent vaccine | 1 month after last dose | 1 (Iversen 2016) | 542 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.91 (0.76 to 1.09) | |
| 1.5 GMT of HPV 31 (mMU/mL) | 1 month after last dose | 1 (Iversen 2016) | 543 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.82 (0.69 to 0.98) | ⊕⊕⊕⊕ HIGH |
| 1.6 GMT of HPV 33 (mMU/mL) | 1 month after last dose | 1 (Iversen 2016) | 548 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.29 (1.10 to 1.52) | ⊕⊕⊕⊕ HIGH |
| 1.7 GMT of HPV 45 (mMU/mL) | 1 month after last dose | 1 (Iversen 2016) | 549 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.54 (0.45 to 0.65) | ⊕⊕⊕⊕ HIGH |
| 1.8 GMT of HPV 52 (mMU/mL) | 1 month after last dose | 1 (Iversen 2016) | 547 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.64 (0.55 to 0.74) | ⊕⊕⊕⊕ HIGH |
| 1.9 GMT of HPV 58 (mMU/mL) | 1 month after last dose | 1 (Iversen 2016) | 543 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.02 (0.87 to 1.19) | ⊕⊕⊕⊕ HIGH |
| 1.10 Seroconversion to HPV 6 | 1 month after last dose | 2 (Dobson 2013; Iversen 2016) | 1001 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.10.1 Quadrivalent vaccine | 1 month after last dose | 1 (Dobson 2013) | 489 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | |
| 1.10.2 Nonavalent vaccine | 1 month after last dose | 1 (Iversen 2016) | 512 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.02) | |
| 1.11 Seroconversion to HPV 11 | 1 month after last dose | 2 (Dobson 2013; Iversen 2016) | 1006 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.11.1 Quadrivalent vaccine | 1 month after last dose | 1 (Dobson 2013) | 494 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | |
| 1.11.2 Nonavalent vaccine | 1 month after last dose | 1 (Iversen 2016) | 512 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | |
| 1.12 Seroconversion to HPV 16 | 1 month after last dose | 4 (Romanowski 2011; Dobson 2013; Iversen 2016; Leung 2015) | 1816 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) | ⊕⊕⊕⊕ HIGH |
| 1.12.1 Bivalent vaccine | 1 month after last dose | 1 (Romanowski 2011) | 132 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.97 to 1.03) | |
| 1.12.2 Quadrivalent vaccine | 1 month after last dose | 2 (Dobson 2013; Leung 2015) | 1143 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) | |
| 1.12.3 Nonavalent vaccine | 1 month after last dose | 1 (Iversen 2016) | 541 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | |
| 1.13 Seroconversion to HPV 18 | 1 month after last dose | 4 (Romanowski 2011; Dobson 2013; Iversen 2016; Leung 2015) | 1833 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) | ⊕⊕⊕⊕ HIGH |
| 1.13.1 Bivalent vaccine | 1 month after last dose | 1 (Romanowski 2011) | 132 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.97 to 1.03) | |
| 1.13.2 Quadrivalent vaccine | 1 month after last dose | 2 (Dobson 2013; Leung 2015) | 1159 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) | |
| 1.13.3 Nonavalent vaccine | 1 month after last dose | 1 (Iversen 2016) | 542 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | |
| 1.14 Seroconversion to HPV 31 | 1 month after last dose | 1 (Iversen 2016) | 543 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.15 Seroconversion to HPV 33 | 1 month after last dose | 1 (Iversen 2016) | 548 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.16 Seroconversion to HPV 45 | 1 month after last dose | 1 (Iversen 2016) | 549 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.17 Seroconversion to HPV 52 | 1 month after last dose | 1 (Iversen 2016) | 547 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.18 Seroconversion to HPV 58 | 1 month after last dose | 1 (Iversen 2016) | 543 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.19 GMT of HPV 6 (mMU/mL) | ||||||
| 1.19.1 Quadrivalent vaccine | 60 months after first dose | 1 (Dobson 2013) | 101 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.73 (0.50 to 1.06) | ⊕⊕⊝⊝ LOW3,4 |
| 1.19.2 Nonavalent vaccine | 36 months after first dose | 1 (Iversen 2016) | 476 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.90 (0.76 to 1.08) | ⊕⊕⊕⊕ HIGH |
| 1.20 GMT of HPV 11 (mMU/mL) | ||||||
| 1.20.1 Quadrivalent vaccine | 60 months after first dose | 1 (Dobson 2013) | 101 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.99 (0.68 to 1.44) | ⊕⊕⊝⊝ LOW2,3 |
| 1.20.2 Nonavalent vaccine | 36 months after first dose | 1 (Iversen 2016) | 476 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.84 (0.70 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.21 GMT of HPV 16 (mMU/mL) | ||||||
| 1.21.1 bivalent vaccine | 60 months after first dose | 1 (Romanowski 2011) | 93 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.51 (0.36 to 0.72) | ⊕⊕⊝⊝ LOW3,4 |
| 1.21.2 Quadrivalent vaccine | 60 months after first dose | 1 (Dobson 2013) | 101 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.14 (0.76 to 1.73) | ⊕⊕⊝⊝ LOW3,4 |
| 1.21.3 Nonavalent vaccine | 36 months after first dose | 1 (Iversen 2016) | 503 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.85 (0.69 to 1.04) | ⊕⊕⊕⊕ HIGH |
| 1.22 GMT of HPV 18 (mMU/mL) | ||||||
| 1.22 1 Bivalent vaccine | 60 months after first dose | 1 (Romanowski 2011) | 92 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.69 (0.47 to 1.02) | ⊕⊕⊝⊝ LOW3,4 |
| 1.22.2 Quadrivalent vaccine | 60 months after first dose | 1 (Dobson 2013) | 101 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.57 (0.34 to 0.96) | ⊕⊕⊝⊝ LOW3,4 |
| 1.22.3 Nonavalent vaccine | 36 months after first dose | 1 (Iversen 2016) | 504 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.77 (0.65 to 0.91) | ⊕⊕⊕⊕ HIGH |
| 1.23 GMT of HPV 31 (mMU/mL) | 36 months after first dose | 1 (Iversen 2016) | 506 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.62 (0.51 to 0.75) | ⊕⊕⊕⊕ HIGH |
| 1.24 GMT of HPV 33 (mMU/mL) | 36 months after first dose | 1 (Iversen 2016) | 510 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.11 (0.94 to 1.31) | ⊕⊕⊕⊕ HIGH |
| 1.25 GMT of HPV 45 (mMU/mL) | 36 months after first dose | 1 (Iversen 2016) | 511 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.46 (0.39 to 0.56) | ⊕⊕⊕⊕ HIGH |
| 1.26 GMT of HPV 52 (mMU/mL) | 36 months after first dose | 1 (Iversen 2016) | 509 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.57 (0.49 to 0.67) | ⊕⊕⊕⊕ HIGH |
| 1.27 GMT of HPV 58 (mMU/mL) | 36 months after first dose | 1 (Iversen 2016) | 505 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.88 (0.74 to 1.05) | ⊕⊕⊕⊕ HIGH |
| 1.28 Seropositivity to HPV 6 | ||||||
| 1.28.1 Quadrivalent vaccine | 60 months after first dose | 1 (Dobson 2013) | 101 | RR (M‐H, random‐effects, 95% CI) | RR 0.98 (0.91 to 1.05) | ⊕⊕⊝⊝ LOW3,4 |
| 1.28.2 Nonavalent vaccine | 36 months after first dose | 1 (Iversen 2016) | 476 | RR (M‐H, random‐effects, 95% CI) | RR 0.97 (0.94 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.29 Seropositivity to HPV 11 | ||||||
| 1.29.1 Quadrivalent vaccine | 60 months after first dose | 1 (Dobson 2013) | 101 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (95% CI not estimable, all participants were seropositive) | ⊕⊕⊝⊝ LOW3,4 |
| 1.29.2 Nonavalent vaccine | 36 months after first dose | 1 (Iversen 2016) | 476 | RR (M‐H, random‐effects, 95% CI) | RR 0.95 (0.92 to 0.99) | ⊕⊕⊕⊕ HIGH |
| 1.30 Seropositivity to HPV 16 | ||||||
| 1.30.1 Bivalent vaccine | 60 months after first dose | 1 (Romanowski 2011) | 490 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (95% CI not estimable, all participants were seropositive) | ⊕⊕⊕⊕ HIGH |
| 1.30.2 Quadrivalent vaccine | 60 months after first dose | 1 (Dobson 2013) | 101 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (95% CI not estimable, all participants were seropositive) | ⊕⊕⊝⊝ LOW3,4 |
| 1.30.3 Nonavalent vaccine | 36 months after first dose | 1 (Iversen 2016) | 503 | RR (M‐H, random‐effects, 95% CI) | RR 0.98 (0.96 to 1.00) | ⊕⊕⊕⊕ HIGH |
| 1.31 Seropositivity to HPV 18 | ||||||
| 1.31.1 Bivalent vaccine | 60 months after first dose | 1 (Romanowski 2011) | 480 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) | ⊕⊕⊕⊕ HIGH |
| 1.31.2 Quadrivalent vaccine | 60 months after first dose | 1 (Dobson 2013) | 101 | RR (M‐H, random‐effects, 95% CI) | RR 0.89 (0.78 to 1.03) | ⊕⊕⊝⊝ LOW3,4 |
| 1.31.3 Nonavalent vaccine | 36 months after first dose | 1 (Iversen 2016) | 504 | RR (M‐H, random‐effects, 95% CI) | RR 0.98 (0.95 to 1.02) | ⊕⊕⊕⊕ HIGH |
| 1.32 Seropositivity to HPV 31 | 36 months after first dose | 1 (Iversen 2016) | 506 | RR (M‐H, random‐effects, 95% CI) | RR 0.96 (0.93 to 1.00) | ⊕⊕⊕⊕ HIGH |
| 1.33 Seropositivity to HPV 33 | 36 months after first dose | 1 (Iversen 2016) | 510 | RR (M‐H, random‐effects, 95% CI) | RR 0.96 (0.92 to 0.99) | ⊕⊕⊕⊕ HIGH |
| 1.34 Seropositivity to HPV 45 | 36 months after first dose | 1 (Iversen 2016) | 511 | RR (M‐H, random‐effects, 95% CI) | RR 0.92 (0.86 to 0.98) | ⊕⊕⊕⊕ HIGH |
| 1.35 Seropositivity to HPV 52 | 36 months after first dose | 1 (Iversen 2016) | 509 | RR (M‐H, random‐effects, 95% CI) | RR 0.96 (0.92 to 0.99) | ⊕⊕⊕⊕ HIGH |
| 1.36 Seropositivity to HPV 58 | 36 months after first dose | 1 (Iversen 2016) | 505 | RR (M‐H, random‐effects, 95% CI) | RR 0.99 (0.97 to 1.01) | ⊕⊕⊕⊕ HIGH |
*Results were stratified into subgroups by type of HPV vaccine and time point. GMTs and seropositivity to HPV 31, 33, 45, 52, and 58 are only measured in nonavalent vaccine trials (Iversen 2016).
1GRADE rating applies to specific vaccine type and outcome
2Downgraded one level for inconsistency: moderate heterogeneity (I2 > 30%)
3Downgraded one level for risk of bias: high loss to follow up
4Downgraded one level for imprecision: small sample size
Abbreviations
CI: confidence interval GMT: geometric mean titre HPV: human papillomavirus IV: inverse variance M‐H: Mantel‐Haenszel RR: risk ratio SMD: standard mean difference mMU: milli‐Merck unit
Appendix 6. Two doses of HPV vaccine with longer interval versus two doses of HPV vaccine with shorter interval in 9‐ to 14‐year old females and males ‐ immunogenicity outcomes
| Outcome or subgroup* | Population | Follow‐up | Studies | Participants | Statistical method | Effect estimate (95% CI) | Certainty of the evidence (GRADE) |
| 3.1 GMT of HPV 6 (mMU/mL) | |||||||
| 3.1.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Iversen 2016) | 381 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.62 (1.32 to 1.98) | ⊕⊕⊕⊕ HIGH |
| 3.1.2 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males | 1 month after last dose | 1 (Iversen 2016) | 397 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.72 (1.41 to 2.09) | ⊕⊕⊕⊕ HIGH |
| 3.2 GMT of HPV 11 (mMU/mL) | |||||||
| 3.2.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Iversen 2016) | 381 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 2.10 (1.82 to 2.40) | ⊕⊕⊕⊕ HIGH |
| 3.2.2 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males | 1 month after last dose | 1 (Iversen 2016) | 398 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 2.08 (1.71 to 2.53) | ⊕⊕⊕⊕ HIGH |
| 3.3 GMT of HPV 16 (EU/mL or mMU/mL) | |||||||
| 3.3.1 Bivalent vaccine (0 and 2 months) vs (0 and 6 months | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Romanowski 2011) | 136 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 2.06 (1.60 to 2.64) | ⊕⊕⊕⊝ MODERATE1 |
| 3.3.2 Bivalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Puthanakit 2016) | 835 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.22 (1.10 to 1.34) | ⊕⊕⊕⊕ HIGH |
| 3.3.3 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Iversen 2016) | 401 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.73 (1.42 to 2.10) | ⊕⊕⊕⊕ HIGH |
| 3.3.4 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males | 1 month after last dose | 1 (Iversen 2016) | 408 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.75 (1.44 to 2.12) | ⊕⊕⊕⊕ HIGH |
| 3.4 GMT of HPV 18 (EU/mL or mMU/mL) | |||||||
| 3.4.1 Bivalent vaccine (0 and 2 months) vs (0 and 6 months | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Romanowski 2011) | 132 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.60 (1.22 to 2.10) | ⊕⊕⊕⊝ MODERATE1 |
| 3.4.2 Bivalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Puthanakit 2016) | 854 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.12 (1.01 to 1.25) | ⊕⊕⊕⊕ HIGH |
| 3.4.3 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Iversen 2016) | 401 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.44 (1.16 to 1.79) | ⊕⊕⊕⊕ HIGH |
| 3.4.4 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males | 1 month after last dose | 1 (Iversen 2016) | 409 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.57 (1.27 to 1.95) | ⊕⊕⊕⊕ HIGH |
| 3.5 GMT of HPV 31 (mMU/mL) | |||||||
| 3.5.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Iversen 2016) | 404 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.45 (1.18 to 1.79) | ⊕⊕⊕⊕ HIGH |
| 3.5.2 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males | 1 month after last dose | 1 (Iversen 2016) | 407 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.43 (1.17 to 1.76) | ⊕⊕⊕⊕ HIGH |
| 3.6 GMT of HPV 33 (mMU/mL) | |||||||
| 3.6.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Iversen 2016) | 405 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.98 (1.63 to 2.40) | ⊕⊕⊕⊕ HIGH |
| 3.6.2 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males | 1 month after last dose | 1 (Iversen 2016) | 408 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 2.27 (1.87 to 2.76) | ⊕⊕⊕⊕ HIGH |
| 3.7 GMT of HPV 45 (mMU/mL) | |||||||
| 3.7.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Iversen 2016) | 406 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.23 (0.98 to 1.54) | ⊕⊕⊕⊕ HIGH |
| 3.7.2 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males | 1 month after last dose | 1 (Iversen 2016) | 409 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.13 (0.90 to 1.41) | ⊕⊕⊕⊕ HIGH |
| 3.8 GMT of HPV 52 (mMU/mL) | |||||||
| 3.8.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Iversen 2016) | 403 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.77 (1.47 to 2.13) | ⊕⊕⊕⊕ HIGH |
| 3.8.2 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males | 1 month after last dose | 1 (Iversen 2016) | 410 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.91 (1.59 to 2.29) | ⊕⊕⊕⊕ HIGH |
| 3.9 GMT of HPV 58 (mMU/mL) | |||||||
| 3.9.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Iversen 2016) | 399 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.79 (1.48 to 2.17) | ⊕⊕⊕⊕ HIGH |
| 3.9.2 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males | 1 month after last dose | 1 (Iversen 2016) | 406 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 2.00 (1.66 to 2.41) | ⊕⊕⊕⊕ HIGH |
| 3.10 Seroconversion to HPV16 | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Puthanakit 2016) | 835 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) | |
| 3.10.1 Bivalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Puthanakit 2016) | 835 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) | ⊕⊕⊕⊕ HIGH |
| 3.11 Seroconversion to HPV 18 | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Puthanakit 2016) | 854 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) | |
| 3.11.1 Bivalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 1 month after last dose | 1 (Puthanakit 2016) | 854 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) | ⊕⊕⊕⊕ HIGH |
| 3.12 GMT of HPV 6 (mMU/mL)† | |||||||
| 3.12.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males and females long interval (0, 12 months) | 36 months after first dose | 1 (Iversen 2016) | 246 | Mean GMT (95% CI) | Mean 401.2 (354.8 to 453.7) | |
| 9‐ to 14‐year‐old females short interval (0, 6 months) | 236 | Mean 209.6 (184.9 to 237.6) | |||||
| 9‐ to 14‐year‐old males short interval (0, 6 months) | 254 | Mean 160.1 (141.9 to 180.7) | |||||
| 3.13 GMT of HPV 11 (mMU/mL)† | |||||||
| 3.13.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males and females long interval (0, 12 months) | 36 months after first dose | 1 (Iversen 2016) | 246 | Mean GMT (95% CI) | Mean 308.2 (271.8 to 349.6) | |
| 9‐ to 14‐year‐old females short interval (0, 6 months) | 236 | Mean 133.7 (117.6 to 152.1) | |||||
| 9‐ to 14‐year‐old males short interval (0, 6 months) | 255 | Mean 115.2 (101.8 to 130.3) | |||||
| 3.14 GMT of HPV 16 (mMU/mL)† | |||||||
| 3.14.1 Bivalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 36 months after first dose | 1 (Puthanakit 2016) | 817 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.29 (1.15 to 1.44) | ⊕⊕⊕⊕ HIGH |
| 3.14.3 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males and females long interval (0, 12 months) | 36 months after first dose | 1 (Iversen 2016) | 253 | Mean GMT (95% CI) | Mean 1534.3 (1328.8 to 1771.5) | |
| 9‐ to 14‐year‐old females short interval (0, 6 months) | 263 | Mean 673.8 (582.8 to 779.1) | |||||
| 9‐ to 14‐year‐old males short interval (0, 6 months) | 248 | Mean 592.6 (514.7 to 682.4) | |||||
| 3.15 GMT of HPV 18 (mMU/mL)† | |||||||
| 3.15.1 Bivalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old females | 36 months after first dose | 1 (Puthanakit 2016) | 794 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.43 (1.26 to 1.62) | ⊕⊕⊕⊕ HIGH |
| 3.15.3 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐14 year old males and females long interval (0, 12 months) | 36 months after first dose | 1 (Iversen 2016) | 255 | Mean GMT (95% CI) | Mean 276.4 (245.3 to 311.6) | |
| 9‐ to 14‐year‐old females short interval (0, 6 months) | 248 | Mean 158.9 (140.8 to 179.4) | |||||
| 9‐ to 14‐year‐old males short interval (0, 6 months) | 262 | Mean 141.7 (125.9 to 159.4) | |||||
| 3.16 GMT of HPV 31 (mMU/mL)† | |||||||
| 3.16.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males and females long interval (0, 12 months) | 36 months after first dose | 1 (Iversen 2016) | 257 | Mean GMT (95% CI) | Mean 218.0 (190.6 to 249.4) | |
| 9‐ to 14‐year‐old females short interval (0, 6 months) | 248 | Mean 127.8 (111.4 to 146.5) | |||||
| 9‐ to 14‐year‐old males short interval (0, 6 months) | 261 | Mean 106.9 (93.5 to 122.1) | |||||
| 3.17 GMT of HPV 33 (mMU/mL)† | |||||||
| 3.17.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males and females long interval (0, 12 months) | 36 months after first dose | 1 (Iversen 2016) | 258 | Mean GMT (95% CI) | Mean 240.4 (213.8 to 270.3) | |
| 9‐ to 14‐year‐old females short interval (0, 6 months) | 249 | Mean 106.0 (94.1 to 119.5) | |||||
| 9‐ to 14‐year‐old males short interval (0, 6 months) | 261 | Mean 95.7 (85.1 to 107.5) | |||||
| 3.18 GMT of HPV 45 (mMU/mL)† | |||||||
| 3.18.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males and females long interval (0, 12 months) | 36 months after first dose | 1 (Iversen 2016) | 257 | Mean GMT (95% CI) | Mean 43.6 (38.3 to 49.7) | |
| 9‐ to 14‐year‐old females short interval (0, 6 months) | 250 | Mean 30.6 (26.9 to 35.0) | |||||
| 9‐ to 14‐year‐old males short interval (0, 6 months) | 263 | Mean 26.8 (23.6 to 30.4) | |||||
| 3.19 GMT of HPV 52 (mMU/mL)† | |||||||
| 3.19.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males and females long interval (0, 12 months) | 36 months after first dose | 1 (Iversen 2016) | 257 | Mean GMT (95% CI) | Mean 143.2 (128.3 to 159.9) | |
| 9‐ to 14‐year‐old females short interval (0, 6 months) | 248 | Mean 66.2 (59.1 to 74.0) | |||||
| 9‐ to 14‐year‐old males short interval (0, 6 months) | 263 | Mean 63.4 (56.8 to 70.7) | |||||
| 3.20 GMT of HPV 58 (mMU/mL)† | |||||||
| 3.20.1 Nonavalent vaccine (0 and 6 months) vs (0 and 12 months) | 9‐ to 14‐year‐old males and females long interval (0, 12 months) | 36 months after first dose | 1 (Iversen 2016) | 255 | Mean GMT (95% CI) | Mean 265.3 (234.8 to 299.8) | |
| 9‐ to 14‐year‐old females short interval (0, 6 months) | 246 | Mean 125.8 (111.1 to 142.5) | |||||
| 9‐ to 14‐year‐old males short interval (0, 6 months) | 261 | Mean 119.2 (105.6 to 134.5) |
*Results were stratified into subgroups by type of HPV vaccine, gender, schedule, and time point
†Data for nonavalent vaccine at 36 month follow‐up (Iversen 2016) was not disaggregated for gender, therefore only mean values (95% CI) are presented per group.
1Downgraded one level for imprecision: small sample size
Abbreviations
CI: confidence interval EU: enzyme‐linked immunosorbent assay (ELISA) unit GMT: geometric mean titre HPV: human papillomavirus IV: inverse variance M‐H: Mantel‐Haenszel RR: risk ratio mMU: milli‐Merck unit
Appendix 7. Summary of findings: Longer interval versus shorter interval between second and third doses of quadrivalent HPV vaccine in 18‐ to 25‐year‐old males
|
Patient or population: 18‐ to 25‐year‐old males Settings: community health centres in the USA Intervention: quadrivalent HPV vaccine (3 doses at 0, 2 and 6 months) Comparison: quadrivalent HPV vaccine (3 doses at 0, 2 and 12 months) | |||||
| Outcomes | Anticipated absolute effects* (95% CI) | Relative effect (95% CI) | No of participants (studies) | Certainty of the evidence (GRADE) | |
| Risk with longer interval | Risk with shorter interval | ||||
| Invasive anal or penile cancer | No studies were identified that reported on this outcome | ||||
| Penile or anal intraepithelial neoplasia | No studies were identified that reported on this outcome | ||||
| External genital lesions (any genotype) | No studies were identified that reported on this outcome | ||||
| Overall local/injection site adverse events | Adverse events data not reported separately for each arm | ||||
| Overall systemic events and general symptoms | Adverse events data not reported separately for each arm | ||||
| Serious adverse events at 13‐month follow‐up | 0 per 1000 | 0 per 1000 | Not estimable, no events were reported | 220 (1 study) |
⊕⊝⊝⊝ VERY LOW1,2,3 |
| Mortality | No studies were identified that reported on this outcome | ||||
| *The risk in the intervention group (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval; HPV: human papillomavirus | |||||
| GRADE Working Group grades of evidence High certainty: we are very confident that the true effect lies close to that of the estimate of the effect Moderate certainty: we are moderately confident in the effect estimate: the true effect is likely to be close to the estimate of the effect, but there is a possibility that it is substantially different Low certainty: our confidence in the effect estimate is limited: the true effect may be substantially different from the estimate of the effect Very low certainty: we have very little confidence in the effect estimate: the true effect is likely to be substantially different from the estimate of effect | |||||
Footnotes
1Downgraded one level for risk of bias: allocation concealment was not reported and the trial was open label.
2Downgraded two levels for serious imprecision: no events reported, the study was not powered to detect a difference in serious adverse events.
3Downgraded one level for indirectness: This outcome is a composite measure of events which may or may not be clinically relevant, may or may not be related to the vaccine and may occur outside a biologically plausible time frame relative to vaccine exposure. This outcome is considered to provide indirect evidence about vaccine safety.
Appendix 8. Three doses of HPV vaccine with shorter interval versus three doses of HPV vaccine with longer interval in 18‐ to 25‐year‐old males ‐ immunogenicity outcomes
| Outcome | Follow‐up | Studies | Participants | Statistical method | Effect estimate (95% CI) |
| 7.1 GMT of HPV 6 | 1 month after last dose | 1 (Lin 2014) | 170 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.31 (0.88 to 1.96) |
| 7.2 GMT of HPV 11 | 1 month after last dose | 1 (Lin 2014) | 172 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.83 (1.18 to 2.84) |
| 7.3 GMT of HPV 16 | 1 month after last dose | 1 (Lin 2014) | 173 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.32 (0.90 to 1.93) |
| 7.4 GMT of HPV 18 | 1 month after last dose | 1 (Lin 2014) | 174 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.35 (0.65 to 2.78) |
Abbreviations
CI: confidence interval GMT: geometric mean titre HPV: human papillomavirus IV: inverse variance
Appendix 9. Quadrivalent HPV vaccine compared to control in 16‐ to 26‐year old males ‐ secondary outcomes
| Outcome | Studies | Participants | Statistical method | Effect estimate (95% CI) |
| 4.1 Persistent infection of HPV 6, 11, 16, or 18 | 1 (Giuliano 2011) | 2790 | Rate ratio (IV, random‐effects, 95% CI) | Rate ratio 0.14 (0.08 to 0.26) |
| 4.2 Persistent infection of HPV 6, 11, 16, or 18 | 1 (NCT01862874 2018) | 995 | Rate ratio (IV, random‐effects, 95% CI) | Rate ratio 0.14 (0.04 to 0.47) |
| 4.3 Combined persistent HPV type 6‐, 11‐, 16‐, or 18‐related infection or disease (HPV type 6, 11, 16, or 18‐related condyloma acuminate, penile, perianal, or perineal intraepithelial neoplasia or cancer) | 1 (NCT01862874 2018) | 996 | Rate ratio (IV, random‐effects, 95% CI) | Rate ratio 0.13 (0.04 to 0.45) |
Abbreviations
CI: confidence interval HPV: human papillomavirus IV: inverse variance
Appendix 10. Bivalent HPV vaccine versus control vaccine in 10‐ to 18‐year‐old males ‐ immunogenicity outcomes
| Outcome | Follow‐up | Studies | Participants | Statistical method | Effect estimate (95% CI) |
| 5.1 Seroconversion to HPV 16 | 1 month after last dose | 1 (Petaja 2009) | 10‐ to 18‐year‐old males | RR (M‐H, random‐effects, 95% CI) | RR 55.83 (11.43 to 272.67) |
| 5.2 Seroconversion to HPV 18 | 1 month after last dose | 1 (Petaja 2009) | 10‐ to 18‐year‐old males | RR (M‐H, random‐effects, 95% CI) | RR 34.68 (10.22 to 117.68) |
| 5.3 GMT of HPV 16 | 1 month after last dose | 1 (Petaja 2009) | 10‐ to 18‐year‐old males | SMD (IV, random‐effects, 95% CI) | SMD 1.50 (1.21 to 1.79) |
| 5.4 GMT of HPV 18 | 1 month after last dose | 1 (Petaja 2009) | 10‐ to 18‐year‐old males | SMD (IV, random‐effects, 95% CI) | SMD 1.36 (1.07 to 1.64) |
Abbreviations
CI: confidence interval GMT: geometric mean titre HPV: human papillomavirus IV: inverse variance M‐H: Mantel‐Haenszel RR: risk ratio SMD: standard mean difference
Appendix 11. Nonavalent HPV vaccine versus quadrivalent HPV vaccine in females ‐ secondary outcomes
| Outcome or subgroup* | Follow‐up | Studies | Participants | Statistical method | Effect estimate (95% CI) |
| 2.1 GMT of HPV 6 (mMU/mL) | |||||
| 2.1.1 9‐ to 15‐year olds | 1 month after last dose | 1 (Vesikari 2015) | 534 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.07 (0.93 to 1.24) |
| 2.1.2 16‐ to 26‐year olds | 1 month after last dose | 1 (Joura 2015) | 7968 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.02 (0.99 to 1.06) |
| 2.2 GMT of HPV 11 (mMU/mL) | |||||
| 2.2.1 9‐ to 15‐year olds | 1 month after last dose | 1 (Vesikari 2015) | 534 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.93 (0.80 to 1.08) |
| 2.2.2 16‐ to 26‐year olds | 1 month after last dose | 1 (Joura 2015) | 7977 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.80 (0.77 to 0.83) |
| 2.3 GMT of HPV 16 (mMU/mL) | |||||
| 2.3.1 9‐ to 15‐year olds | 1 month after last dose | 1 (Vesikari 2015) | 546 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.98 (0.85 to 1.12) |
| 2.3.2 16‐ to 26‐year olds | 1 month after last dose | 1 (Joura 2015) | 8094 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.99 (0.96 to 1.03) |
| 2.4 GMT of HPV 18 (mMU/mL) | |||||
| 2.4.1 9‐ to 15‐year olds | 1 month after last dose | 1 (Vesikari 2015) | 545 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.09 (0.91 to 1.31) |
| 2.4.2 16‐ to 26‐year olds | 1 month after last dose | 1 (Joura 2015) | 9080 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.19 (1.14 to 1.23) |
| 2.5 Seroconversion to HPV 6 | 1 month after last dose | 2 (Joura 2015; Vesikari 2015) | 8502 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) |
| 2.5.1 9‐ to 15‐year olds | 1 month after last dose | 1 (Vesikari 2015) | 534 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) |
| 2.5.2 16‐ to 26‐year olds | 1 month after last dose | 1 (Joura 2015) | 7968 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) |
| 2.6 Seroconversion to HPV 11 | 1 month after last dose | 2 (Joura 2015; Vesikari 2015) | 8511 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) |
| 2.6.1 9‐ to 15‐year olds | 1 month after last dose | 1 (Vesikari 2015) | 534 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) |
| 2.6.2 16‐ to 26‐year olds | 1 month after last dose | 1 (Joura 2015) | 7977 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) |
| 2.7 Seroconversion to HPV 16 | 1 month after last dose | 2 (Joura 2015; Vesikari 2015) | 8640 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) |
| 2.7.1 9‐ to 15‐year olds | 1 month after last dose | 1 (Vesikari 2015) | 546 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) |
| 2.7.2 16‐ to 26‐year olds | 1 month after last dose | 1 (Joura 2015) | 8094 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) |
| 2.8 Seroconversion to HPV 18 | 1 month after last dose | 2 (Vesikari 2015; Joura 2015) | 9625 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) |
| 2.8.1 9‐ to 15‐year olds | 1 month after last dose | 1 (Vesikari 2015) | 545 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) |
| 2.8.2 16‐ to 26‐year olds | 1 month after last dose | 1 (Joura 2015) | 9080 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (1.00 to 1.00) |
| 2.9 GMT of HPV 6 (mMU/mL) | |||||
| 2.9.1 16‐ to 26‐year olds | 42 months after first dose | 1 (Joura 2015) | 1367 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.02 (0.92 to 1.13) |
| 2.10 GMT of HPV 11 (mMU/mL) | |||||
| 2.10.1 16‐ to 26‐year olds | 42 months after first dose | 1 (Joura 2015) | 1367 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.82 (0.74 to 0.90) |
| 2.11 GMT of HPV 16 (mMU/mL) | |||||
| 2.11.1 16‐ to 26‐year olds | 42 months after first dose | 1 (Joura 2015) | 1399 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.96 (0.85 to 1.07) |
| 2.12 GMT of HPV 18 (mMU/mL) | |||||
| 2.12.1 16‐ to 26‐year olds | 42 months after first dose | 1 (Joura 2015) | 1576 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.17 (1.03 to 1.33) |
| 2.13 Seropositivity to HPV 6 | |||||
| 2.13.1 16‐ to 26‐year olds | 24 months after first dose | 1 (Joura 2015) | 1404 | RR (M‐H, random‐effects, 95% CI) | RR 1.01 (0.99 to 1.02) |
| 2.14 Seropositivity to HPV 11 | |||||
| 2.14.1 16‐ to 26‐year olds | 24 months after first dose | 1 (Joura 2015) | 1497 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) |
| 2.15 Seropositivity to HPV 16 | |||||
| 2.15.1 16‐ to 26‐year olds | 24 months after first dose | 1 (Joura 2015) | 1536 | RR (M‐H, random‐effects, 95% CI) | RR 1.01 (1.00 to 1.01) |
| 2.16 Seropositivity to HPV 18 | |||||
| 2.16.1 16‐ to 26‐year olds | 24 months after first dose | 1 (Joura 2015) | 1732 | RR (M‐H, random‐effects, 95% CI) | RR 1.07 (1.02 to 1.11) |
| 2.17 6 months' persistent infection of HPV 6, 11, 16, or 18 | median 4 years | 1 (Joura 2015) | 11,642 | RR (M‐H, random‐effects, 95% CI) | RR 0.72 (0.53 to 0.98) |
| 2.18 6 months' persistent infection of HPV 31, 33, 45, 52, or 58 | median 4 years | 1 (Joura 2015) | 11,896 | RR (M‐H, random‐effects, 95% CI) | RR 0.04 (0.03 to 0.06) |
| 2.19 12 months' persistent infection of HPV 6, 11, 16, or 18 | median 4 years | 1 (Joura 2015) | 11,642 | RR (M‐H, random‐effects, 95% CI) | RR 0.72 (0.43 to 1.20) |
| 2.20 12 months' persistent infection of HPV 31, 33, 45, 52, or 58 | median 4 years | 1 (Joura 2015) | 11,896 | RR (M‐H, random‐effects, 95% CI) | RR 0.04 (0.02 to 0.05) |
*Results were stratified into subgroups by age group
Abbreviations
CI: confidence interval GMT: geometric mean titre HPV: human papillomavirus IV: inverse variance M‐H: Mantel‐Haenszel RR: risk ratio mMU: milli‐Merck unit
Appendix 12. Nonavalent HPV vaccine versus quadrivalent HPV vaccine in males ‐ secondary outcomes
| Outcome | Follow‐up | Studies | Participants | Statistical method | Effect estimate (95% CI) |
| 6.1 GMT of HPV 6 | 1 month after last dose | 1 (van Damme 2016) | 454 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.23 (1.03 to 1.45) |
| 6.2 GMT of HPV 11 | 1 month after last dose | 1 (van Damme 2016) | 454 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.89 (0.75 to 1.04) |
| 6.3 GMT of HPV 16 | 1 month after last dose | 1 (van Damme 2016) | 471 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.04 (0.88 to 1.21) |
| 6.4 GMT of HPV 18 | 1 month after last dose | 1 (van Damme 2016) | 470 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 1.12 (0.91 to 1.37) |
| 6.5 GMT of HPV 31 | 1 month after last dose | 1 (van Damme 2016) | 471 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 52.96 (42.69 to 65.71) |
| 6.6 GMT of HPV 33 | 1 month after last dose | 1 (van Damme 2016) | 472 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 135.44 (117.18 to 156.54) |
| 6.7 GMT of HPV 45 | 1 month after last dose | 1 (van Damme 2016) | 468 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 105.16 (887.87 to 125.85) |
| 6.8 GMT of HPV 52 | 1 month after last dose | 1 (van Damme 2016) | 471 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 226.68 (194.71 to 263.90) |
| 6.9 GMT of HPV 58 | 1 month after last dose | 1 (van Damme 2016) | 465 | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 121.23 (101.71 to 144.49) |
| 6.10 Seroconversion to HPV 6 | 1 month after last dose | 1 (van Damme 2016) | 454 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.97 to 1.02) |
| 6.11 Seroconversion to HPV 11 | 1 month after last dose | 1 (van Damme 2016) | 454 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) |
| 6.12 Seroconversion to HPV 16 | 1 month after last dose | 1 (van Damme 2016) | 471 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) |
| 6.13 Seroconversion to HPV 18 | 1 month after last dose | 1 (van Damme 2016) | 470 | RR (M‐H, random‐effects, 95% CI) | RR 1.00 (0.99 to 1.01) |
| 6.14 Seroconversion to HPV 31 | 1 month after last dose | 1 (van Damme 2016) | 471 | RR (M‐H, random‐effects, 95% CI) | RR 1.62 (1.47 to 1.79) |
| 6.15 Seroconversion to HPV 33 | 1 month after last dose | 1 (van Damme 2016) | 472 | RR (M‐H, random‐effects, 95% CI) | RR 5.84 (4.41 to 7.73) |
| 6.16 Seroconversion to HPV 45 | 1 month after last dose | 1 (van Damme 2016) | 468 | RR (M‐H, random‐effects, 95% CI) | RR 10.51 (7.09 to 15.57) |
| 6.17 Seroconversion to HPV 52 | 1 month after last dose | 1 (van Damme 2016) | 471 | RR (M‐H, random‐effects, 95% CI) | RR 36.38 (17.05 to 77.66) |
| 6.18 Seroconversion to HPV 58 | 1 month after last dose | 1 (van Damme 2016) | 465 | RR (M‐H, random‐effects, 95% CI) | RR 2.76 (2.33 to 3.28) |
Abbreviations
CI: confidence interval GMT: geometric mean titre HPV: human papillomavirus IV: inverse variance M‐H: Mantel‐Haenszel RR: risk ratio
Appendix 13. HPV vaccines for people living with HIV ‐ secondary outcomes
| Outcome | Follow‐up | Studies | Participants | Statistical method | Effect estimate (95% CI) | Certainty of the evidence (GRADE) |
| 8.1 GMT of HPV 6 | 1 month after last dose | 1 (Levin 2010) quadrivalent |
114 children with HIV (7 to 12 years old) | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 123.8 (89.0 to 172.1) | ⊕⊕⊝⊝ LOW1,2 |
| 24 months after first dose | 1 (Levin 2010) | 116 children with HIV (7 to 12 years old) | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 50.44 (34.21 to 74.38) | ||
| 8.2 GMT of HPV 11 | 1 month after last dose | 1 (Levin 2010) | 117 children with HIV (7 to 12 years old) | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 330.4 (261.6 to 417.2) | ⊕⊕⊝⊝ LOW1,2 |
| 24 months after first dose | 1 (Levin 2010) | 116 children with HIV (7 to 12 years old) | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 68.75 (49.33 to 95.81) | ||
| 8.3 GMT of HPV 16 | 1 month after last dose | 1 (Levin 2010) | 117 children with HIV (7 to 12 years old) | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 935.8 (724.5 to 1208.7) | ⊕⊕⊝⊝ LOW1,2 |
| 24 months after first dose | 1 (Levin 2010) | 116 children with HIV (7 to 12 years old) | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 189.44 (129.29 to 277.59) | ||
| 8.4 GMT of HPV 18 | 1 month after last dose | 1 (Levin 2010) | 117 children with HIV (7 to 12 years old) | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 189.2 (132.8 to 269.7) | ⊕⊕⊝⊝ LOW1,2 |
| 24 months after first dose | 1 (Levin 2010) | 116 children with HIV (7 to 12 years old) | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 29.57 (18.08 to 48.37) | ||
| 8.5 Seroconversion to HPV 6 | 1 month after last dose | 1 (Levin 2010) | 114 children with HIV (7 to 12 years old) | RR (M‐H, random‐effects, 95% CI) | RR 55.7 (3.6 to 868.4) | ⊕⊕⊝⊝ LOW1,2 |
| 8.6 Seroconversion to HPV 11 | 1 month after last dose | 1 (Levin 2010) | 117 children with HIV (7 to 12 years old) | RR (M‐H, random‐effects, 95% CI) | RR 55.7 (3.6 to 868.6) | ⊕⊕⊝⊝ LOW1,2 |
| 8.7 Seroconversion to HPV 16 | 1 month after last dose | 1 (Levin 2010) | 117 children with HIV (7 to 12 years old) | RR (M‐H, random‐effects, 95% CI) | RR 18.6 (3.9 to 88.1) | ⊕⊕⊝⊝ LOW1,2 |
| 8.8 Seroconversion to HPV 18 | 1 month after last dose | 1 (Levin 2010) | 117 children with HIV (7 to 12 years old) | RR (M‐H, random‐effects, 95% CI) | RR 53.9 (3.5 to 840.0) | ⊕⊕⊝⊝ LOW1,2 |
| 8.9 Seropositivity, HPV 6, 11, 16, 18 | 1 month after last dose | 1 (Hidalgo‐Tenorio 2017) | 128 HIV‐infected MSM (≥ 18 years old) | RR (M‐H, random‐effects, 95% CI) | RR 2.47 (1.66 to 3.68) | ⊕⊕⊕⊝ MODERATE1 |
| 8.10 GMT of HPV 16 | 1 month after last dose | 1 (Toft 2014) | 40 HIV‐infected males and females | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.79 (0.25 to 2.52) | ⊕⊕⊝⊝ LOW3 |
| 6 months after last dose | 1 (Toft 2014) | 40 HIV‐infected males and females | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.67 (0.21 to 2.08) | ⊕⊕⊝⊝ LOW3 | |
| 8.11 GMT of HPV 18 | 1 month after last dose | 1 (Toft 2014) | 39 HIV‐infected males and females | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.13 (0.04 to 0.41) | ⊕⊕⊕⊝ MODERATE1 |
| six months after last dose | 1 (Toft 2014) | 39 HIV‐infected males and females | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 0.52 (0.16 to 1.76) | ⊕⊕⊝⊝ LOW3 | |
| 8.12 Seropositivity at 12 months, HPV 16 | 6 months after last dose | 1 (Toft 2014) | 91 HIV‐infected males and females | RR (M‐H, random‐effects, 95% CI) | RR 0.96 (0.89 to 1.03) | ⊕⊕⊕⊝ MODERATE1 |
| 8.13 Seropositivity at 12 months, HPV 18 | 6 months after last dose | 1 (Toft 2014) | 91 HIV‐infected males and females | RR (M‐H, random‐effects, 95% CI) | RR 0.76 (0.63 to 0.90) | ⊕⊕⊕⊝ MODERATE1 |
| 8.14 Persistent anal infection (HPV 6, 11, 16, 18) | 1 month after last dose | 1 (Wilkin 2018) | 575 HIV‐positive males and females | RR (M‐H, random‐effects, 95% CI) | RR 0.81 (0.41 to 1.62) | ⊕⊕⊕⊝ MODERATE4 |
| 8.16 GMT of HPV 16 | 1 month after last dose | 1 (Denny 2013) | 82 HIV‐positive females | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 131.73 (80.57 to 215.39) | ⊕⊕⊕⊝ MODERATE1 |
| 12 months after first dose | 1 (Denny 2013) | 78 HIV‐positive females | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 36.14 (21.42 to 60.97) | ||
| 8.17 GMT of HPV 18 | 1 month after last dose | 1 (Denny 2013) | 83 HIV‐positive females | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 134.63 (79.88 to 226.89) | ⊕⊕⊕⊝ MODERATE1 |
| 12 months after first dose | 1 (Denny 2013) | 79 HIV‐positive females | Ratio of GMTs (IV, random‐effects, 95% CI) | Ratio of GMTs 26.39 (15.32 to 45.48) | ||
| 8.18 Seroconversion to HPV 16 | 12 months after first dose | 1 (Denny 2013) | 79 HIV‐positive females | RR (M‐H, random‐effects, 95% CI) | RR 1.29 (1.07 to 1.56) | ⊕⊕⊕⊝ MODERATE1 |
| 8.19 Seroconversion to HPV 18 | 12 months after first dose | 1 (Denny 2013) | 79 HIV‐positive females | RR (M‐H, random‐effects, 95% CI) | RR 1.53 (1.21 to 1.95) | ⊕⊕⊕⊝ MODERATE1 |
*Results were stratified into subgroups by type of HPV vaccine and gender
1Downgraded one level for imprecision: small sample size.
2Downgraded one level for risk of bias: details about how randomisation sequence was generated or how blinding was achieved were not reported.
3Downgraded two levels for imprecision: small sample size and very wide 95% confidence interval that incorporates a potential large beneficial effect and a potential large harmful effect.
4Downgraded one level for imprecision: wide 95% confidence interval that incorporates a potential beneficial effect and a potential harmful effect.
Abbreviations
CI: confidence interval GMT: geometric mean titre HPV: human papillomavirus IV: inverse variance M‐H: Mantel‐Haenszel RR: risk ratio
Appendix 14. Sensitivity analysis using Peto odds ratio for outcomes with very rare events
| Analysis number, outcome (subgroup) | Studies | Participants | Odds ratio (M‐H, random‐effects model, 95% CI) | Peto odds ratio (Peto, fixed‐effect model, 95% CI) |
| 1.5.3 Deaths (nonavalent vaccine) | 1 | 602 | 0.33 (0.01 to 8.19) | 0.14 (0.00 to 6.82) |
| 4.12 Serious adverse events (overall) | 2 | 5162 | 0.69 (0.29 to 1.66) | 0.67 (0.28 to 1.62) |
| 4.13 Deaths | 2 | 5173 | 0.30 (0.09 to 1.01) | 0.32 (0.11 to 0.91) |
| 6.2 High‐grade cervical disease related to HPV 6 to 11, 16, or 18 | 1 | 11,656 | 1.00 (0.06 to 16.01) | 1.00 (0.06 to 16.01) |
| 6.3 High‐grade vulval and vaginal disease related to HPV 6, 11, 16, or 18 | 1 | 11,769 | 0.14 (0.01 to 2.77) | 0.14 (0.01 to 1.30) |
| 6.4 High‐grade cervical disease related to HPV 31, 33, 45, 52, or 58 | 1 | 11,892 | 0.03 (0.00 to 0.21) | 0.15 (0.08 to 0.29) |
| 6.5 High‐grade vulval and vaginal disease related to HPV 31, 33, 45, 52, or 58 | 1 | 12,021 | 0.14 (0.01 to 2.77) | 0.14 (0.01 to 1.30) |
| 6.7 Cervical intraepithelial neoplasia 2 related to HPV 6, 11, 16, or 18 | 1 | 11,656 | 3.00 (0.12 to 73.77) | 7.40 (0.15 to 373.90) |
| 6.8 Cervical intraepithelial neoplasia 2 related to HPV 31, 33, 45, 52, or 58 | 1 | 11,892 | 0.03 (0.00 to 0.23) | 0.15 (0.08 to 0.30) |
| 6.9 Cervical intraepithelial neoplasia 3, adenocarcinoma in situ, and cervical cancer related to HPV 6, 11, 16, or 18 | 1 | 11,656 | 0.33 (0.01 to 8.19) | 0.14 (0.00 to 6.83) |
| 6.10 Cervical intraepithelial neoplasia 3, adenocarcinoma in situ, and cervical cancer related to HPV 31, 33, 45, 52, or 58 | 1 | 11,892 | 0.07 (0.00 to 1.16) | 0.14 (0.03 to 0.59) |
| 6.17.2 Deaths (16‐ to 26‐ year olds) | 1 | 14,149 | 1.00 (0.29 to 3.46) | 1.00 (0.29 to 3.46) |
| 8.2 Overall systemic events and general symptoms | 1 | 126 | 0.62 (0.05 to 7.05) | 0.59 (0.04 to 8.54) |
Abbreviations
CI: confidence interval HPV: human papillomavirus M‐H: Mantel‐Haenszel
Data and analyses
Comparison 1. Two versus three doses of HPV vaccines in 9‐ to 15‐year‐old females.
| Outcome or subgroup title | No. of studies | No. of participants | Statistical method | Effect size |
|---|---|---|---|---|
| 1 Pain at injection site | 2 | 1189 | Risk Ratio (M‐H, Random, 95% CI) | 0.96 [0.91, 1.03] |
| 1.1 Bivalent vaccine | 1 | 476 | Risk Ratio (M‐H, Random, 95% CI) | 0.99 [0.94, 1.03] |
| 1.2 Quadrivalent vaccine | 1 | 713 | Risk Ratio (M‐H, Random, 95% CI) | 0.93 [0.87, 1.00] |
| 2 Swelling at injection site | 2 | 1189 | Risk Ratio (M‐H, Random, 95% CI) | 0.76 [0.65, 0.89] |
| 2.1 Bivalent vaccine | 1 | 476 | Risk Ratio (M‐H, Random, 95% CI) | 0.70 [0.57, 0.87] |
| 2.2 Quadrivalent vaccine | 1 | 713 | Risk Ratio (M‐H, Random, 95% CI) | 0.83 [0.66, 1.04] |
| 3 Redness at injection site | 2 | 1189 | Risk Ratio (M‐H, Random, 95% CI) | 0.85 [0.75, 0.96] |
| 3.1 Bivalent vaccine | 1 | 476 | Risk Ratio (M‐H, Random, 95% CI) | 0.85 [0.72, 0.99] |
| 3.2 Quadrivalent vaccine | 1 | 713 | Risk Ratio (M‐H, Random, 95% CI) | 0.85 [0.71, 1.02] |
| 4 Serious adverse events (overall) | 4 | 2317 | Odds Ratio (M‐H, Random, 95% CI) | 1.03 [0.64, 1.66] |
| 4.1 Bivalent vaccine | 1 | 479 | Odds Ratio (M‐H, Random, 95% CI) | 1.28 [0.64, 2.59] |
| 4.2 Quadrivalent vaccine | 2 | 1236 | Odds Ratio (M‐H, Random, 95% CI) | 0.78 [0.35, 1.74] |
| 4.3 Nonavalent vaccine | 1 | 602 | Odds Ratio (M‐H, Random, 95% CI) | 1.0 [0.32, 3.14] |
| 5 Deaths | 3 | 1797 | Odds Ratio (M‐H, Random, 95% CI) | 0.33 [0.01, 8.19] |
| 5.1 Bivalent vaccine | 1 | 479 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
| 5.2 Quadrivalent vaccine | 1 | 716 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
| 5.3 Nonavalent vaccine | 1 | 602 | Odds Ratio (M‐H, Random, 95% CI) | 0.33 [0.01, 8.19] |
Comparison 2. Two doses of HPV vaccine with longer interval versus two doses of HPV vaccine with shorter interval in 9‐ to 14‐year‐olds.
| Outcome or subgroup title | No. of studies | No. of participants | Statistical method | Effect size |
|---|---|---|---|---|
| 1 Pain at injection site | 2 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 1.1 Bivalent vaccine (0 and 2 months vs 0 and 6 months) | 1 | 477 | Risk Ratio (M‐H, Random, 95% CI) | 1.01 [0.96, 1.06] |
| 1.2 Bivalent vaccine (0 and 6 months vs 0 and 12 months) | 1 | 963 | Risk Ratio (M‐H, Random, 95% CI) | 1.02 [0.98, 1.06] |
| 2 Swelling at injection site | 2 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 2.1 Bivalent vaccine (0 and 2 months vs 0 and 6 months) | 1 | 477 | Risk Ratio (M‐H, Random, 95% CI) | 0.95 [0.76, 1.20] |
| 2.2 Bivalent vaccine (0 and 6 months vs 0 and 12 months) | 1 | 963 | Risk Ratio (M‐H, Random, 95% CI) | 1.01 [0.87, 1.18] |
| 3 Redness at injection site | 2 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 3.1 Bivalent vaccine (0 and 2 months vs 0 and 6 months) | 1 | 477 | Risk Ratio (M‐H, Random, 95% CI) | 1.02 [0.84, 1.24] |
| 3.2 Bivalent vaccine (0 and 6 months vs 0 and 12 months) | 1 | 963 | Risk Ratio (M‐H, Random, 95% CI) | 1.06 [0.93, 1.22] |
| 4 Serious adverse events (overall) | 3 | Odds Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 4.1 Bivalent vaccine (0, 2 months vs 0, 6 months) | 1 | 481 | Odds Ratio (M‐H, Random, 95% CI) | 1.15 [0.55, 2.41] |
| 4.2 Bivalent vaccine (0 and 6 months vs 0 and 12 months) | 1 | 965 | Odds Ratio (M‐H, Random, 95% CI) | 1.63 [0.89, 2.99] |
| 4.3 Nonavalent vaccine (0 and 6 months vs 0 and 12 months) ‐ females and males | 1 | 903 | Odds Ratio (M‐H, Random, 95% CI) | 0.80 [0.31, 2.07] |
| 5 Deaths | 3 | Odds Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 5.1 Bivalent vaccine (0 and 2 months vs 0 and 6 months) | 1 | 481 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
| 5.2 Bivalent vaccine (0 and 6 months vs 0 and 12 months) | 1 | 965 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
| 5.3 Nonavalent vaccine (0 and 6 months vs 0 and 12 months) | 1 | 452 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
Comparison 3. Three doses of HPV vaccine with longer interval versus three doses of HPV vaccine with shorter interval in 18‐ to 25‐year‐old males.
| Outcome or subgroup title | No. of studies | No. of participants | Statistical method | Effect size |
|---|---|---|---|---|
| 1 Adverse events | Other data | No numeric data | ||
| 2 Serious adverse events (overall) | 1 | 220 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
Comparison 4. HPV vaccine versus control in males.
| Outcome or subgroup title | No. of studies | No. of participants | Statistical method | Effect size |
|---|---|---|---|---|
| 1 External genital lesions (any type) | 1 | Rate Ratio (Random, 95% CI) | Subtotals only | |
| 1.1 Quadrivalent vaccine (16‐ to 26‐year olds) | 1 | Rate Ratio (Random, 95% CI) | 0.16 [0.07, 0.38] | |
| 2 External genital lesions (HPV 6, 11, 16, or 18) | 1 | Rate Ratio (Random, 95% CI) | Subtotals only | |
| 2.1 Quadrivalent vaccine (16‐ to 26‐year olds) | 1 | Rate Ratio (Random, 95% CI) | 0.10 [0.03, 0.31] | |
| 3 Anogenital warts | 1 | Rate Ratio (Random, 95% CI) | Subtotals only | |
| 3.1 Quadrivalent vaccine (16‐ to 26‐year olds) | 1 | Rate Ratio (Random, 95% CI) | 0.11 [0.03, 0.38] | |
| 4 All penile, perianal, or perineal intraepithelial neoplasia lesions | 1 | Rate Ratio (Random, 95% CI) | Subtotals only | |
| 4.1 Quadrivalent vaccine (16‐ to 26‐year olds) | 1 | Rate Ratio (Random, 95% CI) | 0.17 [0.01, 3.27] | |
| 5 Penile, perianal, or perineal intraepithelial neoplasia grade 1 | 1 | Rate Ratio (Random, 95% CI) | Subtotals only | |
| 5.1 Quadrivalent vaccine (16‐ to 26‐year olds) | 1 | Rate Ratio (Random, 95% CI) | 0.25 [0.01, 6.22] | |
| 6 Penile, perianal, or perineal intraepithelial neoplasia grade 2 or 3 | 1 | Rate Ratio (Random, 95% CI) | Subtotals only | |
| 6.1 Quadrivalent vaccine (16‐ to 26‐year olds) | 1 | Rate Ratio (Random, 95% CI) | 0.50 [0.02, 14.80] | |
| 7 Overall local/injection site adverse events | 1 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 7.1 Quadrivalent vaccine (16‐ to 26‐year olds) | 1 | 3895 | Risk Ratio (M‐H, Random, 95% CI) | 1.12 [1.06, 1.18] |
| 8 Pain at injection site | 3 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 8.1 Bivalent vaccine (10‐ to 18‐year‐olds) | 1 | 268 | Risk Ratio (M‐H, Random, 95% CI) | 1.99 [1.57, 2.53] |
| 8.2 Quadrivalent vaccine (16‐ to 26‐year olds) | 2 | 5162 | Risk Ratio (M‐H, Random, 95% CI) | 1.13 [1.07, 1.19] |
| 9 Swelling at injection site | 3 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 9.1 Bivalent vaccine (10‐ to 18‐year‐olds) | 1 | 268 | Risk Ratio (M‐H, Random, 95% CI) | 2.51 [1.17, 5.42] |
| 9.2 Quadrivalent vaccine (16‐ to 26‐year olds) | 2 | 5162 | Risk Ratio (M‐H, Random, 95% CI) | 1.29 [1.04, 1.60] |
| 10 Redness at injection site | 3 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 10.1 Bivalent vaccine (10‐ to 18‐year‐olds) | 1 | 268 | Risk Ratio (M‐H, Random, 95% CI) | 1.66 [0.99, 2.79] |
| 10.2 Quadrivalent vaccine (16‐ to 26‐year olds) | 2 | 5162 | Risk Ratio (M‐H, Random, 95% CI) | 1.12 [0.99, 1.27] |
| 11 Overall systemic events and general symptoms | 2 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 11.1 Quadrivalent vaccine (16‐ to 26‐year olds) | 2 | 5008 | Risk Ratio (M‐H, Random, 95% CI) | 0.99 [0.90, 1.08] |
| 12 Serious adverse events (overall) | 3 | Odds Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 12.1 Bivalent vaccine (10‐ to 18‐year‐olds) | 1 | 270 | Odds Ratio (M‐H, Random, 95% CI) | 1.48 [0.15, 14.46] |
| 12.2 Quadrivalent vaccine (16‐ to 26‐year olds) | 2 | 5162 | Odds Ratio (M‐H, Random, 95% CI) | 0.69 [0.29, 1.66] |
| 13 Deaths | 3 | Odds Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 13.1 Bivalent vaccine (10‐ to 18‐year‐olds) | 1 | 270 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
| 13.2 Quadrivalent vaccine (16‐ to 26‐year olds) | 2 | 5173 | Odds Ratio (M‐H, Random, 95% CI) | 0.30 [0.09, 1.01] |
Comparison 5. Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds.
| Outcome or subgroup title | No. of studies | No. of participants | Statistical method | Effect size |
|---|---|---|---|---|
| 1 High‐grade cervical epithelial neoplasia, adenocarcinoma in situ, and cervical cancer | 1 | 13753 | Odds Ratio (M‐H, Random, 95% CI) | 1.00 [0.85, 1.16] |
| 2 High‐grade cervical, vulval, and vaginal disease | 1 | 14054 | Odds Ratio (M‐H, Random, 95% CI) | 0.99 [0.85, 1.15] |
| 3 High‐grade cervical disease related to HPV 6, 11, 16, or 18 | 1 | 11656 | Odds Ratio (M‐H, Random, 95% CI) | 1.00 [0.06, 16.01] |
| 4 High‐grade vulval and vaginal disease related to HPV 6, 11, 16, or 18 | 1 | 11769 | Odds Ratio (M‐H, Random, 95% CI) | 0.14 [0.01, 2.77] |
| 5 High‐grade cervical disease related to HPV 31, 33, 45, 52, or 58 | 1 | 11892 | Odds Ratio (M‐H, Random, 95% CI) | 0.03 [0.00, 0.21] |
| 6 High‐grade vulval and vaginal disease related to HPV 31, 33, 45, 52, or 58 | 1 | 12021 | Odds Ratio (M‐H, Random, 95% CI) | 0.14 [0.01, 2.77] |
| 7 Cervical intraepithelial neoplasia 2 related to HPV 6, 11, 16, or 18 | 1 | 11656 | Odds Ratio (M‐H, Random, 95% CI) | 3.00 [0.12, 73.77] |
| 8 Cervical intraepithelial neoplasia 2 related to HPV 31, 33, 45, 52, or 58 | 1 | 11892 | Odds Ratio (M‐H, Random, 95% CI) | 0.03 [0.00, 0.23] |
| 9 Cervical intraepithelial neoplasia 3, adenocarcinoma in situ, and cervical cancer related to HPV 6, 11, 16, or 18 | 1 | 11656 | Odds Ratio (M‐H, Random, 95% CI) | 0.33 [0.01, 8.19] |
| 10 Cervical intraepithelial neoplasia 3, adenocarcinoma in situ, and cervical cancer related to HPV 31, 33, 45, 52, or 58 | 1 | 11892 | Odds Ratio (M‐H, Random, 95% CI) | 0.07 [0.00, 1.16] |
| 11 Overall local/injection site adverse events | 3 | 15863 | Risk Ratio (M‐H, Random, 95% CI) | 1.07 [1.05, 1.08] |
| 11.1 9‐ to 15‐year‐old females | 1 | 599 | Risk Ratio (M‐H, Random, 95% CI) | 1.04 [0.98, 1.09] |
| 11.2 16‐ to 26‐year‐old females | 1 | 14764 | Risk Ratio (M‐H, Random, 95% CI) | 1.07 [1.05, 1.08] |
| 11.3 16‐ to 26‐year‐old males | 1 | 500 | Risk Ratio (M‐H, Random, 95% CI) | 1.10 [1.00, 1.22] |
| 12 Pain at injection site | 3 | 15863 | Risk Ratio (M‐H, Random, 95% CI) | 1.06 [1.02, 1.11] |
| 12.1 9‐ to 15‐year‐old females | 1 | 599 | Risk Ratio (M‐H, Random, 95% CI) | 1.01 [0.96, 1.07] |
| 12.2 16‐ to 26‐year‐old females | 1 | 14764 | Risk Ratio (M‐H, Random, 95% CI) | 1.07 [1.06, 1.09] |
| 12.3 16‐ to 26‐year‐old males | 1 | 500 | Risk Ratio (M‐H, Random, 95% CI) | 1.12 [1.01, 1.24] |
| 13 Swelling at injection site | 3 | 15863 | Risk Ratio (M‐H, Random, 95% CI) | 1.37 [1.31, 1.44] |
| 13.1 9‐ to 15‐year‐old females | 1 | 599 | Risk Ratio (M‐H, Random, 95% CI) | 1.33 [1.10, 1.60] |
| 13.2 16‐ to 26‐year‐old females | 1 | 14764 | Risk Ratio (M‐H, Random, 95% CI) | 1.38 [1.31, 1.44] |
| 13.3 16‐ to 26‐year‐old males | 1 | 500 | Risk Ratio (M‐H, Random, 95% CI) | 1.58 [0.96, 2.58] |
| 14 Redness at injection site | 3 | 15863 | Risk Ratio (M‐H, Random, 95% CI) | 1.20 [1.00, 1.44] |
| 14.1 9‐ to 15‐year‐old females | 1 | 599 | Risk Ratio (M‐H, Random, 95% CI) | 1.16 [0.92, 1.47] |
| 14.2 16‐ to 26‐year‐old females | 1 | 14764 | Risk Ratio (M‐H, Random, 95% CI) | 1.32 [1.26, 1.39] |
| 14.3 16‐ to 26‐year‐old males | 1 | 500 | Risk Ratio (M‐H, Random, 95% CI) | 0.89 [0.60, 1.33] |
| 15 Overall systemic events and general symptoms | 3 | 15863 | Risk Ratio (M‐H, Random, 95% CI) | 1.01 [0.98, 1.04] |
| 15.1 9‐ to 15‐year‐old females | 1 | 599 | Risk Ratio (M‐H, Random, 95% CI) | 0.91 [0.78, 1.07] |
| 15.2 16‐ to 26‐year‐old females | 1 | 14764 | Risk Ratio (M‐H, Random, 95% CI) | 1.01 [0.98, 1.04] |
| 15.3 16‐ to 26‐year‐old males | 1 | 500 | Risk Ratio (M‐H, Random, 95% CI) | 1.02 [0.82, 1.26] |
| 16 Serious adverse events (overall) | 3 | 15863 | Odds Ratio (M‐H, Random, 95% CI) | 0.60 [0.14, 2.61] |
| 16.1 9‐ to 15‐year‐old females | 1 | 599 | Odds Ratio (M‐H, Random, 95% CI) | 0.5 [0.05, 5.54] |
| 16.2 16‐ to 26‐year‐old females | 1 | 14764 | Odds Ratio (M‐H, Random, 95% CI) | 1.22 [1.00, 1.48] |
| 16.3 16‐ to 26‐year‐old males | 1 | 500 | Odds Ratio (M‐H, Random, 95% CI) | 0.08 [0.00, 1.35] |
| 17 Deaths | 3 | 15248 | Odds Ratio (M‐H, Random, 95% CI) | 1.20 [0.37, 3.94] |
| 17.1 9‐ to 15‐year old females | 1 | 599 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
| 17.2 16‐ to 26‐year‐old females | 1 | 14149 | Odds Ratio (M‐H, Random, 95% CI) | 1.20 [0.37, 3.94] |
| 17.3 16‐ to 26‐year‐old males | 1 | 500 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
5.3. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 3 High‐grade cervical disease related to HPV 6, 11, 16, or 18.
5.4. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 4 High‐grade vulval and vaginal disease related to HPV 6, 11, 16, or 18.
5.6. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 6 High‐grade vulval and vaginal disease related to HPV 31, 33, 45, 52, or 58.
5.12. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 12 Pain at injection site.
5.13. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 13 Swelling at injection site.
5.14. Analysis.

Comparison 5 Nonavalent HPV vaccine versus quadrivalent HPV vaccine in 9‐ to 26‐year‐olds, Outcome 14 Redness at injection site.
Comparison 6. Quadrivalent HPV vaccine versus control in people living with HIV.
| Outcome or subgroup title | No. of studies | No. of participants | Statistical method | Effect size |
|---|---|---|---|---|
| 1 High‐grade anal intraepithelial neoplasia | 1 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 1.1 ≥ 27‐year‐old females and males with HIV | 1 | 574 | Risk Ratio (M‐H, Random, 95% CI) | 1.02 [0.70, 1.48] |
| 2 Recurrence of anogenital warts | 1 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 2.1 18‐ to 65‐year‐old females and males with HIV treated for anogenital warts | 1 | 12 | Risk Ratio (M‐H, Random, 95% CI) | 0.71 [0.06, 8.90] |
| 3 Abnormal anal cytology | 1 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 3.1 ≥ 27‐year‐old females and males with HIV | 1 | 262 | Risk Ratio (M‐H, Random, 95% CI) | 0.82 [0.64, 1.05] |
| 4 Overall local/injection site adverse events | 1 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 4.1 7‐ to 12‐year‐old children with HIV | 1 | 126 | Risk Ratio (M‐H, Random, 95% CI) | 2.19 [0.70, 6.83] |
| 5 Overall systemic event and general symptoms | 1 | Odds Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 5.1 7‐ to 12‐year‐old children with HIV | 1 | 126 | Odds Ratio (M‐H, Random, 95% CI) | 0.62 [0.05, 7.05] |
| 6 Serious adverse events (overall) | 2 | Odds Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 6.1 ≥ 27 year old females and males with HIV | 1 | 575 | Odds Ratio (M‐H, Random, 95% CI) | 0.68 [0.42, 1.10] |
| 6.2 ≥ 18‐year‐old MSM with HIV | 1 | 129 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
| 7 Deaths | 2 | Odds Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 7.1 ≥ 27‐year‐old females and males with HIV | 1 | 575 | Odds Ratio (M‐H, Random, 95% CI) | 0.49 [0.12, 1.99] |
| 7.2 ≥ 18‐year‐old MSM with HIV | 1 | 129 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
Comparison 7. Bivalent HPV vaccine versus control in 18‐ to 25‐year‐old females with HIV.
| Outcome or subgroup title | No. of studies | No. of participants | Statistical method | Effect size |
|---|---|---|---|---|
| 1 Pain at injection site | 1 | 120 | Risk Ratio (M‐H, Random, 95% CI) | 1.86 [1.38, 2.51] |
| 2 Swelling at injection site | 1 | 120 | Risk Ratio (M‐H, Random, 95% CI) | 9.19 [2.24, 37.73] |
| 3 Serious adverse events (overall) | 1 | 120 | Odds Ratio (M‐H, Random, 95% CI) | 1.47 [0.24, 9.15] |
| 4 Deaths | 1 | 120 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
Comparison 8. Bivalent HPV vaccine versus quadrivalent HPV vaccine in people living with HIV.
| Outcome or subgroup title | No. of studies | No. of participants | Statistical method | Effect size |
|---|---|---|---|---|
| 1 Overall local/injection site adverse events | 1 | Risk Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 1.1 ≥ 18‐year‐old females and males with HIV | 1 | 92 | Risk Ratio (M‐H, Random, 95% CI) | 1.31 [1.06, 1.62] |
| 2 Serious adverse events (overall) | 2 | Odds Ratio (M‐H, Random, 95% CI) | Subtotals only | |
| 2.1 ≥ 18‐year‐old females and males with HIV | 1 | 92 | Odds Ratio (M‐H, Random, 95% CI) | 0.0 [0.0, 0.0] |
| 2.2 15‐ to 25‐year‐old females with HIV | 1 | 332 | Odds Ratio (M‐H, Random, 95% CI) | 0.99 [0.38, 2.55] |
Characteristics of studies
Characteristics of included studies [ordered by study ID]
Denny 2013.
| Methods | Phase I/II, partially‐blind, partially‐randomised, placebo‐controlled trial | |
| Participants | Participants: 120 HIV‐positive women (61 in bivalent vaccine group and 59 in control group) in South Africa Age range: 18–25 years Inclusion criteria: women with an intact cervix who reported no more than 6 lifetime sexual partners and whom the investigator believed would comply with the protocol requirements. Sexually active women had to have a normal colposcopy and normal cervical cytology or no worse than atypical squamous cells of undetermined significance at the screening visit. All women had to be willing to undergo HIV counselling and testing and to be informed of their HIV status. |
|
| Interventions | Vaccine: bivalent HPV vaccine; 3 doses: day 0, month 1, month 6 Control: aluminium adjuvant placebo (aluminium hydroxide (Al(OH)3)); 3 doses: day 0, month 1, month 6 |
|
| Outcomes | Harms: adverse events Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: 30 HIV‐negative women were enrolled as a control group and received bivalent HPV vaccine Last report average follow‐up time: 12 months Funding: GlaxoSmithKline Biologicals SA. The study sponsor designed the study in collaboration with the investigators, and co‐ordinated collection, analysis, and interpretation of data. Trial ID: NCT00586339. |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Centralised, Internet‐based randomisation system |
| Allocation concealment (selection bias) | Low risk | Centralised, Internet‐based randomisation system |
| Blinding of participants and personnel (performance bias) All outcomes | Unclear risk | Participants were blinded to allocation. No clear statement presented regarding blinding of personnel or outcome assessors. |
| Blinding of outcome assessment (detection bias) All outcomes | Unclear risk | Participants were blinded to allocation. No clear statement presented regarding blinding of personnel or outcome assessors. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Most analysis per protocol, but baseline data on full cohort provided, data on withdrawals and reasons for withdrawing also provided. |
| Selective reporting (reporting bias) | Low risk | No reasons to suspect that reporting was selective. Clinical trial record checked. |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Dobson 2013.
| Methods | Phase III, open‐label, non‐inferiority, controlled, randomised, multi‐centre trial | |
| Participants | Participants: 520 women and young girls (259 to 2‐dose quadrivalent HPV vaccine and 261 to 3‐dose quadrivalent HPV vaccine) recruited from 3 Canadian provincial centres Age range: girls aged 9‐13 years, young women aged 16‐26 years Inclusion criteria: healthy participants 9‐13 years of age (girls) or 16‐26 years of age (young women), with 4 or fewer lifetime sexual partners |
|
| Interventions | Vaccine 1: quadrivalent HPV vaccine; 2 doses: day 1, month 6 Vaccine 2: quadrivalent HPV vaccine; 3 doses: day 1, month 2, month 6 |
|
| Outcomes | Harms: adverse events Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: in our analyses we did not include the cohort of 16‐26‐year‐old women that were not randomised within the trial Last report average follow‐up time: 36 months Funding: Ministries of Health in the provinces of British Columbia, Nova Scotia, and Quebec. Merck Laboratories Inc conducted the antibody assays at no cost to the study. Merck had no role in the design or conduct of the study; collection, management, analysis, or interpretation of the data; or preparation, review, or approval of the manuscript. Trial ID: NCT00501137 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Girls were randomised (1:1) in balanced, stratified blocks of 6 to receive either 2 doses (at 0 and 6 months) or 3 doses (at 0, 2, and 6 months). The co‐ordinating centre used SAS, version 9.2 (SAS Institute Inc) to generate randomisation lists for each site. |
| Allocation concealment (selection bias) | Low risk | Co‐ordinating centre generated randomisation sequence and allocated girls. |
| Blinding of participants and personnel (performance bias) All outcomes | High risk | Impossible to blind girls as to whether they were randomised to 2 or 3 doses; the young women were not randomised, all receiving 3 doses. |
| Blinding of outcome assessment (detection bias) All outcomes | Low risk | Laboratory staff, blinded to group assignment, conducted the HPV antibody assays. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data were reported for both ITT and per protocol populations, with full information on exclusions and withdrawals. |
| Selective reporting (reporting bias) | Low risk | The primary interest was in the per‐protocol population; however, the results presented were the ITT population because these results could be generalised more readily. |
| Other bias | Low risk | No other bias apparent |
Giuliano 2011.
| Methods | Phase III, double‐blind, parallel, placebo‐controlled, randomised and multi‐site trial | |
| Participants | Participants: 4065 boys and men (2032 to the vaccine group and 2033 to the control group) recruited from 18 countries in five regions (Africa, Asia‐Pacific, Europe, Latin America, North America) Age range: 16‐26 years Inclusion criteria: heterosexual males 16‐23 years old with between 1‐5 lifetime female sexual partners, plus males who have sex with male partners 16‐26 years old with 1‐5 lifetime male or female partners |
|
| Interventions | Vaccine: quadrivalent HPV vaccine; 3 doses: day 1, month 2, month 6 Control: aluminium adjuvant placebo (amorphous aluminium hydroxy‐phosphate sulphate (AAHS)); 3 doses: day 1, month 2, month 6 |
|
| Outcomes | Clinical: external genital lesions; penile, perianal, or perineal intraepithelial neoplasia; or penile, perianal, or perineal cancer Harms: adverse events, deaths Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: N/A Last report average follow‐up time: 36 months Funding: Merck, in collaboration with external investigators and an external data and safety monitoring board. The sponsor co‐designed the trial, collated the data, monitored the conduct of the trial, performed statistical analyses, and co‐ordinated the writing of the manuscript with all the authors. Trial ID: NCT00090285 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | A computer‐generated allocation schedule was produced by the sponsor. Following informed consent and determination that all entry criteria were met, eligible subjects were randomised to a vaccination group. (Hillman 2012, companion paper) |
| Allocation concealment (selection bias) | Low risk | Following informed consent and determination that all entry criteria were met, eligible subjects were randomised to a vaccination group. All investigators and site personnel, subjects, monitors, and laboratory personnel remained blinded to treatment allocation throughout the study. Staff of the sponsor were blinded from the study onset through the database lock for this analysis. (Hillman 2012, companion paper) |
| Blinding of participants and personnel (performance bias) All outcomes | Low risk | Quote: "visually indistinguishable AAHS‐containing placebo"; All investigators and site personnel, subjects, monitors, and laboratory personnel remained blinded to treatment allocation throughout the study. Staff of the sponsor were blinded from the study onset through the database lock for this analysis. (Hillman 2012) |
| Blinding of outcome assessment (detection bias) All outcomes | Low risk | All biopsy specimens were processed independently to prevent contamination of HPV DNA and were assessed in a blinded fashion, first for the purpose of clinical management by pathologists at the central laboratory (Diagnostic Cytology Laboratories) and then for end‐point adjudication by a 4‐member panel of pathologists. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data reported adequately. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective ‐ clinical trial registry checked. |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Hidalgo‐Tenorio 2017.
| Methods | Randomised, double blind, placebo‐controlled trial | |
| Participants | Participants: 129 HIV‐positive men who have sex with men (66 received quadrivalent HPV vaccine and 63 received control) recruited from the Infectious Diseases Service in Spain Age range: ≥18 years of age Inclusion criteria: participants not infected simultaneously by the 4 genotypes of HPV that the quadrivalent vaccine addresses; with a normal high‐resolution anoscopy at screening for inclusion, or with only condylomas or low squamous intraepithelial lesion, or both, in anal biopsy. |
|
| Interventions | Vaccine: quadrivalent HPV vaccine; 3 doses: day 1, month 2, month 6 Control: saline placebo ("water used in the preparation of injectable with <1 mmol of Na"); 3 doses: day 1, month 2, month 6 |
|
| Outcomes | Harms: adverse events, deaths | |
| Notes | Other groups: N/A Last report average follow‐up time: 7 months Funding: Public Health and Social Progress Foundation of the Government of Andalucia [La Fundación Pública Andaluza Progreso y Salud de la Consejería de Igualdad Salud y Política Social] Trial ID: ISRCTN14732216 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Computer generated list of random numbers |
| Allocation concealment (selection bias) | Low risk | Quote: "The person in charge of generating and keeping the list was not part of the research team and did not participate in evaluation or enrolment of patients, therefore guaranteeing patient blinding." |
| Blinding of participants and personnel (performance bias) All outcomes | Unclear risk | Participants were blinded to allocation. No clear statement provided regarding blinding of personnel or outcome assessors. |
| Blinding of outcome assessment (detection bias) All outcomes | Unclear risk | Participants were blinded to allocation. No clear statement provided regarding blinding of personnel or outcome assessors. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | 129 of 162 screened subjects were included. Reasons for ineligibility, withdrawal, and protocol violation fully reported. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective. Trial registered retrospectively. |
| Other bias | Low risk | No other bias apparent. |
Iversen 2016.
| Methods | Phasae III, open‐label, controlled, randomised and multi‐centre trial | |
| Participants | Participants: 1518 girls, boys, and young women (301 girls aged 9–14 years and 301 boys aged 9‐14 years received 2 doses 6 months apart; 301 girls and boys aged 9–14 years received 2 doses 12 months apart; 301 girls aged 9‐14 years and 314 young women aged 16‐26 years received 3 doses at 0, 2, 6 months) recruited from 15 countries (Canada, Chile, Colombia, Czech Republic, Denmark, Israel, Malaysia, Norway, South Korea, South Africa, Spain, Taiwan, Thailand, Turkey, and the USA) Age range: girls and boys aged 9‐14 years and girls and young women aged 16‐26 years Inclusion criteria: girls and boys 9‐14 years had to be generally healthy and not sexually active prior to enrolment. Girls and young women 16‐26 years had to be generally healthy with 4 or fewer lifetime sexual partners, without a history of abnormal Papanicolaou test results or other cervical abnormalities, and to agree to use effective contraception through to study month 7. |
|
| Interventions | Vaccine 1: nonavalent HPV vaccine; 2 doses: day 1, month 6 Vaccine 2: nonavalent HPV vaccine; 2 doses: day 1, month 12 Vaccine 3: nonavalent HPV vaccine; 3 doses: day 1, month 2, month 6 |
|
| Outcomes | Harms: adverse events, deaths Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups:
Last report average follow‐up time: 13 months (1 month after the last dose) Funding: Merck & Co, manufacturer of the quadrivalent and nonavalent HPV vaccines. Merck, as the study sponsor, was directly involved in the design and conduct of the study in conjunction with external investigators; collection, management, analysis, and interpretation of the data; and preparation and review of the manuscript. The presentation also underwent formal review by Merck. However, Merck could not prevent submission of the manuscript. Trial ID: NCT01984697 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Randomisation occurred centrally using interactive voice response system/integrated web response system (IVRS/IWRS). Subjects were assigned randomly to 1 of the 3 vaccination arms based on their age stratum according to a computer‐generated allocation schedule. |
| Allocation concealment (selection bias) | Low risk | Randomisation occurred centrally using interactive voice response system/integrated web response system (IVRS/IWRS). Subjects were assigned randomly to 1 of the 3 vaccination arms based on their age stratum according to a computer‐generated allocation schedule. |
| Blinding of participants and personnel (performance bias) All outcomes | High risk | This was an open‐label trial; therefore, the sponsor, investigator and subject knew the treatment administered. |
| Blinding of outcome assessment (detection bias) All outcomes | High risk | This was an open‐label trial; therefore, the sponsor, investigator and subject knew the treatment administered. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Acceptable dropout rate and reasons for withdrawal provided. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective. Trial protocol and clinical trial registry checked. |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Joura 2015.
| Methods | Phase II/III, double‐blind, randomised, multi‐centre trial | |
| Participants | Participants: 14215 women (6792 in the nonavalent HPV vaccine group and 6795 in the quadrivalent HPV vaccine group) recruited from 18 countries (Austria, Brazil, Canada, Chile, Colombia, Denmark, Germany, Hong Kong, Japan, Korea, Mexico, New Zealand, Norway, Peru, Sweden, Taiwan, Thailand, and the USA (including Puerto Rico)) Age range: 16‐26 years Inclusion criteria: no history of an abnormal result on a Papanicolaou (Pap) test, no more than 4 lifetime sexual partners, and no previous abnormal finding on cervical biopsy |
|
| Interventions | Vaccine 1: nonavalent HPV vaccine; 3 doses: day 1, month 2, month 6 Vaccine 2: quadrivalent HPV vaccine; 3 doses: day 1, month 2, month 6 |
|
| Outcomes | Clinical: high grade cervical, vulval, and vaginal disease; cervical cancer; persistent HPV infection Harms: adverse events, deaths Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: N/A Last report average follow‐up time: 54 months Funding: Merck Trial ID: NCT00543543 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Quote: "An Interactive Voice Response System (IVRS) was used to allocate study subjects and balance randomisation between sites. Subjects were assigned an allocation number from an allocation schedule via the IVRS. Study personnel utilized IVRS at each vaccination visit for assignment of the clinical material from the appropriate vaccination group to be administered to the subject." (From protocol, supplementary material online) |
| Allocation concealment (selection bias) | Low risk | Quote: "An Interactive Voice Response System (IVRS) was used to allocate study subjects and balance randomisation between sites. Subjects were assigned an allocation number from an allocation schedule via the IVRS. Study personnel utilized IVRS at each vaccination visit for assignment of the clinical material from the appropriate vaccination group to be administered to the subject." (From protocol, supplementary material online) |
| Blinding of participants and personnel (performance bias) All outcomes | Low risk | Quote: "The subjects, investigators (and his/her staff), laboratory staff, members of the Scientific Advisory Committee, and HPV Vaccine Program Pathology Panel will remain blinded to subject vaccination group allocations for the duration of the study." (From protocol, supplementary material online) |
| Blinding of outcome assessment (detection bias) All outcomes | Low risk | Quote: "The subjects, investigators (and his/her staff), laboratory staff, members of the Scientific Advisory Committee, and HPV Vaccine Program Pathology Panel will remain blinded to subject vaccination group allocations for the duration of the study. The SPONSOR will remain blinded to subject vaccination allocations until the required number of cases of the primary efficacy endpoint have been observed and the database is unblinded for the primary efficacy analysis, with the exception of unblinded personnel who will provide data summaries for dose selection and DSMB meetings, and those who will determine when the required number of cases of the primary efficacy endpoint have been observed. These unblinded personnel will not be associated with the conduct of the study or the design of any of the statistical analyses for the study (other than those requested by the DSMB)." (From protocol, supplementary material online) |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data reported adequately in published report, with extra data published in Supplementary materials online. |
| Selective reporting (reporting bias) | Low risk | Full protocol published as supplementary material alongside published paper, including analysis plan. |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Lehtinen 2018.
| Methods | Partially blind cluster‐randomised trial | |
| Participants | Participants: 32,175 early adolescents (20,514 girls and 11,661 boys) living in 33 community clusters in Finland; 3703 male participants were included in narrative results Age range: 12‐15 years Inclusion criteria: born 1992–1995; parental consent; healthy, as established by medical history. If female, not pregnant and not of child‐bearing potential or using adequate contraception for 30 days prior to vaccination and to continue for 2 months after completion of the vaccination series |
|
| Interventions | Vaccine 1: 90% of the girls and boys assigned to receive bivalent HPV vaccine (Cervarix) and 10% assigned to receive hepatitis B vaccine (HBV; Engerix) at 0,1 and 6 months (11 clusters) Vaccine 2: 90% of the girls assigned to receive bivalent HPV vaccine, 10% of girls assigned to receive HBV vaccine and all boys received HBV‐vaccine (11 clusters) Control: all participants assigned to receive active control HBV vaccine (11 clusters) |
|
| Outcomes | Harms: adverse events (active surveillance subgroup 12‐month follow‐up) | |
| Notes | Other groups: the data provided on harms in the male participants was based on the 2436 in group 1 who received bivalent vaccine and a sub‐set of 1267 of those who received HBV vaccine in group 2. Last report average follow‐up time: 4 years Funding: GlaxoSmithKline Trial ID: NCT00534638 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Cluster‐randomised: "communities were randomly assigned in equal numbers (1:1:1) to the three intervention arms using a random number generator" |
| Allocation concealment (selection bias) | Low risk | Although the trial used central randomisation: "study participants were to be administered the vaccine dose according to a central randomisation system on Internet" |
| Blinding of participants and personnel (performance bias) All outcomes | High risk | Although the study was blinded for participants in the first arm (HPV or HBV vaccine), the participants in the third arm were aware of their allocation (all received HBV vaccine). |
| Blinding of outcome assessment (detection bias) All outcomes | High risk | Quote: "For investigators, the study was open" |
| Incomplete outcome data (attrition bias) All outcomes | High risk | For active adverse event surveillance, data were collected only for a subset of male participants and it was unclear how these participants were selected. Passive adverse event surveillance was conducted for all participants, but not reported for males separately. |
| Selective reporting (reporting bias) | High risk | No outcomes were reported completely separately for boys and girls. Adverse events were reported in boys separately, but in a selected subset. |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Leung 2015.
| Methods | Phase III, observer‐blind, parallel, randomised trial | |
| Participants | Participants:1075 girls (359 to 2 doses of bivalent HPV; 358 to 2 doses of quadrivalent HPV; 358 to 3 doses of quadrivalent HPV; recruited at 21 sites in France, Hong Kong, Singapore and Sweden Age range: 9‐14 years Inclusion criteria: healthy girls aged 9–14 years; girls of childbearing potential could be enrolled if they were abstinent or practised adequate contraception for 30 days prior to vaccination, had a negative pregnancy test on the day of each vaccination, and agreed to continue contraception for up to 2 months after completion of the vaccination series. |
|
| Interventions | Vaccine 1: quadrivalent HPV vaccine; 2 doses: day 1, month 6 Vaccine 2: quadrivalent HPV vaccine; 3 doses: day 1, month 2, month 6 Girls in the 2‐dose group received aluminium adjuvant placebo (Al(OH)3) at month 2 to maintain the observer blinding. |
|
| Outcomes | Harms: adverse events, deaths Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: 358 girls aged 9‐14 years who received 2 doses of bivalent HPV vaccine. Last report average follow‐up time: 36 months Funding: GlaxoSmithKline Biologicals SA funded this study and was involved in all stages of study conduct, including analysis of the data and the development and publication of the manuscript. Trial ID: NCT01462357 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | The randomisation code was generated using MATEX, a program developed for use in SAS (Cary, NC, USA), by GSK Vaccines, Belgium. |
| Allocation concealment (selection bias) | Low risk | Quote: "Treatment allocation at the investigator site was performed using a centralized internet‐based randomisation system" |
| Blinding of participants and personnel (performance bias) All outcomes | Low risk | The study was conducted in an observer‐blind manner (i.e. vaccines were prepared and administered by qualified medical personnel not otherwise involved in the conduct of this study). Personnel involved in subject evaluation and subjects themselves were blinded to group assignments. Girls in the 2‐dose groups received control Al(OH)3 at month 2 to maintain observer blinding. |
| Blinding of outcome assessment (detection bias) All outcomes | Low risk | Personnel involved in subject evaluation, and subjects themselves, were blinded to group assignments. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data appeared to be reported adequately, including reasons for withdrawals. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective. Clinical trial registry checked. |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Levin 2010.
| Methods | Randomised, double‐blind, placebo‐controlled trial | |
| Participants | Participants: 126 children with HIV infection (96 received quadrivalent HPV vaccine and 30 received control) from the USA and Puerto Rico Age range: children 7‐12 years old Inclusion criteria: CD4% ≥15; at least 3 months of HAART was required for subjects with a CD4% < 25. |
|
| Interventions | Vaccine: quadrivalent HPV vaccine; 3 doses: day 1, month 2, month 6 Control: 'identical placebo' (contents of placebo were not specified (e.g. whether it was aluminium adjuvant or saline)); 3 doses: day 1, month 2, month 6 |
|
| Outcomes | Harms: adverse events Immunological: GMT, seroconversion |
|
| Notes | Other groups: N/A Last report average follow‐up time: 4‐5 years Funding: overall support for the International Maternal Pediatric Adolescent AIDS Clinical Trials Group (IMPAACT) was provided by the National Institute of Allergy and Infectious Diseases (NIAID), the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), and the National Institute of Mental Health (NIMH) Trial ID: NCT01206556 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Unclear risk | Quote: "randomly assigned" |
| Allocation concealment (selection bias) | Unclear risk | No statement provided about allocation concealment. |
| Blinding of participants and personnel (performance bias) All outcomes | Unclear risk | No detailed statement provided about how blinding was maintained or who was blinded. |
| Blinding of outcome assessment (detection bias) All outcomes | Unclear risk | No detailed statement provided about how blinding was maintained or who was blinded. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data were provided for the total vaccinated cohort (100% of enrolled participants), together with full information about reasons for exclusions and withdrawals from follow‐up. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective. Clinical trial record checked. |
| Other bias | Low risk | No other bias apparent. |
Lin 2014.
| Methods | Open‐label, parallel, randomised trial | |
| Participants | Participants: 220 males (111 to the alternate schedule and 109 to the standard schedule) recruited from the USA Age range: 18‐25 years old Inclusion criteria: males 18‐25 years with 4 or fewer lifetime sexual partners |
|
| Interventions | Vaccine 1: standard schedule quadrivalent HPV vaccine; 3 doses at 0, 2, and 6 months Vaccine 2: alternate schedule quadrivalent HPV vaccine; 3 doses at 0, 2 and 12 months |
|
| Outcomes | Harms: compliance with third dose, adverse events Immunogenicity: GMT |
|
| Notes | Other groups: N/A Last report average follow‐up time: month 7 or 13 (depending on group) Funding: the authors and this work were supported in part by a research grant from the Investigator‐Initiated Studies Program of Merck & Co, Inc, manufacturer of Gardasil® quadrivalent human papillomavirus vaccine. Trial ID: NCT01184079 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Quote: "Participants were randomised as they were scheduled for the initial visit using a simple random number sequence to determine the order of assignment into the Standard schedule or the Alternate schedule" |
| Allocation concealment (selection bias) | Unclear risk | Not described |
| Blinding of participants and personnel (performance bias) All outcomes | High risk | Open label; "Participants were aware of their group assignment" |
| Blinding of outcome assessment (detection bias) All outcomes | Unclear risk | Not described |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Quote: "Out of 220 participants enrolled, 204 completed the study" Reasons for withdrawal and protocol violation fully reported. Results for both ITT and per protocol populations reported. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective ‐ clinical trial registry checked |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
NCT00941889 2016.
| Methods | Double blind, controlled, randomised, single‐centre trial | |
| Participants | Participants: 32 HIV‐positive males and females with anal warts (15 to the vaccine group and 17 to the control group) recruited from the USA Age range: 18 to 65 years old Inclusion criteria: HIV positive, ≥ 18 years of age, CD4 > 200 and viral RNA < 400 on HAART or CD4 > 350 if not on HARRT, presence of anal warts that required surgical excision or ablation |
|
| Interventions | Vaccine: quadrivalent HPV vaccine; 3 doses at 0, 2, and 6 months Control: saline placebo; 3 doses at 0, 2 and 6 months |
|
| Outcomes | Clinical: persistence and recurrence of anal warts | |
| Notes | Other groups: N/A Last report average follow‐up time: month 18 Funding: Washington University School of Medicine Trial ID: NCT00941889 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Unclear risk | The online clinical trials record states "Randomized", but details about how randomisation was achieved were not reported. |
| Allocation concealment (selection bias) | Unclear risk | Details of allocation concealment were not reported. |
| Blinding of participants and personnel (performance bias) All outcomes | Unclear risk | The online clinical trials record states "Masking: Double (Participant, Investigator)", but details about how blinding was achieved were not reported. |
| Blinding of outcome assessment (detection bias) All outcomes | Unclear risk | The online clinical trials record states "Masking: Double (Participant, Investigator)", but details about how blinding was achieved were not reported. |
| Incomplete outcome data (attrition bias) All outcomes | High risk | Data for 62.5% (20/32) of the participants enrolled were missing due to withdrawal from the study, the online trial record states "No outcomes data were collected or analysed due to lack of participant follow‐up" |
| Selective reporting (reporting bias) | High risk | The study did not report on adverse events and the online trial record states "No outcomes data were collected or analysed due to lack of participant follow‐up" |
| Other bias | Unclear risk | No published report was identified for this study, data were extracted from the clinical trials record which had insufficient information to establish whether there was a risk of other bias. |
NCT01031069 2017.
| Methods | Phase IV, observer‐blind, randomised, controlled, multi‐centric study | |
| Participants | Participants: 649 HIV seropositive and seronegative females aged 15‐25 years (331 to the bivalent vaccine group and 330 to the quadrivalent vaccine group) recruited from Brazil, Estonia, India, and Thailand Age range: 15‐25 years Inclusion criteria: female 15‐25 years old, HIV voluntary counselling and testing |
|
| Interventions | Vaccine 1: bivalent HPV vaccine; 3 doses at day 0, week 6, and month 6 Vaccine 2: quadrivalent HPV vaccine; 3 doses at day 0, week 6, and month 6 |
|
| Outcomes | Harms: adverse events Immunogenicity | |
| Notes | Other groups: N/A Last report average follow‐up time: month 7 Funding: GlaxoSmithKline Trial ID: NCT01031069 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Unclear risk | The online clinical trials record and clinical trial result summary state "Randomized", but details about how randomisation was achieved were not reported. |
| Allocation concealment (selection bias) | Unclear risk | Details of allocation concealment were not reported |
| Blinding of participants and personnel (performance bias) All outcomes | Unclear risk | The online clinical trials record states "Triple (Participant, Investigator, Outcomes Assessor)", but details about how blinding was achieved were not reported. |
| Blinding of outcome assessment (detection bias) All outcomes | Unclear risk | The online clinical trials record states "Triple (Participant, Investigator, Outcomes Assessor)", but details about how blinding was achieved were not reported. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data were provided for the total vaccinated cohort (100% of enrolled participants), together with full information about reasons for exclusions and withdrawals from follow‐up. |
| Selective reporting (reporting bias) | High risk | Not all outcomes listed in the online trial registration were reported in the trial result summary report. |
| Other bias | Unclear risk | No published report was identified for this study; data were extracted from the clinical trials results summary on the manufacturer's web site (https://www.gsk‐clinicalstudyregister.com/) which had insufficient information to establish whether there was a risk of other bias. |
NCT01862874 2018.
| Methods | Phase 3, parallel, randomised, controlled trial | |
| Participants | Participants: 1124 boys and men (562 received vaccine, 562 received placebo) recruited from Japan Age range:16‐26 years Inclusion criteria: Japanese males with no clinical evidence of sexually transmitted disease and no clinically present external genital warts |
|
| Interventions | Vaccine: quadrivalent HPV vaccine; 3 doses at day 1, month 2, month 6 Control: aluminium adjuvant placebo (placebo formulated with aluminium hydroxyphosphate sulfate adjuvant); 3 doses at day 1, month 2, month 6 |
|
| Outcomes | Incidence of persistent HPV‐6/11/16/18 infection or disease Adverse events |
|
| Notes | Other groups: N/A Last report average follow‐up time: month 36 Funding: Merck Sharp & Dohme Corp Trial ID: NCT01862874 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Unclear risk | The online clinical trials record and clinical trial result summary state "Randomized", details about how randomisation was achieved were not reported. |
| Allocation concealment (selection bias) | Unclear risk | Details of allocation concealment were not reported. |
| Blinding of participants and personnel (performance bias) All outcomes | Unclear risk | The clinical trial record states "masking: triple (participant, investigator, outcomes assessor" but no other details were provided. |
| Blinding of outcome assessment (detection bias) All outcomes | Unclear risk | The clinical trial record states "masking: triple (participant, investigator, outcomes assessor" but no other details were provided. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Reasons for withdrawals were reported and balanced between groups. |
| Selective reporting (reporting bias) | High risk | HPV disease (HPV Type 6, 11, 16, or 18‐related condyloma acuminate, penile, perianal, or perineal intraepithelial neoplasia or cancer) was not reported separately; persistent HPV infection and HPV disease were reported as a combined outcome. |
| Other bias | Unclear risk | No published report was identified for this trial. Trial funded by vaccine manufacturer. |
Petaja 2009.
| Methods | Phase I/II, observer‐blind, parallel‐group, randomised study | |
| Participants | Participants: 270 boys (181 received bivalent HPV vaccine and 89 received hepatitis B vaccine) recruited from 7 study sites in Finland Age range: 10‐18 years old Inclusion criteria: boys free of obvious health problems as established by medical history and clinical examination before entering into the study |
|
| Interventions | Vaccine: bivalent HPV vaccine; 3 doses: day 1, month 1, month 6 Control: hepatitis B active control vaccine; 3 doses: day 1, month 1, month 6 |
|
| Outcomes | Harms: adverse events, deaths Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: N/A Last report average follow‐up time: 12 months Funding: GlaxoSmithKline Trial ID: NCT00309166 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Randomisation list generated at GlaxoSmithKline Biologicals (Rixensart, Belgium) using a standard SAS program (SAS Institute, Cary, NC). |
| Allocation concealment (selection bias) | Low risk | Participants were assigned a vaccine treatment number; blinding was maintained to the individual treatment allocated. |
| Blinding of participants and personnel (performance bias) All outcomes | Low risk | Participants were assigned a vaccine treatment number; blinding was maintained to the individual treatment allocated. All study personnel were blinded to the vaccines used, except the study nurse administrating the vaccines. |
| Blinding of outcome assessment (detection bias) All outcomes | Low risk | Participants were assigned a vaccine treatment number; blinding was maintained to the individual treatment allocated. All study personnel were blinded to the vaccines used, except the study nurse administrating the vaccines. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data for all participants enrolled were reported for adverse events. Reasons for exclusion from immunogenicity analysis was provided. |
| Selective reporting (reporting bias) | Low risk | All relevant outcomes were reported in clinical trials record and clinical study report. |
| Other bias | Unclear risk | No report of industry funding in publication, though the study report is available on GSK web site. |
Puthanakit 2016.
| Methods | Phase III, open‐label, controlled, randomised, multi‐centre trial | |
| Participants | Participants: 1447 participants (482 women to the 3‐dose schedule (months 0, 1, 6); 550 girls to the 2‐dose schedule (months 0 and 6); 415 girls to the 2‐dose schedule (0 and 12 months)) recruited from Canada, Germany, Italy, Taiwan, and Thailand Age range: girls 9‐14 years old and women 15‐25 years old Inclusion criteria: women of childbearing age required to be abstinent or use adequate contraceptive precautions for 30 days before first vaccination and agree to continue such precautions for 2 months after the last vaccine dose |
|
| Interventions | Vaccine 1: bivalent HPV vaccine; 2 doses: month 0 and month 6 Vaccine 2: bivalent HPV vaccine; 2 doses: month 0 and month 12 |
|
| Outcomes | Harms: adverse events, deaths Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: 482 women aged 15‐25 years received 3 doses bivalent HPV vaccine, data not extracted Last report average follow‐up time: 13 months, study ongoing Funding: GlaxoSmithKline Biologicals SA. GlaxoSmithKline Biologicals designed the study in collaboration with investigators and co‐ordinated gathering, analysis, and interpretation of data and writing of the report. Trial ID: NCT01381575 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | The randomisation list was generated by GSK Vaccines using a standard SAS program. A randomisation blocking scheme (1:1 ratio) ensured that balance between the two 2‐dose schedules was maintained. Treatment allocation at each site used a central randomisation system on the Internet. |
| Allocation concealment (selection bias) | Low risk | Treatment allocation at each site used a central randomisation system on the Internet. |
| Blinding of participants and personnel (performance bias) All outcomes | High risk | Investigators and participants were not blinded to group assignment. Girls aged 9–14 years were randomised (1:1) to receive 2‐dose schedule (months 0, and 6 or months 0, and 12) and women aged 15–25 years were allocated to receive 3‐dose schedule (months 0, 1, and 6). |
| Blinding of outcome assessment (detection bias) All outcomes | High risk | Investigators and participants were not blinded to group assignment. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data reported adequately in published report, with extra data published in Supplementary materials online. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective. Clinical trial registry checked. |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Romanowski 2011.
| Methods | Phase I/II, partially blind, controlled, age‐stratified, randomised and multi‐centre trial | |
| Participants | Participants: 960 girls and women (240 in 2‐dose schedule 20 μg dose (months 0 and 6); 241 in 2‐dose schedule 40 μg dose (months 0 and 6); 240 in 2‐dose schedule 40 μg dose (months 0 and 2); 239 in 3‐dose schedule 20 μg dose (months 0, 1, and 6)) recruited from Canada and Germany Age range: girls and young women aged 9‐25 years at the time of first vaccination Inclusion criteria: participants with childbearing potential had to use adequate contraception for 30 days prior to vaccination, have a negative pregnancy test, and continue contraceptive precautions for 2 months after completion of the vaccination series |
|
| Interventions | Vaccine 1: bivalent HPV vaccine; 20 μg dose; 3 doses: day 1, month 1, month 6 Vaccine 2: bivalent HPV vaccine; 20 μg dose; 2 doses: day 1, month 6 Vaccine 3: bivalent HPV vaccine; 40 μg dose; 2 doses: day 1, month 6 Vaccine 4: bivalent HPV vaccine; 40 μg dose; 2 doses: day 1, month 2 In the 2‐dose schedule groups, an aluminium adjuvant placebo was administered at month 2 (Groups 20 μg dose (months 0 and 6) and 40 μg dose (months 0 and 6)) or at month 6 (Group 40 μg dose months 0 and 2) to maintain blinding. |
|
| Outcomes | Harms: adverse events, deaths Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: N/A Last report average follow‐up time: up to month 60 Funding: GlaxoSmithKline Biologicals Trial ID: NCT00541970 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | The randomisation list was computer‐generated at GlaxoSmithKline Biologicals. |
| Allocation concealment (selection bias) | Low risk | Treatment allocation at the investigator site was performed using a central randomisation call‐in system on the Internet; the randomisation algorithm used a minimisation procedure accounting for centre and age (9–14, 15–19 and 20–25 years). |
| Blinding of participants and personnel (performance bias) All outcomes | Unclear risk | The trial was partially blinded within the 2‐dose schedule groups (observers were blinded to group assignment) and open in the 3‐dose schedule group. In the 2‐dose schedule groups, a placebo was administered at month 2 (Groups 20 μg dose (months 0 and 6) and 40 μg dose (months 0 and 6)) or at month 6 (Group 40 μg dose (months 0 and 2) to maintain blinding. |
| Blinding of outcome assessment (detection bias) All outcomes | Low risk | The trial was partially blinded within the 2‐dose schedule groups (observers were blinded to group assignment). |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data appeared to be reported adequately, and included reasons for withdrawals. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective. Clinical trial registry checked. |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Toft 2014.
| Methods | Randomised, double‐blind, head‐to‐head trial | |
| Participants | Participants: 92 male and female HIV‐positive participants (46 to 3‐dose bivalent vaccine and 46 to 3‐dose quadrivalent vaccine) recruited from outpatient clinic in Denmark. Age range: at least 18 years old Inclusion criteria: consenting HIV‐seropositive volunteers at least 18 years old |
|
| Interventions | Vaccine 1: bivalent HPV vaccine; 3 doses: day 1, month 1.5, month 6 Vaccine 2: quadrivalent HPV vaccine; 3 doses: day 1, month 1.5, month 6 |
|
| Outcomes | Harms: adverse events Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: N/A Last report average follow‐up time: 6 months Funding: Aarhus University, Henrik Henriksen’s Foundation, The Hede Nielsen Family Foundation, Aase and Ejnar Danielsen’s Foundation, Jørgen Holm and Wife’s Foundation, Lykfeldt andWife’s Foundation, and the Danish Medical Association Trial ID: NCT01386164 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Random allocation sequences were computer generated by the hospital pharmacy. Participants were assigned their study identification number according to the chronological order in which they were enrolled. Participants and investigators were masked to the assigned vaccine throughout the study. |
| Allocation concealment (selection bias) | Low risk | Random allocation sequences were computer generated by the hospital pharmacy. Participants were assigned their study identification number according to the chronological order in which they were enrolled. Participants and investigators were masked to the assigned vaccine throughout the study. |
| Blinding of participants and personnel (performance bias) All outcomes | Low risk | Participants and investigators were masked to the assigned vaccine throughout the study. |
| Blinding of outcome assessment (detection bias) All outcomes | Low risk | Blinded analysis at the joint Chemical Biology Core Facility of the German Cancer Research Center and the European Molecular Biology Laboratory, Heidelberg, Germany |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data appeared to be reported adequately, and included reasons for withdrawals. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective. Clinical trials registry checked. |
| Other bias | Low risk | No other bias apparent. |
van Damme 2016.
| Methods | Phase III, double‐blind, controlled, randomised and multicenter trial | |
| Participants | Participants: 500 males (249 to the nonavalent HPV vaccine arm, 251 to the quadrivalent HPV vaccine arm) recruited from Belgium, Germany, and the Netherlands Age range: 16‐26 years Inclusion criteria: good physical health, no more than 5 lifetime female and no male sexual partners |
|
| Interventions | Vaccine 1: nonavalent HPV vaccine; 3 doses: day 1, month 2, and month 6 Vaccine 2: quadrivalent HPV vaccine; 3 doses: day 1, month 2, and month 6 |
|
| Outcomes | Harms: adverse events, deaths Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: N/A Last report average follow‐up time: 7 months Funding: Sanofi Pasteur MSD provided financial support for the conduct of the research and preparation of the article and were involved in the study design, in the collection, analysis and interpretation of data and in the writing of the trial report. Trial ID: NCT02114385 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | Quote: "An interactive Web Response System (IWRS) was used to allocate participants to 9vHPV or qHPV vaccine in a blinded manner. The system assigned an allocation number from a randomised, age‐stratified (16‐17 years and 18‐26 years) allocation schedule." |
| Allocation concealment (selection bias) | Low risk | Quote: "An interactive Web Response System (IWRS) was used to allocate participants to 9vHPV or qHPV vaccine in a blinded manner. The system assigned an allocation number from a randomised, age‐stratified (16‐17 years and 18‐26 years) allocation schedule." |
| Blinding of participants and personnel (performance bias) All outcomes | Low risk | Participants and personnel were blinded: "Masking: Quadruple (Participant, Care Provider, Investigator, Outcomes Assessor)" "We conducted a double‐blind, randomised controlled with qHPV vaccine, immunogenicity and safety of the 9vHPV vaccine in young men aged 16‐26 years of age." |
| Blinding of outcome assessment (detection bias) All outcomes | Low risk | Outcome assessors were blinded: "Masking: Quadruple (Participant, Care Provider, Investigator, Outcomes Assessor)" |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Fig 1 shows 97.8% completed. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective ‐ clinical trial record checked and all immunogenicity outcomes reported. |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Vesikari 2015.
| Methods | Phase III, double‐blind, controlled, randomised and multi‐centre trial | |
| Participants | Participants: 600 girls (300 in the nonavalent HPV vaccine arm, 300 in the quadrivalent HPV vaccine arm), recruited from Belgium, Denmark, Finland, Italy, Spain, and Sweden) Age range: 9‐15 years old Inclusion criteria: girls aged ≥ 9 to < 16 years at enrolment, in good physical health, who were virgins and who were not planning to become sexually active before month 7 of the study. |
|
| Interventions | Vaccine 1: nonavalent HPV vaccine; 3 doses: day 1, month 2, month 6 Vaccine 2: quadrivalent HPV vaccine; 3 doses: day 1, month 2, month 6 |
|
| Outcomes | Harms: adverse events, deaths Immunogenicity: GMT, seroconversion |
|
| Notes | Other groups: N/A Last report average follow‐up time: 7 months Funding: Sanofi Pasteur MSD Trial ID: NCT01304498 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Low risk | A central randomisation system, which used an interactive web response system, assigned participants to a vaccine group (blinded) and an allocation number according to the randomised allocation schedules. |
| Allocation concealment (selection bias) | Low risk | A central randomisation system, which used an interactive web response system, assigned participants to a vaccine group (blinded) and an allocation number according to the randomised allocation schedules. |
| Blinding of participants and personnel (performance bias) All outcomes | Low risk | Study reported to be double‐blind. Not explicitly stated, however both groups received vaccines at the same time points. |
| Blinding of outcome assessment (detection bias) All outcomes | Low risk | Described as double blind; however, not explicit that outcome assessment was blinded. Given that the outcomes were objective (serology), assessed as low risk of bias. |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | 98.2% completed study (Figure 1), with full information on exclusions and withdrawals. |
| Selective reporting (reporting bias) | Low risk | No reason to suspect that reporting was selective, clinical trial registry checked |
| Other bias | Unclear risk | Trial funded by vaccine manufacturer. |
Wilkin 2018.
| Methods | Phase III, double blind, placebo‐controlled, randomised, multi‐centre trial | |
| Participants | Participants: 575 HIV‐positive males and females (288 to the vaccine group and 287 to the control group) recruited from the USA, Brazil, and Puerto Rico Age range: at least 27 years old Inclusion criteria: HIV‐1 infection, laboratory values and anal cytology result obtained within 45 days prior to entry |
|
| Interventions | Vaccine: quadrivalent HPV vaccine; 3 doses at 0, 8, and 24 weeks Control: 'placebo vaccine' (contents of placebo vaccine were not specified (e.g. whether it was aluminium adjuvant‐containing or saline)); 3 doses at 0, 8, and 24 weeks |
|
| Outcomes | Clinical: anal intraepithelial neoplasia, persistent infection Harms: adverse events |
|
| Notes | Other groups: N/A Last report average follow‐up time: 4 years Funding: National Institute of Allergy and Infectious Diseases Trial ID: NCT01461096 |
|
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (selection bias) | Unclear risk | Quote: "Permuted‐block randomisation was balanced by site and stratified by sex and presence of bHSIL at study screening.", details on how randomisation sequence was generated was not fully reported |
| Allocation concealment (selection bias) | Low risk | Central allocation: "The treatment assignment was provided electronically to local study pharmacists who prepared identical prefilled vaccine syringes.” |
| Blinding of participants and personnel (performance bias) All outcomes | Unclear risk | Quote: ""Investigators, participants, and study staff were masked to treatment allocation.", details about how blinding was achieved were not reported |
| Blinding of outcome assessment (detection bias) All outcomes | Unclear risk | Quote: ""Investigators, participants, and study staff were masked to treatment allocation.", details about how blinding was achieved were not reported |
| Incomplete outcome data (attrition bias) All outcomes | Low risk | Data were provided for 99% (569/575) participants; full information about reasons for exclusions and withdrawals were provided. |
| Selective reporting (reporting bias) | Low risk | All outcomes listed in online trial registration were reported. |
| Other bias | Low risk | No other bias apparent. |
Abbreviations
AAHS: amorphous aluminium hydroxy‐phosphate sulphate
CD4%: percentage of white blood cells that are CD4 cells
GMT: geometric mean titre
HAART: highly active antiretroviral therapy
HPV: human papillomavirus
ITT: intention‐to‐treat
qHPV: quadrivalent human papillomavirus vaccine
9vHPV: nonavalent human papillomavirus vaccine
Characteristics of excluded studies [ordered by study ID]
| Study | Reason for exclusion |
|---|---|
| Beachler 2016 | No relevant comparison, does not meet protocol: bivalent HPV vs hepatitis A vaccine (control) in women (NCT00128661) |
| Bhatia 2016 | No relevant comparison, does not meet protocol: observational study of vaccinated vs unvaccinated females |
| Bianchi 2016 | No relevant comparison, does not meet protocol: observational study of vaccinated vs unvaccinated females |
| Brown 2012 | No relevant comparison, does not meet protocol: 3 doses vs 3 doses comparing intervals in females (NCT00925288) |
| Canfell 2017 | Not a relevant population: women 25‐64 years (ACTRN12613001207707) |
| Carozzi 2016 | No relevant comparison, does not meet protocol: vaccinated vs unvaccinated females (NCT02296255) |
| Choudhury 2016 | No relevant comparison, does not meet protocol: observational study of vaccinated vs unvaccinated in HIV+ females, none of the HIV+ population was vaccinated |
| Esposito 2011 | No relevant comparison, does not meet protocol: 3 doses vs 3 doses comparing intervals in females (NCT00552279) |
| Flagg 2018 | No relevant comparison, does not meet protocol: observational study of anogenital warts prevalence before and after national HPV vaccination introduction for females, males were not vaccinated |
| Garland 2016 | No relevant comparison, does not meet protocol: vaccinated versus unvaccinated females (NCT00122681 PATRICIA) |
| Gilca 2015 | No relevant comparison, does not meet protocol: booster dose given to girls who had already received 2 doses of vaccine (NCT01456715) |
| Hamsikova 2017 | No relevant comparison, does not meet protocol: observational study of bivalent versus quadrivalent HPV vaccines |
| Harari 2016 | No relevant comparison, does not meet protocol: HPV vaccine vs hepatitis A vaccine (control) in females (NCT00128661) |
| Haskins‐Coulter 2017 | No relevant comparison, does not meet protocol: 3‐dose bivalent vaccine vs 3‐dose quadrivalent vaccine in young females (NCT00956553) |
| Lamontagne 2013 | No relevant comparison, does not meet protocol: 3 doses vs 3 doses comparing intervals in females (NCT00524745) |
| Lehtinen 2017 | No relevant comparison, does not meet protocol: long‐term follow‐up of vaccinated versus unvaccinated females combining arms from 3 RCTs (NCT01393470 (unvaccinated arm); NCT00122681 (PATRICIA vaccinated arm); NCT00169494 (HPV‐012 vaccinated arm)) |
| Luxembourg 2017 | No relevant comparison, does not meet protocol: vaccinated versus unvaccinated females (protocol) (V503‐021, NCT02653118) |
| Money 2016 | No relevant comparison, does not meet protocol: single arm HIV+ cohort (ISRCTN33674451) |
| Neuzil 2011 | No relevant comparison, does not meet protocol: 3 doses vs 3 doses comparing intervals in adolescent girls (NCT00524745) |
| Wheeler 2016 | Not a relevant population: women 26 years and older, 7‐year follow‐up of VIVIANE study (NCT00294047) |
| Zhu 2017 | No relevant comparison, does not meet protocol: HPV vaccine versus aluminium hydroxide control in females (NCT00779766) |
| Zimmerman 2010 | No relevant comparison, does not meet protocol: 3 doses vs 3 doses comparing intervals in females (NCT00572832) |
Abbreviations
HIV+: HIV positive HPV: human papillomavirus RCT: randomised controlled trial
Characteristics of studies awaiting assessment [ordered by study ID]
Li 2012.
| Methods | Randomised, double‐blind, placebo‐controlled trial |
| Participants | Participants: 100 healthy Chinese males and 500 healthy Chinese females (302 received the quadrivalent vaccine and 298 received the control vaccine) from Wuzhou, Guangxi, China Age range: males aged 9–15 years and females aged 9–45 years Inclusion criteria: no history of severe allergic reaction or allergic reaction to any vaccine component and a lifetime number of no more than 4 sex partners. Exclusion criteria: pregnant post‐pubertal females; history of an abnormal Papanicolaou test or biopsy showing cervical intraepithelial neoplasia (CIN) or worse |
| Interventions | Vaccine: quadrivalent HPV vaccine (Gardasil/Silgard, Merck, Whitehouse Station, NJ) (3 doses: day 1, month 2, month 6) Control: adjuvant‐containing placebo (3 doses: day 1, month 2, month 6) |
| Outcomes | Immunogenicity: GMTs, seroconversion Safety: adverse events, serious adverse events, death |
| Notes | Other groups: N/A Last report average follow‐up time: 7 months Funding: Merck Sharp & Dohme Corp Trial ID: NCT01427777 |
Reisinger 2007.
| Methods | Randomised, double‐blind, placebo‐controlled, multicenter study |
| Participants | Participants: 1781 boys and girls (1181 received the quadrivalent vaccine and 597 received the non‐aluminium placebo) from 47 study sites located in 10 countries in North America, Latin America, Europe and Asia Age: 9‐15 years old Inclusion criteria: healthy, sexually naive boys and girls |
| Interventions | Vaccine: quadrivalent HPV‐6/11/16/18 L1 VLP vaccine (GARDASIL/SILGARD, Merck and Co, Inc, Whitehouse Station, NJ) Control: placebo vaccine (identical components to those in the vaccine, with the exception of HPV L1 VLPs and aluminium adjuvant) |
| Outcomes | Immunogenicity: GMT, seroconversion Safety: adverse events, serious adverse events, death |
| Notes | Other groups: N/A Last report average follow‐up time: 18 months Funding: Merck and Co, Inc Trial ID: NCT00092547 |
Abbreviations
GMT: geometric mean titre HPV: human papillomavirus
Characteristics of ongoing studies [ordered by study ID]
NCT01735006.
| Trial name or title | Efficacy and immunogenicity study of recombinant human papillomavirus bivalent (genotype 16/18) vaccine |
| Methods | RCT |
| Participants | Females 18‐45 years Country: China |
| Interventions |
|
| Outcomes | Clinical outcomes, adverse events, immunogenicity |
| Starting date | November 2012 |
| Contact information | Jun Zhang, Xiamen University; Youlin Qiao, Cancer Institute and Hospital, Chinese Academy of Medical Sciences; Ting Wu, Xiamen University |
| Notes | Sponsors: Xiamen University; Xiamen Innovax Biotech Co, Ltd; Beijing Wantai Biological Pharmacy Enterprise Co, Ltd; Ministry of Science and Technology of the People's Republic of China Trial status in August 2018: active, not recruiting |
NCT01824537.
| Trial name or title | Transmission reduction and prevention with HPV vaccination (TRAP‐HPV) study (TRAP‐HPV) |
| Methods | RCT |
| Participants | 18‐45 year‐old couples, males and females Country: Canada |
| Interventions |
|
| Outcomes | HPV DNA positivity |
| Starting date | September 2013 |
| Contact information | Allita Rodrigues (allita.rodrigues@mcgill.ca); Anna Tzagourni (canepiadm.med@mcgill.ca) |
| Notes | Sponsors: McGill University Trial status in August 2018: recruiting |
NCT02009800.
| Trial name or title | ICI‐VPH: Impact of HPV immunisation schedules against HPV (ICI‐VPH) |
| Methods | RCT |
| Participants | Females 14‐16 years old Country: Canada |
| Interventions |
|
| Outcomes | Incidence of persistent HPV‐16/18 infections; GMT of antibodies and seropositivity for HPV genotypes 6, 11, 16 and 18 |
| Starting date | November 2013 |
| Contact information | Chantal Sauvageau, CHU de Quebec‐Universite Laval |
| Notes | Sponsors: CHU de Quebec‐Universite Laval; Centre hospitalier de l'Université de Montréal; Quebec Public Health National Institute; Quebec Ministry of Health and Social Services Trial status in August 2018: active, not recruiting |
NCT02087384.
| Trial name or title | HPV (human papilloma virus) vaccination after treatment of anal intraepithelial neoplasia (AIN) (VACCAIN‐P) |
| Methods | RCT |
| Participants | HIV positive MSM ≥ 18 years old Country: the Netherlands |
| Interventions |
|
| Outcomes | Recurrence of intra‐anal or peri‐anal high‐grade AIN; toxicity/safety; Intra‐anal or peri‐anal low‐grade AIN; anogenital warts; causative HPV genotype in recurrent AIN lesions; HPV genotype‐specific antibody response |
| Starting date | March 2014 |
| Contact information | Jan M Prins, Academisch Medisch Centrum, Universiteit van Amsterdam; Henry JC de Vries, Academisch Medisch Centrum, Universiteit van Amsterdam |
| Notes | Sponsors: Prof Jan Prins Trial status in August 2018: active, not recruiting |
NCT02405520.
| Trial name or title | Safety and immunogenicity study of the recombinant human papillomavirus virus type 6/11 bivalent vaccine |
| Methods | RCT |
| Participants | Males and females 18‐55 years Country: China |
| Interventions |
|
| Outcomes | Adverse events; anti‐HPV 6/11 antibody |
| Starting date | March 2015 |
| Contact information | Jun Zhang, Xiamen University; Zhao‐Jun Mo, Guangxi Center for Disease Prevention and Control; Ting Wu, Xiamen University |
| Notes | Sponsors: Jun Zhang; Xiamen Innovax Biotech Co, Ltd; Beijing Wantai Biological Pharmacy Enterprise Co, Ltd Trial status in August 2018: active, not recruiting |
NCT02562508.
| Trial name or title | Immunogenicity and safety study of a bivalent human papillomavirus (type 16, 18) recombinant vaccine (E.coli) in healthy female subjects aged 9‐17 years |
| Methods | RCT |
| Participants | Females 9‐26 years Country: China |
| Interventions |
|
| Outcomes | Adverse events and immunogenicity |
| Starting date | 5 December 2015 |
| Contact information | Ting Wu, Xiamen University; Yuemei Hu, Jiangsu Provincial Centre for Disease Control and Prevention |
| Notes | Sponsors: Jun Zhang; Xiamen Innovax Biotech Co, Ltd; Beijing Wantai Biological Pharmacy Enterprise Co, Ltd Trial status in August 2018: completed in August 2016, we contacted study investigators but they had provided no data at the time of submitting this review for publication |
NCT02567955.
| Trial name or title | Immunogenicity and safety of Gardasil‐9 and Cervarix |
| Methods | RCT |
| Participants | Boys and girls 9‐10 years old Country: Canada |
| Interventions |
|
| Outcomes | Antibodies to 9 HPV genotypes included in the Gardasil‐9 vaccine; tolerability profile |
| Starting date | September 2015 |
| Contact information | Vladimir Gilca (vladimir.gilca@inspq.qc.ca); Chantal Sauvageau (chantal.sauvageau@inspq.qc.ca) |
| Notes | Sponsors: Laval University Trial status in August 2018: recruiting |
NCT02710851.
| Trial name or title | Immunogenicity study of the recombinant human papillomavirus virus type 6/11 bivalent vaccine |
| Methods | RCT |
| Participants | Males and females 18‐55 years old Country: China |
| Interventions |
|
| Outcomes | Anti‐HPV 6 and anti‐HPV 11 seroconversion rates; serious adverse events |
| Starting date | March 2016 |
| Contact information | Jun Zhang, Xiamen University; Yuemei Hu, Jiangsu Center for Disease Prevention and Control |
| Notes | Sponsors: Jun Zhang; Xiamen Innovax Biotech Co., Ltd; Beijing Wantai Biological Pharmacy Enterprise Co, Ltd Trial status in August 2018: active, not recruiting |
NCT02733068.
| Trial name or title | A phase III double blinded, randomized controlled study to evaluate efficacy of protection against HPV‐16 and 18 related diseases, immunogenicity and safety of HPV‐16/18 vaccine in healthy females aged 18‐30 years |
| Methods | RCT |
| Participants | Females aged 18‐30 years Country: China |
| Interventions |
|
| Outcomes | Clinical outcomes, adverse events, immunogenicity |
| Starting date | November 2014 |
| Contact information | Zhaojun Mo, Guangxi Center for Disease Prevention and Control |
| Notes | Sponsors: Shanghai Zerun Biotechnology Co, Ltd; Guangxi Center for Disease Control and Prevention Trial status in August 2018: active, not recruiting |
NCT02740777.
| Trial name or title | Immunogenicity study of a 2‐dose immunization schedule of recombinant human papillomavirus virus‐like particle vaccine (type 16 and 18 l1 proteins, yeast) in adolescent females aged 9 to 14 years |
| Methods | RCT |
| Participants | Females aged 9‐14 years Country: China |
| Interventions | HPV‐16/18 vaccine (2 doses) HPV‐16/18 vaccine (3 doses) |
| Outcomes | Adverse events and immunogenicity |
| Starting date | February 2016 |
| Contact information | Zhaojun Mo, Guangxi Center for Disease Prevention and Control |
| Notes | Sponsors: Shanghai Zerun Biotechnology Co, Ltd; Guangxi Center for Disease Control and Prevention Trial status in August 2018: recruiting |
NCT02750202.
| Trial name or title | Effectiveness study of human papilloma virus (HPV) vaccines to prevent recurrence of genital warts (TheraVACCS) |
| Methods | RCT |
| Participants | Females ≦ 16 years with vulval vaginal genital warts Country: South Africa |
| Interventions |
|
| Outcomes | Change in size of genital wart lesion; surgical treatment of warts; surgical treatment of cervical disease; immunogenicity; HIV status |
| Starting date | July 2016 |
| Contact information | Greta G Dreyer (Greta.Dreyer@up.ac.za); Cathy Visser (visser.cathy@gmail.com) |
| Notes | Sponsors: University of Pretoria; University of Stellenbosch Trial status in August 2018: not yet recruiting |
NCT02834637.
| Trial name or title | A dose reduction immunobridging and safety study of two HPV vaccines in Tanzanian girls |
| Methods | RCT |
| Participants | Females 9 ‐14 years Country: Tanzania |
| Interventions |
|
| Outcomes | Adverse events and immunogenicity |
| Starting date | 23 February 2017 |
| Contact information | Deborah Watson‐Jones, London School of Hygiene and Tropical Medicine |
| Notes | Sponsors: London School of Hygiene and Tropical Medicine; University of York; Catalan Institute of Oncology; National Cancer Institute (NCI); Karolinska Institutet; Technische Universität Berlin; Tanzanian National Institute for Medical Research; University of Glasgow Trial status in August 2018: active, not recruiting |
NCT02888418.
| Trial name or title | Random, double blind, placebo controlled phase I clinical trials to estimate the safety and preliminary immunogenicity of tetravalent recombinant human papilloma virus vaccine (6,11,16,18 type) (Hansenula polymorpha) in women of 9‐30 years old and men of 9‐17 years old |
| Methods | RCT |
| Participants | Males 9‐17 years old, females 9‐30 years old Country China |
| Interventions |
|
| Outcomes | Adverse events and immunogenicity |
| Starting date | October 2016 |
| Contact information | Beijing Chaoyang District Centre for Disease Control and Prevention |
| Notes | Sponsors: Beijing Chaoyang District Centre for Disease Control and Prevention Trial status in August 2018: unknown, in August 2016 it was 'Not yet recruiting' |
NCT03180034.
| Trial name or title | A scientific evaluation of one or two doses of vaccine against human papillomavirus: the ESCUDDO study |
| Methods | RCT |
| Participants | Females 12‐16 years old Country: Costa Rica |
| Interventions |
|
| Outcomes | Clinical outcomes, adverse events, immunogenicity |
| Starting date | 26 June 2018 |
| Contact information | Aimee R Kreimer (kreimera@mail.nih.gov), National Cancer Institute |
| Notes | Sponsors: National Cancer Institute; Bill and Melinda Gates Foundation Trial status in August 2018: recruiting |
NCT03296397.
| Trial name or title | Efficacy of quadrivalent HPV vaccine to prevent relapses of genital warts after initial therapeutic response (CONDYVAC) |
| Methods | RCT |
| Participants | Males and females ≥ 18 years old, cured of genital warts Country: France |
| Interventions |
|
| Outcomes | Relapse free survival; Improvement of quality of life; adverse events |
| Starting date | November 2017 |
| Contact information | Sebastien Fouere (sebastien.fouere@aphp.fr); Olivier Chosidow (olivier.chosidow@aphp.fr) |
| Notes | Sponsors: Assistance Publique ‐ Hôpitaux de Paris Trial status in August 2018: recruiting |
Abbreviations
AIN: anal intraepithelial neoplasia HPV: human papillomavirus MSM: men who have sex with men RCT: randomised controlled trial
Differences between protocol and review
The original protocol of this review was developed to match the needs of the WHO Initiative for Vaccine Research, and a number of comparisons investigated were not included in the current review.
The protocol did not include adverse events as outcomes, these were extracted and included in this version of the review. In addition, for this version of the review, immunogenicity outcomes were considered as secondary outcomes and included only as Appendices. The outcome of histologically confirmed high‐grade disease was amended for males, to include all clinical outcomes.
We did not plan to assess the impact of statistical method to calculate odds ratios for very rare events in the protocol. We decided to assess the robustness of our analyses for very rare events (rates less than 1%) in view of the alternative statistical methods that can be used in this scenario (Bradburn 2007).
The following comparisons, for non‐randomised immuno‐bridging studies were included in the original protocol, but were not reported in the current review:
fewer than three doses in adolescent girls (9 to 14 years) versus three doses in young women (15 to 26 years), using the same vaccine and the same dosage (three‐dose arm using the WHO recommended schedule);
one dose in adolescent girls (9 to 14 years) versus two doses in young women (15 to 26 years), using the same vaccine and the same dosage;
males versus the same HPV vaccine type in females;
any HPV vaccine type in men who have sex with men (MSM) versus the same vaccine type in females or heterosexual males;
any HPV vaccine type in people with HIV infection compared with people without HIV infection.
Contributions of authors
HB, NH, BSB, GV, JP, CG, and AXRB were involved in the conception and design of the protocol for this review. VL designed and ran the electronic database searches. HB, NH, BSB, GV, and JP were involved in screening abstracts and full‐texts, data extraction and analysis. NH and HB drafted the review manuscript with assistance from NL. BSB, GV, JP, CG, AXRB, and NL provided critical input into the interpretation and intellectual content of the review. All authors read and approved the final version of the review.
Sources of support
Internal sources
No sources of support supplied
External sources
-
WHO Initiative for Vaccine Research, Switzerland.
Commissioned Cochrane Response to complete the review
Declarations of interest
None of the authors have a conflict of interest in relation to this review.
Cochrane Response, which is an evidence consultancy operated by The Cochrane Collaboration, was commissioned to perform part of this review for the WHO Initiative for Vaccine Research.
Hanna Bergman: HB works for Cochrane Response, an evidence services unit operated by the Cochrane Collaboration, and was paid by Cochrane Response for contributing to this review.
Brian S Buckley: BSB works for Cochrane Response, an evidence services unit operated by the Cochrane Collaboration, and was paid by Cochrane Response for contributing to this review.
Gemma Villanueva: GV works for Cochrane Response, an evidence services unit operated by the Cochrane Collaboration, and was paid by Cochrane Response for contributing to this review.
Jennifer Petkovic: JP works for Cochrane Response, an evidence services unit operated by the Cochrane Collaboration, and was paid by Cochrane Response for contributing to this review.
Chantelle Garritty: CG works as a consultant for Cochrane Response, an evidence services unit operated by Cochrane, and was paid by Cochrane Response for contributing to this review.
Vittoria Lutje: VL works as an independent consultant conducting literature searches for various research groups. None of them has any potential relevance to the submitted work.
Alina Ximena Riveros‐Balta: AXRB is an employee of the WHO Initiative for Vaccine Research, which commissioned the review.
Nicola Low: NL was the principal author of the original systematic review of alternative HPV vaccination schedules (D'Addario 2017), which was commissioned by the WHO Initiative for Vaccine Research.
Nicholas Henschke: NH works for Cochrane Response, an evidence services unit operated by Cochrane, and was paid by Cochrane Response for contributing to this review.
New
References
References to studies included in this review
Denny 2013 {published and unpublished data}
- Denny L, Hendricks B, Gordon C, Thomas F, Hezareh M, Dobbelaere, et al. Safety and immunogenicity of the HPV‐16/18 AS04‐adjuvanted vaccine in HIV‐positive women in South Africa: a partially‐blind randomised placebo controlled study. Vaccine 2013;31(48):5745‐53. [DOI] [PubMed] [Google Scholar]
- GSK 107863 (HPV‐020 PRI). Evaluation of the safety and immunogenicity of GlaxoSmithKline Biologicals' HPV vaccine 580299 (Cervarix TM) in adult human immunodeficiency virus (HIV) infected female subjects. www.gsk‐clinicalstudyregister.com/files2/gsk‐107863‐clinical‐study‐report2‐redact.pdf (accessed 16 August 2018).
- GlaxoSmithKline. Evaluation of the safety and immunogenicity of GlaxoSmithKline Biologicals' HPV vaccine 580299 (Cervarix TM) in adult human immunodeficiency virus (HIV) infected female subjects. clinicaltrials.gov/ct2/show/results/NCT00586339 (accessed 16 August 2018).
Dobson 2013 {published data only (unpublished sought but not used)}
- Dobson SR, McNeil S, Dionne M, Dawar M, Ogilvie G, Krajden M, et al. Immunogenicity of 2 doses of HPV vaccine in younger adolescents vs 3 doses in young women: a randomized clinical trial. JAMA 2013;309:1793‐802. [DOI] [PubMed] [Google Scholar]
- Krajden M, Cook D, Yu A, Chow R, Mei W, McNeil S, et al. Human papillomavirus 16 (HPV 16) and HPV 18 antibody responses measured by pseudovirus neutralization and competitive Luminex assays in a two‐ versus three‐dose HPV vaccine trial. Clinical and Vaccine Immunology 2011;18(3):418‐23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krajden M, Cook D, Yu A, Chow R, Su Q, Mei W, et al. Assessment of HPV 16 and HPV 18 antibody responses by pseudovirus neutralization, MerckcLIA and Merck total IgG LIA immunoassays in a reduced dosage quadrivalent HPV vaccine trial. Vaccine 2014;32(5):624‐30. [DOI] [PubMed] [Google Scholar]
- Ogilvie G, Sauvageau C, Dionne M, McNeil S, Krajden M, Money D, et al. Immunogenicity of 2 vs 3 doses of the quadrivalent human papillomavirus vaccine in girls aged 9 to 13 years after 60 months. JAMA 2017;317:1687‐8. [DOI] [PubMed] [Google Scholar]
Giuliano 2011 {published and unpublished data}
- Giuliano AR, Palefsky JM, Goldstone S, Moreira ED Jr, Penny ME, Aranda C, et al. Efficacy of quadrivalent HPV vaccine against HPV Infection and disease in males. New England Journal of Medicine 2011;364:401‐11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hillman RJ, Giuliano AR, Palefsky JM, Goldstone S, Moreira ED Jr, Vardas E, et al. Immunogenicity of the quadrivalent human papillomavirus (type 6/11/16/18) vaccine in males 16 to 26 years old. Clinical and Vaccine Immunology 2012;19:261‐7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merck Sharp, Dohme. An investigational vaccine in reducing the incidence of anogenital warts in young men. clinicaltrials.gov/ct2/show/results/NCT00090285 (accessed 16 August 2018).
- Moreira ED Jr, Palefsky JM, Giuliano AR, Goldstone S, Aranda C, Jessen H, et al. Safety and reactogenicity of a quadrivalent human papillomavirus (types 6, 11, 16, 18) L1 viral‐like‐particle vaccine in older adolescents and young adults. Human Vaccines 2011;7(7):768‐75. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Palefsky JM, Giuliano AR, Goldstone S, Moreira ED, Aranda C, Jessen H, et al. HPV vaccine against anal HPV infection and anal intraepithelial neoplasia. New England Journal of Medicine 2011;365:1576‐85. [DOI] [PubMed] [Google Scholar]
Hidalgo‐Tenorio 2017 {published data only (unpublished sought but not used)}
- Hidalgo‐Tenorio C, Ramirez‐Taboada J, Gil‐Anguita C, Esquivias J, Omar‐Mohamed‐Balgahata M, SamPedro A, et al. Safety and immunogenicity of the quadrivalent human papillomavirus (qHPV) vaccine in HIV‐positive Spanish men who have sex with men (MSM). AIDS Research and Therapy 2017;14:34. [DOI] [PMC free article] [PubMed] [Google Scholar]
Iversen 2016 {published and unpublished data}
- Iversen OE, Miranda MJ, Ulied A, Soerdal T, Lazarus E, Chokephaibulkit K, et al. Immunogenicity of the 9‐valent HPV vaccine using 2‐dose regimens in girls and boys vs a 3‐dose regimen in women. JAMA 2016;316:2411‐21. [DOI] [PubMed] [Google Scholar]
- Iversen OE, Miranda MJ, Ulied A, Soerdal T, Lazarus E, Chokephaibulkit K, et al. Immunogenicity of the 9‐valent HPV vaccine using 2‐dose regimens in girls and boys vs a 3‐dose regimen in women. Obstetrical and Gynecological Survey 2017;72:412‐3. [DOI] [PubMed] [Google Scholar]
- Merck Sharp, Dohme. Phase III study of a 2‐dose regimen of a multivalent human papillomavirus (HPV) vaccine (V503), administered to 9 to 14 year‐olds and compared to young women, 16 to 26 years old (V503‐010). clinicaltrials.gov/ct2/show/results/NCT01984697 (accessed 16 August 2018).
Joura 2015 {published and unpublished data}
- Bouchard C, Vuocolo S, Merck. Effect of the 9vHPV vaccine on abnormal cytology and genital procedures related to HPV31/33/45/52/58. Journal of Lower Genital Tract Disease 2014;18(5 Suppl 1):S9. [Google Scholar]
- Chen YH, Gesser R, Luxembourg A. A seamless phase IIB/III adaptive outcome trial: design rationale and implementation challenges. Clinical Trials Journal 2015;12(1):84‐90. [DOI] [PubMed] [Google Scholar]
- Guevara A, Cabello R, Woelber L, Moreira ED Jr, Joura E, Reich O, et al. Antibody persistence and evidence of immune memory at 5 years following administration of the 9‐valent HPV vaccine. Vaccine 2017;35:5050‐7. [DOI] [PubMed] [Google Scholar]
- Huh WK, Joura EA, Giuliano AR, Iversen OE, Andrade RP, Ault KA, et al. Final efficacy, immunogenicity, and safety analyses of a nine‐valent human papillomavirus vaccine in women aged 16‐26 years: a randomised, double‐blind trial. Lancet 2017;390:2143‐59. [DOI] [PubMed] [Google Scholar]
- Joura E, Garland S, Giuliano A, Bautista O, Chen J, Moeller E, et al. End of study efficacy for vulvovaginal disease of a novel 9‐valent HPV L1 virus‐like particle vaccine in 16‐26 year old women. Journal of Lower Genital Tract Disease 2015;19(3 Suppl 1):S10. [Google Scholar]
- Joura E, Giuliano A, Iversen OE, Bautista O, Chen J, Moeller E, et al. End of study efficacy and immunogenicity of a novel 9‐valent HPV L1 virus‐like particle vaccine in 16‐26 year old women. EUROGIN 2015 Abstracts: HPV Infection and Related Cancers 2015;OC6:174. [Google Scholar]
- Joura E, Vuocolo S. Efficacy of a novel 9‐valent HPV vaccine against high‐grade lesions and cancer in 16‐to 26‐year‐old women. International Journal of Gynecological Cancer 2014;24(9):S4:32. [Google Scholar]
- Joura EA. Clinical efficacy and immunogenicity of the nonavalent HPV vaccine. Acta Cytologica 2016;60:35‐6. [Google Scholar]
- Joura EA, Giuliano AR, Iverson OE, Bouchard C, Mao C, Mehlsen J, et al. A 9‐valent HPV vaccine against infection and intraepithelial neoplasia in women. New England Journal of Medicine 2015;372:711‐23. [DOI] [PubMed] [Google Scholar]
- Luxembourg A, Bautista O, Moeller E, Ritter M, Chen J. Design of a large outcome trial for a multivalent human papillomavirus L1 virus‐like particle vaccine. Contemporary Clinical Trials 2015;42:18‐25. [DOI] [PubMed] [Google Scholar]
- Mayrand MH, Bautista O, Moeller E, Ritter M, Luxembourg A. End of study efficacy, immunogenicity and safety of a novel 9‐valent HPV l1 virus‐like particle vaccine in 16‐26 year old women. International Journal of Gynecology and Obstetrics 2015;131 Suppl 5:E270. [Google Scholar]
- Merck Sharp, Dohme. A randomized, international, double‐blinded (with in‐house blinding), controlled with gardasil, dose‐ranging, tolerability, immunogenicity, and efficacy study of a multivalent human papillomavirus (HPV) L1 virus‐like particle (VLP) vaccine administered to 16‐ to 26‐ year‐old women. clinicaltrials.gov/ct2/show/results/NCT00543543 (accessed 16 August 2018).
Lehtinen 2018 {published and unpublished data}
- GSK 106636 (HPV‐040 PRI). Evaluation of the effectiveness of two vaccination strategies using GlaxoSmithKline Biologicals’ HPV vaccine GSK580299 administered in healthy adolescents. www.gsk‐clinicalstudyregister.com/study/106636?search=study&search_terms=106636#csr (accessed 25 August 2018).
- Lehtinen M, Apter D, Baussano I, Eriksson T, Natunen K, Paavonen J, et al. Characteristics of a cluster‐randomized phase IV human papillomavirus vaccination effectiveness trial. Vaccine 2015;33(10):1284‐90. [DOI] [PubMed] [Google Scholar]
- Lehtinen M, Eriksson T, Apter D, Hokkanen M, Natunen K, Paavonen J, et al. Safety of the human papillomavirus (HPV)‐16/18 AS04‐adjuvanted vaccine in adolescents aged 12–15 years: interim analysis of a large community‐randomized controlled trial. Human Vaccines & Immunotherapeutics 2016;12(12):3177‐85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lehtinen M, Soderlund‐Strand A, Vanska S, Luostarinen T, Eriksson T, Natunen K, et al. Impact of gender‐neutral or girls‐only vaccination against human papillomavirus ‐ results of a community‐randomized clinical trial (I). International Journal of Cancer 2018;142(5):949‐58. [DOI] [PubMed] [Google Scholar]
- NCT00534638. Effectiveness, safety and immunogenicity of GSK Biologicals' HPV vaccine GSK580299 (Cervarix TM) administered in healthy adolescents. clinicaltrials.gov/ct2/show/results/NCT00534638 (accessed 25 August 2018).
Leung 2015 {published and unpublished data}
- GSK 115411 (HPV‐071 PRI). Immunogenicity and safety study of GlaxoSmithKline Biologicals' HPV‐16/18 L1 AS04 vaccine and Merck's Gardasil® vaccine when administered according to alternative 2‐dose schedules in 9‐14 year old females. www.gsk‐clinicalstudyregister.com/files2/gsk‐115411‐clinical‐study‐report‐redact.pdf (accessed 16 August 2018).
- GlaxoSmithKline. Immunogenicity and safety study of GlaxoSmithKline Biologicals' HPV‐16/18 L1 AS04 vaccine and Merck's Gardasil® vaccine when administered according to alternative 2‐dose schedules in 9‐14 year old females. clinicaltrials.gov/ct2/show/results/NCT01462357 (accessed 16 August 2018).
- Leung TF, Liu AP, Lim FS, Thollot F, Oh HM, Lee BW, et al. Comparative immunogenicity and safety of human papillomavirus (HPV)‐16/18 AS04‐adjuvanted vaccine and HPV‐6/11/16/18 vaccine administered according to 2‐and 3‐dose schedules in girls aged 9‐14 years: results to month 12 from a randomized trial. Human Vaccines & Immunotherapeutics 2015;11:1689‐702. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leung TF, Liu AP, Lim FS, Thollot F, Oh HML, Lee BW, et al. Comparative immunogenicity and safety of human papillomavirus (HPV)‐16/18 AS04‐adjuvanted vaccine and 4vHPV vaccine administered according to two‐ or three‐dose schedules in girls aged 9‐14 years: results to month 36 from a randomized trial. Vaccine 2018;36:98‐106. [DOI] [PubMed] [Google Scholar]
Levin 2010 {published data only (unpublished sought but not used)}
- Levin MJ, Huang S, Moscicki AB, Song LY, Read JS, Meyer WA, et al. Four‐year persistence of type‐specific immunity after quadrivalent human papillomavirus vaccination in HIV‐infected children: effect of a fourth dose of vaccine. Vaccine 2018;35(13):1712‐20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levin MJ, Moscicki AB, Song L‐Y, Fenton T, Meyer WA, Read JS, et al. Safety and immunogenicity of a quadrivalent human papillomavirus (types 6, 11, 16, and 18) vaccine in HIV‐infected children 7 to 12 years old. Journal of Acquired Immune Deficiency Syndromes 2010;55(2):197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weinberg A, Song L‐Y, Saah A, Brown M, Moscicki AB, Meyer WA, et al. Humoral, mucosal, and cell‐mediated immunity against vaccine and nonvaccine genotypes after administration of quadrivalent human papillomavirus vaccine to HIV‐infected children. Journal of Infectious Diseases 2012;206(8):1309‐18. [DOI] [PMC free article] [PubMed] [Google Scholar]
Lin 2014 {published and unpublished data}
- Lin CJ, Zimmerman RK, Nowalk MP, Huang HH, Raviotta JM. Randomized controlled trial of two dosing schedules for human papillomavirus vaccination among college age males. Vaccine 2014;32:693‐9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merck Sharp, Dohme. Randomized trial of alternative HPV vaccination schedules in males in a university setting. clinicaltrials.gov/ct2/show/results/NCT01184079 (accessed 16 August 2018).
- Wu RF, Zimmerman RK, Lin CJ. The effect of perceived psychological stress on the immunogenicity of the quadrivalent human papillomavirus vaccine in males. Human Vaccines & Immunotherapeutics 2017;13:676‐9. [DOI] [PMC free article] [PubMed] [Google Scholar]
NCT00941889 2016 {unpublished data only}
- NCT00941889. The effect of HPV vaccination on recurrence rates in HIV patients with condylomata. clinicaltrials.gov/ct2/show/results/NCT00941889?view=results (accessed 27 August 2018).
NCT01031069 2017 {unpublished data only}
- GlaxoSmithKline. Safety and immunogenicity of Cervarix™ in human immunodeficiency virus infected females. www.gsk‐clinicalstudyregister.com/files2/109823‐clinical‐study‐result‐summary.pdf (accessed 27 August 2018).
- NCT01031069. Evaluation of safety and immunogenicity of a human papillomavirus (HPV) vaccine in human immunodeficiency virus (HIV) infected females. clinicaltrials.gov/ct2/show/NCT01031069 (accessed on 27 August 2018).
NCT01862874 2018 {published data only}
- NCT01862874. Efficacy and tolerability study of V501 in Japanese males (V501‐122). clinicaltrials.gov/ct2/show/NCT01862874 (accessed 27 August 2018).
Petaja 2009 {published and unpublished data}
- GSK 580299/011 (HPV‐011). A phase I/II, observer‐blind, randomized, controlled study to assess the immunogenicity and safety of GlaxoSmithKline Biologicals' HPV‐16/18 L1 VLP AS04 vaccine administered intramuscularly according to a 0, 1, 6 month schedule in healthy male subjects aged 10‐18 years. www.gsk‐clinicalstudyregister.com/files2/gsk‐580299‐011‐clinical‐study‐report‐redact.pdf (accessed 16 August 2018).
- Petäjä T, Keränen H, Karppa T, Kawa A, Lantela S, Siitari‐Mattila M, et al. Immunogenicity and safety of human papillomavirus (HPV)‐16/18 AS04‐adjuvanted vaccine in healthy boys aged 10‐18 years. Journal of Adolescent Health 2009;44(1):33‐40. [DOI] [PubMed] [Google Scholar]
Puthanakit 2016 {published and unpublished data}
- GSK 114700 (HPV‐070 PRI). Immunogenicity and safety study of GlaxoSmithKline Biologicals' HPV‐16/18 L1 AS04 vaccine when administered according to alternative 2‐dose schedules in 9‐14 year old females. www.gsk‐clinicalstudyregister.com/files2/gsk‐114700‐clinical‐study‐report‐redact.pdf (accessed 16 August 2018).
- GlaxoSmithKline. Immunogenicity and safety study of GlaxoSmithKline Biologicals' HPV‐16/18 L1 AS04 vaccine when administered according to alternative 2‐dose schedules in 9‐14 year old females. clinicaltrials.gov/ct2/show/results/NCT01381575 (accessed 16 August 2018).
- Huang LM, Puthanakit T, Cheng‐Hsun C, Ren‐Bin T, Schwarz T, Pellegrino A, et al. Sustained immunogenicity of 2‐dose human papillomavirus 16/18 AS04‐adjuvanted vaccine schedules in girls aged 9‐14 years: a randomized trial. Journal of Infectious Diseases 2017;215:1711‐9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Puthanakit T, Huang LM, Chiu CH, Tang RB, Schwarz TF, Esposito S, et al. Randomized open trial comparing 2‐dose regimens of the human papillomavirus 16/18 AS04‐adjuvanted vaccine in girls aged 9‐14 years versus a 3‐dose regimen in women aged 15‐25 years. Journal of Infectious Diseases 2016;214:525‐36. [DOI] [PMC free article] [PubMed] [Google Scholar]
Romanowski 2011 {published and unpublished data}
- GSK 110659 (HPV‐048 PRI). Evaluation of the safety and immunogenicity of GSK Biologicals' HPV vaccine 580299 when administered in healthy females aged 9‐25 years using an alternative schedule and an alternative dosing as compared to the standard schedule and dosing. www.gsk‐clinicalstudyregister.com/files2/gsk‐110659‐clinical‐study‐report‐redact.pdf (accessed 16 August 2018).
- GlaxoSmithKline. Evaluation of the safety and immunogenicity of GSK Biologicals' HPV vaccine 580299 when administered in healthy females aged 9‐25 years using an alternative schedule and an alternative dosing as compared to the standard schedule and dosing. clinicaltrials.gov/ct2/show/results/NCT00541970 (accessed 16 August 2018).
- Romanowski B, Schwarz TF, Ferguson L, Peters K, Dionne M, Behre U, et al. Sustained immunogenicity of the HPV‐16/18 AS04‐adjuvanted vaccine administered as a two‐dose schedule in adolescent girls: five‐year clinical data and modelling predictions from a randomized study. Human Vaccines & Immunotherapeutics 2016;12:20‐9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Romanowski B, Schwarz TF, Ferguson LM, Ferguson M, Peters K, Dionne M, et al. Immune response to the HPV‐16/18 AS04‐adjuvanted vaccine administered as a 2‐dose or 3‐dose schedule up to 4 years after vaccination: results from a randomized study. Human Vaccines & Immunotherapeutics 2014;10:1155‐65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Romanowski B, Schwarz TF, Ferguson LM, Peters K, Dionne M, Schulze K, et al. Immunogenicity and safety of the HPV‐16/18 AS04‐adjuvanted vaccine administered as a 2‐dose schedule compared with the licensed 3‐dose schedule: results from a randomized study. Human Vaccines 2011;7:1374‐86. [DOI] [PMC free article] [PubMed] [Google Scholar]
Toft 2014 {published data only (unpublished sought but not used)}
- Faust H, Toft L, Sehr P, Müller M, Bonde J, Forslund O, et al. Human papillomavirus neutralizing and cross‐reactive antibodies induced in HIV‐positive subjects after vaccination with quadrivalent and bivalent HPV vaccines. Vaccine 2016;34(13):1559‐65. [DOI] [PubMed] [Google Scholar]
- Toft L, Storgaard M, Muller M, Sehr P, Bonde J, Tolstrup M, et al. Immunogenicity and reactogenicity of Cervarix versus Gardasil in HIV‐infected adults: an RCT. Topics in Antiviral Medicine 2014;22(e‐1):174‐5. [Google Scholar]
- Toft L, Storgaard M, Müller M, Sehr P, Bonde J, Tolstrup M, et al. Comparison of the immunogenicity and reactogenicity of Cervarix and Gardasil human papillomavirus vaccines in HIV‐infected adults: a randomized, double‐blind clinical trial. Journal of Infectious Diseases 2014;209(8):1165‐73. [DOI] [PubMed] [Google Scholar]
- Toft L, Tolstrup M, Müller M, Sehr P, Bonde J, Storgaard M, et al. Comparison of the immunogenicity of Cervarix® and Gardasil® human papillomavirus vaccines for oncogenic non‐vaccine serotypes HPV‐31, HPV‐33, and HPV‐45 in HIV‐infected adults. Human Vaccines & Immunotherapeutics 2014;10(5):1147‐54. [DOI] [PMC free article] [PubMed] [Google Scholar]
van Damme 2016 {published data only (unpublished sought but not used)}
- Damme P, Meijer CJ, Kieninger D, Schuyleman A, Thomas S, Luxembourg A, et al. A phase III clinical study to compare the immunogenicity and safety of the 9‐valent and quadrivalent HPV vaccines in men. Vaccine 2016;34:4205‐12. [DOI] [PubMed] [Google Scholar]
Vesikari 2015 {published and unpublished data}
- Merck Sharp, Dohme. A randomized, double‐blinded, controlled with GARDASIL (human papillomavirus vaccine [types 6, 11, 16, 18] (recombinant, adsorbed)), Phase III clinical trial to study the immunogenicity and tolerability of V503 (9‐valent human papillomavirus (HPV) vaccine) in preadolescent and adolescent girls (9‐ to 15‐year‐old). clinicaltrials.gov/ct2/show/results/NCT01304498 (accessed 16 August 2018).
- Vesikari T, Brodszki N, Damme P, Diez‐Domingo J, Icardi G, Petersen LK, et al. A randomized, double‐blind, phase III study of the immunogenicity and safety of a 9‐valent human papillomavirus L1 virus‐like particle vaccine (V503) versus Gardasil® in 9–15‐year‐old girls. Pediatric Infectious Disease Journal 2015;34:992‐8. [DOI] [PubMed] [Google Scholar]
Wilkin 2018 {published and unpublished data}
- Cranston R, Yang M, Paczuski P, Cespedes M, Chiao E, Webster‐Cyriaque J, et al. Baseline data of a Phase 3 trial of the quadrivalent HPV vaccine in HIV+ males and females: ACTG 5298. Topics in Antiviral Medicine 2014;22:364. [Google Scholar]
- NCT01461096. Quadrivalent HPV vaccine to prevent anal HPV in HIV‐infected men and women. clinicaltrials.gov/ct2/show/results/NCT01461096 (accessed 27 August 2018).
- Wilkin TJ, Chen H, Cespedes M, Paczuski P, Godfrey C, Chiao E, et al. ACTG A5298: a phase 3 trial of the quadrivalent HPV vaccine in older HIV+ adults. Topics in Antiviral Medicine 2018;24(E‐1):65‐6. [Google Scholar]
- Wilkin TJ, Chen H, Cespedes MS, Leon‐Cruz JT, Godfrey C, Chiao EY, et al. A randomized, placebo‐controlled trial of the quadrivalent HPV vaccine in HIV‐infected adults age 27 years or older: AIDS Clinical Trials Group protocol A5298. Clinical Infectious Diseases 2018;67(9):1339‐46. [DOI] [PMC free article] [PubMed] [Google Scholar]
References to studies excluded from this review
Beachler 2016 {published data only}
- Beachler D, Kreimer A, Schiffman M, Herrero R, Wacholder S, Rodriguez A, et al. Multisite HPV16/18 vaccine efficacy against cervical, anal, and oral HPV infection. Journal of the National Cancer Institute 2016;108(1):djv302. [DOI] [PMC free article] [PubMed] [Google Scholar]
Bhatia 2016 {published data only}
- Bhatia R, Kavanagh K, Cubie HA, Serrano I, Wennington H, Hopkins M, et al. Use of HPV testing for cervical screening in vaccinated women – insights from the SHEVa (Scottish HPV Prevalence in Vaccinated Women) study. International Journal of Cancer 2016;138(12):2922‐31. [DOI] [PubMed] [Google Scholar]
Bianchi 2016 {published data only}
- Bianchi S, Boveri S, Igidbashian S, Amendola A, Urbinati AM, Frati ER, et al. Chlamydia trachomatis infection and HPV/Chlamydia trachomatis coinfection among HPV‐vaccinated young women at the beginning of their sexual activity. Archives of Gynecology and Obstetrics 2016;294(6):1227‐33. [DOI] [PubMed] [Google Scholar]
Brown 2012 {published data only}
- Brown B, Blas M, Cabral A, Carcamo C, Gravitt P, Halsey N. Randomized trial of HPV4 vaccine assessing the response to HPV4 vaccine in two schedules among Peruvian female sex workers. Vaccine 2012;30(13):2309–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
Canfell 2017 {published data only}
- Canfell K, Caruana M, Gebski V, Darlington‐Brown J, Heley S, Brotherton J, et al. Cervical screening with primary HPV testing or cytology in a population of women in which those aged 33 years or younger had previously been offered HPV vaccination: results of the Compass pilot randomised trial. PLOS Medicine 2017;14(9):e1002388. [DOI] [PMC free article] [PubMed] [Google Scholar]
Carozzi 2016 {published data only}
- Carozzi FM, Ocello C, Burroni E, Faust H, Zappa M, Paci E, et al. Effectivenessof HPV vaccination in women reaching screening age in Italy. Journal of Clinical Virology 2016;84:74‐81. [DOI] [PubMed] [Google Scholar]
Choudhury 2016 {published data only}
- Choudhury SA, Choudhury NA, Humphrey AD, Berthaud V, Ladson G, Tucker VA, et al. Higher prevalence of human papillomavirus‐related cervical precancerous abnormalities in HIV‐infected compared to HIV‐uninfected women. Journal of the National Medical Association 2016;108(1):19‐23. [DOI] [PMC free article] [PubMed] [Google Scholar]
Esposito 2011 {published data only}
- Esposito S, Birlutiu V, Jarcuska P, Perino A, Man SC, Vladareanu R, et al. Immunogenicity and safety of human papillomavirus‐16/18 AS04‐adjuvanted vaccine administered according to an alternative dosing schedule compared with the standard dosing schedule in healthy women aged 15 to 25 years: results from a randomized study. Pediatric Infectious Disease Journal 2011;30(3):e49‐55. [DOI] [PubMed] [Google Scholar]
Flagg 2018 {published data only}
- Flagg EW, Torrone EA. Declines in anogenital warts among age groups most likely to be impacted by human papillomavirus vaccination, United States, 2006‐2014. American Journal of Public Health 2018;108(1):112‐9. [DOI] [PMC free article] [PubMed] [Google Scholar]
Garland 2016 {published data only}
- Garland SM, Paavonen J, Jaisamrarn U, Naud P, Salmeron J, Chow SN, et al. Prior human papillomavirus‐16/18 AS04‐adjuvanted vaccination prevents recurrent high grade cervical intraepithelial neoplasia after definitive surgical therapy: post‐hoc analysis from a randomized controlled trial. International Journal of Cancer 2016;139(12):2812‐26. [DOI] [PMC free article] [PubMed] [Google Scholar]
Gilca 2015 {published data only}
- Gilca V, Sauvageau C, Boulianne N, Serres G, Crajden M, Ouakki M, et al. The effect of a booster dose of quadrivalent or bivalent HPV vaccine when administered to girls previously vaccinated with two doses of quadrivalent HPV vaccine. Human Vaccines & Immunotherapeutics 2015;11(3):732‐8. [DOI] [PMC free article] [PubMed] [Google Scholar]
Hamsikova 2017 {published data only}
- Hamsikova E, Smahelova J, Ludvikova V, Salakova M, Rychla J, Skrenkova J, et al. The prevalence of HPV infections in HPV‐vaccinated women from the general population. Apmis 2017;125(6):585‐95. [DOI] [PubMed] [Google Scholar]
Harari 2016 {published data only}
- Harari A, Chen Z, Rodríguez A, Hildesheim A, Porras C, Herrero R, et al. Crossprotection of the bivalent human papillomavirus (HPV) vaccine against variants of genetically related high‐risk HPV infections. Journal of Infectious Diseases 2016;213(6):939‐47. [DOI] [PMC free article] [PubMed] [Google Scholar]
Haskins‐Coulter 2017 {published data only}
- Haskins‐Coulter T, Southern J, Andrews N, Miller E. Reactogenicity of Cervarix and Gardasil human papillomavirus (HPV) vaccines in a randomized single blind trial in healthy UK adolescent females. Human Vaccines & Immunotherapeutics 2017;13(6):1‐9. [DOI] [PMC free article] [PubMed] [Google Scholar]
Lamontagne 2013 {published data only}
- Lamontagne DS, Thiem VD, Huong VM, Tang Y, Neuzil KM. Immunogenicity of quadrivalent HPV vaccine among girls 11 to 13 years of age vaccinated using alternative dosing schedules: results 29 to 32 months after third dose. Journal of Infectious Diseases 2013;208(8):1325‐34. [DOI] [PubMed] [Google Scholar]
Lehtinen 2017 {published data only}
- Lehtinen M, Lagheden C, Luostarinen T, Eriksson T, Apter D, Harjula K, et al. Ten‐year follow‐up of human papillomavirus vaccine efficacy against the most stringent cervical neoplasia end‐point‐registry‐based follow‐up of three cohorts from randomized trials. BMJ Open 2017;7(8):e015867. [DOI] [PMC free article] [PubMed] [Google Scholar]
Luxembourg 2017 {published data only}
- Luxembourg A, Kjaer SK, Nygard M, Ellison MC, Group T, Marshall JB, et al. Design of a long‐term follow‐up effectiveness, immunogenicity and safety study of women who received the 9‐valent human papillomavirus vaccine. Contemporary Clinical Trials 2017;52:54‐61. [DOI] [PubMed] [Google Scholar]
Money 2016 {published data only}
- Money DM, Moses E, Blitz S, Vandriel SM, Lipsky N, Walmsley SL, et al. HIV viral suppression results in higher antibody responses in HIV‐positive women vaccinated with the quadrivalent human papillomavirus vaccine. Vaccine 2016;34(40):4799‐806. [DOI] [PubMed] [Google Scholar]
Neuzil 2011 {published data only}
- Neuzil KM, Thiem VD, Janmohamed A, Huong VM, Tang Y, Diep NT, et al. Immunogenicity and reactogenicity of alternative schedules of HPV vaccine in Vietnam: a cluster randomized noninferiority trial. JAMA 2011;305(14):1424‐31. [DOI] [PubMed] [Google Scholar]
Wheeler 2016 {published data only}
- Wheeler CM, Skinner SR, Rosario‐Raymundo MR, Garland SM, Chatterjee A, Lazcano‐Ponce E, et al. Efficacy, safety, and immunogenicity of the human papillomavirus 16/18 AS04‐adjuvanted vaccine in women older than 25 years: 7‐year follow‐up of the phase 3, double‐blind, randomised controlled VIVIANE study. Lancet Infectious Diseases 2016;16(10):1154‐68. [DOI] [PubMed] [Google Scholar]
Zhu 2017 {published data only}
- Zhu FC, Hu SY, Hong Y, Hu YM, Zhang X, Zhang YJ, et al. Efficacy, immunogenicity, and safety of the HPV‐16/18 AS04‐adjuvanted vaccine in Chinese women aged 18‐25 years: event‐triggered analysis of a randomized controlled trial. Cancer Medicine 2017;6(1):12‐25. [DOI] [PMC free article] [PubMed] [Google Scholar]
Zimmerman 2010 {published data only}
- Zimmerman RK, Nowalk MP, Lin CJ, Fox DE, Ko FS, Wettick E, et al. Randomized trial of an alternate human papillomavirus vaccine administration schedule in college‐aged women. Journal of Women's Health 2010;19(8):1441‐7. [DOI] [PubMed] [Google Scholar]
References to studies awaiting assessment
Li 2012 {published data only (unpublished sought but not used)}
- Huang T, Liu Y, Li Y, Liao Y, Shou Q, Zheng M, et al. Evaluation on the persistence of anti‐HPV immune responses to the quadrivalent HPV vaccine in Chinese females and males: Up to 3.5 years of follow‐up. Vaccine 2018;36(11):1368‐1374. [DOI] [PubMed] [Google Scholar]
- Li R, Li Y, Radley D, Liu Y, Huang T, Sings HL, et al. Safety and immunogenicity of a vaccine targeting human papillomavirus types 6, 11, 16 and 18: a randomized, double‐blind, placebo‐controlled trial in Chinese males and females. Vaccine 2012;30(28):4284‐91. [DOI] [PubMed] [Google Scholar]
Reisinger 2007 {published data only (unpublished sought but not used)}
- Ferris D, Samakoses R, Block SL, Lazcano‐Ponce E, Restrepo JA, Reisinger KS, et al. Long‐term study of a quadrivalent human papillomavirus vaccine. Pediatrics 2014;134(3):e657‐65. [DOI] [PubMed] [Google Scholar]
- Ferris DG, Samakoses R, Block SL, Lazcano‐Ponce E, Restrepo JA, Mehlsen J, et al. 4‐Valent Human Papillomavirus (4vHPV) Vaccine in Preadolescents and Adolescents After 10 Years. Pediatrics 2017;140(6):pii: e20163947. [DOI] [PubMed] [Google Scholar]
- Reisinger KS, Block SL, Lazcano‐Ponce E, Samakoses R, Esser MT, Erick J, et al. Safety and persistent immunogenicity of a quadrivalent human papillomavirus types 6, 11, 16, 18L1 virus‐like particle vaccine in preadolescents and adolescents: a randomized controlled trial. Pediatr Infect Dis J 2007;26(3):201‐9. [DOI] [PubMed] [Google Scholar]
References to ongoing studies
NCT01735006 {published data only}
- NCT01735006. Efficacy and immunogenicity study of recombinant human papillomavirus bivalent (type 16/18) vaccine. clinicaltrials.gov/ct2/show/NCT01735006 (accessed 27 August 2018).
NCT01824537 {published data only}
- NCT01824537. Transmission reduction and prevention with HPV vaccination (TRAP‐HPV) study (TRAP‐HPV). clinicaltrials.gov/ct2/show/NCT01824537 (accessed 27 August 2018).
NCT02009800 {published data only}
- NCT02009800. ICI‐VPH: impact of HPV immunisation schedules against HPV (ICI‐VPH). clinicaltrials.gov/ct2/show/NCT02009800 (accessed 27 August 2018).
NCT02087384 {published data only}
- NCT02087384. HPV (human papilloma virus) vaccination after treatment of anal intraepithelial neoplasia (AIN) (VACCAIN‐P). clinicaltrials.gov/ct2/show/NCT02087384 (accessed 27 August 2018).
NCT02405520 {published data only}
- NCT02405520. Safety and immunogenicity study of the recombinant human papillomavirus virus type 6/11 bivalent vaccine. clinicaltrials.gov/ct2/show/NCT02405520 (accessed on 27 August 2018).
NCT02562508 {published data only}
- NCT02562508. A bridging study of a recombinant human papillomavirus 16/18 bivalent vaccine in preadolescent girls. clinicaltrials.gov/ct2/show/NCT02562508 (accessed 27 August 2018).
NCT02567955 {published data only}
- NCT02567955. Immunogenicity and safety of Gardasil‐9 and Cervarix. clinicaltrials.gov/ct2/show/NCT02567955 (accessed on 27 August 2018).
NCT02710851 {published data only}
- NCT02710851. Immunogenicity study of the recombinant human papillomavirus virus type 6/11 bivalent vaccine. clinicaltrials.gov/ct2/show/NCT02710851 (accessed on 27 August 2018).
NCT02733068 {published data only}
- NCT02733068. A phase III study of human papillomavirus (HPV)‐16/18 vaccine. clinicaltrials.gov/ct2/show/NCT02733068 (accessed 27 August 2018).
NCT02740777 {published data only}
- NCT02740777. Evaluating the 2‐dose immunization schedule of human papillomavirus (HPV)‐16/18 in adolescent females. clinicaltrials.gov/ct2/show/NCT02740777 (accessed 27 August 2018).
NCT02750202 {published data only}
- NCT02750202. Effectiveness study of human papilloma virus (HPV) vaccines to prevent recurrence of genital warts (TheraVACCS). clinicaltrials.gov/ct2/show/NCT02750202 (accessed on 27 August 2018).
NCT02834637 {published data only}
- NCT02834637. A dose reduction immunobridging and safety study of two HPV vaccines in Tanzanian girls (DoRIS). clinicaltrials.gov/ct2/show/NCT02834637 (accessed 27 August 2018).
NCT02888418 {published data only}
- NCT02888418. Safety and immunogenicity study of human papilloma virus vaccine in women aged 9 to 30 and men aged 9 to 17. clinicaltrials.gov/ct2/show/NCT02888418 (accessed 27 August 2018).
NCT03180034 {published data only}
- NCT03180034. Scientific evaluation of one or two doses of the bivalent or nonavalent prophylactic HPV vaccines. https://clinicaltrials.gov/ct2/show/NCT03180034 (accessed on 27 August 2018) 2017.
- Sampson JN, Hildesheim A, Herrero R, Gonzalez P, Kreimer AR, Gail MH. Design and statistical considerations for studies evaluating the efficacy of a single dose of the human papillomavirus (HPV) vaccine. Contemporary Clinical Trials 2018;68:35‐44. [DOI] [PMC free article] [PubMed] [Google Scholar]
NCT03296397 {published data only}
- NCT03296397. Efficacy of quadrivalent HPV vaccine to prevent relapses of genital warts after initial therapeutic response (CONDYVAC). clinicaltrials.gov/ct2/show/NCT03296397 (accessed 27 August 2018).
Additional references
Alemany 2014
- Alemany L, Saunier M, Tinoco L, Quiros B, Alvarado‐Cabrero I, Alejo M, et al on behalf of the HPV VVAP study group. Large contribution of human papillomavirus in vaginal neoplastic lesions: a worldwide study in 597 samples. European Journal of Cancer 2014;50:2846‐54. [DOI] [PubMed] [Google Scholar]
Arbyn 2018
- Arbyn M, Xu L, Simoens C, Martin‐Hirsch PP. Prophylactic vaccination against human papillomaviruses to prevent cervical cancer and its precursors. Cochrane Database of Systematic Reviews 2018, Issue 5. [DOI: 10.1002/14651858.CD009069.pub3] [DOI] [PMC free article] [PubMed] [Google Scholar]
Block 2006
- Block SL, Nolan T, Sattler C, Barr E, Giacoletti KE, Marchant CD, et al. Comparison of the immunogenicity and reactogenicity of a prophylactic quadrivalent human papillomavirus (types 6, 11, 16, and 18) L1 virus‐like particle vaccine in male and female adolescents and young adult women. Pediatrics 2006;118(5):2135‐45. [DOI] [PubMed] [Google Scholar]
Bogaards 2015
- Bogaards JA, Wallinga J, Brakenhoff RH, Meijer CJ, Berkhof J. Direct benefit of vaccinating boys along with girls against oncogenic human papillomavirus: bayesian evidence synthesis. BMJ 2015;350:h2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
Bonhoeffer 2002
- Bonhoeffer J, Kohl K, Chen R, Duclos P, Heijbel H, Heininger U, et al: The Brighton Colloaboration. The Brighton Collaboration: addressing the need for standardized case definitions of adverse events following immunization (AEFI). Vaccine 2002;21:298‐302. [DOI] [PubMed] [Google Scholar]
Bosch 2002
- Bosch FX, Lorincz A, Munoz N, Meijer CJ, Shah KV. The causal relation between human papillomavirus and cervical cancer. Journal of Clinical Pathology 2002;55:244‐65. [DOI] [PMC free article] [PubMed] [Google Scholar]
Bouvard 2009
- Bouvard V, Baan R, Straif K, Grosse Y, Secretan B, Ghissassi F, et al: WHO International Agency for Research on Cancer Monograph Working Group. A review of human carcinogens‐‐Part B: biological agents. Lancet Oncology 2009;10(4):321‐2. [DOI] [PubMed] [Google Scholar]
Bradburn 2007
- Bradburn MJ, Deeks JJ, Berlin JA, Russell Localio A. Much ado about nothing: a comparison of the performance of meta‐analytical methods with rare events. Statistics in Medicine 2007;26(1):53‐77. [DOI] [PubMed] [Google Scholar]
Brotherton 2018
- Brotherton JM, Bloem PN. Population‐based HPV vaccination programmes are safe and effective: 2017 update and the impetus for achieving better global coverage. Best Practice & Research. Clinical Obstetrics & Gynaecology 2018;47:42‐58. [DOI] [PubMed] [Google Scholar]
Bruni 2010
- Bruni L, Diaz M, Castellsagué X, Ferrer E, Bosch FX, Sanjosé S. Cervical human papillomavirus prevalence in 5 continents: meta‐analysis of 1 million women with normal cytological findings. The Journal of Infectious Diseases 2010;202(12):1789‐99. [DOI] [PubMed] [Google Scholar]
de Martel 2017
- Martel C, Plummer M, Vignat J, Franceschi S. Worldwide burden of cancer attributable to HPV by site, country and HPV type. International Journal of Cancer 2017;141(4):664‐70. [DOI] [PMC free article] [PubMed] [Google Scholar]
de Sanjose 2010
- Sanjose S, Quint WG, Alemany L, Geraets DT, Klaustermeier JE, Lloveras B, et al on behalf of the Retrospective International Survey and HPV Time Trends Study Group. Human papillomavirus genotype attribution in invasive cervical cancer: a retrospective cross‐sectional worldwide study. Lancet Oncology 2010;11:1048‐56. [DOI] [PubMed] [Google Scholar]
DerSimonian 1986
- DerSimonian R, Laird N. Meta‐analysis in clinical trials. Controlled Clinical Trials 1986;7(3):177‐88. [DOI] [PubMed] [Google Scholar]
Djurisic 2017
- Djurisic S, Jakobsen JC, Petersen SB, Kenfelt M, Gluud C. Aluminium adjuvants used in vaccines versus placebo or no intervention. Cochrane Database of Systematic Reviews 2017, Issue 9. [DOI: 10.1002/14651858.CD012805] [DOI] [Google Scholar]
Donken 2015
- Donken R, Knol MJ, Bogaards JA, Klis FR, Meijer CJ, Melker HE. Inconclusive evidence for non‐inferior immunogenicity of two‐ compared with three‐dose HPV immunization schedules in preadolescent girls: a systematic review and meta‐analysis. Journal of Infection 2015;71:61‐73. [DOI] [PubMed] [Google Scholar]
Drolet 2019
- Drolet M, Bénard É, Pérez N, Brisson M, on behalf of the HPV Vaccination Impact Study Group. Population‐level impact and herd effects following the introduction of human papillomavirus vaccination programmes: updated systematic review and meta‐analysis. Lancet 2019;pii: S0140‐6736(19):30298‐3. [DOI] [PMC free article] [PubMed] [Google Scholar]
Gallagher 2018
- Gallagher KE, LaMontagne DS, Watson‐Jones D. Status of HPV vaccine introduction and barriers to country uptake. Vaccine 2018;36(32 Pt A):4761‐7. [DOI] [PubMed] [Google Scholar]
Gillison 2015
- Gillison ML, Chaturvedi AK, Anderson WF, Fakhry C. Epidemiology of human papillomavirus‐positive head and neck squamous cell carcinoma. Journal of Clinical Oncology 2015;33(29):3235‐42. [DOI] [PMC free article] [PubMed] [Google Scholar]
GRADEpro GDT [Computer program]
- McMaster University (developed by Evidence Prime). GRADEpro GDT. Version accessed 27 August 2018. McMaster University (developed by Evidence Prime), 2015.
Greer 1995
- Greer CE, Wheeler CM, Ladner MB, Beutner K, Coyne MY, Liang H, et al. Human papillomavirus (HPV) type distribution and serological response to HPV type 6 virus‐like particles in patients with genital warts. Journal of Clinical Microbiology 1995;33:2058‐63. [DOI] [PMC free article] [PubMed] [Google Scholar]
Guyatt 2011a
- Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso‐Coello P, et al. GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias). Journal of Clinical Epidemiology 2011;64(4):407‐15. [DOI] [PubMed] [Google Scholar]
Guyatt 2011b
- Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfland M, et al. GRADE guidelines: 7. Rating the quality of evidence—inconsistency. Journal of Clinical Epidemiology 2011;64(12):1294‐302. [DOI] [PubMed] [Google Scholar]
Guyatt 2011c
- Guyatt GH, Oxman AD, Montori M, Vist G, Kunz R, Brozek J, et al. GRADE guidelines: 5. Rating the quality of evidence — publication bias. Journal of Clinical Epidemiology 2011;64(12):1277‐82. [DOI] [PubMed] [Google Scholar]
Guyatt 2011d
- Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. Journal of Clinical Epidemiology 2011;64(4):383‐94. [DOI] [PubMed] [Google Scholar]
Higgins 2011a
- Higgins JP, Green S, editor(s). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011. Available from handbook.cochrane.org.
Higgins 2011b
- Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928. [DOI] [PMC free article] [PubMed] [Google Scholar]
Higgins 2017
- Higgins JP, Altman DG, Sterne JA, editor(s). Chapter 8: Assessing risk of bias in included studies. In: Higgins JP, Churchill R, Chandler J, Cumpston MS, editor(s), Cochrane Handbook for Systematic Reviews of Interventions version 5.2.0 (updated June 2017), The Cochrane Collaboration, 2017. Available from www.training.cochrane.org/handbook.
HogenEsch 2018
- HogenEsch H, O'Hagan DT, Fox CB. Optimizing the utilization of aluminum adjuvants in vaccines: you might just get what you want. npj Vaccines 2018;3:51. [DOI] [PMC free article] [PubMed] [Google Scholar]
Huang 2011
- Huang HY, Andrews E, Jones J, Skovron ML, Tilson H. Pitfalls in meta‐analyses on adverse events reported from clinical trials. Pharmacoepidemiology and drug safety 2011;20:1014‐20. [DOI] [PubMed] [Google Scholar]
IARC 2014
- International Agency for Research in Cancer. Primary End‐points for Prophylactic HPV Vaccine Trials. IARC Working Group Report. World Health Organization International Agency for Research on Cancer, 2014. [PubMed] [Google Scholar]
Ioannidis 2004
- Ioannidis JP, Evans SJ, Gøtzsche PC, O'Neill RT, Altman DG, Schulz K, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Annals of Internal Medicine 2004;141(10):781‐8. [DOI] [PubMed] [Google Scholar]
Jefferson 2004
- Jefferson T, Rudin M, Pietrantonj C. Adverse events after immunisation with aluminium‐containing DTP vaccines: systematic review of the evidence. Lancet Infectious Diseases 2004;4(2):84‐90. [DOI] [PubMed] [Google Scholar]
Jørgensen 2018a
- Jørgensen L, Gøtzsche PC, Jefferson T. Index of the human papillomavirus (HPV) vaccine industry clinical study programmes and non‐industry funded studies: a necessary basis to address reporting bias in a systematic review. Systematic Reviews 2018;7(1):8. [DOI] [PMC free article] [PubMed] [Google Scholar]
Jørgensen 2018b
- Jørgensen L, Gøtzsche PC, Jefferson T. The Cochrane HPV vaccine review was incomplete and ignored important evidence of bias. BMJ Evidence‐Based Medicine 2018;23:165‐8. [DOI] [PubMed] [Google Scholar]
Kreimer 2011
- Kreimer AR, Rodriguez AC, Hildesheim A, Herrero R, Porras C, Schiffman M, et al. Proof‐of‐principle evaluation of the efficacy of fewer than three doses of a bivalent HPV16/18 vaccine. Journal of the National Cancer Institute 2011;103(19):1444‐51. [DOI] [PMC free article] [PubMed] [Google Scholar]
Kreimer 2015
- Kreimer AR, Struyf F, Rosario‐Raymundo MR, Hildesheim A, Skinner SR, Wacholder S, et al. Efficacy of fewer than three doses of an HPV‐16/18 AS04‐adjuvanted vaccine: combined analysis of data from the Costa Rica Vaccine and PATRICIA trials. Lancet Oncology 2015;16(7):775‐86. [DOI] [PMC free article] [PubMed] [Google Scholar]
Krustrup 2009
- Krustrup D, Jensen HL, Brule AJ, Frisch M. Histological characteristics of human papilloma‐virus‐positive and‐negative invasive and in situ squamous cell tumours of the penis. International Journal of Experimental Pathology 2009;90:182‐9. [DOI] [PMC free article] [PubMed] [Google Scholar]
LaMontagne 2017
- LaMontagne DS, Bloem PJ, Brotherton JM, Gallagher KE, Badiane O, Ndiaye C. Progress in HPV vaccination in low‐ and lower‐middle‐income countries. International Journal of Gynecology & Obstetrics 2017;138:7‐14. [DOI] [PubMed] [Google Scholar]
Lineberry 2016
- Lineberry N, Berlin JA, Mansi B, Glasser S, Berkwits M, Klem C, et al. Recommendations to improve adverse event reporting in clinical trial publications: a joint pharmaceutical industry/journal editor perspective. BMJ 2016;355:i5078. [DOI] [PubMed] [Google Scholar]
Lundh 2017
- Lundh A, Lexchin J, Mintzes B, Schroll JB, Bero L. Industry sponsorship and research outcome. Cochrane Database of Systematic Reviews 2017, Issue 2. [DOI: 10.1002/14651858.MR000033.pub3] [DOI] [PMC free article] [PubMed] [Google Scholar]
Markowitz 2018
- Markowitz LE, Drolet M, Perez N, Jit M, Brisson M. Human papillomavirus vaccine effectiveness by number of doses: systematic review of data from national immunization programs. Vaccine 2018;36(32 Pt A):4806‐15. [DOI] [PubMed] [Google Scholar]
McCredie 2008
- McCredie MR, Sharples KJ, Paul C, Baranyai J, Medley G, Jones RW, Skegg DC. Natural history of cervical neoplasia and risk of invasive cancer in women with cervical intraepithelial neoplasia 3: a retrospective cohort study. Lancet Oncology 2008;9(5):425‐34. [DOI] [PubMed] [Google Scholar]
Paavonen 2007
- Paavonen J, Jenkins D, Bosch FX, Naud P, Salmerón J, Wheeler CM, et al. Efficacy of a prophylactic adjuvanted bivalent L1 virus‐like‐particle vaccine against infection with human papillomavirus types 16 and 18 in young women: an interim analysis of a phase III double‐blind, randomised controlled trial. Lancet 2007;369(9580):2161‐70. [DOI] [PubMed] [Google Scholar]
Piaggio 2012
- Piaggio G, Elbourne DR, Pocock SJ, Evans SJ, Altman DG. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement.. JAMA 2012;308:2594‐604. [DOI] [PubMed] [Google Scholar]
Sankaranarayanan 2016
- Sankaranarayanan R, Prabhu PR, Pawlita M, Gheit T, Bhatla N, Muwonge R, et al. Immunogenicity and HPV infection after one, two, and three doses of quadrivalent HPV vaccine in girls in India: a multicentre prospective cohort study. Lancet Oncology 2016;17(1):67‐77. [DOI] [PMC free article] [PubMed] [Google Scholar]
Schiller 2018
- Schiller J, Lowy D. Explanations for the high potency of HPV prophylactic vaccines. Vaccine 2018;36(32 Pt A):4768‐73. [DOI] [PMC free article] [PubMed] [Google Scholar]
Schim van der Loeff 2014
- Schim van der Loeff MF, Mooij SH, Richel O, Vries HJ, Prins JM. HPV and anal cancer in HIV‐infected individuals: a review. Current HIV/AIDS Reports 2014;11(3):250‐62. [DOI] [PubMed] [Google Scholar]
Sharma 2017
- Sharma T, Gøtzsche P, Kuss O. The Yusuf‐Peto method was not a robust method for meta‐analyses of rare events data from antidepressant trials. Journal of Clinical Epidemiology 2017;91:129‐36. [DOI] [PubMed] [Google Scholar]
Smith 2011
- Smith MA, Lew J‐B, Walker RJ, Brotherton JM, Nickson C, Canfell K. The predicted impact of HPV vaccination on male infections and male HPV‐related cancers in Australia. Vaccine 2011;29:9112‐22. [DOI] [PubMed] [Google Scholar]
Stanley 2006
- Stanley MA. Human papillomavirus vaccines. Reviews in Medical Virology 2006;16:139‐49. [DOI] [PubMed] [Google Scholar]
Stanley 2014
- Stanley MA, Sudenga SL, Giuliano AR. Alternative dosage schedules with HPV virus‐like particle vaccines. Expert Review of Vaccines 2014;13:1027‐38. [DOI] [PMC free article] [PubMed] [Google Scholar]
Sturegard 2013
- Sturegard E, Johansson H, Ekström J, Hansson B‐G, Johnsson A, Gustafsson E, et al. Human papillomavirus typing in reporting of Condyloma. Sexually Transmitted Diseases 2013;40:123‐9. [DOI] [PubMed] [Google Scholar]
Syrjänen 2010
- Syrjänen S. The role of human papillomavirus infection in head and neck cancers. Annals of Oncology 2010;21:243‐5. [DOI] [PubMed] [Google Scholar]
Vardas 2011
- Vardas E, Giuliano AR, Goldstone S, Palefsky JM, Moreira ED Jr, Penny ME, et al. External genital human papillomavirus prevalence and associated factors among heterosexual men on 5 continents. Journal of Infectious Diseases 2011;203(1):58‐65. [DOI] [PMC free article] [PubMed] [Google Scholar]
Walling 2016
- Walling EB, Benzoni N, Dornfeld J, Bhandari R, Sisk BA, Garbutt J, et al. Interventions to improve HPV vaccine uptake: a systematic review. Pediatrics 2016;138(1):e20153863. [DOI] [PubMed] [Google Scholar]
WHO 2017
- World Health Organization. Human papillomavirus vaccines: WHO position paper, May 2017. Weekly Epidemiological Record 2017;92:241‐68. [Google Scholar]
References to other published versions of this review
Bergman 2017
- Bergman H, Henschke N, Buckley B, Villanueva G, Petkovic J, Garritty C. Protocol for an update of a systematic review and meta‐analysis of the immunogenicity and efficacy of HPV vaccines in females and males aged 9‐26 years. osf.io/qchzb (accessed 31 October 2018).
D'Addario 2017
- D'Addario M, Redmond S, Scott P, Egli‐Gany D, Riveros‐Balta AX, Restrepo AM, et al. Two‐dose schedules for human papillomavirus vaccine: systematic review and meta‐analysis. Vaccine 2017;35:2892‐901. [DOI] [PubMed] [Google Scholar]
