Abstract
Objective
To assess the benefits and harms of the human papillomavirus (HPV) vaccines.
Data sources
Clinical study reports obtained from the European Medicines Agency and GlaxoSmithKline from 2014 to 2017.
Eligibility criteria
Randomised trials that compared an HPV vaccine with a placebo or active comparator in healthy participants of all ages.
Appraisal and synthesis
Two researchers extracted data and judged risk of bias with the Cochrane tool (version 2011). Risk ratio (RR) estimates were pooled using random-effects meta-analysis.
Outcomes
Clinically relevant outcomes in intention to treat populations—including HPV-related cancer precursors irrespective of involved HPV types, treatment procedures and serious and general harms.
Results
Twenty-four of 50 eligible clinical study reports were obtained with 58,412 pages of 22 trials and 2 follow-up studies including 95,670 participants: 79,102 females and 16,568 males age 8–72; 393,194 person-years; and 49 months mean weighted follow-up. We judged all 24 studies to be at high risk of bias. Serious harms were incompletely reported for 72% of participants (68,610/95,670). Nearly all control participants received active comparators (48,289/48,595, 99%). No clinical study report included complete case report forms. At 4 years follow-up, the HPV vaccines reduced HPV-related carcinoma in situ (367 in the HPV vaccine group vs. 490 in the comparator group, RR 0.73 [95% confidence interval, CI, 0.53 to 1.00], number needed to vaccinate [NNV] 387, P = 0.05, I2 = 67%) and HPV-related treatment procedures (1018 vs. 1416, RR 0.71 [95% CI 0.63 to 0.80], NNV 75, P < 0.00001, I2 = 45%). The HPV vaccines increased serious nervous system disorders (exploratory analysis: 72 vs. 46, RR 1.49 [1.02 to 2.16], number needed to harm [NNH] 1325, P = 0.040, I2 = 0%) and general harms (13,248 vs. 12,394, RR 1.07 [95% CI 1.03 to 1.11], NNH 51, P = 0.0002, I2 = 77%) but did not significantly increase fatal harms (45 vs. 38, RR 1.19 [95% CI 0.65 to 2.19], P = 0.58, I2 = 30%) or serious harms (1404 vs. 1357, RR 1.01 [95% CI 0.94 to 1.08], P = 0.79, I2 = 0%).
Conclusion
At 4 years follow-up, the HPV vaccines decreased HPV-related cancer precursors and treatment procedures but increased serious nervous system disorders (exploratory analysis) and general harms. As the included trials were primarily designed to assess benefits and were not adequately designed to assess harms, the extent to which the HPV vaccines’ benefits outweigh their harms is unclear. Limited access to clinical study reports and trial data with case report forms prevented a thorough assessment.
Systematic review registration
CRD42017056093. Our systematic review protocol was registered on PROSPERO in January 2017: https://www.crd.york.ac.uk/PROSPEROFILES/56093_PROTOCOL_20170030.pdf. Two protocol amendments were registered on PROSPERO on November 2017: https://www.crd.york.ac.uk/PROSPEROFILES/56093_PROTOCOL_20171116.pdf. Our index of the HPV vaccine studies was published in Systematic Reviews in January 2018: 10.1186/s13643-018-0675-z. A description of the challenges obtaining the data was published in September 2018: 10.1136/bmj.k3694.
Electronic supplementary material
The online version of this article (10.1186/s13643-019-0983-y) contains supplementary material, which is available to authorized users.
Keywords: Human papillomavirus vaccine, Systematic review, Meta-analysis, Randomised clinical trial and Clinical study report
Introduction
The approved human papillomavirus (HPV) vaccines—GlaxoSmithKline’s Cervarix™ and Merck Sharp and Dohme’s Gardasil™ and Gardasil 9™—are considered safe and effective [1–3]. Recent evidence suggests that the vaccines have significant and long-lasting effects (> 12 years) on cervical cancer [4, 5], better effectiveness when vaccinated below the age of 17 [6], and are possibly able to substantially reduce the global incidence of cervical cancer [7]. However, there are important uncertainties regarding both the benefits and harms of the vaccines.
Uncertainties of the benefits of the HPV vaccines
The HPV vaccines’ regulatory approvals were mainly based on per-protocol populations and surrogate outcomes of HPV-related lesions, e.g. ‘cervical intraepithelial neoplasia or worse’ (CIN2+) infected with an HPV vaccine-specific HPV type, such as HPV types 16 and 18 that are associated with the majority of HPV-related cancers [8–10]. It was considered unfeasible and unethical to use HPV-related cancer as the primary outcome [11, 12], since it takes many years for cancer to develop after an HPV infection and also because cervical screening is an established secondary prevention method that leads to removal of precancerous lesions before they become cancerous. Up to 15% of HPV-related cervical cancers may not contain HPV [13], but HPV may be identified in more cases with newer and more sensitive analysis methods [14]. HPV-related lesions are often infected with more than one HPV type, some of which may not be targeted by the vaccines [15]. This makes it impossible to assess which HPV type caused the lesion. The regulatory vaccine approvals were not based on HPV-related lesions irrespective of HPV type in intention to treat populations, and factors such as antigenic changes and herd immunity may be important in the long-term perspective, as the approved HPV vaccines only target up to 9 of the 25 HPV types considered oncogenic [1].
Uncertainties of the harms of the HPV vaccines
A Cochrane review from 2018 [3] and most large epidemiological studies [16–20] did not find serious or general harms associated with the HPV vaccines. The Cochrane review was mainly based on journal publications that often are influenced by reporting bias [21–24], and epidemiological studies are influenced by confounding [25].
Acknowledged rare serious harms include anaphylaxis and syncope [8–10]. Some case studies have reported rare neurological harms such as postural orthostatic tachycardia syndrome (POTS) [26, 27] and complex regional pain syndrome (CRPS) [28]. Cluster analyses of individual case safety reports from the World Health Organisation’s (WHOs) VigiBase® revealed additional harms—often serious in nature—that overlapped with the symptomatology of POTS and CRPS [29]. Although the European Medicines Agency’s (EMA) investigation of POTS and CRPS did not find an association with the HPV vaccines [2], EMA’s investigation was based on the HPV vaccine manufacturers’ own assessments [30], and about 30 cases of POTS and CRPS were not recognised in the HPV vaccine manufacturers’ trials [31, 32]. Other reported rare harms have included chronic fatigue syndrome (CFS), Guillain–Barré syndrome (GBS) and premature ovarian failure (POF) [33–35].
Addressing the uncertainties of the HPV vaccines
To address the uncertainties of the benefits and harms of the HPV vaccines, we conducted a systematic review with meta-analyses of trial data from clinical study reports. As of July 2017, about one third of the HPV vaccine studies had not been published and study results were not posted for about half of the completed studies on ClinicalTrials.gov [36]. Therefore, we based our review on study programmes in order to identify all trials [36] and on clinical study reports [37], as these reports provide vastly more information about a study than a corresponding journal publication [21–24].
Methods
Search strategy and study eligibility
Using a six-step process, we constructed and published an index of the HPV vaccine study programmes [36] that included 206 comparative prospective studies (see Fig. 1). Two researchers (LJ and TJ) conducted the six steps that included searches of trial registers, journal publication databases and correspondence with regulators and HPV vaccine manufacturers. It was not feasible to account for duplicate entries, as we indexed studies and searched databases that used different IDs for a unique study (e.g. register ID, study programme ID, manufacturer ID and publication ID) [36].
In May 2014, we requested the study programmes’ corresponding clinical study reports from the European Medicines Agency (EMA; via its policy 0043) and obtained those reports that were freely available on GlaxoSmithKline’s online trial register. We did not request clinical study reports from the manufacturers, as this would limit our ability to use and share the data [38]. In January 2017, we registered our systematic review protocol in PROSPERO (International prospective register of systematic reviews): CRD42017056093 [37].
We included those trials and their follow-up studies of the 206 comparative studies from our index that were randomised clinical phase II, III or IV trials. We aimed to include studies for which we obtained industry clinical study reports or similar non-industry reports. In the event of no clinical study report being available (for an otherwise eligible trial), we did not include data from the trial publication. We also aimed to include periodical safety update reports. PICO criteria (participants, interventions, comparisons and outcomes) were used to select trials that compared an HPV vaccine with a placebo (normal saline) or active comparator (adjuvant or non-HPV vaccine such as a hepatitis vaccine) in healthy participants (see Additional file 1 for our PRISMA checklist).
Data extraction and risk of bias assessment
One researcher performed trial selection and data extraction (LJ); a second researcher (TJ) checked the selection and extraction; a third researcher (PCG) arbitrated. Cochrane’s tool (version 2011) was used for risk of bias assessments [25].
Outcome assessment
We assessed the following primary outcomes: all-cause mortality, deaths from and incidence of HPV-related cancers, incidence of histologically confirmed carcinoma in situ and moderate intraepithelial neoplasia, fatal harms, serious harms and harms of special interest (anaphylaxis, chronic fatigue syndrome [CFS], complex regional pain syndrome [CRPS], Guillain-Barré syndrome [GBS], postural orthostatic tachycardia syndrome [POTS], premature ovarian failure [POF] and syncope). Histological outcomes were assessed irrespective of which HPV types were involved.
Secondary outcomes included HPV-related external genital lesions and referral procedures, new onset diseases (reported in the included clinical study reports as ‘medically significant conditions’ and ‘new medical history’) and general harms (reported as 'solicited', ‘unsolicited’ and ‘systemic adverse events’). We did not consider cytological, serological or virological outcomes or local harms due to their lower clinical importance.
The clinical study reports included over 3000 different types of harms that were classified with MedDRA (Medical Dictionary for Regulatory Activities) preferred terms. The harms were often incompletely and heterogeneously reported (see Table 1). We extracted and assessed all individual harms classified with MedDRA-preferred terms. We performed meta-analyses for the five most commonly occurring fatal and serious harms, the five fatal and serious harms that the HPV vaccines increased the most and the five fatal and serious harms that the HPV vaccines decreased the most. For new onset diseases and general harms, we performed meta-analyses for the three most common, increased and decreased harms for each category (‘medically significant conditions’ and ‘new medical history’; and ‘solicited’, ‘unsolicited’ and ‘systemic adverse events’). MedDRA-preferred terms and total harms were reported as the number of participants with one or more harms over the total number of participants.
Table 1.
Reporting of harmsa | Total | GlaxoSmithKline | Merck Sharp and Dohme | |||
---|---|---|---|---|---|---|
Studies (N = 24) |
Participants (N = 96,855)a |
Studies (N = 17) |
Participants (N = 66,235)a |
Studies (N = 7) |
Participants (N = 30,620) |
|
Fatal harms | ||||||
Reported for the whole study period | 23 | 64,679 (67%) | 16 | 34,059 (51%) | 7 | 30,620 (100%) |
Reported for the whole study period for someb participants | 1 | 32,176 (33%) | 1 | 32,176 (49%) | 0 | 0 (0%) |
Serious harmsc | ||||||
Reported for the whole study period | 14 | 28,245 (30%) | 14 | 28,245 (42%) | 0 | 0 (0%) |
No breakdown into MedDRA-preferred terms | 3 (21%) | 2586 (9%) | 3 (21%) | 2586 (9%) | 0 (0%) | 0 (0%) |
Reported 0 to 14 days post-vaccination | 7 | 30,620 (31%) | 0 | 0 (0%) | 7 | 30,620 (100%) |
Reported for the 7-month vaccination period | 2 | 5814 (6%) | 2 | 5814 (9%) | 0 | 0 (0%) |
Reported for a subset or the serious harms judged vaccine-related by the trial investigatorsb | 1 | 32,176 (33%) | 1 | 32,176 (49%) | 0 | 0 (0%) |
New onset diseasesd | ||||||
Reported as ‘medically significant conditions’ for the whole study period | 15 | 65,741 (68%) | 15 | 65,741 (99%) | 0 | 0 (0%) |
No breakdown into MedDRA-preferred terms | 2 (13%) | 33,216 (51%) | 2 (13%) | 33,216 (51%) | 0 (0%) | 0 (0%) |
Reported as ‘new medical history’ for the whole study period | 7 | 30,620 (31%) | 0 | 0 (0%) | 7 | 30,620 (100%) |
Not reported/included in clinical study report | 2 | 494 (1%) | 2 | 494 (1%) | 0 | 0 (0%) |
General harmse | ||||||
Reported as ‘solicited’ and ‘unsolicited’ general harms 7 and 30 days post-vaccination | 14 | 64,010 (66%) | 14 | 64,010 (96%) | 0 | 0 (0%) |
Reported for a subset of participantsf | 2 (14%) | 7791/50,820 | 2 (14%) | 7791/50,820 | 0 (0%) | 0 (0%) |
Reported as ‘systemic adverse events’ 14 days post-vaccination | 7 | 30,620 (31%) | 0 | 0 (0%) | 7 | 30,620 (100%) |
No breakdown into MedDRA-preferred terms | 3 (43%) | 21,441 (70%) | 0 (0%) | 0 (0%) | 3 (43%) | 21,441 (70%) |
Not reported/included in clinical study report | 3 | 2225 (3%) | 3 | 2225 (4%) | 0 | 0 (0%) |
aSee Additional file 2 for details on the reporting of harms. Table 1 includes all 24 clinical study reports including the two follow-up studies HPV-023 (follow-up for trial HPV-001) of 433 participants and HPV-063 (follow-up for trial HPV-032) of 752 participants, i.e. 1185 participants (433 + 752) are included twice for the trials HPV-001 and HPV-032. The total denominator is 95,670 for the 22 included trials and 96,855 (95,670 + 1185) for the 24 included clinical study reports
bIn one trial (HPV-040), 12% (3703/32,176) of participants were included in a subset population for fatal and serious harms reporting
c(1) GlaxoSmithKline defined serious harms as “any untoward medical occurrence that a resulted in death and b was life-threatening, NOTE: The term ‘life-threatening’ in the definition of ‘serious’ refers to an event in which the subject was at risk of death at the time of the event. It did not refer to an event, which hypothetically might have caused death, if it were more severe. c. required hospitalisation or prolongation of existing hospitalisation, NOTE: In general, hospitalisation signified that the subject had been detained (usually involving at least an overnight stay) at the hospital or emergency ward for observation and/or treatment that would not have been appropriate in the physician’s office or out-patient setting. Complications that occurred during hospitalisation were AEs [adverse events]. If a complication prolonged hospitalisation or fulfilled any other serious criteria, the event was serious. When in doubt as to whether “hospitalisation” occurred or was necessary, the AE was to be considered serious. Hospitalisation for elective treatment of a pre-existing condition that did not worsen from baseline was not considered an AE. d. resulted in disability/incapacity, NOTE: The term disability means a substantial disruption of a person’s ability to conduct normal life functions. This definition was not intended to include experiences of relatively minor medical significance such as uncomplicated headache, nausea, vomiting, diarrhoea, influenza, and accidental trauma (e.g. sprained ankle) which may interfere or prevent everyday life functions but did not constitute a substantial disruption. e. was a congenital anomaly/birth defect in the offspring of a study subject”. (2) Merck Sharp and Dohme defined serious harms as “any adverse experience occurring at any dose that: Results in death; or that is life threatening (places the subject/patient, in the view of the investigator, at immediate risk of death from the experience as it occurred. [Note: This does not include an adverse experience that, had it occurred in a more severe form, might have caused death.]); or that results in a persistent or significant disability/incapacity (substantial disruption of one’s ability to conduct normal life functions); or that results in or prolongs an existing inpatient hospitalisation (hospitalised is defined as an inpatient admission, regardless of length of stay, even if the hospitalisation is a precautionary measure for continued observation.); or ALSO: Other important medical events that may not result in death, not be life threatening, or not require hospitalisation may be considered a serious adverse experience when, based upon appropriate medical judgement, the event may jeopardise the subject/patient and may require medical or surgical intervention to prevent one of the outcomes listed above”
d(1) GlaxoSmithKline defined ‘medically significant conditions’ as “Adverse events prompting emergency room or physician visits that are not (1) related to common diseases or (2) routine visits for physical examination or vaccination, or SAEs [serious adverse events] that are not related to common diseases. Serious adverse events related to common diseases were reported but are not classified as medically significant conditions for analysis purposes. Common diseases include: upper respiratory infections, sinusitis, pharyngitis, gastroenteritis, urinary tract infections, cervicovaginal yeast infections, menstrual cycle abnormalities and injury”. (2) Merck Sharp and Dohme did not provide a formal definition for ‘new medical history’ but described ‘new medical history’ as “all new reported diagnoses” in the clinical study report of trial V501-019
e(1) GlaxoSmithKline defined ‘solicited’ general adverse events as “Adverse events to be recorded as endpoints in the clinical study [i.e. arthralgia, fatigue, headache, myalgia, pyrexia, rash and urticaria]. The presence/occurrence/intensity of these events is actively solicited from the subject or an observer during a specified post-vaccination follow-up period”. (2) GlaxoSmithKline defined ‘unsolicited’ general adverse event as “Any AE [adverse event] reported in addition to those solicited during the clinical study. Also, any “solicited” symptom with onset outside the specified period of follow-up for solicited symptoms was reported as an unsolicited AE”. (3) Merck Sharp and Dohme defined ‘systemic adverse event’ as “any systemic clinical adverse event that developed on the day of vaccination or during the 14 days after vaccination was recorded on the VRC [vaccination report card] along with the date it started and the last date it was present”
fThe two trials HPV-008 and HPV-040 only reported general harms for 15% (7791/50,820) of included participants
To check for possible harm clustering on an organ system level, we meta-analysed the MedDRA-preferred terms in their respective system organ classes (for example, the MedDRA-preferred terms ‘dizziness’, ‘pain’ and ‘syncope’ were part of and therefore included in the MedDRA system organ class ‘nervous system disorders’). Only Merck clinical study reports included aggregate numbers for participants with MedDRA system organ class harms, and only for new onset diseases (‘new medical history’) and general harms (‘systemic adverse events’). For all GlaxoSmithKline clinical study reports and for serious harms for Merck clinical study reports, we pooled MedDRA-preferred terms in their respective system organ classes. A participant could potentially be included more than once in a separate analysis (e.g. if a participant experienced a serious ‘headache’ and serious ‘dizziness’, the participant would be counted twice in the MedDRA system organ class analysis of serious nervous system disorders); we therefore consider these MedDRA system organ class analyses exploratory.
Post hoc exploratory outcome assessment
As we did not obtain complete case report forms or individual participant data for any trial, and as the trials’ harm assessments had low internal and external validity (see Table 1 and the “Discussion” section), we performed post hoc exploratory outcome analyses where we (1) compared the clinical study report data with pharmacovigilance data; and (2) assessed signs and symptoms of POTS and CRPS (see protocol amendment on PROSPERO [39]).
We compared the three largest harm clusters reported from pharmacovigilance up to 1 January 2015 to the World Health Organisation’s (WHO) VigiBase® [29] with the clinical study report data (for example, VigiBase’s largest HPV vaccine harm cluster—‘expected systemic reactions’—consists of the MedDRA-preferred terms headache, nausea, pyrexia, dizziness and vomiting). This was done to assess if the pharmacovigilance data were comparable to the clinical study report data. We used the individual harm cluster terms and found the corresponding MedDRA-preferred terms in the clinical study report data. The data were synthesised or those MedDRA-preferred terms included in each harm cluster.
POTS and CRPS are rare syndromes that are difficult to identify; as mentioned, about 30 cases of POTS and CRPS were not recognised in the HPV vaccine manufacturers’ trials [31, 32], and there were no reports of POTS and CRPS in the clinical study reports (see Table 9 and the “Results” section). To assess whether signs and symptoms consistent with POTS and CRPS were present in the data, we asked a physician (Louise Brinth) with clinical expertise in POTS and CRPS to assess the reported MedDRA-preferred terms as ‘definitely’, ‘probably’, ‘probably not’ or ‘definitely not’ associated with the syndromes. As an example, the physician judged the MedDRA-preferred terms ‘dizziness postural’ and ‘pain in extremity’ to be ‘definitely’ associated with POTS and CRPS, respectively. The physician was blinded to the allocation groups and outcome data. The data was synthesised for those MedDRA-preferred terms that the physician judged ‘definitely’ associated with POTS or CRPS. (Note that the synthesis of two or more different MedDRA-preferred term categories may include a participant more than once in an analysis.)
Table 9.
Summary of harms of special interest and post hoc exploratory harm analysesa | Serious harms | New onset diseasesd | General harmse | ||||||
---|---|---|---|---|---|---|---|---|---|
HPV vaccine (N = 47,075) | Comparator (N = 48,595) | Risk ratiof[95% CI] | HPV vaccine (N = 47,075) | Comparator (N = 48,595) | Risk ratiof [95% CI] | HPV vaccine (N = 47,075) | Comparator (N = 48,595) | Risk ratiof [95% CI] | |
Harms of special interest (MedDRA-preferred terms, n = participants) | |||||||||
Anaphylaxis | 2 | 4 | 0.59 [0.13, 2.82] | 11 | 8 | 1.18 [0.48, 2.91] | 0 | 0 | Not applicable |
Chronic fatigue syndrome (CFS) | 0 | 0 | Not applicable | 0 | 0 | Not applicable | 0 | 0 | Not applicable |
Chronic regional pain syndrome (CRPS) | 0 | 0 | Not applicable | 0 | 0 | Not applicable | 0 | 0 | Not applicable |
Guillain-Barré syndrome (GBS) | 0 | 0 | Not applicable | 0 | 0 | Not applicable | 0 | 0 | Not applicable |
Postural orthostatic tachycardia syndrome (POTS) | 0 | 0 | Not applicable | 0 | 0 | Not applicable | 0 | 0 | Not applicable |
Premature ovarian failure (POF) | 0 | 0 | Not applicable | 1 | 0 | 3.00 [0.12, 73.48] | 0 | 0 | Not applicable |
Syncope | 4 | 3 | 0.94 [0.23, 3.81] | 62 | 60 | 1.03 [0.58, 1.84] | 7 | 7 | 0.77 [0.25, 2.34] |
Post hoc exploratory analyses of VigiBase® harm clustersb | |||||||||
Expected systemic reactions | 25 | 11 | 1.96 [0.96, 3.98] | 1465 | 1358 | 1.03 [0.93, 1.14] | 10,926 | 9948 | Not applicableg |
Allergic/hypersensitivity reactions | 2 | 2 | 0.96 [0.14, 6.52] | 284 | 279 | 1.05 [0.82, 1.35] | 1912 | 1469 | 1.30 [1.18, 1.45] |
Vasovagal reactions | 9 | 5 | 1.31 [0.50, 3.46] | 232 | 212 | 1.06 [0.78, 1.44] | 173 | 123 | 1.20 [0.93, 1.55] |
Post hoc exploratory analyses of CRPS and POTSc | |||||||||
Harms judged as ‘definitely associated’ with CRPS | 95 | 57 | 1.54 [1.11, 2.14] | 5079 | 4790 | 1.04 [0.98, 1.10] | 27,899 | 23,223 | Not applicableg |
Harms judged as ‘definitely associated’ with POTS | 56 | 26 | 1.92 [1.21, 3.07] | 3675 | 3352 | 1.08 [1.01, 1.15] | 18,207 | 16,288 | Not applicableg |
aSee Additional file 4 sections 13 and 14 for meta-analyses of the harms of special interest and post hoc exploratory harm analyses. There was no applicable fatal harm of special interest. It was not feasible to present this summary table for the 16 subgroups (based on age group, gender, type of HPV vaccine and comparator) of the 24 included clinical study reports. As we did not obtain complete case report forms or individual participant data, we could not assign harms to individual participants
bAs the included studies’ harm assessments were at risk of low internal and external validity (see Table 1 and the “Discussion” section), we compared the three largest harm clusters reported from pharmacovigilance up to 1 January 2015 to the World Health Organisation’s (WHO) VigiBase with the clinical study report data. We did this to see if the pharmacovigilance data were similar to the study data. VigiBase’s largest HPV vaccine harm cluster (expected systemic reactions) consists of ‘headache, nausea, pyrexia, dizziness and vomiting’. VigiBase’s second largest HPV vaccine harm cluster (allergic/hypersensitivity reactions) consists of ‘pruritis, urticaria, rash and erythema’. VigiBase’s third largest HPV vaccine harm cluster (vasovagal reactions) consists of ‘syncope, dizziness, loss of consciousness, pallor and seizure’. As we synthesised individual MedDRA-preferred term classified harms, our post hoc exploratory analyses of VigiBase harm clusters may therefore include a participant more than once in each separate analysis
cWe asked a physician with clinical expertise in POTS and CRPS to assess the reported MedDRA terms as ‘definitely’, ‘probably’, ‘probably not’ or ‘definitely not’ associated with the syndromes. The physician was blinded to the allocation groups and outcome data. The data was synthesised for those MedDRA-preferred terms that the physician judged ‘definitely’ associated with POTS or CRPS. As we synthesised individual MedDRA-preferred terms, our post hoc exploratory analyses of CRPS and POTS may include a participant more than once in each separate analysis
dNew onset diseases were compiled of the harm categories ‘medically significant conditions’ (for Cervarix) and ‘new medical history’ (for the HPV 16 vaccine, Gardasil and Gardasil 9)
eGeneral harms were compiled of the harm categories ‘solicited general adverse events’, ‘unsolicited general adverse events’ (for Cervarix) and ‘systemic adverse events’ (for Gardasil, Gardasil 9 and the HPV 16 vaccine)
fRisk ratios were calculated with the random-effects inverse variance method
gSome numerators exceeded the denominators making the result nonsensical. Therefore, we did not perform meta-analyses
Data synthesis and analysis
Risk ratios were meta-analysed with the random-effects inverse variance method. As small trials carry more weight with this method, we compared random-effects to a fixed-effect risk ratio for all outcomes. Absolute risk estimates were calculated as the number needed to vaccinate (NNV) or harm (NNH). Review Manager 5 was used for data synthesis and the intention to treat principle to calculate effect estimates. Sensitivity and subgroup analyses were conducted to investigate potential sources of heterogeneity by taking account of age, gender, risk of bias [25] and type of HPV vaccine and comparator.
Results
Characteristics of included trials
We identified 50 eligible studies: 43 industry trials, 5 industry follow-up studies and 2 non-industry trials (see Fig. 1). We obtained 24 clinical study reports of 58,412 pages from EMA and GlaxoSmithKline for 22 industry trials and 2 industry follow-up studies (17 Cervarix™, 5 Gardasil™, 1 Gardasil 9™ and 1 monovalent Merck HPV type 16 vaccine) with a total of 95,670 participants (79,102 females and 16,568 males age 8–72) and 393,194 person-years (see Tables 2 and 3 and Additional file 2). The 24 clinical study reports included 79% (95,670/121,441) of the total eligible sample of the 50 identified eligible studies. It is possible that for some of these eligible studies clinical study reports were never written but journal articles were published. The mean follow-up time was 49 months (weighted by sample size). About two fifths of the participants in the control groups received the aluminium-based adjuvants that were used in the HPV vaccines (18,192/48,595), three fifths received hepatitis vaccines that also contained the aluminium-based adjuvants that were used in the HPV vaccines—except for the hepatitis vaccine Aimmugen™—(29,500), and less than a thousand participants received carrier solution (597) or saline placebo (306).
Table 2.
HPV vaccine manufacturer | Study programme ID | Total pages obtained | European Medicines Agency | GlaxoSmithKline | |
---|---|---|---|---|---|
1 | GlaxoSmithKline | HPV-001 | 5813 | 5813 | 0 |
2 | GlaxoSmithKline | HPV-003 | 799 | 0 | 799 |
3 | GlaxoSmithKline | HPV-008 | 11,456 | 4263 | 7193 |
4 | GlaxoSmithKline | HPV-013 | 8323 | 382 | 7941 |
5 | GlaxoSmithKline | HPV-015 | 6290 | 543 | 5747 |
6 | GlaxoSmithKline | HPV-023 | 936 | 0 | 936 |
7 | GlaxoSmithKline | HPV-029 | 1543 | 0 | 1543 |
8 | GlaxoSmithKline | HPV-030 | 1351 | 0 | 1351 |
9 | GlaxoSmithKline | HPV-031 | 476 | 0 | 476 |
10 | GlaxoSmithKline | HPV-032 | 2912 | 0 | 2912 |
11 | GlaxoSmithKline | HPV-033 | 587 | 0 | 587 |
12 | GlaxoSmithKline | HPV-035 | 451 | 0 | 451 |
13 | GlaxoSmithKline | HPV-038 | 957 | 0 | 957 |
14 | GlaxoSmithKline | HPV-040 | 2892 | 128 | 2764 |
15 | GlaxoSmithKline | HPV-058 | 1745 | 0 | 1745 |
16 | GlaxoSmithKline | HPV-063 | 1474 | 0 | 1474 |
17 | GlaxoSmithKline | HPV-069 | 819 | 0 | 819 |
18 | Merck Sharp and Dohme | V501-005 | 357 | 357 | 0 |
19 | Merck Sharp and Dohme | V501-013 | 1797 | 1797 | 0 |
20 | Merck Sharp and Dohme | V501-015 | 713 | 713 | 0 |
21 | Merck Sharp and Dohme | V501-018 | 1014 | 1014 | 0 |
22 | Merck Sharp and Dohme | V501-019 | 2645 | 2645 | 0 |
23 | Merck Sharp and Dohme | V501-020 | 2595 | 2595 | 0 |
24 | Merck Sharp and Dohme | V503-006 | 467 | 467 | 0 |
Total pages obtained | 58,412 | 20,717 | 37,695 |
Table 3.
Characteristics of included participantsa | Total | HPV vaccine | Comparator | ||||||
---|---|---|---|---|---|---|---|---|---|
HPV vaccine (N = 47,075) |
Comparator (N = 48,595) |
Cervarix (N = 31,316) |
Gardasil (N = 13,937) |
Gardasil 9 (N = 618) |
HPV 16 vaccine (N = 1204) |
Placebo (N = 306) |
Adjuvantb (N = 18,789) |
Hepatitis vaccinec (N = 29,500) |
|
Participation | |||||||||
Randomised | 47,075 | 48,595 | 31,316 | 13,937 | 618 | 1204 | 306 | 18,789 | 29,500 |
Received one (1) dose | 47,012 (99%) | 48,556 (99%) | 31,291 (99%) | 13,927 (99%) | 615 (99%) | 1193 (99%) | 306 (100%) | 18,750 (99%) | 29,500 (100%) |
Received two (2) doses | 46,105 (98%) | 47,725 (98%) | 30,788 (98%) | 13,564 (97%) | 604 (98%) | 1092 (91%) | 304 (99%) | 18,304 (97%) | 29,117 (99%) |
Received three (3) doses | 45,079 (96%) | 46,726 (96%) | 30,073 (96%) | 13,286 (95%) | 597 (97%) | 1019 (85%) | 300 (98%) | 17,906 (96%) | 28,520 (97%) |
Completed vaccination period | 44,202 (94%) | 45,862 (94%) | 29,331 (94%) | 13,156 (94%) | 595 (97%) | 993 (82%) | 300 (98%) | 17,809 (95%) | 27,753 (94%) |
Entered follow-up period | 18,540 (39%) | 18,059 (37%) | 4090 (14%) | 13,344 (96%) | Not applicable | 1126 (94%) | Not applicable | 17,590 (94%) | 469 (2%) |
Completed follow-up period | 15,826 (34%) | 14,601 (30%) | 2929 (10%) | 11,986 (86%) | Not applicable | 835 (69%) | Not applicable | 14,445 (77%) | 156 (1%) |
Gender | |||||||||
Female | 42,036 (89%) | 37,066 (76%) | 28,876 (92%) | 11,338 (81%) | 618 (100%) | 1204 (100%) | 306 (100%) | 16,481 (88%) | 20,279 (69%) |
Age | |||||||||
Mean age in years | 20.3 | 20.2 | 21.2 | 21.4 | 19.0 | 20.0 | 19.0 | 22.9 | 20.5 |
Age group range in years | 9–72 | 8–68 | 9–72 | 9–45 | 12–26 | 16–25 | 12–26 | 9–68 | 8–46 |
Race | |||||||||
Asian | 7589 (16%) | 7295 (15%) | 6232 (20%) | 1248 (9%) | 40 (6%) | 69 (6%) | 14 (5%) | 2678 (14%) | 4603 (16%) |
Black | 1426 (3%) | 1492 (3%) | 467 (2%) | 862 (6%) | 3 (1%) | 94 (8%) | 3 (1%) | 1108 (6%) | 381 (1%) |
Hispanic | 4492 (10%) | 4378 (9%) | 1787 (6%) | 2616 (19%) | 0 (0%) | 89 (7%) | 0 (0%) | 3403 (18%) | 975 (3%) |
White | 31,743 (67%) | 33,558 (69%) | 22,335 (70%) | 7998 (56%) | 483 (78%) | 918 (76%) | 231 (75%) | 9960 (53%) | 23,367 (79%) |
Other | 1625 (3%) | 1576 (3%) | 297 (1%) | 1202 (9%) | 92 (15%) | 34 (3%) | 58 (19%) | 1343 (7%) | 174 (1%) |
Unknown | 209 (1%) | 296 (1%) | 198 (1%) | 11 (1%) | 0 (0%) | 0 (0%) | 0 (0%) | 297 (2%) | 0 (0%) |
aSee Additional file 2 for details on the characteristics of included participants. Table 3 does not include data from the two follow-up studies HPV-023 (follow-up for trial HPV-001) of 433 participants and HPV-063 (follow-up for trial HPV-032) of 752 participants
bAdjuvant comparators included amorphous aluminium hydroxyphosphate sulphate (AAHS), aluminium hydroxide (Al[OH]3) and Gardasil’s carrier solution (yeast protein, sodium chloride, L-histidine, polysorbate 80 and sodium borate)
cHepatitis vaccines included Aimmugen™ (hepatitis A vaccine), Engerix-B™ (hepatitis B vaccine), Havrix™ (hepatitis A vaccine) and Twinrix Paediatric™ (hepatitis A and B vaccine); see Additional file 2
Characteristics of potentially eligible studies
For the 26 remaining and potentially eligible studies (23 trials and three follow-up studies) for which no clinical study reports were obtained (or similar reports for the two non-industry trials), numbers of participants were identified for 20 of the 23 industry and 1 of the 2 non-industry trials. The trials included 25,632 and 139 participants, respectively, which were equal to 21% of the total eligible sample (25,771/121,441). These studies were not included in the review or analyses (see Additional file 3).
Risk of bias of included trials
All 22 trials and the 2 follow-up studies were at low risk of bias for ‘sequence generation’ and ‘allocation concealment’, and the majority were at low risk of bias for ‘blinding of outcome assessors’ (19/24) and ‘blinding of participants and personnel’ (16/24; see Figs. 2 and 3 and Additional file 2). However, due to the following reasons, we judged all studies to be at high risk of bias. Nearly all control participants (48,289/48,595, 99%) received an active comparator such as HPV vaccine aluminium-containing adjuvants or hepatitis vaccines. This distorted—to an unknown extent—the assessment of harms, as the trials tested an HPV vaccine vs. an active part of the same HPV vaccine (see reference [38] for additional clarification). Furthermore, serious harms were incompletely reported for 72% of the participants (68,610/95,670; see Table 1 and Additional file 2). All 24 clinical study reports contained redactions—especially of harms—and lacked significant parts such as serious harm narratives and case report forms (except for two reports: HPV-001 and HPV-008, which, however, included less than half of the participants’ case report forms) [38]. These situations are not covered by Cochrane’s risk of bias tool version 2011. Although not related to participant attrition, we judged the lack of serious harm narratives and case report forms as high risk of ‘incomplete outcome data’. In addition, while not related to the availability of study protocols, we judged the redactions of the clinical study reports as high risk of ‘selective outcome reporting’. We decided to conduct meta-analyses, since the high risk of bias mainly constituted situations that to our knowledge are not related to empirically verified bias mechanisms.
Benefits
Seven clinical study reports assessed histological outcomes of which four reported HPV-related cancer outcomes irrespective of involved HPV types. At 4 years follow-up, the HPV vaccines did not decrease HPV-related cancer (7 in the HPV vaccine groups vs. 3 in the comparator groups, risk ratio [RR] 1.68 [95% confidence interval, CI, 0.51 to 5.49], P = 0.39, I2 = 0%) or deaths hereof (2 vs. 1, RR 1.44 [95% CI 0.23 to 9.12], P = 0.70, I2 = 0%); whereas they decreased HPV-related carcinoma in situ (367 vs. 490, RR 0.73 [95% CI 0.53 to 1.00], number needed to vaccinate [NNV] 387, P = 0.05, I2 = 67%) and the composite surrogate outcome of HPV-related moderate intraepithelial neoplasia or worse (952 vs. 1239, RR 0.78 [95% CI 0.66 to 0.91], NNV 190, P = 0.002, I2 = 53%). The HPV vaccines also decreased HPV-related external genital lesions (289 vs. 582, RR 0.56 [95% CI 0.39 to 0.82], NNV 47, P = 0.003, I2 = 83%) and HPV-related treatment procedures such as cervical conisations (1018 vs. 1416, RR 0.71 [95% CI 0.63 to 0.80], NNV 75, P < 0.00001, I2 = 45%) (see Table 4 and Additional file 4).
Table 4.
Summary of HPV-related outcomesa | HPV vaccine (N = 47,075) | Comparator (N = 48,595) | Risk ratioc [95% CI] |
---|---|---|---|
Cancer mortality | |||
Total | 2 | 1 | 1.44 [0.23, 9.12] |
Cervical | 1 (50%) | 0 (0%) | 2.99 [0.12, 73.33] |
Oropharyngeal | 1 (50%) | 1 (100%) | 1.00 [0.10, 9.58] |
Cancer incidence | |||
Total | 7 | 3 | 1.68 [0.51, 5.49] |
Anal | 0 (0%) | 0 (0%) | Not applicable |
Cervical | 3 (43%) | 2 (67%) | 1.41 [0.19, 10.21] |
Oropharyngeal | 1 (14%) | 1 (33%) | 1.00 [0.10, 9.58] |
Penile | Not reported | Not reported | Not applicable |
Vaginal | 1 (14%) | 0 (0%) | 2.99 [0.12, 73.33] |
Vulvar | 2 (29%) | 0 (0%) | 3.01 [0.31, 28.89] |
Not HPV-related | 20 | 23 | 0.90 [0.49, 1.63] |
Carcinoma in situ incidence | |||
Total | 367 | 490 | 0.73 [0.53, 1.00] |
Anal (AIN3) | Not reported | Not reported | Not applicable |
Cervical | 367 (100%) | 490 (100%) | 0.73 [0.53, 1.00] |
Adenoid type (AIS) | 9 (2%) | 31 (6%) | 0.32 [0.15, 0.66] |
Squamous type (CIN3) | 358 (98%) | 459 (94%) | 0.85 [0.61, 1.17] |
Penile (PIN3) | Not reported | Not reported | Not applicable |
Vaginal (VaIN3) | Not reported | Not reported | Not applicable |
Vulvar (VIN3) | Not reported | Not reported | Not applicable |
Moderate intraepithelial neoplasia incidence | |||
Total | 538 | 763 | 0.81 [0.59, 1.11] |
Anal (AIN2) | 0 (0%) | 0 (0%) | Not applicable |
Cervical (CIN2) | 538 (100%) | 763 (100%) | 0.81 [0.59, 1.11] |
Penile (PIN2) | Not reported | Not reported | Not applicable |
Vaginal (VaIN2) | Not reported | Not reported | Not applicable |
Vulvar (VIN2) | Not reported | Not reported | Not applicable |
Carcinoma in situ or worse incidence | |||
Total | 372 | 498 | 0.79 [0.59, 1.05] |
Anal (AIN3+) | Not reported | Not reported | Not applicable |
Cervical (CIN3+, AIS included) | 372 (100%) | 498 (100%) | 0.79 [0.59, 1.05] |
Penile (PIN3+) | Not reported | Not reported | Not applicable |
Vaginal (VaIN3+) | Not reported | Not reported | Not applicable |
Vulvar (VIN3+) | Not reported | Not reported | Not applicable |
Moderate intraepithelial neoplasia or worse incidence | |||
Total | 952 | 1239 | 0.78 [0.66, 0.91] |
Anal (AIN2+) | 0 (0%) | 0 (0%) | Not applicable |
Cervical (CIN2+) | 892 (93%) | 1144 (92%) | 0.81 [0.68, 0.97] |
Penile (PIN2+) | 3 (1%) | 3 (1%) | 1.00 [0.20, 4.95] |
Vaginal (VaIN2+) | 17 (2%) | 27 (2%) | 0.64 [0.32, 1.27] |
Vulvar (VIN2+) | 18 (2%) | 36 (3%) | 0.49 [0.18, 1.36] |
Vaginal or vulvar (VIN2+ or VaIN2+) | 22 (2%) | 29 (2%) | 0.76 [0.44, 1.32] |
External genital lesion (EGL) incidence | |||
Total | 289 | 582 | 0.56 [0.39, 0.82] |
HPV-related referral proceduresb | |||
Any | 1941 | 2264 | 0.86 [0.81, 0.90] |
Biopsy | 2449 | 3021 | 0.74 [0.62, 0.88] |
Endoscopy | 4354 | 4965 | 0.88 [0.85, 0.91] |
Treatment (surgical and non-surgical) | 1018 | 1416 | 0.71 [0.63, 0.80] |
aSee Additional file 4 sections 1 to 8 for meta-analyses of HPV-related outcomes. It was not feasible to present this summary table for the 16 subgroups (based on age group, gender, type of HPV vaccine and comparator) of the 24 included clinical study reports
bTwo trials (V501-013 and V501-015) reported ‘any’ procedure, while other trials reported individual outcomes, for example, ‘biopsy’
cRisk ratios were calculated with the random-effects inverse variance method
Harms
Serious harms
The HPV vaccines did not significantly increase fatal harms (45 vs. 38, RR 1.19 [95% CI 0.65 to 2.19], P = 0.58, I2 = 30%) or serious harms (1404 vs. 1357, RR 1.01 [95% CI 0.94 to 1.08], P = 0.79, I2 = 0%), and no individual fatal or serious harm classified with a MedDRA-preferred term was significantly increased or decreased by the HPV vaccines (see Table 5 and Additional file 4).
Table 5.
Summary of fatal and serious harmsa | HPV vaccine (N = 47,075) | Comparator (N = 48,595) | Risk ratioe [95% CI] |
---|---|---|---|
Fatal harms | |||
Participants with fatal harmsb | 45 | 38 | 1.19 [0.65, 2.19] |
Number of MedDRA-classified fatal harmsb | 79 | 51 | Not applicable |
Number of fatal harms judged HPV vaccine-related | 0 (0%) | 0 (0%) | Not applicable |
Most common fatal harms (MedDRA-preferred terms, n = participants) | |||
Cardiorespiratory arrest | 3 | 2 | 0.99 [0.13, 7.65] |
Completed suicide | 4 | 8 | 0.58 [0.15, 2.19] |
Gunshot wound | 2 | 3 | 0.74 [0.09, 5.85] |
Homicide | 2 | 2 | 0.95 [0.14, 6.50] |
Road traffic accident | 5 | 7 | 0.77 [0.24, 2.46] |
Fatal harms most increased by the HPV vaccines (MedDRA-preferred terms, n = participants) | |||
Cardiac arrest | 2 | 0 | 3.00 [0.31, 28.82] |
Metastases to lung | 2 | 0 | 3.00 [0.31, 28.82] |
Renal failure acute | 2 | 0 | 3.00 [0.31, 28.82] |
Systemic lupus erythematosus | 2 | 0 | 3.00 [0.31, 28.82] |
Traumatic intracranial haemorrhage | 2 | 0 | 3.00 [0.31, 28.82] |
Fatal harms most decreased by the HPV vaccines (MedDRA-preferred terms, n = participants)c | |||
Completed suicide | 4 | 8 | 0.58 [0.15, 2.19] |
Gunshot wound | 2 | 3 | 0.74 [0.09, 5.85] |
Road traffic accident | 5 | 7 | 0.77 [0.24, 2.46] |
Serious harms | |||
Participants with serious harmsd | 1404 | 1357 | 1.01 [0.94, 1.08] |
Participants that withdrew due to a serious harm | 54 (4%) | 49 (4%) | 1.08 [0.72, 1.61] |
Number of MedDRA-classified serious harmsd | 1741 | 1628 | Not applicable |
Number of serious harms judged HPV vaccine-related | 46 (3%) | 44 (3%) | Not applicable |
Most common serious harms (MedDRA-preferred terms, n = participants) | |||
Abortion missed | 33 | 41 | 0.81 [0.51, 1.27] |
Abortion spontaneous | 89 | 78 | 1.14 [0.84, 1.55] |
Abortion spontaneous complete | 63 | 62 | 1.01 [0.71, 1.44] |
Abortion spontaneous incomplete | 73 | 54 | 1.35 [0.95, 1.92] |
Appendicitis | 72 | 82 | 0.85 [0.62, 1.17] |
Serious harms most increased by the HPV vaccines (MedDRA-preferred terms, n = participants) | |||
Abortion spontaneous | 89 | 78 | 1.14 [0.84, 1.55] |
Abortion spontaneous incomplete | 73 | 54 | 1.35 [0.95, 1.92] |
Pneumonia | 26 | 15 | 1.64 [0.87, 3.09] |
Pyelonephritis | 31 | 17 | 1.70 [0.93, 3.10] |
Tonsillitis | 18 | 9 | 1.59 [0.72, 3.49] |
Serious harms most decreased by the HPV vaccines (MedDRA-preferred terms, n = participants) | |||
Abortion missed | 33 | 41 | 0.81 [0.51, 1.27] |
Appendicitis | 72 | 82 | 0.85 [0.62, 1.17] |
Ligament rupture | 5 | 12 | 0.44 [0.15, 1.29] |
Ovarian cyst rupture | 6 | 13 | 0.46 [0.18, 1.21] |
Overdose | 22 | 31 | 0.72 [0.42, 1.23] |
aSee Additional file 4 sections 9 and 10 for fatal and serious harm meta-analyses. The applied harm categories are MedDRA-preferred terms. It was not feasible to present this summary table for the 16 subgroups (based on age group, gender, type of HPV vaccine and comparator) of the 24 included clinical study reports
bThe clinical study reports reported 130 individual MedDRA-classified fatal harms for 83 participants
cThere were 20 different MedDRA-preferred term categories of fatal harms with the same non-significant difference, i.e. no fatal harm in the HPV vaccine group and one fatal harm in the comparator group
dThe clinical study reports reported 3369 individual MedDRA-classified serious harms for 2761 participants, i.e. 1.2 serious harms per participant. Each MedDRA-classified serious harm was reported as the number of participants with a MedDRA-classified serious harm over the total number of participants
eRisk ratios were calculated with the random-effects inverse variance method
New onset diseases
The HPV vaccines increased new onset back pain (397 vs. 336, RR 1.15 [95% CI 1.00 to 1.33], NNH 589, P = 0.05, I2 = 0%) but decreased new onset gynaecological chlamydia infection (1409 vs. 1512, RR 0.93 [95% CI 0.87 to 1.00], NNV 176, P = 0.05, I2 = 0%) and vaginal infection (369 vs. 420, 0.87 [95% CI 0.76 to 1.00], NNV 150, P = 0.05, I2 = 0%) (see Table 6 and Additional file 4).
Table 6.
Summary of new onset diseasesa | HPV vaccine total (N = 47,075) | Comparator total (N = 48,595) | Risk ratiof total [95% CI] | Risk ratiof MSC [95% CI] | Risk ratiof NMH [95% CI] |
---|---|---|---|---|---|
Total | |||||
Participants with new onset diseasesb | 14,258 | 14,014 | 0.99 [0.97, 1.02] | 0.98 [0.90, 1.06] | 1.00 [0.97, 1.03] |
Follow-upc | 2296 | 2365 | 0.98 [0.94, 1.01] | Not applicable | 0.98 [0.94, 1.01] |
Number of MedDRA-classified new onset diseasesb | 47,474 | 46,662 | Not applicable | Not applicable | Not applicable |
Medically significant conditions (MSC)d | 7882 (17%) | 7994 (17%) | Not applicable | Not applicable | Not applicable |
New medical history (NMH)e | 39,592 (83%) | 38,668 (83%) | Not applicable | Not applicable | Not applicable |
Most common new onset diseases (MedDRA-preferred terms, n = participants) | |||||
MSC | |||||
Depression | 443 | 432 | 1.02 [0.89, 1.16] | 1.02 [0.85, 1.23] | 1.01 [0.84, 1.22] |
Genitourinary tract gonococcal infection | 149 | 162 | 0.92 [0.74, 1.15] | 0.91 [0.73, 1.14] | 1.15 [0.37, 3.52] |
Gynaecological chlamydia infection | 1409 | 1512 | 0.93 [0.87, 1.00] | 0.95 [0.88, 1.03] | 0.87 [0.76, 1.00] |
NMH | |||||
Vaginal candidiasis | 1297 | 1359 | 0.95 [0.89, 1.02] | Not applicable | 0.95 [0.89, 1.02] |
Vaginitis bacterial | 1185 | 1204 | 0.98 [0.91, 1.06] | Not applicable | 0.98 [0.91, 1.06] |
Urinary tract infection | 1023 | 1086 | 0.93 [0.86, 1.01] | 0.33 [0.01, 8.19] | 0.93 [0.86, 1.02] |
New onset diseases most increased by the HPV vaccines (MedDRA-preferred terms, n = participants) | |||||
MSC | |||||
Abdominal pain | 433 | 374 | 1.21 [0.98, 1.50] | 1.38 [1.00, 1.92] | 1.17 [0.87, 1.57] |
Back pain | 397 | 336 | 1.15 [1.00, 1.33] | 1.40 [1.05, 1.86] | 1.08 [0.91, 1.28] |
Headache | 771 | 693 | 1.06 [0.92, 1.22] | 1.29 [0.75, 2.24] | 1.04 [0.93, 1.15] |
NMH | |||||
Amenorrhoea | 394 | 359 | 1.09 [0.87, 1.37] | 0.66 [0.38, 1.15] | 1.17 [0.93, 1.48] |
Headache | 771 | 693 | 1.06 [0.92, 1.22] | 1.29 [0.75, 2.24] | 1.04 [0.93, 1.15] |
Joint sprain | 113 | 83 | 1.18 [0.80, 1.75] | 0.60 [0.29, 1.22] | 1.45 [0.94, 2.24] |
New onset diseases most decreased by the HPV vaccines (MedDRA-preferred terms, n = participants) | |||||
MSC | |||||
Cystitis | 480 | 502 | 0.93 [0.77, 1.09] | 0.65 [0.44, 0.96] | 0.99 [0.87, 1.13] |
Gynaecological chlamydia infection | 1409 | 1512 | 0.93 [0.87, 1.00] | 0.95 [0.88, 1.03] | 0.87 [0.76, 1.00] |
Type 2 diabetes mellitus | 31 | 47 | 0.89 [0.38, 2.09] | 0.62 [0.32, 1.20] | 3.00 [0.47, 19.02] |
NMH | |||||
Urinary tract infection | 1023 | 1086 | 0.93 [0.86, 1.01] | 0.33 [0.01, 8.19] | 0.93 [0.86, 1.02] |
Vaginal candidiasis | 1297 | 1359 | 0.95 [0.89, 1.02] | Not applicable | 0.95 [0.89, 1.02] |
Vaginal infection | 369 | 420 | 0.87 [0.76, 1.00] | Not applicable | 0.87 [0.76, 1.00] |
aSee Additional file 4 section 11 for meta-analyses of new onset diseases. The applied harm categories are MedDRA-preferred terms. New onset diseases consist of ‘medically significant conditions’ (MSC) and ‘new medical history’ (NMH). Numbers for ‘HPV vaccine’ and ‘comparator’ are the total of MSC and NMH. We divided new onset diseases for MSC and NMH, since the definitions for MSC and NMH differed (see Table 1). It was not feasible to present this summary table for the 16 subgroups (based on age group, gender, type of HPV vaccine and comparator) of the 24 included clinical study reports
bThe clinical study reports reported 94,136 individual MedDRA-preferred term classified new onset diseases for 28,272 participants, i.e. 3.3 new onset diseases per participant. New onset diseases were reported as the number of participants over the total number of participants
c‘Follow-up’ represents the trials V501-005, V501-019 and V501-020 that had dichotomized reporting of new medical history (NMH) into the vaccination period (day 0 to month 7) and follow-up period (from month 7 to the last day of follow-up). We included the vaccination periods for these trials in ‘participants with new onset diseases’ and included the follow-up periods in ‘follow-up’
dGlaxoSmithKline defined ‘medically significant conditions’ as “Adverse events prompting emergency room or physician visits that are not (1) related to common diseases or (2) routine visits for physical examination or vaccination, or SAEs [serious adverse events] that are not related to common diseases. Serious adverse events related to common diseases were reported but are not classified as medically significant conditions for analysis purposes. Common diseases include: upper respiratory infections, sinusitis, pharyngitis, gastroenteritis, urinary tract infections, cervicovaginal yeast infections, menstrual cycle abnormalities and injury”
eMerck Sharp and Dohme did not provide a formal definition for ‘new medical history’ but described ‘new medical history’ as “all new reported diagnoses” in the clinical study report of trial V501-019
fRisk ratios were calculated with the random-effects inverse variance method
General harms
The HPV vaccines increased general harms (13,248 vs. 12,394, RR 1.07 [95% CI 1.03 to 1.11], NNH 51, P = 0.0002, I2 = 77%)—especially myalgia (3989 vs. 3047, RR 1.41 [95% CI 1.24 to 1.60], NNH 26, P < 0.00001, I2 = 80%), fatigue (4933 vs. 4489, RR 1.13 [95% CI 1.08 to 1.18], NNH 67, P < 0.00001, I2 = 22%) and headache (5561 vs. 5246, RR 1.06 [95% CI 1.02 to 1.11], NNH 83, P = 0.009, I2 = 40%) (see Table 7 and Additional file 4).
Table 7.
Summary of general harmsa | HPV vaccine total (N = 47,075) | Comparator total (N = 48,595) | Risk ratiof total [95% CI] | Risk ratiof SGAE [95% CI] | Risk ratiof UGAE [95% CI] | Risk ratiof SYAE [95% CI] |
---|---|---|---|---|---|---|
Total | ||||||
Participants with general harmsb | 13,248 | 12,394 | 1.07 [1.03, 1.11] | 1.11 [1.06, 1.16]g | 1.11 [1.06, 1.16]g | 1.01 [0.98, 1.03] |
Number of MedDRA-classified general harmsb | 37,999 | 31,916 | Not applicable | Not applicable | Not applicable | Not applicable |
Solicited general adverse events (SGAE)c | 30,408 (80%) | 25,300 (79%) | Not applicable | Not applicable | Not applicable | Not applicable |
Unsolicited general adverse events (UGAE)d | 3197 (8%) | 3136 (10%) | Not applicable | Not applicable | Not applicable | Not applicable |
Systemic adverse events (SYAE)e | 4394 (12%) | 3480 (11%) | Not applicable | Not applicable | Not applicable | Not applicable |
Most common general harms (MedDRA-preferred terms, n = participants) | ||||||
SGAE and UGAE | ||||||
Fatigue | 4933 | 4489 | 1.13 [1.08, 1.18] | 1.14 [1.09, 1.19] | 1.00 [0.15, 6.53] | 0.92 [0.70, 1.20] |
Headache | 5561 | 5246 | 1.06 [1.02, 1.11] | 1.08 [1.03, 1.14] | 1.76 [1.26, 2.47] | 0.98 [0.90, 1.07] |
Myalgia | 3989 | 3047 | 1.41 [1.24, 1.60] | 1.42 [1.24, 1.63] | 1.15 [0.24, 5.57] | 1.33 [0.95, 1.85] |
SYAE | ||||||
Headache | 5561 | 5246 | 1.06 [1.02, 1.11] | 1.08 [1.03, 1.14] | 1.76 [1.26, 2.47] | 0.98 [0.90, 1.07] |
Pyrexia | 1599 | 1386 | 1.12 [1.02, 1.22] | 1.15 [1.06, 1.25] | 1.47 [0.93, 2.34] | 1.05 [0.80, 1.36] |
Nasopharyngitis | 339 | 277 | 1.17 [0.91, 1.50] | Not applicable | 1.40 [0.94, 2.09] | 0.95 [0.78, 1.16] |
General harms most increased by the HPV vaccines (MedDRA-preferred terms, n = participants) | ||||||
SGAE and UGAE | ||||||
Fatigue | 4933 | 4489 | 1.13 [1.08, 1.18] | 1.14 [1.09, 1.19] | 1.00 [0.15, 6.53] | 0.92 [0.70, 1.20] |
Headache | 5561 | 5246 | 1.06 [1.02, 1.11] | 1.08 [1.03, 1.14] | 1.76 [1.26, 2.47] | 0.98 [0.90, 1.07] |
Myalgia | 3989 | 3047 | 1.41 [1.24, 1.60] | 1.42 [1.24, 1.63] | 1.15 [0.24, 5.57] | 1.33 [0.95, 1.85] |
SYAE | ||||||
Myalgia | 3989 | 3047 | 1.41 [1.24, 1.60] | 1.42 [1.24, 1.63] | 1.15 [0.24, 5.57] | 1.33 [0.95, 1.85] |
Nausea | 213 | 148 | 1.21 [0.89, 1.65] | Not applicable | 1.32 [0.35, 4.98] | 1.25 [0.84, 1.86] |
Pyrexia | 1599 | 1386 | 1.12 [1.02, 1.22] | 1.15 [1.06, 1.25] | 1.47 [0.93, 2.34] | 1.05 [0.80, 1.36] |
General harms most decreased by the HPV vaccines (MedDRA-preferred terms, n = participants) | ||||||
SGAE and UGAE | ||||||
Influenza | 119 | 120 | 0.91 [0.61, 1.36] | Not applicable | 0.88 [0.39, 1.97] | 0.94 [0.56, 1.58] |
Cough | 86 | 87 | 0.89 [0.65, 1.21] | Not applicable | 0.83 [0.46, 1.49] | 0.90 [0.60, 1.37] |
Oropharyngeal pain | 111 | 97 | 1.10 [0.80, 1.50] | Not applicable | 0.91 [0.58, 1.43] | 1.29 [0.75, 2.22] |
SYAE | ||||||
Fungal infection | 4 | 11 | 0.78 [0.09, 6.43] | Not applicable | 3.01 [0.31, 28.83] | 0.18 [0.04, 0.82] |
Sinus headache | 9 | 15 | 0.49 [0.21, 1.14] | Not applicable | Not applicable | 0.49 [0.21, 1.14] |
Joint injury | 2 | 5 | 0.47 [0.11, 2.01] | Not applicable | 3.01 [0.31, 28.83] | 0.15 [0.03, 0.88] |
aSee Additional file 4 section 12 for meta-analyses of general harms for the 16 subgroups (based on age group, type of HPV vaccine and comparator) of the 24 included clinical study reports. The applied harm categories are MedDRA-preferred terms. The table contains general harms of ‘solicited general adverse events’ (SGAE), ‘unsolicited general adverse events’ (UGAE) and ‘systemic adverse events’ (SYAE). Numbers for ‘HPV vaccine’ and ‘comparator’ are the total of SGAE, UGAE and SYAE, but to avoid double counting of participants, UGAE (that accounted for less than 10% of the general harms) were dismissed from the total risk ratio for studies that reported SGAE and UGAE separately (SGAE and UGAE were not reported as pooled estimates for individual general harms classified with MedDRA-preferred terms; see Additional file 4). It was not feasible to present this summary table for the 16 subgroups (based on age group, type of HPV vaccine and comparator) of the 24 included clinical study reports
bThe clinical study reports reported 69,915 individual MedDRA-classified general harms for 25,642 participants, i.e. 2.7 general harms per participant. General harms were reported as the number of participants with a MedDRA-classified general harm over the total number of participants
cGlaxoSmithKline defined ‘solicited general adverse events’ (SGAE) as “Adverse events to be recorded [from day 0 to day 6 after each vaccination] as endpoints [arthralgia, fatigue, headache, myalgia, pyrexia, rash and urticaria] in the clinical study”
dGlaxoSmithKline defined ‘unsolicited general adverse events’ (UGAE) as “Any AE [adverse event] reported in addition to those solicited during the clinical study. Also, any “solicited” symptom with onset outside the specified period of follow-up for solicited symptoms was reported as an unsolicited AE”
eMerck Sharp and Dohme defined ‘systemic adverse events’ (SYAE) as “any systemic clinical adverse event that developed on the day of vaccination or during the 14 days after vaccination was recorded on the VRC [vaccination report card]”
fRisk ratios were calculated with the random-effects inverse variance method
gThe total numbers of participants with general harms in Cervarix studies were reported as ‘solicited [SGAE] and unsolicited [UGAE]’, i.e. the risk ratio is similar for SGAE and UGAE
Exploratory harm analyses
The HPV vaccines increased serious nervous system disorders grouped in the MedDRA system organ class (72 vs. 46, RR 1.49 [95% CI 1.02 to 2.16], number needed to harm [NNH] 1325, P = 0.04, I2 = 0%) but decreased new onset vascular disorders grouped in the MedDRA system organ class (234 vs. 294, RR 0.80 [95% CI 0.67 to 0.94], NNV 439, P = 0.009, I2 = 0%) (see Table 8 and Additional file 4).
Table 8.
Summary of exploratory harm analyses by MedDRA system organ classa | Fatal harms | Serious harms | New onset diseasesb | General harmsc | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
HPV vaccine (N = 47,075) | Comparator (N = 48,595) | Risk ratiod [95% CI] | HPV vaccine (N = 47,075) | Comparator (N = 48,595) | Risk ratiod[95% CI] | HPV vaccine (N = 47,075) | Comparator (N = 48,595) | Risk ratiod [95% CI] | HPV vaccine (N = 47,075) | Comparator (N = 48,595) | Risk ratiod [95% CI] | |
Blood and lymphatic system disorders | 0 | 0 | Not applicable | 11 | 12 | 0.97 [0.44, 2.18] | 424 | 421 | 1.00 [0.88, 1.15] | 17 | 10 | 1.33 [0.56, 3.15] |
Cardiac disorders | 13 | 5 | 2.45 [0.87, 6.87] | 28 | 21 | 1.12 [0.49, 2.55] | 108 | 86 | 1.09 [0.67, 1.78] | 6 | 5 | 0.89 [0.26, 2.99] |
Congenital, familial and genetic disorders | 0 | 0 | Not applicable | 1 | 9 | 0.32 [0.09, 1.13] | 50 | 67 | 0.74 [0.51, 1.06] | 0 | 1 | 0.55 [0.02, 13.40] |
Ear and labyrinth disorders | 0 | 0 | Not applicable | 4 | 6 | 0.68 [0.19, 2.45] | 154 | 139 | 1.04 [0.78, 1.39] | 54 | 40 | 1.10 [0.71, 1.69] |
Endocrine disorders | 1 | 0 | 2.83 [0.12, 69,36] | 7 | 4 | 1.60 [0.48, 5.35] | 189 | 207 | 0.91 [0.74, 1.10] | 1 | 1 | 0.72 [0.04, 11.85] |
Eye disorders | 0 | 0 | Not applicable | 6 | 4 | 1.51 [0.42, 5.37] | 296 | 326 | 0.89 [0.76, 1.04] | 40 | 39 | 0.84 [0.53, 1.33] |
Gastrointestinal disorders | 1 | 0 | 2.83 [0.12, 69,36] | 107 | 92 | 1.12 [0.85, 1.48] | 2226 | 2141 | 1.05 [0.95, 1.16] | 4085 | 3735 | 1.09 [1.01, 1.17] |
General disorders | 0 | 0 | Not applicable | 13 | 9 | 1.45 [0.60, 3.50] | 563 | 483 | 1.14 [1.01, 1.28] | 6401 | 5842 | 1.10 [1.04, 1.17] |
Hepatobiliary disorders | 1 | 1 | 0.94 [0.06, 15.06] | 52 | 48 | 1.03 [0.70, 1.52] | 126 | 143 | 0.86 [0.61, 1.22] | 2 | 1 | 2.00 [0.18, 22.00] |
Immune system disorders | 1 | 0 | 2.83 [0.12, 69,36] | 9 | 14 | 0.68 [0.30, 1.58] | 371 | 398 | 0.92 [0.78, 1.08] | 35 | 24 | 1.29 [0.76, 2.18] |
Infections and infestations | 8 | 5 | 1.51 [0.49, 4.61] | 400 | 367 | 1.04 [0.80, 1.37] | 8970 | 9025 | 0.98 [0.96, 1.00] | 1141 | 965 | 1.14 [1.00, 1.30] |
Injury, poisoning and procedural complications | 16 | 18 | 0.84 [0.43, 1.64] | 199 | 224 | 0.85 [0.64, 1.13] | 1205 | 1209 | 0.94 [0.82, 1.06] | 142 | 122 | 1.03 [0.81, 1.33] |
Investigations | 0 | 0 | Not applicable | 1 | 2 | 0.69 [0.11, 4.40] | 1438 | 1429 | 1.00 [0.94, 1.07] | 7 | 4 | 1.34 [0.41, 4.41] |
Metabolism and nutrition disorders | 1 | 1 | 0.94 [0.06, 15.06] | 19 | 11 | 1.44 [0.72, 2.89] | 342 | 355 | 0.95 [0.82, 1.10] | 17 | 15 | 0.98 [0.49, 1.96] |
Musculoskeletal and connective tissue disorders | 2 | 0 | 4.71 [0.23, 98.09] | 35 | 31 | 1.07 [0.66, 1.74] | 1263 | 1213 | 1.02 [0.94, 1.10] | 6005 | 4683 | 1.34 [1.21, 1.49] |
Neoplasms benign, malignant and unspecified | 13 | 4 | 3.06 [1.00, 9.39] | 68 | 56 | 1.20 [0.84, 1.71] | 466 | 421 | 1.09 [0.96, 1.25] | 2 | 2 | 0.71 [0.14, 3.51] |
Nervous system disorders | 4 | 1 | 3.77 [0.42, 33.71] | 72 | 46 | 1.49 [1.02, 2.16] | 1410 | 1305 | 1.06 [0.97, 1.16] | 5967 | 5422 | 1.09 [1.04, 1.14] |
Pregnancy, puerperium and perinatal conditions | 0 | 0 | Not applicable | 458 | 426 | 1.08 [0.94, 1.23] | 726 | 714 | 1.02 [0.92, 1.12] | 1 | 0 | 2.91 [0.12, 68.66] |
Psychiatric disorders | 4 | 8 | 0.47 [0.14, 1.56] | 80 | 87 | 0.92 [0.68, 1.25] | 961 | 959 | 0.99 [0.91, 1.08] | 49 | 53 | 0.90 [0.61, 1.33] |
Renal and urinary disorders | 2 | 1 | 1.88 [0.17, 20.77] | 19 | 17 | 1.07 [0.57, 2.01] | 404 | 395 | 1.01 [0.88, 1.16] | 12 | 6 | 1.32 [0.48, 3.59] |
Reproductive system and breast disorders | 2 | 0 | 4.71 [0.23, 98.09] | 72 | 78 | 0.90 [0.65, 1.24] | 3458 | 3463 | 0.99 [0.95, 1.04] | 213 | 158 | 1.13 [0.92, 1.38] |
Respiratory, thoracic and mediastinal disorders | 3 | 2 | 1.41 [0.24, 8.45] | 44 | 34 | 1.26 [0.81, 1.97] | 795 | 771 | 1.00 [0.91, 1.11] | 464 | 394 | 1.02 [0.89, 1.18] |
Skin and subcutaneous tissue disorders | 1 | 0 | 2.83 [0.12, 69.36] | 12 | 7 | 1.48 [0.60, 3.63] | 1173 | 1176 | 0.99 [0.88, 1.12] | 997 | 771 | 1.21 [1.03, 1.44] |
Social circumstances | 2 | 2 | 0.94 [0.13, 6.69] | 2 | 2 | 0.95 [0.14, 6.50] | 46 | 42 | 0.95 [0.62, 1.47] | 1 | 1 | 1.00 [0.10, 9.60] |
Surgical and medical procedures | 0 | 0 | Not applicable | 6 | 5 | 1.15 [0.36, 3.67] | 1318 | 1340 | 0.97 [0.90, 1.04] | 0 | 0 | Not applicable |
Vascular disorders | 4 | 3 | 1.26 [0.28, 5.61] | 16 | 16 | 0.96 [0.47, 1.99] | 234 | 294 | 0.80 [0.67, 0.94] | 11 | 12 | 0.68 [0.28, 1.63] |
aSee Additional file 4 sections 9 to 12 for meta-analyses of MedDRA system organ classes. Only Merck clinical study reports aggregated data for MedDRA system organ classes per participant and only for new onset diseases (‘new medical history’) and general harms (‘systemic adverse events’). A participant may have been counted more than once in the MedDRA system organ class analyses of GlaxoSmithKline clinical study reports and in analyses of fatal and serious harms; we therefore consider these analyses exploratory. Risk ratios for GlaxoSmithKline and Merck studies are provided separately in Additional file 4. It was not feasible to present this summary table for the 16 subgroups (based on age group, gender, type of HPV vaccine and comparator) of the 24 included clinical study reports. To avoid double counting of participants in the total risk ratio estimate we only included the new onset diseases reported in the vaccination period for the trials V501-005, V501-019 and V501-020, and we only included solicited adverse events when studies also reported unsolicited adverse events (see Additional file 4)
bNew onset diseases were compiled of the harm categories ‘medically significant conditions’ (for Cervarix) and ‘new medical history’ (for Gardasil, Gardasil 9 and the HPV 16 vaccine)
cGeneral harms were compiled of the harm categories ‘solicited general adverse events’, ‘unsolicited general adverse events’ (for Cervarix) and ‘systemic adverse events’ (for Gardasil, Gardasil 9 and the HPV 16 vaccine). To avoid double counting of participants, ‘unsolicited general adverse events’ were dismissed from the total risk ratio for studies that reported SGAE and UGAE separately
dRisk ratios were calculated with the random-effects inverse variance method
Harms of special interest
Cases of anaphylaxis and syncope were evenly distributed. There were no cases of chronic fatigue syndrome (CFS), complex regional pain syndrome (CRPS), Guillain-Barré syndrome (GBS) or postural orthostatic tachycardia syndrome (POTS), but there was one case of premature ovarian failure (POF) in the HPV vaccine group (see Table 9 and Additional file 4).
Post hoc exploratory harm analyses of special interest
The data from the included clinical study reports that corresponded to the three largest harm clusters reported from pharmacovigilance were associated with general harms, but not serious harms or new onset diseases. The serious harms that were judged ‘definitely associated’ with POTS or CRPS by the blinded physician were increased by the HPV vaccines, both for POTS (56 vs. 26, RR 1.92 [95% CI 1.21 to 3.07], NNH 1073, P = 0.006, I2 = 0%) and CRPS (95 vs. 57, RR 1.54 [95% CI 1.11 to 2.14], NNH 906, P = 0.010, I2 = 0%). The new onset diseases that were judged ‘definitely associated’ with POTS were also increased by the HPV vaccines (3675 vs. 3352, RR 1.08 [95% CI 1.01 to 1.15], NNH 144, P = 0.03, I2 = 29%) (see Table 9 and Additional file 4).
Subgroup analyses
Younger HPV vaccinated participants were more protected against moderate HPV-related intraepithelial neoplasia or worse than older participants (age 15 to 29: 784 vs. 1079, RR 0.71 [95% CI 0.61 to 0.83]; age 21 to 72: 168 vs. 160, RR 1.04 [95% CI 0.84 to 1.29]; ratio of relative risk [RRR] 1.46 [1.12 to 1.91]) and also experienced fewer fatal harms than older participants (age 15 to 27: 24 vs. 32, RR 0.77 [95% CI 0.45, 1.33]; age 21 to 72: 21 vs. 6, RR 3.13 [95% CI 1.29 to 7.61]; RRR 0.25 [95% CI 0.09 to 0.70]), but there were no differences for serious nervous system disorders (age 10 to 35: 53 vs. 35, RR 1.46 [95% CI 0.95 to 2.25]; age 21 to 72: 19 vs. 11, RR 1.56 [95% CI 0.75 to 3.25]; RRR 0.93 [95% CI 0.40 to 2.19]), serious harms that were judged ‘definitely associated’ with of CRPS (age 9 to 35: 76 vs. 48, RR 1.48 [95% CI 1.03 to 2.12]; age 21 to 72: 19 vs. 9, RR 2.11 [95% CI 0.67 to 6.69]; RRR 0.70 [95% CI 0.21 to 2.34]) or serious harms that were judged ‘definitely associated’ with POTS (age 12 to 35: 43 vs. 21, RR 1.86 [95% CI 1.10, 3.15]; age 21 to 72: 13 vs. 5, RR 2.22 [95 CI 0.76 to 6.47]; RRR 0.84 [95% CI 0.25 to 2.76]) (see Additional file 4; note that the subgroup analyses used overlapping age groups due to the different age groups included in the trials). No significant subgroup differences were identified for subgroup analyses based on gender and control treatment.
Random-effects vs. fixed-effect
We found similar results with the fixed-effect model but with narrower confidence intervals, as the between-trial variance is not included in this model.
Discussion
Our systematic review of 24 clinical study reports with 95,670 participants showed that the HPV vaccines within 4 years of follow-up decreased HPV-related carcinoma in situ, which have a high likelihood of progressing to cancer [1], and HPV-related treatment procedures, but the vaccines also increased serious nervous system disorders (exploratory analysis) and general harms. Younger participants who are those primarily intended to receive HPV vaccination [1] were more protected against HPV-related neoplasia and had fewer fatal harms.
Strengths
Our review was based on study programmes, randomised trials reported in clinical study reports, clinically important pre-specified outcomes, intention to treat analyses, absolute risk estimates and a conservative statistical method based on the random-effects model. There was no heterogeneity for serious nervous system disorders or for the post hoc exploratory harm analyses of serious signs and symptoms judged ‘definitely associated’ with POTS and CRPS by a blinded physician with clinical expertise.
Limitations
Insufficient trial data access, incomplete reporting, data fragmentation and limited trial follow-up periods were major limitations. It took 3 years to obtain an incomplete subset of the eligible clinical study reports; a process which we have documented in detail elsewhere [38]. Our review is therefore limited by reporting bias—the bias that we aimed to reduce [37]. We did not obtain any periodical safety update reports before our data lock. The inclusion of the remaining participants from the 26 studies with no available clinical study reports included a fifth of the total eligible participants, which could have influenced our review, as some of our results had P values around our cut-off of 0.05 and confidence intervals that were wide.
We performed multiple comparisons: 166 meta-analyses of which 31 (19%) showed statistical significance for the total risk ratio estimate. With our P value cut-off of 0.05, about eight (166*0.05) or a fourth (8/31) of the significant results are likely to have occurred by chance. We did not use Bonferroni (or similar) corrections [40], as one of our primary outcomes was serious harms, which were affected by incomplete reporting (see Table 1) and lack of saline placebo controls (see Additional file 2).
The 24 included clinical study reports only included one Gardasil 9 trial (V503–006) that was small and did not investigate histological outcomes. Many countries are currently implementing Gardasil 9 as a two-dose regimen in their vaccination programme instead of Cervarix or Gardasil [1]. Two doses of Gardasil 9 may induce fewer harms than three doses, but Gardasil 9 may induce more harms than Gardasil. For example, in the clinical study report that we obtained of phase 3 multicentre trial V503-001/NCT00543543 (not eligible for our systematic review) of 7106 and 7109 healthy females age 16–26 randomised to receive three doses Gardasil 9 or Gardasil, there were more serious harms (233 vs. 183, RR 1.27 [95% CI 1.05 to 1.54], NNH 151, P = 0.010; reported from day 0 to 390) and general harms (‘systemic adverse events’: 2086 vs. 1929, RR 1.08 [95% CI 1.03 to 1.14], NNH 75, P = 0.003; reported 0–14 days post-vaccination) in the Gardasil 9 group. A 0.5-ml dose of Gardasil 9 contains more virus-like particles (270 μg vs. 100 μg) and aluminium-containing adjuvant (500 μg vs. 225 μg) compared to a 0.5-ml dose of Gardasil, which could explain the harm differences. Although Gardasil 9 targets five more HPV types than Gardasil, Gardasil 9 did not decrease CIN2+ more than Gardasil during trial V503-001’s 42-month follow-up (325 vs. 326, RR 1.00 [95% CI 0.86 to 1.16], P = 0.97).
A substantial part of our results should be interpreted carefully due to high heterogeneity. We expected the high heterogeneity for several results (e.g. for HPV-related carcinoma in situ), as the included trials comprised 16 different subgroups—based on the type of HPV vaccine, comparator, age and gender. All meta-analyses were divided according to the 16 subgroups to provide heterogeneity measures (see Additional file 4), but the nationality of the participants and regional practices of HPV-related screening and treatment procedures may also have contributed to the heterogeneity.
Limitations of benefit assessment
Only 10 HPV-related cancers occurred in the follow-up periods. Extended follow-up was not possible for 75% of the comparator participants (36,344/48,595), as they were offered HPV vaccination at trial completion.
We only included benefit results of intention to treat analyses, which also included participants that were enrolled after they had been infected with HPV. The HPV vaccines have no documented effect on HPV-related neoplasia caused by previous infections [1]. Our benefit results may therefore be skewed toward the null compared to real-life settings where mainly 12-year-old adolescents—that are expected to not be previously HPV-infected—are HPV vaccinated. Getting vaccinated before sexual debut is likely to improve the HPV vaccines’ benefits, but no included trial investigated histological outcomes for participants that were vaccinated under the age of 15.
Three trials—HPV-008, V501-013 and V501-015 that contained 38% (36,266/95,670) of the analysed participants—were stopped early when HPV type 16/18-related cervical intraepithelial neoplasia or worse (CIN2+) was significantly reduced for their HPV vaccine per-protocol populations. On average, trials stopped early for benefits exaggerate effects by 29% compared to completed trials of the same intervention [41]. When the three trials were excluded from our CIN2+ meta-analysis, CIN2+ was not significantly decreased (184 vs. 200, RR 0.85 [95% CI 0.54 to 1.33], P = 0.47, I2 = 77%; see Additional file 4).
One clinical study report (HPV-015) only reported CIN2+, although there were three cases of HPV-related cancers in the HPV vaccine group and one in the comparator group (see Additional file 4). These cancers were listed as serious harms and were not mentioned elsewhere in the clinical study report. For transparency, it would have been more appropriate to report each histological outcome (cancer, carcinoma in situ, moderate intraepithelial neoplasia, etc.) than only a composite surrogate outcome such as CIN2+.
No trial tested the HPV vaccines’ protection against cervical cancer without using cervical screening. This may reduce external validity, as some studies show that HPV-vaccinated women may tend to avoid cervical screening [42]; although other studies have not shown a clear tendency [43]. The trial personnel often performed cervical screening together with colposcopy every 6 months, and the included participants were often women aged 15–26. In clinical practice, cervical screening is usually performed every 3 to 5 years and recommended after age 25 [44], as most CIN2+ lesions in women under age 30 regress spontaneously, which may justify active surveillance rather than immediate intervention [45].
No trial used mandatory biopsies, which may reduce internal validity. For example, the precursor lesion of cervical adenocarcinoma is difficult to detect on colposcopy, but easier to recognise on a biopsy [46]. The incidence of cervical adenocarcinoma is increasing and may more often be HPV negative compared to cervical squamous carcinoma [46], but only 5% (40/857) of the reported cervical carcinoma in situ cases in the included studies were adenocarcinoma in situ (see Table 4).
We did not pre-specify genital warts as an outcome, but the HPV vaccines reduced external genital lesions and there is strong evidence that the HPV vaccines—especially Gardasil and Gardasil 9 that target the HPV types 6 and 11—decrease the incidence of genital warts [47].
Limitations of harm assessment
Only Merck clinical study reports reported aggregate numbers for participants with MedDRA system organ classified harms, and only for new onset diseases and general harms. The synthesis of MedDRA system organ classes for all GlaxoSmithKline clinical study reports and for serious harms for Merck clinical study reports may therefore include a participant more than once. As a result, we consider these analyses exploratory.
Serious harms were incompletely reported for 72% of the participants (68,610/95,670; see Table 1 and Additional file 2). There were 2.8 times more serious harms reported in the clinical study reports that reported serious harms for the whole trial period (1838/27,493 vs. 923/38,356). As an example, trial HPV-008 of Cervarix that had reported all serious harms during its 48 months follow-up reported 10 times more participants with serious harms compared to V501-015 of Gardasil that only reported serious harms 14 days post-vaccination (1664/18,644 vs. 102/12,167). In the cluster-randomised trial, HPV-040, 88% (28,473 of 32,176) of the participants were not included for serious harms reporting (see Table 1 and Additional file 2).
The use of active comparators may have underestimated harms related to the HPV vaccines [38]. The aluminium-containing comparators were used, as they provided a similar appearance to that of the HPV vaccines, which enhanced blinding and decreased the risk of performance and detection bias. A single trial—V503-006, of Gardasil 9—used a saline placebo in 306 participants who had previously been vaccinated with Gardasil. It is unlikely that those who had experienced harms following previous Gardasil vaccination would have participated in the Gardasil 9 trial, so the trial’s harm results are not reliable. The trial’s blinding procedure was adequate to ensure low risk of performance and detection bias and could have been used in other trials (see Additional file 2).
Although the manufacturers consider the aluminium-containing comparators to be safe, 52% of the participants (49,301/95,670) were only included in the trials if they had never received the aluminium-containing comparators before. GlaxoSmithKline state that their aluminium-containing comparator induces myalgia (“higher incidences of myalgia might namely be attributable to the higher content of aluminium in the HPV vaccine [450 micrograms Al(OH)3] than the content of aluminium in the HAV [hepatitis A] vaccine [225 micrograms Al(OH)3]” [48]), which we found was increased by the HPV vaccines (see Table 7).
The clinical study reports, their informed consent forms and corresponding journal publications (for example, V501-013 [49] and V501-015 [50]) often used the term placebo (which is a substance with no active effect) to describe the active aluminium-based comparators.
Two thirds of the participants (63,468/95,670) were only included in the trials if they had no history of immunological or nervous system disorders (see Additional file 2). Such disorders are not listed as warnings or contraindications on the package inserts of the approved HPV vaccines [8–10]. The degree of harms might therefore be higher in clinical practice than in the trials. The HPV vaccines did not increase the three largest HPV vaccine-related VigiBase® harms clusters for serious harms and new onset diseases (see the “Methods” section, Table 9 and Additional file 4), which may reflect the differences between real-life and the trials’ settings and entry criteria.
The exploratory analyses of MedDRA system organ classes may have included a participant more than once. For serious nervous system disorders, this is unlikely, as there were only 118 participants with such disorders (reported as individual MedDRA-preferred terms) for 61,331 participants (see Additional file 4). We note, however, that the serious nervous system disorders consisted of very heterogenous harms, for example, ‘anoxic encephalopathy’, ‘moyamoya disease’ and ‘vertebral artery dissection’.
The serious harm analyses of MedDRA-preferred terms associated with POTS and CRPS may also have included a participant more than once, although this is unlikely as there only were 82 participants with a POTS sign/symptom for 60,058 participants and 152 participants with a CRPS sign/symptom for 60,915 participants. The selection of MedDRA-preferred terms associated with POTS and CRPS was subjective, not verified by other assessors and included some signs/symptoms that do not align well with the diagnostic criteria of POTS or CRPS [51, 52], for example, ‘constipation’, ‘vision blurred’ and ‘vomiting’. Other blinded assessors would possibly assign MedDRA-preferred terms differently, as there were over 3000 different included MedDRA-preferred terms. The post hoc exploratory POTS and CRPS analyses were based on randomised trial data where serious harms were underreported and likely underestimated, but since no complete serious harm narratives or complete case report forms were available, the analyses could not take symptom duration, symptom clustering or the diagnostic criteria into account. Therefore, the analyses do not prove that the HPV vaccines cause POTS and CRPS, but they do provide a signal, which makes it important to carry out independent analyses of POTS and CRPS based on the complete data set with individual participant data.
Similar studies
In May 2018, a Cochrane review of the HPV vaccines that included 26 trials with 73,428 female participants concluded that the HPV vaccines decrease precursors to cervical cancer and do not increase serious or general harms [3]. The Cochrane review had similar inclusion criteria to our review, but it was mainly based on journal publications and only included phase II and III trials. In comparison, we identified 50 possibly eligible studies for which we obtained clinical study reports for 22 trials and two follow-up studies and included 30% more participants (95,670) than the Cochrane review. We found that the HPV vaccines decrease precursors to HPV-related cancer and treatment procedures but increase serious nervous system disorders (exploratory analyses) and general harms. Another recent review on males [53] and most large epidemiological studies have found no serious harms associated with the HPV vaccines [16–20].
Conclusion
At 4 years follow-up, the HPV vaccines decreased HPV-related precursors to cervical cancer and treatment procedures but increased serious nervous system disorders (exploratory analysis) and general harms. As the included trials were primarily designed to assess benefits and not adequately designed to assess harms, the extent to which the benefits outweigh the harms is unclear. Limited access to clinical study reports and trial data with case report forms prevented a thorough assessment. An independent assessment of the complete individual participant data is needed. If granted access to the complete data set with individual participant data, we will update this systematic review. A large industry-independent multicentre trial of two doses of Gardasil 9 vs. saline placebo would likely be informative in identifying a more accurate benefit-harm balance, but we recognise that such a trial will be considered unethical in most settings.
Additional files
Acknowledgements
We would like to thank EMA and Louise Brinth for their assistance and Jeppe Bennekou Schroll and Karsten Juhl Jørgensen for helpful comments.
Funding
This study was funded by the Nordic Cochrane Centre, which is funded by the Danish government.
Availability of data and materials
The datasets generated and analysed during the current systematic review are available from the first author (LJ) upon request.
Abbreviations
- AIN
Anal intraepithelial neoplasia
- CFS
Chronic fatigue syndrome
- CIN
Cervical intraepithelial neoplasia
- CRPS
Chronic regional pain syndrome
- EGL
External genital lesion
- EMA
European Medicines Agency
- FDA
Food and Drug Administration
- GBS
Guillain-Barré syndrome
- GSK
GlaxoSmithKline
- HPV
Human papillomavirus
- ICH
International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use
- MedDRA
Medical Dictionary for Regulatory Activities
- Merck
Merck and Co., Inc. or Merck Sharp and Dohme outside the USA and Canada
- MSC
Medically significant condition
- NMH
New medical history
- NNH
Number needed to harm
- NNV
Number needed to vaccinate
- PICO
Patient, intervention, comparator and outcome
- PIN
Penile intraepithelial neoplasia
- POF
Premature ovarian failure
- POTS
Postural orthostatic tachycardia syndrome
- PRISMA
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
- PROSPERO
International Prospective Register of Systematic Reviews
- SGAE
Solicited general adverse event
- SYAE
Systemic adverse event
- UGAE
Unsolicited general adverse event
- VaIN
Vaginal intraepithelial neoplasia
- VIN
Vulvar intraepithelial neoplasia
- WHO
World Health Organisation
Authors’ contributions
LJ wrote the first draft. LJ and TJ contributed to the conception of the review, the design of the review, the collection and assembly of data, the analysis and interpretation of the data, the drafting of the article, the critical revision of the article for important intellectual content and the final approval of the article. PCG contributed to the conception of the review, the critical revision of the article for important intellectual content and the final approval of the article. All authors had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
All authors have completed the ICMJE uniform disclosure form. LJ declares no support from any organisation for the submitted work, no financial relationships with any organisations that might have an interest in the submitted work, no other relationships or activities that could appear to have influenced the submitted work. PCG spoke by video link about the HPV vaccines at the IFICA (International Federation for Injured Children and Adults, www.ificaeurope.org) conference in 2018 but received no fee or reimbursement for this. PCG and TJ were co-signatories of a complaint to the European Ombudsman on maladministration in relation to the EMA investigation of possible harms from HPV vaccines. PCG does not regard this as a competing interest. TJ was a co-recipient of a UK National Institute for Health Research grant (HTA–10/80/01 update and amalgamation of two Cochrane Reviews: neuraminidase inhibitors for preventing and treating influenza in healthy adults and children—https://www.journalslibrary.nihr.ac.uk/programmes/hta/108001#/). TJ is also in receipt of a Cochrane Methods Innovations Fund grant to develop guidance on the use of regulatory data in Cochrane reviews. TJ is occasionally interviewed by market research companies about phase I or II pharmaceutical products. In 2011–2014, TJ acted as an expert witness in a litigation case related to the antiviral oseltamivir, in two litigation cases on potential vaccine-related damage and in a labour case on influenza vaccines in healthcare workers in Canada. He has acted as a consultant for Roche (1997–1999), GSK (2001–2002), Sanofi-Synthelabo (2003) and IMS Health (2013). In 2014–2016, TJ was a member of three advisory boards for Boehringer Ingelheim. TJ was a member of an independent data monitoring committee for a Sanofi Pasteur clinical trial on an influenza vaccine.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Lars Jørgensen, Email: lj@cochrane.dk.
Peter C. Gøtzsche, Email: pcg@scientificfreedom.dk
Tom Jefferson, Email: tj@cochrane.dk.
References
- 1.World Health Organization Human papillomavirus vaccines: WHO position paper. Wkly Epidemiol Rec. 2017;92(19):241–268. [PubMed] [Google Scholar]
- 2.European Medicines Agency. Review under Article 20 of Regulation (EC) No 726/2004 Human papillomavirus (HPV) vaccines. 2015. Available from: http://www.ema.europa.eu/docs/en_GB/document_library/Referrals_document/HPV_vaccines_20/Opinion_provided_by_Committee_for_Medicinal_Products_for_Human_Use/WC500197129.pdf.
- 3.Arbyn M, Xu L, Simoens C, Martin-Hirsch PPL. Prophylactic vaccination against human papillomaviruses to prevent cervical cancer and its precursors. Cochrane Database Syst Rev. 2018;5:CD009069. doi: 10.1002/14651858.CD009069.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Kjaer SK, Nygård M, Dillner J, Brooke Marshall J, Radley D, Li M, et al. A 12-year follow-up on the long-term effectiveness of the quadrivalent human papillomavirus vaccine in 4 Nordic countries. Clin Infect Dis. 2018;66(3):339–345. doi: 10.1093/cid/cix797. [DOI] [PubMed] [Google Scholar]
- 5.Guo F, Cofie LE, Berenson AB. Cervical Cancer incidence in young U.S. females after human papillomavirus vaccine introduction. Am J Prev Med. 2018;55(2):197–204. doi: 10.1016/j.amepre.2018.03.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Dehlendorff C, Sparén P, Baldur-Felskov B, Herweijer E, Arnheim-Dahlström L, Ploner A, et al. Effectiveness of varying number of doses and timing between doses of quadrivalent HPV vaccine against severe cervical lesions. Vaccine. 2018;36(43):6373–6378. doi: 10.1016/j.vaccine.2018.09.011. [DOI] [PubMed] [Google Scholar]
- 7.Hall MT, Simms KT, Lew J-B, Smith MA, Brotherton JM, Saville M, et al. The projected timeframe until cervical cancer elimination in Australia: a modelling study. Lancet Public Health. 2018. 10.1016/S2468-2667(18)30183-X. [DOI] [PubMed]
- 8.Research C for BE and. Approved Products - Cervarix Available from: https://www.fda.gov/BiologicsBloodVaccines/Vaccines/ApprovedProducts/ucm186957.htm
- 9.Research C for BE and. Approved Products - Gardasil. Available from: https://www.fda.gov/BiologicsBloodVaccines/Vaccines/ApprovedProducts/UCM094042
- 10.Research C for BE and. Approved Products-Gardasil 9. Available from: https://www.fda.gov/BiologicsBloodVaccines/Vaccines/ApprovedProducts/ucm426445.htm
- 11.Pagliusi SR, Teresa Aguado M. Efficacy and other milestones for human papillomavirus vaccine introduction. Vaccine. 2004;23(5):569–578. doi: 10.1016/j.vaccine.2004.07.046. [DOI] [PubMed] [Google Scholar]
- 12.IARC HPV Working Group. Primary end-points for prophylactic HPV vaccine trials. Lyon: International Agency for Research on Cancer; 2014. [PubMed]
- 13.de Sanjose S, Quint WG, Alemany L, Geraets DT, Klaustermeier JE, Lloveras B, et al. Human papillomavirus genotype attribution in invasive cervical cancer: a retrospective cross-sectional worldwide study. Lancet Oncol. 2010;11(11):1048–1056. doi: 10.1016/S1470-2045(10)70230-8.. [DOI] [PubMed] [Google Scholar]
- 14.Rodríguez-Carunchio L, Soveral I, Steenbergen RDM, Torné A, Martinez S, Fusté P, et al. HPV-negative carcinoma of the uterine cervix: a distinct type of cervical cancer with poor prognosis. BJOG. 2015;122(1):119–127. doi: 10.1111/1471-0528.13071. [DOI] [PubMed] [Google Scholar]
- 15.Interim Clinical Study Report for Study 580299/008 (HPV-008). Available from: https://www.gsk-clinicalstudyregister.com/files2/gsk-580299-008-clinical-study-report-redact.pdf.
- 16.Feiring B, Laake I, Bakken IJ, Greve-Isdahl M, Wyller VB, Håberg SE, et al. HPV vaccination and risk of chronic fatigue syndrome/myalgic encephalomyelitis: a nationwide register-based study from Norway. Vaccine. 2017;35(33):4203–4212. doi: 10.1016/j.vaccine.2017.06.031. [DOI] [PubMed] [Google Scholar]
- 17.Miranda S, Chaignot C, Collin C, Dray-Spira R, Weill A, Zureik M. Human papillomavirus vaccination and risk of autoimmune diseases: a large cohort study of over 2 million young girls in France. Vaccine. 2017;35(36):4761–4768. doi: 10.1016/j.vaccine.2017.06.030. [DOI] [PubMed] [Google Scholar]
- 18.Scheller NM, Pasternak B, Mølgaard-Nielsen D, Svanström H, Hviid A. Quadrivalent HPV vaccination and the risk of adverse pregnancy outcomes. N Engl J Med. 2017;376(13):1223–1233. doi: 10.1056/NEJMoa1612296. [DOI] [PubMed] [Google Scholar]
- 19.Phillips A, Patel C, Pillsbury A, Brotherton J, Macartney K. Safety of human papillomavirus vaccines: an updated review. Drug Saf. 2018;41(4):329–346. doi: 10.1007/s40264-017-0625-z. [DOI] [PubMed] [Google Scholar]
- 20.Liu EY, Smith LM, Ellis AK, Whitaker H, Law B, Kwong JC, et al. Quadrivalent human papillomavirus vaccination in girls and the risk of autoimmune disorders: the Ontario grade 8 HPV vaccine cohort study. CMAJ. 2018;190(21):E648–E655. doi: 10.1503/cmaj.170871. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Golder S, Loke YK, Wright K, Norman G. Reporting of adverse events in published and unpublished studies of health care interventions: a systematic review. PLoS Med. 2016;13(9):e1002127. doi: 10.1371/journal.pmed.1002127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Schroll JB, Penninga EI, Gøtzsche PC. Assessment of adverse events in protocols, clinical study reports, and published papers of trials of orlistat: a document analysis. PLoS Med. 2016;13(8):e1002101. doi: 10.1371/journal.pmed.1002101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Sharma T, Guski LS, Freund N, Gøtzsche PC. Suicidality and aggression during antidepressant treatment: systematic review and meta-analyses based on clinical study reports. BMJ. 2016;27(352):i65. doi: 10.1136/bmj.i65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Maund E, Tendal B, Hróbjartsson A, Jørgensen KJ, Lundh A, Schroll J, et al. Benefits and harms in clinical trials of duloxetine for treatment of major depressive disorder: comparison of clinical study reports, trial registries, and publications. BMJ. 2014;348:g3510. doi: 10.1136/bmj.g3510. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Cochrane Handbook for Systematic Reviews of Interventions. Available from: http://training.cochrane.org/handbook
- 26.Blitshteyn S, Brook J. Postural tachycardia syndrome (POTS) with anti-NMDA receptor antibodies after human papillomavirus vaccination. Immunol Res. 2017;65(1):282–284. doi: 10.1007/s12026-016-8855-1. [DOI] [PubMed] [Google Scholar]
- 27.Brinth LS, Pors K, Theibel AC, Mehlsen J. Orthostatic intolerance and postural tachycardia syndrome as suspected adverse effects of vaccination against human papilloma virus. Vaccine. 2015;33(22):2602–2605. doi: 10.1016/j.vaccine.2015.03.098. [DOI] [PubMed] [Google Scholar]
- 28.Kinoshita T, Abe R-T, Hineno A, Tsunekawa K, Nakane S, Ikeda S-I. Peripheral sympathetic nerve dysfunction in adolescent Japanese girls following immunization with the human papillomavirus vaccine. Intern Med. 2015;54(15):1955. doi: 10.2169/internalmedicine.54.4644. [DOI] [PubMed] [Google Scholar]
- 29.Chandler RE, Juhlin K, Fransson J, Caster O, Edwards IR, Norén GN. Current safety concerns with human papillomavirus vaccine: a cluster analysis of reports in VigiBase®. Drug Saf. 2017;40(1):81–90. doi: 10.1007/s40264-016-0456-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Jefferson T, Jørgensen L. Human papillomavirus vaccines, complex regional pain syndrome, postural orthostatic tachycardia syndrome, and autonomic dysfunction - a review of the regulatory evidence from the European Medicines Agency. Indian J Med Ethics. 2017;2(1):30–37. doi: 10.20529/IJME.2017.006.. [DOI] [PubMed] [Google Scholar]
- 31.Weber C, Andersen S. The company behind the HPV vaccine underestimated the extent of serious side effects [firma bag HPV-vaccinen underdrev omfanget af alvorlige bivirkninger] 2015. [Google Scholar]
- 32.The Committee for Medicinal Products for Human Use (CHMP) at the European Medicines Agency's (EMA) committee responsible for human medicines. Rapporteurs’ Day 150 Joint Response Assessment Report of Gardasil 9. 2014. EMEA/h/c/3852.
- 33.Palmieri B, Poddighe D, Vadalà M, Laurino C, Carnovale C, Clementi E. Severe somatoform and dysautonomic syndromes after HPV vaccination: case series and review of literature. Immunol Res. 2017;65(1):106–116. doi: 10.1007/s12026-016-8820-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Ojha RP, Jackson BE, Tota JE, Offutt-Powell TN, Singh KP, Bae S. Guillain-Barre syndrome following quadrivalent human papillomavirus vaccination among vaccine-eligible individuals in the United States. Hum Vaccin Immunother. 2014;10(1):232–237. doi: 10.4161/hv.26292. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Little DT, Ward HRG. Premature ovarian failure 3 years after menarche in a 16-year-old girl following human papillomavirus vaccination. BMJ Case Rep. 2012, 2012;30. 10.1136/bcr-2012-006879. [DOI] [PMC free article] [PubMed]
- 36.Jørgensen L, Gøtzsche PC, Jefferson T. Index of the human papillomavirus (HPV) vaccine industry clinical study programmes and non-industry funded studies: a necessary basis to address reporting bias in a systematic review. Syst Rev. 2018;7(1):8. doi: 10.1186/s13643-018-0675-z.. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Jørgensen L, Gøtzsche PC, Jefferson T. Benefits and harms of the human papillomavirus vaccines: systematic review of industry and non-industry study reports. York: PROSPERO; 2017. Available from: https://www.crd.york.ac.uk/PROSPEROFILES/56093_PROTOCOL_20170030.pdf
- 38.Jørgensen L, Doshi P, Gøtzsche PC, Jefferson T. Challenges of independent assessment of potential harms of HPV vaccine. BMJ. 2018;362:k3694. doi: 10.1136/bmj.k3694. [DOI] [PubMed] [Google Scholar]
- 39.Jørgensen L, Gøtzsche PC, Jefferson T. Protocol amendment no. 1 and 2: benefits and harms of the human papillomavirus vaccines: systematic review of industry and non-industry study reports. York: PROSPERO; 2017. Available from: https://www.crd.york.ac.uk/PROSPEROFILES/56093_PROTOCOL_20171116.pdf
- 40.Polanin JR, Pigott TD. The use of meta-analytic statistical significance testing. Res Synth Methods. 2015;6(1):63–73. doi: 10.1002/jrsm.1124. [DOI] [PubMed] [Google Scholar]
- 41.Bassler D, Briel M, Montori VM, Lane M, Glasziou P, Zhou Q, et al. Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. JAMA. 2010;303(12):1180–1187. doi: 10.1001/jama.2010.310. [DOI] [PubMed] [Google Scholar]
- 42.Budd AC, Brotherton JML, Gertig DM, Chau T, Drennan KT, Saville M. Cervical screening rates for women vaccinated against human papillomavirus. Med J Aust. 2014;201(5):279–282. doi: 10.5694/mja14.00021. [DOI] [PubMed] [Google Scholar]
- 43.Paynter CA, Van Treeck BJ, Verdenius I, Lau AWY, Dhawan T, Lash KA, et al. Adherence to cervical cancer screening varies by human papillomavirus vaccination status in a high-risk population. Prev Med Rep. 2015;2:711–716. doi: 10.1016/j.pmedr.2015.07.011.. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Dickinson JA, Ogilvie G, Niekerk DV, Popadiuk C. Evidence that supports policies to delay cervical screening until after age 25 years. CMAJ. 2017;189(10):E380–E381. doi: 10.1503/cmaj.160636. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Tainio K, Athanasiou A, KAO T, Aaltonen R, Hernándes CJ, et al. Clinical course of untreated cervical intraepithelial neoplasia grade 2 under active surveillance: systematic review and meta-analysis. BMJ. 2018;360:k499. doi: 10.1136/bmj.k499. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Serrano B, Brotons M, Bosch FX, Bruni L. Epidemiology and burden of HPV-related disease. Best Pract Res Clin Obstet Gynaecol. 2018;47:14–26. doi: 10.1016/j.bpobgyn.2017.08.006. [DOI] [PubMed] [Google Scholar]
- 47.Harper DM, DeMars LR. HPV vaccines - a review of the first decade. Gynecol Oncol. 2017;146(1):196–204. doi: 10.1016/j.ygyno.2017.04.004. [DOI] [PubMed] [Google Scholar]
- 48.GSK Study Register - Study 104951. Available from: https://www.gsk-clinicalstudyregister.com/study/104951?search=study&search_terms=104951#csr
- 49.Garland SM, Hernandez-Avila M, Wheeler CM, Perez G, Harper DM, Leodolter S, et al. Quadrivalent vaccine against human papillomavirus to prevent anogenital diseases. N Engl J Med. 2007;356(19):1915–1927. doi: 10.1056/NEJMoa061741. [DOI] [PubMed] [Google Scholar]
- 50.FUTURE II Study Group Quadrivalent vaccine against human papillomavirus to prevent high-grade cervical lesions. N Engl J Med. 2007;356(19):1915–1927. doi: 10.1056/NEJMoa061741. [DOI] [PubMed] [Google Scholar]
- 51.Grubb BP. Postural tachycardia syndrome. Circulation. 2008;117(21):2814–2817. doi: 10.1161/CIRCULATIONAHA.107.761643. [DOI] [PubMed] [Google Scholar]
- 52.Harden RN, Bruehl S, Perez RSGM, Birklein F, Marinus J, Maihofner C, et al. Validation of proposed diagnostic criteria (the “Budapest criteria”) for complex regional pain syndrome. Pain. 2010;150(2):268–274. doi: 10.1016/j.pain.2010.04.030.. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Harder T, Wichmann O, Klug SJ, van der Sande MAB, Wiese-Posselt M. Efficacy, effectiveness and safety of vaccination against human papillomavirus in males: a systematic review. BMC Med. 2018;16(1):110. doi: 10.1186/s12916-018-1098-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets generated and analysed during the current systematic review are available from the first author (LJ) upon request.