Skip to main content
PMC home page
BMC Public Health logoLink to BMC Public Health
. 2003 Aug 11;3:26. doi: 10.1186/1471-2458-3-26

Risks of serious complications and death from smallpox vaccination: A systematic review of the United States experience, 1963–1968

Tomás J Aragón 1,2,3,4,✉, Skylar Ulrich 2,4, Susan Fernyak 3,4, George W Rutherford 2
PMCID: PMC194634  PMID: 12911836

Abstract

Background

The United States (US) has re-instituted smallpox vaccinations to prepare for an intentional release of the smallpox virus into the civilian population. In an outbreak, people of all ages will be vaccinated. To prepare for the impact of large-scale ring and mass vaccinations, we conducted a systematic review of the complication and mortality risks of smallpox vaccination. We summarized these risks for post-vaccinial encephalitis, vaccinia necrosum (progressive vaccinia), eczema vaccinatum, generalized vaccinia, and accidental infection (inadvertant autoinoculation).

Methods

Using a MEDLINE search strategy, we identified 348 articles, of which seven studies met our inclusion criteria (the number of primary vaccinations and re-vaccinations were reported, sufficient data were provided to calculate complication or case-fatality risks, and comparable case definitions were used). For each complication, we estimated of the complication, death, and case-fatality risks.

Results

The life-threatening complications of post-vaccinial encephalitis and vaccinia necrosum were at least 3 and 1 per million primary vaccinations, respectively. Twenty-nine percent of vaccinees with post-vaccinial encephalitis died and 15% with vaccinia necrosum died. There were no deaths among vaccinees that developed eczema vaccinatum; however, 2.3% of non-vaccinated contacts with eczema vaccinatum died. Among re-vaccinees, the risk of post-vaccinial encephalitis was reduced 26-fold, the risk of generalized vaccinia was reduced 29-fold, and the risk of eczema vaccinatum was reduced 12-fold. However, the risk reductions of accidental infection and vaccinia necrosum were modest (3.8 and 1.5 fold respectively).

Background

In the United States (US) routine smallpox vaccination of the general population ended in 1972 [1]. The last known case of naturally-acquired smallpox occurred in Somalia in 1977, and in 1980 the World Health Organization (WHO) declared that smallpox had been eradicated from the world [2]. Today, most of the US and the world's population is considered susceptible to smallpox infection. Since the September 2001 airplane attacks on the World Trade Center and the anthrax spore attacks using the US mail, the US has taken several steps to mitigate a possible intentional release of variola major (smallpox) virus [3-6], including re-instituting a national smallpox vaccination program [7]. For Phase 1 of this program, the Advisory Committee on Immunization Practices (ACIP) recommended voluntary vaccination of 500,000 members of public health response and hospital health care teams [8]. In Phase 2, up to 10 million first responders such as police, fire, paramedics, and other health care staff would be offered voluntary smallpox vaccination.

However, the implementation the smallpox vaccination program is not without controversy [9]. Vaccinating individuals against smallpox infection, even voluntarily, means exposing vaccinees and their contacts to the risks of serious adverse reactions without the clear benefit of protection against an infection which does not exist and may never exist again. Volunteers must balance their individual risks and benefits of smallpox vaccination. The individual risks and benefits from being vaccinated before an intentional release depends on the probability of an adverse vaccine reaction, the probability that smallpox virus will be released, and the probability that an individual would be directly exposed to a release or an unrecognized case of smallpox [10]. Once an outbreak occurs, ring and mass vaccination would result in a large number of primary vaccinees of all ages, including some with underlying or unrecognized risks for vaccine adverse reactions. In this scenario, we would expect to see an increased number and risk of vaccine complications. Estimation of the vaccine complication risks by age, including their precision and estimation biases, are necessary to formulate policies and inform individual choice regarding the risks and benefits of pre-outbreak smallpox vaccination, and to estimate the burden of vaccine complications from ring and mass vaccination during an smallpox outbreak in the general population.

Recent publications [11-16] have summarized or cited the complication risks associated with receiving smallpox vaccination; however, to our knowledge, no systematic review of this older literature has been conducted. The purpose of this systematic review is to review and summarize the age-specific complication and case fatality risks of post-vaccinial encephalitis, vaccinia necrosum (progressive vaccinia), eczema vaccinatum, generalized vaccinia, and accidental infection (inadvertant autoinoculation) from smallpox vaccinations conducted in the US. We restricted our review to US studies because the New York City Board of Health vaccinia strain, which was the only strain used in the US, is the strain in current use by the the national vaccination program (and will be in the future) [11].

Methods

Searching

Two reviewers (T.J.A., S.U.) conducted the literature searches, selection of studies, and data extraction. To identify potential studies we searched MEDLINE which covered 1965 through November 2002. We entered the following search string: ((Smallpox Vaccine/*adverse effects [MeSH terms] AND "English" [Language]) OR ((Vaccination/*adverse effects [MeSH terms] AND "vaccinia" [MeSH terms]) AND "English" [Language])). From this search result, potentially relevant studies on smallpox vaccine complications were identified, screened, and retrieved. The reference lists in all retrieved articles, including reviews, were evaluated to identify, screen, and retrieve additional articles not identified in the MEDLINE search. Selected primary authors were contacted to identify additional studies we may have missed [17,18]. Based on this consultation and our inclusion criteria (described below) we did not pursue articles published before 1965 or from additional US databases.

Selection criteria

All US studies of smallpox vaccine complications were included for further review. Articles were screened further based on the following criteria: (1) the number of persons vaccinated and whether the vaccine complications were reported by vaccination status; that is, whether it was a primary vaccination or a re-vaccination, (2) sufficient data were provided to calculate complication or case-fatality risks, and (3) one or more vaccination complications were consistent with case definitions as defined by Neff and colleagues [19]. Prior to this publication there were no consistent case definitions of smallpox vaccine complications. The following summarizes the Neff criteria:

• Encephalitis: post-vaccinial central nervous system involvement, including separately or in combination, the following symptoms: meningeal signs, ataxia, muscular weakness, paralysis, lethargy, coma or convulsions,

• Vaccinia necrosum (progressive vaccinia): spreading necrosis at the site of the vaccination, with or without metastatic necrotic lesions occurring elsewhere on the body,

• Eczema vaccinatum: generalized spread of vaccinial lesions or local implantation of vaccinia in a person who has eczema or a past history of eczema,

• Generalized vaccinia: generalized vaccinial lesions, with no eczema or other pre-existing lesion,

• Accidental infection: vaccinial lesions resulting from accidental autoinoculation of vaccinia virus in the eye or mouth or on other parts of the body, with no eczema or other pre-existing skin lesions.

Validity assessment

For this review we did not develop a quality score. Instead, we collected relevant information that might bias the complication and case fatality risk estimates from each article. This included information on the study location, whether potential vaccinees were screened (e.g., history of eczema/atopic dermatitis), reporting source of vaccine complications and deaths (numerators), and source of numbers of persons vaccinated (denominators). This information was summarized to help the reader interpret the findings.

Data abstraction

Data from each article were abstracted separately by the two primary reviewers. For quality control, two additional staff independently abstracted the data, and any disagreements were resolved by the primary reviewers.

Study characteristics

The selected studies were published in English. They had the type and number of vaccine complications, and an estimate of the number of persons vaccinated. The type and number of complications came from several sources which are summarized in Table 1. The number of persons vaccinated were either known as in the US cohort studies [20,21], or were estimated using data from US national or state immunization surveys [19,22-25].

Table 1.

Comparison of smallpox vaccination adverse effects studies meeting selection criteria for this systematic review

Study and year published [Ref] Source Number of primary and re-vaccinations Screening occurred Complications Numerator source Denominator source
Complication Death
Neff 1967a [19] United States, 1963 6,239,000
7,775,000		 NR PVE, VN, EV, GV, AI Red Cross VIG distribution system, CDC, National Survey of pediatrician and general practitioners Deaths certificates Estimated by National Bureau of Census Immunization Survey
Neff 1967b [22] United States, 1963 (North Carolina, Rhode Island, Washington, Wyoming) 298,000
370,000		 NR PVE, VN, EV, GV, AI Retrospective physician survey, Local health officers, Records at major medical centers Death certificates Estimated by National Bureau of Census Immunization Survey
Lane 1969 [24] United States, 1968 5,594,000
8,574,000		 NR PVE, VN, EV, GV, AI Red Cross VIG distribution system, Red Cross consultants, State & Territorial Epidemiologists, Burroughs-Wellcome Co., Vaccine manufacturers, NCDC Encephalitic Surveillance Unit, NCDC Viral Exanthems Unit Death certificates Estimated by National Bureau of Census Immunization Survey
Lane 1970 [25] United States, 1968 (Alabama, Alaska, Iowa, Kentucky, Maine, Maryland, Rhode Island, South Carolina, Washington, West Virginia) 596,000
998,000		 NR PVE, VN, EV, GV, AI Prospective physician survey, Public health nurse survey (2 states) NR Estimated by National Bureau of Census Immunization Survey
Mellin 1970 [23] United States, 1968 (Maryland) 109,000
166,000		 NR PVE, VN, EV, GV, AI Medical and chirurgical faculty, County health officers, Chief pediatricians in general hospitals, Red Cross VIG distribution system, General hospitals, Public health nurses NR Estimated by National Bureau of Census Immunization Survey
Ratner 1970 [21] Puerto Rico, 1967 369,546
465,926		 Yesa PVE, VN, EV, GV, AI Physician survey, Immunization nurses, University hospital dermatologists, Red Cross VIG distribution system NR National smallpox vaccination campaign
Neff 1972 [20] United States, 1968 (Baltimore pediatric clinic) 549
433		 NR PVE, VN, EV, GV, AI Pediatric clinic chart review NR Clinic chart review
Open in a new tab

NR = Not reported, PVE = post-vaccinial encephalitis, VN = vaccinia necrosum, EV = eczema vaccinatum, GV = generalized vaccinia, AI = accidental infection (inadvertant autoinoculation), VIG = Vaccinia immune globulin, NCDC = National Communicable Disease Center. aVaccinations withheld from persons aged less than 1 year or greater than 60 years, and persons with acute illness, blood dyscrasia, malignancy, pregnancy, eczema or infectious skin disease, eczema in household contacts, steroid therapy, radiation therapy; cerebral damage, or seizure disorder. bWyeth Dryvax product licensed and is use during this period [11]

Quantitative data synthesis

Data in all the studies, except the Ratner study, were stratified by vaccination status and by the following age groups (age <1 year, ages 1 to 4 years, ages 5 to 19 years, ages 20+ years, and all ages combined). For the Ratner study [21], data in the age groups "Age 5 to 14" and "Age 15+" were counted in the groups "Age 5 to 19" and "Age 20+," respectively.

For primary vaccinations, and for each complication, the study risk estimates were stratified by age group and by study, and combined across age groups and studies. First, the age-specific risk of each complication was calculated as the number of reported complications divided by the number vaccinated for that age group. Second, the age-specific risk of death from post-vaccinial encephalitis, vaccinia necrosum, and eczema vaccinatum was calculated as the number of deaths from each complication divided by the number vaccinated for that age group. Third, the age-specific case fatality risks from post-vaccinial encephalitis, vaccinia necrosum, and eczema vaccinatum were calculated as the number of deaths from a specific complication divided by the number with that specific complication. For all risk estimates, exact 95% confidence intervals were calculated based on the binomial distribution using R, a freely available open source programming language for statistical computing and graphics [26].

Although contact vaccinia was not the focus of this review, for non-vaccinees with contact-acquired eczema vaccinatum that was reported, we calculated the case fatality risk.

For re-vaccinations, the same risk estimates were calculated as for primary vaccinations. However, because the risk of complications was much lower for revaccinations, the risks estimates were stratified by study only and summarized in one table.

Results

Our search yielded a total of 348 studies: 342 from the MEDLINE search, 2 from the reference lists review [27,28], 2 from author communications [29,30], and 2 from our files [27,31]. From this pool, 18 articles of smallpox vaccination complications were identified for further review. Using our selection criteria we excluded 11 studies: 3 did not use the Neff criteria [31-33], 3 did not report complications by vaccination status [34-36], 3 did not report the total number of vaccinations by vaccination status [27,37,38], and 2 studies' results [39,40] were reported in another article [25]. The remaining 7 articles form the basis of this systematic review and represent data from approximately 13,206,095 primary vaccinations and 18,349,359 re-vaccinations [19-25] (Table 1).

The US studies covered the years 1963, 1967, and 1968. Five of the 7 studies were period analyses [19,22-25]. For a period analysis, the number of vaccine complications for a selected geographic location and period of time were ascertained from a variety of sources (Table 1, columns 6 and 7). The at-risk population was the number of persons vaccinated in that location during the same time period. This number was estimated from a variety of sources including population-based regional and national surveys (Table 1, column 8). One study was a prospective cohort study [21] and the other was a clinic-based retrospective cohort study [20].

Primary vaccination

Post-vaccinial encephalitis

The risk of post-vaccinial encephalitis (complication risk, CR), the risk of a post-vaccinial encephalitis death (mortality risk, MR), and the individual risk of dying of post-vaccinial encephalitis (case fatality risk, CFR) by age group are displayed in Table 2. The highest risk for developing post-vaccinial encephalitis was among infants aged <1 year old (risk ratio, 2.80, compared to vaccinees aged 1 year or older). Although the summary risk in this age group was 6.8 cases per million vaccinations, the 1970 Lane et al. study [25] that prospectively surveyed physicians estimated a much higher risk (CR, 176.5 cases per million; 95% CI, 36.4–515). The risk in vaccinees aged >1 year was much lower and did not change with age.

Table 2.

Risk of post-vaccinial encephalitis (P.V.E.) and death from primary smallpox vaccinations, Stratified by age and study, 1963–1968

Age group and studies Number vaccinated P.V.E. No. Deaths No. Risk of complication per million (95% C.I.)a Risk of death per million (95% C.I.)a Case fatality risk per hundred (95% C.I.)a
Age <1
 Neff 1967a 654,000 1 0 1.5 (0.04, 8.5) 0.0 (0.0, 5.6) 0.0 (0.0, 97.5)
 Neff 1967b 31,000 1 0 32.3 (0.8, 180) 0.0 (0.0, 119) 0.0 (0.0, 97.5)
 Lane 1969 614,000 4 3 6.5 (1.8, 167) 4.9 (1.0, 14.3) 75.0 (19.4, 99.4)
 Lane 1970 17,000 3 1 176.5 (36.4, 515) 58.8 (1.5, 328) 33.3 (0.84, 90.6)
 Ratner 1970 1 0 0 n/c n/c n/c n/c n/a n/a
 Neff 1972 32 0 0 n/c n/c n/c n/c n/a n/a
 Summary 1,316,033 9 4 6.8 (3.1, 13.0) 3.0 (0.8, 7.8) 44.4 (13.7, 78.8)
Age 1 to 4
 Neff 1967a 2,973,000 2 1 0.7 (0.08, 2.4) 0.3 (0.008, 1.9) 50.0 (1.3, 98.7)
 Neff 1967b 142,000 0 0 0.0 (0.0, 26.0) 0.0 (0.0, 26.0) n/a n/a
 Lane 1969 2,733,000 6 0 2.2 (0.8, 4.8) 0.0 (0.0, 1.3) 0.0 (0.0, 45.9)
 Lane 1970 317,000 3 0 9.5 (2.0, 27.6) 0.0 (0.0, 11.6) 0.0 (0.0, 70.8)
 Ratner 1970 68,002 0 0 0.0 (0.0, 54.2) 0.0 (0.0, 54.2) n/a n/a
 Neff 1972 517 0 0 0.0 (0.0, 7110) 0.0 (0.0, 7110) n/a n/a
 Summary 6,233,519 11 1 1.8 (0.9, 3.2) 0.2 (0.004, 0.9) 9.1 (0.23, 41.3)
Age 5 to 19
 Neff 1967a 2,295,000 8 4 3.5 (1.5, 6.9) 1.7 (0.5, 4.5) 50.0 (15.7, 84.3)
 Neff 1967b 110,000 0 0 0.0 (0.0, 33.5) 0.0 (0.0, 33.5) n/a n/a
 Lane 1969 1,959,000 5 1 2.6 (0.8, 6.0) 0.5 (0.01, 2.8) 20.0 (0.50, 71.6)
 Lane 1970 229,000 2 0 8.7 (1.1, 31.5) 0.0 (0.0, 16.1) 0.0 (0.0, 84.2)
 Ratner 1970b 193,721 1 1 5.2 (0.1, 28.8) 5.2 (0.1, 28.8) 100.0 (2.5, 100)
 Summary 4,786,721 16 6 3.3 (1.9, 5.4) 1.2 (0.5, 2.7) 37.5 (15.2, 64.6)
Age 20 +
 Neff 1967a 317,000 1 0 3.2 (0.1, 17.6) 0.0 (0.0, 11.6) 0.0 (0.0, 97.5)
 Neff 1967b 15,000 0 0 0.0 (0.0, 246) 0.0 (0.0, 246) n/a n/a
 Lane 1969 288,000 1 0 3.5 (0.1, 19.3) 0.0 (0.0, 12.8) 0.0 (0.0, 97.5)
 Lane 1970 33,000 0 0 0.0 (0.0, 112) 0.0 (0.0, 112) n/a n/a
 Ratner 1970b 107,822 0 0 0.0 (0.0, 34.2) 0.0 (0.0, 34.2) n/a n/a
 Summary 760,822 2 0 2.6 (0.3, 9.5) 0.0 (0.0, 4.8) 0.0 (0.0, 84.2)
All agesc
 Neff 1967a 6,239,000 12 5 1.9 (0.2, 3.4) 0.8 (0.3, 1.9) 41.7 (15.2, 72.3)
 Neff 1967b 298,000 1 0 3.4 (0.1, 18.7) 0.0 (0.0, 12.2) 0.0 (0.0, 97.5)
 Lane 1969 5,594,000 16 4 2.9 (1.6, 4.6) 0.7 (0.2, 1.8) 25.0 (7.3, 52.4)
 Lane 1970 596,000 8 1 13.4 (5.8, 26.4) 1.7 (0.04, 9.3) 12.5 (0.3, 52.6)
 Mellin 1970 109,000 0 0 0.0 (0.0, 33.8) 0.0 (0.0, 33.8) n/a n/a
 Ratner 1970 369,546 1 1 2.7 (0.07, 15.1) 2.7 (0.1, 15.1) 100.0 (2.5, 100)
 Neff 1972 549 0 0 0.0 (0.0, 6697) 0.0 (0.0, 6697) n/a n/a
 Summary 13,206,095 38 11 2.9 (2.0, 3.9) 0.8 (0.4, 1.5) 28.9 (15.4, 45.9)
Open in a new tab

n/c = not calculated, n/a = not assessable aRisk and confidence intervals not calculated (n/c) for less that 100 vaccinations. Exact confidence intervals based on the binomial distribution. bThe Ratner study age groups, "Age 5 to 14" and "Age 15+", were counted in the Table age groups "Age 5 to 19" and "Age 20+", respectively. cAll ages group may includes subjects whose age was unknown

The summary case fatality risk for post-vaccinial encephalitis was highest in infants aged <1 year (CFR, 44.4 deaths per 100 cases; 95% CI, 13.7–78.8), however, it was not statistically different from the other age groups (P value = 0.21). For all ages groups, combined there were 11 deaths among 38 cases of post-vaccinial encephalitis (CFR, 28.9 deaths per 100 cases; 95% CI, 15.4–45.9).

Vaccinia necrosum (progressive vaccinia)

The risk of vaccinia necrosum, the risk of a vaccinia necrosum death, and the individual risk of dying from vaccinia necrosum by age group are displayed in Table 3. The highest summary risks for developing vaccinia necrosum were among vaccinees aged 20 years or older (CR, 5.3 cases per million; 95% CI, 1.4–13.5). For all ages combined, there were 13 cases of vaccinia necrosum from over 13 million vaccinations (CR, 1.0 cases per million; 95% CI, 0.5–1.7) Almost all cases of vaccinia necrosum occurred in persons with a previously diagnosed hematopoetic malignancy or immunodeficiency condition [24].

Table 3.

Risk of vaccinia necrosum (V.N.) (progressive vaccinia) and death from primary smallpox vaccinations, Stratified by age and study, 1963–1968

Age group and studies Number vaccinated V.N. No. Deaths No. Risk of complication per million (95% C.I.)a Risk of death per million (95% C.I.)a Case fatality risk per hundred (95% C.I.)a
Age <1
 Neff 1967a 654,000 1 0 1.5 (0.04, 8.5) 0.0 (0.0, 5.6) 0.0 (0.0, 97.5)
 Neff 1967b 31,000 0 0 0.0 (0.0, 122) 0.0 (0.0, 119.0) n/a n/a
 Lane 1969 614,000 0 0 0.0 (0.0, 6.0) 0.0 (0.0, 6.0) n/a n/a
 Lane 1970 17,000 0 0 0.0 (0.0, 217) 0.0 (0.0, 217) n/a n/a
 Ratner 1970 1 0 0 n/c n/c n/c n/c n/a n/a
 Neff 1972 32 0 0 n/c n/c n/c n/c n/a n/a
 Summary 1,316,033 1 0 0.8 (0.02, 4.2) 0.0 (0.0, 2.8) 0.0 (0.0, 97.5)
Age 1 to 4
 Neff 1967a 2,973,000 1 0 0.3 (0.01, 1.9) 0.0 (0.0, 1.2) 0.0 (0.0, 97.5)
 Neff 1967b 142,000 0 0 0.0 (0.0, 26.0) 0.0 (0.0, 26.0) n/a n/a
 Lane 1969 2,733,000 1 0 0.4 (0.01, 2.0) 0.0 (0.0, 1.3) 0.0 (0.0, 97.5)
 Lane 1970 317,000 1 0 3.2 (0.08, 17.6) 0.0 (0.0, 11.6) 0.0 (0.0, 97.5)
 Ratner 1970 68,002 0 0 0.0 (0.0, 54.2) 0.0 (0.0, 54.2) n/a n/a
 Neff 1972 517 0 0 0.0 (0.0, 7110) 0.0 (0.0, 7110) n/a n/a
 Summary 6,233,519 3 0 0.5 (0.1, 1.4) 0.0 (0.0, 0.6) 0.0 (0.0, 70.8)
Age 5 to 19
 Neff 1967a 2,295,000 3 0 1.3 (0.3, 3.8) 0.0 (0.0, 1.6) 0.0 (0.0, 70.6)
 Neff 1967b 110,000 0 0 0 (0.0, 33.5) 0.0 (0.0, 33.5) n/a n/a
 Lane 1969 1,959,000 2 2 1.0 (0.1, 3.7) 1.0 (0.1, 3.7) 100 (15.8, 100)
 Lane 1970 229,000 0 0 0 (0.0, 16.1) 0.0 (0.0, 16.1) n/a n/a
 Ratner 1970b 193,721 0 0 0 (0.0, 19.0) 0.0 (0.0, 19.0) n/a n/a
 Summary 4,786,721 5 2 1.0 (0.34, 2.44) 0.4 (0.05, 1.5) 40.0 (5.3, 85.3)
Age 20 +
 Neff 1967a 317,000 2 0 6.3 (0.8, 22.8) 0.0 (0.0, 11.6) 0.0 (0.0, 84.2)
 Neff 1967b 15,000 0 0 0.0 (0.0, 246) 0.0 (0.0, 246) n/a n/a
 Lane 1969 288,000 2 0 6.9 (0.8, 25.1) 0.0 (0.0, 12.8) 0.0 (0.0, 84.2)
 Lane 1970 33,000 0 0 0.0 (0.0, 112) 0.0 (0.0, 112) n/a n/a
 Ratner 1970b 107,822 0 0 0.0 (0.0, 34.2) 0.0 (0.0, 34.2) n/a n/a
 Summary 760,822 4 0 5.3 (1.4, 13.5) 0.0 (0.0, 4.8) 0.0 (0.0, 60.2)
All agesc
 Neff 1967a 6,239,000 7 0 1.1 (0.4, 2.3) 0.0 (0.0, 0.6) 0.0 (0.0, 41.1)
 Neff 1967b 298,000 0 0 0.0 (0.0, 12.4) 0.0 (0.0, 12.4) n/a n/a
 Lane 1969 5,594,000 5 2 0.9 (0.3, 2.1) 0.4 (0.04, 1.3) 40.0 (5.3, 85.3)
 Lane 1970 596,000 1 0 1.7 (0.04, 9.3) 0.0 (0.0, 6.2) 0.0 (0.0, 97.5
 Mellin 1970 109,000 0 0 0.0 (0.0, 33.8) 0.0 (0.0, 33.8) n/a n/a
 Ratner 1970 369,546 0 0 0.0 (0.0, 10.0) 0.0 (0.0, 10.0) n/a n/a
 Neff 1972 549 0 0 0.0 (0.0, 6697) 0.0 (0.0, 6697) n/a n/a
 Summary 13,206,095 13 2 1.0 (0.5, 1.7) 0.2 (0.02, 0.5) 15.4 (1.9, 45.4)
Open in a new tab

n/c = not calculated, n/a = not assessable aRisk and confidence intervals not calculated (n/c) for less that 100 vaccinations. Exact confidence intervals based on the binomial distribution. bThe Ratner study age groups, "Age 5 to 14" and "Age 15+", were counted in the Table age groups "Age 5 to 19" and "Age 20+", respectively. cAll ages group includes subjects whose age was unknown

For all age groups combined, there were 2 deaths among 13 cases of vaccinia necrosum (CFR, 15.4 deaths per 100 cases; 95% CI, 1.9–45.4).

Eczema vaccinatum

The risk of eczema vaccinatum, the risk of a eczema vaccinatum death, and the individual risk of dying from eczema vaccinatum by age group are displayed in Table 4. For all age groups combined, there were 169 cases of eczema vaccinatum from over 13 million vaccinations (CR, 12.8 cases per 1 million vaccinations; 95% CI, 10.9–14.9). The summary risks of eczema vaccinatum did not differ across age groups. However, within age groups, the highest risks were recorded from the US studies that used physician surveys to ascertain complications not captured by other reporting mechanisms [22,25]. In these two studies, the risks of eczema vaccinatum ranged from 30.3 to 96.8 cases per million vaccinations, and were higher in infants <1 year, although not statistically significant.

Table 4.

Risk of eczema vaccinatum (E.V.) and death from primary smallpox vaccinations, Stratified by age and study, 1963–1968

Age group and studies Number vaccinated E.V. No. Deaths No. Risk of complication per million (95% C.I.)a Risk of death per million (95% C.I.)a Case fatality risk per hundred (95% C.I.)a
Age <1
 Neff 1967a 654,000 16 0 24.5 (14.0, 39.7) 0.0 (0.0, 5.6) 0.0 (0.0, 20.6)
 Neff 1967b 31,000 3 0 96.8 (20.0, 283) 0.0 (0.0, 119) 0.0 (0.0, 70.8)
 Lane 1969 614,000 5 0 8.1 (2.6, 19.0) 0.0 (0.0, 6.0) 0.0 (0.0, 52.2)
 Lane 1970 17,000 1 0 58.8 (1.5, 328) 0.0 (0.0, 217) 0.0 (0.0, 97.5)
 Ratner 1970 1 0 0 n/c n/c n/c n/c n/a n/a
 Neff 1972 32 0 0 n/c n/c n/c n/c n/a n/a
 Summary 1,316,033 25 0 19.0 (12.3, 28.0) 0.0 (0.0, 2.8) 0.0 (0.0, 13.7)
Age 1 to 4
 Neff 1967a 2,973,000 22 0 7.4 (4.6, 11.2) 0.0 (0.0, 1.2) 0.0 (0.0, 15.4)
 Neff 1967b 142,000 9 0 63.4 (29.0, 120) 0.0 (0.0, 26.0) 0.0 (0.0, 33.6)
 Lane 1969 2,733,000 31 0 11.3 (7.7, 16.1) 0.0 (0.0, 1.3) 0.0 (0.0, 11.2)
 Lane 1970 317,000 14 0 44.2 (24.1, 74.1) 0.0 (0.0, 11.6) 0.0 (0.0, 23.2)
 Ratner 1970 68,002 0 0 0.0 (0.0, 54.2) 0.0 (0.0, 54.2) n/a n/a
 Neff 1972 517 0 0 0.0 (0.0, 7110) 0.0 (0.0, 7110) n/a n/a
 Summary 6,233,519 76 0 12.2 (9.6, 15.3) 0.0 (0.0, 0.6) 0.0 (0.0, 4.7)
Age 5 to 19
 Neff 1967a 2,295,000 15 0 6.5 (3.7, 10.8) 0.0 (0.3, 1.6) 0.0 (0.0, 21.8)
 Neff 1967b 110,000 8 0 72.7 (31.4, 143) 0.0 (0.3, 33.5) 0.0 (0.0, 36.9)
 Lane 1969 1,959,000 14 0 7.1 (3.9, 12.0) 0.0 (0.3, 1.9) 0.0 (0.0, 23.2)
 Lane 1970 229,000 8 0 34.9 (15.1, 68.8) 0.0 (0.3, 16.1) 0.0 (0.0, 36.9)
 Ratner 1970b 193,721 3 0 15.5 (3.2, 45.3) 0.0 (0.3, 19.0) 0.0 (0.0, 70.8)
 Summary 4,786,721 48 0 10.0 (7.4, 13.3) 0.0 (0.0, 0.8) 0.0 (0.0, 7.4)
Age 20 +
 Neff 1967a 317,000 1 0 3.2 (0.1, 17.6) 0.0 (0.3, 11.6) 0.0 (0.0, 97.5)
 Neff 1967b 15,000 1 0 66.7 (1.7, 371) 0.0 (0.3, 246 0.0 (0.0, 97.5)
 Lane 1969 288,000 7 0 24.3 (9.8, 50.1) 0.0 (0.3, 12.8) 0.0 (0.0, 41.0)
 Lane 1970 33,000 1 0 30.3 (0.8, 169) 0.0 (0.3, 112 0.0 (0.0, 97.5)
 Ratner 1970b 107,822 0 0 0.0 (0.0, 34.2) 0.0 (0.3, 34.2) n/a n/a
 Summary 760,822 10 0 13.1 (6.3, 24.2) 0.0 (0.0, 4.8) 0.0 (0.0, 30.8)
All agesc
 Neff 1967a 6,239,000 54 0 8.6 (6.5, 11.3) 0.0 (0.0, 0.6) 0.0 (0.0, 6.6)
 Neff 1967b 298,000 24 0 80.5 (51.6, 120) 0.0 (0.0, 12.4) 0.0 (0.0, 14.2)
 Lane 1969 5,594,000 58 0 10.4 (7.9, 13.4) 0.0 (0.0, 0.7) 0.0 (0.0, 6.2)
 Lane 1970 596,000 25 0 41.9 (27.1, 61.9) 0.0 (0.0, 6.2) 0.0 (0.0, 13.7)
 Mellin 1970 109,000 5 0 45.9 (14.9, 107) 0.0 (0.0, 33.8) 0.0 (0.0, 52.2)
 Ratner 1970 369,546 3 0 8.1 (1.7, 23.7) 0.0 (0.0, 10.0) 0.0 (0.0, 70.8)
 Neff 1972 549 0 0 0.0 (0.0, 6697) 0.0 (0.0, 6697) n/a n/a
 Summary 13,206,095 169 0 12.8 (10.9, 14.9) 0.0 (0.0, 0.3) 0.0 (0.0, 2.2)
Open in a new tab

n/c = not calculated, n/a = not assessable aRisk and confidence intervals not calculated (n/c) for less that 100 vaccinations. Exact confidence intervals based on the binomial distribution. bThe Ratner study age groups, "Age 5 to 14" and "Age 15+", were counted in the Table age groups "Age 5 to 19" and "Age 20+", respectively. cAll ages group includes subjects whose age was unknown

For all age groups combined, there were no deaths among 169 cases of eczema vaccinatum (CFR, 0 deaths per 100 cases; 95% CI, 0.0–2.2). However, among non-vaccinees that developed eczema vaccinatum after contact transmission from a recent vaccinee, 3 of 132 cases died (2.3 deaths per 100 cases; 95% CI, 0.5–6.5) [19,22,24,25].

Generalized vaccinia

The risk of generalized vaccinia is displayed in Table 5. The summary risk of developing generalized vaccinia was highest among infants aged <1 year (103.3 cases per million vaccinations; 95% CI, 86.7–122.2). However, within age groups, the highest risks were recorded from the US studies that used physician surveys to ascertain complications not captured by other reporting mechanisms [22,25]. The complication risks ranged from 133.3 to 1647 cases per million vaccinations and were highest in infants aged <1 year. The highest risks were reported from the study that prospectively surveyed physicians [25].

Table 5.

Risk of generalized vaccinia (G.V.) and accidental infection (A.I.) from primary smallpox vaccinations, Stratified by age and study, 1963–1968

Generalized vaccinia Accidental infection
Age group and studies Number vaccinated G.V. No. Deaths No. Risk of complication per million (95% C.I.)a Number vaccinated A.I. No. Deaths No. Risk of complication per million (95% C.I.)a
Age <1
 Neff 1967a 654,000 52 0 79.5 (59.4, 104) 654,000 7 0 10.7 (4.3, 22.0)
 Neff 1967b 31,000 12 0 387.1 (200, 676) n/a n/a n/a n/a n/a
 Lane 1969 614,000 43 0 70.0 (50.7, 94.3) 614,000 7 0 11.4 (4.6, 23.5)
 Lane 1970 17,000 28 0 1647 (1095, 2380) 17,000 36 0 2117.6 (1484, 2930)
 Ratner 1970 1 1 0 n/c n/c 1 0 0 n/c n/c
 Neff 1972 32 0 0 n/c n/c 32 0 0 n/c n/c
 Summary 1,316,033 136 0 103.3 (86.7, 122.2) 1,285,033 50 0 38.9 (28.9, 51.3)
Age 1 to 4
 Neff 1967a 2,973,000 46 0 15.5 (11.3, 20.6) 2,973,000 40 0 13.4 (9.6, 18.3)
 Neff 1967b 142,000 24 0 169.0 (108, 251) n/a n/a n/a n/a n/a
 Lane 1969 2,733,000 47 0 17.2 (12.6, 22.9) 2,733,000 91 0 33.3 (26.8, 40.9)
 Lane 1970 317,000 74 0 233.4 (183, 293) 317,000 183 0 577.3 (497, 667)
 Ratner 1970 68,002 6 0 88.2 (32.4, 192) 68,002 3 0 44.1 (9.1, 129)
 Neff 1972 517 0 0 0.0 (0.0, 7110) 517 3 0 5802.7 (1198, 16,864)
 Summary 6,233,519 197 0 31.6 (27.3, 36.3) 6,091,519 320 0 52.5 (46.9, 58.6)
Age 5 to 19
 Neff 1967a 2,295,000 24 0 10.5 (6.7, 15.6) 2,295,000 33 0 14.4 (9.9, 20.2)
 Neff 1967b 110,000 17 0 154.5 (90.0, 247) n/a n/a n/a n/a n/a
 Lane 1969 1,959,000 25 0 12.8 (8.3, 18.8) 1,959,000 35 0 17.9 (12.4, 24.8)
 Lane 1970 229,000 32 0 139.7 (95.6, 197) 229,000 85 0 371.2 (296, 459)
 Ratner 1970b 193,721 9 0 46.5 (21.2, 88.2) 193,721 2 0 10.3 (1.2, 37.3)
 Summary 4,786,721 107 0 22.4 (18.3, 27.0) 4,676,721 155 0 33.1 (28.1, 38.8)
Age 20 +
 Neff 1967a 317,000 6 0 18.9 (6.9, 41.2) 317,000 4 0 12.6 (3.4, 32.3)
 Neff 1967b 15,000 2 0 133.3 (16.1, 482) n/a n/a n/a n/a n/a
 Lane 1969 288,000 13 0 45.1 (24.0, 77.2) 288,000 4 0 13.9 (3.8, 35.6)
 Lane 1970 33,000 7 0 212.1 (85.3, 437) 33,000 20 0 606.1 (370, 936)
 Ratner 1970b 107,822 10 0 92.7 (44.5, 171) 107,822 8 0 74.2 (32.0, 146)
 Summary 760,822 38 0 49.9 (35.3, 68.6) 745,822 36 0 48.3 (33.8, 66.8)
All agesc
 Neff 1967a 6,239,000 130 0 20.8 (17.4, 24.7) 6,239,000 85 0 13.6 (10.9, 16.8)
 Neff 1967b 298,000 71 0 238.3 (186.1, 300) 298,000 250 0 838.9 (738, 950)
 Lane 1969 5,594,000 131 0 23.4 (19.6, 27.8) 5,594,000 142 0 25.4 (21.4, 23.0)
 Lane 1970 596,000 157 0 263.4 (224, 308) 596,000 344 0 577.2 (518, 641)
 Mellin 1970 109,000 12 0 110.1 (56.9, 192) 109,000 20 0 183.5 (112, 283)
 Ratner 1970 369,546 26 0 70.4 (46.0, 103) 369,546 13 0 35.2 (18.7, 60.1)
 Neff 1972 549 0 0 0.0 (0.0, 6697) 549 3 0 5464.5 (1128, 15,885)
 Summary 13,206,095 527 0 39.9 (36.6, 43.5) 13,206,095 857 0 64.9 (60.6, 69.4)
Open in a new tab

n/c = not calculated, n/a = not available from this study aRisk and confidence intervals not calculated (n/c) for less that 100 vaccinations. Exact confidence intervals based on the binomial distribution. bThe Ratner study age groups, "Age 5 to 14" and "Age 15+", were counted in the Table age groups "Age 5 to 19" and "Age 20+", respectively. cAll ages group includes subjects whose age was unknown

For all age groups combined, there were no deaths among 527 cases of generalized vaccinia (CFR, 0 deaths per 100 cases; 95% CI, 0.0–0.7).

Accidental infection (inadvertent autoinoculation)

The risk of accidental infection is displayed in Table 5. For all age groups combined, there were 857 cases of accidental infection from over 13 million vaccinations (CR, 64.9 cases per 1 million vaccinations; 95% CI, 60.6–69.4). The summary risks of accidental infection did not differ across age groups. However, within age groups, the highest risks were recorded from two US studies: the Lane study [25] that prospectively surveyed physicians and the Neff pediatric clinic study [20]. In the Lane study, the risk ranged from 371.2 to 2118 cases per million vaccinations, and was highest in infants aged <1 year. The Neff study reported 3 accidental infections from 517 vaccinations in the age group 1 to 4 years (CR, 5803 cases per million; 95% CI, 1198–16,863).

For all age groups combined, there were no deaths among 857 cases of accidental infection (CFR, 0 deaths per 100 cases; 95% CI, 0.0–0.4).

Re-vaccination

For smallpox vaccine re-vaccinations, the risks of developing specific complications, the risks of a specific complication death, and the individual risks of dying from specific complications by age group are displayed in Table 6. Because the risks were so low compared to primary vaccination, the risks were not stratified by age group. Compared to primary vaccinations, the summary risk of post-vaccinial encephalitis was 26 times lower in re-vaccinations, vaccinia necrosum was 1.5 times lower, eczema vaccinatum was 12 times lower, generalized vaccinia was 29 times lower, and accidental infection was 3.8 times lower. Only 2 deaths occurred from over 19.5 million re-vaccinations (MR, 0.1 deaths per million; 95% CI, 0.01–0.4). These two deaths occurred among 12 cases of vaccinia necrosum (CFR 16.7 deaths per 100 cases; 95% CI, 2.1–48.4).

Table 6.

Risk of serious complications (S.C.) and death from smallpox re-vaccinations for ages greater than 1, 1963–1968

Complication and studies Number vaccinated S.C. No. Deaths No. Risk of complication per million (95% C.I.)a Risk of death per million (95% C.I.)a Case fatality risk per hundred (95% C.I.)a
Post-vaccinial encephalitis
 Neff 1967a 7,775,000 0 0 0.0 (0.0, 0.5) 0.0 (0.0, 0.5) n/a n/a
 Neff 1967b 370,000 0 0 0.0 (0.0, 10.0) 0.0 (0.0, 10.0) n/a n/a
 Lane 1969 8,574,000 0 0 0.0 (0.0, 0.4) 0.0 (0.0, 0.4) n/a n/a
 Lane 1970 998,000 2 0 2.0 (0.2, 7.3) 0.0 (0.0, 3.7) 0.0 (0.0, 84.2)
 Mellin 1970 166,000 0 0 0.0 (0.0, 22.2) 0.0 (0.0, 22.2) n/a n/a
 Ratner 1970 465,926 0 0 0.0 (0.0, 7.9) 0.0 (0.0, 7.9) n/a n/a
 Neff 1972 433 0 0 0.0 (0.0, 8483) 0.0 (0.0, 8483) n/a n/a
 Summary 18,349,359 2 0 0.1 (0.01, 0.4) 0.0 (0.0, 0.2) 0.0 (0, 84.2)
Vaccinia necrosum
 Neff 1967a 7,775,000 2 0 0.3 (0.03, 0.9) 0.0 (0.0, 0.5) 0.0 (0.0, 84.2)
 Neff 1967b 370,000 0 0 0.0 (0.0, 10.0) 0.0 (0.0, 10.0) n/a n/a
 Lane 1969 8,574,000 6 2 0.7 (0.3, 1.5) 0.2 (0.03, 0.8) 33.3 (4.3, 77.7)
 Lane 1970 998,000 3 0 3.0 (0.6, 8.8) 0.0 (0.0, 3.7) 0.0 (0.0, 70.8)
 Mellin 1970 166,000 1 0 6.0 (0.2, 33.6) 0.0 (0.0, 22.2) 0.0 (0.0, 97.5)
 Ratner 1970 465,926 0 0 0.0 (0.0, 7.9) 0.0 (0.0, 7.9) n/a n/a
 Neff 1972 433 0 0 0.0 (0.0, 8483) 0.0 (0.0, 8483) n/a n/a
 Summary 18,349,359 12 2 0.7 (0.3, 1.1) 0.1 (0.01, 0.4) 16.7 (2.1, 48.4)
Eczema vaccinatum
 Neff 1967a 7,775,000 3 0 0.4 (0.1, 1.1) 0.0 (0.0, 0.5) 0.0 (0.0, 70.8)
 Neff 1967b 370,000 5 0 13.5 (4.4, 31.5) 0.0 (0.0, 10.0) 0.0 (0.0, 52.2)
 Lane 1969 8,574,000 8 0 0.9 (0.4, 1.8) 0.0 (0.0, 0.4) 0.0 (0.0, 36.9)
 Lane 1970 998,000 3 0 3.0 (0.6, 8.8) 0.0 (0.0, 3.7) 0.0 (0.0, 70.8)
 Mellin 1970 166,000 0 0 0.0 (0.0, 22.2) n/a n/a n/a n/a
 Ratner 1970 465,926 0 0 0.0 (0.0, 7.9) n/a n/a n/a n/a
 Neff 1972 433 0 0 0.0 (0.0, 8483) n/a n/a n/a n/a
 Summary 18,349,359 19 0 1.0 (0.6, 1.6) 0.0 (0.0, 0.2) 0.0 (0.0, 17.6)
Generalized vaccinia
 Neff 1967a 7,775,000 3 0 0.4 (0.1, 1.1) n/c n/c n/c n/c
 Neff 1967b 370,000 1 0 2.7 (0.1, 15.1) n/c n/c n/c n/c
 Lane 1969 8,574,000 10 0 1.2 (0.6, 2.1) n/c n/c n/c n/c
 Lane 1970 998,000 9 0 9.0 (4.1, 17.1) n/c n/c n/c n/c
 Mellin 1970 166,000 1 0 6.0 (0.2, 33.6) n/c n/c n/c n/c
 Ratner 1970 465,926 1 0 2.1 (0.05, 12.0) n/c n/c n/c n/c
 Neff 1972 433 0 0 0.0 (0.0, 8483) n/a n/a n/a n/a
 Summary 18,349,359 25 0 1.4 (0.9, 2.0) n/c n/c n/c n/c
Accidental inoculation
 Neff 1967a 7,775,000 8 0 1.0 (0.4, 2.0) n/c n/c n/c n/c
 Neff 1967b 370,000 250 0 675.7 (594, 765) n/c n/c n/c n/c
 Lane 1969 8,574,000 7 0 0.8 (0.3, 1.7) n/c n/c n/c n/c
 Lane 1970 998,000 42 0 42.1 (30.3, 56.9) n/c n/c n/c n/c
 Mellin 1970 166,000 3 0 18.1 (3.7, 52.8) n/c n/c n/c n/c
 Ratner 1970 465,926 1 0 2.1 (0.05, 12.0) n/c n/c n/c n/c
 Neff 1972 433 0 0 0.0 (0.0, 8483) n/a n/a n/a n/a
 Summary 18,349,359 311 0 16.9 (15.1, 18.9) n/c n/c n/c n/c
Open in a new tab

n/a = not assessable, n/c = not calculated aExact confidence intervals based on the binomial distribution

Discussion

To our knowledge, this is the first systematic review of the severe complications of smallpox vaccination in the USA. In addition to the age-specific complication and mortality risks, the case fatality risks were summarized. Using pooled summary measures, for every million primary vaccinations there were 60 cases of accidental infection, 40 cases generalized vaccinia, 13 cases of eczema vaccinatum, 3 cases of post-vaccinial encephalitis, and 1 case of vaccinia necrosum. However, complications for which vaccinia immune globulin (VIG) was not used (post-vaccinial encephalitis) or not generally required (accidental infection, generalized vaccinia) were significantly underreported because they were not captured by the VIG distribution program that was used by investigators to ascertain complications. In contrast, the US studies that used direct physician surveys [22,25] reported significantly higher complication risks. For example, the number of complications per million primary vaccinations for all ages combined was 13.4 cases of post-vaccinial encephalitis [25], 263.4 cases of generalized vaccinia [25], and 838.9 cases of accidental infection [22].

The complications with the highest summary case fatality risks were post-vaccinial encephalitis (CFR, 28.9%) and vaccinia necrosum (CFR, 15.4%). There were no recorded deaths among vaccinees from other major complications, including eczema vaccinatum. Deaths from eczema vaccinatum were observed only among non-vaccinees that acquired the disease after contact to a recent vaccinee [38]. Neff et al. reported that contact-acquired eczema vaccinatum resulted in 3 (2.3%) deaths among the 132 cases in the US studies [41]. In contrast, in the United Kingdom (UK) studies contact-acquired eczema vaccinatum resulted in 9 (7.9%) deaths among 89 cases; however, the UK vaccinations occurred in the 1950s using a different vaccinia strain [29,30].

Compared to primary vaccinees, in re-vaccinees the summary risk was 26-fold lower for post-vaccinial encephalitis, 29-fold lower for generalized vaccinia, 12-fold lower for eczema vaccinatum, 3.8-fold lower for accidental infection, and 1.5-fold lower for vaccinia necrosum. Prior vaccination predicted much lower risks for only 3 of the 5 major complications. Therefore, rather than the risks being significantly modified by prior vaccination status, the risk for accidental infection is more likely linked to behavior (autoinoculation) and the risk of vaccinia necrosum is more likely determined by immune status at the time of vaccination. This is consistent with the observation that vaccinia necrosum occurred almost exclusively in vaccinees with an severe cell-mediated immunodeficiency [42].

A strength of this systematic review is that the data were analyzed and summarized by age groups. The complication risks from each study, or combined, can be compared within and across age groups. For example, compared to vaccinees aged 1 year or older, infants aged <1 year had higher summary risks of post-vaccinial encephalitis (risk ratio, 2.80) and generalized vaccinia (risk ratio, 3.14). In contrast, compared to vaccinees aged <20 years, vaccinees aged 20 or older had a higher summary risk of vaccinia necrosum (risk ratio, 7.27).

There are several limitations to this systematic review. First, the studies reviewed were conducted in the 1960s, and routine smallpox vaccination in the United States ended in the early 1970s. Before routine smallpox vaccinations ceased, the characteristics of those persons vaccinated changed as the vaccination risks became better known and potential vaccinees were screened (e.g., infants aged <1 year, history of eczema). To the extent that routine screening for risk factors was occurring, this would have reduced the vaccine complication risks. Only the Ratner prospective cohort study that was conducted in 1967 was able to report vaccination screening criteria [21].

Second, the methods for ascertaining vaccine complications and deaths (i.e., the numerator in the risk estimates) differed between studies. The number of complications ascertained increased as the quantity and quality of ascertainment methods increased. For example, the studies that used direct physician surveys [22,25] recorded more complications that were less severe (generalized vaccinia, accidental infection) or for which VIG was not used (post-vaccinial encephalitis). Therefore, the Lane et al. study [25] that used a prospective physician survey to enhance reporting yielded the highest (and likely the most accurate) vaccine complication risks for that study period. With respect to complications deaths, only 3 studies [19,22,24] reviewed death certificates for this outcome. So it is possible that the other studies underestimated deaths due to vaccine complications.

Third, in the Lane and Neff studies reviewed, the investigators were unable to verify the clinical diagnosis from the reports of adverse events. For example, generalized non-viremic rashes were sometimes misclassified as generalized vaccinia, possibly resulting in an overestimation of the risk of generalized vaccinia [17,18].

Fourth, the methods for estimating the number of primary and repeat vaccinations (i.e., the denominator in risk estimates) differed between studies. Two studies had data on the actual number of vaccinations given [20,21], and in the remaining studies the number of vaccinations were estimated from national or state immunization surveys [19,22,24,25]. Because the complications evaluated for this review were infrequent, the complication risk estimates are more sensitive to variability in the numerator than in the denominator. Therefore, inaccuracies in the estimations of the populations vaccinated would not likely account for the observed heterogeneity in risk estimates.

Fifth, geographical and temporal factors may have influenced the heterogeneity of risk estimates. Pre-vaccination screening practices and the diagnosis and treatment of complications differed across regions and changed over time. Because these sources of bias likely contribute more to the heterogeneity of risk estimates than random error, the pooled summary measures presented may not be appropriate. For example, the Centers for Disease Control and Prevention (CDC) cite, but do not combine, risks estimates from the two Lane studies [24,25] in their report on smallpox vaccination and adverse reactions [13] in order to provide a range of risk estimates. Based on this review, the CDC approach seems appropriate.

Finally, over the past 40 years many factors have changed that might have affected these studies and their interpretation, including the design and conduct of epidemiologic surveillance studies, the diagnosis and treatment of vaccine complications, and a change in the distributions of risk factors (e.g., atopic dermatitis, immunocompromised) among populations that might undergo vaccinations. In spite of all the study limitations, these are the best available US studies of sufficient size to estimate the complication and case fatality risks for each major complication among vaccinees.

This systematic review summarizes the major smallpox vaccine complication and case fatality risks for predicting the age-specific burden of vaccine complications in the event of widespread ring and mass vaccinations. Because atopic dermatitis and immune compromised states are more common today than when these studies were conducted [12,43-45], higher vaccine complication rates may be observed in an outbreak. In comparison, in the current pre-event smallpox vaccination program, rigorous screening of almost 500,000 vaccinees has resulted in no cases of eczema vaccinatum and progressive vaccinia [46,47]; however, very high rates of myopericarditis (about 1:1,700 in civilian vaccinees and 1 per 12,800 in military vaccinees) and possibly myocardial ischemia have been observed [48,47,49]. Both potential primary and re-vaccinees are at risk for myopericarditis. Similar to post-vaccinial encephalitis, there is no screening criteria to reduce complications rates. For these reasons, and because the long term effects of myopericarditis are not known, the ACIP has recommended a "pause" in the USA smallpox vaccination program until the risks and benefits can be studied more carefully [50]. Unless there is a smallpox outbreak, at the current time, the individual risks of pre-event smallpox vaccination outweigh the potential benefits.

Competing interests

None declared.

Authors' contribution

TJA directed the study, co-extracted data, conducted data entry and statistical analyses, and prepared, revised, and finalized the manuscript, including revisions. SU conceived and designed the study, screened the articles for inclusion, and co-extracted data. GWR and SF consulted on study design, methods, analyses, and manuscript preparation. All authors extensively contributed to manuscript editing and revisions. All authors read and approved the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2458/3/26/prepub

Acknowledgments

Acknowledgments

We express our extreme gratitude to Drs. J. Michael Lane and John M. Neff for reviewing our drafts and providing valuable feedback and direction, and to Randy Reiter and Wayne Enanoria for assisting in data abstraction for quality control.

Contributor Information

Tomás J Aragón, Email: aragon@ucbcidp.org.

Skylar Ulrich, Email: flash100@earthlink.net.

Susan Fernyak, Email: susan.fernyak@sfdph.org.

George W Rutherford, Email: grutherford@psg.ucsf.edu.

References

  1. Henderson DA, Inglesby TV, Bartlett JG, Ascher MS, Eitzen E, Jahrling PB, Hauer J, Layton M, McDade J, Osterholm MT, O'Toole T, Parker G, Perl T, Russell PK, Tonat K. Smallpox as a biological weapon: medical and public health management. Working Group on Civilian Biodefense. JAMA. 1999;281:2127–37. doi: 10.1001/jama.281.22.2127. [DOI] [PubMed] [Google Scholar]
  2. World Health Organization Declaration of Global Eradication of Smallpox. Weekly Epidemiological Record. 1980;55:145–152. [Google Scholar]
  3. Schraeder TL, Campion EW. Smallpox vaccination – the call to arms. New England Journal of Medicine. 2003;348:381–2. doi: 10.1056/NEJMp020177. [DOI] [PubMed] [Google Scholar]
  4. Frey SE, Couch RB, Tacket CO, Treanor JJ, Wolff M, Newman FK, Atmar RL, Edelman R, Nolan CM, Belshe RB. Clinical responses to undiluted and diluted smallpox vaccine. New England Journal of Medicine. 2002;346:1265–74. doi: 10.1056/NEJMoa020534. [DOI] [PubMed] [Google Scholar]
  5. Frey SE, Newman FK, Cruz J, Shelton WB, Tennant JM, Polach T, Rothman AL, Kennedy JS, Wolff M, Belshe RB, Ennis FA. Dose-related effects of smallpox vaccine. New England Journal of Medicine. 2002;346:1275–80. doi: 10.1056/NEJMoa013431. [DOI] [PubMed] [Google Scholar]
  6. Department of Health and Human Services HHS Press Office HHS awards $428 million contract to produce smallpox vaccine: Acambis/Baxter will produce 155 million doses by end of 2002. 2001. http://www.hhs.gov/news/press/2001pres/20011128.html Accessed February 2003.
  7. Centers for Disease Control and Prevention Protecting Americans: Smallpox Vaccination Program http://www.bt.cdc.gov/agent/smallpox/vaccination/vaccination-program-statement.asp Accessed March 7, 2003.
  8. Centers for Disease Control and Prevention CDC Telebriefing Transcript: ACIP Smallpox Vaccine Meeting Briefing, October 17, 2002 http://www.cdc.gov/od/oc/media/transcripts/t021017.htm Accessed March 7, 2003.
  9. Institute of Medicine Committee on Smallpox Vaccination Program Implementation Review of the Centers for Disease Control and Prevention's Smallpox Vaccination Program Implementation – Letter Reports 1 to 3 http://www.nap.edu/catalog/10601.html http://www.nap.edu/catalog/10657.html http://www.nap.edu/catalog/10714.html, Accessed July 1 2003.
  10. Meltzer MI. The Modeling Basis for Vaccination Policy Options. Scientific and Policy Considerations in Developing Smallpox Vaccination Options: A Workshop Report, Institute of Medicine (IOM), Board on Health Promotion and Disease Prevention (HPDP), Division of Health Promotion and Disease Prevention (HPDP) 2002. pp. 14–17.
  11. Centers for Disease Control and Prevention Vaccinia (Smallpox) Vaccine: Recommendations of the Advisory Committee on Immunization Practices (ACIP), 2001. MMWR Recommendations and Reports. 2001;50 [PubMed] [Google Scholar]
  12. Kemper AR, Davis MM, Freed GL. Expected adverse events in a mass smallpox vaccination campaign. Effective Clinical Practice. 2002;5:84–90. [PubMed] [Google Scholar]
  13. Centers for Disease Control and Prevention Smallpox vaccination and adverse reactions: guidance for clinicians. MMWR Dispatch. 2003;52 [PubMed] [Google Scholar]
  14. Bartlett J, Borio L, Radonovich L, Mair JS, O'Toole T, Mair M, Halsey N, Grow R, Inglesby TV. Smallpox vaccination in 2003: key information for clinicians. Clin Infect Dis. 2003;36:883–902. doi: 10.1086/374792. [DOI] [PubMed] [Google Scholar]
  15. Lane JM, Goldstein J. Evaluation of 21st-century risks of smallpox vaccination and policy options. Ann Intern Med. 2003;138:488–93. doi: 10.7326/0003-4819-138-6-200303180-00014. [DOI] [PubMed] [Google Scholar]
  16. Centers for Disease Control and Prevention Recommendations for using smallpox vaccine in a pre-event vaccination program. Supplemental recommendations of the Advisory Committee on Immunization Practices (ACIP) and the Healthcare Infection Control Practices Advisory Committee (HICPAC) MMWR Recomm Rep. 2003;52:1–16. [PubMed] [Google Scholar]
  17. Lane JM. Personal communication (mikelane869@yahoo.com) Formerly from the Smallpox Eradication Program, Centers for Disease Control and Prevention, Atlanta, GA.
  18. Neff JM. Personal communication (jneff@chmc.org) Center for Children with Special Needs, Children's Hospital and Regional Medical Center, and the Department of Pediatrics, University of Washington School of Medicine, Seattle.
  19. Neff JM, Lane JM, Pert JH, Moore R, Millar JD, Henderson DA. Complications of smallpox vaccination. I. National survey in the United States, 1963. New England Journal of Medicine. 1967;276:125–32. doi: 10.1056/NEJM196701192760301. [DOI] [PubMed] [Google Scholar]
  20. Neff JM, Drachman RH. Complications of smallpox vaccination, 1968 surveillance in a Comprehensive Care Clinic. Pediatrics. 1972;50:481–3. [PubMed] [Google Scholar]
  21. Ratner LH, Lane JM, Vicens CN. Complications of smallpox vaccination: surveillance during an island-wide program in Puerto Rico, 1967–1968. American Journal of Epidemiology. 1970;91:278–85. doi: 10.1093/oxfordjournals.aje.a121137. [DOI] [PubMed] [Google Scholar]
  22. Neff JM, Levine RH, Lane JM, Ager EA, Moore H, Rosenstein BJ, Millar JD, Henderson DA. Complications of smallpox vaccination United States 1963. II. Results obtained by four statewide surveys. Pediatrics. 1967;39:916–23. [PubMed] [Google Scholar]
  23. Mellin H, Neff JM, Garber H, Lane JM. Complications of smallpox vaccination, Maryland 1968. Johns Hopkins Medical Journal. 1970;126:160–8. [PubMed] [Google Scholar]
  24. Lane JM, Ruben FL, Neff JM, Millar JD. Complications of smallpox vaccination, 1968. New England Journal of Medicine. 1969;281:1201–8. doi: 10.1056/NEJM196911272812201. [DOI] [PubMed] [Google Scholar]
  25. Lane JM, Ruben FL, Neff JM, Millar JD. Complications of smallpox vaccination, 1968: results of ten statewide surveys. Journal of Infectious Diseases. 1970;122:303–9. doi: 10.1093/infdis/122.4.303. [DOI] [PubMed] [Google Scholar]
  26. R Development Team R – A Language and Environment for Statistical Computing and Graphics http://www.r-project.org
  27. Clark PS, Lane JM. Complications of smallpox vaccination, 1968. Results of a statewide survey in Alaska. California Medicine. 1971;115:7–10. [PMC free article] [PubMed] [Google Scholar]
  28. Greenberg M. Complications of vaccination against smallpox. American Journal of Diseases of Children. 1948;76:492–502. doi: 10.1001/archpedi.1948.02030030505002. [DOI] [PubMed] [Google Scholar]
  29. Conybeare ET. Illness attributed to smallpox vaccination during 1951–60. Monthly Bulletin of the Ministry of Health and the Public Health Laboratory Service. 1964;23:126–133. [PubMed] [Google Scholar]
  30. Monckton Copeman PW, Wallace HJ. Eczema Vaccinatum. Brit Med J. 1964;2:906–908. doi: 10.1136/bmj.2.5414.906. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Smith JW, Seidl LG, Johnson JE., 3rd Smallpox vaccination in hospital personnel. Results of a survey and vaccination program at the Johns Hopkins Hospital. JAMA. 1966;197:309–14. doi: 10.1001/jama.197.5.309. [DOI] [PubMed] [Google Scholar]
  32. Bengtsson E, Hansson S, Nystrom B. Smallpox outbreak and vaccination problems in Stockholm, Sweden 1963. V. Postvaccinal reactions and complications. Acta Medica Scandinavica Supplementum. 1966;464:87–104. [PubMed] [Google Scholar]
  33. Schaffner W, Adair R. Smallpox vaccination campaign for Rhode Island hospital personnel. Public Health Reports. 1969;84:425–9. [PMC free article] [PubMed] [Google Scholar]
  34. Feery BJ. Adverse reactions after smallpox vaccination. Medical Journal of Australia. 1977;2:180–3. doi: 10.5694/j.1326-5377.1977.tb114544.x. [DOI] [PubMed] [Google Scholar]
  35. Haim M, Gdalevich M, Mimouni D, Ashkenazi I, Shemer J. Adverse reactions to smallpox vaccine: the Israel Defense Force experience, 1991 to 1996. A comparison with previous surveys. Military Medicine. 2000;165:287–9. [PubMed] [Google Scholar]
  36. Balasundram R. Smallpox vaccination: complications and present role. Medical Journal of Malaya. 1972;27:89–94. [PubMed] [Google Scholar]
  37. Hallett P. A survey of complications to smallpox vaccination. Medical Journal of Australia. 1969;1:898–901. [PubMed] [Google Scholar]
  38. Lane JM, Ruben FL, Abrutyn E, Millar JD. Deaths attributable to smallpox vaccination, 1959 to 1966, and 1968. JAMA. 1970;212:441–4. doi: 10.1001/jama.212.3.441. [DOI] [PubMed] [Google Scholar]
  39. Nitzkin JL, Anderson L, Skaggs JW, Hernandez C. Complications of smallpox vaccination in Kentucky in 1968. Results of a statewide survey. Journal of the Kentucky Medical Association. 1971;69:184–90. [PubMed] [Google Scholar]
  40. Sinclair MC, Lane JM, Donald WJ, Esco LC. Complications of smallpox vaccination in Alabama, 1968. Southern Medical Journal. 1972;65:41–4. doi: 10.1097/00007611-197201000-00008. [DOI] [PubMed] [Google Scholar]
  41. Neff JM, Lane JM, Fulginiti VA, Henderson DA. Contact vaccinia – transmission of vaccinia from smallpox vaccination. JAMA. 2002;288:1901–5. doi: 10.1001/jama.288.15.1901. [DOI] [PubMed] [Google Scholar]
  42. Bray M, Wright ME. Progressive vaccinia. Clinical Infectious Diseases. 2003;36:766–74. doi: 10.1086/374244. [DOI] [PubMed] [Google Scholar]
  43. Engler RJ, Kenner J, Leung DY. Smallpox vaccination: Risk considerations for patients with atopic dermatitis. Journal of Allergy and Clinical Immunology. 2002;110:357–365. doi: 10.1067/mai.2002.128052. [DOI] [PubMed] [Google Scholar]
  44. Leung DY, Bieber T. Atopic dermatitis. Lancet. 2003;361:151–160. doi: 10.1016/S0140-6736(03)12193-9. [DOI] [PubMed] [Google Scholar]
  45. Centers for Disease Control and Prevention HIV Prevalence Trends in Selected Populations in the United States: Results from National Serosurveillance, 1993–1997. 2001. pp. 1–51.http://www.cdc.gov/hiv/pubs/hivprevalence/toc.htm
  46. Centers for Disease Control and Prevention Update: Adverse Events Following Civilian Smallpox Vaccination – United States, 2003. MMWR. 2003;52:475–77. [PubMed] [Google Scholar]
  47. Grabenstein JD, Winkenwerder W., Jr US Military Smallpox Vaccination Program Experience. JAMA. 2003;289:3278–82. doi: 10.1001/jama.289.24.3278. [DOI] [PubMed] [Google Scholar]
  48. Centers for Disease Control and Prevention Update: Cardiac-Related Events During the Civilian Smallpox Vaccination Program – United States, 2003. MMWR. 2003;52:492–496. [PubMed] [Google Scholar]
  49. Halsell JS, Riddle JR, Atwood JE, Gardner P, Shope R, Poland GA, Gray GC, Ostroff S, Eckart RE, Hospenthal DR, Gibson RL, Grabenstein JD, Arness MK, Tornberg DN. Myopericarditis Following Smallpox Vaccination Among Vaccinia-Naive US Military Personnel. JAMA. 2003;289:3283–9. doi: 10.1001/jama.289.24.3283. [DOI] [PubMed] [Google Scholar]
  50. Advisory committee on Immunization Practices. ACIP statement. Advisory committee on Immunization Practices (ACIP) statement on small pox preparedness and vaccination. 2003. http://www.bt.cdc.gov/agent/smallpox/vaccination/acipjun2003.asp

Articles from BMC Public Health are provided here courtesy of BMC

RESOURCES