Editor—We proposed that BCG and measles vaccine have non-specific beneficial effects, whereas diphtheria-tetanus-pertussis (DTP) vaccination might have no beneficial effect.1 In response, the World Health Organization commissioned several studies.2-4 A WHO expert task force found substantial evidence against a deleterious effect of DTP; all studies showed DTP to be associated with reduced mortality. A negative DTP effect was found only in Guinea-Bissau, and this was presumed to be due to a country specific issue or a peculiarity of the data.5
In our survival analysis, vaccination status was a time fixed variable, held constant from the initial visit to the next; without perfect information for all children, vaccinations during follow-up could not be accounted for, which means a potential source of bias.1 In the WHO sponsored analyses, vaccination status was a time varying variable changing status at the date of vaccination, based on information achieved at a subsequent visit.2-5 We used this approach to re-analyse our data (table).
Table 1.
Vaccination status as time fixed variable
|
Vaccination dates as time varying variables
|
|||||
---|---|---|---|---|---|---|
Deaths | Person years at risk | Mortality per 1000 person years | Deaths | Person years at risk | Mortality per 1000 person years | |
Vaccination status | ||||||
No BCG+DTP one dose | 2 | 9.0 | 222 | 2 | 16.3 | 123 |
No BCG+DTP two doses | 0 | 4.5 | 0 | 0 | 3.5 | 0 |
No BCG+DTP three doses | 0 | 1.4 | 0 | 0 | 4.2 | 0 |
BCG+no DTP | 33 | 537.6 | 61 | 33 | 334.4 | 99 |
BCG+DTP one dose | 59 | 595.5 | 99 | 60 | 679.5 | 88 |
BCG+DTP two doses | 21 | 266.6 | 79 | 20 | 443.4 | 45 |
BCG+DTP three doses | 12 | 119.6 | 100 | 15 | 425.0 | 35 |
Vaccinated | 127 | 1534.2 | 83 | 130 | 1906.3 | 68 |
Unvaccinated | 95 | 875.1 | 109 | 92 | 503.0 | 183 |
All | 222 | 2409.3 | 92 | 222 | 2409.3 | 92 |
Mortality ratio (95% CI) | ||||||
Unvaccinated v vaccinated | 1.35 (0.97 to 1.89) | 2.96 (2.15 to 4.08) | ||||
BCG v BCG unvaccinated | 0.55 (0.36 to 0.85) | 0.62 (0.41 to 0.92) | ||||
One dose DTP v DTP unvaccinated | 1.84 (1.10 to 3.10) | 0.68 (0.44 to 1.04) | ||||
Two doses DTP v DTP unvaccinated
|
1.38 (0.73 to 2.61)*
|
0.26 (0.15 to 0.47)
|
||||
Three doses DTP v DTP unvaccinated | 0.16 (0.08 to 0.32) |
Two and three doses of DTP were combined in original study.1
The distribution of deaths was similar. When we used time varying variables, person years decreased for the unvaccinated and BCG groups, and mortality went up. Person years increased for the DTP groups and mortality decreased. Hence, DTP was associated with reductions in mortality (table), similar to results from WHO sponsored studies.2-4
Why this difference? Information on vaccinations is typically collected through periodic home visits. When a child dies, the vaccination card is usually thrown away; and information on vaccination is therefore collected conditionally on survival to the subsequent visit. If an unvaccinated child was vaccinated and died before the next visit the death would be classified as unvaccinated, in an analysis using time varying variables. If a vaccinated child survived then the follow up time as vaccinated would be moved to the new vaccination. This survival time is risk free—that is, we only know that the child was vaccinated because it survived. Such survival bias may turn a negative estimate into a positive one: our original 84% increase in mortality for one dose of DTP became a 32% reduction (table).
Survival bias can be avoided only if all vaccinations are provided by the researchers, or perfect vaccination information is obtained from all children. Nothing indicates that these conditions were met in the WHO commissioned studies.2-4 In contrast to our study, none of the WHO studies documented which children were unvaccinated; they do not distinguish between “unvaccinated” and “no information.” The contradiction between our study and the WHO sponsored studies might be due to methodological differences and not peculiarity of the data.
Supplementary Material
Details of the three other authors are on bmj.com
References
- 1.Kristensen I, Aaby P, Jensen H. Routine vaccinations and child survival: follow up study in Guinea-Bissau, West Africa. BMJ 2000;321: 1435-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Lehmann D, Vail J, Firth MJ, de Klerk NH, Alpers MP. Benefits of routine immunisations on childhood survival in Tari, Southern Highlands Province, Papua New Guinea. Int J Epidemiol 2005;34: 138-148. [DOI] [PubMed] [Google Scholar]
- 3.Breiman RF, Streatfield PK, Phelan M, Shifa N, Rashi M, Yunus M. Effect of infant immunization on childhood mortality in rural Bangladesh: analysis of health and demographic surveillance data. Lancet 2004;364: 2204-11. [DOI] [PubMed] [Google Scholar]
- 4.Vaugelade J, Pinchinat S, Guielle G, Elguero E, Simondon F. Lower mortality in vaccinated children: follow up study in Burkina Faso. BMJ 2004;329: 1309-11. (4 December.) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.World Health Organization. Global advisory committee on vaccine safety. Wkly Epidemiol Rec 2004;79: 269-72. [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.