Skip to main content
Eurosurveillance logoLink to Eurosurveillance
. 2019 Nov 7;24(45):1900645. doi: 10.2807/1560-7917.ES.2019.24.45.1900645

Heterogeneity in influenza seasonality and vaccine effectiveness in Australia, Chile, New Zealand and South Africa: early estimates of the 2019 influenza season

Sheena G Sullivan 1, Carmen S Arriola 2, Judy Bocacao 3, Pamela Burgos 4, Patricia Bustos 5, Kylie S Carville 6, Allen C Cheng 7,8, Monique BM Chilver 9, Cheryl Cohen 10, Yi-Mo Deng 11, Nathalie El Omeiri 12, Rodrigo A Fasce 13, Orienka Hellferscee 10, Q Sue Huang 3, Cecilia Gonzalez 4, Lauren Jelley 3, Vivian KY Leung 1, Liza Lopez 14, Johanna M McAnerney 10, Andrea McNeill 14, Maria F Olivares 15, Heidi Peck 11, Viviana Sotomayor 15, Stefano Tempia 2,10,16,17, Natalia Vergara 15, Anne von Gottberg 10, Sibongile Walaza 10, Timothy Wood 14
PMCID: PMC6852316  PMID: 31718744

Abstract

We compared 2019 influenza seasonality and vaccine effectiveness (VE) in four southern hemisphere countries: Australia, Chile, New Zealand and South Africa. Influenza seasons differed in timing, duration, intensity and predominant circulating viruses. VE estimates were also heterogeneous, with all-ages point estimates ranging from 7–70% (I2: 33%) for A(H1N1)pdm09, 4–57% (I2: 49%) for A(H3N2) and 29–66% (I2: 0%) for B. Caution should be applied when attempting to use southern hemisphere data to predict the northern hemisphere influenza season.

Keywords: influenza, vaccine effectiveness, southern hemisphere, sentinel surveillance, influenza vaccines


In Australia, Chile, New Zealand and South Africa, sentinel surveillance is conducted in primary care and/or hospitals to monitor the timing, intensity and impact of influenza seasons, and to estimate influenza vaccine effectiveness (VE). While the influenza epidemics of these four southern hemisphere countries often coincide, the type of epidemic experienced can vary. Nevertheless, the influenza season experienced in southern hemisphere countries has sometimes been interpreted as a forewarning to the northern hemisphere [1]. Here, we describe the heterogeneity experienced during the 2019 influenza season in these four countries and provide early VE estimates.

Influenza surveillance systems

The sentinel surveillance systems used in this analysis are described in detail in the Table. For Australia, influenza-like illness (ILI) surveillance data came from the Australian Sentinel Practices Research Network (ASPREN), supplemented by the Victorian Sentinel Practice Influenza Network (VicSPIN) [2]. Hospital surveillance data were obtained from the Influenza Complications Alert Network (FluCAN) [3]. In Chile, severe acute respiratory infection (SARI) sentinel surveillance included seven sentinel hospitals distributed across six of 16 administrative regions [4]. In New Zealand, ILI surveillance leverages general practice-registered patients in all 20 district health boards, ca 540,000, while SARI surveillance includes four public hospitals in Auckland and Counties Manukau District Health Boards [5]. Syndromic surveillance data from South Africa came from outpatient presentations to a large private healthcare provider network, based on International Classification of Diseases (ICD-10) codes for pneumonia and influenza (J9-J11) [6,7]. Virological surveillance in South Africa was conducted through the Viral Watch network [8].

Table. Summary of key differences in case and exposure ascertainment for syndromic and virological surveillance and vaccine effectiveness estimation, four southern hemisphere countries, 2019 influenza season.

Characteristic Australia Chile New Zealand South Africa
Source populationsa ILI: 394 GPs at sentinel general practices nationwide participate in syndromic ILI surveillance; 222 GPs participate in swab testing; 21 sentinel hospitals nation-wide Seven sentinel hospitals in 6/16 regions 86 sentinel practices (ILI patients) in 20 district health boards and four hospitals (SARI patients) Syndromic: a healthcare provider network
Virological and VE: Sentinel general practices (ILI patients) in 6/9 regions
Period used for weekly rates ILI: weeks 1–52
2019: weeks 1–39
Hospitals: weeks 14–44
2019: weeks 14–39
Weeks 1–52
2019: weeks 10–33
Weeks 18–39
2019: weeks 18–39
Weeks 1–52
2019: weeks 1–38
Clinical case definition ILI: fever or history of fever AND cough, fatigue/malaise
Hospitals: suspected influenza (not SARI)
SARI: history of fever, or measured fever of ≥ 38 C° AND cough AND onset within the last 10 days AND hospitalisation ILI: acute respiratory illness with a history of fever or measured fever of ≥ 38 °C, AND cough, AND onset within the past 10 days
SARI: as above, but requiring hospitalisation
ILI: measured fever (≥ 38 °C) or history of fever, cough, onset ≤ 10 days
Virological testing ILI: Around 50% of patients are swabbed for testing by RT-PCR at SA Pathology, Adelaide or the NIC, Melbourne.
Hospitals: RT-PCR testing done at each hospital.
Sequencing performed by WHOCCRRI, Melbourne.
RT-PCR or direct immunofluorescence followed by RT-PCR-positive for pan-negative and influenza-positive specimens for subtyping.
Testing and sequencing performed at NIC, Santiago.
RT-PCR testing at NIC, Wellington.
Sequencing performed by WHOCCRRI, Melbourne.
RT-PCR testing by NIC, Johannesburg.
Sequencing performed by WHOCCRRI, Melbourne or Worldwide Influenza Centre, Crick Institute, London.
Study period for VE estimation ILI: 28 Apr 2019–9 Oct 2019
Hospitals: 1 Apr 2019–16 Aug 2019
SARI: 4 Mar 2019–18 Aug 2019 ILI and SARI: 29 Apr 2019–29 Sep 2019 ILI: 15 Apr 2019–18 Aug 2019
Cases/controls for VE estimates ILI: test-positive cases vs test-negative controls
Hospitals: test-positive cases; control are the next admitted test-negative patient (≤ 2 weeks)
Test-positive cases vs test-negative controls Test-positive cases vs test-negative controls Test-positive cases vs test-negative controls
Vaccination status ascertainment Medical record, self-report or vaccination registry Medical record or vaccination registries (no verbal reports) Vaccination registry and self-report Medical record or self-reported
Vaccination coverage among influenza-negative controls included in VE estimatesb Overall: 49% ILI; 47% hospitals
Adults: 46% ILI; 41% hospitals
Children: 26% ILI; 33% hospitals
Elderly: 78% ILI; 73% hospitals
Overall: 61% SARIc
Adults: 41% SARIc
Children: 72% SARIc
Elderly: 64% SARIc
Overall: 26% ILI; 33% SARI
Adults: 26% ILI; 36% SARI
Children: 9% ILI
Elderly: 70% ILI; 66% SARI
Overall: 11% ILI
Adult: 11% ILI
Children: 9% ILI
Elderly: 35% ILI
Vaccines licensed < 5 years: Flu Quadri Junior (Sanofi)
< 65 years: Afluria Quad (Seqirus), FluQuadri (Sanofi) and Fluarix Tetra (GSK)
≥ 65 years: Fluad (Seqiris; trivalent with B/Yamagata component)
Influvac (Abbott)
(inactivated subunit vaccine)
TIV included a B/Victoria-lineage component
6–35 months: Fluarix Tetra (GSK)
≥ 3 years: FluQuadri (Sanofi), Influvac (Abbott)
 ≥ 5 years only: Afluria Quad (Seqiris)
Vaxigrip (Sanofi Pasteur) (inactivated split-virion vaccine) and Influvac (Abbott) (inactivated subunit vaccine)
All TIV
Target groups for vaccination Recommended for all.
Free for pregnant women; people aged < 5 years or ≥ 65 years; Aboriginal and Torres Strait Islander peoples; people aged 5–64 years with chronic conditions.
Pregnant women from 13 weeks gestation; children aged 6–59 months, adults aged ≥ 65 years; poultry and pig farm workers; patients with chronic conditions aged 5– 64 years; carriers of some risk conditions; healthcare workers. Pregnant women; people aged ≥ 65 years; people aged < 65 years with a medical condition that increases their risk of developing complications from influenza and the condition is specified in the Influenza Immunisation Programme eligibility criteria; children aged ≤ 4 years with previous hospitalisation for respiratory illness or with a history of significant respiratory illness. Pregnant women at all stages of pregnancy, including the post-partum period; HIV-infected individuals; adults or children who are at high risk for influenza complications because of underlying medical conditions or who are receiving regular medical care for conditions such as chronic pulmonary disease; persons aged ≥ 65 years.

GP: general practice; GSK: Glaxo Smith Kline; ILI: influenza-like illness; NIC: National Influenza Centre; QIV: quadrivalent inactivated vaccine; SARI: severe acute respiratory illness; TIV: trivalent inactivated vaccine; VE: vaccine effectiveness; WHOCCRRI: World Health Organization Collaborating Centre for Reference and Research on Influenza.

a Numbers are provided for 2019.

b Children: 6 months–17 years of age; Adults: 18–64 years of age; Elderly: ≥ 65 years of age.

c Only patients in a target group for vaccination are included in SARI surveillance in Chile so these numbers do not necessarily reflect coverage in the whole population.

Seasonality

Weekly 2019 influenza activity rates, e.g. ILI consultations per week, were plotted against the mean weekly rate for influenza seasons from 2013 to 2018. All rates were smoothed using a 3-week moving average. The moving epidemic method (MEM) package [9] in R software version 3.6.1 (R Foundation, Vienna, Austria) was used for calculating means and seasonal thresholds using default values to show the onset and intensity of the season (Figure 1A). The specifications used for the MEM may differ from published national surveillance reports. The onset and peak of the influenza season was at least 5 weeks early in Australia and 1 to 2 weeks early in Chile, New Zealand and South Africa. Activity was well above expected levels in South Africa and very high in Chile, but only reached moderate levels in Australia or New Zealand. The seasons experienced in Chile and South Africa were also much shorter in duration than in Australia and New Zealand.

Figure 1.

Influenza activity (A) and influenza detections (B) for Australia, Chile, New Zealand and South Africa, 2019 influenza season

ILI: influenza-like illness; P&I: pneumonia and influenza; SARI: severe acute respiratory infection.

Influenza activity plots (A) show the intensity of the 2019 influenza season compared with the average for 2013 to 2018. The point at which 2019 activity crossed baseline thresholds set by the prior 6 years’ data are marked with crosses. No post-season thresholds were estimated for New Zealand.

Influenza detections by type and subtype (B) for patients enrolled in hospital and primary care surveillance for VE estimation. The data used in vaccine effectiveness estimation are a subset restricted to those patients with complete information and recruited within the weeks used for estimation (Table).

Figure 1

Virological data

Virological data are shown in Figure 1B and highlight the variation in predominant viruses circulating among countries. For example, while influenza A(H3N2) virus clearly predominated in South Africa and was detected at very high levels with the positivity reaching 80% during the peak period, the predominant virus in Chile was A(H1N1)pdm09. In New Zealand, both influenza A and B viruses were detected; however, their relative frequency differed between ILI and SARI surveillance, with B viruses detected among roughly half (51%; 604/1,179) of ILI patients but only a quarter (27%; 104/385) of SARI patients.

Genetic characterisation of selected viruses showed further differences among countries, although the number of samples characterised was small. Circulating A(H1N1)pdm09 viruses were similar, with most falling into subclade 6B.1A-P5 in Australia, New Zealand and Chile. Differences in the predominant circulating clade were observed for A(H3N2). Of 192 viruses sequenced in Australia, 186 were 3C.2a1b (3C.2a1b + 131K: n = 182; 3C.2a1b + 135K: n = 4), with just six 3C.3a. The majority of A(H3N2) viruses sequenced in New Zealand also clustered in clade 3C.2a1b. In Chile, of 31 viruses sequenced, 13 fell into the clade 3C.2a1b and 18 to 3C.3a. A limited selection of only 10 viruses from South Africa suggested co-circulation of 3C.2a1b + 131K, 3C.2a1b + 135K and 3C.3a viruses. For influenza B, nearly all viruses characterised in Australian primary care surveillance (107/108) and in New Zealand (167/169) were B/Victoria lineage viruses, while all 11 influenza B viruses characterised in Chile were B/Yamagata.

Vaccine effectiveness estimation

The virological data depicted in Figure 1B formed the basis for VE estimation. All systems followed a test-negative design, where the odds ratio (OR) comparing the odds of vaccination among test-positive cases vs test-negative controls was used to derive VE, i.e. VE = (1−ORadj)×100% [10]. Estimates were made separately for each country, virus and age group, incorporating covariates considered important by each site (Figure 2). The heterogeneity among estimates within each virus/age group combination was measured by I2 and τ2 [11]. All networks were able to provide data for the A(H3N2) VE. Too few A(H1N1)pdm09 and B cases were detected in South Africa to enable VE estimation.

Figure 2.

Early vaccine effectiveness estimates against influenza A(H1N1)pdm09, A(H3N2) and B by age group and setting, Australia, Chile, New Zealand and South Africa, 2019 influenza season

CI: compatibility interval; V: vaccinated; UV: unvaccinated; VE: vaccine effectiveness.

I2 and τ2are shown for measures of heterogeneity.

Estimates for Chile only include patients in a target group for vaccination; Australia used adjuvanted TIV for individuals ≥ 65 years of age.

Covariate adjustment: Australia primary care estimates adjusted for week (restricted cubic spline) and age group (where appropriate); Australia hospital estimates adjusted for age group, comorbidities, indigenous ethnicity and pregnancy; Chile estimates adjusted for age, month of symptom onset and pre-existing conditions; New Zealand estimates adjusted for age group; South Africa estimates adjusted for seasonality and age.

Figure 2

For A(H1N1)pdm09, heterogeneity was low overall (I2: 22%). For adults, although heterogeneity was not high (I2: 58%), VE estimates ranged from −6% (95% compatibility interval (CI): −96 to 42) in New Zealand to 72% (95% CI: 51–84) among people in a target group for vaccination in Chile. Only Chile was able to provide VE estimates for children (65%; 95% CI: 49–76) and elderly, i.e. adults aged ≥ 65 years (74%; 95% CI: 51–86).

For A(H3N2), heterogeneity was moderate overall (I2: 49%), but higher for adults (I2: 59%). In Australia, South Africa and New Zealand hospitals, VE point estimates ranged from 34% to 57% across age groups; however, in Chile and New Zealand primary care, estimates were often close to or beyond the null.

For influenza B, heterogeneity was low overall (I2: 0%), despite differences in the predominant lineage and the use of trivalent vaccine in Chile but quadrivalent in New Zealand and Australia. Overall VE was lowest in Chile (29%; 95% CI: −23 to 59). Here, the B component for trivalent vaccines included a B/Victoria-like virus, but most viruses circulating were B/Yamagata thereby suggesting this low VE may be attributable to lineage mismatch. Only one VE estimate was available for elderly adults (Chile: 44%; 95% CI: −10 to 72) and children (Australia: 55%; 95% CI: 20–76).

Discussion

We have shown that within countries of the southern hemisphere, the timing, duration and intensity of the influenza seasons, the predominant circulating viruses, and VE all varied in the 2019 influenza season, even between neighbouring countries such as Australia and New Zealand. Similar observations have been reported from Europe [9]. Thus, it appears that activity in one country is not indicative of activity in another country, even when influenza seasons are contemporaneous.

The early VE estimates for the 2019 influenza season in the southern hemisphere presented here were highest for influenza A(H1N1)pdm09 and lowest for A(H3N2). Early estimates often approximate final estimates [12]. However, the utility of these estimates for the northern hemisphere may be limited because the 2019 southern hemisphere vaccine differed from the 2019/20 northern hemisphere formulation in three of four components, A(H1N1)pdm09, A(H3N2) and B/Victoria. Nevertheless, these estimates or earlier versions of them were included with other data reviewed at the WHO Consultation and Information Meeting on the Composition of Influenza Virus Vaccines for Use in the 2020 Southern Hemisphere Influenza Season during 23–26 September 2019 in Geneva and provided a general impression of the performance of the 2019 vaccine.

While heterogeneity in our VE estimates did not exceed an I2 of 60%, with so few studies, the sensitivity of statistical tests to detect heterogeneity is probably limited. This is exemplified by the I2 of 0% for influenza B estimates among adults despite differences in VE point estimates of 75 percentage points (Figure 2). Thus, low heterogeneity statistics do not alleviate concerns about how to interpret discrepant VE point estimates.

There are many potential sources for this heterogeneity that affect not only the VE estimates, but interpretation of weekly activity rates. First, with random sampling, we should not expect estimates to be the same [13]. Second, when samples are small they may be vulnerable to statistical biases, such as sparse data bias, and bias due to measurement errors may be more profound [14]. Third, there were many differences in study design (Table). Case ascertainment differed; for example, a SARI case definition was used in New Zealand and Chile, but not in Australian hospital surveillance. Exposure ascertainment also differed, with varying availability of registries to verify vaccination status and the use of different vaccines. In particular, the adjuvanted vaccines used among Australians ≥ 65 years of age might be expected to yield higher VE than standard vaccines [15]. Fourth, vaccine coverage varied (Table). Low vaccination coverage, as observed in South Africa, affects power and precision and can exacerbate the bias induced by measurement errors. Higher coverage, as seen in Chile and among elderly patients in New Zealand and Australia, may mean that many more people in the sample are repeat vaccinees. Repeat vaccination may negatively impact VE and could result in lower VE estimates in highly vaccinated populations [16]. Finally, although only limited virological data were available, we observed differences in circulating A(H3N2) virus clades and B lineages. This may impact both seasonality and VE, particularly as most A(H3N2) viruses sequenced appeared to be in different clades from the vaccine virus (3C.2a2). Notably, most A(H3N2) viruses were also in different genetic groups from the 2019/20 northern hemisphere vaccine (3C.3a).

In conclusion, we have attempted to briefly summarise and interpret the 2019 influenza season in four southern hemisphere countries and have presented early VE estimates. We observed substantial variation in available data on influenza seasonality and VE within the southern hemisphere in 2019, which is unsurprising given the many differences in surveillance among these countries. Caution should be applied when attempting to infer the impending northern hemisphere influenza season based on these observations.

Acknowledgements

Australia: We thank Daniel Blakely and Nigel Stocks at University of Adelaide; Violeta Spirotoska at the University of Melbourne; and staff at the Victorian Infectious Diseases Reference Laboratory, SA Pathology and the WHO Collaborating Centre for Reference and Research on Influenza. The Australian Sentinel Practices Research Network, the Influenza Complications Alert NEtwork and the WHO Collaborating Centre for Reference and Research on Influenza are supported by the Australian Government Department of Health.

The Victorian Sentinel Practices Research Network is supported by the Victorian Government Department of Health and Human Services.

Chile: We thank Patricia Bustos, Winston Andrade and Alejandra Acevedo, Sección de Virus Respiratorios y Exantematicos, Instituto de Salud Publica de Chile; Olga López, Hospital Ernesto Torres Galdames, Iquique; Miriam Blanco, Hospital Gustavo Fricke, Viña del Mar; Alejandra Céspedes, Hospital San Juan de Dios, Santiago; Marta Werner, Hospital Guillermo Grant Benavente, Concepción; Tania Campos, Hospital Regional de Temuco; Camila Bolados, Hospital Regional de Puerto Montt; Miguel Angel Descalzo, WHO/PAHO consultant.

New Zealand: We thank Jacqui Ralston, Wendy Gunn and Jessica Danielecz at the Institute of Environmental Science and Research, Wellington.

South Africa: We would like to acknowledge clinicians who participate in the Viral Watch influenza surveillance network and the Netcare Hospital Group for data on patient consultations.

Ethical statements

Australia: Data were collected, used and reported under the legislative authorisation of the Australian state and territory legislation, and thus did not require Human Research Ethics Committee approval.

Chile: The institutional review boards at the Pan American Health Organization and United States CDC reviewed the protocol and considered it a vaccination effectiveness evaluation (non-intervention study). Monitoring vaccine effectiveness in Chile is an objective of severe acute respiratory surveillance; thus, ethics committee approval was not needed for data collection and analysis. We did not collect personal identifiers.

New Zealand: Influenza surveillance in New Zealand is conducted in accordance with the Public Health Act and thus ethics committee approval was not needed for collection or use of these data.

South Africa: Influenza surveillance is conducted in accordance with the Public Health Act and thus ethics committee approval was not needed for collection or use of these data.

Conflict of interest: CC received grant funding to the institute from Sanofi Pasteur, Programme for Applied Technologies in Health and United States Centers for Disease Control and Prevention, and travel funding from Parexel.

AvG has received research funding to the institute from Sanofi and Pfizer, and reimbursement of travel expenses from Sanofi and Pfizer.

Authors’ contributions: All authors contributed text or data to the draft, interpreted results, and approved the final version of the manuscript. SGS coordinated the study, prepared the first draft and managed all revisions; KSC manages VicSPIN, MBMC manages ASPREN and both contributed data; SGS performed VE estimation for ILI surveillance; ACC conceived the study, contributed data, information and VE estimates for FluCAN, and contributed to development of the manuscript; SGS, VKYL, HP and YMD coordinated receipt of viruses for characterisation at the WHOCCRRI; YMD managed sequencing of viruses in Melbourne.

VS is coordinator for VE estimation in Chile and provided information about SARI surveillance and VE estimates; MFO manages SARI surveillance and with NV provided validated data from SARI surveillance; CG manages the national immunisation program and with PBur, provided information about vaccination; RAF and PBus managed virological surveillance activities; NEO and CSA provided support to the VE network in Chile and aided in drafting the manuscript.

QSH directs the National Influenza Centre in New Zealand, TW provided epidemiological data and VE estimates and both contributed to descriptions about influenza surveillance in New Zealand; AM, LL and TW managed surveillance data; JB and LJ were responsible for influenza testing and laboratory analyses of samples sent to ESR as part of the influenza surveillance program.

JMM, CC, OH, AvG and SW contributed surveillance data and VE estimates for South Africa, and provided relevant text and information during development of the draft. ST provided expert advice on surveillance VE estimation and contributed to developing the draft.

References

  • 1. Paules CI, Sullivan SG, Subbarao K, Fauci AS. Chasing Seasonal Influenza - The Need for a Universal Influenza Vaccine. N Engl J Med. 2018;378(1):7-9. 10.1056/NEJMp1714916 [DOI] [PubMed] [Google Scholar]
  • 2. Sullivan SG, Chilver MB, Carville KS, Deng YM, Grant KA, Higgins G, et al. Low interim influenza vaccine effectiveness, Australia, 1 May to 24 September 2017. Euro Surveill. 2017;22(43). 10.2807/1560-7917.ES.2017.22.43.17-00707 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Cheng AC, Holmes M, Dwyer DE, Irving L, Korman T, Senenayake S, et al. Influenza epidemiology in patients admitted to sentinel Australian hospitals in 2016: the Influenza Complications Alert Network (FluCAN). Commun Dis Intell Q Rep. 2017;41(4):E337-47. [PubMed] [Google Scholar]
  • 4. Sotomayor V, Fasce RA, Vergara N, De la Fuente F, Loayza S, Palekar R. Estimating the burden of influenza-associated hospitalizations and deaths in Chile during 2012-2014. Influenza Other Respir Viruses. 2018;12(1):138-45. 10.1111/irv.12502 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Bissielo A, Pierse N, Huang QS, Thompson MG, Kelly H, Mishin VP, et al. Effectiveness of seasonal influenza vaccine in preventing influenza primary care visits and hospitalisation in Auckland, New Zealand in 2015: interim estimates. Euro Surveill. 2016;21(1):30101. 10.2807/1560-7917.ES.2016.21.1.30101 [DOI] [PubMed] [Google Scholar]
  • 6. Tempia S, Walaza S, Moyes J, Cohen AL, McMorrow ML, Treurnicht FK, et al. Quantifying How Different Clinical Presentations, Levels of Severity, and Healthcare Attendance Shape the Burden of Influenza-associated Illness: A Modeling Study From South Africa. Clin Infect Dis. 2019;69(6):1036-48. 10.1093/cid/ciy1017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Kyeyagalire R, Tempia S, Cohen AL, Smith AD, McAnerney JM, Dermaux-Msimang V, et al. Hospitalizations associated with influenza and respiratory syncytial virus among patients attending a network of private hospitals in South Africa, 2007-2012. BMC Infect Dis. 2014;14(1):694. 10.1186/s12879-014-0694-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. McAnerney JM, Walaza S, Tempia S, Blumberg L, Treurnicht FK, Madhi SA, et al. Estimating vaccine effectiveness in preventing laboratory-confirmed influenza in outpatient settings in South Africa, 2015. Influenza Other Respir Viruses. 2017;11(2):177-81. 10.1111/irv.12436 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Vega T, Lozano JE, Meerhoff T, Snacken R, Beauté J, Jorgensen P, et al. Influenza surveillance in Europe: comparing intensity levels calculated using the moving epidemic method. Influenza Other Respir Viruses. 2015;9(5):234-46. 10.1111/irv.12330 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Sullivan SG, Feng S, Cowling BJ. Potential of the test-negative design for measuring influenza vaccine effectiveness: a systematic review. Expert Rev Vaccines. 2014;13(12):1571-91. 10.1586/14760584.2014.966695 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21(11):1539-58. 10.1002/sim.1186 [DOI] [PubMed] [Google Scholar]
  • 12. Leung VK, Cowling BJ, Feng S, Sullivan SG. Concordance of interim and final estimates of influenza vaccine effectiveness: a systematic review. Euro Surveill. 2016;21(16):30202. 10.2807/1560-7917.ES.2016.21.16.30202 [DOI] [PubMed] [Google Scholar]
  • 13. Krzywinski M, Altman N. Points of significance: Importance of being uncertain. Nat Methods. 2013;10(9):809-10. 10.1038/nmeth.2613 [DOI] [PubMed] [Google Scholar]
  • 14. Greenland S. Small-sample bias and corrections for conditional maximum-likelihood odds-ratio estimators. Biostatistics. 2000;1(1):113-22. 10.1093/biostatistics/1.1.113 [DOI] [PubMed] [Google Scholar]
  • 15. Mannino S, Villa M, Apolone G, Weiss NS, Groth N, Aquino I, et al. Effectiveness of adjuvanted influenza vaccination in elderly subjects in northern Italy. Am J Epidemiol. 2012;176(6):527-33. 10.1093/aje/kws313 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Belongia EA, Skowronski DM, McLean HQ, Chambers C, Sundaram ME, De Serres G. Repeated annual influenza vaccination and vaccine effectiveness: review of evidence. Expert Rev Vaccines. 2017;16(7):723-26. 10.1080/14760584.2017.1334554 [DOI] [PubMed] [Google Scholar]

Articles from Eurosurveillance are provided here courtesy of European Centre for Disease Prevention and Control

RESOURCES