Skip to main content
Influenza and Other Respiratory Viruses logoLink to Influenza and Other Respiratory Viruses
. 2019 Dec 3;14(2):105–110. doi: 10.1111/irv.12705

Coordinating the real‐time use of global influenza activity data for better public health planning

Matthew Biggerstaff 1, Fredrick Scott Dahlgren 1, Julia Fitzner 2, Dylan George 3, Aspen Hammond 2, Ian Hall 4, David Haw 5, Natsuko Imai 5, Michael A Johansson 6, Sarah Kramer 7, James M McCaw 8,9, Robert Moss 8, Richard Pebody 10, Jonathan M Read 11, Carrie Reed 1, Nicholas G Reich 12, Steven Riley 5,, Katelijn Vandemaele 2,, Cecile Viboud 13, Joseph T Wu 14
PMCID: PMC7040973  PMID: 32096594

Abstract

Health planners from global to local levels must anticipate year‐to‐year and week‐to‐week variation in seasonal influenza activity when planning for and responding to epidemics to mitigate their impact. To help with this, countries routinely collect incidence of mild and severe respiratory illness and virologic data on circulating subtypes and use these data for situational awareness, burden of disease estimates and severity assessments. Advanced analytics and modelling are increasingly used to aid planning and response activities by describing key features of influenza activity for a given location and generating forecasts that can be translated to useful actions such as enhanced risk communications, and informing clinical supply chains. Here, we describe the formation of the Influenza Incidence Analytics Group (IIAG), a coordinated global effort to apply advanced analytics and modelling to public influenza data, both epidemiological and virologic, in real‐time and thus provide additional insights to countries who provide routine surveillance data to WHO. Our objectives are to systematically increase the value of data to health planners by applying advanced analytics and forecasting and for results to be immediately reproducible and deployable using an open repository of data and code. We expect the resources we develop and the associated community to provide an attractive option for the open analysis of key epidemiological data during seasonal epidemics and the early stages of an influenza pandemic.

Keywords: forecasting, incidence, influenza


Influenza infection causes substantial morbidity and mortality every year in populations worldwide,1 and occasional pandemics have the potential to cause far greater health impacts.2 The primary data sources used to track influenza are public health surveillance systems that report clinical visits for influenza‐like syndromes (including influenza‐like illness (ILI), acute respiratory infections (ARI) and severe acute respiratory infections (SARI)) during a given week and the numbers of positive virological tests for specific types and subtypes.3 Globally, the World Health Organization (WHO) curates two large public databases of syndromic case counts (FluID,4 since 2009) and virologically confirmed influenza infection (Flunet,5 since 1997), with timely and robust data for many countries (Figure 1).

Figure 1.

Figure 1

Influenza‐like‐illness (ILI) data from the FluID database. Weekly scaled rates of ILI since 2010 for all countries that have reported for at least 50% of weeks, from FluID database. For each country, ILI was rescaled by removing the mean and dividing by the variance. Colours represent the intensity of ILI activity from low (yellow) to high (red). Colours are based on the percentile of the distribution of scaled ILI (see above colour bar for values), with white representing lack of reporting. This plot can be reproduced by evaluating the R script “launch_figure.r” in the directory “notes” in the group code repository.30

Health planners must anticipate year‐to‐year and week‐to‐week variation in influenza activity when planning for and responding to pandemics or seasonal epidemics. For example, advanced analytics and modelling have been used to help inform pandemic planning6, 7, 8 and response.9, 10, 11 Also, retrospective analyses using data from surveillance systems and other studies have illuminated important features about the transmission dynamics of influenza, including the characterization of spatial incidence patterns,12, 13 planning for the optimal use of seasonal vaccines,14 early analyses of household transmission15 and global spatial spread.16

In addition, since the 2009 pandemic,17 quantitative models have been used to forecast seasonal influenza activity in real time. The field has grown rapidly18 from early retrospective studies19 to a large network of groups prospectively forecasting US influenza activity each year as part of a competition run by the US Centers for Disease Control and Prevention (CDC) to forecast the time of season onset, time of peak, intensity of peak and near‐term incidence.20 A number of different techniques are used in the competition including crowd‐sourced expert judgement forecasts,21, 22 mechanistic models,19 machine learning23 and statistical models.24 Also, different approaches can be combined into a single ensemble.25

However, despite this success in translating influenza surveillance data into actionable forecasts and a number of forecasting studies from other locations (eg Refs26, 27), there are currently no real‐time efforts to apply advanced analytics to influenza data at a global scale. Also, most public health agencies do not have resident expertise in advanced analytics such as infectious disease forecasting, nor the expertise to interpret those results. Accessing analytical capacity from within this group represents a resource for public health agencies. Generating actionable results from advanced analytics at local and global scales could provide unique insights for managing the consequences of seasonal and pandemic influenza.

Here, we describe the formation of the Influenza Incidence Analytics Group (IIAG), an informal WHO coordinated global effort to apply advanced analytics and modelling to these data in real‐time and thus provide additional insights to WHO Member States who report the data to WHO. The WHO IIAG network includes academics and public health officials from national, regional and global organizations. We organise regular open conference calls and maintain a repository with up‐to‐date global incidence data, accompanying housekeeping code, and initial analytical tools.

Our objective is to systematically couple data to analytical tools to improve the data and analytical capabilities where possible and, most importantly, to increase the quality of actionable real‐time influenza information available to public health institutions and organizations worldwide. With strong movements for both open data and open scientific code, we aim to gather both initiatives together to help create a community of investigators, developers and consumers of analysis.

The WHO IIAG teleconference calls have provided a forum for the exchange of ideas, identifying challenges and potential solutions between WHO staff, country public health practitioners and academic groups working on the advanced analytics and modelling of influenza. WHO staff and country representatives have presented current data and outlined specific questions of interest. In response, analytical and modelling groups have presented related works in progress and model‐derived forecasts based on the available WHO data. The frequent structured interactions between these communities have led to greater awareness and use of advanced analytics and modelling among public health experts, and greater understanding among the academic analytical community of public health challenges.

Analyses are presented and discussed. WHO staff report global patterns of incidence and issues emerging from different Members States, such as lower‐than‐ or higher‐than‐expected incidence for the time of year or unusual age patterns in reported cases. Individual countries can then present their own data and analyses; examples have included forecasting results from England and Wales, the United States (Figure 2A) and Australia (Figure 2B). We also have global analyses that have been undertaken using mechanistic models and publicly available WHO data (Figure 2C, Ref28).

Figure 2.

Figure 2

Examples of influenza forecasting results for the United States (A), Australia (B) and Europe (C). A, Forecast made for week 49, 2018 for national percentage of outpatient visits in the United States that would be for influenza‐like illness for the following 4 wks. Based on results from multiple groups.25 B, Forecasts of the number of laboratory‐confirmed influenza cases in Melbourne made on 2nd September 2018 (blue), with pre‐season “prior” forecast based also on data from previous seasons (brown, made 8th July 2018)35 (C) Real‐time forecast accuracy for 36 European countries during the 2017‐18 influenza season.28 Plots show the proportion of forecasts that accurately predicted peak timing within 1 week of the observed value (red) and that accurately predicted peak intensity within 25% of the observed value (blue). The x‐axis represents the number of weeks between the week of a forecast and the predicted peak week, with positive numbers indicating that the peak is predicted to have passed. The size of the points represents the number of forecasts produced at a given predicted lead week. Dashed lines show the comparative forecast accuracy when the forecasts are run retrospectively using the data available at the end of the season

The global data sets and accompanying example code are available as publicly available repositories29, 30 (Figure 1). The data are updated weekly, and the accompanying functions allow the rapid extraction of country‐level incidence time series for both ILI and virologically confirmed influenza.

While the initiative is new and seems productive, we have faced a number of challenges thus far. Firstly, data quality is not consistent among the reporting countries nor geographically representative. Timing, completeness and frequency of data reporting are not always optimal to allow forecasting. While the number of countries reporting data to FluNet (136 in 2016) and FluID (108 in 2016) has increased substantially over the years, there is still room for improvement.

In addition, any changes to internal reporting, participating sites, case definitions, etc, may not be apparent. Therefore, the interpretation of these data often requires some knowledge of the local context and thus input from local epidemiologists and public health professionals. Since these issues add an additional layer of complexity to real‐time forecasting, we have chosen not to launch a formal forecasting challenge at this time. We seek to augment data quality by working closely with countries to encourage frequent data updates and demonstrate the utility of collecting and reporting data which could then enable a formal forecasting exercise. Such an exercise, if successful, could provide further advocacy for data quality improvement efforts.

Current efforts are only possible because of the large community of analytical scientists who are independently supported to study influenza independent of IIAG. However, we are acutely aware we are not exploiting the full value of these data and that our current momentum likely cannot be sustained without dedicated support for forecasting groups and organizing capacity. Promisingly however, the WHO meeting on Using Influenza Data for Severity Assessment (November 2018) brought together country representatives, the Pandemic Influenza Special Studies working group and IIAG to discuss how to better integrate analytical tools developed for analysis of seasonal influenza with pandemic influenza assessment. The continued communication and trust building between these groups during seasonal epidemics will be critical in the realization of the benefits of advanced analytics and modelling to inform decision‐making in the next pandemic. This network would benefit greatly from modest central resources as previously demonstrated for prior networks of analytical scientists.31, 32

The early stages of an influenza pandemic are a special case of an infectious disease outbreak:33, 34 an outbreak which is more likely to occur than other pathogen types and which is also relatively likely to result in a large epidemic. Many national influenza pandemic plans (eg United States, UK, Australia, Japan) articulate enhanced data collection protocols, the use of routine surveillance systems for non‐routine purposes, and similar, to assess pathogen characteristics such as transmissibility and severity in the early stages of the pandemic. We would expect our activities and resources to continue in the event of an influenza pandemic. We would hope to provide an attractive option for the open analysis of key epidemiological data during the first few weeks. Developing these collaborative working groups during “peacetime” (ie not in the early stages of a real pandemic) is critical to improving the ways in which advanced modelling is integrated into public health decision‐making. We articulate a strategic vision and provide a prototype technical implementation for bringing together global expertise on infectious disease surveillance and real‐time modelling. These efforts provide an important template for informing and supporting public health efforts to combat global outbreaks of infectious disease.

DISCLAIMER

The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

Biggerstaff M, Dahlgren FS, Fitzner J, et al. Coordinating the real‐time use of global influenza activity data for better public health planning. Influenza Other Respi Viruses. 2020;14:105–110. 10.1111/irv.12705

The peer review history for this article is available at https://publons.com/publon/10.1111/irv.12705.

Funding information

We acknowledge the following funders: SK—US National Institutes of Health (GM110748 and T32ES023770); SR—Wellcome Trust (200861/Z/16/Z, 200187/Z/15/Z), Medical Research Council (UK, MR/R015600/1), National Institute for Health Research (UK, Health Protection Research Unit funding).

Contributor Information

Steven Riley, Email: s.riley@imperial.ac.uk.

Katelijn Vandemaele, Email: vandemaelek@who.int.

REFERENCES

  • 1. Iuliano AD, Roguski KM, Chang HH, et al. Estimates of global seasonal influenza‐associated respiratory mortality: a modelling study. Lancet. 2018;391(10127):1285‐1300. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Olson DR, Simonsen L, Edelson PJ, Morse SS. Epidemiological evidence of an early wave of the 1918 influenza pandemic in New York City. Proc Natl Acad Sci USA. 2005;102(31):11059‐11063. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Fleming DM, Elliot AJ. Lessons from 40 years’ surveillance of influenza in England and Wales. Epidemiol Infect. 2008;136(7):866‐875. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. World Health Organization . FluID – a global influenza epidemiological data sharing platform. FluID – a global influenza epidemiological data sharing platform. https://www.who.int/influenza/surveillance_monitoring/fluid/en/. Accessed October 19, 2001.
  • 5. Flahault A, Dias‐Ferrao V, Chaberty P, Esteves K, Valleron AJ, Lavanchy D. FluNet as a tool for global monitoring of influenza on the Web. JAMA. 1998;280(15):1330‐1332. [DOI] [PubMed] [Google Scholar]
  • 6. Wu JT, Riley S, Fraser C, Leung GM. Reducing the impact of the next influenza pandemic using household‐based public health interventions. Hong Kong Med J. 2006;15(9):38‐41. [PubMed] [Google Scholar]
  • 7. Halloran ME, Ferguson NM, Eubank S, et al. Modeling targeted layered containment of an influenza pandemic in the United States. Proc Natl Acad Sci USA. 2008;105(12):4639‐4644. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Cauchemez S, Valleron A‐J, Boëlle P‐Y, Flahault A, Ferguson NM. Estimating the impact of school closure on influenza transmission from Sentinel data. Nature. 2008;452(7188):750‐754. [DOI] [PubMed] [Google Scholar]
  • 9. Fraser C, Donnelly CA, Cauchemez S, et al. Pandemic potential of a strain of influenza A (H1N1): early findings. Science. 2009;324(5934):1557‐1561. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Wu JT, Cowling BJ, Lau EHY, et al. School closure and mitigation of pandemic (H1N1) 2009, Hong Kong. Emerg Infect Dis. 2010;16(3):538‐541. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Moss R, McCaw JM, Cheng AC, Hurt AC, McVernon J. Reducing disease burden in an influenza pandemic by targeted delivery of neuraminidase inhibitors: mathematical models in the Australian context. BMC Infect Dis. 2016;16(1):552. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Viboud C, Bjørnstad ON, Smith DL, Simonsen L, Miller MA, Grenfell BT. Synchrony, waves, and spatial hierarchies in the spread of influenza. Science. 2006;312(5772):447‐451. [DOI] [PubMed] [Google Scholar]
  • 13. Gog JR, Ballesteros S, Viboud C, et al. Spatial transmission of 2009 pandemic influenza in the US. PLoS Comput Biol. 2014;10(6):e1003635. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Baguelin M, Flasche S, Camacho A, Demiris N, Miller E, Edmunds WJ. Assessing optimal target populations for influenza vaccination programmes: an evidence synthesis and modelling study. PLoS Med. 2013;10(10):e1001527. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Longini IM, Koopman JS. Household and community transmission parameters from final distributions of infections in households. Biometrics. 1982;38(1):115‐126. [PubMed] [Google Scholar]
  • 16. Longini IM Jr. A mathematical model for predicting the geographic spread of new infectious agents. Math Biosci. 1988;90(1–2):367‐383. [Google Scholar]
  • 17. Ong JBS, Chen M‐C, Cook AR, et al. Real‐time epidemic monitoring and forecasting of H1N1‐2009 using influenza‐like illness from general practice and family doctor clinics in Singapore. PLoS ONE. 2010;5(4):e10036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Chretien J‐P, George D, Shaman J, Chitale RA, McKenzie FE. Influenza forecasting in human populations: a scoping review. PLoS ONE. 2014;9(4):e94130. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Shaman J, Karspeck A. Forecasting seasonal outbreaks of influenza. Proc Natl Acad Sci USA. 2012;109(50):20425‐20430. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Biggerstaff M, Alper D, Dredze M, et al. Results from the centers for disease control and prevention’s predict the 2013–2014 Influenza Season Challenge. BMC Infect Dis. 2016;16:357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Farrow DC, Brooks LC, Hyun S, Tibshirani RJ, Burke DS, Rosenfeld R. A human judgment approach to epidemiological forecasting. PLoS Comput Biol. 2017;13(3):e1005248. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Polgreen PM, Nelson FD, Neumann GR, Weinstein RA. Use of prediction markets to forecast infectious disease activity. Clin Infect Dis. 2007;44(2):272‐279. [DOI] [PubMed] [Google Scholar]
  • 23. Allen C, Tsou M‐H, Aslam A, Nagel A, Gawron J‐M. Applying GIS and machine learning methods to twitter data for multiscale surveillance of influenza. PLoS ONE. 2016;11(7):e0157734. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Brooks LC, Farrow DC, Hyun S, Tibshirani RJ, Rosenfeld R. Flexible modeling of epidemics with an empirical Bayes framework. PLoS Comput Biol. 2015;11(8):e1004382. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Reich NG, Brooks LC, Fox SJ, et al. A collaborative multiyear, multimodel assessment of seasonal influenza forecasting in the United States. Proc Natl Acad Sci USA. 2019;116:3146‐3154. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Kelly HA, Grant KA, Tay EL, Franklin L, Hurt AC. The significance of increased influenza notifications during spring and summer of 2010–11 in Australia. Influenza Other Respir Viruses. 2013;7(6):1136‐1141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Bloom‐Feshbach K, Alonso WJ, Charu V, et al. Latitudinal variations in seasonal activity of influenza and respiratory syncytial virus (RSV): a global comparative review. PLoS ONE. 2013;8(2):e54445. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Kramer SC, Shaman J. Development and validation of influenza forecasting for 64 temperate and tropical countries. PLoS Comput Biol. 2019;15(2):e1006742. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. World Health Organization . Influenza Incidence Analytics Group Data (WHO FluNet and FluID snapshots). July 2019. 10.5281/zenodo.3347184 [DOI]
  • 30. Riley S, Haw D, Kramer S, Yan A, Cecile V. Influenza Incidence Analytics Group Code; 2019. 10.5281/zenodo.3347178 [DOI] [Google Scholar]
  • 31. Nelson MI, Lloyd‐Smith JO, Simonsen L, et al. Fogarty International Center collaborative networks in infectious disease modeling: lessons learnt in research and capacity building. Epidemics. 2019;26:116‐127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. National Institute of General Medical Studies, USA . Models of Infectious DIsease Agent Study (MIDAS). Models of Infectious DIsease Agent Study (MIDAS). https://www.nigms.nih.gov/Research/specificareas/MIDAS/. Accessed January 23, 2019.
  • 33. Morgan O. How decision makers can use quantitative approaches to guide outbreak responses. Philos Trans R Soc Lond B Biol Sci. 2019;374(1776):20180365. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Rivers C, Chretien J‐P, Riley S, et al. Using “outbreak science” to strengthen the use of models during epidemics. Nat Commun. 2019;10(1):3102. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Moss R, Fielding JE, Franklin LJ, et al. Epidemic forecasts as a tool for public health: interpretation and (re)calibration. Aust N Z J Public Health. 2018;42:69‐76. [DOI] [PubMed] [Google Scholar]

Articles from Influenza and Other Respiratory Viruses are provided here courtesy of Wiley

RESOURCES