Public health policies are only as good as the quality of the data on which they are based. Policy decisions that are so crucial to containing an emerging pathogen are challenged by the sparsity of data on which to optimise them. The earlier, and more completely, the data can be compiled, the better the robustness of risk estimates, forecasting, and modelling. Within 3 weeks of the announcement by WHO of an anomalous cluster of severe coronavirus cases in Wuhan, China, the Johns Hopkins University (JHU) Center for Systems Science and Engineering (CSSE) launched the COVID-19 Dashboard. With the utmost transparency, Dong and colleagues1 detail the challenges faced and the solutions developed in providing a central, user-friendly database for publicly available epidemiological data compiled from over 3500 locations across 195 countries and regions. The reliable granular surveillance of reported SARS-CoV-2 cases, deaths and case fatalities, and vaccine doses administered in many instances, has provided an evidence-base for determining effective local, national, and international control measures. Methodological innovations in the data curation process proved fundamental to overcoming anomalies that arose from a myriad of sources, including the politicisation of COVID-19 risk assessments.
The JHU CSSE Dashboard was not susceptible to the same misalignment of incentives as some government officials who were more concerned about short-term economic repercussions of measures to curtail COVID-19 transmission than accurate risk evaluations. Regression analysis of country-specific death rates among 137 countries, showed that approximately 400 000 deaths were estimated to be unaccounted for during the first year of the pandemic, most likely among autocratic governments.2 During the early stages of the pandemic, the Chinese Government limited knowledge of the emerging disease and downplayed its severity.3 The Chinese Government did not allow the media to use terms like fatal and lockdown.3 Houthi rebels in Yemen relied on under-reporting cases to avoid accountability and maintain economic activity, leading to the reporting of only four COVID-19 cases and one death in the highly populated Sana'a City over the first year of the pandemic.4 Most countries report cases and deaths that are both probable and confirmed by testing. However, in Russia, only COVID-19 confirmed deaths are included in official counts, despite low supplies of PCR tests, leading to vast under-reporting of deaths.5 Similarly, some Brazilian hospitals have been implicated in the under-reporting of COVID-19 deaths in response to government pressure to avoid triggering the apparent need for lockdown measures.6 When official and aggregate sources were available, the JHU CSSE team overcame such challenges by implementing innovative anomaly detection processes and data fusion approaches in the data coalition process.
Political polarisation has threatened the reliability of data supplied by US Government agencies. The Trump White House Administration advised hospitals to send data on SARS-CoV-2 and intensive care unit capacities to a private company, bypassing the US Center for Disease Control and Prevention (CDC).7 Concerningly, a relationship was exposed between the private contractor and the Trump family's corporation.8 The switch to sending data to a private contractor led to a hiatus in publicly available data from the US CDC.9 Moreover, the transition was accompanied by sporadic updates, with many irregularities in the data and inconsistencies in the definition of metrics from the contracted private company.7 Even the appearance of such impropriety undermines public confidence in the accuracy of such data and the willingness to adhere to government recommendations regarding COVID-19 specifically and potentially to health policies more broadly. However, the objectivity of the JHU CSSE Dashboard as an independent data source remained steadfast. The data validation undertaken consisted of computational scanning for large deviations across temporal trajectories, with manual review and confirmation of any anomalies appearing in the data. For instances of anomalous spikes in data due to a backlog in reporting, the respective health agencies were contacted to correctly distribute reporting dates retrospectively. Furthermore, the data collation for the JHU CSSE Dashboard maintains consistent definitions for case and death counts (using those specified by the US CDC) and includes both probable and confirmed numbers in the overall count. As new COVID-19 variants continue to emerge, human behaviour shifts, and policies evolve, the JHU CSSE COVID-19 Dashboard will continue to be a highly informative tool for decision makers and the public alike.
Acknowledgments
We declare no competing interests.
References
- 1.Dong E, Ratcliff J, Goyea TD, et al. The Johns Hopkins University Center for Systems Science and Engineering COVID-19 Dashboard: data collection process, challenges faced, and lessons learned. Lancet Infect Dis. 2022 doi: 10.1016/S1473-3099(22)00434-0. published online Aug 31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Cassan G, Van Steenvoort M. Political regime and COVID 19 death rate: efficient, biasing or simply different autocracies? An econometric analysis. SSM Popul Health. 2021;16 doi: 10.1016/j.ssmph.2021.100912. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Zhong R, Mozur P, Kao J, Krolik A. No ‘negative’ news: how China censored the coronavirus. The New York Times. Dec 19, 2020 https://www.nytimes.com/2020/12/19/technology/china-coronavirus-censorship.html [Google Scholar]
- 4.ReliefWeb. Yemen Houthis risk civilians’ health in Covid-19 [EN/AR] Jun 1, 2021. https://reliefweb.int/report/yemen/yemen-houthis-risk-civilians-health-covid-19-enar
- 5.Troianovski A. ‘You can't trust anyone’: Russia's hidden Covid toll is an open secret. The New York Times. April 10, 2021 https://www.nytimes.com/2021/04/10/world/europe/covid-russia-death.html [Google Scholar]
- 6.Phillips T, Milhorance F. Brazil hospital chain accused of hiding Covid deaths and giving unproven drugs. The Guardian. Sept 29, 2021 https://amp.theguardian.com/global-development/2021/sep/29/brazil-prevent-senior-hospital-chain-covid-accusations [Google Scholar]
- 7.Huang P, Simmons-Duffin S. COVID-19 hospital data system that bypasses CDC plagued by delays, inaccuracies. NPR. July 31, 2020 https://www.npr.org/sections/health-shots/2020/07/31/897429054/covid-19-hospital-data-system-that-bypasses-cdc-plagued-by-delays-inaccuracies [Google Scholar]
- 8.Temple-Raston D, Mak T. Irregularities in COVID reporting contract award process raise new questions. NPR. July 29, 2020 https://www.npr.org/2020/07/29/896645314/irregularities-in-covid-reporting-contract-award-process-raises-new-questions [Google Scholar]
- 9.Sun LH, Goldstein A. Disappearance of covid-19 data from CDC website spurs outcry. The Washington Post. July 16, 2020 https://www.washingtonpost.com/health/2020/07/16/coronavirus-hospitalization-data-outcry/ [Google Scholar]